On-body multi-input indoor localization for dynamic emergency scenarios: Fusion of magnetic tracking and optical character recognition with mixed-reality display

Jason Orlosky, Takumi Toyama, Daniel Sonntag, Andras Sarkany, A. Lőrincz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

Indoor navigation in emergency scenarios poses a challenge to evacuation and emergency support, especially for injured or physically encumbered individuals. Navigation systems must be lightweight, easy to use, and provide robust localization and accurate navigation instructions in adverse conditions. To address this challenge, we combine magnetic location tracking with an optical character recognition (OCR) and eye gaze based method to recognize door plates and position related text to provide more robust localization. In contrast to typical wireless or sensor based tracking, our fused system can be used in low-lighting, smoke, and areas without power or wireless connectivity. Eye gaze tracking is also used to improve time to localization and accuracy of the OCR algorithm. Once localized, navigation instructions are transmitted directly into the user's immediate field of view via head mounted display (HMD). Additionally, setting up the system is simple and can be done with minimal calibration, requiring only a walk-through of the environment and numerical annotation of a 2D area map. We conduct an evaluation for the magnetic and OCR systems individually to evaluate feasibility for use in the fused framework.

Original languageEnglish
Title of host publication2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014
PublisherIEEE Computer Society
Pages320-325
Number of pages6
DOIs
Publication statusPublished - 2014
Event2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014 - Budapest, Hungary
Duration: Mar 24 2014Mar 28 2014

Other

Other2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014
CountryHungary
CityBudapest
Period3/24/143/28/14

Fingerprint

Optical character recognition
Navigation
Fusion reactions
Display devices
Navigation systems
Smoke
Lighting
Calibration
Sensors

Keywords

  • emergency
  • head mounted display
  • imformation presentation
  • indoor localization
  • navigation
  • tracking

ASJC Scopus subject areas

  • Software

Cite this

Orlosky, J., Toyama, T., Sonntag, D., Sarkany, A., & Lőrincz, A. (2014). On-body multi-input indoor localization for dynamic emergency scenarios: Fusion of magnetic tracking and optical character recognition with mixed-reality display. In 2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014 (pp. 320-325). [6815225] IEEE Computer Society. https://doi.org/10.1109/PerComW.2014.6815225

On-body multi-input indoor localization for dynamic emergency scenarios : Fusion of magnetic tracking and optical character recognition with mixed-reality display. / Orlosky, Jason; Toyama, Takumi; Sonntag, Daniel; Sarkany, Andras; Lőrincz, A.

2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014. IEEE Computer Society, 2014. p. 320-325 6815225.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Orlosky, J, Toyama, T, Sonntag, D, Sarkany, A & Lőrincz, A 2014, On-body multi-input indoor localization for dynamic emergency scenarios: Fusion of magnetic tracking and optical character recognition with mixed-reality display. in 2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014., 6815225, IEEE Computer Society, pp. 320-325, 2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014, Budapest, Hungary, 3/24/14. https://doi.org/10.1109/PerComW.2014.6815225
Orlosky J, Toyama T, Sonntag D, Sarkany A, Lőrincz A. On-body multi-input indoor localization for dynamic emergency scenarios: Fusion of magnetic tracking and optical character recognition with mixed-reality display. In 2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014. IEEE Computer Society. 2014. p. 320-325. 6815225 https://doi.org/10.1109/PerComW.2014.6815225
Orlosky, Jason ; Toyama, Takumi ; Sonntag, Daniel ; Sarkany, Andras ; Lőrincz, A. / On-body multi-input indoor localization for dynamic emergency scenarios : Fusion of magnetic tracking and optical character recognition with mixed-reality display. 2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014. IEEE Computer Society, 2014. pp. 320-325
@inproceedings{89949556623c41ac82887f280339e786,
title = "On-body multi-input indoor localization for dynamic emergency scenarios: Fusion of magnetic tracking and optical character recognition with mixed-reality display",
abstract = "Indoor navigation in emergency scenarios poses a challenge to evacuation and emergency support, especially for injured or physically encumbered individuals. Navigation systems must be lightweight, easy to use, and provide robust localization and accurate navigation instructions in adverse conditions. To address this challenge, we combine magnetic location tracking with an optical character recognition (OCR) and eye gaze based method to recognize door plates and position related text to provide more robust localization. In contrast to typical wireless or sensor based tracking, our fused system can be used in low-lighting, smoke, and areas without power or wireless connectivity. Eye gaze tracking is also used to improve time to localization and accuracy of the OCR algorithm. Once localized, navigation instructions are transmitted directly into the user's immediate field of view via head mounted display (HMD). Additionally, setting up the system is simple and can be done with minimal calibration, requiring only a walk-through of the environment and numerical annotation of a 2D area map. We conduct an evaluation for the magnetic and OCR systems individually to evaluate feasibility for use in the fused framework.",
keywords = "emergency, head mounted display, imformation presentation, indoor localization, navigation, tracking",
author = "Jason Orlosky and Takumi Toyama and Daniel Sonntag and Andras Sarkany and A. Lőrincz",
year = "2014",
doi = "10.1109/PerComW.2014.6815225",
language = "English",
pages = "320--325",
booktitle = "2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014",
publisher = "IEEE Computer Society",

}

TY - GEN

T1 - On-body multi-input indoor localization for dynamic emergency scenarios

T2 - Fusion of magnetic tracking and optical character recognition with mixed-reality display

AU - Orlosky, Jason

AU - Toyama, Takumi

AU - Sonntag, Daniel

AU - Sarkany, Andras

AU - Lőrincz, A.

PY - 2014

Y1 - 2014

N2 - Indoor navigation in emergency scenarios poses a challenge to evacuation and emergency support, especially for injured or physically encumbered individuals. Navigation systems must be lightweight, easy to use, and provide robust localization and accurate navigation instructions in adverse conditions. To address this challenge, we combine magnetic location tracking with an optical character recognition (OCR) and eye gaze based method to recognize door plates and position related text to provide more robust localization. In contrast to typical wireless or sensor based tracking, our fused system can be used in low-lighting, smoke, and areas without power or wireless connectivity. Eye gaze tracking is also used to improve time to localization and accuracy of the OCR algorithm. Once localized, navigation instructions are transmitted directly into the user's immediate field of view via head mounted display (HMD). Additionally, setting up the system is simple and can be done with minimal calibration, requiring only a walk-through of the environment and numerical annotation of a 2D area map. We conduct an evaluation for the magnetic and OCR systems individually to evaluate feasibility for use in the fused framework.

AB - Indoor navigation in emergency scenarios poses a challenge to evacuation and emergency support, especially for injured or physically encumbered individuals. Navigation systems must be lightweight, easy to use, and provide robust localization and accurate navigation instructions in adverse conditions. To address this challenge, we combine magnetic location tracking with an optical character recognition (OCR) and eye gaze based method to recognize door plates and position related text to provide more robust localization. In contrast to typical wireless or sensor based tracking, our fused system can be used in low-lighting, smoke, and areas without power or wireless connectivity. Eye gaze tracking is also used to improve time to localization and accuracy of the OCR algorithm. Once localized, navigation instructions are transmitted directly into the user's immediate field of view via head mounted display (HMD). Additionally, setting up the system is simple and can be done with minimal calibration, requiring only a walk-through of the environment and numerical annotation of a 2D area map. We conduct an evaluation for the magnetic and OCR systems individually to evaluate feasibility for use in the fused framework.

KW - emergency

KW - head mounted display

KW - imformation presentation

KW - indoor localization

KW - navigation

KW - tracking

UR - http://www.scopus.com/inward/record.url?scp=84901298474&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901298474&partnerID=8YFLogxK

U2 - 10.1109/PerComW.2014.6815225

DO - 10.1109/PerComW.2014.6815225

M3 - Conference contribution

AN - SCOPUS:84901298474

SP - 320

EP - 325

BT - 2014 IEEE International Conference on Pervasive Computing and Communication Workshops, PERCOM WORKSHOPS 2014

PB - IEEE Computer Society

ER -