Stereo Vision Based Sensory Substitution for the Visually Impaired

Autor: Paul Herghelegiu, Simona Caraiman, Otilia Zvoristeanu, Adrian Burlacu
Rok vydání: 2019
Předmět:
Computer science
Visual impairment
visual impairment
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
Wearable computer
Context (language use)
02 engineering and technology
lcsh:Chemical technology
01 natural sciences
Biochemistry
Article
Analytical Chemistry
User-Computer Interface
Wearable Electronic Devices
obstacle detection
Artificial Intelligence
Human–computer interaction
Orientation
0202 electrical engineering
electronic engineering
information engineering
medicine
Humans
lcsh:TP1-1185
3D reconstruction
Electrical and Electronic Engineering
Instrumentation
Vision
Ocular
Haptic technology
business.industry
010401 analytical chemistry
Usability
sensory substitution
stereo vision
Atomic and Molecular Physics
and Optics
0104 chemical sciences
Stereopsis
Sensory substitution
Sensory Aids
020201 artificial intelligence & image processing
medicine.symptom
business
Visually Impaired Persons
Structured light
Zdroj: Sensors
Volume 19
Issue 12
Sensors (Basel, Switzerland)
Sensors, Vol 19, Iss 12, p 2771 (2019)
ISSN: 1424-8220
DOI: 10.3390/s19122771
Popis: The development of computer vision based systems dedicated to help visually impaired people to perceive the environment, to orientate and navigate has been the main research subject of many works in the recent years. A significant ensemble of resources has been employed to support the development of sensory substitution devices (SSDs) and electronic travel aids for the rehabilitation of the visually impaired. The Sound of Vision (SoV) project used a comprehensive approach to develop such an SSD, tackling all the challenging aspects that so far restrained the large scale adoption of such systems by the intended audience: Wearability, real-time operation, pervasiveness, usability, cost. This article is set to present the artificial vision based component of the SoV SSD that performs the scene reconstruction and segmentation in outdoor environments. In contrast with the indoor use case, where the system acquires depth input from a structured light camera, in outdoors SoV relies on stereo vision to detect the elements of interest and provide an audio and/or haptic representation of the environment to the user. Our stereo-based method is designed to work with wearable acquisition devices and still provide a real-time, reliable description of the scene in the context of unreliable depth input from the stereo correspondence and of the complex 6 DOF motion of the head-worn camera. We quantitatively evaluate our approach on a custom benchmarking dataset acquired with SoV cameras and provide the highlights of the usability evaluation with visually impaired users.
Databáze: OpenAIRE
Externí odkaz:
Nepřihlášeným uživatelům se plný text nezobrazuje