Navigating from a Depth Image Converted into Sound

Autor: Denis Pellerin, David Alleysson, Chloé Stoll, Christian Graff, Richard Palluel-Germain, Vincent Fristot
Přispěvatelé: Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Laboratoire de Psychologie et NeuroCognition (LPNC), Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Joseph Fourier - Grenoble 1 (UJF)-Université Savoie Mont Blanc (USMB [Université de Savoie] [Université de Chambéry]), GIPSA - Architecture, Géométrie, Perception, Images, Gestes (GIPSA-AGPIG), Département Images et Signal (GIPSA-DIS), Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Grenoble Images Parole Signal Automatique (GIPSA-lab), Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS)-Université Pierre Mendès France - Grenoble 2 (UPMF)-Université Stendhal - Grenoble 3-Université Joseph Fourier - Grenoble 1 (UJF)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP )-Centre National de la Recherche Scientifique (CNRS), Pôle Grenoble Cognition, SFR Santé-Société, ANR-12-JSH2-0008,CONSTRAINTPERCEPT,Intégration des Contraintes physiques et sociales dans la Perception visuelle de l'Espace(2012), ANR-11-LABX-0025,PERSYVAL-lab,Systemes et Algorithmes Pervasifs au confluent des mondes physique et numérique(2011)
Jazyk: angličtina
Rok vydání: 2015
Předmět:
Zdroj: Applied Bionics and Biomechanics, Vol 2015 (2015)
Applied Bionics and Biomechanics
Applied Bionics and Biomechanics, Hindawi, 2015, 2015, pp.ID 543492. ⟨10.1155/2015/543492⟩
ISSN: 1176-2322
1754-2103
DOI: 10.1155/2015/543492
Popis: Background.Common manufactured depth sensors generate depth images that humans normally obtain from their eyes and hands. Various designs converting spatial data into sound have been recently proposed, speculating on their applicability as sensory substitution devices (SSDs).Objective.We tested such a design as a travel aid in a navigation task.Methods.Our portable device (MeloSee) converted 2D array of a depth image into melody in real-time. Distance from the sensor was translated into sound intensity, stereo-modulated laterally, and the pitch represented verticality. Twenty-one blindfolded young adults navigated along four different paths during two sessions separated by one-week interval. In some instances, a dual task required them to recognize a temporal pattern applied through a tactile vibrator while they navigated.Results.Participants learnt how to use the system on both new paths and on those they had already navigated from. Based on travel time and errors, performance improved from one week to the next. The dual task was achieved successfully, slightly affecting but not preventing effective navigation.Conclusions.The use of Kinect-type sensors to implement SSDs is promising, but it is restricted to indoor use and it is inefficient on too short range.
Databáze: OpenAIRE