Immersive Virtual Reality Audio Rendering Adapted to the Listener and the Room
| Autor: | Hansung Kim, Luca Remaggi, Philip J. B. Jackson, Adrian Hilton |
|---|---|
| Rok vydání: | 2020 |
| Předmět: |
050101 languages & linguistics
Computer science business.industry Audio equipment 05 social sciences ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 02 engineering and technology Convolutional neural network Rendering (computer graphics) 0202 electrical engineering electronic engineering information engineering Immersion (virtual reality) 020201 artificial intelligence & image processing 0501 psychology and cognitive sciences Computer vision Artificial intelligence business ComputingMethodologies_COMPUTERGRAPHICS |
| Zdroj: | Real VR – Immersive Digital Reality ISBN: 9783030418151 Real VR |
| Popis: | The visual and auditory modalities are the most important stimuli for humans. In order to maximise the sense of immersion in VR environments, a plausible spatial audio reproduction synchronised with visual information is essential. However, measuring acoustic properties of an environment using audio equipment is a complicated process. In this chapter, we introduce a simple and efficient system to estimate room acoustic for plausible spatial audio rendering using 360\(^{\circ }\) cameras for real scene reproduction in VR. A simplified 3D semantic model of the scene is estimated from captured images using computer vision algorithms and convolutional neural network (CNN). Spatially synchronised audio is reproduced based on the estimated geometric and acoustic properties in the scene. The reconstructed scenes are rendered with synthesised spatial audio. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|