Foveated Encoding for Large High-Resolution Displays
| Autor: | Florian Friess, Valentin Bruder, Guido Reina, Thomas Ertl, Matthias Braun, Steffen Frey |
|---|---|
| Přispěvatelé: | Scientific Visualization and Computer Graphics, Robotics and image-guided minimally-invasive surgery (ROBOTICS) |
| Jazyk: | angličtina |
| Rok vydání: | 2021 |
| Předmět: |
Visual acuity
Computer science business.industry Macroblock ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 020207 software engineering 02 engineering and technology Computer Graphics and Computer-Aided Design Gaze Rendering (computer graphics) Visualization Data visualization Foveal Signal Processing 0202 electrical engineering electronic engineering information engineering medicine Computer vision Computer Vision and Pattern Recognition Artificial intelligence medicine.symptom business Encoder Software |
| Zdroj: | IEEE Transactions on Visualization and Computer Graphics, 27(2), 1850-1859. IEEE COMPUTER SOC |
| ISSN: | 1077-2626 |
| Popis: | Collaborative exploration of scientific data sets across large high-resolution displays requires both high visual detail as well as low-latency transfer of image data (oftentimes inducing the need to trade one for the other). In this work, we present a system that dynamically adapts the encoding quality in such systems in a way that reduces the required bandwidth without impacting the details perceived by one or more observers. Humans perceive sharp, colourful details, in the small foveal region around the centre of the field of view, while information in the periphery is perceived blurred and colourless. We account for this by tracking the gaze of observers, and respectively adapting the quality parameter of each macroblock used by the H.264 encoder, considering the so-called visual acuity fall-off. This allows to substantially reduce the required bandwidth with barely noticeable changes in visual quality, which is crucial for collaborative analysis across display walls at different locations. We demonstrate the reduced overall required bandwidth and the high quality inside the foveated regions using particle rendering and parallel coordinates. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|