Real-Time Streaming of Sequential Volumetric Data for Augmented Reality Synchronized with Broadcast Video

Autor: Yuki Kawamura, Hiroyasu Nagata, Koichiro Imamura, Yuki Yamakami
Rok vydání: 2019
Předmět:
Zdroj: ICCE-Berlin
Popis: Commercial 4K/8K satellite broadcasting began in Japan in December 2018. It has been said that 8K video will be the ultimate two-dimensional (2D) video medium, and one of next challenges for future digital media technologies will be to deliver three-dimensional (3D) information. Augmented reality (AR) is attracting increasing attention, but its expressiveness and visual quality are still limited. We have previously proposed a new viewing style where viewers watch 2D video on a television while simultaneously experiencing 3D AR content on a second-display device. In this paper, we describe a system for real-time streaming of sequential volumetric data to provide AR content on second-display devices. To synchronize the video and AR presentations, we utilize the coordinated-universal-time-based presentation timestamps provided by MPEG media transport (MMT), which is the internet-protocol-based media transport scheme adopted for the 4K/8K broadcasting. We evaluate our system’s inter-device synchronization function by transmitting volumetric data and video, captured simultaneously in a volumetric capture studio.
Databáze: OpenAIRE