A real-time 3D video analyzer for enhanced 3D audio–visual systems
| Autor: | Byeongmoon Jeon, Kim Kyuwoon, Joong-Ho Won, Hyunsoo Kim, Sangoh Jeong |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Computer Networks and Communications
business.industry Computer science Frame (networking) ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION 020207 software engineering 02 engineering and technology Video processing Visual processing Computer graphics Hardware and Architecture Gate array Histogram 0202 electrical engineering electronic engineering information engineering Media Technology 020201 artificial intelligence & image processing Computer vision Segmentation Artificial intelligence business Field-programmable gate array Software Information Systems |
| Zdroj: | Multimedia Systems. 26:125-137 |
| ISSN: | 1432-1882 0942-4962 |
| DOI: | 10.1007/s00530-019-00631-x |
| Popis: | With the recent advent of three-dimensional (3D) sound home theater systems (HTS), more and more TV viewers are experiencing rich, immersive auditory presence at home. In this paper, visual processing approaches are provided to make 3D audio–visual (AV) systems more realistic to the viewers. In the proposed system, a visual engine processes stereo video streams to extract a disparity map for each pair of left and right video frames. Then, the engine determines the video depth level representing each frame of the disparity map. An audio engine then gives 3D sound depth effects according to the estimated video depth, thereby making viewers’ audio–visual experiences more synchronized. Two video processing algorithms are devised to extract the video depth from each frame: one is based on object segmentation, which turns out to be too complex to be implemented in the field-programmable gate array (FPGA) employed for real-time processing; the other algorithm uses a much simpler histogram-based approach to determine the depth of each video frame, and hence, it is more suitable for FPGA implementations. Subjective listening test results support the effectiveness of the proposed approaches. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|
Full text from SpringerLink