withyou—An Experimental End-to-End Telepresence System Using Video-Based Reconstruction
| Autor: | Rob Aspin, Franco Tecchia, Simon P. Campion, Allen J. Fairchild, Carl Moore, Paolo Simone Gasparello, David Roberts, John O'Hare, Tobias Duckworth |
|---|---|
| Rok vydání: | 2015 |
| Předmět: |
Teamwork
Multimedia Computer science media_common.quotation_subject 020207 software engineering Context (language use) Cohesion (computer science) Functional requirement 02 engineering and technology Interpersonal communication computer.software_genre Videoconferencing Information and Communications Technology Signal Processing 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing Electrical and Electronic Engineering Set (psychology) media_dig_tech_and_creative_econ computer media_common |
| Zdroj: | IEEE Journal of Selected Topics in Signal Processing. 9:562-574 |
| ISSN: | 1941-0484 1932-4553 |
| DOI: | 10.1109/jstsp.2015.2402635 |
| Popis: | Supporting a wide set of linked non-verbal resources remains an evergreen challenge for communication technology, limiting effectiveness in many applications. Interpersonal distance, gaze, posture and facial expression, are interpreted together to manage and add meaning to most conversations. Yet today's technologies favor some above others. This induces confusion in conversations, and is believed to limit both feelings of togetherness and trust, and growth of empathy and rapport. Solving this problem will allow technologies to support most rather than a few interactional scenarios. It is likely to benefit teamwork and team cohesion, distributed decision-making and health and wellbeing applications such as tele-therapy, tele-consultation, and isolation. We introduce withyou, our telepresence research platform. This paper describes the end-to-end system including the psychology of human interaction and how this drives requirements throughout the design and implementation. Our technology approach is to combine the winning characteristics of video conferencing and immersive collaborative virtual environments. This is to allow, for example, people walking past each other to exchange a glance and smile. A systematic explanation of the theory brings together the linked nature of non-verbal communication and how it is influenced by technology. This leads to functional requirements for telepresence, in terms of the balance of visual, spatial and temporal qualities. The first end-to-end description of withyou describes all major processes and the display and capture environment. An unprecedented characterization of our approach is given in terms of the above qualities and what influences them. This leads to non-functional requirements in terms of number and place of cameras and the avoidance of resultant bottlenecks. Proposals are given for improved distribution of processes across networks, computers, and multi-core CPU and GPU. Simple conservative estimation shows that both approaches should meet our requirements. One is implemented and shown to meet minimum and come close to desirable requirements. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|