Výsledky vyhledávání

Report

Learning Co-Speech Gesture Representations in Dialogue through Contrastive Learning: An Intrinsic Evaluation

Autor: Ghaleb, Esam, Khaertdinov, Bulat, Pouw, Wim, Rasenberg, Marlou, Holler, Judith, Özyürek, Aslı, Fernández, Raquel

Publikováno v: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI 2024)

In face-to-face dialogues, the form-meaning relationship of co-speech gestures varies depending on contextual factors such as what the gestures refer to and the individual characteristics of speakers. These factors make co-speech gesture representati

Externí odkaz: http://arxiv.org/abs/2409.10535

Zobrazit plný text záznamu

Report

MaskAnyone Toolkit: Offering Strategies for Minimizing Privacy Risks and Maximizing Utility in Audio-Visual Data Archiving

Autor: Owoyele, Babajide Alamu, Schilling, Martin, Sawahn, Rohan, Kaemer, Niklas, Zherebenkov, Pavel, Verma, Bhuvanesh, Pouw, Wim, de Melo, Gerard

This paper introduces MaskAnyone, a novel toolkit designed to navigate some privacy and ethical concerns of sharing audio-visual data in research. MaskAnyone offers a scalable, user-friendly solution for de-identifying individuals in video and audio

Externí odkaz: http://arxiv.org/abs/2408.03185

Zobrazit plný text záznamu

Report

Analysing Cross-Speaker Convergence in Face-to-Face Dialogue through the Lens of Automatically Detected Shared Linguistic Constructions

Autor: Ghaleb, Esam, Rasenberg, Marlou, Pouw, Wim, Toni, Ivan, Holler, Judith, Özyürek, Aslı, Fernández, Raquel

Conversation requires a substantial amount of coordination between dialogue participants, from managing turn taking to negotiating mutual understanding. Part of this coordination effort surfaces as the reuse of linguistic behaviour across speakers, a

Externí odkaz: http://arxiv.org/abs/2405.08546

Zobrazit plný text záznamu

Report

Leveraging Speech for Gesture Detection in Multimodal Communication

Autor: Ghaleb, Esam, Burenko, Ilya, Rasenberg, Marlou, Pouw, Wim, Toni, Ivan, Uhrig, Peter, Wilson, Anna, Holler, Judith, Özyürek, Aslı, Fernández, Raquel

Gestures are inherent to human interaction and often complement speech in face-to-face communication, forming a multimodal communication system. An important task in gesture analysis is detecting a gesture's beginning and end. Research on automatic g

Externí odkaz: http://arxiv.org/abs/2404.14952

Zobrazit plný text záznamu

Report

Co-Speech Gesture Detection through Multi-Phase Sequence Labeling

Autor: Ghaleb, Esam, Burenko, Ilya, Rasenberg, Marlou, Pouw, Wim, Uhrig, Peter, Holler, Judith, Toni, Ivan, Özyürek, Aslı, Fernández, Raquel

Gestures are integral components of face-to-face communication. They unfold over time, often following predictable movement phases of preparation, stroke, and retraction. Yet, the prevalent approach to automatic gesture detection treats the problem a

Externí odkaz: http://arxiv.org/abs/2308.10680

Zobrazit plný text záznamu