An automated structural approach to support theatrical performances by introducing gesture recognition to a cuing system
| Autor: | Wolfram Luther, Kosuke Sasaki, Anne-Catherine Luther, Tomoo Inoue |
|---|---|
| Jazyk: | angličtina |
| Rok vydání: | 2019 |
| Předmět: |
Statement (computer science)
050101 languages & linguistics Computer science Process (engineering) Movement (music) Feature vector media_common.quotation_subject 05 social sciences 02 engineering and technology Informatik Proof of concept Gesture recognition Human–computer interaction 0202 electrical engineering electronic engineering information engineering 020201 artificial intelligence & image processing 0501 psychology and cognitive sciences Function (engineering) Gesture media_common |
| Zdroj: | Collaboration Technologies and Social Computing ISBN: 9783030280109 CRIWG/CollabTech |
| Popis: | In this article, we explain how to process and interpret stage directions in order to support actors’ performances. To this end, we specify the function of coverbal gesture and movement as an additional statement by an actor. We introduce a classification of communicative gestures by individuals and groups based on a description with typical body triangles and their sensor-detectable vertices moving in time. We claim that with the help of a speech and gesture recognition system, the occurrence of semantic isotopies to characterize a scene with speech and accompanying metaphoric gestures described in the stage directions can be detected and encoded in a feature vector. As a proof of concept, we highlight the ritual theater play Orphee d’Afrique, which was written as a second part of a homonymous chant novel and presents an implementation of a gesture- and voice-detection cuing system. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|