Interactive sonification of synchronisation of motoric behaviourin social active listening to music with mobile devices

Autor: Vesa Välimäki, Jari Kleimola, Antonio Camurri, Marco Fabiani, Gaël Dubus, Giovanna Varni, Gualtiero Volpe, Sami Oksanen, Roberto Bresin
Jazyk: angličtina
Rok vydání: 2012
Předmět:
Computer science
Sound and music computing
synchronisation
02 engineering and technology
computer.software_genre
Interactive systems
Medieteknik
050105 experimental psychology
Rhythm
Synchronisation
0202 electrical engineering
electronic engineering
information engineering

Psychology
0501 psychology and cognitive sciences
Active listening
Media and Communication Technology
Audio signal
Psykologi
Multimedia
interactive systems
Computer Sciences
05 social sciences
020207 software engineering
Active music listening
Human Computer Interaction
Människa-datorinteraktion (interaktionsdesign)
interactive sonification
sound and music computing
Human-Computer Interaction
Datavetenskap (datalogi)
Sonification
active music listening
Signal Processing
Metric (mathematics)
audio systems
Mobile device
computer
Audio systems
Interactive sonification
Gesture
Zdroj: Aalto University
Popis: This paper evaluates three different interactive sonifications of dyadic coordinated human rhythmic activity. An index of phase synchronisation of gestures was chosen as coordination metric. The sonifications are implemented as three prototype applications exploiting mobile devices: Sync’n’Moog, Sync’n’Move, and Sync’n’Mood. Sync’n’Moog sonifies the phase synchronisation index by acting directly on the audio signal and applying a nonlinear time-varying filtering technique. Sync’n’Move intervenes on the multi-track music content by making the single instruments emerge and hide. Sync’n’Mood manipulates the affective features of the music performance. The three sonifications were also tested against a condition without sonification. QC 20150623 SAME
Databáze: OpenAIRE