Popis: |
In this work, we present a visual and interactive performance of particles conducted by the Leap Motion, for an orchestral arrangement. A visual and gestural feedback in real-time is generated for the conductor and the audience, through the display of a set of particle emitters and the path travelled by the captured gesture. The system we have developed aims to facilitate the understanding of musical compositions for instruments groups and to emphasize the importance of the conductor when directing a musical performance. There are two types of data inputs: the gestures captured from the hands of the conductor (universal movements, typical of the duple, triple and quadruple measures), which are responsible for setting the tempo and dynamics of the orchestra, and a MIDI file, which defines which notes each musical instrument should play, containing information about the score of an orchestral arrangement. Groups of particle emitters represent the orchestra families. The particles appearance is defined by the MIDI musical elements and by the gestural performance of the user. Regarding the gestural input of the conductor, we considered two musical elements of expression: time and dynamics. Moreover, functional tests were conducted and performance analyzes were performed, focusing on the occurrence of false positives, false negatives, positional deviations and latency. |