Gesture Analysis of Violin Bow Strokes

Autor: Nicolas Rasamimanana, Frédéric Bevilacqua, Emmanuel Fléty
Přispěvatelé: Equipe Interactions musicales temps-réel, Sciences et Technologies de la Musique et du Son (STMS), Institut de Recherche et Coordination Acoustique/Musique (IRCAM)-Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS)-Institut de Recherche et Coordination Acoustique/Musique (IRCAM)-Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS), Equipe Autre (hors R&D), Springer Berlin / Heidelberg, Sylvie Gibet, Nicolas Courty, Jean-François Kamp
Rok vydání: 2006
Předmět:
Musical notation
Engineering
Speech recognition
[INFO.INFO-OH]Computer Science [cs]/Other [cs.OH]
ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION
050105 experimental psychology
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
060404 music
violin
Violin
Acceleration
[INFO.INFO-TS]Computer Science [cs]/Signal and Image Processing
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]
Spiccato
[INFO]Computer Science [cs]
0501 psychology and cognitive sciences
Computer vision
[INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]
[SHS.MUSIQ]Humanities and Social Sciences/Musicology and performing arts
business.industry
05 social sciences
[INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM]
[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
Gesture Analysis
06 humanities and the arts
[INFO.INFO-IA]Computer Science [cs]/Computer Aided Engineering
Linear discriminant analysis
augmented instruments
ComputingMethodologies_PATTERNRECOGNITION
Martelé
Dynamics (music)
[INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD]
Bow Strokes
Artificial intelligence
business
[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
0604 arts
Gesture
Zdroj: Lecture Notes in Computer Science ISBN: 9783540326243
Gesture Workshop
Lecture Notes in Computer Science, Vol. 3881, Gesture in Human-Computer Interaction and Simulation: 6th International Gesture Workshop, GW 2005, Berder Island, France, May 18-20, 2005, Revised Selected Papers
Springer Berlin / Heidelberg; Sylvie Gibet, Nicolas Courty, Jean-François Kamp. Lecture Notes in Computer Science, Vol. 3881, Gesture in Human-Computer Interaction and Simulation: 6th International Gesture Workshop, GW 2005, Berder Island, France, May 18-20, 2005, Revised Selected Papers, pp.145-155, 2006
Popis: cote interne IRCAM: Rasamimanana06a; None / None; National audience; We developed an ”augmented violin”, i.e. an acoustic instrument with added gesture capture capabilities to control electronic processes. We report here gesture analysis we performed on three different bow strokes, detache, martele and spiccato, using this augmented violin. Different features based on velocity and acceleration were considered. A linear discriminant analysis has been performed to estimate a minimum number of pertinent features necessary to model these bow stroke classes. We found that the maximum and minimum accelerations of a given stroke were efficient to parameterize the different bow stroke types, as well as differences in dynamics playing. Recognition rates were estimated using a kNN method with various training sets. We finally discuss that bow stroke recognition allows to relate the gesture data to music notation, while a bow stroke continuous parameterization can be related to continuous sound characteristics.
Databáze: OpenAIRE