Description:

A number of conducting gesture analysis and performance systems have been developed over the years. However, most of the previous projects either primarily concentrated on tracking tempo and amplitude indicating gestures, or implemented individual mapping techniques for expressive gestures that varied from research to research. There is a clear need for a uniform process that could be applied toward analysis of both indicative and expressive gestures.

The proposed system provides a set of tools that contain extensive functionality for identification, classification and performance with conducting gestures. Gesture recognition procedure is designed on the basis of Hidden Markov Model (HMM) process. A set of HMM tools are developed for Max/MSP software. Training and recognition procedures are applied toward both right hand beat- and amplitude- indicative gestures, and left hand expressive gestures. Continuous recognition of right-hand gestures is incorporated into a real-time gesture analysis and performance system in Eyesweb and Max/MSP/Jitter environments.

IDMIL Participants:

• Marcelo M. Wanderley
• Paul Kolesnik

Research Areas:

• Movement Analysis

Funding:

• NSERC

Publications:

• Kolesnik, P., Wanderley, M. M. (2004). Recognition, Analysis and Performance with Expressive Conducting Gestures. In Proceedings of the 2004 International Computer Music Conference (ICMC2004). Miami, FL, USA.
• Kolesnik, P., Wanderley, M. M. (2005). Implementation of the Discrete Hidden Markov Model in Max / MSP Environment. In Proceedings of the FLAIRS 2005 Conference. Miami, FL, USA.
• Kolesnik, P. (2004). Conducting Gesture Recognition, Analysis and Performance System. In M.A. Thesis, McGill University (pp. 93). Montreal, Canada.