Download available

Authors:

Florian Grond, Thomas Hermann, Vincent Verfaille, Marcelo M. Wanderley

Publication or Conference Title:

Gestures in Embodied Communication and Human-Computer Interaction - 8th International Gesture Workshop, GW 2009, Bielefeld, Germany, February 2009, Revised Selected Papers. LNAI 5934

Editors:

Stefan Kopp, Ipke Wachsmuth

Abstract:

We present the implementation of two different sonification methods of ancillary gestures from clarinetists. The sonifications are data driven from the clarinetist’s posture which is captured with a VICON motion tracking system. The first sonification method is based on the velocities of the tracking markers, the second method involves a principal component analysis as a data preprocessing step. Further we develop a simple complementary visual display with a similar information content to match the sonification. The effect of the two sonifications with respect to the movement perception is studied in an experiment where test subjects annotate the clarinetists performance represented by various combinations of the resulting uni- and multimodal displays.

Publication Details:

Type:	Conference Paper
Date:	06/01/2010
Pages:	171-181