loading1
loading2

Motion Capture of Music Performances

category

author

John Sullivan

Download available

Authors:

Marcelo M. Wanderley

Publication or Conference Title:

The Oxford Handbook of Music Performance

Editors:

Gary McPherson

Abstract:

Motion capture (mocap)—the recording of three-dimensional movement using high-accuracy systems—has become a standard research tool in the analysis of music performances in the last two decades. A variety of systems is currently available, ranging from optical, multi-camera (passive and/or active) infra-red systems and inertial systems (using orientation sensors) to electromagnetic trackers providing six degrees-of-freedom (DoF) measurement per marker/sensor. Recent advances in technology have made many of these systems more affordable, allowing access to a large research community. Music-related mocap applications include the tracking movements of solo or group, beginner, or expert performers and instruments for teaching performance skills, comparing movement strategies across performers, generating movement synthesis parameters in animation, and use in real-time music interaction. This chapter introduces the basic concepts behind motion capture, reviews the most common mocap technologies used in the study of music performance, and presents several examples of research, pedagogy, and artistic uses. Mocap of single acoustic instrument performances is reviewed, including violin, cello, piano, clarinet, timpani, and acoustic guitar, as well as examples of mocap of multiple instruments. Finally, we discuss the limitations of mocap and possible solutions to overcome them.


Publication Details:

Type:
Book Section
Date:
03/01/2022
Pages:
465–494
Publisher:
Oxford University Press
DOI:
10.1093/oxfordhb/9780190058869.013.30