Embracing Less Common Evaluation Strategies for Studying User Experience in NIME



John Sullivan

Download available


P. J. Charles Reimer, Marcelo M. Wanderley

Publication or Conference Title:

Proceedings of the 2021 International Conference on New Interfaces for Musical Expression (NIME 2021)


Assessment of user experience (UX) is increasingly important in music interaction evaluation, as witnessed in previous NIME reviews describing varied and idiosyncratic evaluation strategies. This paper focuses on evaluations conducted in the last four years of NIME (2017 to 2020), compares results to previous research, and classifies evaluation types to describe how researchers approach and study UX in NIME. While results of this review confirm patterns such as the prominence of short-term, performer perspective evaluations, and the variety of evaluation strategies used, they also show that UX-focused evaluations are typically exploratory and limited to novice performers. Overall, these patterns indicate that current UX evaluation strategies do not address dynamic factors such as skill development, the evolution of the performer-instrument relationship, and hedonic and cognitive aspects of UX. To address such limitations, we discuss a number of less common tools developed within and outside of NIME that focus on dynamic aspects of UX, potentially leading to more informative and meaningful evaluation insights.

Publication Details:

Conference Paper
Shanghai, China

IDMIL Participants: