EyePiano: Leveraging Gaze For Reflective Piano Learning

Paper in proceeding, 2023

Mastering skills which involve high dexterity, such as playing the piano, requires extensive guidance through personal teaching. Understanding how we can leverage data from sensor-based systems to improve the learning process, allows us to build interactive systems which effectively facilitate skill acquisition. To explore such possibilities, we developed EyePiano-a gaze-assisted tool for reflective piano playing. EyePiano guides the practice process of learning piano scores through analyzing the pianist's gaze behavior. We based the design of EyePiano on requirements identified through interviews with piano teachers and a feasibility evaluation of gaze metrics. Our system illustrates that basic gaze metrics are sufficient to predict difficult regions for students. Thus, highlighting sections of the music piece which are particularly difficult for the pianist allows EyePiano to support piano rehearsals for students. Our work showcases the feasibility of using gaze data for reflective music education, enabling effective instrument practice.