Skip to main content

ORIGINAL RESEARCH article

Front. Cognit.
Sec. Perception
Volume 3 - 2024 | doi: 10.3389/fcogn.2024.1417011
This article is part of the Research Topic Neurocognitive Bases of Music Reading View all 3 articles

Classifying musical reading expertise by eye-movement analysis using machine learning

Provisionally accepted
  • UMR5022 Laboratoire d'Etude de l'Apprentissage et du Developpement (LEAD), Dijon, France

The final, formatted version of the article will be published soon.

    Music reading is the key to literacy for musicians in the Western music tradition. This highlevel activity requires an efficient extraction of the visual information from the score to the current needs of the execution. Differences in eye movements between expert and nonexpert musicians during music reading have been shown. The present study goes further, using a machine learning approach to classify musicians according to their level of expertise in analyzing their eye movements and performance during sight-reading. We used a Support Vector Machine (SVM) technique to 1) investigate whether the underlying expertise in musical reading could be reliably inferred from eye movements, performance and subjective measures collected across five levels of expertise and 2) determine the best predictors for classifying expertise from 24 visual measures (e.g., number of progressive fixations, number of regressive fixations, pupil size, first-pass fixations, second-pass fixations..), 10 performance measures (e.g., eye-hand span, velocity, latency, play duration, tempo, false notes), and 4 subjective measures (perceived complexity and cognitive skills). Eye movements from 68 pianists being at five different levels of music expertise (according to their level in the Conservatory of music -from 1st cycle to professional) were co-registered with their piano performance via a MIDI interface, while they sight-read classical and contemporary music scores. Results revealed relevant classification by the SVM analysis. The model optimally classified the lower levels of expertise (1, 2) compared to the higher levels (3, 4, 5) and the medium level (3) compared to higher levels (4, 5). Furthermore, the model identified across a total of 38 measures used, the four best predictors of the level of expertise: the sum of fixations by note, the number of blinks, the number of fixations and the average fixation duration. Thus, that it is possible to efficiently classify musical reading expertise from musicians' eye movements and performance, using SVM. The results have important theoretical and practical implications for music cognition and pedagogy, enhancing the specialized eye and performance behaviors required for an expert music reading.

    Keywords: sight reading, Expertise, musicians, Classification, machine learning, SVM, eyemovements

    Received: 13 Apr 2024; Accepted: 12 Aug 2024.

    Copyright: © 2024 Drai-Zerbib, Ansart, Grenot, Poulin-Charronnat, Perra and Baccino. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

    * Correspondence: Véronique Drai-Zerbib, UMR5022 Laboratoire d'Etude de l'Apprentissage et du Developpement (LEAD), Dijon, France

    Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.