Distinct and content-specific neural representations of self- and other-produced actions in joint piano performance

Natalie Kohler ^1,2 Anna M. Czepiel ^2,3 Örjan de Manzano ^2,4 Giacomo Novembre ⁵ Peter Erik Keller ^6,7 Arno Villringer ¹ Daniela Sammler ^1,2*

• ¹ Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Lower Saxony, Germany
• ² Max Planck Institute for Empirical Aesthetics, Max Planck Society, Frankfurt, Germany
• ³ University of Toronto Mississauga, Mississauga, Ontario, Canada
• ⁴ Karolinska Institutet (KI), Solna, Stockholm, Sweden
• ⁵ Italian Institute of Technology, Rome, Italy
• ⁶ Aarhus University, Aarhus, Central Denmark Region, Denmark
• ⁷ Western Sydney University, Penrith, New South Wales, Australia

During ensemble performance, musicians predict their own and their partners’ action outcomes to smoothly coordinate in real time. The neural auditory-motor system is thought to contribute to these predictions by running internal forward models that simulate self- and other-produced actions slightly ahead of time. What remains elusive, however, is whether and how own and partner actions can be represented simultaneously and distinctively in the sensorimotor system, and whether these representations are content-specific. Here, we applied multivariate pattern analysis (MVPA) to functional magnetic resonance imaging (fMRI) data of duetting pianists to dissociate the neural representation of self- and other-produced actions during synchronous joint music performance. Expert pianists played familiar right-hand melodies in a 3T MR-scanner, in duet with a partner who played the corresponding left-hand basslines in an adjacent room. In half of the pieces, pianists were motorically familiar (or unfamiliar) with their partner’s left-hand part. MVPA was applied in primary motor and premotor cortices (M1, PMC), cerebellum, and planum temporale of both hemispheres to classify which piece was performed. Classification accuracies were higher in left than right M1, reflecting the content-specific neural representation of self-produced right-hand melodies. Notably, PMC showed the opposite lateralization, with higher accuracies in the right than left hemisphere, likely reflecting the content-specific neural representation of other-produced left-hand basslines. Direct physiological support for the representational alignment of partners’ M1 and PMC should be gained in future studies using novel tools like interbrain representational similarity analyses. Surprisingly, motor representations in PMC were similarly precise irrespective of familiarity with the partner’s part. This suggests that expert pianists may generalize contents of familiar actions to unfamiliar pieces with similar musical structure, based on the auditory perception of the partner’s part. Overall, these findings support the notion of parallel, distinct, and content-specific self and other internal forward models that are integrated within cortico-cerebellar auditory-motor networks to support smooth coordination in musical ensemble performance and possibly other forms of social interaction.