AUTHOR=Ehninger Julia , Knigge Jens , Rolle Christian 

TITLE=Why are certain items more difficult than others in a competency test for music–related argumentation?

JOURNAL=Frontiers in Education

VOLUME=7

YEAR=2022

URL=https://www.frontiersin.org/journals/education/articles/10.3389/feduc.2022.1013841

DOI=10.3389/feduc.2022.1013841

ISSN=2504-284X

ABSTRACT=<p>This paper examines why certain items in a competency test for music-related argumentation are more difficult than others. Based on previous studies on school-related achievement tests, the authors assume that differences in item difficulty are related to different item characteristics or combinations of characteristics. In this study, the item characteristics of a test for music-related argumentation were first identified and coded. Three domains were identified as contributing to item difficulty: cognitive requirements, knowledge, and formal item features. Second, multiple linear regression analyses were conducted with the item characteristics as predictors of item difficulty, which had been estimated in a prior study. A comparison of three regression models confirmed that the model holding four predictors of the domain “cognitive requirements” best fit the study data<inline-formula><mml:math id="M1" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:msup><mml:msub><mml:mi>R</mml:mi><mml:mrow><mml:mi>a</mml:mi><mml:mi>d</mml:mi><mml:mi>j</mml:mi></mml:mrow></mml:msub><mml:mn>2</mml:mn></mml:msup><mml:mo>=</mml:mo><mml:mn>0.71</mml:mn><mml:mtext>.</mml:mtext></mml:math></inline-formula> The strongest predictor in the final model was “reference to musical attributes” <inline-formula><mml:math id="M2" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mfenced open="(" close=")"><mml:mrow><mml:mi>β</mml:mi><mml:mo>=</mml:mo><mml:mn>0.46</mml:mn><mml:mo>,</mml:mo><mml:mspace width="0.5em" /><mml:mi>β</mml:mi><mml:mo>=</mml:mo><mml:mn>0.51</mml:mn></mml:mrow></mml:mfenced><mml:mtext>,</mml:mtext></mml:math></inline-formula> followed by “cross-sentence argumentation” <inline-formula><mml:math id="M3" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mfenced open="(" close=")"><mml:mrow><mml:mi>β</mml:mi><mml:mo>=</mml:mo><mml:mn>0.37</mml:mn></mml:mrow></mml:mfenced></mml:math></inline-formula> and “dialogical argumentation” <inline-formula><mml:math id="M4" xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mfenced open="(" close=")"><mml:mrow><mml:mi>β</mml:mi><mml:mo>=</mml:mo><mml:mn>0.20</mml:mn></mml:mrow></mml:mfenced><mml:mtext>.</mml:mtext></mml:math></inline-formula> These results indicate that the difficulty of an item increased most when participants had to refer to musical attributes to solve the task. The items that required the participants to provide cross-sentence or dialogical argumentation were more challenging as well. The findings regarding the relations between item characteristics and item difficulty contribute to a better understanding of music-related argumentative competence, with important implications for the music classroom.</p>