The final, formatted version of the article will be published soon.
ORIGINAL RESEARCH article
Front. Educ.
Sec. Assessment, Testing and Applied Measurement
Volume 9 - 2024 |
doi: 10.3389/feduc.2024.1440760
This article is part of the Research Topic Educational Evaluation in the Age of Artificial Intelligence: Challenges and Innovations View all 5 articles
Improving Automated Scoring of Prosody in Oral Reading Fluency Using Deep Learning Algorithm
Provisionally accepted- 1 Simmons School of Education & Human Development, Southern Methodist University, Dallas, United States
- 2 University of South Florida, Tampa, Florida, United States
- 3 Southwest Research Institute (SwRI), San Antonio, Texas, United States
- 4 Department of Computer Science, Southern Methodist University, Dallas, United States
- 5 University of Oregon, Eugene, Oregon, United States
Automated assessing prosody of oral reading fluency presents challenges due to the inherent difficulty of quantifying prosody. This study proposed and evaluated an approach focusing on specific prosodic features using a deep-learning neural network. The current work focuses on crossdomain performance, researching how generalizable the prosody scoring is across students and text passages. The results demonstrated that the model with selected prosodic features had better crossdomain performance with an accuracy of 62.5% compared to 57% from the previous research. Our findings also indicate that students' reading patterns influence cross-domain performance more than specific text passage patterns. In other words, letting the student read at least one passage is more important than having others read all passage texts. The specific prosodic features had a high generalization to capture the typical prosody characteristics for achieving a satisfactorily high accuracy and classification agreement rate. This result provides valuable information for developing future automated scoring algorithms of prosody. This study is an essential demonstration of estimating the prosody score using fewer selected features, which would be more efficient and interpretable.
Keywords: automated scoring1, oral reading fluency2, prosody3, reading assessment4, crossdomain test5, Deep learning6, feature selection7, speech8
Received: 30 May 2024; Accepted: 11 Nov 2024.
Copyright: © 2024 Wang, Qiao, Sammit, Larson, Nese and Kamata. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
* Correspondence:
Kuo Wang, Simmons School of Education & Human Development, Southern Methodist University, Dallas, United States
Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.