AUTHOR=Babushkin Vahan , Alsuradi Haneen , Jamil Muhammad Hassan , Al-Khalil Muhamed Osman , Eid Mohamad
TITLE=Assessing handwriting task difficulty levels through kinematic features: a deep-learning approach
JOURNAL=Frontiers in Robotics and AI
VOLUME=10
YEAR=2023
URL=https://www.frontiersin.org/journals/robotics-and-ai/articles/10.3389/frobt.2023.1193388
DOI=10.3389/frobt.2023.1193388
ISSN=2296-9144
ABSTRACT=Introduction: Handwriting is a complex task that requires coordination of motor, sensory, cognitive, memory, and linguistic skills to master. The extent these processes are involved depends on the complexity of the handwriting task. Evaluating the difficulty of a handwriting task is a challenging problem since it relies on subjective judgment of experts.
Methods: In this paper, we propose a machine learning approach for evaluating the difficulty level of handwriting tasks. We propose two convolutional neural network (CNN) models for single- and multilabel classification where single-label classification is based on the mean of expert evaluation while the multilabel classification predicts the distribution of experts’ assessment. The models are trained with a dataset containing 117 spatio-temporal features from the stylus and hand kinematics, which are recorded for all letters of the Arabic alphabet.
Results: While single- and multilabel classification models achieve decent accuracy (96% and 88% respectively) using all features, the hand kinematics features do not significantly influence the performance of the models.
Discussion: The proposed models are capable of extracting meaningful features from the handwriting samples and predicting their difficulty levels accurately. The proposed approach has the potential to be used to personalize handwriting learning tools and provide automatic evaluation of the quality of handwriting.