AUTHOR=Dapogny Arnaud , Grossard Charline , Hun Stéphanie , Serret Sylvie , Grynszpan Ouriel , Dubuisson Séverine , Cohen David , Bailly Kevin TITLE=On Automatically Assessing Children's Facial Expressions Quality: A Study, Database, and Protocol JOURNAL=Frontiers in Computer Science VOLUME=1 YEAR=2019 URL=https://www.frontiersin.org/journals/computer-science/articles/10.3389/fcomp.2019.00005 DOI=10.3389/fcomp.2019.00005 ISSN=2624-9898 ABSTRACT=

While there exists a number of serious games geared toward helping children with ASD to produce facial expressions, most of them fail to provide a precise feedback to help children to adequately learn. In the scope of the JEMImE project, which aims at developing such serious game platform, we introduce throughout this paper a machine learning approach for discriminating between facial expressions and assessing the quality of the emotional display. In particular, we point out the limits in generalization capacities of models trained on adult subjects. To circumvent this issue in the design of our system, we gather a large database depicting children's facial expressions to train and validate the models. We describe our protocol to elicit facial expressions and obtain quality annotations, and empirically show that our models obtain high accuracies in both classification and quality assessment of children's facial expressions. Furthermore, we provide some insight on what the models learn and which features are the most useful to discriminate between the various facial expressions classes and qualities. This new model trained on the dedicated dataset has been integrated into a proof of concept of the serious game.