AUTHOR=Wang Xi , Zhou Bo , Gong Ping , Zhang Ting , Mo Yan , Tang Jie , Shi Xinmiao , Wang Jianhong , Yuan Xinyu , Bai Fengsen , Wang Lei , Xu Qi , Tian Yu , Ha Qing , Huang Chencui , Yu Yizhou , Wang Lin TITLE=Artificial Intelligence–Assisted Bone Age Assessment to Improve the Accuracy and Consistency of Physicians With Different Levels of Experience JOURNAL=Frontiers in Pediatrics VOLUME=10 YEAR=2022 URL=https://www.frontiersin.org/journals/pediatrics/articles/10.3389/fped.2022.818061 DOI=10.3389/fped.2022.818061 ISSN=2296-2360 ABSTRACT=Background

The accuracy and consistency of bone age assessments (BAA) using standard methods can vary with physicians' level of experience.

Methods

To assess the impact of information from an artificial intelligence (AI) deep learning convolutional neural network (CNN) model on BAA, specialists with different levels of experience (junior, mid-level, and senior) assessed radiographs from 316 children aged 4–18 years that had been randomly divided into two equal sets-group A and group B. Bone age (BA) was assessed independently by each specialist without additional information (group A) and with information from the model (group B). With the mean assessment of four experts as the reference standard, mean absolute error (MAE), and intraclass correlation coefficient (ICC) were calculated to evaluate accuracy and consistency. Individual assessments of 13 bones (radius, ulna, and short bones) were also compared between group A and group B with the rank-sum test.

Results

The accuracies of senior, mid-level, and junior physicians were significantly better (all P < 0.001) with AI assistance (MAEs 0.325, 0.344, and 0.370, respectively) than without AI assistance (MAEs 0.403, 0.469, and 0.755, respectively). Moreover, for senior, mid-level, and junior physicians, consistency was significantly higher (all P < 0.001) with AI assistance (ICCs 0.996, 0.996, and 0.992, respectively) than without AI assistance (ICCs 0.987, 0.989, and 0.941, respectively). For all levels of experience, accuracy with AI assistance was significantly better than accuracy without AI assistance for assessments of the first and fifth proximal phalanges.

Conclusions

Information from an AI model improves both the accuracy and the consistency of bone age assessments for physicians of all levels of experience. The first and fifth proximal phalanges are difficult to assess, and they should be paid more attention.