Ziming Yin ^1* Heng Li ¹ Xun Han ² Ye Ran ² Zhichen Wang ¹ Zhao Dong ²

• ¹ University of Shanghai for Science and Technology, Shanghai, China
• ² Department of Neurology, Chinese PLA General Hospital, Beijing, Beijing Municipality, China

Objective: To determine whether the diagnostic ability of the newly designed hierarchical fuzzy diagnosis method is consistent with that of headache experts for probable migraine (PM) and probable tension-type headache (PTTH). Background: Clinical decision support systems (CDSS) are computer systems designed to help doctors to make clinician decisions by information technology, and have proven to be effective in improving headache diagnosis by making medical knowledge readily available to users in some studies. However, one serious drawback is that the CDSS lacks the ability to deal with some fuzzy boundaries of the headache features utilized in diagnostic criteria, which might be caused by patients’ recall bias and subjective bias. Methods: A hybrid mechanism of rule-based reasoning and hierarchical fuzzy diagnosis method based on international classification of headache disorders, 3rd edition (ICHD-3) was designed and then validated by a retrospective study with 325 consecutive patients and a prospective study with 380 patients who were clinically diagnosed with migraine and TTH at the headache clinic of Chinese PLA General Hospital. Results: The results of the diagnostic test in the retrospective study indicated that the fuzzy-based CDSS can be used in the diagnosis of migraine without aura (MO) (sensitivity 97.71%, specificity 100%), TTH (sensitivity 98.57%, specificity 100%), PM (sensitivity 91.25%, specificity 98.75%) and PTTH (sensitivity 90.91%, specificity 99.63%). While in the prospective study, the diagnostic performances were MO (sensitivity 91.62%, specificity 96.52%), TTH (sensitivity 92.17%, specificity 95.47%), PM (sensitivity 85.48%, specificity 98.11%) and PTTH (sensitivity 87.50%, specificity 98.60%). Cohen’s kappa values for the consistency test were 0.984 ± 0.018 (MO), 0.991 ± 0.018 (TTH), 0.916 ± 0.051 (PM), 0.932 ± 0.059 (PTTH) in the retrospective study and 0.884 ± 0.047 (MO), 0.870 ± 0.055 (TTH), 0.853 ± 0.073 (PM), 0.827 ± 0.118 (PTTH) in the prospective study, which indicated good consistency with the fuzzy-based CDSS and the gold standard (P<0.001). Conclusion: We developed a fuzzy-based CDSS performs much more similarly to expert diagnosis and performs better than the routine CDSS method in the diagnosis of migraine and TTH, and it could promote the application of artificial intelligence in the area of headache diagnosis.