- 1Department of Geriatric Neurology, The Second Medical Center and National Clinical Research Center for Geriatric Disease, Chinese PLA General Hospital, Beijing, China
- 2Gyenno Science Co., Ltd., Shenzhen, China
- 3HUST-GYENNO CNS Intelligent Digital Medicine Technology Center, Wuhan, China
Introduction: Parkinson’s disease (PD) is the second most common neurodegenerative disease and affects millions of people. Accurate diagnosis and subsequent treatment in the early stages can slow down disease progression. However, making an accurate diagnosis of PD at an early stage is challenging. Previous studies have revealed that even for movement disorder specialists, it was difficult to differentiate patients with PD from healthy individuals until the average modified Hoehn-Yahr staging (mH&Y) reached 1.8. Recent researches have shown that dysarthria provides good indicators for computer-assisted diagnosis of patients with PD. However, few studies have focused on diagnosing patients with PD in the early stages, specifically those with mH&Y ≤ 1.5.
Method: We used a machine learning algorithm to analyze voice features and developed diagnostic models for differentiating between healthy controls (HCs) and patients with PD, and for differentiating between HCs and patients with mild PD (mH&Y ≤ 1.5). The models were independently validated using separate datasets.
Results: Our results demonstrate that, a remarkable diagnostic performance of the model in identifying patients with mild PD (mH&Y ≤ 1.5) and HCs, with area under the ROC curve 0.93 (95% CI: 0.851.00), accuracy 0.85, sensitivity 0.95, and specificity 0.75.
Conclusion: The results of our study are helpful for screening PD in the early stages in the community and primary medical institutions where there is a lack of movement disorder specialists and special equipment.
1 Introduction
Parkinson’s disease (PD) is a neurological degenerative disease characterized by a group of motor symptoms, including bradykinesia, rigidity, postural instability, and resting tremors, as well as a group of non-motor symptoms, including hyposmia, cognitive impairment, and autonomic dysfunctions (Solla et al., 2020; Ercoli et al., 2022), which occur due to progressive loss of dopaminergic neurons in the substantia nigra of the midbrain (Hornykiewicz, 1998). Both motor and non-motor symptoms have significant impact on the quality of life of patients with PD (Solla et al., 2020; Ercoli et al., 2022). Although PD remains incurable, accurate diagnosis and subsequent treatment of mild conditions can improve the patient’s quality of life (Lang et al., 2013). However, accurate diagnosis of early-stage PD is difficult because mild motor symptoms are often misconstrued as typical signs of aging. A survey reported a clinical diagnostic accuracy of only 80% by experienced movement disorder specialists, whereas the precision is even lower when performed by general neurologists (Adler et al., 2014). In recent years, several tools have been used for the early diagnosis of PD, including dopamine transporter (DaT) scans, 7-Tesla magnetic resonance imaging, and radioactive iodine metaiodobenzylguanidine scans, with satisfactory accuracy (Brooks, 1993; Gaenslen et al., 2008; Cosottini et al., 2014; Kawazoe et al., 2019; Vaswani et al., 2022). However, these examinations are time-consuming, costly, and rely on specialized equipment and reagents that are only feasible in a limited number of top-tier tertiary medical centers, thus restricting their widespread application. Hence, a reliable, inexpensive, and convenient tool that can accurately identify early-stage PD is required.
Dysarthria, a prevalent motor manifestation of PD, is observed in approximately 90% of patients. Notably, it may manifest up to 5 years before the occurrence of motor symptoms, highlighting its potential as an early indicator of PD (Postuma et al., 2012). Dysarthria in PD is characterized by hypokinetic symptoms, including reduced voice volume and pitch variation, breathy voice, tremors, hoarse voice quality, inconsistent voice rates, and imprecise articulation. Hypokinetic dysarthria reflects the involvement of all dimensions of voice production, including respiration, phonation, resonance, articulation, and prosody (Moro et al., 2021). Objective acoustic analysis of voice in individuals with PD can reveal abnormalities in specific features, including decreased signal-to-noise ratios and increased jitter and shimmer (Suphinnapong et al., 2021). Moreover, the advancement of data processing technology has led to the utilization of machine learning algorithms for dynamic analysis of voice feature parameters, aiming to achieve accurate classification between patients with PD and healthy controls (HCs). Many studies utilized linear voice feature parameters such as jitter, shimmer, or noise, in conjunction with various machine learning algorithms that typically result in an accuracy exceeding 0.75 when distinguishing individuals with PD from HCs (Khojasteh et al., 2018; Rusz et al., 2018; Moro-Velazquez et al., 2019). Little et al., utilized nonlinear voice feature parameters, including Recurrence Period Density Entropy (RPDE), Detrended Fluctuation Analysis (DFA), and Pitch Period Entropy (PPE), in combination with the SVM algorithm to achieve an accuracy of 0.91 in differentiating individuals with PD from HCs (Little et al., 2007; Orozco-Arroyave et al., 2016). Additionally, other types of feature parameters such as Mel-Frequency Cepstral Coefficients (MFCC), and Band Bark Energies (BBE) have been employed alongside several machine learning algorithms to provide accuracies exceeding 0.85 (Sakar et al., 2019; Vasquez-Correa et al., 2020). Recently, several studies have utilized representation learning feature parameters in combination with machine learning algorithms to discriminate individuals with PD from HCs (Zhang, 2017; Cummins et al., 2018). These feature parameters were extracted using deep learning methods and contained additional hidden voice information that is difficult to interpret compared to conventional voice features. Moreover, these features could help to improve the accuracy of different models to classify pathological voice (Cummins et al., 2018). The aforementioned studies have successfully used machine learning algorithms to analyze conventional voice feature parameters and representation learning feature parameters to accurately distinguish individuals with PD from HCs. However, most studies have focused on discriminating between individuals with PD and HCs without considering the differentiation between those with mild/early PD and HCs. Even studies that have specifically focused on diagnosing mild/early PD typically use modified Hoehn–Yahr staging (mH&Y) criteria of ≤3 or mH&Y ≤ 2 to define mild/early PD. These studies also had limited datasets, usually encompassing <50 patients with mild/early PD (Rusz et al., 2011; Defazio et al., 2016; Lim et al., 2022; Wang et al., 2022). Indeed, in clinical practice, patients with mH&Y ≥ 2 are easier to identify, whereas those presenting with mH&Y ≤ 1.5 often exhibit mild motor symptoms that frequently lead to misdiagnosis. Therefore, it is imperative to use voice to differentiate individuals with “real” mild/early PD (mH&Y ≤ 1.5) from HCs. Otherwise, since current research on using voice to distinguish between PD and HCs mainly focuses on English-speaking populations, there is a relative lack of studies on native Chinese speakers. Given this gap, the present study has employed a Chinese database for both model construction and validation, aiming to strengthen the evidence base in this field.
This study aimed to establish machine learning models for analyzing conventional and representation learning feature parameters extracted from sustained vowels, which could be used to distinguish patients with PD and mild PD (mH&Y ≤ 1.5) from age- and sex-matched HCs. We also compared the diagnostic performance of the models with that of general neurologists, who are not experts in movement disorders.
2 Materials and methods
2.1 Participants
The study was approved by the local ethics committee on human experimentation and performed in accordance with the ethical standards established in the 1964 Declaration of Helsinki. The study protocol and all amendments were approved by the institutional review board or an independent ethics committee (ethics committee approval no. S2023-618-02).
Between January and August 2023, we recruited 278 Chinese-speaking participants, including 139 patients with PD and 139 HCs, from the movement disorder outpatient department of the Chinese People’s Liberation Army General Hospital.
Patients with PD were diagnosed by two experienced movement disorder experts according to the 2015 Movement Disorder Society (MDS) diagnostic criteria (Postuma et al., 2015). In instances of disagreement between their diagnoses, a consensus was reached through discussion. To guarantee a precise and reliable diagnosis of PD, all patients with mild PD underwent DaT scans and showed positive results. The exclusion criteria were (1) age < 45 years; (2) other neurological diseases; (3) cognitive impairment or dementia, defined as a Mini-Mental State Exam (MMSE) scale score ≤ 26 points (illiterate ≤24 points); (4) mental or psychological disorders; (5) speech and language disorders unrelated to Parkinsonian symptoms; (6) hearing disorders; (7) receiving speech function rehabilitation treatment; (8) intolerance to withdrawal of dopaminergic drugs for 12 h; and (9) severe dyskinesias. The severity of motor symptoms in patients with PD was evaluated using the MDS Unified Parkinson’s Disease Rating Scale (MDS-UPDRS) part III (Goetz et al., 2008) and mH&Y (Goetz et al., 2004). Cognitive function was assessed using the MMSE and Montreal Cognitive Assessment (MoCA). The mild (mH&Y ≤ 1.5) and moderate-to-severe (mH&Y ≥ 2) PD groups included 69 and 70 patients, respectively.
HCs were neurologically unaffected participants who were spouses or accompanying friends of patients with PD. The exclusion criteria were: (1) age < 45 years; (2) neurological diseases; (3) cognitive impairment or dementia (MMSE scale score ≤ 26 [illiterate ≤24]); (4) mental or psychological disorders; (5) speech, language, or hearing disorders; and (6) undergoing speech function rehabilitation. Cognitive function was assessed using the MMSE and MoCA.
The 139 patients with PD and 139 HCs were randomly divided in a 7:3 ratio into a training cohort (98 patients with PD and 98 HCs) to develop the PD diagnostic model and a testing cohort (41 patients with PD and 41 HCs) to validate the model.
The 69 patients with mild PD (derived from a pool of 139 patients with PD) and 69 HCs (randomly selected from the pool of 139 HCs to achieve a balanced distribution between the two groups) were randomly divided in a 7:3 ratio into a training cohort (49 patients with PD and 49 HCs) to develop a mild PD diagnostic model and a testing cohort (20 patients with PD and 20 HCs) to validate the model.
2.2 Voice data collection and processing
All participants were instructed to take a deep breath and perform three sustained vowel phonations ([a], [o], and [i]) separately at a comfortable pitch and loudness for as long and steadily as possible until they ran out of air. Each phonation lasted for at least 6 s. Recordings of patients with PD were collected when they had not taken any medication or >12 h had elapsed since their last dose. Recordings were made in a consulting room with a low ambient noise level using an external condenser microphone coupled to a smartphone placed approximately 5 cm from the participant’s mouth. The microphone gain was set to the same optimal level for all participants to ensure comparable recording conditions. The audio data were digitized from the microphone to a computer at a sampling rate of 44.1 kHz and 16-bit quantization was performed using RecForge Pro software. The original voice data were imported to a computer and digitally edited to establish a voice database.
2.3 Diagnosis model establishment and validation
2.3.1 Extraction of voice feature parameters
Four phonetic voice features, namely prosody, articulation, phonation, and representation learning features, were extracted from each original voice segment. Phonation involves the vibrations generated by the vocal cords and is associated with the source of the glottis and the resonant structure of the vocal tract. Articulation is an analysis based on sustained vowels or continuous voice signals, which reflects changes in the position, tension, and shape of the organs involved in voice production. This is observed through parameters such as articulator speed and acceleration, transition patterns between sound segments, and resonance peak evolution. Prosody encompasses loudness, vocal-fold vibration frequency, and other characteristics that accompany natural language. Representation learning features are computational features of representation learning strategies based on recurrent autoencoders (RAE) and convolutional autoencoders (CAE) (Vasquez-Correa et al., 2020).
This study utilized the DisVoice tool to preprocess raw audio data, resulting in 2155 acoustic feature parameters for each vowel phonation. Table 1 presents all the feature parameters extracted from each sustained vowel.
A total of 28 feature parameters were extracted from the phonation feature. This feature had seven descriptors (Shimmer, Jitter, Amplitude Perturbation Quotient, Pitch Perturbation Quotient [PPQ], First Derivative of the Fundamental Frequency [DF0], Second Derivative of the Fundamental Frequency [DDF0], and Logarithmic Energy [LogE]), each of which has four values including mean, standard deviation (std), skewness, and kurtosis.
A total of 488 feature parameters belonged to the articulation feature. This feature had 14 descriptors, each of which has four values including mean, std., skewness, and kurtosis. The descriptors are Bark Band Energies in onset transitions (BBE on), Bark Band Energies in offset transitions (BBE off), Mel Frequency Cepstral Coefficients in onset transitions (MFCC on), Mel Frequency Cepstral Coefficients in offset transitions (MFCC off), First derivative of the MFCCs in onset transitions (DMFCC on), First derivative of the MFCCs in offset transitions (DMFCC off), Second derivative of the MFCCs in onset transitions (DDMFCC on), Second derivative of the MFCCs in offset transitions (DDMFCC off), First Formant Frequency (F1), First Derivative of F1 (DF1), Second Derivative of F1 (DDF1), Second Formant Frequency (F2), First Derivative of F2 (DF2), and Second Derivative of F2 (DDF2). The BBE on and BBE off descriptors have 22 levels, each and the MFCC on, MFCC off, DMFCC on, DMFCC off, DDMFCC on, and DDMFCC off descriptors have 12 levels each.
A total of 103 feature parameters belonged to prosody feature. This feature has three descriptors including Fundamental Frequency (F0), Energy, and Duration. The F0 descriptor has 30 feature parameters, the Energy descriptor has 48 feature parameters, and the Duration descriptor has 25 feature parameters.
A total of 1,536 feature parameters belonged to representation learning feature. This feature had two descriptors, each of which has four values including mean, std., skewness and kurtosis. The two descriptors are Bottleneck and Mean Squared Error (MSE) between the decoded and input spectrograms of the autoencoder in different frequency regions. The Bottleneck descriptor has 256 levels, and the MSE descriptor has 128 levels.
Consequently, each participant contributed 6,465 extracted feature parameters, corresponding to a combination of feature parameters from the three vowel phonations (2,155 × 3).
2.3.2 Voice feature parameter selection
First, through single-factor analysis, we compared the feature parameters between patients with PD or mild PD and the HCs group to identify intergroup differences. Using a non-parametric test (Wilcoxon test), only feature parameters with p < 0.05 were selected. Next, we utilized the training cohort dataset to assess the importance of these feature parameters using random forest techniques and ranked them based on the mean decrease accuracy (Edwards et al., 2018). Ten-fold cross-validation was conducted with five repetitions to validate the relationship between the model error and number of feature parameters. When the error reached its minimum, we selected the corresponding feature parameters as the best feature parameter subset to develop the diagnostic models.
2.3.3 Modeling and evaluation
After completing the feature parameter selection, we established a random forest classification model (Edwards et al., 2018) to predict whether individuals belonged to the PD, mild PD, or HCs groups. For the training cohort, a ten-fold cross-validation was employed with five repetitions to perform model selection and hyperparameter optimization. The final model was then evaluated in an independent cohort. The procedures for participant allocation, voice data collection, voice feature parameter extraction, voice feature parameter selection, modeling, and evaluation are presented in Figure 1.
Figure 1. Procedure of participant allocation, voice data collection, voice feature parameter extraction, voice feature parameter selection, modeling, and evaluation.
We considered the sensitivity, specificity, accuracy, precision, Kappa and F1 score evaluation performance of the machine learning models in the training and independent testing cohorts.
2.4 General neurologists’ differentiation of patients with PD from HCs
Two general neurologists who had completed specialist training in neurology, but were not specialists in movement disorders, were asked to perform neurological examinations of the testing cohorts. If parkinsonism was detected during the examination, the participant was classified as having suspected PD; if parkinsonism was not observed, the participant was classified as suspected HCs. In the case of disagreement between the two general neurologists, a consensus was reached through discussion. The general neurologists were blinded to both the DaT-positron emission tomography scan findings and the diagnoses made by the movement disorder specialists.
2.5 Statistical analysis
Continuous variables are represented as mean ± standard deviation. Equality of variance was assessed using Levene’s test. For normally distributed data, two-tailed t-tests or analysis of variance were used to compare variables. In cases where normality or homoscedasticity assumptions were violated, nonparametric t-tests were employed. Categorical variables are presented as numbers and percentages and compared using a chi-square test. The diagnostic performance of the models was evaluated by calculating the area under the receiver operating characteristic curve (AUROC) and 95% confidence interval (95% CI). Statistical analyses and machine learning were conducted using R version 4.3.2 in RStudio version 2023.09.1–494. Voice feature parameter extraction was performed using the disvoice package version 0.1.8. in Python version 3.8.16.
3 Results
3.1 Participant demographic and clinical characteristics
The demographic characteristics of the participants are shown in Table 2. The cohort comprised 139 patients with PD and 139 HCs, with no significant differences in age, sex ratio, MMSE score, or MoCA score between the two groups.
In the PD diagnostic model, no significant differences were observed in age, sex ratio, MMSE score, or MoCA score between patients with PD and HCs in either the training or testing cohorts. Furthermore, no significant differences were observed in age; sex ratio; and mH&Y, MDS-UPDRS III, PDQ-39, MMSE, or MoCA score between patients with PD in the training and testing cohorts. No significant differences were observed in age, sex ratio, MMSE score or MoCA score between HCs in the training and testing cohorts.
In the mild PD diagnostic model, no significant differences in age, sex ratio, MMSE score, or MoCA score were observed between patients with mild PD and HCs in both the training and testing cohorts. No significant differences were observed in age, sex ratio, mH&Y, MDS-UPDRS III, PDQ-39, MMSE score, or MoCA score between patients with mild PD in the training and testing cohorts. No significant differences were observed in age, sex ratio, MMSE score, or MoCA score between HCs in the training and testing cohorts.
The patients with PD in the training cohort of the PD diagnostic model exhibited higher disease duration, mH&Y scores, MDS-UPDRS III scores, and PDQ-39 scores than that exhibited by patients with mild PD in the training cohort of the mild PD diagnostic model. Patients with PD in the testing cohort of the PD diagnostic model exhibited higher mH&Y and MDS-UPDRS III scores than that exhibited by the patients with mild PD in the testing cohort of the mild PD diagnostic model. No significant differences in age, sex ratio, MMSE score, or MoCA score were observed between the HCs in the training cohort of the PD and mild PD diagnostic models. Furthermore, no significant differences in age, sex ratio, MMSE score, or MoCA score were observed between the HCs in the testing cohort of the PD and mild PD diagnostic models.
3.2 The best feature parameter subsets to develop the diagnostic models
Table 3 presents the best feature parameter subset for developing the model that distinguishes patients with PD from HCs. The best feature parameter set included 3 phonation, 2 articulation, and 22 representation learning feature parameters of vowel [a]; 5 phonation and 17 representation learning feature parameters of vowel [o]; and 5 phonation, 3 articulation, and 16 representation learning feature parameters of vowel [i].
Table 3. Best feature parameter Subset for developing the model distinguishing patients with PD from HCs.
Table 4 presents the best feature parameter subset for developing the model that distinguishes patients with mild PD from HCs. The best feature parameter set included 3 phonation, 1 articulation, and 21 representation learning feature parameters of vowel [a]; 3 phonation, 7 articulation, and 29 representation learning feature parameters of vowel [o]; 3 phonation, 1 articulation, and 13 representation learning feature parameters of vowel [i].
Table 4. Best feature parameter subset for developing the model distinguishing patients with mild PD from HCs.
3.3 Diagnostic performance based on voice feature parameters for identifying patients with PD and HCs
The diagnostic performance based on voice feature parameters for identifying patients with PD and HCs is shown in Table 5 (left column) and Figure 2. In the training dataset, we examined the performance of voice feature parameters for differentiating the entire cohort of patients with PD from the HCs. The classifier demonstrated an AUROC, accuracy, sensitivity, and specificity of 0.99 (95% CI: 0.98–1.00), 0.94, 1.00, and 0.88, respectively, when analyzed using a 10-fold cross-validation. The model was then validated using the testing cohort. In discriminating between all patients with PD and HCs, the AUROC, accuracy, sensitivity, and specificity were 0.94 (95% CI: 0.90–1.00), 0.93, 1.00, and 0.85, respectively.
Table 5. Diagnostic performance based on voice features for identifying patients with PD and HCs, as well as for identifying patients with mild PD and HCs.
Figure 2. Receiver operating characteristic curves to discriminate between PDs and HCs, calculated using the machine-learning classifier model, based on voice.
3.4 Diagnostic performance based on voice feature parameters for identifying patients with mild PD and HCs
The diagnostic performance based on voice feature parameters for identifying patients with mild PD and HCs is presented in Table 5 (right column) and Figure 3. In the training dataset, we examined the performance of voice feature parameters in differentiating the entire cohort of patients with mild PD from the HCs. The classifier demonstrated an AUROC, accuracy, sensitivity, and specificity of 0.99 (95% CI: 0.99–1.00), 0.96, 1.00, and 0.92, respectively, when analyzed using a 10-fold cross-validation. The model was then validated using the testing dataset. In discriminating between all patients with PD and HCs, the AUROC, accuracy, sensitivity, and specificity were 0.93 (95% CI: 0.85–1.00), 0.85, 0.95, and 0.75, respectively.
Figure 3. Receiver operating characteristic curves to discriminate between mild PDs and HCs, calculated using the machine-learning classifier model, based on voice.
3.5 Diagnostic performance of general neurologists
The diagnostic performances of neurologists who were not experts in movement disorders are presented in Tables 6, 7. The accuracy, sensitivity, and specificity for discriminating between patients with PD and HCs were 0.87, 0.85, and 0.88, respectively. However, when discriminating between patients with mild PD and HCs, the accuracy, sensitivity, and specificity decreased to 0.68, 0.60, and 0.75, respectively.
4 Discussion
In this study, we used a machine-learning algorithm to analyze conventional and representation learning feature parameters extracted from sustained vowel and developed diagnostic models to differentiate between HCs, patients with PD, and patients with mild PD. The models were independently validated using separate datasets. Subsequently, the diagnostic performance of the model was compared with that of general neurologists. Our results demonstrated that compared with general neurologists, the diagnostic models showed satisfactory performance in distinguishing between patients with PD and HCs, as well as patients with mild PD and HCs.
Our study revealed that within the best feature parameter subset for developing the mild PD model, the vowel [o] exhibited a significantly higher number of feature parameters ([a]: 25 parameters, [o]: 39 parameters, [i]: 17 parameters). This finding suggests that the vowel [o] contained more information to distinguish mild PD and HCs. In the research on using sustained vowel tasks to differentiate patients with PD from HCs, the vowels [a], [o], and [i] are commonly employed (Moro et al., 2021). However, there is still controversy regarding which vowel provides more information for distinguishing PD patients from HCs. Hireš et al. found that, when compared to other vowels, the vowel [a] demonstrated the highest diagnostic performance in distinguishing between patients with PD and HCs, achieving an accuracy of 0.99, a sensitivity of 0.86, a specificity of 0.93, and an AUROC of 0.89 (Hireš et al., 2022). However, Orozco-Arroyavede et al. found that when distinguishing between patients with PD and HCs, the vowel [i] achieved the highest accuracy of 0.76 among the 5 vowels ([a], [e], [i], [o], [u]) (Orozco-Arroyave et al., 2013). While, Song et al. revealed that when distinguishing between patients with mild PD (mH&Y ≤ 3) and HCs, the vowel [o] achieved the highest accuracy of 0.85, compared to vowels [a] and [i] (Song et al., 2020). The possible causes for why the vowel [o] contains more information to distinguish mild PD from HCs, we speculated as follows: The position of the tongue within the oral cavity varies when phonating different vowels (Zhenni et al., 2020). When producing the vowel [a], the tongue is positioned in the middle horizontally and at its lowest point vertically within the oral cavity (Zhenni et al., 2020). This indicates that the tongue is in a relaxed state during vowel [a] production. While producing vowels [o] and [i], the tongue must remain in specific positions within oral cavity. When pronouncing the vowel [i], the tongue is positioned close to the palate, where there is relatively limited space in the oral cavity, making it easier to maintain a stable tongue position (Zhenni et al., 2020). However, when pronouncing the vowel [o], the position of the tongue is close to the back of the oral cavity, and it is centered in the vertical direction (Zhenni et al., 2020). This makes it more difficult for the tongue to maintain a stable position. In patients with mild PD, the abnormal movement of the tongue due to bradykinesia and rigidity makes it challenging to maintain a stable position (Mefferd and Dietrich, 2019). Therefore, it is more difficult for patients with mild PD to produce sustained and stable vowel [o] compared to vowels [a] and [i].
Our study also found that the representation learning feature parameters accounted for the majority of the best feature subsets used to construct the two diagnostic models, indicating that these parameters provided more information for distinguishing patients with PD from HCs than conventional voice feature parameters. The phenomenon of voice is inherently complex, characterized by high-dimensional data, and the effects of PD on voice are also multidimensional. Conventional voice feature parameters may not adequately capture enough information to characterize the voice signals associated with PD (Vasquez-Correa et al., 2020). The application of deep learning methods to automatically extract abstract and unexplained hidden features from voice and distinguish PD patients from HCs has been attracting increasing attention. Correa et al., utilized RAE and CAE to extract representation learning feature parameters from voice data, which were then classified using the SVM algorithm. The accuracy achieved for discriminating patients with PD and HCs was 0.84 (Vasquez-Correa et al., 2020). Zhang et al., using stacked autoencoders (SAE) to extract representation learning feature parameters from voice data, which were then classified using the KNN algorithm. The accuracy achieved for discriminating patients with PD and HCs was 0.97 (Zhang, 2017). Subsequently, they compared the diagnostic performance of representation learning feature parameters with that of conventional feature parameters and found that the representation learning feature parameters had a higher classification accuracy than conventional feature parameters.
Currently, four primary tasks are utilized for detecting dysarthria in patients with PD: sustained vowel, syllable repetition, passage reading, and monologue tasks (Rusz et al., 2021). In comparison to other tasks, the sustained vowel task remains unaffected by cognition, language, and dialect (Gerratt et al., 2016). Additionally, the sustained vowel task can be effortlessly executed and adheres to a consistently standardized methodology. However, several studies have pointed out that compared to sustained vowel tasks, syllable repetition, passage reading, and monologue tasks can provide more comprehensive voice information and be more accurate in distinguishing between patients with PD and HCs (Rusz et al., 2013; Godino-Llorente et al., 2017; Wang et al., 2022). While, our study revealed that even sustained vowel task could distinguish mild PD from HC with accuracy ≥0.85. The possible reasons for our high accuracy are as follows: In addition to conventional feature parameters, our study utilized representation learning feature parameters that encompass abstract and unexplained hidden features (not present in conventional features), which are helpful in distinguishing patients with PD from HCs (Vasquez-Correa et al., 2020).
Recent report has indicated that PD affects 3.62 million patients in China, accounting for half of the global number of patients with PD (Qi et al., 2021). With a rapidly aging population, this number is predicted to increase to approximately 5 million by 2030 (Li et al., 2019). However, a significant proportion (an estimated 20–40%) of individuals with PD remain undiagnosed, (MRC CFAS et al., 2006; Bajaj et al., 2010) with even lower figures in rural areas (Zhang et al., 2003). In the early stages of PD, mild motor symptoms may be perceived as an age-related decline in motor function and are easily overlooked by patients and general neurologists, leading to misdiagnosis. Even movement disorder specialists have difficulty distinguishing patients with PD from HCs until the average mH&Y stage reaches 1.8 (Hughes et al., 2002). Furthermore, diagnoses made by general neurologists are likely to have lower diagnostic accuracy and later mH&Y staging (Joutsa et al., 2014). In the present study, the sensitivity of general neurologists to discriminate between patients with PD and HCs was 0.85 and 0.60 for mild PD and HCs, respectively. These results implied that 15% of patients with PD and 40% of those with mild PD are misdiagnosed by general neurologists, which is consistent with the misdiagnosis rates reported previously. Compared with the diagnostic performance of general neurologists, the machine learning-based diagnostic model analyzing voice feature parameters in the present study demonstrated outstanding performance. When using voice feature parameters to differentiate between patients with PD and HCs, most studies exhibited impressive AUROC and accuracies (>0.9) (Little et al., 2007; Orozco-Arroyave et al., 2016; Khojasteh et al., 2018; Rusz et al., 2018; Moro-Velazquez et al., 2019). Studies that focused on discriminating between patients with mild early PD and HCs exhibited satisfactory diagnostic performance (AUROC and accuracy >0.8) (Zhang, 2017; Cummins et al., 2018; Sakar et al., 2019; Vasquez-Correa et al., 2020). However, these studies defined mild/early PD as mH&Y ≤ 3 or mH&Y ≤ 2, and most of the participants with mild/early PD enrolled in these studies had a mH&Y stage of ≥1.5. To the best of our knowledge, the current study is the first to attempt to distinguish PD with mH&Y ≤ 1.5 from HCs using voice feature parameters. The results demonstrated the remarkable diagnostic performance of the model in identifying patients with mild PD and HCs, with an AUROC of 0.93 and an accuracy of 0.85. The sensitivity of the model in identifying patients with mild PD and HCs reached 0.95. Thus, the model can distinguish most patients with mild PD from the general population, making it suitable for screening.
Although PD remains incurable, accurate diagnosis and subsequent treatment can improve the patient’s quality of life However, in real-world settings, the diagnosis and treatment of PD in its early stages are challenging. Owing to the lack of early screening tools and accurate diagnostic support, it is difficult to diagnose most patients earlier than mH&Y stage 2 (Joutsa et al., 2014), thereby missing the best time window for disease-modifying treatment. Until now, the precise diagnosis of early-stage PD relied on a limited number of movement disorder specialists and rare, expensive equipment. Additionally, few patients are aware of their symptoms and consult doctors before mH&Y staging 1.5. Consequently, the development of satisfactorily sensitive and convenient non-invasive screening tools stage is urgently needed to detect prodromal or mild PD. Our study results showed that analyzing voice feature parameters extracted from a simple sustained vowel task, which can be performed using only a smartphone with a microphone for recording and a computer for analyzing, is a convenient and relatively affordable tool for identifying PD before mH&Y stage 1.5.
Our study has some limitations. First, we did not analyze the correlation between voice parameters and disease severity (mH&Y, and MDS-UPDRS III). Dysarthria is just one manifestation of the motor symptoms of PD, and although it may appear earlier than other motor symptoms, relying solely on voice parameters to assess PD severity may not fully reflect the actual severity. Additionally, we only included patients with PD and HCs and excluded patients with other types of parkinsonism (e.g., multiple system atrophy and progressive supranuclear palsy), which would make the model more widely applicable. Currently, diagnostic criteria for prodromal PD have been proposed, and idiopathic rapid eye movement sleep behavior disorder is a prodromal symptom of PD that has garnered significant attention. The use of voice and other multimodal somatosensory parameters to screen for these diseases are future research directions.
5 Conclusion
In this study, we used a machine learning algorithm to analyze voice feature parameters and developed diagnostic models for differentiating between HCs, patients with PD, and those with mild PD (mH&Y ≤ 1.5). The models were independently validated using separate datasets. Our results demonstrate a remarkable diagnostic performance of the model in identifying patients with mild PD (mH&Y ≤ 1.5) and HCs. Furthermore, we proposed a paradigm for the automatic identification of patients with PD by voice. The results of our study are helpful for screening PD in the early stages in the community and primary medical institutions where movement disorder specialists and special equipment are lacking.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by Ethics committee of Chinese PLA General Hospital. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
MW: Data curation, Formal analysis, Investigation, Methodology, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing. XlZ: Writing – original draft, Writing – review & editing. FL: Writing – original draft, Writing – review & editing. LW: Formal analysis, Methodology, Software, Validation, Writing – original draft, Writing – review & editing. YiL: Data curation, Resources, Writing – review & editing. RT: Investigation, Writing – review & editing. JY: Investigation, Writing – review & editing. SL: Data curation, Formal analysis, Methodology, Software, Writing – review & editing. YZ: Data curation, Formal analysis, Methodology, Software, Writing – review & editing. YuL: Data curation, Formal analysis, Methodology, Software, Writing – review & editing. KR: Data curation, Formal analysis, Methodology, Software, Writing – review & editing. ZC: Data curation, Formal analysis, Methodology, Software, Writing – review & editing. XY: Funding acquisition, Investigation, Resources, Validation, Visualization, Writing – review & editing. ZW: Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing. ZG: Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – review & editing. XZ: Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the National Key Research and Development Program of China (grant nos. 2021YFC2501203 and 2021YFC2501206), Special Research Project on Military Health Care (grant no. 21BJZ18), and the Youth Innovation Science Fund of the Chinese PLA General Hospital (grant no. 22QNCZ028).
Conflict of interest
LW, SL, YZ, YL, KR, and ZC were employed by Gyenno Science Co., Ltd.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Adler, C. H., Beach, T. G., Hentz, J. G., Shill, H. A., Caviness, J. N., Driver-Dunckley, E., et al. (2014). Low clinical diagnostic accuracy of early vs advanced 6. Parkinson disease: clinicopathologic study. Neurology 83, 406–412. doi: 10.1212/WNL.0000000000000641
Bajaj, N. P., Gontu, V., Birchall, J., Patterson, J., Grosset, D. G., and Lees, A. J. (2010). Accuracy of clinical diagnosis in tremulous parkinsonian patients: a blinded video study. J. Neurol. Neurosurg. Psychiatry 81, 1223–1228. doi: 10.1136/jnnp.2009.193391
Brooks, D. J. (1993). PET studies on the early and differential diagnosis of Parkinson's disease. Neurology 3, 6–16,
Cosottini, M., Frosini, D., Pesaresi, I., Costagli, M., Biagi, L., Ceravolo, R., et al. (2014). MR imaging of the substantia nigra at 7 T enables diagnosis of Parkinson disease. Radiology 271, 831–838. doi: 10.1148/radiol.14131448
Cummins, N., Baird, A., and Schuller, B. W. (2018). Speech analysis for health: current state-of-the-art and the increasing impact of deep learning. Methods 151, 41–54. doi: 10.1016/j.ymeth.2018.07.007
Defazio, G., Guerrieri, M., Liuzzi, D., Gigante, A. F., and di Nicola, V. (2016). Assessment of voice and speech symptoms in early Parkinson's disease by the Robertson dysarthria profile. Neurol. Sci. 37, 443–449. doi: 10.1007/s10072-015-2422-8
Edwards, J. A., Santos-Medellín, C. M., Liechty, Z. S., Nguyen, B., Lurie, E., Eason, S., et al. (2018). Compositional shifts in root-associated bacterial and archaeal microbiota track the plant life cycle in field-grown rice. PLoS Biol. 16:e2003862. doi: 10.1371/journal.pbio.2003862
Ercoli, T., Masala, C., Cadeddu, G., Mascia, M. M., Orofino, G., Gigante, A. F., et al. (2022). Does olfactory dysfunction correlate with disease progression in Parkinson's disease? A systematic review of the current literature. Brain Sci. 12:513. doi: 10.3390/brainsci12050513
Gaenslen, A., Unmuth, B., Godau, J., Liepelt, I., di Santo, A., Schweitzer, K. J., et al. (2008). The specificity and sensitivity of transcranial ultrasound in the differential diagnosis of Parkinson's disease: a prospective blinded study. Lancet Neurol. 7, 417–424. doi: 10.1016/S1474-4422(08)70067-X
Gerratt, B. R., Kreiman, J., and Garellek, M. (2016). Comparing measures of voice quality from sustained phonation and continuous speech. J. Speech Lang. Hear. Res. 59, 994–1001. doi: 10.1044/2016_JSLHR-S-15-0307
Godino-Llorente, J. I., Shattuck-Hufnagel, S., Choi, J. Y., Moro-Velázquez, L., and Gómez-García, J. A. (2017). Towards the identification of idiopathic Parkinson's disease from the speech. PLoS One 12:e0189583. doi: 10.1371/journal.pone.0189583
Goetz, C. G., Poewe, W., Rascol, O., Sampaio, C., Stebbins, G. T., Counsell, C., et al. (2004). Movement disorder society task force report on the Hoehn and Yahr staging scale: status and recommendations the movement disorder society task force on rating scales for Parkinson’s disease. Mov. Disord. 19, 1020–1028. doi: 10.1002/mds.20213
Goetz, C. G., Tilley, B. C., Shaftman, S. R., Stebbins, G. T., Fahn, S., Martinez-Martin, P., et al. (2008). Movement Disorder Society-sponsored revision of the unified Parkinson's disease rating scale (MDS-UPDRS): scale presentation and clinometric testing results. Mov. Disord. 23, 2129–2170. doi: 10.1002/mds.22340
Hireš, M., Gazda, M., Drotár, P., Pah, N. D., Motin, M. A., and Kumar, D. K. (2022). Convolutional neural network ensemble for Parkinson's disease detection from voice recordings. Comput. Biol. Med. 141:105021. doi: 10.1016/j.compbiomed.2021.105021
Hornykiewicz, O. (1998). Biochemical aspects of Parkinson's disease. Neurology 51, S2–S9. doi: 10.1212/WNL.51.2_Suppl_2.S2
Hughes, A. J., Daniel, S. E., Ben-Shlomo, Y., and Lees, A. J. (2002). The accuracy of diagnosis of parkinsonian syndromes in a specialist movement disorder service. Brain 125, 861–870. doi: 10.1093/brain/awf080
Joutsa, J., Gardberg, M., Röyttä, M., and Kaasinen, V. (2014). Diagnostic accuracy of parkinsonism syndromes by general neurologists. Parkinsonism Relat. Disord. 20, 840–844. doi: 10.1016/j.parkreldis.2014.04.019
Kawazoe, M., Arima, H., Maeda, T., Tsuji, M., Mishima, T., Fujioka, S., et al. (2019). Sensitivity and specificity of cardiac 123I-MIBG scintigraphy for diagnosis of early-phase Parkinson's disease. J. Neurol. Sci. 407:116409. doi: 10.1016/j.jns.2019.07.027
Khojasteh, P., Viswanathan, R., Aliahmad, B., Ragnav, S., Kumar, DK., et al. (2018). Parkinson's disease diagnosis based on multivariate deep features of speech signal. IEEE, 187–190. doi: 10.1109/LSC.2018.8572136
Lang, A. E., Melamed, E., Poewe, W., and Rascol, O. (2013). Trial designs used to study neuroprotective therapy in Parkinson's disease. Mov. Disord. 28, 86–95. doi: 10.1002/mds.24997
Li, G., Ma, J., Cui, S., He, Y., Xiao, Q., Liu, J., et al. (2019). Parkinson's disease in China: a forty-year growing track of bedside work. Transl Neurodegener. 8:22. doi: 10.1186/s40035-019-0162-z
Lim, W. S., Chiu, S. I., Wu, M. C., Tsai, S. F., Wang, P. H., Lin, K. P., et al. (2022). An integrated biometric voice and facial features for early detection of Parkinson's disease. NPJ Parkinsons Dis. 8:145. doi: 10.1038/s41531-022-00414-8
Little, M. A., McSharry, P. E., Roberts, S. J., Costello, D. A., and Moroz, I. M. (2007). Exploiting nonlinear recurrence and fractal scaling properties for voice disorder detection. Biomed. Eng. Online 6:23. doi: 10.1186/1475-925X-6-23
Mefferd, A. S., and Dietrich, M. S. (2019). Tongue- and jaw-specific articulatory underpinnings of reduced and enhanced acoustic vowel contrast in talkers with Parkinson's disease. J. Speech Lang. Hear. Res. 62, 2118–2132. doi: 10.1044/2019_JSLHR-S-MSC18-18-0192
Moro, V. L., Gomez, A., Arias, D., et al. (2021). Advances in Parkinson’s disease detection and assessment using voice and speech: a review of the articulatory and phonatory aspects. Biomed Signal Process Control. 66:102418. doi: 10.1016/j.bspc.2021.102418
Moro-Velazquez, L., Gomez-Garcia, J. A., Godino-Llorente, J. I., Grandas-Perez, F., Shattuck-Hufnagel, S., Yagüe-Jimenez, V., et al. (2019). Phonetic relevance and phonemic grouping of speech in the automatic detection of Parkinson’s disease. Sci. Rep. 9:19066. doi: 10.1038/s41598-019-55271-y
MRC CFASFoltynie, T., Matthews, F. E., Ishihara, L., and Brayne, C. (2006). The frequency and validity of self-reported diagnosis of Parkinson's disease in the UK elderly: MRC CFAS cohort. BMC Neurol. 6:29. doi: 10.1186/1471-2377-6-29
Orozco-Arroyave, J. R., Arias-Londoño, J. D., Vargas-Bonilla, J. F., and Nöth, E. (2013). Analysis of speech from people with Parkinson's disease through nonlinear dynamics. Adv. Nonlinear Speech Process. 7911, 112–119. doi: 10.1007/978-3-642-38847-7_15
Orozco-Arroyave, J. R., Hönig, F., Arias-Londoño, J. D., Vargas-Bonilla, J. F., Daqrouq, K., Skodda, S., et al. (2016). Automatic detection of Parkinson's disease in running speech spoken in three different languages. J. Acoust. Soc. Am. 139, 481–500. doi: 10.1121/1.4939739
Postuma, R. B., Berg, D., Stern, M., Poewe, W., Olanow, C. W., Oertel, W., et al. (2015). MDS clinical diagnostic criteria for Parkinson's disease. Mov. Disord. 30, 1591–1601. doi: 10.1002/mds.26424
Postuma, R. B., Lang, A. E., Gagnon, J. F., Pelletier, A., and Montplaisir, J. Y. (2012). How does parkinsonism start? Prodromal parkinsonism motor changes in idiopathic REM sleep behaviour disorder. Brain 135, 1860–1870. doi: 10.1093/brain/aws093
Qi, S., Yin, P., Wang, L., Qu, M., Kan, G. L., Zhang, H., et al. (2021). Prevalence of Parkinson's disease: a community-based study in China. Mov. Disord. 36, 2940–2944. doi: 10.1002/mds.28762
Rusz, J., Cmejla, R., Ruzickova, H., and Ruzicka, E. (2011). Quantitative acoustic measurements for characterization of speech and voice disorders in early untreated Parkinson's disease. J. Acoust. Soc. Am. 129, 350–367. doi: 10.1121/1.3514381
Rusz, J., Cmejla, R., Tykalova, T., Ruzickova, H., Klempir, J., Majerova, V., et al. (2013). Imprecise vowel articulation as a potential early marker of Parkinson's disease: effect of speaking task. J. Acoust. Soc. Am. 134, 2171–2181. doi: 10.1121/1.4816541
Rusz, J., Hlavnicka, J., Tykalova, T., Novotny, M., Dusek, P., Sonka, K., et al. (2018). Smartphone allows capture of speech abnormalities associated with high risk of developing Parkinson’s disease. IEEE Trans. Neural Syst. Rehabil. Eng. 26, 1495–1507. doi: 10.1109/TNSRE.2018.2851787
Rusz, J., Tykalova, T., Ramig, L. O., and Tripoliti, E. (2021). Guidelines for speech recording and acoustic analyses in dysarthrias of movement disorders. Mov. Disord. 36, 803–814. doi: 10.1002/mds.28465
Sakar, C. O., Serbes, G., Gunduz, A., Tunc, H. C., Nizam, H., Sakar, B. E., et al. (2019). A comparative analysis of speech signal processing algorithms for Parkinson’s disease classification and the use of the tunable Q-factor wavelet transform. Appl. Soft Comput. 74, 255–263. doi: 10.1016/j.asoc.2018.10.022
Solla, P., Masala, C., Liscia, A., Piras, R., Ercoli, T., Fadda, L., et al. (2020). Sex-related differences in olfactory function and evaluation of possible confounding factors among patients with Parkinson's disease. J. Neurol. 267, 57–63. doi: 10.1007/s00415-019-09551-2
Song, G., Wang, M., Zhongbao, G., Wang, W., Chen, T., Lou, R., et al. (2020). Application of artificial intelligence voice analysis system in clinical diagnosis of PD Chinese. J. Geriatric Heart Brain Vessel Diseases 22, 514–519. doi: 10.3969/j.issn.1009-0126.2020.05.017
Suphinnapong, P., Phokaewvarangkul, O., Thubthong, N., Teeramongkonrasmee, A., Mahattanasakul, P., Lorwattanapongsa, P., et al. (2021). Objective vowel sound characteristics and their relationship with motor dysfunction in Asian Parkinson's disease patients. J. Neurol. Sci. 426:117487. doi: 10.1016/j.jns.2021.117487
Vasquez-Correa, J. C., Arias-Vergara, T., Schuster, M., Orozco-Arroyave, J. R., and Nöth, E. (2020). Parallel representation learning for the classification of pathological speech: studies on Parkinson’s disease and cleft lip and palate. Speech Comm. 122, 56–67. doi: 10.1016/j.specom.2020.07.005
Vaswani, P. A., Morley, J. F., Jennings, D., Siderowf, A., Marek, K., Jennings, D., et al. (2022). Serial olfactory testing for the diagnosis of prodromal Parkinson's disease in the PARS study. Parkinsonism Relat. Disord. 104, 15–20. doi: 10.1016/j.parkreldis.2022.09.007
Wang, Q., Fu, Y., Shao, B., Chang, L., Ren, K., Chen, Z., et al. (2022). Early detection of Parkinson's disease from multiple signal speech: based on mandarin language dataset. Front. Aging Neurosci. 14:1036588. doi: 10.3389/fnagi.2022.1036588
Zhang, Y. N. (2017). Can a smartphone diagnose Parkinson disease? A deep neural network method and Telediagnosis system implementation. Parkinsons Dis. 2017, 1–11. doi: 10.1155/2017/6209703
Zhang, Z. X., Anderson, D. W., Huang, J. B., et al. (2003). Prevalence of Parkinson's disease and related disorders in the elderly population of greater Beijing, China. Mov. Disord. 18, 764–772. doi: 10.1002/mds.10445
Keywords: Parkinson’s disease, early diagnosis, machine learning, Chinese database, voice
Citation: Wang M, Zhao X, Li F, Wu L, Li Y, Tang R, Yao J, Lin S, Zheng Y, Ling Y, Ren K, Chen Z, Yin X, Wang Z, Gao Z and Zhang X (2024) Using sustained vowels to identify patients with mild Parkinson’s disease in a Chinese dataset. Front. Aging Neurosci. 16:1377442. doi: 10.3389/fnagi.2024.1377442
Edited by:
Santiago Perez-Lloret, National Scientific and Technical Research Council (CONICET), ArgentinaReviewed by:
Carla Masala, University of Cagliari, ItalyMohammod Abdul Motin, Rajshahi University of Engineering & Technology, Bangladesh
Copyright © 2024 Wang, Zhao, Li, Wu, Li, Tang, Yao, Lin, Zheng, Ling, Ren, Chen, Yin, Wang, Gao and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xi Zhang, zhangxi@301hospital.com.cn; Zhongbao Gao, gaozb301@163.com; Zhenfu Wang, zhenfuw@sina.com; Xi Yin, hos301Martin@163.com; Zhonglue Chen, chenzhonglue@gyenno.com
†These authors have contributed equally to this work