Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 07 November 2024
Sec. Sleep Disorders

Utilizing machine learning techniques to identify severe sleep disturbances in Chinese adolescents: an analysis of lifestyle, physical activity, and psychological factors

Lirong Zhang*Lirong Zhang1*Shaocong ZhaoShaocong Zhao1Wei YangWei Yang1Zhongbing YangZhongbing Yang2Zhi&#x;an WuZhi’an Wu3Hua ZhengHua Zheng4Mingxing Lei,,*Mingxing Lei5,6,7*
  • 1Department of Physical Education, Xiamen University of Technology, Xiamen, Fujian, China
  • 2School of Physical Education, Guizhou Normal University, Guiyang, Guizhou, China
  • 3Department of Physical Education, Guangzhou Institute of Physical Education, Guangzhou, China
  • 4College of Physical Education and Health Sciences, Chongqing Normal University, Chongqing, China
  • 5Department of Orthopaedics, Hainan Hospital of Chinse PLA General Hospital, Sanya, China
  • 6Nursing Department, The First Medical Center of Chinese PLA General Hospital, Beijing, China
  • 7Chinese PLA Medical School, Beijing, China

Background: Adolescents often experience difficulties with sleep quality. The existing literature on predicting severe sleep disturbance is limited, primarily due to the absence of reliable tools.

Methods: This study analyzed 1966 university students. All participants were classified into a training set and a validation set at the ratio of 8:2 at random. Participants in the training set were utilized to establish models, and the logistic regression (LR) and five machine learning algorithms, including the eXtreme Gradient Boosting Machine (XGBM), Naïve Bayesian (NB), Support Vector Machine (SVM), Decision Tree (DT), CatBoosting Machine (CatBM), were utilized to develop models. Whereas, those in the validation set were used to validate the developed models.

Results: The incidence of severe sleep disturbance was 5.28% (104/1969). Among all developed models, the XGBM model performed best in AUC (0.872 [95%CI: 0.848-0.896]), followed by the CatBM model (0.853 [95% CI: 0.821-0.878]) and DT model (0.843 [95% CI: 0.801-0.870]), whereas the AUC of the logistic regression model was only 0.822 (95% CI: 0.777-0.856). Additionally, the XGBM model had the best accuracy (0.792), precision (0.780), F1 score (0.796), Brier score (0.143), and log loss (0.444).

Conclusions: The XGBM model may be a useful tool to estimate the risk of experiencing severe sleep disturbance among adolescents.

Introduction

Severe sleep disturbance has emerged as a critical concern for college students, affecting their overall well-being and academic performance (14). Recent epidemiological studies indicated that the prevalence of sleep disturbances in this population ranged from 20% to 60% (5), with as many as 12.7% reporting experiencing severe sleep disturbance (6). This widespread issue warrants attention due to its profound implications on both physical and mental health. The consequences of severe sleep disturbances can manifest as excessive daytime sleepiness, reduced cognitive function, and impaired academic performance, which collectively hinder students’ ability to thrive in their educational pursuits (2, 3). Moreover, the long-term repercussions of inadequate sleep can predispose individuals to a spectrum of chronic diseases, including liver disease, diabetes, hypertension, and cardiovascular conditions (7, 8). As the academic pressures and lifestyle changes associated with college life intensify, the need for effective strategies to mitigate sleep disturbances has become increasingly urgent, highlighting the necessity for ongoing research in this critical area.

The causes of sleep disturbance among university students are multifactorial. Academic pressure, social life, and environmental factors are some of the most common causes of sleep disturbance among adolescents. Lifestyle factors such as smoking, alcohol consumption, and caffeine intake can also contribute to sleep disturbance (9). The use of electronic devices, such as smartphones and laptops, is able to disrupt sleep patterns (10). Primary headaches, prevalent among younger populations, can negatively impact sleep quality (11). In addition, there is a significant relationship between sleep disturbance and psychology. Psychological factors such as anxiety, depression, and stress can lead to sleep disturbance (3, 12). Conversely, sleep disturbance can exacerbate psychological problems. Namely, poor sleep quality can increase the risk of developing mood disorders such as depression and anxiety (13).

Notably, a predictive model can help identify adolescents who are at high risk of developing sleep disturbance, and the model can be established based on significant risk factors. By identifying students at high risk of developing sleep disturbance, interventions can be implemented to prevent the development of sleep disturbance. However, the existing literature on predicting severe sleep disturbance is limited, primarily due to the absence of reliable tools. The last decade saw major progress in the field of machine learning with the increase in processing power, and it has emerged as a promising tool for the diagnosis and treatment of sleep problems (1416). Machine learning algorithms can analyze large amounts of data, identify patterns and relationships, and predict outcomes, making them ideal for analyzing sleep data.

Therefore, this study aims to develop and validate an artificial intelligence (AI) tool to assess the risk of experiencing severe sleep disturbance using machine learning algorithms for adolescents. By identifying individuals who are at risk for developing sleep disorders, healthcare providers can offer early intervention and treatment, reducing the risk of sleep disturbance and thus further improving overall health outcomes. As technology continues to advance, AI prediction tool will become increasingly important approaches in the management of sleep disturbance.

Methods

Participants and study design

This study analyzed 1966 university students across five institutions: Xiamen University of Technology (Xiamen), North China University of Water Resources and Electric Power (Zhengzhou), Chongqing Normal University (Chongqing), Harbin Sport University (Harbin), and Sichuan Normal University (Chengdu), during the period from September to December 2021. Participants in this study were volunteers who willingly engaged in the survey, providing responses reflective of their actual circumstances. The survey gathered information regarding their basic characteristics, lifestyle choices, exercise habits, and psychological well-being. Only those participants who consented to participate and were on track for timely graduation were included in the analysis. To ensure accessibility for university students, the survey was conducted online. Of all enrolled participants, 80% were randomly selected as the training set (n=1572), and the remaining 20% were treated as the validation set (n=394). Participants in the training set were used to build the machine learning models. On the other hand, participants in the validation set were used to evaluate and validate the performance of the models. The study protocol was approved by the Academic Committee and Ethics Board of the Xiamen University of Technology (No. 202001), and informed consent was obtained from all subjects or legal guardians before filling the questions in the survey. Participants were all informed that their personal information was not identified and collected, and all data were anonymous. The study was abided by the Declaration of Helsinki.

Collection of clinical characteristics

This study collected participant’s basic characteristics (age, gender, grade, and marital status), lifestyle (number of cigarettes per day, drinking frequency per week, monthly expense, and prefer eating oily food, barbecue, vegetable, and fruit), sport habit (sedentary time and sport frequency per week), chronic disease, and psychological health (anxiety, depression, and stress), history of sleep disorder, and history of mental distress after thoroughly searching for literature and in terms of availability of variables (3, 12, 1719). Anxiety was evaluated using the generalized anxiety disorde-7 (GAD-7) (20, 21), and this scale was ranged from 0 to 21 with 0 to 4 indicating none anxiety, 5 to 9 indicating mild anxiety, 10 to 13 indicating moderate anxiety, and 14 and above indicating severe anxiety. In this study, the Cronbach α of GAD-7 was 0.939. Participant’s depression was assessed using the patient health questionnaire-9 (PHQ-9) with the score range of 0 to 27 (20, 21). In this scale, 0 to 4 were categorized as none depression, 5-9 mild depression, 10-14 moderate depression, 15-19 moderate-to-severe depression, and 20-27 severe depression. In the present study, the PHQ-9 had an internal consistency (Cronbach α) of 0.923. Stress was measured using depression anxiety stress scale-21 (DASS-21), and in the subscale to evaluate stress condition, the total score was the two times of the sum of seven questions in the DASS-21 (22). Thus, the stress score ranged from 0 to 41 with a higher score suggesting severer stress. To elaborate, a score of 14 and below indicates normal status, 15-18 indicates mild stress, 19-25 indicates moderate stress, and 26-33 indicates severe stress, and 34-41 indicates extremely severe stress. The stress score had a Cronbach α of 0.950 in the study.

Definition of serve sleep disturbance

Participant’s sleep quality was evaluated using the Pittsburgh Sleep Quality Index (PSQI) (23). The PSQI is a 19-item scale which is a retrospectively self-report questionnaire to assess seven fields during the past seven days, including sleep latency, habitual sleep efficiency, sleep duration, sleep disturbances, subjective sleep quality, use of sleep medications, and daytime dysfunction. Each item has a score range from 0 representing no difficulty to 3 representing severe difficulty, and after summing the scores of all items, the global score is ranged from 0 to 21. Since the PSQI is a self-report questionnaire, sleep disturbances reflect the subjective experiences of the respondents in our study. Sleep disturbance was defined as the PSQI of above 5 and in the study severe sleep disturbance was defined that participants with the PSQI of above 10 (6, 2426). The PSQI had an internal consistency (Cronbach α) of 0.746 in the present study, and demonstrated favorable sensitivity.

Modelling and validation

In the study, we used SMOTETomek, a resampling strategy, to address the effects of imbalanced data distribution to produce a robust model. The SMOTETomek is a combination of Synthetic Minority Oversampling Technique and Tomek Links Undersampling. Participants in the training set were utilized to establish models, and the logistic regression (LR) model and five machine learning algorithms, including the eXtreme Gradient Boosting machine (XGBM), Naïve Bayesian (NB), Support Vector Machine (SVM), Decision Tree (DT), and CatBoosting Machine (CatBM), were utilized to develop machine learning models. Whereas, those in the validation set were used to validate models, and area under the curve (AUC) with applying 100 bootstraps, calibration curve, accuracy, precision, recall, F1 score, Brier score, log loss, and decision curve were severed as evaluation metrics. Machine learning algorithms was applied using Python (version 3.9.7), and hyper parameters tuning tool was based on Python scikit learn (version 1.2.2). The Brier score is a metric used to evaluate the accuracy of probabilistic predictions, particularly in the context of binary outcomes (27). It calculates the mean squared difference between predicted probabilities and actual outcomes, with lower scores indicating better predictive performance. To improve the clinical applicability of predictive models, Shapley additive explanation (SHAP) values are utilized to identify the importance of various features within the model (2830). SHAP values offer insights into how each feature contributes to the predictions, enabling clinicians to understand which factors are most influential in determining outcomes.

Establishment of an innovative web-based AI model

The design of the web-based AI model interface was crafted to enable users to efficiently input patient data and obtain accurate predicted probabilities. It features user-friendly panels that facilitate the selection of model parameters, probability calculations, and easy access to comprehensive information about the underlying model. The primary objective of the interface is to provide a captivating and interactive experience, enhancing users’ ability to interpret and evaluate the likelihood of severe sleep disturbances.

Comparative analysis: assessing the predictive performance of the AI tool vis-à-vis medical experts

To ascertain the efficacy of the AI tool, a comparative study was conducted pitting the tool against seasoned psychologists with extensive experience in the field. Five esteemed psychologists participated in this study independently, offering their individual predictions concerning the risk of severe sleep disturbance. This study provided 100 participants, whom the psychologists assessed based on their experience to evaluate the risk of severe sleep disturbance. Subsequently, by comparing the predicted outcomes with the actual status of sleep disturbance, the AUC value was used as an evaluation metric for the predictive performance of each expert.

Statistical analysis

This study summarized the continuous variables as the format of average and standard deviation (SD); the categorical variables were presented as the format of proportions. Chi-square test was used to compare the distribution of categorical variables, and student t test or Wilcoxon rank test was used to make the comparison of continuous variables. All statistical analysis was conducted using R language program (version 4.1.2). A P value of less than 0.05 was considered as significant with two sides.

Results

Participant’s basic characteristics

A total of 1969 participants with an average age of 19.65 years (SD: 1.71) were enrolled for analysis (Table 1). Of all enrolled participants, 55.2% were female, 47.2% were second grade, and 76.8% were single. The majority of participants were non-current smoker (95.2%), non-current drinker (86.4%), and had a monthly expense of less than 2000 yuan (79.1%). Regarding eating habit, the proportion of preference to eat oily food, barbecue, vegetable, and fruit were 26.0%, 28.9%, 49.3%, and 57.6%, respectively. Regarding sport, 78.7% participants did sport once a week or above, and 76.5% participants had sedentary time of three hours or above a day. In addition, only 4.1% of participants had chronic disease.

Table 1
www.frontiersin.org

Table 1. Participant’s characteristics and a comparison stratified by the presence of severe sleep disturbance among university students.

Mental health and quality of sleep

In the entire population, the average of GAD-7 was 3.26, and 31.3% participants had mild or above anxiety. As for depression, the average PHQ-9 was 4.17, and 37.8% participants had mild or above depression. The means stress score was 7.99, and 17.7% participants had mild or above stress. The history of sleep disorder and mental distress is not common, because the two accounted for 2.7% and 2.3%, respectively. The average PSQI was 5.54, and 5.28% (104/1969) participants had severe sleep disturbance.

Analysis of participants categorized by the presence of severe sleep disturbance

Individuals experiencing severe sleep disturbances were found to exhibit a higher frequency of alcohol consumption per week (P=0.006) (Table 1), increased monthly expenditures (P<0.001), a preference for consuming barbecued food (P=0.006), the presence of chronic illnesses (P=0.002), heightened levels of anxiety (P<0.001), depression (P<0.001), and stress (P<0.001), as well as a history of sleep disorders (P<0.001) or psychological distress (P<0.001). Thus, the above variables were used as input features for modelling.

Evaluation of models

The prediction performance was evaluated using AUC, calibration curve, accuracy, precision, recall, F1 score, Brier score, and log loss. Figure 1 shows AUC of all models after applying 100 bootstraps, and it demonstrated that the XGBM model performed best in AUC (0.872 [95%CI: 0.848-0.896]), followed by the CatBM model (0.853 [95% CI: 0.821-0.878]) and DT model (0.843 [95% CI: 0.801-0.870]). However, the NB model was the worst in AUC (0.736 [95% CI: 0.687-0.769]), and the LR model was the second worst in AUC (0.822 [95% CI:0.777-0.856]). Figure 2 shows the calibration curves of all models, and it proved that the most of models, in particular the XGBM model, had favorable calibrating ability. Less overlap between participants with and without severe sleep disturbance was observed, especially in the XGBM, DT, and CatBM models (Figure 3). This result denoted that good separation of predicted risk was achieved in the three models between participants who had severe sleep disturbance and who had not. By contract, relatively large overlap existed in the LR, NB, and SVM models.

Figure 1
www.frontiersin.org

Figure 1. The area under the curve for all developed models after applying 100 bootstraps.

Figure 2
www.frontiersin.org

Figure 2. Calibration curve for all developed models.

Figure 3
www.frontiersin.org

Figure 3. Density curves for all developed models. (A) Logistic regression; (B) XGBoosting Machine; (C) Naïve Bayesian; (D) Support Vector Machine; (E) Decision Tree; (F) CatBoosting Machine. The green curve indicates patients without severe sleep disturbance, and the red curve indicates patients with severe sleep disturbance.

More metrics are summarized in Table 2 and Figure 4. The XGBM model also had the best accuracy (0.792), precision (0.780), F1 score (0.796), Brier score (0.143), and log loss (0.444). Although the CatBM performed the best in recall (0.815), the recall of XGBM was also good (0.812). Thus, the XGBM was the optimal model based on the above findings. In addition, to assess the goodness of different models, we first calculated the net benefit for each model at different threshold probabilities. The net benefit considered the consequences of true positives (benefit) and false positives (harm) in making predictions. Next, we plotted the decision curves for each model, with the x-axis representing the threshold probability and the y-axis representing the net benefit. We were able to compare the decision curves of different models to assess their relative performance, when putting the decision curves of all models together. The XGBM model had the best clinical net benefits (Figure 5), as its decision curve had higher net benefit over a wide range of threshold probabilities, indicating that the model provided more accurate predictions, which was able to minimize false positives while maximize true positives.

Table 2
www.frontiersin.org

Table 2. Prediction performance of models to estimate the risk of severe sleep disturbance among university students.

Figure 4
www.frontiersin.org

Figure 4. Evaluation metrics of prediction performance for all developed models. (A) Accuracy; (B) Precision; (C) Recall; (D) F1 score; (E) Brier; (F) Log loss.

Figure 5
www.frontiersin.org

Figure 5. Decision curve analysis for all developed models. It examined the net benefit of using a model for predicting outcomes across a range of threshold probabilities.

Feature importance

SHAP-based feature importance analysis showed that the top four important model features in the XGBM model were depression, stress, monthly expense, and anxiety (Figure 6). This finding indicated that participant’s mental health was closely related to their quality of sleep. Figure 7 confirms that the PSQI was significantly associated with GAD-7 (P<0.001), PHQ-9 (P<0.001), and stress score (P<0.001). In addition, participants with the severe sleep disturbance had significantly higher GAD-7 (P<0.001), PHQ-9 (P<0.001), and stress score (P<0.001) than patients without the severe sleep disturbance. Participants with severe sleep disturbance had significantly higher PSQI than patients without severe sleep disturbance (12.35 vs. 5.16). Similar tendency was also observed in the seven subscales of the PSQI (Figure 8).

Figure 6
www.frontiersin.org

Figure 6. Feature importance using the SHAP analysis.

Figure 7
www.frontiersin.org

Figure 7. Association between sleep quality and mental health. (A) Relationship between PSQI and GAD-7; (B) Relationship between PSQI and PHQ-9; (C) Relationship between PSQI and stress. Red indicates participants with severe sleep disturbance; Green indicates participants without severe sleep disturbance. GAD-7, Generalized anxiety disorde-7; PHQ-9, Patient health questionnaire; PSQI, Pittsburgh Sleep Quality Index.

Figure 8
www.frontiersin.org

Figure 8. The distribution of the seven subscales of the PSQI between participants with and without severe sleep disturbance. Red indicates participants with severe sleep disturbance; Green indicates participants without severe sleep disturbance.

Applicability of the AI tool

We have developed a user-friendly, web-based AI tool designed to evaluate the risk of severe sleep disturbance, and the code can be available at https://github.com/Starxueshu/severe_sleep_disturbance. For example, a university student does not consume alcohol, has a monthly expense ranging from 0 to 1999 RMB, does not enjoy eating barbecue, has no chronic diseases, experiences moderate anxiety and moderate-to-severe depression, endures severe stress, and has no history of sleep disorders or mental distress. By inputting the above data into the AI tool, we can determine that the predicted risk for this individual to suffer from severe sleep disturbance is 86.95%. In addition, the predictive accuracy of the five psychologists was notably subpar, with AUC3 values ranging between 0.643 and 0.722. This performance was significantly inferior compared to the AI tool’s AUC value of 0.872 (Figure 9), highlighting the AI tool’s superior predictive capabilities.

Figure 9
www.frontiersin.org

Figure 9. The area under the curve for a comparison of prediction performance between human and the AI tool.

Discussion

Principal findings

The study established and validated an AI tool to predict the risk of severe sleep disturbance among adolescents. The AI tool was developed based on the XGBM model, which performed the best with the AUC of 0.872. This tool considered various psychological and lifestyle factors, enabling early identification and intervention for sleep-related issues in this population. This tool can be used by healthcare professionals, parents, and educators to identify individuals at risk and provide timely interventions.

Risk factors related to sleep disturbance

In the present study, we found that the risk factors that were relevant to severe sleep disturbance included drinking, monthly expense, barbecue, chronic disease, anxiety, depression, stress, and history of sleep disorder and mental distress. In addition, preferring to eating oily food tended to be a risk factor, and loving sport tended to be a protective factor, but the two factors were not significant. Previous studies have shown that alcohol consumption was a significant contributor to poor quality of sleep (17, 18), and this was consistent with our findings. Additionally, individuals who tended to feel more alert upon waking tended to consume more alcohol on average (17). Individuals who spend more money each month were more likely to experience poor sleep quality and insomnia. This may be due to financial stress and worry, as well as the lifestyle factors that often accompany high levels of spending. One study found that individuals who reported high levels of debt and financial strain were more likely to experience insomnia and other sleep disorders (19). Research has shown that sleep disorders were associated with an increased risk of developing a variety of chronic diseases, such as diabetes, hypertension, and cardiovascular disease. One of the main ways in which sleep disorders contribute to chronic diseases is through their effect on the body’s hormonal, metabolic systems, and inflammation (31, 32).

In the present study, the SHAP analysis demonstrated that the top four important model features were depression, stress, monthly expense, and anxiety, indicating the importance of mental health in impacting quality of sleep among university students. Mental health could have a significant impact on the sleep disturbance among college students. Conversely, sleep disturbance was able to intrigue and exacerbate psychological problems (13). Studies have shown that poor global sleep quality could be functioned as a mediator of the prospective bidirectional anxiety-depression relationship (33). Some studies also pointed out that gender, age, and smoking might be risk factors, and eating fruit could be a protective factor (34).

Applications of AI in sleep disorders

AI has been used in the field of sleep disorders (35). For example, machine learning can be used to analyze sleep data and identify patterns that can be used to diagnose and treat insomnia. In 2021, Kusmakar et al. (36) proposed a novel AI model based on the actigraphy signals to assess chronic insomnia after analyzing 40 cohabiting couples with one partner seeking treatment for insomnia. More recently, Japanese researchers utilized machine learning algorithms to establish models to predict comorbid insomnia among breast cancer patients using a nationwide questionnaire survey, and the AUC of the optimal model was 0.76 (37). Additionally, machine learning was used to diagnose sleep apnea after analyzing sleep data, such as electrocardiographic, oximetric, and polysomnographic recordings. For instance, Simegn et al. (38) used machine learning algorithms to develop an automatic sleep apnea, a potentially serious sleep disorder and characterized by breathing pauses during sleep, and evaluate the severity classification based on the electrocardiograph recordings and saturation of oxygen signals, and the AUC of the model was not assessed in the original study. Zhuang et al. (39) developed a detection framework to assess sleep apnea with the polysomnography data from the radar system after using random forest machine learning, and the accuracy of the detection framework was up to more than 95%. In addition, after summarizing 63 studies undergoing diagnostic model development, a systematic review found that the best AUC was 0.98 in a logistic model with age, waist circumference, Epworth Sleepiness Scale score, and oxygen saturation being model features (40). Interestingly, Kim et al. (41) used a wearable digital device to collect circadian rhythm-based features and proposed a machine learning-based prediction model for assessing attention-deficit and sleep problems among children, and the AUC of model to predict sleep problems was 0.737.

However, the majority of the above machine learning models were developed using the data from actigraphic signals, electrocardiograph recordings, saturation of oxygen signals, and polysomnography, wearable digital devices, making those models hard to be widely used among general populations to screen patients at the high risk of experiencing severe sleep disorders. Furthermore, those models were not developed especially for adolescents, and thus their effectiveness might be limited in this population. Notably, a study developed a prediction model after investigating potential correlated factors, and the model was established using machine learning techniques with age, number of cups of tea, electronics usage hours, headache, other systematic diseases, and neck pain being model features. But the optimal machine learning model was random forest model with an AUC of only 0.74 (42). In addition, we previously developed a machine learning-based model to assess sleep disturbance among college students, achieving an optimal AUC value of 0.779 (43). In the present study, we specifically focused on severe sleep disturbance, and our results demonstrate improved predictive performance, with the new model attaining a maximum AUC value of 0.872, indicating enhanced predictive power. Overall, this research presents a more effective model for identifying severe sleep disturbance, thereby increasing its clinical relevance.

With AI assistance, the risk of sleep disturbances among university students has been identified. Based on previous literature, those at high risk of sleep disorders should establish a regular sleep routine, avoiding daytime naps, and limiting caffeine and alcohol, especially in the evening. Creating a quiet, dark, and cool sleep environment while minimizing electronic distractions is also crucial. Relaxation techniques like deep breathing or meditation may help those who struggle to fall asleep. Low-risk individuals should maintain good sleep habits, avoid late-night screen time, reduce stress, and engage in regular physical activity. They can optimize their sleep environment with a comfortable mattress, pillows, and by using white noise or blackout curtains. In both cases, consulting a healthcare provider or sleep specialist may be necessary if sleep problems persist despite these measures.

In addition, our study demonstrated that abstaining from drinking, less monthly expense, avoiding barbecue and oily food, treating chronic disease, loving sports, and alleviating anxiety, depression, and stress are able to do some help to improve quality of sleep. Therefore, interventions such as counseling, lifestyle changes, and behavioral therapies can be implemented to prevent the development of sleep disturbance. Furthermore, based on previous studies, interventions for sleep disorders in college students, such as cognitive-behavioral therapy and sleep hygiene education, have shown effectiveness in improving sleep quality (44, 45). However, evidence on the effectiveness of sleep education remains insufficient (46). Additional strategies include relaxation techniques, physical activity, and exposure to natural light (47). Overall, these interventions and preventive measures can be effective in addressing sleep disorders in college students and improving overall well-being.

Limitations

Several limitations still exist in the study. To begin with, the data collected for the study might be biased due to self-reporting, and thus recall bias was hardly be avoided and it might affect the accuracy of the results. Secondly, although this study collected extensive features in terms of demographics, sports, lifestyles, and mental conditions, it might not capture all relevant variables that contribute to sleep disorders among college students. Thirdly, the study might not be able to establish a causal relationship between the identified predictors and sleep disorders among college students, due to confounding variables or the design of the study. Fourthly, polysomnography remains the sole objective method for evaluating sleep disorders; in contrast, other validated questionnaires, such as PSQI used in the study, often exhibit various limitations, including a notable degree of subjectivity. Lastly, the model used in the study might not be generalizable to other populations or contexts, which may limit the utility of the findings. Therefore, although this study had a relatively large size of sample and the model had favorable prediction performance, this study still needs wide external validation.

Conclusions

The XGBM model can be a favorable method to estimate the risk of severe sleep disturbance among university students, and the online calculator is able to be used as a screen tool to individually identify those who are at high risk of sleep disturbance. Thus, earlier intervention and improved outcomes can be achieved. This study also demonstrates that Participants with severe sleep disturbance usually suffer from poor psychological health, and abstaining from drinking, less monthly expense, avoiding barbecue, treating chronic disease, and alleviating anxiety, depression, and stress are able to do some help to improve quality of sleep among university students.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the Academic Committee and Ethics Board of the Xiamen University of Technology (No. 202001). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

LZ: Funding acquisition, Investigation, Supervision, Validation, Writing – review & editing. SZ: Supervision, Validation, Writing – review & editing. WY: Supervision, Validation, Writing – review & editing. ZY: Supervision, Validation, Writing – review & editing. ZW: Supervision, Validation, Writing – review & editing. HZ: Formal analysis, Project administration, Supervision, Validation, Writing – review & editing. ML: Conceptualization, Formal analysis, Investigation, Methodology, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This study was funded by the teaching reform research project of Xiamen University of Technology (JYCG202459) and National Social Science General Project (24BTY029).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

AUC, Area under the curve; SD, Standard deviation; GAD-7, Generalized anxiety disorde-7; PHQ-9, Patient health questionnaire; PSQI, Pittsburgh Sleep Quality Index; Logistic regression, LR; XGBoosting machine, XGBM; Naïve Bayesian, NB; Support Vector Machine, SVM; Decision Tree, DT; CatBoosting Machine, CatBM; SHAP, Shapley additive explanation; CI, Confident interval; DASS-21, Depression anxiety stress scale-21.

References

1. Alotaibi AD, Alosaimi FM, Alajlan AA, Bin Abdulrahman KA. The relationship between sleep quality, stress, and academic performance among medical students. J Family Community Med. (2020) 27:23–8. doi: 10.4103/jfcm.JFCM_132_19

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

2. Gaultney JF. The prevalence of sleep disorders in college students: impact on academic performance. J Am Coll Health. (2010) 59:91–7. doi: 10.1080/07448481.2010.483708

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

3. Al-Khani AM, Sarhandi MI, Zaghloul MS, Ewid M, Saquib N. A cross-sectional survey on sleep quality, mental health, and academic performance among medical students in Saudi Arabia. BMC Res Notes. (2019) 12:665. doi: 10.1186/s13104-019-4713-2

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

4. Brown WJ, Wilkerson AK, Boyd SJ, Dewey D, Mesa F, Bunnell BE. A review of sleep disturbance in children and adolescents with anxiety. J Sleep Res. (2018) 27:e12635. doi: 10.1111/jsr.2018.27.issue-3

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

5. Lund HG, Reider BD, Whiting AB, Prichard JR. Sleep patterns and predictors of disturbed sleep in a large population of college students. J Adolesc Health. (2010) 46:124–32. doi: 10.1016/j.jadohealth.2009.06.016

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

6. Liu X, Lang L, Wang R, Chen W, Ren X, Lin Y, et al. Li T et al: Poor sleep quality and its related risk factors among university students. Ann Palliat Med. (2021) 10:4479–85. doi: 10.21037/apm-21-472

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

7. Marjot T, Ray DW, Williams FR, Tomlinson JW, Armstrong MJ. Sleep and liver disease: a bidirectional relationship. Lancet Gastroenterol Hepatol. (2021) 6:850–63. doi: 10.1016/S2468-1253(21)00169-2

PubMed Abstract | Crossref Full Text | Google Scholar

8. Reutrakul S, Van Cauter E. Sleep influences on obesity, insulin resistance, and risk of type 2 diabetes. Metabolism. (2018) 84:56–66. doi: 10.1016/j.metabol.2018.02.010

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

9. Riera-Sampol A, Rodas L, Martinez S, Moir HJ, Tauler P. Caffeine intake among undergraduate students: sex differences, sources, motivations, and associations with smoking status and self-reported sleep quality. Nutrients. (2022) 14:1661. doi: 10.3390/nu14081661

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

10. Hysing M, Pallesen S, Stormark KM, Jakobsen R, Lundervold AJ, Sivertsen B. Sleep and use of electronic devices in adolescence: results from a large population-based study. BMJ Open. (2015) 5:e006748. doi: 10.1136/bmjopen-2014-006748

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

11. Waliszewska-Prosół M, Nowakowska-Kotas M, Chojdak-Łukasiewicz J, Budrewicz S. Migraine and sleep-an unexplained association? Int J Mol Sci. (2021) 22:5539. doi: 10.3390/ijms22115539

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

12. Almojali AI, Almalki SA, Alothman AS, Masuadi EM, Alaqeel MK. The prevalence and association of stress with sleep quality among medical students. J Epidemiol Glob Health. (2017) 7:169–74. doi: 10.1016/j.jegh.2017.04.005

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

13. Celik N, Ceylan B, Unsal A, Cagan O. Depression in health college students: relationship factors and sleep quality. Psychol Health Med. (2019) 24:625–30. doi: 10.1080/13548506.2018.1546881

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

14. Elgart M, Redline S, Sofer T. Machine and deep learning in molecular and genetic aspects of sleep research. Neurotherapeutics. (2021) 18:228–43. doi: 10.1007/s13311-021-01014-9

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

15. Zhang GQ, Cui L, Mueller R, Tao S, Kim M, Rueschman M, et al. The National Sleep Research Resource: towards a sleep data commons. J Am Med Inform Assoc. (2018) 25:1351–8. doi: 10.1093/jamia/ocy064

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

16. Arslan RS, Ulutas H, Koksal AS, Bakir M, Ciftci B. Automated sleep scoring system using multi-channel data and machine learning. Comput Biol Med. (2022) 146:105653. doi: 10.1016/j.compbiomed.2022.105653

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

17. Fucito LM, Bold KW, Van Reen E, Redeker NS, O’Malley SS, Hanrahan TH, et al. Reciprocal variations in sleep and drinking over time among heavy-drinking young adults. J Abnorm Psychol. (2018) 127:92–103. doi: 10.1037/abn0000312

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

18. Thakkar MM, Sharma R, Sahota P. Alcohol disrupts sleep homeostasis. Alcohol. (2015) 49:299–310. doi: 10.1016/j.alcohol.2014.07.019

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

19. Hall M, Buysse DJ, Nofzinger EA, Reynolds CF 3rd, Thompson W, Mazumdar S, et al. Financial strain is a significant correlate of sleep continuity disturbances in late-life. Biol Psychol. (2008) 77:217–22. doi: 10.1016/j.biopsycho.2007.10.012

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

20. Xu T, Zhu P, Ji Q, Wang W, Qian M, Shi G. Psychological distress and academic self-efficacy of nursing undergraduates under the normalization of COVID-19: multiple mediating roles of social support and mindfulness. BMC Med Educ. (2023) 23:348. doi: 10.1186/s12909-023-04288-z

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

21. Sun S, Xu S, Guy A, Guigayoma J, Zhang Y, Wang Y, et al. Analysis of psychiatric symptoms and suicide risk among younger adults in China by gender identity and sexual orientation. JAMA Netw Open. (2023) 6:e232294. doi: 10.1001/jamanetworkopen.2023.2294

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

22. Wang J, Yang C, Wang J, Sui X, Sun W, Wang Y. Factors affecting psychological health and career choice among medical students in eastern and western region of China after COVID-19 pandemic. Front Public Health. (2023) 11:1081360. doi: 10.3389/fpubh.2023.1081360

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

23. Buysse DJ, Reynolds CF 3rd, Monk TH, Berman SR, Kupfer DJ. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Res. (1989) 28:193–213. doi: 10.1016/0165-1781(89)90047-4

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

24. Dietch JR, Taylor DJ, Sethi K, Kelly K, Bramoweth AD, Roane BM. Psychometric evaluation of the PSQI in U.S. College students. J Clin Sleep Med. (2016) 12:1121–9. doi: 10.5664/jcsm.6050

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

25. Gorgoraptis N, Zaw-Linn J, Feeney C, Tenorio-Jimenez C, Niemi M, Malik A, et al. Cognitive impairment and health-related quality of life following traumatic brain injury. NeuroRehabilitation. (2019) 44:321–31. doi: 10.3233/NRE-182618

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

26. Harrison L, Wilson S, Heron J, Stannard C, Munafò MR. Exploring the associations shared by mood, pain-related attention and pain outcomes related to sleep disturbance in a chronic pain sample. Psychol Health. (2016) 31:565–77. doi: 10.1080/08870446.2015.1124106

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

27. Rufibach K. Use of Brier score to assess binary predictions. J Clin Epidemiol. (2010) 63:938–939; author reply 939. doi: 10.1016/j.jclinepi.2009.11.009

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

28. Nohara Y, Matsumoto K, Soejima H, Nakashima N. Explanation of machine learning models using shapley additive explanation and application for real data in hospital. Comput Methods Programs BioMed. (2022) 214:106584. doi: 10.1016/j.cmpb.2021.106584

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

29. Lei M, Wu B, Zhang Z, Qin Y, Cao X, Cao Y, et al. A web-based calculator to predict early death among patients with bone metastasis using machine learning techniques: development and validation study. J Med Internet Res. (2023) 25:e47590. doi: 10.2196/47590

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

30. Cui Y, Shi X, Qin Y, Wan Q, Cao X, Che X, et al. Establishment and validation of an interactive artificial intelligence platform to predict postoperative ambulatory status for patients with metastatic spinal disease: a multicenter analysis. Int J Surg. (2024) 110:2738–56. doi: 10.1097/JS9.0000000000001169

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

31. Irwin MR, Olmstead R, Carroll JE. Sleep disturbance, sleep duration, and inflammation: A systematic review and meta-analysis of cohort studies and experimental sleep deprivation. Biol Psychiatry. (2016) 80:40–52. doi: 10.1016/j.biopsych.2015.05.014

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

32. Grandner MA, Chakravorty S, Perlis ML, Oliver L, Gurubhagavatula I. Habitual sleep duration associated with self-reported and objectively determined cardiometabolic risk factors. Sleep Med. (2014) 15:42–50. doi: 10.1016/j.sleep.2013.09.012

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

33. Nguyen VV, Zainal NH, Newman MG. Why sleep is key: poor sleep quality is a mechanism for the bidirectional relationship between major depressive disorder and generalized anxiety disorder across 18 years. J Anxiety Disord. (2022) 90:102601. doi: 10.1016/j.janxdis.2022.102601

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

34. St-Onge MP, Mikic A, Pietrolungo CE. Effects of diet on sleep quality. Adv Nutr. (2016) 7:938–49. doi: 10.3945/an.116.012336

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

35. Mallett J, Arnardottir ES. Improving machine learning technology in the field of sleep. Sleep Med Clin. (2021) 16:557–66. doi: 10.1016/j.jsmc.2021.08.003

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

36. Kusmakar S, Karmakar C, Zhu Y, Shelyag S, Drummond SPA, Ellis JG, et al. A machine learning model for multi-night actigraphic detection of chronic insomnia: development and validation of a pre-screening tool. R Soc Open Sci. (2021) 8:202264. doi: 10.1098/rsos.202264

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

37. Ueno T, Ichikawa D, Shimizu Y, Narisawa T, Tsuji K, Ochi E, et al. Comorbid insomnia among breast cancer survivors and its prediction using machine learning: a nationwide study in Japan. Jpn J Clin Oncol. (2022) 52:39–46. doi: 10.1093/jjco/hyab169

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

38. Simegn GL, Nemomssa HD, Ayalew MP. Machine learning-based automatic sleep apnoea and severity level classification using ECG and SpO(2) signals. J Med Eng Technol. (2022) 46:148–57. doi: 10.1080/03091902.2022.2026503

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

39. Zhuang Z, Wang F, Yang X, Zhang L, Fu CH, Xu J, et al. Accurate contactless sleep apnea detection framework with signal processing and machine learning methods. Methods. (2022) 205:167–78. doi: 10.1016/j.ymeth.2022.06.013

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

40. Ferreira-Santos D, Amorim P, Silva Martins T, Monteiro-Soares M, Pereira Rodrigues P. Enabling early obstructive sleep apnea diagnosis with machine learning: systematic review. J Med Internet Res. (2022) 24:e39452. doi: 10.2196/39452

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

41. Kim WP, Kim HJ, Pack SP, Lim JH, Cho CH, Lee HJ. Machine learning-based prediction of attention-deficit/hyperactivity disorder and sleep problems with wearable data in children. JAMA Netw Open. (2023) 6:e233502. doi: 10.1001/jamanetworkopen.2023.3502

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

42. Alghwiri AA, Almomani F, Alghwiri AA, Whitney SL. Predictors of sleep quality among university students: the use of advanced machine learning techniques. Sleep Breath. (2021) 25:1119–26. doi: 10.1007/s11325-020-02150-w

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

43. Zhang L, Zhao S, Yang Z, Zheng H, Lei M. An artificial intelligence platform to stratify the risk of experiencing sleep disturbance in university students after analyzing psychological health, lifestyle, and sports: A multicenter externally validated study. Psychol Res Behav Manag. (2024) 17:1057–71. doi: 10.2147/PRBM.S448698

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

44. Carney CE, Edinger JD, Kuchibhatla M, Lachowski AM, Bogouslavsky O, Krystal AD, et al. Cognitive behavioral insomnia therapy for those with insomnia and depression: A randomized controlled clinical trial. Sleep. (2017) 40:zsx019. doi: 10.1093/sleep/zsx019

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

45. Hershner S, O’Brien LM. The impact of a randomized sleep education intervention for college students. J Clin Sleep Med. (2018) 14:337–47. doi: 10.5664/jcsm.6974

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

46. Dietrich SK, Francis-Jimenez CM, Knibbs MD, Umali IL, Truglio-Londrigan M. Effectiveness of sleep education programs to improve sleep hygiene and/or sleep quality in college students: a systematic review. JBI Database System Rev Implement Rep. (2016) 14:108–34. doi: 10.11124/JBISRIR-2016-003088

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

47. Dumont M, Beaulieu C. Light exposure in the natural environment: relevance to mood and sleep disorders. Sleep Med. (2007) 8:557–65. doi: 10.1016/j.sleep.2006.11.008

PubMed Abstract | PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: sleep disturbance, adolescents, machine learning, epidemiology, prediction model, Pittsburgh sleep quality index

Citation: Zhang L, Zhao S, Yang W, Yang Z, Wu Z, Zheng H and Lei M (2024) Utilizing machine learning techniques to identify severe sleep disturbances in Chinese adolescents: an analysis of lifestyle, physical activity, and psychological factors. Front. Psychiatry 15:1447281. doi: 10.3389/fpsyt.2024.1447281

Received: 27 June 2024; Accepted: 21 October 2024;
Published: 07 November 2024.

Edited by:

Qing Liu, Central South University, China

Reviewed by:

Marta Waliszewska-Prosół, Wroclaw Medical University, Poland
Ying Han, Peking University, China

Copyright © 2024 Zhang, Zhao, Yang, Yang, Wu, Zheng and Lei. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lirong Zhang, 22674481@qq.com; Mingxing Lei, leimingxing@301hospital.com.cn

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.