Identifying the most crucial factors associated with depression based on interpretable machine learning: a case study from CHARLS

Background: Depression is one of the most common mental illnesses among middle-aged and older adults in China. It is of great importance to find the crucial factors that lead to depression and to effectively control and reduce the risk of depression. Currently, there are limited methods available to accurately predict the risk of depression and identify the crucial factors that influence it.

Methods: We collected data from 25,586 samples from the harmonized China Health and Retirement Longitudinal Study (CHARLS), and the latest records from 2018 were included in the current cross-sectional analysis. Ninety-three input variables in the survey were considered as potential influential features. Five machine learning (ML) models were utilized, including CatBoost and eXtreme Gradient Boosting (XGBoost), Gradient Boosting decision tree (GBDT), Random Forest (RF), Light Gradient Boosting Machine (LightGBM). The models were compared to the traditional multivariable Linear Regression (LR) model. Simultaneously, SHapley Additive exPlanations (SHAP) were used to identify key influencing factors at the global level and explain individual heterogeneity through instance-level analysis. To explore how different factors are non-linearly associated with the risk of depression, we employed the Accumulated Local Effects (ALE) approach to analyze the identified critical variables while controlling other covariates.

Results: CatBoost outperformed other machine learning models in terms of MAE, MSE, MedAE, and R²metrics. The top three crucial factors identified by the SHAP were r4satlife, r4slfmem, and r4shlta, representing life satisfaction, self-reported memory, and health status levels, respectively.

Conclusion: This study demonstrates that the CatBoost model is an appropriate choice for predicting depression among middle-aged and older adults in Harmonized CHARLS. The SHAP and ALE interpretable methods have identified crucial factors and the nonlinear relationship with depression, which require the attention of domain experts.

1 Introduction

Population aging is one of the most concerned public health issues. It is predicted that by 2050, China’s elderly population will increase substantially, with more than 400 million people over 65 (Zeng, 2012). Aging leads to a variety of negative health effects, which include an increased risk of depression (Qiu et al., 2020). A report conducted by the World Health Organization showed that depression was ranked as the single largest contributor to non-fatal health loss, and 7% of old adults suffered from depression (World Health Organization, 2017). Moreover, depression can lead to a decline in physical function, lower quality of life, and increased health costs, which will seriously affect the physical and psychiatric health of middle-aged and older adults. In this context, predicting the risk of depression and analyzing the critical predictors of risk formation is crucial for disease control and improving quality of life.

At present, there have been many empirical methods focusing on factors related to depression in middle-aged and older adults (Yunming et al., 2012). Typically, Luo et al. (2023) used binary logistic regression to examine the correlation between dietary diversity, exercise, and depressive symptoms. They showed that a score on the Dietary Diversity Scale and qualified physical activity were protective factors against depressive symptoms among middle-aged women. Jung et al. (2015) conducted multivariable logistic regression and calculated odds ratios to assess potential interactions between depression prevalence and the ages of menarche and menopause. The results found that the odds ratio of depression decreased with increasing age of menopause and duration of reproductive years. However, the above studies have mainly focused on the relationship between physiological aspects and depression.

In addition, some scholars have focused on the relationship between family factors and depression. McMunn et al. (2021) examined the relationship between work-family and middle-aged psychological distress by multivariable logistic regression. They found that middle-aged people with weaker long-term employment relationships had poorer mental health and well-being. Giannelis et al. (2021) used logistic regression to estimate the relationship between family status and depression; the results showed that a higher number of children and lack of cohabitation with a spouse or partner were associated with a greater likelihood of depression. Therefore, since depression has multiple and complex influences, this study comprehensively considered multiple factors such as demographic variables, health status, cognitive status, income, family structure, stress, and life satisfaction.

At the same time, several related studies also focused on the construction of risk prediction models for depression. For example, Zhou et al. (2023) utilized the Kaplan–Meier method and Cox proportional hazards regression model to evaluate the relationship between baseline chronic disease and depression. They found that suffering from different degrees of chronic diseases increased the risk of depression in middle-aged and older adults. Luo et al. (2018) used the Cox proportional hazards model to estimate the relationship between obesity status and depression. They discovered a negative correlation between the relationship between body weight and depression. Kimmel et al. (2000) used Cox proportional hazards regression analysis to predict the mortality hazard associated with depression in chronic hemodialysis outpatients. They found that medical deterioration factors may increase depression. Zhou et al. (2021) used Cox proportional hazards regression models to examine the association between socioeconomic status and the incidence of depression. They found that participants with the highest level of household income had a 20% reduction in risk of depression. Xiang and Wang (2021) used competing risks regression analysis to examine the relationship between childhood adversity and major depression in older adults and found that childhood adversity increased the risk of major depression in later life, especially for those who experienced physical abuse. In the above studies, the risk regression model was able to assess the relationship between depression and risk factors.

However, while parametric models can well illustrate the association between depression and risk factors, many risk-analysis studies have found that these models are still suboptimal when faced with complex relationships and high-dimensional inputs, and machine learning is relatively better (Hao et al., 2019; Luo and Qi, 2021). Recent studies have demonstrated that machine learning methods outperformed traditional linear models regarding nonlinear fitting performance (Zhang et al., 2018). Machine learning is better equipped to identify the relationship between input and output when dealing with multiple inputs or explanatory variables, resulting in more outstanding performance. For example, Lin et al. (2023) classified the trajectories of depressive symptoms via the latent class growth model and growth mixture model. Based on the identified trajectory patterns, three ML classification algorithms, i.e., gradient-enhanced decision tree, support vector machine, and random forest, demonstrated that machine learning could be very robust in predicting depressive symptom onset and developmental trajectory. However, machine learning is often criticized as the ‘black box’ due to its numerous parameters and complex calculation process, which makes the decision-making process not transparent (Tjoa and Guan, 2021).

Therefore, in this study, we propose an idea based on identifying the most critical factors affecting depression using interpretable machine learning. For this purpose, we adopted five machine learning prediction models: Random forest (RF) (Breiman, 2001; Fawagreh et al., 2014), CatBoost (Prokhorenkova et al., 2018; Ibrahim et al., 2020), eXtreme Gradient Boosting (XGBoost) (Chen and Guestrin, 2016), Light Gradient Boosting Machine (LightGBM) (Ke et al., 2017), and Gradient Boosting decision tree (GBDT) (Friedman, 2001; Zhang and Jung, 2019) for depression risk prediction. First, we utilized demographics, cognitive, income, stress, family structure, health status, life satisfaction, and CESD-10 data collected from the China Health and Retirement Longitudinal Study (CHARLS). Then, continuous values of depression in middle-aged and older adults were predicted using demographic variables, health variables, cognitive, income, pressure, family structure, and life satisfaction from CHARLS data. Then, in the baseline experimental study, we randomly divided the dataset into 80% training dataset for model construction and 20% testing dataset for model testing and compared them with the traditional multiple linear regression (LR) model. Based on this, we used SHapley Additive exPlanations (SHAP) (Lundberg and Lee, 2017) to make an in-depth interpretation of the input variables in the prediction model and clarify the importance of each feature and their net impact on different individual cases. We further adopted the Accumulated Local Effects (ALE) (Apley and Zhu, 2020) method to estimate the nonlinear association between crucial variables and predicted depression.

The contribution of this research can be summarized into the following three aspects: (1) We proposed a depression risk prediction method under multiple factors based on the CatBoost model which outperforms traditional parametric model; (2) We proposed interpretable methods based on SHAP and ALE, and explain the decision-making process of the CatBoost model, overcoming the problem of ‘black box’; (3) We identified the most critical risk factors of depression in a hypothesis-free manner based on the interpretable machine learning framework, demonstrating the most crucial position of life satisfaction.

2 Materials and methods

2.1 Dataset

The data and information used in this study are obtained from the Harmonized CHARLS dataset and Codebook. The development of the Harmonized CHARLS was funded by the National Institute on Aging, and detailed descriptions of the survey design and procedures were reported in the original study documentation (Zhao et al., 2014).

As shown in Figure 1, in this study, all samples were selected from CHARLS fourth wave ( $\mathrm{n}=25586$ ), and variables with missing values exceeding 30% have been excluded. Finally, ninety-four variables with the proportion of missing values within 30% were used in this study. For these variables, we adopted the KNearest Neighbours (KNN) algorithm (Troyanskaya et al., 2001) to impute the missing values. Based on this, 93 explanatory variables are selected as inputs, and one variable is the prediction target.

Figure 1

Figure 1. Flow diagram of sample selection.

2.2 Outcome variables and input variables

In this study, the outcome variable is $\mathrm{r}4\mathrm{cesd}10$ , which records the continuous value of depression by using the 10-item Center for Epidemiology Studies Depression Scale (CESD-10), which has good reliability and validity among Chinese adults (Chin et al., 2015) and also showed good internal consistency among older respondents (Jiang et al., 2020). CESD-10 focuses on 10 questions about the experience in the past week: feeling depressed, feeling everything they did was effortful, feeling restless sleep, feeling happy, feeling lonely, feeling bothered, feeling they could not get “going,” feeling hopeful for the future, feeling fearful, having trouble in remember what was done. The total CESD-10 score ranged from 0 to 30, with higher scores indicating more severe depressive symptoms. In this study, the CESD-10 depression values of all the respondents were included. A respondent with depression scores of not less than 10 was considered to have depressive symptoms (Chen et al., 2023).

According to the research needs, a total of 93 input variables were selected in the fourth wave of Harmonized CHARLS, including seven categories:

1. Demographic: this category contains eight variables, including $\mathrm{rabplace}:\mathrm{C}$ (birthplace), $\mathrm{raeduc}:\mathrm{C}$ (education), r $4\mathrm{mnev}$ (never married), $\mathrm{ragender}$ (gender), r4hukou, h4cpl (a couple household), h4rural (urban or rural), r4agey (age).

2. Health status: this category contains 48 variables, including: r4psyche (ever had any emotional, nervous, or psychiatric problems), $\mathrm{r}4\mathrm{asthmae}$ (ever had asthma), r4memrye (ever had memory-related disease), r4cancre (ever had cancer), r4kidneye (ever had a kidney disease), r4stroke (ever had stroke disease), r4livere (ever had liver disease), r4diabe (ever had diabetes disease), r4lung (ever had lunge disease), r4digeste (ever had a digestive disease), r4hearte (ever had heart disease), r4hibpe (ever had high blood pressure disease), r4dyslipe (ever had dyslipidemia disease), r4arthre (ever had arthritis disease), r4drinkev (ever drinks any alcohol), r4smokev (smoking), r4vgact_c (any vigorous physical activity), r4vgactx_c (the number of days of vigorous activity), r4mdact_c (any moderately physical activity), r4mdactx_c (the number of days of moderate activity), r4ltact_c (any light physical activity), r4ltactx_c (the number of days of light activity), r4mealsa (preparing meals), r4phonea (making phone calls), r4moneya (managing money), r4medsa (taking medications), r4shopa (shopping), r4housewka (cleaning house), r4lowermob (lower body mobility), r4walk1kms (walking 1KM), r4chaira (getting up from a chair), r4mobilsev (7 item mobility), r4dressa (dressing), r4uppermob (3-item summary of any difficulty with upper-body mobility activities), r4stoopa (stooping, kneeling or crouching), r4adlfive (5-item summary of any difficulty with activities of daily living), r4adlab_c (6-item summary), r4adla_c (4-item summary), $\mathrm{r}4\mathrm{armsa}$ (reaching arms above shoulder level), r $4\mathrm{dlmeas}$ (picking up a coin from the table), r $4\mathrm{lifta}$ (lifting or carrying weights over ten jins), r $4\mathrm{climsa}$ (climbing several flights of stairs without resting), $\mathrm{r}4\mathrm{toilta}$ (using the toile), r4eata (eating), r4urina (controlling urination and defecation), r4batha (bathing and showering), r4beda (getting in and out of bed), r4shlta (self-reported health).

3. Family structure: this category contains 23 variables, including: h4coresd (any children with them), rameduc_c (mother’s education level), rafeduc_c (father’s education level), h4dchild (total number of deceased children), h4child (number of living children), r4dadliv (father alive), h4kcnt (contact with their children), h4lvnear (live near children), r4livpar (number of living parents), r4dadoccup_c (father’s occupation), r4momliv (the respondent’s mother is alive), h4fcamt (amount of transfers from children/grandchildren), h4tcamt (amount of transfers to children/grandchildren), h4fpamt (amount of transfers from parents/parents-in-law), h4tpamt (amount of transfers to parents/parents-in-law), h4foamt (the number of transfers from others), h4toamt (the number of transfers to others), h4frec (the total amount of transfers received), h4tgiv (the total amount of transfers given), h4ftot (net value of financial transfers), r4decsib (number of deceased siblings), r4livsib (number of living siblings), r4socwk (social activities).

4. Income: r4ipen (private pension).

5. Stress: this category contains 11 variables, including ramomdrug (female guardian had an alcohol and drug), rapadrug (guardians had alcoholism nor had a drug problem), ramwarm_c (female guardian warmth summary mean score), ramomgrela (good relationship with female guardian), ramomeft (female guardian put effort into watching over), ramomatt_c (received female guardian’s love), radaddrug (male guardian had an alcohol and drug), radadgrela (good relationship with male guardian), rafinacom (self-rated family financial situation before age 17), Rahltcom (health condition compared to other children), r4chdeathe (experienced death of own child),

6. Cognitive: r4slfmem (self-reported memory).

7. Life Satisfaction: r4satlife.

The details, including meanings and descriptive analysis of the input and outcome variables, can be found in the Supplementary material.

2.3 Predictive model development and evaluation

In this study, compared to the traditional multiple linear regression model, machine learning models of the XGBoost, GBDT, RF, CatBoost, and LightGBM were used to predict the risk of depression and generate six sets of data. Among them, the LR Model is a classic statistical algorithm. XGBoost, LightGBM, and CatBoost are the current most used tree-based algorithms, which can also be classified into the gradient-boosting decision tree algorithm series.

For the hyperparameter setting, Catboost was selected as the primary model for this study due to its excellent performance in healthy prediction-related studies (Zhang et al., 2021), and Optuna (Akiba et al., 2019) was used for optimal parameter search. In detail, for Catboost, the $\mathrm{loss}:\mathrm{function}$ is set to $\mathrm{M}\mathrm{A}\mathrm{E}$ , the $\mathrm{l}2:\mathrm{leaf}:\mathrm{r}\mathrm{e}\mathrm{g}$ is fixed to 0.0034, the $\mathrm{learning}:\mathrm{rate}$ is 0.0155, the $\mathrm{n}:\mathrm{estimators}$ is 22,148, the $\mathrm{depth}$ is 7, the $min:\mathrm{data}:\mathrm{in}:\mathrm{leaf}$ is 13. All other model parameters use the default settings from Python libraries: scikit-learn (version 1.2.2), xgboost (version 1.7.5), and lightgbm (version 4.3).

In the regression task, we used four common metrics to evaluate the models’ performances, including mean absolute error (MAE), mean square error (MSE), median absolute error (MedAE), and R-squared. For MAE, MSE, and MedAE, the smaller error, the better the model. In addition, R² measures how well the model explains the total variance of the outcome variable; the closer R² is to 1, the better the model’s fit. The calculations of these four metrics are shown in Equations 1–4.

$\begin{array}{ll}\mathrm{M}\mathrm{A}\mathrm{E}=\frac{1}{n}{\displaystyle \sum }_{i=1}^n\left|y_i-{\widehat{y}}_i\right|& (1)\end{array}$

$\begin{array}{ll}\mathrm{M}\mathrm{S}\mathrm{E}=\frac{1}{n}{\displaystyle \sum }_{i=1}^n{\left(y_i-{\widehat{y}}_i\right)}^2& (2)\end{array}$

$\begin{array}{ll}\mathrm{MedAE}=\mathrm{median}\left(\left|y_1-{\widehat{y}}_1\right|,\dots ,\left|y_n-{\widehat{y}}_n\right|\right)& (3)\end{array}$

$\begin{array}{ll}{\mathrm{R}}^2=1-\frac{{{\displaystyle \sum }}_{i=1}^n{\left(y_i-{\widehat{y}}_i\right)}^2}{{{\displaystyle \sum }}_{i=1}^n{\left(y_i-\overline{y}\right)}^2}& (4)\end{array}$

2.4 SHAP and ALE methods

Based on the comparison of model prediction effectiveness, the optimal depression risk prediction model can be selected and used as the basis for SHAP and ALE analysis. We used SHAP to find the most critical influencing factors at the entire dataset level and then explained the individual heterogeneity through local sample analysis. Further, we adopted ALE to manipulate selected variables while controlling other covariates to analyze how different factors are nonlinear and associated with depression risk.

The core idea behind SHAP is to assign a value to each feature for a specific prediction, indicating its contribution to the outcome. This approach is based on game theory’s Shapley values, which aim to fairly distribute the gains or losses among players in a cooperative game. Based on this, SHAP treats the machine learning model as a game where each feature is a player. For each prediction, the Shapley value is calculated for each feature, and the overall explanation is obtained by summing up the values for all features. Benefiting from the ability to explain both in individual samples and cumulatively, SHAP can obtain both global and local interpretability. If the SHAP value is positive, as in the case of the regression continuous outcome prediction task, it indicates that the feature increases the prediction and vice versa. A larger absolute value of SHAP means the feature is more critical to the model.

The ALE method aims to analyze how features influence the model’s prediction on average (Molnar, 2020). Consider clarifying how a change in one feature affects the prediction when other input variables are held constant. ALE first divides the input feature’s values into a grid of bins, and for each bin, ALE gets the model’s predictions using the corresponding input value. Based on this, ALE can calculate the difference between the predicted outcome and the overall mean prediction across all bins, namely, the local effect. Through accumulating the regional effects, ALE finally gets the total pattern of each feature. More details on the calculation of SHAP and ALE can be found in Python libraries: Shap library (version 0.41.0) and Alibi (version 0.9.2) (Klaise et al., 2021).

3 Results

3.1 Model evaluation and comparison

Table 1 demonstrates the performance of each model under the four regression prediction assessment metrics on the test dataset. The performance of the optimal model under each evaluation metric in the table is bolded, and the suboptimal is underlined. It can be seen that the CatBoost model achieved the best performance with MAE (3.2198), MSE (19.6281), MedAE (2.457), and R² (0.3855). The sub-optimal modelsare LightGBM and RF. The values of MAE, MSE, MedAE, and R² for the LightGBM model, were 3.3809, 19.8245, 2.6759, and 0.3793. The values of MAE, MSE, MedAE, and R² for RF model were, respectively, 3.3231, 20.2088, 2.616, 0.3673. According to the evaluation index of model performance, most machine learning models are better than the traditional multiple linear regression model.

Table 1

Table 1. Model performance for predicting depression.

It is worth noting that, in the baseline experimental study, the outcome variable was also performed KNN-based missing value filling to retain more samples. In the Sect.3.4 robustness test, we further excluded samples with null values of the outcome variable to verify the reliability of the study.

3.2 SHAP analysis results

We used SHAP to find the critical influencing factors at the whole dataset level and determine the importance of each variable. As shown in Table 2, the top three significant impact characteristics are r4satlife, r4slfmem, and r4shlta. These three crucial factors were essential features of the depression prediction model, and the SHAP values were, respectively, 1.0871, 0.7614, and 0.6572. Based on the SHAP feature importance bar plot of the CatBoost model, we can more intuitively understand the variable dimensions that play an important role. As shown in Figure 2, the influence values of the top three crucial factors, such as r4satlife, r4slfmem, and r4shlta, were all above 0.6.

Table 2

Table 2. Order of key influencing factors.

Figure 2

Figure 2. Bar plot of feature importance based on CatBoost-SHAP.

SHAP beeswarm plot provides the degree of importance of the variable and the positive and negative impact on the CatBoost model’s prediction results. In Figure 3, each row represents a variable, and the abscissa is the SHAP value, showing the importance ranking of each feature SHAP value from top to bottom. Each point represents a sample. The redder the color, the larger the feature itself, and the bluer the color, the smaller the feature itself. When the SHAP value is positive, it indicates increasing the model’s prediction results; in contrast, when the SHAP value is negative, the negative impact is on the model’s output. According to the three crucial factors in Figure 3, r4satlife had the most significant effect on outcomes, indicating that greater satisfaction values decreased the probability of depression and that satisfaction and depression were negatively correlated. The scores of r4slfmem and r4shlta ranged from 1 for excellent to 5 for very poor, meaning that higher respondent scores indicate worse self-rated memory and health. The results from Figure 3 showed that higher scores of self-reported memory and self-reported health increased the risk of depression. Thus, self-reported memory and health were positively associated with depression.

Figure 3

Figure 3. Beeswarm plot of effects of features based on CatBoost-SHAP.

In this study, two samples were randomly selected to perform SHAP analysis to analyze the instance-level influencing factors and discover individual heterogeneity. As shown in Figures 4, 5, the vertical axis represents different feature values; the horizontal axis represents SHAP values, and E (f(x)) represents the expectation of the predicted value of all samples. The red section indicates a positive effect on predicted depressive values, and the blue section suggests a negative impact. Figure 4 demonstrates that the expected value of a sample f(x) is 14.592, much higher than the E (f(x)), indicating that the individual’s depression is higher than the average level. According to the SHAP interpretation, the reasons why this sample was predicted as a higher level of depression were mainly influenced by variables such as r4satilfe, r4shlta, r4moblisev, r4toilta, and r4shopa. In Figure 5, the predicted value of sample f(x) is 5.136, indicating that the individual is lower than the average depression level. This lower level of depression is influenced by variables such as r4shlta, r4slfmem, r4ipen, r4agey, r4mobilsev, and r4rural. Therefore, under the SHAP individual case analysis, the crucial influencing factors of different samples are different, which reflects the individual heterogeneity well.

Figure 4

Figure 4. Analysis of SHAP values for single-sample full features.

Figure 5

Figure 5. SHAP values analysis of single-sample full features.

3.3 ALE analysis results

We plotted the ALE of the depression prediction model based on the r4satlife, r4slfmem, and r4shlta. Figure 6 shows that r4satlife has a strong negative impact on the prediction of depression, and the prediction value will decrease with the increase in life satisfaction. Since the scores on r4slfmem from 1 for excellent to 5 for very poor, Figure 7 shows that higher scores of respondents’ self-reported memory had a strong positive effect on depression prediction, and the prediction value will increase with the higher self-reported memory. That is, the worse the respondents’ self-reported memory, the easier it is to predict the risk of depression. However, when the self-reported memory was greater than 4.7, the impact of the higher memory value on the increased predictive value of depression was weakened. Since the scores on r4shlta from 1 for excellent to 5 for very poor, Figure 8 shows that higher scores of respondents’ self-reported health status of the individuals also had a strong positive impact on the prediction of depression, and the predicted value overall increased with the higher self-reported health value. That is, the worse the respondents’ self-reported health, the easier it is to predict the risk of depression.

Figure 6

Figure 6. ALE plot of r4satlife effect on depression.

Figure 7

Figure 7. ALE plot of r4slfmem effects on depression.

Figure 8

Figure 8. ALE plot of r4shlta effects on depression.

3.4 Robustness test

To ensure the reliability of the findings of this study, we also conducted the robustness test. There are three main parts of the test. First, the samples with missing values of the dependent variable are excluded. In the baseline study, we used KNN to interpolate the missing values of the dependent variable to retain more samples. In the robustness test, we exclude these samples with missing values for the depression outcome variable and look at the performance of each machine learning model. The results are shown in Supplementary Table S2, where it can be seen that due to the reduced sample size, there are relatively fewer patterns of data to learn, and the error of each model has increased. However, Catboost is still the comparatively better model. The three most important variables remain $\mathrm{r}4\mathrm{satlife}$ , $\mathrm{r}4\mathrm{shlta}$ , and $\mathrm{r}4\mathrm{slfmem}$ .

Second, due to the 93 input variables in the benchmark experiment, there is a more severe problem of multicollinearity. To deal with this concern, this study adopts the Recursive Feature Elimination (RFE) method (Guyon et al., 2002), which sequentially removes the input features with the highest Variance Inflation Factor (VIF) values until the VIFs of all the features are less than 5. As shown in Supplementary Figure S2, during this process, the performance of the CatBoost model retraining and validation are recorded. It can be found that the multicollinearity problem is no longer serious after the input features are reduced to 58. CatBoost’s performance decreases throughout the RFE process but still performs relatively best with the original 93 inputs. This indicates that the multicollinearity problem is not severe for CatBoost and is consistent with the characteristics of machine learning methods such as tree-based models (Zhao et al., 2019; Chan et al., 2022).

Third, due to the stochastic nature of machine learning, this study uses a 5-fold cross-validation (CV) approach to compare the comprehensive performance of each model in the baseline experiment. The results record the mean and standard deviation of the performance of all models in cross-validation, and it can be seen that the CatBoost model is still robust and has about 14% improvement over the LR model in the critical R² measurement. The detailed results of the robustness test can be found in the Supplementary material.

4 Discussion

In this study, based on data from the fourth wave of Harmonized CHARLS, we obtained demographic variables, health status, cognitive, income, family structure, stress, life satisfaction, and CESD in a total of 25,586 middle-aged and older people sample. Five machine learning and traditional models showed that the former was the best in predicting the risk of depression, consistent with earlier related studies (Ay et al., 2019). Moreover, further comparison found that the CatBoost model more accurately predicted the risk of depression in older adults. Therefore, based on the CatBoost model, the SHAP method was used to analyze the crucial factors to obtain the global interpretation of the whole sample set and the feature importance ranking of the model. There were three significant impact characteristics: life satisfaction, self-reported memory, and self-reported health. Similarly, previous studies also found that there is considerable heterogeneity in depressive symptoms in older adults, but cognition and self-reported memory are considered to predict the essential characteristics of ‘depressive symptoms events increased trajectory’ and ‘chronic symptoms trajectory’ (Lin et al., 2023), self-reported memory presented was also a vital influence feature obtained in this study.

The SHAP method analysis found that life satisfaction was one of the most critical key impact features that predicted depression levels. Prior studies have also shown that the higher the level of depression in middle-aged and older adults, the lower the life satisfaction, which is the strongest negative predictor of depression in older adults (Yoo et al., 2016). Lee’s study of older Koreans found that life satisfaction increased significantly over time, and the level of depression decreased (Lee et al., 2020). These are consistent with the findings presented in the present study. We considered the following reasons: on the one hand, life satisfaction is an evaluation indicator of subjective well-being and is an important part of improving the quality of life of older adults (Chachamovich et al., 2007). A study showed that subjective well-being and depression were negatively correlated with each other (Bartels et al., 2013). On the other hand, life satisfaction was one of the important characteristics of individuals with chronic and highly stable depression trajectories, indicating that life satisfaction and the incidence of depression are highly related (Kaup et al., 2016).

In this study, self-reported memory is confirmed to be a more critical influencing factor. Sun’s study found that memory was significantly negatively associated with depression (Sun et al., 2019). Zhou’s study also found that participants with depressive symptoms all had poor cognitive function (Zhou et al., 2021). We considered the following reasons: On the one hand, the deterioration of mental function is related to depression. Episodic memory deteriorated in answering structured questions (but not free recollection of past events) among depressed patients (Wachowska et al., 2022).

On the other hand, cognitive impairment appears to be the core pathological symptom of depression, and cognitive impairment may appear before depression parameters (Maramis et al., 2021). Some argue that cognitive symptoms should be viewed as a separate dimension and an important target for any treatment that has already started (Planchez et al., 2019). Therefore, in this study, self-reported memory is considered to be a more important influencing factor in predicting depression.

Self-reported health is also confirmed to be a more important influencing factor. Kuchibhatla’s study found that the reduction in depressive symptoms is strongly associated with health (Kuchibhatla et al., 2012). Kaup’s study found that good education, better health, fewer stressful events, and a more extensive social network would reduce the incidence of depressive symptoms (Kaup et al., 2016). Chan’s study found that a history of self-perceived health and perceived low cost in older men are important risk factors for depression (Chan and Zeng, 2011). Wen’s study found that individuals who perceived their health status as excellent had a 62% lower risk of depression compared with those who perceived their health as poor (Wen et al., 2019). The reason is that self-rated health was associated with both objective health status and components of psychological perceptions. It has been found to be associated with depression factors that share the same psychological and biological mechanisms (Peleg and Nudelman, 2021). Therefore, in this study, self-reported health is considered to be a more important influencing factor in predicting depression.

Based on the entire interpretable machine learning framework, this study identified the most critical factors affecting depression levels in a hypothesis-free manner, excluding possible interference from confounding factors, demonstrating the most crucial position of life satisfaction. Meanwhile, we randomly selected two respondents and explained the key factors affecting individual depression levels, namely, finding individual heterogeneity. In further research, using the ALE method, we found the depression prediction model diagram of some essential factors, so we can also change the level of depression and improve the quality of life by controlling for some related variables.

This study has three innovations but also has three limitations. First, we did not use the longitudinal data, only the fourth wave of the Harmonized CHARLS data. Second, the study did not include variables such as finance, housing, health care, and insurance. Third, we did not adopt more complex parameter adjustment methods, most of which used the default configuration, which has some limitations on the applicability of the challenging depression prediction task. In future research, we need to develop more advanced integration models.

Data availability statement

This analysis uses data or information from the Harmonized CHARLS dataset and Codebook, Version D as of June 2021 developed by the Gateway to Global Aging Data. The development of the Harmonized CHARLS was funded by the National Institute on Aging (R01 AG030153, RC2 AG036619, R03 AG043052). For more information, please refer to https://g2aging.org/. The CHARLS data can be accessed at: https://charls.charlsdata.com/pages/Data/harmonized_charls/en.html. For more details and code for this study, please contact the corresponding author.

Author contributions

RL: Conceptualized, Methodology, Writing – original draft. XW: Conceptualized, Methodology, Writing – review & editing. LL: Conceptualized, Methodology, Writing – review & editing. YY: Conceptualized, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This research is supported by the Humanities and Social Science Fund of Ministry of Education of China (No. 23YJC630130), and Sichuan Science and Technology Program (No. 2023NSFSC1015).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2024.1392240/full#supplementary-material

References

Akiba, T., Sano, S., Yanase, T., Ohta, T., and Koyama, M. (2019). Optuna: a next-generation Hyperparameter optimization framework. Proceedings of the 25th ACM SIGKDD international conference on Knowledge Discovery & Data Mining, 2623–2631.

Google Scholar

Apley, D. W., and Zhu, J. (2020). Visualizing the effects of predictor variables in black box supervised learning models. J R Stat Soc Series B Stat Methodol. 82, 1059–1086.

Google Scholar

Ay, B., Yildirim, O., Talo, M., Baloglu, U. B., Aydin, G., Puthankattil, S. D., et al. (2019). Automated depression detection using deep representation and sequence learning with EEG signals. J. Med. Syst. 43:205. doi: 10.1007/s10916-019-1345-y

PubMed Abstract | Crossref Full Text | Google Scholar

Bartels, M., Cacioppo, J. T., Van Beijsterveldt, T. C. E. M., and Boomsma, D. I. (2013). Exploring the association between well-being and psychopathology in adolescents. Behav. Genet. 43, 177–190. doi: 10.1007/s10519-013-9589-7

PubMed Abstract | Crossref Full Text | Google Scholar

Breiman, L. (2001). Random forests. Mach. Learn. 45, 5–32.

Google Scholar

Chachamovich, E., Trentini, C., and Fleck, M. P. (2007). Assessment of the psychometric performance of the WHOQOL-BREF instrument in a sample of Brazilian older adults. Int. Psychogeriatr. 19, 635–646. doi: 10.1017/S1041610206003619

PubMed Abstract | Crossref Full Text | Google Scholar

Chan, J. Y.-L., Leow, S. M. H., Bea, K. T., Cheng, W. K., Phoong, S. W., Hong, Z.-W., et al. (2022). Mitigating the multicollinearity problem and its machine learning approach: a review. Mathematics 10:1283. doi: 10.3390/math10081283

Crossref Full Text | Google Scholar

Chan, M. F., and Zeng, W. (2011). Exploring risk factors for depression among older men residing in Macau. J. Clin. Nurs. 20, 2645–2654. doi: 10.1111/j.1365-2702.2010.03689.x

PubMed Abstract | Crossref Full Text | Google Scholar

Chen, T., and Guestrin, C. (2016). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, 785–794. doi: 10.1145/2939672.2939785

Crossref Full Text | Google Scholar

Chen, X., He, L., Shi, K., Wu, Y., Lin, S., and Fang, Y. (2023). Interpretable machine learning for fall prediction among older adults in China. Am. J. Prev. Med. 65, 579–586. doi: 10.1016/j.amepre.2023.04.006

PubMed Abstract | Crossref Full Text | Google Scholar

Chin, W. Y., Choi, E. P. H., Chan, K. T. Y., and Wong, C. K. H. (2015). The psychometric properties of the Center for Epidemiologic Studies Depression Scale in Chinese primary care patients: factor structure, construct validity, reliability, Sensitivity and Responsiveness. Plos One 10:e0135131. doi: 10.1371/journal.pone.0135131

PubMed Abstract | Crossref Full Text | Google Scholar

Fawagreh, K., Gaber, M. M., and Elyan, E. (2014). Random forests: from early developments to recent advancements. Syst. Sci. Cont. Eng. 2, 602–609. doi: 10.1080/21642583.2014.956265

Crossref Full Text | Google Scholar

Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. Ann. Stat. 1189–1232.

Google Scholar

Giannelis, A., Palmos, A., Hagenaars, S. P., Breen, G., Lewis, C. M., and Mutz, J. (2021). Examining the association between family status and depression in the UK biobank. J. Affect. Disord. 279, 585–598. doi: 10.1016/j.jad.2020.10.017

PubMed Abstract | Crossref Full Text | Google Scholar

Guyon, I., Weston, J., Barnhill, S., and Vapnik, V. (2002). Gene selection for Cancer classification using support vector machines. Mach. Learn. 46, 389–422.

Google Scholar

Hao, M., Jiang, D., Ding, F., Fu, J., and Chen, S. (2019). Simulating Spatio-temporal patterns of terrorism incidents on the Indochina peninsula with GIS and the random Forest method. ISPRS Int. J. Geo Inf. 8:133. doi: 10.3390/ijgi8030133

Crossref Full Text | Google Scholar

Ibrahim, A. A., Ridwan, R. L., Muhammed, M. M., Abdulaziz, R. O., and Saheed, G. A. (2020). Comparison of the CatBoost classifier with other machine learning methods. Int. J. Adv. Comput. Sci. Appl. 11:11. doi: 10.14569/IJACSA.2020.0111190

Crossref Full Text | Google Scholar

Jiang, C., Zhu, F., and Qin, T. (2020). Relationships between chronic diseases and depression among middle-aged and elderly people in China: a prospective study from CHARLS. Curr. Med. Sci. 40, 858–870. doi: 10.1007/s11596-020-2270-5

PubMed Abstract | Crossref Full Text | Google Scholar

Jung, S. J., Shin, A., and Kang, D. (2015). Menarche age, menopause age and other reproductive factors in association with post-menopausal onset depression: results from health examinees study (HEXA). J. Affect. Disord. 187, 127–135. doi: 10.1016/j.jad.2015.08.047

PubMed Abstract | Crossref Full Text | Google Scholar

Kaup, A. R., Byers, A. L., Falvey, C., Simonsick, E. M., Satterfield, S., Ayonayon, H. N., et al. (2016). Trajectories of depressive symptoms in older adults and risk of dementia. JAMA Psychiatry 73, 525–531. doi: 10.1001/jamapsychiatry.2016.0004

PubMed Abstract | Crossref Full Text | Google Scholar

Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., et al. (2017). Light GBM: A highly efficient gradient boosting decision tree. Adv. Neural Inf. Process Syst. 30.

Google Scholar

Kimmel, P. L., Peterson, R. A., Weihs, K. L., Simmens, S. J., Alleyne, S., Cruz, I., et al. (2000). Multiple measurements of depression predict mortality in a longitudinal study of chronic hemodialysis outpatients. Kidney Int. 57, 2093–2098. doi: 10.1046/j.1523-1755.2000.00059.x

Crossref Full Text | Google Scholar

Klaise, J., Van-Looveren, A., Vacanti, G., and Coca, A. (2021). Alibi explain: Algorithms for explaining machine learning models. J. Mach. Learn. Res. 22, 1–7.

Google Scholar

Kuchibhatla, M. N., Fillenbaum, G. G., Hybels, C. F., and Blazer, D. G. (2012). Trajectory classes of depressive symptoms in a community sample of older adults. Acta Psychiatr. Scand. 125, 492–501. doi: 10.1111/j.1600-0447.2011.01801.x

PubMed Abstract | Crossref Full Text | Google Scholar

Lee, S. W., Yang, J. M., Moon, S. Y., Yoo, I. K., Ha, E. K., Kim, S. Y., et al. (2020). Association between mental illness and COVID-19 susceptibility and clinical outcomes in South Korea: a nationwide cohort study. Lancet Psychiatry 7, 1025–1031. doi: 10.1016/S2215-0366(20)30421-1

PubMed Abstract | Crossref Full Text | Google Scholar

Lin, S., Wu, Y., He, L., and Fang, Y. (2023). Prediction of depressive symptoms onset and long-term trajectories in home-based older adults using machine learning techniques. Aging Ment. Health 27, 8–17. doi: 10.1080/13607863.2022.2031868

PubMed Abstract | Crossref Full Text | Google Scholar

Lundberg, S. M., and Lee, S.-I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems 30 (pp. 4765–4774). Eds. I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, and S. Vishwanathan. Curran Associates, Inc. Available at: http://papers.nips.cc/paper/7062-a-unified-approach-to-interpreting-model-predictions.pdf

Google Scholar

Luo, H., Li, J., Zhang, Q., Cao, P., Ren, X., Fang, A., et al. (2018). Obesity and the onset of depressive symptoms among middle-aged and older adults in China: evidence from the CHARLS. BMC Public Health 18:909. doi: 10.1186/s12889-018-5834-6

PubMed Abstract | Crossref Full Text | Google Scholar

Luo, L., and Qi, C. (2021). An analysis of the crucial indicators impacting the risk of terrorist attacks: a predictive perspective. Saf. Sci. 144:105442. doi: 10.1016/j.ssci.2021.105442

Crossref Full Text | Google Scholar

Luo, Y., Yang, P., Wan, Z., Kang, Y., Dong, X., Li, Y., et al. (2023). Dietary diversity, physical activity and depressive symptoms among middle-aged women: a cross-sectional study of 48,637 women in China. J. Affect. Disord. 321, 147–152. doi: 10.1016/j.jad.2022.10.038

PubMed Abstract | Crossref Full Text | Google Scholar

Maramis, M. M., Mahajudin, M. S., and Khotib, J. (2021). Impaired cognitive flexibility and working memory precedes depression: a rat model to study depression. Neuropsychobiology 80, 225–233. doi: 10.1159/000508682

PubMed Abstract | Crossref Full Text | Google Scholar

McMunn, A., Lacey, R., Worts, D., Kuh, D., McDonough, P., and Sacker, A. (2021). Work-family life courses and psychological distress: evidence from three British birth cohort studies. Adv. Life Course Res. 50:100429. doi: 10.1016/j.alcr.2021.100429

PubMed Abstract | Crossref Full Text | Google Scholar

Molnar, C. (2020). Interpretable machine learning. Lulu. com.

Google Scholar

Peleg, S., and Nudelman, G. (2021). Associations between self-rated health and depressive symptoms among older adults: does age matter? Soc. Sci. Med. 280:114024. doi: 10.1016/j.socscimed.2021.114024

PubMed Abstract | Crossref Full Text | Google Scholar

Planchez, B., Surget, A., and Belzung, C. (2019). Animal models of major depression: drawbacks and challenges. J. Neural Transm. 126, 1383–1408. doi: 10.1007/s00702-019-02084-y

PubMed Abstract | Crossref Full Text | Google Scholar

Prokhorenkova, L., Gusev, G., Vorobev, A., Dorogush, A. V., and Gulin, A. (2018). CatBoost: Unbiased boosting with categorical features. Adv. Neural Inf. Process Syst. 31.

Google Scholar

Qiu, Q., Qian, S., Li, J., Jia, R., Wang, Y., and Xu, Y. (2020). Risk factors for depressive symptoms among older Chinese adults: a meta-analysis. J. Affect. Disord. 277, 341–346. doi: 10.1016/j.jad.2020.08.036

PubMed Abstract | Crossref Full Text | Google Scholar

Sun, Z., Wang, Z., Xu, L., Lv, X., Li, Q., Wang, H., et al. (2019). Characteristics of cognitive deficit in amnestic mild cognitive impairment with subthreshold depression. J. Geriatr. Psychiatry Neurol. 32, 344–353. doi: 10.1177/0891988719865943

PubMed Abstract | Crossref Full Text | Google Scholar

Tjoa, E., and Guan, C. (2021). A survey on explainable artificial intelligence (XAI): toward medical XAI. IEEE Trans. Neural Netw. Learn. Syst. 32, 4793–4813. doi: 10.1109/TNNLS.2020.3027314

PubMed Abstract | Crossref Full Text | Google Scholar

Troyanskaya, O., Cantor, M., Sherlock, G., Brown, P., Hastie, T., Tibshirani, R., et al. (2001). Missing value estimation methods for DNA microarrays. Bioinformatics 17, 520–525. doi: 10.1093/bioinformatics/17.6.520

Crossref Full Text | Google Scholar

Wachowska, K., Szemraj, J., Śmigielski, J., and Gałecki, P. (2022). Inflammatory markers and episodic memory functioning in depressive disorders. J. Clin. Med. 11:693. doi: 10.3390/jcm11030693

PubMed Abstract | Crossref Full Text | Google Scholar

Wen, Y., Liu, C., Liao, J., Yin, Y., and Wu, D. (2019). Incidence and risk factors of depressive symptoms in 4 years of follow-up among mid-aged and elderly community-dwelling Chinese adults: findings from the China health and retirement longitudinal study. BMJ Open 9:e029529. doi: 10.1136/bmjopen-2019-029529

PubMed Abstract | Crossref Full Text | Google Scholar

World Health Organization . (2017). Depression and other common mental disorders: global health estimates (No. WHO/MSD/MER/2017.2). Available at: https://www.who.int/publications/i/item/depression-global-health-estimates

Google Scholar

Xiang, X., and Wang, X. (2021). Childhood adversity and major depression in later life: a competing-risks regression analysis. Int. J. Geriatr. Psychiatry 36, 215–223. doi: 10.1002/gps.5417

PubMed Abstract | Crossref Full Text | Google Scholar

Yoo, J. S., Chang, S. J., and Kim, H. S. (2016). Prevalence and predictive factors of depression in community-dwelling older adults in South Korea. Res. Theory Nurs. Pract. 30, 200–211. doi: 10.1891/1541-6577.30.3.200

PubMed Abstract | Crossref Full Text | Google Scholar

Yunming, L., Changsheng, C., Haibo, T., Wenjun, C., Shanhong, F., Yan, M., et al. (2012). Prevalence and risk factors for depression in older people in xi′an China: a community-based study. Int. J. Geriatr. Psychiatry 27, 31–39. doi: 10.1002/gps.2685

PubMed Abstract | Crossref Full Text | Google Scholar

Zeng, Y. (2012). Toward deeper research and better policy for healthy aging – using the unique data of Chinese longitudinal healthy longevity survey. China Econ. J. 5, 131–149. doi: 10.1080/17538963.2013.764677

PubMed Abstract | Crossref Full Text | Google Scholar

Zhang, C., Chen, X., Wang, S., Hu, J., Wang, C., and Liu, X. (2021). Using CatBoost algorithm to identify middle-aged and elderly depression, national health and nutrition examination survey 2011–2018. Psychiatry Res. 306:114261. doi: 10.1016/j.psychres.2021.114261

PubMed Abstract | Crossref Full Text | Google Scholar

Zhang, X., Jin, M., Fu, J., Hao, M., Yu, C., and Xie, X. (2018). On the risk assessment of terrorist attacks coupled with multi-source factors. ISPRS Int. J. Geo Inf. 7:354. doi: 10.3390/ijgi7090354

Crossref Full Text | Google Scholar

Zhang, Z., and Jung, C. (2019). GBDT-MO: Gradient boosted decision trees for multiple outputs (arXiv:1909.04373). arXiv. Available at:http://arxiv.org/abs/1909.04373

Google Scholar

Zhao, X., Yu, B., Liu, Y., Chen, Z., Li, Q., Wang, C., et al. (2019). Estimation of poverty using random Forest regression with multi-source data: a case study in Bangladesh. Remote Sens. 11:375. doi: 10.3390/rs11040375

Crossref Full Text | Google Scholar

Zhao, Y., Hu, Y., Smith, J. P., Strauss, J., and Yang, G. (2014). Cohort profile: the China health and retirement longitudinal study (CHARLS). Int. J. Epidemiol. 43, 61–68. doi: 10.1093/ije/dys203

PubMed Abstract | Crossref Full Text | Google Scholar

Zhou, L., Ma, X., and Wang, W. (2021). Relationship between cognitive performance and depressive symptoms in Chinese older adults: the China health and retirement longitudinal study (CHARLS). J. Affect. Disord. 281, 454–458. doi: 10.1016/j.jad.2020.12.059

PubMed Abstract | Crossref Full Text | Google Scholar

Zhou, P., Wang, S., Yan, Y., Lu, Q., Pei, J., Guo, W., et al. (2023). Association between chronic diseases and depression in the middle-aged and older adult Chinese population—a seven-year follow-up study based on CHARLS. Front. Public Health 11:1176669. doi: 10.3389/fpubh.2023.1176669

PubMed Abstract | Crossref Full Text | Google Scholar

Zhou, S., Gao, L., Liu, F., Tian, W., Jin, Y., and Zheng, Z. (2021). Socioeconomic status and depressive symptoms in older people with the mediation role of social support: a population-based longitudinal study. Int. J. Methods Psychiatr. Res. 30:e1894. doi: 10.1002/mpr.1894

PubMed Abstract | Crossref Full Text | Google Scholar