- 1Department of Medical Informatics, School of Biomedical Engineering and Informatics, Nanjing Medical University, Nanjing, China
- 2Department of Medical Psychology, Nanjing Brain Hospital, Nanjing Medical University, Nanjing, China
- 3Department of Information, The First Affiliated Hospital, Nanjing Medical University, Nanjing, China
Objectives: Diabetes and its complications are commonly associated with depressive symptoms, and few studies have investigated the diagnosis effect of depressive symptoms in patients with diabetes. The present study used a network-based approach to explore the association between depressive symptoms, which are annotated from electronic health record (EHR) notes by a deep learning model, and the diagnosis of type 2 diabetes mellitus (T2DM) and its complications.
Methods: In this study, we used anonymous admission notes of 52,139 inpatients diagnosed with T2DM at the first affiliated hospital of Nanjing Medical University from 2008 to 2016 as input for a symptom annotation model named T5-depression based on transformer architecture which helps to annotate depressive symptoms from present illness. We measured the performance of the model by using the F1 score and the area under the receiver operating characteristic curve (AUROC). We constructed networks of depressive symptoms to examine the connectivity of these networks in patients diagnosed with T2DM, including those with certain complications.
Results: The T5-depression model achieved the best performance with an F1-score of 91.71 and an AUROC of 96.25 compared with the benchmark models. The connectivity of depressive symptoms in patients diagnosed with T2DM (p = 0.025) and hypertension (p = 0.013) showed a statistically significant increase 2 years after the diagnosis, which is consistent with the number of patients diagnosed with depression.
Conclusion: The T5-depression model proposed in this study can effectively annotate depressive symptoms in EHR notes. The connectivity of annotated depressive symptoms is associated with the diagnosis of T2DM and hypertension. The changes in the network of depressive symptoms generated by the T5-depression model could be used as an indicator for screening depression.
1. Introduction
Depression is two times more common in patients with diabetes in the general population (1). Diabetic patients with depression have difficulty controlling their glycemic index (2), have a higher risk of dementia (3), and experience higher health care costs (4), especially in older adults (5). Depression has been reported to promote high risks of poor glucose control, comorbidities, and mortality in diabetic patients with depression (5, 6).
The duration of diabetes is associated with depression (7). A trial involving people who were newly diagnosed with type 2 diabetes mellitus (T2DM) found that the prevalence of depressive symptoms increased at least 1 year post diagnosis (8). Depressive symptoms are also associated with the presence of complications of diabetes, including cardiovascular disease, cerebrovascular disease, and neuropathy (9–12). This sentence highlights that the diagnosis events of complications, but the previous sentence describes about the relation between complications and depressive symptoms.
Depressive symptoms were estimated mostly using sum scores based on reported symptoms from screening tools (8, 13). The widely used validated tools for depression screening include the Patient Health Questionnaire-9 (PHQ-9), the Center for Epidemiologic Studies Depression Scale, and the World Health Organization-5 Well Being Index (WHO-5) (13, 14). Although treatment guidelines for patients with diabetes recommend regular depression screening (15), the rate of depression screening for such patients is low (16–18). However, owing to the heterogeneity of depression, the sum scores used in screening tools ignore the interactions among depressive symptoms when estimating the severity of symptoms (19). The low rate of depression screening and a lack of information on symptom interaction limit the identification of depressive symptoms and the understanding of their correlations in patients with diabetes.
The development of natural language processing (NLP) models and data mining in large-scale clinical real-world datasets of electronic health records (EHRs) has promoted screening for depression in patients with diabetes (18), especially screening based on admission notes. These notes contain a history of past illness, present illness, allergy, and birth information (20). Present illness includes the patient's main complaints, narratives of symptoms, and progress of treatment during their time in the hospital. During their hospital stay, patients will be checked for their status of spirit, sleep quality, and appetite, among others. Some researchers successfully used NLP tools to extract symptom data from unstructured free-text clinical documents in EHR. For example, Geraci et al. (21) extracted data from clinical notes through an NLP technique to predict the diagnosis of depression. Patel et al. (22) investigated the associations of depressive symptoms with clinical outcomes. These research studies provide opportunities for identifying depression-related symptoms and computer-aided diagnosis (23, 24).
In contrast to screening tools, network connectivity of symptoms focuses on estimating the associations among symptoms. The symptom–symptom interactions are used to form a network structure in the network analysis (25). Based on the network structure of depressive symptoms, the associations between symptoms and disease can be estimated from a part-whole perspective (26). Increases in network connectivity are associated with the severity of depression and persistent depressive symptoms (27, 28). Therefore, network analysis has recently been used as an alternative approach to assessing the severity of depressive symptoms.
In the present study, a model for classification and analysis of depression-related symptoms was proposed to directly identify depression symptoms from the EHRs of inpatients. Data were collected from an observational clinical dataset of inpatients at the First Affiliated Hospital of Nanjing Medical University over 8 years. The model integrated a transformer model with network analysis to facilitate an increased screening rate while retaining symptom interactions. The study examined depressive symptoms in patients with four complications of diabetes. The overall and local connectivities of the resulting networks were compared with the diagnosis of depression.
2. Methods
2.1. Study design and setting
The present study obtained medical record data from the Observational Medical Outcomes Partnership Common Data Model (OMOP CDM) at the First Affiliated Hospital of Nanjing Medical University (29). In this dataset, 61,471 inpatients with valid present-illness notes were selected from among the 148,624 patients in the CDM who had been diagnosed with T2DM. We included data on patients' age at T2DM diagnosis, sex, diagnosis of depression (ICD-10 codes F32–F33), and diagnosis of complications: hypertension (ICD-10 code I10), ischemic heart disease (ICD-10 codes I20–I25), and cerebrovascular disease (ICD-10 codes I60–I69). The date of diagnosis of T2DM was defined as the earliest date of hemoglobin A1C ≥ 48 mmol/mol, or 6.5%, or use of insulin, or oral hypoglycemic drugs, or the first recorded diagnosis of T2DM. The date of diagnosis of complications was defined as the first recorded diagnosis of the complications. Ethical approval for the study was received from the Ethics Committee of the First Affiliated Hospital, Nanjing Medical University, Jiangsu, China.
We identified 52,139 inpatients who were first diagnosed with T2DM between 2008 and 2016 from a total of 61,471 patients. The complications (ischemic heart disease, hypertension, or cerebrovascular disease) of T2DM were confirmed after the diagnosis of T2DM had been made. To examine the difference in depressive symptoms before and after the diagnosis of T2DM or complications, a filtering rule (admission pairs, APs) was defined: patients were required to have admission records before and after the date of disease diagnosis during 2 years. For example, “patients have AP for hypertension” meant that patients had admission records 2 years before and after the date of diagnosis of hypertension. Eligible patients had AP for T2DM or its complications. Once the eligibility criteria had been met, 8,885 patients with T2DM, 1,357 patients with ischemic heart disease, 2,619 patients with hypertension, and 1,693 patients with cerebrovascular disease were selected for analysis. The procedure of patient selection is shown in Supplementary Figure S1. The year when patients were first diagnosed with T2DM, hypertension, ischemic heart disease, or cerebrovascular disease was coded as 0. Admissions in the preceding 2 years were coded as –2 and successive admissions as 2.
2.2. Depressive symptoms annotation
2.2.1. Processing of labeled datasets
To limit the cost of labeling, we randomly selected 10% of (15,615) notes from 156,156 admission notes of all inpatients (61,471 patients) to build and test the annotation model. Repeated notes of present-illness were excluded. Once the eligibility criteria had been met, 13,880 valid records of present-illness (dataset I) were labeled. To train, validate, and test the model, this dataset was split according to a ratio of 8:1:1. In addition, to internally evaluate the performance of the model, we randomly selected 4,658 admission notes (10% of 46,583 notes) as dataset II. These notes were extracted from the samples obtained in the previous patient selection process (see the “Study design and setting” section). Three annotators completed the labeling process of both datasets under the training of a clinical expert. A diagram illustrating this procedure is shown in Supplementary Figure S2.
We summarized depressive symptoms according to items described in previous research (30) and two commonly used screening tools namely, PHQ-9 (31) and WHO-5 (32). We included increased and decreased weights as symptoms because they were reported to have an effect on increasing the risk of depression in patients with T2DM (30). Another nine unique depressive symptoms were selected from PHQ-9 and WHO-5 scales, including feeling tired, difficulty in sleeping, a decrease in appetite, moving slowly, feeling irritable, a decline in memory or attention, feeling dispirited, depressed, or anxious, and feeling suicidal. The relationships of items in the screening tools and symptoms are shown in Supplementary Table S2. Antonyms were used for items in WHO-5 because these items are both positive expressions compared to PHQ-9. A total of 11 candidate depressive symptoms were evaluated by clinical experts. The synonyms of candidate depressive symptoms were also provided by clinical experts and were used in labeling (Supplementary Table S3).
Descriptive statistics for the manual labeling of datasets I and II are shown in Supplementary Table S4. Symptoms that occurred fewer than 10 times in any dataset were excluded. Finally, nine symptoms (feeling tired, difficulty in sleeping, a decrease in appetite, moving slowly, feeling irritable, a decline in memory or attention, a decrease in weight, an increase in weight, and feeling dispirited) were selected to build the model.
2.2.2. Annotation model development and evaluation
To annotate the depressive symptoms, we built a model named T5-depression based on a transformer model, Transfer Text-to-Text Transformer (T5 model) (33) model, with a sequence-to-structure paradigm. The architecture of T5-depression is shown in Figure 1. This model contains three parts: two multi-head attention modules (the encoder and decoder modules) and an auto rule-based result conversion module. The encoder module changes the input sentence x into a contextualized representation. The decoder module predicts the output sentence y on a token-by-token basis in the structured sequence. A constrained decoding algorithm for the symptom schema is injected during inference. The probability of the output is given in Equation 1, where T represents the size of the output and yi represents each step of the output:
In the present study, each present illness note was regarded as the input, and all the related symptoms were formatted as the output. An example of formatted input and output is shown in Figure 1. To support the Chinese language, we replaced the original pretrained model T5-base (33) with T5-Mengzi (34). Among the super-parameters used in T5-depression model, the learning rate was set to 5e-5, training epochs to 25, and batch size to 16. Other super-parameters were set as same as in Text2event.
We compared the performance of our model with a rule-based model, the Bidirectional Encoder Representations from Transformers (Bert) model (35), and the Roberta model (36) as benchmarks. The rule-based model was implemented using regular expressions derived from synonyms of each symptom in Supplementary Table S1. Roberta (36) was pretrained with Chinese-Roberta-wwm-ext (37) and Bert (35) was pretrained with Bert-base-Chinese. Bert is a contextualized word representation model that has been applied successfully to several tasks in the medical domain (38, 39). In the present study, we used the same number of epochs, batch size, and learning rate for Roberta and Bert. The implementation of the benchmark model was based on the Transformers package (40). All code for this study has been uploaded to https://github.com/inseptember/T5-depression.
To evaluate the performance of the models, precision, recall, F1-score, HammingLoss (41), and area under the receiver operating characteristic curve (AUROC) were used as metrics. Definitions of these metrics are given in Eqs. S1–S4 (Supplementary material). Precision is the ability to identify true positive samples among all positive prediction results. Recall is the ability to identify true positive samples among all positive results. F1 is the harmonic mean of the precision and recall. HammingLoss is the minimum number of substitutions required to change one sequence to another. This study indicates the fraction of symptoms that were incorrectly predicted. Owing to the unbalanced symptoms in our dataset (Supplementary Table S4), micro-averaging was performed on all symptoms. To prevent incorrect prediction of present illness notes, a model with higher recall and F1 is preferred to one with higher precision, AUROC, or HammingLoss. All metrics were calculated using the scikit-learn Python package (42).
Finally, T5-depression was used to process all present illness notes. The depressive symptoms, annotated from present illness notes within the range of admissions, were marked as binary values (1 for yes and 0 or no), depending on whether the notes contained the symptoms or not.
2.3. Statistical analysis
In depressive symptom networks, nodes represent symptoms and edges represent the associations between symptoms (26). We used the Ising models with the extended Bayesian information criterion from the R package bootnet (43) to construct and estimate the centrality of depressive symptoms before and after the diagnosis of each T2DM complication. We set the hyper-parameter tuning to 0 to estimate more connections (28). The weighted networks were illustrated using the R package qgraph (44).
Statistical assessment of the differences in overall connectivity of networks was performed using the R package NetworkComparisonTest (NCT) (27, 45). NCT is a two-tailed permutation-based hypothesis test to assess the difference between two groups (in our case, before and after the diagnosis of a disease or complication). The R package was run 1,000 times in our study to observe the differences in overall connectivity between the networks. In addition, differences in the importance of nodes were measured by node strength, closeness, and betweenness (44). Strength describes the degree to which a node is connected to other nodes. Closeness measures how close a node is to other nodes. Betweenness assesses the degree to which a node lies on the shortest path between nodes (46). In the present study, node strength was used as a local connectivity index. Furthermore, χ2 test was conducted to determine depression associated difference for each complication. We compared the results from this test to the overall difference from the NCT package.
3. Results
3.1. Participants
A total of four cohorts with a diagnosis of T2DM or its complications (hypertension, ischemic heart disease, and cerebrovascular disease) were selected for this study. Descriptive statistics are shown in Table 1. The mean ages of participants in these four cohorts were 60.36 ± 15.58, 62.07 ± 13.03, 66.06 ± 14.15, and 66.52 ± 13.92, respectively. More than 59% of patients were men. Of the 8,885 patients in the T2DM cohort, 60 patients developed depression after diagnosis of T2DM within 2 years (p < 0.001). Of the 2,619 T2DM patients with hypertension, 24 developed depression after diagnosis with hypertension within 2 years (p < 0.01). There were no statistically significant differences in the diagnosis of depression after diagnosis with ischemic heart disease or cerebrovascular disease in patients with T2DM within 2 years.
3.2. Performance and annotation results of the T5-depression model
Table 2 reports the performance of the models for the annotation of depressive symptoms. Compared with other models, the T5-depression model achieved the best performance, with a micro-average F1 of 91.71% in dataset I and 95.53% in dataset II. The rule-based approach had the highest precision value of 95.39% and the lowest recall value of 79.23% in dataset I. The Roberta model achieved the best HammingLoss of 0.0027 in dataset I. The Bert model did not outperform other models in both datasets. We chose the T5-depression model as the auto-annotation model for the present-illness notes of patients.
According to annotation with the T5-depression model, the top three depressive symptoms in all cohorts were feeling tired, difficulty in sleeping, and a decrease in appetite (Table 1). The percentage of each depressive symptom increased significantly in the 2 years after diagnosis in the T2DM cohort, except for feeling irritable. Symptoms of a decrease in appetite (p < 0.01) and a decrease in weight (p < 0.01) showed a significant increase in the 2 years after diagnosis in the T2DM and hypertension cohort. Only a decrease in appetite (p < 0.05) showed a significant increase in the ischemic heart disease cohort. No change in symptoms was found in the cerebrovascular disease cohort.
3.3. Network analysis
A comparison of overall network connectivity before and after diagnosis (with T2DM, hypertension, ischemic heart disease, and cerebrovascular disease) is presented in Table 3. After diagnosis of diabetes (p = 0.025) and hypertension (p = 0.013) in patients, the overall connectivity of the symptom networks increased significantly during the 2 years. Due to consistent increase in overall connectivity, the number of patients with T2DM and hypertension diagnosed with depression also increased. With regard to symptoms, strong positive connections between a decline in memory/attention and feeling irritable were found after diagnosis of T2DM and hypertension (Figure 2). The strength of symptoms was measured as local connectivity (Supplementary Figure S2). The symptom of a decrease in appetite remained high and stable both before and after diagnosis. Weight-related symptoms had relatively lower values.
Figure 2. Depressive symptom networks within 2 years before and after the diagnosis of T2DM and hypertension. Green lines represent positive association, and thicker lines represent stronger association. (A) is within 2 years before diagnosed date of T2DM. (B) is within 2 years after diagnosed date of T2DM. (C) is within 2 years before diagnosed date of hypertension. (D) is within 2 years after diagnosed date of hypertension.
4. Discussion
In the present study, we compared depressive symptoms from the EHR notes of patients in the 2 years before and after the diagnosis of T2DM and complications (hypertension, ischemic heart disease, and cerebrovascular disease). To annotate depressive symptoms in EHR notes of patients with T2DM, we applied the T5-depression model to automatically label depressive symptoms. We used network analysis to examine the differences among depressive symptom networks. The diagnoses of T2DM and hypertension were associated with increased overall connectivity of the symptom network.
The T5-depression model was built using a sequence-to-structure paradigm. Classic methods used for symptom annotation include rule-based approaches and form part of pipelines including MedLEE (47), ClinREAD (48), and MTERMS (49). The rule-based methods mostly extract symptoms through keyword retrieval, which ignores the context semantics of each symptom. Recently, Bert (35) was applied to various clinical tasks (50–52). Through a multi-head attention mechanism, Bert-related models can obtain context features of each symptom. Moreover, methods used for annotation tasks train a classifier on the last layer of the model. However, this requires much effort when applied to medical notes with fine-grained token-level annotation. The sequence-to-structure paradigm model can generate all targets in one step and show competitive performance using only record-level annotations. This mechanism can reduce much of the effort involved in the annotation procedure and has generalizability (53).
In the present study, the T5-depression model achieved promising performance on our dataset. The architecture of T5-depression was designed to translate the input text to an augmented readable text, which makes the annotation procedure easier and enables the handling of labels of different sizes with less modification than classification models with one-hot labels. T5-depression can make full use of semantic information of labels by relative positional embeddings and use of an autoregressive decoder, unlike Bert-related models. Owing to the smaller number of annotations of certain symptoms, including feeling irritable and a decline in memory or attention (Supplementary Table S4), the rule-based model achieved the highest precision; however, it had a lower recall value than the T5-depression model. Through keyword searching, the rule-based approach could identify the exact same symptoms as labeled in notes but failed to identify symptoms in other formats. The T5-depression model showed poor performance related to symptoms including moving slowly (F1: 70.59) and feeling irritable (F1: 70.27) because these two symptoms had a more varied expression in the Chinese population and were reported in limited numbers compared with other symptoms in our dataset. The T5-depression model still achieved the best overall performance compared with regular rule-based annotation methods. Thus, the model could be a reliable tool for identifying depressive symptoms in EHR of patients with T2DM, thereby saving time and effort on the part of medical experts.
This study showed a significant increase in the overall connectivity of depressive symptoms during the 2 years after diagnosis of T2DM and hypertension. Persistent depressive symptoms have been reported in the early stages of diabetes (8), and awareness of hypertension indicates a higher prevalence of depressive symptoms (54). It has been reported that persistent depressive symptoms are associated with stronger network connectivity (27), and the change in overall connectivity in this study was consistent with the diagnosis of depression in patients with T2DM and hypertension. Although some studies have reported that cerebrovascular disease has stronger associations with depressive symptoms in patients with diabetes (11, 55), the short-term prevalence of depression was unchanged (56), which is consistent with our results. The network connectivity of depressive symptoms in the early stages of T2DM could be an indicator for further monitoring of depression while current method for screening depression in patients with diabetes is insufficient. Although a study has suggested that the development of T2DM might not induce depressive symptoms (2), the increase in frequency of depressive symptoms after the diagnosis of T2DM illustrates the importance of mining EHR notes for psychiatric research.
High centrality of symptoms in the network could be considered as important parts in maintaining the mental disorders (25). We used the strength of nodes to measure local connectivity in this study. For patients diagnosed with T2DM and complications including hypertension, the centrality of the symptom of a decline in memory or attention ranked top among all depressive symptoms over 2 years. Depression is associated with concurrent cognitive decline (57) in patients with diabetes. Nonpharmacological treatments for behavioral and psychological symptoms of dementia have been shown to result in improvements in depression (58). Some studies also reported that anti-dementia drugs have antidepressant-like effects (59, 60) in animal models. Treatment of cognitive symptoms is thus a potential approach for the prevention of depression in patients with diabetes.
5. Limitations
Our study had some limitations. First, we included admissions only 2 years before and after the initial diagnosis; this time period might not be enough given that this was a study of chronic disease, in which some patients may have developed before their first admission or diagnosis in the hospital. Second, the annotation model for present illness in EHR notes has the potential to improve precision on some limited symptoms. In the current study, the semantics of tags helped to improve the performance of the model. In the future, we could inject a detailed description of each symptom obtained from multi-modal resources to the model and fuse vital indicators with symptom descriptions in the model. Third, the selected symptoms in this study might not cover the whole range of depressive symptoms compared with other screening tools like CES-D. Some associations of symptoms could therefore have been missed. More screening tools should be examined in the future to include more symptoms.
6. Conclusion
In the present study, depressive symptoms were annotated effectively from EHR notes by the T5-depression model, and network analysis was used to examine the effects of the diagnosis of T2DM and complications on depression. The model achieved acceptable performance on the annotation of depressive symptoms in all datasets, and the connectivity of depressive symptom networks was shown to be associated with the diagnosis of T2DM and hypertension during the past 2 years. In future research, the transition of symptoms during the course of T2DM should be examined, and more symptoms should be included in the model to estimate the relationships with other vital indicators.
Data availability statement
The datasets presented in this article are not readily available because data privacy and security requirements. Requests to access the datasets should be directed to YL, bGl1eXVuJiN4MDAwNDA7bmptdS5lZHUuY24=.
Ethics statement
The studies involving human participants were reviewed and approved by the Ethics Committee of the First Affiliated Hospital, Nanjing Medical University (2020-SR-163). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
WF and CW contributed to conception and design of the study and performed the statistical analysis and wrote the first draft of the manuscript. HM and XZ organized the database. JW and RH prepared the figures in manuscript. HYa and HYu conducted the process of data collection. YL supervised the research activity planning and execution. RM and MJ annotated the datasets and participated in revising the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.
Funding
This work was supported by the Industry Prospecting and Common Key Technology Key Projects of Jiangsu Province Science and Technology Department (Grant no. BE2020721), the National Key Research & Development Plan of Ministry of Science and Technology of China (Grant nos. 2018YFC1314900 and 2018YFC1314901), the Industrial and Information Industry Transformation and Upgrading Special Fund of Jiangsu Province in 2021 [Grant no. (2021)92], the Industrial and Information Industry Transformation and Upgrading Special Fund of Jiangsu Province in 2018 [Grant no. (2019)55], the Key Project of Smart Jiangsu in 2021 [Grant no. (2021)9], the Key Project of Smart Jiangsu in 2020 [Grant no. (2021)1], and Jiangsu Province Engineering Research Center of Big Data Application in Chronic Disease and Intelligent Health Service [Grant no. (2020)1460].
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2022.966758/full#supplementary-material
References
1. Grigsby AB, Anderson RJ, Freedland KE, Clouse RE, Lustman PJ. Prevalence of anxiety in adults with diabetes: a systematic review. J Psychosom Res. (2002) 53:1053–60. doi: 10.1016/S0022-3999(02)00417-8
2. Tabák AG, Akbaraly TN, Batty GD, Kivimäki M. Depression and type 2 diabetes: a causal association? Lancet Diab Endocrinol. (2014) 2:236–45. doi: 10.1016/S2213-8587(13)70139-6
3. Katon W, Pedersen HS, Ribe AR, Fenger-Grøn M, Davydow D, Waldorff FB, et al. Effect of depression and diabetes mellitus on the risk for dementia: a national population-based cohort study. JAMA Psychiatry. (2015) 72:612–9. doi: 10.1001/jamapsychiatry.2015.0082
4. Iturralde E, Chi FW, Grant RW, Weisner C, Van Dyke L, Pruzansky A, et al. Association of anxiety with high-cost health care use among individuals with type 2 diabetes. Diabetes Care. (2019) 42:1669–74. doi: 10.2337/dc18-1553
5. Fung ACH, Tse G, Cheng HL, Lau ESH, Luk A, Ozaki R, et al. Depressive symptoms, co-morbidities, and glycemic control in Hong Kong Chinese elderly patients with type 2 diabetes mellitus. Front Endocrinol. (2018) 9:261. doi: 10.3389/fendo.2018.00261
6. Kimbro LB, Mangione CM, Steers WN, Duru OK, McEwen L, Karter A, et al. Depression and all-cause mortality in persons with diabetes mellitus: are older adults at higher risk? Results from the translating research into action for diabetes study. J Am Geriatr Soc. (2014) 62:1017–22. doi: 10.1111/jgs.12833
7. Almeida OP, McCaul K, Hankey GJ, Yeap BB, Golledge J, Norman PE, et al. Duration of diabetes and its association with depression in later life: the health in men study (HIMS). Maturitas. (2016) 86:3–9. doi: 10.1016/j.maturitas.2016.01.003
8. Skinner TC, Carey ME, Cradock S, Dallosso HM, Daly H, Davies MJ, et al. Depressive symptoms in the first year from diagnosis of Type 2 diabetes: results from the DESMOND trial. Diabetic Med. (2010) 27:965–7. doi: 10.1111/j.1464-5491.2010.03028.x
9. Bruce DG, Casey G, Davis WA, Starkstein SE, Clarnette RC, Foster JK, et al. Vascular depression in older people with diabetes. Diabetologia. (2006) 49:2828–36. doi: 10.1007/s00125-006-0478-y
10. Ascher-Svanum H, Zagar A, Jiang D, Schuster D, Schmitt H, Dennehy EB, et al. Associations between glycemic control, depressed mood, clinical depression, and diabetes distress before and after insulin initiation: an exploratory, post hoc analysis. Diabetes Therapy. (2015) 6:303–16. doi: 10.1007/s13300-015-0118-y
11. Deschênes SS, Burns RJ, Pouwer F, Schmitz N. Diabetes complications and depressive symptoms: prospective results from the Montreal diabetes health and well-being study. Psychosom Med. (2017) 79:603–12. doi: 10.1097/PSY.0000000000000447
12. Yang QQ, Sun JW, Shao D, Zhang HH, Bai CF, Cao FL. The association between diabetes complications, diabetes distress, and depressive symptoms in patients with type 2 diabetes mellitus. Clin Nurs Res. (2021) 30:293–301. doi: 10.1177/1054773820951933
13. van Steenbergen-Weijenburg KM, de Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, et al. Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Health Serv Res. (2010) 10:235. doi: 10.1186/1472-6963-10-235
14. Aujla N, Skinner TC, Khunti K, Davies MJ. The prevalence of depressive symptoms in a white European and South Asian population with impaired glucose regulation and screen-detected Type 2 diabetes mellitus: a comparison of two screening tools. Diabetic Med. (2010) 27:896–905. doi: 10.1111/j.1464-5491.2010.03042.x
15. Siu AL on on behalf of the US Preventive Services Task Force. Screening for depression in children and adolescents: US preventive services task force recommendation statement. Pediatrics. (2016) 137:e20154467. doi: 10.1542/peds.2015-4467
16. Barnacle M, Strand MA, Werremeyer A, Maack B, Petry N. Depression screening in diabetes care to improve outcomes: are we meeting the challenge? Diabetes Educ. (2016) 42:646–51. doi: 10.1177/0145721716662917
17. Kato E, Borsky AE, Zuvekas SH, Soni A, Ngo-Metzger Q. Missed opportunities for depression screening and treatment in the United States. J Am Board Family Med. (2018) 31:389–97. doi: 10.3122/jabfm.2018.03.170406
18. Owens-Gary MD, Zhang X, Jawanda S, Bullard KM, Allweiss P, Smith BD. The importance of addressing depression and diabetes distress in adults with type 2 diabetes. J Gen Intern Med. (2019) 34:320–24. doi: 10.1007/s11606-018-4705-2
19. Fried EI, Nesse RM. Depression sum-scores don't add up: why analyzing specific depression symptoms is essential. BMC Med. (2015) 13:72. doi: 10.1186/s12916-015-0325-4
20. Menachemi N, Collum TH. Benefits and drawbacks of electronic health record systems. Risk Manag Healthc Policy. (2011) 4:47–55. doi: 10.2147/RMHP.S12985
21. Geraci J, Wilansky P, de Luca V, Roy A, Kennedy JL, Strauss J. Applying deep neural networks to unstructured text notes in electronic medical records for phenotyping youth depression. Evidence Based Mental Health. (2017) 20:83–7. doi: 10.1136/eb-2017-102688
22. Patel R, Irving J, Brinn A, Taylor M, Shetty H, Pritchard M, et al. Associations of presenting symptoms and subsequent adverse clinical outcomes in people with unipolar depression: a prospective natural language processing (NLP), transdiagnostic, network analysis of electronic health record (EHR) data. BMJ Open. (2022) 12:e056541. doi: 10.1136/bmjopen-2021-056541
23. Jackson RG, Patel R, Jayatilleke N, Kolliakou A, Ball M, Gorrell G, et al. Natural language processing to extract symptoms of severe mental illness from clinical text: the Clinical Record Interactive Search Comprehensive Data Extraction (CRIS-CODE) project. BMJ Open. (2017) 7:e012012. doi: 10.1136/bmjopen-2016-012012
24. Wu CS, Kuo CJ, Su CH, Wang S, Dai HJ. Using text mining to extract depressive symptoms and to validate the diagnosis of major depressive disorder from electronic health records. J Affect Disord. (2020) 260:617–23. doi: 10.1016/j.jad.2019.09.044
25. Borsboom D. A network theory of mental disorders. World Psychiatry. (2017) 16:5–13. doi: 10.1002/wps.20375
26. Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol. (2013) 9:91–121. doi: 10.1146/annurev-clinpsy-050212-185608
27. van Borkulo C, Boschloo L, Borsboom D, Penninx BWJH, Waldorp LJ, Schoevers RA. Association of symptom network structure with the course of depression. JAMA Psychiatry. (2015) 72:1219–26. doi: 10.1001/jamapsychiatry.2015.2079
28. Kelley SW, Gillan CM. Using language in social media posts to study the network dynamics of depression longitudinally. Nat Commun. (2022) 13:870. doi: 10.1038/s41467-022-28513-3
29. Zhang X, Wang L, Miao S, Xu H, Yin Y, Zhu Y, et al. Analysis of treatment pathways for three chronic diseases using OMOP CDM. J Med Syst. (2018) 42:260. doi: 10.1007/s10916-018-1076-5
30. An JH, Han Kd, Jung JH, Yoo J, Fava M, Mischoulon D, et al. High bodyweight variability increases depression risk in patients with type 2 diabetes mellitus: a nationwide cohort study in Korea. Front Psychiatry. (2021) 12:765129. doi: 10.3389/fpsyt.2021.765129
31. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x
32. Topp CW, Østergaard SD, Søndergaard S, Bech P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. (2015) 84:167–76. doi: 10.1159/000376585
33. Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, et al. Exploring the limits of transfer learning with a unified text-to-text transformer. J Mach Learn Res. (2020) 21:1–67. doi: 10.48550/arXiv.1910.10683
34. Zhang Z, Zhang H, Chen K, Guo Y, Hua J, Wang Y, et al. Mengzi: towards lightweight yet ingenious pre-trained models for Chinese. arXiv:211006696 [cs] (2021). doi: 10.48550/arXiv.2110.06696
35. Devlin J, Chang MW, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. arXiv:181004805 [cs] (2019). doi: 10.48550/arXiv.1810.04805
36. Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et al. RoBERTa: a robustly optimized BERT pretraining approach. arXiv:1907.11692 [cs.CL] (2019). doi: 10.48550/arXiv.1907.11692
37. Cui Y, Che W, Liu T, Qin B, Wang S, Hu G. Revisiting pre-trained models for chinese natural language processing. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: Findings. Online: Association for Computational Linguistics. (2020). p. 657–68.
38. Liu H, Zhang Z, Xu Y, Wang N, Huang Y, Yang Z, et al. Use of BERT (Bidirectional Encoder Representations from Transformers)-based deep learning method for extracting evidences in Chinese radiology reports: development of a computer-aided liver cancer diagnosis framework. J Med Internet Res. (2021) 23:e19689. doi: 10.2196/19689
39. Ji S, Hölttä M, Marttinen P. Does the magic of BERT apply to medical code assignment? A quantitative study. Comput Biol Med. (2021) 139:104998. doi: 10.1016/j.compbiomed.2021.104998
40. Wolf T, Debut L, Sanh V, Chaumond J, Delangue C, Moi A, et al. Transformers: state-of-the-art natural language processing. In: Proceedings of the 2020Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Online: Association for Computational Linguistics. (2020). p. 38–45.
41. Tsoumakas G, Katakis I. Multi-label classification: an overview. Int J Data Warehous Min. (2007) 3:1–13. doi: 10.4018/jdwm.2007070101
42. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: machine learning in python. J Mach Learn Res. (2011) 12:2825–30. doi: 10.5555/1953048.2078195
43. Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods. (2018) 50:195–212. doi: 10.3758/s13428-017-0862-1
44. Epskamp S, Cramer AOJ, Waldorp LJ, Schmittmann VD, Borsboom D. qgraph : network visualizations of relationships in psychometric data. J Stat Softw. (2012) 48:4. doi: 10.18637/jss.v048.i04
45. Borkulo CDv, Boschloo L, Kossakowski JJ, Tio P, Schoevers RA, Borsboom D, et al. Comparing network structures on three aspects: a permutation test. J Stat Software. (2017). doi: 10.1037/met0000476 [Epub ahead of print].
46. Opsahl T, Agneessens F, Skvoretz J. Node centrality in weighted networks: generalizing degree and shortest paths. Soc Networks. (2010) 32:245–51. doi: 10.1016/j.socnet.2010.03.006
47. Friedman C, Alderson PO, Austin JH, Cimino JJ, Johnson SB. A general natural-language text processor for clinical radiology. J Am Med Inform Assoc: (1994) 1:161–74. doi: 10.1136/jamia.1994.95236146
48. Childs LC, Enelow R, Simonsen L, Heintzelman NH, Kowalski KM, Taylor RJ. Description of a rule-based system for the i2b2 challenge in natural language processing for clinical data. J Am Med Inform Assoc: (2009) 16:571–5. doi: 10.1197/jamia.M3083
49. Zhou L, Baughman AW, Lei VJ, Lai KH, Navathe AS, Chang F, et al. Identifying patients with depression using free-text clinical documents. Stud Health Technol Inform. (2015) 216:629–33.
50. Liu X, Hersch GL, Khalil I, Devarakonda M. Clinical trial information extraction with BERT. In: 2021 IEEE 9th International Conference on Healthcare Informatics (ICHI). Victoria, BC: IEEE (2021). p. 505–6.
51. Irving J, Patel R, Oliver D, Colling C, Pritchard M, Broadbent M, et al. Using natural language processing on electronic health records to enhance detection and prediction of psychosis risk. Schizophr Bull. (2021) 47:405–14. doi: 10.1093/schbul/sbaa126
52. Madan S, Julius Zimmer F, Balabin H, Schaaf S, Frohlich H, Fluck J, et al. Deep learning-based detection of psychiatric attributes from German mental health records. Int J Med Inform. (2022) 161:104724. doi: 10.1016/j.ijmedinf.2022.104724
53. Lu Y, Lin H, Xu J, Han X, Tang J, Li A, et al. Text2Event: controllable sequence-to-structure generation for end-to-end event extraction. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). Online: Association for Computational Linguistics. (2021). p. 2795–806.
54. Rantanen AT, Korkeila JJA, Löyttyniemi ES, Saxén UKM, Korhonen PE. Awareness of hypertension and depressive symptoms: a cross-sectional study in a primary care population. Scand J Prim Health Care. (2018) 36:323–8. doi: 10.1080/02813432.2018.1499588
55. Jones LC, Clay OJ, Ovalle F, Cherrington A, Crowe M. Correlates of depressive symptoms in older adults with diabetes. J Diabetes Res. (2016) 2016:8702730. doi: 10.1155/2016/8702730
56. Farner L, Wagle J, Engedal K, Flekkøy KM, Wyller TB, Fure B. Depressive symptoms in stroke patients: a 13 month follow-up study of patients referred to a rehabilitation unit. J Affect Disord. (2010) 127:211–8. doi: 10.1016/j.jad.2010.05.025
57. Ravona-Springer R, Heymann A, Lin HM, Liu X, Berman Y, Schwartz J, et al. Increase in number of depression symptoms over time is related to worse cognitive outcomes in older adults with type 2 diabetes. Am J Geriatr Psychiatry. (2021) 29:1–11. doi: 10.1016/j.jagp.2020.09.022
58. Callahan CM, Boustani MA, Unverzagt FW, Austrom MG, Damush TM, Perkins AJ, et al. Effectiveness of collaborative care for older adults with Alzheimer disease in primary care - a randomized controlled trial. JAMA. (2006) 295:2148–57. doi: 10.1001/jama.295.18.2148
59. Papp M, Gruca P, Lason-Tyburkiewicz M, Willner P. Antidepressant, anxiolytic and procognitive effects of rivastigmine and donepezil in the chronic mild stress model in rats. Psychopharmacology. (2016) 233:1235–43. doi: 10.1007/s00213-016-4206-0
Keywords: type 2 diabetes mellitus, depressive symptoms, natural language processing, network analysis, diabetes complication
Citation: Wan C, Feng W, Ma R, Ma H, Wang J, Huang R, Zhang X, Jing M, Yang H, Yu H and Liu Y (2022) Association between depressive symptoms and diagnosis of diabetes and its complications: A network analysis in electronic health records. Front. Psychiatry 13:966758. doi: 10.3389/fpsyt.2022.966758
Received: 11 June 2022; Accepted: 08 August 2022;
Published: 23 September 2022.
Edited by:
Wenhao Jiang, Southeast University, ChinaReviewed by:
Sowmya Kamath S, National Institute of Technology Karnataka, IndiaJungchan Park, Sungkyunkwan University, South Korea
Venkatesh Avula, Geisinger Health System, United States
Copyright © 2022 Wan, Feng, Ma, Ma, Wang, Huang, Zhang, Jing, Yang, Yu and Liu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yun Liu, bGl1eXVuJiN4MDAwNDA7bmptdS5lZHUuY24=
†These authors have contributed equally to this work