Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 14 February 2023
Sec. Public Mental Health

Predictive potential of somatic symptoms for the identification of subthreshold depression and major depressive disorder in primary care settings

\nXiuwen Li,,&#x;Xiuwen Li1,2,3Huimin Zhang,,,&#x;Huimin Zhang1,2,3,4Xue HanXue Han4Lan Guo,,Lan Guo1,2,3Felicia Ceban,,Felicia Ceban5,6,7Yuhua Liao,,,Yuhua Liao1,2,3,4Jingman Shi,,Jingman Shi1,2,3Wanxin Wang,,Wanxin Wang1,2,3Yifeng LiuYifeng Liu4Weidong SongWeidong Song4Dongjian ZhuDongjian Zhu4Hongqiong Wang,,Hongqiong Wang1,2,3Lingjiang LiLingjiang Li8Beifang Fan
Beifang Fan4*Ciyong Lu,,
Ciyong Lu1,2,3*Roger S. McIntyre,,,,Roger S. McIntyre5,6,7,9,10
  • 1Department of Medical Statistics and Epidemiology, School of Public Health, Sun Yat-sen University, Guangzhou, China
  • 2Guangdong Provincial Key Laboratory of Food, Nutrition and Health, Sun Yat-sen University, Guangzhou, China
  • 3Department of Nutrition, Guangdong Engineering Technology Research Center of Nutrition Translation, Guangzhou, China
  • 4Department of Psychiatry, Shenzhen Nanshan Center for Chronic Disease Control, Shenzhen, China
  • 5Mood Disorders Psychopharmacology Unit, University Health Network, Toronto, ON, Canada
  • 6Brain and Cognition Discovery Foundation, Toronto, ON, Canada
  • 7Braxia Health, Mississauga, ON, Canada
  • 8Mental Health Institute of the Second Xiangya Hospital, Central South University, Changsha, China
  • 9Department of Psychiatry, University of Toronto, Toronto, ON, Canada
  • 10Department of Pharmacology, University of Toronto, Toronto, ON, Canada

Background: The presence of heterogenous somatic symptoms frequently obscures the recognition of depression in primary care. We aimed to explore the association between somatic symptoms and subthreshold depression (SD) and Major Depressive Disorder (MDD), as well as to determine the predictive potential of somatic symptoms in identifying SD and MDD in primary care.

Methods: Data were derived from the Depression Cohort in China study (ChiCTR registry number: 1900022145). The Patient Health Questionnaire-9 (PHQ-9) was used to assess SD by trained general practitioners (GPs), and the Mini International Neuropsychiatric Interview depression module was used to diagnose MDD by professional psychiatrists. Somatic symptoms were assessed using the 28-item Somatic Symptoms Inventory (SSI).

Results: In total of 4,139 participants aged 18–64 years recruited from 34 primary health care settings were included. The prevalence of all 28 somatic symptoms increased in a dose-dependent manner from non-depressed controls to SD, and to MDD (P for trend <0.001). Hierarchical clustering analysis grouped the 28 heterogeneous somatic symptoms into three clusters (Cluster 1: energy-related symptoms, Cluster 2: vegetative symptoms, and Cluster 3: muscle, joint, and central nervous symptoms). Following adjustment for potential confounders and the other two clusters of symptoms, per 1 increase of energy-related symptoms exhibited significant association with SD (OR = 1.24, 95% CI, 1.18–1.31) and MDD (OR = 1.50, 95% CI, 1.41–1.60) The predictive performance of energy-related symptoms in identifying individuals with SD (AUC = 0.715, 95% CI, 0.697–0.732) and MDD (AUC = 0.941, 95% CI, 0.926–0.963) was superior to the performance of total SSI and the other two clusters (P < 0.05).

Conclusions: Somatic symptoms were associated with the presence of SD and MDD. In addition, somatic symptoms, notably those related to energy, showed good predictive potential in identifying SD and MDD in primary care. The clinical implication of the present study is that GPs should consider the closely related somatic symptoms for early recognition for depression in practice.

Introduction

The diagnosis and treatment of Major Depressive Disorder (MDD) is a preeminent public health challenge due to its high prevalence and extensive disease burden (1). Globally, depressive disorders are ranked as the single greatest contributor to non-fatal health loss (7.5% of all Years Lived with Disability) (1). The total estimated number of individuals living with depression increased by 18.4% between 2005 and 2015 (2), with trends likely to increase in the near future due to factors including but not limited to rapid socio-economic development and increased psychosocial stress. Subthreshold depression (SD, also called minor or subsyndromal depression), defined as depressive symptoms present but not meeting the diagnostic threshold for MDD, is regarded as the precursor for incident major depression (3, 4). Persons with SD are nearly twice as likely to develop major depression compared to non-depressed controls (4). Thus, the early detection and management of SD is critical in reducing the onset and severity of clinical depression.

Primary care is the most frequent entry point into the healthcare system. Accordingly, in most countries, the vast majority of individuals with depression are screened, diagnosed, and treated in primary care (5, 6). Although epidemiologic studies have shown that approximately 20% of patients present to primary care with clinically significant depressive symptoms (7), over 50% of patients with depression remain undiagnosed and untreated (8, 9) due to factors including, but not limited to, inadequate diagnostic skills, limited consultation time, and heterogeneous presentations of depression (10, 11). Among the foregoing factors, somatic symptoms (i.e., headache, back pain, fatigue, and heart palpitations) of depression are a predominant hindrance to the recognition of depression in primary care. Although several reports have shown that emotional and cognitive symptoms are prominent both in SD and MDD (12, 13), patients with depression who go to primary care would like to complain about various somatic symptoms rather than emotional and cognitive symptoms (14, 15), which in turn may lead to misdiagnosis with physical disease (16). In western countries, it is reported that 66–93% of patients with depression exhibit somatic symptoms (17, 18), whereas in China, more than 70% of patients with depression exhibit moderate to severe somatic symptoms (19). In addition, patients may be hesitant to discuss psychological distress in non-psychiatric settings, and instead, choose to focus on their somatic symptoms. Therefore, improving the evaluation of depressive-related somatic symptoms may be feasible and effective toward the early recognition and management of SD and MDD in primary care.

The importance of somatic symptoms in SD and MDD has been raised in the past decades. Tuithof et al. found that chronic physical disorders, which may cause various somatic symptoms, were risk factors for SD to MDD (20). Castellini et al. reported that several somatic symptoms including migraine, headache, and fatigue could serve as early signs of mood disorders (21). Our previous study (13), which aimed to examine the impact of cognitive-affective and somatic domains on the transitions of SD, also found that compared to the remission and intermittent group, participants with persistent depressive symptoms during 12 months showed significantly higher somatic symptom scores. Besides, McMahon and colleagues reported that somatic symptoms in energy level accounted for the elevated prevalence of SD among pregnant women (22). Novick et al. found that among various somatic symptoms, pain-related symptoms showed the greatest prognostic value for treatment response and remission in patients with MDD (23). Thus, somatic symptoms are gaining increasing attention both in SD and MDD, and the results varied in previous studies due to different populations and the heterogeneity of somatic symptoms. However, there is limited research investigating the extensive somatic symptoms across the spectrum from SD to MDD in the general population. Besides, considering the high heterogeneity of various somatic symptoms, exploring the associations between different clusters of somatic symptoms and depression might help to recognize the most closely depressive-related somatic symptoms.

Therefore, the present population-based study was conducted to (1) explore the correlations between extensive somatic symptoms and depressive symptoms, and identify different clusters of somatic symptoms via cluster analysis, (2) the association between total somatic symptoms, as well as different clusters of somatic symptoms, and SD and MDD, (3) evaluate whether assessing total and different clusters of somatic symptoms would be useful toward the early identification of SD and MDD in primary care.

Participants and methods

Study design and participants

Data were derived from the Depression Cohort in China (DCC) study (ChiCTR registry number: 1900022145), which is an ongoing population-based longitudinal study with the aim to improve early identification, treatment, prevention, and management of subthreshold and clinical depression. The DCC study uses a Toronto-based Building Bridges to Integrate Care (BRIDGES) model (24) to standardize the screening, diagnosis, and treatment of subthreshold depression and depression. A detailed description of the DCC study design has been described elsewhere (25).

In our analysis, participants aged 18–64 years were recruited from 34 primary health care settings between January 2019 and November 2020. Exclusion criteria were: (1) diagnosis of severe psychiatric disorder (i.e., bipolar disorder, schizophrenia, schizoaffective mental disorder, paranoid mental disorder mental disorders caused by epilepsy, or mental retardation), and/or alcohol or drug addiction disorder; (2) pregnant or perinatal women; (3) non-fluency in mandarin; (4) inability to understand study questionnaires or provide informed consent. Additionally, participants were excluded from all analyses if they were missing or had incomplete data concerning: demographic characteristics, smoking, drinking, body mass index (BMI), sleep duration, sleep quality, evaluation of somatic symptoms, and evaluation of depression. All study procedures were carried out in accordance with the Declaration of Helsinki, and written informed consent was obtained from all participants.

Study measures

Diagnosis of subthreshold depression and major depressive disorder

Participants were consecutively recruited and first screened for SD by trained general practitioners (GPs) at the point of enrollment. Participants with SD were further referred to the psychiatry department to take part in the face-to-face Mini-International Neuropsychiatric Interview (MINI) to receive the diagnosis of MDD within 12 months.

SD was assessed using the Patient Health Questionnaire-9 (PHQ-9) administered by trained GPs, and the PHQ-9 was previously identified as the most reliable tool for screening depression (26). SD was operationalized as a total PHQ-9 score ≥5 and no current or past history of MDD. Since higher PHQ-9 scores are associated with a higher risk of MDD, and a cut-off score of ≥10 has the best accuracy to detect MDD (27, 28), participants with SD were divided into low-risk and high-risk groups in the subsequent analysis. The Cronbach α for PHQ-9 was 0.77 in this study.

According to PHQ-9 and MINI assessments, all study participants were divided into 4 groups: (1) the non-depressed control group (n = 900) was operationalized as PHQ-9 total score ≤ 4 without a history of MDD; (2) the low-risk group (n = 2,044) was operationalized as PHQ-9 total score 5–9 without a history of MDD; (3) the high-risk group (n = 975) was operationalized as PHQ-9 ≥ 10 and no definitive clinical diagnosis of MDD according to the MINI; (4) the MDD group (n = 220) consisted of individuals with a definitive clinical diagnosis of MDD in accordance with the MINI depression module.

Assessment of somatic symptoms

Somatic symptoms were assessed using the 28-item Somatic Symptoms Inventory (SSI), a self-report scale appraising extensive somatic symptoms which have bothered the respondent in the past week. The SSI rates the respondent's degree of discomfort for each of the included 28 symptoms from 1 to 5 (1 = absent; 2 = a little bit; 3 = moderate; 4 = quite a bit; 5 = a great deal). The total SSI score (i.e., the sum of all items) was used to quantify the severity of somatic symptoms. The Cronbach α for PHQ-9 was 0.XXX in this study. The Cronbach α for SSI was 0.95 in this study.

Additional covariates

Additional covariates, including demographic characteristics, health status, and behavioral habits, were assessed via self-report questionnaires. Chronic disease was defined as the prevalence of any of the following: (1) hypertension; (2) diabetes; (3) heart disease; (4) apoplexy; (5) thyroid disease; (6) dyslipidemia; (7) hyperuricemia; (8) gastrointestinal issues (i.e., chronic gastritis, gastric ulcer, gastroesophageal reflux); (9) history of tumors. Body mass index (BMI) was calculated as weight in kilograms divided by height in meters squared. Sleep duration was defined as self-reported actual sleep time at night, and sleep quality was self-assessed across 5 levels ranging from very good to very poor.

Statistical analysis

Continuous variables were reported as the median (interquartile range, IQR), and compared using the Kruskal–Wallis H test for overall groups. Categorical variables were expressed by measures of frequency and percentages, and intergroup comparisons were analyzed via the chi-squared test. The percent prevalence of every somatic symptom (self-reporting any of the following options: a little bit; moderate; quite a bit and a great deal) was calculated separately according to different groups. The Cochran-Armitage trend test was used to determine the trend in the prevalence of each somatic symptom, and the percentage of individuals exhibiting a mean SSI item score (i.e., total SSI score divided by 28) ≥2 from non-depressed controls to SD, and to MDD.

Bivariate correlations between each PHQ-9 and SSI item were determined via Kendall correlation coefficient analysis. Hierarchical clustering analysis was employed to yield clusters of 28 SSI items (based on their Kendall correlation coefficients matrix with PHQ-9 items), and the number of clusters was determined based on the proportion of variation in the data captured by the clusters. To validate the accuracy and stability of the clustering, participants were randomly divided into a discovery set and a validation set at a 1:1 ratio in hierarchical clustering analysis, and external criteria of Rand index (29) of the clusters derived from the two independent datasets were calculated to obtain numerical comparison values.

Subsequently, a multivariable-adjusted general linear model (GLM) was used to evaluate the linear trend of different clusters of somatic symptoms from non-depressed controls to SD, and to MDD. To estimate the odds ratios (ORs) per 1 score increase of total SSI or different clusters for SD, and MDD, multinomial logistic regression analysis was performed rather than an ordinal regression model because the parallel regression assumption was violated. Receiver operating characteristic (ROC) curve analysis was performed to test the predictive potential of total SSI or different clusters of somatic symptoms in identifying participants with SD or MDD, using the bootstrap method to compare different measures of the area under the curve (AUC). All statistical analyses were performed using R (4.2.1). A 2-sided P < 0.05 was considered statistically significant.

Results

Characteristics of study population

A total of 4,139 participants were included in this study. The median (IQR) age for all the participants was 36.0 (29.0, 47.0) years and 37.7% were male. Among all participants, 900 (21.7%) were classified into the non-depressed control group, 3,019 (73.0%) exhibited SD, of which 2,044 (49.4%) were stratified to the low-risk group and 975 (23.6%) to the high-risk group. A total of 220 (5.3%) participants were definitively diagnosed with MDD. Baseline characteristics, including demographic factors, health status, behavioral habits, PHQ-9 score, and SSI score, are summarized in Table 1. Median age and frequency of smoking in the past month were balanced among participants within different groups. Compared with the normal group, participants with SD or MDD had higher rates of single status or divorce, chronic diseases, increased frequency of drinking alcohol in the past month, lower BMI, lower exercise frequency, shorter sleep duration, and worse sleep quality.

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics of the study participants.

Prevalence of somatic symptoms across participant groups

The prevalence of all 28 somatic symptoms assessed by the SSI (with presence operationalized as an item score ≥ 2) was higher in participants with SD or MDD compared to the non-depressed control group. Furthermore, individuals with MDD demonstrated a higher prevalence of all 28 somatic symptoms compared to individuals with SD. The results of the Cochran-Armitage trend test demonstrated that the prevalence of all 28 somatic symptoms increased when going from the non-depressed control group to SD, and then to MDD (P for trend < 0.001) (Table 2). Similarly, the prevalence of a mean item score (i.e., total SSI score divided by 28) ≥2 increased going from the non-depressed control group to SD, and then to MDD (P for trend < 0.001). The prevalence of several symptoms, including feeling faint or dizzy, feeling not in as good physical health as most friends, feeling weak in parts of the body, and not feeling well most of the time in the past few years, was less than 25% in the non-depressed control group, compared to >50% in the high-risk group, and >75% in persons with MDD.

TABLE 2
www.frontiersin.org

Table 2. Prevalence (%) of Somatic symptoms in different groups.

Correlation analysis and clustering analysis of SSI and PHQ-9

We performed Kendall correlation analysis to investigate the correlations between items on the SSI and PHQ-9. A significant correlation was determined between each SSI and PHQ-9 item (P < 0.05). A heatmap of the Kendall correlation coefficients is shown in Figure 1. Subsequently, Hierarchical clustering analysis was applied to the yield clusters of unique SSI items based on their Kendall correlation coefficients matrix with each PHQ-9 item. To validate the accuracy and stability of the clustering, participants were randomly divided into a discovery set (n = 2,070) and a validation set (n = 2,069) at a 1:1 ratio. Three clusters of different somatic symptoms were identified by this unsupervised classification approach in each dataset. In sum, 26 (92.9%) of the 28 SSI items were allocated to the same cluster using the discovery set and validation set with a Rand index of 0.90, indicating good accuracy and stability of the clustering. In both datasets, Cluster 1 consists of 6 energy-related symptoms (SSI items: 4, 7, 17, 21, 22, and 23); Cluster 2 of the discovery set consists of 15 vegetative symptoms (SSI items: 1, 3, 8, 9,11, 12, 14, 16, 18, 19, 20, 24, 25, 26, and 28) and Cluster 3 of the discovery set consists of 7 muscle, joint and central nervous symptoms (SSI items: 2, 5,6, 10, 13, 15, and 27). There were 2 symptoms, SSI item 3 (pains or cramps in your abdomen), and item 9 (pain in lower back) which were grouped in Cluster 2 using the discovery set, but grouped in Cluster 3 using the validation set. Finally, Clusters derived from the discovery set were used in the following analysis according to experts' opinions. The cluster scores were calculated by summing the items in each cluster.

FIGURE 1
www.frontiersin.org

Figure 1. Heatmap of Kendall correlation coefficient between SSI and PHQ-9. (A) Heatmap of Kendall correlation coefficient between SSI and PHQ-9 in discovery set (n = 2,070); (B) Heatmap of Kendall correlation coefficient between SSI and PHQ-9 in validation set (n = 2069). Significant correlations were found between each SSI item and each PHQ-9 item using Kendall correlation analysis (P < 0.05). Hierarchical clustering analysis was applied to the yield clusters of the 28 SSI items based on their Kendall correlation coefficients with PHQ-9, and the number of clusters was decided based on the proportion of variation in the data captured by the clusters. PHQ-9, indicates patient health questionnaire-9; P01 to P09, represents item 1 to item 9 in PHQ-9; SSI indicates somatic symptoms inventory; SSI_01 to SSI_28, represents item 1 to item 28 in SSI. Cluster 1 consists of 6 energy-related symptoms, including fatigue, weakness, faintness or dizziness, heavy arms or legs, feeling unwell most of the time in the past few years, feeling not in as good physical health most friends; Cluster 2 consists of 15 vegetative symptoms, including nausea and vomiting, pains, or cramps in abdomen, indigestion, upset stomach, or acid stomach, fullness in head or nose, back pain, trouble in catching, breath, pains in heart or chest, heart pounding, turning over or missing a beat, numbness, tingling or burning, headaches, lump in throat, hands and feet not feeling warm enough, sense that hearing is not as good as it used to be; Cluster 3 consists of 7 muscle, joint and central nervous symptoms, including muscles soreness, muscles twitching or jumping, joint pain, trouble with vision, ringing, or buzzing in ears, difficulty in keeping balance while walking, constipation.

The median (IQR) Cluster 1 (energy-related symptoms) scores for non-depressed control, low-risk, high-risk, and MDD groups were 7 (6, 8), 8 (7, 10), 12 (9, 16), and 17 (22, 23), respectively. The median (IQR) Cluster 2 (vegetative symptoms) scores for non-depressed control, low-risk, high-risk, and MDD groups were 16 (15, 18), 17 (16, 21), 23 (18, 30), and 28 (22, 35), respectively. The median (IQR) Cluster 3 (muscle, joint and central nervous symptoms) scores for non-depressed control, low-risk, high-risk, and MDD groups were 8 (7, 9), 9 (7, 10), 11 (8, 14), and 12 (10, 16), respectively (Figure 2). There were significant increasing trends for all three clusters' scores going from non-depressed control to SD and to MDD after adjustment for age, gender, marital status, education, employed status, family income, living status, chronic disease, smoking frequency, drinking frequency, BMI, exercise frequency, sleep duration, and sleep quality (P for trend < 0.001).

FIGURE 2
www.frontiersin.org

Figure 2. Boxplot of Total SSI score and different clusters scores. (A) Total SSI score in different groups; (B) Cluster 1(energy-related symptoms) score in different groups; (C) Cluster 2 (vegetative symptoms) score in different groups; (D) Cluster 3 (muscle, joint and central nervous symptoms) score in different groups. P for trend was determined by General linear model (GLM) evaluating the linear trend of the different clusters of somatic symptoms from non-depressed individuals to SD, and to MDD after adjustment for age, gender, marital status, education, employed status, family income, living status, chronic disease, smoking frequency, drinking frequency, BMI, exercise frequency, sleep duration, and sleep quality. SD, subthreshold depression; MDD, major depressive disorder; SSI, somatic symptoms inventory.

Association between total SSI score or cluster scores and presence of SD or MDD

Univariate multinomial logistic regression analysis revealed that, compared to the non-depressed controls, an increase in total SSI score, or an increase in any of the three cluster scores, was associated with an increased odds ratio of SD (both low-risk and high-risk group) and MDD respectively. After controlling for potential confounders, compared to the non-depressed control group, the OR for SD and MDD was 1.08 (95% CI, 1.07–1.09) and 1.13 (95% CI, 1.11–1.14) with per 1 total SSI score increase, respectively (Table 3). When the 28 SSI items were divided into three clusters of somatic symptoms via Hierarchical clustering analysis, after controlling for potential confounders, a per 1 score increase in Cluster 1(energy-related symptoms) was associated with a significant increase in the odds ratio of SD (OR = 1.30, 95% CI, 1.25–1.35) and MDD (OR = 1.53, 95% CI, 1.46–1.61) compared to the non-depressed control group, respectively. Moreover, the odds ratio in the high-risk group was greater than in the low-risk group. The increase in the odds ratio of SD and MDD by Cluster 2 (vegetative symptoms) and Cluster 3 (muscle, joint and central nervous symptoms) scores were lower than by Cluster 1 (energy-related symptoms) after adjustment for confounders (Table 3). Even further adjusted for the other two clusters of somatic symptoms, Cluster 1 (energy-related symptoms) was positively associated with the presence of SD (OR = 1.24, 95% CI, 1.18–1.31) and MDD (OR = 1.50, 95% CI, 1.41–1.60).

TABLE 3
www.frontiersin.org

Table 3. Association between total SSI score or different cluster scores and the presence of SD or MDD.

We also estimate the odds ratio per 1 score increase of total SSI or different clusters in MDD vs. SD subjects, with SD (or its subgroups) as the reference groups (Supplementary Table 1). Compared to the SD group, a per 1 score increase in total SSI and Cluster 1 (energy-related symptoms) was associated with a significant increase in the odds ratio of MDD, respectively. Besides, a per 1 score increase in total SSI and Cluster 1 (energy-related symptoms) was significantly associated with an increase in the odds ratio of MDD, both using the low-risk or high-risk group as the reference group, respectively.

Predictive potential of total SSI score or cluster scores in identifying SD or MDD

The total SSI score and all three cluster scores demonstrated a moderate but significant ability to identify participants with SD. The AUC for total SSI, Cluster 1 (energy-related symptoms), Cluster 2 (vegetative symptoms), and Cluster 3 (muscle, joint and central nervous symptoms) were 0.707 (95% CI, 0.689–0.725), 0.715 (95% CI, 0.697–0.732), 0.688 (95% CI, 0.670–0.706), and 0.641 (95% CI, 0.451–0.763), respectively. The sensitivity and specificity were 59.0 and 71.1% for the total SSI score, 66.7 and 64.6% for Cluster 1 (energy-related symptoms), 58.5 and 69.4% for Cluster 2 (vegetative symptoms), and 45.1 and 76.3% for the Cluster 3 (muscle, joint and central nervous symptoms). The predictive potential of the total SSI score in identifying SD was equal to that of Cluster 1 (energy-related symptoms) (P for bootstrap method = 0.109), but superior to Cluster 2 (vegetative symptoms) and Cluster 3 (muscle, joint and central nervous symptoms) (P for bootstrap method < 0.001). The foregoing results are presented in Table 4.

TABLE 4
www.frontiersin.org

Table 4. Receiver operating characteristic analysis of total SSI score and different Clusters scores in identifying SD and MDD.

In distinguishing participants with MDD from the non-depressed control group, Cluster 1 (energy-related symptoms) demonstrated good predictive potential with an AUC, sensitivity, and specificity of 0.941 (95% CI, 0.926–0.963), 83.2%, and 91.7%, respectively, which was significantly better than the performance of total SSI score (AUC, 0.932; 95% CI, 0.912–0.951; sensitivity, 82.7%; specificity, 89.3%, P for bootstrap method = 0.011). The performance of both Cluster 2 (vegetative symptoms) and Cluster 3 (muscle, joint and central nervous symptoms) in distinguishing MDD were lower than for Cluster 1 (energy-related symptoms) (P for bootstrap method < 0.001).

Furthermore, compared with the SD group, participants in the MDD group could be identified by total SSI score with a sensitivity of 80.9% and a specificity of 67.0% (AUC, 0.802; 95% CI, 0.773–0.831), which was inferior to the performance of the of Cluster 1(energy-related symptoms) (AUC, 0. 822; 95% CI, 0.793–0.850; sensitivity, 69.5%; specificity, 82.7%, P for bootstrap method = 0.004). The ROC analysis results of the total SSI score and different clusters in other subgroup comparisons were concluded in Table 4 and Supplementary Table 2.

We also performed analyses to examine the ROC when a specific cluster was excluded, respectively. The results were concluded in Supplementary Table 3. In distinguishing participants with SD from the non-depressed control group, after excluding Cluster 1 (energy-related symptoms) from the total SSI, the AUC decreased from 0.707 (0.689–0.725) to 0.683 (0.665–0.702), P for bootstrap method < 0.001; while after excluding Cluster 3 (muscle, joint and central nervous symptoms) from the total SSI, the AUC increased from 0.707 (0.689–0.725) to 0.716 (0.698-0.734), P for bootstrap method < 0.001. In distinguishing participants with MDD from the non-depressed control group, excluding cluster 1 (energy-related symptoms) from the total SSI resulted in a decrease of the AUC from 0.932 (0.912–0.951) to 0.902 (0.876–0.928), P for bootstrap method < 0.001; while excluding cluster 3 (muscle, joint and central nervous symptoms) from the total SSI resulted in an increase of the AUC from 0.932 (0.912–0.951) to 0.938 (0.919–0.957), P for bootstrap method = 0.022.

Discussion

In this large population-based study analyzing data derived from primary care settings, we determined that somatic symptoms were correlated with depressive symptoms, and significantly increased in a dose-dependent manner from non-depressed controls to SD, and to MDD. Among all the somatic symptoms assessed by the 28-item SSI, a cluster of energy-related symptoms (including fatigue, weakness, faintness or dizziness, heavy arms or legs, or feeling unwell most of the time in the past few years, feeling not in as good physical health most friends) showed the best performance to identify participants with SD and MDD from non-depressed participants followed by vegetative symptoms. Besides, the ability of energy-related symptoms to discern SD and MDD was superior to that of the total SSI score. To our knowledge, this is the first large population-based study to investigate the effects of somatic symptoms across the spectrum from non-depressed controls to SD and to MDD, and to evaluate the predictive ability of total SSI score and different clusters of somatic symptoms in identifying SD and MDD.

The identification of depression-related somatic symptoms might be feasible and effective for the recognition of depression. However, there is currently no gold standard method to assess for somatic symptoms associated with depression in primary care. In addition, a standard classification for the heterogeneous and abundant array of somatic symptoms does not currently exist. The 28-item SSI, which includes 28 different somatic symptoms across the entire body, is always used to assess somatic symptoms in patients with depression and other psychological disorders (30, 31). Previous studies have subdivided the 28 SSI items into different dimensions to explore the associations between different dimensions and the clinical outcomes of diagnosed MDD (19, 23, 3234). Compared with the previous studies mentioned above, our study focused on a spectrum of participants including SD and MDD, and aimed to evaluate whether a particular cluster of depression-related somatic symptoms could demonstrate the greatest screening potential for SD and MDD. In light of the different study populations and study objectives, we did not believe the aforementioned classification of somatic symptoms to be the optimal somatic symptom grouping strategy for screening depression. Via our unsupervised classification approach, we determined three clusters (energy, vegetative, and other) of somatic symptoms, which were different from the two-dimension (painful and non-painful) or four-dimension (pain, autonomic, energy, and central nervous symptoms) classification in the previous studies (19, 23, 33). Somatic symptoms are heterogeneous that may include different biological entities and require different management. The total SSI included extensive somatic symptoms which could be interpreted as the total burden of physical symptoms, while the three clusters yielded by clustering analysis represent different domains. The previous studies determined that pain symptoms but not the other dimensions were closely associated with the clinical outcomes of diagnosed MDD (23, 32, 33). Interestingly, in our study, the energy cluster demonstrated superior predictive performance in identifying SD and MDD compared to vegetative and other somatic symptoms. Our results indicated that energy-related somatic symptoms may be more useful for screening depression in primary care, followed by vegetative symptoms. The other symptoms, including muscle, joint and central nervous symptoms, might be less useful in such areas.

Although many studies have shown that emotional and cognitive symptoms are prominent in SD (35) and MDD (12), patients with depression who go to primary care would like to complain about various somatic symptoms rather than emotional and cognitive symptoms (14, 15). As a result, a growing body of evidence supported that somatic symptoms are predominant hindrances to the recognition of depression in primary care (1416). In contrast, recent research held the opinion that somatic symptoms might represent a valid tool for early recognition of depression for the first request of help to GPs when enough attention was paid to the depression-related somatic symptoms (21). In accordance with the Castellini et al. study (21), our results supported that somatic symptoms could be interpreted as an early sign of depression, and represent a valid indication for the GPs diagnostic process of depression. Our previous study (13), which aimed to explore the impact factor on the longitudinal illness deterioration in subjects with SD, found that cognitive-affective symptoms in SD are at greater risk of illness deterioration. At the same time, we also found that compared to subjects showing a remission or intermittent trend, subjects with persistent SD during 12 months showed higher baseline and followed-up somatic symptom scores (13), which indicated that higher burden of somatic symptoms could also play negative effects on worse SD transition. In the current study aiming at examining the predictive potential of somatic symptoms for the early identification of SD and MDD at the point of screening, we further found that somatic symptoms, especially the energy, and vegetative symptoms, showed good predictive potential in identifying SD and MDD in primary care settings. Given that most countries do not recommend screening depression routinely using tools including the emotional and cognitive symptoms in primary care (5), as well as the high initiative complaint of various somatic symptoms in patients with depression who seek help from the GPs (14, 15), it is important to improve the awareness of depression-related somatic symptoms both to GPs and patients at the screening at point of care.

Because the recruitment and assessment period of some participants occurred during the COVID-19 pandemic, concerns about the pandemic and related health measurements might have impacts on the somatic and depressive symptoms of participants. The prevalence of somatic symptoms in our study were higher than that in previous study (21). Nonetheless, consistent with the previous studies before the COVID-19 pandemic (21), our study found that somatic symptoms could help to early recognize depression in primary care. The significance of somatic symptoms in SD and MDD has been raised in the past decades. However, there is limited literature concerning the extensive somatic symptoms across the spectrum of depression. Besides, the ability of the heterogeneous somatic symptoms to identify SD and MDD was not clear. Our study extends the foregoing knowledge base in the following aspects. First, somatic symptoms were highly present in SD compared to non-depressed persons, and increased in a dose-dependent manner from non-depressed individuals to SD and then to MDD in the community population. Second, the extensive somatic symptoms were positively correlated with depressive symptoms, and different clusters of depression-related somatic symptoms could be drawn according to the closeness of correlation. Third, somatic symptoms showed good ability in distinguishing SD and MDD, especially the energy-related symptoms. Taken together, somatic symptoms should be investigated thoroughly in the management of the full range of depression. As the idea of preventing depression gains more traction (36), the assessment and treatment of SD have become a priority (3739). Further studies to elucidate whether treating somatic symptoms in SD could help to reduce incident MDD are warranted.

The results of our study should be interpreted within the context of several limitations. First, the study participants were only recruited from primary care settings in China, therefore our findings may not generalize to other countries due to factors including but not limited to differences in cultural practices and healthcare systems. However, it is noteworthy that literature from other countries has recognized the importance of somatic symptoms in identifying MDD. Second, the somatic symptoms in our study were assessed via the 28-item SSI; we did not measure and analyze other somatic symptoms which may be present in our study population. We plan to expand to include additional somatic symptoms in future studies. Third, participants in our study were recruited from 34 primary health care settings who seek help for basic medical services, and GPs selectively screened those who had mental health-related physical complaints (e.g., sleep problems and chronic somatic pain) or are more likely to have mental health issues based on the GPs' clinical experience and our study training (25). However, the information about the treatment and resolution of specific symptoms leading to the consultation was not collected, which might have a potential influence on the psychic wellbeing of participants. Fourth, information on family history of psychiatric disorders other than depression was not collected in our study. Despite these limitations, to our knowledge, this is the first large population study conducted in primary care settings to investigate the association of somatic symptoms with SD and MDD, and to evaluate whether somatic symptoms are useful toward the recognition of SD and MDD in primary care settings. The strengths of this study included the large representative community-based sample, and the use of a clinically validated diagnostic interview (i.e., MINI) to diagnose MDD.

Conclusion

Herein, we established that somatic symptoms were associated with the presence of SD and MDD, and increased in a dose-dependent manner from non-depressed controls to SD, and to MDD. Moreover, somatic symptoms showed good predictive performance in identifying SD and MDD in primary care settings. Besides, a cluster of energy-related symptoms showed the best identifying ability followed by vegetative symptoms. The clinical implication of the present study is that GPs should consider the closely related somatic symptoms for early recognition and management of depression in practice.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by Sun Yat-sen University School of Public Health Institutional Review Board. The patients/participants provided their written informed consent to participate in this study.

Author contributions

XL, LG, BF, and CL conceived and designed the study. XL performed data analysis and drafted the manuscript. HZ acquired, analyzed, and interpreted the data. YLia, JS, WW, YLiu, WS, DZ, and HW collected the data. HZ, YLia, and XH supervised the study in the 34 primary care settings. LG, LL, FC, RM, BF, and CL provided guidance to revise the draft. All authors critically revised the manuscript for scientific content and approved the final version of the article.

Funding

This study was supported by the National Key Research and Development Program of China (Grant No. 2018YFC2000705) and National Natural Science Foundation of China (Grant No. 81761128030). The work described is original research that has not been published previously and is not under consideration for publication elsewhere, in whole or in part.

Acknowledgments

We thank all residents participating in this study. We also appreciate the GPs and psychiatrists from the Nanshan hospital group participating in the Depression Cohort in China (DCC) study. The DCC study is conducted by the Sun Yat-sen University and Shenzhen Nanshan Center for Chronic Disease Control in Shenzhen, China.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2023.999047/full#supplementary-material

References

1. WHO. Depression and Other Common Mental Disorders: Global Health Estimates. Geneva, Switzerland, World Health Organization (2017).

Google Scholar

2. Vos T, Allen C, Arora M, Barber RM, Bhutta ZA, Brown A, et al. regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. (2016) 388:1545–602.

PubMed Abstract | Google Scholar

3. Kroenke K. When and how to treat subthreshold depression. JAMA. (2017) 317:702–4. doi: 10.1001/jama.2017.0233

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Lee YY, Stockings EA, Harris MG, Doi SAR, Page IS, Davidson SK, et al. The risk of developing major depression among individuals with subthreshold depression: a systematic review and meta-analysis of longitudinal cohort studies. Psychol Med. (2019) 49:92–102. doi: 10.1017/S0033291718000557

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Ferenchick EK, Ramanuj P, Pincus HA. Depression in primary care: part 1-screening and diagnosis. BMJ. (2019) 365:l794. doi: 10.1136/bmj.l794

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Ramanuj P, Ferenchick EK, Pincus HA. Depression in primary care: part 2-management. BMJ. (2019) 365:l835. doi: 10.1136/bmj.l835

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Mitchell AJ, Vaze A, Rao S. Clinical diagnosis of depression in primary care: a meta-analysis. Lancet. (2009) 374:609–19. doi: 10.1016/S0140-6736(09)60879-5

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Zhong B-L, Ruan Y-F, Xu Y-M, Chen W-C, Liu L-F. Prevalence and recognition of depressive disorders among Chinese older adults receiving primary care: A multi-center cross-sectional study. J Affect Disord. (2020) 260:26–31. doi: 10.1016/j.jad.2019.09.011

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Craven MA, Bland R. Depression in primary care: current and future challenges. Can J Psychiatry. (2013) 58:442–8. doi: 10.1177/070674371305800802

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Searle K, Blashki G, Kakuma R, Yang H, Zhao Y, Minas H. Current needs for the improved management of depressive disorder in community healthcare centres, Shenzhen, China: a view from primary care medical leaders. Int J Ment Health Syst. (2019) 13:47. doi: 10.1186/s13033-019-0300-0

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Hou J, Michaud C, Li Z, Dong Z, Sun B, Zhang J, et al. Transformation of the education of health professionals in China: progress and challenges. Lancet. (2014) 384:819–27. doi: 10.1016/S0140-6736(14)61307-6

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Howland RH, Schettler PJ, Rapaport MH, Mischoulon D, Schneider T, Fasiczka A, et al. Clinical features and functioning of patients with minor depression. Psychother Psychosom. (2008) 77:384–9. doi: 10.1159/000151519

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Liao Y, Zhang H, Guo L, Fan B, Wang W, Teopiz KM, et al. Impact of cognitive-affective and somatic symptoms in subthreshold depression transition in adults: Evidence from Depression Cohort in China (DCC). J Affect Disord. (2022) 315:274–81. doi: 10.1016/j.jad.2022.08.009

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Caballero L, Aragonès E, García-Campayo J, Rodríguez-Artalejo F, Ayuso-Mateos JL, Polavieja P, et al. characteristics, and attribution of somatic symptoms in Spanish patients with major depressive disorder seeking primary health care. Psychosomatics. (2008) 49:520–9. doi: 10.1176/appi.psy.49.6.520

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Tylee A, Gandhi P. The importance of somatic symptoms in depression in primary care. Prim Care Companion J Clin Psychiatry. (2005) 7:167–76. doi: 10.4088/PCC.v07n0405

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Tylee A. Identifying and managing depression in primary care in the United kingdom. J Clin Psychiatry. (2006) 67:41–5.

PubMed Abstract | Google Scholar

17. Vaccarino AL, Sills TL, Evans KR, Kalali AH. Prevalence and association of somatic symptoms in patients with Major Depressive Disorder. J Affect Disord. (2008) 110:270–6. doi: 10.1016/j.jad.2008.01.009

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Bekhuis E, Boschloo L, Rosmalen JGM, Schoevers RA. Differential associations of specific depressive and anxiety disorders with somatic symptoms. J Psychosom Res. (2015) 78:116–22. doi: 10.1016/j.jpsychores.2014.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Novick D, Montgomery WS, Aguado J, Peng X, Brugnoli R, Haro JM. Which somatic symptoms are associated with an unfavorable course in Chinese patients with major depressive disorder? Asia Pac Psychiatry. (2015) 7:427–35. doi: 10.1111/appy.12189

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Tuithof M, Ten Have M, van Dorsselaer S, Kleinjan M, Beekman A, Graaf Rde. Course of subthreshold depression into a depressive disorder and its risk factors. J Affect Disord. (2018) 241:206–15. doi: 10.1016/j.jad.2018.08.010

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Castellini G, Pecchioli S, Cricelli I, Mazzoleni F, Cricelli C, Ricca V, et al. How to early recognize mood disorders in primary care: A nationwide, population-based, cohort study. Eur Psychiat. (2016) 37:63–9. doi: 10.1016/j.eurpsy.2016.04.003

PubMed Abstract | CrossRef Full Text | Google Scholar

22. McMahon AB, Arms-Chavez CJ, Harper BD, LoBello SG. PHQ-8 minor depression among pregnant women: association with somatic symptoms of depression. Arch Womens Ment Health. (2017) 20:405–9. doi: 10.1007/s00737-017-0715-z

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Novick D, Montgomery W, Aguado J, Kadziola Z, Peng X, Brugnoli R, et al. Which somatic symptoms are associated with an unfavorable course in Asian patients with major depressive disorder? J Affect Disord. (2013) 149:182–8. doi: 10.1016/j.jad.2013.01.020

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Bhattacharyya O, Schull M, Shojania K, Stergiopoulos V, Naglie G, Webster F, et al. Building bridges to integrate care (BRIDGES): Incubating health service innovation across the continuum of care for patients with multiple chronic conditions. Healthc Q. (2016) 19:60–6. doi: 10.12927/hcq.2016.24701

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Zhang H, Liao Y, Han X, Fan B, Liu Y, Lui LMW, et al. Screening depressive symptoms and incident major depressive disorder among chinese community residents using a mobile app-based integrated mental health care model: cohort study. J Med Internet Res. (2022) 24:e30907. doi: 10.2196/30907

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Costantini L, Pasquarella C, Odone A, Colucci ME, Costanza A, Serafini G, et al. Screening for depression in primary care with Patient Health Questionnaire-9 (PHQ-9): A systematic review. J Affect Disord. (2021) 279:473–83. doi: 10.1016/j.jad.2020.09.131

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Levis B, Benedetti A, Thombs BD. Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: individual participant data meta-analysis. BMJ. (2019) 365:l1476. doi: 10.1136/bmj.l1476

PubMed Abstract | CrossRef Full Text | Google Scholar

28. He C, Levis B, Riehm KE, Saadat N, Levis AW, Azar M, et al. The accuracy of the patient health questionnaire-9 algorithm for screening to detect major depression: an individual participant data meta-analysis. Psychother Psychosom. (2020) 89:25–37.

PubMed Abstract | Google Scholar

29. Ghebremedhin M, Heitkamp R, Yesupriya S, Clay B, Crane NJ. Accurate and rapid differentiation of acinetobacter baumannii strains by raman spectroscopy: A comparative study. J Clin Microbiol. (2017) 55:2480–90. doi: 10.1128/JCM.01744-16

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Stewart WF, Ricci JA, Chee E, Hahn SR, Morganstein D. Cost of lost productive work time among US workers with depression. JAMA. (2003) 289:3135–44. doi: 10.1001/jama.289.23.3135

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Nakao M, Shinozaki Y, Ahern DK, Barsky AJ. Anxiety as a predictor of improvements in somatic symptoms and health anxiety associated with cognitive-behavioral intervention in hypochondriasis. Psychother Psychosom. (2011) 80:151–8. doi: 10.1159/000320122

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Ang QQ, Wing YK, He Y, Sulaiman AH, Chiu NY, Shen YC, et al. Association between painful physical symptoms and clinical outcomes in East Asian patients with major depressive disorder: a 3-month prospective observational study. Int J Clin Pract. (2009) 63:1041–9. doi: 10.1111/j.1742-1241.2009.02107.x

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Novick D, Shi Q, Yue L, Moneta MV, Siddi S, Haro JM. Impact of pain and remission in the functioning of patients with depression in Mainland China, Taiwan, and Hong Kong. Asia Pac Psychiatry. (2018) 10:e12295. doi: 10.1111/appy.12295

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Bahk W-M, Park S, Jon D-I, Yoon B-H, Min KJ, Hong JP. Relationship between painful physical symptoms and severity of depressive symptomatology and suicidality. Psychiatry Res. (2011) 189:357–61. doi: 10.1016/j.psychres.2011.01.009

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Rapaport MH, Judd LL, Schettler PJ, Yonkers KA, Thase ME, Kupfer DJ, et al. A descriptive analysis of minor depression. Am J Psychiatry. (2002) 159:637–43. doi: 10.1176/appi.ajp.159.4.637

PubMed Abstract | CrossRef Full Text | Google Scholar

36. van Zoonen K, Buntrock C, Ebert DD, Smit F, Reynolds CF, Beekman ATF, et al. Preventing the onset of major depressive disorder: a meta-analytic review of psychological interventions. Int J Epidemiol. (2014) 43:318–29. doi: 10.1093/ije/dyt175

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Gilbody S, Lewis H, Adamson J, Atherton K, Bailey D, Birtwistle J, et al. Effect of collaborative care vs usual care on depressive symptoms in older adults with subthreshold depression: The CASPER randomized clinical trial. JAMA. (2017) 317:728–37. doi: 10.1001/jama.2017.0130

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Buntrock C, Ebert DD, Lehr D, Smit F, Riper H, Berking M, et al. Effect of a web-based guided self-help intervention for prevention of major depression in adults with subthreshold depression: A randomized clinical trial. JAMA. (2016) 315:1854–63. doi: 10.1001/jama.2016.4326

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Davidson SK, Harris MG, Dowrick CF, Wachtler CA, Pirkis J, Gunn JM. Mental health interventions and future major depression among primary care patients with subthreshold depression. J Affect Disord. (2015) 177:65–73. doi: 10.1016/j.jad.2015.02.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: subthreshold depression, major depressive disorder, somatic symptoms, primary care, screening, depression

Citation: Li X, Zhang H, Han X, Guo L, Ceban F, Liao Y, Shi J, Wang W, Liu Y, Song W, Zhu D, Wang H, Li L, Fan B, Lu C and McIntyre RS (2023) Predictive potential of somatic symptoms for the identification of subthreshold depression and major depressive disorder in primary care settings. Front. Psychiatry 14:999047. doi: 10.3389/fpsyt.2023.999047

Received: 20 July 2022; Accepted: 30 January 2023;
Published: 14 February 2023.

Edited by:

Xinyu Fang, Nanjing Brain Hospital Affiliated to Nanjing Medical University, China

Reviewed by:

Satoshi Yokoyama, Hiroshima University, Japan
Elmars Rancans, Riga Stradinš University, Latvia

Copyright © 2023 Li, Zhang, Han, Guo, Ceban, Liao, Shi, Wang, Liu, Song, Zhu, Wang, Li, Fan, Lu and McIntyre. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Beifang Fan, yes ZmFuYmYmI3gwMDA0MDtmb3htYWlsLmNvbQ==; Ciyong Lu, yes bHVjaXlvbmcmI3gwMDA0MDttYWlsLnN5c3UuZWR1LmNu

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.