Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 14 September 2022
Sec. Public Mental Health
This article is part of the Research Topic Towards the Wellbeing Economy: Economic, Social, and Environmental Impact on Mental Wellness View all 5 articles

The co-occurrence of multidimensional loneliness with depression, social anxiety and paranoia in non-clinical young adults: A latent profile analysis

  • 1Department of Psychology, The Chinese University of Hong Kong, Hong Kong, Hong Kong SAR, China
  • 2Department of Psychology, School of Educational Sciences, Hunan Normal University, Changsha, China
  • 3Cognition and Human Behavior Key Laboratory of Hunan Province, Hunan Normal University, Changsha, China
  • 4Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
  • 5Department of Psychology, The University of Chinese Academy of Sciences, Beijing, China

Introduction: Loneliness is a negative experience arising from a mismatch between perceived and actual social relationships. Several dimensions of loneliness have been suggested, namely intimate, relational and collective loneliness. Loneliness has been linked to poorer mental health, with its co-occurrence with depression, social anxiety, and paranoia most widely reported. While expressions of these symptoms are heterogeneous across individuals in the non-clinical population, it remains unclear how these symptoms co-occur with one another and with various dimensions of loneliness. It is also of interest how trait factors such as core schemas about self/others may moderate these relationships between loneliness and co-occurring symptoms.

Methods: A demographically diverse sample of young adults was recruited from multiple sources. The validated sample consisted of 2,089 participants (68.4% female), who completed an online survey consisting of questionnaires assessing levels of multidimensional loneliness, depression, social anxiety, paranoia, core schemas, and demographic characteristics. Latent profile analysis (LPA) was used to identify distinct profiles of loneliness and the three symptoms. Positive and negative core schemas about self and others were modeled as predictors of these profiles.

Results: Five distinct profiles were identified. Profile 1 had low levels across all symptoms and dimensions of loneliness (n = 1,273, 60.9%). Profiles 2–5 were elevated on dimensions of loneliness, and were heightened in depression (n = 189, 9.0%), social anxiety (n = 206, 9.9%), paranoia (n = 198, 9.5%), and all symptoms (n = 223, 10.7%), respectively. Relative to Profile 1, the other four profiles scored higher on negative-self (adjusted ORs = 1.36–1.49, ps < 0.001) and negative-other schemas (adjusted ORs = 1.24–1.44, ps < 0.001), and lower on positive-self (adjusted ORs = 0.82–0.85, ps < 0.001) and positive-other schemas (adjusted ORs = 0.81–0.90, ps < 0.001).

Conclusion: More marked intimate, relational and collective loneliness were evident across profiles that had heightened depression, social anxiety and/or paranoia, suggesting that loneliness may serve as a general risk factor for these psychopathologies. Our findings shed light on the heterogeneity of the co-occurrence of loneliness and various mental health difficulties in non-clinical young adults. Core schemas are suggested to be putative psychological mechanisms underlying their co-occurrence and even development.

Introduction

Loneliness is a negative experience arising from the mismatch between perceived and actual social relationships (1). As a subjective experience, loneliness is conceptually distinct from objective social isolation, with its indicators such as the size of social network and frequency of social contact only weakly or moderately correlated with loneliness [e.g., (2)]. Loneliness is found to be correlated with various sociodemographic adversities (e.g., low socioeconomic status), as well as poor physical and mental health [e.g., (3, 4)]. Emerging evidence has suggested loneliness as a multidimensional phenomenon, with intimate, relational and collective dimensions consistently identified in samples of various age periods and cultures (5) and across measures of loneliness (6). Intimate (or emotional) loneliness indicates a feeling of aloneness and an absence of emotional support from close and significant others (6, 7). Relational (or social) loneliness refers to the lack of perceived closeness with and support from friends and relatives; whereas collective loneliness concerns identification and cohesion with social groups and society (e.g., civic groups and neighborhood organizations) (6, 7). These three dimensions are differentially associated with aspects of social relationships and indicators of wellbeing [e.g., (5, 8, 9)], supporting the utility and validity of multi-dimensionality of loneliness.

Loneliness is experienced as mild and transient for most people. However, for some individuals, loneliness could prolong and lead to negative physical and mental health consequences (7, 10, 11). Compared to the general population, more marked loneliness was reported by individuals with mental disorders, in particular major depressive disorder and social anxiety disorder (12). Loneliness in psychotic disorders has recently been examined. There is increasing evidence supporting a robust association with paranoia (1315), one of the cardinal psychotic symptoms characterized by fears that others are targeting one for harm (16). Symptoms of major depressive disorder, social anxiety disorder, and psychotic disorders can be expressed below their clinical threshold in the non-clinical population and predispose the transition into a full-blown disorder (1618).

Previous studies have reported that loneliness co-occurs with symptoms of depression, social anxiety and paranoia in non-clinical or general population samples [e.g., (14, 19, 20)]. Longitudinal studies also found that loneliness predicts an increase in the severity of these symptoms over time [e.g., (14, 21, 22)], suggesting the role of loneliness in their development and maintenance. However, this line of research has encountered two theoretical and methodological challenges. Firstly, most of these studies considered loneliness as a unidimensional construct. A few exceptions examined the relationships of depression and social anxiety with only emotional and social loneliness [e.g., (2326)], lending preliminary support for a stronger association with emotional loneliness. So far, it is uncertain how the three dimensions of loneliness are distinctly related to these three symptoms. This line of research would benefit from examining intimate, relational and collective loneliness together in a single study.

Secondly, even among non-patients, it is common for symptoms of depression, social anxiety, and paranoia to be present together [e.g., (14, 27, 28)]. Various patterns of co-occurrence of these psychopathologies could exist, which are yet to be examined. In view of the potentially heterogeneous expressions of both loneliness dimensions and these symptoms in non-clinical individuals, a more comprehensive investigation of the relationship between loneliness and psychopathologies can be performed by using latent profile analysis (LPA), a person-centered statistical modeling approach that reveals distinct profiles of individuals based on pre-defined variables (29). By revealing profiles characterized by varying levels of multidimensional loneliness and psychopathologies, LPA helps to address the following question: whether loneliness dimensions are exacerbated in individuals with elevated symptom(s) exclusively, or is loneliness reported by individuals regardless of their levels of these symptoms. Addressing this research question is crucial to the understanding of distinctive patterns of co-occurrence and even development of loneliness and these symptoms in non-clinical populations, which has not been considered in the literature.

An LPA that takes into account the co-occurrence of loneliness and non-clinical symptoms will pave the way for addressing putative psychological mechanisms that may contribute to these phenomena. Core schemas are global and stable beliefs about the self and others (30, 31). Negative-self schemas (e.g., “I am bad and inferior”) are suggested to drive and maintain depression (32) and social anxiety (33). Negative-self (e.g., “I am vulnerable and weak”) and – other (e.g., “Others are hostile and untrustworthy”) schemas are proposed to predispose paranoid thinking (34, 35). Moreover, negative views about self and others are also proposed to maintain loneliness over time (1). On the contrary, the role of positive schemas is less understood. Freeman et al. (36) found that positive-self schemas were more strongly associated with social anxiety than paranoia.

The aim of the present study was twofold: (1) to identify profiles of co-occurrence of loneliness dimensions with depression, social anxiety, and paranoia; and (2) to examine the contribution of positive and negative core schemas of self and others in predicting these profiles. For (1), we sought to identify profiles of individuals based on validated measures of multidimensional loneliness, depression, social anxiety and paranoia. For (2), we would expect negative-self schemas to be more marked in profile(s) with elevated loneliness, depression, and/or social anxiety, whereas both negative-self and negative-other schemas would be more marked in profile(s) with elevated paranoia. Levels of positive-self and positive-other schemas were also compared across profiles. The current study focused on early adulthood, as previous studies have suggested that this life stage is among the most vulnerable to the emergence of loneliness (3741) as well as the symptoms of interest (e.g., (4244)).

Materials and methods

Ethics approval for this study was granted by the Survey and Behavioral Research Ethics Committee of The Chinese University of Hong Kong. Written consent was obtained from all participants.

Participants

Participants were Hong Kong residents aged 18–30. As this study focused on loneliness among non-patients, participants who reported a current or previous psychiatric diagnosis and those who were on psychiatric medication were excluded. Participants who reported any of the following neurological conditions, such as epilepsy and Tourette disorder etc., were also excluded. To reach participants with diverse socioeconomic backgrounds, recruitment was carried out through various means, including invitation through a marketing company, university mass mailing, distribution of leaflets at multiple locations around Hong Kong (e.g., public transport), promotion on social media platforms (i.e., Facebook and Instagram), and snowball sampling. The sampling procedure was detailed in Chau et al. (45).

Measures

Indicator variables for latent profile analysis

Multidimensional loneliness was measured by the University of California, Los Angeles, Loneliness Scale (version 3) [UCLA-LS-v3, (46)]. It consists of 20 items assessing the frequency of experience of loneliness. Each item is rated on a 4-point scale ranging from 1 (“Never”) to 4 (“Often”). Dimension scores of intimate, relational and collective loneliness were computed according to (6), which have been validated in a Chinese sample of young adults (5). In the current sample, the internal consistencies of the loneliness dimension scores were 0.72, 0.83, and 0.75 respectively.

Depression was measured by the Patient Health Questionnaire-9 [PHQ-9, (47)]. The PHQ-9 consists of nine items based on the DSM-IV diagnostic criteria for depressive disorders. Each item is rated on a 4-point scale, ranging from 0 (“not at all”) to 3 (“nearly everyday”). The Chinese version of the PHQ-9 yielded satisfactory internal reliability (α = 0.82) and good construct validity (48). The internal consistency of the PHQ-9 total score in the current sample was 0.87.

Social anxiety was measured by the Social Interaction Anxiety Scale and Social Phobia Scale—Short Form [SIAS-6/SPS-6, (49)]. The SIAS-6/SPS-6 is a 12-item 5-point (0–4) rating scale assessing anxiety arising from social interactions and scrutiny by others. The Chinese version was translated for this study (unpublished). The SIAS-6/SPS-6 had excellent internal consistency in the current sample (Cronbach’s alpha = 0.92).

The Revised Green Paranoid Thoughts Scale [R-GPTS; (50)] is an 18-item 5-point (0–4) rating scale assessing ideas of reference (eight items) and ideas of persecution (10 items) in the general population. The Chinese version of the R-GPTS has been validated (51, 52). The R-GPTS had excellent internal consistency in the current sample (Cronbach’s alpha = 0.95).

Predictors of estimated profiles

The Brief Core Schema Scales [BCSS, (53)] is a 24-item 5-point (0–4) scale that assesses evaluative beliefs about the self and others. The BCSS yields four subscores (six items each): negative-self, positive-self, negative-other, and positive-other schemas. The Chinese version of the BCSS has been used in So et al. (51). The BCSS had good internal consistency in the current sample (Cronbach’s alphas of subscores > 0.79).

Participants also provided the following demographic information: age, gender, educational attainment, employment status, and monthly household income.

Procedure

Consented participants completed an online survey individually, which consisted of the above self-report measures. Participants received a remuneration of HK$50 (US$6.41) upon completion of the online survey. Data collection was conducted from June to July 2018. Data validity was thoroughly checked according to recommendations in Curran (54). Specifically, response validity was evaluated with the attention check items (passing more than half of the attention check items) and long-string responses based on the UCLA-LS-v3. The procedure of data collection and data validity check was reported in Chau et al. (45).

Data analysis

Descriptive statistics and correlations of multidimensional loneliness, depression, social anxiety, and paranoia were calculated in SPSS (55), whereas the LPA was performed on Mplus (56). The dimension scores of the UCLA-LS-v3 and total scores of the PHQ-9, SIAS-6/SPS-6, and R-GPTS were transformed into z-scores before being analyzed with the LPA. Latent profile models were estimated with robust maximum likelihood estimation with 500 initial stage random starts and 20 final stage optimizations, respectively. The LPA by default assumes that indicator variables are normally distributed and uncorrelated after conditioning on the latent profile membership (i.e., conditional independence), as well as homogeneity of variances across latent profiles (57). Given the robust associations between loneliness and these symptoms [e.g., (14, 15, 20)], we relaxed the assumption of conditional independence and allowed the indicator variables to be correlated. Given that our indicator variables are non-normal, we estimated the latent profile model using the t-distribution (58).

Models of two to eight profiles were estimated and compared on multiple criteria to determine the optimal number of profiles. These criteria included Akaike information criteria (AIC), Bayesian information criteria (BIC), Bozdogan’s consistent AIC (CAIC), sample size adjusted BIC (ssBIC), classification likelihood information criterion (CLC), normalized entropy criterion (NEC), entropy, and integrated complete likelihood BIC (ICL-BIC). A better-fitted model is indicated by a smaller value on all these criteria except for entropy, where a greater value would suggest a clear profile separation (59). The Lo-Mendell-Rubin likelihood ratio test was also performed to evaluate the relative model fit between K-profile and K-1 profile models. After identification of the optimal number of profiles, individuals were classified into the most likely profiles according to their posterior probabilities. To examine the differences in demographic characteristics and levels of indicator variables between profiles, chi-square tests and Kruskal-Wallis ANOVAs were used for categorical and continuous variables, respectively.

To examine research question 2, core schemas and demographic characteristics were compared across profiles using Vermunt’s (60) three-step approach. This approach fully accounts for any classification error and can simultaneously estimate the LPA and the effects of hypothesized predictors on profiles using a multinomial logistic regression approach. Self and other schemas (i.e., negative-self, positive-self, negative-other, positive-other) were treated as predictors of profiles, first without and then with demographic characteristics as covariates.

Results

Sample characteristics

A total of 2,595 participants responded to the survey, among whom 316 did not meet the recruitment criteria and were excluded (lack of contact: n = 134, repeated responses: n = 25, self-reported psychiatric or neurological conditions/use of psychiatric medication: n = 157). Another 190 participants were excluded for failing to meet the validity criteria (attention check items: n = 79; long-string responses: n = 111). The final sample consisted of 2,089 participants, among whom 527 (25.2%) were recruited through a marketing company. The mean age of the current sample was 23.63 years (SD = 3.67), with the majority being female (n = 1,429, 68.4%). Demographic characteristics of the sample were reported in full in Chau et al. (45). Means and correlations of key variables are reported in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Descriptive statistics of and correlations between indicator variables.

Latent profile analysis

For models with two to five profiles, the model optimization was satisfactory, and their best likelihood ratios were replicated. However, the best likelihood ratios for models with six to eight profiles were not replicated, so their parameters may not be reliably estimated.

As shown in Table 2, the six-profile model was indicated by BIC and CAIC, whereas the two-profile model was indicated by CLC, NEC, entropy, and ICL-BIC. The seven- and eight-profile model was indicated by ssBIC and AIC, respectively. The Lo-Mendell-Rubin likelihood ratio test suggested an optimal fit for models with five profiles or fewer. Examination of model parameters in the eight-, seven-, and six-profile models revealed that some parameters were not reliably estimated for interpretation. Upon consideration of model fit indexes, model parsimony, and proportion of individuals per profile (>5%) (61), a five-profile model was selected as the optimal solution.

TABLE 2
www.frontiersin.org

Table 2. Model fit indexes for latent profile models.

The resultant five profiles consisted of 1,273 (60.9%), 189 (9.0%), 206 (9.9%), 198 (9.5%), and 223 (10.7%) participants, respectively. Demographic characteristics across profiles are reported in Table 3. There were significant differences in age, gender, educational attainment, employment status, and monthly household income across profiles (ps < 0.01). In particular, Profile 3 was younger and less likely to be full-time employed than Profile 1. Profile 5 was more male-dominant, followed by Profile 4 and then Profile 3, with Profiles 2 and 1 not differing from each other. As opposed to Profile 1, Profile 5 was less likely to receive a bachelor’s degree and earned the lowest monthly household income.

TABLE 3
www.frontiersin.org

Table 3. Descriptive statistics of demographic characteristics, symptoms, and loneliness dimensions within identified profiles.

Means and SDs of the indicator variables of the five profiles are shown in Table 3 and Figure 1. Kruskal-Wallis ANOVAs revealed significant differences in the levels of all indicator variables (ps < 0.001, ε2 = 0.47–0.55) and dimensions of loneliness (ps < 0.001, ε2 = 0.13–0.20) across profiles. Profile 1 scored the lowest on depression, social anxiety, paranoia and the three dimensions of loneliness; hence, it was labeled as “low loneliness/low overall symptoms.” Profiles 2–5 reported higher levels of dimensions of loneliness than Profile 1. In particular, levels of intimate loneliness were comparable between Profiles 3–5, which were higher than Profile 2. The level of relational loneliness was the highest in Profile 3, which was comparable to Profiles 4 and 5 but higher than Profile 2. The level of collective loneliness was the highest in Profiles 5 and 3, which were higher than Profile 2. In addition, while Profile 5 was elevated on all symptoms, Profiles 2–4 were characterized by elevated levels of depression, social anxiety, or paranoia, respectively. Therefore, Profiles 2–4 were labeled as “moderate loneliness/high depression,” “high loneliness/high social anxiety,” and “high loneliness/high paranoia,” respectively, and Profile 5 was labeled as “high loneliness/high overall symptoms.”

FIGURE 1
www.frontiersin.org

Figure 1. Z-score profiles and 95% confidence interval of psychopathologies and loneliness dimensions across five profiles. DEP, depression; SA, social anxiety; PAR, paranoia; INT-LONE, intimate loneliness; RC-LONE, relational loneliness; CC-LONE, collective loneliness.

Prediction of profiles with core schemas as predictors

Results of multinomial logistic regression of latent profiles on all BCSS scores are shown in Table 4. Figure 2 displays the results of the regression models with adjustment for demographic characteristics. A higher BCSS negative-self schema score increased the likelihood of being classified in Profiles 2–5 as opposed to Profile 1 (ORs: 1.34–1.47, ps < 0.001), even after adjusting for demographic characteristics (adjusted ORs: 1.36–1.49, ps < 0.001). The odds ratios for Profile 5 as opposed to other profiles were significant (adjusted ORs: 1.07–1.49, ps < 0.010). Similarly, a higher BCSS negative-other schema score increased the likelihood of being classified in Profiles 2–5 as opposed to Profile 1 (ORs: 1.23–1.42, ps < 0.001; adjusted ORs: 1.24–1.44, ps < 0.001). The odds ratios for Profiles 4 and 5 as opposed to other profiles were significant (adjusted ORs: 1.05–1.44, ps < 0.050).

TABLE 4
www.frontiersin.org

Table 4. Multinomial logistic regression of latent profiles using Vermunt’s 3-step approach.

FIGURE 2
www.frontiersin.org

Figure 2. Adjusted odds ratios and the 95% confidence intervals of the prediction of profiles by core schemas after adjusting for demographic characteristics.

Higher BCSS positive-self and positive-other scores decreased the likelihood of being classified in Profiles 2–5 as opposed to Profile 1 (positive-self: ORs: 0.81–0.86, ps < 0.001; positive-other: ORs: 0.82–0.90, ps < 0.001). These effects remained robust after adjustment for demographic characteristics (positive-self: adjusted ORs: 0.82–0.85, ps < 0.001; positive-other: adjusted ORs: 0.81–0.90, ps < 0.001). Also, the effects of positive-other schemas for Profile 4 were significant as opposed to Profiles 2 (adjusted OR: 0.92, p = 0.030) and 3 (adjusted OR: 0.90, p = 0.006), but not to Profile 5 (adjusted OR: 0.96, p = 0.364).

Discussion

The current study examined the distinct patterns of co-occurrence of loneliness, depression, social anxiety, and paranoia in a non-clinical sample of young adults. This study built on and extended the current evidence of positive correlations between loneliness, depression, social anxiety, and paranoia (e.g., 14, 15, 20), and focused on young adulthood when these experiences are likely to have emerged in vulnerable individuals. Considering loneliness as a multidimensional phenomenon, this study identified distinct profiles of co-occurrence of loneliness and the three symptoms using LPA and compared these profiles on core schemas about self and others.

Our LPA revealed five profiles of individuals. The majority of the individuals (60.9%) were classified as Profile 1, scoring low on dimensions of loneliness and all symptoms. The remaining four profiles had moderate to high levels of loneliness and were elevated in at least one symptom. Although the current sample did not have a psychiatric diagnosis, a substantial proportion of them had elevated symptoms and loneliness. Profile 5, which reported high levels of loneliness and multiple symptoms, is likely to bring the most distress and functioning impairment among profiles (62). This finding speaks for the importance of early identification and intervention for distressing symptoms among non-patients [e.g., (63, 64)].

The LPA revealed two interesting patterns of the co-occurrence between loneliness and psychiatric symptoms. First, when loneliness is reported to be at least a moderate level (Profiles 2–5), it is always accompanied by elevated depression, social anxiety, paranoia, or their combination. There did not exist a profile that had elevated loneliness but low symptoms. Together with evidence that loneliness is associated with emotional instability and hypervigilance to social threats, which predispose the development of affective and psychotic disorders [e.g., (8, 21, 65)], and that there are polygenetic overlaps between loneliness with these disorders (66, 67), the current findings lend support to the idea that loneliness may be a general risk factor that pertains to various psychopathologies (68, 69).

Second, the results revealed fine distinctions in the levels of dimensions of loneliness across profiles, confirming the need to consider loneliness as a multidimensional construct. In particular, Profiles 3, 4, and 5 reported the highest levels of social anxiety and/or paranoia, as well as intimate loneliness, supporting their proximal relationships. This result is consistent with the recent findings that excessive worry in and a tendency to withdraw from intimate relationships (i.e., attachment insecurity 70) are characteristic of social anxiety (71), paranoia (72, 73), and intimate loneliness (74, 75). For relational and collective loneliness, their differences across profiles were more subtle, rendering interpretations more ubiquitous. Nevertheless, the current findings highlight the need to consider the fine-grained dimensions of loneliness (76, 77), paving the way for future research on the dimensionality of loneliness and its implications on the expression of psychopathologies.

As hypothesized, the levels of negative-self schemas were higher in profiles with elevated symptoms and loneliness (i.e., Profiles 2–5). The levels of negative-other schemas were also higher in profiles with elevated symptoms and loneliness, among which the levels in profiles with elevated paranoia only (i.e., Profiles 4 and 5) were more prominent. As exploratory analyses, positive-self and positive – other schemas were found to have effects in the opposite direction to negative-self and negative-other schemas. These findings suggested beliefs about the self as a shared psychological mechanism across profiles with elevated symptoms and loneliness, whereas beliefs about others as a specific psychological mechanism for paranoia [e.g., (34, 35, 53)]. Overall, core schemas may contribute to the heterogeneous patterns of expression of loneliness and various symptoms, with specific schemas impacting on the development of loneliness and various mental disorders in distinct ways. Interventions targeting maladaptive schemas have shown promise in improving depressive symptoms (78) and persecutory delusions (79) in clinical populations. These interventions may also benefit the non-clinical populations with elevated levels of symptoms and/or loneliness.

This study had several limitations. The main limitation is that the screening for psychiatric history was based on participants’ self-report, which was not verified by diagnostic interviews or medical records. Since it was an online survey study, no extra steps were taken to confirm participants’ reports. Besides, all measures of psychopathologies were self-reported. Although these questionnaires have satisfactory psychometric properties, they may not correspond perfectly with findings from interviewer-rated measures. In addition, the current study only considered core schemas as predictors of profiles. There may be other etiological processes, such as biases in reasoning and social cognition [e.g., (8082)], that contribute to the classification of profiles. Lastly, the cross-sectional design of the study did not allow us to infer any directional relationships between loneliness and co-occurring symptoms, or to test the causal role of core schemas in the development of these profiles.

Against these caveats, the current study found that elevated loneliness, including the intimate, relational and collective dimensions, tends to co-occur with heightened depression, social anxiety, and/or paranoia in non-clinical young adults, suggesting loneliness as a general risk factor to these symptoms. Our results shed light on the distinct patterns of loneliness and various mental health difficulties and the contributions of positive and negative schemas underlying these patterns of co-occurrence.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by the Survey and Behavioral Research Ethics Committee (SBREC), The Chinese University of Hong Kong. The patients/participants provided their written informed consent to participate in this study.

Author contributions

AC and SH-wS designed the study, wrote the protocol, and wrote the first draft of the manuscript. AC, SH-wS, XS, and CZ managed the data collection. C-DC, RC, and PL oversaw the data collection. AC undertook the statistical analysis. All authors contributed to and have approved the final manuscript.

Funding

This work was supported by the General Research Fund, Research Grant Council, HKSAR, China (Project No. 14605717). SH-wS received support from Croucher Foundation (Grant Code: 8508666). XS was supported by Hunan Education Department Fund for Outstanding Young Scholars (20B349). The funders were not directly involved in the design and conduct of the study.

Acknowledgments

We are grateful to all participants for joining the survey.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Cacioppo JT, Hawkley LC. Perceived social isolation and cognition. Trends Cogn Sci. (2009) 13:447–54. doi: 10.1016/j.tics.2009.06.005

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Coyle CE, Dugan E. Social isolation, loneliness and health among older adults. J Aging Health. (2012) 24:1346–63. doi: 10.1177/0898264312460275

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Solmi M, Veronese N, Galvano D, Favaro A, Ostinelli EG, Noventa V, et al. Factors associated with loneliness: an umbrella review of observational studies. J Affect Disord. (2020) 271:131–8. doi: 10.1016/j.jad.2020.03.075

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Lim MH, Eres R, Vasan S. Understanding loneliness in the twenty-first century: an update on correlates, risk factors, and potential solutions. Soc Psychiatry Psychiatr Epidemiol. (2020) 55:793–810. doi: 10.1007/s00127-020-01889-7

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Hawkley LC, Gu Y, Luo Y-J, Cacioppo JT. The mental representation of social connections: generalizability extended to Beijing adults. PLoS One. (2012) 7:e44065. doi: 10.1371/journal.pone.0044065

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Hawkley LC, Browne MW, Cacioppo JT. How can i connect with thee?:Let me count the ways. Psychol Sci. (2005) 16:798–804. doi: 10.1111/j.1467-9280.2005.01617.x

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Cacioppo S, Grippo AJ, London S, Goossens L, Cacioppo JT. Loneliness:clinical import and interventions. Perspect Psychol Sci. (2015) 10:238–49. doi: 10.1177/1745691615570616

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Badcock JC, Barkus E, Cohen AS, Bucks R, Badcock DR. Loneliness and schizotypy are distinct constructs, separate from general psychopathology. Front Psychol. (2016) 7:1018. doi: 10.3389/fpsyg.2016.01018

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Shevlin M, Murphy S, Murphy J. The latent structure of loneliness:testing competing factor models of the ucla loneliness scale in a large adolescent sample. Assessment. (2015) 22:208–15. doi: 10.1177/1073191114542596

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Cacioppo JT, Cacioppo S. Chapter Three – Loneliness in the modern age: an evolutionary theory of loneliness. In: Olson JM editor. Advances in Experimental Social Psychology. (Vol. 58), Cambridge, MA: Academic Press (2018). p. 127–97.

Google Scholar

11. Holt-Lunstad J. Social connection as a public health issue: the evidence and a systemic framework for prioritizing the “social” in social determinants of health. Ann Rev Public Health. (2022) 43:193–213. doi: 10.1146/annurev-publhealth-052020-110732

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Meltzer H, Bebbington P, Dennis MS, Jenkins R, McManus S, Brugha TS. Feelings of loneliness among adults with mental disorder. Soc Psychiatry Psychiatr Epidemiol. (2013) 48:5–13. doi: 10.1007/s00127-012-0515-8

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Jaya ES, Hillmann TE, Reininger KM, Gollwitzer A, Lincoln TM. Loneliness and psychotic symptoms: the mediating role of depression. Cogn Therapy Res. (2017) 41:106–16. doi: 10.1007/s10608-016-9799-4

CrossRef Full Text | Google Scholar

14. Lim MH, Rodebaugh TL, Zyphur MJ, Gleeson JFM. Loneliness over time: the crucial role of social anxiety. J Abnorm Psychol. (2016) 125:620–30. doi: 10.1037/abn0000162

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Chau AKC, Zhu C, So SH-W. Loneliness and the psychosis continuum: a meta-analysis on positive psychotic experiences and a meta-analysis on negative psychotic experiences. Int Rev Psychiatry. (2019) 31:471–90. doi: 10.1080/09540261.2019.1636005

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Freeman D, Garety PA, Bebbington PE, Smith B, Rollinson R, Fowler D, et al. Psychological investigation of the structure of paranoia in a non-clinical population. Br J Psychiatry. (2005) 186:427–35. doi: 10.1192/bjp.186.5.427

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Hankin BL, Fraley RC, Lahey BB, Waldman ID. Is depression best viewed as a continuum or discrete category? A taxometric analysis of childhood and adolescent depression in a population-based sample. J Abnorm Psychol. (2005) 114:96–110. doi: 10.1037/0021-843X.114.1.96

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Knappe S, Beesdo K, Fehm L, Lieb R, Wittchen H-U. Associations of familial risk factors with social fears and social phobia: evidence for the continuum hypothesis in social anxiety disorder? J Neural Transm. (2009) 116:639–48. doi: 10.1007/s00702-008-0118-4

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Beutel ME, Klein EM, Brähler E, Reiner I, Jünger C, Michal M, et al. Loneliness in the general population: prevalence, determinants and relations to mental health. BMC Psychiatry. (2017) 17:97. doi: 10.1186/s12888-017-1262-x

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Matthews T, Danese A, Caspi A, Fisher HL, Goldman-Mellor S, Kepa A, et al. Lonely young adults in modern britain: findings from an epidemiological cohort study. Psychol Med. (2019) 49:268–77. doi: 10.1017/S0033291718000788

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Cacioppo JT, Hughes ME, Waite LJ, Hawkley LC, Thisted RA. Loneliness as a specific risk factor for depressive symptoms: cross-sectional and longitudinal analyses. Psychol Aging. (2006) 21:140–51. doi: 10.1037/0882-7974.21.1.140

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Tan M, Barkus E, Favelle S. The cross-lagged relationship between loneliness, social support, and psychotic-like experiences in young adults. Cogn Neuropsychiatry. (2021) 26:379–93. doi: 10.1080/13546805.2021.1960156

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Diehl K, Jansen C, Ishchanova K, Hilger-Kolb J. Loneliness at universities: determinants of emotional and social loneliness among students. Int J Environ Res Public Health. (2018) 15:1865.

Google Scholar

24. Acquah EO, Topalli P-Z, Wilson ML, Junttila N, Niemi PM. Adolescent loneliness and social anxiety as predictors of bullying victimisation. Int J Adolesc Youth. (2016) 21:320–31. doi: 10.1080/02673843.2015.1083449

CrossRef Full Text | Google Scholar

25. Peerenboom L, Collard RM, Naarding P, Comijs HC. The association between depression and emotional and social loneliness in older persons and the influence of social support, cognitive functioning and personality: a cross-sectional study. J Affect Disord. (2015) 182:26–31. doi: 10.1016/j.jad.2015.04.033

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Raut N, Singh S, Subramanyam A, Pinto C, Kamath R, Shanker S. Study of loneliness, depression and coping mechanisms in elderly. J Geriatr Mental Health. (2014) 1:20–7. doi: 10.4103/2348-9995.141920

CrossRef Full Text | Google Scholar

27. Combs DR, Penn DL. The role of subclinical paranoia on social perception and behavior. Schizophr Res. (2004) 69:93–104. doi: 10.1016/S0920-9964(03)00051-3

CrossRef Full Text | Google Scholar

28. Schutters SIJ, Dominguez MdG, Knappe S, Lieb R, van Os J, Schruers KRJ, et al. The association between social phobia, social anxiety cognitions and paranoid symptoms. Acta Psychiatr Scand. (2012) 125:213–27. doi: 10.1111/j.1600-0447.2011.01787.x

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Oberski D. Mixture models: latent profile and latent class analysis. In: Robertson J, Kaptein M editors. Modern Statistical Methods for HCI. Cham: Springer International Publishing (2016). p. 275–87.

Google Scholar

30. Beck AT. Depression. New York, NY: Harper and Row (1967).

Google Scholar

31. Beck AT. Cognitive Therapy of Depression. New York, NY: Guilford press (1979).

Google Scholar

32. Beck AT. Cognitive models of depression. J Cogn Psychother. (1987) 1:5–37.

Google Scholar

33. Wells A, Clark DM, Salkovskis P, Ludgate J, Hackmann A, Gelder M. Social phobia: the role of in-situation safety behaviors in maintaining anxiety and negative beliefs. Behav Ther. (1995) 26:153–61. doi: 10.1016/S0005-7894(05)80088-7

CrossRef Full Text | Google Scholar

34. Freeman D, Garety PA, Kuipers E, Fowler D, Bebbington PEA. Cognitive model of persecutory delusions. Br J Clin Psychol. (2002) 41:331–47. doi: 10.1348/014466502760387461

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Humphrey C, Bucci S, Varese F, Degnan A, Berry K. Paranoia and negative schema about the self and others: a systematic review and meta-analysis. Clin Psychol Rev. (2021) 90:102081. doi: 10.1016/j.cpr.2021.102081

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Freeman D, Gittins M, Pugh K, Antley A, Slater M, Dunn G. What makes one person paranoid and another person anxious? The differential prediction of social anxiety and persecutory ideation in an experimental situation. Psychol Med. (2008) 38:1121–32. doi: 10.1017/S0033291708003589

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Buecker S, Mund M, Chwastek S, Sostmann M, Luhmann M. Is loneliness in emerging adults increasing over time? A preregistered cross-temporal meta-analysis and systematic review. Psychol Bull. (2021) 147:787–805. doi: 10.1037/bul0000332

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Demarinis S. Loneliness at epidemic levels in America. Explore. (2020) 16:278–9.

Google Scholar

39. Hawkley LC, Buecker S, Kaiser T, Luhmann M. Loneliness from young adulthood to old age: explaining age differences in loneliness. Int J Behav Dev. (2020) 46:39–49. doi: 10.1177/0165025420971048

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Luhmann M, Hawkley LC. Age differences in loneliness from late adolescence to oldest old age. Dev Psychol. (2016) 52:943–59. doi: 10.1037/dev0000117

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Yang K, Victor C. Age and loneliness in 25 European nations. Ageing Soc. (2011) 31:1368–88.

Google Scholar

42. Freeman D, McManus S, Brugha T, Meltzer H, Jenkins R, Bebbington P. Concomitants of paranoia in the general population. Psychol Med. (2011) 41:923–36.

Google Scholar

43. Jefferies P, Ungar M. Social anxiety in young people: a prevalence study in seven countries. PLoS One. (2020) 15:e0239133. doi: 10.1371/journal.pone.0239133

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Jorm AF. Does old age reduce the risk of anxiety and depression? A review of epidemiological studies across the adult life span. Psychol Med. (2000) 30:11–22. doi: 10.1017/s0033291799001452

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Chau AKC, So SH, Sun X, Zhu C, Chiu C-D, Chan RCK, et al. A network analysis on the relationship between loneliness and schizotypy. J Affect Disord. (2022) 311:148–56. doi: 10.1016/j.jad.2022.05.057

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Russell DW. UCLA loneliness scale (version 3): reliability, validity, and factor structure. J Pers Assess. (1996) 66:20–40. doi: 10.1207/s15327752jpa6601_2

CrossRef Full Text | Google Scholar

47. Kroenke K, Spitzer RL, Williams JBW. The Phq-9: validity of a brief depression severity measure. J Gen Intern Med. (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Yu X, Tam WWS, Wong PTK, Lam TH, Stewart SM. The patient health questionnaire-9 for measuring depressive symptoms among the general population in Hong Kong. Compr Psychiatry. (2012) 53:95–102. doi: 10.1016/j.comppsych.2010.11.002

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Peters L, Sunderland M, Andrews G, Rapee RM, Mattick RP. Development of a short form social interaction anxiety (Sias) and social phobia scale (Sps) using nonparametric item response theory: the Sias-6 and the Sps-6. Psychol Assess. (2012) 24:66–76. doi: 10.1037/a0024544

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Freeman D, Loe BS, Kingdon D, Startup H, Molodynski A, Rosebrock L, et al. The revised green Et Al., paranoid thoughts scale (R-Gpts): psychometric properties, severity ranges, and clinical cut-offs. Psychol Med. (2021) 51:244–53. doi: 10.1017/S0033291719003155

PubMed Abstract | CrossRef Full Text | Google Scholar

51. So SH, Zhu C, Lincoln TM, Gaudiano BA, Kingston JL, Ellett L, et al. Pandemic paranoia, general paranoia, and their relationships with worry and beliefs about self/others – a multi-site latent class analysis. Schizophr Res. (2022) 241:122–9. doi: 10.1016/j.schres.2022.01.045

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Kingston JL, Schlier B, Ellett L, So SH, Gaudiano BA, Morris EMJ, et al. The pandemic paranoia scale (Pps): factor structure and measurement invariance across languages. Psychol Med. (2021) 1–10. doi: 10.1017/S0033291721004633 [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Fowler D, Freeman D, Smith BEN, Kuipers E, Bebbington P, Bashforth H, et al. The brief core schema scales (Bcss): psychometric properties and associations with paranoia and grandiosity in non-clinical and psychosis samples. Psychol Med. (2006) 36:749–59. doi: 10.1017/S0033291706007355

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Curran PG. Methods for the detection of carelessly invalid responses in survey data. J Exp Soc Psychol. (2016) 66:4–19. doi: 10.1016/j.jesp.2015.07.006

CrossRef Full Text | Google Scholar

55. Spss I. Statistics for Windows, Version 24. Armonk, NY: IBM Corp (2016).

Google Scholar

56. Muthén LK, Muthén B. Mplus User’s Guide. Eighth ed. Los Angeles, CA: Muthén & Muthén (2017).

Google Scholar

57. Tein J-Y, Coxe S, Cham H. Statistical power to detect the correct number of classes in latent profile analysis. Struct Equa Modeling. (2013) 20:640–57. doi: 10.1080/10705511.2013.824781

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Muthén B, Asparouhov T. Growth mixture modeling with non-normal distributions. Statist Med. (2015) 34:1041–58. doi: 10.1002/sim.6388

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Celeux G, Soromenho G. An entropy criterion for assessing the number of clusters in a mixture model. J Classif. (1996) 13:195–212. doi: 10.1007/BF01246098

CrossRef Full Text | Google Scholar

60. Vermunt JK. Latent class modeling with covariates: two improved three-step approaches. Polit Anal. (2017) 18:450–69.

Google Scholar

61. Vandekerckhove J, Matzke D, Wagenmakers E-J. Model comparison and the principle of parsimony. In: Busemeyer JR, Wang Z, Townsend JT, Eidels A editors. The Oxford Handbook of Computational and Mathematical Psychology. Oxford: Oxford University Press. (2015). p. 300–19.

Google Scholar

62. Teesson M, Slade T, Mills K. Comorbidity in Australia: findings of the 2007 national survey of mental health and wellbeing. Aust N Z J Psychiatry. (2009) 43:606–14. doi: 10.1080/00048670902970908

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Hetrick SE, Parker AG, Hickie IB, Purcell R, Yung AR, McGorry PD. Early identification and intervention in depressive disorders: towards a clinical staging model. Psychother Psychosom. (2008) 77:263–70. doi: 10.1159/000140085

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Niendam TA, Jalbrzikowski M, Bearden CE. Exploring predictors of outcome in the psychosis prodrome: implications for early identification and intervention. Neuropsychol Rev. (2009) 19:280. doi: 10.1007/s11065-009-9108-z

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Käll A, Shafran R, Lindegaard T, Bennett S, Cooper Z, Coughtrey A, et al. A common elements approach to the development of a modular cognitive behavioral theory for chronic loneliness. J Consult Clin Psychol. (2020) 88:269–82. doi: 10.1037/ccp0000454

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Andreu-Bernabeu Á, Díaz-Caneja CM, Costas J, De Hoyos L, Stella C, Gurriarán X, et al. Polygenic contribution to the relationship of loneliness and social isolation with schizophrenia. Nat Commun. (2022) 13:51. doi: 10.1038/s41467-021-27598-6

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Rødevand L, Bahrami S, Frei O, Lin A, Gani O, Shadrin A, et al. Polygenic overlap and shared genetic loci between loneliness, severe mental disorders, and cardiovascular disease risk factors suggest shared molecular mechanisms. Transl Psychiatry. (2021) 11:3. doi: 10.1038/s41398-020-01142-4

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Caspi A, Houts RM, Belsky DW, Goldman-Mellor SJ, Harrington H, Israel S, et al. The P Factor:one general psychopathology factor in the structure of psychiatric disorders? Clin Psychol Sci. (2014) 2:119–37. doi: 10.1177/2167702613497473

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Heinrich LM, Gullone E. The clinical significance of loneliness: a literature review. Clin Psychol Rev. (2006) 26:695–718. doi: 10.1016/j.cpr.2006.04.002

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Mikulincer M, Shaver PR. An attachment perspective on psychopathology. World Psychiatry. (2012) 11:11–5. doi: 10.1016/j.wpsyc.2012.01.003

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Manning RPC, Dickson JM, Palmier-Claus J, Cunliffe A, Taylor PJA. Systematic review of adult attachment and social anxiety. J Affect Disord. (2017) 211:44–59. doi: 10.1016/j.jad.2016.12.020

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Lavin R, Bucci S, Varese F, Berry K. The relationship between insecure attachment and paranoia in psychosis: a systematic literature review. Br J Clin Psychol. (2020) 59:39–65. doi: 10.1111/bjc.12231

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Murphy R, Goodall K, Woodrow A. The relationship between attachment insecurity and experiences on the paranoia continuum: a meta-analysis. Br J Clin Psychol. (2020) 59:290–318. doi: 10.1111/bjc.12247

PubMed Abstract | CrossRef Full Text | Google Scholar

74. DiTommaso E, Brannen-McNulty C, Ross L, Burgess M. Attachment styles, social skills and loneliness in young adults. Pers Individ Differ. (2003) 35:303–12. doi: 10.1016/S0191-8869(02)00190-3

CrossRef Full Text | Google Scholar

75. Bogaerts S, Vanheule S, Desmet M. Feelings of subjective emotional loneliness: an exploration of attachment. Soc Behav Pers. (2006) 34:797–812.

Google Scholar

76. van Tilburg TG. Social, emotional, and existential loneliness: a test of the multidimensional concept. Gerontologist. (2020) 61:e335–44. doi: 10.1093/geront/gnaa082

PubMed Abstract | CrossRef Full Text | Google Scholar

77. van Tilburg TG. Emotional, social, and existential loneliness before and during the covid-19 pandemic: prevalence and risk factors among dutch older adults. J Gerontol B. (2021) 77:e179–84. doi: 10.1093/geronb/gbab101

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Malogiannis IA, Arntz A, Spyropoulou A, Tsartsara E, Aggeli A, Karveli S, et al. Schema therapy for patients with chronic depression: a single case series study. J Behav Ther Exp Psychiatry. (2014) 45:319–29. doi: 10.1016/j.jbtep.2014.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Freeman D, Pugh K, Dunn G, Evans N, Sheaves B, Waite F, et al. An early phase ii randomised controlled trial testing the effect on persecutory delusions of using cbt to reduce negative cognitions about the self: the potential benefits of enhancing self confidence. Schizophr Res. (2014) 160:186–92. doi: 10.1016/j.schres.2014.10.038

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Zhu C, Kwok NT, Chan TC, Chan GH, So SH. Inflexibility in reasoning: comparisons of cognitive flexibility, explanatory flexibility, and belief flexibility between schizophrenia and major depressive disorder. Front Psychiatry. (2021) 11:609569. doi: 10.3389/fpsyt.2020.609569

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Freeman D, Pugh K, Garety P. Jumping to conclusions and paranoid ideation in the general population. Schizophr Res. (2008) 102:254–60. doi: 10.1016/j.schres.2008.03.020

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Martin JA, Penn DL. Social cognition and subclinical paranoid ideation. Br J Clin Psychol. (2001) 40:261–5. doi: 10.1348/014466501163670

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: perceived social isolation, loneliness, depression, social anxiety, paranoia, core schemas

Citation: Chau AKC, So SH-w, Sun X, Zhu C, Chiu C-D, Chan RCK and Leung PWL (2022) The co-occurrence of multidimensional loneliness with depression, social anxiety and paranoia in non-clinical young adults: A latent profile analysis. Front. Psychiatry 13:931558. doi: 10.3389/fpsyt.2022.931558

Received: 29 April 2022; Accepted: 24 August 2022;
Published: 14 September 2022.

Edited by:

Yi Sun, Hong Kong Polytechnic University, Hong Kong SAR, China

Reviewed by:

Srinivas Dannaram, Banner – University Medical Center Phoenix, United States
Shengming Yin, Dalian Medical University, China

Copyright © 2022 Chau, So, Sun, Zhu, Chiu, Chan and Leung. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Suzanne Ho-wai So, shwso@psy.cuhk.edu.hk

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.