David Matthew Doyle1*
Lisa Molix2- 1Washington Singer Laboratories, Department of Psychology, University of Exeter, Exeter, United Kingdom
- 2Department of Psychology, Tulane University, New Orleans, LA, United States
Introduction
Cao et al. (2017) conducted a meta-analysis of the association between sexual minority stress and relationship well-being. Having published a similar meta-analysis (Doyle and Molix, 2015b), we were struck by a number of important similarities as well as critical differences in these two reviews, as other authors working on minority stress and sexual minority romantic relationship functioning have also been recently (e.g., Ballester et al., 2021; Vale and Bisconti, 2021). Here we aim to reconcile discrepant findings with regard to conceptual and methodological differences between the two reviews. Additionally, we aim to contribute to a broader discussion of understanding overlapping meta-analytic reviews (Siontis et al., 2013; Helfer et al., 2015).
In order to integrate findings from these two reviews, for illustrative purposes we began by conducting a second-order meta-analysis using the psychmeta package in R (Dahlke and Wiernik, 2018). For reasons discussed in detail later, we conducted a “bare bones” second-order meta-analysis using uncorrected first-order meta-analysis estimates weighted by the number of primary studies included (Schmidt and Oh, 2013), shown in Table 1. Overall, the combined estimate of the effect of minority stress on sexual minority relationship functioning across these two meta-analyses was small but statistically significant, r = −0.144, 95% CI (−0.157, −0.132), echoing the importance of understanding minority stress processes for research on sexual minority romantic relationships. We continue to refer to the results of our “bare bones” second-order meta-analysis as we discuss similarities and differences in the two reports.
Table 1. Results of “bare bones” second-order meta-analysis of associations between minority stress and relationship functioning.
Conceptual Differences
Inclusion of Visibility Management
In framing the research, both meta-analyses drew upon Meyer (2003) influential minority stress theory to conceptualize various stressors for sexual minorities. In addition to internalized stigma and perceived stigma, included in both reports, Cao et al. included visibility management as a third form of minority stress, a decision marking an important distinction between these two reviews. Past research on the implications of sexual orientation concealment (and identity management more broadly) for romantic relationships has revealed mixed results (Lavner, 2017; Vale and Bisconti, 2021). This is potentially because concealment is not just a stressor, but also a coping strategy by which sexual minorities can manage the stigma to which they are exposed (Talley and Bettencourt, 2011; Doyle and Molix, 2016b; Pachankis and Bränström, 2018). Therefore, we agree that it is sensible to examine the influence of visibility management on sexual minorities' romantic relationships, however these effects should not be collapsed into a broader umbrella of minority stress alongside internalized and perceived stigma.
In line with this reasoning, the estimate of the effect of visibility management presented by Cao et al. was not statistically significant and was almost equal to zero, r = 0.008, 95% CI (−0.043, 0.059). By including this variable as a form of minority stress alongside internalized stigma and perceived stigma, the overall estimate of the effect of minority stress on same-sex relationships becomes muddled and, in this case, attenuated. Thus, while we reported an overall association of small to moderate magnitude, r = −0.17, 95% CI (−0.20, −0.14), Cao et al. reported an overall association of substantially smaller magnitude, r = −0.090, 95% CI (−0.140, −0.040), with neither estimate contained in the other's confidence interval. While this difference may appear relatively trivial, it can lead to problematic characterizations regarding the average effect of minority stress (e.g., Cao et al. refer to this association as “quite small” on p. 1269). A combined estimate excluding visibility management from our second-order meta-analysis, r = −0.152, 95% CI (−0.161, −0.143), provides support for a relatively larger magnitude effect size, closer to that reported in our original meta-analysis. We do concur with Cao et al. in that visibility management is an important facet of sexual minority experience that may influence romantic relationships, but we recommend exploring its effects in a conceptually distinct way that acknowledges the agency of sexual minority individuals to negotiate their identities in confrontation with social stigma (Doyle and Molix, 2016b).
Role of Perceived Stigma
Further drawing upon Meyer's minority stress model, both of these analyses used the proximal-distal distinction to hypothesize which forms of minority stress would be most damaging for same-sex relationships. Consistently, in both introductions, internalized stigma (also recently referred to as “internalized negativity” to reflect the process of coming to associate negative attitudes with one's own identity; Dyar et al., 2018) was highlighted as being particularly pernicious and problematic for relationship functioning. Confirming this hypothesis, both meta-analyses found evidence for moderation of effect sizes by minority stress type, and in both cases, estimates for effect sizes involving internalized stigma were larger than for effect sizes involving perceived stigma. Therefore, both reviews correctly emphasized the importance of understanding how internalized stigma contaminates romantic relationships for sexual minorities. However, a critical difference emerged in the point estimates for perceived stigma.
In our analysis, the effect of perceived stigma on relationship functioning was found to be statistically significant, r = −0.12, 95% CI (−0.16, −0.08), while in Cao et al.'s analysis it was not, r = −0.053, 95% CI (−0.108, 0.002). A combined estimate from our second-order meta-analysis, r = −0.102, 95% CI (−0.120, −0.085), confirms a small but deleterious association between perceived stigma and relationship functioning. A growing body of work (e.g., Doyle and Molix, 2014, 2016a) has been documenting the ways in which prejudice and discrimination negatively affect social relationships, including romantic relationships, for sexual minorities. While internalized stigma is undoubtedly important to social relationships, so too is perceived stigma, which damages relationships through pathways such as decreasing self-esteem (Doyle and Molix, 2014) and increasing negative affect (Vale and Bisconti, 2021). Moreover, internalized negativity is produced over time through exposure to prejudicial and discriminatory social systems and environments (Meyer, 1995; Williamson, 2000; Szymanski et al., 2008), which can sometimes even lead to a normalization of hegemonic stigmatizing attitudes regarding gender and sexual orientation (i.e., sexism, homonegativity) among sexual minorities themselves (López-Sáez et al., 2020). Although statistical significance of a point estimate should not determine whether an association is considered meaningful or not, we are concerned that portraying the association between perceived stigma and relationship functioning as smaller and therefore potentially less important than it truly is may impede work to change social structures and policies protecting sexual minorities from discrimination.
Methodological Differences
Number of Studies/Effect Sizes Included
Turning to methodological differences, as is common with overlapping meta-analyses on similar topics (Siontis et al., 2013), there were differences in the number of studies, and consequently effect sizes, included in these reports. With a notable difference in independent variables (excluding visibility management in ours), we identified 35 studies reporting 130 effect sizes; Cao et al. identified 32 studies reporting 179 effect sizes. Based on materials presented in Cao et al.'s supplemental tables, we were able to examine potential differences in study identification. Our review did not include 6 studies identified by Cao et al. that were published after our search had concluded as well as 6 studies that focused exclusively on visibility management. We were able to ascertain that 10 of the studies not identified by Cao et al. were unpublished dissertations and 1 was a book chapter (both considered “gray literature”), with only 5 published journal articles missing, potentially because they did not meet inclusion criteria. Although Cao et al. report in their methods that gray literature was included in their search strategy, exclusion or under-identification of gray literature in meta-analyses can bias effect size estimates (Conn et al., 2003). Moreover, because Cao et al. did not include a study inclusion flowchart (Moher et al., 2009) or a table of extracted effect sizes, we are unable to fully discuss and contrast methodological differences related to study/effect size inclusion decisions. Therefore, comparisons between the specific effect sizes included in the two reports are not possible, nor is a pooled omnibus meta-analysis (Schmidt and Oh, 2013).
Inclusion of Regression Coefficients
Another critical methodological difference between these two meta-analyses involves the inclusion of effect size estimates from slopes in multiple regression analyses (i.e., from standardized regression coefficients, or betas). The inclusion of betas in meta-analysis, while sometimes done in practice, has recently been heavily criticized (e.g., Aloe, 2015). The key issue here is that these coefficients are adjusted for other relevant independent variables but there may or may not be consistency in what specific independent variables (or covariates) are included across studies. So, for example, one study might control for depressive symptomatology which is a correlate (and potentially product) of minority stress. Including depressive symptomatology in a multiple regression analysis might attenuate direct associations between minority stress and relationship functioning, thus attenuating effect size estimates in the meta-analysis and introducing spurious heterogeneity across studies.
Moderation by Gender
An important similarity between these reviews is that both highlighted a lack of sample diversity (e.g., age, race) and methodological diversity (e.g., longitudinal, experimental) as major limitations of the literature. However, while Cao et al. found evidence for moderation by gender (with stronger effects for samples of sexual minority women and mixed gender samples relative to samples of sexual minority men), we did not find similar evidence. This difference may be due to the different number of studies identified by gender (we found equal numbers of studies with samples composed of sexual minority women and men while Cao et al. found more studies focusing on sexual minority women than men) or to a difference in the effect of visibility management by gender as we did not include this variable in our analyses. A weighted analysis might help to further shed light on this issue. Future research should also aim to clarify this point, as unraveling the intersection of gender identity and sexual orientation (including greater consideration of gender diversity) is vital for work in this area.
Discussion
In summary, our conceptual and methodological review and “bare bones” second-order meta-analysis indicate that the overall association between minority stress and sexual minority romantic relationship functioning is likely to be small but substantial, particularly when excluding visibility management as a form of minority stress. There is need for greater nuance in research on how visibility management affects sexual minority relationships in future work, potentially distinguishing identity management strategies motivated by internalized negativity (López-Sáez et al., 2020; Ballester et al., 2021) as opposed to efforts at coping with prejudice and discrimination (Doyle and Molix, 2016b; Pachankis and Bränström, 2018). Furthermore, the association of relationship functioning with internalized stigma is of greater magnitude than with perceived stigma, but the deleterious role of perceived stigma in sexual minority romantic relationships is still meaningful and should not be overlooked by researchers. We recommend that future work on this topic continue to investigate the effects of not only internalized and perceived stigma, but also structural stigma. Research bridging multiple levels of analysis (e.g., intrapersonal, interpersonal, systemic) will be important in revealing a nuanced picture of the ways in which discriminatory social environments affect social relationships for sexual minority people (Doyle and Molix, 2015a).
Methodologically, the exclusion of gray literature and inclusion of standardized regression coefficients in meta-analyses on this topic is likely to bias estimates of the association between minority stress and sexual minority romantic relationship functioning. Therefore, we recommend that any future reviews on this topic involve a thorough and concerted search of unpublished work (including dissertations and theses), with reviewers contacting primary authors when necessary to determine unadjusted coefficients not reported in published studies. Finally, future research should aim to situate work in this area within the intersection of gender identity and sexual orientation, examining the possibility of differences in the (potentially multiplicative) effects of social stigma on sexual minority romantic relationships involving transgender and gender diverse people.
Overall, we are encouraged by the fact that research on sexual minority stress and relationship functioning seems to be growing. While we aimed to draw attention to some concerns with specific methodological and conceptual decisions, we are heartened to see continued work in this area building upon the research covered in our review. The results of our “bare bones” second-order meta-analysis integrate findings from these two reports, continuing to indicate an important role for minority stress in shaping romantic relationship functioning among sexual minorities and pointing toward directions for future work on this topic.
Author Contributions
DD conducted the analyses and wrote the first draft of the manuscript. DD and LM contributed to manuscript revision, read, and approved the submitted version. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Aloe, A. M. (2015). Inaccuracy of regression results in replacing bivariate correlations. Res. Synth. Methods 6, 21–27. doi: 10.1002/jrsm.1126
Ballester, E., Cornish, M. A., and Hanks, M. A. (2021). Predicting relationship satisfaction in LGBQ+ people using internalized stigma, outness, and concealment. J. GLBT Fam. Stud. 15. doi: 10.1080/1550428X.2021.1923104
Cao, H., Zhou, N., Fine, M., Liang, Y., Li, J., and Mills-Koonce, W. R. (2017). Sexual minority stress and same-sex relationship well-being: a meta-analysis of research prior to the US nationwide legalization of same-sex marriage. J. Marriage Fam. 79, 1258–1277. doi: 10.1111/jomf.12415
Conn, V. S., Valentine, J. C., Cooper, H. M., and Rantz, M. J. (2003). Grey literature in meta-analyses. Nurs. Res. 52, 256–261. doi: 10.1097/00006199-200307000-00008
Dahlke, J. A., and Wiernik, B. M. (2018). Psychmeta: an R package for psychometric meta-analysis. Appl. Psychol. Measur.. 43, 415–416. doi: 10.1177/0146621618795933
Doyle, D. M., and Molix, L. (2014). How does stigma spoil relationships? Evidence that perceived discrimination harms romantic relationship quality through impaired self-image. J. Appl. Soc. Psychol. 44, 600–610. doi: 10.1111/jasp.12252
Doyle, D. M., and Molix, L. (2015a). Perceived discrimination and social relationship functioning among sexual minorities: Structural stigma as a moderating factor. Anal. Soc. Issues Public Policy 15, 357–381. doi: 10.1111/asap.12098
Doyle, D. M., and Molix, L. (2015b). Social stigma and sexual minorities' romantic relationship functioning: a meta-analytic review. Personal. Soc. Psychol. Bull. 41, 1363–1381. doi: 10.1177/0146167215594592
Doyle, D. M., and Molix, L. (2016a). Disparities in social health by sexual orientation and the etiologic role of self-reported discrimination. Arch. Sexual Behav. 45, 1317–1327. doi: 10.1007/s10508-015-0639-5
Doyle, D. M., and Molix, L. (2016b). Minority stress and inflammatory mediators: covering moderates associations between perceived discrimination and salivary interleukin-6 in gay men. J. Behav. Med. 39, 782–792. doi: 10.1007/s10865-016-9784-0
Dyar, C., Feinstein, B. A., Eaton, N. R., and London, B. (2018). The mediating roles of rejection sensitivity and proximal stress in the association between discrimination and internalizing symptoms among sexual minority women. Arch. Sexual Behav. 47, 205–218. doi: 10.1007/s10508-016-0869-1
Helfer, B., Prosser, A., Samara, M. T., Geddes, J. R., Cipriani, A., Davis, J. M., et al. (2015). Recent meta-analyses neglect previous systematic reviews and meta-analyses about the same topic: a systematic examination. BMC Med. 13:82. doi: 10.1186/s12916-015-0317-4
Lavner, J. A. (2017). Relationship satisfaction in lesbian couples: review, methodological critique, and research agenda. J. Lesbian Stud. 21, 7–29. doi: 10.1080/10894160.2016.1142348
López-Sáez, M. Á., García-Dauder, D., and Montero, I. (2020). Intersections around ambivalent sexism: internalized homonegativity, resistance to heteronormativity and other correlates. Front. Psychol. 11:608793. doi: 10.3389/fpsyg.2020.608793
Meyer, I. H. (1995). Minority stress and mental health in gay men. J. Health Soc. Behav. 36, 38–56. doi: 10.2307/2137286
Meyer, I. H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: conceptual issues and research evidence. Psychol. Bull. 129, 674–697. doi: 10.1037/0033-2909.129.5.674
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., and Prisma Group (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 6:e1000097. doi: 10.1371/journal.pmed.1000097
Pachankis, J. E., and Bränström, R. (2018). Hidden from happiness: structural stigma, sexual orientation concealment, and life satisfaction across 28 countries. J. Consult. Clin. Psychol. 86, 403–415. doi: 10.1037/ccp0000299
Schmidt, F. L., and Oh, I. S. (2013). Methods for second order meta-analysis and illustrative applications. Org. Behav. Hum. Decis. Proces. 121, 204–218. doi: 10.1016/j.obhdp.2013.03.002
Siontis, K. C., Hernandez-Boussard, T., and Ioannidis, J. P. (2013). Overlapping meta-analyses on the same topic: survey of published studies. BMJ 347:f4501. doi: 10.1136/bmj.f4501
Szymanski, D. M., Kashubeck-West, S., and Meyer, J. (2008). Internalized heterosexism: a historical and theoretical overview. Counseling Psychol. 36, 510–524. doi: 10.1177/0011000007309488
Talley, A. E., and Bettencourt, B. A. (2011). The moderator roles of coping style and identity disclosure in the relationship between perceived sexual stigma and psychological distress. J. Appl. Soc. Psychol. 41, 2883–2903. doi: 10.1111/j.1559-1816.2011.00863.x
Vale, M. T., and Bisconti, T. L. (2021). Minority stress and relationship well-being in sexual minorities: the varying role of outness on relationship and sexual satisfaction. Int. J. Sexual Health. 15. doi: 10.1080/19317611.2021.1909684
Keywords: minority stress, social stigma, sexual minority, relationship functioning, meta-analysis
Citation: Doyle DM and Molix L (2021) Reconciling Associations Between Minority Stress and Sexual Minority Romantic Relationship Functioning. Front. Psychol. 12:707058. doi: 10.3389/fpsyg.2021.707058
Received: 08 May 2021; Accepted: 31 May 2021;
Published: 25 June 2021.
Edited by:
David L. Rodrigues, University Institute of Lisbon, PortugalReviewed by:
Miguel Ángel López-Sáez, Rey Juan Carlos University, SpainJosé Alberto Ribeiro-Gonçalves, William James Center for Research, Portugal
Copyright © 2021 Doyle and Molix. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: David Matthew Doyle, ZC5kb3lsZSYjeDAwMDQwO2V4ZXRlci5hYy51aw==