Ying Zhang1,2,3
Yufang Bian1,2,3*- 1Collaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University, Beijing, China
- 2Institute of Mental Health and Education, Beijing Normal University, Beijing, China
- 3Child and Family Education Research Center, Beijing Normal University, Beijing, China
Objectives: Emotion regulation has been extensively studied in various areas of psychology. The Emotion Regulation Questionnaire (ERQ) was developed to assess two specific constructs associated with emotion control—cognitive reappraisal and expression suppression (Gross and John, 2003). The instrument displayed sound psychometric properties; however, to date, inquiry regarding the measure’s characteristics has been limited. This study aims to measure cross-gender invariance [measurement invariance (MI)] in Chinese undergraduates using the ERQ.
Methods: This study measured the psychometric properties of the ERQ in a sample of 847 Mainland China undergraduates (401 males and 446 females) through confirmatory factor analysis. The tests of MI were used to examine potential structural differences based on gender.
Results: The findings supported the measure’s original structure with all demographic groups and demonstrated exceptional fit. Additional normative data for gender and ethnic groups are included as well. The results also supported the use of the instrument in future research.
Conclusion: The two-factor structure in the ERQ establishes a cross-gender equivalence between males and females in Chinese college students. This study supports the use of the instrument in future research.
Introduction
Emotion regulation implies the process that individuals use to regulate, experience, and express their emotions (Gross, 2002; John and Gross, 2007; Wang et al., 2020). Using emotion regulation strategies, individuals could alter their emotions in physiological activities, subjective experiences, and behavior (Ochsner and Gross, 2008; Miao, 2009; Gratz et al., 2015). Individuals regulate their emotions using the emotion regulation strategy, which enables them to improve, maintain, or reduce one or several emotional reactions (Gross, 1998; Dunsmore et al., 2013). Emotion regulation can influence individuals’ physical health (e.g., sleep quality) (Minkel et al., 2012), mental health (e.g., social anxiety and other negative emotions) (Goldin et al., 2012), interpersonal relationships (e.g., partnership and parent–child relationship) (English et al., 2012; Shi et al., 2019). Reportedly, individual emotion regulation could appear and often play a role in daily life and various interpersonal interactions (Gross et al., 2006). Emotion regulation has become a pressing issue in the field of psychology.
Successful emotion regulation strategies are crucial for an individual’s emotion (Cai et al., 2012), social support (English et al., 2012; Goldin et al., 2012), and subjective well-being (Parkinson and Totterdell, 1999; Gross and John, 2003; McRae et al., 2012). To clearly and directly assess emotion regulation strategies, Gross (1998) developed the Emotion Regulation Questionnaire (ERQ) based on the process model of emotion regulation [i.e. ERQ, compiled by Gross (1998) at Stanford University, United States, which focuses on the frequency of individual utilization of emotion regulation strategies by measuring two dimensions: “cognitive reappraisal” and “expression suppression,” 1 (Chinese version)]. Cognitive reappraisal is an antecedent-focused strategy and often tries to reinterpret events positively (e.g., When I’m faced with a stressful situation, I make myself think about it in a way that helps me stay calm) (John and Gross, 2004). Expressive suppression, however, attempts to suppress, hide, or reduce emotional expression (e.g., I keep my emotions to myself) (John and Gross, 2004). Gross’s ERQ comprises 10 items, including 6 items for measuring the cognitive reappraisal dimension and 4 measuring the expression suppression dimension. In recent years, ERQ has been extensively used in the measurement of special and normal groups and has been translated into different languages and widely used worldwide (Liu et al., 2017; Lotfi et al., 2019; Pastor et al., 2019; Wang et al., 2020). ERQ is acceptable to excellent levels of internal consistency reliability across various types of participants (posttraumatic stress disorder, anxiety disorders, normal adolescents, and young adults) (Gross and John, 2003; Wiltink et al., 2011; Spaapen et al., 2014; Preece et al., 2019).
The effects of cognitive reappraisal and expressive suppression are manifold depending on the cultural background. In the Western cultural background, the impact of cognitive reappraisal is more positive such as better social support and lower level of psychopathology symptoms (Moore et al., 2008; Joormann and Gotlib, 2010; McRae et al., 2012), whereas the impact of expressive suppression is more negative such as higher level of depression and anxiety (Moore et al., 2008; Eftekhari et al., 2009). However, in the Asian cultural background, cognitive reappraisal could be an ineffective strategy for some minority groups experiencing oppression, and expressive suppression appears to be less harmful (Soto et al., 2012; Su et al., 2015; Wang et al., 2020). Indeed, most studies that investigated the ERQ’s psychometric properties are under Western cultural background (Australian Bureau of Statistics, 2017), and a few have focused on the Asian cultural background (e.g., Mainland China) (Preece et al., 2019). Wang et al. (2007) explored the ERQ’s psychometric properties in Chinese college students, and Wang et al. (2020) tested the ERQ’s psychometric properties in Chinese rural-to-urban migrant adolescents and young adults; both studies found that the reliability and validity of ERQ fulfilled the requirements of psychometrics.
The research testing measurement invariance (MI) across different populations using the confirmatory factor analysis (CFA) has highlighted the significance of identifying discrepancies in factor and parameter characteristics and assessing how this could affect and distort between-group comparisons (Meredith, 1993). Wang et al. (2007) and Wang et al. (2020) focused on Oriental culture under the background of people’s emotion regulation strategies, and their studies’ impact on the measurement tool laid the foundation. Although both studies mentioned above in China reported worthwhile findings, the consideration of MI did not receive attention. Thus, it is crucial to determine whether the underlying traits measured by the measurement (e.g., ERQ in this study) are equivalent across different groups. For example, the ERQ measuring emotion regulation could exhibit variance across gender. Despite this inconsistency, measurement has always been a combination of males and females without distinction, and the latent construct of emotion regulation being measured could be observed in the male group but not in the female group, or vice versa. In this instance, variance is expected, and perhaps, the construct cannot be measured in the female or male group. Consequently, the scale could be an excellent measure of the latent construct of emotion regulation in a male population; however, the mean score comparisons between the male and female groups are relatively worthless because of measurement non-equivalence across the items. Such issues are of key significance in cross-gender research and when examining potential intergroup differences (e.g., based on gender, ethnicity, or age) in psychological constructs measured through self-reporting (Little, 1997; Gregorich, 2006). In addition, comparisons of gender differences based on the ERQ or studies of the impact of emotional regulation strategy between different genders should be based on the measurement equivalence of the scale. When the study was based on the scale to conduct further research and found differences between different genders, one should first consider from the angle of exploring ERQ measurement equivalence between different gender groups, that is, the scale to participants of different genders was measured on the equivalence, only to make the equivalence scale further valuable. However, to date, no equivalence study based on this scale has been reported among different genders in Chinese cultural background, and this study is conducted on such considerations.
This Study
This study uses tests of model invariance to determine whether the scale illustrates consistent measurement characteristics across two specific demographic comparisons—male and female undergraduate participants. The normative data for these gender groups in an undergraduate sample are included to provide further information about how the questionnaire performs across varying participant groups. It is hypothesized that this study will support the two-subscale structure illustrated in a previous research, and the measure will demonstrate invariance across gender comparison groups.
Materials and Methods
Participants and Procedure
We enrolled junior and senior students from a university in Beijing. A total of 882 participants (47.01% males), aged 19–23 years, were enrolled [mean (Mage) = 21.31, standard deviation (SD) = 1.09]. The sample encompassed 93.42% of individuals who reported their ethnicity as Han, and a further 6.58% classified themselves as belonging to an ethnic minority. To control ordering effects, the order of questionnaire administration was counterbalanced in each study. All participants were given information outlining the purpose and possible drawbacks of participation before completing the measures, as well as the opportunity to decline participation if they desired. Participants completed all measures and returned the questionnaires to research assistants before leaving the classroom.
Measures
In this study, the ERQ comprised 10 items. It includes two dimensions—cognitive reappraisal factor (six items; items 1, 3, 5, 7, 8, and 10) and expression suppression factor (four items; items 2, 4, 6, and 9). The ERQ is primarily used to evaluate individual emotion regulation strategies. We used the Likert seven-point scoring method for the items. The higher the score, the higher the frequency of using emotion regulation strategy. The internal consistency (Cronbach’s α) in this study was 0.825.
Statistical Analysis
Missing Data
The original sample included 882 Chinese college students; however, as 35 failed to respond to all ERQ items, they were excluded from the analysis. A total of 847 valid questionnaires (401 males and 446 females) were collected (effective rate: 96.03%).
Analytic Stages
Our analyses contained the following two stages: (i) CFA tested the fit of the emotional regulation model; and (ii) MIs of the emotional regulation model were assessed, from the CFA, across gender.
Stage 1: Model Evaluation in CFA
CFA was conducted for the Emotional Regulation model, and the CFA was specified and estimated using Mplus 8.0 software (Muthén and Muthén, 1998-2017). Based on previous studies, we used some fit indices to assess the overall fit of the models; these included chi-square (χ2), comparative fit index (CFI), Tucker–Lewis index (TLI), root mean square error of approximation (RMSEA), and standardized root mean square residual (SRMR). The values >0.90 for the CFI and TLI and <0.08 for the RMSEA and SRMR indicated an adequate fit (Kline, 2010).
Stage 2: Model Specification
Following the generally accepted practice, we assessed the fit of each model by examining multiple fit indices (Kline, 2010). When examining factorial invariance, we followed the established procedures (Meredith, 1993; Gregorich, 2006; Meredith and Teresi, 2006), which were used in the related literature (Engdahl et al., 2011; Wang et al., 2013a). If configural invariance (baseline model, Model A) is supported, further restrictive constraints could be imposed on the model, as was performed in the conventional multiple group CFA invariance test. First, factor loadings were constrained to be equal across gender to test metric or weak invariance (Model B). In addition, a χ2 difference test was conducted to assess if the baseline model was significantly different from the constrained model. A non-significant χ2 difference test indicated that factor loadings were invariant across gender, thereby satisfying metric invariance. Furthermore, based on the metric invariance model, intercepts were constrained to be equal across gender to build Model C, a test of scalar or strong invariance. Model D included the restrictions from Model C plus the additional constraint of equal item error variances across the two genders (invariant error variance or strict invariance). Subsequent to Model D, residual error variances were not constrained to be equal across timepoints (Grouzet et al., 2006). Thus, Model E was compared with Model C to preserve nested model testing. Model E comprised the constraints from Model C plus the additional constraint of equal factor variances across the two genders (invariant factor variances). During testing, except for the baseline model (Model A), the first two invariance testing analyses were also called MI, while the next invariance testing analyses were called structural invariance.
Data Analysis
Statistical analyses were performed using SPSS 19.0, JASP-0.11.1.0 (2; Marsman and Wagenmakers, 2017; Wagenmakers et al., 2017a; Wagenmakers et al., 2017a,b), and Mplus 8.0 (Muthén and Muthén, 1998-2017). JASP-0.11.1.0 software was primarily used to analyze the kurtosis and skewness of items. Using Mplus 8.0 software, we used the CFA of the ERQ, compared the fitting index, and obtained the best factor model to fit the Chinese college students. In addition, significant skewness and kurtosis values were obtained for each item (p < 0.01). We selected the robust maximum-likelihood estimation method for unbiased estimation of non-normal distribution data for data analysis (Satorra and Bentler, 2001). The robust ML estimator with a mean-adjusted χ2 (maximum likelihood parameter estimates with standard errors and a mean-adjusted χ2 test statistic) was selected, as these provide parameter estimates that are robust to non-normality (Satorra and Bentler, 2001; Wang et al., 2013a). Furthermore, we use the corrected scaled χ2 difference test to compare the nested models (Satorra and Bentler, 2001).
We evaluated the fit of each model by examining multiple fit indices (Kline, 2010; Wang et al., 2012). We used the Satorra Bentler chi-square statistic (S-Bχ2), RMSEA, SRMR, TLI, and CFI. On the basis of extensive simulation studies conducted by Hu and Bentler (1999), it appears that good-fitting models have CFI and TLI values greater than 0.95, RMSEA values less than 0.06, and less than 0.08 (Wang et al., 2012). The corrected scaled chi-square difference test developed by Satorra and Bentler (2001); Muthén and Muthén (1998-2017) was used to compare nested models. However, tests of the change in CFI (i.e., ΔCFI) are superior to chi-square (Δχ2) difference tests of invariance because they are not affected by the sample size (Cheung and Rensvold, 2002; Meade et al., 2008). Thus, the corrected scaled chi-square difference test and change in CFI were used to compare nested models. When both results contradict each other, however, we primarily depended on results of CFI differences.
According to the suggestion of Cheung and Rensvold (2002), the change in CFI was chosen to evaluate the measurement invariance. When ΔCFI < 0.01, it implies that the invariance hypothesis cannot be rejected, and the model fits well; when 0.01 ≤ ΔCFI ≤ 0.02, it implies that the degree of the model has a moderate deterioration, which cannot reveal that the difference exists and is significant; when ΔCFI ≥ 0.02, it signifies a significant difference (Cheung and Rensvold, 2002; Meade et al., 2008; Wang et al., 2013b), and the standard of the nested model is ΔCFI < 0.01, ΔTLI < 0.01 (Wang et al., 2012, Wang et al., 2013b).
Ethics Statement
In this study, the core variables were participants’ ERQ scores, and we collected the data in the classroom. Written informed consent was obtained from all principals and participants in this study. The protocol and questionnaires used were approved by the university’s Institutional Review Board.
Results
Descriptive Statistics
Table 1 lists the average scores measured by the ERQ and standardized factor loads for each item. Significant multivariate skewness and kurtosis were found (p < 0.05, based on univariate and multivariate tests). In the ERQ, the real score was 20–53 (male: 36.83 ± 6.118; female: 32.98 ± 5.732), and the male score was significantly higher than the female score (t = 3.054, p < 0.01, d = 0.46). In the cognitive reappraisal factor score, the male score was 16.02 ± 2.659, while the female score was 14.95 ± 2.802; thus, the male and female scores revealed no statistically significant difference (t = 1.223, p = 0.171). In the expression suppression factor score, the male score was 22.01 ± 3.754, while the female score was 18.65 ± 4.002; the male score was significantly higher than that of the females (t = 3.124, p < 0.01, d = 0.42). In this study, Cronbach α was 0.825 in the ERQ, and the coefficient α of cognitive reappraisal and expression suppression was 0.831 and 0.778, respectively.
Table 1. Descriptive statistics results of Emotion Regulation Questionnaire (ERQ).
Item analysis was used to discriminate each item (Table 2). (i) A critical ratio (decision values of the high- and low-score groups) was used and the correlation of the total items to test the discrimination of each item. We defined the first 27% of the score in the ERQ as the high-score group, while the latter 27% as the low-score group. (ii) Each item score difference in the high- and low-score groups was compared in this study. The results revealed that the ERQ scores in the high- and low-score groups were statistically significant, and the correlation of the total items were 0.38–0.62 (p < 0.01).
Table 2. The t-test of high- and low-score group for each item and total item correlation of ERQ.
Stage 1: Confirmatory Factor Analysis
The CFA results (Figure 1) revealed that S-B χ2/df = 5.95, p = 0.004, CFI = 0.93, TLI = 0.92, RMSEA = 0.056, and SRMR = 0.038. Specifically, for males, the CFA results revealed that S-B χ2/df = 3.49, p = 0.002, CFI = 0.94, TLI = 0.93, RMSEA = 0.043, and SRMR = 0.051. For females, the CFA results revealed that S-B χ2/df = 3.66, p = 0.002, CFI = 0.95, TLI = 0.93, RMSEA = 0.059, and SRMR = 0.044 (Table 3).
Figure 1. Standardized factor loadings for total sample confirmatory factor analysis (CFA).
Table 3. Two-factor structure model fitting results in ERQ.
Stage 2: Measurement Invariance Testing Across Gender
The results from the MI across gender revealed that all five steps of MI testing resulted in significant χ2 (ps < 0.01), excellent (CFIs > 0.95, TLIs > 0.090), and equivalent fit indices (ΔCFIs < 0.01, ΔTLIs < 0.01). Moreover, all goodness-of-fit indices suggested that all models assuming different degrees of invariance were acceptable (Table 4).
Table 4. Goodness-of-fit indices of the compared models.
Configural Invariance (Model A)
In the configural MI testing, the factor load and the intercept of observation variables were performed for free estimation. In this study, each fitting index of Model A fulfilled the measurement standard (CFI ≥ 0.90; TLI ≥ 0.90), thereby establishing the configural invariance, and Model A fulfilled the requirements as the next MI analysis baseline model (Table 4).
Metric Invariance (Model B)
After passing the configural invariance testing, the factor load MI was set according to Model A, and both groups of corresponding factor loads were constrained to be equal to test the weak invariance model. After increasing the factor load equal constrain, if the data fitting situation did not reach the standard in statistics, the constrain was not removed. In this study, comparing the CFIs and TLIs of Model B and Model A, the |ΔCFI| and |ΔTLI| values were 0 and 0.003. As shown in Table 4, the model fitted well, and the MI test continued.
Scalar Invariance (Model C)
Based on the construction of Model B, we set the measurement intercepts of two groups equally (Model C). As shown in Table 4, we compared the CFIs and TLIs of Model C and Model B, the |ΔCFI| and |ΔTLI| values were 0.003 and 0.001, and the model fitted well, thereby the MI test continued.
Residual Error Invariance (Model D)
Based on Model C, we constrained residual error variances across the groups. Then, we compared CFIs and TLIs values of Model D and Model C, the |ΔCFI| and |ΔTLI| values were 0.004 and 0.002. As shown in Table 3, the model fitted well, thereby the MI test continued.
Invariant Factor Variances (Model E)
The final test of this study was to test structural invariance (Model E), which additionally constrained factor variances and covariances (not residual variances), tested against Model C. As shown in Table 4, |ΔCFI| and |ΔTLI| values of the two models mentioned above were 0.004 and 0.001, respectively, implying that the factor variance MI was established.
Discussion
This study first tested the two-factor structure of the emotion regulation using the CFA among Mainland China college students. The item analysis revealed that the distinction and discrimination of the items were acceptable, which is consistent with previous studies that used the CFA to compare alternative structures of emotion regulation among Chinese rural-to-urban migrant youth (Wang et al., 2020). The Cronbach’s α of ERQ total scores and subscales was acceptable (0.778–0.831), suggesting that the ERQ is a reliable measure of emotion regulation. The CFA results supported the two-factor structure of the ERQ, which demonstrated a clear replication with the results of most previous studies (Wang et al., 2007; Matsumoto et al., 2008). The total internal consistency α coefficient of the ERQ was 0.825, and each dimension was 0.831 (cognitive reappraisal) and 0.778 (expressive suppression), which is acceptable. In addition, α coefficients of the ERQ were similar to that in previous studies in Chinese literature (cognitive reappraisal, α = 0.85; expressive suppression, α = 0.77) (Wang et al., 2007); however, α coefficients of the ERQ were marginally lower than that of the rural-to-urban migrant adolescents and young adults in China (the total internal consistency α coefficient of the ERQ was 0.82, and each dimension was 0.82 (cognitive reappraisal) and 0.73 (expressive suppression) (Wang et al., 2020); this could be attributable to different characteristics of different groups of people.
This study examined MI across gender and compared the gender difference of emotion regulation strategy based on the ERQ. The findings demonstrated that all models assuming different degrees of invariance were acceptable, suggesting that the ERQ factors have the same meaning across gender, suggesting that comparisons across gender based on the ERQ are meaningful. This study’s results of MI across gender corroborated previous research, in which MI was found in a sample of American undergraduates (Melka et al., 2011). Furthermore, the results of this research extend the study area from the perspective of MI in Mainland China with Oriental cultural background.
Comparison of differences in ERQ scores and the two factors between males and females revealed that males’ overall emotion regulation is markedly higher than females’. Regarding cognitive reappraisal factors, no significant difference was observed between males and females, whereas, a significant difference was observed between males and females in terms of expression suppression, suggesting that males exhibit more utilization of expression suppression strategies for emotion regulation than females. Notably, previous studies have compared the emotion regulation strategy of people from various backgrounds (Sala et al., 2012). However, as related to gender, if the MI does not hold across groups, differences in observed scores may not be directly comparable. This finding is consistent with previous studies on the differences in emotion regulation between males and females (Hess et al., 2000; Parkins, 2012; Chaplin and Aldao, 2013), and, thus, our results provide additional empirical support from Mainland China for their conclusion.
Our findings provide crucial meaning for practice. First, influenced by Chinese traditional culture, undergraduates in Mainland China are not good at expressing their emotions, which remind college administrators to be concerned about undergraduates, teach them emotion regulation strategies and interpersonal communication strategies, and provide them with opportunities to interact and practice emotion regulation strategies in their relationships, and specific educational schedules should be developed and used for this group. Second, gender differences depicted in ERQ measurement scores reflect the real differences in the cognitive reappraisal and expression suppression between males and females, rather than caused by the variance measured by the ERQ itself (Meredith and Teresi, 2006), thereby providing a comparative psychological basis for related research. Finally, it is significant that future emotion regulation measurement and invariance measurement criteria should consider this character.
This study has some limitations. First, we used a restricted sample of college students from Mainland China; thus, the results might not be entirely generalizable for all Chinese population. Second, the sample was not considered regarding other variables and, thus, was not further explained; however, it could serve as a basis for future research. Finally, we used a more appropriate parameter estimate approach (Flora and Curran, 2004; Melka et al., 2011).
Conclusion
This study establishes the ERQ as a structurally consistent and sound measure of cognitive reappraisal and emotional suppression across gender groups. Given the popularity of emotion regulation research in recent years, attempts to elucidate mea sures of associated constructs are vital. This study provides further evidence that the ERQ is a valuable research topic. Nonetheless, continued efforts to use the instrument in future studies are highly recommended.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by the Institutional Review Committee of the Collaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University. Participants provided their written informed consent to participate in the study.
Author Contributions
YZ designed and executed the study, analyzed the data, and wrote the manuscript. YB collaborated with the design of the study. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Footnotes
References
Australian Bureau of Statistics (2017). 2016 Census Data Summary: Cultural Diversity in Australia. Canberra: Australian Bureau of Statistics.
Cai, L., Zhong, M., Zhu, X., Tang, Q., and Wang, Q. (2012). Relationship between cognitive emotion regulation strategies and depressive symptoms in patients with depression. Chin. J. Clin. Psychol. 20, 176–179. doi: 10.1016/j.paid.2005.12
Chaplin, T. M., and Aldao, A. (2013). Gender differences in emotion expression in children: a meta-analytic review. Psychol. Bull. 139, 735–765. doi: 10.1037/a0030737
Cheung, W. G., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. A Multidiscipl. J. 9, 233–255. doi: 10.1207/S15328007SEM0902_5
Dunsmore, J. C., Booker, J. A., and Ollendick, T. H. (2013). Parental emotion coaching and child emotion regulation as protective factors for children with oppositional defiant disorder. Soc. Dev. 22, 444–446. doi: 10.1111/j.1467-9507.2011.00652.x
Eftekhari, A., Zoellner, L. A., and Vigil, S. A. (2009). Patterns of emotion regulation and psychopathology. Anxiety Stress Cop. 22, 571–586. doi: 10.1080/10615800802179860
Engdahl, R. M., Elhai, J. D., Richardson, J. D., and Frueh, B. C. (2011). Comparing posttraumatic stress disorder s symptom structure between deployed and non-deployed veterans. Psychol. Assess. 23, 1–6. doi: 10.1037/a0020045
English, T., John, O. P., Srivastava, S., and Gross, J. J. (2012). Emotion regulation and peer-rated social functioning: a 4-year longitudinal study. J. Res. Pers. 46, 780–784. doi: 10.1016/j.jrp.2012.09.006
Flora, D. B., and Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol. Methods 9, 466–491. doi: 10.1037/1082-989x.9.4.466
Goldin, P., Ziv, M., and Jazaieri, H. (2012). Cognitive reappraisal self-efficacy mediates the effects of individual cognitive-behavioral therapy for social anxiety disorder. J. Consult. Clin. Psychol. 80, 1034–1040. doi: 10.1037/a0028555
Gratz, K. L., Weiss, N. H., and Tull, M. T. (2015). Examining emotion regulation as an outcome, mechanism, or target of psychological treatments. Curr. Opin. Psychol. 3, 85–90. doi: 10.1016/j.copsyc.2015.02.010
Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med. Care 44, 578–594. doi: 10.1097/01.mlr.0000245454.12228.8f
Gross, J. J. (1998). The emerging field of emotion regulation: an integrative review. Rev. Gen. Psychol. 2, 271–299. doi: 10.1037/1089-2680.2.3.271
Gross, J. J. (2002). Emotion regulation: affective, cognitive, and social consequences. Psychophysiology 39, 281–291. doi: 10.1017/s0048577201393198
Gross, J. J., and John, O. P. (2003). Individual differences in two emotion regulation processes: implications for affect, relationships, and wellbeing. J. Pers. Soc. Psychol. 85, 348–362. doi: 10.1037/0022-3514.85.2.348
Gross, J. J., Richards, J. M., and John, O. P. (2006). “Emotion regulation in everyday life,” in Emotion Regulation in Couples and Families: Pathways to Dysfunction and Health, eds D. K. Snyder, J. Simpson, and J. N. Hughes (Washington, DC: American Psychological Association), 13–35. doi: 10.1037/11468-001
Grouzet, F. M. E., Kasser, T., Ahuvia, A., Dols, J. M. F., Kim, Y., Lau, S., et al. (2006). The structure of goal contents across 15 cultures. J. Pers. Soc. Psychol. 89, 800–816. doi: 10.1037/0022-3514.89.5.800
Hess, U., Senécal, S., Kirouac, G., Herrera, P., Philippot, P., and Kleck, R. E. (2000). Emotional expressivity in men and women: stereotypes and self-perceptions. Cogn. Emot. 14, 609–642. doi: 10.1080/02699930050117648
Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1–55. doi: 10.1080/10705519909540118
John, O. P., and Gross, J. J. (2004). Healthy and unhealthy emotion regulation: personality processes, individual differences, and life span development. J. Pers. 72, 1301–1334. doi: 10.1111/j.1467-6494.2004.00298.x
John, O. P., and Gross, J. J. (2007). “Individual differences in emotion regulation strategies: links to lobal trait, dynamic, and social cognitive constructs,” in Handbook of Emotion Regulation, ed. J. J. Gross (New York, NY: Guilford Press), 351–372.
Joormann, J., and Gotlib, I. H. (2010). Emotion regulation in depression: relation to cognitive inhibition. Cogn. Emot. 24, 281–298. doi: 10.1080/02699930903407948
Kline, R. B. (2010). Principles and Practice of Structural Equation Modeling, 3rd Edn, New York, NY: Guilford Press.
Little, T. D. (1997). Mean and covariance structure (MACS) analyses of cross-culture data: practical and theoretical issues. Multiv. Behav. Res. 32, 53–76. doi: 10.1207/s15327906mbr3201_3
Liu, W., Chen, L., and Tu, X. (2017). Chinese adaptation of emotion regulation questionnaire for children and adolescents (ERQ-CCA): a psychometric evaluation in Chinese children. Intern. J. Psychol. 52, 398–405. doi: 10.1002/ijop.12233
Lotfi, M., Bahrampouri, L., Amini, M., Fatemitabar, R., Birashk, B., Entezari, M., et al. (2019). Persian adaptation of emotion regulation questionnaire for children and adolescents (ERQ-CA). J. Mazand. Univ. Med. Sci. 29, 117–128.
Marsman, M., and Wagenmakers, E.-J. (2017). Bayesian benefits with JASP. Eur. J. Dev. Psychol. 14, 545–555. doi: 10.1080/17405629.2016.1259614
Matsumoto, D., Yoo, S. H., and Nakagawa, S. (2008). Culture, emotion regulation, and adjustment. J. Pers. Soc. Psychol. 94, 925–937. doi: 10.1037/0022-351494.6.925
McRae, K., Jacobs, S. E., Ray, R. D., John, O. P., and Gross, J. J. (2012). Individual differences in reappraisal ability: links to reappraisal frequency, well-being, and cognitive control. J. Res. Pers. 46, 2–7. doi: 10.1016/j.jrp.2011.10.003
Meade, A. W., Johnson, E. C., and Braddy, P. W. (2008). Power and sensitivity of alternative fit indices in tests of measurement invariance. J. Appl. Psychol. 93, 568–592. doi: 10.1037/0021-9010.93.3.568
Melka, S. E., Lancaster, S. L., Bryant, A. R., and Rodriguez, B. F. (2011). Confirmatory factor and measurement invariance analyses of the emotion regulation questionnaire. J. Clin. Psychol. 67, 1283–1293. doi: 10.1002/jclp.20836
Meredith, W. (1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika 58, 525–543. doi: 10.1007/BF02294825
Meredith, W., and Teresi, J. A. (2006). An essay on measurement and factorial invariance. Med. Care 44, 69–77. doi: 10.1097/01.mlr.0000245438.73837.89
Miao, Y. J. (2009). Happiness in the Perspective of Psychology-The Theory of Happiness and Its Evaluation. Tianjin: Tianjin People’s Press.
Minkel, J. D., McNealy, K., and Gianaros, P. J. (2012). Sleep quality and neural circuit function supporting emotion regulation. Biol. Mood Anx. Disord. 2, 1–9.
Moore, S. A., Zoellner, L. A., and Mollenholt, N. (2008). Are expressive suppression and cognitive reappraisal associated with stress-related symptoms? Behav. Res. Ther. 46, 993–1000. doi: 10.1016/j.brat.2008.05.001
Muthén, L. K, and Muthén, B. O (1998-2017). Mplus User S Guide, 8th Edn, Los Angeles, CA: Muthén & Muthén.
Ochsner, K. N., and Gross, J. J. (2008). Cognitive emotion regulation: Insights from social cognitive and affective neuroscience. Curr. Direct. Psychol. Sci. 17, 153–158. doi: 10.1111/j.1467-8721.2008.00566.x
Parkins, R. (2012). Gender and emotional expressiveness: an analysis of prosodic features in emotional expression. Griffith Work. Pap. Pragmat. Interc. Commun. 5, 46–54.
Parkinson, B., and Totterdell, P. (1999). Classifying affect-regulation strategies. Cogn. Emot. 13, 277–303. doi: 10.1080/026999399379285
Pastor, M. C., López-Penadés, R., Cifre, E., and Moliner-Urdiales, D. (2019). The spanish version of the emotion regulation questionnaire for children and Adolescents (ERQ-CA): a psychometric evaluation in early adolescence. Span. J. Psychol. 22:30. doi: 10.1017/sjp.2019.30
Preece, D. A., Becerra, R., Robinson, K., and Gross, J. J. (2019). The emotion regulation questionnaire: psychometric properties in general community samples. J. Pers. Assess. 102, 1–9. doi: 10.1080/00223891.2018.1564319
Sala, M. N., Molina, P., Abler, B., Kessler, H., Vanbrabant, L., and van de Schoot, R. (2012). Measurement invariance of the emotion regulation questionnaire (ERQ). a cross-national validity study. Eur. J. Dev. Psychol. 9, 751–757. doi: 10.1080/17405629.2012.690604
Satorra, A., and Bentler, P. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika 66, 507–514. doi: 10.1007/BF02296192
Shi, L., Guang, P., and Luo, X. (2019). A network analysis of the influence of parental anxiety and its emotional regulation on adolescent anxiety. Chin. J. Clin. Psychol. 27, 1237–1241.
Soto, J. A., Armenta, B. E., Perez, C. R., Zamboanga, B. L., UmañaTaylor, A. J., Lee, R. M., et al. (2012). Strength in numbers? Cognitive reappraisal tendencies and psychological functioning among Latinos in the context of oppression. Cult. Diver. Ethnic Minor. Psychol. 18, 384–394. doi: 10.1037/a0029781
Spaapen, D., Waters, F., Brummer, L., Stopa, L., and Bucks, R. (2014). The emotion regulation questionnaire: validation of the ERQ-9 in two community samples. Psychol. Assess. 26, 46–54. doi: 10.1037/a0034474
Su, J. C., Lee, R. M., Park, I. J. K., Soto, J. A., Chang, J., Zamboanga, B. L., et al. (2015). Differential links between expressive suppression and well-being among Chinese and Mexican American college students. Asian Am. J. Psychol. 6, 15–24. doi: 10.1037/a0036116
Wagenmakers, E.-J., Love, J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., et al. (2017a). Bayesian inference for psychology. Part II: example applications with JASP. Psychon. Bull. Rev. 25, 58–76. doi: 10.3758/s13423-017-1323-7
Wagenmakers, E.-J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., et al. (2017b). Bayesian inference for psychology. Part I: theoretical advantages and practical ramifications. Psychon. Bull. Rev. 25, 35–57. doi: 10.3758/s13423-017-1343-3
Wang, D., Yuan, B., Han, H., and Wang, C. (2020). Validity and reliability of emotion regulation questionnaire (ERQ) in Chinese rural-to-urban migrant adolescents and young adults. Curr. Psychol. 4, 1–8. doi: 10.1007/s12144-020-00754-9
Wang, L., Liu, H. C., Li, Z. Q., and Du, W. (2007). Reliability and validity of emotion regulation questionnaire Chinese revised version. Chin. J. Health Psychol. 15, 503–505.
Wang, M., Armour, C., Li, X., Dai, X., Zhu, X., and Yao, S. (2013a). The factorial invariance across gender of three well-supported models. J. Nerv. Ment. Dis. 201, 145–152. doi: 10.1097/nmd.0b013e31827f627d
Wang, M., Armour, C., Wu, Y., Ren, F., Zhu, X., and Yao, S. (2013b). Factor structure of the CES-D and measurement invariance across gender in mainland chinese adolescents. J. Clin. Psychol. 69, 966–979. doi: 10.1002/jclp.21978
Wang, M., Elhai, J. D., Dai, X., and Yao, S. (2012). Longitudinal invariance of posttraumatic stress disorder symptoms in adolescent earthquake survivors. J. Anx. Disord. 26, 263–270. doi: 10.1016/j.janxdis.2011.12.009
Keywords: emotion regulation, cognitive reappraisal, expression suppression, across gender, measurement invariance
Citation: Zhang Y and Bian Y (2020) Emotion Regulation Questionnaire for Cross-Gender Measurement Invariance in Chinese University Students. Front. Psychol. 11:569438. doi: 10.3389/fpsyg.2020.569438
Received: 04 June 2020; Accepted: 06 October 2020;
Published: 04 November 2020.
Edited by:
José Antonio Lozano Lozano, Autonomous University of Chile, ChileCopyright © 2020 Zhang and Bian. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Yufang Bian, Ymlhbnl1ZmFuZzY2QDEyNi5jb20=