Jie Luo
Meng-Cheng Wang
Ying Ge
Wei Chen
Shuang Xu- 1School of Psychology, Guizhou Normal University, Guiyang, China
- 2Department of Psychology, Guangzhou University, Guangzhou, China
- 3The Key Laboratory for Juveniles Mental Health and Educational Neuroscience in Guangdong Province, Guangzhou University, Guangzhou, China
- 4The Center for Psychometrics and Latent Variable Modeling, Guangzhou University, Guangzhou, China
- 5Key Laboratory of Emotion and Mental Health in Chongqing, Chongqing Collaborative Innovation Center for Brain Science, Chongqing University of Arts and Sciences, Chongqing, China
The current study examined the longitudinal measurement invariance (LMI) of the Short Grit Scale (Grit-S) in a survey sample of Chinese young adults (N = 233, 48.9% male, mean age = 19.36 years, SD = 0.90 years) who completed the Grit-S twice over a 3-month interval. Confirmatory factor analysis was conducted to examine the LMI of the Grit-S across time. Results showed that the Grit-S has strict longitudinal invariance (i.e., equality of factor patterns, factor loadings, item intercepts, and item uniqueness for all items) over time. Additionally, the internal consistency indices of the Grit-S were acceptable across time, the stability coefficients over time were moderate, and latent factor means did not differ significantly across time. In sum, these findings suggest that the Grit-S has satisfactory longitudinal properties when used in Chinese young adults.
Introduction
Grit, as a personality trait, is interpreted as trait-level perseverance with a passion for long-term goals, and it has been shown to predict an individual’s achievement in challenging domains over and beyond measures of talent (Duckworth et al., 2007; Duckworth and Quinn, 2009). According to Duckworth et al. (2007), although there has been some empirical evidence for a close relationship between grit and conscientiousness (e.g., Ivcevic and Brackett, 2014; Rimfeld et al., 2016; Schmidt et al., 2018), grit distinguishes from the traditionally measured facets of Big Five Conscientiousness in its focusing on stamina. More specifically, grit shows that one is available to keep effort and interest in projects that may take months or even more to accomplish. Individuals with high scores in grit measurement do not stray from their goals, even without positive feedback (Duckworth and Quinn, 2009). Moreover, grit is also related to or overlaps with self-control (Credé et al., 2017; Vazsonyi et al., 2018; Werner et al., 2019), yet it differs from self-control or self-regulation (Duckworth and Quinn, 2009; Duckworth and Gross, 2014). According to Duckworth and Gross (2014), self-control entails the ability to sustain focus on a present task and to desist from distractions, more consistent with avoidance systems; grit, on the other hand, is best understood as an ability to pursue long-term goals and is related to the approach motivation system. As such, grit is unique and should remain predictive independent of self-control because it focuses on the ability to attain long-term goals (Duckworth and Gross, 2014).
Traditionally, grit researchers conceptualized grit as the combination of two components: perseverance of effort (PE) and consistency of interests (CI). Despite the extensive studies of grit as a whole construct and obtaining a total scale score by summing the PE and CI subscale scores, there is an increasing amount of evidence that the two grit facets can reflect independent constructs instead of aspects of the single grit construct (e.g., Credé et al., 2017; Tyumeneva et al., 2017). For instance, prior research has shown the unique validity of two grit subscales for performance outcome (Credé et al., 2017) as well as well-being and personality strength (Disabato et al., 2018). Accordingly, researchers recommended that the two grit subscales (i.e., PE and CI) be kept separate instead of combining them to form a total grit score (Credé, 2018). Broadly speaking, growing evidence has shown that grit may predict one’s success and performance in academic, vocational, and avocational domains (Duckworth et al., 2007, 2009; Duckworth and Quinn, 2009; Eskreis-Winkler et al., 2014; Zhong et al., 2018). For example, at the United States Military Academy in West Point, New York, freshman cadets who measured higher in grit were less likely to drop out than their less-gritty peers, even after controlling for other measures (e.g., SAT scores, high school rank, and Big Five Conscientiousness) (Duckworth et al., 2007). Additionally, a recent meta-analysis has indicated that overall grit exhibited a relationship with overall academic performance as well as with overall GPA criterion (Credé et al., 2017). Likewise, existing meta-analytic evidence indicates differences between the two grit facets in predicting achievement, retention, and intelligence outcomes (Credé et al., 2017). In summary, given the importance of grit in educational, personal, and professional domains, it is therefore necessary to identify and validate the brief, stand-alone measure of grit.
The Grit Scale and Its Short Version
In the absence of adequate existing measures, Duckworth et al. (2007) developed and validated the 12-item self-report measure of grit (Grit-O). The Grit-O was theoretically consistent with grit as a compound trait comprising stamina in the dimensions of interest (i.e., consistency of interest) and effort (i.e., PE). The consistency of interest (CI) factor refers to the tendency to not change goals and interests frequently; the PE factor assesses the tendency to work hard even in the face of setbacks. Duckworth et al. (2009) subsequently revised and developed a more economical and efficient measure of grit: the Short Grit Scale (Grit-S). The Grit-S keeps the proposed two-factor structure of the full Grit-O, but contains four fewer items and demonstrates better psychometric properties than the original Grit-O (Duckworth and Quinn, 2009).
Following the work of Duckworth et al. (2009), the Grit-S has been formally translated into Japanese (Nishikawa et al., 2015), Turkish (Sarıçam et al., 2015), Filipino (Datu et al., 2016), German (Schmidt et al., 2017), Polish (Wyszyńska et al., 2017), Spanish (Arco-Tirado et al., 2018), and Chinese (Wang et al., 2017; Li et al., 2018; Zhong et al., 2018). Overall, cross-sectional data show that each version of the Grit-S has acceptable psychometric properties and that each translation resembles the English-speaking version (see Table 1). None of these investigations, however, have assessed the longitudinal properties for the Grit-S, nor have they focused on the longitudinal measurement invariance (LMI) of the Grit-S scores over different time periods.
Table 1. Psychometric properties in previous studies for the Grit-S.
While the Grit-S is a popular measurement for grit, there have been some controversies regarding the factor structure of the Grit-S. More specifically, the original factor structure of the Grit-S was a high-order construct with two low-order components (i.e., PE and CI) and was based on confirmatory factor analysis (Duckworth and Quinn, 2009). Some comments, however, have suggested that this solution might be problematic (e.g., Credé et al., 2017; Credé, 2018) since a factor model with one second-order factor and two first-order factors cannot be identified at the higher-order level (Kline, 2011). Criterion-related studies, on the other hand, with Grit-S also have inconsistencies – they either combine the two grit facets to a single grit score (Duckworth and Quinn, 2009) or treat the two grit subscales separately (Credé, 2018; Guo et al., 2019). Additionally, recent controversies have focused on how the Grit-S captures only perseverance (PE) without passion (CI) (e.g., Jachimowicz et al., 2018, 2019; Credé, 2019; Guo et al., 2019). Given that prior studies that examined the psychometric properties of the Grit-S preferred the two first-order factors structure to the high-order factor solution (see Table 1), the present study would like to examine the longitudinal properties of the Grit-S within the two lower order factors model.
Measurement Invariance of the Grit-S
Measurement invariance (MI) is vital because the interpretation of mean differences may be misguided and questionable unless there is the same latent construct in different subgroups (Byrne and Watkins, 2003; Chen, 2008). That is, the establishment of MI is a prerequisite for meaningful comparisons across groups (e.g., male vs. female) (Chen, 2008). Previous studies (Datu et al., 2016; Schmidt et al., 2017; Zhong et al., 2018) have discussed the MI of the Grit-S scores for gender, educational levels, and age groups. For example, Zhong et al. (2018) showed that the self-report measure of Grit-S has strict MI across gender and age in Chinese insurance employees. Likewise, the partial strict invariance across gender and different levels has been supported using a German sample of university students (Schmidt et al., 2017). In a mixed sample of Filipino high school and university students, only the configural invariance model was supported, while not existing evidence of measurement and structural invariance when comparing between two student groups (i.e., high school and university students; Datu et al., 2016).
While existing research has focused on the MI of the Grit-S across different groups (e.g., gender and age), the LMI (i.e., measurement invariance across different points in time) for Grit-S has not been explored. Similar to the MI across different groups, LMI tests the equality of a construct for an instrument, but its focus is on equality across time rather than across groups (Dimitrov, 2010; Millsap and Cham, 2012). LMI is a desirable quality in a measurement because it indicates that the same construct can be tested across occasions (i.e., configural, metric, scalar, and strict invariance), providing a solid and necessary basis for mean comparisons in longitudinal studies. Any inference about developmental changes over time may be misleading and inaccurate unless the premise of LMI is met (Dimitrov, 2010; Millsap and Cham, 2012). As such, confirming the LMI is critical to be able to draw valid conclusions about growth and changes in latent constructs across time. Although longitudinal studies that examine the relationship between grit and other covariates across diverse situations have been common in health and occupational psychology (e.g., Duckworth et al., 2007, 2009, 2011; Duckworth and Quinn, 2009), these studies did not measure whether grit has MI across time. In the current research, it is the first time to test whether the Grit-S has LMI over time.
The Present Study
The main purpose of this research was to examine the LMI of Grit-S in a survey sample of Chinese young adults. For this purpose, the confirmatory factor analysis was conducted to test whether the Grit-S scores have LMI. Specifically, we tested the configural, metric, scalar, and strict invariance over a 3-month interval. Given that traits such as grit describe tendencies to act, think, and feel that are relatively stable across time and situations (Duckworth et al., 2007), it could be expected that the Grit-S scores would have strict longitudinal invariance. The internal consistency values of the Grit-S scores were measured separately, first at the baseline and then at the follow-up. Finally, the stability coefficients across time were computed, and the latent factor means from both times were compared.
Materials and Methods
Participants
The subjects used in the current investigation were recruited from a normal university in Guiyang city, China. In this in-progress longitudinal research, we aimed to seek a more particular knowledge of the correlates and causes of heterogeneity in freshman adaptation to college and psychological health. The first survey was administered at the beginning of the second semester of freshman year in March 2019, when 296 first-year students were recruited to complete the Chinese version of the Grit-S (Zhong et al., 2018); the second assessment was conducted in the end of the second semester of the freshman year (June 2019), with 233 of the original first-year students attending the investigation. Participant data from those subjects who did not complete the second survey were excluded (n = 63). An independent-samples t-test showed that the two subscales and total scale scores of the Grit-S at Time 1 were not significantly different between the participants and dropouts at Time 2 (CI: t = −0.147, p = 0.883; PE: t = 0.133, p = 0.894; Grit-S total: t = −0.005, p = 0.996), suggesting that the sample attrition at Time 2 was random. Regarding the final sample, participants were between 17 and 22 years of age (M = 19.36, SD = 0.90), with approximately 91% of participants being 18–20 years old, 114 (48.9%) were male and 119 (51.1%) were female, 83 (35.6%) were majoring in education, 38 (16.3%) were majoring in science, 40 (17.2%) were majoring in economics, 15 (6.4%) were majoring in law, and 57 (24.5%) were majoring in engineering. Most participants were of Han ethnicity (79%), with the remaining 21% being of mixed ethnic minority backgrounds. Finally, a statistical power analysis indicated that a sample size of 190 would be needed for power of 0.80 by a Monte Carlo study in a confirmatory factor analysis model (Muthén and Muthén, 2002). Moreover, G∗power 3.1.9.2 (Faul et al., 2009) suggested that a sample size of 35 would be needed to obtain a satisfactory test-retest coefficient (r = 0.70, α = 0.01, 1-β = 0.99) within an interval of time, and a sample size of 100 would be needed to detect a medium effect size (d = 0.5, α = 0.01, 1-β = 0.99) between two times. A final sample size (n = 233) would be used to test the longitudinal properties of the Grit-S over a 3-month interval between the two assessments.
Procedure
The study questionnaires were administered in a classroom setting when participants were attending their classes. All participants provided written consent prior to completing the questionnaire, having been notified of the nature, goal, confidentiality, and anonymity of the study. The present study was approved by the Human Subjects Review Committee at Guizhou Normal University. All participants completed study questionnaires for extra course credit.
Measures
The Short Grit Scale (Grit-S)
The Grit-S (Duckworth and Quinn, 2009) is a brief version of the full Grit-O (Duckworth et al., 2007) developed to measure trait-level perseverance and passion for long-term goals using two factors: consistency of interest (CI; 4-item) and perseverance of effort (PE; 4-item). Each item of the self-reported Grit-S scale is rated on a five-point Likert scale that ranges from 1 (“not at all like me”) to 5 (“very much like me”). The Chinese version of the Grit-S has been validated in adolescents (Wang et al., 2017; Li et al., 2018) and in adults (Zhong et al., 2018). In this present study, the alphas and mean inter-item correlation (MIC) for CI and PE at the two time points were 0.75 (MIC = 0.42)/0.75 (MIC = 0.43) and 0.80 (MIC = 0.49)/0.78 (MIC = 0.48), respectively.
Data Analysis Strategy
Firstly, descriptive statistics of the Grit-S scores were performed with SPSS 22.0 (IBM Corp, 2013). Next, following the previous longitudinal studies (e.g., Wang et al., 2012; Luo et al., 2019), the CFA with Mplus 7 (Muthén and Muthén, 1998–2015) was used to test LMI across time. The proposed two first-order factors structure was seen as a baseline model. In this model, the eight items of the Grit-S assessed separately at Time 1 and Time 2 are loaded on the two factors (i.e., CI: 4 items, and PE: 4 items). Given that the values of the skewness and kurtosis for some items were not the range of −1 to +1, we used a maximum likelihood estimation with a mean-adjusted chi-square (MLM) that was robust to non-normality. A model is judged to have an adequate model fit if the comparative fit index (CFI) and the Tucker–Lewis index (TLI) are each larger than 0.90, and if the root mean square error of approximation (RMSEA) is smaller than 0.08; if CFI and TLI are above 0.95 and RMSEA values are below 0.05, this indicates a good model fit (Hu and Bentler, 1999).
Then, the LMI was tested across time using a set of four nested models by continuously setting the equality of the parameters of the measurement model over time. The configural invariance tests the hypothesis that the same general pattern of factor loadings holds across time (Millsap and Cham, 2012); the metric invariance sets the corresponding factor loadings to be equal across occasions; the scalar invariance requires the corresponding factor loadings and intercepts across time to be set as equal; and the strict invariance sets the corresponding factor loadings, intercepts, and residual variances of items to be equal over time. To evaluate the invariance at each level, a chi-square difference test was computed but not used due to the fact that the chi-square difference test is sensitive to minor parameter changes in large samples (Chen, 2007). Instead, the change in CFI (△CFI) was used, with changes smaller than 0.01 indicating that the more restrictive model and the less restricted model were equivalent (Cheung and Rensvold, 2002; Chen, 2007). Additionally, as recommended by Chen (2007), a change in RMSEA (△RMSEA) of 0.015 or higher suggests an absence of MI.
Next, the reliability assessment of the Grit-S was performed, including measuring the internal consistency and stability coefficient. The Grit-S internal consistency was examined by looking at the two time points individually. According to Barker et al. (1994), alpha coefficients below 0.60 suggest insufficient, 0.60–0.69 indicate marginal, 0.70–0.79 suggest acceptable, 0.80–0.89 indicate good, and above 0.90 indicate excellent. We also inspected the MIC, which are independent of scale lengths and should be in the range of 0.15–0.50 to be considered acceptable (Clark and Watson, 1995). The stability coefficients (correlations between two-time point factors) across time were also calculated by using the strict invariance model to assess the relative stability of the grit trait. Specifically, setting the factor variances to 1 and freely estimating the first factor loading for each factor made the purpose of calculating latent factor correlations.
Finally, on the basis of the LMI, the latent factor means across time were compared to explore the development of the grit trait. More specifically, the latent factor scores were calculated by setting the two grit factors mean to zero at Time 1 and freely estimating the latent factor mean at Time 2.
Results
Descriptive Statistics
Descriptive statistics results for each item at both time points are shown in Table 2, involving the mean, standard deviation, skewness, kurtosis, and corrected item-total correlations (CITC) with each item’s respective factor, as well as the two Grit-S subscales and the total scale. Moreover, the zero-order (observed) correlations between the subscales for the two assessments were 0.22 (Time 1) and 0.10 (Time 2), respectively.
Table 2. Descriptive statistics for the Short Grit Scale at two time points.
Longitudinal Measurement Invariance of the Grit-S
The LMI of the Grit-S across time was calculated using the following steps. First of all, we assessed the fit of the model for each time point separately. All model fit values were adequate for both time points (CFI and TLI > 0.90, RMSEA < 0.08), allowing for further examination of the LMI. As shown in Table 3, the configural model was adequate (CFI = 0.947, TLI = 0.930, and RMSEA = 0.050). The correlations within and between factors for the model are presented in Figure 1.
Table 3. Longitudinal measurement invariance model fit statistics for the Short Grit Scale.
Figure 1. Diagram for the longitudinal configural invariance model. CI-1, consistency of interest at Time 1; PE-1, perseverance of effort at Time 1; CI-2, consistency of interest at Time 2; PE-2, perseverance of effort at Time 2.
Then, the factor loadings were set to be equal across time to test for metric invariance. The metric model fit was satisfactory (CFI = 0.949, TLI = 0.936, and RMSEA = 0.048), and there were inappreciable differences in CFI, TLI, and RMSEA between the configural and metric models (△CFI = 0.002, △TLI = 0.006, and △RMSEA = −0.002). These findings supported the metric invariance of the Grit-S across occasions.
Next, the scalar invariance was examined by placing restrictions on all item intercepts to be equal over time. The scalar model provided satisfactory fit indices (CFI = 0.941, TLI = 0.931, and RMSEA = 0.050) and showed a non-significant change in CFI, TLI, and RMSEA (△CFI = −0.008, △TLI = −0.005, and △RMSEA = 0.002). Thus, the scalar invariance of the Grit-S scores also held over time.
Finally, the item uniqueness was set to be equal to test for strict invariance over time. The fit indices were adequate (CFI = 0.938, TLI = 0.933, and RMSEA = 0.049), with inappreciable differences shown in CFI, TLI, and RMSEA between the scalar and strict models (△CFI = −0.003, △TLI = 0.002, and △RMSEA = −0.001). The strict invariance of the Grit-S scores was therefore supported across time.
In sum, these results suggest that the two-factor solution of the Grit-S had LMI over the 3 months. The standardized factor loadings for the longitudinal invariance model are shown in Table 4.
Table 4. Standardized factor loadings for the longitudinal invariance model of the Grit-S.
Internal Consistency, Stability Coefficients, and Latent Factor Means Across Time
Regarding internal consistency indices, the coefficient αs for the Grit-S factor scores were acceptable (α > 0.70) at each time point in measurement. For the CI factor, the coefficient αs were 0.75 (MIC = 0.42) at Time 1 and 0.75 (MIC = 0.43) at Time 2. For the PE factor, the coefficient αs at the two measurement points were 0.80 (MIC = 0.49) at the baseline and 0.78 (MIC = 0.48) at the follow-up, respectively. Moreover, the stability coefficients (the correlations between the two time point factors) across time were computed using the strict invariance model. The resulting estimated factor correlations between Time 1 and Time 2 were 0.48 for CI and 0.66 for PE (ps < 0.001). Finally, the means of each latent factor at two separate time points could be made meaningfully comparison because the strict longitudinal invariance model was existed. Specifically, the latent means were not significantly different between Time 1 and Time 2 (e.g., CI mean difference = −0.013, p = 0.626; PE mean difference = −0.021, p = 0.524). Overall, these results support the stability of the Grit-S scores.
Discussion
The purpose of the current investigation was to further explore the LMI of the Grit-S (Duckworth and Quinn, 2009), a popular instrument designed to evaluate one’s consistency of interest and PE in measuring one’s level of grit. Although some controversies with the Grit-S remain, we would like to test the longitudinal properties of the Grit-S within the two-factor solution. These findings support that the Grit-S has strict longitudinal invariance, showing equality of factor patterns, factor loadings, item intercepts and item uniqueness for all items over a 3-month interval. Moreover, the internal consistencies, stable coefficients, and latent factor means also provide the support for the stability of the Grit-S scores across time. In summary, our findings replicate and extend prior work (e.g., Duckworth and Quinn, 2009; Schmidt et al., 2017; Zhong et al., 2018) that also support the psychometric properties of Grit-S scores.
Longitudinal Measurement Invariance of the Grit-S
Longitudinal measurement invariance assesses whether the same constructs are measured equally in different time points within a same group to ensure that growth and/or development in observed scores over time can be attributed to actual development and/or changes in the construct under investigation (Dimitrov, 2010; Millsap and Cham, 2012). Despite the fact that the psychometric properties of Grit-S scores have been supported in cross-sectional data (Duckworth and Quinn, 2009; Schmidt et al., 2017; Zhong et al., 2018), not much literature to date has addressed the longitudinal properties of the Grit-S. The present study thus examined the LMI of the Grit-S in young adults.
Similar to previous research which measured Grit-S invariance across gender and age groups (Zhong et al., 2018), the results of this current study show strict longitudinal invariance (specifically configural, metric, scalar, and strict invariance) in Grit-S scores measured across time in each of the eight items that make up the measure, suggesting that the Grit-S does indeed assess grit constructs across different moments in time. This implies that when using the Grit-S at two different time points, the mean differences in grit scores can be considered as being actual changes in an individual’s level of grit. The LMI findings also hold great significance for longitudinal research regarding the Girt-S. For instance, in longitudinal models, the input matrix becomes enormous due to numerous measurement occasions. Item parceling is often conducted to deal with this issue, whereas the use of parcels as indicators may affect MI tests at an item parcel level (Meade and Kroustalis, 2006). Therefore, achieving strict longitudinal invariance of the Grit-S at an item level in the present study supports the allowance of using item parcel sets in longitudinal models. Likewise, the Grit-S LMI is especially relevant for developmental and personality psychologists who are interested in grit. One may focus on the development and growth of one’s level of grit, while the other would be more concerned whether one’s level of grit is relatively stable or changing. Given that, until now, few studies have formally and comprehensively examined the LMI of Grit-S scores, further study on this topic is needed to ascertain the viability of the current findings in various populations (e.g., adolescents).
Internal Consistency, Stable Coefficients, and Latent Factor Means Comparison Over Time
The internal consistency values over time also offered some meaningful information regarding the stability for Grit-S scores. Similar to cross-sectional investigations (Duckworth and Quinn, 2009; Nishikawa et al., 2015; Sarıçam et al., 2015; Li et al., 2018; Zhong et al., 2018), the coefficient αs of the Grit-S factor scores were acceptable over time, and the MIC values were adequate in the current study. Overall, our findings demonstrate that Grit-S scores have satisfactory and acceptable internal consistency indices over different periods of time.
In addition, the stability coefficients over time were computed with the LMI. More specifically, the stable coefficients that involved latent factor correlations between Time 1 and Time 2 were moderate (rs ranging from 0.48 to 0.66). Comparable with manifest factor correlations (Duckworth and Quinn, 2009; Li et al., 2018), the latent factor correlations also suggest that grit is somewhat stable over different measurement occasions (Duckworth et al., 2007; Duckworth and Quinn, 2009). Likewise, it is noteworthy that the test-retest reliability (particularly for consistency of interest) was not satisfactory in comparison to the rank-order consistencies found within other personality traits in young adulthood (e.g., Roberts and DelVecchio, 2000; Robins et al., 2001). In sum, our findings preliminarily support some stability (especially for PE) but also point to rank-level changes in the grit scores across the 3 months.
Finally, considering that the LMI of the Grit-S is supported, further comparisons of the latent factor means make us obtain more meaningful information. In the sample used for this study, both two grit factors (e.g., consistency of interest and PE) were not significantly different between Time 1 and Time 2. According to Duckworth et al. (2007), an important predictor of success and performance is a personality trait termed as grit, and the grit construct is defined as trait-level perseverance and a passion for long-term goals. It has been suggested that personality traits such as grit describe tendencies to act, think, and feel that are relatively stable across time (Duckworth et al., 2007; Duckworth and Quinn, 2009). Despite the fact that studies into longitudinal differences in grit are rare, our findings indicate the importance of considering both perseverance and passion for long-term goals within different contexts. Future research should examine changes in individual- and population-reported grit across time.
Limitations and Future Directions
The findings from this study should be considered in light of its limitations. First, the participants in the present study were recruited predominantly from Southwest China, so the results may not be appropriate for other geographic regions or cultures; more research should replicate our findings in other Chinese regions. Second, we only tested the LMI of Grit-S scores over a 3-month interval; future research should test the longitudinal invariance of the Grit-S over a longer time interval. Finally, the current investigation examined longitudinal invariance of the Grit-S in young adults; future studies should test the Grit-S LMI in other populations (e.g., adolescents).
In general, the present study expands our perception of the longitudinal properties of the Grit-S measure. Moreover, we would stress that LMI is an important psychometric property of the Grit-S, particularly when it is administered in longitudinal studies looking into how grit might predict success and performance. Future work should pay further attention to this property of the Grit-S.
Data Availability Statement
The datasets generated for this study are available on request to the corresponding authors.
Ethics Statement
The studies involving human participants were reviewed and approved by The Human Subjects Review Committee at Guizhou Normal University. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
JL, WC, and SX contributed to the investigation, analysis of the data, and drafted the manuscript. M-CW and YG helped to perform the revision of the manuscript, and provided final approval for the manuscript.
Funding
This study was supported by the Guizhou Philosophy and Social Science Planning General Project (18GZYB57), as well as the Guizhou Science and Technology Project (LH [2016] 7227) and the Key Project of Key Research Base for Humanities and Social Sciences of Chongqing (13SKB016).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Arco-Tirado, J. L., Fernández-Martín, F. D., and Hoyle, R. H. (2018). Development and validation of a Spanish version of the Grit-S scale. Front. Psychol. 9:96. doi: 10.3389/fpsyg.2018.00096
Barker, C., Pistran, N., and Elliot, R. (1994). Research Methods in Clinical and Counselling Psychology. Chichester: Wiley.
Byrne, B. M., and Watkins, D. (2003). The issue of measurement invariance revisited. J. Cross Cult. Psychol. 34, 155–175. doi: 10.1177/0022022102250225
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Modeling 14, 464–504. doi: 10.1080/10705510701301834
Chen, F. F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. J. Personal. Soc. Psychol. 95, 1005–1018. doi: 10.1037/a0013193
Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Modeling 9, 233–255. doi: 10.1207/s15328007sem0902_5
Clark, L. A., and Watson, D. (1995). Constructing validity: basic issues in objective scale development. Psychol. Assess. 7, 309–319. doi: 10.1037/1040-3590.7.3.309
Credé, M. (2018). What shall we do about grit? A critical review of what we know and what we don’t know. Educ. Res. 47, 606–611. doi: 10.3102/0013189X18801322
Credé, M. (2019). Total grit scale score does not represent perseverance. Proc. Natl. Acad. Sci. U.S.A. 116:3941. doi: 10.1073/pnas.1816934116
Credé, M., Tynan, M. C., and Harms, P. D. (2017). Much ado about grit: a meta-analytic synthesis of the grit literature. J. Pers. Soc. Psychol. 113, 492–511. doi: 10.1037/pspp0000102
Datu, J. A. D., Valdez, J. P. M., and King, R. B. (2016). Perseverance counts but consistency does not! validating the Short Grit Scale in a collectivist setting. Curr. Psychol. 35, 121–130. doi: 10.1007/s12144-015-9374-2
Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Meas. Eval. Couns. Dev. 43, 121–149. doi: 10.1177/0748175610373459
Disabato, D. J., Goodman, F. R., and Kashdan, T. B. (2018). Is grit relevant to well-being and strengths? Evidence across the globe for separating perseverance of effort and consistency of interests. J. Personal. 87, 194–211. doi: 10.1111/jopy.12382
Duckworth, A. L., and Gross, J. J. (2014). Self-control and grit: related but separable determinants of success. Curr. Dir. Psychol. Sci. 23, 319–325. doi: 10.1177/0963721414541462
Duckworth, A. L., Kirby, T. A., Tsukayama, E., Berstein, H., and Ericsson, K. A. (2011). Deliberate practice spells success: why grittier competitors triumph at the national spelling bee. Soc. Psychol. Personal. Sci. 2, 174–181. doi: 10.1177/1948550610385872
Duckworth, A. L., Peterson, C., Matthews, M. D., and Kelly, D. R. (2007). Grit: perseverance and passion for long-term goals. J. Personal. Soc. Psychol. 92, 1087–1101. doi: 10.1037/0022-3514.92.6.1087
Duckworth, A. L., and Quinn, P. D. (2009). Development and validation of the Short Grit Scale (Grit-S). J. Pers. Assess. 91, 166–174. doi: 10.1080/00223890802634290
Duckworth, A. L., Quinn, P. D., and Seligman, M. E. P. (2009). Positive predictors of teacher effectiveness. J. Posit. Psychol. 4, 540–547. doi: 10.1080/17439760903157232
Eskreis-Winkler, L., Shulman, E. P., Beal, S. A., and Duckworth, A. L. (2014). The grit effect: predicting retention in the military, the workplace, school and marriage. Front. Psychol. 5:36. doi: 10.3389/fpsyg.2014.00036
Faul, F., Erdfelder, E., Buchner, A., and Lang, A. (2009). Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160. doi: 10.3758/BRM.41.4.1149
Guo, J., Tang, X., and Xu, K. M. (2019). Capturing the multiplicative effect of perseverance and passion: measurement issues of combining two grit facets. Proc. Natl. Acad. Sci. U.S.A. 116, 3938–3940. doi: 10.1073/pnas.1820125116
Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modeling 6, 1–55. doi: 10.1080/10705519909540118
Ivcevic, Z., and Brackett, M. (2014). Predicting school success: comparing conscientiousness, grit, and emotion regulation ability. J. Res. Personal. 52, 29–36. doi: 10.1016/j.jrp.2014.06.005
Jachimowicz, J. M., Wihler, A., Bailey, E. R., and Galinsky, A. D. (2018). Why grit requires perseverance and passion to positively predict performance. Proc. Natl. Acad. Sci. U.S.A. 115, 9980–9985. doi: 10.1073/pnas.1803561115
Jachimowicz, J. M., Wihlerb, A., Baileya, E. R., and Galinskya, A. D. (2019). Grit-S scale measures only perseverance, not passion, and its supposed subfactors are merely artifactors. Proc. Natl. Acad. Sci. U.S.A. 116, 3942–3944. doi: 10.1073/pnas.1821668116
Kline, R. B. (2011). Principles and Practices of Structural Equation Modeling, 3rd Edn. New York, NY: Guilford Press.
Li, J., Zhao, Y., Kong, F., Du, S., Yang, S., and Wang, S. (2018). Psychometric assessment of the Short Grit Scale among Chinese adolescents. J. Psychoeduc. Assess. 36, 291–296. doi: 10.1177/0734282916674858
Luo, J., Wang, X., Wang, M.-C., Zhang, X., Deng, J., Zhong, C., et al. (2019). Longitudinal measurement invariance of the child problematic trait inventory in older Chinese children. PLoS One 14:e0219136. doi: 10.1371/journal.pone.0219136
Meade, A. W., and Kroustalis, C. M. (2006). Problems with item parceling for confirmatory factor analytic tests of measurement invariance. Organ. Res. Methods 9, 369–403. doi: 10.1177/1094428105283384
Millsap, R. E., and Cham, H. (2012). “Investigating factorial invariance in longitudinal data,” in Handbook of Developmental Research Methods, eds B. Laursen, T. D. Little, and N. A. Card (New York, NY: Guilford Press), 109–127.
Muthén, L. K., and Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Struct. Equ. Modeling 9, 599–620. doi: 10.1207/S15328007SEM0904_8
Muthén, L. K., and Muthén, B. O. (1998–2015). Mplus User’s Guide, 7th Edn. Los Angeles, CA: Muthén and Muthén
Nishikawa, K., Okugami, S., and Amemiya, T. (2015). Development of the Japanese Short Grit Scale (Grit-S). Jpn. J. Personal. 24, 167–169.
Rimfeld, K., Kovas, Y., Dale, P. S., and Plomin, R. (2016). True grit and genetics: predicting academic achievement from personality. J. Personal. Soc. Psychol. 111, 780–789. doi: 10.1037/pspp0000089
Roberts, B. W., and DelVecchio, W. F. (2000). The rank-order consistency of personality traits from childhood to old age: a quantitative review of longitudinal studies. Psychol. Bull. 126, 3–25. doi: 10.1037/10.1037/0033-2909.126.1.3
Robins, R. W., Fraley, R. C., Roberts, B. W., and Trzesniewski, K. H. (2001). A longitudinal study of personality change in young adulthood. J. Personal. 69, 617–640. doi: 10.1111/1467-6494.694157
Sarıçam, H., Çelik, İ, and Oǧuz, A. (2015). Kısa Azim (Sebat) Ölçeǧinin Türkçeye Uyarlanması: Geçerlik ve Güvenirlik Çalıs̨ması-Turkish Adaptation of the Short Grit Scale (Grit-S): Validity and Reliability Study. Ankara: The International Congress on Curriculum and Instruction.
Schmidt, F. T. C., Fleckenstein, J., Retelsdorf, J., Eskreis-Winkler, L., and Möller, J. (2017). Measuring grit: a German validation and a domain-specific approach to grit. Eur. J. Psychol. Assess. 35, 436–447. doi: 10.1027/1015-5759/a000407
Schmidt, F. T. C., Nagy, G., Fleckenstein, J., Möller, J., and Retelsdorf, J. (2018). Same same, but different? Relations between facets of conscientiousness and grit. Eur. J. Personal. 32, 705–720. doi: 10.1002/per.2171
Tyumeneva, Y., Kardanova, E., and Kuzmina, J. (2017). Grit: two related but independent constructs instead of one. Evidence from item response theory. Eur. J. Psychol. Assess. 35, 469–478. doi: 10.1027/1015-5759/a000424
Vazsonyi, A. T., Ksinan, A. J., Jiskrova, G., Mikuška, J., Javakhishvili, M., and Cui, G. (2018). To grit or not to grit, that is the question! J. Res. Personal. 78, 215–226. doi: 10.1016/j.jrp.2018.12.006
Wang, M.-C., Elhai, J. D., Dai, X., and Yao, S. (2012). Longitudinal invariance of posttraumatic stress disorder symptoms in adolescent earthquake survivors. J. Anxiety Disor. 26, 263–270. doi: 10.1016/j.janxdis.2011.12.009
Wang, S., Zhou, M., Chen, T., Yang, X., Chen, G., Wang, M., et al. (2017). Grit and the brain: spontaneous activity of the dorsomedial prefrontal cortex mediates the relationship between the trait grit and academic performance. Soc. Cogn. Affect. Neurosci. 12, 452–460. doi: 10.1093/scan/nsw145
Werner, K. M., Milyavskaya, M., Klimo, R., and Levine, S. L. (2019). Examining the unique and combined effects of grit, trait self-control, and conscientiousness in predicting motivation for academic goals: a commonality analysis. J. Res. Personal. 81, 168–175. doi: 10.1016/j.jrp.2019.06.003
Wyszyńska, P., Ponikiewska, K., Karaś, D., Najderska, M., and Rogoza, R. (2017). Psychometric properties of the Polish version of the Short Grit Scale. Pol. Psychol. Bull. 48, 229–236. doi: 10.1515/ppb-2017-0026
Keywords: longitudinal measurement invariance, personality trait, grit, Grit-S, Chinese young adults
Citation: Luo J, Wang M-C, Ge Y, Chen W and Xu S (2020) Longitudinal Invariance Analysis of the Short Grit Scale in Chinese Young Adults. Front. Psychol. 11:466. doi: 10.3389/fpsyg.2020.00466
Received: 15 August 2019; Accepted: 27 February 2020;
Published: 24 March 2020.
Edited by:
Holmes Finch, Ball State University, United StatesCopyright © 2020 Luo, Wang, Ge, Chen and Xu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Meng-Cheng Wang, d21jaGVuZzIwMDZAMTI2LmNvbQ==; Ying Ge, Z3k4NjIwQDE2My5jb20=