Dimensionality of the Mental Toughness Questionnaire (MTQ48)

Currently there is debate as to whether mental toughness is a unidimensional or multidimensional construct. To investigate the dimensionality of the Mental Toughness Questionnaire 48-items (MTQ48), a widely used measure of mental toughness, we examined data from a sample of 78,947 participants. A series of exploratory structural equation models (ESEM) assessed unidimensional, multidimensional, and bifactor solutions. Overall, results supported a bifactor conceptualization of mental toughness. Bifactor analysis was consistent with the use of a general factor score. In conclusion, the authors argue that mental toughness should be considered as an umbrella term representing a general trait comprised of related constructs that provide a psychological advantage in performance and promote positive mental health. Finally, this article identifies limitations in the existing measurement of mental toughness and proposes necessary directions in future research.

Introduction

Mental toughness (MT) has been conceptualized as the possession of enabling experientially developed and heritable psychological resources (i.e., values, attitudes, emotions, cognitions, and behaviors) that facilitate achievement and promote positive mental health (Coulter et al., 2010; Papageorgiou et al., 2019a,b). More precisely, researchers regard MT as a positive psychological construct, which has important real-world applications. Notably, Clough et al. (2002) delimit MT as the capability to cope with difficulties and to achieve self-defined aims. This conceptualization derives from the notion that MT is a resistance resource that guards against the negative effects of stress across a range of contexts (i.e., sport, education, occupational, and health) (Crust and Keegan, 2010; Lin et al., 2017; Papageorgiou et al., 2019a).

Noting these points, Gucciardi (2017, p. 18) operationalized MT as, “a state-like psychological resource that is purposeful, flexible, and efficient in nature for the enactment and maintenance of goal-directed pursuits.” Collectively, MT delineations reflect the core assumptions that the construct represents an aggregation of personal resources, resides within the individual, is continuous, and helps individuals to deal with everyday hassles and major life events (Gucciardi et al., 2015).

The most widely used instrument to measure MT is the Mental Toughness Questionnaire-48 (MTQ48; Clough et al., 2002; Birch et al., 2017). This developed from Clough’s multidimensional 4Cs model, which posits the existence of discrete, but related factors (i.e., Challenge, Commitment, Control, and Confidence) (Clough and Strycharczyk, 2012). Challenge refers to the extent that individuals perceive barriers and tests as opportunities for self-development. Commitment denotes persistence and the ability to carry out tasks successfully. Control designates the degree to which an individual believes they have influence over their life. Lastly, Confidence represents self-belief in abilities, particularly the capacity to successfully complete tasks.

The 4Cs model draws upon elements of hardiness (Challenge, Commitment, and Control) (Kobasa, 1979). These encourage resilience by motivating coping and social interaction (Maddi and Kobasa, 1984). In recognition of the physical and mental demands of competitive sport, Clough et al. (2002) added Confidence to the hardiness factors. The inclusion of this additional dimension gave Clough’s model a sport-specific (performance-based) focus (Birch et al., 2017).

The Control and Confidence dimensions incorporate nested, subdivided components. In the case of Control, this comprises consideration of emotions and life. For Confidence, this encompasses belief in personal abilities, and capabilities related to dealing with social situations and interactions. As the MTQ48 derives directly from the 4C/6C model, the scale’s performance provides tangible insights into the validity of Clough’s abstraction of MT (see Birch et al., 2017). A review of the relevant literature reveals that psychometric evaluation of the MTQ48 has produced mixed results (Gucciardi, 2018).

Several studies have provided support for the 4C’s across various contexts (Perry et al., 2013, 2015). For example, education (St Clair-Thompson et al. 2014/2017), and health (Gerber et al., 2013). Specifically, Perry et al. (2013) using senior managers, lower and middle managers, clerical/administrative workers, athletes, and students supported the factorial validity of the MTQ48. This sample represented the full domain of possible MT expressions. Following analysis, Perry et al. (2013) concluded that the MTQ48 was a robust psychometric instrument.

An area of concern was the Emotional Control subscale, which demonstrated weak factor loadings and poor internal consistency. Despite this, Perry et al. (2013) advocated cautious retention of the subscale because Emotional Control is an important component of MT. This requires assessing the internal consistency of the emotion subscale prior to analysis. These findings, alongside the results of criterion related validity, indicated that the 4Cs was a valid conceptualization of MT. From the perspective of the MTQ48, the measure requires regular monitoring, item/scale reduction and/or item refinement.

Vaughan et al. (2018) observed acceptable MTQ48 internal consistency at the total and subscale levels using a sample comprising cross elite, amateur, and non-athletes. Evaluation of model fit indicated that the six-factor model possessed acceptable levels of fit, whilst the four-factor model did not fit data well. Within the six-factor model, there were large degrees of misspecification in the factor structures across elite, amateur, and non-athletes. Overall, results cautioned against the use of the measure with elite athletes and suggested that refinement of the MTQ48 at the subscale level was required.

Moreover, other studies have failed to reproduce the 4C solution, and accordingly questioned its appropriateness (Gucciardi et al. 2012/2013). Concerns center on the model’s robustness. Explicitly, fit (i.e., poorly loading items) and applicability to specific samples. Illustratively, confirmatory factor analysis and exploratory structural equation modeling have failed to produce good data fit in athlete and workplace samples (Gucciardi et al., 2012). With misfit evident at local (pattern of factor loadings) and global (model-data congruence) levels. These findings suggest incongruence between the MTQ48 and measurement of the underlying theoretical model. Noting this outcome, Gucciardi et al. (2012) concluded that the MTQ48 might not be a valid measure of MT with student athletes. Based on these observations and further research, Gucciardi et al. (2015) contends that MT is a unidimensional, rather than multidimensional concept.

This notion has proved contentious because other researchers have found evidence for multidimensionality (Perry et al., 2013; Vaughan et al., 2018). Although, they do recommend refinement of the MTQ48 at subscale level. Placing too much emphasis on parsimonious model fit produces a much narrower, unidimensional conceptualization. Whilst this approach has advantages, notably factorial validity, and brevity, it also possesses important disadvantages. Specifically, shorter scales are less sensitive and demonstrate weakened ability to discriminate. This can result in a flatter distribution (Perry et al., 2020). Furthermore, at a practical level the multidimensional approach presents greater potential for applied use, as practitioners can identify individual components of MT to develop. However, in some specific circumstances, an overall, abridged measure can prove useful since it places fewer demands on respondents. This is particularly the case in research that uses a battery of questionnaires.

Using a large sample, this study definitively examined the dimensionality of the MTQ48 and proposed necessary developments. The authors also considered the merits of a bifactor model, whereby MTQ48 items contribute to both subscales and overall representation of MT.

Methods

Participants

A sample of 78,947 participant responses were analyzed. Gender was fairly equally split (male = 30,597, 38.76%; female = 28,801, 36.48%; unspecified = 19,549, 24.76%). Age ranged from 11 to 83 (M = 35.33, SD = 11.12). Data from over 20 nationalities was included. All responses were in English. Occupations ranged from school through to retired individuals. Most of the sample were middle or senior managers, who completed the measure as part of individual coaching.

Measures

The MTQ48 (Clough et al., 2002) was used to measure mental toughness. This contains 48-items, which require a response on a five-point Likert-type scale anchored from 1 (strongly disagree) to 5 (strongly agree).

Procedure

Participants completed the MTQ48 online between 2014 and 2017. Ethical approval for all data collection was obtained from a departmental ethics committee a United Kingdom higher education institution.

Data Analysis

Preliminary analyses screened data for missing values and outliers prior to examining distributions. To estimate internal consistency, the authors calculated omega estimates. Main analyses examined a series of structural models using Mplus 8.6 (Muthén and Muthén, 1998-2017). The robust maximum likelihood (MLR) estimator was used throughout. These included unidimensional, multidimensional, and bifactor solutions. Only the six-factor model (not the four-factor) model were explored as part of the multidimensional model, as previous support for this has been unequivocal (e.g., Perry et al., 2013). The unidimensional model includes all 48 items as indicators of an overall MT score.

Within the multidimensional model, the six MTQ factors (Challenge, Commitment, Emotional Control, Life Control, Confidence in Abilities, and Interpersonal Confidence) were postulated as latent variables in an exploratory structural equation model (ESEM; Asparouhov and Muthén, 2009) with target rotation. ESEM models specify that all observed variables (item responses in this case) load onto all latent variables (factors). This is advantageous over traditional methods, such as confirmatory factor analysis with independent cluster models (CFA-ICM), as it does not recognize non-significant cross-loadings as misspecifications (Marsh et al., 2004).

Previous research indicates that ESEM is a more appropriate method for assessing factorial validity in complex models with several factors (Perry et al., 2015). Target rotation designates that “targeted” cross-loadings but not forced (as they would in CFA-ICM) to be zero (Browne, 2001). This method outperforms the default geomin rotation for accuracy in Monte Carlo samples (Myers et al., 2016). As noted by Marsh et al. (2014), the target rotation method is particularly appropriate when ESEM is used in a more confirmatory context, such as when there is a clearly defined a priori factor structure.

Analysis next tested a series of increasingly constrained multigroup CFAs evaluated measurement invariance for gender and age. Practitioners often enquire about this information and the large sample provided an opportune moment to test this. This involved four stages. The first assessed configural invariance by replicating the model across groups. The second evaluated metric variance by constraining factor loadings. The third tested scalar invariance by constraining factor loadings and intercepts. Finally, the fourth stage examined residual invariance by constraining factor loadings, item intercepts, and factor means. The assumption of measurement invariance derived from the observation of little or no change (ΔCFI ≤ 0.01; Cheung and Rensvold, 2002) on the increasingly constrained models.

Finally, a bifactor model examined whether it was appropriate to assess simultaneously the composite parts of MT and overall MT. Hence, this solution necessitated the inclusion of a seventh, general factor upon which all items loaded in addition to their loading onto component factors.

Each model fit was assessed via several fit indices. Explicitly, the comparative fit index (CFI) and the Tucker-Lewis index (TLI) functioned as incremental indices and the standardized root-mean-square residual (SRMR) and root-mean square error of approximation (RMSEA) served as absolute fit indices. We cautiously adopted Hu and Bentler’s (1999) recommendations of acceptable fit approaching.95 for incremental fit indices and close to.05 for absolute fit indices. Consistent with the advice of several authors these rules of thumb acted as guidelines rather than definitive criteria (e.g., Marsh et al., 2004; Perry et al., 2015). Regarding parameter estimates, standardized loadings < 0.30 were negligible.

Results

Preliminary analysis found < 0.1% missing data and no concerning outliers. Owing to the large sample size, normality estimates were very close to zero (skew < 1, kurt < 1). Internal consistency estimates were all satisfactory (ω > 0.70) except for Emotional Control (ω = 0.63). This is consistent with previous literature examining the MTQ48 (e.g., Perry et al., 2013).

The first model tested was the unidimensional model. The model demonstrated poor fit, χ²(1,080) = 245513.46, CFI = 0.663, TLI = 0.648, SRMR = 0.058, RMSEA = 0.054 [90% CI = 0.053, 0.054]. However, 43 of the 48 items loaded satisfactorily (>0.30). The high modification indices indicate that it would be quite simple to produce a short unidimensional scale with good fit from this data. Next, analysis tested the multidimensional, six-factor model. The resultant model fit provided reasonable support for this factor structure, χ²(855) = 71233.41, CFI = 0.903, TLI = 0.872, SRMR = 0.021, RMSEA = 0.032 [90% CI = 0.032, 0.032]. Examination of factor loadings identified that 30 of the items presented satisfactory loading on their respective scale (Table 1), however, this was not consistent across all factors.

TABLE 1

Table 1. Factor loadings for multidimensional model with target rotation.

Specifically, the interpersonal Confidence factor performed the best, with all items loading satisfactorily and no items presenting substantive cross-loadings onto other scales. The Commitment scale had eight satisfactory loadings and three < 0.30. Three of the items from this scale loaded also onto the Challenge scale. Slightly over 50% of items presented satisfactory loadings on the Emotional Control, Life Control, and Confidence in Abilities factors and on each of these factors, there were two non-negligible cross-loadings. The Challenge scale performed the worst, as five of the eight loadings were < 0.30.

Given the equivocal findings of previous studies examining the factor structure of the MTQ48, further analysis assessed whether model fit was replicated across random subsamples. Thus, the original sample was randomly divided into 50 subsamples of 1,578 and the same bifactor ESEM with target rotation applied. The results (Supplementary Table 1) presented highly consistent findings for both incremental fit indices (CFI = 0.912–0.951, TLI = 0.878–0.933) and absolute fit indices (SRMR = 0.025–0.020, RMSEA = 0.037–0.025).

Next analysis tested measurement invariance for gender and age using the bifactor model. For age, we defined the following groups: < 21 (n = 1,531), 21–30 (n = 16,508), 31–40 (n = 13,482), 41–50 (n = 12,552), > 50 (n = 7,101). There were 27,764 (35.20%) with age unspecified. Measurement invariance was supported across gender and age (Table 2) indicating that the obtained outcomes were comprehensive and broadly applicable in research and practice. Further, measurement invariance was tested for gender and supported (Metric ΔCFI < 0.01 = 87.50%; Scalar ΔCFI < 0.01 = 97.50%; Residual ΔCFI = 95.00%) in the 50 subsamples (Supplementary Table 2).

TABLE 2

Table 2. Measurement invariance testing for bifactor model by gender and age.

The bifactor model produced a stronger model fit than the multidimensional model, χ²(813) = 58216.35, CFI = 0.934, TLI = 0.909, SRMR = 0.018, RMSEA = 0.030 [90% CI = 0.030, 0.030]. Factor loadings were significantly larger on the general factor than the subscale factors (Table 3). To further investigate the bifactor model, the authors calculated hierarchical omega and subscale omega to determine the relative variance explained by the general factor and composite subscales, adopting the recommendations of Rodriguez et al. (2016). Explained common variance (ECV) by the general factor (0.72) and its associated hierarchical omega (ωH = 0.89) suggest unidimensionality, as does the relative omega value (0.96), which represents the proportion of variance in the multidimensional composite due to the general factor (Dueber, 2017). Explained common variance, hierarchical omega estimates, and relative omega for subscales are presented in Supplementary Table 3. Relative omega for the subscales were substantively different, as Interpersonal Confidence and Emotional Control accounted for greater variance than Commitment.

TABLE 3

Table 3. Factor loadings for bifactor model with target rotation.

Discussion

Building on preceding work, this study further examined the dimensionality of the MTQ48. This was necessary because previous research has produced inconsistent solutions. The current findings supported a bifactor model, indicating the presence of both multi-dimensionality and an underlying general factor. This factor, however, did not account for more variance than the discrete 6Cs. These outcomes advise that the MTQ48 provides valid measurements at both multi and unidimensional levels. Specifically, in applied settings, where factor scores provide nuanced suggestions for personal development, and in academic research using overall scores.

Commensurate with these outcomes, subsequent scale development should continue to assess the relative contribution of subscale scores to global mental toughness (MT). This approach is consistent with the need to regular assess scale dimensionality and refine subscale items (e.g., Emotional Control scale). Indeed, this work is ongoing and will be reported shortly. Ultimately, the authors encourage researchers to focus on producing an improved measure of MT, rather than merely focusing on further investigation of MTQ48 factor structure. This advocacy reflects the fact that psychometric tests need systematic review as understanding of psychological concepts evolves and advances.

A limitation of the present study is that the MTQ48 was designed to assess MT as a multidimensional construct. It is therefore not possible to make claims about MT as operationalized differently by alternative psychometric measures. While the scale and breadth of the sample is a potential strength of the current study, a second limitation is the broad range of individuals within the sample. It is, however, anticipated that by utilizing a very large sample, containing a range of demographic representation, more robust and practically useful models were produced.

In conclusion, the results presented here provide general support for the factorial validity of the MTQ48, particularly with regards to a bifactor model, but highlights specific needs for modification. Firstly, a small number of items require replacing. Secondly, if the scale is to function as a multidimensional scale in practice, a greater distinction between the constructs is required, particularly where ECV is low (i.e., Commitment). Moreover, the recent increase in interest in mental toughness in a broad range of domains, including education, health, sport and business, emphasizes the importance of establishing robust measures and models of mental toughness in light of its increasing prominence.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Manchester Metropolitan University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JP, PC, and DS designed the study. PC and JP were main authors. JP conducted all analyses. DS organized data collection. ND, AD, and KP advised on manuscript contents and contributed to writing and reviewing of drafts. All authors contributed to the article and approved the submitted version.

Funding

The publication fees for this manuscript were provided by the Mary Immaculate College.

Conflict of Interest

DS was Managing Director of AQR International, who distribute the MTQ48.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.654836/full#supplementary-material

References

Asparouhov, T., and Muthén, B. (2009). Exploratory structural equation modeling. Struct. Equ. Modeling 16, 397–438. doi: 10.1080/10705510903008204

CrossRef Full Text | Google Scholar

Birch, P. D. J., Crampton, S., Greenlees, I., Lowry, R., and Coffee, P. (2017). The mental toughness questionnaire-48: a re-examination of factorial validity. Int. J. Sport Psychol. 48, 331–355.

Google Scholar

Browne, M. W. (2001). An overview of analytic rotation in exploratory factor analysis. Multivariate Behav. Res. 36, 111–150. doi: 10.1207/S15327906MBR3601_05

CrossRef Full Text | Google Scholar

Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for measurement invariance. Struct. Equ. Modeling 9, 233–255. doi: 10.1207/S15328007SEM0902_5

PubMed Abstract | CrossRef Full Text | Google Scholar

Clough, P. J., and Strycharczyk, D. (2012). Developing Mental Toughness: Improving Performance, Wellbeing and Positive Behaviour in Others. London: Kogan Page.

Google Scholar

Clough, P., Earle, K., and Sewell, D. (2002). “Mental toughness: the concept and its measurement,” in Solutions in Sport Psychology, ed. I. Cockerill (London: Thomson), 32–43.

Google Scholar

Coulter, T., Mallett, C. J., and Gucciardi, D. F. (2010). Understanding mental toughness in Australian soccer: perceptions of players, parents, and coaches. J. Sports Sci. 28, 699–716. doi: 10.1080/02640411003734085

PubMed Abstract | CrossRef Full Text | Google Scholar

Crust, L., and Keegan, R. (2010). Mental toughness and attitudes to risk-taking. Pers. Individ. Differ. 49, 164–168. doi: 10.1016/j.paid.2010.03.026

CrossRef Full Text | Google Scholar

Dueber, D. M. (2017). Bifactor Indices Calculator: A Microsoft Excel-Based Tool to Calculate Various Indices Relevant to Bifactor CFA Models. Kentucky: University of Kentucky.

Google Scholar

Gerber, M., Kalak, N., Lemola, S., Clough, P. J., Perry, J. L., Pühse, U., et al. (2013). Are adolescents with high mental toughness levels more resilient against stress? Stress Health 29, 164–171. doi: 10.1002/smi.2447

PubMed Abstract | CrossRef Full Text | Google Scholar

Gucciardi, D. F. (2018). Commentary: mental toughness and individual differences in learning, educational and work performance, psychological well-being, and personality: a systematic review. Front. Psychol. 8:2329. doi: 10.3389/fpsyg.2017.02328

PubMed Abstract | CrossRef Full Text | Google Scholar

Gucciardi, D. F., Hanton, S., and Mallett, C. J. (2012). Progressing measurement in mental toughness: a case example of the mental toughness questionnaire 48. Sport Exerc. Perform. Psychol. 1, 194–214. doi: 10.1037/a0027190

CrossRef Full Text | Google Scholar

Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., and Temby, P. (2015). The concept of mental toughness: tests of dimensionality, nomological network, and traitness. J. Pers. 83, 26–44. doi: 10.1111/jopy.12079

PubMed Abstract | CrossRef Full Text | Google Scholar

Gucciardi, D., Hanton, S., and Mallett, C. (2013). Progressing measurement in mental toughness: a response to clough, earle, perry and crust. Sport Exerc. Perform. Psychol. 2, 157–172. doi: 10.1037/spy0000002

CrossRef Full Text | Google Scholar

Gucciardi, F. (2017). Mental toughness: progress and prospects. Curr. Opin. Psychol. 16, 17–23. doi: 10.1016/j.copsyc.2017.03.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Hu, L., and Bentler, P. M. (1999). Cut-off criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Modelling 6, 1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

Kobasa, S. C. (1979). Stressful life events, personality, and health: an inquiry into hardiness. J. Pers. Soc. Psychol. 37, 1–11. doi: 10.1037/0022-3514.37.1.1

PubMed Abstract | CrossRef Full Text | Google Scholar

Lin, Y., Mutz, J., Clough, P. J., and Papageorgiou, K. A. (2017). Mental toughness and individual differences in learning, educational and work performance, psychological well-being, and personality: a systematic review. Front. Psychol. 8:1345. doi: 10.3389/fpsyg.2017.01345

PubMed Abstract | CrossRef Full Text | Google Scholar

Maddi, S. R., and Kobasa, S. C. (1984). The Hardy Executive: Health and Stress. Homewood, IL: Dow Jones-Irwin.

Google Scholar

Marsh, H. W., Hau, K. T., and Wen, Z. (2004). In search of golden rules: comment on hypothesis testing approaches to setting cut-off values for fit indexes and dangers in over-generalising Hu & Bentler’s (1999) findings. Struct. Equ. Modeling 11, 320–341. doi: 10.1207/s15328007sem1103_2

CrossRef Full Text | Google Scholar

Marsh, H. W., Morin, A. J. S., Parker, P. D., and Kaur, G. (2014). Exploratory structural equation modeling: an integration of the best features of exploratory and confirmatory factor analysis. Annu. Rev. Clin. Psychol. 10, 85–110. doi: 10.1146/annurev-clinpsy-032813-153700

PubMed Abstract | CrossRef Full Text | Google Scholar

Muthén, B. O., and Muthén, L. K. (1998-2017). Mplus User’s Guide, Eigth Edn. Los Angeles, CA: Muthén & Muthén.

Google Scholar

Myers, N. D., Jin, Y., Ahn, S., Celimli, S., and Zopluoglu, C. (2016). Rotation to a partially specified target matrix in exploratory factor analysis in practice. Behav. Res. Methods 47, 494–505. doi: 10.3758/s13428-014-0486-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Papageorgiou, K. A., Denovan, A., and Dagnall, N. (2019a). The positive effect of narcissism on depressive symptoms through mental toughness: narcissism may be a dark trait but it does help with seeing the world less grey. Eur. Psychiatry 55, 74–79. doi: 10.1016/j.eurpsy.2018.10.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Papageorgiou, K. A., Gianniou, F. M., Wilson, P., Moneta, G. B., Bilello, D., and Clough, P. J. (2019b). The bright side of dark: exploring the positive effect of narcissism on perceived stress through mental toughness. Pers. Individ. Differ. 139, 116–124. doi: 10.1016/j.paid.2018.11.004

CrossRef Full Text | Google Scholar

Perry, J. L., Clough, P. J., Crust, L., Earle, K., and Nicholls, A. R. (2013). Factorial validity of the mental toughness questionnaire-48. Pers. Individ. Differ. 54, 587–592. doi: 10.1016/j.paid.2012.11.020

CrossRef Full Text | Google Scholar

Perry, J. L., Nicholls, A. R., Clough, P. J., and Crust, L. (2015). Assessing model fit: caveats and recommendations for confirmatory factor analysis and exploratory structural equation modeling. Meas. Phys. Educ. Exerc. Sci. 19, 12–21. doi: 10.1080/1091367X.2014.952370

CrossRef Full Text | Google Scholar

Perry, J. L., Temple, E., Worrell, F. C., Zivkovic, U., Mello, Z. R., Musil, B., et al. (2020). Different version, similar result? A critical analysis of the multiplicity of shortened versions of the zimbardo time perspective inventory. Sage Open 10:2158244020923351. doi: 10.1177/2158244020923351

CrossRef Full Text | Google Scholar

Rodriguez, A., Reise, S. P., and Haviland, M. G. (2016). Applying bifactor statistical indices in the evaluation of psychological measures. J. Pers. Assess. 98, 223–237. doi: 10.1080/00223891.2015.1089249

PubMed Abstract | CrossRef Full Text | Google Scholar

St Clair-Thompson, H., Bugler, M., Robinson, J., Clough, P. J., McGeown, S., and Perry, J. L. (2014). Mental toughness in education: exploring relationships with attainment, attendance, behaviour and peer relationships. Educ. Psychol. 35, 886–907. doi: 10.1080/01443410.2014.895294

CrossRef Full Text | Google Scholar

St Clair-Thompson, H., Giles, R., McGeown, S. P., Putwain, D., Clough, P., and Perry, J. (2017). Mental toughness and transitions to high school and to undergraduate study. Educ. Psychol. 37, 792–809. doi: 10.1080/01443410.2016.1184746

CrossRef Full Text | Google Scholar

Vaughan, R., Hanna, D., and Breslin, G. (2018). Psychometric properties of the mental toughness questionnaire 48 (MTQ48) in Elite, amateur and nonathletes. Sport Exerc. Perform. Psychol. 7, 128–140. doi: 10.1037/spy0000114

CrossRef Full Text | Google Scholar