Neil Dagnall1*
Andrew Denovan1
Kostas A. Papageorgiou2
Peter Joseph Clough3
Andrew Parker1
Kenneth Graham Drinkwater1- 1Department of Psychology, Manchester Metropolitan University, Manchester, United Kingdom
- 2School of Psychology, Queen’s University Belfast, Belfast, United Kingdom
- 3Department of Psychology, University of Huddersfield, Huddersfield, United Kingdom
The 18-item Mental Toughness Questionnaire (MTQ-18) is a brief, widely used measure of mental toughness. The MTQ-18 derives from the longer MTQ-48, which comprises four independent but correlated factors (challenge, commitment, control, and confidence). Despite sampling items from across MTQ-48 dimensions, the MTQ-18 (as intended) provides a global, unidimensional score. Researchers have recently developed a further abridged version of the MTQ-18, the MTQ-10, which has demonstrated promising psychometric performance. The current paper assessed the factorial structure, reliability, predictive validity and invariance of the MTQ-18 and MTQ-10 in a sample of 944 students from English independent schools (year 11, aged 16 years). Respondents completed the MTQ-18 items online alongside the Satisfaction with Life Scale. Confirmatory factor analysis revealed that the MTQ-10 was a superior general measure, because the MTQ-18 possessed additional variance to that accounted for by an unidimensional solution. Additionally, the MTQ-10 evidenced higher factor loadings and demonstrated better data-model fit. Tests of concurrent validity revealed the MTQ-10 was a stronger predictor of well-being (life satisfaction). Both the MTQ-18 and MTQ-10 demonstrated gender invariance at the configural, metric, and scalar level. Overall, although the MTQ-18 was a psychometrically acceptable measure, the MTQ-10 was a superior unidimensional measure of MT.
Introduction
Since the 1980s, the concept of mental toughness (MT) has received considerable academic interest (Loehr, 1982; Luszki, 1982). The construct arose from work with elite athletes. Accordingly, Loehr (1982, 1986) defined mental toughness (MT) as stress tolerance and the ability to maximize performance (i.e., the capacity to perform consistently toward the upper range of one’s skills and talents regardless of circumstances) (Loehr, 1994).
Inherent within this conceptualization is ownership of key psychological characteristics. These include the capability to deal with adversity, the ability to thrive under pressure, self-belief, control, resilience, persistence, and superior mental skills (Crust, 2008). Recent reviews by Gucciardi (2017) and Lin et al. (2017) provide an overview of the theoretical development of MT and discuss important methodological issues, which have significantly influenced the construct’s development (see also Gucciardi, 2018). Despite ongoing academic debates about the nature and applicability of MT, it has become a prevailing concept within positive psychology (Rusk and Waters, 2013; Gucciardi, 2017).
In a general context, MT serves as an umbrella term to denote enabling psychological resources across a range of achievement contexts that promote positive mental health (Lin et al., 2017; Drinkwater et al., 2019; Papageorgiou et al., 2019a, b). Such universality can give rise to terminology that lacks a sound empirical basis, is theoretically vague, and contributes to conceptual obfuscation. Noting issues with the definition of MT, Gucciardi (2017) proposed an informed, contemporary delineation. This outlines MT as “a state-like psychological resource that is purposeful, flexible, and efficient in nature for the enactment and maintenance of goal-directed pursuits” (p. 18). Gucciardi’s (2017) characterization recognizes both the traditional roots of MT and its contemporary application to a range of settings. These include sport (Meggs et al., 2018), education (Gerber et al., 2013a; St Clair-Thompson et al., 2015; Haghighi and Gerber, 2018), occupational (Marchant et al., 2009), and health (Coulter et al., 2010; Clough and Strycharczyk, 2012; Brand et al., 2014; Sadeghi Bahmani et al., 2016a; Kruger, 2018).
Concomitant with the absence of a consensually agreed definition, other major concerns have stimulated intense academic debate. Issues center predominately on dimensionality (unidimensional vs. multidimensional), contextual variation (applicability to general vs. context-dependent situations), and dispositional nature (trait vs. state-like). These are important factors to acknowledge because lack of consensus restricts the generalizability of extant findings (Gucciardi et al., 2015) and questions the psychometric integrity of MT measurement instruments. Indeed, unless scales derive from a strong, established research base and demonstrate construct validity there can be no confidence in the legitimacy of reported outcomes (Gucciardi, 2018).
Insofar as researcher preference has informed measurement development, the failure to reach conceptual agreement has undermined the psychometric assessment of MT. The existence of myriad definitions of MT and the advance of various measures evidence this. In this context, scales fall into two broad categories: global (i.e., Mental Toughness Questionnaire, Tiwari and Sharma, 2007) and context specific (i.e., The Sports Mental Toughness Questionnaire, Sheard et al., 2009; Military Training Mental Toughness Inventory, Arthur et al., 2015; Gucciardi, 2018).
For these reasons, it is imperative that researchers establish the psychometric credibility of MT measures before employing them. This is especially true of the Mental Toughness Questionnaire 18-item (MTQ-18 or MT-18) which, despite limited psychometric verification, has featured in a number of peer-reviewed papers (see Table 1 for an indicative list). Explicit concerns are an absence of key details (i.e., rationale for scale, processes involved in item selection, and reporting of measurement properties) (see Clough et al., 2002).
Table 1. Indicative published studies using shortened mental toughness questionnaire measures (MTQ-18 and MTQ-10).
The MTQ-18 is a shortened version of the Mental Toughness Questionnaire 48-item (MTQ-48) (Clough et al., 2002), which is one of the most prevalently used measures of MT. The MTQ-48 assesses total MT and comprises four dimensions: challenge, commitment, confidence (subdivided into two components; interpersonal and own ability) and control (partitioned into two components; emotional and life). Horsburgh et al. (2009) offer support for the MTQ-48’s factorial structure. The MTQ-48 is a widely used measure of mental toughness that possesses established psychometric properties. Specifically, the measure has established internal and test–retest reliability (Levy et al., 2006; Nicholls et al., 2008; Crust, 2009; Gerber et al., 2013a, 2015, 2018). Furthermore, Clough et al. (2002) provide evidence for MTQ-48 construct validity via significant relationships with related measures (i.e., optimism, self-image, satisfaction with life, self-efficacy, and trait anxiety). Gerber et al. (2018) has previously examined the factorial structure of the MTQ-18. Clough et al. (2002) also report criterion validity; participants with self-reported high MT provided lower rating of exertion during a 30 min physically demanding cycling task.
The MTQ-18 uses items drawn directly from the MTQ-48. The justification for the scale is that its brevity makes it highly accessible for end-users. This is advantageous when testing time is restricted, assessment of MT occurs within a large psychological battery of test/measures and fatigue is a potential issue, and/or the participant group is subject to cognitive limitations (i.e., younger participants have shorter attention spans and are more prone to distractions). Accordingly, the MTQ-18 provides a brief, easy to administer/score global measure of MT. Psychometric support for the MTQ-18 frequently references the fact that the scale correlates strongly (r = 0.87) with the MTQ-48, which is a well-established measurement instrument (Clough et al., 2002; Nicholls et al., 2016). Beyond this basic analysis, there is little discrete psychometric information regarding the psychometric performance of the MTQ-18. This represents a significant gap in the literature.
One of the earliest studies to provide psychometric details about the MTQ-18, Levy et al. (2006), reported an adequate level of internal reliability (Cronbach’s alpha, α = 0.65) (see Taber, 2018 for a detailed description of alpha values). Crust et al. (2010) (α = 0.69) and Lang et al. (2019) (α = 0.70) observed similar reasonable alpha values. Gerber et al. (2013a, 2015, 2018) in a series of papers (α = 0.70, 0.77, and 0.75 respectively) and Sabouri et al. (2016) (α = 0.80) reported satisfactory internal reliability. Finally, Brand et al. (2015a, b, 2017) (α = 0.94, 0.91, and 0.91 respectively) and Sadeghi Bahmani et al. (2016b) (α = 0.92) observed excellent internal reliabilities within their studies.
Of studies reporting reliability, only the Crust et al. (2010) paper provides details on test–retest reliability. This study used a small, limited sample of 21 academy football players, and found the MTQ-18 was highly stable across a 3-month interval (intraclass correlation > 0.95). Other studies using the MTQ-18, have unfortunately failed to provide comprehensive psychometric information on the measure (i.e., Hardy et al., 2014; Delaney et al., 2015).
Since the MTQ-18 is a truncated version of the MTQ-48 and there is, currently, little literature on the MTQ-18, it is necessary to consider briefly some of the key assumptions underpinning the parent measure. This examination is necessary because debates around the soundness of the MTQ-48 question assumptions underpinning the MTQ-18 and potentially undermine the scale’s presumed psychometric integrity. At a conceptual level, the MTQ measures derive from the delineation of MT as a resistance resource or defense against the effects of stress (Crust and Keegan, 2010), which facilitates coping via production of appropriate attitudes, values, cognitions, and emotions (Nicholls et al., 2011). From this perspective, at a general level, MT moderates the negative effects of stress. Explicitly, it provides individuals with the capacity to deal with pressures and challenges (Clough et al., 2002). Previous work has documented the validity of the stress-moderating function of mental toughness (Gerber et al., 2013a, b, 2018; Haghighi and Gerber, 2018).
A key concern with MTQ measures is dimensionality. The authors of the MTQ-48 contend that the scale comprises four dimensions (Commitment, Challenge, Control, and Confidence) (Clough and Strycharczyk, 2012). Commitment or “stickability” is perseverance and the ability to carry out tasks successfully, despite problems/obstacles. Challenge designates the degree to which individuals see challenges as opportunities for self-development. Control denotes the extent to which the individual believes they have influence over their life (the external environment) and emotions (internal states). Finally, confidence embodies self-belief to complete successfully tasks, particularly confidence in abilities (individual qualities) and interpersonal confidence (being assertive and less likely to be intimidated in social contexts). To date 56 published papers have included the MTQ-48. The majority of these (n = 43) have reported the Four C dimensions alongside an overall mental toughness (e.g., Crust and Azadi, 2010). The remaining 13 studies have reported only the global score (e.g., Jackman et al., 2016).
Despite comprising items sampled from each of the MTQ-48 dimensions (Challenge, 3-items; Commitment, 3-items; Control, 5-items; and Confidence, 7-items) the MTQ-18, consistent with the measures design, provides only an overall, unidimensional MT score (Clough et al., 2002). An exception to this was a study by Godlewski and Kline (2012). The authors, for the purposes of structural equation modeling, extracted factors corresponding to the four C dimensions using a principal axis factor analysis using varimax rotation. The factors comprised the highest loading items in each dimension and demonstrated sufficient (Confidence, α = 0.57; Challenge, α = 0.59; and Commitment, α = 0.63) to good internal reliability (Control, α = 0.78) (Taber, 2018).
Within the current literature, there is no explicit justification for why the multidimensional MTQ-48 should give rise to the abridged, unidimensional MTQ-18 (Gucciardi, 2017). This discrepancy thus requires further investigation, especially in light of the fact that other shorter measures often retain dimensionality whilst sampling less construct breadth. For instance, the Big Five Inventory extra-short form (BFI-2-XS) covers all aspects of personality yet contains only 15-items (Soto and John, 2017). Common item variance arising from MTQ-48 dimensionality may produce a less than optimal unidimensional solution. Explicitly, within the MTQ-18 this may represent a general factor indexed by all items that also possesses elements of multidimensionality originating from item parcels that tap similar subject content domains (i.e., MTQ-48 subscale membership) (Reise et al., 2010). Despite issues of dimensionality, global MTQ-48 and MTQ-18 correlate highly.
The lack of information relating to dimensionality within the MTQ-18 resonates with current debates concerning the structure of the MTQ-48. Clough and colleagues produce results that support the factorial validity of the Four C’s Model (Perry et al., 2013, 2015), as do other researchers (e.g., Horsburgh et al., 2009), whereas other researchers question their interpretation (Gucciardi et al., 2012, 2013). Particularly, critics report poor model fit for factors (i.e., several poorly loading items). Indeed, subsequent independent confirmatory factor analysis (CFA) and exploratory structural equation modeling have found that the hypothesized correlated 4-factor model did not produce good data fit in athlete and workplace samples (Gucciardi et al., 2012); misfit was evident at both the global (i.e., model-data congruence) and local (i.e., pattern of factor loadings) levels. Based on these observations and other research, Gucciardi et al. (2015) contend that MT is a unidimensional concept that plays an important role in performance, goal progress, and thriving despite stress.
Noting the MTQ-48 dimensionality issue and the fact that well-regarded studies have employed the MTQ-18, the present paper examined the factorial structure of the MTQ-18 measure. Expanding upon this, analysis also evaluated the psychometric properties of a newly developed 10-item version of the MTQ (MTQ-10) (Papageorgiou et al., 2018). Establishing this measure was necessary in order to provide a succinct, global assessment of Mental Toughness in the context of utilizing an additional large questionnaire battery. Papageorgiou et al. (2018) used this in a recent study examining longitudinal associations between narcissism, mental toughness, and school achievement. The MTQ-10 derived from analysis of the MTQ-48 via selection of the highest line-adding items in each of the four dimensions (i.e., challenge, commitment, control, and confidence). Specifically, this resulted in 12 items (three items relating to each dimension). Initial CFA revealed that two items loaded poorly on a general factor. Subsequent removal of these items resulted in the 10-item, unidimensional scale comprising two items from both challenge and commitment, and three items from both control and confidence. Cross-lagged analyses across two data collection waves by Papageorgiou et al. (2018) demonstrated that the MTQ-10 was stable over time.
The existence of 18 and 10-item versions of the MTQ provides the opportunity to compare the performance of the two brief scales measures, particularly to assess whether they function effectively as unidimensional measures. In this context, the present study evaluated the psychometric performance of the MTQ-18 and MTQ-10. This was an important topic because it further informs debates around MTQ measures. It is important to attempt to resolve measurement issues because persisting conflicting operationalizations thwart conceptual development and undermine MT as a psychological construct. Additionally, this study establishes the psychometric validity of the shortened measures and in doing so demarcates the parameters of use.
A further stage in comparing the performance of the MTQ-18 and MTQ-10 was to assess the predictive capacity of the scales in relation to an established MT criterion, specifically life satisfaction. Research has consistently documented that higher levels of mental toughness (measured with the MTQ-48 and MTQ-18) are associated with greater levels of life satisfaction (Clough et al., 2002; Gerber et al., 2013a). Life satisfaction offers a suitable index of adjustment and adaptive functioning (Gerber et al., 2013a), and is representative of a range of positive psychology measures (e.g., optimism, Nicholls et al., 2008; self-esteem, Earle, 2006) that are typically related to higher levels of MT. To ensure consistency with the focus of previous research utilizing the MTQ-18 and MTQ-10 (see Table 1 for a summary), the current study used a student sample.
Materials and Methods
Participants
The sample comprised 944 Year 11 students who were 16 years of age, drawn from several independent schools within England. Consideration of sample composition revealed that 632 (66%) respondents were male, 307 (32.5%) female, and the remaining 14 (1.5%) preferred not to say. Data collection occurred as part of a project investigating the potential impact of sports participation on resilience and psychological well-being. Head teachers from participating institutions invited eligible pupils to participate. Students who responded participated as volunteers.
Procedure
Head teachers, via email, invited eligible Year 11s to participate. Prior to undertaking the online measures (hosted by Qualtrics) potential respondents received the study brief. This delineated study aims, purpose, content, and ethical procedures. Consenting respondents demonstrated informed consent by selecting a survey option confirming willingness to participate. Following this, respondents advanced to the study materials. Alongside the measures (specifically MTQ-18, MTQ-10, and SWLS), participants completed a brief demographics section which asked for confirmation of age, school, and preferred gender. Next respondents progressed through to the measures. These included a section on sports participation, but this was not analyzed within the present study. Further instructions asked respondents to work through the measures systematically, respond to all items in an open and honest manner and work at their own pace, and reassured respondents that there were no right or wrong answers. On completing the materials, participants were thanked and received a short debrief reaffirming the study’s purpose and their ethical rights.
Ethics Statement
The research team gained ethical authorization for the project (The Potential Benefits and Costs of Participation in School Sport: A Cross-Sectional and Longitudinal Study). The study investigated the impact of sports participation on resilience and psychological well-being. Following formal submission, the Director of the Research Institute for Health and Social Change and the Manchester Metropolitan University Faculty of Health, Psychology and Social Care Ethics Committee granted ethical approval.
Measures
Mental Toughness Questionnaire 18-Item (MTQ-18) (Clough et al., 2002)
The MTQ-18 uses a selection of items from the MTQ-48 (three Challenge, three Commitment, five Control, and seven Confidence). Items appear as statements (e.g., “I generally feel in control”) and respondents indicate their level of agreement via a five-point Likert-type scale anchored at 1 = strongly disagree and 5 = strongly agree. Summing of individual item responses produces an overall score. Higher scores indicate greater levels of MT. Please see the Introduction for commentary on established psychometric quality. In this study, the internal consistency of the MTQ-18 was satisfactory, α = 0.82.
Mental Toughness Questionnaire 10-Item (MTQ-10) (Papageorgiou et al., 2018)
The MTQ-10 is an abridged version of the MTQ-18; it comprises the highest line-adding items in each of the four dimensions (i.e., challenge, commitment, control, and confidence). For example, “I generally cope well with any problems that occur.” The MTQ-10 like other MTQ measures uses a five-point Likert and provides an overall score of mental toughness. Although MTQ-10 has demonstrated promising psychometric properties, further validation is required (Papageorgiou et al., 2018). Specifically, Papageorgiou et al. (2018) reported good model fit via CFA for a unidimensional solution, adequate composite reliability and Cronbach’s alpha across two time points (Time 1 ρc = 0.77 and Time 2 ρc = 0.73; Time 1 α = 0.76 and Time 2 α = 0.75), in addition to test–retest reliability (0.74). The MTQ-10 evidenced satisfactory reliability in the current study, α = 0.77.
The Satisfaction With Life Scale (SWLS) (Diener et al., 1985)
The Satisfaction with Life Scale (SWLS) assesses global cognitive judgments of contentment with life (Diener et al., 1985). The measure consists of five statements: (1) In most ways, my life is close to my ideal; (2) The conditions of my life are excellent; (3) I am satisfied with my life; (4) So far, I have achieved the important things I want in life; (5) If I could live my life over, I would change almost nothing. Participants indicate their degree of agreement using a seven-point Likert scale. Possible responses are 1 = strongly disagree, 2 = disagree, 3 = slightly disagree, 4 = neither agree nor disagree, 5 = slightly agree, 6 = agree, and 7 = strongly agree. Summation of items produces an overall total. High scores indicate greater levels of life satisfaction. The SWLS possesses good psychometric properties. These include construct validity, internal consistency, and test–retest reliability (Pavot and Diener, 2008). Internal consistency was satisfactory for the SWLS in this study, α = 0.85.
Data Analysis
Descriptive Analyses
Data screening for normality occurred prior to considering correlations between study variables. For univariate normality, this considered if skewness and kurtosis scores fell within the recommended range of −2 and +2 (Byrne, 2010). Multivariate normality applied Mardia’s coefficient with a critical ratio, which should fall below 5 (Bentler and Wu, 2005). This study used Cohen’s (1988) conventions to interpret the strength of correlations, with 0.1–0.29 representative of a weak relationship; 0.3–0.49 indicative of a moderate relationship; and 0.50 or larger representative of a strong correlation.
Confirmatory Factor Analyses
Subsequent analysis, using Amos 25, examined factor models (1-factor, correlated 4-factor and 4-factor bifactor solutions) for the MTQ-18 and MTQ-10 (Figure 1). The 1-factor model is consistent with previous MTQ-18 literature, and assumes that items load on a single dimension. The 4-factor models assessed the measures in terms of the original MTQ-48 multidimensional approach, which advocates the presence of four latent factors. Particularly, research evidence (e.g., Perry et al., 2013) dictated the allocation of items to subfactors of Commitment, Control, Confidence and Challenge. The 4-factor solution comprised correlated subfactors because this operationalization is consistent with the view of MTQ-48 as a multidimensional measure comprising intercorrelated subfactors (Perry et al., 2013). The bifactor model consisted of the four subfactors in addition to a general Mental Toughness factor. Here, all items loaded onto the general factor as well as the respective subfactors. Bifactor modeling was appropriate given the absence of consensus regarding dimensionality of Mental Toughness and its associated measures (Reise et al., 2010).
Figure 1. Competing factor models of the MTQ-18.
The maximum likelihood (ML) method estimated model parameters, and several indices assessed model fit: chi-square, Comparative Fit Index (CFI), Standardized Root-Mean-Square Residual (SRMR) and Root-Mean-Square Error of Approximation (RMSEA). Chi-square in isolation is insufficient to determine the suitability of model fit (Byrne, 2010). Hence, analysis considered also CFI, SRMR, and RMSEA. Consistent with Browne and Cudeck (1993), an acceptable model required SRMR < 0.08, RMSEA < 0.08, and CFI > 0.90. Reporting of RMSEA included the 90% confidence interval (CI). For model comparison, analysis included Akaike’s Information Criterion (AIC), with lower values indicating superior fit.
Consideration of Modification Indices (MI) occurred within each analysis of model fit. Particularly, MI values in excess of 20 were scrutinized (Rossier et al., 2012). Statisticians typically discourage covarying item errors. However, assessment of MI was necessary in this study because some subfactor items were similar in phrasing (Byrne, 2010). As a rule of thumb to assess the significance of factor loadings corresponding to each model, loadings of 0.3 indicate a minimum threshold of acceptance (Hair et al., 2010). This suggests that an item possesses a weak correlation with an extracted factor. Similarly, Hair et al. (2010) assert that the majority of factor loadings should exceed 0.5 to indicate practical significance for a measure. In contrast with 0.3, a loading of 0.5 infers that an item evidences a medium correlation with a factor.
Multi-Group Analysis
Multi-group CFA analyzed a progressively restrictive sequence of models to reveal the degree of invariance that existed among the responses of men and women. Specifically, analysis considered invariance of factor structure (configural invariance), factor loadings (metric invariance), and item intercepts (scalar invariance). In addition, using Chen’s (2007) criteria, CFI values should not change by more than 0.01 and RMSEA should not alter by more than 0.015 across the invariance models.
Structural Equation Models
The final stage of analysis evaluated the predictive capacity of the MTQ-18 vs. the MTQ-10 by specifying and testing structural equation models. These regressed superior MTQ solutions onto life satisfaction (SWLS), a pertinent and often cited MT outcome (e.g., Crust and Azadi, 2010; Gerber et al., 2013a, 2015).
Results
Descriptive Analyses
Kurtosis and skewness fell between −2 and +2 indicating acceptable normal univariate distribution (see Table 2). Mardia’s coefficient was 52.732 (critical ratio = 30.190) for the MTQ-18, and 19.348 (critical ratio = 19.186) for the MTQ-10. These results indicated multivariate non-normality, which can produce standard error biases (Bentler and Wu, 2005). Consequently, CFA analyses utilized ML estimation with bootstrapping (resampled 600 times) to create accurate standard errors alongside bias-corrected p-values and confidence intervals (at the 95% confidence level) (Byrne, 2010). Naïve bootstrapping functions effectively when data is non-normal and is a robust alternative to other methods of robust ML estimation (e.g., the Satorra–Bentler chi-square) (Nevitt and Hancock, 2001).
Table 2. Means, standard deviations, and correlations for all study variables.
Consideration of zero-order correlations revealed moderate to strong positive relationships among MT totals and subfactors (Table 2). Additionally, moderate to strong positive relationships existed between MT totals and subfactors with life satisfaction.
Confirmatory Factor Analyses
The 1-factor solution for the MTQ-18 reported unsatisfactory fit across indices: χ2 (135, N = 944) = 1613.439, p < 0.001, CFI = 0.640, SRMR = 0.087, RMSEA = 0.108 (CI of 0.103 to 0.113) (see Table 3). Covarying errors for items 2 and 8, 3 and 6, 7 and 9, 7 and 18, 9 and 18, 12 and 17, and 14 and 15 produced satisfactory fit: χ2 (128, N = 944) = 542.065, p < 0.001, CFI = 0.900, SRMR = 0.055, RMSEA = 0.059 (CI of 0.054 to 0.064). Moreover, this model fitted data significantly better than the unconstrained solution: χ2difference (7, N = 944) = 1071.374, p < 0.001.
Table 3. Fit indices for alternative measurement models of the MTQ-18 and MTQ-10.
The correlated 4-factor model (comprising subfactors of Commitment, Confidence, Control, and Challenge) demonstrated unsatisfactory fit across indices: χ2 (129, N = 944) = 1392.327, p < 0.001, CFI = 0.692, SRMR = 0.083, RMSEA = 0.102 (CI of 0.097 to 0.107). Permitting covariance of errors between items 2 and 16, 7 and 18, 7 and 9, 8 and 9, 9 and 18, and 14 and 15 resulted in better fit on RMSEA and SRMR: χ2 (123, N = 944) = 805.513, p < 0.001, CFI = 0.834, SRMR = 0.063, RMSEA = 0.077 (CI of 0.072 to 0.082). Model fit was significantly better than the unconstrained 4-factor solution: χ2difference (6, N = 944) = 586.814, p < 0.001. However, the model did not reach satisfactory fit across indices.
A 4-factor bifactor model also demonstrated unsatisfactory fit across indices, but SRMR: χ2 (117, N = 944) = 882.458, p < 0.001, CFI = 0.813, SRMR = 0.065, RMSEA = 0.083 (CI of 0.078 to 0.088). Covariance among errors was not permissible for this solution because recommended changes would result in correlating error terms among items belonging to distinct subfactors. A comparison of AIC values suggested that the 1-factor model was the superior solution. This had a lower AIC (664.065) compared with the correlated 4-factor (937.513) and 4-factor bifactor (1026.458) solutions.
An assessment of factor loadings for the MTQ-18 1-factor solution revealed that all items apart from 18 and 7 loaded greater than the minimum threshold of 0.3. Similarly, 33.33% of items loaded above 0.5 (a cut-off to indicate practical significance) (Hair et al., 2010). This suggests that the scale comprises a majority of items that do not evidence practical significance, with two items failing to meet the minimum recommended threshold.
Similarly to the MTQ-18 results, the MTQ-10 1-factor model demonstrated unsatisfactory fit across all indices, but SRMR: χ2 (35, N = 944) = 310.574, p < 0.001, CFI = 0.854, SRMR = 0.061, RMSEA = 0.091 (CI of 0.082 to 0.101). Permitting error covariance between items 2 and 8, and 3 and 6 significantly improved model fit: χ2difference (2, N = 944) = 182.384, p < 0.001. This solution also possessed good fit across indices: χ2 (33, N = 944) = 128.190, p < 0.001, CFI = 0.950, SRMR = 0.037, RMSEA = 0.055 (CI of 0.045 to 0.066).
The correlated 4-factor solution reported satisfactory fit: χ2 (29, N = 944) = 191.971, p < 0.001, CFI = 0.914, SRMR = 0.048, RMSEA = 0.077 (CI of 0.067 to 0.088). In addition, the 4-factor bifactor model indicated suitable overall fit: χ2 (29, N = 944) = 167.828, p < 0.001, CFI = 0.927, SRMR = 0.045, RMSEA = 0.071 (CI of 0.061 to 0.082). Similarly to the MTQ-18 results, error covariance was not permissible for these solutions because recommended changes necessitated correlating error terms among items belonging to discrete subfactors. Assessment of AIC results revealed that the 1-factor solution (AIC of 172.190) demonstrated better data fit than the correlated 4-factor (AIC of 243.971) and 4-factor bifactor (AIC of 239.828) models.
An inspection of factor loadings revealed that all items loaded above the minimum threshold of 0.3, and 50% of items loaded greater than 0.5. These results infer that the scale satisfies the minimum requirements of Hair et al. (2010) overall.
Multi-Group Analysis
An assessment of gender invariance occurred for MTQ-18 and MTQ-10 superior factor solutions (i.e., the 1-factor models). For the MTQ-18, a test of configural invariance revealed satisfactory fit across RMSEA and SRMR, but not CFI: χ2 (256, N = 944) = 710.224, p < 0.001, CFI = 0.885, SRMR = 0.066, RMSEA = 0.044 (CI of 0.040 to 0.048). The metric invariance test demonstrated similar results. However, the CFI difference (0.001) and RMSEA difference (0.002) were minimal, supporting invariance among the factor loadings. In addition, the scalar invariance test demonstrated an acceptable change in CFI (0.028) and RMSEA (0.004). This indicated invariance at the intercept level.
For the MTQ-10, configural invariance analysis revealed good fit across indices: χ2 (66, N = 944) = 148.374, p < 0.001, CFI = 0.954, SRMR = 0.042, RMSEA = 0.037 (CI of 0.029 to 0.045). In relation to the metric model, the difference in CFI (0.001) and RMSEA (0.002) was minimal, suggesting invariance for the factor loadings. The scalar model also demonstrated minimal change in CFI (0.001) and RMSEA (0.001), indicating invariance among the item intercepts.
Structural Equation Models
A structural equation model using the 1-factor mental toughness solution as a predictor of life satisfaction for the MTQ-18 (Figure 2) indicated satisfactory model fit: χ2 (222, N = 944) = 863.854, p < 0.001, CFI = 0.904, SRMR = 0.053, RMSEA = 0.055 (CI of 0.052 to 0.059).
Figure 2. MTQ-18 as a predictor of life satisfaction. Ellipses represent latent variables; measured variables are represented by rectangles; error is not shown but was specified for all variables. ∗∗p < 0.001 (using bootstrap significance estimates).
Inspection of structural paths revealed that mental toughness significantly predicted life satisfaction, β = 0.677, p < 0.001. Replicating the structural equation model for the superior MTQ-10 solution (the 1-factor model; Figure 3) demonstrated good data-model fit: χ2 (87, N = 944) = 358.296, p < 0.001, CFI = 0.939, SRMR = 0.044, RMSEA = 0.058 (CI of 0.051 to 0.064). The structural paths revealed that mental toughness was a significant predictor of life satisfaction, β = 0.688, p < 0.001.
Figure 3. MTQ-10 as a predictor of life satisfaction. Ellipses represent latent variables; measured variables are represented by rectangles; error is not shown but was specified for all variables. ∗∗p < 0.001 (using bootstrap significance estimates).
Discussion
Comparison of unidimensional (1-factor) and factorial models (correlated 4-factor and 4-factor bifactor) revealed that single factor models were superior to multidimensional alternatives for both the MTQ-18 and MTQ-10. Of the models tested, the MTQ-10 1-factor model demonstrated best fit. In comparison, the MTQ-18 possessed additional variance to that accounted for by a unidimensional solution. This resulted in the need to correlate multiple item error terms, equaling more than 50% of the scale items.
The additional variance was attributable to the methodological approach used to create the MTQ-18 (Clough et al., 2002). In an attempt to sample construct breadth, the MTQ-18 authors selected high loading items from each of the MTQ-48 subscales (challenge, commitment, control, and confidence). It appears that this approach inadvertently introduced structural contamination arising from 4Cs dimensional resonance; latent item associations weakened the intended unidimensional structure. This results in an adequate global measure that derives from a less than optimal factorial solution. Contrastingly, because the MTQ-10 stems from the highest loading scale items (regardless of factor origin) it remains largely untainted by the underlying MTQ-48 structure.
Overall, analysis indicated that the MTQ-10 was a psychometrically superior global measure to the MTQ-18. Particularly, the MTQ-10 had higher factor loadings and demonstrated better data-model fit. Additionally, the MTQ-10 regression path with the established mental toughness criterion, life satisfaction, was stronger.
The conceptual issue of why the abridged MT measures are unidimensional, whereas the parent MTQ-48 scale is multidimensional, is beyond the remit of this paper. However, it is important to note that despite sampling MTQ-48 subscales, the MTQ-18 best fitted a unidimensional model (Gucciardi et al., 2015; Birch et al., 2017; Vaughan et al., 2018) confirming the author’s assertion that the scale provides a global measure of MT.
Although the MTQ-18 performs less well psychometrically than the MTQ-10, this study indicates that the scale is an acceptable, but less parsimonious, measure of global mental toughness. This outcome is reassuring for studies that have used the MTQ-18 to measure global levels of mental toughness (see Table 1). The MTQ-18 and MTQ-10 were highly correlated with each other. In this context, previous work on the MTQ-48 provides a wealth of background evidence that supports the assertion that the MTQ-18 is valid to the extent that it adequately indexes mental toughness as defined by Clough and colleagues. In summary, conceptual disagreements concerning the precise nature of mental toughness are beyond the scope of the present paper, but theoretically important to note (see recent reviews by Gucciardi, 2017 and Lin et al., 2017).
In terms of performance with an established mental toughness criterion, life satisfaction, both the MTQ-18 and MTQ-10 performed similarly to the MTQ-48. The present study observed correlations between both brief measures and Life Satisfaction in the large range (MTQ-18, r = 0.52; MTQ-10, r = 0.53). These relationships were comparable to those reported by Crust and Clough (2005) (r = 0.56) and Marchant et al. (2009) (r = 0.56). Correlations generally further supported the well-established finding that higher levels of MT are associated with life satisfaction (Gerber et al., 2013a).
The present study used a sample of Year 11 (16 years old) students to facilitate direct comparisons with related studies, who have generally used commensurate participant groups (i.e., older school students, undergraduates, and young adults). This paper found that the short MTQ scales were appropriate measures of global MT within young people (16 year olds). Additionally, the MTQ-18 and MTQ-10 demonstrated gender invariance indicating that there was no difference between males and females. Furthermore, Gerber et al. (2018) found that testing the factor structure of the MTQ-18 resulted in acceptable model fit in young elite athletes (Gerber et al., 2018). Whilst these results were encouraging, further work is required to establish whether this is also true of other populations. This will inform key conceptual concerns, which have hindered the development of MT (i.e., contextual variations and temporal stability).
Drawing on the MTQ-48 literature, there is evidence that scale structure varies as a function of contextual variations. Particularly, that the appropriateness of the 4C structure varies as a function of sample. For instance, Birch et al. (2017) observed that the 4Cs model did not apply to student athletes. Similarly, Vaughan et al. (2018) found that the 4-factor model produced poor data fit when applied to elite athletes. Noting these factorial discrepancies, consistent with the concerns of Gucciardi (2018), the authors advocate caution when extrapolating the psychometric properties of the MTQ-18 and MTQ-10. Currently, conclusions should remain within the perimeters of young adult and undergraduate students.
Although the present paper indicates that the two concise measures of MT possess sound psychometric properties, there are important unresolved issues that require further evaluation. One particular concern is temporal stability. Currently, there is only limited evidence to indicate that the MTQ-18 (Crust, 2009) and MTQ-10 (Papageorgiou et al., 2018) possess satisfactory test–retest reliability. It is essential to establish test–rest reliability because this supports the internal validity by demonstrating that measurements obtained by a scale are representative and stable over time. Specifically, the ability to provide consistent scores over time in a stable population (Aaronson et al., 2002).
Establishing that scales possess enduring properties is essential at both measurement and theoretical levels. Knowing the limitations of psychometric tools is vital to appropriate score interpretation. In the case of contextual variations, it is necessary to identify group differences in order to generate appropriate norm groups. Conceptually, examining contextual variations and temporal stability informs the development of MT by offering insights into key theoretical questions. Accordingly, the development of the MTQ-10 will provide valuable insights.
Clough and colleagues (e.g., Crust and Clough, 2005) support the notion that MT is a trait-like dimension (Clough et al., 2012), whereas critics contend that MT lacks stability. Acknowledging this, several MTQ-48-related articles refer to the importance of the role of experiential factors. Principally, the notion that exposure to challenging situations facilitates the development of resources through problem solving (Crust and Clough, 2011; Clough et al., 2016). The MTQ-10 provides a brief, easy to administer measure that lends itself to regular completion. Hence, the MTQ-10 will enable researchers to readily assess temporal stability, investigate the effect of intervening factors (i.e., training), and test MT levels across multiple time points and settings.
Recently, Strycharczyk and Clough (2014) postulated that MT as measured by the MTQ-48 is a ‘plastic’ personality trait (Strycharczyk and Clough, 2014). Plastic in this context signifies that level of mental toughness is malleable. It derives from the observation that MT is ‘trainable’ to the extent that people can learn to adopt non-preferential behaviors. In this context, the short MT measures provide expedient, accessible, and easy to interpret indexes for assessing levels of MT in everyday situations (i.e., sport, educational, and occupational).
Data Availability
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
The research team gained ethical authorization for the project (The Potential Benefits and Costs of Participation in School Sport: A Cross-Sectional and Longitudinal Study). This study investigated the impact of sports participation on resilience and psychological well-being. Following formal submission, the Director of the Research Institute for Health and Social Change and the Manchester Metropolitan University Faculty of Health, Psychology and Social Care Ethics Committee granted ethical approval.
Author Contributions
ND and AD designed the study. ND was the main author. AD conducted the main analysis and wrote the manuscript. PC and KD organized the data collection and commented on the manuscript drafts. KP provided the specialist advice and performed the editing. AP and KD advised on the manuscript contents.
Funding
The publication fees for this manuscript were provided by the Manchester Metropolitan University.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Aaronson, N., Alonso, J., Burnam, A., Lohr, K. N., Patrick, D. L., Perrin, E., et al. (2002). Assessing health status and quality-of-life instruments: attributes and review criteria. Qual. Life Res. 11, 193–205. doi: 10.1023/A:1015291021312
Arthur, C. A., Fitzwater, J., Hardy, L., Beattie, S., and Bell, J. (2015). Development and validation of a military training mental toughness inventory. Mil. Psychol. 27, 232–241. doi: 10.1037/mil0000074
Bentler, P. M., and Wu, E. J. C. (2005). EQS 6.1 for Windows user’s Guide. Encino, CA: Multivariate Software.
Birch, P. D., Crampton, S., Greenlees, I. A., Lowry, R. G., and Coffee, P. (2017). The mental toughness questionniare-48: a re-examination of factorial validity. Int. J. Sport Psychol. 48, 331–355.
Brand, S., Gerber, M., Kalak, N., Kirov, R., Lemola, S., Clough, P. J., et al. (2014). Adolescents with greater mental toughness show higher sleep efficiency, more deep sleep and fewer awakenings after sleep onset. J. Adolesc. Health 54, 109–113. doi: 10.1016/j.jadohealth.2013.07.017
Brand, S., Hatzinger, M., Stadler, C., Bolten, M., von Wyl, A., Perren, S., et al. (2015a). Does objectively assessed sleep at five years predict sleep and psychological functioning at 14 years?–Hmm, yes and no! J. Psychiatr. Res. 60, 148–155. doi: 10.1016/j.jpsychires.2014.10.007
Brand, S., Kirov, R., Kalak, N., Gerber, M., Pühse, U., Lemola, S., et al. (2015b). Perfectionism related to self-reported insomnia severity, but not when controlled for stress and emotion regulation. Neuropsychiatr. Dis. Treat. 11, 263–271. doi: 10.2147/NDT.S74905
Brand, S., Kalak, N., Gerber, M., Clough, P. J., Lemola, S., Sadeghi Bahmani, D., et al. (2017). During early to mid adolescence, moderate to vigorous physical activity is associated with resoring sleep, psychological functioning, mental toughness and male gender. J. Sport Sci. 35, 426–434. doi: 10.1080/02640414.2016.1167936
Browne, M. W., and Cudeck, R. (1993). “Alternative ways of assessing model fit,” in Testing Structural Equation Models, eds K. A. Bollen and J. S. Long (Beverly Hills, CA: Sage), 136–162.
Byrne, B. M. (2010). Structural Equation Modeling with AMOS: Basic Concepts, Applications, and Programming. New York, NY: Taylor & Francis Group.
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. 14, 464–504. doi: 10.1080/10705510701301834
Clough, P., Earle, K., Perry, J., and Crust, L. (2012). Comment on “Progressing measurement in mental toughness: a case example of the Mental Toughness Questionnaire 48” by Gucciardi, Hanton, and Mallett (2012). Sport Exerc. Perform. Psychol. 1, 283–287. doi: 10.1037/a0029771
Clough, P., Earle, K., and Sewell, D. (2002). “Mental toughness: the concept and its measurement. Solutions in sport psychology,” in Solutions in Sport Psychology, ed. I. M. Cockerill (London: Cengage Learning, EMEA), 32–43.
Clough, P., Oakes, S., Dagnall, N., St Clair-Thompson, H., and McGeown, S. (2016). “The study of non-cognitive attributes in education,” in Non-cognitive Skills and Factors in Educational Attainment, eds M. S. Khine and S. Areepattamannil (Rotterdam: SensePublishers), 315–329. doi: 10.1007/978-94-6300-591-3_14
Clough, P. J., and Strycharczyk, D. (2012). Developing Mental Toughness: Improving Performance, Wellbeing and Positive Behaviour in Others. London: Kogan Page.
Cohen, J. E. (1988). Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates.
Coulter, T., Mallett, C. J., and Gucciardi, D. F. (2010). Understanding mental toughness in Australian soccer: perceptions of players, parents, and coaches. J. Sports Sci. 28, 699–716. doi: 10.1080/02640411003734085
Crust, L. (2008). A review and conceptual re-examination of mental toughness: implications for future researchers. Pers. Individ. Dif. 45, 576–583. doi: 10.1016/j.paid.2008.07.005
Crust, L. (2009). The relationship between mental toughness and affect intensity. Pers. Individ. Dif. 47, 959–963. doi: 10.1016/j.paid.2009.07.023
Crust, L., and Azadi, K. (2010). Mental toughness and athletes’ use of psychological strategies. Eur. J. Sport Sci. 10, 43–51. doi: 10.1080/17461390903049972
Crust, L., and Clough, P. J. (2005). Relationship between mental toughness and physical endurance. Percept. Mot. Skills 100, 192–194. doi: 10.2466/pms.100.1.192-194
Crust, L., and Clough, P. J. (2011). Developing mental toughness: from research to practice. J. Sport Psychol. Action 2, 21–32. doi: 10.1080/21520704.2011.563436
Crust, L., and Keegan, R. (2010). Mental toughness and attitudes to risk-taking. Pers. Individ. Dif. 49, 164–168. doi: 10.1016/j.paid.2010.03.026
Crust, L., Nesti, M., and Littlewood, M. (2010). A cross-sectional analysis of mental toughness in a professional football academy. Athl. Insight J. 2, 165–174.
Delaney, P. F., Goldman, J. A., King, J. S., and Nelson-Gray, R. O. (2015). Mental toughness, reinforcement sensitivity theory, and the five-factor model: personality and directed forgetting. Pers. Individ. Dif. 83, 180–184. doi: 10.1016/j.paid.2015.04.020
Diener, E., Emmons, R. A., Larsen, R. J., and Griffin, S. (1985). The satisfaction with life scale. J. Pers. Assess. 49, 71–75. doi: 10.1207/s15327752jpa4901_13
Drinkwater, K., Dagnall, N., Denovan, A., and Parker, A. (2019). The moderating effect of mental toughness: perception of risk and belief in the paranormal. Psychol. Rep. 122, 268–287. doi: 10.1177/0033294118756600
Earle, K. (2006). The Construct of Mental Toughness: A Psychometric and Experimental Analysis. Unpublished Ph.D. thesis, University of Hull, Hull.
Gerber, M., Best, S., Meerstetter, F., Walter, M., Ludyga, S., Brand, S., et al. (2018). Effects of stress and mental toughness on burnout and depressive symptoms: a prospective study with young elite athletes. J. Sci. Med. Sport 21, 1200–1205. doi: 10.1016/j.jsams.2018.05.018
Gerber, M., Brand, S., Feldmeth, A. K., Lang, C., Elliot, C., Holsboer-Trachsler, E., et al. (2013a). Adolescents with high mental toughness adapt better to perceived stress: a longitudinal study with Swiss vocational students. Pers. Individ. Dif. 54, 808–814. doi: 10.1016/j.paid.2012.12.003
Gerber, M., Kalak, N., Lemola, S., Clough, P. J., Perry, J. L., Pühse, U., et al. (2013b). Are adolescents with high mental toughness levels more resilient against stress? Stress Health 29, 164–171. doi: 10.1002/smi.2447
Gerber, M., Lang, C., Feldmeth, A. K., Elliot, C., Brand, S., Holsboer-Trachsler, E., et al. (2015). Burnout and mental health in Swiss vocational students: the moderating role of physical activity. J. Res. Adolesc. 25, 63–74. doi: 10.1111/jora.12097
Godlewski, R., and Kline, T. (2012). A model of voluntary turnover in male Canadian Forces recruits. Mil. Psychol. 24, 251–269. doi: 10.1080/08995605.2012.678229
Gucciardi, D., Hanton, S., and Mallett, C. (2013). Progressing measurement in mental toughness: a response to Clough, Earle, Perry and Crust. Sport Exerc. Perform. Psychol. 2, 157–172. doi: 10.1037/spy0000002
Gucciardi, D. F. (2017). Mental toughness: progress and prospects. Curr. Opin. Psychol. 16, 17–23. doi: 10.1016/j.copsyc.2017.03.010
Gucciardi, D. F. (2018). Commentary: mental toughness and individual differences in learning, educational and work performance, psychological well-being, and personality: a systematic review. Front. Psychol. 8:2329. doi: 10.3389/fpsyg.2017.02329
Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., and Temby, P. (2015). The concept of mental toughness: tests of dimensionality, nomological network, and traitness. J. Pers. 83, 26–44. doi: 10.1111/jopy.12079
Gucciardi, D. F., Hanton, S., and Mallett, C. J. (2012). Progressing measurement in mental toughness: a case example of the mental toughness questionnaire 48. Sport Exerc. Perform. Psychol. 1, 194–214. doi: 10.1037/a0027190
Haghighi, M., and Gerber, M. (2018). Does mental toughness buffer the relationship between perceived stress, depression, burnout, anxiety and sleep? Int. J. Stress Manag. 26, 297–305. doi: 10.1037/str0000106
Hair, J., Black, W., Babin, B., and Anderson, R. (2010). Multivariate Data Analysis, 7th Edn. Upper Saddle River, NJ: Prentice-Hall.
Hardy, J. H. III, Imose, R. A., and Day, E. A. (2014). Relating trait and domain mental toughness to complex task learning. Pers. Individ. Dif. 68, 59–64. doi: 10.1016/j.paid.2014.04.011
Horsburgh, V. A., Schermer, J. A., Veselka, L., and Vernon, P. A. (2009). A behavioural genetic study of mental toughness and personality. Pers. Individ. Dif. 46, 100–105. doi: 10.1207/s15327752jpa4901_13
Jackman, P. C., Swann, C., and Crust, L. (2016). Exploring athletes’ perceptions of the relationship between mental toughness and dispositional flow in sport. Psychol. Sport Exerc. 27, 56–65. doi: 10.1016/j.psychsport.2016.07.007
Kruger, E. (2018). Mental toughness is a predictor of suicidality in university students. Educ. Health 36, 42–47.
Lang, C., Brand, S., Colledge, F., Ludyga, S., Pühse, U., and Gerber, M. (2019). Adolescents personal beliefs about sufficient physical activity are more closely related to sleep and psychological functioning than self-reported physical activity: a prospective study. J. Sports Health Sci. 8, 280–288. doi: 10.1016/j.jshs.2018.03.002
Levy, A. R., Polman, R. C., Clough, P. J., Marchant, D. C., and Earle, K. (2006). Mental toughness as a determinant of beliefs, pain, and adherence in sport injury rehabilitation. J. Sport Rehabil. 15, 245–254. doi: 10.1123/jsr.15.3.245
Lin, Y., Mutz, J., Clough, P. J., and Papageorgiou, K. A. (2017). Mental toughness and individual differences in learning, educational and work performance, psychological well-being, and personality: a systematic review. Front. Psychol. 8:1345. doi: 10.3389/fpsyg.2017.01345
Loehr, J. (1982). Athletic Excellence: Mental Toughness Training for Sports. New York, NY: Forum Publishing Company.
Loehr, J. (1986). Mental Toughness Training for Sports: Achieving Athletic Excellence. Lexington, MA: Stephen Greene Press.
Marchant, D. C., Polman, R. C., Clough, P. J., Jackson, J. G., Levy, A. R., and Nicholls, A. R. (2009). Mental toughness: managerial and age differences. J. Manag. Psychol. 24, 428–437. doi: 10.1108/02683940910959753
Meggs, J., Chen, M. A., and Hoehn, S. (2018). Relationships between flow, mental toughness and subjective performance perception in various triathletes. Percept. Mot. Skills 126, 241–252. doi: 10.1177/0031512518803203
Nevitt, J., and Hancock, G. R. (2001). Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Struct. Equ. Model. 8, 353–377. doi: 10.1207/S15328007SEM0803_2
Nicholls, A. R., Levy, A. R., Polman, R. C., and Crust, L. (2011). Mental toughness, coping self-efficacy, and coping effectiveness among athletes. Int. J. Sport Psychol. 42, 513–524.
Nicholls, A. R., Morley, D., and Perry, J. L. (2016). Mentally tough athletes are more aware of unsupportive coaching behaviours: perceptions of coach behaviour, motivational climate, and mental toughness in sport. Int. J. Sports Sci. Coach. 11, 172–181. doi: 10.1177/1747954116636714
Nicholls, A. R., Polman, R. C., Levy, A. R., and Backhouse, S. H. (2008). Mental toughness, optimism, pessimism, and coping among athletes. Pers. Individ. Dif. 44, 1182–1192. doi: 10.1016/j.paid.2007.11.011
Papageorgiou, K. A., Denovan, A., and Dagnall, N. (2019a). The positive effect of narcissism on depressive symptoms through mental toughness: narcissism may be a dark trait but it does help with seeing the world less grey. Eur. Psychiatry 55, 74–79. doi: 10.1016/j.eurpsy.2018.10.002
Papageorgiou, K. A., Gianniou, F. M., Wilson, P., Moneta, G. B., Bilello, D., and Clough, P. J. (2019b). The bright side of dark: exploring the positive effect of narcissism on perceived stress through mental toughness. Pers. Individ. Dif. 139, 116–124. doi: 10.1016/j.paid.2018.11.004
Papageorgiou, K. A., Malanchini, M., Denovan, A., Clough, P. J., Shakeshaft, N., Schofield, K., et al. (2018). Longitudinal associations between narcissism, mental toughness and school achievement. Pers. Individ. Dif. 131, 105–110. doi: 10.1016/j.paid.2018.04.024
Pavot, W., and Diener, E. (2008). The satisfaction with life scale and the emerging construct of life satisfaction. J. Posit. Psychol. 3, 137–152. doi: 10.1080/17439760701756946
Perry, J. L., Clough, P. J., Crust, L., Earle, K., and Nicholls, A. R. (2013). Factorial validity of the mental toughness questionnaire-48. Pers. Individ. Dif. 54, 587–592. doi: 10.1016/j.paid.2012.11.020
Perry, J. L., Nicholls, A. R., Clough, P. J., and Crust, L. (2015). Assessing model fit: caveats and recommendations for confirmatory factor analysis and exploratory structural equation modeling. Meas. Phys. Educ. Exerc. Sci. 19, 12–21. doi: 10.1080/1091367X.2014.952370
Reise, S. P., Moore, T. M., and Haviland, M. G. (2010). Bifactor models and rotations: exploring the extent to which multidimensional data yield univocal scale scores. J. Pers. Assess. 92, 544–559. doi: 10.1080/00223891.2010.496477
Rossier, J., Zecca, G., Stauffer, S. D., Maggiori, C., and Dauwalder, J. P. (2012). Career adapt-abilities scale in a french-speaking swiss sample: psychometric properties and relationships to personality and work engagement. J. Vocat. Behav. 80, 734–743. doi: 10.1016/j.jvb.2012.01.004
Rusk, R. D., and Waters, L. E. (2013). Tracing the size, reach, impact, and breadth of positive psychology. J. Posit. Psychol. 8, 207–221. doi: 10.1080/17439760.2013.777766
Sabouri, S., Gerber, M., Bahmani, D. S., Lemola, S., Clough, P. J., Kalak, N., et al. (2016). Examining dark triad traits in relation to mental toughness and physical activity in young adults. Neuropsychiatr. Dis. Treat. 12, 229–235. doi: 10.2147/NDT.S97267
Sadeghi Bahmani, D., Gerber, M., Kalak, N., Lemola, S., Clough, P. J., Calabrese, P., et al. (2016a). Mental toughness, sleep disturbances, and physical activity in patients with multiple sclerosis compared to healthy adolescents and young adults. Neuropsychiatr. Dis. Treat. 12, 1571–1579. doi: 10.2147/NDT.S111208
Sadeghi Bahmani, D., Hatzinger, M., Gerber, M., Lemola, S., Clough, P. J., Perren, S., et al. (2016b). The origins of mental toughness–prosocial behavior and low internalizing and externalizing problems at age 5 predict higher mental toughness scores at age 14. Front. Psychol. 7:1221. doi: 10.3389/fpsyg.2016.01221
Sheard, M., Golby, J., and Van Wersch, A. (2009). Progress toward construct validation of the sports mental toughness questionnaire (SMTQ). Eur. J. Psychol. Assess. 25, 186–193. doi: 10.1027/1015-5759.25.3.186
Soto, C. J., and John, O. P. (2017). Short and extra-short forms of the big five inventory–2: the BFI-2-S and BFI-2-XS. J. Res. Pers. 68, 69–81. doi: 10.1016/j.jrp.2017.02.004
St Clair-Thompson, H., Bugler, M., Robinson, J., Clough, P., McGeown, S. P., and Perry, J. (2015). Mental toughness in education: exploring relationships with attainment, attendance, behaviour and peer relationships. Educ. Psychol. 35, 886–907. doi: 10.1080/01443410.2014.895294
Strycharczyk, D., and Clough, P. (eds) (2014). Developing Mental Toughness in Young People: Approaches to Achievement, Well(-)Being, Employability, and Positive Behaviour. London: Karnac Books.
Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res. Sci. Educ. 48, 1273–1296. doi: 10.1007/s11165-016-9602-9602
Tiwari, S., and Sharma, J. (2007). Development and Validation of Mental Toughness Questionnaire for Volleyball Players. Master thesis, Annamali University, India.
Keywords: mental toughness, psychometric validation, MTQ-18, MTQ-10, life satisfaction
Citation: Dagnall N, Denovan A, Papageorgiou KA, Clough PJ, Parker A and Drinkwater KG (2019) Psychometric Assessment of Shortened Mental Toughness Questionnaires (MTQ): Factor Structure of the MTQ-18 and the MTQ-10. Front. Psychol. 10:1933. doi: 10.3389/fpsyg.2019.01933
Received: 04 March 2019; Accepted: 06 August 2019;
Published: 21 August 2019.
Edited by:
Maicon Rodrigues Albuquerque, Federal University of Minas Gerais, BrazilReviewed by:
Admassu Nadew Lamu, University of Bergen, NorwayMarkus Gerber, University of Basel, Switzerland
Copyright © 2019 Dagnall, Denovan, Papageorgiou, Clough, Parker and Drinkwater. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Neil Dagnall, n.dagnall@mmu.ac.uk