Tianxue Cui
Chuang Wang
Jianzhong Xu- 1Faculty of Education, University of Macau, Taipa, China
- 2Department of Counseling, Educational Psychology, and Foundations, Mississippi State University, Starkville, MS, United States
The study aimed to adapt and validate two popular instruments on academic resilience in a collectivistic culture. One is a brief unidimensional scale (ARS_SCV), and another is a context-specific multidimensional scale (ARS_MCV). The participants were 569 high school students in China. Based on Messick’s validity framework, we provided evidence to support the construct validity of the newly developed scales. Results first indicated that both scales were reliable with high internal consistency and construct reliability. Then, the results of confirmatory factor analysis (CFAs) showed that ARS_SCV had a unidimensional factor structure and ARS_MCV had a four-factor structure. Multi-group CFAs then showed that both models were invariant across gender and socio-economic status (SES) levels. Results of correlations demonstrated that both scales significantly correlated with each other and with other external constructs (grit, academic self-efficacy, and learning engagement). The findings of this study contribute to the literature by proposing two instruments, which provide practitioners with options for specific assessments to measure academic resilience in a collectivist culture.
Introduction
Academic resilience is a crucial concept that educational and psychological researchers developed to apply the conventional idea of resilience to school academic issues (Rudd et al., 2021). Similar to resilience, scholars have argued that academic resilience can be considered a set of traits, outcomes, or processes concerning a specific research context (Olsson et al., 2003; Tudor and Spray, 2018; Rudd et al., 2021; Leung et al., 2022). Several definitions are available in the literature. For instance, Wang et al. (1994) defined academic resilience as “the heightened likelihood of success in school and other life accomplishments, despite environmental adversities brought about by early traits, conditions, and experiences” (p. 46). Similarly, Martin (2013) defined academic resilience as “a capacity to overcome acute and/or chronic adversity that is seen as a major threat to a student’s educational development” (p.488). No matter how academic resilience is conceptualized−as a personal asset, an advantaged quality, or a process, studies (e.g., Martin and Marsh, 2006; Cassidy, 2016; Li et al., 2019; Putwain et al., 2020) have demonstrated that academic resilience is related to students’ cognitive or mental outcomes positively, such as grit, academic self-efficacy, engagement in learning, and academic performance. Therefore, studying academic resilience is advocated to provide information on achieving academic success.
When reviewing the literature, most of the scales used to measure academic resilience were developed and validated in an individualistic culture, such as Spain (Meneghel et al., 2019) and the United Kingdom (Cassidy, 2016). However, cultural diversities may lead to different understandings or interpretations of academic resilience. That is, a valid and reliable scale in an individualistic culture does not necessarily work well in a collectivist context (Lee et al., 2010). In light of the lack of well-established academic resilience-related instruments in the context of collectivistic culture, this study attempts to fill this gap by validating a well-established academic resilience scales in the individualistic culture adapted to a collectivist culture.
Literature review
Tudor and Spray (2018) suggested that the appropriate concepts on academic resilience should be first targeted and that researchers should generate an effective and accurate measurement to promote academic resilience through intervention in school settings. Despite the similar definition of academic resilience, the inconsistent conceptualized constructs lead to the lack of prevalent measurements of academic resilience (Rudd et al., 2021). Several unidimensional or multidimensional scales of academic resilience exist in the literature. For example, Martin and Marsh (2006) developed one of the most popular unidimensional scales. The Academic Resilience Scale (ARS-6) is a brief attitudinal scale comprising six items to evaluate students’ capacity to deal with challenges, setbacks, and stress in learning settings. This scale was developed based on the individual’s psychological and educational factors together with several motivational theories, i.e., the theory of needs, motivational orientation theory, self-sufficiency theory, self-value motivation theory, and expectancy-value theory, leading the scale to capture positive mood or attitudes in response to the academic adversities (Martin and Marsh, 2006).
On the other hand, scholars have demonstrated that measures of academic resilience should include an individual’s emotional or behavioral reactions during specific disadvantaged events or situations (Friedland, 2005; Hoge et al., 2007), accounting for the generation of the multi-dimensional construct. The most well-known multidimensional construct scale is the Academic Resilience Scale-30 (ARS-30), developed by Cassidy (2016). The scale contained 30 items measuring three dimensions: perseverance, negative affect and emotional response, and reflecting and adaptive help-seeking. The ARS-30 is a process-based measure that employed a hypothetical but authentic academic adversity case vignette before responding to the scale items. Such a vignette depicts a typically adverse incident in the educational context, based on which the scholars can capture students’ cognitive, affective and behavioral responses toward the hypothetic academic setbacks (Cassidy, 2016).
The two scales have been translated into multiple languages and were found reliable and valid in most individualistic cultural contexts (Meneghel et al., 2019; Trigueros et al., 2020), but not in the collectivist cultural contexts. Such cultural diversities (i.e., cultural values and beliefs) might play a quintessential role in education. Due to the potential differences in the educational status quo among different cultural backgrounds, it is crucial to develop a culturally appropriate instrument of academic resilience in a collectivistic culture and contribute to academic resilience research in various cultural backgrounds. Influenced by traditional Confucian beliefs in a collectivistic culture, students in many East Asian countries (e.g., China, Korea, and Japan) may behave and show different emotional reactions when facing academic difficulties and challenges than Western students influenced by individualistic culture. Compared with students in western countries, students in East Asian countries tend to display characteristics of collectivist cultures (e.g., harmony and emotional dependence; Hofstede, 2001; Xu et al., 2014). They are more likely to monitor, regulate, and control negative emotions due to more substantial uncertainty avoidance and more emphasis on long-term orientation (e.g., persistence toward learning goals; Tsikriktsis, 2002; Moran et al., 2013; Xu, 2018).
Taking Chinese culture as collectivist culture as an example, Chinese culture emphasizes human malleability and the value of effort and perseverance in the face of academic hardship and adversity (Li, 2001; Leung, 2016). There is a traditional Chinese proverb, Ren Ding Sheng Tian (man’s determination can conquer nature). It refers to the fact that everyone can change their destiny regardless of his/her setbacks. Such beliefs may account for Chinese students to respond differently to their counterpart in individualistic countries when they experience setbacks. Hence, the current study aims to adapt and validate the self-report academic resilience scales developed by Martin and Marsh (2006), ARS-6 and Cassidy (2016), ARS-30 for Chinese students. The scales are unidimensional and multidimensional constructs that serve as more comprehensive and theoretically grounded measures than other scales (Tudor and Spray, 2018; Rudd et al., 2021). We named the academic resilience scales developed in the study ARS_SCV and ARS_MCV to distinguish from the original scales, ARS-6 (Martin and Marsh, 2006) and ARS-30 (Cassidy, 2016).
Furthermore, the present study focused on high school students. They are a group of students who need particular concern in linkage to their mental health. They face the university entrance examination, and such a challenge lets them experience the high strength of peer competition and academic pressure (Wang, 2001; Zhang et al., 2002). Helping them cope with academic setbacks and be resilient may increase their chances of academic success and affect their future or life-long success (Agasisti et al., 2018).
The current study
To conclude, inspired by the existing two popular English versions of academic resilience scales: Martin and Marsh’s (2006) unidimensional ARS-6 and Cassidy’s (2016) multidimensional ARS-30, the current study attempted to adapt both academic resilience scales to a collectivist culture. To examine the validity, we applied Messick’s (1989a,b, 1995) validation approach to provide construct validity evidence of the two academic resilience-related instruments with data from Chinese high school students. According to Messick (1995), construct validity is a unified framework that contains six aspects. We employed four of the six aspects of construct validity as statistical evidence to justify the adaptation and validation of the scales: content, structural, generalizability, and external. The content aspect refers to the evidence of whether the items are representative and relevant to the target factors. The structural aspect includes evidence of the structural relationship among items. The generalizability aspect shows whether the target measure has stable score properties and similar interpretations across various populations or contexts. The external aspect demonstrates associations of the tested measure with other measures (Wang et al., 2020).
Specifically, we planned to use academic self-efficacy, grit, and learning engagement as the criterion to examine the external aspect of construct validity. Several studies, such as Martin and Marsh (2006), Cassidy (2016) and Carlson (2001), have validated their scales by testing the association between self-efficacy and academic resilience and reported weak (i.e., r = 0.19, Martin and Marsh, 2006) to strong (i.e., r = 0.59, Carlson, 2001) correlations. Grit means achieving long-term goals passionately and industriously despite obstacles (Duckworth et al., 2007). Scholars have found that grit correlates with academic resilience [e.g., Calo et al., 2019 (r = 0.42); Chisolm-Burns et al., 2019 (rs = 0.20–0.46)]. Furthermore, studies have demonstrated that more academically resilient students tend to engage more in learning with very small to moderate effect sizes, rs ranging from 0.10 to 0.57 (e.g., Martin, 2012; Rajan et al., 2017; Li et al., 2019). Hence, the current study first adapted the English version of unidimensional (ARS-6) and multidimensional (ARS-30) academic resilience scales and translated them into Chinese, ARS-SCV and ARS-MCV, according to Chinese educational background and then evaluated the psychometric properties to determine their potential as the reliable and valid construct measures of academic resilience in Chinese high school populations.
Methods
Participants
Six hundred eleventh graders from one regular public high school were selected randomly from a northern city in China to participate in the study, and 569 students responded to the questionnaire (missing rate = 5.2%). Of the students in the sample, 273 were girls (48%), and 296 were boys (52%), ranging from 13 to 17 years old. Regarding family composition, 91.4% of the students came from complete families, with the rest from single-parent families or other families.
Instruments
ARS_MCV
ARS_MCV is a context-specific instrument concerning three domains of academic resilience (cognitive, affective, and behavioral). Regarding the content of ARS_MCV, we retained 18 items in the original English version of the Academic Resilience Scale-30 (ARS-30) developed by Cassidy (2016): eight items were derived from the ‘perseverance’ subdimension (cognitive domain), four items were derived from the ‘negative affect and emotional response’ subdimension (affective domain), and six items were derived from the ‘adaptive help-seeking’ subdimension (behavioral domain). The other 12 items were removed. The reasons for the removal of the other 12 items were presented in the Supplementary materials (see Supplementary Table S1).
A three-step translation process was employed to acquire a Chinese translation of the scale (Ægisdóttir et al., 2008). Two Ph.D. students independently translated the scale (including the vignette) into Chinese. Any differences in the translations were discussed and adjusted to a more accurate translation of the items. Then, the Chinese version was translated back into English by another two doctorate students. Finally, two experts independently evaluated the descriptions for the two translations again. The four doctoral students were English as a second language (ESL) learners and specialized in English education. The two experts had postgraduate degrees and have been working in education for many years, one is working at the Author’s school, and another is working at a top-tier teacher education university in China. Modifications were adjusted step by step until no disagreements emerged on the Chinese translation. For example, “I would keep trying” was changed into “I would keep trying until I come up with new solutions” for greater clarity. We also replaced the original item “I would seek encouragement from my family and friends” with two items, “I would seek encouragement from my classmates/friends” and “I would seek encouragement from my family,” to avoid double-barreled items.
Combined with the characteristics of the Chinese language and the suggestions by the experts, the original factor, reflecting and adaptive help-seeking, was divided into two factors: adaptive help-seeking (AHS) and self-reflection and adaption (SRA). We did this classification to better distinguish the self-effort as an adapted strategy and the help-seeking from others as another adapted strategy to cope with the stress and difficulties they encounter in academic situations (Rohrkemper and Corno, 1988; Newman, 1994). For AHS, items 8, 10, and 19 remained in the original adaptive help-seeking dimension, and item 4, “I would use the feedback to improve my work,” was borrowed from the original perseverance dimension. It was suggested to reflect teachers’ support consistently agreed upon by the two experts.
For the SRA, three items (items 3, 11, 13) remained in the original adaptive help-seeking dimension; two items were adapted from the original perseverance dimension to reflect SRA (items 16, 17). Specifically, the item “I would see the situation as a challenge” was changed to “I would adapt myself to this challenging situation.” The reason for the change is that in the Chinese background, considering failure as a challenge does not mean we will persist in learning to overcome it. This modification followed the adaption in Chisolm-Burns’s et al. (2019) study. We clarified that only the students who accepted and adapted to this challenge could be considered resilient. The item “I would try different ways to study” was changed to “I will try different ways to solve this dilemma.” We modified it to make it closer to the contextual feature. Experts indicated that the above two items were more suitable to reflect SRA as a behavioral-based feature rather than reflecting a perseverance-related feature. One item (item 14) was newly developed to represent students’ self-reflection and adaption, which was inspired by the existing literature in the field of resilience (King and Caleon, 2021) and self-regulated learning (Zimmerman and Schunk, 2001). Dimensions of perseverance (items 1, 6, 7, 15, 18, 20), negative affect and emotional response (items 2, 5, 9, 12) kept the rest original items. After experts’ evaluations and modifications, the first draft of the scale comprising 20 items, with four factors, was developed.
Next, we conducted a pilot test for the items on tenth eleventh graders, who were excluded from the final study. The students responded on a Likert scale from 1 (very unclear) to 5 (very clear) to rate the clarity of descriptions on each item. All the students could understand the meaning of each item; no further modifications were needed. The above operations of experts and students provided evidence for the content aspect of construct validity (Messick, 1989b). We adopted the 20 items of ARS_MCV in the final study. Students first read the vignette to assume they were experiencing academic adversity and challenge, then completed the scale on a 5-point Likert scale from 1 (very unlikely to do so) to 5 (very likely to do so). A higher score in each factor and overall score indicated more academic resilience in each domain, and in total, they perceived.
ARS_SCV
ARS_SCV is a short instrument concerning high school students’ overall academic resilience level. We replicated the same procedure to adapt the instrument of ARS_SCV. We retained all the six items of ARS-6 developed by Martin and Marsh (2006). After conducting the three-step translation process, we modified two items based on the experts’ suggestions. One item: “I’m good at bouncing back from a poor mark in my schoolwork.” was changed into “I’m good at bouncing back from academic setbacks (e.g., a poor mark) in my schoolwork.” Another item: “I do not let a bad mark affect my confidence.” was changed into “I do not let the learning setbacks (e.g., a bad mark) affect my confidence.” We modified both items for greater clarity. The pilot test for the items also reached a unanimous conclusion that all the students could understand the meaning of each item and that no further modification was needed. Confirming the content aspect of the construct validity by experts and students, we applied the six items of ARS_SCV in the final study. Students completed the scale on a 7-point Likert scale from 1 (strongly disagree) to 7 (strongly agree). A higher score reflected a higher degree of overall academic resilience.
Grit
We applied the self-reported Short Grit Scale (Grit-S) Chinese Version (Li et al., 2018) to test students’ gritty features. It contains two dimensions: consistency of interest (INT) and perseverance of effort (PER). Students responded to eight items on a five-point Likert scale ranging from 1 (not like me at all) to 5 (very much like me). Items in PER were regular-scored, and that in INT were reversely coded. A higher score represented that students possessed a higher level of gritty traits.
Academic self-efficacy
We evaluated students’ academic self-efficacy using the subscale of the Revised Chinese version of the Motivated Strategies for Learning Questionnaire (MSLQ-RCV, Lee et al., 2010). The MSLQ-RCV aims to explore students’ motivational beliefs in learning settings in the Chinese context. Participants completed seven items on a 7-point Likert scale ranging from 1 (not at all true of me) to 7 (very true of me). A higher score indicated a higher perception of students’ academic self-efficacy belief.
Learning engagement scale
We measured students’ learning engagement using the Reversed Learning Engagement Scale Chinese Version developed by Wei et al. (2014). Sixteen items were to examine the degree of learning engagement in students’ behavioral domain (5 items), emotional domain (5 items), and cognitive domain (6 items). Students completed the scale using a five-point Likert-type scale ranging from 1 (completely disagree) to 5 (completely agree). The total items’ average scores reflected the overall learning engagement performance.
Socio-economic status
Following the PISA 2009 (Organization of Economic Co-Operation and Development, 2012), we created a composite SES index by averaging the standardized scores of the following three variables: the highest level of parental education (Li, 2005), the highest occupational status of parents, and family belongings such as home educational resources (Organization of Economic Co-Operation and Development, 2012). The SES index could reflect the general view of student family resources. We followed Agasisti’s et al. (2018) study to divide the SES index into three categories: students in the top quarter as the high SES group, students in the bottom quarter as the low SES group, and the middle 50% of the students as the medium SES group.
All the items in the abovementioned scales were randomized. Table 1 showed that all the instruments above had good reliabilities and psychometric properties. The confirmatory factor analyzes (CFAs) supported each scale’s unidimensional or multidimensional structure.
Table 1. Summary of reliability and construct validity of the instruments.
Data collection procedures
Upon the ethics approval from the Institutional Review Board of the first author’s university, we sent a letter to the principals of the selected schools. We obtained the agreement to conduct the investigation. Then we informed all the selected students of the aim of this study. The students who agreed to participate in the study completed an online network questionnaire during class. The time for answering the questionnaire lasted about 15 min.
Data analytical procedures
We conducted all the analyzes in SPSS 20.0 and Amos 24.0. We first conducted preliminary analyzes to examine item-level descriptive statistical analysis on all items in ARS_MCV and ARS_SCV, including mean, standard deviation, skewness, kurtosis and corrected item-total correlations. We recommended that the skewness and kurtosis values within the ±1 representing the scores approximated a normal distribution (King and Caleon, 2021). Clark and Watson’s (1995) suggested that the corrected item-total correlation should be above 0.15.
We tested Cronbach’s αs to represent the internal consistency of ARS_MCV/ARS_SCV and all other measures in the current study. A higher coefficient indicated a better internal consistency of the items. We also examined construct reliability (CR) as an additional reliability indicator. Values higher than 0.70 indicated good reliability of the questionnaire (Hair et al., 2010).
We performed confirmatory factor analyzes (CFAs) of the ARS_MCV/ARS_SCV to provide evidence of the structural aspect of construct validity. We used multiple indices to evaluate the goodness of fit of the CFA models. Values of comparative Fit Index (CFI) and Tucker-Lewis index (TLI) greater than 0.90; the value of standardized root mean square residual (SRMR) less than 0.06; the value of root mean squared error of approximation (RMSEA) less than 0.08, were considered as the indicators of good fit of the data to the model (Hu and Bentler, 1999; Hooper et al., 2008; Byrne, 2010; Hair et al., 2010).
We examined the factorial invariance of the models across gender and socio-economic status (SES) levels to provide evidence of the generalizability of the construct validity. More specifically, we conducted one comparison to check whether the ARS_SCV and ARS_MCV functioned differentially across gender. We conducted three comparisons to check whether the ARS_SCV and ARS_MCV functioned differentially across SES levels: one for high level vs. medium level, one for high level vs. low level, and one for medium level vs. low level. Changes in CFI values less than 0.01 were suggested as the indicators of invariance (Cheung and Rensvold, 2002). Following the three incrementally constrained steps recommended by Dimitrov (2010), we examined the configural invariance (overall model structure invariance), measurement invariance, including metric (factor loadings invariance) and scalar (item intercepts invariance), and structural invariance (factor variances and covariances invariance) across groups. We conducted both CFA and factor invariance tests using maximum likelihood estimation.
We finally conducted the Pearson correlation to test the relationship between ARS_MCV/ARS_SCV scores and other instrument scores, providing evidence of the external aspect of construct validity.
Results
Item level analyzes
Table 2 presents the results of item-level analyzes. The distributional properties showed that each item stated approximately normal distribution. The values of skewness and kurtosis were below ±1. The corrected item-total correlations within items all above 0.15.
Table 2. Descriptive statistics for academic resilience scale.
The Cronbach’s alphas for the total academic resilience scale and each dimension are 0.73 [perseverance (PER)], 0.83 [self-reflection and adaption (SRA)], 0.75 [adaptive help-seeking (AHS)], 0.82 [negative affect and emotional response (NAE)], 0.90 (overall ARS_MCV), and 0.88 (overall ARS_SCV). Deleting any items would lead to lower internal consistency reliability. The values of construct reliability (CR) were all above 0.70, with 0.75 (PER), 0.82 (SRA), 0.76 (AHS), 0.81 (NAE), 0.94 (overall ARS_MCV), and 0.88 (overall ARS_SCV). Results of internal and construct reliabilities indicated an acceptable level of score consistency.
Structural aspect of construct validity
We performed two CFA models with respect to ARS_MCV. First is a unidimensional model with all 20 items loaded directly on the latent variable of academic resilience. The second is a four-factor model with the four latent models intercorrelated. The four latent variables are PER, AHS, SRA, and NAE. The unidimensional model did not convergent, but the four-factor model showed adequate fit indices, with χ2 = 415.76, df = 161, p < 0.001, χ2/df = 2.58, CFI = 0.94, TLI = 0.93, SRMR = 0.04, RMSEA = 0.053 [90% CI, 0.047–0.059] (see Figure 1). The correlation between the four latent factors ranged from 0.50 to 0.88. Taken together, these findings provided empirical support to the four-factor structure model of ARS_MCV.
Figure 1. First-order Model Structure of ARS-MCV. PER = Perseverance; SRA = Self-reflection and adaption; AHS = Adaptive help-seeking; NAE = Negative affect and emotional response (reversed Scoring). All modeled correlations and path coefficients are standardized and significant at p < 0.001.
In the four-factor model, we linked residual covariances between ARS1 and ARS20, ARS14 and ARS17, and ARS5 and ARS9. All these three covariances were statistically significant. The residual covariance between ARS1 (I would work harder) and ARS20 (I would see the situation as temporary) is related to the belief in perseverance. A possible explanation for this residual covariance is that if students believe that the academic setbacks are temporary and they can cope with them, they are inclined to work harder in the subsequent learning activities to obtain success. Regarding the residual covariance in the SRA dimension between ARS14 (I would reflect on the possible problems in my learning methods) and ARS17 (I would try different ways to solve this dilemma), a possible explanation is that reflecting the problems in learning methods may be one of the ways to solve this academic dilemma. With respect to the residual covariance in the NAE dimension between ARS5 (I would probably get depressed) and ARS9 (I would be very disappointed), the potential explanation is that such disappointment toward themselves reflected the despondent of failing to fulfill their academic expectations, which is similar to the emotional state of depression (Pollard, 2009).
Regarding the ARS_SCV, we conducted a CFA model with all six items loaded on one latent factor (see Figure 2). The statistical result suggested that the data of students’ responses fitted the unidimensional model structure of ARS_SCV [χ2 = 33.97, df = 8, p < 0.001, χ2/df = 4.97, CFI = 0.98, TLI = 0.97, SRMR = 0.03, RMSEA = 0.076 (90% CI: 0.051–0.083)]. We linked the residual covariance between ARS3 (I’m good at bouncing back from academic setbacks (e.g., a poor mark) in my schoolwork) and ARS5 (I do not let the learning setbacks (e.g., a bad mark) affect my confidence). This significant covariance could be justified by the fact that students who recover quickly from academic setbacks have more stable self-confidence, making their self-confidence less susceptible to academic setbacks (Martin and Marsh, 2006).
Figure 2. First-order model structure of ARS-SCV. All modeled correlations and path coefficients are standardized and significant at p < 0.001.
Generalizability of the construct validity
Tables 3, 4 present the results of the factorial invariance of ARS_MCV across gender and SES levels. First, the configural invariance model fitted the data well, indicating that the factor structure remained stable between males and females. Then, the metric invariance model fitted the data well, demonstrating that the invariance of factor loadings was satisfied between males and females. Next, the scalar invariance model fitted the data well, representing that invariance of item intercepts was satisfied between males and females. Finally, the data fit the structural invariance model well, indicating that the structural relations among latent factors remained stable across gender. The changes of all aforementioned models were relatively small: △CFIs < 0.01 (see details in Table 3).
Table 3. Testing for factorial invariance of ARS_MCV across gender (n = 569).
Table 4. Testing for Factorial Invariance of ARS_MCV across SES Levels (n = 569).
Findings of the factorial invariance test across SES levels also revealed that the construct of ARS_MCV with four latent factors had similar meanings for students who were involved across SES levels (high vs. medium, high vs. low, and medium vs. low), as shown by the values of CFI change less than 0.01. The explanation was similar to those in factorial invariance across gender (see details in Table 4). Taken together, the ARS_MCV was deemed invariant across gender and SES levels.
Tables 5, 6 present the factorial invariance of ARS_SCV across gender and SES levels. Invariance of the overall factor structure, factor loadings, item intercepts, and variances and covariances were also satisfied across gender and SES levels (high vs. medium, high vs. low, and medium vs. low). Findings revealed that males and females and students with different SES levels responded to ARS_SCV similarly.
Table 5. Testing for factorial invariance of ARS_SCV across gender (n = 569).
Table 6. Testing for factorial invariance of ARS_SCV across SES levels (n = 569).
External aspects of construct validity
Table 7 shows the results of the Pearson correlation analysis. Findings suggested positive correlations between dimensions of ARS_MCV, r ranging from 0.36 to 0.69, ps < 0.001. The total score of ARS_MCV also statistically significantly correlated with ARS_SCV (r = 0.70, p < 0.001). Dimensions together with the total score of ARS_MCV and total score of ARS_SCV also demonstrated positive relationships with other external variables, r ranging from 0.35 to 0.67, ps < 0.001. The above significantly positive relationships provided evidence for the external aspects of the construct validity of ARS_MCV and ARS_SCV.
Table 7. Pearson correlation coefficients among variables.
Discussion
In the current study, we adapted two popular academic resilience scales: ARS_MCV and ARS_SCV, to fit the collectivistic context to support the statement that academic resilience can be considered a unidimensional or multidimensional construct (Rudd et al., 2021). We further examined the psychometric properties of the adapted scales. The results demonstrated that both scales had good psychometric properties, and the scores of both scales significantly correlated with other constructs of academic and psychological outcomes. The findings extended the literature on the development of the instrument of academic resilience in a collectivist cultural context, as previous research in this field has been confined to individualistic cultural contexts. The full text of ARS_SCV and ARS_MCV in both English and Chinese can be seen in Supplementary materials (Supplementary Tables S2–S5).
Factor structure
Academic resilience can be described as a unidimensional latent construct. The ARS_SCV in the study supported the factor structure in the original English version (Martin and Marsh, 2006) and other language versions, i.e., the Turkish version (Kapikiran, 2012) and the Spanish version (Meneghel et al., 2019). ARS_SCV is a brief attitudinal scale that measures how well students respond to academic adversities, such as poor grades in schoolwork. Items in ARS_SCV are derived from theoretically relevant concepts (i.e., self-efficacy), and the design of the scale could reflect the most commonly cited definitions of academic resilience (Martin and Marsh, 2006).
Academic resilience can also be described as a multidimensional latent construct. The multidimensional academic resilience scale is a context-specific measure focusing on cognitive and emotional responses and involves students’ behavioral responses to hypothetical incidents (Cassidy, 2016). However, the ARS_MCV is slightly different from the original English version (Cassidy, 2016) of the multidimensional academic resilience scale and other versions, such as the Iran version (Ramezanpour et al., 2019) and the Philippines version (Lanuza et al., 2020).
Combined with the unique Chinese language environment, we modified the instrument vignette and item wording to reflect the adverse experiences and the potential cognitive, affective, and behavioral reactions of Chinese high school students. The final scale contained 20 items with four factors. We retained two factors from the original ARS_30. Factor 1, perseverance, captured students’ beliefs of hard-working and their willingness to insist on their plans and goals (Wagnild and Young, 1993; Cassidy, 2016). Factor 2, negative affect and emotional response, captured students’ adverse reactions, including anxiety, depression, and hopelessness, which kept pace with the negative effect in other well-known academic resilience scales (e.g., Martin and Marsh, 2006).
To better capture such behavioral responses in ARS_MCV, we divided the third factor of the original multidimensional scales of ARS_30, reflecting and adaptive help-seeking, into two factors: adaptive help-seeking from others and self-reflection and adaption (Wagnild and Young, 1993; Lamond et al., 2008; Cassidy, 2016). Despite specific differences between ARS_MCV and existing ARS_30 in other languages, the factors of ARS_MCV proposed in the study followed the theoretical definitions of academic resilience. They reflected the crucial multiple-dimensional academic resilience features similar to previous research.
Reliability and validity
We provided convincing evidence for both scales’ internal consistency. Cronbach’s alpha for the overall scales and dimensions in ARS_MCV were close to the coefficients reported in Cassidy’s (2016) study.
We found that Chinese high school students’ data fitted unidimensional and multidimensional academic resilience models well. Furthermore, our results indicated factorial invariance across males and females and students with various SES levels. In other words, the factor constructs, interpretations of ARS_SCV and ARS_MCV, and structural relations remain stable across those student samples. Consistent with previous research (e.g., Martin and Marsh, 2006; Cassidy, 2016; Chisolm-Burns et al., 2019; Li et al., 2019), we also found that factor scores of both scales significantly correlated with grit, academic self-efficacy, and learning engagement with moderate to strong effect sizes. Meanwhile, ARS_SCV also strongly correlated with dimensions and overall scores of ARS_MCV. The above findings supported that ARS_MCV and ARS_SCV are valid for measuring academic resilience in a collectivist cultural context.
Implications
This study contributes to the literature by adapting and validating two well-known measurements to measure academic resilience in a collectivist culture. Findings suggest that both unidimensional (with six items named ARS_SCV) and multidimensional measures (with 20 items named ARS_MCV) are reliable and valid for Chinese high school students.
Resilient individuals can overcome difficulties and ultimately achieve success (Rudd et al., 2021). Nevertheless, few valid instruments on academic resilience emerged under the collectivist cultural background. An accurate assessment of students’ academic resilience is crucial in nurturing their resilient characteristics, and scaffolding should be provided to help students develop the capacity to cope with academic setbacks. Validating and adapting the existing popular instruments of academic resilience (e.g., ARS-6 and ARS-30) with Chinese high school students can provide information on how to detect students’ reactions to academic setbacks more precisely in the collectivist context. These two Chinese scales on academic resilience: ARS_SCV and ARS_MCV, provide practitioners with options for specific assessments.
Limitation and future research
There are several limitations to the study. First, we only recruited students from Mainland China. It is not representative enough for students with a collectivist cultural background. There is a need to replicate the research across diverse socio-cultural contexts beyond China. Second, we only conducted a correlation between academic resilience and other relevant constructs, which prevented us from generating causal relationships between academic resilience and other constructs. Further studies can explore how academic resilience links with other variables, e.g., how academic resilience impact students’ psychological and academic outcomes; how academic resilience can be enhanced through suitable interventions. Finally, further research may include the measure of social desirability to control its potential effect on the responses.
Conclusion
This study contributes to the literature by adapting and validating two well-known measurements to measure academic resilience in Chinese settings. Findings suggest that both unidimensional (ARS_SCV) and multidimensional (ARS_MCV) measures are reliable and valid for Chinese high school students.
Data availability statement
The datasets presented in this article are not readily available because the data are not publicly available due to privacy or ethical restrictions. Requests to access the datasets should be directed to YC07111@connect.um.edu.mo.
Author contributions
TC wrote the draft of the manuscript. CW supervised and guided the whole procedure. JX revised the manuscript. All authors contributed to the article and approved the submitted version.
Funding
The Research & Development Grant for Chair Professor of the University of Macau (CPG2023-00022-FED).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2023.1114285/full#supplementary-material
References
Ægisdóttir, S., Gerstein, L. H., and Çinarbas, D. C. (2008). Methodological issues in cross-cultural counseling research: equivalence, bias, and translations. Couns. Psychol. 36, 188–219. doi: 10.1177/0011000007305384
Agasisti, T., Avvisati, F., Borgonovi, F., and Longobardi, S.. (2018). Academic Resilience: What Schools and Countries do to Help Disadvantaged Students Succeed in PISA. OECD Education Working Papers, No. 167. OECD Publishing, Paris, France.
Byrne, B. M.. (2010). Structural Equation Modeling with AMOS: Basic Concepts, Applications and Programming. 2nd. Abingdon: Taylor and Francis.
Calo, M., Peiris, C., Chipchase, L., Blackstock, F., and Judd, B. (2019). Grit, resilience and mindset in health students. Clin. Teach. 16, 317–322. doi: 10.1111/tct.13056
Carlson, D. J. (2001). Development and Validation of a College Resilience Questionnaire Publication No. 3016308 (Doctoral Dissertation, University of Nebraska). Pro Quest Dissertations and Theses Global.
Cassidy, S. (2016). The academic resilience scale (ARS-30): a new multidimensional construct measure. Front. Psychol. 7, 1–11. doi: 10.3389/fpsyg.2016.01787
Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 9, 233–255. doi: 10.1207/S15328007SEM0902_5
Chisolm-Burns, M. A., Spivey, C. A., Sherwins, E., Williams, J., and Phelps, S. (2019). Development of an instrument to measure academic resilience among pharmacy students. Am. J. Pharm. Educ. 83, 1373–1390. doi: 10.5688/ajpe6896
Clark, L. A., and Watson, D. (1995). Constructing validity: basic issues in objective scale development. Psychol. Assess. 7, 309–319. doi: 10.1037/1040-3590.7.3.309
Dimitrov, D. M. (2010). Testing for factorial invariance in the context of construct validation. Meas. Eval. Couns. Dev. 43, 121–149. doi: 10.1177/0748175610373459
Duckworth, A. L., Peterson, C., Matthews, M. D., and Kelly, D. R. (2007). Grit: perseverance and passion for long-term goals. J. Pers. Soc. Psychol. 92, 1087–1101. doi: 10.1037/0022-3514.92.6.1087
Friedland, N. (2005). “Introduction–the "elusive" concept of social resilience” in The Concept of Social Resilience. eds. N. Friedland, A. Arian, A. Kirschnbaum, A. Karin, and N. Fleischer (The Technion. Samuel Neaman Institute: Haifa), 7–10.
Hair, J. F., Black, W. C., Babin, B. J., and Anderson, R. E. (2010). Multivariate Data Analysis. 7th. Hoboken: Prentice Hall.
Hofstede, G. (2001). Culture’s Consequences: Comparing Values, Behaviors, Institutions, and Organizations a Cross Nations. 2nd. Thousand Oaks, CA: Sage.
Hoge, E. A., Austin, E. D., and Pollack, M. H. (2007). Resilience: research evidence and conceptual considerations for posttraumatic stress disorder. Depress Anxiety 24, 139–152. doi: 10.1002/da.20175
Hooper, D., Coughlan, J., and Mullen, M. (2008). Structural equation modelling: guidelines for determining model fit. Electron. J. Bus. Res. Methods 31, 449–459. doi: 10.3109/03005364000000039
Hu, L. T., and Bentler, P. M. (1999). Cutoff criteria for fit indices in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. 6, 1–55. doi: 10.1080/10705519909540118
Kapikiran, S. (2012). Validity and reliability of the academic resilience scale in Turkish high school. Education 132, 474–483.
King, R. B., and Caleon, I. S. (2021). School psychological capital: instrument development, validation, and prediction. Child Indic. Res. 14, 341–367. doi: 10.1007/s12187-020-09757-1
Lamond, A. J., Depp, C. A., Allison, M., Langer, R., Reichstadt, J., Moore, D. J., et al. (2008). Measurement and predictors of resilience among community-dwelling older women. J. Psychiatr. Res. 43, 148–154. doi: 10.1016/j.jpsychires.2008.03.007
Lanuza, M. H., Rizal, A. G., Aligam, N. P., and Uy, R. (2020). Contextualize program of strengthening academic resilience level of the secondary education students. J. Crit. Rev. 7, 286–292. doi: 10.31838/jcr.07.11.46
Lee, J. C. K., Yin, H., and Zhang, Z. (2010). Adaptation and analysis of motivated strategies for learning questionnaire in the Chinese setting. Int. J. Test. 10, 149–165. doi: 10.1080/15305050903534670
Leung, J. T. (2016). Maternal beliefs, adolescent perceived maternal control and psychological competence in poor Chinese female-headed divorced families. J. Child Fam. Stud. 25, 1815–1828. doi: 10.1007/s10826-016-0367-z
Leung, D. Y., Chan, A. C., and Ho, G. W. (2022). Resilience of emerging adults after adverse childhood experiences: a qualitative systematic review. Trauma Violence Abuse 23, 163–181. doi: 10.1177/1524838020933865
Li, J. (2001). Chinese conceptualization of learning. Ethos 29, 111–137. doi: 10.1525/eth.2001.29.2.111
Li, C. (2005). Prestige stratification in the contemporary China: occupational prestige measures and socio-economic index. Sociol. Res. 2, 74–102.
Li, C. C., Li, S. M., and Wei, C. F. (2019). The development and validation of academic resilience scale for undergraduate in Taiwan: Rasch analysis. Adv. Soc. Sci. Educ. Hum. Res. 369, 205–208. doi: 10.2991/ichess-19.2019.41
Li, J., Zhao, Y., Kong, F., Du, S., Yang, S., and Wang, S. (2018). Psychometric assessment of the short grit scale among Chinese adolescents. J. Psychoeduc. Assess. 36, 291–296. doi: 10.1177/0734282916674858
Martin, M. (2012). Situated Academic Engagement for Immigrant Origin Males: Student Centered Studies of the Relationship between Sources of Academic Stress/Support, Academic Engagement, and Academic Outcomes (Publication No. 3511442) (Doctoral Dissertation, New York University). Pro Quest Dissertations and Theses Global.
Martin, A. J. (2013). Academic buoyancy and academic resilience: exploring 'everyday' and 'classic' resilience in the face of academic adversity. Sch. Psychol. Int. 34, 488–500. doi: 10.1177/0143034312472759
Martin, A. J., and Marsh, H. (2006). Academic resilience and its psychological and educational correlates: a construct validity approach. Psychol. Sch. 43, 267–281. doi: 10.1002/pits.20149
Meneghel, I., Martínez, I. M., Salanova, M., and Witte, H. (2019). Promoting academic satisfaction and performance: building academic resilience through coping strategies. Psychol. Sch. 56, 875–890. doi: 10.1002/pits.22253
Messick, S. (1989a). Meaning and values in test validation: the science and ethics of assessment. Educ. Res. 18, 5–11. doi: 10.3102/0013189X018002005
Messick, S. (1989b). “Validity” in Educational Measurement. ed. R. L. Linn. 3rd ed (Stuttgart: Macmillan), 13–103.
Messick, S. (1995). Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am. Psychol. 50, 741–749. doi: 10.1002/j.2333-8504.1994.tb01618
Moran, C. M., Diefendorff, J. M., and Greguras, G. J. (2013). Understanding emotional display rules at work and outside of work: the effects of country and gender. Motiv. Emot. 37, 323–334. doi: 10.1007/s11031-012-9301-x
Newman, R. S. (1994). “Adaptive help seeking: a strategy of self-regulated learning” in Self-Regulation of Learning and Performance: Issues and Educational Applications. eds. D. H. Schunk and B. J. Zimmerman (Hillsdale, NJ: Lawrence Erlbaum Associates), 283–301.
Olsson, C. A., Bond, L., Burns, J. M., Vella-Brodrick, D. A., and Sawyer, S. M. (2003). Adolescent resilience: a concept analysis. J. Adolesc. 26, 1–11. doi: 10.1016/S0140-1971(02)00118-5
Organization of Economic Co-Operation and Development (2012). PISA 2009 Technical Report. Paris, France: PISA, OECD Publishing.
Pollard, A. (2009). Field of screams: difficulty and ethnographic fieldwork. Anthropol. Matters 11, 1–24. doi: 10.22582/am.v11i2.10
Putwain, D. W., Gallard, D., and Beaumont, J. (2020). Academic buoyancy protects achievement against minor academic adversities. Learn. Individ. Differ. 83-84:101936. doi: 10.1016/j.lindif.2020.101936
Rajan, S. K., Harifa, P. R., and Pienyu, R. (2017). Academic resilience, locus of control, academic engagement and self-efficacy among the school children. Indian J. Posit. Psychol. 8, 507–511.
Ramezanpour, A., Kouroshnia, M., Mehryar, A., and Javidi, H. (2019). Psychometric evaluation of the academic resilience scale (ARS-30) in Iran. Iran. Evol. Educ. Psychol. J. 1, 144–150. doi: 10.29252/ieepj.1.3.144
Rohrkemper, M., and Corno, L. (1988). Success and failure on classroom tasks: adaptive learning and classroom teaching. Elem. Sch. J. 88, 297–312. doi: 10.1086/461540
Rudd, G., Meissel, K., and Meyer, F. (2021). Measuring academic resilience in quantitative research: a systematic review of the literature. Educ. Res. Rev. 34:100402. doi: 10.1016/j.edurev.2021.100402
Trigueros, T., Magaz-González, A. M., García-Tascón, M., Alias, A., and Aguilar-Parra, J. M. (2020). Validation and adaptation of the academic-resilience scale in the Spanish context. Int. J. Environ. Res. Public Health 17, 3779–3790. doi: 10.3390/ijerph17113779
Tsikriktsis, N. (2002). Does culture influence website quality expectations? An empirical study. J. Serv. Res. 5, 101–112. doi: 10.1177/109467002237490
Tudor, K. E., and Spray, C. M. (2018). Approaches to measuring academic resilience: a systematic review. Int. J. Res. Stud. Educ. 7, 41–61. doi: 10.5861/ijrse.2017.1880
Wagnild, G. M., and Young, H. M. (1993). Development and psychometric evaluation of the resilience scale. J. Nurs. Meas. 1, 165–178.
Wang, Y. N. (2001). A study on the pressure of college entrance examination and personality of senior high school students. Psychol. Sci. 24, 104–105.
Wang, M., Haertal, G., and Walberg, H. (1994). “Educational resilience in inner cities” in Educational Resilience in Inner-city America: Challenges and Prospects. eds. M. Wang and E. Gordon (Hillsdale, NJ: Lawrence Erlbaum Associates), 45–72.
Wang, C., Zhang, J., Lambert, R. G., Wu, C., and Wen, H. (2020). Comparing teacher stress in Chinese and US elementary schools: classroom appraisal of resources and demands. Psychol. Sch. 58, 569–584. doi: 10.1002/pits.22464
Wei, J., Liu, R., He, Y., Tang, M., Di, M., and Zhuang, H. (2014). Mediating role of learning persistence and engagement in relations among self-efficacy, intrinsic value and academic achievement. Stud. Psychol. Behav. 12, 326–333.
Xu, J. (2018). Emotion regulation in math homework: an empirical study. J. Educ. Res. 111, 1–11. doi: 10.1080/00220671.2016.1175409
Xu, J., Du, J., and Fan, X. (2014). Emotion management in online groupwork reported by Chinese students. Educ. Technol. Res. Dev. 62, 795–819. doi: 10.1007/s11423-014-9359-0
Zhang, X. K., Zhang, L., and Ma, L. W. (2002). The relationship among cognitive appraisal, psychological control, social support and stress facing college entrance examination in high school students. Psychol. Dev. Educ. 3, 76–81.
Keywords: academic resilience, scale development, collectivistic culture, Chinese high school, psychometric properties
Citation: Cui T, Wang C and Xu J (2023) Validation of Academic Resilience Scales Adapted in a Collective Culture. Front. Psychol. 14:1114285. doi: 10.3389/fpsyg.2023.1114285
Edited by:
Ana Belén Barragán Martín, University of Almeria, SpainReviewed by:
Ma Dongmin, North China University of Water Conservancy and Electric Power, ChinaJosé Luis Ortega-Martín, University of Granada, Spain
Copyright © 2023 Cui, Wang and Xu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Chuang Wang, wangc@um.edu.mo