Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 18 December 2020
Sec. Quantitative Psychology and Measurement

Psychometric Analysis of a School Social Climate Scale: Input Elements for the Investigation and Promotion of Well-Being

  • 1Núcleo Científico Tecnológico en Ciencias Sociales y Humanidades, Universidad de La Frontera, Temuco, Chile
  • 2Departamento de Producción Agropecuaria, Universidad de La Frontera, Temuco, Chile

School social climate from a multidimensional perspective is a focus of great interest in international research and educational and well-being public policies due to the high prevalence of interpersonal violence in adolescents, currently considered a global public health problem. The object of the present study was to assess the psychometric measurement capacity of a set of items to evaluate school social climate in the Student Context Questionnaire of the Chilean Education Quality Measurement System. The sample analyzed consisted of second-year high school students who replied to a Student Context Questionnaire in 2015 (n~158,572). Exploratory and confirmatory factorial analyses were carried out in a measurement model to identify the presence of constructs and items of high homogeneity. The results showed an acceptable to a good fit in the final model, which consisted of 15 latent constructs, and also showed invariance for school administrative dependencies and invariance for sex. All the above implies a contribution to the public organisms that create standardized tests along with the investigation in compulsory secondary education measurement to prevent future violent behaviors, contribute to reducing interpersonal violence, and improve the well-being of the educational community.

Introduction

School social climate (SSC) has been extensively studied by empirical and theoretical means, especially considering reports of negative factors associated with interpersonal violence in adolescents, which has generated concern in health and education policies (Senanayake et al., 2019). From an ecological perspective, it is understood as the affective and cognitive perceptions of the social interactions, relationships, values, and beliefs of students, teachers, administrators, and personnel in a school (Bronfenbrenner, 1989; Rudasill et al., 2018).

School violence is defined as any physical or psychological assault, or threat of assault, between participants in a school (Akiba et al., 2010). This behavior is present from the earliest years of schooling (Albaladejo-Blázquez et al., 2013) and serves as a predictor of the quality of social coexistence in schools (Córdoba et al., 2016) and academic performance (Bravo-Sanzana et al., 2020). Recent studies have shown that the relation between school attachment and violent behavior is mediated over time by violent attitudes (Varela et al., 2018). Another recent study indicated that adverse childhood experiences increase the risk of violence perpetration and victimization, suggesting that schools should evaluate adverse childhood experiences systematically to increase access to intervention services (Forster et al., 2017).

Furthermore, interpersonal violence in adolescents is sufficiently prevalent to be considered a world public health problem (Senanayake et al., 2019). This category includes other types of violence, such as adolescent dating violence (Vivolo-Kantor et al., 2016) and the school violence suffered by adolescents who are dissatisfied with their socially assigned gender and are at higher risk of staying away from school due to their concerns about safety and their experiences of harassment. This situation requires further research into structural factors such as SSC to orient the development of prevention efforts (Klemmer et al., 2019).

The literature identifies other negative factors associated with school life, such as bullying (Machado et al., 2015; Baldry et al., 2017; Thornberg et al., 2017), cyberbullying (Estévez et al., 2018; López-Castedo et al., 2018), and discrimination (Molla, 2016; Yupanqui et al., 2016; Trucco and Inostroza, 2017).

The creation of this construct has received attention as a way of improving academic performance (Cocorada et al., 2017; Bravo-Sanzana et al., 2019b; Laurito et al., 2019), reducing problem behaviors (Cornell and Huang, 2016; Gaias et al., 2017; Konold et al., 2017; Moratto et al., 2017; Valdés-Cuervo et al., 2018), developing environments with a lower perception of stress and greater effectiveness and job satisfaction among teachers (Malinen and Savolainen, 2016; Bravo-Sanzana et al., 2019a), and especially recognizing the impact of school climate on well-being experience and school engagement (Lombardi et al., 2019). Likewise, school climate is important for promoting student life satisfaction and for preventing the negative consequences associated with being bullied (Lázaro-Visa et al., 2019), as well as the association between SSC and school mental health. Recent reviews and studies report mental health-related factors such as low self-esteem, low motivation, and low interest in going to school, insecurity, and psychiatric problems such as depression, anxiety, and even suicide (Klomek et al., 2010; Suldo et al., 2012; Kutsyuruba et al., 2015; Bravo-Sanzana et al., 2016; Aldridge and McChesney, 2018). In this context, a study on violence against teachers suggests that SSC can play a role in reducing the probability of teacher victimization (Huang et al., 2017). This represents a clear need for proper measurement of this construct to obtain the input information needed by governments and schools to make evidence-based decisions on general and contextual issues.

School Social Climate From the Perspective of Ecological Systems Theory

Conceiving school space as a type of environment situates us in the complex relations and interrelations of all the social agents and factors involved. In psychological terms, the ecological environment is the factor that most influences human behavior (Bronfenbrenner, 1979). This is a set of nested structures organized at different interacting levels: microsystem, mesosystem, exosystem, and macrosystem, with each level containing the next (Bronfenbrenner, 1987). This ecological model of society has been adapted to the school context by different authors because of its usefulness in understanding social processes within the school (Thapa et al., 2013; Benbenishty et al., 2016).

The concept of SSC is still under construction because no consensus has yet been reached on its definition and the constructs it contains. Its theoretical construct has been little discussed. For example, the review by Thapa et al. (2013) focused on five essential constructs of SSC: safety, relations, teaching and learning, institutional environment, and the school improvement process. However, the recent literature suggests other constructs that have provided empirical evidence about SSC, such as the classroom climate created by teachers (Alonso-Tapia and Nieto, 2019), the effectiveness of teachers in managing student behavior (Malinen and Savolainen, 2016), or components of students' subjective well-being (Benavente et al., 2017). In this context, Rudasill et al. (2018) proposed a theoretical model to orient studies on SSC called Systems View of School Climate, based on the theoretical framework of the Ecological Systems Theory of Bronfenbrenner (1989, 1992). Rudasill et al. (2018) also considered the deconstruction of earlier models and empirical research about SSC to summarize the existing literature, orient research, and provide a widely applicable framework for research into this construct.

This integral framework places individuals, i.e., students, teachers, education assistants, and the like, in the center of a series of nested, interactive contexts (nested structures according to Bronfenbrenner, 1987), which function synergistically to support or discredit students' experiences in school. The authors incorporate nanosystems, a new component for examining interactions between subsystems within schools, such as classrooms.

In this theoretical framework, the microsystem represents the school, the space in which the SSC develops out of the affective and cognitive perceptions of its members and where influential factors converge. Here, nanosystems, e.g., peer groups or sports teams in the school, are nested in the microsystems and are exclusive to the school and each context. The mesosystem is created by the interaction of the school and family microsystems, as well as other factors that influence the SSC. Exosystems, macrosystems, and synchronization systems also include broader factors that can help identify influences in the school climate (Rudasill et al., 2018).

Thus, the SSC construct exists within the school microsystem; however, its formation is complex as it may be the result of multiple influences on the proximal, i.e., personal interactions by direct contact and distal levels of the system where the SSC does not exist, yet these may be considered potential influences on its development. Furthermore, the characteristics of the school's students, teachers, and personnel may be considered factors related to the internal development of the SSC. Other elements form part of the microsystem, such as leadership, teaching practices, and the physical environment, which may be related to perceptions of the SSC. Students' families, the community, other institutions, education policies, and social norms all form part of the theoretical framework as significant variables and additional mechanisms influencing the SSC. Finally, the chronosystem or time (Bronfenbrenner and Ceci, 1994) is incorporated to explain and consider how events in life can direct interactions and influence relations; this could be shown by longitudinal studies of the construct (Rudasill et al., 2018).

Measuring the Construct

There is a wide range of scales for measuring the SSC; although they present good psychometric evidence, they may lack a broad theoretical basis to support the construct (Trianes et al., 2006; Gálvez Nieto et al., 2014); they may not be based on a multidimensional perspective (Benbenishty and Astor, 2005) or even those with a multidimensional perspective may fail to incorporate an important dimension, such as teacher–student relations (Wang and Degol, 2015) or the student's sense of identity with the school (Elipe et al., 2018). Although there are recent advances in measurement with a solid theoretical base (Gálvez-Nieto et al., 2020), according to Kearney et al. (2020), studies regarding school climate assessment have been marked, for example, by limited sample sizes or narrow developmental levels.

Thus, the SSC construct is complex and must be measured from a multidimensional perspective; this is why social interactions are established at the school level, as schools develop unique environments and at the same time influence social relations and interactions as well as individual behaviors. It is in these unique environments where relevant factors, either positive or negative, emerge to better understand the dynamics of the SSC by providing insight on how to intervene in schools to foster school environments that will promote the learning and the well-being of the educational community.

Based on the theoretical platform presented earlier, this study's object is to make an empirical evaluation of a measurement model to identify the constructs and items of greatest convergence. This has implications for educational policy management and for the empirical and theoretical inputs for investigating SSC.

Methods

This research is instrumental (Montero and León, 2002), making it a secondary study, quantitative, exploratory, and correlational, with a non-experimental, cross-sectional design (Toro and Parra, 2010).

Database

The analyzed information was obtained from the database of the Chilean Education Quality Measurement System (SIMCE). The questionnaires were answered by 195,509 second-year high school students (second year of compulsory secondary education, ESO). Of these respondents, 37% presented complete data responding to all the items on all the variables associated with SSC in the Student Context Questionnaires attached to the SIMCE tests. Non-parametric multiple imputations were applied with random forest bootstrap (Stekhoven and Bühlmann, 2012), using the R MissForest package in cases where fewer than 20% of the variables were missing and where no whole item groups for an entire construct were left blank. Thus, the final database for statistical analysis consisted of 158,572 students.

The mean age was 15.33 (SD = 0.602) with a minimum of 14 and a maximum of 19 years. Fifty-one percent were reported as girls and 49% as boys. Of the students, 32.7% were enrolled in schools run by a municipality, whereas 58.8% studied in state-subsidized private schools and 8.5% in fee-paying private schools.

Instruments

Secondary information was used from data recorded in the Student Context Questionnaires from the SIMCE 2015 (CCES2015); these answers were in pencil and paper format. The questionnaire consisted of 414 items, most of them in ordinal scale responses grouped into 42 categories (Table is attached as complementary material). It was designed to obtain information on the students' school and family environment. It contains indicators in the personal and social spheres, including the SSC, described by the Chilean Education Ministry as school social coexistence, as a management instrument (Agencia de Calidad de la Educación, 2015).

The scales used for this study are related to variables important for evaluating the SSC (see Table 1). Thus, the authors of this study configured scales, categorizing items according to their explicit or implicit origin and compared them with the literature review referring to SSC. Seventy-seven items were selected and grouped into 14 categories, all directly related to SSC factors.

TABLE 1
www.frontiersin.org

Table 1. Description of the SSC constructs according to the SIMCE 2015 evaluation scales.

Data Analysis

To investigate the existence of evidence supporting the validity of the scale structure, the information was separated into two samples for estimation and validation with 67 and 33%, respectively, as recommended by Xu and Goodacre (2018) using the random simple cross-validation method that corresponds to the most commonly used data splitting method to estimate the exploratory factor analysis (EFA) and validate the confirmatory factorial analysis (CFA). In the first sample, the EFA of the ordinal variables was applied to the polychoric correlation matrix, using unweighted least squares to estimate factors and parallel analysis to determine the number of factors to be retained using the Factor program (Lorenzo-Seva and Ferrando, 2006). In the second sample, the CFA was carried out using the Psych R package (Revelle, 2018), with an unweighted least squares estimation on the polychoric correlation matrix.

To determine the reliability and the internal consistency of the scale, the Cronbach's alpha and McDonald's omega 1999 coefficients and the average variance extracted were calculated.

The following indices were used to assess the fit of the models to the data: comparative fit index (CFI), Tucker–Lewis index (TLI), and root mean square error of approximation (RMSEA). For CFI and TLI, the fit of the model was considered adequate with values higher than 0.90 or 0.95 (Schreiber et al., 2006), whereas for RMSEA, the fit was considered reasonable with values below 0.08 (Hooper et al., 2008).

Finally, to evaluate the scale's stability between male and female students, a measurement invariance analysis was applied to ordinal variables using multigroup analysis. The configural invariance and the measurement invariance, i.e., weak, strong, and strict, were scored according to Dimitrov's 2010 proposals. To determine the satisfaction of the configural invariance, the same goodness-of-fit indices were used as described for CFA. The satisfaction of the different levels of measurement invariance was established when the CFI's delta, i.e., the difference between the CFI of the most and least restricted models, was below 0.01 (Cheung and Rensvold, 2002). The analyses were performed using the Mplus software 7.1 (Muthén and Muthén, 1998–2012).

Results

The parallel analysis determined the presence of 15 latent constructs based on the selection of the items that did not present crossed loads with respect to a quartimin rotation. Ten items were eliminated because they presented crossed correlations in the exploratory factorial analysis stage. Construct 22, school violence, was separated into two subdimensions: direct school violence such as fights, threats, or physical aggression and indirect school violence such as theft, ill-intentioned rumors, mockery, or insults. As a result of the EFA, the scale was established with 15 constructs and 67 items. When this structure was fitted to the data in a CFA in the estimation sample, good goodness-of-fit indices were obtained (RMSEA = 0.021; CFI = 0.984; TLI = 0.982), reflecting the good fit of the model to the data. The estimations of the standardized factorial loads of the items were statistically significant and presented values higher than 0.40. The results are presented in Table 2 and the reliability statistics and omegas in Table 3.

TABLE 2
www.frontiersin.org

Table 2. Constructs of SSC and saturations of the items of which it is composed. All loadings are significant (P ≤ 0.001).

TABLE 3
www.frontiersin.org

Table 3. Reliability and alpha and omega coefficients.

Each scale presented good levels of reliability, with Cronbach's alpha values between 0.66 and 0.94 and McDonald's omega values between 0.66 and 0.94. The average variance extracted presented values below 0.50 in 5 out of the 12 constructs; the lowest value was 0.39, which implies that more than half of the variance of these constructs is not explained by the items of which it is composed (Table 3).

The measurement invariance analysis by students' sex showed that strict invariance was satisfied (Table 4). This establishes the stability of the scale measurement in students of both sexes, meaning that the results obtained in each dimension can be compared between groups by sex. Any variation between groups in any item is due only to variations in the latent variable of each group.

TABLE 4
www.frontiersin.org

Table 4. Measurement invariance of items about SSC by sex in estimation and validation samples.

The CFA with the validation sample showed that the model presented a good fit with the data (RMSEA = 0.015; CFI = 0.990; TLI = 0.989) and good levels of reliability, with omega and alpha values between 0.66 and 0.93 for the constructs of the scale. The measurement invariance analysis by students' sex also showed that strict invariance was satisfied (Table 4). This corroborated the stability of the scale measurement in students of both sexes, allowing the results obtained in each dimension to be compared between groups by sex.

The model presents a good fit for every school administrative dependency category. The CFA for municipal, i.e., public, schools shows good fit indices (RMSEA = 0.027; CFI = 0.910; TLI = 0.905). The same holds for state-subsidized private schools (RMSEA = 0.025; CFI = 0.914; TLI = 0.909). In the case of fee-paying private schools, the fit is poorer (RMSEA = 0.025; CFI = 0.891; TLI = 0.885) but acceptable; there may be a sample size effect here, as this type of school administration is smaller than the other school administration sample sizes. In fact, the sample size of municipal schools is 21,827, state-subsidized private schools 40,260, and fee-paying private schools 5,461. Nonetheless, the measurement invariance analysis shows regular fit indices for configural invariance, with a good RMSEA level but poor CFI and TLI (RMSEA = 0.044; CFI = 0.859; TLI = 0.853). Nevertheless, the CFI deltas show a slight decrease of fit across the measurement invariance levels (Table 5), reaching the strict measurement invariance. This implies the model can be used through the different school administrative dependencies.

TABLE 5
www.frontiersin.org

Table 5. Measurement invariance of items about SSC by school administrative dependency in the validation sample.

Discussion

The object of this study was to assess the psychometric measurement capacity of a set of items to evaluate the SSC in the SIMCE through exploratory and confirmatory factorial analyses to identify the presence of constructs and items with high homogeneity or convergence.

For the constructs Promotion of Participation, Climate in the Classroom, Discrimination, Student-Teacher Violence, and Indirect School Violence, more than half of the variance could not be explained by the items of which they are composed, indicating that they need to be reviewed by the managers of the SIMCE standardized test. Special mention must be made of the construct School Violence, one of the most important variables for academic performance in Latin American countries, particularly Chile (LLECE, 2008; Trucco and Inostroza, 2017) and one of the most frequently reported variables in the study of the construct. This variable was divided into two constructs alluding to an explicitly aggressive form of violence: Direct School Violence; and School Violence expressed in rumors, threats, and theft: Indirect School Violence. These constructs operate on the SSC scale and contribute together with the rest, presenting a 56% variance, which gives them good fit and reliability. The present study provides a good basis for future work with this and the other constructs.

Based on this study's results, it may be concluded that the instrument measures SSC adequately, showing the existence of differentiation in the constructs, which theoretically configure this construct with different degrees of correlation.

The model with 15 correlated factors indicates that the SSC comprises different processes, all closely related, but which can be reported separately (Lara et al., 2018).

The instrument presents good internal consistency in each of the constructs indicated, allowing students at risk of SSC to be identified. Results offer input for the orientation of school improvement projects and others related to managing social coexistence in school. From this perspective, significantly low evaluations on the scale may indicate adverse school environments (Moratto et al., 2017), and it will be possible to identify which of the constructs require intervention in school planning. In turn, the significantly high scores allow the school to identify factors that could be considered strengths and areas that are still important for orienting management of the school's social coexistence policy.

Tables 6, 7 show quartiles for the total scale and subscales, respectively. They were calculated on the sum of the answers to the items that comprise each subscale and the sum of all subscales (DiStefano et al., 2009).

TABLE 6
www.frontiersin.org

Table 6. Quartiles for the total scale.

TABLE 7
www.frontiersin.org

Table 7. Quartiles for subscales.

The SSC measurement provides both educational centers and local government with inputs that will enable them to establish a school's network strategies to work cooperatively on social coexistence and assess the effectiveness of intervention programs (MINEDUC, 2015).

One of the strengths of this study is that the system was validated with a sample of Chilean adolescents belonging to schools of the three types existing in the Chilean educational system, i.e., public, subsidized private, and fee-paying private, and considering the type of teaching; therefore, it is representative, and the results are reliable. In addition, results also show invariance for school administrative dependencies and invariance for sex. This implies the model can be used through the different types of schools and with equal accuracy in both sexes.

A second strength is that the instrument represents a wide range of factors related to the SSC, giving it a more comprehensive view of the construct.

One of the study's limitations is the need not only to measure the SSC from the student's perception but also to incorporate other key actors of the educational community to identify contextual factors.

Conclusion

The results illustrated the adjustment and reliability values of the measure and factorial invariance across school administrative dependencies and invariance for sex.

We conclude that the SSC scale introduced in the SIMCE 2015 Student Context Questionnaire permits greater understanding of the SSC construct and enables public policy and research into measuring SSC to make decisions based on reliable and valid input to generate other instruments, programs, and interventions that will help to ensure improvements and well-being in school environments.

Future work should focus on exploring the perceptions of school climate of other key actors in the educational community to identify contextual factors and, in addition, linking findings from the scale to other key school variables such as social–emotional competency.

Data Availability Statement

The data analyzed in this study is subject to the following licenses/restrictions: The databases of the Chilean Education Quality System, SIMCE, are confidential, they cannot be shared. Requests to access these datasets should be directed to bW9uaWNhdml2aWFuYS5icmF2byYjeDAwMDQwO3Vmcm9udGVyYS5jbA==.

Ethics Statement

The studies involving human participants were reviewed and approved by 170/15 Comité de Ética de la Universidad de La Frontera. Written informed consent from the participants' legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.

Author Contributions

MB-S created the research question, conducted a bibliographic search, theoretical framework, methodological design, and contributed to the discussion. EM-Z contributed methodological design, performed the data analysis, and generated the results. HM contributed to the methodological design and data analysis. All authors contributed to the article and approved the submitted version.

Funding

This work was produced within the framework of FONDECYT INICIA Project No. 11150665. We appreciate the collaboration of the Vice-Rector's Office for Research and Postgraduate Studies in financing this publication.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Agencia de Calidad de la Educación (2015). Programa de Aplicación, Evaluaciones de Aprendizaje SIMCE. Available online at: http://archivos.agenciaeducacion.cl/biblioteca_digital_historica/orientacion/2015/programa_dirmedia_2015.pdf

Akiba, M., Shimizu, K., and Zhuang, Y. (2010). Bullies, victims, and teachers in Japanese middle schools. Comp. Educ. Rev. 54, 369–392. doi: 10.1086/653142

CrossRef Full Text | Google Scholar

Albaladejo-Blázquez, N., Ferrer-Cascales, R., Reig-Ferrer, A., and Fernández-Pascual, M.-D. (2013). Does school violence occur in pre-school and primary education? A proposal for assessment and management. Ann Psychol. 29, 1060–1069. doi: 10.6018/analesps.29.3.158431

CrossRef Full Text

Aldridge, J., and McChesney, K. (2018). The relationships between school climate and adolescent mental health and well-being: a systematic literature review. Int. J. Educ. Res. 88, 121–145. doi: 10.1016/j.ijer.2018.01.012

CrossRef Full Text | Google Scholar

Alonso-Tapia, J., and Nieto, C. (2019). Classroom emotional climate: nature, measurement, effects and implications for education. Rev. Psicodidáctica 24, 79–87. doi: 10.1016/j.psicod.2018.08.002

CrossRef Full Text | Google Scholar

Baldry, A. C., Farrington, D. P., and Sorrentino, A. (2017). School bullying and cyberbullying among boys and girls: roles and overlap. J. Aggression Maltreat. Trauma 26, 937–951. doi: 10.1080/10926771.2017.1330793

CrossRef Full Text | Google Scholar

Benavente, M., Cova, F., Pérez-Salas, C., Varela, J., Alfaro, J., and Chuecas, J. (2017). Psychometric properties of the brief adolescents' subjective well-being in school scale (BASWBSS) in a sample of chilean adolescents. Rev. Iberoamericana Diagnóstico y Eval. Psicol. 48, 53–65. doi: 10.21865/RIDEP48.3.05

CrossRef Full Text

Benbenishty, R., and Astor, R. (2005). School Violence in Context: Culture, Neighborhood, Family, School, and Gender. Oxford: University Press.

PubMed Abstract | Google Scholar

Benbenishty, R., Astor, R. A., Roziner, I., and Wrabel, S. L. (2016). Testing the causal links between school climate, school violence, and school academic performance: a cross-lagged panel autoregressive model. Educ. Res. 45, 197–206. doi: 10.3102/0013189X16644603

CrossRef Full Text | Google Scholar

Bravo-Sanzana, M., Miranda-Zapata, E., Huaiquián, C., and Miranda, H. (2019a). School social climate in students of la Araucanía Region, Chile. J. Sport Health Res. 11(Suppl. 2), 23–40.

Bravo-Sanzana, M., Pavez, M., Salvo-Garrido, S., and Mieres-Chacaltana, M. (2019b). Self-efficacy, expectations and school violence as mediators of learning in Mathematics. Revista Espacios 40:28.

Bravo-Sanzana, M., Salvo, S., and Mieres, M. (2016). El clima social escolar en el logro de aprendizajes y el desarrollo integral, ς‘cómo afecta a la salud mental de los niños y niñas? Salud Pública Méx 58, 597–599. doi: 10.21149/spm.v58i6.7913

PubMed Abstract | CrossRef Full Text | Google Scholar

Bravo-Sanzana, M., Salvo, S., Miranda, H., and Bangdiwala, S. (2020). What school social climate factors affect mathematics performance in secondary school students? A multilevel analysis. Culture Educ. 32, 506–528. doi: 10.1080/11356405.2020.1785138

CrossRef Full Text | Google Scholar

Bronfenbrenner, U. (1979). The Ecology of Human Development: Experiments by Nature and Design. Cambridge, MA; London: Harvard University Press. Available online at: https://khoerulanwarbk.files.wordpress.com/2015/08/urie_bronfenbrenner_the_ecology_of_human_developbokos-z1.pdf

PubMed Abstract | Google Scholar

Bronfenbrenner, U. (1987). La ecología del Desarrollo Humano. Barcelona: Ediciones Paidós.

Bronfenbrenner, U. (1989). The developing ecology of human development: paradigm lost or paradigm regained. Paper Presented at the Biennial Meeting of the Society for Research in Child Development (Kansas City, MO).

Bronfenbrenner, U. (1992). “Ecological systems theory,” in Six Theories of Child Development: Revised Formulations and Current Issues, ed R. Vasta (London: Jessica Kingsley Publishers), 187–249.

Google Scholar

Bronfenbrenner, U., and Ceci, S. J. (1994). Nature-nurture reconceptualized: a bioecological model. Psychol. Rev. 101, 568–586. doi: 10.1037/0033-295X.101.4.568

Cheung, G. W., and Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equat. Model. 9, 233–255. doi: 10.1207/S15328007SEM0902_5

CrossRef Full Text | Google Scholar

Cocorada, E., Cazan, A., and Orzea, I. E. (2017). School climate and school achievement in the romanian secondary education. J. Psychoeduc. Assess. 36, 516–522. doi: 10.1177/0734282916683285

CrossRef Full Text | Google Scholar

Córdoba, F., Del Rey, R., Casa, J., and Ortega, R. (2016). Students' rating of school climate in elementary schools: the value of peer networks. Psicoperspectivas. 16, 79–90.

Cornell, D., and Huang, F. (2016). Authoritative school climate and high school student risk behavior: a cross-sectional multi-level analysis of student. J. Youth Adolesc. 45, 2246–2259. doi: 10.1007/s10964-016-0424-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Dimitrov, D. (2010). Testing for factorial invariance in the context of construct validation. Measure. Eval. Counsel. Dev. 43, 121–149. doi: 10.1177/0748175610373459

CrossRef Full Text | Google Scholar

DiStefano, C., Zhu, M., and Mindrila, D. (2009). Understanding and using factor scores: considerations for the applied researcher. Pract. Assess. Res. Eval. 14, 1–11. doi: 10.7275/da8t-4g52

CrossRef Full Text

Elipe, P., Casas, J. A., Rey, R., Del Ortega-ruiz, R., Cerda, G., and Pérez, C. (2018). Validation and cross-cultural robustness of the School-wide Climate Scale (SCS) across Spanish and Chilean students. Stud. Educ. Eval. 56, 182–188. doi: 10.1016/j.stueduc.2018.01.002

CrossRef Full Text | Google Scholar

Estévez, E., Jiménez, T., and Moreno, D. (2018). Aggressive behavior in adolescence as a predictor of personal, family, and school adjustment problems. Psicothema 30, 66–73. doi: 10.7334/psicothema2016.294

PubMed Abstract | CrossRef Full Text | Google Scholar

Forster, M., Gower, A., McMorris, B., and Borowsky, I. (2017). Adverse childhood experiences and school-based victimization and perpetration. J. Interpers. Violence 35, 662–681. doi: 10.1177/0886260517689885

PubMed Abstract | CrossRef Full Text | Google Scholar

Gaias, L., Lindstrom, S., White, R., Pettigrew, J., and Dumka, L. (2017). Understanding school – neighborhood mesosystemic effects on adolescent development. Adolesc. Res. Rev. 3, 301–3190. doi: 10.1007/s40894-017-0077-9

CrossRef Full Text | Google Scholar

Gálvez Nieto, J. L., Tereucan Angulo, J., Muñoz Navarro, S., Briceño Olivera, C., and Mayorga Muñoz, C. (2014). Psychometric properties of the questionnaire to assess school social climate (CECSCE). Liberabit. Rev. Psicol. 20, 165–174.

Gálvez-Nieto, J. L., Vera-Bachmann, D., Trizano-Hermosilla, Í., Polanco-Levican, K., and Briceño-Olivera, C. (2020). Adaptation and validation of the school climate and school identification measure-student scale (SCASIM-St) in a sample of chilean adolescents. Front. Psychol. 11:1561. doi: 10.3389/fpsyg.2020.01561

PubMed Abstract | CrossRef Full Text | Google Scholar

Hooper, D., Coughlan, J., and Mullen, M. (2008). Structural equation modelling: guidelines for determining model fit structural equation modelling: guidelines for determining model fit. Electr. J. Business Res. Methods 6, 53–60. Available online at: http://www.ejbrm.com/volume6/issue1

Huang, F., Colleen, E., and Camp, E. (2017). The role of the perceptions of school climate and teacher victimization by students. J. Interpers. Violence 35, 5526–5551. doi: 10.1177/0886260517721898

PubMed Abstract | CrossRef Full Text | Google Scholar

Kearney, C. A., Sanmartín, R., and Gonzálvez, C. (2020). The school climate and academic mindset inventory (SCAMI): confirmatory factor analysis and invariance across demographic groups. Front. Psychol. 11, 303–304. doi: 10.3389/fpsyg.2020.02061

PubMed Abstract | CrossRef Full Text | Google Scholar

Klemmer, C., Rusow, J., Goldbach, J., Kattari, S. K., and Rice, E. (2019). Socially assigned gender nonconformity and school violence experience among transgender and cisgender adolescents. J. Interpers. Viol. 1–23. doi: 10.1177/0886260519844781

PubMed Abstract | CrossRef Full Text | Google Scholar

Klomek, A. B., Sourander, A., and Gould, M. (2010). The association of suicide and bullying in childhood to young adulthood: a reviewof cross-sectional and longitudinal research findings. Can. J. Psychiatry 55, 282–288. doi: 10.1177/070674371005500503

PubMed Abstract | CrossRef Full Text | Google Scholar

Konold, T., Cornell, D., Shukla, K., and Huang, F. (2017). Racial/ethnic differences in perceptions of school climate and its association with student engagement and peer aggression. J. Youth Adolesc. 46, 1289–1303. doi: 10.1007/s10964-016-0576-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Kutsyuruba, B., Klinger, D. A., and Hussain, A. (2015). Relationships among school climate, school safety, and student achievement and well-being: a review of the literature. Rev. Educ. 3, 103–135. doi: 10.1002/rev3.3043

CrossRef Full Text | Google Scholar

Lara, L., Saracostti, M., Navarro, J., de Toro, X., Miranda-Zapata, E., Trigger, J., et al. (2018). School engagement: development and validation of an instrument. Rev. Mexicana Psicol. 35, 52–62.

Google Scholar

Laurito, A., Lacoe, J., Schwartz, A. E., Sharkey, P., and Ellen, I. (2019). School climate and the impact of neighborhood crime on test scores. RSF Russell Sage Found. J. Soc. Sci. 5, 141–166. doi: 10.7758/rsf.2019.5.2.08

PubMed Abstract | CrossRef Full Text | Google Scholar

Lázaro-Visa, S., Palomera, R., Briones, E., Fernández-Fuertes, A. A., and Fernández-Rouco, N. (2019). Bullied adolescent's life satisfaction: personal competencies and school climate as protective factors. Front. Psychol. 10:1691. doi: 10.3389/fpsyg.2019.01691

PubMed Abstract | CrossRef Full Text | Google Scholar

LLECE. (2008). Educación en América Latina, Segundo Estudio Regional Comparativo y Explicativo (SERCE) de la UNESCO. UNESCO/OREALC/UNESCO. Available online at: http://unesdoc.unesco.org/images/0016/001606/160660S.pdf

Lombardi, E., Traficante, D., Bettoni, R., Offredi, I., Giorgetti, M., and Vernice, M. (2019). The impact of school climate on well-being experience and school engagement: a study with high-school students. Front. Psychol. 10:2482. doi: 10.3389/fpsyg.2019.02482

PubMed Abstract | CrossRef Full Text | Google Scholar

López-Castedo, A., Alvarez, D., Domínguez, J., and Alvarez, E. (2018). Expressions of school violence in adolescence. Psicothema 30, 395–400. doi: 10.7334/psicothema2018.130

PubMed Abstract | CrossRef Full Text | Google Scholar

Lorenzo-Seva, U., and Ferrando, P. J. (2006). FACTOR: a computer program to fit the exploratory factor analysis model. Behav. Res. Methods 38, 88–91. doi: 10.3758/BF03192753

PubMed Abstract | CrossRef Full Text | Google Scholar

Machado, C., Madalena, A., Leite de Moraes, C., Bertazzi, R., and Rossi, M. (2015). School bullying: a systematic review of contextual-level risk factors in observational studies. Aggress. Violent Behav. 22, 65–76. doi: 10.1016/j.avb.2015.04.006

CrossRef Full Text | Google Scholar

Malinen, O. P., and Savolainen, H. (2016). The effect of perceived school climate and teacher efficacy in behavior management on job satisfaction and burnout: a longitudinal study. Teach. Teacher Educ. 60, 144–152. doi: 10.1016/j.tate.2016.08.012

CrossRef Full Text | Google Scholar

McDonald, R. P. (1999). Test Theory: A Unified Treatment. Mahwah: Lawrence Erlbaum Associates, Inc.

Google Scholar

MINEDUC (2015). La Política Nacional de Convivencia Escolar, 2015-2018. Available online at: http://www.convivenciaescolar.cl/usuarios/convivencia_escolar/File/2016/politica-diciembre(3).pdf

Molla, E. (2016). The role of school in gender socialization. Eur. J. Educ. Sci. EJES 3, 1–7. doi: 10.19044/ejes.v3no1a1

CrossRef Full Text | Google Scholar

Montero, I., and León, O. (2002). Clasificación y descripción de las metodologías de investigación en psicología. Rev. Int. Psicol. Clín. Salud 2, 503–508.

Google Scholar

Moratto, N., Cárdenas, N., and Berbesí, D. (2017). School climate and family functionality as associated factors to bullying in students of Antioquia, Colombia. Pensamiento Psicol. 15, 63–72. doi: 10.11144/Javerianacali.PPSI15-1.CEFF

CrossRef Full Text | Google Scholar

Muthén, L. K., and Muthén, B. O. (1998–2012). Mplus User's Guide, 7th Edn. Los Angeles, CA: Muthén & Muthén. Available online at: https://www.statmodel.com/download/usersguide/Mplus%20user%20guide%20Ver_7_r3_web.pdf

Revelle, W. (2018). psych: Procedures for Personality and Psychological Research (1.8.12.). Northwestern University. https://cran.r-project.org/package=psych

Google Scholar

Rudasill, K. M., Snyder, K. E., Levinson, H., and Adelson, J. L. (2018). Systems view of school climate: a theoretical framework for research. Educ. Psychol. Rev. 30, 35–60. doi: 10.1007/s10648-017-9401-y

CrossRef Full Text | Google Scholar

Schreiber, J., Nora, A., Stage, F., Barlow, E., and King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: a review. J. Educ. Res. 99, 323–337. doi: 10.3200/JOER.99.6.323-338

CrossRef Full Text | Google Scholar

Senanayake, S. J., Gunawardena, S., Wickramasinghe, S., Wickramasinghe, C., Gunawardena, N. S., Lokubalasooriya, A., et al. (2019). Prevalence and correlates of interpersonal violence among in-school adolescents in Sri Lanka: results from the 2016 Sri Lankan global school-based health survey. Asia Pac. J. Public Health 31, 147–156. doi: 10.1177/1010539519825600

PubMed Abstract | CrossRef Full Text | Google Scholar

Stekhoven, D. J., and Bühlmann, P. (2012). MissForest-non-parametric missing value imputation for mixed-type data. Bioinformatics 28, 112–118. doi: 10.1093/bioinformatics/btr597

PubMed Abstract | CrossRef Full Text | Google Scholar

Suldo, S., McMahan, M., Chappel, A., and Loker, T. (2012). Relationships between perceived school climate and adolescent mental health across genders. School Mental Health 4, 69–80. doi: 10.1007/s12310-012-9073-1

CrossRef Full Text | Google Scholar

Thapa, A., Cohen, J., Guffey, S., and Higgins-D'Alessandro, A. (2013). A review of school climate research. Rev. Educ. Res. 83, 357–385. doi: 10.3102/0034654313483907

CrossRef Full Text | Google Scholar

Thornberg, R., Wänström, L., Hong, J. S., and Espelage, D. L. (2017). Classroom relationship qualities and social-cognitive correlates of defending and passive bystanding in school bullying in Sweden: a multilevel analysis. J. School Psychol. 63, 49–62. doi: 10.1016/j.jsp.2017.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Toro, I., and Parra, R. (2010). Fundamentos Epistemológicos de la Investigación y la Metodología de la Investigación Cualitativa-Cuantitativa. Medellín: Fondo Editorial Universidad EAFIT.

Trianes, M., Blanca, M., de la Morena, L., Infante, L., and Raya, S. (2006). Un cuestionario para evaluar el clima social del centro escolar. Psicothema, 18, 272–277.

PubMed Abstract | Google Scholar

Trucco, D., and Inostroza, P. (2017). Las Violencias en el Espacio Escolar. Comisión Económica Para América Latina y El Caribe (CEPAL), 222–247. Available online at: https://repositorio.cepal.org/bitstream/handle/11362/41068/1/S1700122_es.pdf

Google Scholar

Valdés-Cuervo, A., Martínez-Ferrer, B., and Carlos-Martínez, E. (2018). The role of teaching practices in the prevention of school violence among peers. Rev. Psicodidáctica 23, 33–38. doi: 10.1016/j.psicoe.2017.05.007

CrossRef Full Text | Google Scholar

Varela, J., Zimmerman, M., Ryan, A., Stoddard, S., and Heinze, J. (2018). School attachment and violent attitudes preventing future violent behavior among youth. J. Interpers. Violence. 1–20. doi: 10.1177/0886260518800314

PubMed Abstract | CrossRef Full Text | Google Scholar

Vivolo-Kantor, A., O'Malley, E., and Bacon, S. (2016). Associations of teen dating violence and bullying among US high school students. J. School Health 86, 620–627. doi: 10.1111/josh.12412

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, M.-T., and Degol, J. (2015). School climate: a review of the construct, measurement, and impact on student outcomes. Educ. Psychol. Rev. 28, 315–352. doi: 10.1007/s10648-015-9319-1

CrossRef Full Text | Google Scholar

Xu, Y., and Goodacre, R. J. (2018). On splitting training and validation set: a comparative study of cross-validation, bootstrap and systematic sampling for estimating the generalization performance of supervised learning. J. Anal. Test. 2, 249–262. doi: 10.1007/s41664-018-0068-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Yupanqui, A., González, M. Á., Llancalahuén, M., Quilodrán, W., and Toledo, C. (2016). Lenguaje, discriminación y discapacidad en el contexto educativo de Magallanes: un enfoque de derechos humanos desde la terapia ocupacional. Magallania 44, 149–166. doi: 10.4067/S0718-22442016000100009

CrossRef Full Text | Google Scholar

Keywords: multidimensional, ecological systems theory, structural equation models, psychometric properties, evaluation, wellbeing, school social climate

Citation: Bravo-Sanzana M, Miranda-Zapata E and Miranda H (2020) Psychometric Analysis of a School Social Climate Scale: Input Elements for the Investigation and Promotion of Well-Being. Front. Psychol. 11:605326. doi: 10.3389/fpsyg.2020.605326

Received: 11 September 2020; Accepted: 18 November 2020;
Published: 18 December 2020.

Edited by:

João P. Marôco, University Institute of Psychological, Social and Life Sciences (ISPA), Portugal

Reviewed by:

Milan Kubiatko, J. E. Purkyne University, Czechia
Thomas J. Smith, Northern Illinois University, United States

Copyright © 2020 Bravo-Sanzana, Miranda-Zapata and Miranda. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Mónica Bravo-Sanzana, bW9uaWNhdml2aWFuYS5icmF2byYjeDAwMDQwO3Vmcm9udGVyYS5jbA==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.