- 1Department of Organizational Behaviour, BI Norwegian Business School, Oslo, Norway
- 2Department of Psychology, Colby College, Waterville, ME, United States
Two studies were conducted to assess the psychometric properties of scores from the Norwegian adaptation of the Big Five Inventory-2 (BFI-2). In Study 1, the BFI-2 was translated to Norwegian and the scores from a convenience sample (N = 606) demonstrated good psychometric properties. BFI-2 scores from subsamples correlated in expected ways with self- and other ratings of the Big Five, and with self-ratings of empathic concern and perspective taking. In Study 2, after some minor improvements in translation, the psychometric properties of BFI-2 scores were assessed in a new sample (N = 409). Results from random intercept EFA of scores supported the proposed model. The psychometric properties of two shorter versions of the inventory, the BFI-2-S and BFI-2-XS, were also examined. Overall, the results suggest that the Norwegian adaptation of the BFI-2 provide reliable and valid scores.
Introduction
The Big Five model of personality describes five broad personality domains, often termed Extraversion, Agreeableness, Conscientiousness, Neuroticism, and Openness (John and Srivastava, 1999). Each domain encompasses a broad group of personality traits, or relatively stable patterns of thinking, feeling, and behaving. In personality research, the Big Five Inventory (BFI; John and Srivastava, 1999) has become one of the most frequently used measures of Big Five. Recently, a new version of this inventory was developed: the Big Five Inventory-2 (BFI-2; Soto and John, 2017a). The BFI-2 is freely available for use in research, and has been adapted to several languages, which may facilitate personality research around the world. In the present research, we will assess whether the good psychometric properties of scores from the original BFI-2 extend to the Norwegian adaptation of the BFI-2.
Compared to the original BFI, the BFI-2 has been improved in several ways (for a thorough description, see Soto and John, 2017a). First, for each Big Five domain, the BFI-2 measures three facets that frequently appear in various personality hierarchies. One facet is considered factor pure, in that “previous research has identified [it] as central to its own domain and independent from the other four domains” (Soto and John, 2017a, p. 5). The two other facets are complementary facets, which means that they “are prominent in the personality literature and represented in the original BFI’s item content” (Soto and John, 2017a, p. 5). Previous research has shown that the inclusion of facet-level traits can improve the descriptive and predictive power of personality inventories (Hofstee, 1992; Hendriks et al., 1999; Paunonen and Ashton, 2001; Ashton et al., 2014). Second, to control for acquiescence, the items in each scale are content-balanced, that is, they consist of an equal number of positively and negatively keyed items. Third, new labels were introduced for two of the domains to better reflect their content: Negative Emotionality (instead of Neuroticism) and Open-Mindedness (instead of Openness). Each of the Big Five personality domains is measured by three facets, which are measured by four items each (i.e., 12 items per domain). Overall, the BFI-2 consists of 60 items, where 18 items are identical to items in the original BFI, 14 are revised BFI items, and 28 are entirely new items.
Many studies utilizing various adaptations of the BFI-2 into different languages have provided strong support for the validity of BFI-2 scores. For instance, several studies have supported the convergent and divergent validity of scores (provided by either the full or brief versions), by relating them to a range of other personality inventories, like the BFAS, NEO PI-R, NEO-FFI, Big Five Mini-Markers, and peer ratings of the BFI-2 in English (Soto and John, 2017a); the NEO PI-R in German (Rammstedt et al., 2018); the Big Five Mini-Markers in Danish (Vedel et al., 2021); the IPIP Big Five scales in Dutch (Denissen et al., 2019); and the Big Five factor markers in Russian (Shchebetenko et al., 2019). Studies have also demonstrated that facet scores may outperform broad domain scores in the prediction of various criteria, like behavioral and psychological outcomes (Soto and John, 2017a); affective states, self-endorsed values, and satisfaction with life outcomes (Denissen et al., 2019); and educational attainment, income, health, and life satisfaction (Danner et al., 2021). Thus, a large body of evidence supports the validity of scores provided by various adaptations of the BFI-2 into different languages.
The aim of the present research was to develop a Norwegian adaptation of the BFI-2 and assess the psychometric properties of scores. In Study 1, the BFI-2 was translated to Norwegian and the psychometric properties of scores assessed. In Study 2, the good psychometric properties of BFI-2 scores were confirmed in a new sample, after some minor improvements in translation.
Study 1
The aim of Study 1 was to translate the BFI-2 into Norwegian and assess the psychometric properties of scores. That is, we wanted to assess the factor structure and reliability of scores; their convergent and divergent validity in relation to self- and others’ ratings of the Big Five; and their predictive validity in relation to empathic concern and perspective taking, two constructs that have been frequently used as indicators of empathy (Davis, 1980, 1983).
While few studies have looked at how empathic concern and perspective taking are related to facets of Big Five, several studies have examined their relationship with the broad Big Five domains (Graziano et al., 2007; Mooradian et al., 2011; Habashi et al., 2016; Melchers et al., 2016; Neumann et al., 2016; Song and Shi, 2017; Guilera et al., 2019). These studies found that empathic concern was positively and strongly related to agreeableness (r = 0.31–0.63); but also to extraversion (r = 0.05–0.29), openness (r = 0.04–0.22), conscientiousness (r = 0.05–0.22); and neuroticism (r = −0.04 to 0.17). Perspective taking on the other hand, was positively related to agreeableness (r = 0.22–0.43), openness (r = 0.20–0.30), conscientiousness (r = 0.11–0.28), and extraversion (r = 0.00–0.15), while negatively related to neuroticism (r = −0.13 to −0.33).
Based on these findings, we expect that empathic concern should be positively related to several Big Five domains, especially agreeableness and extraversion. Perspective taking should also be positively related to several Big Five domains, but negatively related to negative emotionality. In the present study, we will also examine whether the BFI-2 facets may outperform the broad domains in predicting these constructs.
Materials and Methods
Participants and Procedure
A convenience sample (N = 601) was used, consisting of 425 participants from an executive education program at a Norwegian business school, ranging in age from 25 to 65 years old (M = 42.22, SD = 7.39), mainly consisting of women (72.2% women, 25.4% men, 2.4% did not report gender, no difference in mean age between men and women); 28 Master of Science students in an organizational psychology class at a Norwegian business school, ranging from 22 to 39 years (M = 25.36, SD = 0.44, gender not reported to preserve anonymity); and 148 sales employees from a Norwegian company (neither age nor sex were reported in order to preserve anonymity). The students completed the BFI-2 in a paper and pencil version, while sales employees completed an online version. Participants and colleagues also completed other questionnaires not reported on here.
Measures
Big Five Inventory-2
The process of translating the BFI-2 into Norwegian was conducted in collaboration with the authors of the original BFI-2, who had developed detailed translation guidelines for this purpose. As some BFI-2 items are identical with items in the BFI, the translation was informed by results from a principal component analysis (PCA) of item scores from the Norwegian adaptation of the BFI (Engvik and Føllesdal, 2005) in a sample of 1,767 Norwegians (H. Engvik, personal communication, July 1, 2016). The factor loadings indicated that some item translations might be improved. The BFI-2 items were translated to Norwegian by the principal author in cooperation with a translator, and back-translated to English by a bilingual psychologist, and the final translation was reviewed by the authors of the original BFI-2. Informed by the BFI-2 authors’ experiences with adapting this measure into other languages, and the results from the PCA of item scores from the Norwegian adaptation of BFI, alternative translations of six items were included and tested out in the first version of the inventory. For instance, results from PCA of BFI data indicated that the translation of one of the items (“Er selvhevdende” [“Has an assertive personality”]) loaded most strongly (and negatively) on Agreeableness, rather on Extraversion which was the intended domain. An alternative translation of this item was therefore included (“Er selvsikker, gjør seg gjeldende”). Likewise, alternative translations of five other items were included to be tested out. A five-point Likert scale was used, with the labels helt uenig [totally disagree], litt uenig [somewhat disagree], nøytral/ingen oppfatning [neutral/no opinion], litt enig [somewhat agree], and helt enig [totally agree].
Big Five Inventory
Five days after completing the BFI-2, a subsample of executive students (n = 209) completed the 44-item Norwegian adaptation of BFI (John and Srivastava, 1999), as part of a larger research project. We utilized these data to obtain preliminary evidence for the convergent and divergent validity of BFI-2 scores. Although the BFI is the precursor of the BFI-2, only about one-third of the items are identical to items in the BFI, while two-thirds of the items in BFI-2 are new or revised BFI items. In Norway, the BFI is frequently used to measure the Big Five, and it has been found to provide scores with good psychometric properties (Engvik and Føllesdal, 2005). A 7-point rating scale was used (which is standard in the Norwegian adaptation of BFI), ranging from helt uenig [totally disagree] to helt enig [totally agree], with no labels for the scale points in between. In the present sample, Cronbach’s alpha for the domain scores were 0.84 (Extraversion), 0.73 (Agreeableness), 0.78 (Conscientiousness), 0.82 (Neuroticism), and 0.84 (Openness).
Big Five Inventory-20
A subsample of executive students (n = 279) were also rated on the BFI-20 by an average of 4.5 colleagues (n = 1246) at work (the participants worked in different organizations, and each participant recruited raters among their colleagues (supervisor, subordinates, and same level colleagues). These data were also collected as part of a larger research project but utilized in the present study to provide preliminary evidence of convergent and divergent validity of BFI-2 scores. The BFI-20 is a brief 20-item version of the Norwegian adaptation of the BFI, which has been demonstrated to provide scores with adequate structural and predictive validity; and reliability coefficients in the range of 0.57–0.78 (Engvik and Clausen, 2011). Only four out of 20 items in the BFI-20 are identical to BFI-2 items, while six of the items in BFI-20 were slightly revised in the BFI-2. A 7-point rating scale was used, ranging from helt uenig [totally disagree] to helt enig [totally agree], with no labels for the scale points in between.
Empathic Concern and Perspective Taking
Immediately after completing the BFI-2, 220 of the participants completed two seven-item scales selected from the Interpersonal Reactivity Index (Davis, 1980). These data were also collected as part of a larger research project but utilized in the present study to examine the predictive validity of BFI-2 scores. The selected scales, Empathic Concern and Perspective Taking, are frequently used as measures of empathy. Empathic Concern “assesses ‘other-oriented’ feelings of sympathy and concern for unfortunate others” (Davis, 1983, p. 114), and an example item is “I often have tender, concerned feelings for people less fortunate than me.” Perspective Taking measures “the tendency to spontaneously adopt the psychological point of view of others” (Davis, 1983, p. 113–114), and an example item is “I believe that there are two sides to every question and try to look at them both.” A 5-point rating scale was used, ranging from passer ikke [inaccurate] to passer helt [accurate], with no labels for the scale points in between. Cronbach’s alpha in the present sample were 0.77 and 0.76 for Empathic Concern and Perspective Taking, respectively, and the two scale scores were only modestly correlated (r = 0.23, p = 0.000).
Results and Discussion
Results from reliability analyses and item-total correlations of the 66 candidate items were used to select the final set of 60 items for the Norwegian BFI-2. After selecting this final item set, we conducted identical analyses to Soto and John (2017a) to be able to compare the psychometric properties of scores with those reported for the original, English-language BFI-2 (for an explanation of the rationale for the various analyses, see Soto and John, 2017a).
In order to assess the structure in the BFI-2 scores, a Principal Component Analysis (PCA) was performed. Although PCA may not be optimally suited to assess the latent structure in scores (Conway and Huffcutt, 2003), this type of analysis was chosen in order to enable comparison with results reported for the original BFI-2 (Soto and John, 2017a). PCA were conducted on item scores after within-person-centering, in order to control for acquiescence. That is, each item score for each person was centered around their within-person mean across all 60 items (for an explanation of this approach, see Soto and John, 2017a). PCA with varimax rotation, requesting five components, revealed that 59 of the 60 item scores had their highest loading on the intended Big Five component (Table 1). Moreover, a PCA with varimax rotation of the 15 facet scores (Table 2) showed that all facets had their highest loading on the intended Big Five domains. Cronbach’s alpha ranged from 0.79 to 0.86 for the domain scores (Table 3) and from 0.57 to 0.77 for the facet scores (Table 4). In order to assess the similarity of the principal components obtained in the present study with those reported for the original BFI-2 (i.e., for the Internet sample, Soto and John, 2017a, p. 12), Tucker’s factor congruence was estimated for pairs of corresponding components, using the R psych package (Revelle, 2021). A congruence coefficient above 0.95 indicates that components can be considered equal (Lorenzo-Seva and ten Berge, 2006). The coefficients were 0.96–0.97 for components derived from item scores, and 0.98–0.99 for components derived from the facets. These findings indicate that the components derived from scores from the Norwegian adaptation of the BFI-2 can be considered equivalent to corresponding components in the original BFI-2. Overall, the psychometric properties are highly similar to those reported for the original BFI-2, and the structural validity of scores was supported.
Table 1. Loadings from a principal component analysis of the 60 within-person centered Norwegian BFI-2 items (Study 1 and 2).
Table 2. Loadings from a principal component analysis of scores from the 15 BFI-2 facets (Study 1 and 2).
Table 3. Reliability estimates (with confidence intervals) and intercorrelations for scores from BFI-2 domains (Study 1 and 2).
Table 4. Reliability, descriptive statistics, and intercorrelations for scores from BFI-2 facets (Study 1 and 2).
Convergent and Divergent Validity
As mentioned previously, both self–ratings with the BFI and other ratings with the BFI-20 were collected for a subsample of executive students as part of a larger research project. In the present study, these data were utilized to provide preliminary evidence of convergent and divergent validity of scores from the Norwegian adaptation of BFI-2. The results are presented in Table 6. First, we examined the correlations between BFI-2 scores and self-ratings of personality with the BFI. The BFI-2 domain scores were strongly related to corresponding self-rated BFI domain scores, with correlation coefficients ranging from 0.72 to 0.83, averaging 0.77. Moreover, the BFI-2 domain scores were weakly related to non-corresponding self-rated BFI domain scores, with correlations ranging from −0.25 to 0.24, and absolute correlations averaging 0.13. The average correlation between corresponding domains of 0.77 was somewhat lower than the corresponding average correlation of 0.92 reported by Soto and John (2017a). In their study, however, the BFI and BFI-2 were administered together, while in the present study these questionnaires were administered 5 days apart, which may have attenuated the correlations between the scores. Moreover, in the present study, a 7-point scale was used with the BFI, with rating labels on the endpoints only, which is standard for the Norwegian adaptation of the BFI.
Next, we examined the correlations between BFI-2 scores and colleagues’ ratings with the BFI-20. Due to the nested nature of data (raters nested within participants), a multilevel model was specified and analyzed using Mplus 8.7 using manifest personality scores. The intraclass correlations (ICC = 0.27–0.44) indicated that a substantial amount of variance in personality ratings was due to differences among rated targets, supporting the decision to use a multilevel model. The relationships between self-ratings and colleagues’ ratings of personality were assessed on the between-group level in the model, as colleagues are nested within participants. The results are presented in Table 5. As expected, the self-rated BFI-2 domain scores correlated most strongly with the corresponding domain scores rated by colleagues (average r = 0.47, range = 0.38–0.53), and weaker with the non-corresponding domains rated by colleagues (average |r| = 0.13, range −0.27 to 0.32). Overall, the pattern of correlations between self and other ratings of Big Five supports the convergent and divergent validity of BFI-2 scores.
Table 5. BFI-2 scores and their correlations with self-ratings on BFI and colleagues’ ratings on BFI-20.
Predicting Empathic Concern and Perspective Taking
To further assess the validity of scores, we examined how the BFI-2 facet and domain scores could predict self-ratings of Empathic Concern and Perspective Taking, and whether the BFI-2 facet scores could outperform the broad domains. As facets generally provide scores with lower reliability than domain scores (due to fewer items) it may be challenging to compare their predictive validity. Therefore, both facet and domain scores were corrected for measurement error by modeling them as latent variables in Mplus, by specifying the residual variance for each variable x to variancex × (1 − reliabilityx), based on the estimated reliability of scores in the present sample (Bollen, 1989). The results are presented in Table 6; in the following text, the results for the corrected (latent) variable scores are reported.
The pattern of correlations between BFI-2 domain scores and Empathic Concern were in line with previous studies. That is, among the Big Five domains, Empathic Concern correlated most strongly with Agreeableness (Graziano et al., 2007; Mooradian et al., 2011; Melchers et al., 2016; Neumann et al., 2016; Song and Shi, 2017; Guilera et al., 2019). This relationship, however, seems to be mostly driven by the facet Compassion, as this correlation (r = 0.71) was substantially higher than for overall Agreeableness (r = 0.40). This is reasonable, as Compassion and Empathic Concern are conceptually very similar constructs, and because Compassion is considered a factor-pure facet of Agreeableness (Soto and John, 2017a). Empathic Concern was also positively correlated with the domain scores for Negative Emotionality and Open-mindedness, in line with findings reported by Song and Shi (2017). Moreover, all facets within these domains correlated positively with Empathic Concern. For Extraversion, the correlation with Empathic Concern was not significant, in contrast to findings reported in previous studies (Mooradian et al., 2011; Melchers et al., 2016; Neumann et al., 2016; Guilera et al., 2019). By examining the Extraversion facets, however, the scores from Energy Level were positively and significantly correlated with Empathic Concern, which underscores the importance of measuring facets in addition to domain scores.
The BFI-2 facets also seem to outperform the broad domains in predicting Empathic Concern. For four of the Big Five domains (all except Negative Emotionality), the correlations with Empathic Concern were stronger for facet scores than for domain scores. Moreover, the Big Five explained 50% of the variance (R2Adj. = 0.498, p = 0.000) in Empathic Concern, with Extraversion (β = 0.20, p = 0.008), Agreeableness (β = 0.57, p = 0.000), Negative Emotionality (β = 0.55, p = 0.000), and Open-Mindedness (β = 0.17, p = 0.017) as significant predictors. However, when using only one facet score from each domain as predictors (the facet score from each domain that was most strongly, and significantly, correlated with Empathic Concern), the four facets (Energy Level, Compassion, Anxiety, and Aesthetic Sensitivity) explained 56% of the variance (R2Adj. = 0.555, p = 0.000), with Compassion (β = 0.61, p = 0.000) and Anxiety (β = 0.20, p = 0.001) as significant predictors. It is important to note, however, that such an analysis, where we select as predictors the facets that are most strongly correlated with the outcome, may capitalize on chance and inflate the estimated explained variance (Ones and Viswesvaran, 1996). Future studies should therefore try to replicate these findings.
Turning to Perspective Taking, the correlation pattern with BFI-2 domain scores was also in line with previous studies. The scores from Perspective Taking were most strongly correlated with Agreeableness, as has been found in previous studies (Mooradian et al., 2011; Melchers et al., 2016; Neumann et al., 2016; Song and Shi, 2017). In contrast to Empathic Concern (which correlated most strongly with one facet within Agreeableness), Perspective Taking correlated positively with all three facets within Agreeableness. Moreover, Perspective Taking was negatively correlated with Negative Emotionality and positively correlated with Open-mindedness, as found in previous studies (Mooradian et al., 2011; Melchers et al., 2016; Song and Shi, 2017). Perspective Taking was also uncorrelated with the domain scores of Extraversion and Conscientiousness, while positively correlated with one facet score within each of these domains (Energy Level and Responsibility, respectively).
The scores from BFI-2 facets also seem to outperform broad domains in predicting Perspective Taking. That is, for all domains, except Agreeableness, the facet scores provided higher correlations than the domain scores. Regression analyses revealed that the Big Five explained 28% of the variance (R2Adj. = 0.283, p = 0.000) with Agreeableness (β = 0.21, p = 0.000) and Open-Mindedness (β = 0.20, p = 0.000) as the only significant predictors. When using only the one strongest facet from each domain as a predictor, the five facets (Energy Level, Respectfulness, Responsibility, Depression, and Intellectual Curiosity) together explained 41% of the variance (R2Adj. = 0.39, p = 0.000), with Respectfulness (β = 0.37, p = 0.001) and Intellectual Curiosity (β = 0.55, p = 0.000) as significant predictors.
Overall, the results suggest that the BFI-2 scores predict empathic concern and perspective taking in expected ways, supporting the construct validity of BFI-2 scores. Moreover, facet scores seem to be more important predictors than domain scores, but this pattern was not entirely consistent. For instance, the facets Compassion and Intellectual Curiosity outperformed their respective broad domains (Agreeableness and Open-Mindedness) in predicting Empathic Concern and Perspective Taking, respectively. For Negative Emotionality and Agreeableness, however, the domain scores outperformed the respective facet scores in predicting Empathic Concern and Perspective Taking, respectively. This illustrates that facets may be more important than domain scores in some instances, and not in others, which might be due to the degree of conceptual correspondence between predictor and criterion (for a discussion, see e.g., Judge et al., 2013). Overall, however, a faceted approach may be important in informing us about which aspects of personality are important for understanding and predicting empathy.
Taken together, the results of Study 1 suggest that the Norwegian adaptation of the BFI-2 provides scores with good psychometric properties. The proposed factor structure was supported, and the scales provided scores with adequate reliability, which correlated as expected with both self- and other ratings of the Big Five. Moreover, the scores correlated as expected with self-ratings of empathic concern and perspective taking. Finally, the facet scores generally outperformed the broad domain scores in predicting empathic concern and perspective taking. Overall, these findings support the construct validity of the BFI-2 scores.
Some minor issues, however, may be noted. First, while completing the BFI-2, some younger students reported that they did not understand the meaning of one of the words in item 28 [“skjødesløs” (careless)]. Thus, one may question the validity of scores from this scale in younger samples. Second, a closer look at the distribution of item scores revealed that item 13 provided scores with a relatively high mean (4.78) and a very large kurtosis (11.05), which is not optimal. Third, for 25 of the 60 items, the modal value was identical to the endpoints of the rating scale (either 1 or 5), suggesting that these items provide extreme scores and may not optimally differentiate among individuals. These issues were addressed in Study 2.
Study 2
The aim of Study 2 was to assess the psychometric properties of scores from the Norwegian adaptation of BFI-2 in a new sample, after some slight improvements based on findings in Study 1. First, small revisions of items 13 and 28 were tested out in smaller samples before a final translation was selected for inclusion in the Norwegian adaptation of the BFI-2. That is, item 13 was rephrased from “Er til å stole på, stødig” to “Er pliktoppfyllende, gjør som avtalt” and item 28 was rephrased from “Kan være litt skjødesløs” to “Kan vaere litt slurvete, likeglad.” Second, in order to reduce the extreme scores on some of the items, the endpoint labels on the rating scale were rephrased to be more similar in meaning to the labels in the original BFI-2. That is, in Study 1 the endpoint labels helt uenig [totally disagree] and helt enig [totally agree] were used. These labels are commonly used in Norwegian questionnaires, and are also used in the Norwegian adaptation of the BFI (Engvik and Føllesdal, 2005). One may question, however, whether these labels express the same strong levels of disagreement and agreement as the labels in the original BFI-2, i.e., strongly disagree and strongly agree. The labels were therefore rephrased to svært uenig [strongly disagree] and svært enig [strongly agree], respectively.
One aim of the present study was therefore to see if a slight improvement in the translation of the endpoints of the rating scale might lead to less extreme scale scores. A second aim was to try to replicate the good psychometric properties of the final Norwegian adaptation of BFI-2 in a new sample. A third aim was to examine the preliminary psychometric properties of two shorter versions of the inventory, the BFI-2-S and BFI-2-XS (Soto and John, 2017b).
Materials and Methods
Participants and Procedure
Students in an organizational psychology class at a Norwegian business school were invited to participate. They were provided with an anonymous link to a Qualtrics questionnaire and were encouraged to also recruit friends to participate. Participants were offered a brief feedback on their BFI-2 domain scores. Respondents were excluded if they (a) had completed the test previously, (b) did not select the response “I have done my best to answer all questions,” or (c) used less than 4 min or more than 40 min to answer all items. The final sample (N = 409) consisted of 250 women and 159 men, ranging from 17 to 71 years of age (M = 26.77 years, SD = 10.86, no difference in mean age across gender). About 57 percent of the sample were students at the Norwegian business school, and about 75 percent reported they were full-time students.
Measures
Participants completed the Norwegian adaptation of the BFI-2, using a 5-point scale with the labels 1 = svært uenig [strongly disagree], 2 = litt uenig [disagree a little], 3 = nøytral [neutral], 4 = litt enig [agree a little], and 5 = svært enig [strongly agree].
Results and Discussion
We first compared the distribution of item scores with those from Study 1, and then assessed the Norwegian BFI-2’s psychometric properties by conducting several analyses that were identical to the ones reported in the study with the original BFI-2 (Soto and John, 2017a), that is, PCA and confirmatory factor analysis (CFA). In addition, we also utilized random intercept exploratory factor analysis (RI-EFA; Aichholzer, 2014), which has been used to assess the structure of scores from the BFI-2-S and BFI-2-XS (Soto and John, 2017b), and the Russian adaptation of BFI-2 (Shchebetenko et al., 2019), within a latent variable framework that also controls for individual differences in response style.
Score Distribution
The distribution of scores was better than in Study 1. First, the scores from the slightly revised item 13 had a lower mean, compared to Study 1 (4.56 vs. 4.78), and a lower kurtosis (2.44 vs. 11.05). Second, the modal value was identical to the most extreme value for only 17 items, compared to 25 items in Study 1. Though we expected these improvements, we cannot conclusively determine whether they were due to the slight change in the rating scale, or due to differences in the samples. Some items do still provide extreme scores, but this is also seen with the original BFI-2, as descriptive statistics for a large representative American sample (Soto, 2021) indicate that some scales may provide high mean scores.
Results From Principal Component Analysis and Congruence Analysis
Once again, in order to compare the psychometric properties of the scores from the Norwegian BFI-2 with those reported in the original study on the English-language instrument, we ran identical analyses to those reported on by Soto and John (2017a). A PCA with centered item scores (in order to control for acquiescence) revealed that the 60 items (Table 1) and 15 facet scores (Table 2) all had their highest loadings on the intended Big Five factor. Cronbach’s alpha ranged from 0.81 to 0.90 for the domain scores (Table 3), and 0.57 to 0.82 for the facet scores (Table 4), which is comparable to those reported for the original BFI-2. Moreover, we estimated congruence coefficients comparing the component loadings with those reported for the original BFI-2 (i.e., for the Internet sample, Soto and John, 2017a, p. 12). These coefficients were in the range 0.96–0.97 for components derived from the BFI-2 items, and 0.98–0.99 for components derived from the facets, indicating that the components may be considered equal. Finally, congruence coefficients comparing the components from Study 1 and Study 2 (in the present research) were in the range of 0.95–0.98 for the item-derived components, and 0.98–0.99 for the facet-derived components, indicating that components may be considered equal across the two studies.
Facet Level Structure
In order to assess the structure of scores at the facet level within each domain, three different CFA models were tested on the 12 item scores, using Mplus 8.7 (Muthén and Muthén, 1998-2017). The MLR estimator in Mplus was used, providing maximum likelihood parameter estimates with standard errors and a chi-square statistic that are robust to non-normality. The three models were identical to three of the models tested in the original study with the BFI-2 (Soto and John, 2017a, p. 16), which makes it possible to compare results. The results are provided in Table 7. In the single domain model, all item scores within one domain were specified to load on one factor. This model obtained poor fit in all domains. In the three facets model, each factor was measured by four items, corresponding to the three facets in the domain, and the three factors were allowed to correlate. This model obtained an acceptable fit in three out of five domains. In the three facets plus acquiescence model, all items were in addition constrained to load 1 on an acquiescence factor, which was specified to be uncorrelated with the three substantive facet factors (Billiet and McClendon, 2000). This model obtained an acceptable fit in all five domains, which was also the case for the original BFI-2 (Soto and John, 2017a). In the present study, the inclusion of an acquiescence factor improved the model fit significantly in three of the five Big Five domains. Overall, the results indicate that the Norwegian BFI-2 items capture three facet traits within each Big Five domain, and also allow researchers to model individual differences in acquiescent responding (Billiet and McClendon, 2000).
Hierarchical Structure
In order to examine the structure of scores at both the domain and facet levels simultaneously, we used the exploratory structural equation modeling (ESEM) framework in Mplus to test an RI-EFA model (Aichholzer, 2014). This model allowed each of the 60 Norwegian BFI-2 item scores to load on both (a) five CF-varimax-rotated exploratory factors (to represent the Big Five domains) and (b) a confirmatory factor representing acquiescent response style. All loadings on the acquiescence factor were constrained to equal 1, and this factor was not allowed to correlate with the five domain factors. In addition, we allowed correlated residuals among the four items within each of the 15 BFI-2 facet scales (i.e., correlated uniqueness; Marsh et al., 2010). Thus, this model was specified to simultaneously represent (a) the Big Five domains (using exploratory factors), (b) the 15 BFI-2 facets (using correlated uniqueness), and (c) acquiescent response style. The model was tested in Mplus with the MLR estimator and provided a good fit (Table 8), χ2 (1,389, N = 409) = 1984.18, p = 0.000, RMSEA = 0.032 [95% C.I. = 0.029–0.036], and CFI = 0.935. Moreover, all 60 items had their strongest loading on their intended domain factor, though one item loaded equally strong on two domain factors (Supplementary Table 1). These results replicate findings from the Russian adaptation of the BFI-2 (Shchebetenko et al., 2019) by showing that ESEM can be used to simultaneously model the domain-level and facet-level structure of the BFI-2.
Table 8. Fit indices for RI-EFA of scores from different models of the 60 item scores from the BFI-2.
Short Versions, Big Five Inventory-2-S, and Big Five Inventory-2-XS
Finally, we examined the psychometric properties of scores from the subsets of items making up the two briefer versions of the BFI-2, that is, the 30-item BFI-2-S and the 15-item BFI-2-XS (Soto and John, 2017b). These two shorter measures were originally designed for use in situations where it is not feasible to administer the full 60-item version. Examples of such situations may be large-scale research projects where personality need to be assessed with fewer questions, and round-robin designs where each participant rates several other participants (Soto and John, 2017b). The 30-item BFI-2-S measures each facet with two items, while the BFI-2-XS measures only the Big Five domains, each assessed with three items (for more information about the development of these brief versions, see Soto and John, 2017b). In the present study, the item scores were obtained by administering the full 60 item BFI-2, thus the results should be considered tentative (Smith et al., 2000).
For both brief versions, an RI-EFA model was specified with five factors, using CF-varimax orthogonal rotation, corresponding to models tested with the brief English-language versions (Soto and John, 2017b). The models were tested in Mplus using the MLR estimator, and good fit was obtained for both models, that is BFI-2-S: χ2 (294, N = 409) = 602.39, p = 0.000, RMSEA = 0.051 [95% C.I. = 0.045–0.056], and CFI = 0.902; and BFI-2-XS: χ2 (39, N = 409) = 83.06, p = 0.000, RMSEA = 0.053 [95% C.I. = 0.037–0.068], and CFI = 0.954. All items had their strongest loading on the intended factor, except for one item in BFI-2-XS (Table 9). The average primary and secondary absolute loadings were 0.72 and 0.13, respectively, for the BFI-2-S; and 0.64 and 0.11, respectively, for the BFI-2-XS. For the BFI-2-S, the reliability of scores was in the range 0.70–0.82 for the domain scales, and 0.27–0.76 for the facet scales (Table 10). Thus, the reliability is very low for some facets, as expected when using only two items per scale. For the BFI-2-XS, the reliability of scores for the domain scales ranged from 0.46 to 0.56. In comparison, Soto and John (2017b) reported corresponding reliabilities of scores in an Internet sample, in the range of 0.74–0.84 for the domain scales and 0.42–0.79 for the facet scales from the BFI-2-S; and 0.49–0.69 for the domain scales from the BFI-2-XS. Thus, in the present sample, the Norwegian BFI-2-S and BFI-2-XS provided scores with comparable structural validity but somewhat lower internal consistency than reported for their English-language counterparts.
Overall Discussion
The aim of the present research was to assess whether the good psychometric properties of scores from the original, English-language BFI-2 could be replicated with the Norwegian adaptation of BFI-2. The results suggest that the Norwegian adaptation of the BFI-2 provides scores with good psychometric properties, comparable to those reported for the original BFI-2.
Overall, the scores from the Norwegian BFI-2 showed very good structural validity and reliability. In Study 2, the highest factor loading for each item was on the intended factor. The reliability of scores were around 0.80 for the Big Five domains, and 0.60–0.70 for the facets, which is comparable to what has been reported for the original BFI-2 (Soto and John, 2017a). Thus, the Norwegian adaptation of BFI-2 seems to be well suited for use in research. One should be careful, however, in using the BFI-2 to assess personality traits on the individual level, particularly when measuring facets. Due to low reliability of facet scores, some scores will likely have a high standard error of measurement, leading to imprecise scores. Nunnally (1978) recommended that scales providing scores with reliability of 0.70 might be useful in early stages of developing a questionnaire, while 0.80 might be adequate for many purposes in basic research (for a discussion, see Gugiu and Gugiu, 2018). Thus, the BFI-2 may be a useful tool for researchers who need a brief measure of the Big Five personality domains along with narrow traits within the Big Five.
The present research has several strengths. A thorough translation process was conducted, and the final adaptation of BFI-2 was refined across two samples. Moreover, multilevel modeling was used to assess convergent and divergent validity with others’ ratings of Big Five. The present research, however, also has some limitations that may be addressed in future studies.
One limitation is that only the BFI (and the brief version BFI-20) were used to provide evidence for convergent and divergent validity with alternative measures of the Big Five. This is not optimal, as the BFI is a precursor for the BFI-2, and about one-third of the BFI-2 items are identical to items in the BFI. Despite this limitation, however, the overall evidence provides support for the validity of scores from the Norwegian adaptation of the BFI-2. First, the psychometric analyses of the scores in the present study (i.e., PCA, CFA, reliability analysis, and congruence analysis) clearly demonstrate that the Norwegian adaptation of BFI-2 provide scores that are highly similar to the scores provided by the original BFI-2. Second, the present study shows that the scores correlate in expected ways with both self- and other ratings on the BFI/BFI-20, and in expected ways with empathic concern and perspective taking, supporting the construct validity of scores. Nevertheless, future studies may further assess the convergent and divergent validity of scores by relating them to scores from other established personality inventories in Norwegian, preferably inventories that measure personality facets. Moreover, future studies should also try to replicate these findings in larger and more diverse samples and assess predictive validity of facet scores in relation to other important outcomes. Finally, some items and scales in the BFI-2 seem to provide high scores, and future studies might look closer at whether this is due to social desirability or other issues.
Conclusion
The present research supports the validity and reliability of scores from the Norwegian adaptation of the BFI-2. The psychometric properties are good, and comparable to those reported for scores from the original, English-language version. The Norwegian adaptation of the BFI-2 may be useful for personality research in both Norwegian-language and cross-cultural contexts, when one needs to measure the Big Five or more narrow personality traits.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided written or active informed consent to participate in this study.
Author Contributions
HF collected data, organized the database, performed the statistical analyses, and wrote the first draft of the manuscript. CS provided syntax for SPSS analyses. Both authors contributed to the development and refinement of the Norwegian adaptation of the BFI-2, interpretation of the results, manuscript revision, read, and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.858920/full#supplementary-material
References
Aichholzer, J. (2014). Random intercept EFA of personality scales. J. Res. Pers. 53, 1–4. doi: 10.1016/j.jrp.2014.07.001
Ashton, M. C., Paunonen, S. V., and Lee, K. (2014). On the validity of narrow and broad personality traits: a response to Salgado, Moscoso, and Berges (2013). Pers. Individ. Differ. 56, 24–28. doi: 10.1016/j.paid.2013.08.019
Baumgartner, T. A., and Chung, H. (2001). Confidence limits for intraclass reliability coefficients. Meas. Phys. Educ. Exerc. Sci. 5, 179–188. doi: 10.1207/S15327841MPEE0503_4
Billiet, J. B., and McClendon, M. J. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Struct. Equ. Model. 7, 608–628. doi: 10.1207/s15328007sem0704_5
Bollen, K. A. (1989). Structural Equations with Latent Variables, Vol. 210. New York, NY: John Wiley & Sons.
Bravo, G., and Potvin, L. (1991). Estimating the reliability of continuous measures with Cronbach’s alpha or the intraclass correlation coefficient: toward the integration of two traditions. J. Clin. Epidemiol. 44, 381–390. doi: 10.1016/0895-4356(91)90076-L
Conway, J. M., and Huffcutt, A. I. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organ. Res. Methods 6, 147–168. doi: 10.1177/1094428103251541
Danner, D., Lechner, C. M., Soto, C. J., and John, O. P. (2021). Modelling the incremental value of personality facets: the domains-incremental facets-acquiescence bifactor model. Eur. J. Pers. 35, 67–84. doi: 10.1002/per.2268
Davis, M. H. (1980). A multidimensional approach to individual differences in empathy. JSAS Catal. Select. Doc. Psychol. 10:85.
Davis, M. H. (1983). Measuring individual differences in empathy: evidence for a multidimensional approach. J. Pers. Soc. Psychol. 44, 113–126.
Denissen, J. J. A., Geenen, R., Soto, C. J., John, O. P., and van Aken, M. A. G. (2019). The big five inventory-2: replication of psychometric properties in a Dutch adaptation and first evidence for the discriminant predictive validity of the facet scales. J. Pers. Assess. 102, 309–324. doi: 10.1080/00223891.2018.1539004
Engvik, H., and Clausen, S.-E. (2011). Norsk kortversjon av big five inventory (BFI-20). Tidsskrift Norsk Psykologforening 48, 869–872.
Engvik, H., and Føllesdal, H. (2005). The big five inventory på norsk. Tidsskrift Norsk Psykologforening 42, 128–129.
Graziano, W. G., Habashi, M. M., Sheese, B. E., and Tobin, R. M. (2007). Agreeableness, empathy, and helping: a person× situation perspective. J. Pers. Soc. Psychol. 93, 583. doi: 10.1037/0022-3514.93.4.583
Gugiu, C., and Gugiu, M. (2018). Determining the minimum reliability standard based on a decision criterion. J. Exp. Educ. 86, 458–472. doi: 10.1080/00220973.2017.1315712
Guilera, T., Batalla, I., Forné, C., and Soler-González, J. (2019). Empathy and big five personality model in medical students and its relationship to gender and specialty preference: a cross-sectional study. BMC Med. Educ. 19:57. doi: 10.1186/s12909-019-1485-2
Habashi, M. M., Graziano, W. G., and Hoover, A. E. (2016). Searching for the prosocial personality: a big five approach to linking personality and prosocial behavior. Pers. Soc. Psychol. Bull. 42, 1177–1192. doi: 10.1177/0146167216652859
Hendriks, A. A. J., Hofstee, W. K. B., and Raad, B. D. (1999). The five-factor personality inventory (FFPI). Pers. Individ. Differ. 27, 307–325. doi: 10.1016/S0191-8869(98)00245-1
Hofmann, R. J. (1978). Complexity and simplicity as objective indices descriptive of factor solutions. Multivar. Behav. Res. 13, 247–250. doi: 10.1207/s15327906mbr1302_9
Hofstee, W. K. (1992). Integration of the big five and circumplex approaches to trait structure. J. Pers. Soc. Psychol. 63, 146–163. doi: 10.1037//0022-3514.63.1.146
John, O. P., and Srivastava, S. (1999). “The big five trait taxonomy: history, measurement, and theoretical perspectives,” in Handbook of Personality: Theory and Research, 2nd Edn, eds L. A. Pervin and O. P. John (New York, NY: The Guilford Press), 102–138.
Judge, T. A., Rodell, J. B., Klinger, R. L., Simon, L. S., and Crawford, E. R. (2013). Hierarchical representations of the five-factor model of personality in predicting job performance: integrating three organizing frameworks with two theoretical perspectives. J. Appl. Psychol. 98, 875–925. doi: 10.1037/a0033901
Lorenzo-Seva, U., and ten Berge, J. M. F. (2006). Tucker’s congruence coefficient as a meaningful index of factor similarity. Methodology 2, 57–64. doi: 10.1027/1614-2241.2.2.57
Marsh, H. W., Lüdtke, O., Muthén, B. O., Asparouhov, T., Morin, A. J. S., Trautwein, U., et al. (2010). A new look at the big five factor structure through exploratory structural equation modeling. Psychol. Assess. 22, 471–491. doi: 10.1037/a0019227
Melchers, M. C., Li, M., Haas, B. W., Reuter, M., Bischoff, L., and Montag, C. (2016). Similar personality patterns are associated with empathy in four different countries. Front. Psychol. 7:290. doi: 10.3389/fpsyg.2016.00290
Mooradian, T. A., Davis, M., and Matzler, K. (2011). Dispositional empathy and the hierarchical structure of personality. Am. J. Psychol. 124, 99–109. doi: 10.5406/amerjpsyc.124.1.0099
Muthén, L. K., and Muthén, B. O. (2022). Chi-Square Difference Testing Using the Satorra-Bentler Scaled Chi-Square. Available online at: https://www.statmodel.com/chidiff.shtml (accessed March 15, 2022).
Muthén, B. O., and Muthén, L. K. (1998-2017). Mplus User’s Guide, 8th Edn. Los Angeles, CA: Muthén & Muthén.
Neumann, D. L., Chan, R. C. K., Wang, Y., and Boyle, G. J. (2016). Cognitive and affective components of empathy and their relationship with personality dimensions in a Chinese sample. Asian J. Soc. Psychol. 19, 244–253. doi: 10.1111/ajsp.12138
Ones, D. S., and Viswesvaran, C. (1996). Bandwidth-fidelity dilemma in personality measurement for personnel selection. J. Organ. Behav. 17, 609–626. doi: 10.1002/(sici)1099-1379(199611)17:6<609::aid-job1828>3.0.co;2-k
Paunonen, S. V., and Ashton, M. C. (2001). Big five factors and facets and the prediction of behavior. J. Pers. Soc. Psychol. 81, 524–539. doi: 10.1037/0022-3514.81.3.524
Rammstedt, B., Danner, D., Soto, C. J., and John, O. P. (2018). Validation of the short and extra-short forms of the big five inventory-2 (BFI-2) and their German adaptations. Eur. J. Psychol. Assess. 36, 149–161. doi: 10.1027/1015-5759/a000481
Revelle, W. (2021). Psych: Procedures for Psychological, Psychometric, and Personality Research. R Package Version 2.1.9. Available online at: https://CRAN.R-project.org/package=psych (accessed June 15, 2021).
Shchebetenko, S., Kalugin, A. Y., Mishkevich, A. M., Soto, C. J., and John, O. P. (2019). Measurement invariance and sex and age differences of the big five inventory–2: evidence from the Russian version. Assessment 27, 472–486. doi: 10.1177/1073191119860901
Smith, G. T., McCarthy, D. M., and Anderson, K. G. (2000). On the sins of short-form development. Psychol. Assess. 12, 102–111. doi: 10.1037/1040-3590.12.1.102
Song, Y., and Shi, M. (2017). Associations between empathy and big five personality traits among Chinese undergraduate medical students. PLoS One 12:e0171665. doi: 10.1371/journal.pone.0171665
Soto, C. J. (2021). Descriptive Statistics for the BFI-2. Available online at: http://www.colby.edu/psych/personality-lab/ (accessed April 21, 2021).
Soto, C. J., and John, O. P. (2017a). The next big five inventory (BFI-2): developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. J. Pers. Soc. Psychol. 113, 117–143. doi: 10.1037/pspp0000096
Soto, C. J., and John, O. P. (2017b). Short and extra-short forms of the big five inventory–2: the BFI-2-S and BFI-2-XS. J. Res. Pers. 68, 69–81. doi: 10.1016/j.jrp.2017.02.004
Keywords: BFI-2, personality, big five, empathy, psychometric, personality assessment, empathic concern, perspective taking
Citation: Føllesdal H and Soto CJ (2022) The Norwegian Adaptation of the Big Five Inventory-2. Front. Psychol. 13:858920. doi: 10.3389/fpsyg.2022.858920
Received: 20 January 2022; Accepted: 13 April 2022;
Published: 18 May 2022.
Edited by:
Cesar Merino-Soto, Universidad de San Martin de Porres, PeruReviewed by:
Lisa Di Blas, University of Trieste, ItalyPetar Čolović, University of Novi Sad, Serbia
Copyright © 2022 Føllesdal and Soto. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hallvard Føllesdal, hallvard.follesdal@bi.no