- 1Department of Psychology, University of Cologne, Cologne, Germany
- 2Department of Psychosomatic Medicine and Psychotherapy, Justus Liebig University Giessen, Giessen, Germany
- 3Department for Psychosomatic Medicine and Psychotherapy, Medical Center of the Philipps University Marburg, Marburg, Germany
- 4Department of Medical Psychology and Medical Sociology, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany
- 5Department of Psychosomatic Medicine and Psychotherapy, Medical Faculty of the Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- 6Department of General Internal Medicine and Psychosomatics, University Hospital Heidelberg, Heidelberg University, Heidelberg, Germany
- 7Department of Psychosomatic Medicine and Psychotherapy, University Medical Center of the Johannes Gutenberg University, Mainz, Germany
- 8Department of Medical Psychology and Medical Sociology, University Hospital Leipzig, Leipzig, Germany
Background: The assessment of personality functioning is at the core of current dimensional models of personality disorders. A variety of measures from different clinical and research traditions aim to assess basic psychological capacities regarding the self and others. While some instruments have shown reliability and validity in clinical or other selected samples, much less is known about their performance in the general population.
Methods: In three samples representative of the German adult population with a total of 7,256 participants, levels of personality functioning were measured with the short 12-item version of the Operationalized Psychodynamic Diagnosis – Structure Questionnaire (OPD-SQS). We addressed questions of factor structure, reliability, validity, factorial invariance, and provide norm values.
Results: Confirmatory factor analysis indicated a satisfactory to good model fit. OPD-SQS models were mostly unaffected by variables such as gender, age, or measurement time. As expected, personality functioning was associated with general psychopathology as well as indices of occupational functioning.
Conclusion: The OPD-SQS is a viable measure to assess personality functioning in the general population.
1. Introduction
Measuring severity of personality disorders (PD) through levels of personality functioning has attracted researchers and clinicians alike. From a clinical perspective, it enables treatment-planning on a personalized profile of abilities and personality styles rather than on categorical diagnosis (Morey and Hopwood, 2020). From a research-perspective, it solves several issues related to variance and distributions, cut-off values, comorbidity, and unspecific residual categories. However, there are a number of challenges associated with this approach as well, some of them on a conceptual level, others in relation to a lack of empirical data. While the number of studies in clinical populations is growing, less is known about the measurement of personality functioning in the general population.
The DSM-5 Alternative Model for the Assessment of Personality Disorders [AMPD; (Morey et al., 2011)] and the revision of the related chapter of the ICD-11 (Tyrer et al., 2011) have proposed a hybrid model for diagnosing PDs. Both approaches include a dimensional rating of basic psychological capacities as a stand-alone-measure as well as a prerequisite for further differentiation by clinical five-factor variables and PD prototypes (Tyrer et al., 2019). At the core of each model is a dimensional rating of severity of personality dysfunction, which has a twofold purpose: on the one hand, it serves as a general indicator of the level of capabilities in basic psychological functioning, and therefore helps to translate clinical phenomena into a measure of impairment, including cut-off scores for the presence or absence of a PD in the sense of categorical diagnosis. On the other hand, it includes clinically relevant information in itself, as DSM-5 and ICD-11 approaches define personality functioning as a combination of a number of capacities with regard to the self and interpersonal processes, which can inform treatment planning and evaluation. Since the initial publications, both DSM-5 AMPD as well as ICD-11 PD have stimulated a considerable amount of research (Zimmermann et al., 2019; Bach and Anderson, 2020; Krueger and Hobbs, 2020; Rek et al., 2020). In addition to measures specifically designed to capture dimensions of the DSM-5 and ICD-11, there are a number of approaches that assess similar constructs. One of those approaches is based on the Operationalized Psychodynamic Diagnosis system (OPD).
The OPD was initially developed by a group of researcher-clinicians from psychiatry, psychosomatic medicine, and clinical psychology in the beginning of the 1990s (Task Force, 2008; Arbeitskreis zur Operationalisierung Psychodynamischer Diagnostik, 2014). Its second edition (OPD-2) on which the questionnaire of the current study is based, is a multiaxial system to supplement psychiatric symptom-oriented diagnosis (OPD-2 Axis V) by adding treatment-relevant information in the areas of experience of illness and prerequisites for treatment (Axis I), interpersonal relations (Axis II), intrapsychic motivational conflicts (Axis III), and personality functioning, which has been labeled as ‘structure’ (Axis IV) in the OPD (Wöller and Kruse, 2018). The clinical model focuses on interrelations between axis II, axis III, and axis IV. Repetitive maladaptive interpersonal patterns are either based on conflictual insecure core motives which translate into ambivalent relationships that include motive-related wishes as well as a ‘defense’ against these wishes, or on impairments in personality functioning that complicate relationships on a basic level, or on a combination of both (Schauenburg and Grande, 2012; Ehrenthal and Benecke, 2019). “Structure” according to the OPD-2 operationalizes personality functioning by means of Levels of Structural Integration (LSIA).
The OPD-2 defines ‘structure’ as basic psychological capacities that are necessary for an adaptive organization of the self and its relation to internal and external ‘objects’, i.e., self and interpersonal functioning (Arbeitskreis zur Operationalisierung Psychodynamischer Diagnostik, 2014). The OPD-2 LSIA follows several principles: 1. It has a developmental focus and assesses functioning that is usually acquired in normal development but impaired due to disadvantageous conditions often related to neglect and abuse. 2. It assesses functioning with regard to abilities, not necessarily concerning specific behavioral consequences per se. In other words, it focuses on tools and skills, which result in a higher or lower probability for achieving adaptive behavior. 3. It tries to be as descriptive as possible, stepping back from wording directly associated with specific psychodynamic or other therapy schools. 4. Every facet is formulated as a possible direct treatment target that can be communicated with patients as shared goals.
‘Structure’ is observed in four different areas that relate to capacities of cognition/perception, regulation, communication, and attachment, each with regard to the self and others, resulting in eight broad structural functions. Every one of those consists of three subdimensions or facets: for example, ‘self-perception’ comprises capacities of self-reflection, affect differentiation, and identity, while ‘regulation of relationships’ is composed of capacities for protecting relationships, balancing interests, and anticipation [for a full description, see for example (Ehrenthal and Benecke, 2019)]. Each of these facets and dimensions is rated on a four-point scale from high integration (rating of 1), via medium (rating of 2) and low (rating of 3) levels of integration, to disintegration (rating of 4), resulting in an overall score of structural integration. These ratings can be further differentiated by intermediate steps. Usually, a score of 2.5 or 3 indicates a predominant structural impairment of personality functioning. Ratings are based on a semi-structured interview as conducted in routine clinical practice.
Interview-based ratings of the OPD LSIA show generally good inter-rater reliability, convergent validity, and construct validity (Zimmermann et al., 2012; Ehrenthal and Benecke, 2019). In 2012, Ehrenthal and colleagues (Ehrenthal et al., 2012) published a self-report questionnaire to complementarily assess personality functioning from the patients’ perspective (OPD-Structure Questionnaire; OPD-SQ). Its full version correlates significantly with expert ratings of the LSIA (r = 0.62), and explains variance in the prediction of the number of DSM-IV SCID-II personality disorder diagnoses incrementally to the expert ratings (Dinger et al., 2014). It is associated with attachment insecurity and neuroticism, and differentiates between individuals currently not in psychotherapy treatment, patients in outpatient treatment, and patients in inpatient psychotherapy, even if statistically controlled for influences of general symptom load (Ehrenthal et al., 2012). It is also related to burnout in students (Bugaj et al., 2016), PTSD symptom severity (Baie et al., 2020), or other self-report measures of personality functioning in adults (König et al., 2016) and adolescents (Bock et al., 2018). Patients with borderline personality disorder (BPD) and comorbid depression had higher scores in the OPD-SQ than patients with depression alone (Köhling et al., 2016). Higher scores of the OPD-SQ but not a categorical diagnosis of BPD were associated with active negative emotions in psychotherapy inpatients (Dinger et al., 2021). OPD-SQ scores but not depression predicted less success in blood glucose normalization in the treatment of patients with type 2 diabetes mellitus (Ehrenthal et al., 2019), and could be related to gastrointestinal complaints (Berens et al., 2021) and irritable bowel syndrome (Berens et al., 2021), profiles of eating disorders (Rohde et al., 2019), bipolar disorder (Wagner-Skacel et al., 2020), vaginismus and dyspareunia (Koops et al., 2021), and has been applied in different areas of psychotherapy research (Ehrenthal et al., 2020; Nikendei et al., 2020; Zeeck et al., 2020; Knefel et al., 2021; Kraus et al., 2021; Immel et al., 2022). In addition, the OPD-SQ is highly correlated with state and trait measures of emotional intelligence as well as self-reported levels of personality functioning according to the DSM-5 (Jauk and Ehrenthal, 2021), and it mediates the association between childhood trauma and adult depression (Dagnino et al., 2020). The OPD-SQ can also be used as an item pool for computer adaptive testing (Obbarius et al., 2021).
A 12-item short version (OPD-SQS) was developed by Ehrenthal and colleagues (Ehrenthal et al., 2015). It comprises three highly correlated subscales that address abilities around the topics of self-perception, shaping contact, and key relationship models. In the initial validation study, reported fit indices of the model were acceptable to good [TLI = 0.93; CFI = 0.95; RMSEA (90% CI) = 0.10 (0.09–0.11)]. Patients with higher scores in the OPD-SQS reported more previous psychotherapeutic and psychiatric treatment, independent of general symptom load (Ehrenthal et al., 2015). The OPD-SQS correlates with an interview-based assessment of DSM-5 LPFS [r = 0.78; (Zettl et al., 2019)], impaired reflective functioning (Zettl et al., 2020), and other convergent measures of severity of personality problems (Obbarius et al., 2019; Zimmermann et al., 2020). OPD-SQS scores partially mediate the association between adverse childhood experiences and health-related variables such as distress, experience of somatic symptoms, and body dysmorphic concerns (Krakau et al., 2021), and have been used in other areas of clinical psychology and health psychology (Ernst et al., 2022; Graetz et al., 2022; Vierl et al., 2022; Bröcker et al., 2023; Ernst et al., 2023; Zara et al., 2023).
While research on DSM-5 and ICD-11 personality functioning and related constructs such as the OPD has flourished in clinical samples as well as easy-to-access convenience samples, much less is known about the general population. In fact, Zimmermann and colleagues (Zimmermann et al., 2019) demanded that “… representative samples from the general population should be collected to establish normative values, which will greatly enhance the interpretation of test scores in single-case scenarios.” In accordance with this task, we present representative norm values of the German adult population of a common instrument to assess personality functioning: the OPD-SQS (Ehrenthal et al., 2015). In addition, we tested several models to replicate and expand previous findings on factorial validity and reliability. Furthermore, we addressed measurement invariance with regard to gender,1 measurement year, and age group. Finally, we aimed at replicating associations with general psychopathology as well as relationships with occupational functioning, the latter operationalized as unemployment frequency, personal income, and household income, and possible interaction effects of general psychopathology and personality functioning on occupational functioning.
2. Methods
2.1. Participants and procedure
The studies were not formally preregistered. The present representative study samples were collected in the years 2013, 2016, and 2019 by the demographic consulting company USUMA by order of the University of Leipzig. Sample size per study was determined by the usual procedure of the company. A total of N = 7,549 participants was collected using a multistage sampling method based on electoral districts, households, and persons in the household. Households were selected via random route procedure, and household members were selected using the Kish selection grid. This procedure aimed at obtaining a representative sample of the German population in terms of sex, age, and education. We confirmed this by comparing the distributions with data provided by the Federal Statistical Office of Germany (Statistisches Bundesamt. Bevölkerung, 2019). Descriptive statistics are reported in Table 1. Only participants with sufficient German language skills and an age of 18 or older were included. All participants were interviewed face-to-face by an USUMA employee, who assessed their language skills prior to the interview, which also served as a data validity check. Prior to participating, all participants were informed of the investigation’s general purpose and procedure and that data storage would be anonymized. In addition, they received a detailed data protection statement. The study included questionnaires assessing mental well-being of respondents. However, since no medical or psychological interventions were applied, there was no risk involved for participants. In accordance with German law, all participants provided verbal informed consent. Additionally, the studies followed the ICC/ESOMAR International Code of Marketing and Social Research Practice. After being informed of the general purpose of the survey, participants filled out the questionnaires mentioned below.
In the current study, there were some missing data for the OPD-SQS. Due to the large samples as well as prerequisites of some of the conducted analyses, we only included individuals with complete data regarding the OPD-SQS. This resulted in an exclusion of 293 individuals,2 leaving 7,256 cases to be analyzed.
2.2. Instruments
2.2.1. Personality functioning
The OPD-SQS (Ehrenthal et al., 2015) is a 12-item version of the OPD-Structure Questionnaire (Ehrenthal et al., 2012) described above. Individuals respond to each question on a scale from 0 (“fully disagree”) to 4 (“fully agree”). Different from the full version, where mean values are computed, the OPD-SQS uses a sum score for an easier use in clinical settings, resulting in a range of possible values from 0 to 48. Higher numbers indicate more impairment in personality functioning. In addition, three subscales (self-perception, shaping contact, and relationship model) with four items each can be computed. Findings on reliability and validity are cited above.
2.2.2. General psychopathology
The PHQ-4 (Löwe et al., 2010) is a very brief measure of depression and anxiety derived from the depression and anxiety scales of the Patient Health Questionnaire (Kroenke et al., 2009), which is often used to assess general levels of common psychopathology. Two items on depression and two items on anxiety are scored on a scale from 0 (“not at all”) to 3 (“nearly every day”), resulting in a range for the sum score from 0 to 12. Higher numbers indicate more depressive and anxiety symptoms. The PHQ-4 is widely used as a screening measure or in representative samples as an assessment of common psychopathology. In addition, it has been associated with symptoms related to impaired personality functioning such as self-harm (Müller et al., 2016) or adverse childhood experiences (Schilling et al., 2016). In our study, ω for the PHQ-4 was 0.874 across all samples.
2.2.3. Occupational functioning
A predominantly occupational aspect of psychosocial functioning was assessed by reported unemployment frequency (“How often have you been unemployed including current unemployment?”), personal income (13 groups in total, ascending in predefined steps from no personal income to 5,000 Euro and more), and household income (following the same ascending logic from under 500 Euro to 5,000 Euro and more). Both income variables were assessed as they seem to be related to psychosocial functioning in personality disorders in the long term (Skodol, 2018).
2.3. Statistical analyses
All analyses were conducted in R, using the packages lavaan and semTools (Rosseel, 2012; Jorgensen et al., 2020). First, we conducted confirmatory factor analyses for all three subsamples separately and jointly. Since the response data exhibits a strong right-skew, we used robust diagonally weighted least squares estimation and theta parameterization [WLSMV in lavaan (Li, 2016)]. We then judged the closeness of model fit based on the common recommendations (Hu and Bentler, 1999; Schermelleh-Engel et al., 2003): 2 should be non-significant, CFI and TLI should be greater than 0.950, and RMSEA and SRMR should be smaller than 0.080. We investigated reliability using McDonald’s (McDonald, 1999). Because of the ordered categorical data assumption, we used Green and Yang’s formula to estimate the coefficient (Green and Yang, 2009). Next, we tested for measurement invariance to ensure the comparability of observed groups between sexes, age groups, and measurement points (Meredith, 1993). Some modifications to the typical procedure have to be made to account for the ordinal data structure (Millsap and Yun-Tein, 2004; Wu and Estabrook, 2016). That is, intercepts are fixed to zero in all groups for identification purposes, and one instead checks the invariance of thresholds across groups. The successive constraint levels, thus, refer to item thresholds, factor loadings, and residual variances. Chen (2007) provides cut-off values for these nested model comparisons: 2 should be non-significant, ΔCFI should be ≤ 0.010, and ΔRMSEA should be ≤ 0.015. We conducted ordered logistic regression analyses for associations between OPD-SQS, PHQ-4, and their interaction on the one, and unemployment frequency, personal income, and household income using the R package MASS (Venables and Ripley, 2010). We report Nagelkerke’s R2 as a measure of effect size for the related models. We report how we determined our sample size, all data exclusions (if any), and all manipulations. As the USUMA studies usually comprise a variety of instruments per measurement point, we can only report the measures of interest for this study.
3. Results
3.1. Item descriptive analyses
As can be seen from the descriptive item parameters reported in Table 2, all of the OPD-SQS’s items have positive skewness. This means that the majority of participants responded with low values (such as 0 or 1), and a smaller number of participants responded with options in the middle or the upper extreme of the scale.
3.2. Confirmatory factor analysis
Using the procedure described in the method section, we then tested the OPD-SQS’s factorial validity. As can be seen in Table 3, model fit was acceptable in all three samples. The 2 test was significant in all cases, and the descriptive measures of fit were in an acceptable range. CFI never fell below 0.950, and TLI was only marginally below the threshold in one sample. SRMR evinced good fit with values around 0.050. RMSEA fell slightly above the 0.080 cut-off value in two samples and clearly above it in the third sample. Overall, fit measures indicated acceptable fit. Standardized factor loadings are reported in Table 2 for all three samples. Most loadings exceeded 0.70, indicating strong discrimination at the trait level. Across the board, had very good values considering the brevity of the three scales: not a single coefficient was below 0.800.
To justify the construction of a total scale score, we also tested a bi-factor model (Reise et al., 2007; Chen et al., 2012) for the OPD-SQS across the combined sample. This model showed a further improved fit, 2 (Obbarius et al., 2019) = 1370.865, p < 0.001, CFI = 0.985, TLI = 0.977, RMSEA = 0.066, SRMR = 0.030. The hierarchical coefficient of 0.834 indicated that the majority of the OPD-SQS’s variance can be traced to a general factor.
In addition, we computed a second-order factor model in which the subscale factors of the OPD-SQS load on a higher order general factor. This model fit was slightly worse than the bi-factor model, but was still acceptable with regard to three out of the four employed descriptive fit indices, 2 (Löwe et al., 2010) = 3214.042, p < 0.001, CFI = 0.965, TLI = 0.955, RMSEA = 0.092, SRMR = 0.046. Reliability of the second order construct was ω = 0.870 at the first level, and 0.925 at the second level. The former of the two coefficients represents the proportion of total variance explained by the general factor in the model-implied covariance matrix.
3.3. Measurement invariance and group-specific differences of the OPD-SQS
We then tested the OPD-SQS’ three-factor model for measurement invariance across measurement years, age groups, and participant sex.3 As can be seen in Table 4, ΔCFI and ΔRMSEA never exceeded their respective cut-offs. Thus, we accept the measurement process for the OPD-SQS’s model to be invariant across the three aforementioned grouping variables.
Given invariance, we then checked for differences in observed OPD-SQS sum scores across the three grouping variables (see Table 5). Eight out of nine F tests were significant, but this is not surprising given the very large sample size. As can be seen with the proportions of systematic variance η2, only participant sex explained more than 1%, and only for the ‘self’ subscale. Overall, the OPD-SQS scores were thus largely unaffected by participant sex, age, and measurement time.
3.4. Convergent validity
We report latent and observed correlations among the OPD-SQS subscales and between the OPD-SQS and the PHQ-4 (see Table 6). Latent and observed correlations between the subscales were very high (r ≥ 0.677 and 0.503, respectively). Considering the PHQ-4 as a related measure of psychopathology, all subscales showed the expected pattern of moderate to strong associations.
3.5. Norm values
Finally, we report Table 7 with normative percentile values for the OPD-SQS’s subscales and the total score. Since sociodemographic variables and time of measurement had only negligible impact on the sum scores, we did not stratify the norm values in any way.
3.6. Occupational functioning
Number of unemployment times was not assessed in the 2016 survey. In all available samples, PHQ-4 as well as OPD-SQS, but not their interaction, were significantly associated with a higher probability for a higher unemployment frequency, and with a lower probability for lower personal as well as household income, with generally small effects (see Table 8).
Table 8. Associations between personality functioning, common psychopathology, and occupational functioning.
4. Discussion
In three samples representative of the German adult population with more than 7,000 participants, we found a 12-item self-report measure of personality functioning to be mostly independent of gender, age and assessment year. OPD-SQS scores were associated with general common psychopathology as well as indices of occupational functioning.
The results of reliability and confirmatory factor analyses closely resemble results from previously published studies. Internal consistency was high in the original evaluation in a mixed as well as a clinical sample [Cronbach’s α = 0.87–0.89; (Ehrenthal et al., 2015)], a Danish college counseling sample [α = 0.85; (Østergård et al., 2019)], a mixed clinical and control sample [α = 0.92; (Zettl et al., 2020)], and a clinical sample [α = 0.88–0.89; (Obbarius et al., 2019)]. Across studies and samples, the OPD-SQS seems to be of robust acceptable to high internal consistency. The same applies for the CFA, which is also within the range of the original evaluation (Ehrenthal et al., 2015) and the data from Obbarius and colleagues (Obbarius et al., 2019). Similar to Obbarius et al., fit indices improved when testing a bifactorial model. Taken together, our results add to the stability of a general factor resulting from three interrelated facets. We also found that this was largely unaffected by variables such as age, gender, or the year of our measurement points. Therefore, the scores can be reasonably compared for inferences with relation to the theorized constructs.
Correlations with general common psychopathology were high. To our knowledge, there is no published study that did not find similar associations. This confirms OPD-SQS personality functioning as a substantial statistical predictor of psychological distress. Previous studies found the OPD-SQ and OPD-SQS to be associated to other variables such as attachment, personality, and mentalization even when statistically controlling for the effect of general psychopathology (Ehrenthal et al., 2012, 2015; Zettl et al., 2020). However, we cannot conclude the direction of the association from the current dataset, and further research with longitudinal designs and intensive measurement is needed to disentangle the shared variance.
Associations with indices of occupational function (i.e., unemployment frequency, personal, and household income) were significant but small. This points toward the importance of personality functioning as a risk factor that limits an individual’s options to live up to their full potential. We found no significant interactions between OPD-SQS and PHQ-4, tentatively suggesting several pathways from what used to be called Axis I and Axis II in the DSM-IV on related variables. Associations between occupational functioning and personality functioning are complex and call for more sophisticated designs and measures that take into account objective as well as subjective measures, and also other areas that go beyond mere occupational functioning, including relational and interpersonal functioning (Frankenburg and Zanarini, 2011; Skodol, 2018; Cruitt and Oltmanns, 2019; Buer Christensen et al., 2020). In addition, other areas such as educational achievement could be of interest for future research. This would need to include other variable such as intelligence. While one study (Bock et al., 2018) did not find a relationship between intelligence and the long version of the OPD-SQ (r = 0.02) in a clinical sample of 147 adolescents, this has yet to be replicated in adult samples.
Strengths of this study are the use of a rigorous sampling strategy and the high quality of the data. To our knowledge, this is also the first study using three samples each representative of the respective adult population to address the questions of reliability and validity of the construct of levels of personality functioning. The results are robust and comparable to earlier studies from mixed and clinical samples. In addition, we computed norm values that can be used for comparison and help to classify individuals according to the similarity or deviation of their personal scores on the instrument. Limitations are a cross-sectional design that limits inferences about causality. Even more so, using longitudinal designs that take into account significant personal events would be more suited to test the impact of personality functioning as a vulnerability factor. One might also argue from a methodological perspective that it would be sufficient to test invariance for a general factor and not the three subscales, especially, as the dataset does not allow for more nuanced testing of associations in terms of external validity. However, we wanted to stick with the originally proposed factor model, and would again stress the need for more longitudinal studies. And last, but not least: by using samples representative of the German adult population, we do include individuals with higher as well as lower levels of personality functioning, of which some may even be in psychotherapeutic or psychiatric treatment. Therefore, especially when using it as a reference sample, it is important to keep in mind that it is not a purely non-clinical dataset, but rather one that represents current distributions of psychopathology as one would expect in the general population.
From a clinical perspective, it is important to note that the development of measures from different traditions does not need to be a disadvantage. Quite the contrary, as personality functioning seems to be captured adequately and largely comparably by a variety of questionnaires and interviews (Wright et al., 2022), it provides clinicians enough freedom to use the construct within their respective intervention models, which is important for acceptance and dissemination. In addition, first attempts to make these measures comparable have been published as well (Zimmermann et al., 2020; Obbarius et al., 2021). And last, but not least, the third edition of the Operationalized Psychodynamic Diagnosis system (OPD-3) has just been published (Arbeitskreis zur Operationalisierung Psychodynamischer Diagnostik, 2023). While some subscales of the LSIA have been altered, most of the core aspects of OPD-2 personality functioning remained in the manual. Due to this continuity as well as the assumption of personality functioning to be a core latent construct which can manifest in different facets, we consider the OPD-SQ and OPD-SQS still similarly valid with regard to the expert rating. Taken together, the OPD-SQS can be considered a robust brief measure to assess personality functioning in the general population.
Data availability statement
Due to the nature of the data collection, the datasets are not published in an open science repository. The datasets with the codes for the statistical analyses can be made available from the first author, upon reasonable request.
Ethics statement
The studies involving humans were approved by the Institutional Review Board of the Medical Faculty of Leipzig University, Leipzig, Germany (050/13‐11032013; 297/16ek; Az 145/19-ek). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
JE: conceptualization, writing of the original draft, methodology, and data curation. JK: conceptualization and data curation. BS: methodology and statistical analyses. UD, SW, HS, and HK: conceptualization. EB: conceived and designed original surveys. All authors contributed to manuscript revision, read, and approved the submitted version.
Conflict of interest
JE, UD, and HS are authors of the original OPD-SQ and OPD-SQS. The questionnaires are free of charge and these authors declare no commercial or financial relationship that could be construed as a potential conflict of interest.The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
1. ^As the assessment procedure did not take into account various aspects of gender, we can only conduct analyses to a binary male–female version of gender.
2. ^To be more precise, of 90,588 (12 items x 7,549 participants) possible values of the OPD-SQS, less than 1% (658) were missing, which led to the abovementioned exclusion of less than 1% of the initial participants.
3. ^As mentioned above, we can only conduct analysis with regard to a binary (male–female) variant of gender, which we use the word ‘sex’ for on a level of operationalization to describe a binary self-attribution by the participants.
References
Arbeitskreis zur Operationalisierung Psychodynamischer Diagnostik. OPD-2 - Operationalisierte Psychodynamische Diagnostik: Das Manual für Diagnostik und Therapieplanung. (3rd Edn.). Bern: Hans Huber; (2014).
Arbeitskreis zur Operationalisierung Psychodynamischer Diagnostik. OPD-3 - Operationalisierte Psychodynamische Diagnostik: Das Manual für Diagnostik und Therapieplanung. Göttingen: Hogrefe; (2023).
Bach, B., and Anderson, J. L. (2020). Patient-reported ICD-11 personality disorder severity and DSM-5 level of personality functioning. J. Personal. Disord. 34, 231–249. doi: 10.1521/pedi_2018_32_393
Baie, L., Hucklenbroich, K., Hampel, N., Ehrenthal, J. C., Heuft, G., and Burgmer, M. (2020). Steht das strukturelle Integrationsniveau nach OPD-2 in Zusammenhang mit der Symptomschwere einer Posttraumatischen Belastungsstörung (PTBS)? – Eine Kohortenstudie bei Patienten einer Trauma-Ambulanz. Z. Psychosom. Med. Psychother. 66, 5–19. doi: 10.13109/zptm.2020.66.1.5
Berens, S., Schaefert, R., Ehrenthal, J. C., Baumeister, D., Eich, W., and Tesarz, J. (2021). Different dimensions of affective processing in patients with irritable bowel syndrome: a multi-center cross-sectional study. Front. Psychol. 12:625381. doi: 10.3389/fpsyg.2021.625381
Berens, S., Schaefert, R., Ehrenthal, J. C., Baumeister, D., Gauss, A., Eich, W., et al. (2021). The validity of somatic symptom disorder in patients with gastrointestinal complaints. J. Clin. Gastroenterol. 55, e66–e76. doi: 10.1097/MCG.0000000000001505
Bock, A., Sevecke, K., Huber, E. M. P., Weil, P. B. M., and Ehrenthal, J. C. (2018). Der OPD-Strukturfragebogen (OPD-SF) in Anwendung auf eine jugendliche Schul- und klinische Stichprobe: Ergebnisse zu Reliabilität und Validität. Prax. Kinderpsychol. Kinderpsychiatr. 67, 674–690. doi: 10.13109/prkk.2018.67.7.674
Bröcker, A.-L., Zimmermann, J., Stuke, F., Just, S., Bayer, S., Mielau, J., et al. (2023). Exploring the latent structure and convergent and incremental validity of the metacognition assessment scale – abbreviated in a sample of patients with non-affective psychosis. J. Pers. Assess. 105, 100–110. doi: 10.1080/00223891.2022.2048843
Buer Christensen, T., Eikenaes, I., Hummelen, B., Pedersen, G., Nysæter, T., Bender, D. S., et al. (2020). Level of personality functioning as a predictor of psychosocial functioning—concurrent validity of criterion a. Personal Disord 11, 79–90. doi: 10.1037/per0000352
Bugaj, T. J., Müksch, C., Ehrenthal, J. C., Köhl-Hackert, N., Schauenburg, H., Huber, J., et al. (2016). Stresserleben bei Medizinstudierenden: Welche Rolle spielen Bindungserleben und Persönlichkeitsaspekte?: Eine Querschnittsanalyse. Psychother. Psychosom. Med. Psychol. 66, 88–92. doi: 10.1055/s-0035-1569285
Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Struct. Equ. Model. Multidiscip. J. 14, 464–504. doi: 10.1080/10705510701301834
Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J.-P., and Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs: a comparison of the bifactor model to other approaches. J. Pers. 80, 219–251. doi: 10.1111/j.1467-6494.2011.00739.x
Cruitt, P. J., and Oltmanns, T. F. (2019). Unemployment and the relationship between borderline personality pathology and health. J. Res. Pers. 82. doi: 10.1016/j.jrp.2019.103863
Dagnino, P., Ugarte, M. J., Morales, F., González, S., Saralegui, D., and Ehrenthal, J. C. (2020). Risk factors for adult depression: the influence of personality functioning. Front. Psychol. 11. doi: 10.3389/fpsyg.2020.594698
Dinger, U., Fuchs, M., Köhling, J., Schauenburg, H., and Ehrenthal, J. C. (2021). Change of emotional experience in major depression and borderline personality disorder during psychotherapy: associations with depression severity and personality functioning. J. Personal. Disord. 35, 1–20. doi: 10.1521/pedi_2019_33_420
Dinger, U., Schauenburg, H., Hörz, S., Rentrop, M., Komo-Lang, M., Klinkerfuß, M., et al. (2014). Self-report and observer ratings of personality functioning: a study of the OPD system. J. Pers. Assess. 96, 220–225. doi: 10.1080/00223891.2013.828065
Ehrenthal, J. C., and Benecke, C. (2019). “Tailored treatment planning for individuals with personality disorders: the operationalized psychodynamic diagnosis (OPD) approach” in Case formulation for personality disorders: tailoring psychotherapy to the individual client. ed. U. Kramer (London, San Diego, Cambridge, MA, Oxford: Academic Press, an imprint of Elsevier), 291–314.
Ehrenthal, J. C., Dinger, U., Horsch, L., Komo-Lang, M., Klinkerfuss, M., Grande, T., et al. (2012). Der OPD-Strukturfragebogen (OPD-SF): Erste Ergebnisse zu Reliabilität und Validität. Psychother. Psychosom. Med. Psychol. 62, 25–32. doi: 10.1055/s-0031-1295481
Ehrenthal, J. C., Dinger, U., Schauenburg, H., and Lambert, L. (2015). Entwicklung einer Zwölf-Item-Version des OPD-Strukturfragebogens (OPD-SFK). Z. Psychosom. Med. Psychother. 61, 262–274. doi: 10.13109/zptm.2015.61.3.262
Ehrenthal, J. C., Düx, A., Baie, L., and Burgmer, M. (2019). Levels of personality functioning and not depression predict decline of plasma glucose concentration in patients with type 2 diabetes mellitus. Diabetes Res. Clin. Pract. 151, 106–113. doi: 10.1016/j.diabres.2019.04.011
Ehrenthal, J. C., Schöckel, A., Nikendei, C., Dinger, U., Schauenburg, H., and Lambert, L. (2020). Gruppentherapie zu Stabilisierung und Selbstregulation bei posttraumatischer Belastungsstörung (STABILI-T). Psychotherapeut 65, 264–271. doi: 10.1007/s00278-020-00434-w
Ernst, M., Brähler, E., Kampling, H., Kruse, J., Fegert, J. M., Plener, P. L., et al. (2022). Is the end in the beginning? Child maltreatment increases the risk of non-suicidal self-injury and suicide attempts through impaired personality functioning. Child Abuse Negl. 133:105870. doi: 10.1016/j.chiabu.2022.105870
Ernst, M., Brähler, E., Kruse, J., Kampling, H., and Beutel, M. E. (2023). Does loneliness lie within? Personality functioning shapes loneliness and mental distress in a representative population sample. J. Affect. Disord. Rep. 12:100486. doi: 10.1016/j.jadr.2023.100486
Frankenburg, F. R., and Zanarini, M. C. (2011). Relationship between cumulative BMI and symptomatic, psychosocial, and medical outcomes in patients with borderline personality disorder. J. Personal. Disord. 25, 421–431. doi: 10.1521/pedi.2011.25.4.421
Graetz, C., Ehrenthal, J. C., Kowalski, R., Cyris, M., Geiken, A., and Dörfer, C. E. (2022). Periodontal maintenance: individual patient responses and discontinuations. BMC Oral Health 22:610. doi: 10.1186/s12903-022-02655-8
Green, S. B., and Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: an alternative to coefficient alpha. Psychometrika 74, 155–167. doi: 10.1007/s11336-008-9099-3
Hu, L., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 6, 1–55. doi: 10.1080/10705519909540118
Immel, N., Dagnino, P., and Hunger-Schoppe, C. (2022). Associations between patient personality, symptomatic change and therapy dropout. Clin. Psychol. Psychother. 29, 922–932. doi: 10.1002/cpp.2670
Jauk, E., and Ehrenthal, J. C. (2021). Self-reported levels of personality functioning from the operationalized psychodynamic diagnosis (OPD) system and emotional intelligence likely assess the same latent construct. J. Pers. Assess. 103, 365–379. doi: 10.1080/00223891.2020.1775089
Jorgensen, TD, Pornprasertmanit, S, Schoemann, AM, Rosseel, Y, Miller, P, Quick, C, et al. SemTools: useful tools for structural equation modeling (0.5–3): [Computer software]; (2020). Available at: https://CRAN.R-project.org/package=semTools.
Knefel, M., Toro, S., Meier, M., Wlassits, W., and Pidlich, J. (2021). Effektivität stationärer internistisch-psychosomatischer Behandlung im Krankenhaus: evaluation eines Behandlungskonzepts in Niederösterreich. Z. Psychosom. Med. Psychother. 67, 381–402. doi: 10.13109/zptm.2021.67.oa7
Köhling, J., Moessner, M., Ehrenthal, J., Bauer, S., Cierpka, M., Kämmerer, A., et al. (2016). Affective instability and reactivity in depressed patients with and without borderline pathology. J. Personal. Disord. 30, 776–795. doi: 10.1521/pedi_2015_29_230
König, K., Dahlbender, R. W., Holzinger, A., and Topitz, A., Doering SU-Pm (2016). Kreuzvalidierung von drei Fragebögen zur Strukturdiagnostik: BPI, IPO und OPD-SF. Z. Psychosom. Med. Psychother. 62, 177–189. doi: 10.13109/zptm.2016.62.2.177
Koops, T. U., Wiessner, C., Ehrenthal, J. C., and Briken, P. (2021). Assessing psychodynamic conflicts and level of personality functioning in women diagnosed with vaginismus and dyspareunia. Front. Psychol. 12:687369. doi: 10.3389/fpsyg.2021.687369
Krakau, L., Tibubos, A. N., Beutel, M. E., Ehrenthal, J. C., Gieler, U., and Brähler, E. (2021). Personality functioning as a mediator of adult mental health following child maltreatment. J. Affect. Disord. 291, 126–134. doi: 10.1016/j.jad.2021.05.006
Kraus, B., Dammann, G., Rudaz, M., Sammet, I., Jeggle, D., and Grimmer, B. (2021). Changes in the level of personality functioning in inpatient psychotherapy. Psychother. Res. 31, 117–131. doi: 10.1080/10503307.2020.1763493
Kroenke, K., Spitzer, R. L., Williams, J. B. W., and Löwe, B. (2009). An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics 50, 613–621. doi: 10.1176/appi.psy.50.6.613
Krueger, R. F., and Hobbs, K. A. (2020). An overview of the DSM-5 alternative model of personality disorders. Psychopathology 53, 126–132. doi: 10.1159/000508538
Li, C.-H. (2016). Confirmatory factor analysis with ordinal data: comparing robust maximum likelihood and diagonally weighted least squares. Behav. Res. Methods 48, 936–949. doi: 10.3758/s13428-015-0619-7
Löwe, B., Wahl, I., Rose, M., Spitzer, C., Glaesmer, H., Wingenfeld, K., et al. (2010). A 4-item measure of depression and anxiety: validation and standardization of the patient health Questionnaire-4 (PHQ-4) in the general population. J. Affect. Disord. 122, 86–95. doi: 10.1016/j.jad.2009.06.019
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika 58, 525–543. doi: 10.1007/BF02294825
Millsap, R. E., and Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivar. Behav. Res. 39, 479–515. doi: 10.1207/S15327906MBR3903_4
Morey, L. C., Berghuis, H., Bender, D. S., Verheul, R., Krueger, R. F., and Skodol, A. E. (2011). Toward a model for assessing level of personality functioning in DSM-5, part II: empirical articulation of a core dimension of personality pathology. J. Pers. Assess. 93, 347–353. doi: 10.1080/00223891.2011.577853
Morey, L. C., and Hopwood, C. J. (2020). Expert preferences for categorical, dimensional, and mixed/hybrid approaches to personality disorder diagnosis. J. Personal. Disord. 34, 124–131. doi: 10.1521/pedi_2019_33_398
Müller, A, Claes, L, Smits, D, Brähler, E, and Zwaan, Mde. Prevalence and correlates of self-harm in the German general population. PLoS One. (2016). 11:e0157928, doi: 10.1371/journal.pone.0157928
Nikendei, C., Mölle, C., Fischer, K., Granov, M., Huber, J., Dinger, U., et al. (2020). Persönlichkeitsstruktur und Bindungsstil als Prädiktoren für die erfolgreiche Aufnahme einer ambulanten psychotherapeutischen Behandlung: = level of personality functioning and attachment style as predictors of the successful referral to outpatient psychotherapy. Z. Psychosom. Med. Psychother. 66, 178–192. doi: 10.13109/zptm.2020.66.2.178
Obbarius, A., Ehrenthal, J. C., Fischer, F., Liegl, G., Obbarius, N., Sarrar, L., et al. (2021). Applying item response theory to the OPD structure questionnaire: identification of a unidimensional Core construct and feasibility of computer adaptive testing. J. Pers. Assess. 103, 645–658. doi: 10.1080/00223891.2020.1828435
Obbarius, A., Obbarius, N., Fischer, F., Liegl, G., and Rose, M. (2019). Evaluation der Faktorenstruktur und Konstruktvalidität der 12-Item Kurzversion des OPD-Strukturfragebogens (OPD-SFK) an psychosomatischen Patienten. Psychother. Psychosom. Med. Psychol. 69, 38–48. doi: 10.1055/s-0043-125394
Østergård, O. K., Fenger, M., and Hougaard, E. (2019). Symptomatic distress and effectiveness of psychological treatments delivered at a nationwide student counseling service. Couns. Psychol. Q. 32, 150–168. doi: 10.1080/09515070.2017.1410696
Reise, S. P., Morizot, J., and Hays, R. D. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Qual. Life Res. 16, 19–31. doi: 10.1007/s11136-007-9183-7
Rek, K., Thielmann, I., Henkel, M., Crawford, M., Piccirilli, L., Graff, A., et al. (2020). A psychometric evaluation of the standardized assessment of severity of personality disorder (SASPD) in nonclinical and clinical German samples. Psychol. Assess. 32, 984–990. doi: 10.1037/pas0000926
Rohde, J., Hofmann, T., Voigt, B., Rose, M., and Obbarius, A. (2019). Measurement of personality structure by the OPD structure questionnaire can help to discriminate between subtypes of eating-disorders. Front. Psychol. 10:2326. doi: 10.3389/fpsyg.2019.02326
Rosseel, Y. (2012). Lavaan: an R package for structural equation modeling. J. Stat. Soft. 48. doi: 10.18637/jss.v048.i02
Schauenburg, H., and Grande, T. (2012). “Interview measures of interpersonal functioning andquality of object relations” in Handbook of interpersonal psychology. eds. L. M. Horowitz and S. Strack (Hoboken, NJ: John Wiley & Sons, Inc), 343–356.
Schermelleh-Engel, K., Moosbrugger, H., and Müller, H. (2003). Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol. Res. 8, 23–74. doi: 10.2196/21279
Schilling, C., Weidner, K., Brähler, E., Glaesmer, H., Häuser, W., and Pöhlmann, K. (2016). Patterns of childhood abuse and neglect in a representative German population sample. PLoS One 11:e0159510. doi: 10.1371/journal.pone.0159510
Skodol, A. E. (2018). Impact of personality pathology on psychosocial functioning. Curr. Opin. Psychol. 21, 33–38. doi: 10.1016/j.copsyc.2017.09.006
Statistisches Bundesamt. Bevölkerung. (2019). Available at: www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Bevoelkerung/_inhalt.htm.
Tyrer, P., Crawford, M., Mulder, R., Blashfield, R., Farnam, A., Fossati, A., et al. (2011). The rationale for the reclassification of personality disorder in the 11th revision of the international classification of diseases (ICD-11): ICD-11 reclassification. Personal. Ment. Health 5, 246–259. doi: 10.1002/pmh.190
Tyrer, P., Mulder, R., Kim, Y.-R., and Crawford, M. J. (2019). The development of the ICD-11 classification of personality disorders: an amalgam of science, pragmatism, and politics. Annu. Rev. Clin. Psychol. 15, 481–502. doi: 10.1146/annurev-clinpsy-050718-095736
Venables, WN, and Ripley, BD. Modern applied statistics with S. (4th edn.). New York: Springer; (2010).
Vierl, L., Juen, F., Benecke, C., and Hörz-Sagstetter, S. (2022). Exploring the associations between psychodynamic constructs and psychopathology: a network approach. Personal Ment. Health. 1–15. doi: 10.1002/pmh.1559
Wagner-Skacel, J., Bengesser, S., Dalkner, N., Mörkl, S., Painold, A., Hamm, C., et al. (2020). Personality structure and attachment in bipolar disorder. Front. Psych. 11:410. doi: 10.3389/fpsyt.2020.00410
Wöller, W, and Kruse, J. Tiefenpsychologisch fundierte Psychotherapie: Basisbuch und Praxisleitfaden. 5., aktualisierte Auflage. Stuttgart: Schattauer; (2018).
Wright, A. G. C., Ringwald, W. R., Hopwood, C. J., and Pincus, A. L. (2022). It's time to replace the personality disorders with the interpersonal disorders. Am. Psychol. 77, 1085–1099. doi: 10.1037/amp0001087
Wu, H., and Estabrook, R. (2016). Identification of confirmatory factor analysis models of different levels of invariance for ordered categorical outcomes. Psychometrika 81, 1014–1045. doi: 10.1007/s11336-016-9506-0
Zara, S., Brähler, E., Sachser, C., Fegert, J. M., Häuser, W., Krakau, L., et al. (2023). Associations of different types of child maltreatment and diabetes in adulthood - the mediating effect of personality functioning: findings from a population-based representative German sample. Ann. Epidemiol. 78, 47–53. doi: 10.1016/j.annepidem.2022.12.004
Zeeck, A., Von, W. J., Weiss, H., Hermann, S., Endorf, K., Lau, I., et al. (2020). Self-criticism and personality functioning predict patterns of symptom change in major depressive disorder. Front. Psych. 11:147. doi: 10.3389/fpsyt.2020.00147
Zettl, M., Taubner, S., Hutsebaut, J., and Volkert, J. (2019). Psychometrische Evaluation der deutschen Version des Semistrukturierten Interviews zur Erfassung der DSM-5 Persönlichkeitsfunktionen (STiP-5.1). Psychother. Psychosom. Med. Psychol. 69, 499–504. doi: 10.1055/a-1010-6887
Zettl, M., Volkert, J., Vögele, C., Herpertz, S. C., Kubera, K. M., and Taubner, S. (2020). Mentalization and criterion a of the alternative model for personality disorders: results from a clinical and nonclinical sample. Personal. Disord. Theory Res. Treat. 11, 191–201. doi: 10.1037/per0000356
Zimmermann, J., Ehrenthal, J. C., Cierpka, M., Schauenburg, H., Doering, S., and Benecke, C. (2012). Assessing the level of structural integration using operationalized psychodynamic diagnosis (OPD): implications for DSM-5. J. Pers. Assess. 94, 522–532. doi: 10.1080/00223891.2012.700664
Zimmermann, J., Kerber, A., Rek, K., Hopwood, C. J., and Krueger, R. F. (2019). A brief but comprehensive review of research on the alternative DSM-5 model for personality disorders. Curr. Psychiatry Rep. 21:92. doi: 10.1007/s11920-019-1079-z
Keywords: personality functioning, OPD-SQS, personality disorders, assessment, norm values, validity
Citation: Ehrenthal JC, Kruse J, Schmalbach B, Dinger U, Werner S, Schauenburg H, Brähler E and Kampling H (2023) Measuring personality functioning with the 12-item version of the OPD-Structure Questionnaire (OPD-SQS): reliability, factor structure, validity, and measurement invariance in the general population. Front. Psychol. 14:1248992. doi: 10.3389/fpsyg.2023.1248992
Edited by:
Sandor Rozsa, Károli Gáspár University of the Reformed Church in Hungary, HungaryReviewed by:
Dominik Szabó, Semmelweis University, HungaryRadek Heissler, National Institute of Mental Health, Czechia
Copyright © 2023 Ehrenthal, Kruse, Schmalbach, Dinger, Werner, Schauenburg, Brähler and Kampling. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Johannes C. Ehrenthal, johannes.ehrenthal@uni-koeln.de