Comparison of Psychometric Characteristics for Five Versions of the Interpersonal Needs Questionnaire in Teenagers Sample

Interpersonal Needs Questionnaire (INQ) is a self-report measure of perceived burdensomeness and thwarted belongingness with five versions in recent studies. There are five versions of INQ. But results from studies using different versions are quite different. Current suicide behavior among teenagers has attracted much attention. But which version is more suitable for teenage samples is still uncertain. It is important to compare the potential differences in different versions of INQ to identify the most psychometrically available version to predict teenagers' acquired capability for suicide and provide them with timely help to reduce teenagers' suicide rates. This study compared the construct validity, internal consistency, validity, and average test information of each version in the sample of teenagers. Results showed the 10-item version provided the most average test information in both thwarted belongingness subscale and perceived burdensomeness subscale, and the INQ-10 is more suitable for teenage samples.

Introduction

Suicide is a major social and public health problem facing the world. Nearly 800,000 people commit suicide each year, and the number of suicide attempts is many times the number of suicides. Suicide occurred throughout the lifespan and it was the third leading cause of death in 15–19-year-old worldwide in 2016 (World Health Organization, 2019). In the general population, attempted suicide is the biggest risk factor for suicide. Suicide attempts peak in mid-puberty (Carballo et al., 2019). Suicide and serious self-harm not only seriously endanger the lives and health of young people, but also cause serious losses to individuals, families, and society.

The interpersonal–psychological theory of suicide (IPTS) was first proposed by Joiner (2005) and further expanded by Van Orden et al. (2010). This theory surpasses the previous theories of suicide in that it explains why the vast majority of people with suicidal ideation do not attempt suicide. IPTS proposes that suicidal behavior occurs only when an individual has both the desire to die and the acquired capability to engage in suicidal behavior. The desire to die is an individual's desire to end her/his life, which roughly corresponds to the common definition of suicidal ideation (Van Orden et al., 2008a). The acquired ability to engage in suicidal behavior is a learned ability, which means that through repeated exposure to painful and provocative events, the fear of death can be reduced and the tolerance of physical pain can be enhanced. According to the prediction of IPTS (Joiner, 2005; Van Orden et al., 2010), whether an individual has suicidal ideation depends on whether belongingness of the individual is met (thwarted belongingness, TB) and whether the individual considers himself/herself a burden to others (perceived burdensomeness, PB), and suicidal ideation will not turn into suicidal behavior until the acquired capability is large enough. Therefore, the interpersonal–psychological theory of suicide is defined as the framework of ideation-to-action (Klonsky and May, 2014; Klonsky et al., 2016).

Since the interpersonal–psychological theory of suicide was proposed, it has inspired many empirical studies on the causes of suicidal ideation, attempts, and fatalities. Research on the interpersonal–psychological theory of suicide has been conducted in different samples, such as undergraduates (Hagan et al., 2015; Suh et al., 2017), prison inmates (Mandracchia and Smith, 2015), physicians (Fink-Miller, 2015), older adults (Cukrowicz et al., 2013), psychiatric inpatients and outpatients (Monteith et al., 2013), military service members (Bryan et al., 2010), sexual minorities (Silva et al., 2015), and firefighters (Chu et al., 2016). The interpersonal–psychological theory of suicide was also validated cross-culturally across Korean and US undergraduate students (Suh et al., 2017). Moreover, based on IPTS, Van Orden (2009) further confirmed and extended the theory that perceived burdensomeness and thwarted belongingness were combined into interpersonal needs and constructed a corresponding Interpersonal Needs Questionnaire (INQ) with 25 items to reflect whether current interpersonal relationship needs of the individual were met. On account of the multicollinearity between thwarted belongingness and perceived burdensomeness, the 12-item INQ was later developed (Van Orden et al., 2008a). And the original authors proposed a 15-item version (Van Orden et al., 2012). An 18-item version was validated in a book on the interpersonal theory (Joiner et al., 2009) and a 10-item INQ was validated for use in military samples (Bryan et al., 2010). Each of the shorter versions of INQ is a subset of the original 25-item version. The 18-item version has been used primarily in the older adult, veterans, and college student samples in the US and college student samples in China (e.g., Davidson et al., 2011; Rasmussen and Wingate, 2011; Wong et al., 2011; Monteith et al., 2013; Zhang et al., 2013; Suh et al., 2017). The 15-item version introduced as an empirically derived refinement of the INQ-25 has been used in college student samples in the US, Singapore, China, and Switzerland (INQ-15; e.g., Van Orden et al., 2012; Hill and Pettit, 2013; Li et al., 2015; Baertschi et al., 2017; Teo et al., 2018), and Hallensleben et al. (2016) administrated the INQ-15 to a sample of German general population aged 14–75 years. The 12-item version has been used in a variety of samples in the US (e.g., Van Orden et al., 2008a; Davidson et al., 2009; Freedenthal et al., 2011; Hill and Pettit, 2012; Lamis and Lester, 2012). The 10-item version has been used primarily in military samples (e.g., Bryan et al., 2010, 2012, 2013; Bryan, 2011). According to previous studies (e.g., Bryan, 2011; Davidson et al., 2011; Freedenthal et al., 2011; Baertschi et al., 2017), the original version and its four shorter versions had acceptable internal consistencies and validities.

Although previous studies showed the INQ predicted suicide behaviors significantly (e.g., Van Orden et al., 2008a,b), a large number of discrepant studies found different versions of INQ had some differences in predicting suicide behaviors. For example, the INQ-25 (Anestis and Joiner, 2011), the INQ-18 (Wong et al., 2011), the INQ-12 (Hill and Pettit, 2012), and INQ-10 (Bryan et al., 2012) have been confirmed that perceived burdensomeness was a significant predictor, but thwarted belongingness was not. On the contrary, both perceived burdensomeness and thwarted belongingness had adequate predictive validity in the 12-item version (Lamis and Malone, 2011) and the 15-item version (Van Orden et al., 2012). The differences in the predictive validity of the measures confuse future researchers on which version of INQ should be used. Furthermore, there is documentation on how to select items in the previous literature for the INQ-25 and INQ-15. But for the other versions, it is unclear how to select items from the original 25-item. Therefore, it is necessary to investigate and compare the psychometric characteristics of the five versions of the INQ in the same sample.

In the past, most psychological constructs of self-rating measurements have been assessed through classical test theory (CTT), which focuses on construct validity, internal consistency, and test-retest stability (Hunsley and Mash, 2008). However, CTT methods to assess interpersonal needs of an individual rely on the total score or transformed total score and fail to offer individuals with more direct information about his/her interpersonal needs range. This goal can be realized through the application of the item response theory (IRT). As the basis of the latest psychometric techniques, the IRT methods can provide analyses of individual latent traits (e.g., interpersonal needs) and item characteristics.

Based on IRT, item and test-information functions can be calculated by integrating the estimated parameters in IRT models to describe graphically and most precisely evaluate the regions of the individual latent trait continuum. Based on the IRT, item and test-information functions assessed on the same latent trait instrument are comparable in different measurements (Fayers, 2004). Therefore, based on the IRT methods, multiple inventories on a single and common metric can be comparable. What is more, the IRT methods can provide suggestions on which item or inventory can provide the most information for different latent traits (Olino et al., 2012).

Until now, no study has compared the psychometric characteristics of different INQ versions based on the IRT in the teenage samples and no study has investigated which version of INQ is more suitable for teenage samples. But the issue of teenagers' suicide cannot be ignored. From the Centers for Disease Control and Prevention, the incidence of suicide attempts peaks in mid-puberty, and the suicide mortality rate steadily increases throughout the teenage period with age. It is the third leading cause of death among young people aged 10–24 (Centers for Disease Control Prevention, 2017). The suicidal characteristics of teenagers are different from those of adults (Parellada et al., 2008). Hence, an effective tool is needed to assess the ranges of interpersonal needs of young people to identify a higher risk of suicidal behaviors. Predicting which individual is likely to commit suicide will help establish strategies for youth suicide prevention and intervention. It is important to explore the potential differences in different versions of INQ to identify the most psychometrically available version to assess the range of interpersonal needs. Moreover, results from many empirical studies found that the relationship between thwarted belongingness and suicidal behaviors was generally weaker in comparison to perceived burdensomeness (Ma et al., 2016; Chu et al., 2017). It is necessary to verify whether this phenomenon exists in teenagers.

In this study, we have investigated and compared the psychometric properties of five versions of the INQ based on an IRT model, to identify the version (or versions), which is more suitable for teenage samples to assess interpersonal needs. Since INQ-15 is a refinement of the INQ-25 (see Van Orden et al., 2012) and how the other versions select items from the original 25-item version is unknown, we hypothesized that the 15-item version would have adequate psychometric characteristics concerning factor structure, internal consistency, and validity. According to Hill et al. (2015), we hypothesized that the 15-item version and 10-item version would show more satisfactory psychometric characteristics compared to the other versions. Based on the IPTS and previous studies, we also hypothesized that in the INQ-12, INQ-18, and INQ-25, perceived burdensomeness, but not thwarted belongingness, would significantly predict capability for suicide and that both PB and TB would significantly predict capability for suicide in the INQ-15 and the INQ-10. Since no research were testing average test information and the differential item functioning caused by gender in the five versions, no specific hypotheses were made. The software R (Version 3.3.21) and the R packages mirt (Version 1.24; Chalmers, 2012) were employed to estimate item parameters. Moreover, we also compared which version could provide greater average test information in a larger range of latent traits. What is more, there was a conversion table provided to obtain the transformed scores of each version. At last, this study is also exempted to test the hypotheses of the IPTS and guide refinement of the IPTS.

Methods

Participants

The complete data in the study was available for 905 individuals after deleting the missing response data. Participants were Chinese teenagers from four middle schools in two provinces of China. The mean age of the participants was 15.03 years ranged from 12 to 18 years (SD = 1.70). Participants were predominantly male (60.4%), only child (77.8%), and urban (78.6%). Participants were from six grades: Junior One (10.2%), Junior Two (22.9%), Junior Three (10.5%), Senior One (16.6%), Senior Two (16.8%), and Senior Three (23.1%). Both written and verbal consents were acquired from parents of the participants before taking part in the experiment. This study was approved by the Ethics Committee of Jiangxi Normal University and was conducted following the ethical principles of the Declaration of Helsinki.

Measures

The Interpersonal Needs Questionnaire (INQ; Van Orden, 2009) is a 25-item self-report measure used to assess thwarted belongingness and perceived burdensomeness. Each of the 18-, 15-, 12-, and 10-item versions is a subset of the original 25-item version (see Table 1). Each item is rated on a 7-point Likert scale ranging from 1 (not at all true for me) to 7 (very true for me). The higher scores represent thwarted belongingness and perceived burdensomeness of the heavier individuals. The coefficients of Cronbach's alpha of five versions ranged from 0.91 to 0.95 in the current study.

TABLE 1

Table 1. Items included in each version of the INQ.

The revised UCLA Loneliness Scale (Russell et al., 1980) is a 20-item self-report measure of loneliness. Participants are asked to rate the frequency of satisfaction and dissatisfaction with social relationships. All items are on a 4-point Likert scale ranging from 1 (never) to 4 (always). The higher scores represent higher levels of loneliness. Russell et al. (1980) reported a high internal consistency for the scale (Cronbach's alpha = 0.94), as well as support for the validity of the scale. In the current study, the scale had a high internal consistency (Cronbach's alpha = 0.91).

The Perceived Social Support Scale (PSSS; Blumenthal et al., 1987) is a 12-item self-report measure of social support. Participants rate their degree of agreement to statements describing people can give them support on a 7-point Likert scale, ranging from “strongly agree” to “strongly disagree.” The higher scores represent more social support. Blumenthal et al. (1987) reported a good internal consistency (Cronbach's alpha = 0.88). In the current study, the scale had a high internal consistency (Cronbach's alpha = 0.94).

The Acquired Capability for Suicide Scale–Chinese Version (ACSS-CV; Yang et al., 2019) is a 14-item self-report measure of acquired capability for suicide. Participants rate their degree of agreement to statements that describe their fearlessness about lethal self-injury on a 5-point Likert scale, ranging from “I do not agree at all” to “I fully agree.” The higher scores represent less fearlessness about lethal self-injury. Yang et al. (2019) reported a proper internal consistency (Cronbach's alpha = 0.78). In this study, the scale had a good internal consistency (Cronbach's alpha = 0.80).

Analysis

Construct validity

Confirmatory factor analysis (CFA) was used to examine the fit of the structure of five versions of the INQ, and several global fit indices were used to evaluate the fitness, including the root mean square error of approximation (RMSEA), the standardized root mean square residual (SRMR), the comparative fit index (CFI), and the Tucker–Lewis index (TLI). RMSEA and SRMR values <0.08 (Browne and Cudeck, 1992; Hu and Bentler, 1999), and CFI and TLI values close to 0.95 or greater were considered adequate (Brown, 2006).

Internal consistency and validity

Cronbach's alpha coefficients were used to examine the internal consistency of each version scale and its subscales. And regression equations were constructed to test whether the five versions of PB and TB would predict acquired capability for suicide (measured by the ACSS-CV) significantly.

Differential item functioning

If respondents from different groups (e.g., gender) with the same ability or proficiency level have different probabilities of choosing the same option for a certain item, then the item is flagged for differential item functioning (DIF; Kim, 2001). In the study, DIF analysis was used to identify systematic bias caused by gender. The IRTPRO program was used to calculate the DIF analysis based on the IRT method. This program performed DIF analysis according to Lord's IRT parameter comparison technique (Lord, 1977) under the framework of IRT.

Average test information

Test information is the sum of the information of each item. When the test provides more information to the participants with a certain potential trait value (θ), the standard error of the measurement of these participants will be smaller. In other words, the measurement will be more accurate. Based on the IRT model, we calculated the total test information curve of each subscale separately. The average test information was the total test information divided by the corresponding test length. The equation of item and test information in the graded response model (GRM; Samejima, 1969) are given, respectively, as

$\begin{array}{ll}{I}_j\left(\theta \right)={\displaystyle \sum _{t=0}^{m{f}_j}}{D}^2{a}_j^2\left(P_{jt}^{{}^{*}}-P_{j,t+1}^{*}\right){\left(1-P_{jt}^{*}-P_{j,t+1}^{*}\right)}^2,& (1)\end{array}$

and

$\begin{array}{ll}I(\theta )={\displaystyle \sum _{j=1}^n}{I}_j(\theta ),& (2)\end{array}$

where

$\begin{array}{ll}{P}_{jt}^{*}=\frac{1}{1+e^{-D{a}_j({\theta }_i-b_{jt})}}.& (3)\end{array}$

Here a_j and b_jt denote the discrimination parameter and the location parameter of the item j in GRM, respectively. b_jt is the tth location parameter for item j, which satisfies b_j1 < b_j2 < · · · < b_jmfj; mf_j represents the maximum score of item j. θ_i refers to the potential trait value of the participant i. $P_{jt}^{*}$ denotes the cumulative probability of participants i gaining at least a score point t on the item j. D is a constant with a value of 1.7, I_j(θ) refers to the information provided by item j to participants whose potential trait value is θ, n is the test length. I(θ) denotes the total test information.

Expected Scores Conversion

Based on the graded response model (GRM), we estimated the item parameters and transferred the potential trait value (θ) to calculate the expected scores of five versions of INQ, and then created a conversion table to implement a comparable process. To calculate the expected scores of subscales, the individual's response probability was calculated based on the GRM. The expected scores for θ_i can be calculated as

$\begin{array}{ll}Expectedscores({\theta }_i)={\displaystyle \sum _{j=1}^n}{\displaystyle \sum _{t=1}^{m{f}_j}}{P}_{jt}({\theta }_i)\times t,& (4)\end{array}$

$\begin{array}{ll}{P}_{jt}({\theta }_i)=P_{jt}^{*}-P_{j,t+1}^{*},& (5)\end{array}$

where P_jt(θ_i) is the probability of getting t score.

Result

Confirmatory Factor Analyses

Consistent with the literature to date, items of each of the five versions were loaded in two dimensions of perceived burdensomeness and thwarted belongingness and were set to load on their hypothesized factor with a correlation between the two factors. Similar to the work of Van Orden et al. (2012), and due to consistently high modification indices across different versions, each subscale had a pair of correlated residuals (items 1 and 3 on the perceived burdensomeness subscales and items 20 and 21 on the thwarted belongingness subscales). Since INQ-12 didn't include both item 20 and item 21, this pair of residuals was not included in the corresponding thwarted belongingness subscale.

Fit indices for the models are presented in Table 2. As can be seen in Table 2, the INQ-25 and the INQ-18 met few criteria for acceptable model fit, which was consistent with Hill et al. (2015), while the INQ-15, the INQ-12, and the INQ-10 met criteria for acceptable fit for all global indices of fit. These results indicated the INQ-15, the INQ-12 and the INQ-10 were more suitable in teenage samples.

TABLE 2

Table 2. Global fit indices and correlations between subscales.

Internal Consistency and Validity

To examine the internal consistency and criterion validity of each subscale, Cronbach's coefficient alphas and correlation coefficients were generated for each subscale (see Table 3). Both perceived burdensomeness and thwarted belongingness subscales were demonstrated good internal consistency (Cronbach's alphas ranged from 0.81 to 0.93). The internal consistency coefficients of thwarted belongingness subscales were smaller than the corresponding versions of perceived burdensomeness subscales. Both perceived burdensomeness and thwarted belongingness subscales had significant correlation coefficients with the calibration standards of PSSS and UCLA Loneliness Scale. The result verified the views of Van Orden (2009) that interpersonal interactions characterized by low closeness or low frequency could not fully satisfy the sense of belonging, and might lead to feelings of loneliness and perceptions of insufficient social support. The criterion validities between the two subscales of each version were similar.

TABLE 3

Table 3. Internal consistencies, and correlations between scales.

To examine concurrent predictive validity, the regression equations were conducted. Both perceived burdensomeness and thwarted belongingness of each version were significant predictors of acquired capability for suicide (see Table 4).

TABLE 4

Table 4. Regression models of perceived burdensomeness and thwarted belongingness predicting acquired capability for suicide.

Differential Item Functioning

To examine the differential item functioning of 25 items, the ‘gender’ variable divided into males and females was used to analyze. According to parameter comparison, the first item with the significance level of 0.01 and the 18th item with the significance level of 0.001 existed DIF (see Table 5). All versions contained the first item. Therefore, the versions without the 18th item were suggested such as the 10-item version and the 12-item version.

TABLE 5

Table 5. DIF statistics for graded response model.

Average Test Information Curve

To examine the average test information of each subscale, we calculated the total test information curve of each subscale presented in Figures 1, 2, and the average test information curves were presented in Figures 3, 4, which indicated the item information contained at each node along the θ scale. Measurement providing more information had higher reliability and more measurement precision. In Figure 3, the INQ-10 provided the most average test information at the range approximately from −0.8 to 2 standard deviations of perceived burdensomeness, among the five versions. At high ranges of θ value, the five scales provided a similar amount of information, while at other ranges of θ value, the INQ-10 provided the least in the five scales. On the whole, the five scales could provide proper average test information. The results suggested that the INQ-10 could provide more measurement precision for varying degrees of perceived burdensomeness, and this suggested that the INQ-10 might be more useful in teenage samples for measuring perceived burdensomeness in clinical trials and measuring perceived burdensomeness as an index of treatment response. In Figure 4, above −1 standard deviations of thwarted belongingness, the INQ-10 provided the most average test information, while at other ranges of θ value, the INQ-10 was the least in the five scales, but close to the other versions. Similar to the result of perceived burdensomeness subscales, the thwarted belongingness subscale of the INQ-10 could provide higher reliability and more measurement precision for varying degrees of thwarted belongingness. Overall, both the perceived burdensomeness subscale and the thwarted belongingness subscale of the INQ-10 had the highest reliability and most measurement precision. Hence, in the five versions of INQ, choosing the INQ-10 may be better in teenage samples at varying degrees of interpersonal needs.

FIGURE 1

Figure 1. Total test information curves of perceived burdensomeness of each version. INQ25PB, perceived burdensomeness subscale of INQ-25; INQ18PB, perceived burdensomeness subscale of INQ-18; INQ15PB, perceived burdensomeness subscale of INQ-15; INQ12PB, perceived burdensomeness subscale of INQ-12; INQ10PB, perceived burdensomeness subscale of INQ-10, same as below.

FIGURE 2

Figure 2. Total test information curves of thwarted belongingness of each version. INQ25TB=thwarted belongingness subscale of INQ-25; INQ18TB=thwarted belongingness subscale of INQ-18; INQ15TB=thwarted belongingness subscale of INQ-15; INQ12TB=thwarted belongingness subscale of INQ-12; INQ10TB=thwarted belongingness subscale of INQ-10, same as below.

FIGURE 3

Figure 3. Average test information curves of perceived burdensomeness of each version.

FIGURE 4

Figure 4. Average test information curves of thwarted belongingness of each version.

Expected Scores

The expected scores of the five versions were calculated by transferring θ values based on GRM and presented in Table 6. The scores conversion means that the scores of the five versions measuring the same psychological trait can be compared with each other. The conversion table of the five scale scores provides help shifting one scale into another one and is useful for future study and application when different version scores need to be switched.

TABLE 6

Table 6. Conversion table of five versions of INQ based on expected scores.

Discussion

To date, the present study provides the first comparison of five versions of INQ simultaneously within teenage samples. Construct validity, internal consistency, validity, and average test information were compared for the five versions to (a) identify the version with the optimal overall psychometric characteristics in teenage samples to encourage future use, and (b) test the hypotheses of the IPTS and guide refinement of the IPTS.

Concerning validity, the INQ-15, INQ-12, and INQ-10 demonstrated adequate fit for a two-factor model for all global indices of fit, while the other longer versions did not. Thus, the INQ-15, INQ-12, and INQ-10 most consistently demonstrated construct validity, providing evidence in support of their continued use in teenage samples. The results of internal consistency and criterion validity showed that five versions of the INQ and their subscales all had good internal consistency. But the internal consistency coefficients of thwarted belongingness subscales were smaller than perceived burdensomeness subscales, which was similar to most previous researches (e.g., Bryan et al., 2010; Hill and Pettit, 2012; Monteith et al., 2013; Teo et al., 2018). The correlation coefficients of perceived burdensomeness and thwarted belongingness subscales were closed to each other. As for concurrent predictive validity, both perceived burdensomeness and thwarted belongingness of each version were significant predictors of acquired capability for suicide. The internal consistency, correlation coefficient, and concurrent validity of different versions did not provide any basis for recommending a specific version of the INQ. According to the DIF analysis, the first item with the significance level of 0.01 and 18th with the significance level of 0.001 item had DIF. All versions contained the first item. Therefore, the versions without the 18th item were suggested such as the 10-item version and the 12-item version. As for average test information, the INQ-10 had clear advantages both in the perceived burdensomeness subscale and in thwarted belongingness subscale. In perceived burdensomeness subscales, the version that included more items provided less average test information. In thwarted belongingness subscales, the thwarted belongingness subscale of INQ-10 evidently provided the most average test information, and the thwarted belongingness subscale of INQ-25 provided the second most information. The average test information curves of thwarted belongingness subscales of the other three versions almost coincided. The thwarted belongingness subscales of INQ-18 and INQ-15 contained the same items, and the result demonstrated that 5-item of thwarted belongingness subscale of the INQ-12 provided the same average test information with 9-item of thwarted belongingness subscales of the INQ-15 and the INQ-18. Concerning the expected scores, the conversion of the five scale scores (see Table 6) enables the conversion of one scale shifting into another one. The conversion table can provide help for future studies and applications when one of the five scale scores needs to be transformed into another.

Overall, the result of average test information suggested the INQ-10 provided higher reliability and more measurement precision, and the 10-item version with proper reliability and validity was demonstrated as an adequate fit for a two-factor model. Hence, the 10-item version of INQ is the most suitable version for future use in teenage samples. In addition, the results above showed that perceived burdensomeness performed better in multiple indicators in comparison to thwarted belongingness. If different results are a consequence of measurement, it is necessary to take into consideration both theoretical and operational definitions of the thwarted belongingness and perceived burdensomeness. It is also possible that the thwarted belongingness subscale of the INQ is not adequately measuring the thwarted belongingness and developing a new self-report scale for thwarted belongingness is needed.

The results of this study should be viewed within the context of its limitations. First, the present study uses data from a teenage sample in China, which limits the generalizability of the results. According to the study, we cannot make a decision on which version of the INQ is best for the elderly and clinical samples. Furthermore, the INQ was demonstrated that it could predict suicidal ideation of the individual in previous studies (Joiner, 2005; Van Orden et al., 2010). But this study demonstrated that the INQ could predict the acquired capability for suicide and it was cross-sectional and did not examine the difference of predictive validity about suicidal ideation among the five versions, which can be done in the future. In addition, the five versions of INQ were derived from the response to INQ-25. Thus, current data did not take into account the possible influence of question order effects (e.g., consecutive questions might be answered more similarly than non-continuous questions). Furthermore, the internal consistency coefficients of thwarted belongingness subscales were smaller than the perceived burdensomeness subscales in this study. And findings in previous studies for the relationship between thwarted belongingness and suicidal ideation were weaker in comparison to perceived burdensomeness (Ma et al., 2016; Chu et al., 2017). In the future study, a new self-report scale for thwarted belongingness (TB) can be developed to expand the availability of valid measurement approaches for interpersonal risk.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by Ethics Committee of School of Psychology, Jiangxi Normal University. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.

Author Contributions

DT, XY, and YC selected the topic and made some modifications of the paper. JQ collected the data and wrote the manuscript. All authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.676361/full#supplementary-material

References

Anestis, M. D., and Joiner, T. E. (2011). Examining the role of emotion in suicidality: negative urgency as an amplifier of the relationship between components of the interpersonal psychological theory of suicidal behavior and lifetime number of suicide attempts. J. Affect. Disord. 129, 261–269. doi: 10.1016/j.jad.2010.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Baertschi, M., Costanza, A., Richard-Lepouriel, H., Pompili, M., Sarasin, F., Weber, K., et al. (2017). The application of the interpersonal-psychological theory of suicide to a sample of Swiss patients attending a psychiatric emergency department for a non-lethal suicidal event. J. Affect. Disord. 210, 323–331. doi: 10.1016/j.jad.2016.12.049

PubMed Abstract | CrossRef Full Text | Google Scholar

Blumenthal, J. A., Burg, M. M., Barefoot, J., Williams, R. B., Haney, T., and Zimet, G. (1987). Social support, type a behavior, and coronary artery disease. Psychosom. Med. 49, 331–340. doi: 10.1097/00006842-198707000-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, T. A. (2006). Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford.

Google Scholar

Browne, M. W., and Cudeck, R. (1992). Alternative ways of assessing model fit. Sociol. Methods Res. 21, 230–258. doi: 10.1177/0049124192021002005

CrossRef Full Text | Google Scholar

Bryan, C. J. (2011). The clinical utility of a brief measure of perceived burdensomeness and thwarted belongingness for the detection of suicidal military personnel. J. Clin. Psychol. 67:981–92. doi: 10.1002/jclp.20726

PubMed Abstract | CrossRef Full Text | Google Scholar

Bryan, C. J., Clemans, T. A., and Hernandez, A. M. (2012). Perceived burdensomeness, fearlessness of death, and suicidality among deployed military personnel. Pers. Individ. Dif. 52, 374–379. doi: 10.1016/j.paid.2011.10.045

CrossRef Full Text | Google Scholar

Bryan, C. J., Hernandez, A. M., Allison, S., and Clemans, T. (2013). Combat exposure and suicide risk in two samples of military personnel. J. Clin. Psychol. 69, 64–77. doi: 10.1002/jclp.21932

PubMed Abstract | CrossRef Full Text | Google Scholar

Bryan, C. J., Morrow, C., Anestis, M., and Joiner, T. (2010). A preliminary test of the interpersonal-psychological theory of suicidal behavior in a military sample. Pers. Individ. Dif. 48, 347–350. doi: 10.1016/j.paid.2009.10.023

CrossRef Full Text | Google Scholar

Carballo, J. J., Llorente, C., Kehrmann, L., Flamarique, I., Zuddas, A., and Arango, C. (2019). Psychosocial risk factors for suicidality in children and adolescents. Eur. Child Adolesc. Psychiatry 29, 759–776. doi: 10.1007/s00787-018-01270-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Centers for Disease Control Prevention (2017). Available online at: http://www.cdc.gov/violenceprevention/pub/youth_suicide.html (Retrieved March 30, 2020).

Chalmers, R. P. (2012). mirt: a multidimensional item response theory package for the r environment. J. Statisti. Softw. 48, 1–29. doi: 10.18637/jss.v048.i06

CrossRef Full Text | Google Scholar

Chu, C., Buchman-Schmitt, J. M., Hom, M. A., Stanley, I. H., and Joiner, T. E. (2016). A test of the interpersonal theory of suicide in a large sample of current firefighters. Psychiatry Res. 240, 26–33. doi: 10.1016/j.psychres.2016.03.041

PubMed Abstract | CrossRef Full Text | Google Scholar

Chu, C., Buchman-Schmitt, J. M., Stanley, I. H., Hom, M. A., Tucker, R. P., Hagan, C. R., et al. (2017). The interpersonal theory of suicide: a systematic review and meta-analysis of a decade of cross-national research. Psychol. Bull. 143, 1313–1345. doi: 10.1037/bul0000123

PubMed Abstract | CrossRef Full Text | Google Scholar

Cukrowicz, K. C., Jahn, D. R., Graham, R. D., Poindexter, E. K., and Williams, R. B. (2013). Suicide risk in older adults: evaluating models of risk and predicting excess zeros in a primary care sample. J. Abnorm. Psychol. 122, 1021–1030. doi: 10.1037/a0034953

PubMed Abstract | CrossRef Full Text | Google Scholar

Davidson, C. L., Wingate, L. R., Grant, D. M., Judah, M. R., and Mills, A. C. (2011). Interpersonal suicide risk and ideation the influence of depression and social anxiety. J. Soc. Clin. Psychol. 30, 842–855. doi: 10.1521/jscp.2011.30.8.842

CrossRef Full Text | Google Scholar

Davidson, C. L., Wingate, L. R., Rasmussen, K. A., and Slish, M. L. (2009). Hope as a predictor of interpersonal suicide risk. Suicide Life-Threatening Behav. 39, 499–507. doi: 10.1521/suli.2009.39.5.499

PubMed Abstract | CrossRef Full Text | Google Scholar

Fayers, P. (2004). Item response theory for psychologists. Q. Life Res. 13, 715–716. doi: 10.1023/B:QURE.0000021503.45367.f2

CrossRef Full Text | Google Scholar

Fink-Miller, E. L. (2015). An examination of the interpersonal psychological theory of suicidal behavior in physicians. Suicide Life-Threat. Behav. 45, 488–494. doi: 10.1111/sltb.12147

PubMed Abstract | CrossRef Full Text | Google Scholar

Freedenthal, S., Lamis, D. A., Osman, A., Kahlo, D., and Gutierrez, P. M. (2011). Evaluation of the psychometric properties of the interpersonal needs questionnaire-12 in samples of men and women. J. Clin. Psychol. 67, 609–623. doi: 10.1002/jclp.20782

CrossRef Full Text | Google Scholar

Hagan, C. R., Podlogar, M. C., Chu, C., and Joiner, T. E. (2015). Testing the interpersonal theory of suicide: the moderating role of hopelessness. Int. J. Cogn. Therapy 8, 99–113. doi: 10.1521/ijct.2015.8.2.99

CrossRef Full Text | Google Scholar

Hallensleben, N., Spangenberg, L., Kapusta, N. D., Forkmann, T., and Glaesmer, H. (2016). The German version of the Interpersonal Needs Questionnaire (INQ) - dimensionality, psychometric properties and population-based norms. J. Affect. Disord. 195, 191–198. doi: 10.1016/j.jad.2016.01.045

PubMed Abstract | CrossRef Full Text | Google Scholar

Hill, R. M., and Pettit, J. W. (2012). Suicidal ideation and sexual orientation in college students: the roles of perceived burdensomeness, thwarted belongingness, and perceived rejection due to sexual orientation. Suicide Life-Threat. Behav. 42, 567–579. doi: 10.1111/j.1943-278X.2012.00113.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hill, R. M., and Pettit, J. W. (2013). The role of autonomy needs in suicidal ideation: integrating the interpersonal-psychological theory of suicide and self-determination theory. Arch. Suicide Res. 17, 288–301. doi: 10.1080/13811118.2013.777001

PubMed Abstract | CrossRef Full Text | Google Scholar

Hill, R. M., Rey, Y., Marin, C. E., Sharp, C., Green, K. L., and Pettit, J. W. (2015). Evaluating the interpersonal needs questionnaire: comparison of the reliability, factor structure, and predictive validity across five versions. Suicide Life. Threat. Behav. 45, 302–314. doi: 10.1111/sltb.12129

PubMed Abstract | CrossRef Full Text | Google Scholar

Hu, L.-T., and Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct. Eq. Model. 6, 1–55. doi: 10.1080/10705519909540118

CrossRef Full Text | Google Scholar

Hunsley, J., and Mash, E. J. (2008). A Guide to Assessments That Work. Oxford: Oxford University Press. doi: 10.1093/med:psych/9780195310641.001.0001

CrossRef Full Text | Google Scholar

Joiner, T. E. (2005). Why People Die by Suicide. Cambridge, MA: Harvard University Press.

Google Scholar

Joiner, T. E., Van Orden, K. A., Witte, T. K., and Rudd, M. D. (2009). The Interpersonal Theory of Suicide: Guidance for Working With Suicidal Clients. Arlington, VA: American Psychiatric Association. doi: 10.1037/11869-000

CrossRef Full Text | Google Scholar

Kim, M. (2001). Detecting DIF across the different language groups in a speaking test. Lang. Testing 18, 88–114. doi: 10.1177/026553220101800104

CrossRef Full Text

Klonsky, E. D., and May, A. M. (2014). Differentiating suicide attempters from suicide ideators: a critical frontier for suicidology research. Suicide Life-Threat. Behav. 44, 1–5. doi: 10.1111/sltb.12068

PubMed Abstract | CrossRef Full Text | Google Scholar

Klonsky, E. D., May, A. M., and Saffer, B. Y. (2016). Suicide, suicide attempts, and suicidal ideation. Ann. Rev. Clin. Psychol. 12, 307–330. doi: 10.1146/annurev-clinpsy-021815-093204

PubMed Abstract | CrossRef Full Text | Google Scholar

Lamis, D. A., and Lester, D. (2012). Risk factors for suicidal ideation among African American and European American college women. Psychol. Women Q. 36, 337–349. doi: 10.1177/0361684312439186

CrossRef Full Text | Google Scholar

Lamis, D. A., and Malone, P. S. (2011). Alcohol-related problems and risk of suicide among college students: the mediating roles of belongingness and burdensomeness. Suicide Life-Threat. Behav. 41, 543–553. doi: 10.1111/j.1943-278X.2011.00052.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X. M., Xin, T. G., Yuan, J., Lv, L. X., Tao, J. L., and Liu, Y. (2015). Validity and reliability of the interpersonal needs questionnaire in Chinese college students. Chin. J. Clin. Psychol. 23, 590–593. doi: 10.16128/j.cnki.1005-3611.2015.04.005

CrossRef Full Text | Google Scholar

Lord, F. M. (1977). A broad-range tailored test of verbal ability. Appl. Psychol. Measure. 1, 95–100. doi: 10.1177/014662167700100115

CrossRef Full Text | Google Scholar

Ma, J., Batterham, P. J., Calear, A. L., and Han, J. (2016). A systematic review of the predictions of the interpersonal-psychological theory of suicidal behavior. Clin. Psychol. Rev. 46, 34–45. doi: 10.1016/j.cpr.2016.04.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Mandracchia, J. T., and Smith, P. N. (2015). The interpersonal theory of suicide applied to male prisoners. Suicide Life-Threat. Behav. 45, 293–301. doi: 10.1111/sltb.12132

PubMed Abstract | CrossRef Full Text | Google Scholar

Monteith, L. L., Menefee, D. S., Pettit, J. W., Leopoulos, W. L., and Vincent, J. P. (2013). Examining the interpersonal-psychological theory of suicide in an inpatient veteran sample. Suicide Life-Threat. Behav. 43, 418–428. doi: 10.1111/sltb.12027

PubMed Abstract | CrossRef Full Text | Google Scholar

Olino, T. M., Yu, L., Klein, D. N., Rohde, P., Seeley, J. R., Pilkonis, P. A., et al. (2012). Measuring depression using item response theory: an examination of three measures of depressive symptomatology. Int. J. Methods Psychiatr. Res. 21, 76–85. doi: 10.1002/mpr.1348

PubMed Abstract | CrossRef Full Text | Google Scholar

Parellada, M., Saiz, P., Moreno, D., Vidal, J., Llorente, C., Alvarez, M., et al. (2008). Is attempted suicide different in adolescent and adults? Psychiatry Res. 157, 131–137. doi: 10.1016/j.psychres.2007.02.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Rasmussen, K. A., and Wingate, L. R. (2011). The role of optimism in the interpersonal-psychological theory of suicidal behavior. Suicide Life. Threat. Behav. 41, 137–148. doi: 10.1111/j.1943-278X.2011.00022.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Russell, D., Peplau, L. A., and Cutrona, C. E. (1980). The revised UCLA loneliness scale: concurrent and discriminant validity evidence. J. Pers. Soc. Psychol. 39, 472–480. doi: 10.1037/0022-3514.39.3.472

PubMed Abstract | CrossRef Full Text | Google Scholar

Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika 34, 1–97. doi: 10.1007/BF03372160

CrossRef Full Text | Google Scholar

Silva, C., Chu, C., Monahan, K. R., and Joiner, T. E. (2015). Suicide risk among sexual minority college students: a mediated moderation model of sex and perceived burdensomeness. Psychol. Sex. Orient. Gender Diversity 2, 22–33. doi: 10.1037/sgd0000086

CrossRef Full Text | Google Scholar

Suh, S., Ebesutani, C. K., Hagan, C. R., Rogers, M. L., Hom, M. A., Ringer, F. B., et al. (2017). Cross-cultural relevance of the interpersonal theory of suicide across Korean and U.S. undergraduate students. Psychiatry Res. 251, 244–252. doi: 10.1016/j.psychres.2017.02.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Teo, D. C. H., Suárez, L., and Oei, T. P. S. (2018). Validation of the interpersonal needs questionnaire of young male adults in Singapore. PLos ONE 13, 1–9. doi: 10.1371/journal.pone.0198839

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Orden, K. A. (2009). Construct Validity of the Interpersonal Needs Questionnaire. (Unpublished doctoral dissertation), Florida State University, Florida, United States.

PubMed Abstract | Google Scholar

Van Orden, K. A., Cukrowicz, K. C., Witte, T. K., and Joiner, T. E. (2012). Thwarted belongingness and perceived burdensomeness: construct validity and psychometric properties of the interpersonal needs questionnaire. Psychol. Assess. 24, 197–215. doi: 10.1037/a0025358

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Orden, K. A., Witte, T. K., Cukrowicz, K. C., Braithwaite, S. R., Selby, E. A., and Joiner, T. E. (2010). The interpersonal theory of suicide. Psychol. Rev. 117, 575–600. doi: 10.1037/a0018697

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Orden, K. A., Witte, T. K., Gordon, K. H., Bender, T. W., and Joiner, T. E. (2008a). Suicidal desire and the capability for suicide: tests of the interpersonal-psychological theory of suicidal behavior among adults. J. Consult. Clin. Psychol. 76, 72–83. doi: 10.1037/0022-006X.76.1.72

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Orden, K. A., Witte, T. K., James, L. M., Castro, Y., Gordon, K. H., Braithwaite, S. R., et al. (2008b). Suicidal ideation in college students varies across semesters: the mediating role of belongingness. Suicide Life-Threat. Behav. 38, 427–435. doi: 10.1521/suli.2008.38.4.427

PubMed Abstract | CrossRef Full Text | Google Scholar

Wong, Y. J., Koo, K., Tran, K. K., Chiu, Y.-C., and Mok, Y. (2011). Asian American college students' suicide ideation: a mixed-methods study. J. Couns. Psychol. 58, 197–209. doi: 10.1037/a0023040

PubMed Abstract | CrossRef Full Text | Google Scholar

World Health Organization (2019). Newsroom-Fact sheets. Available online at: https://www.who.int/news-room/fact-sheets/detail/suicide (Retrieved March 30, 2020).

Yang, L., Pan, D., Li, Z., and Liu, X. (2019). Validation of a Chinese version of the acquired capability for suicide scale. Death Stud. 3, 1–8. doi: 10.1080/07481187.2019.1671545

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, J., Lester, D., Zhao, S., and Zhou, C. (2013). Suicidal ideation and its correlates: testing the interpersonal theory of suicide in chinese students. Arch. Suicide Res. 17, 236–241. doi: 10.1080/13811118.2013.805643

PubMed Abstract | CrossRef Full Text | Google Scholar