Trajectory Analysis of Suicidal Ideation in Spanish College Students Using Ecological Momentary Assessment

Introduction: Suicide is a preventable death in young people. It is well known that suicide behavior is a multicausal phenomenon. However, suicidal ideation (SI) commonly underlies suicide, and Ecological Momentary Assessment (EMA) can help us to better characterize it and its risk and protective factors in the short term. We aimed, first, to investigate the estimated prevalence and trajectories of SI in a community sample of Spanish college students using an EMA methodology and, second, explore the associations between risk and protective factors and SI categorized as moderate or low.

Materials and Methods: A total of 737 participants followed the EMA during a period of 6 months. We estimated the prevalence and trajectories of SI and the associations between depressive symptoms, positive and negative affect, thwarted belongingness, perceived burdensomeness, cognitive reappraisal, emotional suppression, and purpose in life with the MEmind smartphone App. SI was assessed 14 times during this period.

Results: Twenty-eight participants referred to SI at least once in longitudinal assessments. We found a lack of curvature and, thus, a relatively stable trajectory of SI. Two groups of latent dimensions were observed related to risk and protective factors of SI. One latent dimension of the risk factors (higher levels of thwarted belongingness, perceived burdensomeness, depressive symptoms, negative affect, and emotional suppression) best represented the group with moderate levels of SI, and a second latent dimension of protective variables (positive affect, cognitive reappraisal, and purpose in life) best represented the group with lower levels of SI.

Discussion: These findings may indicate that students with a sense of having a life worth living, in addition to having the ability to reevaluate their negative beliefs, are less likely to experience high levels of SI. Therefore, purpose in life would be a protective factor against the presence of SI.

Introduction

According to the World Health Organization (WHO), around 700,000 people die annually as a result of suicide, and it is the fourth leading cause of death among young people between 15 and 19 years old (1). Therefore, it is a worrisome behavior that has increased in recent years (2). Although suicidal behavior is a multi-factorial phenomenon (3), and a great deal of knowledge about suicide risk and protective factors has been obtained in recent years (4), less is known about the direct precursors of suicidal behavior (5).

Most of the clinical correlates of suicide seem to be best conceptualized as correlates of suicidal ideation (SI) (6). Research has found that SI is one of the strongest predictors of suicide attempts (SA) (7), and even more so in the presence of previous suicide attempts and non-suicidal self-injury (NSSI) (8). Moreover, it is important to point out that the occurrence of these kinds of ideas can be chronic (9).

Furthermore, SI increases exponentially during adolescence and remains high from then on (10). In this regard, in the United States, in 2017, about 17% of adolescents seriously considered committing suicide (11). A recent meta-analysis revealed a high persistence of adolescent-onset suicidal thoughts and behaviors into the college years (12). At the same time, rates of lifetime SI are higher in females than in males (13), and completed suicide is more prevalent in men (14). Across all countries, 60% of the evolution from SI to planning or SA takes place within the first year after SI onset (15).

Recent literature has found neurocognitive functions that are associated with the risk of suicide behavior in young people (16, 17). In this regard, SI usually starts in adolescence and is associated with both clinical and community populations (18), with its intensity fluctuating considerably over short periods of time (19). Furthermore, it is relevant to explore this variation because an examination over long periods (months or years) cannot capture the true nature of these thoughts. A recent study that focused on the longitudinal evolution of SI using Ecological Momentary Assessment (EMA) showed that almost a third of all SI scores were one standard deviation below or above the previous response only 4–8 h earlier (20). Moreover, a recent theoretical study (21) proposed that there may be a minimum of two subtypes of the experience of SI. One suggested subtype is described as large fluctuations in SI severity in reaction to life stress (stress responsive ideators). The other suggested subtype is described as persistent levels of SI that do not fluctuate in reaction to life events (non-stress responsive ideators). In addition, Kleiman et al. (22) found five phenotypes of SI that differed mainly in the average severity of SI over time (Low mean, low variability; Moderate mean, low variability; Moderate mean, moderate variability; High mean, moderate variability; and High mean, high variability). Moreover, there is a promising strategy for exploring suicide that focuses on the evaluation of “serious suicide attempt survivors.” These would include cases where people received quick medical attention through speedy and effective first-aid care, cases that received other adequate forms of emergency treatment, or even cases where the response was due to mere coincidence (23). Therefore, this point of view emphasizes the differences between levels of suicidal behaviors in people at high risk for suicide.

The Interpersonal Theory of Suicide (24) proposes two interpersonal variables that may lead a person to SI: thwarted belongingness and perceived burdensomeness. The former points out the person’s need to be socially integrated, whereas the latter describes the person’s perception of being a burden to others. The presence of only one of these variables leads to passive SI, whereas the combined presentation of both along with hopelessness may lead to active SI (25). Recent research found a significant direct effect between thwarted belongingness, perceived burdensomeness, and hopelessness on college students with a presence of SI (26). Otherwise, SI is related to affective symptomatology in general and in young people in particular (27). Recent research revealed that high negative affect and low positive affect show a significant association with SI in adolescents (28). Furthermore, negative emotional states affect SI more strongly than factors such as low social integration (29).

In addition, emotional dysregulation seems to be related to an elevated suicidal desire and may participate in the conversion to suicidal behavior in people who use dysfunctional coping methods (30). Expressive suppression is a strategy included in the model of emotion regulation postulated by Gross and John (31). Importantly, studies have found that increased levels of expressive suppression may significantly predict SI (32). In the opposite direction, other studies have shown that people who modulate their emotions using a cognitive reappraisal strategy show lower levels of SI and suicidal behaviors than those who have trouble using this strategy (33). In this regard, different studies have shown that high levels of cognitive reappraisal are related to less suicidality (32, 34).

Regarding protective variables against SI, meaning in life has been found to be a protective and mediating factor that can reduce SI (35, 36). Meaning in life refers to the fundamental motivational force of the human being and the condition of personal self-realization (37), and it has been described as comprising three main dimensions: purpose, coherence, and significance (38). Moreover, some studies have identified a link between low meaning in life and suicide risk factors (39, 40). In addition, positive affect has been shown to be a significant barrier against SI, given that this variable is negatively related to SI (28).

It should be noted that, in contrast with the moderately static outcome incidence, SI trajectories are a dynamic result and, therefore, need a more fine-grained assessment (41). Previous literature has demonstrated that fluctuation is frequent and clinically significant (42, 9). In this regard, the recurrence of SI may have an important impact on other clinical outcomes, and so it is important to consider SI trajectories over time. Czyz and King (42) showed that a group of chronic SI adolescents reported higher levels of hopelessness, even after controlling other variables such as depressive symptoms. Furthermore, Wolff et al. (41) found that emotion dysregulation considerably differentiated people with chronic SI from people with declining SI because those who were more unconcerned about emotional responses and had inadequate contact with emotion regulation strategies were more likely to report chronic SI. Moreover, a four-year longitudinal study showed that thwarted belongingness amplified the projection of SI trajectories in the outcome of suicide loss, and perceived burdensomeness predicted complicated-grief levels over time in suicide survivors (43).

Ecological Momentary Assessment and Suicidal Ideation

Studies based on EMA (44) might be especially relevant for evaluating SI at the moment it occurs (45). Moreover, the time variable is particularly important in the study of suicidal behavior, given that numerous studies have shown that the first 6 months is the critical period for carrying out a new attempt (46). Therefore, examination of SI over long periods of time (months or years) cannot capture the true nature of these thoughts (20).

Furthermore, there is evidence of increasing research on EMA and suicidality [e.g., (15, 19, 20, 47–50)]. Although these studies have made noteworthy contributions, there are still important gaps related to the use of EMA with SI and SA. In this regard, the majority of EMA studies have included a fairly short follow-up period (one or two weeks), primarily with adults (45, 51).

Although EMA studies in college samples are relatively extensive, with contributions in areas such as physical activity (52), food choices (53), sleep quality (54), marijuana (55), alcohol (56), or the effects of mindfulness training on daily stress (57), there is a lack of studies that specifically evaluate SI and SA in college students using this methodology.

Accordingly, the aim of this study was to: (1) investigate the estimated prevalence and trajectories of SI in a community sample of Spanish college students using EMA methodology for a period of 6 months and (2) explore the associations between risk and protective factors of SI—depressive symptoms, positive and negative affect, cognitive reappraisal, emotional suppression, thwarted belongingness, perceived burdensomeness, and purpose in life- and their relationships with categories of high, moderate, or low SI in a community sample of university students.

Regarding the first objective, we expected to find an estimated prevalence of around 10%, based on previous literature (58). Furthermore, we expected to find a high fluctuation in SI over short periods of time, in accordance with results from Hallensleben et al. (48). As for the second objective, we hypothesized that risk factors would better represent the group of participants with high or moderate levels of SI, and a second latent dimension of protective variables would better represent the group of patients with lower levels of SI.

Materials and Methods

Participants

In a context of voluntary participation, 975 undergraduates were initially approached, of whom 737 completed the initial evaluation (75.59%). They were recruited from a Spanish university and received instruction about how to use the EMA in their Smartphones with the “MEmind” app (59).

Participants used the EMA for a period of six months; 54.95% were women (n = 405), and 45.05% were men (n = 332). The majority were young (mean = 23 years, SD = 5.7), although there was a wide age range (17–65 years). In addition, 55.1% (n = 406) of the participants were single; 41.2% (n = 304) had a partner, and 3.7% (n = 27) were separated.

The EMA protocol was composed of a series of evaluations in different periods of time. In this regard, 737 participants completed the initial evaluation, whereas in the third evaluation (n = 509), students completed the assessment, of whom 58% were women (n = 295) and 42% men (n = 214). Moreover, during the sixth evaluation, (n = 275) participants completed the assessment, of whom 61% were women (n = 168), and 39% were men (n = 107). In the ninth evaluation, we had responses from a total of n = 132 students, of whom 70% were women (n = 93), and 30% were men (n = 39), whereas in the 12th evaluation (n = 44), participants completed the assessment, of whom 86% were women (n = 38), and 14% were men (n = 6).

The inclusion criteria were being a college student, having and using a Smartphone, and understanding and agreeing with the working procedure. The exclusion criterion was refusing to participate. The procedure in the present study was approved by the ethical committee of the Catholic University of Valencia (code 072). The participants were recruited in their classrooms and signed informed consents before the initial evaluation. They received a certificate of participation and university credits as compensation. The students were recruited between September 2019 and January 2020. For privacy reasons, no personal information was collected that could associate the ID of the Smartphone with the identity of the participant in this study. The sample of college students completed a subset of self-report questionnaires, described below. The database was registered and protected with the highest level of security, in accordance with the Spanish data protection law.

Assessments and Measures

Ecological Momentary Assessment (EMA) SI questions. This tool was designed ad hoc to assess suicide risk with a dynamic non-linear model that combines Likert-type scales and visual analog scales. The questions about suicide behavior were the following: (1) During the past week, have you self-injured with the intention of hurting yourself (I have made cuts, blows, stuck needles, burned myself, hit myself, scratched my skin forcefully, not allowed wounds to heal, I have ingested substances, etc.)? (yes–no). If the answer is yes, how often did you do so? (2) In the past week, have you thought about taking your life? If the answer is yes, how often did you do so? (3) In the past week, have you planned to kill yourself? (yes-no), If the answer is yes, how often did you do so? (4) In the past week, have you tried to kill yourself? (yes–no). If the answer is yes, how often did you do so?

The Emotion Regulation Questionnaire (ERQ) (60). This scale is the Spanish version of the ERQ (31). It consists of 10 items divided into two subscales: cognitive reappraisal (6 items) and emotional suppression (4 items), and participants respond on a 7-point Likert-scale. The ERQ showed reliability for the reappraisal scale (α = 0.75) and for suppression (α = 0.79). In our sample, there was adequate internal consistency for cognitive reappraisal (ϖ = 0.78) and emotional suppression (ϖ = 0.78).

The Positive and Negative Affect Schedule (PANAS) (61). This scale is the Spanish version of the PANAS (62), and it consists of 20 positive and negative adjectives rated on a 5-point Likert scale. PANAS showed positive reliability for positive affect (α = 0.76) and negative affect (α = 0.83). In our sample, there was adequate internal consistency for positive affect (ϖ = 0.86) and negative affect (ϖ = 0.85).

Interpersonal Needs Questionnaire (INQ) (63). This scale is the Spanish version of the INQ (64), and it consists of 15 items divided into two subscales: (1) thwarted belongingness and (2) perceived burdensomeness. Spanish scale reliabilities were high for perceived burdensomeness (α = 0.96) and thwarted belongingness (α = 0.78). In our sample, there was adequate internal consistency for thwarted belongingness (ϖ = 0.81) and perceived burdensomeness (ϖ = 0.83).

Patient Health Questionnaire (PHQ-9) (65). This scale is the Spanish version of the PHQ-9 (66), and it consists of nine items with a total score between 0 and 27 that indicates the presence of depressive symptoms in the past two weeks. The original version has a sensitivity of 75% and a specificity of 90%. The Spanish version has an overall accuracy of 88%; sensitivity, 87%; and specificity, 88%, similar to the original questionnaire. In our sample, there was adequate internal consistency (ϖ = 0.72).

Purpose In Life-10 (PIL-10) (67). This scale is a reduced Spanish version of the PIL (68), and it is composed of a 10-item Likert scale related to different aspects of meaning in life. The total score ranges from 10 to 70, so that higher scores show greater meaning in life. The PIL-10 showed high reliability for the global scale (α = 0.92) (67). In our sample, there was adequate internal consistency for the PIL-10 (ϖ = 0.88).

Procedure

To verify the feasibility of the methodology and its correct enactment, a pilot study was designed for subsequent implementation on a larger scaler. This study was carried out with 60 students who answered the tests that made up the final evaluation protocol. The pilot study lasted approximately 30–35 min. With the pilot study, any doubts about the language used in the questionnaires were clarified, as well as questions about use and access to the MEmind application.

First, during the initial evaluation, the information corresponding to each participant was collected based on the responses to the questionnaires related to depressive symptoms, positive and negative affect, cognitive reappraisal, emotional suppression, thwarted belongingness, perceived burdensomeness, and purpose in life. Second, the MEmind application sent a notification to the participants’ mobile devices asking them to participate daily by answering the different SI questions, with a total of 14 different measurements over a 6-month period.

For sample recruitment, the research team first contacted the deans by email. In most of the cases, the dean sent the evaluation request to the different professors of each course in the different majors, and each professor proposed a suitable time for the initial evaluation. During class time, the researchers explained the objective of the investigation, and if the students agreed, they were instructed to sign the informed consent. The initial evaluation took an average of 20 min to complete, and any questions about the procedure were answered by the researchers. The researchers encouraged participants to sit apart from their classmates in order to avoid sharing the content of their answers through their Smartphones and facilitate honesty on sensitive items. Similarly, researchers helped participants on a case-by-case basis when there were difficulties in accessing the application, mainly due to not updating their Smartphone devices or to problems involving Internet access, which is required to download the application.

Assessment With the “MEmind” App

MEmind is a web application created to fuse different data sources. It is accessible at www.memind.net, and it is compatible with Tablets, computers, and Smartphones with any operating system. The application creates a database that is accessed with a personalized and unidentified password, so that the participants can record their answers to the diverse blocks of questions personally in their own environment. Data and keys are hidden by a key management infrastructure that executes strict logical and physical security controls to avoid unauthorized entrance (59, 69).

First, initial data were obtained in the participants’ university through the questionnaires that made up the study assessment protocol. Second, after the first assessment, they were asked to participate daily by answering the different questions presented by MEmind through a notification on the participants’ mobile devices. The application’s questions consisted of the items on the different questionnaires, presented at different times of the day and during the week. The protocol also provided a section for notes where participants could report qualitative information about their personal situation and ask for individualized psychological help. Moreover, the application was presented through the Smartphones based on two types of questions: static questions that appeared every day at the same time or dynamic questions that changed randomly over time.

The number of questions was progressively reduced throughout the follow-up to ensure feasibility and reduce dropouts. During the first month, the participants had to answer four blocks of questions per day, two static items and two items from a dynamic random selection of the overall questions. To guarantee a balanced evaluation of the variables, all the items were used before starting a new round of questions. During the second and third month, the students were evaluated through simple questions twice a day. Finally, during the last three months of follow-up, participants were only evaluated four times a week with dynamic items that they had to respond to in the next half hour. Given that this paper is part of a larger study with an EMA protocol with broader objectives, for this study we selected the EMA questions related to SI, in order to explore their longitudinal trajectories. In this regard, participants did not receive any indications about emotion management during the EMA. However, in cases where the participants anonymously reported the presence of suicidal behavior, a contact number was provided so that the person could receive psychological treatment. However, none of the participants asked for the help offered.

Data Analysis

A growth mixture model (GMM) was specified to gain a better understanding of the underlying populations according to their SI trajectories. As Figure 1 shows, the unconditional first-order GMM model hypothesized that two latent factors (intercept and slope) had a direct effect on 11 equally spaced points of measurement of frequency of SI.

FIGURE 1

Figure 1. Growth mixture model (GMM) for suicidal ideation (SI).

This model assumes that the distribution of the repeated measures of SI frequency is a finite mixture of p—dimensional normal probability distribution, as follows:

$f\left(y_i\right)=\sum _{k=1}^K{\mathrm{\pi }}_k{\mathrm{\varphi }}_k({\mathrm{\Lambda }}_k{\mathrm{\alpha }}_k,{\mathrm{\Lambda }}_k{\mathrm{\Psi }}_k{\mathrm{\Lambda }}_k^{\prime }+{\mathrm{\Theta }}_k)$

Where y_i is the vector containing 11 repeated measures of frequency of SI per participant, π_k represents the probability that a participant belongs to class k, Λ_k is a matrix of factor loadings (intercept and slope), α_k is a vector holding the means of individual trajectory parameters (between—class component), Ψ_k is a residual matrix reflecting individual differences (ζ_i) from these means (within—class component), and Θ_k is a covariance matrix for measurement errors (ε_i).

In order to examine the goodness of fit of this model, we compared an unconditional univariate single-class growth model with other models with two and three classes, using the entropy statistic, as well as the following indexes: the Akaike Information Criterion (AIC), the Bayesian Information Criterion (BIC), the Sample-Size Adjusted BIC (SSBIC), the nested model likelihood ratio suggested by Lo, Mendell, and Rubin (LMR), the Vuong, Lo, Mendell, and Rubin (VLMR), and the bootstrapped likelihood ratio test (BLRT). We also considered the parsimony criteria, the meaning and interpretability of the solution, and the recommendations provided by Nylund et al. (70) concerning the sensitivity of these indexes to small sample sizes. Once individuals were classified according to their trajectories, we examined the association between these classes and participants’ health and psychological strategies. We performed an exploratory factor analysis using maximum likelihood estimation and varimax rotation, and we summarized the results through a biplot graphical representation.

Results

N = 737 (75.59%) students completed the subset of questionnaires at initial evaluation through the MEmind app, and 28 participants (3.8%) reported SI at least once during the EMA follow-up (14 moments of measurement). To assess trajectories across time, we estimated the average number of ideations through the middle point of the class interval for each participant and measurement (None = 0, Once = 1, From 2 to 4 = 3, More than 5 = 5) (Table 1).

TABLE 1

Table 1. Relative frequencies and attrition rate.

To examine the nature of the mean-level change, the analysis of a GMM was carried out for the frequency of SI, as Table 2 shows. Although we could not confirm a significant improvement in goodness-of fit indexes due to the small sample size, the number of classes provided successive improvements in the AIC, BIC, SSBIC indices and entropy. The model with three classes was eventually selected because it presented the best fit and the solution was meaningful in terms of the estimated parameters. The four-class model could not reach convergence during the estimation process.

TABLE 2

Table 2. Fit indices for one- to three-class growth mixture models (unconditional).

Table 3 shows growth parameter estimates for the final unconditional model composed of three classes. Two of the classes (two and three) presented plain trajectories with non-significant slope parameters, whereas the first class was composed of only one participant who was considered an extreme value. The majority of the participants were assigned to a class with relatively low frequencies of SI.

TABLE 3

Table 3. Growth factor parameter estimates for three-class conditional model.

The second largest class was characterized by participants with moderate and stable levels of SI frequency, as depicted in Figure 2. Next, principal component analysis was applied to the following measures: Cognitive reappraisal (ERQ), emotional suppression (ERQ), purpose in life (PIL), thwarted belongingness (INQ), perceived burdensomeness (INQ), positive affect (PANAS), negative affect (PANAS), and depressive symptoms (PHQ-9).

FIGURE 2

Figure 2. Average number of suicidal ideations per class across time (14 measurements).

Based on the Kayser criterion retention, two latent factors accounted for 68% of the total sample variance. As Table 4 reveals, the first factor was labeled ‘Risk factors’ because it showed high factor loadings (greater than 0.5) on the Patient Health Questionnaire (PHQ-9), the Expressive Suppression subscale of the Emotion Regulation Questionnaire (ERQ), both the Burden and Belonging subscales of the Interpersonal Needs Questionnaire (INQ), and the Negative Affect Schedule (PANAS). The second factor represents a collection of positive factors and was labeled “Protective factors,” with the following total scores showing factor loadings greater than 0.5: Cognitive reevaluation from the Emotion Regulation Questionnaire (ERQ), the Purpose in Life (PIL) scale, and the Positive Affect Schedule (PANAS) (Table 4).

TABLE 4

Table 4. Factor loadings of participants’ health and psychological strategies.

The graphical representation of the factor loadings and scores in Figure 2 allowed us to identify some interesting relationships between participants’ health and strategies and their classifications according to their trajectories across time with regard to SI. As Figure 3 shows, the collection of strategies whose high loadings in the “Risk factors” dimension was close to individuals with moderate levels of SI’. Similarly, the location of “Protective factors” in the graph was close to the majority of participants with low levels of frequency in SI. The extreme value identified as an independent class was not clearly located close to any of these dimensions.

FIGURE 3

Figure 3. Biplot of factor scores and loadings obtained for participants’ health and strategies and their classification according to the frequency of suicidal ideation.

Discussion

This study had two main objectives. The first was to investigate the estimated prevalence and trajectories of SI in a community sample of Spanish college students using EMA methodology. The second was to explore the associations between risk and protective factors—depressive symptoms, positive and negative affect, cognitive reappraisal, emotional suppression, thwarted belongingness, perceived burdensomeness, and purpose in life- and their relationships with categories of high, moderate, or low SI in a community sample of university students.

In relation to the first objective, the percentage of college students who presented SI in our study was 3.80%. This figure is low compared to data reported by Han et al. (71) in Americans from 2009 to 2015 showing that the 12-month prevalence of SI increased from 6.1 to 8.3%. In a 12-month prevalence study in Spanish university students, results showed that around 9.9% had experienced SI (58). In this regard, and even though MEmind is an app that offers participants a space where they can freely express themselves (59), it is possible that in our study some college students were not completely sincere when reporting their responses about SI. Some of the researchers were also professors in their university, and, therefore, some of the students might have been reluctant to share private and sensitive information. In this direction, Schmeelk-Cone et al. (72) highlighted that students are often uncertain about talking to teachers about private problems, including the presence of SI. Specifically, Pisani et al. (73), in their study that included 381 participants who had considered committing SA in the past, found that only about one in four students told this intention to an adult. Future research should count on collaborators apart from their own university staff, in order to reduce reluctance to openly respond to questions about SI. In addition, it should be noted that of the 975 participants approached in this study, only 737 completed the first assessment. Therefore, 24.4% of the students who did not complete the assessment might have experienced higher rates of SI and, for this reason, could have affected the overall rates of SI in this study.

Moreover, we found a lack of curvature in the trajectory analysis for SI, reflecting that it remained relatively stable weekly over the six-month period in our sample, with no significant upward or downward variations. Some previous studies have revealed mixed results, finding fluctuations in SI (74). In the study by Gratch et al. (75), 58% of their participants who reported SI using EMA methodology denied any past-week ideation. However, in our study, non-significant fluctuations in SI were found when SI was moderate or low in frequency. In the same direction, another study found that people with a multiple attempt status more frequently experienced a wider range and greater intensity of their SI over time, compared to those with limited or no experience of SI (76). In addition, our results are in line with the work by Bernanke et al. (21), and it is possible that participants in our sample may be best described as non-stress responsive ideators because they do not present a pattern of SI associated with rapid, changing, and potentially fleeting fluctuations. Furthermore, Kleiman et al. (22) postulated that there may be two superordinate phenotypes (high versus low variability) of SI. In this regard, our results are in line with their findings, and our sample might be better described as non-stress responsive ideators with low variability in SI.

In addition, for the second objective of exploring the associations between risk and protective factors and their relationships with participants’ inclusion in categories of high, moderate, or low suicide ideation, we expected to find that risk factors better represented the group of participants with high levels of SI. However, only one participant scored high on this variable, and, therefore, it was considered an extreme value. Specifically, we found two groups of latent dimensions related to risk and protective factors against SI. One latent dimension of risk factors better represented the group of participants with moderate levels of SI, and a second latent dimension of protective variables better represented the group of patients with lower levels of SI. Specifically, we found that participants with moderate levels of SI tended to show higher levels of thwarted belongingness, perceived burdensomeness, depressive symptoms, negative affect, and emotional suppression. This finding may indicate that participants in the group with stable moderate levels of SI overall showed higher levels of risk factors. In this regard, for thwarted belongingness and perceived burdensomeness, previous literature has shown that these variables are risk factors related to SI in college samples (77, 78). Furthermore, Lockman and Servaty-Seib (79) showed support for these variables as proximal mental states associated with SI in university students, although they highlighted that perceived burdensomeness was the strongest proximal interpersonal risk factor predicting SI. In fact, Díez-Gómez et al. (80) found four distinct groups related to suicide risk in their latent class analysis: “low risk-healthy,” “suicidal act,” “suicidal ideation,” and “high suicide risk” in a sample of 1,506 adolescent students. Results showed that the group of participants with high theoretical suicide risk showed lower scores on positive affect and higher levels of behavioral and emotional problems. Although our sample is composed of college students, our results are similar because the group of participants with moderate levels of SI had higher levels of negative affect and emotional difficulties.

Moreover, past research has shown that depressive symptoms are an important risk factor related to SI in university students [i.e., (81, 82)]. In the case of emotional dysregulation, our results may indicate that the group of college students that tended to show moderate levels of SI used this strategy as a way of escaping negative emotions or internal states. This relationship has been found in previous literature (83–85). Furthermore, DeShong et al. (77) found that neuroticism, a personality trait characterized by the presence of elevated rates of negative affect, was positively associated with thwarted belongingness and perceived burdensomeness in a sample of college students with SI. Likewise, Bowen et al. (86) found that negative affect and emotional instability independently predicted SI.

In addition, we found that participants in the group with lower levels of SI tended to show higher levels of positive affect, cognitive reappraisal, and purpose in life, indicating that participants in the group with stable lower levels of SI showed higher levels of protective factors. In this regard, Li et al. (78) showed that having a reason for living seemed to be a protective factor against SI and suicidal behaviors in college students. Therefore, the ability to reevaluate life as a value that gives meaning to experience may help students to avoid the presence of SI. Thus, these findings may indicate that students with a sense of having a life worth living who tend to reevaluate their negative cognitions and frequently experience positive affect are less likely to experience high levels of SI. Therefore, these factors would protect them from the presence of these dysfunctional thoughts.

We have to highlight some limitations. First, the trajectories could not confirm a significant improvement in goodness of fit due to the small sample size of Spanish college students. Second, our final sample was composed of 28 of the 737 participants who reported at least one moment of SI during the EMA follow-up, and so the sample that reported SI was quite small. Therefore, the generalization of our results is limited, and these results should be replicated in future research with larger samples. Future studies should explore suicide behaviors and their profiles or classes with the aim of differentiating subtypes within the same construct (e.g., subtypes of people with SI/SA) (87).

Moreover, it is possible that this sample underestimated the real prevalence of SI trajectories in college students, given the possible sincerity problems. Furthermore, it would be important to explore our hypotheses with larger samples of university students. Third, although daily assessment may have practical advantages for this population, the students had Smartphone restrictions while they were attending lectures, and so it is possible that they could not immediately respond to some of the questions, which could have influenced later responses. Finally, we assessed suicide ideation through questions created ad hoc by the research team. The use of a validated questionnaire on suicide ideation would have been more appropriate.

Despite these limitations, to the best of our knowledge, this is the first study to evaluate fluctuations in SI in Spanish college students using EMA methodology. Prior research in our country with this population assessed SI using traditional paper-and-pencil interviews (88) or online surveys (58, 89). Moreover, the majority of the EMA studies that evaluated SI integrated a fairly short follow-up time (one or two weeks) (45). In this regard, our follow-up of EMA for six months sheds more light on SI trajectories in non-clinical samples. Thus, our results highlight the need for university units dedicated to suicide prevention. In this regard, evidence shows that acknowledging and talking about suicide may in fact reduce SI (90). Therefore, there is a need to monitor mental health in college students and improve evaluation strategies in order to achieve greater transparency and honesty when reporting SI using digital applications.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

Our work was approved by the Ethics Committee of the Catholic University of Valencia (code 072), research code “UCV2017-2018-116”. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SP, JM, and EB-G: conception and design of the work. JL: data collection. JL, AC, JM, MB, EB-G, and SP: data analysis and interpretation and critical revision of the manuscript. JL, JM, and SP: drafting the manuscript. All authors contributed to the article and approved the submitted version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

SI, suicidal ideation; SA, suicide attempts; WHO, World Health Organization; EMA, Ecological Momentary Assessment.

References

1. WHO. Suicide Data. (2021). Available online at: https://www.who.int/news-room/fact-sheets/detail/suicide (accessed January 10, 2022).

Google Scholar

2. Curtin SC, Warner M, Hedegaard H. Increase in Suicide in the United States, 1999-2014 (No. 2016). Hyattsville, MD: National Center for Health Statistics. (2016).

Google Scholar

3. Madrigal de León EA, Astudillo-García CI, Durand-Arias S. Depression, substance abuse, and suicide risk: a rising problem. Addict Disord Their Treat. (2019) 18:99–104. doi: 10.1097/ADT.0000000000000155

CrossRef Full Text | Google Scholar

4. Ribeiro JD, Franklin JC, Fox KR, Bentley KH, Kleiman EM, Chang BP, et al. Self-injurious thoughts and behaviors as risk factors for future suicide ideation, attempts, and death: a meta-analysis of longitudinal studies. Psychol Med. (2016) 46:225–36. doi: 10.1017/S0033291715001804

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Franklin JC, Ribeiro JD, Fox KR, Bentley KH, Kleiman EM, Huang X, et al. Risk factors for suicidal thoughts and behaviors: a meta-analysis of 50 years of research. Psychol Bull. (2017) 143:187. doi: 10.1111/sltb.12076

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Klonsky ED, May AM, Saffer BY. Suicide, suicide attempts, and suicidal ideation. Annu Rev Clin Psychol. (2016) 12:307–30. doi: 10.1146/annurev-clinpsy-021815-093204

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Liu RT, Bettis AH, Burke TA. Characterizing the phenomenology of passive suicidal ideation: a systematic review and meta-analysis of its prevalence, psychiatric comorbidity, correlates, and comparisons with active suicidal ideation. Psychol Med. (2020) 50:367–83. doi: 10.1017/S003329171900391X

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Victor SE, Klonsky ED. Correlates of suicide attempts among selfinjurers: a meta-analysis. Clin Psychol Rev. (2014) 34:282–97. doi: 10.1016/j.cpr.2014.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Prinstein MJ, Nock MK, Simon V, Aikins JW, Cheah CS, Spirito A. Longitudinal trajectories and predictors of adolescent suicidal ideation and attempts following inpatient hospitalization. J Consult Clin Psychol. (2008) 76:92–103. doi: 10.1037/0022-006X.76.1.92

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Nock MK, Green JG, Hwang I, McLaughlin KA, Sampson NA, Zaslavsky AM, et al. Prevalence, correlates, and treatment of lifetime suicidal behavior among adolescents: results from the national comorbidity survey replication adolescent supplement. JAMA Psychiatry. (2013) 70:300–10. doi: 10.1001/2013.jamapsychiatry.55

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Kann L, McManus T, Harris WA, Shanklin SL, Flint KH, Queen B, et al. Youth risk behavior surveillance-United States, 2017. MMWR Surveill Summ. (2018) 67:1–114. doi: 10.15585/mmwr.ss6708a1

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Mortier P, Cuijpers P, Kiekens G, Auerbach RP, Demyttenaere K, Green JG, et al. The prevalence of suicidal thoughts and behaviours among college students: a meta-analysis. Psychol Med. (2018) 48:554–65. doi: 10.1017/S0033291717002215

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Nock MK, Borges G, Bromet EJ, Alonso J, Angermeyer M, Beautrais A, et al. Cross-national prevalence and risk factors for suicidal ideation, plans and attempts. Br J Psychiatry. (2008) 192:98–105. doi: 10.1192/bjp.bp.107.040113

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Freeman A, Mergl R, Kohls E, Székely A, Gusmao R, Arensman E, et al. A cross-national study on gender differences in suicide intent. BMC Psychiatry. (2017) 17:234. doi: 10.1186/s12888-017-1398-8

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Nock MK, Hwang I, Sampson N, Kessler RC, Angermeyer M, Beautrais A, et al. Cross-national analysis of the associations among mental disorders and suicidal behavior: findings from the WHO world mental health surveys. PLoS Med. (2009) 6:e1000123. doi: 10.1371/journal.pmed.1000123

PubMed Abstract | CrossRef Full Text | Google Scholar

16. McHugh CM, Iorfino F, Crouse JJ, Tickell A, Nichles A, Zmicerevska N, et al. Neurocognitive functioning predicts suicidal behaviour in young people with affective disorders. J Affect Disord. (2021) 15:289–96. doi: 10.1016/j.jad.2020.11.077

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Ortuño-Sierra J, Aritio-Solana R, Díez-Gómez A, Fonseca-Pedrero E. Neurocognitive functioning in adolescents at risk for suicidal behaviors. Arch Suicide Res. (2021) 25:657–671. doi: 10.1080/13811118.2020.1746938

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Bračič M, Roškar S, Kocjan GZ, Klanšček HJ. The prevalence and predictors of suicidal ideation among Slovene adolescents. Commun Ment Health J. (2019) 55:1210–7. doi: 10.1007/s10597-019-00398-5

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Hallensleben N, Spangenberg L, Forkmann T, Rath D, Hegerl U, Kersting A, et al. Investigating the dynamics of suicidal ideation. Crisis. (2017) 39:65–9. doi: 10.1027/0227-5910/a000464

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Kleiman EM, Turner BJ, Fedor S, Beale EE, Huffman JC, Nock MK. Examination of real-time fluctuations in suicidal ideation and its risk factors: results from two ecological momentary assessment studies. J Abnorm Psychol. (2017) 126:726. doi: 10.1037/abn0000273

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Bernanke JA, Stanley BH, Oquendo MA. Toward fine-grained phenotyping of suicidal behavior: the role of suicidal subtypes. Mol Psychiatry. (2017) 22:1080–1. doi: 10.1038/mp.2017.123

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Kleiman EM, Turner BJ, Fedor S, Beale EE, Picard RW, Huffman JC, et al. Digital phenotyping of suicidal thoughts. Depres Anxiety. (2018) 35:601–8. doi: 10.1002/da.22730

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Gvion Y, Levi-Belz Y. Serious suicide attempts: systematic review of psychological risk factors. Front Psychiatry. (2018) 9:56. doi: 10.3389/fpsyt.2018.00056

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Joiner T. Why People Die by Suicide. Cambridge, MA: Harvard University Press (2005).

Google Scholar

25. Van Orden KA, Witte TK, Cukrowicz KC, Braithwaite SR, Selby EA, Joiner TE Jr. The interpersonal theory of suicide. Psychol Rev. (2010) 117:575.

Google Scholar

26. Kim E, Kim B. The mediating effects of hopelessness and the moderating effects of self-compassion and gender on the relationship between perceived burdensomeness, thwarted belongingness, and suicidal ideation in college students. Korean J Couns Psychother. (2020) 32:287–313.

Google Scholar

27. Von Brachel R, Teismann T, Feider L, Margraf J. Suicide ideation as a predictor of treatment outcomes in cognitive-behavioral therapy for unipolar mood disorders. Int J Clin Health Psychol. (2019) 19:80–4. doi: 10.1016/j.ijchp.2018.09.002

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Rubio A, Oyanedel JC, Bilbao M, Mendiburo-Seguel A, López V, Páez D. Suicidal ideation mediates the relationship between affect and suicide attempt in adolescents. Front Psychol. (2020) 11:524848. doi: 10.3389/fpsyg.2020.524848

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Joiner TE Jr, Brown JS, Wingate LR. The psychology and neurobiology of suicidal behavior. Annu Rev Psychol. (2005) 56:287–314. doi: 10.1146/annurev.psych.56.091103.070320

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Law KC, Khazem LR, Anestis MD. The role of emotion dysregulation in suicide as considered through the ideation to action framework. Curr Opin Psychol. (2015) 3:30–5. doi: 10.1016/j.copsyc.2015.01.014

CrossRef Full Text | Google Scholar

31. Gross JJ, John OP. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being. J Pers Soc Psychol. (2003) 85:348. doi: 10.1037/0022-3514.85.2.348

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Forkmann T, Scherer A, Böcker M, Pawelzik M, Gauggel S, Glaesmer H. The relation of cognitive reappraisal and expressive suppression to suicidal ideation and suicidal desire. Suicide Life Threat Behav. (2014) 44:524–36. doi: 10.1111/sltb.12076

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Kudinova AY, Owens M, Burkhouse KL, Barretto KM, Bonanno GA, Gibb BE. Differences in emotion modulation using cognitive reappraisal in individuals with and without suicidal ideation: an ERP study. Cogn Emot. (2016) 30:999–1007. doi: 10.1080/02699931.2015.1036841

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Kalichman SC, Heckman T, Kochman A, Sikkema K, Bergholte J. Depression and thoughts of suicide among middle-aged and older persons living with HIV-AIDS. Psychiatr Serv. (2000) 51:903–7. doi: 10.1176/appi.ps.51.7.903

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Kleiman EM, Adams LM, Kashdan TB, Riskind JH. Gratitude and grit indirectly reduce risk of suicidal ideations by enhancing meaning in life: evidence for a mediated moderation model. J Res Pers. (2013) 47:539–46. doi: 10.1016/j.jrp.2013.04.007

CrossRef Full Text | Google Scholar

36. Marco JH, Cañabate M, Llorca G, Pérez S. Meaning in life moderates hopelessness, suicide ideation, and borderline psychopathology in participants with eating disorders: a longitudinal study. Clin Psychol Psychother. (2020) 27:146–58. doi: 10.1002/cpp.2414

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Frankl VE. El Principio Era El Sentido. Barcelona: Paidós (2001).

Google Scholar

38. Martela F, Steger MF. The three meanings of meaning in life: distinguishing coherence, purpose, and significance. J Posit Psychol. (2016) 11:531–45. doi: 10.1080/17439760.2015.1137623

CrossRef Full Text | Google Scholar

39. Costanza A, Prelati M, Pompili M. The meaning in life in suicidal patients: the presence and the search for constructs. A systematic review. Medicina. (2019) 55:1–18. doi: 10.3390/medicina55080465

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Van Tongeren DR, Hill PC, Krause N, Ironson GH, Pargament KI. The mediating role of meaning in the association between stress and health. Ann Behav Med. (2017) 51:775–81. doi: 10.1007/s12160-017-9899-8

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Wolff JC, Davis S, Liu RT, Cha CB, Cheek SM, Nestor BA, et al. Trajectories of suicidal ideation among adolescents following psychiatric hospitalization. J Abnorm Child Psychol. (2018) 46:355–63. doi: 10.1007/s10802-017-0293-6

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Czyz EK, King CA. Longitudinal trajectories of suicidal ideation and subsequent suicide attempts among adolescent inpatients. J Clin Child Adolesc Psychol. (2015) 44:181–93. doi: 10.1080/15374416.2013.836454

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Levi-Belz Y, Aisenberg D. Interpersonal predictors of suicide ideation and complicated-grief trajectories among suicide bereaved individuals: a four-year longitudinal study. J Affect Disord. (2021) 282:1030–5. doi: 10.1016/j.jad.2021.01.006

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol. (2008) 4:1–32. doi: 10.1146/annurev.clinpsy.3.022806.091415

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Czyz EK, King CA, Nahum-Shani I. Ecological assessment of daily suicidal thoughts and attempts among suicidal teens after psychiatric hospitalization: lessons about feasibility and acceptability. Psychiatry Res. (2018) 267:566–74. doi: 10.1016/j.psychres.2018.06.031

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Irigoyen M, Segovia AP, Galván L, Puigdevall M, Giner L, De Leon S, et al. Predictors of re-attempt in a cohort of suicide attempters: a survival analysis. J Affect Disord. (2019) 247:20–8. doi: 10.1016/j.jad.2018.12.050

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Glenn CR, Kleiman EM, Kearns JC, Santee AC, Esposito EC, Conwell Y, et al. Feasibility and acceptability of ecological momentary assessment with high-risk suicidal adolescents following acute psychiatric care. J Clin Child Adolesc Psychol. (2020) 51:32–48. doi: 10.1080/15374416.2020.1741377

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Hallensleben N, Glaesmer H, Forkmann T, Rath D, Strauss M, Kersting A, et al. Predicting suicidal ideation by interpersonal variables, hopelessness and depression in real-time. An ecological momentary assessment study in psychiatric inpatients with depression. Eur Psychiatry. (2019) 56:43–50. doi: 10.1016/j.eurpsy.2018.11.003

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Rodríguez-Blanco L, Carballo JJ, Baca-García E. Use of ecological momentary assessment (EMA) in non-suicidal self-injury (NSSI): a systematic review. Psychiatry Res. (2018) 263:212–9. doi: 10.1016/j.psychres.2018.02.051

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Santangelo PS, Koenig J, Funke V, Parzer P, Resch F, Ebner-Priemer UW, et al. Ecological momentary assessment of affective and interpersonal instability in adolescent non-suicidal self-injury. J Abnorm Child Psychol. (2017) 45:1429–38. doi: 10.1007/s10802-016-0249-2

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Sedano-Capdevila A, Porras-Segovia A, Bello HJ, Baca-García E, Barrigón ML. Use of ecological momentary assessment to study suicidal thoughts and behavior: a systematic review. Curr Psychiatry Rep. (2021) 23:41. doi: 10.1007/s11920-021-01255-7

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Maher J, Reifsteck E, Newton J, Shriver L, Wideman L. Physical activity habit disruption during the transition out of college sports: an ecological momentary assessment study. J Sport Exerc Psychol. (2019) 41:S77.

Google Scholar

53. Ashurst J, Van Woerden I, Dunton G, Todd M, Ohri-Vachaspati P, Swan P, et al. The association among emotions and food choices in first- year college students using mobile-ecological momentary assessments. BMC Public Health. (2018) 18:573. doi: 10.1186/s12889-018-5447-0

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Midgette EP, Whited M, Ellis J. Ecological momentary assessment of sleep quaility, daytime sleepiness, and eating behavior among college students. Ann Behav Med. (2019) 53:237. doi: 10.1111/jsr.12024

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Phillips KT, Phillips MM, Lalonde TL, Prince MA. Does social context matter? An ecological momentary assessment study of marijuana use among college students. Addict Behav. (2018) 83:154–9. doi: 10.1016/j.addbeh.2018.01.004

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Hultgren B, Scaglione N, Slavish D, Turrisi R. Congruence between ecological momentary assessment and daily diaries of college student drinking: implications for prevention. Psychosom Med. (2017) 79:76. doi: 10.1016/j.beth.2010.07.003

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Bai S, Elavsky S, Kishida M, Dvořáková K, Greenberg MT. Effects of mindfulness training on daily stress response in college students: ecological momentary assessment of a randomized controlled trial. Mindfulness. (2020) 11:1433–45. doi: 10.1007/s12671-020-01358-x

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Blasco MJ, Vilagut G, Almenara J, Roca M, Piqueras JA, Gabilondo A, et al. Suicidal thoughts and behaviors: prevalence and association with distal and proximal factors in Spanish university students. Suicide Life Threat Behav. (2019) 49:881–98. doi: 10.1111/sltb.12491

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Barrigón ML, Berrouiguet S, Carballo JJ, Bonal-Giménez C, Fernández-Navarro P, Pfang B, et al. User profiles of an electronic mental health tool for ecological momentary assessment: MEmind. Int J Methods Psychiatr Res. (2017) 26:e1554. doi: 10.1002/mpr.1554

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Cabello R, Salguero JM, Fernández-Berrocal P, Gross JJ. A Spanish adaptation of the emotion regulation questionnaire. Eur J Psychol Assess. (2013) 29:234–40. doi: 10.1027/1015-5759/a000150

CrossRef Full Text | Google Scholar

61. Sandín B, Chorot P, Lostao L, Joiner TE, Santed MA, Valiente RM. Escalas PANAS de afecto positivo y negativo: validación factorial y convergencia transcultural. Psicothema. (1999) 11:37–51.

Google Scholar

62. Watson D, Clark AL, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scale. J Pers Soc Psychol. (1988) 54:1063–70. doi: 10.1037/0022-3514.54.6.1063

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Silva C, Hurtado G, Hartley C, Rangel JN, Hovey JD, Pettit JW, et al. Spanish translation and validation of the interpersonal needs questionnaire. Psychol Assess. (2018) 30:e21–37. doi: 10.1037/pas0000643

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Van Orden KA, Cukrowicz KC, Witte TK, Joiner TE Jr. Thwarted belongingness and perceived burdensomeness: construct validity and psychometric properties of the interpersonal needs questionnaire. Psychol Assess. (2012) 24:197. doi: 10.1037/a0025358

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Diez-Quevedo C, Rangil T, Sanchez-Planell L, Kroenke K, Spitzer RL. Validation and utility of the patient health questionnaire in diagnosing mental disorders in 1003 general hospital Spanish inpatients. Psychosom Med. (2001) 63:679–86. doi: 10.1097/00006842-200107000-00021

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Internal Med. (2001) 16:606–13. doi: 10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

67. García-Alandete J, Martínez ER, Nohales PS. Estructura factorial y consistencia interna de una versión española del purpose-in-life test. Univ Psychol. (2013) 12:517–30. doi: 10.11144/Javeriana.UPSY12-2.efci

CrossRef Full Text | Google Scholar

68. Crumbaugh JC, Maholick LT. Manual of Instructions for the Purpose in Life Test. Abilene, TX: Viktor Frankl Institute of Logotherapy (1969).

Google Scholar

69. Porras-Segovia A, Molina-Madueño RM, Berrouiguet S, López-Castroman J, Barrigón ML, Pérez-Rodríguez, et al. Smartphone-based ecological momentary assessment (EMA) in psychiatric patients and student controls: a real-world feasibility study. J Affect Disord. (2020) 274:733–41. doi: 10.1016/j.jad.2020.05.067

PubMed Abstract | CrossRef Full Text | Google Scholar

70. Nylund KL, Asparouhov T, Muthén BO. Deciding on the number of classes in latent class analysis and growth mixture modeling: a Monte Carlo simulation study. Struct Equ Modeling. (2007) 14:535–69. doi: 10.1080/10705511.2014.882690

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Han B, Compton WM, Blanco C, Colpe L, Huang L, McKeon R. National trends in the prevalence of suicidal ideation and behavior among young adults and receipt of mental health care among suicidal young adults. J Am Acad Child Adolesc Psychiatry. (2018) 57:20–7. doi: 10.1016/j.jaac.2017.10.013

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Schmeelk-Cone K, Pisani AR, Petrova M, Wyman PA. Three scales assessing high school students’ attitudes and perceived norms about seeking adult help for distress and suicide concerns. Suicide Life Threat Behav. (2012) 42:157–72. doi: 10.1111/j.1943-278X.2011.00079.x

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Pisani AR, Schmeelk-Cone K, Gunzler D, Petrova M, Goldston DB, Tu X, et al. Associations between suicidal high school students’ help- seeking and their attitudes and perceptions of social environment. J Youth Adolesc. (2012) 41:1312–24. doi: 10.1007/s10964-012-9766-7

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Joiner TE Jr, Rudd MD. Intensity and duration of suicidal crises vary as a function of previous suicide attempts and negative life events. J Consult Clin Psychol. (2000) 68:909. doi: 10.1037/0022-006X.68.5.909

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Gratch I, Choo TH, Galfalvy H, Keilp JG, Itzhaky L, Mann JJ, et al. Detecting suicidal thoughts: the power of ecological momentary assessment. Depress Anxiety. (2021) 38:8–16. doi: 10.1002/da.23043

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Witte TK, Fitzpatrick KK, Warren KL, Schatschneider C, Schmidt NB. Naturalistic evaluation of suicidal ideation: variability and relation to attempt status. Behav Res Ther. (2006) 44:1029–40. doi: 10.1016/j.brat.2005.08.004

PubMed Abstract | CrossRef Full Text | Google Scholar

77. DeShong HL, Tucker RP, O’Keefe VM, Mullins-Sweatt SN, Wingate LR. Five factor model traits as a predictor of suicide ideation and interpersonal suicide risk in a college sample. Psychiatry Res. (2015) 226:217–23. doi: 10.1016/j.psychres.2015.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Li W, Dorstyn DS, Jarmon E. Identifying suicide risk among college students: a systematic review. Death Stud. (2020) 47:450–458. doi: 10.1080/07481187.2019.1578305

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Lockman JD, Servaty-Seib HL. College student suicidal ideation: perceived burdensomeness, thwarted belongingness, and meaning made of stress. Death Stud. (2016) 40:154–64. doi: 10.1080/07481187.2015.1105325

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Díez-Gómez A, Pérez-Albéniz A, Sebastián-Enesco C, Fonseca-Pedrero E. Suicidal behavior in adolescents: a latent class analysis. Int J Environ Res Public Health. (2020) 17:2820. doi: 10.3390/ijerph17082820

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Chang EC, Chang OD. Development of the frequency of suicidal ideation inventory: evidence for the validity and reliability of a brief measure of suicidal ideation frequency in a college student population. Cogn Ther Res. (2016) 40:549–56. doi: 10.1007/s10608-016-9758-0

CrossRef Full Text | Google Scholar

82. Hirsch JK, Webb JR, Jeglic EL. Forgiveness, depression, and suicidal behavior among a diverse sample of college students. J Clin Psychol. (2011) 67:896–906. doi: 10.1002/jclp.20812

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Joiner TE Jr, Van Orden KA, Witte TK, Selby EA, Ribeiro JD, Lewis R, et al. Main predictions of the interpersonal–psychological theory of suicidal behavior: empirical tests in two samples of young adults. J Abnorm Psychol. (2009) 118:634. doi: 10.1037/a0016500

PubMed Abstract | CrossRef Full Text | Google Scholar

84. Rajappa K, Gallagher M, Miranda R. Emotion dysregulation and vulnerability to suicidal ideation and attempts. Cogn Ther Res. (2012) 36:833–9. doi: 10.1007/s10608-011-9419-2

CrossRef Full Text | Google Scholar

85. Weinberg A, Klonsky ED. Measurement of emotion dysregulation in adolescents. Psychol Assess. (2009) 21:616. doi: 10.1037/a0016669

PubMed Abstract | CrossRef Full Text | Google Scholar

86. Bowen R, Balbuena L, Peters EM, Leuschen-Mewis C, Baetz M. The relationship between mood instability and suicidal thoughts. Arch Suicide Res. (2015) 19:161–71. doi: 10.1080/13811118.2015.1004474

PubMed Abstract | CrossRef Full Text | Google Scholar

87. Flores-Soto MR, Cancino-Marentes ME, Varela F, del Rocío M. Revisión sistemática sobre conductas autolesivas sin intención suicida en adolescentes. Rev. Cuba Salud. Pública. (2018) 44:200–16.

Google Scholar

88. Vázquez FL, Blanco V. Prevalence of DSM-IV major depression among Spanish university students. J Am Coll Health. (2008) 57:165–72. doi: 10.3200/JACH.57.2.165-172

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Ballester L, Alayo I, Vilagut G, Almenara J, Cebrià AI, Echeburúa E, et al. Accuracy of online survey assessment of mental disorders and suicidal thoughts and behaviors in Spanish university students. Results of the WHO world mental health-international college student initiative. PLoS One. (2019) 14:e0221529. doi: 10.1371/journal.pone.0221529

PubMed Abstract | CrossRef Full Text | Google Scholar

90. Dazzi T, Gribble R, Wessely S, Fear NT. Does asking about suicide and related behaviours induce suicidal ideation? What is the evidence? Psychol Med. (2014) 44:3361–3. doi: 10.1017/S0033291714001299

PubMed Abstract | CrossRef Full Text | Google Scholar