Association of Resting Heart Rate and Heart Rate Variability With Proximal Suicidal Risk in Patients With Diverse Psychiatric Diagnoses

Objectively measurable biomarkers have not been applied for suicide risk prediction. Resting heart rate (HR) and heart rate variability (HRV) showed potential as trans-diagnostic markers associated with suicide. This study aimed to investigate the associations of resting HR and HRV on proximal suicide risk in patients with diverse psychiatric diagnoses. This chart review study used the medical records of psychiatric patients who visited the outpatient clinic at an academic tertiary hospital. A total of 1,461 patients with diverse psychiatric diagnoses was included in the analysis. Proximal suicide risk was measured using the Mini-International Neuropsychiatric Interview (MINI) suicidal score. Linear regression analyses with the MINI suicidal score as a dependent variable and binary logistic regression analyses with moderate-to-high suicide risk (MINI suicidal risk score ≥6) as a dependent variable were conducted to explore the effects of resting HR and HRV parameters on acute suicide risk after adjusting for age, sex, presence of major depressive disorder (MDD) and bipolar disorder (BD), severity of depression and anxiety severity. We found that 55 (34.6%) patients in the MDD group, 40 (41.7%) in the BD group and 36 (3.9%) in the others group reported moderate-to-high suicide risk. Linear regression analysis revealed that both resting HR and root-mean-square of successive difference (RMSSD) had significant associations with the MINI suicidal score (P = 0.037 with HR, P = 0.003 with RMSSD). In logistic regression, only RMSSD showed a significant association with moderate-to-high suicide risk (P = 0.098 with HR, P = 0.019 with RMSSD), which remained significant in subgroup analysis with patients who reported any suicide-related symptom (MINI suicidal score >0; n = 472; P = 0.017 with HR, P = 0.012 with RMSSD). Our study findings suggest the potential for resting HR and RMSSD as biomarkers for proximal suicide risk prediction. Further research with longitudinal evaluation is needed to confirm our study findings.

Introduction

Suicide is a significant mental health problem. Extensive efforts have been made toward suicide risk prediction and prevention. In clinical practice, suicide risk assessment generally is based on clinical observation of the patient's current state and previous history. However, the validity, reliability, and utility of current suicide risk prediction systems are unknown (1). To increase the accuracy of suicidal risk prediction, objectively measurable biomarkers that can discriminate patients in an “at-risk” state are needed.

Physiological biomarkers that can be measured when an individual is in an “at-risk” state are promising candidates for suicide risk monitoring. Heart rate (HR) and heart rate variability (HRV) can be used for this purpose. HRV refers beat-to-beat variations in HR. Both HR and HRV are produced by sympathetic and parasympathetic neural activity. Lower HRV is an indicator of dysregulation of cardiac autonomic function and a predictor of poor health status (2). Short-term power spectral analysis of HRV, which has been standardized since 1996 (3), has been developed as a reliable and non-invasive tool to probe the autonomic regulation of the heart. Several studies have reported that resting HR (4, 5) and resting HRV (6) showed associations with suicide attempts.

Despite the potential of resting HR and resting HRV as candidate biomarkers for “at risk” states, previous studies have limitations with respect to generalizing their results. First, aside from limited sample sizes, most studies have explored associations with suicide ideation (7–9) or lifetime suicide attempts (9, 10). To assess the potential of resting state HR and HRV as biomarkers to identify the “at-risk” state, an association with “proximal” suicide risk should be examined. Second, most studies included biased populations in terms of psychiatric diagnoses. Suicide is a complex phenomenon that can occur among individuals suffering from a range of diverse psychiatric conditions (11). Focusing on populations with certain psychiatric disorders can hinder generalization of study findings. In particular, patients with subthreshold disorder manifestations have not been included in previous studies. Considering the dimensional nature of suicidality, patients with subthreshold disorder manifestations that can involve significant distress and dysfunction (12) should be included in studies exploring potential biomarkers. In addition, resting HRV is a biomarker for various psychiatric conditions. Meta-analytic studies have shown that decreased HRV is associated with diverse psychiatric illnesses including major depressive disorder (MDD) (13), bipolar disorder (BD) (14), anxiety disorder (15), and schizophrenia (16), indicating a broad association of decreased HRV with psychopathology rather than with a single disorder. To determine the association between resting HRV and suicide risk, additional investigations that include diverse psychiatric populations are needed.

In the present study, we examined the association of resting HR and HRV with proximal suicide risk in patients with diverse psychiatric diagnoses. Using a large clinical population with diverse psychiatric conditions including subthreshold disorder manifestations, we investigated the associations of resting HR and HRV with proximal suicide risk.

Methods

Study Population

Data were obtained from retrospective chart reviews of patients who visited the outpatient clinic of Samsung Medical Center between January 1, 2017 and December 31, 2019. As part of routine care, all patients who visited the outpatient clinic of the Department of Psychiatry at Samsung Medical Center underwent a standardized evaluation process including psychological and biological evaluations. Following an initial interview with a board-certified psychiatrist, patients between 18 and 65 years of age were referred for the evaluation process. The psychological evaluation was designed to confirm the clinical diagnosis of subjects based on the Diagnostic and Statistical Manual of Mental Disorders, fourth edition, text revision (DSM-IV-TR), and to evaluate symptom severity. The psychologist who conducted the evaluation had more than 2 years of clinical experience. Detailed psychological measures included in the evaluation process were described elsewhere (17). Patients suspected of psychosis or intellectual disability or those who required emergency admission were not referred for the evaluation. Because this study targeted trans-diagnostic features associated with emotional disorder, we also excluded any subject who were suspected to have schizophrenia and related disorders. In this study, we analyzed the test results of comprehensive psychological evaluations and resting HRV measures. A total of 1,461 subjects was included in the analysis.

The study protocol was approved by the Institutional Review Board of Samsung Medical Center (no. 2018-11-019). The study was performed in accordance with the ethical standards stated in the 1964 Declaration of Helsinki. All identifying data were removed from the clinical database prior to analyses. The need for patient consent was waived because this was a retrospective chart review study.

Applied Measures

Psychiatric Diagnoses

The diagnoses of study subjects were evaluated using the Korean version of the Mini International Neuropsychiatric Interview (MINI) (18). MINI diagnostic modules for major depressive disorder, dysthymia, manic episode, panic disorder, agoraphobia, social phobia, obsessive-compulsive disorder, posttraumatic stress disorder, alcohol dependence, schizophrenia, delusional disorder, generalized anxiety disorder, somatoform disorder, adjustment disorders and attention deficit hyperactivity disorder were included. When symptoms did not meet the full criteria, diagnoses with not otherwise specified were coded. Primary psychiatric diagnoses based on the DSM-IV-TR (19) diagnoses were included for the analysis.

Emotional Symptoms

The Hamilton rating scale for depression (HAM-D) (20) was adopted to evaluate current depressive symptoms in patients. The Hamilton rating scale for anxiety (HAM-A) (21) was used to evaluate anxiety symptoms.

Proximal Suicide Risk

The proximal suicide risk was measured using the MINI suicide-item modules. The MINI suicide module is a six-question, yes-or-no, interviewer-administered questionnaire used to evaluate suicidality. The MINI suicide module assesses experiences during the past month of recurrent thoughts of death (1 point), ideas of self-harm (2 points), presence of suicide ideation (6 points), plans for suicide (10 points), and suicide attempts (10 points). In addition, lifetime history of suicide attempts (4 points) is assessed. The MINI suicidal score is calculated by adding the assigned points of the items checked as “yes” in the suicide module. We used the MINI suicidal score as a marker for proximal suicide risk. A previous study that examined the predictive validity of the MINI suicidal scale reported good sensitivity (0.61–0.75) and specificity (0.61–0.75) in predicting suicidal behavior. The suicide risk score is categorized as low risk (<6 points), moderate risk (6–9 points), or high risk (≥10 points) for future suicide attempts (22).

Resting HRV

Data collection and HRV analysis were completed using SA-6000 (Medicore Co., Seoul, Korea). HRV data analysis and signal processing followed guidelines defined by the Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology (23). The measurement was conducted between 9 A.M. and 4 P.M. Prior to undergoing measurement, patients were instructed to refrain from intake of alcohol, caffeine, and food and from smoking for at least 2 h before the test. After 5 min of rest, an electrocardiogram was recorded for 3 min with the patient in a sitting position. We calculated HR and three features based on R-R interval using time-domain analysis, standard deviation of average normal-normal intervals (SDNN), and root mean square of successive differences (RMSSD). The SDNN reflects both sympathetic and parasympathetic activities, while the RMSSD is sensitive to parasympathetic modulation (24). Frequency domain features indicate various spectral components, including low frequency (LF: 0.04~0.15 Hz), high frequency (HF: 0.15~0.4 Hz) and the LF/HF ratio. LF is modulated by sympathetic and parasympathetic activities, and HF is modulated by parasympathetic activities. The LF/HF ratio measures the balance between sympathetic and parasympathetic activities (25).

Statistical Analyses

We divided participants into three groups based on psychiatric diagnoses associated with high suicide risk: MDD, BD, and others. We compared demographic characteristics, depression and anxiety severity, frequency of each item of the MINI suicide module, resting HR, and HRV measures among the three groups. Analyses of variances (ANOVA) were used for continuous variables, and chi-square test was used for categorical variables. Post-hoc analyses were conducted using the Fisher's Least Significant Difference (LSD) method. We performed multivariate linear regression analyses to determine associations of resting-state HR and HRV measures with proximal suicide risk. The MINI suicidal score was entered as a dependent variable in linear regression analyses. Age, sex, diagnostic group (MDD, BD, and others), depression, and anxiety severity were entered as covariates. As most previous studies focused on suicidality in mood disorders, MDD and BD also were entered as covariates. To examine whether resting HR and HRV measures could differentiate patients with moderate-to-high suicide risk among patients who reported any kind of suicide-related symptom, multivariate logistic regression analysis was performed in a subgroup of patients with MINI suicidal score >0. The significance level was set at P < 0.05. All statistical analyses were performed using R version 4.02 (26).

Results

A total of 1,461 patients (mean age of 42.05 years, 36.8% male) was included in the study analysis. Table 1 lists the primary psychiatric diagnoses of the patients as determined by the MINI. Among the total 1,461 patients, 448 (30.7%) had MDD, 222 (15.2%) had panic disorder, 148 (10.1%) had anxiety disorder other than panic disorder, 102 (7.0%) had somatic symptom or related disorder, and 96 (6.6%) had bipolar disorder. Seventy-three (5.0%) patients did not experience psychiatric symptoms that met the DSM criteria for any disorder and were assigned as having a subthreshold diagnosis.

TABLE 1

Table 1. Primary diagnoses of patients included in the analysis.

Among the total 1,461 patients, 472 (32.3%) responded “yes” to at least one item of the MINI suicide module (MINI suicidal score >0), while 229 (15.7%) showed moderate-to-high risk based on the MINI suicidal score. The primary psychiatric diagnoses of patients were diverse (Figure 1). The mean MINI suicidal score was highest in the BD group [6.49 standard deviation (SD) = 8.22)], followed by the MDD group [5.01 (SD = 7.42); Table 2]. Likewise, patients with moderate-to-high suicidal risk were most common in BD (41.7%) and MDD (34.6%) groups. Of patients with non-MDD, 19.2% (n = 194) responded “yes” to at least one item of the MINI suicide module, and 7.3% (n = 74) had moderate-to-high suicide risk.

FIGURE 1

Figure 1. Distribution of MINI suicidal scores across primary diagnoses. MINI suicidal score was categorized as low risk (<6 points), moderate risk (6–9 points), or high risk (≥10 points). Proportions of subjects with moderate risk and high risk in each primary diagnosis (A). Mean MINI suicidal score in each primary diagnosis (B). Error bars represent standard deviation. MINI, Mini-International Neuropsychiatric Interview; ADHD, attention deficit hyperactivity disorder; ADJ, adjustment disorder; ALC, alcohol use disorder; ANX, anxiety disorder other than panic disorder; BPRD, bipolar and related disorders; DEP, depressive disorder other than major depressive disorder; INS, insomnia disorders; MDD, major depressive disorder; OCRD, obsessive-compulsive and related disorders; PAN, panic disorder; PTSD, posttraumatic stress disorder or acute stress disorder; SOM, somatic symptom and related disorders; TIC, tic disorders; OTH, others; SUB, subthreshold diagnosis.

TABLE 2

Table 2. Comparisons of demographic, clinical characteristics and suicidal risk between major depressive disorder and other diagnoses.

In terms of demographic characteristics, females were more common in the MDD group. The BD group was youngest, followed by the MDD group and others. Depression and anxiety severity, all items in the MINI suicidal module, and MINI suicidal score were highest in the BD group, followed by the MDD group and others.

Resting state HR and HRV measures were compared among the three groups (Table 3). Significant differences were observed in resting HR, SDNN, and LF between groups. In post-hoc analyses, the MDD group had lower resting HR, SDNN, and LF compared with the BD group and a lower SDNN compared with the others group.

TABLE 3

Table 3. Comparison of HRV measures between MDD, BD, and others group.

In linear regression analyses, both HR (P = 0.037) and RMSSD (P = 0.003) showed significant association with the MINI suicidal score after adjusting for age, sex, primary diagnosis, and HAM-D and HAM-A scores (Table 4). The overall directions of the association were similar across MDD, BD and others groups (Figure 2). Other HRV measures did not show significant associations with the MINI suicidal score. In logistic regression analyses, only RMSSD showed a significant association with moderate-to-high suicide risk after adjusting for the aforementioned covariates (P = 0.098 with HR, P = 0.019 with RMSSD; Table 5). When we only included participants with any suicide-related symptom (MINI suicidal score >0), a total of 472 subjects with MINI suicidal score 0 was included in the analyses. Both HR (P = 0.010) and RMSSD (P = 0.002) showed significant associations with MINI suicidal score. In logistic regression analyses, HR (P = 0.017) and RMSSD (P = 0.012) showed significant associations with moderate-to-high suicide risk.

TABLE 4

Table 4. Multivariate linear regression analysis of association of resting heart rate (HR) and root-mean-square of R-R interval successive difference with the MINI suicidal scale.

FIGURE 2

Figure 2. Association between heart rate variability and MINI suicidal scale in two subgroups of major depressive disorder and other diagnoses. MINI, Mini-International Neuropsychiatric Interview; MDD, major depressive disorder; RMSSD, root mean square of R-R interval of successive differences; HR, resting state heart rate.

TABLE 5

Table 5. Multivariate logistic regression analysis of association of resting heart rate (HR) and root-mean-square of R-R interval successive difference with the moderate-to-high suicide risk.

Of all patients included in the analyses, 738 (50.0%) completed the alcohol use disorders identification test (AUDIT) (27). An AUDIT score ≥8 suggests harmful alcohol consumption. When we adjust harmful alcohol consumption in regression analyses to determine the effects of HR and HRV on suicide risk, resting HR and RMSSD showed significant association with the MINI suicidal score in linear regression analyses (Standardized beta = 0.074, t = 2.23, P = 0.026 for HR; standardized beta = 0.070, t = −2.073, P = 0.039 for RMSSD), while none of them show significant associations with the moderate-to-high suicide risk in logistic regression analysis (P = 0.170 for HR; P = 0.167 for RMSSD).

Discussion

Suicide is a major mental health problem that remains difficult to prevent. Finding objectively measurable biomarkers to detect proximal suicide risk could change the current approaches to suicide prevention. In this study, we examined whether resting-state HR and HRV measures showed significant associations with proximal suicide risk in patients with diverse psychiatric conditions. We found that resting-state HR and RMSSD were associated with proximal suicide risk, suggesting their potential as biomarkers for suicide risk prediction.

In our study, we included patients with diverse psychiatric conditions. The MDD group had more females compared with other diagnostic groups, which is consistent with previous findings that MDD is more commonly observed in females (28). Patients with diverse psychiatric diagnoses reported suicide-related symptoms. Approximately 4% of individuals in the others group showed a moderate-to-high suicide risk. A recent review suggested that a person with suicidal thoughts is at risk even if there are few overt symptoms of psychiatric diagnoses (29). Considering that suicidal behavior was observed trans-diagnostically, suicidal behavior disorder was suggested as a different psychiatric diagnostic entity in the DSM-5 (30).

Most previous studies on resting HRV focused on comparisons between patients with a single psychiatric disorder and healthy controls. Meta-analytic studies have shown that decreased HRV is associated with diverse psychiatric illnesses including MDD (13), BD (14), anxiety disorder (15), and schizophrenia (16), indicating an association of decreased HRV with psychopathology in general rather than with a single disorder. Whether there are diagnosis-specific differences in resting HRV measures remains unclear. Other factors including symptom severity could affect the differences between diagnostic groups. In our study, the overall directions of association were similar across diverse diagnostic groups (Figure 2), and the results remained significant even before adjusting for diagnostic groups.

Previous studies showed that a heightened autonomic state measured using HR and HRV (i.e., higher HR and lower variance of RR intervals) were associated with suicide (6). However, limited research has explored the associations of HR and HRV with proximal suicide risk. Most studies focused on lifetime suicide attempt or suicide ideation, which cannot be used to evaluate if an individual is an “at-risk” state. In our study, resting-state HR and RMSSD both showed significant associations with proximal suicide risk measured using the MINI suicidal score. In addition, the association remained significant in subgroup analysis with patients who reported any kind of suicide- related symptoms only (patients with a MINI suicidal score >0), indicating the potential of resting HR and RMSSD as a biomarker used for proximal suicide risk prediction.

Both HR and HRV are controlled by the autonomic nervous system. In particular, RMSSD is a marker of resting vagal tone. Cortical activity modulates cardiac activity via the vagus nerve (31). In addition, the orbitofrontal cortex (OFC) and medial prefrontal cortex (mPFC) tonically inhibit the amygdala via the vagal pathway (32). Thus, reduced vagal tone could reflect the activity of OFC and mPFC, which are associated with cognitive control in relation to suicide attempt (33). Prior studies have demonstrated the association between vagally-mediated resting state HRV and cognitive (34) and affective flexibility (35). Cognitive inflexibility can lead to suicidal behavior during a crisis, in which patients consider suicide the only way to escape their current distress (36).

In the Research Domain Criteria (RDoC) project that aims to identify trans-diagnostic dimensions of psychiatric illnesses, resting HR and HRV are affected by the arousal and regulatory system. This system is one of the least studied areas of the RDoC system in association with suicide (37). Unlike other risk factors, resting-state HR and HRV measures can be monitored on a real-time basis using recent technology (6). With this newly developed technology, clinicians might predict and prevent suicide in a more effective and timely manner. Additional study is needed to apply resting-state HR and HRV to evaluating acute suicide risk on a real-time basis.

The current study findings should be interpreted within the context of the study design. First, this study only included cross-sectional, single, and short-term evaluations. Therefore, we could not evaluate causal relationships. We also did not evaluate whether patients with high risk of suicide in our study actually showed suicidal behavior prospectively. However, as mentioned above, the MINI suicidal score showed good predictive validity in a previous study. Second, we could not control for several confounding factors of resting HRV including physical comorbidities, somatic symptoms, physical activity, current medications, body mass index, sleep profile, timing and smoking status. Third, the study did not include healthy controls.

Notwithstanding the abovementioned limitations, this study demonstrated the associations of resting-state HR and RMSSD with proximal suicide risk in patients with diverse psychiatric conditions. Across diverse psychiatric populations, including those with subthreshold disorder manifestations, we found that resting HR and RMSSD displayed significant associations with proximal suicide risk. In addition, we found that resting HR and RMSSD demonstrated significant associations with proximal suicide risk among patients with any suicide-related symptom (MINI suicidal score >0). Additional research with real time monitoring is needed to confirm the study findings.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

The studies involving human participants were reviewed and approved by Samsung medical center. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

JB developed the initial research idea. JB, DL, and YC conducted statistical analyses. JB and DL wrote the manuscript. DL and YC constructed the table and figures. JB, DL, YC, and KH edited the finalized version. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by a National Research Foundation of Korea (NRF) Grant (NRF-2019R1G1A109167912) funded by the Korean government (MSIT) and by the CRP project of Samsung Medical Center (No. SMO1200551).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2021.652340/full#supplementary-material

References

1. Murray D. Is it time to abandon suicide risk assessment? BJPsych Open. (2016) 2:e1–2. doi: 10.1192/bjpo.bp.115.002071

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Dekker JM, Crow RS, Folsom AR, Hannan PJ, Liao D, Swenne CA, et al. Low heart rate variability in a 2-minute rhythm strip predicts risk of coronary heart disease and mortality from several causes: the ARIC study. Atherosclerosis risk in communities. Circulation. (2000) 102:1239–44. doi: 10.1161/01.CIR.102.11.1239

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. Task Force of the European society of cardiology and the North American society of pacing and electrophysiology. Eur Heart J. (1996) 17:354–81.

Google Scholar

4. Chang SS, Bjorngaard JH, Tsai MK, Bjerkeset O, Wen CP, Yip PS, et al. Heart rate and suicide: findings from two cohorts of 533 000 Taiwanese and 75 000 Norwegian adults. Acta Psychiatr Scand. (2016) 133:277–88. doi: 10.1111/acps.12513

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lemogne C, Thomas F, Consoli SM, Pannier B, Jégo B, Danchin N. Heart rate and completed suicide: evidence from the IPC cohort study. Psychosom Med. (2011) 73:731–6. doi: 10.1097/PSY.0b013e3182365dc7

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Kang GE, Patriquin MA, Nguyen H, Oh H, Rufino KA, Storch EA, et al. Objective measurement of sleep, heart rate, heart rate variability, and physical activity in suicidality: a systematic review. J Affect Disord. (2020) 273:318–27. doi: 10.1016/j.jad.2020.03.096

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Chang CC, Tzeng NS, Kao YC, Yeh CB, Chang HA. The relationships of current suicidal ideation with inflammatory markers and heart rate variability in unmedicated patients with major depressive disorder. Psychiatry Res. (2017) 258:449–56. doi: 10.1016/j.psychres.2017.08.076

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Gutierrez PM, Davidson CL, Friese AH, Forster JE. Physical activity, suicide risk factors, and suicidal ideation in a veteran sample. Suicide Life Threat Behav. (2016) 46:284–92. doi: 10.1111/sltb.12190

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Tsypes A, James KM, Woody ML, Feurer C, Kudinova AY, Gibb BE. Resting respiratory sinus arrhythmia in suicide attempters. Psychophysiology. (2018) 55:e12978. doi: 10.1111/psyp.12978

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Wilson ST, Chesin M, Fertuck E, Keilp J, Brodsky B, Mann JJ, et al. Heart rate variability and suicidal behavior. Psychiatry Res. (2016) 240:241–7. doi: 10.1016/j.psychres.2016.04.033

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Glenn CR, Cha CB, Kleiman EM, Nock MK. Understanding suicide risk within the research domain criteria (RDoC) framework: insights, challenges, and future research considerations. Clin Psychol Sci. (2017) 5:568–92. doi: 10.1177/2167702616686854

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Krueger RF, Eaton NR. Transdiagnostic factors of mental disorders. World Psychiatry. (2015) 14:27–9. doi: 10.1002/wps.20175

CrossRef Full Text | Google Scholar

13. Koch C, Wilhelm M, Salzmann S, Rief W, Euteneuer F. A meta-analysis of heart rate variability in major depression. Psychol Med. (2019) 49:1948–57. doi: 10.1017/S0033291719001351

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Faurholt-Jepsen M, Kessing LV, Munkholm K. Heart rate variability in bipolar disorder: a systematic review and meta-analysis. Neurosci Biobehav Rev. (2017) 73:68–80. doi: 10.1016/j.neubiorev.2016.12.007

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Chalmers JA, Quintana DS, Abbott MJ, Kemp AH. Anxiety disorders are associated with reduced heart rate variability: a meta-analysis. Front Psychiatry. (2014) 5:80. doi: 10.3389/fpsyt.2014.00080

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Clamor A, Lincoln TM, Thayer JF, Koenig J. Resting vagal activity in schizophrenia: meta-analysis of heart rate variability as a potential endophenotype. Br J Psychiatry. (2016) 208:9–16. doi: 10.1192/bjp.bp.114.160762

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Baek JH, Kim JS, Nierenberg AA, Jeon HJ, Hong KS. Clinical correlates of false positive assignment in bipolar screening measures across psychiatric diagnoses among patients without bipolar disorder. Psychiatry Investig. (2020) 17:1118–25. doi: 10.30773/pi.2020.0246

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Yoo SW, Kim Y, Noh JS. Validity of Korean version of the mini-international neuropsychiatric interview. Anxiety Mood. (2006) 2:50–5.

PubMed Abstract | Google Scholar

19. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision (DSM-IV-TR). Arlington, VA: American Psychiatric Publishing (2000).

Google Scholar

20. Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. (1960) 23:56–62. doi: 10.1136/jnnp.23.1.56

CrossRef Full Text | Google Scholar

21. Hamilton M. The assessment of anxiety states by rating. Br J Med Psychol. (1959) 32:50–5. doi: 10.1111/j.2044-8341.1959.tb00467.x

CrossRef Full Text | Google Scholar

22. Roaldset JO, Linaker OM, Bjørkly S. Predictive validity of the MINI suicidal scale for self-harm in acute psychiatry: a prospective study of the first year after discharge. Arch Suicide Res. (2012) 16:287–302. doi: 10.1080/13811118.2013.722052

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. Eur Heart J. (1996) 17:354–81.

Google Scholar

24. Choi KW, Jang EH, Kim AY, Fava M, Mischoulon D, Papakostas GI, et al. Heart rate variability for treatment response between patients with major depressive disorder versus panic disorder: A 12-week follow-up study. J Affect Disord. (2019) 246:157–65. doi: 10.1016/j.jad.2018.12.048

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Thayer JF, Yamamoto SS, Brosschot JF. The relationship of autonomic imbalance, heart rate variability and cardiovascular disease risk factors. Int J Cardiol. (2010) 141:122–31. doi: 10.1016/j.ijcard.2009.09.543

PubMed Abstract | CrossRef Full Text | Google Scholar

26. R Core Team (2020). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. Available online at: https://www.R-project.org/.

Google Scholar

27. Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the alcohol use disorders identification test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption–II. Addiction. (1993) 88:791–804. doi: 10.1111/j.1360-0443.1993.tb02093.x

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Piccinelli M, Wilkinson G. Gender differences in depression. Critical review. Br J Psychiatry. (2000) 177:486–92. doi: 10.1192/bjp.177.6.486

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Fazel S, Runeson B. Suicide. N Engl J Med. (2020) 382:266–74. doi: 10.1056/NEJMra1902944

CrossRef Full Text | Google Scholar

30. Oquendo MA, Baca-Garcia E. Suicidal behavior disorder as a diagnostic entity in the DSM-5 classification system: advantages outweigh limitations. World Psychiatry. (2014) 13:128–30. doi: 10.1002/wps.20116

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Uijtdehaage SH, Thayer JF. Accentuated antagonism in the control of human heart rate. Clin Auton Res. (2000) 10:107–10. doi: 10.1007/BF02278013

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Thayer JF. On the importance of inhibition: central and peripheral manifestations of nonlinear inhibitory processes in neural systems. Dose Res. (2006) 4:2–21. doi: 10.2203/dose-response.004.01.002.Thayer

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Schmaal L, van Harmelen AL, Chatzi V, Lippard ETC, Toenders YJ, Averill LA, et al. Imaging suicidal thoughts and behaviors: a comprehensive review of 2 decades of neuroimaging studies. Mol Psychiatry. (2020) 25:408–27. doi: 10.1038/s41380-019-0587-x

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Hildebrandt LK, McCall C, Engen HG, Singer T. Cognitive flexibility, heart rate variability, and resilience predict fine-grained regulation of arousal during prolonged threat. Psychophysiology. (2016) 53:880–90. doi: 10.1111/psyp.12632

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Grol M, De Raedt R. The link between resting heart rate variability and affective flexibility. Cogn Affect Behav Neurosci. (2020) 20:746–56. doi: 10.3758/s13415-020-00800-w

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Forkmann T, Meessen J, Teismann T, Sutterlin S, Gauggel S, Mainz V. Resting vagal tone is negatively associated with suicide ideation. J Affect Disord. (2016) 194:30–2. doi: 10.1016/j.jad.2016.01.032

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Glenn CR, Kleiman EM, Cha CB, Deming CA, Franklin JC, Nock MK. Understanding suicide risk within the research domain criteria (RDoC) framework: a meta-analytic review. Depress Anxiety. (2018) 35:65–88. doi: 10.1002/da.22686

PubMed Abstract | CrossRef Full Text | Google Scholar