Jianping Lu
Yuqi Zeng1,2
Nan Lin- 1Department of Neurology, Fujian Medical University Union Hospital, Fuzhou, China
- 2Institute of Clinical Neurology, Fujian Medical University Union Hospital, Fuzhou, China
- 3Department of Geriatrics, Fujian Medical University Union Hospital, Fuzhou, China
Background: Even in patients with a successful return of spontaneous circulation (ROSC), outcomes after cardiac arrest (CA) remain poor, with some eventually succumbing after several months of treatment. There is a need for early assessment of outcomes in patients with ROSC after CA. Therefore, we developed three models for predicting death within 6 months after CA using early post-arrest factors, performed external validation, and compared their efficiency.
Methods: In this retrospective cohort study, 199 patients aged 18–80 years who experienced either in-hospital cardiac arrest or out-of-hospital cardiac arrest and achieved ROSC were included as the training set. Patients were divided into an “alive” group (95 cases) and a “dead” group (104 cases) according to their survival status 6 months after CA. Demographic data, medical history, and laboratory results were collected. Univariate and multivariate logistic regression analyses were used to identify risk factors. A risk prediction model was constructed using random forest methods, support vector machine (SVM), and a nomogram based on factors with P < 0.1 in the multivariate logistic analyses. An additional 42 patients aged 18–80 years who experienced CA with ROSC were included as the validation set. Receiver operating characteristic (ROC), decision, and calibration curves were used to assess model performance.
Results: Duration of cardiac arrest, lactate level after ROSC, secondary infections, length of hospital stay, and ventilator support were the top five risk factors for death within 6 months after CA (P < 0.1) in sequence. The random forest model [average area under the ROC curve (AUC), training set = 0.991, validation set = 0.703] performed better than the SVM model (AUC, training set = 0.905, validation set = 0.636) and the nomogram model (AUC, training set = 0.893, validation set = 0.682). Decision curve analysis indicated that the random forest model provided the best net benefit. The calibration curve indicated that the prediction for death within 6 months after CA by the random forest model was consistent with actual outcomes. The AUC of the prediction model constructed using random forest, SVM, and nomogram methods was 0.991, 0.893, and 0.905, respectively.
Conclusions: The prediction model established by early post-arrest factors performed well, which can aid in evaluating prognosis within 6 months after cardiac arrest. The predictive model constructed using random forest methods exhibited better predictive efficacy.
Introduction
Cardiac arrest (CA) is the sudden cessation of cardiac ejection function and carries low survival rates or unfavorable outcomes (1–3). It is a significant public health problem and the leading cause of death worldwide (4–6). A study reported that the annual incidence of CA in the United States is approximately 150,000 cases, claiming thousands of lives. Each year, approximately 292,000 adults suffer an in-hospital cardiac arrest (IHCA) (7), while 420,000 people suffer an out-of-hospital cardiac arrest (OHCA) (8). In another study including 24,132 patients admitted to critical care units after CA in the United Kingdom, the in-hospital mortality rate was 71% (9). In China, an estimated 54.4 million people experience CA each year, of which only about 1% of people survive (10). Even worse, the global incidence of CA continues to increase each year (11, 12).
A large number of CA patients with return of spontaneous circulation (ROSC) undergo continuous monitoring and relevant treatment in the intensive care unit (ICU) (13–16). Therefore, clinicians rely on medical history and various examination results to make early prognostic assessments and provide adequate counseling to relatives. By far, several prognostic models have been used to predict prognosis for CA patients (17–19). Even in patients with successful ROSC, outcomes after CA remain poor, with some patients ultimately succumbing after several months of treatment (20, 21). Although substantial progress has been made in the prognostication of short-term outcomes after cardiac arrest, early post-arrest factors predicting death within 6 months after CA are still unreported. There is a need for an early assessment of outcomes in patients with ROSC after CA.
Therefore, this study aimed to develop models for predicting death within 6 months after CA using early post-arrest factors, perform external validation, and compare their efficiency.
Methods
Study population
This retrospective cohort study included 264 patients aged 18–80 years who experienced either IHCA or OHCA and achieved ROSC at Fujian Medical University Union Hospital. Patients admitted from January 2018 to June 2022 were used as the training set, while those admitted from July 2022 to December 2023 were used as the validation set. Informed consent was not required because this study involved a retrospective review of medical records. The study was approved by the Ethics Committee of Fujian Medical University Union Hospital (2021-KJT045).
CA was identified using ICD-10 codes corresponding to cardiac arrest or resuscitation, such as I46.0 (cardiac arrest with successful resuscitation), I46.1 (sudden cardiac death), and I46.9 (cardiac arrest, unspecified). Patients with ICD codes for cardiac arrest or resuscitation who had invasive rescue efforts refused by relatives, patients without initially recorded vital signs, and patients who arrived at the emergency department (ED) with unstable initial vital signs indicating peri-arrest status (systolic blood pressure ≤ 40 mmHg; heart rate ≤ 20/min; and respiratory rate ≤ 4/min) were all excluded. In addition, patients younger than 18 years of age or older than 80 years were excluded. In this study, secondary infection refers to an infection that occurred during the first hospitalization after cardiac arrest. The interval from the beginning of cardiac arrest to the return of spontaneous circulation was defined as the duration of cardiac arrest.
Data collection
Blood samples were collected within 24 h after CA, and lactate levels were measured. All clinical data were collected from clinical electronic medical records and extracted into Microsoft Excel for later analysis. Data regarding demographic and clinical characteristics were collected. Follow-up phone interviews were conducted 6 months after CA. The main outcome was death, either in-hospital or out-of-hospital, within 6 months after CA.
Statistical analysis
Identify risk factors
Continuous variables were presented as mean ± standard deviation, and categorical variables were presented as frequency (%). We compared baseline characteristics between the alive and dead groups using the Wilcoxon two-sample test, chi-square test, or Fisher's exact test. Multivariate logistic regression was performed using IBM SPSS Statistics 26 to identify risk factors.
Model development and external validation
Factors with P < 0.1 in multivariate analysis were used to establish the predictive model using the rms package in R4.3.1 software. Receiver operating characteristic (ROC) curves for each factor and the multifactor model were plotted, and the area under the ROC curve (AUC) values were calculated. The calibration curve and the nomogram were plotted using the “rms” package, and the decision curve was generated using the “rmda” package in R4.3.1 software.
Results
Risk factors for death within 6 months after CA
A total of 221 patients who experienced CA and ROSC were admitted to Fujian Medical University Union Hospital between January 2018 and June 2022. We excluded 22 patients for the following reasons: 8 refused invasive rescue by relatives, 9 had missing key data, and 5 were lost to follow-up. Of the remaining 199 patients, 95 were still alive and 104 had died within 6 months after CA. The comparisons of baseline characteristics between alive and dead groups are presented in Table 1. Duration of cardiac arrest, lactate level after ROSC, secondary infections, length of hospital stay, and ventilator support were the top five risk factors of death within 6 months after CA in sequence (P < 0.1) (Table 2 and Figure 1).
Table 1. Baseline characteristics of the alive group and the dead group.
Table 2. Risk factors for death within 6 months after CA.
Figure 1. Importance ranking of all risk factors.
Model development and external validation
The top five factors with P < 0.1 in the multivariate analysis were used to establish predictive models using random forest, support vector machine (SVM), and nomogram methods, with external validation conducted for each. In the training set, the random forest model achieved an AUC of 0.991, an accuracy of 81.0%, a sensitivity of 79.0%, and a specificity of 84.4% (Figure 2a). In the validation set, the random forest model also showed good discrimination, with an AUC of 0.703, an accuracy of 68.5%, a sensitivity of 85.7%, and a specificity of 47.2% (Figure 2b). The decision curve analysis and calibration curve results for the training set (Figures 2c,e) and the validation set (Figures 2d,f) are illustrated in Figure 2.
Figure 2. Performance of the random forest model: (a) receiver operating characteristic curve of the training set; (b) receiver operating characteristic curve of the validation set; (c) decision curve analysis of the training set; (d) decision curve analysis of the validation set; (e) calibration curve of the training set; and (f) calibration curve of the validation set.
The SVM model showed a mean accuracy of 80.2% and a mean AUC of 0.905 in the training set and a mean accuracy of 77.0% and a mean AUC of 0.636 in the validation set (Figure 3). The nomogram model demonstrated an accuracy of 80.7% and an AUC of 0.893 in the training set and an accuracy of 70.7% and an AUC of 0.632 in the validation set (Figure 4). The average AUC of the prediction model constructed using random forest, SVM, and nomogram methods was 0.991, 0.893, and 0.905, respectively (Figure 5).
Figure 3. Performance of the SVM model: (a) receiver operating characteristic curve of the training set; (b) receiver operating characteristic curve of the validation set; (c) decision curve analysis of the training set; (d) decision curve analysis of the validation set; (e) calibration curve of the training set; and (f) calibration curve of the validation set.
Figure 4. Performance of the nomogram model: (a) receiver operating characteristic curve of the training set; (b) receiver operating characteristic curve of the validation set; (c) decision curve analysis of the training set; (d) decision curve analysis of the validation set; (e) calibration curve of the training set; and (f) calibration curve of the validation set.
Figure 5. Comparison of AUC–ROC curves across all models.
Discussion
In this study, we demonstrated that the top five risk factors for death within 6 months after CA, in sequence, were duration of cardiac arrest, lactate level after ROSC, secondary infections, length of hospital stay, and ventilator support. The predictive models constructed using random forest, SVM, and nomogram methods based on these above factors performed well in the training set. Among the three models, the random forest model exhibited the best prediction performance in the external validation set.
CA is a major cause of death and a highly disabling condition worldwide (22–24). Even in patients who obtain ROSC, the prognosis remains very poor. The prognosis of CA patients is mainly determined by the extent of neurological injury induced by circulatory arrest. Various factors and biomarkers have been studied as early prognostic markers for CA patients who achieve ROSC (25–27). The duration of CA is crucial for patient outcomes. In some CA models, neuronal injury highly depends on the duration of CA, with longer durations consistently associated with a large increase in mortality (28, 29). Among the laboratory parameters obtainable in the early hours after ROSC, lactate levels have been used to predict outcomes after CA. Particularly, lactate level on admission has the diagnostic ability to predict neurological outcomes after CA (30). In this study, lactate levels were measured in the first 24 h after ROSC. Poor outcomes were observed in CA patients who required ventilator support. The results of risk factors for the prognosis of CA in this study are largely consistent with findings from previous reports.
Various studies have proposed different approaches to predict neurological and other clinical outcomes for CA patients (31–33). For example, scoring models have been to predict the neurological outcomes for CA patients (34–36). Differences exist among different studies: (1) data sets vary, with some being larger but more heterogeneous, leading to variations in model performance due to differences in characteristics, care practices, and clinical care; (2) model training and validation strategies differ across studies, with some studies even having not performed validation; (3) model evaluation practices differ across studies; (4) most studies have constructed only one model. In this study, more than 200 patients were enrolled to develop different predictive models, and prospective validation was conducted. In addition, we used model calibration and decision analysis, in addition to AUC, for evaluation. Calibration measures a model's ability to provide clinically relevant probabilistic estimates of risk, which can be done at the individual patient level and across all predicted probabilities. Decision analysis is an objective, explicit method that uses models to represent specific decision problems. Like most studies, predictive models tend to perform more poorly on the external validation set than on the training and test sets.
Overall, the contributions of the present work include technical innovations such as complete use of the data, effective utilization of temporal information, and increased automation; increased rigor in investigating model generalizability; and enhanced rigor and scale of model validation. One limitation of these prediction models is that they could only predict survival or death. It would be more meaningful to assess neurological outcomes beyond the Glasgow coma scale (GCS) at discharge, especially after 6 months. Since this was a retrospective study, outcome follow-ups were conducted by telephone, and further assessment could not be performed.
Conclusions
In conclusion, this study developed and validated a prediction model using early post-arrest factors, which can provide suggestions for evaluating prognosis within 6 months after cardiac arrest. The predictive model constructed using the random forest method demonstrated better predictive efficacy. Nevertheless, our conclusions still need to be further verified by well-designed, prospective cohort studies, and additional data are needed to validate these models.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material; further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by the Fujian Medical University Union Hospital Ethics Committee. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
JL: Conceptualization, Data curation, Formal Analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. YZ: Data curation, Methodology, Supervision, Writing – review & editing. NL: Data curation, Methodology, Supervision, Writing – review & editing. QY: Data curation, Formal Analysis, Investigation, Methodology, Supervision, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by a guiding key project of social development by the Science and Technology Department, Fujian Province (2021Y0018) and the Clinical Research Center for Precision Diagnosis and Treatment of Neurological Diseases of Fujian Province (2022Y2005).
Acknowledgments
The authors thank the staff of the Department of Computer Technology for their hard work on data management.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Andersen LW, Holmberg MJ, Berg KM, Donnino MW, Granfeldt A. In-hospital cardiac arrest: a review. JAMA. (2019) 321(12):1200–10. doi: 10.1001/jama.2019.1696
2. Hancock LA, Nichol G. What explains unexplained cardiac arrest? Circulation. (2020) 141(22):1775–7. doi: 10.1161/CIRCULATIONAHA.120.046552
3. Perman SM, Elmer J, Maciel CB, Uzendu A, May T, Mumma BE, et al. 2023 American Heart Association focused update on adult advanced cardiovascular life support: an update to the American Heart Association guidelines for cardiopulmonary resuscitation and emergency cardiovascular care. Circulation. (2024) 149(5):e254–73. doi: 10.1161/CIR.0000000000001194
4. Cronberg T, Greer DM, Lilja G, Moulaert V, Swindell P, Rossetti AO. Brain injury after cardiac arrest: from prognostication of comatose patients to rehabilitation. Lancet Neurol. (2020) 19(7):611–22. doi: 10.1016/S1474-4422(20)30117-4
5. Leoni D, Rello J. Cardiac arrest among patients with infections: causes, clinical practice and research implications. Clin Microbiol Infect. (2017) 23(10):730–5. doi: 10.1016/j.cmi.2016.11.018
6. Descatha A, Savary D. Cardiac arrest: treatment is prevention? Resuscitation. (2024) 198:110212. doi: 10.1016/j.resuscitation.2024.110212
7. Harrod M, Kamphuis LA, Hauschildt K, Seigworth C, Korpela PR, Rouse M, et al. Getting better or getting by? A qualitative study of in-hospital cardiac arrest survivors long-term recovery experiences. SSM Qual Res Health. (2021) 1:100002. doi: 10.1016/j.ssmqr.2021.100002
8. Mcdonnell S, Whittington A, Perkins G. Survey of current strategies for case ascertainment for out of hospital cardiac arrest (OHCA) in UK ambulance services. Resuscitation. (2015) 96:103–103. doi: 10.1016/j.resuscitation.2015.09.244
9. Hirsch KG, Abella BS, Amorim E, Bader MK, Barletta JF, Berg K, et al. Critical care management of patients after cardiac arrest: a scientific statement from the American Heart Association and neurocritical care society. Circulation. (2024) 149(2):e168–200. doi: 10.1161/CIR.0000000000001163
10. Zhou X, Liu Y, Huang Y, Zhu S, Zhu J, Wang R. Hypertonic saline infusion suppresses apoptosis of hippocampal cells in a rat model of cardiopulmonary resuscitation. Sci Rep. (2017) 7(1):5783. doi: 10.1038/s41598-017-05919-4
11. Chopard R, Behr J, Vidoni C, Ecarnot F, Meneveau N. An update on the management of acute high-risk pulmonary embolism. J Clin Med. (2022) 11(16):4807. doi: 10.3390/jcm11164807
12. Morrison LJ, Neumar RW, Zimmerman JL, Link MS, Newby LK, McMullan PW Jr, et al. Strategies for improving survival after in-hospital cardiac arrest in the United States: 2013 consensus recommendations: a consensus statement from the American Heart Association. Circulation. (2013) 127(14):1538–63. doi: 10.1161/CIR.0b013e31828b2770
13. Kosidło JW, Wolszczak-Biedrzycka B, Matowicka-Karna J, Dymicka-Piekarska V, Dorf J. Clinical significance and diagnostic utility of NLR, LMR, PLR and SII in the course of COVID-19: a literature review. J Inflamm Res. (2023) 16:539–62. doi: 10.2147/JIR.S395331
14. Saeid Y, Ebadi A, Salaree MM, Moradian ST. Development and psychometric evaluation of the family intensive care units syndrome inventory. Brain Behav. (2023) 13(7):e3101. doi: 10.1002/brb3.3101
15. Wang N, Lu W, Xu Y, Mao S, He M, Lin X, et al. Recurrence of diet-treated gestational diabetes in primiparous women in northern Zhejiang, China: epidemiology, risk factors and implications. J Obstet Gynaecol Res. (2018) 44(8):1391–6. doi: 10.1111/jog.13688
16. Weikert T, Rapaka S, Grbic S, Re T, Chaganti S, Winkel DJ, et al. Prediction of patient management in COVID-19 using deep learning-based fully automated extraction of cardiothoracic CT metrics and laboratory findings. Korean J Radiol. (2021) 22(6):994–1004. doi: 10.3348/kjr.2020.0994
17. Paul R, Murugesh C, Chepulis L, Tamatea J, Wolmarans L. Should antenatal corticosteroids be considered in women with gestational diabetes before planned late gestation caesarean section. Aust N Z J Obstet Gynaecol. (2019) 59(3):463–6. doi: 10.1111/ajo.12963
18. Moseby-Knappe M, Mattsson-Carlgren N, Stammet P, Backman S, Blennow K, Dankiewicz J, et al. Serum markers of brain injury can predict good neurological outcome after out-of-hospital cardiac arrest. Intensive Care Med. (2021) 47(9):984–94. doi: 10.1007/s00134-021-06481-4
19. Albinali H, Alumran A, Alrayes S. Impact of cardiopulmonary resuscitation duration on the neurological outcomes of out-of-hospital cardiac arrest. Int J Emerg Med. (2022) 15(1):12. doi: 10.1186/s12245-022-00418-4
20. Layeghian Javan S, Sepehri MM, Layeghian Javan M, Khatibi T. An intelligent warning model for early prediction of cardiac arrest in sepsis patients. Comput Methods Programs Biomed. (2019) 178:47–58. doi: 10.1016/j.cmpb.2019.06.010
21. Amacher SA, Blatter R, Briel M, Appenzeller-Herzog C, Bohren C, Becker C, et al. Predicting neurological outcome in adult patients with cardiac arrest: systematic review and meta-analysis of prediction model performance. Crit Care. (2022) 26(1):382. doi: 10.1186/s13054-022-04263-y
22. Lott C, Truhlář A, Alfonzo A, Barelli A, González-Salvado V, Hinkelbein J, et al. Corrigendum to “European Resuscitation Council Guidelines 2021: cardiac arrest in special circumstances” [Resuscitation 161 (2021) 152–219]. Resuscitation. (2021) 167:91–2. doi: 10.1016/j.resuscitation.2021.08.012
23. Zheng K, Du L, Cao Y, Niu Z, Song Z, Liu Z, et al. Monitoring cardiopulmonary resuscitation quality in emergency departments: a national survey in China on current knowledge, attitudes, and practices. BMC Emerg Med. (2022) 22(1):33. doi: 10.1186/s12873-022-00590-z
24. Jerkeman M, Sultanian P, Lundgren P, Nielsen N, Helleryd E, Dworeck C, et al. Trends in survival after cardiac arrest: a Swedish nationwide study over 30 years. Eur Heart J. (2022) 43(46):4817–29. doi: 10.1093/eurheartj/ehac414
25. Lin L, Gao R, Chen L, Wu Z, Wei X, Xie Y. Relationship between serum lactate dehydrogenase and mortality after cardiac arrest: a retrospective cohort study. Medicine (Baltimore). (2022) 101(45):e31499. doi: 10.1097/MD.0000000000031499
26. Sugiyama K, Miyazaki K, Ishida T, Tanabe T, Hamabe Y. Categorization of post-cardiac arrest patients according to the pattern of amplitude-integrated electroencephalography after return of spontaneous circulation. Crit Care. (2018) 22(1):226. doi: 10.1186/s13054-018-2138-2
27. Rhee CK, Lim SY, Koh SO, Choi WI, Lee YJ, Chon GR, et al. Usefulness of N-terminal pro-B-type natriuretic peptide in patients admitted to the intensive care unit: a multicenter prospective observational study. BMC Anesthesiol. (2014) 14:16. doi: 10.1186/1471-2253-14-16
28. Schmutz JB, Meier LL, Manser T. How effective is teamwork really? The relationship between teamwork and performance in healthcare teams: a systematic review and meta-analysis. BMJ Open. (2019) 9(9):e028280. doi: 10.1136/bmjopen-2018-028280
29. Venkata GK, Forder JR, Clark D, Shih A, Udassi S, Badugu S, et al. Ventricular fibrillation-induced cardiac arrest results in regional cardiac injury preferentially in left anterior descending coronary artery territory in piglet model. Biomed Res Int. (2016) 2016:5958196. doi: 10.1155/2016/5958196
30. Maupain C, Bougouin W, Lamhaut L, Deye N, Diehl JL, Geri G, et al. The CAHP (Cardiac Arrest Hospital Prognosis) score: a tool for risk stratification after out-of-hospital cardiac arrest. Eur Heart J. (2016) 37(42):3222–8. doi: 10.1093/eurheartj/ehv556
31. Mauracher LM, Buchtele N, Schörgenhofer C, Weiser C, Herkner H, Merrelaar A, et al. Increased citrullinated histone H3 levels in the early post-resuscitative period are associated with poor neurologic function in cardiac arrest survivors—a prospective observational study. J Clin Med. (2019) 8(10):1568. doi: 10.3390/jcm8101568
32. Endisch C, Westhall E, Kenda M, Streitberger KJ, Kirkegaard H, Stenzel W, et al. Hypoxic-ischemic encephalopathy evaluated by brain autopsy and neuroprognostication after cardiac arrest. JAMA Neurol. (2020) 77(11):1430–9. doi: 10.1001/jamaneurol.2020.2340
33. Livesey JA, Lone N, Black E, Broome R, Syme A, Keating S, et al. Neurological outcome following out of hospital cardiac arrest: evaluation of performance of existing risk prediction models in a UK cohort. J Intensive Care Soc. (2023) 25(2):131–9. doi: 10.1177/17511437231214146
34. Veron AD, Bienboire-Frosini C, Girard SD, Sadelli K, Stamegna JC, Khrestchatisky M, et al. Syngeneic transplantation of olfactory ectomesenchymal stem cells restores learning and memory abilities in a rat model of global cerebral ischemia. Stem Cells Int. (2018) 2018:2683969. doi: 10.1155/2018/2683969
35. Düring J, Annborn M, Cariou A, Chew MS, Dankiewicz J, Friberg H, et al. Influence of temperature management at 33°C versus normothermia on survival in patients with vasopressor support after out-of-hospital cardiac arrest: a post hoc analysis of the TTM-2 trial. Crit Care. (2022) 26(1):231. doi: 10.1186/s13054-022-04107-9
Keywords: cardiac arrest, prognosis, prediction model, machine learning, return of spontaneous circulation
Citation: Lu J, Zeng Y, Lin N and Ye Q (2024) Development and validation of prediction models for death within 6 months after cardiac arrest. Front. Cardiovasc. Med. 11:1469801. doi: 10.3389/fcvm.2024.1469801
Received: 8 August 2024; Accepted: 11 November 2024;
Published: 28 November 2024.
Edited by:
Sebastian Schnaubelt, Medical University of Vienna, AustriaCopyright: © 2024 Lu, Zeng, Lin and Ye. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Qinyong Ye, dW5pb25xeXllOEBmam11LmVkdS5jbg==