Skip to main content

ORIGINAL RESEARCH article

Front. Aging Neurosci., 28 May 2021
Sec. Neuroinflammation and Neuropathy

Prediction of Hemorrhagic Transformation After Ischemic Stroke: Development and Validation Study of a Novel Multi-biomarker Model

\r\nJunfeng Liu&#x;Junfeng Liu1†Yanan Wang&#x;Yanan Wang1†Yuxi JinYuxi Jin2Wen GuoWen Guo1Quhong SongQuhong Song1Chenchen Wei,Chenchen Wei1,3Jing LiJing Li4Shanshan ZhangShanshan Zhang5Ming Liu*Ming Liu1*
  • 1Department of Neurology, Center of Cerebrovascular Diseases, West China Hospital, Sichuan University, Chengdu, China
  • 2West China School of Medicine, Sichuan University, Chengdu, China
  • 3Department of Neurology, The Affiliated Hospital of Qingdao University, Qingdao, China
  • 4Department of Neurology, The First People’s Hospital of Ziyang, Ziyang, China
  • 5Department of Neurology, Mianyang Central Hospital, Mianyang, China

Objectives: We aimed to develop and validate a novel multi-biomarker model for predicting hemorrhagic transformation (HT) risk after acute ischemic stroke (AIS).

Methods: We prospectively included patients with AIS admitted within 24 h of stroke from January 1st 2016 to January 31st 2019. A panel of 17 circulating biomarkers was measured and analyzed in this cohort. We assessed the ability of individual circulating biomarkers and the combination of multiple biomarkers to predict any HT, symptomatic HT (sHT) and parenchymal hematoma (PH) after AIS. The strategy of multiple biomarkers in combination was then externally validated in an independent cohort of 288 Chinese patients.

Results: A total of 1207 patients with AIS (727 males; mean age, 67.2 ± 13.9 years) were included as a derivation cohort, of whom 179 patients (14.8%) developed HT. The final multi-biomarker model included three biomarkers [platelets, neutrophil-to-lymphocyte ratios (NLR), and high-density lipoprotein (HDL)] from different pathways, showing a good performance for predicting HT in both the derivation cohort (c statistic = 0·64, 95% CI 0·60–0·69), and validation cohort (c statistic = 0·70, 95% CI 0·58–0·82). Adding these three biomarkers simultaneously to the basic model with conventional risk factors improved the ability of HT reclassification [net reclassification improvement (NRI) 65.6%, P < 0.001], PH (NRI 64.7%, P < 0.001), and sHT (NRI 71.3%, P < 0.001).

Conclusion: This easily applied multi-biomarker model had a good performance for predicting HT in both the derivation and external validation cohorts. Incorporation of biomarkers into clinical decision making may help to identify patients at high risk of HT after AIS and warrants further consideration.

Introduction

Hemorrhagic transformation (HT) is not only a part of the natural history of ischemic stroke, but also a major complication of reperfusion therapy, and is associated with increased morbidity and mortality (Álvarez-Sabín et al., 2013). A recent meta-analysis (Sadeh-Gonik et al., 2018) reported a HT and symptomatic HT (sHT) rates of 24% and 8%, respectively, when patients treated with thrombectomy. In a survey of emergency physicians about thrombolysis, Brown et al. (2005) reported about two thirds of physicians may overestimate the risk of HT, and so they inappropriately avoid thrombolysis. In high-income countries, only 20% of ischemic stroke patients received thrombolysis (Langhorne et al., 2018), and less than 3% of patients in China (Wu et al., 2019). In addition, our previous review (Wu et al., 2019) suggested that a concern over HT risk also hampers the widespread adoption of anticoagulation for secondary prevention in patients with atrial fibrillation (AF) in Asia, especially in China. Therefore, early and quickly identification of patients at high risk of HT to help individualized treatment decisions in patients with ischemic stroke is a top priority of research on stroke.

At present, evaluating the risk of HT after ischemic stroke mainly depends on clinical factors and neuroimaging (Álvarez-Sabín et al., 2013). By combining those clinical and neuroimaging markers, several risk models (Cucchiara et al., 2008; Lou et al., 2008; Menon et al., 2012; Strbian et al., 2012; Saposnik et al., 2013) have been developed to stratify the risk of HT after thrombolysis. However, existing models have only a modest capability in predicting those at “high risk” for HT after stroke (Sung et al., 2013), irrespective of the use of thrombolysis. In addition, some neuroimaging markers used in these models may not be routinely available in all ischemic stroke patients due to contraindications and lack of availability. Hence, there has been increasing interest to find new approaches which can achieve better accuracy and be easier to use in predicting HT. Circulating biomarkers may be a promising approach.

A growing number of studies reported that individual novel biomarkers, such as matrix metalloproteinase 9, S100B, and tight-junction proteins, were associated with HT after ischemic stroke (Montaner et al., 2003; Foerch et al., 2007; Kelly et al., 2008; Kazmierski et al., 2012; Yuan et al., 2018). However, there are multiple practical challenges before these novel biomarkers can be used in the clinical practice, including the need for high sensitivity and specificity, and fast and easy-to-assess availability of the results. Furthermore, few studies investigated the relationship between multiple biomarkers and HT systematically, and the clinical significance of multiple biomarkers when used in combination for predicting HT is also unknown. Therefore, we aimed to develop and externally validate a novel multi-biomarker model for predicting HT after ischemic stroke that can be calculated from readily available routine clinical circulation biomarkers.

Materials and Methods

Participants

A prospective cohort of 1,362 patients with ischemic stroke (≥18 years old) admitted to West China hospital, Sichuan University within 24 h after stroke onset between January 1st 2016 and January 31st 2019, were recruited as a derivation cohort. Patients with hemorrhage on the initial admission imaging (n = 33), those who did not have a follow-up computed tomography (CT) or magnetic resonance imaging (MRI) scan within 7 days after admission (n = 118) and those without data of all 17 circulating biomarkers (n = 4) were excluded, leaving 1,207 patients for the final analysis.

We also screened 350 patients with ischemic stroke admitted to Mianyang Central Hospital and The First People’s Hospital of Ziyang within 24 h after stroke onset between June 1st 2017 and March 31st 2019 as an external validation cohort. The cohort excluded patients with hemorrhage on the initial admission imaging (n = 2), those who did not have a follow-up CT or MRI scan during hospitalization (n = 53) and those without data of all 17 circulating biomarkers (n = 7). Two-hundred and eighty-eight patients were included for the final analysis of external validation.

The definition of ischemic stroke was based on the World Health Organization criteria (Aho et al., 1980), and further confirmed by a CT or MRI scan (Sacco et al., 2013). The study was approved by the Biomedical Research Ethics Committee of West China Hospital, Sichuan University [2016(339)]. Informed consent was obtained from all patients or their relatives.

Data Collection

Baseline data on demographic characteristics (age and sex), vascular risk factors (hypertension, diabetes mellitus, atrial fibrillation, hyperlipidemia, smoking and drinking), NIHSS score on admission, therapy before and after admission, and the Trial of ORG 10172 in Acute Stroke Treatment (TOAST) classification were collected using a standard questionnaire. Systolic blood pressure (SBP) and diastolic blood pressure (DBP) were measured and obtained at admission.

Circulating Biomarker Measurements

The circulating biomarkers were selected based on the results of our (Wang et al., 2020a, b) and previous review (Lu et al., 2018). Accordingly, 17 biomarkers representing inflammation [white blood cells, WBC, monocyte, neutrophils, lymphocytes, and neutrophil-to-lymphocyte ratios (NLR)], coagulation/fibrinolysis disorder (platelets), vasoreactivity (creatinine, and cystatin C), lipid metabolism [total cholesterol (TC), triglyceride (TG), high-density lipoprotein (HDL), low-density lipoprotein (LDL)], liver function [alkaline phosphatase (ALP), alanine aminotransferase (ALT), aspartate aminotransferase (AST) and total bilirubin (TBIL)] and glucose were measured and analyzed in patients with acute ischemic stroke (AIS).

The median time from stroke onset to biomarker blood draw was 4.0 h (2.4, 6.8 h interquartile range). All circulating biomarkers were measured in the department of laboratory medicine by experienced technicians who were blinded to the clinical characteristics of the patients. The NLR was calculated as the ratio of neutrophil absolute value to lymphocyte absolute value, both obtained from the same blood sample.

Definition of Hemorrhagic Transformation

Any hemorrhage found on the follow-up CT or MRI within 7 days after admission but not detected on initial head CT was defined as HT. sHT was diagnosed according to the definition of the National Institute of Neurological Disease and Stroke study (National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group, 1995). Two trained neurologists who were blinded to patients’ clinical data assessed HT and sHT independently, and a third neurologist was consulted in case of disagreement. The inter-rater reliability (Kappa) for assessing the presence of HT and sHT was 0.92 and 0.87, separately. HT was also classified as Hemorrhagic Infarction (HI) and Parenchymal Hematoma (PH) according to the European Cooperative Acute Stroke Study III definitions (de Los Ríos la Rosa et al., 2012).

Outcomes

The primary outcome of this analysis is the composite of sHT and asymptomatic HT detected during hospitalization (i.e., any HT). We chose a composite outcome because, although sHT was the most feared complication of reperfusion therapy in AIS (Yaghi et al., 2017), asymptomatic HT was found to worsen long-term clinical outcomes (Lei et al., 2014), and also the main concern of initiating anticoagulants at discharge for secondary prevention in ischemic stroke patients with atrial fibrillation in China (Liu et al., 2021). Moreover, an increased number of primary outcomes was desirable to support the statistical power of the analysis. The secondary outcomes of the study were the presence of PH and sHT.

Model Development and External Validation

In the derivation cohort, univariate logistical analysis was carried out to investigate the relationships between biomarkers and HT. Variables that showed a univariate relationship with HT (P < 0.05) were further analyzed in multivariate logistic regression analysis. Each biomarker was assessed separately using logistic analysis.

Multiple biomarkers were evaluated using both a categorical and continuous exposure measure. Only biomarkers significantly associated with HT in the initial stage were included in the following analysis. First, receiver operating characteristics (ROC) curve analysis was used to identify the optimal cut-off point of each biomarker, and the effect of multiple biomarkers in combination on HT was evaluated using a multivariable analysis. Second, we created a continuous multi-marker score based on an equation reported by a previous study (Zhong et al., 2019): H = (β1 × biomarker A) + (β2 × biomarker B) + (β3 × biomarker C), and so on. β1, β2, and β3 represented the estimates of beta coefficients for biomarkers A, B, and C, and were obtained by the logistic regression model for the study outcome. Patients were divided based on the tertiles of the multi-biomarker score. Odds radio (ORs) and 95% confidence intervals (CIs) for each group were calculated and reported using the lowest tertile as reference. Tests for linear trends in ORs were conducted using the number of biomarkers that achieved the cut-off points or the median within each tertile as the predictor. We further used a logistic regression model with restricted cubic splines to evaluate the pattern and magnitude of the association between multi-biomarker score and the risk of HT with three knots (at the 10th, 50th, and 90th percentiles). The discriminatory ability of one or multiple biomarkers in combination for predicting HT were also evaluated in the external validation cohort.

The Predictive Value of Adding Circulating Biomarkers to the Conventional Model

A conventional model was built based on the multivariate logistic regression analysis for the association of traditional risk factors (such as age and NIHSS score) with HT. The ability to reclassify HT risks by adding each biomarker and the combination of multiple biomarkers/the multi-biomarker score to the conventional model was also evaluated. We calculated the C statistics, net reclassification improvement (NRI) and integrated discrimination improvement (IDI) to assess the risk refinement (enhanced risk differentiation) provided by one or more new markers (Pencina et al., 2008). The C statistics of each model were compared by Delong method (DeLong et al., 1988). Likelihood ratio tests were then performed to evaluate whether the global model fit improved after the addition of biomarkers.

Statistical Analysis

Continuous data were reported as mean ± standard deviation or median with interquartile range, while categorical data were reported as frequencies and percentages. Differences in categorical data were assessed using χ2 test, while differences in continuous data were assessed using student’s t-test or the Mann–Whitney U test, as appropriate. A 2-sided P < 0.05 was considered statistically significant. Statistical analysis was performed using SPSS 25.0 (IBM, Chicago, IL, USA) and STATA 15.0 (Corporation, College Station, TX, USA).

Data Availability

The data that support the results of this study are available from the corresponding author upon reasonable request.

Results

One-thousand, two-hundred and seven patients with AIS (60.2% males; mean age, 67.2 ± 13.9 years) were included as a derivation cohort, and 288 patients (62.9% males; mean age, 69.0 ± 12.0 years) as an external validation cohort (Figure 1). The demographic and clinical characteristics are summarized in Supplementary Table 1. During hospitalization, 179 (14.8%) patients were found to have HT, of whom 76 (6.3%) with HI, 103 (8.5%) with PH, and 44 (3.7%) with sHT were in the derivation cohort. The median time of stroke onset to develop HT was 3 days (1–4 days), and 95 patients (53.1%) were diagnosed with HT on CT scans. In the external cohort, 22 patients (7.6%) had HT. Nighteen (6.6%) with HI, 3 (1.0%) with PH, and 6 (2.1%) with sHT were detected. The median time of stroke onset to develop HT was 2 days (1–4 days), and nine patients (40.9%) were found to have HT on CT scans.

FIGURE 1
www.frontiersin.org

Figure 1. Flowchart of patients inclusion. HT, hemorrhagic transformation; CT, computed tomography; MRI, magnetic resonance imaging.

Single Biomarker and Association With Hemorrhagic Transformation

Univariable analysis in the derivation cohort (Table 1) found a significant association of HT with several conventional predictors that were consistently reported previously: age, sex, atrial fibrillation, National Institutes of Health Stroke Scale score, smoking, drinking, SBP, antiplatelets, lipid-lowering agents, thrombolysis/thrombectomy treatment and Toast classification. Nine biomarkers were also identified to associate with HT significantly in the univariable analysis. After adjusting for confounders, the levels of platelets, neutrophils, lymphocytes, NLR, and HDL were significantly and independently related to risk of HT (all P < 0.05, Table 2).

TABLE 1
www.frontiersin.org

Table 1. Univariable analysis in the derivation cohort.

TABLE 2
www.frontiersin.org

Table 2. Biomarkers and risk of hemorrhagic transformation after acute ischemic stroke.

Multi-biomarkers and Association With Hemorrhagic Transformation

ROC curve analysis was used to identify the optimal cut-off points of platelets, neutrophils, lymphocytes, NLR, and HDL for predicting HT (Supplementary Table 2). To avoid collinearity in the multiple biomarkers model, only one biomarker from the same pathway underlying HT was chose based on the ROC curve for the following analysis. Accordingly, platelets, NLR, and HDL were included in the following multi-biomarker analysis. The prevalence of HT according to the number of biomarkers achieving the thresholds or tertiles of the multi-biomarker score are shown in Figure 2.

FIGURE 2
www.frontiersin.org

Figure 2. Multivariable-adjusted odds radios (ORs; 95% CIs) of HT according to the number of elevated biomarkers or tertiles of biomarkers scores among acute ischemic stroke (AIS) patients. Odds ratios for HT were adjusted for age, sex, atrial fibrillation, NIHSS, smoking, drinking, Systolic blood pressure (SBP), antiplatelets, lipid-lowering agents, Thrombolysis/Thrombectomy treatment and TOAST classification. Odds ratios for PH were adjusted for age, sex, atrial fibrillation, NIHSS, smoking, drinking, SBP, antiplatelets, lipid-lowering agents, Thrombolysis/Thrombectomy treatment and TOAST classification. Odds ratios for sICH were adjusted for atrial fibrillation, NIHSS and Thrombolysis/Thrombectomy treatment. HT, hemorrhagic transformation; PH, Parenchymal hematoma; sICH, Symptomatic intracerebral hemorrhage; NIHSS, National Institutes of Health Stroke Scale score; TOAST, the Trial of ORG 10172 in Acute Stroke Treatment.

In our derivation cohort, 150 (12.4%) patients had all three biomarkers achieving the thresholds, and had the highest risk of HT. The patients with greater number of biomarkers achieving the thresholds had a higher risk of HT (P for trend <0.001, Figure 2). After adjustment for the confounders, compared to the patients without any biomarker achieving the thresholds, the ORs (95% CIs) of those with three biomarkers were 6.65 (3.06–14.48) for HT. Additionally, we assessed the effect of multiple biomarkers by constructing a continuous multi-biomarker score based on the estimates of beta coefficients of these three biomarkers obtained from logistic regression model (Figure 2). Patients with a higher score had an increased risk of HT (P for trend <0.001), and the adjusted OR (95% CI) for the highest tertile of the multi-biomarker score was 2.76 (1.75–4.35) for HT compared to patients with lowest tertile score. Similarly, the multi-biomarker score was also significantly associated with an increased risk of HT (adjusted OR, 2.32; 95% CI, 1.68–3.20, P < 0.001), independently of established covariates. Using a logistic regression model with restricted cubic splines, we found that a higher multi-biomarker score was associated with an increased risk of HT (Figure 3A).

FIGURE 3
www.frontiersin.org

Figure 3. Multiple spline regression analyses were used to analyze the association between biomarkers score and HT (A), PH (B), sHT (C) with three knots (at the 10th, 50th, 90th percentiles). Solid line indicates adjusted odds ratios, and dotted line indicates 95% confidence intervals (CIs). Odds ratios for HT were adjusted for age, sex, atrial fibrillation, NIHSS, smoking, drinking, SBP, antiplatelets, lipid-lowering agents, Thrombolysis/Thrombectomy treatment and TOAST classification. Odds ratios for PH were adjusted for age, sex, atrial fibrillation, NIHSS, smoking, drinking, SBP, antiplatelets, lipid-lowering agents, Thrombolysis/Thrombectomy treatment and TOAST classification. Odds ratios for sHT were adjusted for atrial fibrillation, NIHSS and Thrombolysis/Thrombectomy treatment. HT, hemorrhagic transformation; PH, parenchymal hematoma; sHT, symptomatic hemorrhagic transformation; NIHSS, National Institutes of Health Stroke Scale score; TOAST, the Trial of ORG 10172 in Acute Stroke Treatment.

Incorporating the three biomarkers (platelets, NLR, and HDL) simultaneously provided good discriminative capacity to predict HT (c statistic = 0.64; Table 4; likelihood ratio test P < 0.001) in the derivation cohort. Similarly, we also determined good discrimination of the three biomarkers in combination in the external validation cohort (c statistic = 0·70, 95% CI 0·58–0·82; Table 3). In both the derivation and validation cohorts, the three biomarkers in combination performed better in predicting HT than a single biomarker.

TABLE 3
www.frontiersin.org

Table 3. Area under the receiver-operating characteristic curve (AUC) of biomarkers for predicting hemorrhagic transformation in derivation and validation cohorts.

TABLE 4
www.frontiersin.org

Table 4. Reclassification of hemorrhagic transformation by circulating biomarkers among ischemic stroke patients.

Multi-biomarkers and Association With Parenchymal Hematoma (PH) and Symptomatic Hemorrhagic Transformation (sHT)

We also assessed the effect of the multi-biomarker model for predicting the risks of PH and sHT, respectively in our derivation cohort. Patients with all three biomarkers achieving the thresholds had the highest risks of PH and sHT (all P for trend ≤0.001, Figure 2). Patients with a higher multi-biomarker score had an increased risk of PH (P for trend <0.001), and the adjusted OR (95% CI) for the highest tertile of multi-biomarker score was 2.68 (1.49–4.84) for PH compared to patients with lowest tertile of score (Figure 2). Similarly, an increased trend in the risk of sHT from the lowest tertile of score to the highest tertile of score was also found (P for trend = 0.001, Figure 2). In multivariate analysis, the multi-biomarker score was still significantly associated with sHT (adjusted OR, 2.28; 95% CI, 1.50–3.44; P = 0.008) and PH (adjusted OR, 2.39; 95% CI, 1.49–3.83; P < 0.001). Using a logistic regression model with restricted cubic splines, we found that a higher multi-biomarker score was associated with an increased risk of PH (Figure 3B) and sHT (Figure 3C).

The Additional Predictive Value of Biomarkers Over the Conventional Model

A conventional model included age, sex, atrial fibrillation, National Institutes of Health Stroke Scale score, smoking, drinking, SBP, antiplatelets, lipid-lowering agents, thrombolysis/thrombectomy treatment and Toast classification was developed according to the multivariate logistic regression analysis for the association with HT in the derivation cohort. The predictive performance of the conventional model was significantly improved by adding three biomarkers simultaneously or the multi-biomarker score (both c statistic = 0.8, P = 0.01, Table 4). Simultaneously adding these three biomarkers offered the greatest positive reclassification for HT over the conventional model (category-free NRI 65.6%, P < 0.001, Table 4). Addition of the multi-biomarker score also confirmed an increased sensitivity (IDI, 3.2%; P = 0.001) and positive reclassification (NRI, 56.2%; P < 0.001; Table 4). Good performance of predicting PH and sHT was also found when three biomarkers or the multi-biomarker score were simultaneously added to the conventional model (Supplementary Table 3).

Discussion

In the study, 17 circulating biomarkers representing different pathologic pathways after stroke were analyzed, and their predictive values for HT were evaluated. Individually, we found platelets, NLR, and HDL were related to the risk of HT, independently of established covariates. When we combined these three biomarkers together, there was a clear ascending trend in risk of HT, PH and sHT with increasing numbers of biomarkers. Addition of these three biomarkers simultaneously/the multi-biomarker score to the conventional risk model enhanced the risk refinement and reclassification for HT, PH and sHT. In addition, the multi-biomarker model was successfully externally validated and showed good discrimination for HT.

Prior studies (Bruno et al., 2002; Lee et al., 2010) demonstrated that individual biomarkers are associated with a gradient of risk for HT after adjusting for conventional risk factors. Our study confirmed prior results and investigated the relationship between various biomarkers and HT after AIS systematically. In this study, platelets, NLR, and HDL were identified to associate with HT independently. Despite that, the individual predictive value for predicting HT of the three identified biomarkers was modest. Given the multiple and interconnected pathological processes underlying HT (Álvarez-Sabín et al., 2013), one biomarker may not be able to capture sufficient information to assess the risk of HT. Recent studies (Melander et al., 2009; Jackson et al., 2016; Hijazi et al., 2017; Zhong et al., 2019) demonstrated the incremental usefulness of multiple biomarkers as a predictor for outcomes in patients with several cardiovascular conditions, and the risk of cardiovascular events. However, there are limited data on the predictive value of multiple biomarkers for the risk of HT after ischemic stroke.

A prospective cohort study (Marsh et al., 2016) investigated the addition of serum glucose, WBC count and warfarin use on admission to the HeRs score (age, infarct volume, eGFR) improved the predictive value for HT in 241 patients with AIS and with an indication for anticoagulation. We extended this finding and identified the addition of the three biomarkers (platelets, NLR, and HDL) that enhanced the risk prediction for HT compared to conventional risk model in a real-world practice. In addition, these three biomarkers we chose in our study represented different pathologic pathways underlying HT, which is consistent with the opinion (Wang, 2011; Bachmann and Wang, 2018) that multiple biomarkers from one pathway may provide overlapping information, resulting non-improvement in risk classification after addition of multi-biomarkers.

This study has several strengths. The sample size of the derivation cohort was larger than most of the previous studies of blood biomarkers and HT after ischemic stroke. Comprehensive information and multiple biomarkers were collected and measured with standardized protocols and rigid quality control procedure. Good performance of the multi-biomarker model in the external validation cohort and inclusion of a broad spectrum of people with ischemic stroke support the use of this instrument in diverse clinical settings. Furthermore, our study may have potential important implications for clinical practice. The three biomarkers are easily measured, and routinely available in the emergency department, which could shorten the turnaround time to their availability. In addition, our study suggests that addition of multi-biomarker in conjunction with established risk factors could refine risk prediction for HT. A biomarker panel predicting HT may affect clinical decisions regarding reperfusion and anticoagulation therapy. Although the multi-biomarker model had a good ability to identify patients at high risk of HT in the study, withholding reperfusion and anticoagulation therapy in those patients resulting in better long-term outcomes remains unknown. Further longitudinal studies with large sample size evaluating whether incorporating blood biomarkers into clinical decision could allow us to choose ischemic stroke patients who will benefit the most from reperfusion and anticoagulation therapy and avoid exposing other patients with substantial HT risk could bring interesting information and potentially help us get closer to the aim of precision medicine.

Several limitations of this analysis should be acknowledged. First, we did not include radiological markers such as lesion size and the Alberta Stroke Program Early CT (ASPECT) score, because it is not routinely determined in the clinical setting, and there is significant interobserver variability. Compared to anterior stroke, posterior stroke had a lower frequency of HT. Considering this, there might be some differences in the development of HT in ischemic stroke patients with different locations. The location of the infarcts has not been analyzed in the study. Future studies are needed to investigate whether the model have the similar performance in both anterior and posterior stroke. In addition, there are numerous other biomarkers that were not analyzed in the study. Despite that, the selected biomarkers were repeatedly used in previous studies and can be easily ascertained in different settings. They are part of the routine tests of stroke patients, making our results applicable for clinical practice. Second, we only included ischemic stroke patients with a follow-up CT/MRI within 7 days after admission to identify HT. Therefore, we only looked at HT within about 1 week after stroke onset in the study. Although, this may not reflect clinical practice in some settings, we aimed to detect more HT in the study. Our previous study (Tan et al., 2014) showed HT usually occurs within 1 week after stroke onset. Third, HT in the study was detected by a follow-up CT or MRI, and MRI is more sensitive than CT for detection of HT (Álvarez-Sabín et al., 2013). However, CT and MRI have a similar sensitivity to detect PH after ischemic stroke. In the study, the addition of the multi-biomarker score to a conventional model improved not only the risk refinement for HT, but also for PH. Fourth, there were differences in baseline characteristics and observed frequency of HT in the derivation and validation cohorts. This variance could be attributed to differences in hospital settings (central vs. local hospital). The multi-biomarker model performed well in different hospitals, showing the robustness and reliability of the model when applied to different cohorts. Finally, the biomarkers were measured only once, while serial measurements of these biomarkers may offer more information and help us to better understand the mechanism of HT after ischemic stroke. Future studies should unravel whether the association between these blood biomarkers and HT is only an epiphenomenon or whether it reflects a causal relationship.

Conclusions

The present study suggests that levels of platelets, NLR, and HDL on admission were individually associated with an increased risk of HT after ischemic stroke, independent of established variables. Incorporation of a combination of these three biomarkers to a basic model with conventional risk factors enhanced the risk discrimination and reclassification for HT in patients with ischemic stroke. Our multi-biomarker model might be a useful instrument to identify individuals who are most likely to benefit from reperfusion and anticoagulation interventions.

Data Availability Statement

The data that support the results of this study are available from the corresponding author upon reasonable request.

Ethics Statement

The studies involving human participants were reviewed and approved by the Biomedical Research Ethics Committee of West China Hospital, Sichuan University [2016(339)]. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JLiu drafted the manuscript. YW analyzed the data. YJ, WG, QS, CW, JLi, and SZ collected the data. ML designed the research. All authors contributed to the article and approved the submitted version.

Funding

This research was funded by a Major International (Regional) Joint Research Project, the Natural Science Foundation of China (81620108009), the National Natural Science Foundation of China (81901199), and the 1.3.5 Project for Disciplines of Excellence, West China Hospital, Sichuan University (No. ZYGD18009).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We are grateful to the study participants and their relatives and the clinical staff at hospital for support and contribution to this study.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnagi.2021.667934/full#supplementary-material.

References

Aho, K., Harmsen, P., Hatano, S., Marquardsen, J., Smirnov, V. E., and Strasser, T. (1980). Cerebrovascular disease in the community: results of a WHO collaborative study. Bull. World Health Organ. 58, 113–130.

PubMed Abstract | Google Scholar

Álvarez-Sabín, J., Maisterra, O., Santamarina, E., and Kase, C. S. (2013). Factors influencing haemorrhagic transformation in ischaemic stroke. Lancet Neurol. 12, 689–705. doi: 10.1016/S1474-4422(13)70055-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Bachmann, K. N., and Wang, T. J. (2018). Biomarkers of cardiovascular disease: contributions to risk prediction in individuals with diabetes. Diabetologia 61, 987–995. doi: 10.1007/s00125-017-4442-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, D. L., Barsan, W. G., Lisabeth, L. D., Gallery, M. E., and Morgenstern, L. B. (2005). Survey of emergency physicians about recombinant tissue plasminogen activator for acute ischemic stroke. Ann. Emerg. Med. 46, 56–60. doi: 10.1016/j.annemergmed.2004.12.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Bruno, A., Levine, S. R., Frankel, M. R., Brott, T. G., Lin, Y., Tilley, B. C., et al. (2002). Admission glucose level and clinical outcomes in the NINDS rt-PA stroke trial. Neurology 59, 669–674. doi: 10.1212/wnl.59.5.669

PubMed Abstract | CrossRef Full Text | Google Scholar

Cucchiara, B., Tanne, D., Levine, S. R., Demchuk, A. M., and Kasner, S. (2008). A risk score to predict intracranial hemorrhage after recombinant tissue plasminogen activator for acute ischemic stroke. J. Stroke Cerebrovasc. Dis. 17, 331–333. doi: 10.1016/j.jstrokecerebrovasdis.2008.03.012

PubMed Abstract | CrossRef Full Text | Google Scholar

DeLong, E. R., DeLong, D. M., and Clarke-Pearson, D. L. (1988). Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44, 837–845. doi: 10.2307/2531595

PubMed Abstract | CrossRef Full Text | Google Scholar

de Los Ríos la Rosa, F., Khoury, J., Kissela, B. M., Flaherty, M. L., Alwell, K., Moomaw, C. J., et al. (2012). Eligibility for intravenous recombinant tissue-type plasminogen activator within a population: the effect of the european cooperative acute stroke study (ECASS) III trial. Stroke 43, 1591–1595. doi: 10.1161/STROKEAHA.111.645986

PubMed Abstract | CrossRef Full Text | Google Scholar

Foerch, C., Wunderlich, M. T., Dvorak, F., Humpich, M., Kahles, T., Goertler, M., et al. (2007). Elevated serum S100B levels indicate a higher risk of hemorrhagic transformation after thrombolytic therapy in acute stroke. Stroke 38, 2491–2495. doi: 10.1161/STROKEAHA.106.480111

PubMed Abstract | CrossRef Full Text | Google Scholar

Hijazi, Z., Oldgren, J., Siegbahn, A., and Wallentin, L. (2017). Application of biomarkers for risk stratification in patients with atrial fibrillation. Clin. Chem. 63, 152–164. doi: 10.1373/clinchem.2016.255182

PubMed Abstract | CrossRef Full Text | Google Scholar

Jackson, C. E., Haig, C., Welsh, P., Dalzell, J. R., Tsorlalis, I. K., McConnachie, A., et al. (2016). The incremental prognostic and clinical value of multiple novel biomarkers in heart failure. Eur. J. Heart Fail. 18, 1491–1498. doi: 10.1002/ejhf.543

PubMed Abstract | CrossRef Full Text | Google Scholar

Kazmierski, R., Michalak, S., Wencel-Warot, A., and Nowinski, W. L. (2012). Serum tight-junction proteins predict hemorrhagic transformation in ischemic stroke patients. Neurology 79, 1677–1685. doi: 10.1212/WNL.0b013e31826e9a83

PubMed Abstract | CrossRef Full Text | Google Scholar

Kelly, P. J., Morrow, J. D., Ning, M. M., Koroshetz, W., Lo, E. H., Terry, E., et al. (2008). Oxidative stress and matrix metalloproteinase-9 in acute ischemic stroke: the biomarker evaluation for antioxidant therapies in stroke (BEAT-stroke) study. Stroke 39, 100–104. doi: 10.1161/STROKEAHA.107.488189

PubMed Abstract | CrossRef Full Text | Google Scholar

Langhorne, P., O’Donnell, M. J., Chin, S. L., Zhang, H., Xavier, D., Avezum, A., et al. (2018). Practice patterns and outcomes after stroke across countries at different economic levels (INTERSTROKE): an international observational study. Lancet 391, 2019–2027. doi: 10.1016/S0140-6736(18)30802-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, J. H., Park, K. Y., Shin, J. H., Cha, J. K., Kim, H. Y., Kwon, J. H., et al. (2010). Symptomatic hemorrhagic transformation and its predictors in acute ischemic stroke with atrial fibrillation. Eur. Neurol. 64, 193–200. doi: 10.1159/000319048

PubMed Abstract | CrossRef Full Text | Google Scholar

Lei, C., Wu, B., Liu, M., and Chen, Y. (2014). Asymptomatic hemorrhagic transformation after acute ischemic stroke: is it clinically innocuous? J. Stroke Cerebrovasc. Dis. 23, 2767–2772. doi: 10.1016/j.jstrokecerebrovasdis.2014.06.024

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, J., Wang, Y., Guo, W., Cheng, Y., Zhang, S., Wu, B., et al. (2021). Temporal trends of atrial fibrillation and/or rheumatic heart disease-related ischemic stroke and anticoagulant use in Chinese population: an 8-year study. Int. J. Cardiol. 322, 258–264. doi: 10.1016/j.ijcard.2020.08.046

PubMed Abstract | CrossRef Full Text | Google Scholar

Lou, M., Safdar, A., Mehdiratta, M., Kumar, S., Schlaug, G., Caplan, L., et al. (2008). The HAT score: a simple grading scale for predicting hemorrhage after thrombolysis. Neurology 71, 1417–1423. doi: 10.1212/01.wnl.0000330297.58334.dd

PubMed Abstract | CrossRef Full Text | Google Scholar

Lu, G., He, Q., Shen, Y., and Cao, F. (2018). Potential biomarkers for predicting hemorrhagic transformation of ischemic stroke. Int. J. Neurosci. 128, 79–89. doi: 10.1080/00207454.2017.1349766

PubMed Abstract | CrossRef Full Text | Google Scholar

Marsh, E. B., Llinas, R. H., Schneider, A.L.C., Hillis, A. E., Lawrence, E., Dziedzic, P., et al. (2016). Predicting hemorrhagic transformation of acute ischemic stroke: prospective validation of the HeRS score. Medicine 95:e2430. doi: 10.1097/MD.0000000000002430

PubMed Abstract | CrossRef Full Text | Google Scholar

Melander, O., Newton-Cheh, C., Almgren, P., Hedblad, B., Berglund, G., Engström, G., et al. (2009). Novel and conventional biomarkers for prediction of incident cardiovascular events in the community. JAMA 302, 49–57. doi: 10.1001/jama.2009.943

PubMed Abstract | CrossRef Full Text | Google Scholar

Menon, B. K., Saver, J. L., Prabhakaran, S., Reeves, M., Liang, L., Olson, D. M., et al. (2012). Risk score for intracranial hemorrhage in patients with acute ischemic stroke treated with intravenous tissue-type plasminogen activator. Stroke 43, 2293–2299. doi: 10.1161/STROKEAHA.112.660415

PubMed Abstract | CrossRef Full Text | Google Scholar

Montaner, J., Molina, C. A., Monasterio, J., Abilleira, S., Arenillas, J. F., Ribó, M., et al. (2003). Matrix metalloproteinase-9 pretreatment level predicts intracranial hemorrhagic complications after thrombolysis in human stroke. Circulation 107, 598–603. doi: 10.1161/01.cir.0000046451.38849.90

PubMed Abstract | CrossRef Full Text | Google Scholar

National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. (1995). Tissue plasminogen activator for acute ischemic stroke. N. Engl. J. Med. 333, 1581–1587.

Google Scholar

Pencina, M. J., D’Agostino, R. B., D’Agostino, R. B., and Vasan, R. S. (2008). Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat. Med. 27, 157–172; discussion 207–212. doi: 10.1002/sim.2929

PubMed Abstract | CrossRef Full Text | Google Scholar

Sacco, R. L., Kasner, S. E., Broderick, J. P., Caplan, L. R., Connors, J. J., Culebras, A., et al. (2013). An updated definition of stroke for the 21st century. Stroke 44, 2064–2089. doi: 10.1161/STR.0b013e318296aeca

PubMed Abstract | CrossRef Full Text | Google Scholar

Sadeh-Gonik, U., Tau, N., Friehmann, T., Bracard, S., Anxionnat, R., Derelle, A. L., et al. (2018). Thrombectomy outcomes for acute stroke patients with anterior circulation tandem lesions: a clinical registry and an update of a systematic review with meta-analysis. Eur. J. Neurol. 25, 693–700. doi: 10.1111/ene.13577

PubMed Abstract | CrossRef Full Text | Google Scholar

Saposnik, G., Guzik, A. K., Reeves, M., Ovbiagele, B., and Johnston, S. C. (2013). Stroke prognostication using age and NIH stroke scale: SPAN-100. Neurology 80, 21–28. doi: 10.1212/WNL.0b013e31827b1ace

PubMed Abstract | CrossRef Full Text | Google Scholar

Strbian, D., Engelter, S., Michel, P., Meretoja, A., Sekoranja, L., Ahlhelm, F. J., et al. (2012). Symptomatic intracranial hemorrhage after stroke thrombolysis: the SEDAN score. Ann. Neurol. 71, 634–641. doi: 10.1002/ana.23546

PubMed Abstract | CrossRef Full Text | Google Scholar

Sung, S. F., Chen, S. C. C., Lin, H. J., Chen, Y. W., Tseng, M. C., and Chen, C. H. (2013). Comparison of risk-scoring systems in predicting symptomatic intracerebral hemorrhage after intravenous thrombolysis. Stroke 44, 1561–1566. doi: 10.1161/STROKEAHA.111.000651

PubMed Abstract | CrossRef Full Text | Google Scholar

Tan, S., Wang, D., Liu, M., Zhang, S., Wu, B., and Liu, B. (2014). Frequency and predictors of spontaneous hemorrhagic transformation in ischemic stroke and its association with prognosis. J. Neurol. 261, 905–912. doi: 10.1007/s00415-014-7297-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, T. J. (2011). Assessing the role of circulating, genetic and imaging biomarkers in cardiovascular risk prediction. Circulation 123, 551–565. doi: 10.1161/CIRCULATIONAHA.109.912568

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Y., Qiu, K., Song, Q., Cheng, Y., Liu, J., and Liu, M. (2020a). AST to ALT ratio and risk of hemorrhagic transformation in patients with acute ischemic stroke. Neurol. Res. 42, 980–986. doi: 10.1080/01616412.2020.1796403

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Y., Song, Q., Cheng, Y., Wei, C., Ye, C., Liu, J., et al. (2020b). Association between non-high-density lipoprotein cholesterol and haemorrhagic transformation in patients with acute ischaemic stroke. BMC Neurol. 20:47. doi: 10.1186/s12883-020-1615-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Wu, S., Wu, B., Liu, M., Chen, Z., Wang, W., Anderson, C. S., et al. (2019). Stroke in China: advances and challenges in epidemiology, prevention and management. Lancet Neurol. 18, 394–405. doi: 10.1016/S1474-4422(18)30500-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Yaghi, S., Willey, J. Z., Cucchiara, B., Goldstein, J. N., Gonzales, N. R., Khatri, P., et al. (2017). Treatment and outcome of hemorrhagic transformation after intravenous alteplase in acute ischemic stroke a scientific statement for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 48, e343–e361. doi: 10.1161/STR.0000000000000152

PubMed Abstract | CrossRef Full Text | Google Scholar

Yuan, R., Tan, S., Wang, D., Wu, S., Cao, X., Zhang, S., et al. (2018). Predictive value of plasma matrix metalloproteinase-9 concentrations for spontaneous haemorrhagic transformation in patients with acute ischaemic stroke: a cohort study in Chinese patients. J. Clin. Neurosci. 58, 108–112. doi: 10.1016/j.jocn.2018.09.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhong, C., Zhu, Z., Wang, A., Xu, T., Bu, X., Peng, H., et al. (2019). Multiple biomarkers covering distinct pathways for predicting outcomes after ischemic stroke. Neurology 92, e295–e304. doi: 10.1212/WNL.0000000000006717

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: acute ischemic stroke, multiple biomarkers, hemorrhagic transformation, risk reclassification, prediction model

Citation: Liu J, Wang Y, Jin Y, Guo W, Song Q, Wei C, Li J, Zhang S and Liu M (2021) Prediction of Hemorrhagic Transformation After Ischemic Stroke: Development and Validation Study of a Novel Multi-biomarker Model. Front. Aging Neurosci. 13:667934. doi: 10.3389/fnagi.2021.667934

Received: 15 February 2021; Accepted: 27 April 2021;
Published: 28 May 2021.

Edited by:

Aurel Popa-Wagner, University Hospital Essen, Germany

Reviewed by:

Julien Rossignol, Central Michigan University, United States
Yulu Wang, Fujian University of Traditional Chinese Medicine, China

Copyright © 2021 Liu, Wang, Jin, Guo, Song, Wei, Li, Zhang and Liu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ming Liu, wyplmh@hotmail.com

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.