Kristina Shkirkova1*
Theodore T. Wang2
Lily Vartanyan2David S. Liebeskind3Marc Eckstein4Sidney Starkman3Samuel Stratton5Franklin D. Pratt6Scott Hamilton7May Kim-Tenser2Robin Conwit8
Jeffrey L. Saver3
Nerses Sanossian2 on behalf of FAST-MAG Investigators and Coordinators- 1Zilkha Neurogenetic Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA, United States
- 2Department of Neurology, Roxanna Todd Hodges Comprehensive Stroke Center, Keck School of Medicine, University of Southern California, Los Angeles, CA, United States
- 3Department of Neurology, UCLA Comprehensive Stroke Center, Los Angeles, CA, United States
- 4Department of Emergency Medicine, University of Southern California, Los Angeles, CA, United States
- 5Department of Community Health Sciences, University of California, Los Angeles, Los Angeles, CA, United States
- 6Los Angeles County Department of Public Health, Los Angeles, CA, United States
- 7Department of Neurology, Stanford Stroke Center, School of Medicine, Stanford University, Palo Alto, CA, United States
- 8National Institutes of Health, Bethesda, MD, United States
Background and Purpose: Primary stroke center (PSC) certification is associated with improvements in stroke care and outcome. However, these improvements may reflect a higher baseline level of care delivery in hospitals eventually achieving certification. This study examines whether advancements in acute stroke care at PSCs are due to certification or factors intrinsic to the hospital.
Methods: Data was obtained from the Field Administration of Stroke Therapy-Magnesium (FAST-MAG) trial with participation of 40 Emergency Medical System agencies, 315 ambulances, and 60 acute receiving hospitals in Los Angeles and Orange Counties. Subjects were transported to one of three types of destinations: PSC certified hospitals (PSCs), hospitals that were not PSCs at time of enrollment but would later become certified (pre-PSCs), and hospitals that would never be certified (non-PSCs). Metrics of acute stroke care quality included time arrival to imaging, use of intravenous tPA, and arrival to treatment.
Results: Of 1,700 cases, 856(50%) were at certified PSCs, 529(31%) were at pre-PSCs, and 315 (19%) were at non-PSCs. Mean (SD) was 33min (±76.1) at PSCs, 47(±86.6) at pre-PSCs, and 49(±71.7) at non-PSCs. Of 1,223 cerebral ischemia cases, rate of tPA utilization was 43% at PSCs, 27% at pre-PSCs, and 28% at non-PSCs. Mean ED arrival to thrombolysis was 71(±32.7) at PSC, 98(±37.6) at pre-PSC, and 95(±45.0) at non-PSCs. PSCs had improved time to imaging (p = 0.014), percent tPA use (p < 0.001), and time to treatment (p = 0.003).
Conclusions: Stroke care at hospitals prior to PSC certification is equivalent to care at non-PSCs.
Clinical Trial Registration: http://www.clinicaltrials.gov. Unique identifier: NCT00059332.
Introduction
The Brain Attack Coalition (BAC) published their recommendations for the formation and operation of Primary Stroke Centers (PSCs) in 2000 and updated their recommendations in 2011 (1, 2). Multiple studies have demonstrated that PSC-certification is associated with improvement in stroke care, such as streamlined processes, improved rates of thrombolysis, and better outcomes (3–7). However, nationwide, less than one in three hospitals has achieved this designation (8). There are many barriers to becoming a PSC, including costs, lack of diversion of patients to appropriate levels of care, presence of leadership, and shortage of neurological expertise (1, 2, 9). Thus, many hospitals may never be able to achieve PSC certification.
There are challenges in demonstrating that benefits associated with PSCs are directly related to the certification process. Investigating outcomes at PSCs by doing pre- and post-certification comparisons is difficult for several reasons. Because the BAC criteria are organized around 11 aspects of stroke care, hospitals that are not fully certified can adopt many, but not all, elements of PSCs shown to be beneficial and improve overall stroke care (1, 2, 9). Additionally, improved outcomes at hospitals that achieve PSC certification may be explained by a higher baseline level of stroke care and expertise. We aimed to determine whether improvements in stroke care seen in PSCs in some part reflect the fact that hospitals eventually achieving certification are better at delivering care at baseline.
Methods
Data was obtained from the National Institute of Health-NINDS-sponsored Field Administration of Stroke Therapy Magnesium (FAST-MAG) clinical trial conducted in Los Angeles County from 2005 to 2012 and in Orange County from 2010 to 2012 (10). FAST-MAG was a phase 3, randomized, placebo-controlled clinical trial of prehospital, field-initiated magnesium sulfate in hyperacute stroke patients presenting within the first 2 h of defined symptom 5 onset (11, 12). The study protocol was approved by the institutional review board at each prehospital and hospital study site.
The current study only included FAST-MAG trial patients from Los Angeles County, chosen because of its diverse population of inhabitants. Participating sites included 32 Emergency Medical System agencies, 228 paramedic ambulances, and 55 acute receiving hospitals in the County of Los Angeles. The 55 FAST-MAG consortium of acute receiving hospitals included community hospitals, regional centers, and tertiary academic centers. Patient enrollment criteria required that subjects be identified as likely having acute stroke by the Los Angeles Prehospital Stroke Screen (LAPSS) (13, 14), in addition to having a paramedic- and physician-confirmed last known well time (LKWT) within 2 h of actual last known well time.
During the FAST-MAG trial, many hospitals began the PSC certification process and eventually achieved status as PSC. Thus, each patient involved as a subject in the FAST-MAG trial was coded as enrolled at either a hospital already certified as a PSC by The Joint Commission (TJC) or an equivalent national body (8); a hospital that was not yet a PSC but would later become certified; or a hospital that never achieved certification. For the current study, subjects were classified as being enrolled at either a designated PSC (PSC), a hospital that was not a PSC at the time of enrollment but would later become certified (pre-PSC), or a hospital that would never achieve certification (non-PSC).
Three metrics were chosen to reflect quality of acute stroke care: time from Emergency Department (ED) arrival to first brain scan (“door to imaging”), rate of tPA utilization in cases of cerebral ischemia, and time from ED arrival to initiation of tPA (“door to tPA initiation”).
Results
From January 2005 to December 2012, a total of 1,700 patients met criteria and were enrolled in the current study. 856 (50%) were coded as enrolled at certified PSCs, 529 (31%) were coded as enrolled at pre-PSCs, and 315 (19%) were coded as enrolled at non-PSCs (Table 1). Clinical characteristics of the overall FAST-MAG Study Population and PSC, pre-PSC, and non-PSC populations are listed in Table 2.
Table 1. Patient enrollment at PSCs, pre-PSCs, and non-PSCs.
Table 2. Patient characteristics of the overall FAST-MAG Study Population and PSC, pre-PSC, and non-PSC populations.
Median (IQR) time from arrival to imaging was 23 min (16–32) at PSCs, 33.5 (24–46) at pre-PSCs, and 37 (26–53) at non-PSCs (p < 0.0001) (Figure 1). Among cases of cerebral ischemia (n = 1,223), rates of tPA utilization were 43% at PSCs, 27% at pre-PSCs, and 28% at non-PSCs (p < 0.001, X2) (Figure 2). In treated cerebral ischemia cases, median (IQR) time in minutes from ED arrival (door) to initiation of tPA was 75 (57–95) at PSCs, 101 (79–121) at pre-PSCs, and 87 (71–118) at non-PSCs (p < 0.0001) (Figure 3).
Figure 1. Metrics of acute stroke care quality: time (minutes) from door to imaging: median time with interquartile range in minutes from emergency department (ED) arrival (door) to first brain scan (imaging) was 23 (17–32) at PSCs, 27 (19–38) at pre-PSCs, and 34 (25–41) at non-PSCs (p < 0.001). PSCs had a faster time from ED arrival to first brain scan.
Figure 2. Metrics of acute stroke care quality: tPA use in cerebral ischemia: mean rates of tPA utilization in cases of cerebral ischemia. Of 1,223 cerebral ischemia cases, rate of tPA utilization was 43% at PSCs, 27% at pre-PSCs, and 28% at non-PSCs (p < 0.001, X2). PSCs had a higher rate of tPA utilization in patients diagnosed with ischemic stroke.
Figure 3. Metrics of acute stroke care quality: median time with interquartile range (minutes) from door to tPA initiation: in treated cerebral ischemia cases, time in minutes from ED arrival (door) to initiation of tPA was 75 (57–95) at PSC, 101 (79–121) at pre-PSC, and 87 (71–118) at non-PSCs (p < 0.001). PSCs had a reduced time from door to thrombolysis.
As compared to hospitals that were not certified PSCs at the time of study enrollment but eventually achieved certification, hospitals that had already achieved PSC designation at the time of enrollment had a statistically significant reduction in the time from ED arrival to first brain scan, from 47 to 33 min (p = 0.014); a statistically significant increased rate of tPA utilization in cases of cerebral ischemia, from 27 to 43% (p < 0.001); and a statistically significant reduction in the time from ED arrival to tPA initiation, from 98 to 71 min (p = 0.003). In contrast, comparing values between non-PSCs (hospitals that would never achieved PSC status) and pre-PSCs (hospitals that eventually completed certification but were not PSCs at time of enrollment) revealed no significant difference in time to imaging (47 vs. 49 min), percent tPA use (27% vs. 28%), and time to thrombolysis (98 vs. 95 min).
Discussion
Our findings in this study demonstrate that hospitals with PSC designation have shorter time of door to first imaging. Furthermore, in cerebral ischemia PSC hospitals had higher rate of tPA use in patients who met criteria for thrombolytic treatment as well as shorter time from door to needle. In contrast, the data reflect that stroke care at hospitals prior to PSC certification was equivalent to care at non-PSCs, hospitals that would never achieve certification. These findings suggest that improvements in acute stroke evaluation and care at PSCs are a result of undergoing the certification process and achieving designation, and not intrinsic to hospitals.
Prior studies attempting to evaluate this question have demonstrated mixed results. A 2009 study found that hospitals certified as PSCs had better patient outcomes as compared to non-certified hospitals at least 11 months before the Joint Commission certification program began (16). Outcomes studied included in-hospital mortality, 30-day mortality, and 30-day readmission, all of which were found to be lower in the future PSC-certified hospitals. This study was unable to take into account stroke severity potentially affecting outcomes, and they were unable to address thrombolytic use in stroke. The study coordinators concluded that cross-sectional analyses examining the benefits of stroke center certification have the potential to be biased if they do not account for these pre-existing differences.
A 2011 follow-up study by the same group again compared hospitals with and without PSC certification but analyzed 30-day risk-standardized mortality (RSMR) and readmission (RSRR) rates (17). Their results showed that ~50% of PSCs had lower than the national average mortality rate, vs. 19% of non-PSCs. However, their data on readmission rates did not demonstrate definitive improvement in PSCs. They concluded that while there were more high-performing hospitals identified in the PSC group, certification did not necessarily guarantee better performance at these sites.
In contrast, a 2011 New York State observational study evaluated if care at stroke centers had an effect on mortality, and found greater use of thrombolytic therapy and reduced mortality rates in patients admitted to PSCs when compared to patients admitted to non-designated hospitals (5). Notably, they were able to demonstrate that these outcome differences were specific to a diagnosis of stroke, vs. acute myocardial infarction and/or gastrointestinal hemorrhage. These findings suggest that improvements in stroke care are specific to PSC designation and the implementation of BAC stroke guidelines, rather than to factors intrinsic to hospitals achieving certification that affect overall quality improvement.
Although prior studies have shown that PSCs are associated with reduced mortality, increased use of thrombolytic therapy, and related processes of care and outcomes in acute stroke cases (6, 7), the results from these studies have failed to definitively demonstrate that improvements in stroke care are a result of the PSC certification process. This is the first study that we are aware of that examined hospitals at various stages of the certification process. By doing so, we were uniquely able to analyze data from pre-PSCs and non-PSCs to address the quality of stroke care at hospitals prior to PSC certification and compare it to the quality of stroke care at hospitals that would never achieve certification. Thus, by showing that care at pre-PSCs is equivalent to care at non-PSCs, the findings in our study support prior reports that the improvements seen in PSCs are derived directly from achieving designation.
Potential limitations exist in the present study. Data on acute stroke care was obtained from the FAST-MAG trial, which did not enroll patients transported to smaller hospitals, representing ~20% of the hospitals in Los Angeles County. Therefore, the findings in this study do not account for these patients. However, as the study progressed, and more hospitals became Approved Stroke Centers and joined the regional system, additional geographic areas were incorporated into the trial, covering a larger subset of patients in the county. None of the FAST-MAG trial exclusion criteria, such as renal failure, absence of a consent provider, or patient declination regarding trial participation, appear likely to confound analysis. Additionally, our study was limited to 3 metrics chosen to reflect acute stroke care and did not assess outcomes like stroke morbidity, mortality, and readmission rates. Future studies are needed to definitively address PSC certification on these patient outcomes. Finally, the BAC guidelines, our study, and most of the prior studies found in the literature focus primarily on acute ischemic stroke and initiation of thrombolytic therapy. Therefore, there is a deficit in research assessing standardized measures to address management of non-tPA stroke (9).
We conclude that the impact of achieving primary stroke center certification is significant and has the potential to improve acute stroke care processes. We expect this to have beneficial effects on clinical outcomes based on prior clinical trials and observational studies.
Data Availability Statement
The main FAST-MAG trial database and materials have been made publicly available at the NIH-NINDS Archived Clinical Research Datasets and can be accessed at https://www.ninds.nih.gov/Current-Research/Research-Funded-NINDS/Clinical-Research/Archived-Clinical-Research-Datasets. Supplementary data on clinically-recorded, ED-arrival GCS in FAST-MAG are available from author JS (jsaver@mednet.ucla.edu) upon reasonable request.
Author Contributions
KS performed data acquisition, statistical analysis, drafting, writing, and revision of manuscript. TW and LV assisted with manuscript writing and data analysis. SH contributed to study design, statistical analysis, and revision of manuscript. SSta, ME, SStr, FP, and DL contributed to study design, data acquisition, and revision of manuscript. MK-T contributed to manuscript content planning, data analysis, and manuscript revision. RC contributions included funding and oversight. JS and NS contributed to study design, data acquisition, statistical analysis, writing, and revision of the manuscript.
Funding
This study was supported by NIH-NINDS Award U01 NS 44364.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1. Alberts MJ, Latchaw RE, Jagoda A, Wechsler LR, Crocco T, George MG, et al. Revised and updated recommendations for the establishment of primary stroke centers: a summary statement from the brain attack coalition. Stroke. (2011) 42:2651–65. doi: 10.1161/STROKEAHA.111.615336
2. Alberts MJ, Hademenos G, Latchaw RE, Jagoda A, Marler JR, Mayberg MR, et al. Recommendations for the establishment of primary stroke centers. Brain attack coalition. JAMA. (2000) 283:3102–9. doi: 10.1001/jama.283.23.3102
3. Gropen TI, Gagliano PJ, Blake CA, Sacco RL, Kwiatkowski T, Richmond NJ, et al. Quality improvement in acute stroke: the New York State Stroke Center Designation Project. Neurology. (2006) 67:88–93. doi: 10.1212/01.wnl.0000223622.13641.6d
4. Douglas VC, Tong DC, Gillum LA, Zhao S, Brass LM, Dostal J, et al. Do the Brain Attack Coalition's criteria for stroke centers improve care for ischemic stroke? Neurology. (2005) 64:422–7. doi: 10.1212/01.WNL.0000150903.38639.E1
5. Xian Y, Holloway RG, Chan PS, Noyes K, Shah MN, Ting HH, et al. Association between stroke center hospitalization for acute ischemic stroke and mortality. JAMA. (2011) 305:373–80. doi: 10.1001/jama.2011.22
6. Johnson AM, Goldstein LB, Bennett P, O'Brien EC, Rosamond WD, investigators of the Registry of the North Carolina Stroke Care Collaborative. Compliance with acute stroke care quality measures in hospitals with and without primary stroke center certification: the North Carolina Stroke Care Collaborative. J Am Heart Assoc Cardiovasc. Cerebrovasc. Dis. (2014) 3:e00042. doi: 10.1161/JAHA.113.000423
7. McKinney JS, Cheng JQ, Rybinnik I, Kostis JB for the Myocardial Infarction Data Acquisition System (MIDAS 22) Study Group. Comprehensive stroke centers may be associated with improved survival in hemorrhagic stroke. J Am Heart Assoc Cardiovasc. Cerebrovasc. Dis. (2015) 4:e001448. doi: 10.1161/JAHA.114.001448
8. Certification for Primary Stroke Centers | Joint Commission. (2018). Available online at: https://www.jointcommission.org/certification/primary_stroke_centers.aspx.
9. Chaudhry FS, Schneck MJ, Warady J, Platakis J, Morales-Vidal SG, Biller J, et al. Primary stroke center concept: strengths and limitations. Front Neurol. (2012) 3:108. doi: 10.3389/fneur.2012.00108
10. Saver JL, Starkman S, Eckstein M, Stratton SJ, Pratt FD, Hamilton S, et al. Prehospital use of magnesium sulfate as neuroprotection in acute stroke. N Engl J Med. (2015) 372:528–36. doi: 10.1056/NEJMoa1408827
11. Saver JL, Starkman S, Eckstein M, Stratton S, Pratt F, Hamilton S, et al. Methodology of the Field Administration of Stroke Therapy - Magnesium (FAST-MAG) phase 3 trial: part 1 - rationale and general methods. Int J Stroke. (2014) 9:215–9. doi: 10.1111/ijs.12243
12. Saver JL, Starkman S, Eckstein M, Stratton S, Pratt F, Hamilton S, et al. Methodology of the Field Administration of Stroke Therapy - Magnesium (FAST-MAG) phase 3 trial: part 2 - prehospital study methods. Int J Stroke. (2014) 9:220–5. doi: 10.1111/ijs.12242
13. Kidwell CS, Saver JL, Schubert GB, Eckstein M, Starkman S. Design and retrospective analysis of the Los Angeles Prehospital Stroke Screen (LAPSS). Prehosp Emerg Care. (1998) 2:267–73. doi: 10.1080/10903129808958878
14. Kidwell CS, Starkman S, Eckstein M, Weems K, Saver JL. Identifying stroke in the field. Prospective validation of the Los Angeles prehospital stroke screen (LAPSS). Stroke. (2000) 31:71–6. doi: 10.1161/01.STR.31.1.71
15. Llanes JN, Kidwell CS, Starkman S, Leary MC, Eckstein M, Saver JL. The Los Angeles Motor Scale (LAMS): a new measure to characterize stroke severity in the field. Prehosp Emerg Care. (2004) 8:46–50. doi: 10.1080/312703002806
16. Lichtman JH, Allen NB, Wang Y, Watanabe E, Jones SB, Goldstein LB. Stroke patient outcomes in US hospitals before the start of the Joint Commission Primary Stroke Center certification program. Stroke. (2009) 40:3574–9. doi: 10.1161/STROKEAHA.109.561472
Keywords: stroke, primary stroke center, stroke center certification, acute ischemic stroke, cerebral ischemia, tPA, thrombolytic
Citation: Shkirkova K, Wang TT, Vartanyan L, Liebeskind DS, Eckstein M, Starkman S, Stratton S, Pratt FD, Hamilton S, Kim-Tenser M, Conwit R, Saver JL and Sanossian N (2020) Quality of Acute Stroke Care at Primary Stroke Centers Before and After Certification in Comparison to Never-Certified Hospitals. Front. Neurol. 10:1396. doi: 10.3389/fneur.2019.01396
Received: 14 October 2019; Accepted: 19 December 2019;
Published: 22 January 2020.
Edited by:
Claus Ziegler Simonsen, Aarhus University Hospital, DenmarkReviewed by:
Martin Ebinger, Charité Medical University of Berlin, GermanyAristeidis H. Katsanos, McMaster University, Canada
Copyright © 2020 Shkirkova, Wang, Vartanyan, Liebeskind, Eckstein, Starkman, Stratton, Pratt, Hamilton, Kim-Tenser, Conwit, Saver and Sanossian. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kristina Shkirkova, kristina.shkirkova@usc.edu