- 1Department of Radiology, University Medical Center Utrecht, Utrecht, Netherlands
- 2Image Sciences Institute, University Medical Center Utrecht, Utrecht, Netherlands
- 3Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam, Netherlands
- 4Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers, Location Academic Medical Center, Amsterdam, Netherlands
Introduction: Locating a vessel occlusion is important for clinical decision support in stroke healthcare. The advent of endovascular thrombectomy beyond proximal large vessel occlusions spurs alternative approaches to locate vessel occlusions. We explore whether CT perfusion (CTP) data can help to automatically locate vessel occlusions.
Methods: We composed an atlas with the downstream regions of particular vessel segments. Occlusion of these segments should result in the hypoperfusion of the corresponding downstream region. We differentiated between seven-vessel occlusion locations (ICA, proximal M1, distal M1, M2, M3, ACA, and posterior circulation). We included 596 patients from the DUtch acute STroke (DUST) multicenter study. Each patient CTP data set was processed with perfusion software to determine the hypoperfused region. The downstream region with the highest overlap with the hypoperfused region was considered to indicate the vessel occlusion location. We assessed the indications from CTP against expert annotations from CTA.
Results: Our atlas-based model had a mean accuracy of 86% and could achieve substantial agreement with the annotations from CTA according to Cohen's kappa coefficient (up to 0.68). In particular, anterior large vessel occlusions and occlusions in the posterior circulation could be located with an accuracy of 80 and 92%, respectively.
Conclusion: The spatial layout of the hypoperfused region can help to automatically indicate the vessel occlusion location for acute ischemic stroke patients. However, variations in vessel architecture between patients seemed to limit the capacity of CTP data to distinguish between vessel occlusion locations more accurately.
Introduction
The location of a vessel occlusion is central to the clinical decision support of acute ischemic stroke patients. To diagnose these patients, multimodal CT imaging is performed, consisting of non-contrast CT, CT angiography (CTA), and CT perfusion (CTP). Non-contrast CT can be used to exclude hemorrhagic stroke and stroke mimics, after which CTP can be used to distinguish the infarcted tissue from the salvageable tissue, and CTA can be used to locate the vessel occlusion (1).
Mechanical thrombectomy has become the standard of care for patients suffering from acute ischemic stroke due to anterior circulation proximal large vessel occlusions (2). Recent advancements in stent retriever technology and thromboaspiration devices may widen the eligibility criteria for endovascular treatment by considering occlusions in smaller and more distal vessels (3). It is a prerequisite for endovascular treatment to locate vessel occlusion.
Reading CTA to locate vessel occlusions can be challenging. The more distal the vessel occlusion, the harder this task becomes because the occlusion is smaller, has delayed opacification, can be concealed behind cortical veins, and can be found in a larger number of vessels that exhibit more anatomical variability (4, 5). Moreover, while less experienced readers are likely on call in the emergency setting, they do not perform as well as experienced readers in giving fast and accurate evaluations (6, 7). Therefore, the advent of endovascular treatment beyond proximal large vessel occlusions spurs alternative approaches to locate vessel occlusions (8).
CTP provides a way to locate vessel occlusions because a vessel occlusion results in a perfusion deficit in the downstream region of the occluded vessel (3, 5, 9, 10). As such, it has been shown that experienced readers of CTP can accurately discern patients with distal vessel occlusion from patients without vessel occlusion (5). Moreover, the addition of CTP to CTA has expedited and improved the detection of vessel occlusions on CTA in previous studies (9, 10). Hence, CTP data may contain information that is helpful in locating vessel occlusions.
CTP data on its own are often regarded as complex because it consists of several physiological parameters. Although the presence of a perfusion deficit suffices to detect a vessel occlusion, assessing this deficit to locate the vessel occlusion requires additional physiological and neuroanatomical expertise. Therefore, an automatic evaluation of CTP data may facilitate the support of CTP in reading CTA.
In this study, we explore the potential of CTP to automatically locate vessel occlusions. We present an atlas-based method in which CTP data are used to indicate the vessel occlusion location. These indicated vessel occlusion locations were compared with annotated vessel occlusion locations from expert readings of CTA.
Methods
Acquiring imaging data from the patient population
Retrospective data were obtained from the DUtch acute STroke (DUST) study, in which 14 stroke centers in the Netherlands participated (11). All included DUST participants gave informed consent for the use of their imaging and clinical data. Patients that were admitted to the DUST study were suspected of an ischemic stroke and underwent non-contrast CT, CTP, and CTA imaging within 9 h after symptom onset. Only patients with both an annotated vessel occlusion location (obtained from CTA) and a perfusion deficit (obtained from CTP) were considered in this study.
The CTP protocol consisted of scanning at 80 kVp and 150 mAs on 40- to 320-detector CT scanners (GE Healthcare, Philips, Siemens, or Toshiba) with a 2 s interval for a duration of 50 s. The scans were reconstructed as 5 mm contiguous axial slices. The advised injection protocol was a 40 mL contrast bolus injected at a rate of 6 mL/s followed by a saline flush of 40 mL injected at a rate of 6 mL/s.
For the CTA, a 50–70 mL contrast bolus was injected at a rate of 6 mL/s followed by a saline flush of 40 mL injected at a rate of 6 mL/s. Centers could adhere to their own scanning protocol (such as setting the kVp and the mAs). The CTA scan delay after contrast injection was determined on a per-patient basis either from the time to peak arterial enhancement on CTP or by a trigger based on a threshold for the attenuation measured in the aortic arch during contrast enhancement.
The multicenter DUST data were processed centrally in the University Medical Center Utrecht. The CTA scans were examined with commercially available software on an Extended Brilliance Workstation (IntelliSpace Portal 4.5, Philips Healthcare). All further data processing and analysis were carried out with MATLAB (MATLAB, R2019b: The Mathworks Inc.).
Annotating vessel occlusion locations with CTA
The vessel occlusion locations on CTA were defined as shown in Table 1 (also see Figure 1) and were termed ICA, M1p, M1d, M2 (anterior and posterior), M3, ACA, and PC. An expert reader (from a pool of three readers with at least 5 years of experience in neurovascular imaging) annotated the CTA images with the most proximal vessel occlusion location by reviewing thin slice CTA data with adjustable maximum intensity projection and multiplanar reformatting. The reader was blind to all clinical information other than the side of the symptoms. In Table 1, we differentiated between anterior M2 and posterior M2 occlusions because these have different downstream regions, but both were annotated as M2 on the CTA images.
Figure 1. A visual representation of our methods. On the left is a schematic depiction of the arterial blood supply of the brain. The annotations from CTA did not specify between different M2 (or M3) branches. On the top right, we show the regions from a neuroanatomical CT-MRI brain atlas specific to the stroke population (registered to the CT perfusion scan of a patient) (12). On the bottom right, the neuroanatomical regions (shown on the top right) are grouped to constitute downstream regions that correspond to the vessel occlusion locations (shown on the left). We show the M1d downstream region in the left hemisphere and the two M2 downstream regions in the right hemisphere.
Defining downstream regions for vessel occlusion locations
We adopted a neuroanatomical CT-MRI brain atlas specific to the stroke population from Kaffenberger et al. to define the downstream regions corresponding to the vessel occlusion locations (12). The neuroanatomical regions in the atlas were grouped to constitute these downstream regions in each hemisphere separately as shown in Table 1 (see Figure 1).
Determining hypoperfused regions with CTP
The CTP scans were first corrected for motion by a three-dimensional rigid registration on the skull with Elastix (13). Subsequently, the registered CTP scans were smoothed using a bilateral filter with a kernel of size 3 × 3 × 3 mm × 20 HU. The arterial input function was determined automatically as described elsewhere (14). An in-house developed model-based non-linear regression method generated the perfusion maps of the cerebral blood flow, the cerebral blood volume, the mean transit time, and the time to peak (15). From these perfusion maps, a logistic model (that is described elsewhere) determined the hypoperfused region (i.e., the infarct core and the penumbra taken together) (16).
Indicating vessel occlusion locations with CTP
For each patient, we aligned the atlas with the downstream regions to the CTP scan by an affine transformation using Elastix. For each downstream region, we calculated the intersection-over-union with the hypoperfused region, i.e., the volume of the region that is both the downstream region and the hypoperfused region (the intersection) divided by the volume of the region that is either the downstream region or the hypoperfused region or both (the union). The downstream region with the highest intersection-over-union with the hypoperfused region was considered to indicate the vessel occlusion location. We restricted the calculation of the intersection-over-union to slices with a perfusion deficit, and we used the Zadeh operators to determine the intersection and the union (17).
Assessing classification with performance metrics
We compared the indicated vessel occlusion locations from CTP and the annotated vessel occlusion locations from CTA with a confusion matrix (also known as an error matrix), considering the annotations from CTA as the reference class and the indications from CTP as the predicted class. To elicit some properties of our atlas-based model, we also looked at two (separate) variations of this confusion matrix. The first variation was to consider both the best and second-best downstream regions in order to examine the extent of wrong indications. For example, if the annotation was M1p, the best indication was M1d, and the second-best indication was M1p, then we would count the classification as correct. The second variation was a dichotomization of vessel occlusion locations into anterior large vessel occlusions and other vessel occlusions because CTP has been shown to improve the detection of CTA of vessel occlusions that are not anterior large vessel occlusions (9, 10). Anterior large vessel occlusions were defined as ICA, M1p, M1d, and the first segment of the ACA (A1). We visualized the confusion matrices with stacked bar graphs.
We derived several performance metrics from the confusion matrices. The accuracy is the number of matching annotations and indications divided by the number of patients. For each vessel occlusion location, we determined the precision and the recall. Given an indication, the precision is the probability that it matches the annotation. Given an annotation, the recall is the probability that it matches the indication.
To indicate the agreement between annotations and indications, we computed Cohen's kappa coefficient (with its 95% confidence interval). Cohen's kappa coefficient is a statistic that measures the overall agreement between two different categorizations of the same data. Mathematically, Cohen's kappa is defined as one minus the quotient of the relative observed disagreement and the hypothetical probability of chance disagreement. We evaluated Cohen's kappa coefficient qualitatively according to the levels of agreement: poor (<0.00), slight (0.00–0.20), fair (0.21–0.40), moderate (0.41–0.60), substantial (0.61–0.80), and almost perfect (0.81–1.00) (18).
Results
A total of 620 patients were included. The included patients had a mean age of 67 years (SD: 15 years), a median NIHSS quintile of 4 (Q1–Q3: 3–5), a mean time from onset to imaging of 148 min (SD: 121 min), a median 3-month follow-up mRS of 3 (Q1–Q3: 1–4), and 57% were male (N: 353).
Table 2 shows the confusion matrix for the annotations and indications. The annotations and indications matched 48% (299/620) of the patients. Based on chance alone, the classification of seven categories would result in an accuracy of 14% (=1/7). For 23 patients (4%), there was no hypoperfused region.
Table 2. The confusion matrix for the annotated vessel occlusion locations from CT angiography (CTA) and the indicated vessel occlusion locations from CT perfusion (CTP).
Table 3 presents the accuracy, Cohen's kappa, precision, and recall for each vessel occlusion location. The mean accuracy for these location-specific performance assessments was 86%, the mean precision was 46%, and the mean recall was 47%. Overall, Cohen's kappa coefficient (95% confidence interval) was 0.39 (0.35, 0.44), which indicates fair agreement. Figures 2–5 show examples of the downstream regions and the hypoperfused regions for different annotations and indications.
Figure 2. Examples of annotations (CTA) and indications (CTP) that match different segments of the middle cerebral artery. On the left, time-to-peak perfusion maps are shown. On the right, the hypoperfused regions and the downstream regions (according to Figure 1) are shown. For each example, we only regarded the M3 downstream region with the highest intersection-over-union. If displayed, these M3 downstream regions are the superior temporal region, the superior temporal region, and the precentral region (from top to bottom).
Figure 3. Examples of annotations (CTA) and indications (CTP) that match arteries other than the middle cerebral artery. On the left, time-to-peak perfusion maps are shown. On the right, the hypoperfused regions and the downstream regions (according to Figure 1) are shown. For each example, we only regarded the M3 downstream region with the highest intersection-over-union. The only displayed M3 downstream region is the superior temporal region.
Figure 4. Examples of annotations (CTA) and indications (CTP) that do not match different segments of the middle cerebral artery. On the left, time-to-peak perfusion maps are shown. On the right, the hypoperfused regions and the downstream regions (according to Figure 1) are shown. For each example, we only regarded the M3 downstream region with the highest intersection-over-union. These M3 downstream regions are the superior temporal region, the supramarginal region, the supramarginal region, the supramarginal region, and the middle temporal region (from top to bottom). The second best indications were M1p, M1d, M1p, M2, and M1d (from top to bottom).
Figure 5. Examples of annotations (CTA) and indications (CTP) that do not match arteries other than the middle cerebral artery. On the left, time-to-peak perfusion maps are shown. On the right, the hypoperfused regions and the downstream regions (according to Figure 1) are shown. For each example, we only regarded the M3 downstream region with the highest intersection-over-union. If displayed, these M3 downstream regions are the frontal white matter and the frontal white matter (from top to bottom). The second-best indications were M2, ACA, and M2 (from top to bottom).
Table 4 shows the confusion matrix for considering both the best and second-best downstream regions. The precision and the recall for the vessel occlusion locations can be found in the Supplementary material. This allowance yielded 410/620 correct matches, a mean accuracy of 91%, a mean precision of 64%, a mean recall of 64%, and an overall Cohen's kappa coefficient (95% confidence interval) of 0.62 (0.57, 0.67), which indicates substantial agreement.
Table 4. The confusion matrix for the annotated vessel occlusion locations from CT angiography (CTA) and the indicated vessel occlusion locations from CT perfusion (CTP) if we allow the second-best indication to also count as correct.
Table 5 shows the confusion matrix for the dichotomization of vessel occlusion locations into anterior large vessel occlusions and other vessel occlusions. The precision and the recall for the vessel occlusion locations can be found in the Supplementary material. This dichotomization yielded an accuracy of 80% (479/597), a mean precision of 80%, a mean recall of 80%, and a Cohen's kappa coefficient (95% confidence interval) of 0.61 (0.54, 0.67), which indicates substantial agreement.
Table 5. The confusion matrix for the annotated vessel occlusion locations from CT angiography (CTA) and the indicated vessel occlusion locations from CT perfusion (CTP) if we dichotomize the vessel occlusion locations into anterior large vessel occlusions and other vessel occlusions.
Figure 6 shows the stacked bar graphs corresponding to the confusion matrices of Tables 2, 4, 5.
Figure 6. The stacked bar graphs for the confusion matrices from Table 2 (top), Table 4 (middle), and Table 5 (bottom). We considered the annotated vessel occlusion locations from CT angiography as the reference class and the indicated vessel occlusion locations from CT perfusion as the predicted class. For the middle-stacked bar graph, we allowed the second-best indication to also count as correct. For the bottom stacked bar graph, we dichotomized the vessel occlusion locations into anterior large vessel occlusions and other vessel occlusions.
Discussion
We presented an atlas-based method in which CTP data were used to automatically indicate the vessel occlusion location in acute ischemic stroke patients. We evaluated the performance of these indications by comparing them with the vessel occlusion locations acquired from expert visual assessments of CTA. The inter-rater agreement between the annotations from CTA and the indications from CTP was fair to substantial.
We focused on locating vessel occlusions instead of detecting vessel occlusions. Studies that automatically detected vessel occlusions on CTA did not evaluate their performance in locating vessel occlusions (19–24). Instead, these studies were designed to distinguish a group of patients with a large vessel occlusion from a group of patients without a detectable vessel occlusion. Similarly, experienced readers of CTP images could distinguish a group of patients with distal vessel occlusion from a group of patients without detectable vessel occlusion (5). Although these readers did not report the vessel occlusion location, their sensitivity for detecting vessel occlusions with CTP imaging agrees with the percentage of patients that did not show hypoperfusion in our study. Furthermore, expert readers of multiphase CTA images could distinguish a group of patients with a medium vessel occlusion from a group of patients without a detectable vessel occlusion, with a large vessel occlusion, or with the occlusion of the vertebrobasilar circulation (25). This last study reported that 70% (81/116) of vessel occlusions were located correctly, whereas we indicated 48% (299/620) of vessel occlusion locations correctly.
Our atlas-based method varied in performance by the vessel occlusion location (Table 3). In particular, ICA annotations had the lowest recall (14%), and ICA indications had the second lowest precision (33%). This relative underperformance may be explained by the larger potential for blood supply via conduit collaterals for ICA annotated occlusions than for other vessel occlusions. Conduit collaterals such as the circle of Willis can redirect blood flow based on the patient-specific angioarchitecture, resulting in hypoperfused regions that may be highly variable between patients (comparing Figures 3, 5) (26–28).
Considering both the best and second-best downstream region improved our overall performance. Although the performance for occlusions of the different segments of the middle cerebral artery improved, the performance stayed roughly equal for middle cerebral artery occlusions as a whole as well as for ICA occlusions, ACA occlusions, and PC occlusions (Figure 6). This partial improvement may be due to the variation in vessel architecture of the middle cerebral artery, resulting in a considerable number of consequential boundary cases (3). For the different segments of the middle cerebral artery, only M2 annotations with an M1d indication were not resolved by considering both the best and second-best downstream region. For these M2 annotations, the second-best downstream region often was M1p because of the relatively small difference between the M1p downstream region and the M1d downstream region (Figure 4). Thus, the performance of our atlas-based method likely suffered from variation in vessel architecture, emphasizing the need for an approach that incorporates patient-specific vessel data to locate vessel occlusions.
Our atlas-based method was limited by its design. It was unfeasible to differentiate between all possible vessel occlusion locations. To illustrate, we may consider the occlusion of the recurrent artery of Heubner, the largest perforating branch from the proximal anterior cerebral artery. Occlusion of this artery may result in a perfusion deficit that is restricted to the basal ganglia. Although this perfusion deficit is distinctly different from an M1p occlusion, our atlas-based method would indicate M1p. For the sake of clarity, we decided to only allow ordinal arteries to have overlapping downstream regions/have no overlapping downstream regions of arteries that are not in ordinal relation.
Several shortcomings should be noted. Although the defined downstream regions appear reasonable (Figures 2, 4), the performance of our atlas-based method seemed to suffer from physiological variation, for example, in collateral circulation or in M2 angioarchitecture. Furthermore, in contrast with the middle cerebral artery, we did not consider occlusions of different vessels in the posterior circulation because of a limited number of patients with occlusions in the posterior circulation. Moreover, there might be a number of patients with a missed vessel occlusion on the CTA images, especially for the smaller vessel occlusions. Unfortunately, the majority of the patients included in the DUST study did not have digital subtraction angiography (DSA) imaging, so we could not compare CTA and DSA imaging for this group. Finally, technical limitations (e.g., artifacts, the registration, or the perfusion analysis) may have resulted in an inaccurate hypoperfused region, an inaccurate downstream region, an inaccurate alignment of the hypoperfused region and the downstream region, or an unfortunate scoring by the intersection-over-union (Figures 3, 5).
In conclusion, spatial CTP data can help to automatically locate vessel occlusions for acute ischemic stroke patients. However, variations in vessel architecture between patients seemed to limit the capacity of CTP data to distinguish between vessel occlusion locations more accurately. Nevertheless, the spatial layout of the hypoperfused region might be employed in combination with patient-specific vessel data to locate vessel occlusions more effectively.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving human participants were reviewed and approved by Institutional Review Board of University Medical Center Utrecht. The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
DUST (Dutch acute stroke) study investigators
The DUtch acute STroke trial (DUST) investigators are: Academic Medical Center, Amsterdam, The Netherlands (Majoie CB, Roos YB); Catharina Hospital, Eindhoven, The Netherlands (Duijm LE, Keizer K); Erasmus Medical Center, Rotterdam, The Netherlands (van der Lugt A, Dippel DW); Gelre Hospitals, Apeldoorn, The Netherlands (Droogh - de Greeve KE, Bienfait HP); Leiden University Medical Center, Leiden, The Netherlands (van Walderveen MA, Wermer MJ); Medical Center Haaglanden, The Hague, The Netherlands (Lycklama à Nijeholt GJ, Boiten J); Onze Lieve Vrouwe Gasthuis, Amsterdam, The Netherlands (Duyndam D, Kwa VI); Radboud University Nijmegen Medical Centre, Nijmegen, The Netherlands (Meijer FJ, van Dijk EJ); Rijnstate Hospital, Arnhem, The Netherlands (Kesselring FO, Hofmeijer J); St. Antonius Hospital, Nieuwegein, The Netherlands (Vos JA, Schonewille WJ); St. Elisabeth Hospital, Tilburg, The Netherlands (van Rooij WJ, de Kort PL); St. Franciscus Hospital, Rotterdam, The Netherlands (Pleiter CC, Bakker SL); University Medical Center Utrecht, Utrecht, The Netherlands (Velthuis BK, van der Schaaf IC, Dankbaar JW, Mali WP, van Seeters T, Horsch AD, Niesten JM, Biessels GJ, Kappelle LJ, Luitse MJ, van der Graaf Y); and VU Medical Center, Amsterdam, The Netherlands (Bot J, Visser MC).
Author contributions
DP: study design, analysis, interpretation of data, and manuscript draft. HM: study concept, study design, and manuscript revision. JD and BE: study design and manuscript revision. HJ, EB, BV, and CM: manuscript revision. All authors contributed to the article and approved the submitted version.
Funding
This research is part of the Leading the Change program made possible by the trial agency Zorgevaluatie Nederland.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2023.1136232/full#supplementary-material
References
1. Wannamaker R, Buck B, Butcher K. Multimodal CT in Acute Stroke. Curr Neurol Neurosci Rep. (2019) 19:63. doi: 10.1007/s11910-019-0978-z
2. Campbell BCV, Donnan GA, Lees KR, Hacke W, Khatri P, Hill MD, et al. Endovascular stent thrombectomy: the new standard of care for large vessel ischaemic stroke. Lancet Neurol. (2015) 14:846–54. doi: 10.1016/S1474-4422(15)00140-4
3. Saver JL, Chapot R, Agid R, Hassan A, Jadhav AP, Liebeskind DS, et al. Thrombectomy for distal, medium vessel occlusions: a consensus statement on present knowledge and promising directions. Stroke. (2020) 51:2872–84. doi: 10.1161/STROKEAHA.120.028956
4. Byrne D, Sugrue G, Stanley E, Walsh JP, Murphy S, Kavanagh EC, et al. Improved detection of anterior circulation occlusions: The delayed vessel sign on multiphase CT angiography. Am J Neuroradiol. (2017) 38:1911–6. doi: 10.3174/ajnr.A5317
5. Amukotuwa SA, Wu A, Zhou K, Page I, Brotchie P, Bammer R. Distal medium vessel occlusions can be accurately and rapidly detected using tmax maps. Stroke. (2021) 52:3308–17. doi: 10.1161/STROKEAHA.120.032941
6. Volny O, Cimflova P, Kadlecova P, Vanek P, Vanicek J, Menon BK, et al. Single-phase versus multiphase CT angiography in middle cerebral artery clot detection—benefits for less experienced radiologists and neurologists. J Stroke Cerebrovasc Dis. (2017) 26:19–24. doi: 10.1016/j.jstrokecerebrovasdis.2016.08.023
7. Fasen BACM, Heijboer RJJ, Hulsmans FJH, Kwee RM, CT. Angiography in evaluating large-vessel occlusion in acute anterior circulation ischemic stroke: factors associated with diagnostic error in clinical practice. Am J Neuroradiol. (2020) 41:607–11. doi: 10.3174/ajnr.A6469
8. Duvekot MHC, van Es ACGM, Venema E, Wolff L, Rozeman AD, Moudrous W, et al. Accuracy of CTA evaluations in daily clinical practice for large and medium vessel occlusion detection in suspected stroke patients. Eur Stroke J. (2021) 6:357–66. doi: 10.1177/23969873211058576
9. Becks MJ, Manniesing R, Vister J, Pegge SAH, Steens SCA, van Dijk EJ, et al. Brain CT perfusion improves intracranial vessel occlusion detection on CT angiography. J Neuroradiol. (2019) 46:124–9. doi: 10.1016/j.neurad.2018.03.003
10. Bathla G, Pillenahalli Maheshwarappa R, Soni N, Hayakawa M, Priya S, Samaniego E, et al. Do CT perfusion maps increase accuracy for detection of M2-MCA occlusions in acute ischemic stroke? J Stroke Cerebrovasc Dis. (2022) 31:106473. doi: 10.1016/j.jstrokecerebrovasdis.2022.106473
11. van Seeters T, Biessels GJ, van der Schaaf IC, Dankbaar JW, Horsch AD, Luitse MJA, et al. Prediction of outcome in patients with suspected acute ischaemic stroke with CT perfusion and CT angiography: the Dutch acute stroke trial (DUST) study protocol. BMC Neurol. (2014) 14:37. doi: 10.1186/1471-2377-14-37
12. Kaffenberger T, Venkatraman V, Steward C, Thijs VN, Bernhardt J, Desmond PM, et al. Stroke population–specific neuroanatomical CT-MRI brain atlas. Neuroradiology. (2022) 64:1557–67. doi: 10.1007/s00234-021-02875-9
13. Klein S, Staring M, Murphy K, Viergever M, Pluim J. Elastix: a toolbox for intensity-based medical image registration. IEEE Trans Med Imaging. (2010) 29:196–205. doi: 10.1109/TMI.2009.2035616
14. Peerlings D, Bennink E, Dankbaar JW, Velthuis BK, de Jong HWAM, Majoie CB, et al. Variation in arterial input function in a large multicenter computed tomography perfusion study. Eur Radiol. (2021) 31:8317–25. doi: 10.1007/s00330-021-08067-6
15. Bennink E, Oosterbroek J, Kudo K, Viergever MA, Velthuis BK, de Jong HWAM. Fast nonlinear regression method for CT brain perfusion analysis. J Med Imaging. (2016) 3:026003. doi: 10.1117/1.JMI.3.2.026003
16. Peerlings D, van Ommen F, Bennink E, Dankbaar JW, Velthuis BK, Emmer BJ, et al. Probability maps classify ischemic stroke regions more accurately than CT perfusion summary maps. Eu Radiol. (2022) 32:6367–75. doi: 10.1007/s00330-022-08700-y
17. Zadeh LA. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets Syst. (1978) 1:3–28. doi: 10.1016/0165-0114(78)90029-5
18. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. (1977) 33:159. doi: 10.2307/2529310
19. Seker F, Pfaff JAR, Mokli Y, Berberich A, Namias R, Gerry S, et al. Diagnostic accuracy of automated occlusion detection in CT angiography using e-CTA. Int J Stroke. (2022) 17:77–82. doi: 10.1177/1747493021992592
20. Amukotuwa SA, Straka M, Smith H, Chandra R V, Dehkharghani S, Fischbein NJ, et al. Automated detection of intracranial large vessel occlusions on computed tomography angiography a single center experience. Stroke. (2019) 50:2790–8. doi: 10.1161/STROKEAHA.119.026259
21. Czap AL, Bahr-Hosseini M, Singh N, Yamal J-M, Nour M, Parker S, et al. Machine learning automated detection of large vessel occlusion from mobile stroke unit computed tomography angiography. Stroke. (2021) 53:1651–6. doi: 10.1161/STROKEAHA.121.036091
22. Dehkharghani S, Lansberg M, Venkatsubramanian C, Cereda C, Lima F, Coelho H, et al. High-performance automated anterior circulation CT angiographic clot detection in acute stroke: a multireader comparison. Radiology. (2021) 298:665–70. doi: 10.1148/radiol.2021202734
23. Dovrat AY, Saban M, Merhav G, Lankri I, Abergel E, Eran A, et al. Evaluation of artificial intelligence-powered identification of large-vessel occlusions in a comprehensive stroke center. Am J Neuroradiol. (2021) 42:247–54. doi: 10.3174/ajnr.A6923
24. Luijten SPR, Wolff L, Duvekot MHC, van Doormaal P-J, Moudrous W, Kerkhoff H, et al. Diagnostic performance of an algorithm for automated large vessel occlusion detection on CT angiography. J Neurointerv Surg. (2021) 14:794–98. doi: 10.1136/neurintsurg-2021-017842
25. McDonough RV, Qiu W, Ospel JM, Menon BK, Cimflova P, Goyal M. Multiphase CTA-derived tissue maps aid in detection of medium vessel occlusions. Neuroradiology. (2021) 64:887–96. doi: 10.1007/s00234-021-02830-8
26. Van der Grond J. Collateral ability of the circle of willis in patients with unilateral internal carotid artery occlusion: border zone infarcts and clinical symptoms. Stroke. (2001) 32:2768–73. doi: 10.1161/hs1201.099892
27. Romero JR, Pikula A, Nguyen TN, Nien YL, Norbash A, Babikian VL. Cerebral collateral circulation in carotid artery disease. Curr Cardiol Rev. (2010) 5:279–88. doi: 10.2174/157340309789317887
Keywords: brain ischemia, cerebrovascular occlusions, perfusion imaging, stroke, tomography, X-ray computed
Citation: Peerlings D, de Jong HWAM, Bennink E, Dankbaar JW, Velthuis BK, Emmer BJ, Majoie CBLM and Marquering HA (2023) Spatial CT perfusion data helpful in automatically locating vessel occlusions for acute ischemic stroke patients. Front. Neurol. 14:1136232. doi: 10.3389/fneur.2023.1136232
Received: 02 January 2023; Accepted: 06 March 2023;
Published: 29 March 2023.
Edited by:
Andre Kemmling, University of Marburg, GermanyReviewed by:
Gabriel Broocks, University of Hamburg, GermanyPhilip Barber, University of Calgary, Canada
Copyright © 2023 Peerlings, de Jong, Bennink, Dankbaar, Velthuis, Emmer, Majoie and Marquering. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Daan Peerlings, ZC5wZWVybGluZ3MmI3gwMDA0MDt1bWN1dHJlY2h0Lm5s