Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 18 December 2023
Sec. Neurotrauma
This article is part of the Research Topic Artificial Intelligence in Acute Neurology View all 16 articles

Clinical performance of a multiparametric MRI-based post concussive syndrome index

Steven P. Meyers&#x;Steven P. Meyers1Adnan HiradAdnan Hirad2Patricia GonzalezPatricia Gonzalez3Jeffrey J. BazarianJeffrey J. Bazarian4Mark H. MirabelliMark H. Mirabelli5Katherine H. RizzoneKatherine H. Rizzone5Heather M. MaHeather M. Ma6Peter RosellaPeter Rosella1Saara TottermanSaara Totterman3Edward Schreyer&#x;Edward Schreyer3Jose G. Tamez-Pena&#x;
Jose G. Tamez-Pena7*
  • 1Department of Imaging Sciences, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
  • 2Department of Vascular Surgery, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
  • 3Qmetrics Technologies, Pittsford, NY, United States
  • 4Departments of Emergency Medicine, Neurology, Neurosurgery, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
  • 5Department of Orthopedics, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
  • 6Department of Physical Medicine and Rehabilitation, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
  • 7School of Medicine and Health Sciences, Tecnologico de Monterey, Monterrey, Mexico

Introduction: Diffusion Tensor Imaging (DTI) has revealed measurable changes in the brains of patients with persistent post-concussive syndrome (PCS). Because of inconsistent results in univariate DTI metrics among patients with mild traumatic brain injury (mTBI), there is currently no single objective and reliable MRI index for clinical decision-making in patients with PCS.

Purpose: This study aimed to evaluate the performance of a newly developed PCS Index (PCSI) derived from machine learning of multiparametric magnetic resonance imaging (MRI) data to classify and differentiate subjects with mTBI and PCS history from those without a history of mTBI.

Materials and methods: Data were retrospectively extracted from 139 patients aged between 18 and 60 years with PCS who underwent MRI examinations at 2 weeks to 1-year post-mTBI, as well as from 336 subjects without a history of head trauma. The performance of the PCS Index was assessed by comparing 69 patients with a clinical diagnosis of PCS with 264 control subjects. The PCSI values for patients with PCS were compared based on the mechanism of injury, time interval from injury to MRI examination, sex, history of prior concussion, loss of consciousness, and reported symptoms.

Results: Injured patients had a mean PCSI value of 0.57, compared to the control group, which had a mean PCSI value of 0.12 (p = 8.42e-23) with accuracy of 88%, sensitivity of 64%, and specificity of 95%, respectively. No statistically significant differences were found in the PCSI values when comparing the mechanism of injury, sex, or loss of consciousness.

Conclusion: The PCSI for individuals aged between 18 and 60 years was able to accurately identify patients with post-concussive injuries from 2 weeks to 1-year post-mTBI and differentiate them from the controls. The results of this study suggest that multiparametric MRI-based PCSI has great potential as an objective clinical tool to support the diagnosis, treatment, and follow-up care of patients with post-concussive syndrome. Further research is required to investigate the replicability of this method using other types of clinical MRI scanners.

Introduction

Traumatic brain injuries (TBIs) are evaluated based on clinical symptoms, neurological impairments, and imaging findings (15). The majority (80–90%) of TBIs are mild, characterized by Glasgow Coma Scale scores of 13–15 (57). Mild TBI (mTBI) and concussion are often used interchangeably, with sports-related concussions being a subtype (6, 8). It is estimated that 1.4–3.8 million concussions occur annually in the US and are caused by sports, recreational activities, falls, assaults, and motor vehicle accidents (1, 2, 4, 5).

Symptoms associated with concussions include headaches, amnesia, dizziness, fatigue, drowsiness, sleep disturbance, irritability, blurred vision, nausea, hypersensitivity to light and noise, emotional lability, anxiety, depression, deficits in attention, concentration, memory, executive function, balance problems, and/or loss of consciousness for less than 30 min (5, 714). Loss of consciousness occurs in 10–20% of concussions but is not required for diagnosis (1517). Most symptoms resolve within 14 days in adults and 4–6 weeks in children (4, 6, 7, 1618). However, 15–30% of mTBI patients may experience post-concussion symptoms, referred to as persistent post-concussive syndrome (PCS), for several months or longer (4, 6, 7, 1720). In the Prospective TRACK-TBI study, 33% of patients remained functionally impaired 3 months after injury, and 22.4% were not at full functional status 1 year after injury (4), further confirming that some patients with mTBI may experience long-term disability (7). Schneider et al. reported a poor 1-year cognitive outcome in 13.5% of patients with mTBI (21).

In most post-acute patients with a history of mTBI and PCS, there is no radiological evidence of brain injury using computed tomography (CT) or conventional MRI techniques (4, 5, 7, 18, 22). Recently, an advanced MRI technique, Diffusion Tensor Imaging (DTI), has been used to evaluate mild traumatic injuries in the acute, subacute, and delayed phases (5, 7, 18). However, literature reviews have found variable, inconsistent, or negative findings in the diffusion metrics between patients with PCS and controls (5, 6, 18, 22). Additionally, in patients with PCS or post-injury behavioral changes (18), diffusion imaging abnormalities were inconsistent. The inconsistencies in group differences in the locations of DTI-related white matter abnormalities have been proposed to be related to the heterogeneous nature and symptoms of mTBI, different mechanisms of injury, variable locations and phases of injury, differences in DTI protocols, and/or the limited numbers of control and subject populations (5, 18, 23). Previous studies using DTI to evaluate PCS at the group level have focused on univariate analyses of diffusion metrics such as FA, ADC, MD, RD, and AD (24). Although microstructural changes in DTI metrics have been demonstrated at the group level in patients with PCS, the complexity of advanced DTI post-analysis limits its application of these changes at the individual level in clinical settings for diagnosis, treatment, and follow-up care (18, 25).

Despite advances in measuring changes in the brain related to traumatic brain injury, there is currently no objective and reliable MRI assessment to guide clinical decision-making for individual patients with mTBI and PCS (18, 24, 25). The lack of objective data on mTBI in patients leads to challenges in the diagnosis, prognosis, and treatment of patients with a history of mTBI and PCS, based on subjective symptom reports and clinical examinations (25). To address this issue, machine learning (ML) approaches have been suggested (2628). ML has also been applied to MRI data from patients with traumatic brain injuries. For example, Mitra et al. used a ML technique to classify patients with a history of mild, moderate, or severe TBI, based on altered structural connectivity patterns within intra-and interhemispheric white matter pathways secondary to trauma (28). Additionally, Goswami et al. reported that for retired football players with a history of multiple concussions, ML of mean and radial diffusion data showed alterations involving the uncinate fasciculus, which is associated with behavioral regulation (29). Vergara et al. reported that data from resting-state fMRI used to assess network connectivity was more accurate than DTI in detecting mild traumatic brain injury at the group level (30). Luo et al. reported that a support vector machine algorithm of multiparametric fMRI data in patients with mild traumatic brain injury could improve the classification performance of mTBI compared to normal controls by using the brain regions associated with emotion and cognition (27). Lui et al. (24) reported that an algorithm developed from multi-feature analysis of data from diffusion-weighted imaging, fMRI, and volumetrics may aid in the classification of patients with mTBI compared to controls (24). Abdelrahman et al. reported that combining multiple DTI metrics improved the accuracy of identifying patients with chronic moderate brain injury, with a mean time since injury of 9 years, compared with controls (31).

ML has also been widely applied to multiparametric clinical MRI data in oncology and other medical conditions (32, 33). The purpose of using ML has been to develop clinical tools that support diagnoses, predict prognoses, and predict responses to treatment for different diseases and medical conditions (33). In our previous work, we developed a PCS index (PCSI) for patients with a history of mTBI, using a feature selection process applied to multiparametric structural and diffusion MRI data. The PCSI combines complex radiomic information from the MP RAGE series, fractional anisotropy (FA), and apparent diffusion coefficient (ADC) series (26). This method enabled the detection of post-concussive imaging changes in all series, even when no apparent findings were evident on clinical MRI exams.

The objective of this study was to further evaluate the performance of a multiparametric MRI-based PCSI to detect post-concussive injury in a real-world clinical environment. A significant limitation of the previous study was the control population, which consisted of a relatively small number of young, healthy control athletes. Here, we expand the application of the PSCI to a significantly larger number of routine clinical patients diagnosed with mTBI and patients referred for neuroimaging without history of prior brain injury to explore the associations of the PCSI with sex, mechanism of injury, elapsed time from injury, prior concussion history and clinical symptoms in patients aged 18–60.

Materials and methods

Participants

The Research Subjects Review Board of the University of Rochester approved this retrospective study. Figure 1 shows the inclusion and exclusion criteria for this retrospective review of the medical records of patients referred to an outpatient MRI center from 2016 to 2022. MRI was performed for 309 uninjured patients ranging in age from 18 to 60 years who were referred for MRI because of non-trauma related subjective complaints of headaches (n = 88), hearing loss (n = 132), or other complaints (N = 42), and who had normal MRI examinations. The uninjured patients also included 27 student athletes recruited as part of the prior study (26). A retrospective review was also performed of the medical records from 2016 to 2022 for 139 patients ranging in age from 18 to 60 years who were referred for MRI at the same facility by Sports Medicine Physicians, Physical Medicine, and Rehabilitation Physicians, or Neurologists with the diagnosis of concussion based on clinical history and combination of symptoms (4, 68, 1018). The inclusion criteria included a clinical diagnosis of concussion with persistent post-concussion symptoms (PCS) and MRI performed at least 2 weeks and no later than 12 months after mTBI, excluding those subjects with dental braces, prior brain surgery, ventricular shunts, intracranial hemorrhage, intra-axial MRI signal abnormalities, skull fractures, or standard contraindications for MR. Thirty eight patients received MR exams within 90 days from injury; 17 between 90 and 180 days from injury, 7 between 180 and 270 days from injury, with the remaining 7 between 270 days and 1 year from injury. Twenty five injured and 25 uninjured subjects were excluded due to issues with the MRI exams, such as missing series required for analysis, or excessive artifact. Patient age and sex, number of previous concussions, absence of loss of consciousness (LOC) at the most recent concussion, the time between injury and MRI, and persistent signs and symptoms were extracted from the electronic medical records. All patient identifiers were removed prior to the analysis.

FIGURE 1
www.frontiersin.org

Figure 1. Inclusion–exclusion criteria for the study participants. This paper presents the performance of the PCSI on the validation participants.

Image acquisition

All MRI exams for the concussed patients and 27 student athlete controls were performed between 2016, and 2022, on one of two 3 T Siemens Skyra MRI Scanners using a 20-channel Head/Neck Coil using the following imaging protocol: T1- weighted MP-RAGE images (FOV = 250 mm, 208 axial slices; 1 × 1 × 1 mm, TR = 1,200 ms, TE = 2.29 ms, TI = 600 ms), Flip angle = 8 degrees, 3D axial SWI images [FOV 220 mm, 88 slices/1.5 mm slice thickness (interleaved)/TR 27 ms, TE 29 ms, 1 average], DTI acquisition parameters were axial DTI/TA:10:14 min, FOV 256 mm, 70 slices, 2 mm slice thickness, TR 9,000 ms, TE 88 ms, Flip Angle 15°, 1 average, Acceleration Factor 2/ref. lines 24, diffusion directions 64, b-value 1:0 s/mm2; b-value 2:1,000 s/mm2. Diffusion images were also corrected for susceptibility distortions with the acquisition of a sequence with 64 PA reversed-phase directions. Double IR FLAIR images were obtained for the concussed patients (26).

For the other control patients (n = 309), Sagittal T1 FLAIR, Axial MP-RAGE, and DTI images were acquired identically to the concussed patients. All image sets in this study were anonymized and correlated with clinical data. Axial T2-FLAIR images were also obtained for control subjects.

Image analysis

Image preprocessing, segmentation, and quantification

For each subject, three MRI series (MPRAGE, Apparent Diffusion Coefficient, and Fractional Anisotropy) were co-registered using 3D Affine registration with spline deformation and segmented into two tissue types (gray and white matter) in eight anatomical subregions using a derivative of the 152c Montreal Brain atlas. These subregions included the right and left temporal, occipital, parietal, and frontal lobes. Five radiomic quantifications were performed, including raw signal measurement, fractal signature, and three-level wavelet decompositions, which provided information regarding the three-dimensional texture patterns of the measurements. The two tissues, three MRI series, eight subregions, and five radiomic measurements yielded 240 numeric sets, each further described by 33 statistical descriptions ranging from simple arithmetic mean and standard deviation to complex representations of numeric distribution, yielding a total set of 7,920 individual quantitative values for each subject. Logistic Regression with L1 regularization was used to estimate a subset of features to build the Post-Concussive Syndrome Index (PCSI) (34). The PCSI is a mathematical formula that produces a value between 0 and 1 for each subject based on the values of the subset of radiomic measurements, with values less than 0.5 regarded as consistent with uninjured healthy subjects and values of 0.5 or greater associated with post-concussive subjects. Thus, the PCSI value represents the probability of PCS based on the multidimensional MRI signal. Details of the image processing and ML are provided by Tamez-Peña et al. (26). All image processing was performed using CIPAS (Qmetrics Technologies, Rochester, NY), and prediction of the PCSI was carried out using R 4.1.2, with the FRESA.CAD 3.3.1 Package (35).

Statistical analysis

For each participant, we recorded the PCSI, sex, age, weight, health, origin of trauma or condition, and clinical symptoms at the time of the MRI. Age, weight, height, and PCSI of subjects in the validation set were described by mean and standard deviation and stratified by cases and controls. Statistical differences between the cases and controls were computed using t-tests for age, height, and weight. The PCSI was described using receiver operating characteristics (ROC) and the area under the ROC curve (ROCAUC). This paper also reports the accuracy, sensitivity, specificity, and diagnostic odds ratio between concussed and non-concussed subjects with their corresponding confidence intervals. The behavior of PCSI values for control group subsets (uninjured subjects with hearing loss, headaches, other indications, or young athletes) was described by frequency and PCSI association using violin plots and compared using ROC analysis. PCSI values of injured subjects were compared according to sex, loss of consciousness at the time of injury, mechanism of injury (sports, vehicular injuries, and assaults/falls), time interval from injury to MRI examination, prior concussion history, and reported symptoms. Significant associations with binary symptoms were computed using the Wilcoxon signed-rank test, and the effect size was described by ROCAUC. None of the p-values were adjusted for multiple comparisons. All statistical analyses were performed using R 4.2.2.

Results

Table 1 presents the demographic characteristics of the study participants. The MRI indication for the control/uninjured participants was hearing loss (n = 132), followed by headache (n = 88), and several other conditions (n = 42). The mechanism of injury in the case/PCS participants was sports-related (n = 34), motor vehicle use (n = 14), or other causes (n = 21). The sex distribution of the case/control sets was statistically different, where female participants were slightly more common in the control group than in the case group, although there were more females than males in both groups. There were marked differences between the age at injury of the participants (cases) and normal clinical patients (controls). Controls were slightly older (42.7 ± 11.2 years) than cases (31.9 ± 14.3 years). Another significant difference in this cohort was the weight of the control participants being heavier than the cases (90.3 ± 25.3 kg vs. 77.3 ± 20.7 kg, p < 0.001).

TABLE 1
www.frontiersin.org

Table 1. Demographics of the PCSI validation cohort.

Regarding the PCSI, Figure 2 shows the distribution of the index across all patients stratified by sex. The PCSI could separate PCS subjects from non-injury subjects using the injury threshold of 0.5 with an accuracy of 0.88 (95%CI [0.84, 0.92]), sensitivity of 0.64 (95%CI [0.51, 0.75]), specificity of 0.95 (95%CI [0.91, 0.97]), diagnostic odds ratio (DOR) of 31 (95%CI [15, 65]), and ROCAUC 0.87 (95%CI [0.82, 0.92]). The performance of the index was similar between males and females with sensitivity, specificity, and DOR of 0.63, 0.97, and 63 vs. 0.64, 0.93, and 23 for males and females, respectively.

FIGURE 2
www.frontiersin.org

Figure 2. Distribution of the PCSI. Top left, violin plots of the cases and controls stratified by gender. Top right, ROC plot of all subjects. Bottom plots, ROC plots of Males and Females.

Because there was a strong age imbalance between the cases and controls, we tested the hypothesis that the index was not associated with the participant’s age. The test consisted of modeling the PCSI by participant age adjusted by subject class (Case or Control). The results of the model indicated that subject class predicted most of the variance in the PCSI (p < 0.001), while age did not (p = 0.42). Hence, the PCSI was not affected by participant age.

Exploratory analysis of the PCSI

Table 2 shows the distribution of the most common PCS symptoms and their association with the PCSI. The most common symptom of PCS was headache (87%), followed by concentration issues (62%). Headache was not associated with the index value, but the presence of vision problems was associated with a higher index value [0.671 vs. 0.478, p(P > A) = 0.02]. Concentration problems and anxiety showed a trend [(P > A) < 0.1] of higher index values when symptoms were present. Both the symptoms had a ROCAUC of 0.6. Figure 3 shows the distribution of the PCSI for the three top symptoms as well as the distribution of the PCSI and the presence of neck pain. The neck pain results showed a negative trend of having a lower index value for subjects reporting neck pain vs. patients without neck pain [p = 0.440, A = 0.636, p(P < A) = 0.03].

TABLE 2
www.frontiersin.org

Table 2. Symptoms and PCSI.

FIGURE 3
www.frontiersin.org

Figure 3. Violin plots of the distributions of the PCSI based on the case symptoms. Subjects reporting vision problems had PCSI values larger than subjects without problems (p = 0.02). Subjects reporting neck pain had lower PSCI values than subjects without neck pain (p = 0.03). The other symptoms had non-significant differences between the presence or absence of symptoms.

Figure 4 shows the distribution of the PCSI concerning the history of previous concussions, loss of consciousness, and the mechanism of trauma. In these cases, we observed a positive trend toward a higher PCSI value in the three exploratory analyses, but none of them reached statistical significance (p > 0.1).

FIGURE 4
www.frontiersin.org

Figure 4. Violin plots showing the distribution of case subjects according to the history/origin of the concussion. Left, distribution based on the number of concussions. Middle, PCSI distribution according to the history of loss of consciousness. Right, differences between the origin of the trauma: Sports injury or another traumatic event.

We also explored the effect of elapsed time from injury on the PCSI and observed a non-significant trend of diminishing index values with increasing time from injury (p = 0.12).

The final exploratory analysis explored the behavior of the index in non-trauma participants. The results are presented at the bottom of Table 2. The hearing loss, headache, and other patient subcohorts had non-significantly different PCSI values than the other non-trauma patients [p(A ≠ B) = 0.16, 0.88, and 0.09, respectively].

Discussion

This study showed that our previously developed ML-based classifier, the PCSI, enabled differentiation of real-world patients with clinically diagnosed mTBI from those without history of head injury with statistical accuracy (26). In this study, we further evaluated the performance of the PCSI by classifying a broader demographic of injured patients with PCS and comparing them with a broader control population of uninjured subjects aged between 18 and 60 years, imaged on multiple MRI scanners. The results of this study indicate that PCSI performed well in the real-world population, with a mean PCSI value of 0.57 for patients with PCS and a mean PCSI value of 0.12 for control subjects (ROCAUC 0.87, 95%CI [0.84, 0.92]). The PCSI had a sensitivity of 64%, specificity of 95%, and accuracy of 88% for the evaluation of patients with PCS. Clear differences in PCSI between controls and injured patients were observed across population subgroups, including females, males, sports-related mTBI, and non-sports-related mTBI, as well as sub-cohorts of injured and non-injured athletes. These results further suggest that the PCSI detects post-injury microtrauma, and that mTBI subjects with PCS exhibit significant differences in the content of the MRI information from combined structural and DTI image data as compared to uninjured subjects.

The PCSI performance of 88% accuracy with 65% sensitivity compares well with the reported work of Fleck et al. (36) that showed classification accuracy of only 62%. The main difference is that our work is based on an open adult population, while their study concentrated on an adolescent population. Other studies on the use of AI in mTBI showed similar performance, with sensitivity varying from 68% (Mitra) (28), 79% (Goswami) (29), to 89% (Vergara) (30). Even though these last three studies used mTBI subjects instead of PCS subjects, they illustrated that AI has an important role in identifying subtle differences in brain function or microstructure that may have clinical relevance in the near future.

Although performance of the PSCI is good, the current method is based on a simple logistic model with L1 penalization. In the future, a more elaborate ML method may be able to be implemented, considering the source of individual misclassification errors, or the inclusion of additional clinically relevant information to further enhance accuracy. Furthermore, the presented results were validated using the same hardware, obtained using the same protocol on the same types of 3.0 Tesla MRI scanners, thus enabling data harmonization. Therefore, the performance of the developed PCSI must be evaluated on other types of MRI scanners, such as 3 or 1.5 Tesla, and with other diffusion tensor imaging protocols.

No significant differences were found in the PCSI based on sex for the control group or the mTBI cohort, consistent with previously reported results regarding the effect of sex on the frequency of PCS and rate of clinical recovery (37). The analysis of the PCSI showed a non-statistically significant, slightly downward trend associated with increased time intervals between injury and MRI. These findings are similar to those of multiple prior studies that showed persistent changes in individual DTI metrics from weeks to months after mTBI although the specific DTI metrics were inconsistent in their behavior (5, 18, 3841). These observations are consistent with previous findings of partial resolution of alterations in AD and MD in cerebral white tracts from 2 weeks to 6 months post-mTBI, compared with persistent changes in lower FA. Contradictory results have been reported regarding the outcome of patients with PCS in relation to the number of prior concussions (17, 40, 42, 43). In our study, the relationship between the number of prior concussions and the PCSI showed a trend of increasing PCSI values for subjects with a history of more prior concussions; however, this did not reach statistical significance. In our study, no statistically significant differences were found in the PCSI values when comparing sub-cohorts of injured subjects who lost consciousness at the time of injury and those who did not, consistent with previous reports that loss of consciousness is not associated with an increased rate and duration of PCS (17, 44).

The exploratory analysis of the case subjects revealed that certain symptoms were associated with higher PCSI values. Specifically, we found that participants with vision problems had higher PCSI values than those without vision problems. Similar trends were observed for anxiety and concentration. As illustrated in Figure 3, subjects who reported vision problems, including blurring, had higher index values than those who did not (45). Upon examination, all patients with vision problems complained of either binocular blurred vision or convergence insufficiency. At least 12 of the 30 participants with vision problems also reported LOC after a concussive episode. Unfortunately, a complete ophthalmologic report was unavailable for these subjects; therefore, our ability to localize the potential injury site was limited. However, blurred vision is often the result of diplopia or nystagmus, which can occur from dysfunction in pathways located in the midbrain, a region with known biomechanical vulnerability to concussive forces (45). The connection between these symptoms and midbrain dysfunction is more likely for the subset of subjects presenting with both blurred vision and LOC, indicating midbrain-thalami involvement.

It is worth noting that the PCSI was negatively correlated with the presence of neck pain in the subset of cases whose trauma originated from motor vehicle accidents, which suggests the possibility of PCS symptoms originating from neck injury rather than structural brain microtrauma, assuming greater prevalence of neck injury due to MVA than other causes of mTBI (46, 47).

Our prior study suggested that the PCSI was able to detect structural post-injury microtrauma in the brain, but was limited by a small, relatively young control demographic. In this study, we expanded the study of the PCSI to include subjects injured in everyday activities outside of athletics, and uninjured subjects undergoing neuroimaging for tinnitus and migraine, but otherwise healthy, with normal MRI exam findings and no history of head trauma. This larger study population, imaged on multiple MRI scanners, demonstrated that the PCSI continued to accurately differentiate subjects with history of mTBI and PCS from those without, even those with similar symptoms (headache). The results presented continue to suggest the PCSI detects structural microtrauma associated with mTBI. Significant limitations include a lack of objective data confirming neurological injury, such as histopathology or force vector data from the injury event that could be compared with PSCI results to show positive correlation with injury. PCSI values could add confidence to diagnosis of concussion and determination of return to activity based on resolution of symptoms. Although our data trends show the PCSI diminishes with time from injury, we have no proof that the PCSI follows patient recovery from mTBI, given the lack of PCSI information from mTBI patients without PCS, e.g., those who have clinically recovered. Thus, the results presented in this study do not conclusively indicate whether the PCSI can predict the resolution of PCS or whether brain changes observed due to mTBI are permanent fixtures in affected patients. We hope to address this in future work examining longitudinal correlation of PCSI values and symptomatic recovery, perhaps providing prognostic information about recovery timelines. Sub-regional PSCI information could also help physicians determine patient-specific recovery therapy.

Conclusion

The results of this study show that the previously developed PCSI applied to multiparametric MR data from individuals aged between 18 and 60 years can accurately classify and differentiate patients with PCS from controls from 2 weeks to 1 year after mTBI with high sensitivity, specificity, and accuracy. No statistically significant differences were found in the PCSI values when compared by sex or loss of consciousness at the time of injury and those who did not. The results of this study suggest that the PCSI has great potential as an objective clinical tool to support the diagnosis, treatment, and follow-up care of patients with PCS. Further research is required to investigate the replicability of this method using other types of clinical MRI scanners. The PCSI could also provide sub-regional information about MRI-based structural abnormalities; additional investigation to compare localized PCSI data with objective data on injury localization would further increase confidence in the correlation of the PCSI values with post-traumatic brain injury microtrauma. Finally, work to examine PCSI behavior on patients recovering from mTBI including those who have recovered symptomatically, e.g., without PCS, could provide useful information on the relationship between symptomatic resolution and whether this is due to brain plasticity or the healing of structural injuries.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by the University of Rochester Office for Human Subject Protection. The studies were conducted in accordance with the local legislation and institutional requirements. The ethics committee/institutional review board waived the requirement of written informed consent for participation from the participants or the participants’ legal guardians/next of kin because This research study involves a retrospective analysis of existing data only and there is no more than minimal risk to subjects. Due to the size of the study it would be impractical to locate and contact the potential subjects and burdensome for them to provide consent. In addition, no personally-identifiable information is being extracted, making it impossible to identify and locate individuals to request consent. Once subjects are selected for inclusion in this study, PHI will be removed for analysis and results reporting. For these reasons, waiving informed consent will not adversely affect the rights of subjects.

Author contributions

SM: Conceptualization, Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing. AH: Writing – original draft, Writing – review & editing. PG: Formal analysis, Writing – review & editing. JB: Writing – review & editing. MM: Writing – review & editing. KR: Writing – review & editing. HM: Writing – review & editing. PR: Data curation, Writing – review & editing. ST: Formal analysis, Validation, Writing – original draft, Writing – review & editing. ES: Formal analysis, Project administration, Writing – original draft, Writing – review & editing. JT-P: Conceptualization, Formal analysis, Investigation, Methodology, Software, Supervision, Validation, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

The authors would like to acknowledge Jared Noble for assistance with data handling and management, and Colleen Cottrell for assistance with coordinating IRB submission and manuscript review.

Conflict of interest

JT-P, ST, ES, and PG were shareholders of Qmetrics Technologies.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

AI, artificial intelligence; ML, machine learning; mTBI, mild traumatic brain injury; SRC, sports related concussion; PCS, post-concussion syndrome; DTI, diffusion weighted imaging; FA, fractional anisotropy mapping from DTI sequences; ADC, apparent diffusion coefficient from DTI sequences

References

1. Taylor, CA, Bell, JM, Breiding, MJ, and Xu, LK. Traumatic brain injury-related emergency department visits, hospitalizations, and deaths - United States, 2007 and 2013. MMWR Surveill Summ. (2017) 66:1–16. doi: 10.15585/mmwr.ss6609a1

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Langlois, JA, Rutland-Brown, W, and Wald, MM. The epidemiology and impact of traumatic brain injury - a brief overview. J Head Trauma Rehabil. (2006) 21:375–8. doi: 10.1097/00001199-200609000-00001

CrossRef Full Text | Google Scholar

3. Narayana, PA. White matter changes in patients with mild traumatic brain injury: MRI perspective. Concussion. (2017) 2:CNC35. doi: 10.2217/cnc-2016-0028

PubMed Abstract | CrossRef Full Text | Google Scholar

4. McMahon, P, Hricik, A, Yue, JK, Puccio, AM, Inoue, T, Lingsma, HF, et al. Symptomatology and functional outcome in mild traumatic brain injury: results from the prospective TRACK-TBI study. J Neurotrauma. (2014) 31:26–33. doi: 10.1089/neu.2013.2984

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Asken, BM, DeKosky, ST, Clugston, JR, Jaffee, MS, and Bauer, RM. Diffusion tensor imaging (DTI) findings in adult civilian, military, and sport-related mild traumatic brain injury (mTBI): a systematic critical review. Brain Imaging Behav. (2018) 12:585–612. doi: 10.1007/s11682-017-9708-9

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Levin, HS, and Diaz-Arrastia, RR. Diagnosis, prognosis, and clinical management of mild traumatic brain injury. Lancet Neurol. (2015) 14:506–17. doi: 10.1016/S1474-4422(15)00002-2

CrossRef Full Text | Google Scholar

7. Shenton, ME, Hamoda, HM, Schneiderman, JS, Bouix, S, Pasternak, O, Rathi, Y, et al. A review of magnetic resonance imaging and diffusion tensor imaging findings in mild traumatic brain injury. Brain Imaging Behav. (2012) 6:137–92. doi: 10.1007/s11682-012-9156-5

PubMed Abstract | CrossRef Full Text | Google Scholar

8. McCrory, P, Feddermann-Demont, N, Dvořák, J, Cassidy, JD, McIntosh, A, Vos, PE, et al. What is the definition of sports-related concussion: a systematic review. Br J Sports Med. (2017) 51:877–87. doi: 10.1136/bjsports-2016-097393

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Vallières, M, Kay-Rivest, E, Perrin, LJ, Liem, X, Furstoss, C, Aerts, HJWL, et al. Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer. Sci Rep. (2017) 7:10117. doi: 10.1038/s41598-017-10371-5

PubMed Abstract | CrossRef Full Text | Google Scholar

10. McCrory, P, Meeuwisse, WH, Aubry, M, Cantu, RC, Dvořák, J, Echemendia, RJ, et al. Consensus statement on concussion in sport: the 4th international conference on concussion in sport, Zurich, November 2012. J Athl Train. (2013) 48:554–75. doi: 10.1136/bjsports-2013-092313

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Ruff, RM, Iverson, GL, Barth, JT, Bush, SS, and Broshek, DK, the NAN Policy and Planning Committee. Recommendations for diagnosing a mild traumatic brain injury: a National Academy of neuropsychology education paper. Arch Clin Neuropsychol. (2009) 24:3–10. doi: 10.1093/arclin/acp006

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Carroll, LJ, Cassidy, JD, Holm, L, Kraus, J, and Coronado, VG. Methodological issues and research recommendations for mild traumatic brain injury: the WHO collaborating Centre task force on mild traumatic brain injury. J Rehabil Med. (2004) 36:113–25. doi: 10.1080/16501960410023877

CrossRef Full Text | Google Scholar

13. Kontos, AP, Elbin, RJ, Schatz, P, Covassin, T, Henry, L, Pardini, J, et al. A revised factor structure for the post-concussion symptom scale baseline and postconcussion factors. Am J Sports Med. (2012) 40:2375–84. doi: 10.1177/0363546512455400

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Scorza, KA, and Cote, W. Current concepts in concussion: initial evaluation and management. Am Fam Physician. (2019) 99:426–34.

PubMed Abstract | Google Scholar

15. Mullally, WJ. Concussion. Am J Med. (2017) 130:885–92. doi: 10.1016/j.amjmed.2017.04.016

CrossRef Full Text | Google Scholar

16. McCrory, P, Meeuwisse, W, Dvorak, J, Aubry, M, Bailes, J, Broglio, S, et al. Consensus statement on concussion in sport-the 5th international conference on concussion in sport held in Berlin, October 2016. Br J Sports Med. (2017) 51:838–47. doi: 10.1136/bjsports-2017-097699

CrossRef Full Text | Google Scholar

17. Tator, CH, Davis, HS, Dufort, PA, Tartaglia, MC, Davis, KD, Ebraheem, A, et al. Postconcussion syndrome: demographics and predictors in 221 patients. J Neurosurg. (2016) 125:1206–16. doi: 10.3171/2015.6.JNS15664

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Gumus, M, Santos, A, and Tartaglia, MC. Diffusion and functional MRI findings and their relationship to behaviour in postconcussion syndrome: a scoping review. J Neurol Neurosurg Psychiatry. (2021) 92:1259–70. doi: 10.1136/jnnp-2021-326604

PubMed Abstract | CrossRef Full Text | Google Scholar

19. McCauley, SR, Boake, C, Levin, HS, Contant, CF, and Song, JX. Postconcussional disorder following mild to moderate traumatic brain injury: anxiety, depression, and social support as risk factors and comorbidities. J Clin Exp Neuropsychol. (2001) 23:792–808. doi: 10.1076/jcen.23.6.792.1016

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Nelson, LD, Temkin, NR, and Dikmen, S. Recovery after mild traumatic brain injury in patients presenting to US level 1 trauma centers: a transforming research and clinical knowledge in traumatic brain injury (TRACK-TBI) study. JAMA Neurol. (2019) 76:1049–520. doi: 10.1001/jamaneurol.2019.1313

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Ganesh, A, and Galetta, S. Editors' note: cognitive outcome 1 year after mild traumatic brain injury: results from the TRACK-TBI study. Neurology. (2022) 99:773–3. doi: 10.1212/WNL.0000000000201414

CrossRef Full Text | Google Scholar

22. Rausa, VC, Shapiro, J, Seal, ML, Davis, GA, Anderson, V, Babl, FE, et al. Neuroimaging in paediatric mild traumatic brain injury: a systematic review. Neurosci Biobehav Rev. (2020) 118:643–53. doi: 10.1016/j.neubiorev.2020.08.017

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Levin, HS, Temkin, NR, Barber, J, Nelson, LD, Robertson, C, Brennan, J, et al. Association of sex and age with mild traumatic brain injury-related symptoms: a TRACK-TBI study. JAMA Netw Open. (2021) 4:e213046. doi: 10.1001/jamanetworkopen.2021.3046

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Lui, YW, Xue, YY, Kenul, D, Ge, YL, Grossman, RI, and Wang, Y. Classification algorithms using multiple MRI features in mild traumatic brain injury. Neurology. (2014) 83:1235–40. doi: 10.1212/WNL.0000000000000834

PubMed Abstract | CrossRef Full Text | Google Scholar

25. McDonald, MA, Tayebi, M, McGeown, JP, Kwon, EE, Holdsworth, SJ, and Danesh-Meyer, HV. A window into eye movement dysfunction following mTBI: a scoping review of magnetic resonance imaging and eye tracking findings. Brain Behav. (2022) 12:e2714. doi: 10.1002/brb3.2714

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Tamez-Peña, J, Rosella, P, Totterman, S, Schreyer, E, Gonzalez, P, Venkataraman, A, et al. Post-concussive mTBI in student athletes: MRI features and machine learning. Front Neurol. (2022) 12:12. doi: 10.3389/fneur.2021.734329

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Luo, XP, Lin, DZ, Xia, SW, Wang, D, Weng, X, Huang, W, et al. Machine learning classification of mild traumatic brain injury using whole-brain functional activity: a radiomics analysis. Dis Markers. (2021) 2021:1–7. doi: 10.1155/2021/3015238

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Mitra, J, Shen, KK, Ghose, S, Bourgeat, P, Fripp, J, Salvado, O, et al. Statistical machine learning to identify traumatic brain injury (TBI) from structural disconnections of white matter networks. Neuroimage. (2016) 129:247–59. doi: 10.1016/j.neuroimage.2016.01.056

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Goswami, R, Dufort, P, Tartaglia, MC, Green, RE, Crawley, A, Tator, CH, et al. Frontotemporal correlates of impulsivity and machine learning in retired professional athletes with a history of multiple concussions. Brain Struct Funct. (2016) 221:1911–25. doi: 10.1007/s00429-015-1012-0

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Vergara, VM, Mayer, AR, Damaraju, E, Kiehl, KA, and Calhoun, V. Detection of mild traumatic brain injury by machine learning classification using resting state functional network connectivity and fractional anisotropy. J Neurotrauma. (2017) 34:1045–53. doi: 10.1089/neu.2016.4526

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Abdelrahman, HAF, Ubukata, S, Ueda, K, Fujimoto, G, Oishi, N, Aso, T, et al. Combining multiple indices of diffusion tensor imaging can better differentiate patients with traumatic brain injury from healthy subjects. Neuropsychiatr Dis Treat. (2022) 18:1801–14. doi: 10.2147/NDT.S354265

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Nakagawa, M, Nakaura, T, Namimoto, T, Kitajima, M, Uetani, H, Tateishi, M, et al. Machine learning based on multi-parametric magnetic resonance imaging to differentiate glioblastoma multiforme from primary cerebral nervous system lymphoma. Eur J Radiol. (2018) 108:147–54. doi: 10.1016/j.ejrad.2018.09.017

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Nakagawa, M, Nakaura, T, Yoshida, N, Azuma, M, Uetani, H, Nagayama, Y, et al. Performance of machine learning methods based on multi-sequence textural parameters using magnetic resonance imaging and clinical information to differentiate malignant and benign soft tissue tumors. Acad Radiol. (2023) 30:83–92. doi: 10.1016/j.acra.2022.04.007

CrossRef Full Text | Google Scholar

34. Tibshirani, R. Regression shrinkage and selection via the lasso. J R Stat Soc B Methodol. (1996) 58:267–88. doi: 10.1111/j.2517-6161.1996.tb02080.x

CrossRef Full Text | Google Scholar

35. Tamez-Pena, JG, and Tamez-Pena, MJG. Package ‘FRESA. CAD’ (2014). Available at: https://rdocumentation.org/packages/FRESA.CAD/versions/3.4.7

Google Scholar

36. Fleck, DE, Ernest, N, Asch, R, Adler, CM, Cohen, K, Yuan, W, et al. Predicting post-concussion symptom recovery in adolescents using a novel artificial intelligence. J Neurotrauma. (2021) 38:830–6. doi: 10.1089/neu.2020.7018.

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Gupte, R, Brooks, W, Vukas, R, Pierce, J, and Harris, J. Sex differences in traumatic brain injury: what we know and what we should know. J Neurotrauma. (2019) 36:3063–91. doi: 10.1089/neu.2018.6171

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Kim, E, Yoo, RE, Seong, MY, and Oh, BM. A systematic review and data synthesis of longitudinal changes in white matter integrity after mild traumatic brain injury assessed by diffusion tensor imaging in adults. Eur J Radiol. (2022) 147:110117. doi: 10.1016/j.ejrad.2021.110117

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Jain, B, Das, AK, Agrawal, M, Babal, R, and Purohit, DK. Implications of DTI in mild traumatic brain injury for detecting neurological recovery and predicting long-term behavioural outcome in paediatric and young population-a systematic review. Childs Nerv Syst. (2021) 37:2475–86. doi: 10.1007/s00381-021-05240-6

CrossRef Full Text | Google Scholar

40. Manley, G, Gardner, AJ, Schneider, KJ, Guskiewicz, KM, Bailes, J, Cantu, RC, et al. A systematic review of potential long-term effects of sport-related concussion. Br J Sports Med. (2017) 51:969–77. doi: 10.1136/bjsports-2017-097791

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Wu, YC, Harezlak, J, Elsaid, NMH, Lin, Z, Wen, Q, Mustafi, SM, et al. Longitudinal white-matter abnormalities in sports-related concussion a diffusion MRI study. Neurology. (2020) 95:E781–92. doi: 10.1212/WNL.0000000000009930

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Kerr, ZY, Zuckerman, SL, Wasserman, EB, Vander Vegt, CB, Yengo-Kahn, A, Buckley, TA, et al. Factors associated with post-concussion syndrome in high school student-athletes. J Sci Med Sport. (2018) 21:447–52. doi: 10.1016/j.jsams.2017.08.025

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Gaudet, CE, Iverson, GL, Kissinger-Knox, A, Van Patten, R, and Cook, NE. Clinical outcome following concussion among college athletes with a history of prior concussion: a systematic review. Sports Med Open. (2022) 8:134. doi: 10.1186/s40798-022-00528-6

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Zuckerman, SL, Yengo-Kahn, AM, Buckley, TA, Solomon, GS, Sills, AK, and Kerr, ZY. Predictors of postconcussion syndrome in collegiate student-athletes. Neurosurg Focus. (2016) 40:E13. doi: 10.3171/2016.1.FOCUS15593

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Hirad, AA, Bazarian, JJ, Merchant-Borna, K, Garcea, FE, Heilbronner, S, Paul, D, et al. A common neural signature of brain injury in concussion and subconcussion. Sci Adv. (2019) 5:eaau3460. doi: 10.1126/sciadv.aau3460

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Kennedy, E, Chapple, C, Quinn, D, and Tumilty, S. Can the neck contribute to persistent symptoms post concussion? Long-term follow up from a prospective descriptive case series. J Man Manip Ther. (2021) 29:318–31. doi: 10.1080/10669817.2021.1920276

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Kasch, H, and Jensen, LL. Minor head injury symptoms and recovery from whiplash injury: a 1-year prospective study. Rehabil Process Outcome. (2019) 8:117957271984563. doi: 10.1177/1179572719845634

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: post-concussive syndrome, MTBI, MRI, radiomics, diffusion imaging

Citation: Meyers SP, Hirad A, Gonzalez P, Bazarian JJ, Mirabelli MH, Rizzone KH, Ma HM, Rosella P, Totterman S, Schreyer E and Tamez-Pena JG (2023) Clinical performance of a multiparametric MRI-based post concussive syndrome index. Front. Neurol. 14:1282833. doi: 10.3389/fneur.2023.1282833

Received: 24 August 2023; Accepted: 01 December 2023;
Published: 18 December 2023.

Edited by:

Tarun Singh, University of Michigan, United States

Reviewed by:

Eduardo C. Gonzalez-Toledo, Louisiana State University, United States
Thomas Welton, National Neuroscience Institute (NNI), Singapore

Copyright © 2023 Meyers, Hirad, Gonzalez, Bazarian, Mirabelli, Rizzone, Ma, Rosella, Totterman, Schreyer and Tamez-Pena. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Jose G. Tamez-Pena, jose.tamezpena@tec.mx

†ORCID: Steven P. Meyers, https://orcid.org/0000-0003-4192-6486

Edward Schreyer, https://orcid.org/0000-0003-2573-7458

Jose G. Tamez-Pena, https://orcid.org/0000-0003-1361-5162

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.