Skip to main content

ORIGINAL RESEARCH article

Front. Neurol., 27 March 2023
Sec. Applied Neuroimaging

Effects of post-acute COVID-19 syndrome on the functional brain networks of non-hospitalized individuals

Nathan W. Churchill,,
Nathan W. Churchill1,2,3*Eugenie RoudaiaEugenie Roudaia4J. Jean Chen,,J. Jean Chen4,5,6Asaf Gilboa,Asaf Gilboa4,7Allison Sekuler,,Allison Sekuler4,7,8Xiang JiXiang Ji9Fuqiang GaoFuqiang Gao10Zhongmin Lin,Zhongmin Lin5,11Aravinthan Jegatheesan,Aravinthan Jegatheesan6,11Mario Masellis,,Mario Masellis4,10,12Maged Goubran,,,Maged Goubran6,10,11,13Jennifer S. Rabin,,Jennifer S. Rabin12,13,14Benjamin Lam,,Benjamin Lam4,10,12Ivy Cheng,,Ivy Cheng15,16,17Robert Fowler,Robert Fowler17,18Chris Heyn,Chris Heyn10,19Sandra E. Black,,Sandra E. Black4,10,12Bradley J. MacIntosh,,,Bradley J. MacIntosh5,10,11,20Simon J. Graham,,Simon J. Graham5,10,11Tom A. Schweizer,,Tom A. Schweizer1,2,21
  • 1Neuroscience Research Program, St. Michael’s Hospital, Toronto, ON, Canada
  • 2Keenan Research Centre for Biomedical Science of St. Michael’s Hospital, Toronto, ON, Canada
  • 3Physics Department, Toronto Metropolitan University, Toronto, ON, Canada
  • 4Rotman Research Institute, Baycrest Academy for Research and Education, Toronto, ON, Canada
  • 5Department of Medical Biophysics, University of Toronto, Toronto, ON, Canada
  • 6Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada
  • 7Department of Psychology, University of Toronto, Toronto, ON, Canada
  • 8Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
  • 9LC Campbell Cognitive Neurology Research Group, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
  • 10Hurvitz Brain Sciences Program, Sunnybrook Research Institute, Toronto, ON, Canada
  • 11Physical Sciences Platform, Sunnybrook Research Institute, Toronto, ON, Canada
  • 12Division of Neurology, Department of Medicine, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada
  • 13Harquail Centre for Neuromodulation, Sunnybrook Research Institute, Toronto, ON, Canada
  • 14Rehabilitation Sciences Institute, University of Toronto, Toronto, ON, Canada
  • 15Evaluative Clinical Sciences, Sunnybrook Research Institute, Toronto, ON, Canada
  • 16Integrated Community Program, Sunnybrook Research Institute, Toronto, ON, Canada
  • 17Department of Medicine, University of Toronto, Toronto, ON, Canada
  • 18Emergency and Critical Care Research Program, Sunnybrook Research Institute, Toronto, ON, Canada
  • 19Department of Medical Imaging, University of Toronto, Toronto, ON, Canada
  • 20Computational Radiology and Artificial Intelligence Unit, Division of Radiology and Nuclear Medicine, Oslo University Hospital, Oslo, Norway
  • 21Faculty of Medicine (Neurosurgery), University of Toronto, Toronto, ON, Canada

Introduction: The long-term impact of COVID-19 on brain function remains poorly understood, despite growing concern surrounding post-acute COVID-19 syndrome (PACS). The goal of this cross-sectional, observational study was to determine whether there are significant alterations in resting brain function among non-hospitalized individuals with PACS, compared to symptomatic individuals with non-COVID infection.

Methods: Data were collected for 51 individuals who tested positive for COVID-19 (mean age 41±12 yrs., 34 female) and 15 controls who had cold and flu-like symptoms but tested negative for COVID-19 (mean age 41±14 yrs., 9 female), with both groups assessed an average of 4-5 months after COVID testing. None of the participants had prior neurologic, psychiatric, or cardiovascular illness. Resting brain function was assessed via functional magnetic resonance imaging (fMRI), and self-reported symptoms were recorded.

Results: Individuals with COVID-19 had lower temporal and subcortical functional connectivity relative to controls. A greater number of ongoing post-COVID symptoms was also associated with altered functional connectivity between temporal, parietal, occipital and subcortical regions.

Discussion: These results provide preliminary evidence that patterns of functional connectivity distinguish PACS from non-COVID infection and correlate with the severity of clinical outcome, providing novel insights into this highly prevalent disorder.

1. Introduction

Severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) and the associated coronavirus disease 2019 (COVID-19) (1) represent an unprecedented global health crisis. In addition to its effects on the respiratory system, COVID-19 can significantly impact multiple organ systems, including the brain. Acute effects on the central nervous system are well documented, with hyposmia, hypogeusia, headaches and cognitive disturbances being widely reported (2). There is also evidence of neuropathology, with punctate lesions observed on clinical imaging of individuals with acute COVID-19 (3, 4), and signs of neuroinflammation, hypoxia, microvascular injury and axonal degeneration in the autopsied brains of individuals who died while infected with SARS-CoV-2 (5–8). Similar findings have also been reported in non-human primate studies, even in the absence of severe respiratory disease (9–11).

Collectively, these findings raise concerns about the long-term effects of COVID-19 on brain function in humans. Such concerns are further bolstered by growing case numbers of post-acute COVID-19 syndrome (PACS), in which symptoms and neurological issues associated with SARS-CoV-2 infection persist for more than 12 weeks post-infection (12, 13), i.e., well outside of the acute phase of the disease. This disorder has a relatively high prevalence, with conservative estimates of at least 30% among COVID-19 survivors (14). At present, however, we have a limited understanding of the functional brain changes that are associated with PACS, especially among non-hospitalized cohorts. In particular, it is unclear to what extent functional changes differ from non-COVID viral infection, and whether these changes are correlated with the severity of symptom burden. This limits our ability to identify at-risk individuals and to develop therapeutic interventions.

Blood-oxygenation-level dependent functional MRI (BOLD fMRI) provides the means to investigate the effects of PACS on brain function at the network level, based on fluctuations in local blood-oxygen levels. This technique has been used to study brain function in numerous clinical cohorts, typically by estimating functional connectivity, which reflects the temporal synchronization between brain regions. The present cross-sectional observational study examined resting-state BOLD fMRI data collected as part of the Toronto-based NeuroCOVID-19 study (15). It compared whole-brain functional networks of self-isolating individuals who tested positive for SARS-CoV-2 and subsequently experienced persistent symptoms, relative to controls who tested negative but had cold or flulike symptoms, with both groups imaged an average of 4–5 months after COVID testing. There is emerging evidence of long-term declines in cerebral blood flow (CBF) (16) and grey matter (17, 18) among non-hospitalized individuals with persistent symptoms, as well as neurometabolic deficits throughout the recovery timeline (19, 20), particularly in frontal, temporal and subcortical regions. Thus, we hypothesized that the COVID-19 group would have decreased network connectivity in these regions relative to controls, measured using BOLD fMRI. As the determination of PACS is largely based on symptom presentation, subsequent analyzes of the COVID-19 cohort also examined the relationship between self-reported symptoms and functional connectivity.

2. Materials and methods

2.1. Study participants

Participants with COVID-19 were recruited through the Department of Emergency Medicine at Sunnybrook Health Sciences Centre, Toronto, Canada; physician referral; and community advertisements, following a diagnosis of COVID-19. Diagnosis was determined in accordance with local provincial public health procedures (21), and included a nasopharyngeal or oropharyngeal swab with real-time reverse transcription polymerase chain reaction (PCR) testing, conducted at a provincially-approved facility. Participants were assessed at a minimum of 14 days post-infection and did not travel in this period. In addition, the study recruited controls who had symptoms of viral illness but tested negative for COVID-19. None of the participants had a history of neurologic or psychiatric illness, unstable cardiovascular disease, or MRI contraindications. Recruitment and data collection were carried out between May 2020 and December 2021, and the study was in accordance with the Canadian Tri-Council Policy Statement 2, with full approval of the study by the Sunnybrook Health Sciences Centre ethics board and with participants giving free and written informed consent.

2.2. Magnetic resonance imaging data

All participants were imaged at Sunnybrook Health Sciences Centre using a 3 Tesla Magnetom Prisma MRI system (Siemens Healthineers). Structural and functional imaging included a T1-weighted 3-dimensional magnetization-prepared rapid gradient-echo (MPRAGE) anatomical scan (sagittal acquisition, 1.0 mm isotropic voxels) and a 2-dimensional multi-slice blood-oxygenation-level–dependent (BOLD) resting state functional MRI scan (3.5 mm isotropic voxels, 30/2130 ms TE/TR, 250 volumes). The data were processed using a hybrid pipeline that included ANTs (advanced normalization tools; http://stnava.github.io/ANTs), AFNI (analysis of functional neuroimages; https://afni.nimh.nih.gov), FSL (FMRIB software library; https://fsl.fmrib.ox.ac.uk/fsl) and custom in-house software (see Appendix 1 for details of acquisition and preprocessing), with the final data in Montreal Neurological Institute (MNI) coordinate space and voxels resampled at 3mm isotropic resolution. Afterwards, the brain was parcellated based on the Brainnetome atlas (BNA) with cohort-specific weights obtained via mixture model fitting (22). This approach subdivided the brain into 246 regions of interest (ROIs), with 2 ROIs in bilateral inferior temporal gyri discarded due to susceptibility-related signal dropout. Pairwise functional connectivity was then computed between all remaining nodes, producing a 244×244 matrix with 29,646 unique connectivity values per participant. Outlier imaging data were identified in terms of both estimated head motion and BOLD signal fluctuations, with two participants (controls) excluded from imaging analysis; further post-hoc testing of head motion found no significant confounding effects on the main study analyses (see Appendix 1 for details).

2.3. Analysis of clinical and demographic data

Participant demographics are listed in Table 1, including age, sex and years of education; the time interval from symptom onset to imaging, and from PCR test to imaging were also reported. All participants completed a questionnaire evaluating symptom status for 9 items: fever, cough, sore throat, shortness of breath, fatigue, gastrointestinal issues, problems with smell/taste, headache and “other.” They reported whether each symptom (1) was absent, (2) had occurred but resolved, or (3) was currently ongoing. Along with individual symptom ratings, overall severity scores were obtained by summing the number of “ongoing” and “resolved” symptoms, and the “combined” total of both ongoing and resolved symptoms. Symptom counts are an established approach for measuring the severity of clinical outcome in multiple cohorts, including concussion, mild behavioral impairment and mild cognitive impairment (23–25). The approximate normality of each demographic variable was assessed by comparing its skewness and kurtosis against simulated null distributions, i.e., with the statistics calculated from normally-distributed samples (5,000 iterations). The means and standard deviations were reported for measures that did not deviate from normality at p < 0.05 and the medians with upper and lower quartiles were reported for those that did. The frequency of ongoing and resolved individual symptoms was also reported, with bootstrapped 95% confidence intervals (95%CIs) obtained by resampling on participants with replacement (2000 iterations).

TABLE 1
www.frontiersin.org

Table 1. Summary of demographic and clinical data for study participants.

A series of 2-sample bootstrap analyzes then tested for group differences in demographics (2-tailed) and in the frequencies of individual symptoms, along with the total number of ongoing, resolved and combined symptoms. Reporting included mean differences, standard errors (SE), bootstrap ratios (BSR; a z-scored statistic of effect, based on the ratio of bootstrap mean/SE) and percentile p-values (2-tailed). For analyzes of both clinical and neuroimaging data, bootstrapping was used to estimate effects, as this non-parametric approach is robust to deviations from normality and unequal variances, particularly given the unbalanced group sample sizes (26). The differences of means were reported for measures that did not deviate from normality, and the differences of medians were reported for those that did. For these analyzes, the effects of interest were identified at an uncorrected threshold of p < 0.05.

2.4. Main effects of COVID-19 on connectivity

To assess the effects of COVID-19 on brain connectivity, a general linear model (GLM) estimated the effect of group for each network node, with covariates adjusting for age and sex. Standardized coefficient values were obtained, with bootstrapping (2000 iterations) to produce BSRs and 2-tailed p-value. For the main results, significantly altered connections were identified after adjusting for multiple comparisons over all network nodes, by applying a false discovery rate (FDR) threshold of 0.05. To further localize effects and evaluate the study hypotheses, the percentage of significant connections was calculated for each pair of the seven lobes: frontal, temporal, parietal, insular, limbic, occipital, subcortical. Lobe pairs were then identified where the percentage of significant connections exceeded those expected by chance alone, by randomly permuting the location of significant connections (5,000 iterations) and generating a p-value based on the fraction of permutations with a percentage value more extreme than the data. Significance was determined at an FDR threshold of 0.05, and pairs with significantly elevated percentage values were identified. In addition, for the set of significant connections, mean connectivity values were plotted for each participant in the control and COVID-19 groups. An overall coefficient of effect b, bootstrapped 95%CI, BSR and p-value were also reported based on these mean connectivity values.

2.5. Effects of clinical covariates on connectivity

Within the COVID-19 group, secondary analyzes examined whether functional connectivity was related to the total number of “ongoing” symptoms at the time of imaging, as an index of the severity of post-COVID outcome. Bootstrapped partial correlations were conducted, adjusting for age and sex, producing BSRs and 2-tailed p-values. Significant connections were again identified after adjusting for multiple comparisons over all network nodes, by applying an FDR threshold of 0.05. The percentage of significant connections present between each pair of lobes was again recorded, and significantly elevated percentages identified based on permutation testing as previously outlined, at an FDR threshold of 0.05. For the set of significant connections, mean connectivity values were plotted for each participant with COVID-19 against their symptom score, along with the control values for reference. An overall partial correlation coefficient, bootstrapped 95%CI and p-value were also reported per group, based on these mean connectivity values. As an alternative measure of clinical outcome, partial correlations were also obtained for the “combined” symptom count (ongoing and resolved); this measure is potentially more reflective of the cumulative effects of SARS-CoV-2 infection on brain function, rather than focusing solely on the effects of ongoing symptoms.

3. Results

At the time of analysis, 51 participants with COVID-19 and 15 controls had been recruited and scanned, with fMRI and T1-weighted anatomical imaging available. Participant demographics are summarized in Table 1 for COVID-19 and control groups. Both groups were comparable in age, proportion of male and female participants and years of education. There was substantial variability in imaging time post-onset for both cohorts, with both groups assessed a median of 4–5 months after their confirmed PCR test. In terms of symptoms, participants with COVID-19 tended to report a higher number of resolved symptoms and combined symptoms (resolved and ongoing) in comparison to controls, but not a higher number of ongoing symptoms on their own. Individual symptom reporting percentages are depicted in Figure 1. In comparison to the control group, the COVID-19 group showed an increased tendency to report ongoing headache (mean increase: 25.0%, 95%CI: [13.8%, 39.2%], BSR = 4.01, p < 0.001), and resolved gastrointestinal issues (27.1% [1.2%, 49.6%], BSR = 2.09, p = 0.036). All other symptom categories showed more limited group differences (all |BSR| ≤ 1.83, p ≥ 0.085), although the average reporting rates for all resolved symptoms are consistently higher in the COVID-19 group. For a detailed list of the specific symptoms reported in the “other” category, see Appendix 2. There was substantial reporting heterogeneity between individuals, although pain and body aches were most consistently identified in both the control (3 ongoing, 2 recovered) and COVID-19 (8 ongoing, 10 recovered) groups, and were most frequently localized to the chest. Issues related to cognition and memory were among the most consistently identified in the COVID-19 group alone (7 ongoing, 3 recovered).

FIGURE 1
www.frontiersin.org

Figure 1. Symptom reporting rates for individuals with COVID-19 and controls. Bar plots summarize the percentage of participants reporting (A) ongoing symptoms and (B) resolved symptoms at time of imaging in each group. Error-bars denote bootstrapped 2-tailed 95% confidence intervals of the mean, and ‘*’ denotes group differences at p ≤ 0.05 (2-tailed).

Figure 2 compares the functional connectivity of participants with COVID-19 to controls, with 53/29,646 (0.18%) connections showing significant effects at an FDR of 0.05 (see Appendix 3, Supplementary Tables S2,S3 for details). In Figure 2A significant connections are shown to consist of uniform decreases in functional connectivity, with nodes mainly in subcortical and medial temporal regions, although frontal and parietal effects can also be seen. The greatest number of decreased connections are seen in the thalamus (22 connections total), parahippocampal gyri (19 connections), amygdala (14 connections), basal ganglia (10 connections) and superior temporal gyri (10 connections). Figure 2B shows the distribution of connections by lobe, with effects being mainly intra-temporal (p = 0.021), intra-subcortical (p < 0.001), temporal-subcortical (p = 0.001) and frontal-subcortical (p = 0.006). Figure 2C shows the difference in mean connectivity values for the participant groups, averaged over significant connections, with a mean difference of −0.159 ([−0.204, −0.119], BSR = -7.22, p < 0.001). Post-hoc analysis of the COVID-19 group found no significant associations of mean functional connectivity in these regions with years of education, days from symptom onset, days from testing, total number of ongoing symptoms, or the number of combined symptoms (ongoing and recovered), with all |BSR| ≤ 1.10 and p ≥ 0.277.

FIGURE 2
www.frontiersin.org

Figure 2. Altered network functional connectivity for individuals with COVID-19 relative to controls. (A) significant connections are depicted via lines connecting regions of interest (ROIs), with warm colors indicating increased connectivity for the COVID-19 group, and cool colors denoting decreased connectivity; line colors denote the strength of effect in terms of bootstrap ratio (BSR) and node sizes denote the number of significant connections. (B) heatmap showing the percentage of significant connections that occur between a given pair of lobes; a ‘*’ denotes significantly elevated connections for the lobe pair. (C) scatterplot showing mean connectivity values within regions of significant decrease, plotted for individuals in the COVID-19 and control groups; boxplots denote group means and 95%CIs of the mean.

Figure 3 depicts the associations between ongoing symptom count and functional connectivity within the COVID-19 group, with 41/29,646 (0.14%) connections showing significant effects at an FDR of 0.05 (see Appendix 3, Supplementary Tables S4,S5 for details). In Figure 3A the significant connections are shown to consist of mainly positive associations with ongoing symptoms, with nodes in occipital, subcortical, temporal and parietal regions. The greatest number of positively associated connections are seen in the medioventral occipital cortex (21 connections total), inferior parietal lobule (11 connections), superior parietal lobule (8 connections) and basal ganglia (7 connections), while a single negatively associated connection is seen between the right parahippocampal gyrus and left superior frontal gyrus. Figure 3B shows the distribution of connections by lobe, with effects being mainly occipital-subcortical (p < 0.001), occipital-temporal (p < 0.001) and intra-parietal (p = 0.004). Figure 3C plots the mean connectivity values of significantly positive regions against ongoing symptom count for the COVID-19 group, along with the control group for comparison purposes. The partial correlation coefficient for the COVID-19 group was of moderate strength (ρ = 0.53 [0.38, 0.68], p < 0.001) whereas the controls showed near-zero correlations with symptoms (ρ = −0.06 [−0.76, 0.81], p = 0.960). Similar analyzes were also conducted on the combined symptom count (ongoing and recovered) and depicted in Appendix 4, with a comparable pattern of significantly affected brain regions and uniformly positive associations with symptom count.

FIGURE 3
www.frontiersin.org

Figure 3. Effects of ongoing symptom count on functional connectivity for individuals with COVID-19. (A) significant connections are depicted by lines connecting regions of interest (ROIs), with warm colors indicating increased connectivity with greater symptom count, and cool colors denoting decreased connectivity; line colors denote the strength of effect in terms of bootstrap ratio (BSR) and node sizes denote the number of significant connections. (B) heatmap showing the percentage of significant connections that are between each pair of lobes; a ‘*’ denotes significantly elevated connections for the lobe pair. (C) scatterplot showing mean connectivity values within regions of significant increase, plotted against symptom count, for individuals in the COVID-19 and control groups; solid lines denote the lines of best fit and shaded areas denote the 95%CIs of the mean.

4. Discussion

The present study investigated the neural correlates of COVID-19 in self-isolating individuals that were experiencing symptoms an average of 4–5 months post-infection. This is consistent with current PACS definitions (12, 13) and it is well outside of the 4-week window in which the SARS-CoV-2 virus is actively replicating (27). The study identified significant, uniformly decreased patterns of functional connectivity for the COVID-19 group in comparison to the control group. These decreases were mainly within and between temporal and subcortical regions, including the thalamus, parahippocampal gyri, amygdala, basal ganglia and superior temporal gyri. This suggests reduced functional integration of these areas, in terms of both local and long-range connections. Previous fMRI studies conducted outside of the infectious stage of COVID-19 have yielded mixed findings; studies of persistent olfactory dysfunction have reported increased connectivity within the olfactory network (28) and default-mode network (29), and greater connectivity between these networks (29). Another study of recovered individuals showed decreased connectivity within the temporal lobe and angular gyrus, but increased connectivity within the hippocampus (30). The present study findings suggest a distinct functional response associated with PACS, although given the methodological differences in the cited studies, any comparisons should be made with caution. In particular, the cited studies compared patients to healthy uninfected controls, making it unclear to what extent the effects are specific to COVID-19 and to what extent they represent a general response to viral infection.

The present study findings are partially congruent with a recent study of cerebral blood flow (CBF) conducted in this cohort, which also found long-term reductions in CBF in the prefrontal and subcortical nuclei of non-hospitalized COVID-19 patients (16). It is also aligned with a study comparing mild and severe forms of COVID-19, where the latter group had lower CBF in temporal regions (31). These findings suggest that vascular injury may contribute at least partially to the observed BOLD connectivity effects, potentially via endothelial infiltration of SARS-CoV-2 via angiotensin-converting enzyme 2 (ACE-2) receptors (32), or alternatively via inflammatory cytokine-mediated disruption of the blood–brain barrier. Other contributors may include altered neurometabolism, as PET studies in the acute and recovery phases of COVID-19 have found signs of hypo-metabolism relative to healthy controls (19, 20), including effects within the parahippocampal gyri. Similar hypometabolic effects were also seen in the amygdala, thalamus, and hippocampus among patients with PACS (33, 34). An additional contributor may be subtle decreases in cortical tissue (17, 18), e.g., due to astrocytic infections causing neuronal death or dysfunction (35).

The affected brain regions are noteworthy, given the commonly reported cognitive and behavioral sequelae of patients with COVID-19. The thalamus and basal ganglia have key integrative roles in sensory, motor and cognitive processes (36, 37), with the thalamus in particular mediating post-infection sickness behavior (38). In addition, the thalamus, amygdala and basal ganglia are implicated in pain processing (39), and may play a role in the headache symptoms seen in this study and others (40), along with pain and body ache reported in the “other” symptoms category. The amygdala has a key role in emotion regulation and stress response, which is relevant to post-COVID mood and mental health (41, 42). Neuroplastic alterations of the amygdala may further affect memory (43), while the parahippocampal gyri are critical hubs to memory formation (44); this is an area of concern, as memory impairments often occur after COVID-19 infection (45) and were reported in a subset of participants in this study, via the “other” symptoms category. Superior temporal involvement is also noteworthy, given its role in speech and language (46); although post-COVID language issues are not commonly reported, concerns have been raised due to prior studies of viral infection (47). The above cognitive and behavioral domains were not directly assessed in this study, which is a limitation that should be addressed in future research. However, the results provide preliminary evidence for brain areas and related functional domains that should be investigated in future research, with a particular focus on sensory processing, pain, emotion regulation, memory and language.

The present study also identified significant, mostly positive associations between functional connectivity and ongoing COVID-related symptoms. These effects mainly involved connections of subcortical and temporal regions to the occipital cortex, including the medioventral occipital cortex and basal ganglia. Intra-parietal effects were also observed, including the inferior and superior parietal lobules. The results suggest that elevated connectivity is associated with more severe post-COVID symptoms. Although understudied in this cohort, the relationship between symptoms and functional connectivity has been investigated in concussion, i.e., another form of diffuse neural injury. In this cohort, symptom severity is correlated with increased connectivity between functional networks in the early symptomatic phase of injury (48, 49) and reduced segregation between lobes of the brain at 6 months post-injury, for individuals with persistent post-concussion symptoms (50). These results are consistent with the positive associations between inter-lobe connectivity and symptom count seen in the COVID-19 group. The parietal effects seen in the COVID-19 group are also partly corroborated by a recent study of CBF within this cohort, which found elevated parietal blood flow in patients endorsing fatigue-related symptoms (16). The effects seen in the present study may stem from an aggregate of neural and systemic injury, the interoceptive mechanisms involved in detecting the consequences of injury, and/or adaptive neural mechanisms engaged in response to injury. The latter interpretation is consistent with a meta-analysis that reported hyper-connectivity of parietal, temporal and subcortical regions as part of a generalized response to neural injury (51). Nevertheless, further studies are needed to definitively establish the underlying mechanisms, and whether they constitute a pathological response or an adaptation to COVID-related neural injury.

This study significantly advances our understanding of PACS and its neural correlates, however, there are also some limitations to acknowledge. The present study focused on connectivity differences in symptomatic individuals with and without COVID-19 diagnosis. However, it is unclear (a) to what extent connectivity patterns in the control group are altered by infection and (b) to what extent connectivity patterns in the COVID-19 group are specific to PACS. To this end, future research should include additional control groups, consisting of non-infected individuals and COVID-infected individuals without persistent symptoms, respectively. The studied groups were also unbalanced, with COVID-19 having a substantially larger sample than controls. This leads to diminishing power gains, although the bootstrapping approach was chosen to partially mitigate these issues. Additionally, the larger COVID-19 sample enables the more precise quantification of within-group relationships between connectivity and symptoms. There was also variability in the time interval from symptom onset to MRI scan, although including this factor as a model covariate did not yield substantial effects, nor modify the main effect of interest, suggesting it has minimal impact on our conclusions. We also did not have information about variants of SARS-CoV-2 participants were infected with, although data collection ran from May 2020 to December 2021, with PCR testing an average of 4–5 prior, hence it is likely they were infected with earlier variants. Further work is needed to determine whether the neural effects of PACS depend significantly on the viral variant. Lastly, the analyzes of symptoms rely on self-report, which may be subject to a variety of reporting biases. The strength of the associations and congruency with related research supports the results, but further studies are needed to validate these findings, with emphasis on psychological factors that influence reporting habits, such as conscientiousness and neuroticism, with support from more objective neurocognitive testing.

Overall, the findings of this study suggest persistent alterations of the functional connectome after COVID-19 infection, for non-hospitalized individuals meeting criteria for PACS. These effects also appear to have circumscribed localization, mainly to temporal and subcortical regions. Furthermore, there is a distinct pattern of occipital, temporal, subcortical and parietal connectivity associated with severity of PACS symptoms. These results indicate that physiological recovery from COVID-19 may extend well beyond the resolution of acute symptoms, with the persistence of post-COVID brain changes raising particular concerns about the cumulative effects of repeated infection on brain function (52). The results further suggest a distinct neural response related to severity of PACS symptoms, helping to better clarify the neural mechanisms that underlie heterogeneous patient outcomes after infection.

Data availability statement

The original contributions presented in the study are publicly available. This data can be found here: Figshare, https://doi.org/10.6084/m9.figshare.21797735.

Ethics statement

The studies involving human participants were reviewed and approved by Sunnybrook Health Sciences Centre ethics board. The patients/participants provided their written informed consent to participate in this study.

Author contributions

ER, JC, AG, AS, XJ, FG, ZL, AJ, MM, MG, JR, BL, IC, RF, CH, SB, BM, and SG: study design. XJ, ER, ZL, AJ, SG, and BM: data collection. NC, ER, JC, AG, AS, XJ, FG, ZL, AJ, MM, MG, JR, BL, IC, RF, CH, SB, BM, SG, and TS: data analysis and interpretation. NC, SG, and TS: manuscript writing. All authors contributed to the article and approved the submitted version.

Funding

This study is funded in part by the Sunnybrook Foundation, the SB Centre for Brain Resilience & Recovery, a Canadian Institutes of Health Research (CIHR) Project Grant (165981), and a CIHR Operating Grant on Emerging COVID-19 Research Gaps and Priorities (177756).

Acknowledgments

The authors gratefully acknowledge Ruby Endre, Garry Detzler and Sangkyu Moon for their work in imaging the research participants associated with the study. The authors also thank all participants who volunteered for the research.

Conflict of interest

SB reports payments for contract research to her institution from GE Healthcare, Eli Lilly and Company, Biogen, Genentech, Optina Diagnostics, and Roche; consulting fees and payments related to an advisory board from Roche; and payments related to an advisory board, a speaker panel, talks, and an educational session from Biogen. There were peer-reviewed grants to her institution from the Ontario Brain Institute, Canadian Institutes of Health Research, Leducq Foundation, Heart and Stroke Foundation of Canada, National Institutes of Health, Alzheimer’s Drug Discovery Foundation, Brain Canada, Weston Brain Institute, Canadian Partnership for Stroke Recovery, Canadian Foundation for Innovation, Focused Ultrasound Foundation, Alzheimer’s Association US, Department of National Defense, Montreal Medical International Kuwait, Queen’s University, Compute Canada Resources for Research Groups, CANARIE, and Networks of Centres of Excellence of Canada. She has participated on a data safety monitoring board or advisory board for the Conference Board of Canada, World Dementia Council, and University of Rochester. She has contributed to the mission and scientific leadership of the Small Vessel VCID Biomarker Validation Consortium, National Institute of Neurological Disorders and Stroke.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2023.1136408/full#supplementary-material

References

1.Zhu, N, Zhang, D, Wang, W, Li, X, Yang, B, Song, J, et al. A novel coronavirus from patients with pneumonia in China, 2019. N Engl J Med. (2020) 382:727–33. doi: 10.1056/NEJMoa2001017

PubMed Abstract | CrossRef Full Text | Google Scholar

2.Fernández-De-Las-Peñas, C, Palacios-Ceña, D, Gómez-Mayordomo, V, Florencio, LL, Cuadrado, ML, Plaza-Manzano, G, et al. Prevalence of post-COVID-19 symptoms in hospitalized and non-hospitalized COVID-19 survivors: a systematic review and meta-analysis. Eur J Intern Med. (2021) 92:55–70. doi: 10.1016/j.ejim.2021.06.009

PubMed Abstract | CrossRef Full Text | Google Scholar

3.Gulko, E, Oleksk, M, Gomes, W, Ali, S, Mehta, H, Overby, P, et al. MRI brain findings in 126 patients with COVID-19: initial observations from a descriptive literature review. Am J Neuroradiol. (2020) 41:2199–203. doi: 10.3174/ajnr.A6805

PubMed Abstract | CrossRef Full Text | Google Scholar

4.Manca, R, De Marco, M, Ince, PG, and Venneri, A. Heterogeneity in regional damage detected by neuroimaging and neuropathological studies in older adults with COVID-19: a cognitive-neuroscience systematic review to inform the long-term impact of the virus on neurocognitive trajectories. Front Aging Neurosci. (2021) 13:646908. doi: 10.3389/fnagi.2021.646908

PubMed Abstract | CrossRef Full Text | Google Scholar

5.Ho, C-Y, Salimian, M, Hegert, J, O’Brien, J, Choi, SG, Ames, H, et al. Postmortem assessment of olfactory tissue degeneration and microvasculopathy in patients with COVID-19. JAMA Neurol. (2022) 79:544–53. doi: 10.1001/jamaneurol.2022.0154

PubMed Abstract | CrossRef Full Text | Google Scholar

6.Jaunmuktane, Z, Mahadeva, U, Green, A, Sekhawat, V, Barrett, NA, Childs, L, et al. Microvascular injury and hypoxic damage: emerging neuropathological signatures in COVID-19. Acta Neuropathol. (2020) 140:397–400. doi: 10.1007/s00401-020-02190-2

PubMed Abstract | CrossRef Full Text | Google Scholar

7.Matschke, J, Lütgehetmann, M, Hagel, C, Sperhake, JP, Schröder, AS, Edler, C, et al. Neuropathology of patients with COVID-19 in Germany: a post-mortem case series. Lancet Neurol. (2020) 19:919–29. doi: 10.1016/S1474-4422(20)30308-2

PubMed Abstract | CrossRef Full Text | Google Scholar

8.Wierzba-Bobrowicz, T, Krajewski, P, Tarka, S, Acewicz, A, Felczak, P, Stępień, T, et al. Neuropathological analysis of the brains of fifty-two patients with COVID-19. Folia Neuropathol. (2021) 59:219–31. doi: 10.5114/fn.2021.108829

PubMed Abstract | CrossRef Full Text | Google Scholar

9.Beckman, D, Bonillas, A, Diniz, GB, Ott, S, Roh, JW, Elizaldi, SR, et al. SARS-CoV-2 infects neurons and induces neuroinflammation in a non-human primate model of COVID-19. Cell Rep. (2022) 41:111573. doi: 10.1016/j.celrep.2022.111573

PubMed Abstract | CrossRef Full Text | Google Scholar

10.Philippens, IH, Böszörményi, KP, Wubben, JA, Fagrouch, ZC, Van Driel, N, Mayenburg, AQ, et al. Brain inflammation and intracellular α-Synuclein aggregates in macaques after SARS-CoV-2 infection. Viruses. (2022) 14:776. doi: 10.3390/v14040776

PubMed Abstract | CrossRef Full Text | Google Scholar

11.Rutkai, I, Mayer, MG, Hellmers, LM, Ning, B, Huang, Z, Monjure, CJ, et al. Neuropathology and virus in brain of SARS-CoV-2 infected non-human primates. Nat Commun. (2022) 13:1745. doi: 10.1038/s41467-022-29440-z

PubMed Abstract | CrossRef Full Text | Google Scholar

12.Shah, W, Heightman, M, and O'brien, S. UK guidelines for managing long-term effects of COVID-19. Lancet. (2021) 397:1706. doi: 10.1016/S0140-6736(21)00847-3

PubMed Abstract | CrossRef Full Text | Google Scholar

13.World Health Organization (2021). A clinical case definition of post COVID-19 condition by a Delphi consensus, 6 October 2021 [Online]. World Health Organization. Available from: https://www.who.int/publications/i/item/WHO-2019-nCoV-Post_COVID-19_condition-Clinical_case_definition-2021.1 (Accessed Oct 30, 2022).

Google Scholar

14.Nalbandian, A, Sehgal, K, Gupta, A, Madhavan, MV, Mcgroder, C, Stevens, JS, et al. Post-acute COVID-19 syndrome. Nat Med. (2021) 27:601–15. doi: 10.1038/s41591-021-01283-z

PubMed Abstract | CrossRef Full Text | Google Scholar

15.Macintosh, BJ, Ji, X, Chen, JJ, Gilboa, A, Roudaia, E, Sekuler, AB, et al. Brain structure and function in people recovering from COVID-19 after hospital discharge or self-isolation: a longitudinal observational study protocol. Can Med Assoc Open Access J. (2021) 9:e1114–9. doi: 10.9778/cmajo.20210023

CrossRef Full Text | Google Scholar

16.Kim, WS, Ji, X, Roudaia, E, Chen, JJ, Gilboa, A, Sekuler, A, et al. MRI assessment of cerebral blood flow in nonhospitalized adults who self-isolated due to COVID-19. J Magn Reson Imaging. (2022) 1:1–11. doi: 10.1002/jmri.28555

CrossRef Full Text | Google Scholar

17.Douaud, G, Lee, S, Alfaro-Almagro, F, Arthofer, C, Wang, C, Mccarthy, P, et al. SARS-CoV-2 is associated with changes in brain structure in UK biobank. Nature. (2022) 604:697–707. doi: 10.1038/s41586-022-04569-5

PubMed Abstract | CrossRef Full Text | Google Scholar

18.Lu, Y, Li, X, Geng, D, Mei, N, Wu, P-Y, Huang, C-C, et al. Cerebral micro-structural changes in COVID-19 patients–an MRI-based 3-month follow-up study. EClinicalMedicine. (2020) 25:100484. doi: 10.1016/j.eclinm.2020.100484

PubMed Abstract | CrossRef Full Text | Google Scholar

19.Donegani, MI, Miceli, A, Pardini, M, Bauckneht, M, Chiola, S, Pennone, M, et al. Brain metabolic correlates of persistent olfactory dysfunction after SARS-Cov2 infection. Biomedicine. (2021) 9:287. doi: 10.3390/biomedicines9030287

PubMed Abstract | CrossRef Full Text | Google Scholar

20.Hosp, JA, Dressing, A, Blazhenets, G, Bormann, T, Rau, A, Schwabenland, M, et al. Cognitive impairment and altered cerebral glucose metabolism in the subacute stage of COVID-19. Brain. (2021) 144:1263–76. doi: 10.1093/brain/awab009

PubMed Abstract | CrossRef Full Text | Google Scholar

21.Public Health Ontario (2021). Coronavirus disease 2019 (COVID-19) – PCR [online]. Available from: https://www.publichealthontario.ca/en/laboratory-services/%20test-information-index/covid-19 (Accessed Sept 30, 2022).

Google Scholar

22.Churchill, NW, Madsen, K, and Mørup, M. The functional segregation and integration model: mixture model representations of consistent and variable group-level connectivity in fMRI. Neural Comput. (2016) 28:2250–90. doi: 10.1162/NECO_a_00877

PubMed Abstract | CrossRef Full Text | Google Scholar

23.Asken, BM, Houck, ZM, Bauer, RM, and Clugston, JR. SCAT5 vs. SCAT3 symptom reporting differences and convergent validity in collegiate athletes. Arch Clin Neuropsychol. (2020) 35:291–301. doi: 10.1093/arclin/acz007

PubMed Abstract | CrossRef Full Text | Google Scholar

24.Ismail, Z, Agüera-Ortiz, L, Brodaty, H, Cieslak, A, Cummings, J, Fischer, CE, et al. The mild behavioral impairment checklist (MBI-C): a rating scale for neuropsychiatric symptoms in pre-dementia populations. J Alzheimers Dis. (2017) 56:929–38. doi: 10.3233/JAD-160979

PubMed Abstract | CrossRef Full Text | Google Scholar

25.Mallo, SC, Ismail, Z, Pereiro, AX, Facal, D, Lojo-Seoane, C, Campos-Magdaleno, M, et al. Assessing mild behavioral impairment with the mild behavioral impairment-checklist in people with mild cognitive impairment. J Alzheimers Dis. (2018) 66:83–95. doi: 10.3233/JAD-180131

PubMed Abstract | CrossRef Full Text | Google Scholar

26.Sadooghi-Alvandi, S, and Jafari, AA. A parametric bootstrap approach for one-way ANCOVA with unequal variances. Commun StatTheory Methods. (2013) 42:2473–98. doi: 10.1080/03610926.2011.625486

CrossRef Full Text | Google Scholar

27.Chippa, V., Aleem, A., and Anjum, F. (2021). Post Acute Coronavirus (COVID-19) Syndrome. Treasure Island, FL: StatPearls Publishing.

Google Scholar

28.Esposito, F, Cirillo, M, De Micco, R, Caiazzo, G, Siciliano, M, Russo, AG, et al. Olfactory loss and brain connectivity after COVID-19. Hum Brain Mapp. (2022) 43:1548–60. doi: 10.1002/hbm.25741

PubMed Abstract | CrossRef Full Text | Google Scholar

29.Zhang, H, Chung, TW-H, Wong, FK-C, Hung, IF-N, and Mak, HK-F. Changes in the intranetwork and internetwork connectivity of the default mode network and olfactory network in patients with COVID-19 and olfactory dysfunction. Brain Sci. (2022) 12:511. doi: 10.3390/brainsci12040511

PubMed Abstract | CrossRef Full Text | Google Scholar

30.Cattarinussi, G, Miola, A, Trevisan, N, Valeggia, S, Tramarin, E, Mucignat, C, et al. Altered brain regional homogeneity is associated with depressive symptoms in COVID-19. J Affect Disord. (2022) 313:36–42. doi: 10.1016/j.jad.2022.06.061

PubMed Abstract | CrossRef Full Text | Google Scholar

31.Qin, Y, Wu, J, Chen, T, Li, J, Zhang, G, Wu, D, et al. Long-term microstructure and cerebral blood flow changes in patients recovered from COVID-19 without neurological manifestations. J Clin Invest. (2021) 131:e147329. doi: 10.1172/JCI147329

PubMed Abstract | CrossRef Full Text | Google Scholar

32.Meinhardt, J, Radke, J, Dittmayer, C, Franz, J, Thomas, C, Mothes, R, et al. Olfactory transmucosal SARS-CoV-2 invasion as a port of central nervous system entry in individuals with COVID-19. Nat Neurosci. (2021) 24:168–75. doi: 10.1038/s41593-020-00758-5

PubMed Abstract | CrossRef Full Text | Google Scholar

33.Guedj, E, Campion, J, Dudouet, P, Kaphan, E, Bregeon, F, Tissot-Dupont, H, et al. 18F-FDG brain PET hypometabolism in patients with long COVID. Eur J Nucl Med Mol Imaging. (2021) 48:2823–33. doi: 10.1007/s00259-021-05215-4

PubMed Abstract | CrossRef Full Text | Google Scholar

34.Sollini, M, Morbelli, S, Ciccarelli, M, Cecconi, M, Aghemo, A, Morelli, P, et al. Long COVID hallmarks on [18F] FDG-PET/CT: a case-control study. Eur J Nucl Med Mol Imaging. (2021) 48:3187–97. doi: 10.1007/s00259-021-05294-3

PubMed Abstract | CrossRef Full Text | Google Scholar

35.Crunfli, F, Carregari, VC, Veras, FP, Silva, LS, Nogueira, MH, Antunes, ASLM, et al. Morphological, cellular, and molecular basis of brain infection in COVID-19 patients. Proc Natl Acad Sci. (2022) 119:e2200960119. doi: 10.1073/pnas.2200960119

PubMed Abstract | CrossRef Full Text | Google Scholar

36.Leisman, G, and Melillo, R. The basal ganglia: motor and cognitive relationships in a clinical neurobehavioral context. Rev Neurosci. (2013) 24:9–25. doi: 10.1515/revneuro-2012-0067

PubMed Abstract | CrossRef Full Text | Google Scholar

37.Rikhye, RV, Wimmer, RD, and Halassa, MM. Toward an integrative theory of thalamic function. Annu Rev Neurosci. (2018) 41:163–83. doi: 10.1146/annurev-neuro-080317-062144

PubMed Abstract | CrossRef Full Text | Google Scholar

38.Felger, JC, and Miller, AH. Cytokine effects on the basal ganglia and dopamine function: the subcortical source of inflammatory malaise. Front Neuroendocrinol. (2012) 33:315–27. doi: 10.1016/j.yfrne.2012.09.003

PubMed Abstract | CrossRef Full Text | Google Scholar

39.Reddan, MC, and Wager, TD. Modeling pain using fMRI: from regions to biomarkers. Neurosci Bull. (2018) 34:208–15. doi: 10.1007/s12264-017-0150-1

PubMed Abstract | CrossRef Full Text | Google Scholar

40.Martelletti, P, Bentivegna, E, Spuntarelli, V, and Luciani, M. Long-COVID headache. SN Compr Clin Med. (2021) 3:1704–6. doi: 10.1007/s42399-021-00964-7

CrossRef Full Text | Google Scholar

41.Cai, X, Hu, X, Ekumi, IO, Wang, J, An, Y, Li, Z, et al. Psychological distress and its correlates among COVID-19 survivors during early convalescence across age groups. Am J Geriatr Psychiatry. (2020) 28:1030–9. doi: 10.1016/j.jagp.2020.07.003

PubMed Abstract | CrossRef Full Text | Google Scholar

42.Janiri, D, Carfì, A, Kotzalidis, GD, Bernabei, R, Landi, F, and Sani, G. Posttraumatic stress disorder in patients after severe COVID-19 infection. JAMA Psychiat. (2021) 78:567–9. doi: 10.1001/jamapsychiatry.2021.0109

PubMed Abstract | CrossRef Full Text | Google Scholar

43.Roozendaal, B, Mcewen, BS, and Chattarji, S. Stress, memory and the amygdala. Nat Rev Neurosci. (2009) 10:423–33. doi: 10.1038/nrn2651

CrossRef Full Text | Google Scholar

44.Ward, AM, Schultz, AP, Huijbers, W, Van Dijk, KR, Hedden, T, and Sperling, RA. The parahippocampal gyrus links the default-mode cortical network with the medial temporal lobe memory system. Hum Brain Mapp. (2014) 35:1061–73. doi: 10.1002/hbm.22234

PubMed Abstract | CrossRef Full Text | Google Scholar

45.Llana, T, Zorzo, C, Mendez-Lopez, M, and Mendez, M. Memory alterations after COVID-19 infection: a systematic review. Appl Neuropsychol Adult. (2022) 1:1–14. doi: 10.1080/23279095.2022.2123739

CrossRef Full Text | Google Scholar

46.Bigler, ED, Mortensen, S, Neeley, ES, Ozonoff, S, Krasny, L, Johnson, M, et al. Superior temporal gyrus, language function, and autism. Dev Neuropsychol. (2007) 31:217–38. doi: 10.1080/87565640701190841

CrossRef Full Text | Google Scholar

47.Schuller, BW, Schuller, DM, Qian, K, Liu, J, Zheng, H, and Li, X. Covid-19 and computer audition: An overview on what speech & sound analysis could contribute in the sars-cov-2 corona crisis. Front Digit Health. (2021) 3:564906. doi: 10.3389/fdgth.2021.564906

PubMed Abstract | CrossRef Full Text | Google Scholar

48.Mayer, AR, Mannell, MV, Ling, J, Gasparovic, C, and Yeo, RA. Functional connectivity in mild traumatic brain injury. Hum Brain Mapp. (2011) 32:1825–35. doi: 10.1002/hbm.21151

PubMed Abstract | CrossRef Full Text | Google Scholar

49.Zhou, Y, Milham, MP, Lui, YW, Miles, L, Reaume, J, Sodickson, DK, et al. Default-mode network disruption in mild traumatic brain injury. Radiology. (2012) 265:882–92. doi: 10.1148/radiol.12120748

PubMed Abstract | CrossRef Full Text | Google Scholar

50.Messé, A, Caplain, S, Pélégrini-Issac, M, Blancho, S, Lévy, R, Aghakhani, N, et al. Specific and evolving resting-state network alterations in post-concussion syndrome following mild traumatic brain injury. PLoS One. (2013) 8:e65470. doi: 10.1371/journal.pone.0065470

PubMed Abstract | CrossRef Full Text | Google Scholar

51.Hillary, F, Roman, C, Venkatesan, U, Rajtmajer, S, Bajo, R, and Castellanos, N. Hyperconnectivity is a fundamental response to neurological disruption. Neuropsychology. (2015) 29:59–75. doi: 10.1037/neu0000110

PubMed Abstract | CrossRef Full Text | Google Scholar

52.Brouqui, P, Colson, P, Melenotte, C, Houhamdi, L, Bedotto, M, Devaux, C, et al. COVID-19 re-infection. Eur J Clin Investig. (2021) 51:e13537. doi: 10.1111/eci.13537

CrossRef Full Text | Google Scholar

Keywords: brain function, COVID-19, functional connectivity, symptoms, fMRI

Citation: Churchill NW, Roudaia E, Chen JJ, Gilboa A, Sekuler A, Ji X, Gao F, Lin Z, Jegatheesan A, Masellis M, Goubran M, Rabin JS, Lam B, Cheng I, Fowler R, Heyn C, Black SE, MacIntosh BJ, Graham SJ and Schweizer TA (2023) Effects of post-acute COVID-19 syndrome on the functional brain networks of non-hospitalized individuals. Front. Neurol. 14:1136408. doi: 10.3389/fneur.2023.1136408

Received: 03 January 2023; Accepted: 07 March 2023;
Published: 27 March 2023.

Edited by:

Mark S. Bolding, University of Alabama at Birmingham, United States

Reviewed by:

Tracy Fischer, Tulane University, United States
Adeel Ali Memon, West Virginia University, United States
Giacomo Tondo, Vita-Salute San Raffaele University, Italy

Copyright © 2023 Churchill, Roudaia, Chen, Gilboa, Sekuler, Ji, Gao, Lin, Jegatheesan, Masellis, Goubran, Rabin, Lam, Cheng, Fowler, Heyn, Black, MacIntosh, Graham and Schweizer. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Nathan W. Churchill, nchurchill.research@gmail.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.