Grant L. Iverson
Fionn Büttner
Jaclyn B. Caccese- 1Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, United States
- 2Spaulding Research Institute, Spaulding Rehabilitation Hospital, Charlestown, MA, United States
- 3Sports Concussion Program, MassGeneral Hospital for Children, Boston, MA, United States
- 4Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Charlestown, MA, United States
- 5School of Public Health, Physiotherapy and Sports Science, University College Dublin, Dublin, Ireland
- 6School of Health and Rehabilitation Sciences, The Ohio State University College of Medicine, Columbus, OH, United States
- 7Chronic Brain Injury Program, The Ohio State University, Columbus, OH, United States
A controversial theory proposes that playing tackle football before the age of 12 causes later in life brain health problems. This theory arose from a small study of 42 retired National Football League (NFL) players, which reported that those who started playing tackle football at a younger age performed worse on selected neuropsychological tests and a word reading test. The authors concluded that these differences were likely due to greater exposure to repetitive neurotrauma during a developmentally sensitive maturational period in their lives. Several subsequent studies of current high school and collegiate contact/collision sports athletes, and former high school, collegiate, and professional tackle football players have not replicated these findings. This narrative review aims to (i) discuss the fundamental concepts, issues, and controversies surrounding existing research on age of first exposure (AFE) to contact/collision sport, and (ii) provide a balanced interpretation, including risk of bias assessment findings, of this body of evidence. Among 21 studies, 11 studies examined former athletes, 8 studies examined current athletes, and 2 studies examined both former and current athletes. Although the literature on whether younger AFE to tackle football is associated with later in life cognitive, neurobehavioral, or mental health problems in former NFL players is mixed, the largest study of retired NFL players (N = 3,506) suggested there was not a significant association between earlier AFE to organized tackle football and worse subjectively experienced cognitive functioning, depression, or anxiety. Furthermore, no published studies of current athletes show a significant association between playing tackle football (or other contact/collision sports) before the age of 12 and cognitive, neurobehavioral, or mental health problems. It is important to note that all studies were judged to be at high overall risk of bias, indicating that more methodologically rigorous research is needed to understand whether there is an association between AFE to contact/collision sports and later in life brain health. The accumulated research to date suggests that earlier AFE to contact/collision sports is not associated with worse cognitive functioning or mental health in (i) current high school athletes, (ii) current collegiate athletes, or (iii) middle-aged men who played high school football. The literature on former NFL players is mixed and does not, at present, clearly support the theory that exposure to tackle football before age 12 is associated with later in life cognitive impairment or mental health problems.
Introduction
Playing American football carries inherent risk of sustaining orthopedic injury and concussion (1–4). The rate of sport-related concussion in American tackle football is higher than in most other sports (5–7). Rule changes (8–10), reductions in the number of full contact practices (11–16), protective equipment improvements (17–19), and changes to tackling technique (20–22) have been pursued with the goal of reducing the incidence of sport-related concussion in tackle football (23, 24). Helmet sensor research has revealed that high school and collegiate players are exposed to thousands of head impacts while participating in this sport (25), and concerns have been expressed that repetitive blows to the head might cause long-term changes in brain health (26, 27). Participation in youth tackle football has declined ~10% over the last decade (28), which might reflect, at least in part, concerns among parents about concussion in tackle football and its association with long-term brain health problems.
There are, of course, considerable benefits to participation in youth, high school, and collegiate sports. Participation in sport is associated with diverse health benefits, including better cardiovascular fitness (29), greater lean muscle mass (30), lower rates of obesity (31), lower rates of depression (32, 33) and suicide (34–36), less anxiety and other psychological health problems (37), greater social connectedness (30, 38, 39), and greater self-confidence (39) and self-esteem (40, 41). Notably, greater involvement in sports and exercise is also associated with presumed positive differences in brain neurobiology (42) and better cognitive functioning (42–44) in some studies.
High School Football and Later in Life Brain Health
Eight studies have examined whether participating in high school football is associated with later in life mental health problems or cognitive impairment. Three research groups have used the National Longitudinal Study of Adolescent to Adult Health database to examine whether boys who played high school football are more likely to have mental health problems during their 20s (45–47). They reported that playing football in high school was not associated with greater lifetime rates of depression (45–47) or anxiety (46), suicidal ideation within the past year (45–47), current symptoms of depression [i.e., within the past seven days (46)], or substance abuse (i.e., nicotine, cannabis, alcohol) (46).
One study surveyed more than 400 middle-aged men (ages 35–55) from the United States general population and reported that those who played high school football were not more likely to have a lifetime history of treatment for mental health problems (48). Middle-aged men who played high school football also reported similar experiences with depression, anxiety, anger, concentration problems, or memory problems in the preceding year compared to men who did not play high school football (48). Four studies with older adult men have also shown no association between playing high school football and later in life problems with brain health. Two research teams examining data from the Wisconsin Longitudinal Study reported no association between playing high school football and later in life cognitive functioning, mental health, or self-rated physical health in older adult men (49, 50). Two medical-record linkage studies found that former high school football players are not at greater risk for later in life neurological or neurodegenerative diseases (51, 52).
Professional American Football and Later in Life Brain Diseases
Many studies have been conducted with former National Football League (NFL) players. Researchers using diverse experimental neuroimaging techniques have reported that some former NFL players have measurable macrostructural (53–55) and microstructural (56, 57) differences in their brains, and differences in neurochemistry, measured by magnetic resonance spectroscopy (58), and neurophysiology, measured using several technologies (e.g., positron emission tomography and functional magnetic resonance imaging) (59–64). Some clinical studies have reported that some former NFL players perform worse on neuropsychological tests than control participants (54, 57, 65). In large survey studies, most participants report that they have broadly normal health, but a subgroup of former NFL players reports poor mental health and cognitive functioning (66–71). Post-mortem brain donation studies have revealed diverse microscopic neuropathology in some former NFL players (72), including chronic traumatic encephalopathy neuropathologic changes (73, 74).
Studies based on reviews of death certificates have reported greater rates of Alzheimer's disease (75) and amyotrophic lateral sclerosis (75) as contributory causes of death in former NFL players compared to men from the general population, but not psychiatric illness (76) or suicide (76, 77). However, two studies examining death certificates from former NFL players who played between 1959 and 1988 (76) and between 1986 and 2012 (78), found no significant increased risk for “diseases of the nervous system or sense organs.”
A recent mortality study compared former NFL players to former professional Major League Baseball (MLB) players and revealed a greater risk for all-cause neurodegenerative diseases in the former football players (Hazard Ratio, HR = 2.99; 95% CI, 1.64–5.45) (79), although the absolute rates of having a neurodegenerative disease listed on their death certificates were relatively low (i.e., 7.5 vs. 3%). The NFL players, compared to MLB players, had a significantly elevated mortality rate from Parkinson's disease (14/517, 2.7% compared to 5/431, 1.2%). Mortality rates from dementia and/or Alzheimer's disease (16/517; 3.1%) and amyotrophic lateral sclerosis (10/517; 1.9%) were higher in former NFL players than in former MLB players, but differences were not statistically significant. Taken together, the above studies suggest partially elevated risk for former NFL players but not former high school football players.
Theory: Exposure to Football Before Age 12 and Long-Term Brain Health
A theory proposes that playing tackle football before the age of 12, vs. after that age, causes later in life brain health problems. This theory arose from a small study of retired NFL players conducted at Boston University as part of a program of research entitled “DETECT” (Diagnosing and Evaluating Traumatic Encephalopathy Using Clinical Tests), which identified a statistically significant association between worse neuropsychological functioning and starting to play tackle football before the age of 12 (80–83). These studies served as the impetus for several subsequent studies of high school (84–86), collegiate (84, 87–90), and former NFL players (71, 91–94) (Table 1).
Table 1. Summary of studies of retired athletes.
Since 2018, several states, such as New York, Illinois, California, Maryland, New Jersey, and Massachusetts have introduced legislation to ban tackle football (i) entirely from youth sports or (ii) prior to a certain age (95). Advocacy groups for this legislation have cited this early study to support the campaign that playing tackle football before age 12 is associated with brain health problems later in life (80, 92, 94).
There is a need to critically review the literature related to this theory because existing studies have notable methodological limitations. Furthermore, the results of the original, theory-generating study have not been replicated by other research groups. Research on age of first exposure (AFE) to contact/collision sport and later in life brain health has seen significant progress in recent years, in study design, methodology, and subsequent study findings. The purpose of this narrative review is to (i) discuss the fundamental concepts, issues, and controversies surrounding existing research on AFE to contact/collision sport, and (ii) provide a balanced interpretation, including risk of bias assessment findings, of this body of evidence. We used PubMed for our initial search and a pearl growing strategy to find additional articles, and then used the Quality in Prognostic Studies (QUIPS) assessment tool to evaluate the risk of bias of included studies. This review is divided into four sections, as follows: Origin of the Theory, Studies with Retired Amateur and Professional Athletes, Studies with Current Athletes, and Risk of Bias Assessment Findings.
Methodology
We performed article searches in PubMed using both (i) keywords that are relevant to the narrative review question under investigation (e.g., “age of first exposure,” “AFE,” “sport,” “football,” “repetitive head impact”), and (ii) the names of authors who have published scientific articles on this topic. Additionally, we used a pearl growing strategy, similar to snowball sampling, whereby the reference lists of each study were reviewed to identify other studies that were relevant to this review. For each study identified, we used the ‘find similar articles' function in PubMed to retrieve related scientific articles answering conceptually similar research questions. We searched only for articles published from 2015 as the original scientific article proposing the theory of AFE (and its relationship with later in life brain health) stems from an article published in 2015 (80).
Twenty-one original research studies investigating the relationship between AFE to contact and/or collision sports and later in life brain health were identified and included for narrative review. Narrative reviews, presented in a systematic manner, are useful as a scholarly summary, interpretation, and critique of studies that answer a common research question while using distinctive methodologies (96). These reviews are also helpful for providing a historical account of the development of a theory or research on a topic (97). Two authors (FCB and JBC) independently extracted data from included studies using a pre-developed data extraction template that focused on study characteristics, including empirical design, participants, exposure definition(s), outcome type(s) and definition(s), and potential confounders. The extraction table that summarizes all of the articles is included as an Online Supplementary Material.
We used the QUIPS assessment tool to evaluate the risk of bias of studies included in this narrative review. QUIPS is an outcome-level, domain-based tool developed by Hayden et al. to evaluate the risk of bias in prognostic factor studies (98). The QUIPS has six risk of bias domains that outline potential sources of bias in a prognostic factor study: (i) study participation, (ii) study attrition, (iii) prognostic factor measurement, (iv) outcome measurement, (v) confounding, and (vi) statistical analysis and reporting. Due to the cross-sectional nature of included studies and lack of participant follow-up, we omitted study attrition from our risk of bias assessment. Risk of bias domains are judged to be at low, moderate, or high risk of bias, which in turn inform an overall judgement of low, moderate, or high risk of bias for each study. For example, if all risk of bias domains in a study were at low risk of bias, an overall judgment of low risk of bias was considered. If there was at least one domain at moderate risk of bias, an overall judgment of moderate risk of bias was considered. If there was at least one domain at high risk of bias or multiple domains at moderate risk of bias, an overall judgment of high risk of bias was considered.
Using QUIPS prior to data extraction, two review authors (FCB & JBC) developed content-specific criteria within each risk of bias domain relating to the relationship between AFE and later-life cognitive, behavioral, and mental health outcomes (see the QUIPS tool in the Supplementary Material). All review authors approved AFE-specific risk of bias criteria. Two assessors (JBC & FCB) independently performed domain-based risk of bias assessments of each study. Between-assessor disagreement was resolved via discussion. A third author (GLI) arbitrated persisting between-assessor disagreement that could not be resolved via discussion.
Origin of the Theory
Stamm et al. (80) studied a sample of 42 retired NFL players, half of whom began playing football before the age of 12 (n = 21) and half of whom began after the age of 12 (n = 21). Both groups were selected from a larger sample of retired NFL players (N = 74), all of whom self-reported cognitive, behavioral, and mood symptoms for at least 6 months prior to enrolment in the study. For the DETECT study, a battery of neuropsychological tests measuring attention (e.g., Digit Span), speed of processing (e.g., Trails A and Digit Symbol Coding), visual-spatial and visual-constructional skills (e.g., Rey Complex Figure and Map Reading), confrontation naming, learning and memory (e.g., List Learning and Story Learning), verbal fluency (e.g., Controlled Oral Word Association Test and Animal Naming), and executive functioning (e.g., Trails B, Wisconsin Card Sorting Test, and the Color-Word Interference Test) was administered to each of the retired NFL players. The authors reported that they selected a “focused set” of neuropsychological outcome measures for the study to reduce the likelihood of type I errors and based on their a priori hypotheses. They selected only two neuropsychological tests from the battery, the Wisconsin Card Sorting Test and the List Learning Test. They also reported the results from a word reading test that they noted is commonly used in research to estimate premorbid (i.e., longstanding) verbal intellectual ability. The authors hypothesized “that those who began playing football before age 12 would perform significantly worse on measures of executive function, memory, and premorbid estimated verbal IQ (eVIQ) than those who started playing at age 12 or older.” They reported that those who started playing at a younger age performed worse on both of their selected neuropsychological tests and the reading test. The authors concluded that these differences were likely due to greater exposure to repetitive neurotrauma during a developmentally sensitive maturational period in their lives (80).
Methodological Issues Relating to the Original Study
Other researchers have expressed important concerns about methodological problems and the conclusions drawn from this study (99–101), and some of these concerns were reported in the discussion section of the original article and by the authors in a letter to the editor (102). First, the study was small and potentially under-powered, containing only 21 subjects in each group. Second, the sample is not representative of the general youth football player because most youth players do not go on to play professional football and because participants self-reported an astonishing average of nearly 400 prior concussions. Third, it is not clear in the study whether the choices of using the two neuropsychological tests from all the other tests, or a binary cutoff threshold of age 12, were influenced by exploratory analyses and selective outcome reporting. Increased risk for spurious findings occurs when researchers undertake exploratory analyses (103, 104) and/or hypothesize after the results are known (105, 106). Finally, the groups differed on the presence of learning disabilities, with the younger AFE group having more subjects with lifelong learning disabilities. It is well-known that people with learning disabilities, as a group, perform worse on cognitive tests (107–110).
In this original study, the younger AFE group performed worse on a word reading test. The authors argued that this was not a coincidental difference between the groups but rather this difference was caused by playing football (80). Given the complex nature of determinants of reading ability, inferring causality from reductive statistical approaches using potentially underpowered and unrepresentative samples increases the likelihood that study conclusions are inaccurate. Additionally, the authors did not cite any studies to support this opinion that playing football before age 12 causes learning disabilities or somehow interferes with a person's lifelong proficiency in single word reading, and we are not aware of any studies that support these assertions. In contrast, a recent study suggested that neurotrauma exposure variables explained <1% of the variance on a word reading test, whereas sociodemographic and academic aptitude variables explained >20% of the variance in a sample of 6,598 collegiate student-athletes (111). Thus, a more parsimonious and logical explanation is that differences in rates of learning disabilities, and lower reading scores, were not caused by playing the sport at an earlier age but rather reflect a longstanding, lifelong difference between both (small) samples of former NFL players. This is fundamentally important because it is well-established in neuropsychology that single-word reading performance is positively correlated with both intelligence and performance on tests in other cognitive domains, including memory and executive functioning (112–119). As such, a compelling alternative explanation for the findings from the study by Stamm et al. is that cognitive test scores were worse because the earlier AFE group was more likely to have learning disabilities and/or lower reading skills, not because they played football starting at a younger age. That said, the original authors reported in a letter to the editor that the statistically significant difference between the two groups on the learning test and the executive function test remained after using the reading test as a covariate (102).
Studies With Retired Amateur and Professional Athletes
Three additional studies by the same research group were published, using mostly the same sample of retired NFL players. These studies revealed (i) differences in white matter microstructure (81), as measured by diffusion tensor imaging (DTI), (ii) differences in thalamic volumes (82) and (iii) differences in cortical thickness (83), as measured by magnetic resonance imaging (MRI). Specifically, Stamm et al. (81) examined fractional anisotropy, trace, axial diffusivity, and radial diffusivity in the whole corpus callosum and in five sub-regions. Former NFL players in the AFE <12 group had significantly lower fractional anisotropy in three corpus callosum sub-regions and higher radial diffusivity in one corpus callosum sub-region than those in the AFE ≥12 group. Thus, of the 24 analyses that the authors performed in this study, 4 (17%) were significant. Schultz et al. (82) reported that right thalamic volume, but not left thalamic volume, was associated with AFE, whereby for every year a participant started playing football earlier, the average decrease in right thalamic volume was 64.9 mm3, but thalamic volumes were mostly unrelated to cognitive and behavioral/mood assessments. Finally, Kaufmann et al. (83) identified clusters of cortical thickness that were associated with AFE. Specifically, a statistically significant correlation between AFE and cortical thickness was found in the left supramarginal gyrus and superior parietal lobule, in the right posterior superior frontal cortex and dorsal precentral gyrus, as well as in the bilateral cuneal cortex and pericalcarine cortex and lingual gyrus. Thus, there have been four published studies using the sample of retired NFL players recruited for the DETECT study, and all have found some significant findings in brain structure or microstructure that were associated with earlier AFE. However, the number of brain regions examined, and the number of statistical comparisons undertaken, were not always clear. Moreover, researchers should not assume that these are four independent studies given that there was likely considerable overlap in subjects across the studies.
The Boston University Chronic Traumatic Encephalopathy (CTE) Center recruited an independent cohort of tackle football players for the “Longitudinal Examination to Gather Evidence of Neurodegenerative Disease” (LEGEND) study. Participants in the LEGEND study included former football players older than 18 years of age with a history of participation in organized sport, including high school, college, or professional levels of play. Alosco et al. (92) examined the association between AFE to tackle football and later in life cognitive and neuropsychiatric outcomes in former high school (n = 43), college (n = 103), and professional (n = 68) tackle football players from the LEGEND Study. Those with younger AFE, whether analyzed continuously or dichotomously (using the age 12 cutoff), self-reported worse executive function, depression, and apathy, but AFE was unrelated to cognitive functioning as assessed by the Brief Test of Adult Cognition. However, when examining the effects of cumulative head impact exposure among subjects from the same LEGEND cohort, Montenigro et al. (93) reported that AFE did not add independently to the model, nor did including AFE in the model eliminate the significance of cumulative head impact exposure for predicting clinical outcomes, suggesting that cumulative exposure may affect neuropsychiatric and cognitive outcomes more than AFE. The authors noted that participants with AFE <12 had some increase in the risk for impairment, but this was not statistically significant for any outcome measure after adjusting for cumulative exposure. Therefore, in the Montenigro et al. study (93), unlike the Alosco et al. study (92), AFE was not related to self-reported worse executive function, depression, and apathy.
Four follow-up studies, using different samples and methodologies, have not replicated findings from the DETECT and LEGEND studies regarding AFE (71, 85, 86, 91). Solomon et al. (91) aimed to replicate the study findings of Stamm et al. with data from former NFL players (120), focusing particularly on neuropsychological test results. There were 45 retired NFL players who underwent extensive medical history, neurological examination, Mini-Mental State Examination, Beck Depression Inventory, Patient Health Questionnaire, magnetic resonance imaging (MRI), APoE genotyping, and paper and pencil and computerized neuropsychological testing. Unlike participants in the Stamm study (80), retirees reported 9.0 ± 6.9 concussions (maximum = 25) and 14.9 ± 7.9 “dings,” which were likely unrecognized concussions. Exclusion criteria for retirees were also more stringent than in the study by Stamm et al. Notably, individuals with a history of significant alcohol abuse and/or drug abuse were excluded, whereas over 50% of participants in DETECT reported illicit drug and alcohol use. Solomon et al. reported no relationship between years of pre-high school tackle football exposure and any neuroradiological, neurological, behavioral, or neuropsychological outcomes.
Roberts et al. (71) examined survey data from a large cohort of former NFL players (N = 3,506) who participated in the NFL after 1960. Participants completed the short form of the Quality of Life in Neurological Disorders: Applied Cognition–General Concerns (Neuro-QOL), to assess perceived cognitive functioning, and the Patient Health Questionnaire−4 (PHQ-4) to assess symptoms of depression and anxiety. Among this very large cohort, there was no relationship between AFE and subjectively experienced cognitive problems, depression, or anxiety, whether AFE to organized tackle football was analyzed continuously or dichotomously at age 12. In contrast, greater seasons of professional play were associated with worse perceived cognitive functioning, depression, and anxiety. Thus, in the largest study of former NFL players to date, earlier AFE to organized tackle football was not related to later in life brain health problems.
Former NFL players are not ideal for examining associations between youth sports participation and later in life brain health. Iverson et al. (85, 86) recruited two independent samples of men in the United States: (i) ages 35–55 years (M = 44.8, SD = 6.2 years; N = 123) and (ii) ages 35 and older (M = 51.8, SD = 10.9 years; N = 186), who played high school football. Participants completed the Patient Health Questionnaire-8 to assess symptoms of depression over the preceding 2 weeks, the British Columbia Post-Concussion Symptom Inventory to assess frequency and severity of persistent concussion symptoms, and a survey of medical history. Although men who played football before age 12 reported a greater number of lifetime concussions and a younger age at first concussion than those who started at or after age 12, younger AFE to football was not associated with symptoms of, or treatment for, mental health problems, memory loss, chronic pain, or headaches. Specifically, younger AFE to football was not associated with (1) ever having seen a psychologist, counselor, or therapist for mental health care; (2) ever being prescribed medications for depression; (3) feeling depressed in the preceding week or year; (4) current symptoms of depression; (5) ever having been prescribed medications for anxiety; (6) having had problems with anxiety in the preceding week or year; (7) current symptoms of anxiety; (8) current post-concussion-like symptoms; or (9) current perceived difficulties with cognitive functioning (85, 86).
Hunzinger et al. (121) surveyed 1,034 current and former community-level rugby players. Participants completed patient-reported outcomes, including the Brief Symptom Inventory 18 to assess psychological distress, the Short Form Health Survey 12 to assess physical and mental health quality of life, and the Satisfaction with Life Scale. Earlier AFE to contact/collision sports, whether analyzed continuously or dichotomously at age 12, was not associated with worse psychological distress or quality of life among men or women.
Finally, there has been one large-scale study of active (n = 442) and retired (n = 64) professional fighters (i.e., boxers, mixed martial artists, and martial artists), and this study examined numerous neuroimaging variables, neuropsychological test scores, and self-report symptom measures. Earlier AFE to combat sports was associated with several differences in brain macrostructure, worse measured cognitive functioning, and greater self-reported symptoms of depression and impulsiveness (122). Although the authors state, “AFE to competitive fighting was defined as the study participant's self-reported age (in years) when competitive fighting began…This age was the earlier of either amateur or professional competitive fighting experience,” the descriptive statistics for AFE were not presented. However, when subtracting the mean years of fighting from the mean age for active fighters, data suggest the AFE for this cohort is 24 years old, so it remains unclear how these findings inform long-term outcomes of repetitive neurotrauma on neurodevelopment. Nonetheless, based on this study, earlier AFE to fighting is associated with smaller brain structures, worse cognitive functioning, and greater subjectively experienced symptoms.
Studies With Current Athletes
No published studies of current athletes show a statistically significant association between playing football (or other contact sports) before the age of 12 and worse functioning (84, 87, 88, 90, 111, 123, 124) or worse clinical outcome from concussion (89). In contrast, several large-scale cross-sectional studies of high school and collegiate athletes have found that earlier AFE to football and other contact sports is not significantly associated with worse objectively measured cognitive functioning (84, 87, 88, 90, 123) or greater self-reported physical, cognitive, or emotional symptoms (84, 88). Collectively, these five studies examined four independent cohorts amassing nearly 10,000 athletes across 20 different outcome measures, and they did not report a single outcome measure that was worse with earlier AFE to football or other contact sports.
It is important to note that many of these studies included a control group comprising athletes who participated in non-contact sports and that many of these studies controlled for neurodevelopmental history and a variety of sociodemographic factors that may influence both sports participation and outcome measures. For example, several large-scale studies have shown that having a neurodevelopmental problem, such as ADHD (109, 110), learning disability (109, 110), or significant academic problems (107, 108), was associated with lower scores on cognitive testing and greater self-reported physical, cognitive, and emotional symptoms. Lower SES and other sociodemographic disparities were also associated with worse performance on cognitive testing in student athletes (90, 111, 125). These studies are not without limitations, however. Notably, most large cohorts were recruited through a single study, the National Collegiate Athletic Association (NCAA)-US Department of Defense (DoD) Grand Alliance Concussion Assessment, Research and Education (CARE) Consortium Study (87–90, 111, 123), and outcome measures were selected based on those typically included in sport-related concussion baseline assessments, which may not be as sensitive for more subtle effects of early exposure to repetitive head impacts. Furthermore, findings only inform short- to medium-term effects in current athletes who may have sufficient cognitive reserve to mask potential consequences of earlier AFE to repetitive neurotrauma. Thus, if there is an association between earlier AFE and worse mental health or cognitive functioning, that association might emerge in association with aging. Nonetheless, the best available evidence suggests that, in current high school and collegiate athletes, earlier AFE to contact/collision sport is not associated with lower cognitive abilities on objective testing at baseline (84, 87, 88, 90, 123), greater physical, cognitive, or emotional symptom reporting at baseline (84, 88), or worse clinical outcome following concussion (89).
Risk of Bias Assessment Findings
All studies (k = 21, 100%) were judged to be at high overall risk of bias (Table 2). In the study participation domain, four studies (19%) were deemed to be at low risk of selection bias and two studies (10%) were deemed to be at moderate risk of selection bias. Fifteen (71%) were judged to be at high risk of selection bias, which was attributable to the methodology used in most studies to identify the target population. Specifically, if a study population was composed of a convenience sample, reported that a specific study outcome such as self-reported behavioral, emotional, or cognitive symptoms/complaints was an inclusion criterion, or if next of kin, relevant other, or medical practitioner referred or enrolled participants in a study, we rated this domain as high risk of bias. Several studies were judged to be at high risk of bias due to multiple items within this domain being at moderate risk of bias from a lack of reporting (of study recruitment period and participation rates) or from low study participation rates.
Table 2. Summary of studies of current athletes.
Prognostic Factor Measurement
In the ‘prognostic factor measurement' domain, six studies (29%) were at moderate risk of bias and fifteen studies (71%) were at high risk of bias arising from analyzing and reporting AFE. Studies were considered moderate risk of bias if AFE was self-reported by survey or clinical interview without bias limitation techniques rather than determined objectively. Studies were considered high risk of bias for a number of reasons, including if AFE was estimated by subtracting current age from self-reported number of years playing the sport or if AFE was analyzed and reported as a dichotomized variable only. Importantly, all studies used self-reported AFE to contact/collision sport—no study ascertained AFE, either retrospectively or prospectively, using electronic health or sporting participation records to objectively verify the start-date of participation in contact/collision sport. Although studies were rated to have a moderate risk of bias due to participant self-report of AFE, at this time there is no better measurement method. Even in cases where electronic health or sporting participation registries may exist, it is likely too expensive, obtrusive, or time consuming to obtain. In the case of self-reported data, recall bias is of primary concern; however, there are some solutions to overcome recall bias that we propose for future research. For example, methods to facilitate recall include the use of memory aids and structured screening tests rather than single-item methods (126–129). One specific method that might improve the quality of self-reported AFE is to ask a series of questions, instead of a single question, and to also refer to the participant's grade in school when he started playing football, which will be much easier to remember for many participants compared to their age at that time.
Outcome Measurement
For the ‘outcome measurement' domain, fifteen studies (71%) used clinically observed outcomes or validated patient-reported outcome measures, and they were at low risk of bias. One study (5%) used outcome measures based on clinical opinion of a medical examiner, and it was rated at moderate risk of bias. Five studies (24%) were judged to be at high risk of bias because reported outcome measures represented only a subset of a larger outcome set and thus may have been selectively reported. Additionally, neuroimaging studies were considered to be at high risk of bias if only specific brain regions were examined and reported without a pre-registered study protocol—preceding data collection—being available that specified the a priori brain regions of interest.
Confounding
All studies (k = 21, 100%) were considered to be at high risk of confounding due to (i) a lack of measuring and reporting potential third variables, and (ii) uncertainty surrounding the type and definition of third variables in included studies. Notably, most studies did not measure or report the following potential third variables: (i) prior concussion history; (ii) diagnosed learning disability/ADHD/learning accommodations; (iii) history of headaches or migraine; (iv) mental health problems; (v) socioeconomic status, race, or ethnicity; (vi) duration of play; or (vii) education, which were deemed to be potentially important third variables in the possible association between AFE and later in life brain health. When those variables were assessed and considered, there was little information provided regarding how the confounding variables were defined, measured, or included in statistical analyses.
Not measuring and adequately adjusting for relevant confounding variables may result in bias toward or away from the null—the exact direction and magnitude of this bias is unknown. The role of confounding variables, and other third variables (such as mediating and effect modifying variables), is particularly important when trying to discern the nature of an association, if any, between AFE to contact/collision sport and later in life brain health. Many factors may be associated with both exposure (AFE to tackle football) and outcome (later in life brain health), and therefore may play a pivotal role in understanding the direction and magnitude of this association, irrespective of whether these factors sit on the causal pathway between exposure and outcome. Consequently, it is crucial that future studies investigating this association carefully measure and adjust for potentially important third variables, such as socioeconomic status and concussion history.
Statistical Analysis/Reporting
Eight studies (38%) were rated at low risk of bias. Eleven studies (52%) were rated at moderate risk of bias due to the authors performing many comparisons between groups without adjusting for multiple comparisons. It was difficult to determine whether many outcomes and/or analytical approaches were used but only some reported. Without an available pre-registered protocol detailing study outcomes and statistical analysis plans prior to data collection, it was/is not possible to determine selective outcome reporting and selective analytical reporting. One study (5%) was judged to be at high risk of bias due to a perceived limitation in the statistical analysis (89), and one study (5%) was considered high risk of bias due to clear evidence that data for only a subset of analyses was fully reported, and that the fully reported results were selected based on the (statistically significant) nature of the results (122).
Risk of Bias Conclusions and Future Recommendations
Our risk of bias assessment of the studies identified that each study had at least two domains at high risk of bias, leading to an overall judgement of high risk of bias for every study (Table 3). High risk of bias ratings were attributable to perceived limitations in the design, conduct, analysis, and/or reporting. Importantly, however, the domain and overall ratings of high risk of bias in every study also reflect the stringent nature of risk of bias as a concept.
Table 3. Quality in prognosis studies tool ratings (risk for bias ratings).
Risk of bias is a systematic deviation from the truth in the results of a research study due to limitations in design, conduct, analysis, or reporting, irrespective of what study authors were capable of (130–132). For example, the cross-sectional nature of included studies required study authors to ascertain AFE using participant retrospective self-report. Participant retrospective self-report can introduce measurement inaccuracies to a study due to recall bias, whereby the accuracy of participants' memories may be influenced by subsequent events and experiences (133–135). In this instance, historical electronic sporting participation records would minimize systematic measurement error of AFE, despite this being nearly impossible for authors to access and use. Therefore, although participants' self-report of their AFE is the most feasible method of prognostic factor measurement, the potential of this method to distort study results from the truth necessitated a moderate risk of bias judgement. This is especially notable for studies requiring a binary classification of before or after the age of 12, which represents when subjects in the United States typically were in the 6th or 7th grade. However, future research may consider methods to overcome recall bias, such as including the use of memory aids and structured screening tests rather than single-item methods (126–129).
Studies that provided unclear or ambiguous reports of design, conduct, or analysis were rated as moderate risk of bias. This was due to the empirical assertion that suboptimal reporting does not always imply a suboptimal methodology (136). Future research in this area will benefit from transparent pre-specification of study methods, outcomes, and analyses prior to study analyses that enables readers to distinguish between planned and post-hoc study decisions and methods.
It is also important for future research to include both planned and independent replication and extension—especially in neuroimaging research where concern has been expressed about a reproducibility or replication “crisis” (137–139)—although these concerns apply to psychology and other fields more broadly where researchers often do not wish to replicate prior work given the pressures and incentives associated with “novel findings” and new discoveries (140, 141). That is, when possible, researchers reporting findings from small clinical and neuroimaging studies should attempt to directly replicate (and also extend) those findings, and independent researchers are also encouraged to attempt to replicate prior studies using the same or similar methods—especially with larger samples. Replication studies with larger, more diverse samples may adjust for potentially confounding factors leading to more generalizable results, despite conflicting findings. Further, future studies should continue to examine the association between AFE and outcomes across the lifespan and with aging.
The dichotomy of views held by investigating research groups may, in itself, be hindering the progress of science toward discovering the true underlying relationship between AFE and midlife and later-life brain health. This could be addressed through so-called “adversarial collaboration” wherein two or more research scientists (or groups) with opposing views work together despite having distinct, competing hypotheses (142–147). By collaborating, those with opposing views hold each other to high standards of scientific design, conduct, analysis, and reporting, resulting in study findings that have greater scientific clarity, certainty, and credibility (given that both research teams have collaboratively undertaken the science producing the observed/published result).
Discussion
There has been considerable interest in whether earlier AFE to football, and other collision and contact sports, is associated with future problems with brain health. The genesis of this interest was a single small study of retired NFL players (N = 42) reporting that those who started playing football before the age of 12 performed worse on two neuropsychological tests and a single-word reading test (80). Furthermore, this study was part of the impetus for tremendous societal interest and legislative advocacy relating to whether tackle football should be banned for youth under a specific age. This first study had methodological limitations, as discussed in this review, and the results from that study have not been replicated by other research groups. The original study might have been exploratory. Exploratory, underpowered studies with considerable methodological and analytical flexibility have an increased risk of observing novel but spurious findings (104, 148, 149). Three follow-up studies have examined neuropsychological test performance in former professional football players and none have found a statistically significant association between earlier AFE and worse cognitive functioning (91–93).
Clinical Studies of Middle-Aged and Older Adult Men
Beyond the original study, there have been six studies to date examining middle-aged and older adult men who played football to determine if earlier AFE was associated with greater reporting of mental health problems, cognitive deficits, or other neurobehavioral symptoms. Only one study has found such as association using data from subjects recruited into the LEGEND study (N = 214) (92). This same research team, however, also using subjects from the LEGEND study and a different methodology, did not find an association between AFE and these same self-reported symptom outcomes (N = 93) (93). Four additional independent studies, one large survey of former NFL players (N = 3,506) (71), one clinical study of former NFL players (N = 45) (91), and two surveys of men who played high school football (N = 123, N = 186) (85, 86), have not found a statistically significant association between earlier AFE to football and self-reported cognitive, neurobehavioral, or psychological functioning later in life. In one large-scale study of active and retired professional fighters, earlier AFE to combat sport was associated with worse measured cognitive functioning and greater self-reported symptoms of depression and impulsiveness (122).
Neuroimaging Studies
There have been four studies to date using experimental neuroimaging modalities to examine whether earlier AFE to football is associated with differences in brain macrostructure or microstructure in former football players. Three of those studies have been published by the same research group and they have reported that (i) differences in white matter microstructure (81), as measured by DTI, (ii) differences in thalamic volumes (82), as measured by volumetric analytic methods, and differences in cortical thickness (83) are associated with AFE in former NFL players. These neuroimaging studies used subjects from the DETECT study—researchers should not assume that these are three independent studies given that there was likely considerable overlap in subjects across the studies. These findings have not been replicated to date in independent samples of former football players. One independent study of former NFL players did not demonstrate evidence of a detectable association between AFE and neuroimaging outcome measures (91). In a study of combat sport athletes, earlier AFE to fighting was associated with smaller brain structures in some brain regions (122).
Studies of Current High School and Collegiate Athletes
There have been eight published studies on this topic with current high school and collegiate athletes, which inform possible short- to medium-term associations in current athletes. No published studies of current athletes have reported a statistically significant association between playing football (or other contact sports) before the age of 12 and worse functioning (84, 87, 88, 90, 111, 123, 124), or worse clinical outcome from concussion (89). These large-scale cross-sectional studies of high school and collegiate athletes have found that earlier AFE to football and other contact sports is not significantly associated with worse objectively measured cognitive functioning (84, 87, 88, 90, 123) or greater self-reported physical, cognitive, or emotional symptoms (84, 88). In fact, these five studies (84, 87, 88, 90, 123) examined four independent cohorts amassing nearly 10,000 athletes across 20 different outcome measures, and they did not report a single outcome measure that was worse with earlier AFE to football or other contact sports.
Conclusions
In summary, the literature on whether earlier AFE to football is associated with later in life cognitive, neurobehavioral, or mental health problems in former NFL players is mixed. In the largest study to date of retired NFL players (N = 3,506), there was not a significant association between starting to play football before the age of 12, or earlier AFE analyzed continuously, and worse subjectively-experienced cognitive functioning, depression, or anxiety (71). Smaller studies of former NFL players have shown some associations with neuroimaging findings and clinical outcome variables (80–82, 92, 94). One large study of combat sport athletes does show an association between earlier AFE to professional fighting and smaller brain structures, worse cognitive functioning, and greater subjectively experienced symptoms. Therefore, it is possible that there is an association between AFE to contact/collision sport and brain health in some former professional athletes with very high exposure to repetitive neurotrauma. It will be important to observe whether the findings of prior studies are replicated by future research investigating this association. The best available evidence to date suggests that earlier AFE to contact or collision sports is not associated with worse cognitive functioning or mental health in (i) current high school athletes, (ii) current collegiate athletes (84, 87, 88, 90, 111, 123, 124), or (iii) middle-aged men who played high school football (85, 86).
Author Contributions
GI conceptualized and designed the review, assisted with conducting the literature review, wrote portions of the manuscript, edited drafts, and agrees to be accountable for the content of the work. FB and JC assisted with conducting the literature review, conducted the risk of bias assessment, wrote portions of the manuscript, edited drafts, and agrees to be accountable for the content of the work. All authors contributed to the article and approved the submitted version.
Funding
GI acknowledges unrestricted philanthropic support from ImPACT Applications, Inc., the Mooney-Reed Charitable Foundation, the National Rugby League, and the Spaulding Research Institute. These entities were not involved in the study design, interpretation of data, the writing of this article or the decision to submit it for publication.
Conflict of Interest
GI serves as a scientific advisor for NanoDx®, Sway Operations, LLC, and Highmark, Inc. He has a clinical and consulting practice in forensic neuropsychology, including expert testimony, involving individuals who have sustained mild TBIs (including athletes). He has received research funding from several test publishing companies, including ImPACT Applications, Inc., CNS Vital Signs, and Psychological Assessment Resources (PAR, Inc.). He has received research funding as a principal investigator from the National Football League, and subcontract grant funding as a collaborator from the Harvard Integrated Program to Protect and Improve the Health of National Football League Players Association Members.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2021.727089/full#supplementary-material
References
1. Lawrence DW, Hutchison MG, Comper P. Descriptive epidemiology of musculoskeletal injuries and concussions in the National Football League, 2012-2014. Orthop J Sports Med. (2015) 3:2325967115583653. doi: 10.1177/2325967115583653
2. Dick R, Ferrara MS, Agel J, Courson R, Marshall SW, Hanley MJ, et al. Descriptive epidemiology of collegiate men's football injuries: National collegiate athletic association injury surveillance system 1988-1989 through 2003-2004. J Athl Train. (2007) 42:221–33.
3. Kerr ZY, Wilkerson GB, Caswell SV, Currie DW, Pierpoint LA, Wasserman EB, et al. The first decade of web-based sports injury surveillance: descriptive epidemiology of injuries in United States High School Football (2005-2006 through 2013-2014) and National Collegiate Athletic Association Football (2004-2005 through 2013-2014). J Athl Train. (2018) 53:738–51. doi: 10.4085/1062-6050-144-17
4. Mello MJ, Myers R, Christian JB, Palmisciano L, Linakis JG. Injuries in youth football: national emergency department visits during 2001–2005 for young and adolescent players. Acad Emerg Med. (2009) 16:243–8. doi: 10.1111/j.1553-2712.2009.00357.x
5. Zuckerman SL, Kerr ZY, Yengo-Kahn A, Wasserman E, Covassin T, Solomon GS. Epidemiology of sports-related concussion in NCAA athletes from 2009-2010 to 2013-2014: incidence, recurrence, and mechanisms. Am J Sports Med. (2015) 43:2654–62. doi: 10.1177/0363546515599634
6. Kerr ZY, Chandran A, Nedimyer AK, Arakkal A, Pierpoint LA, Zuckerman SL. Concussion incidence and trends in 20 high school sports. Pediatrics. (2019) 144:e20192180. doi: 10.1542/peds.2019-2180
7. Pfister T, Pfister K, Hagel B, Ghali WA, Ronksley PE. The incidence of concussion in youth sports: a systematic review and meta-analysis. Br J Sports Med. (2016) 50:292–7. doi: 10.1136/bjsports-2015-094978
8. Kerr ZY, Marshall SW, Simon JE, Hayden R, Snook EM, Dodge T, et al. Injury rates in age-only versus age-and-weight playing standard conditions in american youth football. Orthop J Sports Med. (2015) 3:2325967115603979. doi: 10.1177/2325967115603979
9. Stemper BD, Shah AS, Harezlak J, Rowson S, Duma S, Mihalik JP, et al. Repetitive head impact exposure in college football following an NCAA rule change to eliminate two-a-day preseason practices: a study from the NCAA-DoD CARE consortium. Ann Biomed Eng. (2019) 47:2073–85. doi: 10.1007/s10439-019-02335-9
10. Wiebe DJ, D'Alonzo BA, Harris R, Putukian M, Campbell-McGovern C. Association between the experimental kickoff rule and concussion rates in ivy league football. J Am Med Assoc. (2018) 320:2035–6. doi: 10.1001/jama.2018.14165
11. Broglio SP, Martini D, Kasper L, Eckner JT, Kutcher JS. Estimation of head impact exposure in high school football: implications for regulating contact practices. Am J Sports Med. (2013) 41:2877–84. doi: 10.1177/0363546513502458
12. Broglio SP, Williams RM, O'Connor KL, Goldstick J. football players' head-impact exposure after limiting of full-contact practices. J Athl Train. (2016) 51:511–8. doi: 10.4085/1062-6050-51.7.04
13. Cobb BR, Urban JE, Davenport EM, Rowson S, Duma SM, Maldjian JA, et al. Head impact exposure in youth football: elementary school ages 9-12 years and the effect of practice structure. Ann Biomed Eng. (2013) 41:2463–73. doi: 10.1007/s10439-013-0867-6
14. Daniel RW, Rowson S, Duma SM. Head impact exposure in youth football. Ann Biomed Eng. (2012) 40:976–81. doi: 10.1007/s10439-012-0530-7
15. Kerr ZY, Yeargin S, Valovich McLeod TC, Nittoli VC, Mensch J, Dodge T, et al. Comprehensive coach education and practice contact restriction guidelines result in lower injury rates in youth American football. Orthop J Sports Med. (2015) 3:2325967115594578. doi: 10.1177/2325967115594578
16. Pfaller AY, Brooks MA, Hetzel S, McGuine TA. Effect of a new rule limiting full contact practice on the incidence of sport-related concussion in high school football players. Am J Sports Med. (2019) 47:2294–9. doi: 10.1177/0363546519860120
17. Sproule DW, Campolettano ET, Rowson S. Football helmet impact standards in relation to on-field impacts. Proc Inst Mech Eng P J Sport Eng Technol. (2017) 231:317–23. doi: 10.1177/1754337117703019
18. Rowson S, Duma SM, Greenwald RM, Beckwith JG, Chu JJ, Guskiewicz KM, et al. Can helmet design reduce the risk of concussion in football? J Neurosurg. (2014) 120:919–22. doi: 10.3171/2014.1.JNS13916
19. Rowson S, Duma SM. Development of the STAR evaluation system for football helmets: integrating player head impact exposure and risk of concussion. Ann Biomed Eng. (2011) 39:2130–40. doi: 10.1007/s10439-011-0322-5
20. Gellner RA, Campolettano ET, Rowson S. Association between tackling technique and head acceleration magnitude in youth football players. Biomed Sci Instrum. (2018) 54:39–45.
21. Swartz EE, Myers JL, Cook SB, Guskiewicz KM, Ferrara MS, Cantu RC, et al. A helmetless-tackling intervention in American football for decreasing head impact exposure: a randomized controlled trial. J Sci Med Sport. (2019) 22:1102–7. doi: 10.1016/j.jsams.2019.05.018
22. Champagne AA, Distefano V, Boulanger MM, Magee B, Coverdale NS, Gallucci D, et al. Data-informed intervention improves football technique and reduces head impacts. Med Sci Sports Exerc. (2019) 51:2366–74. doi: 10.1249/MSS.0000000000002046
23. Harmon KG, Drezner JA, Gammons M, Guskiewicz KM, Halstead M, Herring SA, et al. American Medical Society for Sports Medicine position statement: concussion in sport. Br J Sports Med. (2013) 47:15–26. doi: 10.1136/bjsports-2012-091941
24. Council On Sports Medicine and Fitness. Tackling in youth football. Pediatrics. (2015) 136:e1419–30. doi: 10.1542/peds.2015-3282
25. Rowson B, Duma SM. A Review of On-Field Investigations into the biomechanics of concussion in football and translation to head injury mitigation strategies. Ann Biomed Eng. (2020) 48:2734–50. doi: 10.1007/s10439-020-02684-w
26. McAllister T, McCrea M. Long-term cognitive and neuropsychiatric consequences of repetitive concussion and head-impact exposure. J Athl Train. (2017) 52:309–17. doi: 10.4085/1062-6050-52.1.14
27. Tarnutzer AA, Straumann D, Brugger P, Feddermann-Demont N. Persistent effects of playing football and associated (subconcussive) head trauma on brain structure and function: a systematic review of the literature. Br J Sports Med. (2017) 51:1592–604. doi: 10.1136/bjsports-2016-096593
28. National Federation of State High School Associations. High School Athletics Participation Survey 2019. Available online at: https://www.nfhs.org/sports-resource-content/high-school-participation-survey-archive/ (accessed June 14, 2021).
29. Carlisle CC, Weaver RG, Stodden DF, Cattuzzo MT. Contribution of organized sport participation to health-related fitness in adolescents. Glob Pediatr Health. (2019) 6:2333794X19884191. doi: 10.1177/2333794X19884191
30. Agata K, Monyeki MA. Association between sport participation, body composition, physical fitness, and social correlates among adolescents: the PAHL study. Int J Environ Res Public Health. (2018) 15:2793. doi: 10.3390/ijerph15122793
31. Lee JE, Pope Z, Gao Z. The role of youth sports in promoting children's physical activity and preventing pediatric obesity: a systematic review. Behav Med. (2018) 44:62–76. doi: 10.1080/08964289.2016.1193462
32. Sanders CE, Field TM, Diego M, Kaplan M. Moderate involvement in sports is related to lower depression levels among adolescents. Adolescence. (2000) 35:793–7.
33. Ferron C, Narring F, Cauderay M, Michaud PA. Sport activity in adolescence: associations with health perceptions and experimental behaviours. Health Educ Res. (1999) 14:225–33. doi: 10.1093/her/14.2.225
34. Taliaferro LA, Rienzo BA, Miller MD, Pigg RM Jr, Dodd VJ. High school youth and suicide risk: exploring protection afforded through physical activity and sport participation. J Sch Health. (2008) 78:545–53. doi: 10.1111/j.1746-1561.2008.00342.x
35. Harrison PA, Narayan G. Differences in behavior, psychological factors, and environmental factors associated with participation in school sports and other activities in adolescence. J Sch Health. (2003) 73:113–20. doi: 10.1111/j.1746-1561.2003.tb03585.x
36. Taliaferro LA, Eisenberg ME, Johnson KE, Nelson TF, Neumark-Sztainer D. Sport participation during adolescence and suicide ideation and attempts. Int J Adolesc Med Health. (2011) 23:3–10. doi: 10.1515/ijamh.2011.002
37. Eime RM, Young JA, Harvey JT, Charity MJ, Payne WR. A systematic review of the psychological and social benefits of participation in sport for children and adolescents: informing development of a conceptual model of health through sport. Int J Behav Nutr Phys Act. (2013) 10:98. doi: 10.1186/1479-5868-10-98
38. Linver MR, Roth JL, Brooks-Gunn J. Patterns of adolescents' participation in organized activities: are sports best when combined with other activities? Dev Psychol. (2009) 45:354–67. doi: 10.1037/a0014133
39. Zarrett N, Fay K, Li Y, Carrano J, Phelps E, Lerner RM. More than child's play: variable- and pattern-centered approaches for examining effects of sports participation on youth development. Dev Psychol. (2009) 45:368–82. doi: 10.1037/a0014577
40. Guddal MH, Stensland SO, Smastuen MC, Johnsen MB, Zwart JA, Storheim K. Physical activity and sport participation among adolescents: associations with mental health in different age groups. Results from the Young-HUNT study: a cross-sectional survey. BMJ Open. (2019) 9:e028555. doi: 10.1136/bmjopen-2018-028555
41. Erkut S, Tracy AJ. Predicting adolescent self-esteem from participation in school sports among latino subgroups. Hisp J Behav Sci. (2002) 24:409–29. doi: 10.1177/0739986302238212
42. Lubans D, Richards J, Hillman C, Faulkner G, Beauchamp M, Nilsson M, et al. Physical activity for cognitive and mental health in youth: a systematic review of mechanisms. Pediatrics. (2016) 138:e20161642. doi: 10.1542/peds.2016-1642
43. Herting MM, Chu X. Exercise, cognition, and the adolescent brain. Birth Defects Res. (2017) 109:1672–9. doi: 10.1002/bdr2.1178
44. Donnelly JE, Hillman CH, Castelli D, Etnier JL, Lee S, Tomporowski P, et al. Physical activity, fitness, cognitive function, and academic achievement in children: a systematic review. Med Sci Sports Exerc. (2016) 48:1197–222. doi: 10.1249/MSS.0000000000000901
45. Bohr AD, Boardman JD, McQueen MB. Association of adolescent sport participation with cognition and depressive symptoms in early adulthood. Orthop J Sports Med. (2019) 7:2325967119868658. doi: 10.1177/2325967119868658
46. Deshpande SK, Hasegawa RB, Weiss J, Small DS. The association between adolescent football participation and early adulthood depression. PLoS ONE. (2020) 15:e0229978. doi: 10.1371/journal.pone.0229978
47. Iverson GL, Merz ZC, Terry DP. Playing high school football is not associated with increased risk for suicidality in early adulthood. Clin J Sport Med. in press.
48. Iverson GL, Merz ZC, Terry DP. High school football and midlife brain health problems. Clin J Sport Med. (2021). doi: 10.1097/JSM.0000000000000898. [Epub ahead of print].
49. Deshpande SK, Hasegawa RB, Rabinowitz AR, Whyte J, Roan CL, Tabatabaei A, et al. Association of playing high school football with cognition and mental health later in life. JAMA Neurol. (2017) 74:909–18. doi: 10.1001/jamaneurol.2017.1317
50. Gaulton TG, Deshpande SK, Small DS, Neuman MD. Observational study of the associations of participation in high school football with self-rated health, obesity, and pain in adulthood. Am J Epidemiol. (2020) 189:592–601. doi: 10.1093/aje/kwz260
51. Janssen PH, Mandrekar J, Mielke MM, Ahlskog JE, Boeve BF, Josephs K, et al. High school football and late-life risk of neurodegenerative syndromes, 1956-1970. Mayo Clin Proc. (2017) 92:66–71. doi: 10.1016/j.mayocp.2016.09.004
52. Savica R, Parisi JE, Wold LE, Josephs KA, Ahlskog JE. High school football and risk of neurodegeneration: a community-based study. Mayo Clin Proc. (2012) 87:335–40. doi: 10.1016/j.mayocp.2011.12.016
53. Koerte IK, Hufschmidt J, Muehlmann M, Tripodis Y, Stamm JM, Pasternak O, et al. Cavum septi pellucidi in symptomatic former professional football players. J Neurotrauma. (2016) 33:346–53. doi: 10.1089/neu.2015.3880
54. Strain JF, Womack KB, Didehbani N, Spence JS, Conover H, Hart J Jr, et al. Imaging correlates of memory and concussion history in retired national football league athletes. JAMA Neurol. (2015) 72:773–80. doi: 10.1001/jamaneurol.2015.0206
55. Lepage C, Muehlmann M, Tripodis Y, Hufschmidt J, Stamm J, Green K, et al. Limbic system structure volumes and associated neurocognitive functioning in former NFL players. Brain Imaging Behav. (2019) 13:725–34. doi: 10.1007/s11682-018-9895-z
56. Strain J, Didehbani N, Cullum CM, Mansinghani S, Conover H, Kraut MA, et al. Depressive symptoms and white matter dysfunction in retired NFL players with concussion history. Neurology. (2013) 81:25–32. doi: 10.1212/WNL.0b013e318299ccf8
57. Hart J Jr, Kraut MA, Womack KB, Strain J, Didehbani N, Bartz E, et al. Neuroimaging of cognitive dysfunction and depression in aging retired National Football League players: a cross-sectional study. JAMA Neurol. (2013) 70:326–35. doi: 10.1001/2013.jamaneurol.340
58. Alosco ML, Tripodis Y, Rowland B, Chua AS, Liao H, Martin B, et al. A magnetic resonance spectroscopy investigation in symptomatic former NFL players. Brain Imaging Behav. (2019) 14:1419–29. doi: 10.1007/s11682-019-00060-4
59. Small GW, Kepe V, Siddarth P, Ercoli LM, Merrill DA, Donoghue N, et al. PET scanning of brain tau in retired national football league players: preliminary findings. Am J Geriatr Psychiatry. (2013) 21:138–44. doi: 10.1016/j.jagp.2012.11.019
60. Hampshire A, MacDonald A, Owen AM. Hypoconnectivity and hyperfrontality in retired American football players. Sci Rep. (2013) 3:2972. doi: 10.1038/srep02972
61. Ford JH, Giovanello KS, Guskiewicz KM. Episodic memory in former professional football players with a history of concussion: an event-related functional neuroimaging study. J Neurotrauma. (2013) 30:1683–701. doi: 10.1089/neu.2012.2535
62. Stern RA, Adler CH, Chen K, Navitsky M, Luo J, Dodick DW, et al. Tau positron-emission tomography in former National football league players. N Engl J Med. (2019) 380:1716–25. doi: 10.1056/NEJMoa1900757
63. Coughlin JM, Wang Y, Minn I, Bienko N, Ambinder EB, Xu X, et al. Imaging of glial cell activation and white matter integrity in brains of active and recently retired National Football League players. JAMA Neurol. (2017) 74:67–74. doi: 10.1001/jamaneurol.2016.3764
64. Amen DG, Willeumier K, Omalu B, Newberg A, Raghavendra C, Raji CA. Perfusion neuroimaging abnormalities alone distinguish National Football League players from a healthy population. J Alzheimers Dis. (2016) 53:237–41. doi: 10.3233/JAD-160207
65. Schaffert J, LoBue C, Fields L, Wilmoth K, Didehbani N, Hart J Jr, et al. Neuropsychological functioning in ageing retired NFL players: a critical review. Int Rev Psychiatry. (2020) 32:71–88. doi: 10.1080/09540261.2019.1658572
66. Weir DR, Jackson JS, Sonnega A. National Football League Player Care Foundation: Study of Retired NFL Players. Ann Arbor, MI: University of Michigan, Institute for Social Research (2009).
67. Schwenk TL, Gorenflo DW, Dopp RR, Hipple E. Depression and pain in retired professional football players. Med Sci Sports Exerc. (2007) 39:599–605. doi: 10.1249/mss.0b013e31802fa679
68. Guskiewicz KM, Marshall SW, Bailes J, McCrea M, Cantu RC, Randolph C, et al. Association between recurrent concussion and late-life cognitive impairment in retired professional football players. Neurosurgery. (2005) 57:719–26; discussion 719–26. doi: 10.1227/01.NEU.0000175725.75780.DD
69. Kerr ZY, Marshall SW, Harding HP Jr, Guskiewicz KM. Nine-year risk of depression diagnosis increases with increasing self-reported concussions in retired professional football players. Am J Sports Med. (2012) 40:2206–12. doi: 10.1177/0363546512456193
70. Plessow F, Pascual-Leone A, McCracken CM, Baker J, Krishnan S, Baggish A, et al. Self-reported cognitive function and mental health diagnoses among former professional American-style football players. J Neurotrauma. (2020) 37:1021–8. doi: 10.1089/neu.2019.6661
71. Roberts AL, Pascual-Leone A, Speizer FE, Zafonte RD, Baggish AL, Taylor H Jr, et al. Exposure to American football and neuropsychiatric health in former national football league players: findings from the football players health study. Am J Sports Med. (2019) 47:2871–80. doi: 10.1177/0363546519868989
72. McKee AC, Gavett BE, Stern RA, Nowinski CJ, Cantu RC, Kowall NW, et al. TDP-43 proteinopathy and motor neuron disease in chronic traumatic encephalopathy. J Neuropathol Exp Neurol. (2010) 69:918–29. doi: 10.1097/NEN.0b013e3181ee7d85
73. McKee AC, Stein TD, Nowinski CJ, Stern RA, Daneshvar DH, Alvarez VE, et al. The spectrum of disease in chronic traumatic encephalopathy. Brain. (2013) 136:43–64. doi: 10.1093/brain/aws307
74. Mez J, Daneshvar DH, Kiernan PT, Abdolmohammadi B, Alvarez VE, Huber BR, et al. Clinicopathological evaluation of chronic traumatic encephalopathy in players of American football. J Am Med Assoc. (2017) 318:360–70. doi: 10.1001/jama.2017.8334
75. Lehman EJ, Hein MJ, Baron SL, Gersic CM. Neurodegenerative causes of death among retired National Football League players. Neurology. (2012) 79:1970–4. doi: 10.1212/WNL.0b013e31826daf50
76. Baron SL, Hein MJ, Lehman E, Gersic CM. Body mass index, playing position, race, and the cardiovascular mortality of retired professional football players. Am J Cardiol. (2012) 109:889–96. doi: 10.1016/j.amjcard.2011.10.050
77. Lehman EJ, Hein MJ, Gersic CM. Suicide mortality among retired national football league players who played 5 or more seasons. Am J Sports Med. (2016) 44:2486–91. doi: 10.1177/0363546516645093
78. Lincoln AE, Vogel RA, Allen TW, Dunn RE, Alexander K, Kaufman ND, et al. Risk and causes of death among former National football league players (1986-2012). Med Sci Sports Exerc. (2018) 50:486–93. doi: 10.1249/MSS.0000000000001466
79. Nguyen VT, Zafonte RD, Chen JT, Kponee-Shovein KZ, Paganoni S, Pascual-Leone A, et al. Mortality among professional American-style football players and professional american baseball players. JAMA Netw Open. (2019) 2:e194223. doi: 10.1001/jamanetworkopen.2019.4223
80. Stamm JM, Bourlas AP, Baugh CM, Fritts NG, Daneshvar DH, Martin BM, et al. Age of first exposure to football and later-life cognitive impairment in former NFL players. Neurology. (2015) 84:1114–20. doi: 10.1212/WNL.0000000000001358
81. Stamm JM, Koerte IK, Muehlmann M, Pasternak O, Bourlas AP, Baugh CM, et al. Age at first exposure to football is associated with altered corpus callosum white matter microstructure in former professional football players. J Neurotrauma. (2015) 32:1768–76. doi: 10.1089/neu.2014.3822
82. Schultz V, Stern RA, Tripodis Y, Stamm J, Wrobel P, Lepage C, et al. Age at first exposure to repetitive head impacts is associated with smaller thalamic volumes in former professional American football players. J Neurotrauma. (2018) 35:278–85. doi: 10.1089/neu.2017.5145
83. Kaufmann D, Sollmann N, Kaufmann E, Veggeberg R, Tripodis Y, Wrobel PP, et al. Age at first exposure to tackle football is associated with cortical thickness in former professional American football players. Cereb Cortex. (2021) 31:3426–34. doi: 10.1093/cercor/bhab021
84. Brett BL, Huber DL, Wild A, Nelson LD, McCrea MA. Age of First exposure to American football and behavioral, cognitive, psychological, and physical outcomes in high school and collegiate football players. Sports Health. (2019) 11:332–42. doi: 10.1177/1941738119849076
85. Iverson GL, Caccese JB, Merz Z, Buttner F, Terry DP. Age of first exposure to football is not associated with later-in-life cognitive or mental health problems. Front Neurol. (2021) 12:647314. doi: 10.3389/fneur.2021.647314
86. Iverson GL, Terry DP, Caccese JB, Buttner F, Merz ZC. Age of first exposure to football is not associated with midlife brain health problems. J Neurotrauma. (2021) 38:538–45. doi: 10.1089/neu.2020.7041
87. Caccese JB, DeWolf RM, Kaminski TW, Broglio SP, McAllister TW, McCrea M, et al. Estimated age of first exposure to American football and neurocognitive performance amongst NCAA male student-athletes: a cohort study. Sports Med. (2019) 49:477–87. doi: 10.1007/s40279-019-01069-x
88. Caccese JB, Bodt BA, Iverson GL, Kaminski TW, Bryk K, Oldham J, et al. Estimated age of first exposure to contact sports and neurocognitive, psychological, and physical outcomes in healthy NCAA collegiate athletes: a cohort study. Sports Med. (2020) 50:1377–92. doi: 10.1007/s40279-020-01261-4
89. Caccese JB, Houck Z, Kaminski TW, Clugston JR, Iverson GL, Bryk KN, et al. Estimated age of first exposure to American football and outcome from concussion. Neurology. (2020) 95:e2935–44. doi: 10.1212/WNL.0000000000010672
90. Houck ZM, Asken BM, Bauer RM, Caccese JB, Buckley TA, McCrea MA, et al. Academic aptitude mediates the relationship between socioeconomic status and race in predicting ImPACT scores in college athletes. Clin Neuropsychol. (2020) 34:561–79. doi: 10.1080/13854046.2019.1666923
91. Solomon GS, Kuhn AW, Zuckerman SL, Casson IR, Viano DC, Lovell MR, et al. Participation in pre-high school football and neurological, neuroradiological, and neuropsychological findings in later life: a study of 45 retired national football league players. Am J Sports Med. (2016) 44:1106–15. doi: 10.1177/0363546515626164
92. Alosco ML, Kasimis AB, Stamm JM, Chua AS, Baugh CM, Daneshvar DH, et al. Age of first exposure to American football and long-term neuropsychiatric and cognitive outcomes. Transl Psychiatry. (2017) 7:e1236. doi: 10.1038/tp.2017.197
93. Montenigro PH, Alosco ML, Martin BM, Daneshvar DH, Mez J, Chaisson CE, et al. Cumulative head impact exposure predicts later-life depression, apathy, executive dysfunction, and cognitive impairment in former high school and college football players. J Neurotrauma. (2017) 34:328–40. doi: 10.1089/neu.2016.4413
94. Alosco ML, Mez J, Tripodis Y, Kiernan PT, Abdolmohammadi B, Murphy L, et al. Age of first exposure to tackle football and chronic traumatic encephalopathy. Ann Neurol. (2018) 83:886–901. doi: 10.1002/ana.25245
95. De Caro S, Kaplen MV. Youth Tackle Football—Proposed Legislation: DE CARO & KAPLEN, LLP 2020. Available online at: https://brainlaw.com/youth-tackle-football/ (accessed June 14, 2021).
96. Greenhalgh T, Thorne S, Malterud K. Time to challenge the spurious hierarchy of systematic over narrative reviews? Eur J Clin Invest. (2018) 48:e12931. doi: 10.1111/eci.12931
97. Siddaway AP, Wood AM, Hedges LV. How to do a systematic review: a best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses. Annu Rev Psychol. (2019) 70:747–70. doi: 10.1146/annurev-psych-010418-102803
98. Hayden JA, van der Windt DA, Cartwright JL, Cote P, Bombardier C. Assessing bias in studies of prognostic factors. Ann Intern Med. (2013) 158:280–6. doi: 10.7326/0003-4819-158-4-201302190-00009
99. Larrabee GJ, Rohling ML, Binder LM. Age of first exposure to football and later-life cognitive impairment in former NFL players. Neurology. (2015) 85:1007–8.
100. Andrikopoulos J. Age of first exposure to football and later-life cognitive impairment in former NFL players. Neurology. (2015) 85:1007.
101. Maroon JC, Bailes J, Collins M, Lovell M, Mathyssek C. Age of first exposure to football and later-life cognitive impairment in former NFL players. Neurology. (2015) 85:1007. doi: 10.1212/WNL.0000000000001942
102. Stern RA, Stamm JM, Tripodis Y. Age of first exposure to football and later-life cognitive impairment in former NFL players. Neurology. (2015) 85:1008–10.
103. Anderson DR, Burnham KP, Gould WR, Cherry S. Concerns about finding effects that are actually spurious. Wildl Soc Bull. (2001) 29:311–6. Available online at: https://sites.warnercnr.colostate.edu/anderson/wp-content/uploads/sites/26/2016/11/Concerns.pdf
104. Buttner F, Toomey E, McClean S, Roe M, Delahunt E. Are questionable research practices facilitating new discoveries in sport and exercise medicine? The proportion of supported hypotheses is implausibly high. Br J Sports Med. (2020) 54:1365–71. doi: 10.1136/bjsports-2019-101863
105. Forstmeier W, Wagenmakers EJ, Parker TH. Detecting and avoiding likely false-positive findings - a practical guide. Biol Rev Camb Philos Soc. (2017) 92:1941–68. doi: 10.1111/brv.12315
106. Kerr NL. HARKing: hypothesizing after the results are known. Pers Soc Psychol Rev. (1998) 2:196–217. doi: 10.1207/s15327957pspr0203_4
107. Peng P, Fuchs D. A Meta-analysis of working memory deficits in children with learning difficulties: is there a difference between verbal domain and numerical domain? J Learn Disabil. (2016) 49:3–20. doi: 10.1177/0022219414521667
108. Kramer JH, Knee K, Delis DC. Verbal memory impairments in dyslexia. Arch Clin Neuropsychol. (2000) 15:83–93. doi: 10.1093/arclin/15.1.83
109. Zuckerman SL, Lee YM, Odom MJ, Solomon GS, Sills AK. Baseline neurocognitive scores in athletes with attention deficit-spectrum disorders and/or learning disability. J Neurosurg Pediatr. (2013) 12:103–9. doi: 10.3171/2013.5.PEDS12524
110. Elbin RJ, Kontos AP, Kegel N, Johnson E, Burkhart S, Schatz P. Individual and combined effects of LD and ADHD on computerized neurocognitive concussion test performance: evidence for separate norms. Arch Clin Neuropsychol. (2013) 28:476–84. doi: 10.1093/arclin/act024
111. Asken BM, Houck ZM, Clugston JR, Larrabee GJ, Broglio SP, McCrea MA, et al. Word-reading ability as a “hold test” in cognitively normal young adults with history of concussion and repetitive head impact exposure: a CARE Consortium Study. Clin Neuropsychol. (2020) 34:919–36. doi: 10.1080/13854046.2019.1680735
112. Schretlen DJ, Buffington AL, Meyer SM, Pearlson GD. The use of word-reading to estimate “premorbid” ability in cognitive domains other than intelligence. J Int Neuropsychol Soc. (2005) 11:784–7. doi: 10.1017/S1355617705050939
113. Franzen MD, Burgess EJ, Smith-Seemiller L. Methods of estimating premorbid functioning. Arch Clin Neuropsychol. (1997) 12:711–38. doi: 10.1093/arclin/12.8.711
114. Bright P, Hale E, Gooch VJ, Myhill T, van der Linde I. The National adult reading test: restandardisation against the wechsler adult intelligence scale-fourth edition. Neuropsychol Rehabil. (2018) 28:1019–27. doi: 10.1080/09602011.2016.1231121
115. Crawford JR, Deary IJ, Starr J, Whalley LJ. The NART as an index of prior intellectual functioning: a retrospective validity study covering a 66-year interval. Psychol Med. (2001) 31:451–8. doi: 10.1017/S0033291701003634
116. Frick A, Wahlin TB, Pachana NA, Byrne GJ. Relationships between the National Adult Reading Test and memory. Neuropsychology. (2011) 25:397–403. doi: 10.1037/a0021988
117. Swanson HL, Xinhua Z, Jerman O. Working memory, short-term memory, and reading disabilities: a selective meta-analysis of the literature. J Learn Disabil. (2009) 42:260–87. doi: 10.1177/0022219409331958
118. Johnson AS, Flicker LJ, Lichtenberg PA. Reading ability mediates the relationship between education and executive function tasks. J Int Neuropsychol Soc. (2006) 12:64–71. doi: 10.1017/S1355617706060073
119. Swanson HL. Adults with reading disabilities: converting a meta-analysis to practice. J Learn Disabil. (2012) 45:17–30. doi: 10.1177/0022219411426856
120. Casson IR, Viano DC, Haacke EM, Kou Z, LeStrange DG. Is there chronic brain damage in retired NFL players? Neuroradiology, neuropsychology, and neurology examinations of 45 retired players. Sports Health. (2014) 6:384–95. doi: 10.1177/1941738114540270
121. Hunzinger KJ, Caccese JB, Costantini KM, Swanik CB, Buckley TA. Age of first exposure to collision sports does not affect patient reported outcomes in women and men community rugby players. Med Sci Sports Exerc. (2021) 53:1895–902. doi: 10.1249/MSS.0000000000002657
122. Bryant BR, Narapareddy BR, Bray MJC, Richey LN, Krieg A, Shan G, et al. The effect of age of first exposure to competitive fighting on cognitive and other neuropsychiatric symptoms and brain volume. Int Rev Psychiatry. (2020) 32:89–95. doi: 10.1080/09540261.2019.1665501
123. Caccese JB, Iverson GL, Cameron KL, Houston MN, McGinty GT, Jackson JC, et al. Estimated age of first exposure to contact sports is not associated with greater symptoms or worse cognitive functioning in male U.S. service academy athletes. J Neurotrauma. (2020) 37:334–9. doi: 10.1089/neu.2019.6571
124. Caccese JB, Santos FV, Yamaguchi F, Jeka JJ. Age of first exposure to soccer heading and sensory reweighting for upright stance. Int J Sports Med. (2020) 41:616–27. doi: 10.1055/a-1141-3553
125. Houck Z, Asken B, Clugston J, Perlstein W, Bauer R. Socioeconomic status and race outperform concussion history and sport participation in predicting collegiate athlete baseline neurocognitive scores. J Int Neuropsychol Soc. (2018) 24:1–10. doi: 10.1017/S1355617717000716
126. Althubaiti A. Information bias in health research: definition, pitfalls, and adjustment methods. J Multidiscip Healthc. (2016) 9:211–7. doi: 10.2147/JMDH.S104807
127. Dams-O'Connor K, Cantor JB, Brown M, Dijkers MP, Spielman LA, Gordon WA. Screening for traumatic brain injury: findings and public health implications. J Head Trauma Rehabil. (2014) 29:479–89. doi: 10.1097/HTR.0000000000000099
128. Corrigan JD, Bogner J. Initial reliability and validity of the Ohio State University TBI Identification Method. J Head Trauma Rehabil. (2007) 22:318–29. doi: 10.1097/01.HTR.0000300227.67748.77
129. Vanderploeg RD, Groer S, Belanger HG. Initial developmental process of a VA semistructured clinical interview for TBI identification. J Rehabil Res Dev. (2012) 49:545–56. doi: 10.1682/JRRD.2011.04.0069
130. Buttner F, Winters M, Delahunt E, Elbers R, Lura CB, Khan KM, et al. Identifying the ‘incredible'! Part 1: assessing the risk of bias in outcomes included in systematic reviews. Br J Sports Med. (2020) 54:798–800. doi: 10.1136/bjsports-2019-100806
131. Buttner F, Winters M, Delahunt E, Elbers R, Lura CB, Khan KM, et al. Identifying the ‘incredible'! Part 2: spot the difference - a rigorous risk of bias assessment can alter the main findings of a systematic review. Br J Sports Med. (2020) 54:801–8. doi: 10.1136/bjsports-2019-101675
132. Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al. Cochrane Handbook for Systematic Reviews of Interventions. West Sussex: John Wiley & Sons (2019). doi: 10.1002/9781119536604
133. Chouinard E, Walter S. Recall bias in case-control studies: an empirical analysis and theoretical framework. J Clin Epidemiol. (1995) 48:245–54. doi: 10.1016/0895-4356(94)00132-A
134. Coughlin SS. Recall bias in epidemiologic studies. J Clin Epidemiol. (1990) 43:87–91. doi: 10.1016/0895-4356(90)90060-3
135. Drews CD, Greeland S. The impact of differential recall on the results of case-control studies. Int J Epidemiol. (1990) 19:1107–12. doi: 10.1093/ije/19.4.1107
136. Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, et al. Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. (2004) 328:22–4. doi: 10.1136/bmj.328.7430.22
137. Kellmeyer P. Ethical and legal implications of the methodological crisis in neuroimaging. Camb Q Healthc Ethics. (2017) 26:530–54. doi: 10.1017/S096318011700007X
138. Gorgolewski KJ, Poldrack RA. A practical guide for improving transparency and reproducibility in neuroimaging research. PLoS Biol. (2016) 14:e1002506. doi: 10.1371/journal.pbio.1002506
139. Specht K. Current challenges in translational and clinical fMRI and future directions. Front Psychiatry. (2019) 10:924. doi: 10.3389/fpsyt.2019.00924
140. Lilienfeld SO. Psychology's replication crisis and the grant culture: righting the ship. Perspect Psychol Sci. (2017) 12:660–4. doi: 10.1177/1745691616687745
141. Tackett JL, Brandes CM, King KM, Markon KE. Psychology's replication crisis and clinical psychological science. Annu Rev Clin Psychol. (2019) 15:579–604. doi: 10.1146/annurev-clinpsy-050718-095710
142. Cowan N, Belletier C, Doherty JM, Jaroslawska AJ, Rhodes S, Forsberg A, et al. How do scientific views change? Notes from an extended adversarial collaboration. Perspect Psychol Sci. (2020) 15:1011–25. doi: 10.1177/1745691620906415
143. Fiske ST. Going in many right directions, all at once. Perspect Psychol Sci. (2017) 12:652–5. doi: 10.1177/1745691617706506
144. Leichsenring F, Abbass A, Hilsenroth MJ, Leweke F, Luyten P, Keefe JR, et al. Biases in research: risk factors for non-replicability in psychotherapy and pharmacotherapy research. Psychol Med. (2017) 47:1000–11. doi: 10.1017/S003329171600324X
145. Heyman T, Moors P, Rabagliati H. The benefits of adversarial collaboration for commentaries. Nat Hum Behav. (2020) 4:1217. doi: 10.1038/s41562-020-00978-6
146. Ellemers N, Fiske ST, Abele AE, Koch A, Yzerbyt V. Adversarial alignment enables competing models to engage in cooperative theory building toward cumulative science. Proc Natl Acad Sci USA. (2020) 117:7561–7. doi: 10.1073/pnas.1906720117
147. Mellers B, Hertwig R, Kahneman D. Do frequency representations eliminate conjunction effects? An exercise in adversarial collaboration. Psychol Sci. (2001) 12:269–75. doi: 10.1111/1467-9280.00350
148. Ioannidis JP. Why most published research findings are false. PLoS Med. (2005) 2:e124. doi: 10.1371/journal.pmed.0020124
Keywords: football, chronic traumatic encephalopathy (CTE), concussion, mild traumatic brain injury (mTBI), repetitive head impacts
Citation: Iverson GL, Büttner F and Caccese JB (2021) Age of First Exposure to Contact and Collision Sports and Later in Life Brain Health: A Narrative Review. Front. Neurol. 12:727089. doi: 10.3389/fneur.2021.727089
Received: 18 June 2021; Accepted: 27 August 2021;
Published: 29 September 2021.
Edited by:
Bridgette D. Semple, Monash University, AustraliaReviewed by:
Robert Lake Conder, Carolina Neuropsychological Service, United StatesScott Lawrence Zuckerman, Vanderbilt University Medical Center, United States
Copyright © 2021 Iverson, Büttner and Caccese. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Grant L. Iverson, Z2l2ZXJzb24mI3gwMDA0MDttZ2guaGFydmFyZC5lZHU=