Lulu Guan1
Bote Qi
Yu Zou- 1Department of Sport and Exercise Science, College of Education, Zhejiang University, Hangzhou, China
- 2School of Public Health, Hangzhou Normal University, Hangzhou, China
- 3College of Physical Education, Guizhou University of Finance and Economics, Guiyang, China
Background: The study of chronic traumatic encephalopathy (CTE) has received great attention from academia and the general public. This study aims to analyze the research productivity on CTE and investigate the most discussed articles in academia and the general public by conducting bibliometric and altmetric analyses.
Methods: Data of articles were obtained from the Web of Science Core Databases and Altmetric Explore. VOSviewer and CiteSpace software were used to analyze and visualize the articles. The correlation between Altmetric attention scores (AAS) and citation counts were assessed by Spearman correlation coefficient.
Results: 788 publications of CTE were eventually gathered and analyzed, and 100 articles with highest citation counts (Top-cited) and 100 articles with highest AASs (Top-AAS) were then identified. The keywords density map showed both the general public and the scientists were particularly interested in the risk factors and pathology of CTE, and scientists were interested in the causes and characteristics of neurodegenerative diseases while the public became increasingly concerned about the detection and prevention of CTE. By examining the shared characteristics of the 44 articles (High-High articles) that overlapped between Top-cited and Top-AAS articles, we identified certain traits that may potentially contribute to their high citation rates and high AASs. Besides, significant positive correlations with varied strength between AAS and citation were observed in the 788 articles, Top-cited, Top-AAS and High-High datasets.
Conclusion: This study is the first to link bibliometric and altmetric analyses for CTE publications, which may provide deeper understanding of the attention of the scientists and the general public pay to the study of CTE, and offer some guidance and inspiration for future CTE in the selection of research topics and directions.
Introduction
Chronic traumatic encephalopathy (CTE) is a progressive tauopathy that occurs due to repetitive mild traumatic brain injury (1). Over 93 years ago, Martland originally described the clinical aspects of a progressive neurological decline as “punch drunk,” which occurred after repetitive brain trauma in boxers (2). With the development of research, “chronic traumatic encephalopathy” was widely used to describe the disease. Later studies reported that CTE was unrestricted to boxing but also happened in various contact sports, including football, wrestling, rugby, hockey, lacrosse, soccer, and skiing (1). More than that, CTE has been diagnosed in military veterans with combat exposure and others who have suffered frequent head impacts (3–5). Although some reports suggest that degenerative brain disease is almost unavoidable for athletes participating in certain sports, a cause-and-effect relationship between exposure to contact sports and CTE has not been demonstrated (6). Yet, the actual prevalence of CTE is unknown (7). There are currently no definitive criteria for a diagnosis of CTE during life, and identifying CTE in a living individual is still challenging. The disease can only be definitively diagnosed through post-mortem examination of the brain tissue (8). In 2014, based on the literature of the clinical manifestations of CTE from 202 published cases, research diagnostic criteria for traumatic encephalopathy syndrome (TES) were proposed to diagnose CTE pathology in life (9). These criteria were used as a starting point and initial organizing structure for the development of following consensus criteria- NINDS Consensus Diagnostic Criteria for TES (9). And these criteria would be an invaluable tool to enhance the ability to diagnose and manage TES/CTE in individuals and possibly mitigate the associated consequences. Meanwhile, clinical symptoms of CTE can be nonspecific, and there may be overlap with other neurodegenerative diseases (10). In recent years, significant progress and achievements have been made in the field of CTE research, such as the development of advanced imaging techniques (11), identification of specific protein biomarkers (12), underlying pathogenesis of CTE (13), and potential therapeutic targets and interventions (14). In addition to the attention received in the research field, the term CTE has gained significant public attention due to intense media coverage. It has even been the subject of numerous documentaries and a Hollywood movie. Since CTE poses a threat to a significant part of the population and attracts the attention of scientists and the general public, it is important to analyze the dissemination and influence of CTE-related research in academia and the general public.
Bibliometrics is a traditional useful tool for evaluating the productivity, impact, and research trends in a certain field. From a scientific perspective, bibliometrics for determining the value of scientific research centers on the number of times the article is cited and the impact factor of the journal in which the article is published (15, 16). Besides, with the emergence and development of the internet and social media, altmetrics, shorter for alternative metrics, are increasingly utilized as nontraditional metrics of scholarly impact by a weighted calculation of the attention an article receives online (17). Data resources for altmetrics include Twitter, Facebook, blogs, news outlets, Wikipedia, Google, Weibo, Reddit, and other online platforms such as YouTube (18). Altmetric Explorer (Altmetric LLP, London, United Kingdom) generates a weighted score, known as Altmetric Attention Score (AAS). AAS tracks the online presence of articles by measuring and compiling the mentions an article receives across various social media outlets. Besides, AAS allows for continuous updating, and reflects an article’s online attention trends. In recent years, CTE has garnered increased public attention. The most-read article with an extremely AAS published in The Journal of the American Medical Association (JAMA) in 2017 reported that 110 of 111 (99%) former football players were suspected of having CTE (19). The article caused extensive controversy and sustained attention and discussion in society until now. Thus, altmetric analysis of CTE productions can help us understand how CTE research is being received and utilized by the general public, and provide evidence of the broader impact of CTE research beyond traditional bibliometric metrics.
Studies have combined bibliometric and altmetric analyses to conduct in-depth researches in some research areas, including osteoporosis, nuclear medicine, reproductive biology, obstetrics and gynecology, and urology (20–24). There were some bibliometric or altmetric studies on CTE in the literature (25–27). However, to the best of our knowledge, this is the first study that combines bibliometric with altmetric analysis about CTE. In this study, we aim to address the following issues: 1. identify the characteristics of total CTE article; 2. examine the traits and commonalities/differences between articles with the highest citation counts and articles with the highest AASs; 3. determine if there is any overlap between articles with the highest citation counts and articles with the highest AASs; 4. conduct an analysis of these overlapped articles. This study may be beneficial to the publication of papers by investigators and the design for the future research of CTE.
Materials and methods
Data sources
The data for measurement and statistical analysis were screened from the Web of Science Core Collection (WoSCC) and Altmetric Explorer1 on March 2023. We chose WoSCC because it collects scientific publications with the most significant impact and is used as the main criterion in academic decision making. Altmetric Explorer was used to obtain AAS data of the literature from WoSCC. Approval by institutional review boards was not required as the analysis was based on publicly accessible data. This cross-sectional altmetric and bibliometric study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline for cross-sectional studies (28).
Search strategy
The search strategy in the WoSCC database were as follows:
#1 TI = “chronic traumatic encephalopathy.”
#2 AB = “chronic traumatic encephalopathy.”
#3 AK = “chronic traumatic encephalopathy.”
#4 #1 OR #2 OR #3.
Inclusion and exclusion criteria
Inclusion criteria Document type: articles and reviews; Language: English. The results were arranged using a link on WoSCC database system “sort-by Citation-highest first.” Then, three independent investigators reviewed the titles and abstracts and deleted studies that were not associated with CTE. Any disagreements were resolved through discussion, and the input of an independent colleague would be sought where consensus could not be reached. The 839 records were selected and exported to an excel format. The DOI or PubMed identification number of articles were entered into the advanced search tool of Altmetric Explorer.
Exclusion criteria Articles without any AAS data were excluded. Eventually records for 788 articles that received altmetric activities were retrieved (Figure 1).
Figure 1. Flowchart detailing the paper collection and screening process.
Analysis of articles
Bibliometric data of 788 articles were downloaded from the WoSCC, and altmetric data of 788 articles were downloaded from Altmetric Explorer on March 2023. The analyses were performed using IBM SPSS, version 24 (Statistical Package for Social Sciences, Chicago, IL). For bibliometric data, we recorded title, study type, topic of the study, authors, organizations, publication year, citation number, keywords, journal name and impact factor. For altmetric data of 788 articles, we recorded the AASs and the number of mentions on Twitter, news outlets, blog posts, policy mentions, patent mentions, peer mentions, Facebook, and Wikipedia for each article. To provide insight into the characteristics of CTE research that with high citation rates and high AASs, the 100 articles with highest citation counts (Top-cited) and the 100 articles with highest AASs (Top-AAS) were identified for further research. The Spearman correlation coefficient was used to assess the correlation between AASs and citation numbers, and was interpreted according to r-level as follows: <0.19 (very weak), 0.2–0.39 (weak), 0.4–0.59 (moderate), 0.6–0.79 (strong), and > 0.8 (very strong). p < 0.01 was considered statistically significant.
Data visualization
In this study, VOSviewer (version 1.6.18) and CiteSpace (version 6.1.R2) were used for data visualization of Top-cited and Top-AAS articles. The keyword density visualization map was plotted by utilizing VOSviewer to identify the study subjects in a certain field and explore the research hotspots (29). The timeline review of keywords was exported by CiteSpace to show the chronological distribution and historical evolvement of knowledge domains (30).
Results
Characteristics of total 788 articles
Based on the study’s strategic flowchart, we eventually gathered 788 publications, and the related data were downloaded from WoSCC and Altmetric Explorer. As shown in Table 1, among the 788 articles, 63 articles were cited 0 times, 717 were cited 1 to 499 times, 5 were cited 500 to 999 times, and 3 were cited ≥1,000 times. There were 30 articles with AASs of 0, 741 articles with AASs between 1 and 499, 12 articles with AASs between 500 to 999, and 5 articles with AASs of ≥1,000. There was a moderate correlation between AASs and citation numbers (r = 0.406**, p < 0.01). We then analyzed the average number of online mentions per source for the 788 articles included in the study. Each online source in altmetrics is assigned a weight, such as 8 for every mention in a news article (Supplementary Table S1), and each publication is assigned every source score. The results showed that for the 788 articles the average score of Twitter was 24.74 and the average score of News was 6.40, which were far higher than other sources, indicating that Twitter and News outlets were the principal drivers of attention (Table 1). To provide a more detailed analysis of the AASs, we tracked the sources of AASs for 788 articles over time. Figure 2 showed the temporal evolution of mentions for all 788 research outputs between 2009 to 2023. The highest point of the waterfall chart, representing the peak of attention, manifested on Twitter in July 2017 with 1,311 mentions. The peak of News also appeared in July 2017 with 364 mentions. This surge in attention was not arbitrary, but directly correlated with the publication of a groundbreaking article by Dr. McKee et al. titled “Clinicopathological Evaluation of Chronic Traumatic Encephalopathy in Players of American Football,” published in JAMA (19). This work presented the largest CTE case series until 2017, revealing the presence of CTE in all but one of the 111 (99%) participants who were former National Football League players.
Table 1. Characteristics of total 788 articles.
Figure 2. Mentions over time of each AAS online source of 788 research outputs. The peak of News and Twitter appeared in July 2017 with 364 and 1,311 mentions.
Characteristics of the Top-cited and Top-AAS articles
We also conducted a detailed analysis of the citation counts, AASs, study designs, and open access status of the Top-cited and Top-AAS articles (Table 2). Among the Top-cited articles, 92 were cited 90 to 499 times, 5 were cited 500 to 999 times, and 3 were cited ≥1,000 times. Average citation of Top-cited articles was 244.88. There were 57 articles with AASs of 0–79, 34 articles with AASs between 80 and 499, 4 articles with AASs between 500 to 999, and 5 articles with AASs of ≥1,000. Average AAS of Top-cited articles was 225.49. Among the Top-AAS articles, 56 were cited 1 to 89 times, 36 were cited 90 to 499 times, 5 were cited 500 to 999 times, and 3 were cited ≥1,000 times. Average citation of Top-AAS articles was 157.57. There were 83 articles with AASs between 80 and 499, 12 articles with AASs between 500 to 999, and 5 articles with AASs of ≥1,000. Average AAS of Top-AAS articles was 341.6. A weak correlation was found between correlation of AASs and citation numbers in Top-cited articles (r = 0.36**, p < 0.01) and in Top-AAS articles (r = 0.247*, p < 0.05). As for the study design, nearly half of Top-cited articles were review (n = 47), and a quarter of Top-cited articles were basic study (n = 25), whereas nearly half of Top-AAS articles were observational study (n = 47), including case control (n = 17), case report (n = 8), case series (n = 6), cohort study (n = 13), cross-sectional (n = 3). Besides, Top-cited (n = 82) and Top-AAS (n = 89) articles were both more likely to be open access.
Table 2. Characteristics the top-cited and top-AAS articles.
Research hot topics of CTE
We separately plotted in Figures 3A,B the keyword density visualization map of the Top-cited and Top-AAS articles utilizing VOSviewer, and detailed keywords lists were presented in Table 3. Density views are especially useful for understanding the overall structure of a map and drawing attention to the most important areas on it (29). Each node in the keyword density visualization plot had a color that relied on the density of items at that node. The keywords in the red area appeared more recurrent, indicating the keywords were the most frequently occurring hot topics. We found that “chronic traumatic encephalopathy,” “Alzheimer’s disease,” “traumatic brain injury,” “concussion” and “brain-injury” were the hot topics both appeared in the Top-cited map and Top-AAS map. In addition to the hot keywords that both appeared in Top-cited map and Top-AAS map, we also found that some keywords “amyloid precursor protein,” “cerebrospinal-fluid diffuse,” “axonal injury” and “microglial activation” only appeared in Top-cited map, and “diagnosis,” “criteria” and “neuropathologic assessment” only appeared in Top-AAS map.
Figure 3. Keywords density visualization map of Top-cited (A) vs. Top-AAS (B) articles by VOSviewer software. “chronic traumatic encephalopathy,” “Alzheimer’s disease,” “traumatic brain injury,” “concussion” and “brain-injury” were the hot topics both appeared in the Top-cited map and Top-AAS map.
Table 3. Information of keywords with keywords density visualization map.
Knowledge evolution of CTE
In the CiteSpace timeline view, we could clearly see the evolution of each cluster over time. Each node in the network can be clustered together according to its interconnectivity to form different clusters, with each cluster representing a different professional or disciplinary concept (30). As shown in Figures 4A,B, the cluster and timeline views of the Top-cited and Top-AAS articles were presented, and clusters information were listed in Supplementary Table S2. The active time of each cluster on the timeline reflected the attention given to the research topic in different periods. The modularity value and the mean silhouette score were 0.614 (>0.3), 0.843 (>0.5) in Top-cited and 0.521 (>0.3), 0.813 (>0.5) in Top-AAS, indicating that the structures of clusters were significant and the clusters were efficient and convincing (30). In timeline view of Top-cited, there was a total of 9 clusters. #0 concussion, #1 dementia pugilistica, #3 motor neuron disease and #4 brain injury had been active since 1995, whereas #2 cerebrospinal fluid, #5 neurodegenerative disorders, #8 hypercapnia and #9 bbb began to receive attention in approximately 2010. Only #6 progressive supranuclear palsy and #7 mouse model still maintained a high degree of activity until now. In timeline view of Top-AAS, there was a total of 11 clusters. #0 American football, #1 brain injury, #2 tau, #3 league players, #6 phosphorylation and #9 epidemiology had been active since 2005, and #4 brain injury, #5 central nervous system, #7 mouse model, #8 repetitive brain trauma and #10 21st century brain bank had received attention since 2012. Notably, #0 American football, #3 league players, #6 phosphorylation, #7 mouse model and #11 catastrophic injury were relatively frontier research direction, which has received widespread attention today.
Figure 4. Timeline view of Top-cited (A) vs. Top-AAS (B) articles. This view represents the appearance of clusters at different time points and time spans. In timeline view of Top-cited (A), there was a total of 9 clusters. In timeline view of Top-AAS (B), there was a total of 11 clusters.
Overlaps between Top-cited and Top-AAS articles
There were 44 articles that overlapped between Top-cited and Top-AAS articles, indicating the 44 articles both had high citations and high AASs. We called them High-High articles in the following discussion and more details were available in the Supplementary Table S3. From Table 4, There were 36 articles were cited 90 to 499 times, 5 were cited 500 to 999 times, and 3 were cited ≥1,000 times. Among the High-High articles, 35 articles with AASs between 79 and 499, 4 articles with AASs between 500 to 999, and 5 articles with AASs of ≥1,000. It was evident that the average citation count and the average AAS of these High-High articles were significantly high, averaging at 317.89 and 476.2, respectively. There was a moderate correlation (r = 0.415**, p < 0.01) between citation numbers and AASs in the High-High articles. Most of the High-High articles were open access (n = 40). A considerable proportion of the High-High articles had more than 4 collaborating institutions (n = 36) and more than 5 authors (n = 33). Over half of the High-High articles (n = 25) published in journals with impact factor greater than 10. As for study design, the most common type of the High-High articles was observational study (n = 20), followed by review (n = 12). As for the characteristics of title, there were over half of High-High articles (n = 27) with number of words in title shorter than 12, nearly 1/3 articles (n = 12) with titles separated by a colon or ended with a question mark, and nearly 1/3 articles (n = 12) had declarative titles that used a verb (usually past tense or present tense).
Table 4. Characteristics the high-high articles.
Discussion
Over the last few decades, there has been an amount of breakthrough about CTE research, including biomarkers for differential diagnosis (12), in-vivo positron emission tomography (PET) tau imaging (11), neuropathological diagnosis criteria (8), and tau filaments structures determination (13). These developments were evidenced by the vast number of articles published on CTE. Although there were some bibliometric or altmetric studies on CTE in the literature (25–27), this study is the first of its kind to combine bibliometric and altmetric analysis that may provide a more comprehensive understanding of the CTE field. In this study, we identified the characteristics of total CTE articles and examined the traits and commonalities/differences between Top-cited and Top-AAS articles. We also found there were 44 articles that overlapped between Top-cited and Top-AAS articles and reported the characteristics of them. This study revealed the shared and distinct research interests in CTE among academia and the general public, and could provide researchers with suggestions and inspirations that might enhance the impact of their research work about CTE in the future.
Topic of interest in the scientific community and the general public
Through Top-cited and Top-AAS articles, we could see that there was considerable overlap between the topics covered by the two representative lists. From the common keywords list that appeared in Top-cited and Top-AAS articles (Table 3), we could observe that both the general public and the scientific community were particularly interested in the risk factors for neurodegenerative diseases such as CTE, AD, and dementia, especially the role of injury and concussion in their development. It is important to note that not all head injuries lead to CTE, and the exact relationship between head trauma and CTE is still not fully understood (31). The link between injuries, concussions, and CTE has become a major area of research in recent years, particularly in the context of professional sports. Furthermore, numerous studies indicated a correlation between traumatic brain injury (TBI) and post-traumatic stress disorder (PTSD), and demonstrated role of TBI in rendering individuals more susceptible to developing PTSD (32, 33). Moreover, we also found that the pathology of CTE captured the attention of the general public and scientific community. The accumulation of abnormal tau protein in the brain into neurofibrillary tangles is one of hallmarks of CTE (34). In addition to CTE, abnormal aggregation of tau protein also occurs in other neurodegenerative diseases like AD and dementia (32, 35). They may differ in the location, morphology, and severity of aggregation (12). More research is still needed to explore the specific mechanisms and impacts of tau aggregation in these neurodegenerative diseases. Besides, we could see from Figure 4 that mouse model is the research frontiers in the field of CTE and garnered both public and scientific attention. Establishing CTE-like disease in models (non-impact head acceleration, blast wave, weight drop, fluid percussion, and controlled cortical impact models) could provide a better understanding of neurobiological molecular pathways (36).
Substantial differences were also found between the characteristics of Top-cited and Top-AAS articles. By analyzing the unique keywords list in Top-cited articles, we could know that scientists were interested in studying the causes and characteristics of neurodegenerative diseases. Diffuse axonal injury, microglial activation, accumulation of amyloid precursor protein, neuroinflammation, and formation of beta-amyloid plaques are key factors in the development and progression of CTE. These factors may interact with each other, leading to dysfunction and death of brain cells (37). Research into these pathological features of CTE is ongoing, and investigating the underlying mechanisms may provide important insights into potential therapeutic targets for the disease.
However, from the unique keywords list in Top-AAS articles, we could know the general public has become increasingly concerned about the detection and prevention of CTE. Diagnosing CTE requires examining brain tissue under a microscope to detect the presence of specific neuropathological features, and there is currently no reliable method for diagnosing CTE in a living person (8). However, identifying ante-mortem prognosis of CTE instead of post-mortem diagnosis is of significant societal importance. PET imaging is being studied as a potential tool for detecting early signs of the disease in living individuals by detecting the concentration of tracer injected into the body (11). Recently, Boston University CTE Center examined the association between antemortem tracer flortaucipir-PET uptake and postmortem p-tau neuropathology in six deceased former elite American football players. Findings from this PET-to-autopsy case series suggested that PET tracer flortaucipir may be useful for detecting high stage CTE neuropathology (38). In future, more research is needed to refine this technique and develop it into a reliable diagnostic tool for CTE.
The shared characteristics of High-High articles
There were 44 articles that overlapped between the Top-cited and Top-AAS articles. The 44 High-High articles displayed both high number of citations and high AASs, indicating that these articles had both significant scholarly impact and great public attention. It can be concluded that certain topics or findings in CTE field have captured the attention of both the scientific community and the general public. This phenomenon did not appear in other similar studies (23, 24, 39). By examining the shared characteristics of High-High articles, we identified certain traits that may potentially contribute to their high citation rates and high AASs.
Journal impact: After conducting our analysis, we found that a significant portion of the High-High articles were featured in journals with notably high impact factors, such as Nature, Science, JAMA, Lancet, New England Journal of Medicine, and British Journal of Sports Medicine. This observation implied that publishing in a journal with a higher impact factor may be a viable strategy for achieving High-High outcomes, as is the case in other fields (40, 41).
Scientific collaboration: In 44 High-High articles, most article possessed more than five authors and involved three or more research institutions. Our analysis revealed a compelling link between research collaboration (individual or institutional) and the attainment of High-High outcomes. A number of studies found that multi-authorship increases above all the probability to be cited by others (42), and papers published by the cooperation of authors from several organizations gather significantly more citations than papers authored by authors from one organization (43, 44). Besides, it is maintained that papers with international collaboration have a greater impact than papers with national collaborations because of their greater quality and prestige (45). However, in High-High articles, institutional cooperation was still limited to Boston University and Harvard University, and remained primarily domestic cooperation within the United States. The strong international collaborations with other nations or regions have not found and they have not formed such a dense collaboration network. As noted in a previous bibliometric analysis of CTE, it was imperative that institutions from around the globe were motivated to engage in the discourse surrounding sports-related CTE and provide their diverse viewpoints (26). This will enable the establishment of a more comprehensive and diverse international network of collaborations, beyond the United States, to further advance the understanding and knowledge of CTE.
Study design: Our analysis revealed that observational studies were the most prevalent in High-High articles. Most of the observational studies were on diagnoses features (neuropathological and clinical) of CTE. However, typically, review papers tend to garner more impacts than research papers (43). AAS reflects the impact of disseminating research based on the interests of the general public, exhibiting greater interest in common clinical medicine topics than in complex, fundamental issues. The study subjects involved in these observational studies were the core population in the field of CTE that attracted public attention and spark discussion. These observational studies acted as building blocks of research and predominated among classics. The article titled “Clinicopathological Evaluation of Chronic Traumatic Encephalopathy in Players of American Football” published in JAMA July 25, 2017 with extremely high score 4,770 reported that 110 of 111 (99%) former football players were suspected of having CTE (19). Another article titled “The spectrum of disease in chronic traumatic encephalopathy” analyzed post-mortem brains obtained from a cohort of 85 subjects with histories of repetitive mild traumatic brain injury and found evidence of CTE in 68 subjects (46). These observational studies with stunning results and conclusions have sent shockwaves through the scientific environment and the general public.
Characteristics of the title: Through analyzing the title of High-High articles, we found that many article titles have certain characteristics, including brevity (Number of words in titles <12), attention-grabbing (Presence of a colon or question in title), and accuracy (Declarative: used a verb). An attractive, simple, understandable, concise, and informative title for articles might be more attractive to readers (47). This phenomenon in other disciplines also applied to our research, which the titles of High-High articles were more readable than titles that use complex terminologies. There was evidence that articles with shorter titles were more likely to have advantages of citations (40, 48, 49). and articles with declarative/interrogative titles were associated with higher AASs (40, 50). However, due to the limited scope of our research, more specialized studies of association between characteristics of tile and article impact, especially with higher sample size, are required to generalize the findings of our study.
Accessibility of papers: In our study, most of High-High articles were open access. Papers published in open access journals were cited more often in comparison to papers published in non-open access journals (51, 52). The impact of open access is not only reflected in citation, the potential for more extensive research dissemination inherent in the open access option may translate into greater reach and social media attention (53). When an article is more accessible, it has the potential to reach more readers and be cited more frequently, ultimately increasing its visibility and impact within its field.
Sharing activities on social media: We have tracked the AAS sources of the High-High articles, and found that news was a great contributor to the overall score. Our study provided objective evidence that these topics received a great deal of attention in prominent news media outlets such as CNN news, Yahoo, and TIMES. Besides, Twitter activity was one of the major contributors to the final AAS of almost all articles, which was consistent with other studies (54–56). We discovered that in addition to comments from the general public, many tweets about an article also came from official Twitter accounts of its published journal (@ScienceMagazine, @NaturePortfolio, @NEJM @JAMA_current and @Brain1878), research institution (@ShorterLabGrou, @UCSFmac, @Carter_Lab, @MADLab1, and @bu_cte), author team, and other relevant journals. In the era of social media today, various scholar organizations and individuals can use platforms such as Twitter/Blog to share their views and opinions, and promote their research results and perspectives. Moreover, many journals themselves have their own official Twitter accounts, particularly top journals such as Lancet, JAMA, Nature, and Science, and tweet their recent articles regularly. Many studies from other disciplines have confirmed the effectiveness of Twitter in increasing the impact of articles (57–60). The role of social platforms in the dissemination of research is being increasingly recognized.
In summary, through analyzing the High-High articles of Top-cited and Top-AAS, we summarized the commonalities, including: publishing in high-impact journals; having multilateral collaborations; observational studies; having attractive titles; open access; and using social media tools (Figure 5). It might provide valuable insights for researchers to improve the quality and impact of their future studies in CTE field.
Figure 5. The shared characteristics of High-High articles.
Associations between number of citations and AASs
Unlike findings reported by other similar studies(61–63), our results showed significant positive correlations between AAS and citation with varied strength for all 788 articles, Top-cited, Top-AAS, and High-High datasets. This difference between our work and other study may attribute to the differential research field. Although such associations were observed in our study, there was uncertainty surrounding the ability of the AAS score to accurately reflect traditional bibliometrics. Moreover, it is crucial to emphasize that online attention can be positive or negative. A controversial article may garner public interest, thereby increase the AAS of the article, while the impact of the article on the scientific community might not align with the level of public attention. Thus, AAS should be used as a complementary measure to aid researchers in appraising social media presence and evaluate the quality and impact of an article along with traditional metrics.
In the last, as previous study mentioned, several journals including the American Journal of Epidemiology, have appointed associate editors of social media to enhance conversations about the work they publish on social media (64). We would recommend that journals and researchers use various methods of social media promotion. Meanwhile, there is a need for increased incorporation of experimental study designs to better determine the effectiveness of different communication strategies across various channels. Twitter, News, Facebook, infographics, blog posts, virtual abstracts, and podcasts, each of these modalities has its unique characteristics and audience, and may have different effects on dissemination and readership of research findings. Today, the impact of a scientific work extends far beyond traditional citation metrics. An article might be read in order to create its value in clinical decision-making, academic educational content, educational content for the general public, development of a policy document or a guideline, public discourse and awareness, etc. Confronted with the crucial issue of CTE in people’s daily lives, CTE researchers should pay more attention to social media to introduce scientific achievements in simple and easy-to-understand language, and convey the value and significance of science to the public. Furthermore, researchers and policymakers could connect the public and academics to improve public understanding of CTE related knowledge, and share clinical guides to enhance public health.
Conclusion
This study presented bibliometric and altmetric overviews of CTE-linked literature and compared the most discussed articles on CTE, highlighting the similarities and differences in the understanding of CTE between the scientific community and the general public. There was a moderate correlation between AASs and citation numbers of the total articles we gathered. Both the general public and the scientific community were particularly interested in the risk factors and pathology of CTE, and scientists were interested in studying the causes and characteristics of neurodegenerative diseases while the public has become increasingly concerned about the detection and prevention of CTE. We determined that there was considerable overlap between articles that scientists and the general public most concerned, and analyzed the potential shared characteristics of the overlapped articles. This study, which combines altmetric and traditional metrics, may provide a more comprehensive description of scientific research output, offering a point of reference for future CTE research in the selection of study topics and directions.
Limitations
A possible limitation of this type of study was that a single database may lead to some missed publications and limit the scope of the analyses and results. It might be possible to find different insights if a larger sample of articles was included. In further studies, more various databases, such as Google Scholars, will be considered to collect data. Another limitation was the time dependence of both citation and social media mentions. The number of citations tends to increase with time, and citations rarely decrease. Unlike citations, the AAS is dynamic and can rise or fall. Lastly, given altmetric data’s recency bias, emerging research is more likely to be tweeted because Twitter was not available as a platform before 2007.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding authors.
Author contributions
LG: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Visualization, Writing – original draft. JT: Data curation, Formal analysis, Methodology, Writing – review & editing. BQ: Data curation, Formal analysis, Software, Visualization, Writing – review & editing. YC: Formal analysis, Software, Visualization, Writing – review & editing. ET: Data curation, Formal analysis, Writing – review & editing. JP: Conceptualization, Investigation, Supervision, Writing – review & editing. YZ: Conceptualization, Investigation, Methodology, Supervision, Writing – review & editing.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fneur.2024.1294125/full#supplementary-material
Footnotes
References
1. McKee, AC, Cantu, RC, Nowinski, CJ, Hedley-Whyte, ET, Gavett, BE, Budson, AE, et al. Chronic traumatic encephalopathy in athletes: progressive tauopathy after repetitive head injury. J Neuropathol Exp Neurol. (2009) 68:709–35. doi: 10.1097/NEN.0b013e3181a9d503
3. Chen, ST, Siddarth, P, Merrill, DA, Martinez, J, Emerson, ND, Liu, J, et al. FDDNP-PET tau brain protein binding patterns in military personnel with suspected chronic traumatic encephalopathy. J Alzheimers Dis. (2018) 65:79–88. doi: 10.3233/JAD-171152
4. McKee, AC, and Robinson, ME. Military-related traumatic brain injury and neurodegeneration. Alzheimers Dement. (2014) 10:S242. doi: 10.1016/j.jalz.2014.04.003
5. Weiner, MW, Friedl, KE, Pacifico, A, Chapman, JC, Jaffee, MS, Little, DM, et al. Military risk factors for Alzheimer’s disease. Alzheimers Dement. (2013) 9:445–51. doi: 10.1016/j.jalz.2013.03.005
6. Kelly, JP, Priemer, DS, Perl, DP, and Filley, CM. Sports concussion and chronic traumatic encephalopathy: finding a path forward. Ann Neurol. (2023) 93:222–5. doi: 10.1002/ana.26566
7. Smith, DH, Johnson, VE, Trojanowski, JQ, and Stewart, W. Chronic traumatic encephalopathy—confusion and controversies. Nat Rev Neurol. (2019) 15:179–83. doi: 10.1038/s41582-018-0114-8
8. McKee, AC, Stein, TD, Huber, BR, Crary, JF, Bieniek, K, Dickson, D, et al. Chronic traumatic encephalopathy (CTE): criteria for neuropathological diagnosis and relationship to repetitive head impacts. Acta Neuropathol. (2023) 145:371–94. doi: 10.1007/s00401-023-02540-wTurk
9. Montenigro, PH, Baugh, CM, Daneshvar, DH, Mez, J, Budson, AE, Au, R, et al. Clinical subtypes of chronic traumatic encephalopathy: literature review and proposed research diagnostic criteria for traumatic encephalopathy syndrome. Alzheimers Res Ther. (2014) 6:68. doi: 10.1186/s13195-014-0068-z
10. Lenihan, MW, and Jordan, BD. The clinical presentation of chronic traumatic encephalopathy. Curr Neurol Neurosci Rep. (2015) 15:23. doi: 10.1007/s11910-015-0541-5
11. Ayubcha, C, Revheim, ME, Newberg, A, Moghbel, M, Rojulpote, C, Werner, TJ, et al. A critical review of radiotracers in the positron emission tomography imaging of traumatic brain injury: FDG, tau, and amyloid imaging in mild traumatic brain injury and chronic traumatic encephalopathy. Eur J Nucl Med Mol Imaging. (2021) 48:623–41. doi: 10.1007/s00259-020-04926-4
12. Bergauer, A, Van Osch, R, Van Elferen, S, Gyllvik, S, Venkatesh, H, and Schreiber, R. The diagnostic potential of fluid and imaging biomarkers in chronic traumatic encephalopathy (CTE). Biomed Pharmacother. (2022) 146:112602. doi: 10.1016/j.biopha.2021.112602
13. Shi, Y, Zhang, W, Yang, Y, Murzin, AG, Falcon, B, Kotecha, A, et al. Structure-based classification of tauopathies. Nature. (2021) 598:359–63. doi: 10.1038/s41586-021-03911-7
14. Morin, A, Davis, R, Darcey, T, Michael, M, Benoit, M, and Fiona, C. Subacute and chronic proteomic and phosphoproteomic analyses of a mouse model of traumatic brain injury at two timepoints and comparison with chronic traumatic encephalopathy in human samples. Mol Brain. (2022) 15:62. doi: 10.1186/s13041-022-00945-4
15. Trueger, NS, Thoma, B, Hsu, CH, Sullivan, D, Peters, L, and Lin, M. The altmetric score: a new measure for article-level dissemination and impact. Ann Emerg Med. (2015) 66:549–53. doi: 10.1016/j.annemergmed.2015.04.022
16. Chang, J, Desai, N, and Gosain, A. Correlation between altmetric score and citations in pediatric surgery core journals. J Surg Res. (2019) 243:52. doi: 10.1016/j.jss.2019.05.010
17. Elmore, SA. The Altmetric attention score: what does it mean and why should I care? Toxicol Pathol. (2018) 46:252–5. doi: 10.1177/0192623318758294
18. Thelwall, M, Haustein, S, Larivière, V, and Sugimoto, CR. Do altmetrics work? Twitter and ten other social web services. PloS One. (2013) 8:e64841. doi: 10.1371/journal.pone.0064841
19. Mez, J, Daneshvar, DH, Kiernan, PT, Abdolmohammadi, B, Alvarez, VE, Huber, BR, et al. Clinicopathological evaluation of chronic traumatic encephalopathy in players of American football. JAMA. (2017) 318:360–70. doi: 10.1001/jama.2017.8334
20. Baek, S, Yoon, DY, Lim, KJ, Hong, JH, Moon, JY, Seo, YL, et al. Top-cited articles versus top altmetric articles in nuclear medicine: a comparative bibliometric analysis. Acta Radiol. (2020) 61:1343–9. doi: 10.1177/0284185120902391
21. O’Connor, EM, Nason, GJ, O’Kelly, F, Manecksha, RP, and Loeb, S. Newsworthiness vs scientific impact: are the most highly cited urology papers the most widely disseminated in the media? BJU Int. (2017) 120:441–54. doi: 10.1111/bju.13881
22. Suzan, V, Bektan Kanat, B, Yavuzer, H, and Doventas, A. Themes and trends for osteoporosis: the bibliometric and altmetric approach. Arch Osteoporos. (2021) 16:122. doi: 10.1007/s11657-021-00983-w
23. Park, S, Blackledge, K, Ananth, C, Sauer, M, and Brandt, J. Altmetric and bibliometric analysis of influential articles in reproductive biology, 1980–2019. Reprod Biomed Online. (2022) 45:384–90. doi: 10.1016/j.rbmo.2022.04.005
24. Grover, S, Elwood, AD, Patel, JM, Ananth, CV, and Brandt, JS. Altmetric and bibliometric analysis of obstetrics and gynecology research: influence of public engagement on citation potential. Am J Obstet Gynecol. (2022) 227:300.e1–300.e44. doi: 10.1016/j.ajog.2022.03.013
25. Qi, B, Jin, S, Qian, H, and Zou, Y. Bibliometric analysis of chronic traumatic encephalopathy research from 1999 to 2019. Int J Environ Res Public Health. (2020) 17:5411. doi: 10.3390/ijerph17155411
26. Wolfson, DI, Kuhn, AW, Kerr, ZY, Brett, BL, Yengo-Kahn, AM, Solomon, GS, et al. Chronic traumatic encephalopathy research viewed in the public domain: what makes headlines? Brain Inj. (2020) 34:528–34. doi: 10.1080/02699052.2020.1725843
27. Eagle, SR, and Okonkwo, DO. Telling the whole story: bibliometric network analysis to evaluate impact of media attention on chronic traumatic encephalopathy research. J Neurotrauma. (2023) 40:148–54. doi: 10.1089/neu.2022.0266
28. STROBE Initiative. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. Available at: https://www.equator-network.org/reporting-guidelines/strobe/
29. Van Eck, NJ, and Waltman, L. Software survey: VOSviewer, a computer program for bibliometric mapping. Forensic Sci. (2010) 84:523–38. doi: 10.1007/s11192-009-0146-3
31. Paul, M, Willem, HM, Mark, A, Bob, C, Jiří, D, Ruben, JE, et al. Consensus statement on concussion in sport: the 4th international conference on concussion in sport held in Zurich, November 2012. Br J Sports Med. (2013) 47:250–8. doi: 10.1136/bjsports-2013-092313
32. Gillam, W, Godbole, N, Sangam, S, DeTommaso, A, Foreman, M, and Lucke-Wold, B. Neurologic injury-related predisposing factors of post-traumatic stress disorder: a critical examination. Biomedicine. (2023) 11:2732. doi: 10.3390/biomedicines11102732
33. Lucke-Wold, B, Nolan, R, Nwafor, D, Nguyen, L, Cheyuo, C, Turner, R, et al. Post-traumatic stress disorder delineating the progression and underlying mechanisms following blast traumatic brain injury. J Neurosci Neuropharmacol. (2018) 4:118.
34. McKee, AC, Cairns, NJ, Dickson, DW, Folkerth, RD, Dirk Keene, C, Litvan, I, et al. The first NINDS/NIBIB consens us meeting to define neuropathological criteria for the diagnosis of chronic traumatic encephalopathy. Acta Neuropathol. (2016) 131:75–86. doi: 10.1007/s00401-015-1515-z
35. Sriram, S, and Lucke-Wold, B. Advances research in traumatic encephalopathy. Biomedicine. (2022) 10:2287. doi: 10.3390/biomedicines10092287
36. Turner, RC, Lucke-Wold, BP, Logsdon, AF, Robson, MJ, Lee, JM, Bailes, JE, et al. Modeling chronic traumatic encephalopathy: the way forward for future discovery. Front Neurol. (2015) 6:223. doi: 10.3389/fneur.2015.00223
37. Cherry, JD, Tripodis, Y, Alvarez, VE, Huber, B, Kiernan, PT, Daneshvar, DH, et al. Microglial neuroinflammation contributes to tau accumulation in chronic traumatic encephalopathy. Acta Neuropathol Commun. (2016) 4:112. doi: 10.1186/s40478-016-0382-8
38. Alosco, ML, Su, Y, Stein, TD, Protas, H, Cherry, JD, Adler, CH, et al. Associations between near end-of-life flortaucipir PET and postmortem CTE-related tau neuropathology in six former American football players. Eur J Nucl Med Mol Imaging. (2023) 50:435–52. doi: 10.1007/s00259-022-05963-x
39. Banshal, SK, Basu, A, Singh, VK, and Muhuri, PK. Scientific vs. public attention: a comparison of top cited papers in WoS and top papers by Altmetric score In: M Erdt, editor. Communications in Computer and Information Science, vol. 856. Singapore, SG: Springer Singapore (2018)
40. Didegah, F, Bowman, TD, and Holmberg, K. On the differences between citations and altmetrics: an investigation of factors driving altmetrics versus citations for finnish articles. J Assoc Inf Sci Technol. (2018) 69:832–43. doi: 10.1002/asi.23934
41. Araujo, AC, Vanin, AA, Nascimento, DP, Gonzalez, GZ, and Costa, LOP. What are the variables associated with Altmetric scores? Syst Rev. (2021) 10:193. doi: 10.1186/s13643-021-01735-0
42. Glänzel, W, Debackere, K, Thijs, B, and Schubert, A. A concise review on the role of author self-citations in information science, bibliometrics and science policy. Forensic Sci. (2006) 67:263–77. doi: 10.1007/s11192-006-0098-9
43. Tahamtan, I, Safipour Afshar, A, and Ahamdzadeh, K. Factors affecting number of citations: a comprehensive review of the literature. Forensic Sci. (2016) 107:1195–225. doi: 10.1007/s11192-016-1889-2
44. Puuska, H-M, Muhonen, R, and Leino, Y. International and domestic co-publishing and their citation impact in different disciplines. Forensic Sci. (2014) 98:823. doi: 10.1007/s11192-013-1181-7
45. Sooryamoorthy, R. Do types of collaboration change citation? A scientometric analysis of social science publications in South Africa. Forensic Sci. (2017) 111:379–400. doi: 10.1007/s11192-017-2265-6
46. McKee, AC, Stern, RA, Nowinski, CJ, Stein, TD, Alvarez, VE, Daneshvar, DH, et al. The spectrum of disease in chronic traumatic encephalopathy. Brain. (2013) 136:e255. doi: 10.1093/brain/awt051
47. Rostami, F, Mohammadpoorasl, A, and Hajizadeh, M. The effect of characteristics of title on citation rates of articles. Forensic Sci. (2014) 98:2007–10. doi: 10.1007/s11192-013-1118-1
48. Letchford, A, Moat, HS, and Preis, T. The advantage of short paper titles. 2015. R Soc Open Sci. (2015) 2:150266. doi: 10.1098/rsos.150266
49. Deng, B. Papers with shorter titles get more citations. Nature. (2015) 2:150266. doi: 10.1038/nature.2015.18246
50. Araujo, AC, Nascimento, DP, Gonzalez, GZ, Maher, CG, and Costa, LOP. Impact of low back pain clinical trials measured by the altmetric score: cross-sectional study. J Med Internet Res. (2018) 20:e86. doi: 10.2196/jmir.9368
51. Alkhawtani, RHM, Kwee, TC, and Kwee, RM. Citation advantage for open access articles in European radiology. Eur Radiol. (2020) 30:482–6. doi: 10.1007/s00330-019-06389-0
52. Hua, F, Sun, H, Walsh, T, Glenny, AM, and Worthington, H. Open access to journal articles in oncology: current situation and citation impact. Ann Oncol. (2017) 28:2612–7. doi: 10.1093/annonc/mdx398
53. Vadhera, AS, Lee, JS, Veloso, IL, Khan, ZA, Trasolini, NA, Gursoy, S, et al. Open access articles garner increased social media attention and citation rates compared with subscription access research articles: an altmetrics-based analysis. Am J Sports Med. (2022) 50:3690–7. doi: 10.1177/03635465221124885
54. Kolahi, J, Khazaei, S, Iranmanesh, P, Khademi, A, Nekoofar, MH, and Dummer, PMH. Altmetric analysis of the contemporary scientific literature in Endodontology. Int Endod J. (2020) 53:308–16. doi: 10.1111/iej.13226
55. Studenic, P, and Ospelt, C. Do you tweet?: trailing the connection between Altmetric and research impact! RMD Open. (2020) 6:e001034. doi: 10.1136/rmdopen-2019-001034
56. Wang, J, Alotaibi, NM, Ibrahim, GM, Kulkarni, AV, and Lozano, AM. The spectrum of altmetrics in neurosurgery: the top 100 “trending” articles in neurosurgical journals. World Neurosurg. (2017) 103:883. doi: 10.1016/j.wneu.2017.04.157
57. Nabavi, M. An analysis of journalism articles achieving high Altmetric attention scores. Learned Publishing. (2022) 35:617–24. doi: 10.1002/leap.1492
58. Moon, JY, Yun, EJ, Yoon, DY, Seo, YL, Cho, YK, Lim, KJ, et al. Analysis of the altmetric top 100 articles with the highest altmetric attention scores in medical imaging journals. Jpn J Radiol. (2020) 38:630–5. doi: 10.1007/s11604-020-00946-0
59. Garcovich, D, Ausina Marquez, V, and Adobes, MM. The online attention to research in periodontology: an Altmetric study on the most discussed articles on the web. J Clin Periodontol. (2020) 47:330–42. doi: 10.1111/jcpe.13221
60. Jeong, JW, Kim, MJ, Oh, H-K, Jeong, S, Kim, MH, Cho, JR, et al. The impact of social media on citation rates in coloproctology. Colorectal Dis. (2019) 21:1175–82. doi: 10.1111/codi.14719
61. Delli, K, Livas, C, Nikitakis, NG, and Vissink, A. Impact of COVID-19 dentistry-related literature: an altmetric study. Int Dent J. (2023) 73:770–6. doi: 10.1016/j.identj.2022.11.005
62. Collins, CS, Singh, NP, Ananthasekar, S, Boyd, CJ, Brabston, E, and King, TW. The correlation between altmetric score and traditional bibliometrics in orthopaedic literature. J Surg Res. (2021) 268:705–11. doi: 10.1016/j.jss.2021.07.025
63. Fox, ES, McDonnell, JM, Kelly, A, Cunniffe, GM, Darwish, S, Bransford, R, et al. The correlation between altmetric score and traditional measures of article impact for studies pertaining to spine trauma. Eur Spine J. (2023) 1–7. doi: 10.1007/s00586-023-07962-4
Keywords: chronic traumatic encephalopathy, altmetric attention score, bibliometric analysis, comparation, twitter
Citation: Guan L, Tan J, Qi B, Chen Y, Tong E, Pan J and Zou Y (2024) The bibliometric and altmetric analysis of chronic traumatic encephalopathy research: how great is the impact? Front. Neurol. 15:1294125. doi: 10.3389/fneur.2024.1294125
Edited by:
Jifeng Cai, Central South University, ChinaReviewed by:
Brandon Peter Lucke-Wold, University of Florida, United StatesM. Ahmed, Phcog.Net, India
Copyright © 2024 Guan, Tan, Qi, Chen, Tong, Pan and Zou. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jingcheng Pan, bmllcGFuamNAZ21haWwuY29t; Yu Zou, em91eXV6eUB6anUuZWR1LmNu