- 1Library of Zhuhai Campus, Jinan University, Zhuhai, China
- 2Department of Otorhinolaryngology-Head and Neck Surgery, The First Affiliated Hospital of Jinan University, Guangzhou, China
- 3Department of Neurology, The First Affiliated Hospital of Jinan University, Guangzhou, China
- 4Clinical Neuroscience Institute, The First Affiliated Hospital of Jinan University, Guangzhou, China
- 5Department of Subject Service and Consultation, Jinan University Library, Guangzhou, China
- 6Intellectual Property Information Service Center, Jinan University, Guangzhou, China
Since the outbreak of COVID-19, olfactory dysfunction (OD) has become an important and persistent legacy problem that seriously affects the quality of life. The purpose of this paper is to quantitatively analyze and visualize the current research status and development trend of COVID-19 related OD by using VOSviewer software. Based on the Web of Science database, a total of 1,592 relevant documents were retrieved in January 2023, with publication time spanning from 2020 to 2023. The bibliometric analysis revealed that the most influential research results in the field of COVID-19 related OD were concentrated in journals of related disciplines such as otorhinolaryngology, medicine, general and internal, virology, neurosciences, etc. The knowledge base of the research is mainly formed in two fields: COVID-19 clinical research and OD specialized research. The research hotspots are mainly concentrated in six directions: COVID-19, long COVID, smell, anosmia, OD, and recovery. Based on the results of the bibliometric analysis, the temporal trends of COVID-19 related OD studies were visually revealed, and relevant suggestions for future research were proposed.
1. Introduction
The novel coronavirus disease 2019 (COVID-19), caused by the severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), was first reported in late 2019 and quickly spread globally, leading to the declaration of a pandemic by the World Health Organization on March 11, 2020 (Sharma et al., 2020). A growing body of evidence suggests that the most common symptom of COVID-19 infection is the loss or diminished sense of smell (hyposmia) (Gori et al., 2020; Dawson et al., 2021; de Melo et al., 2021; Gupta et al., 2021). Before the COVID-19 pandemic, other factors such as viral infections, sinus disease, and head trauma could also cause olfactory loss (Desai and Oppenheimer, 2021). However, SARS-CoV-2 has been found to cause a more severe form of hyposmia compared to other seasonal cold viruses (Haehner et al., 2022). OD is also one of the most common neurological complications reported among patients with COVID-19 (Azizi and Azizi, 2020; Wei et al., 2022).
OD associated with COVID-19 has a significant impact on quality of life and may lead to several negative outcomes, such as malnutrition, weight loss, food poisoning, and exposure to hazardous chemicals (Gómez-Iglesias et al., 2020; Glezer et al., 2021). Moreover, individuals with COVID-19 who experience olfactory loss are more likely to suffer from poor sleep quality, high levels of fatigue, and depression compared to those who do not (Alqahtani et al., 2022).
In response to the COVID-19 pandemic, many researchers have focused on studying OD. Several literature reviews, systematic reviews, and meta-analyses have been conducted, including a meta-analysis of data from 24 studies of 8,438 patients with COVID-19 from 13 countries (Agyeman et al., 2020) and a meta-analysis of 11,074 patients with confirmed COVID-19 in 51 studies (Aziz et al., 2021). These studies have shown that OD is a common and important extrapulmonary manifestation of COVID-19.
However, despite these efforts, there have been only a limited number of comprehensive, quantitative analyses, and visualizations of COVID-19 related OD using bibliometrics. The data from these analyses were collected before 2021 (Hu et al., 2022; Zyoud et al., 2022), making it challenging to identify the most recent research directions in this field. To address this gap, this study will perform a comprehensive review and visualization of existing COVID-19 related OD research using a bibliometric approach. Specifically, co-citation analysis, co-word analysis, and cluster analysis will be applied to data retrieved from the Web of Science using VOSviewer. The results of this analysis will identify the knowledge base and research hotspots of COVID-19 related OD, reveal the temporal trends of this research, and provide recommendations for future COVID-19 related OD research.
2. Data source and analysis method
2.1. Data source
To ensure the authority and comprehensiveness of the study data, the Web of Science Core Collection was used as the data source, from which the Science Citation Index Expanded (SCI-EXPANDED) and Social Sciences Citation Index (SSCI) databases. The search terms for the COVID-19 Pandemic included “COVID-19,” “Corona Virus,” “Coronavirus,” and “2019-nCoV.” The search terms for Olfaction research included “olfactory,” “olfaction,” and “smell.” The search query was set as “TS = (COVID-19 or Corona Virus or Coronavirus or 2019-nCoV) AND TS = (olfactory or olfaction or smell).” The types of literature were limited to articles, review articles, and early access, with a publication year restricted to 2020 to present. The search was conducted on January 23, 2023, and a total of 1,592 relevant literature was finally retrieved and used as the data source for this study.
Table 1 presents the number of papers investigating OD in the context of the COVID-19 pandemic. As of January 23, 2023, 391 papers were published in 2020, with 655 papers in 2021, 541 papers in 2022, and 5 papers having been published in 2023. In the 1,592 relevant literature, there were 1,222 articles (76.76%), 359 review articles (22.55%), and 11 papers in early access type (0.69%). This indicates a significant amount of in-depth studies on COVID-19 related OD have been conducted since 2020, and suggests the rapidly evolving nature of the COVID-19 pandemic has necessitated a large number of Review Articles to keep up with the latest literature data.
According to Table 2, the top 10 countries or regions involved in COVID-19 related research are highly concentrated. Out of the 104 countries or regions worldwide, the United States leads with a total of 395 documents, representing 24.812% of the scientific output. This is followed by Italy with 216 articles, accounting for 13.568%. Other countries such as England, Germany, France, and others have also made significant contributions to the research output. The top 10 countries alone make up 93.72% of the total publications on the subject, highlighting a noticeable concentration trend.
2.2. Analysis method
Since 1969 (Pritchard, 1969), bibliometric analysis has been widely used in scientific and application fields (Ellegaard and Wallin, 2015; Huang et al., 2016; Xu et al., 2021). Since 2020, bibliometric analysis has been used (Zhang et al., 2020; Lin et al., 2022; Pang et al., 2022; Xie et al., 2022) to help researchers grasp the knowledge base, hot spots, and trends in the research field of COVID-19. VOSviewer, a powerful bibliometric analysis software developed by van Eck and Waltman in 2010, which offers advanced graphical representation capabilities for mapping knowledge units and their relationships within the research literature (van Eck and Waltman, 2010). In order to perform bibliometric analysis of the knowledge base and research hotspots of COVID-19 related OD research, VOSviewer was used as the knowledge mapping analysis tool in this paper, and the software version was VOSviewer_1.6.19. First, the full record and cited references data of the retrieved 1,592 literature references data retrieved were imported into VOSviewer, and then co-citation analysis, co-word analysis and cluster analysis were performed. The research structure of this review is shown in Figure 1.
3. Results
3.1. Most co-cited journals
As depicted in Figure 2, the results of the co-citation analysis of cited sources are presented in a mapping format, produced using the VOSviewer software. In order to ensure the relevance of the results, the authors chose to only include cited sources with a citation frequency exceeding 200. Out of the 91 cited sources present in the data set, 61 sources met this criterion.
The visual representation in Figure 2 utilizes nodes to symbolize sources and links to indicate the co-citation relationships between them. Sources that share close co-citation relationships are marked with the same color. The results of the analysis highlight that the majority of the co-cited sources in COVID-19 related ocular disease research are journal articles. Notable journals such as the New England Journal of Medicine, European Archives of Oto-Rhino-Laryngology, Lancet, and Nature occupy a central position and are closely distributed, showcasing their significant influence on the topic of COVID-19 related ocular disease research and their interrelatedness.
Table 3 showcases the top ten journals as determined by the Total Link Strength (TLS) metric in VOSviewer. The New England Journal of Medicine, European Archives of Oto-Rhino-Laryngology, and International Forum of Allergy & Rhinology stand out as the journals with higher Local Citation Score (LCS) and TLS values compared to other journals. This implies that these journals possess a strong reputation in the field of COVID-19 related ocular disease research. Eight of the top ten journals are published in the United States while the remaining two are published in Europe, indicating a concentration of COVID-19 related ocular disease research in these regions. The analysis results in Table 3 also reveal that the most impactful journals for COVID-19 related ocular disease research primarily belong to the categories of otorhinolaryngology, medicine, general and internal medicine, virology, and neurosciences.
Figure 2 visually represents the co-citation relationships among the most influential journals in COVID-19 related OD research. The analysis highlights the dominance of medicine, general, and internal journals (e.g., New England Journal of Medicine, Lancet) in the red area, while the blue area is dominated by otorhinolaryngology journals (e.g., European Archives of Oto-Rhino-Laryngology, International Forum of Allergy & Rhinology). The yellow area is a cluster of neurology journals, including Frontiers in Neurology, and the green area is dominated by comprehensive journals such as Nature and Science. This illustration demonstrates a pronounced interdisciplinary cross-fertilization among COVID-19 related OD research themes, as evidenced by the co-citation relationships among journals in the red, blue, yellow, and green regions.
3.2. Most co-cited references
As depicted in Figure 3, the results of the co-citation analysis of highly cited references are presented, with the 20 most frequently cited references highlighted. The selection criteria of these references were established based on a minimum citation frequency of 128, out of a total of 40,340 cited references in the dataset. These highly cited references serve as indicators of the key topics and influential works in the field.
Figure 3 and Table 4 present the results of the highly cited reference analysis in the COVID-19 related OD research field. The selection criteria for these cited references were a citation frequency of over 128, and 20 references met this criterion among the 40,340 cited references in the dataset. The results are sorted by the TLS metric, and the LCS and Global Citation Score (GCS) are also listed.
The LCS metric measures the number of citations between locally retrieved collections of literature, and can reflect the degree of attention given to specific literature within a particular field, similar to peer evaluation metrics. It can be seen from the results in Table 4 that the majority of the most influential literature in COVID-19 related OD research is concentrated in 2020 and 2021, with the exception of one research literature from 2008. The types of literature mainly involve Articles, Letters, Reviews, and Editorial Material. Both specialized literature with low GCS indicators and clinical research literature with high GCS indicators are represented.
These findings emphasize the significance of recent developments in the COVID-19 related OD research field, as well as the importance of considering both specialized and clinical research literature in evaluating the impact of this research area.
Figure 3 and Table 4 highlight the divided knowledge base of COVID-19 related OD research, with two main clusters identified based on the top 20 highly cited papers as determined by the VOSviewer LCS metrics. These clusters center around COVID-19 clinical research and specialized OD research topics.
The first cluster, which focuses on COVID-19 clinical research, is represented by the red area in Figure 3 and includes literature such as Netland et al. (2008), Baig et al. (2020), Brann et al. (2020), Guan et al. (2020), Hoffmann et al. (2020), Huang et al. (2020), Li et al. (2020), Mao et al. (2020), Moriguchi et al. (2020), and Meinhardt et al. (2021), among others. These articles delve into various aspects of COVID-19, including neurological symptoms, OD, the susceptibility of neurons to SARS-CoV-2, clinical features, and treatment options. In particular, Mao et al. (2020) conducted a case study on 214 COVID-19 patients in Wuhan, China and found a significant proportion of neurological symptoms, including central nervous system manifestations, peripheral nervous system manifestations, and skeletal muscle damage manifestations. Brann et al. (2020) explored the connection between SARS-CoV-2 infection of non-neuronal cells and OD in COVID-19 patients, while Netland et al. (2008) found that neurons were highly susceptible targets of SARS-CoV.
The second cluster of COVID-19 related OD research, as depicted by the green area in Figure 3, encompasses literature that focuses on specialized OD topics. This cluster comprises literature numbered 1, 3, 4, 7, 8, 11, 12, 14, 16, and 19 in Table 4. Literature No.1, with the highest LCS and TLS indicators among the specialized OD literature, is an investigation carried out by Lechien et al. (2020) who surveyed 417 patients with COVID-19 across 12 European hospitals. They found that olfactory and gustatory dysfunction were clinical manifestations of mild to moderate cases of COVID-19. In addition, literature numbered 3, 8, 11, and 19, as demonstrated by Giacomelli et al. (2020), Tong et al. (2020), Vaira et al. (2020a), and Yan C. H. et al. (2020), respectively, show that taste or smell impairment are symptoms commonly observed in SARS-CoV-2-positive hospitalized patients. Furthermore, literature numbered 4, 12, 14, and 16, as reported by Menni et al. (2020), Moein et al. (2020), Vaira et al. (2020b), and Yan C. R. H. et al. (2020), suggest that olfactory impairment is a feature of neoconiosis and that olfactory testing may be useful for identifying patients in need of early treatment or isolation. Lastly, Spinato et al. (2020) in literature No.7 assessed the prevalence, intensity, and duration of olfactory or taste alterations.
3.3. Emerging themes from the literature
In the present study, a keyword co-occurrence analysis was conducted on a corpus of 1,592 documents related to OD in the context of COVID-19. The VOSviewer tool was utilized to visualize the relationships between author keywords within this research area. The resulting graph presents author keywords as nodes, with larger nodes indicating a greater frequency of occurrence of these keywords. The line segments connecting these nodes represent the interrelatedness between the keywords, with thicker lines indicating a stronger association and shorter lines reflecting a closer connection.
Before conducting analysis in VOSviewer, a systematic data cleaning and term merging is carried out. For instance, in regards to keywords related to COVID-19, various terms such as “coronavirus disease 2019,” “coronavirus disease 2019 (COVID-19),” “COVID-19,” and “COVID-19” are standardized as “COVID-19.” This process of term merging and data cleaning is crucial in maintaining consistency in terminology and enabling accurate analysis.
Subsequently, after carefully reviewing the dataset containing 2,649 author keywords, it was determined that those with a co-occurrence frequency exceeding 11 were deemed to be of particular significance. As a result, 62 keywords were selected and used to generate the keyword co-occurrence analysis graph depicted in Figure 4.
Figure 4 illustrates the results of the co-word analysis performed on the keywords utilized by authors in the field of COVID-19 and its related areas of study within the OD domain. The analysis reveals the existence of six clusters, each distinguished by a unique color, representing closely related hot topics. In order to succinctly convey the main concepts and hot topics of each cluster, Table 5 summarizes these findings.
The results of the high-frequency author keyword co-occurrence analysis, as depicted in Figure 4 and summarized in Table 5, demonstrate the major hotspots and emerging themes in COVID-19 related research within the OD domain. Utilizing the VOSviewer tool, the findings indicate that these themes can be broadly categorized into six clusters: COVID-19, long COVID, smell, anosmia, olfactory dysfunction, and recovery research. This information provides valuable insight into the current state and direction of COVID-19 related research.
Cluster 1 (Red): An examination of COVID-19 research was conducted and revealed the largest cluster, comprising 28 keywords. The most prevalent keyword, “COVID-19” (occurrences = 1,052, total link strength = 2,492), was found to be closely related to “SARS-CoV-2,” “ACE2,” “olfactory bulb,” “CNS,” “neurological manifestations,” and other relevant terms.
Cluster 2 (Green): The second significant cluster was identified as related to the phenomenon of long COVID, which consisted of 12 keywords. The most frequently occurring keyword, “long COVID” (occurrences = 70, total link strength = 154), was found to be associated with “symptoms,” “epidemiology,” “children,” “healthcare workers,” “prevalence,” and other related keywords.
Cluster 3 (Blue): This cluster, consisting of 10 keywords, was found to be related to the research area of smell. The most frequent keyword, “smell” (occurrences = 173, total link strength = 688), was shown to be one of many neurological symptoms affected by the “coronavirus” and “virus,” impacting sensory perception and resulting in related neurological symptoms such as “olfaction,” “taste,” “gustatory,” “hyposmia,” “hypogeusia,” and others.
Cluster 4 (Yellow): Our analysis revealed the emergence of a cluster centered around the theme of anosmia, with six keywords identified. The keyword “Anosmia” had the highest frequency of occurrence (occurrences = 370, total link strength = 1,259) and was found to be strongly associated with “dysgeusia,” “ageusia,” “taste loss,” and “coronavirus infections,” and “SARS-CoV-2 infection.”
Cluster 5 (Purple): Another cluster was identified that pertains to OD, encompassing three keywords. The keyword “olfactory dysfunction” was the most frequently occurring among these keywords (occurrences = 255, total link strength = 788) and was observed to have a causal relationship with “olfactory training” and “quality of life.”
Cluster 6 (Turquoise): The sixth cluster identified in our analysis pertained to the theme of Recovery, with three keywords identified. The keyword “recovery” was the most frequently occurring among these keywords (occurrences = 29, total link strength = 113) and was observed to be associated with “smell test” and “prognosis.”
The largest of the six study clusters discussed is COVID-19, where evidence has emerged that SARS-CoV-2 infecting Angiotensin-converting enzyme 2 (ACE2) leads to olfactory impairment in patients with neocoronary pneumonia (Bilinska et al., 2020). The presence of the virus in the olfactory epithelium and bulb further highlights the critical role that olfaction plays in the potential pathways of SARS-CoV-2 entry into the central nervous system (CNS) (Lima et al., 2020; Klingenstein et al., 2021). The growing body of research supports the notion that SARS-CoV-2 can target the nervous system, leading to various neurological manifestations, including loss of smell and taste (Divani et al., 2020). The second largest cluster is “long COVID,” which refers to symptoms, signs, and adverse reactions that persist for a prolonged period following neocoronavirus infection. Among the symptoms of Long COVID, Liao et al. (2022) have noted that olfactory and gustatory disturbances may be the primary symptoms in patients with long COVID-19. A significant proportion of patients reportedly develop persistent chemosensory impairments, including olfactory and taste disturbances, ranging from 3 months to 2 years after the onset of symptoms.
Studies from both the COVID-19 and long COVID clusters suggest that SARS-CoV-2 can result in neurological manifestations, including loss of smell, which may present as a persistent phenomenon in long COVID patients.
Within the six research clusters, four clusters, including smell, anosmia, olfactory dysfunction, and recovery, are focused on OD and its related themes. Multiple studies have reported that the senses of smell and taste are the most frequently impacted in patients with neocoronary pneumonia, with OD and taste impairment being key symptoms of the illness (Lechien et al., 2020; Yan C. H. et al., 2020; Ferrulli et al., 2022). Among them, OD is classified into two levels: olfactory loss (anosmia) and olfactory decline (hyposmia). The accurate detection, diagnosis, treatment, olfactory training, recovery, and prognosis of OD in neocoronary pneumonia patients are essential to enhance their quality of life.
4. Discussion
4.1. Research trend under the perspective of time
Given the rapidly evolving nature of COVID-19, with its alarming rate of transmission and the emergence of new mutant strains, it is imperative to have a comprehensive understanding of the spatiotemporal evolution of related research results. Therefore, in this paper, based on the clusters of Figure 4 and their keywords, and subsequently combined with the average year of publication values of each keyword counted in VOSviewer, we produced the mapping of keywords in six clusters of COVID-19 related OD temporal evolution, as shown in Figure 5, thus revealing the temporal trends of related studies.
As depicted in Figure 5, the temporal evolution of COVID-19 related OD research can be characterized by three distinct phases. The second phase, which began in the beginning of 2021, is the phase where the majority of the keywords in the six clusters of COVID-19 related OD research show a concentrated peak, particularly for keywords such as COVID-19, smell, anosmia, olfactory dysfunction, and recovery. This suggests that the world was facing its most challenging moment in terms of COVID-19 during this phase, with a significant shortage of medical resources in several countries and an immediate need for extensive COVID-19-related research efforts. The first phase encompasses the period prior to the start of 2021, during which the impact of COVID-19 on patients' sense of taste and smell was gradually being recognized. This phase saw the initial attention from researchers toward the topics of SARS, CNS, ACE2, and taste loss. Finally, the third phase, which began in 2021, has seen a consolidation of the objective fact that COVID-19 causes OD symptoms. This stage has witnessed a shift in research focus toward new areas, such as long COVID, olfactory bulb, fatigue, olfactory training, quality of life, among others.
4.2. Suggestions on future research
4.2.1. Understanding the mechanisms of OD
Several studies have explored the mechanisms underlying OD in COVID-19 patients. Pujadas et al. (2021) conducted a molecular profiling autopsy study and revealed the damage to the olfactory bulb caused by the New Coronary Pneumonia. Sharma et al. (2021) reviewed the entry pathways and pathogenic mechanisms of SARS-CoV-2 into the central nervous system, including the olfactory and retinal nervous systems. Najafloo et al. (2021) examined the mechanisms associated with olfactory impairment in neocoronary pneumonia, including olfactory cleft syndrome, local inflammation, apoptosis of olfactory cells, and damage to olfactory neurons and stem cells.
Sodagar et al. (2022) reviewed the pathological features, neuroinflammatory mechanisms, and potential treatments of SARS-CoV-2 in the brain, finding strong infection of the olfactory bulb, thalamus, and brainstem. Karimian et al. (2022) explored the molecular mechanism of SARS-CoV-2-induced olfactory deficit, suggesting that OD may be a temporary or long-term complication caused by olfactory neuroepithelial disorders, with the Delta and Omicron strains relying on TMPRSS2 to enter cells and inducing inflammation, apoptosis, and neuronal damage.
Despite these advances, there remains a significant knowledge gap regarding the possible mechanisms leading to olfactory loss (Dunai et al., 2022). Further studies are urgently needed to better understand and identify the causes of OD in COVID-19 patients, in order to improve prevention and treatment strategies (de Melo et al., 2021).
4.2.2. Assessment of OD
In recent years, various tools and methods have been employed to evaluate OD in patients with COVID-19. For instance, Duff et al. (2022) utilized brain magnetic resonance imaging (MRI) to assess the neuropsychiatric consequences of neocoronary pneumonia, demonstrating the high reliability of multiple imaging derived phenotypes (IDPs) in measuring the impact of SARS-CoV-2 infection on the brain through potential pathogenic mechanisms. Melkumyan et al. (2022) conducted a cross-sectional study that analyzed the sensitivity to olfaction and trigeminal nerve-triggered olfaction, as well as the ability to distinguish between different odors, in patients recovering from neocoronary pneumonia and revealed pathological changes in olfactory and trigeminal perceptual abilities that result in OD. Kim and Min (2022) proposed a psychophysical assessment system for OD in neocoronary pneumonia patients using a universal odorant that is free from the risk of viral transmission, which may provide early diagnosis and management of such patients. Ciofalo et al. (2022) used the Visual Analogue Scale (VAS) to prospectively evaluate nasal and olfactory symptoms in 162 neocoronary pneumonia patients. Gupta et al. (2022) utilized the Novel Anosmia Screening at Leisure (NASAL) patient report to assess olfactory perception, demonstrating its efficacy in identifying OD in patients.
These studies suggest that the use of OD assessment tools or methods can aid in our understanding of the prevalence of the disease and facilitate the development of effective treatments. However, further research is necessary in this field, particularly to establish standardized assessments that can more accurately measure OD in patients with COVID-19.
4.2.3. Interventions of OD
In addressing OD in patients with neocoronary pneumonia, a range of therapeutic approaches have been evaluated, including oral supplementation, topical medications, nasal rinses, and olfactory training.
Hosseinpoor et al. (2022) and Vaira et al. (2022) studied the effect of intranasal corticosteroid treatment on long-term OD recovery caused by COVID-19. At the same time, Veronese et al. (2022) found that the combination of olfactory rehabilitation and oral supplementation of palmitoyl ethanolamine and lidocaine can improve the treatment effect of post-conjunctivitis OD. A review by Gao et al. (2022) reported that topical herbal therapies demonstrated positive effects in the treatment of OD. Additionally, a study by Forouzanfar et al. (2022) revealed that diets containing pomegranate juice and lacquer sap were effective in reducing symptoms such as olfactory and gustatory dysfunction in patients with neoconjunctivitis.
As for olfactory training, Hwang et al. (2023) evaluated the impact of olfactory training on OD in patients with neocoronary pneumonia. It is found that olfactory training was effective in improving OD caused by neocoronary pneumonia both in the acute and chronic phases. Khan et al. (2022) conducted a randomized clinical trial on the efficacy of combined visual-olfactory training in patients with olfactory loss due to neocoronary pneumonia. The results of the trial suggest that bimodal visual-olfactory training may benefit patients with neocoronary pneumonia, although the efficacy of fragrance treatment has not yet been established.
In conclusion, multiple drug and non drug interventions have shown good results in the OD treatment of patients with COVID-19. Further research is needed to determine the most effective treatment and explore the potential benefits of joint intervention. In addition, personalized intervention is needed for different groups (such as children, the elderly and patients with potential health conditions) to better understand the impact of OD on these groups and develop personalized intervention measures.
4.2.4. Long COVID prognosis of OD
Several studies have investigated the prognosis of OD in patients with neocoronary pneumonia. Mendonca et al. (2022) reported that OD is more prevalent in patients with neocoronary pneumonia than in those with severe disease, and that the presence of olfactory hyposmia/anosmia may indicate a favorable prognosis in neocoronary pneumonia. Tan et al. (2022) found that a significant proportion of patients with neocoronary pneumonia may experience long-lasting changes in their sense of smell or taste, potentially exacerbating the impact of long COVID.
Ho et al. (2022) conducted autopsy assessments on patients with neocoronary pneumonia and found that the infection is associated with axonal damage and microangiopathy in the olfactory tissues, resulting in severe and permanent OD. A review by Ibrahim et al. (2022) explored the potential determinants of poor prognosis for neurological symptoms in neocoronary pneumonia and reported that the olfactory nerve is the most commonly affected cranial nerve, resulting in olfactory loss.
In conclusion, the long-term prognosis of OD in patients with neocoronary pneumonia is still hard to predict. Further studies are needed to ensure its recovery rate and persistence. This will be important in providing guidance and developing treatments for patients with persistent psychosis.
5. Conclusion
The COVID-19 pandemic has been a catastrophic public health event, with infection contributing to a significant increase in the global prevalence of OD symptoms, affecting the quality of life of long-term COVID-19 patients and posing a major challenge to human health. To address this challenge, it is crucial to raise awareness and further explore the underlying mechanisms of OD through research. Our study analyzed 1,592 publications related to COVID-19 related OD in the Web of Science database, demonstrating the broad interest of researchers from different disciplines and countries. The most influential findings in the field were published in otorhinolaryngology, medicine, general and internal medicine, virology, and neuroscience journals. The study identified six research hotspots, including COVID-19, long COVID, smell, anosmia, recovery, and olfactory dysfunction. These findings provide valuable insight into the temporal trends in COVID-19 related OD research and will aid future researchers in understanding and developing effective assessments, interventions, and prognostic options. Ultimately, a better understanding of the underlying mechanisms of OD in COVID-19 patients will be crucial in addressing the lasting legacy of the pandemic on human health.
Author contributions
YM and WB contributed to the writing and conception of the professional part of the study. ZY and JT contributed to the implementation of bibliometric methods and mapping. YM, ZY, and JT drafted the manuscript and performed the data analysis. WB and JT revised the manuscript and made critical suggestions on this work. All authors contributed to the article and approved the submitted version.
Funding
This research was supported by the Philosophy and Social Sciences Foundation of Guangdong Province of China (GD21CTS03).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Agyeman, A. A., Chin, K. L., Landersdorfer, C. B., Liew, D., and Ofori-Asenso, R. (2020). Smell and taste dysfunction in patients with COVID-19: a systematic review and meta-analysis. Mayo Clinic Proc. 95, 1621–1631. doi: 10.1016/j.mayocp.2020.05.030
Alqahtani, A. S., Aldhahi, M. I., Alqahtani, F., Altamimi, M., and Alshehri, M. M. (2022). Impact of the loss of smell on the sleep quality and fatigue level in COVID-19 survivors. Eur. Arch. Oto-Rhino-Laryngol. 279, 4443–4449. doi: 10.1007/s00405-022-07381-z
Aziz, M., Goyal, H., Haghbin, H., Lee-Smith, W. M., Gajendran, M., and Perisetti, A. (2021). The association of “loss of smell” to COVID-19: a systematic review and meta-analysis. Am. J. Med. Sci. 361, 216–225. doi: 10.1016/j.amjms.2020.09.017
Azizi, S. A., and Azizi, S. A. (2020). Neurological injuries in COVID-19 patients: direct viral invasion or a bystander injury after infection of epithelial/endothelial cells. J. Neurovirol. 26, 631–641. doi: 10.1007/s13365-020-00903-7
Baig, A. M., Khaleeq, A., Ali, U., and Syeda, H. (2020). Evidence of the COVID-19 virus targeting the CNS: tissue distribution, host-virus interaction, and proposed neurotropic mechanisms. ACS Chem. Neurosci. 11, 995–998. doi: 10.1021/acschemneuro.0c00122
Bilinska, K., Jakubowska, P., Von Bartheld, C. S., and Butowt, R. (2020). Expression of the SARS-CoV-2 entry proteins, ACE2 and TMPRSS2, in cells of the olfactory epithelium: identification of cell types and trends with age. ACS Chem. Neurosci. 11, 1555–1562. doi: 10.1021/acschemneuro.0c00210
Brann, D. H., Tsukahara, T., Weinreb, C., Lipovsek, M., Van den Berge, K., Gong, B. Y., et al. (2020). Non-neuronal expression of SARS-CoV-2 entry genes in the olfactory system suggests mechanisms underlying COVID-19-associated anosmia. Sci. Adv. 6:19. doi: 10.1126/sciadv.abc5801
Ciofalo, A., Cavaliere, C., Masieri, S., Di Chicco, A., Fatuzzo, I., Lo Re, F., et al. (2022). Long-term subjective and objective assessment of smell and taste in COVID-19. Cells 11:14. doi: 10.3390/cells11050788
Dawson, P., Rabold, E. M., Laws, R. L., Conners, E. E., Gharpure, R., Yin, S., et al. (2021). Loss of taste and smell as distinguishing symptoms of coronavirus disease 2019. Clin. Infect. Dis. 72, 682–685. doi: 10.1093/cid/ciaa799
de Melo, G. D., Lazarini, F., Levallois, S., Hautefort, C., Michel, V., Larrous, F., et al. (2021). COVID-19-related anosmia is associated with viral persistence and inflammation in human olfactory epithelium and brain infection in hamsters. Sci. Transl. Med. 13:eabf8396. doi: 10.1126/scitranslmed.abf8396
Desai, M., and Oppenheimer, J. (2021). The importance of considering olfactory dysfunction during the COVID-19 pandemic and in clinical practice. J. Allergy Clin. Immunol. 9, 7–12. doi: 10.1016/j.jaip.2020.10.036
Divani, A. A., Andalib, S., Biller, J., Napoli, D., Moghimi, N., Rubinos, C. A., et al. (2020). Central nervous system manifestations associated with COVID-19. Curr. Neurol. Neurosci. Rep. 20:20. doi: 10.1007/s11910-020-01079-7
Duff, E., Zelaya, F., Almagro, F. A., Miller, K. L., Martin, N., Nichols, T. E., et al. (2022). Reliability of multi-site UK biobank MRI brain phenotypes for the assessment of neuropsychiatric complications of SARS-CoV-2 infection: the COVID-CNS travelling heads study. PLoS ONE 17:e273704. doi: 10.1371/journal.pone.0273704
Dunai, C., Collie, C., and Michael, B. D. (2022). Immune-mediated mechanisms of COVID-19 neuropathology. Front. Neurol. 13:882905. doi: 10.3389/fneur.2022.882905
Ellegaard, O., and Wallin, J. A. (2015). The bibliometric analysis of scholarly production: how great is the impact? Scientometrics 105, 1809–1831. doi: 10.1007/s11192-015-1645-z
Ferrulli, A., Senesi, P., Terruzzi, I., and Luzi, L. (2022). Eating habits and body weight changes induced by variation in smell and taste in patients with previous SARS-CoV-2 infection. Nutrients 14:12. doi: 10.3390/nu14235068
Forouzanfar, F., Ahmadpoor, M., Farahi, M. M., Hadianfar, A., Sahebkar, A., Esmaily, H., et al. (2022). The effect of pomegranate juice and sumac consumption in the treatment of outpatients with COVID-19. Mediat. Inflamm. 2022:6850342. doi: 10.1155/2022/6850342
Gao, Q., Wang, Y. F., and Li, X. H. (2022). Safety and efficacy of Chinese herbal tonics for the treatment of olfactory disorders caused by the delta strain in COVID-19: a protocol for systematic review and meta-analysis. Medicine 101:5. doi: 10.1097/MD.0000000000031827
Giacomelli, A., Pezzati, L., Conti, F., Bernacchia, D., Siano, M., Oreni, L., et al. (2020). Self-reported olfactory and taste disorders in patients with severe acute respiratory coronavirus 2 infection: a cross-sectional study. Clin. Infect. Dis. 71, 889–890. doi: 10.1093/cid/ciaa330
Glezer, I., Bruni-Cardoso, A., Schechtman, D., and Malnic, B. (2021). Viral infection and smell loss: the case of COVID-19. J. Neurochem. 157, 930–943. doi: 10.1111/jnc.15197
Gómez-Iglesias, P., Porta-Etessam, J., Montalvo, T., Valls-Carbó, A., Gajate, V., Matías-Guiu, J. A., et al. (2020). An online observational study of patients with olfactory and gustory alterations secondary to SARS-CoV-2 infection. Front. Publ. Health 8:243. doi: 10.3389/fpubh.2020.00243
Gori, A., Leone, F., Loffredo, L., Cinicola, B. L., Brindisi, G., De Castro, G., et al. (2020). Covid-19-related anosmia: the olfactory pathway hypothesis and early intervention. Front. Neurol. 11:10. doi: 10.3389/fneur.2020.00956
Guan, W., Ni, Z., Hu, Y., Liang, W., Ou, C., He, J., et al. (2020). Clinical characteristics of coronavirus disease 2019 in china. N. Engl. J. Med. 382, 1708–1720. doi: 10.1056/NEJMoa2002032
Gupta, K., Mohanty, S. K., Mittal, A., Kalra, S., Kumar, S., Mishra, T., et al. (2021). The cellular basis of loss of smell in 2019-nCoV-infected individuals. Brief. Bioinformatics 22, 873–881. doi: 10.1093/bib/bbaa168
Gupta, S., Kallogjeri, D., Farrell, N. F., Lee, J. J., Smith, H. J., Khan, A. M., et al. (2022). Development and validation of a novel at-home smell assessment. JAMA 148, 252–258. doi: 10.1001/jamaoto.2021.3994
Haehner, A., Marquardt, B., Kardashi, R., De With, K., Rossler, S., Landis, B. N., et al. (2022). SARS-CoV-2 leads to significantly more severe olfactory loss than other seasonal cold viruses. Life-Basel 12:8. doi: 10.3390/life12030461
Ho, C. Y., Salimian, M., Hegert, J., O'Brien, J., Choi, S. G., Ames, H., et al. (2022). Postmortem assessment of olfactory tissue degeneration and microvasculopathy in patients with COVID-19. JAMA Neurol. 79, 544–553. doi: 10.1001/jamaneurol.2022.0154
Hoffmann, M., Kleine-Weber, H., Schroeder, S., Kruger, N., Herrler, T., Erichsen, S., et al. (2020). SARS-CoV-2 cell entry depends on ACE2 and TMPRSS2 and is blocked by a clinically proven protease inhibitor. Cell 181:271. doi: 10.1016/j.cell.2020.02.052
Hosseinpoor, M., Kabiri, M., and Bakhshaee, M. (2022). In response to intranasal corticosteroid treatment on recovery of long-term olfactory dysfunction due to COVID-19. Laryngoscope 132, 2209–2216. doi: 10.1002/lary.30353
Hu, W., Chen, N., Yan, W. H., Pei, P., Wei, Y. X., and Zhan, X. J. (2022). Knowledge mapping of olfactory dysfunction: a bibliometric study. Front. Syst. Neurosci. 16:12. doi: 10.3389/fnsys.2022.904982
Huang, C. L., Wang, Y. M., Li, X. W., Ren, L. L., Zhao, J. P., Hu, Y., et al. (2020). Clinical features of patients infected with 2019 novel coronavirus in Wuhan, china. Lancet 395, 497–506. doi: 10.1016/S0140-6736(20)30183-5
Huang, Y. L., Huang, Q., Ali, S., Zhai, X., Bi, X. M., and Liu, R. Q. (2016). Rehabilitation using virtual reality technology: a bibliometric analysis, 1996-2015. Scientometrics 109, 1547–1559. doi: 10.1007/s11192-016-2117-9
Hwang, S. H., Kim, S. W., Basurrah, M. A., and Kim, D. (2023). The efficacy of olfactory training as a treatment for olfactory disorders caused by coronavirus disease-2019: a systematic review and meta-analysis. Am. J. Rhinol. Allergy. 19458924221150977. doi: 10.1177/19458924221150977
Ibrahim, E. A. A., Hassan, R. I. F., Ahmed, K., Salah, E. T., Omer, M. E. A., and Haroun, M. S. (2022). Neurological manifestations of COVID-19: a potential gate to the determinants of a poor prognosis. Brain Behav. 12:3. doi: 10.1002/brb3.2587
Karimian, A., Behjati, M., and Karimian, M. (2022). Molecular mechanisms involved in anosmia induced by SARS-CoV-2, with a focus on the transmembrane serine protease TMPRSS2. Arch. Virol. 167, 1931–1946. doi: 10.1007/s00705-022-05545-0
Khan, A. M., Piccirillo, J., Kallogjeri, D., and Piccirillo, J. F. (2022). Efficacy of combined visual-olfactory training with patient-preferred scents as treatment for patients with COVID-19 resultant olfactory loss a randomized clinical trial. JAMA Otolaryngol. Head Neck Surg. 149, 141–149. doi: 10.1001/jamaoto.2022.4112
Kim, K. S., and Min, H. J. (2022). A tool for the psychophysical assessment of olfactory dysfunction in patients with COVID-19. Ear Nose Throat J. 1455613221084062. doi: 10.1177/01455613221084062
Klingenstein, M., Klingenstein, S., Neckel, P. H., Mack, A. F., Wagner, A. P., Kleger, A., et al. (2021). Evidence of SARS-CoV2 entry protein ACE2 in the human nose and olfactory bulb. Cells Tissues Organs 209, 155–164. doi: 10.1159/000513040
Lechien, J. R., Chiesa-Estomba, C. M., De Siati, D. R., Horoi, M., Le Bon, S. D., Rodriguez, A., et al. (2020). Olfactory and gustatory dysfunctions as a clinical presentation of mild-to-moderate forms of the coronavirus disease (COVID-19): a multicenter European study. Eur. Arch. Oto-Rhino-Laryngol. 277, 2251–2261. doi: 10.1007/s00405-020-05965-1
Li, Y. C., Bai, W. Z., and Hashikawa, T. (2020). The neuroinvasive potential of SARS-CoV2 may play a role in the respiratory failure of COVID-19 patients. J. Med. Virol. 92, 552–555. doi: 10.1002/jmv.25728
Liao, B., Deng, Y.-K., Zeng, M., and Liu, Z. (2022). Long-term consequences of COVID-19: chemosensory disorders. Curr. Allergy Asthma Rep. 23, 111–119. doi: 10.1007/s11882-022-01062-x
Lima, M., Siokas, V., Aloizou, A. M., Liampas, I., Mentis, A. F. A., Tsouris, Z., et al. (2020). Unraveling the possible routes of SARS-CoV-2 invasion into the central nervous system. Curr. Treatm. Opt. Neurol. 22:15. doi: 10.1007/s11940-020-00647-z
Lin, G. X., Kotheeranurak, V., Chen, C. M., Hu, B. S., and Rui, G. (2022). Global research hotspots and trends in the field of spine surgery during the COVID-19 pandemic: a bibliometric and visual analysis. Front. Surg. 9:13. doi: 10.3389/fsurg.2022.976546
Mao, L., Jin, H. J., Wang, M. D., Hu, Y., Chen, S. C., He, Q. W., et al. (2020). Neurologic manifestations of hospitalized patients with coronavirus disease 2019 in Wuhan, china. JAMA Neurol. 77, 683–690. doi: 10.1001/jamaneurol.2020.1127
Meinhardt, J., Radke, J., Dittmayer, C., Franz, J., Thomas, C., Mothes, R., et al. (2021). Olfactory transmucosal SARS-CoV-2 invasion as a port of central nervous system entry in individuals with COVID-19. Nat. Neurosci. 24, 168–175. doi: 10.1038/s41593-020-00758-5
Melkumyan, K., Shingala, D., Simonyan, S., Torossian, H., Mkrtumyan, K., Dilbaryan, K., et al. (2022). Assessment of smell and taste disturbances among COVID-19 convalescent patients: a cross-sectional study in Armenia. J. Clin. Med. 11:21. doi: 10.3390/jcm11123313
Mendonca, C. V., Neto, J. A. M., Suzuki, F. A., Orth, M. S., Neto, H. M., and Nacif, S. R. (2022). Olfactory dysfunction in COVID-19: is a marker of good prognosis? Braz. J. Otorhinolaryngol. 88, 439–444. doi: 10.1016/j.bjorl.2020.12.002
Menni, C., Valdes, A. M., Freidin, M. B., Sudre, C. H., Nguyen, L. H., Drew, D. A., et al. (2020). Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat. Med. 26:1037. doi: 10.1038/s41591-020-0916-2
Moein, S. T., Hashemian, S. M., Mansourafshar, B., Khorram-Tousi, A., Tabarsi, P., and Doty, R. L. (2020). Smell dysfunction: a biomarker for COVID-19. Int. Forum Allergy Rhinol. 10, 944–950. doi: 10.1002/alr.22587
Moriguchi, T., Harii, N., Goto, J., Harada, D., Sugawara, H., Takamino, J., et al. (2020). A first case of meningitis/encephalitis associated with sars-coronavirus-2. Int. J. Infect. Dis. 94, 55–58. doi: 10.1016/j.ijid.2020.03.062
Najafloo, R., Majidi, J., Asghari, A., Aleemardani, M., Kamrava, S. K., Simorgh, S., et al. (2021). Mechanism of anosmia caused by symptoms of COVID-19 and emerging treatments. ACS Chem. Neurosci. 12, 3795–3805. doi: 10.1021/acschemneuro.1c00477
Netland, J., Meyerholz, D. K., Moore, S., Cassell, M., and Perlman, S. (2008). Severe acute respiratory syndrome coronavirus infection causes neuronal death in the absence of encephalitis in mice transgenic for human ACE2. J. Virol. 82, 7264–7275. doi: 10.1128/JVI.00737-08
Pang, X. M., Peng, Z. Y., Zheng, X., Shi, J. J., and Zhou, B. C. (2022). Analysis of research hotspots in COVID-19 genomics based on citespace software: bibliometric analysis. Front. Cell. Infect. Microbiol. 12:14. doi: 10.3389/fcimb.2022.1060031
Pujadas, E., Beaumont, M., Shah, H., Schrode, N., Francoeur, N., Shroff, S., et al. (2021). Molecular profiling of coronavirus disease 2019 (COVID-19) autopsies uncovers novel disease mechanisms. Am. J. Pathol. 191, 2064–2071. doi: 10.1016/j.ajpath.2021.08.009
Sharma, A., Tiwari, S., Deb, M. K., and Marty, J. L. (2020). Severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2): a global pandemic and treatment strategies. Int. J. Antimicrob. Agents 56:106054. doi: 10.1016/j.ijantimicag.2020.106054
Sharma, S., Jagadeesh, H., Saxena, A., Chakravarthy, H., and Devanathan, V. (2021). Central nervous system as a target of novel coronavirus infections: potential routes of entry and pathogenic mechanisms. J. Biosci. 46:14. doi: 10.1007/s12038-021-00232-9
Sodagar, A., Javed, R., Tahir, H., Abd Razak, S. I., Shakir, M., Naeem, M., et al. (2022). Pathological features and neuroinflammatory mechanisms of SARS-CoV-2 in the brain and potential therapeutic approaches. Biomolecules 12:23. doi: 10.3390/biom12070971
Spinato, G., Fabbris, C., Polesel, J., Cazzador, D., Borsetto, D., Hopkins, C., and Boscolo-Rizzo, P. (2020). Alterations in smell or taste in mildly symptomatic outpatients with SARS-CoV-2 infection. JAMA 323, 2089–2091. doi: 10.1001/jama.2020.6771
Tan, B. K. J., Han, R. B., Zhao, J. J., Tan, N. K. W., Quah, E. S., Tan, C. J. W., et al. (2022). Prognosis and persistence of smell and taste dysfunction in patients with COVID-19: meta-analysis with parametric cure modelling of recovery curves. Br. Med. J. 378:12. doi: 10.1136/bmj-2021-069503
Tong, J. Y., Wong, A., Zhu, D., Fastenberg, J. H., and Tham, T. (2020). The prevalence of olfactory and gustatory dysfunction in COVID-19 patients: a systematic review and meta-analysis. Otolaryngol. Head Neck Surg. 163, 3–11. doi: 10.1177/0194599820926473
Vaira, L. A., De Riu, G., Boscolo-Rizzo, P., Hopkins, C., and Lechien, J. R. (2022). In reference to intranasal corticosteroid treatment on recovery of long-term olfactory dysfunction due to COVID-19. Laryngoscope. doi: 10.1002/lary.30505
Vaira, L. A., Deiana, G., Fois, A. G., Pirina, P., Madeddu, G., De Vito, A., et al. (2020a). Objective evaluation of anosmia and Ageusia in COVID-19 patients: single-center experience on 72 cases. Head Neck J. Sci. Spec. Head Neck 42, 1252–1258. doi: 10.1002/hed.26204
Vaira, L. A., Salzano, G., Deiana, G., and De Riu, G. (2020b). Anosmia and Ageusia: common findings in COVID-19 patients. Laryngoscope 130, 1787–1787. doi: 10.1002/lary.28692
van Eck, N. J., and Waltman, L. (2010). Software survey: vosviewer, a computer program for bibliometric mapping. Scientometrics 84, 523–538. doi: 10.1007/s11192-009-0146-3
Veronese, N., Bonica, R., Cotugno, S., Tulone, O., Camporeale, M., Smith, L., et al. (2022). Interventions for improving long COVID-19 symptomatology: a systematic review. Viruses Basel 14:9. doi: 10.3390/v14091863
Wei, G. L., Gu, J. L., Gu, Z. C., Du, C., Huang, X. F., Xing, H. Y., et al. (2022). Olfactory dysfunction in patients with coronavirus disease 2019: a review. Front. Neurol. 12:783249. doi: 10.3389/fneur.2021.783249
Xie, X. D., Lei, P., Liu, L. M., Hu, J., and Liang, P. H. (2022). Research trends and hotspots of COVID-19 impact on sexual function: a bibliometric analysis based on web of science. Front. Publ. Health 10:976582. doi: 10.3389/fpubh.2022.976582
Xu, H., Winnink, J., Yue, Z., Zhang, H., and Pang, H. (2021). Multidimensional scientometric indicators for the detection of emerging research topics. Technol. Forecast. Soc. Change 163:120490. doi: 10.1016/j.techfore.2020.120490
Yan, C. H., Faraji, F., Prajapati, D. P., Boone, C. E., and DeConde, A. S. (2020). Association of chemosensory dysfunction and COVID-19 in patients presenting with influenza-like symptoms. Int. Forum Allergy Rhinol. 10, 806–813. doi: 10.1002/alr.22579
Yan, C. R. H., Faraji, F., Prajapati, D. P., Ostrander, B. T., and DeConde, A. S. (2020). Self-reported olfactory loss associates with outpatient clinical course in COVID-19. Int. Forum Allergy Rhinol. 10, 821–831. doi: 10.1002/alr.22592
Zhang, L., Zhao, W. J., Sun, B. B., Huang, Y., and Glanzelz, W. (2020). How scientific research reacts to international public health emergencies: a global analysis of response patterns. Scientometrics 124, 747–773. doi: 10.1007/s11192-020-03531-4
Keywords: COVID-19 pandemic, long COVID, olfactory dysfunction, co-citation analysis, co-word analysis, cluster analysis
Citation: Yang Z, Ma Y, Bi W and Tang J (2023) Exploring the research landscape of COVID-19-induced olfactory dysfunction: A bibliometric study. Front. Neurosci. 17:1164901. doi: 10.3389/fnins.2023.1164901
Received: 13 February 2023; Accepted: 06 March 2023;
Published: 24 March 2023.
Edited by:
Dongdong Qin, Yunnan University of Chinese Medicine, ChinaReviewed by:
Hongshen Pang, Shenzhen University, ChinaXianming Wang, Helmholtz Center München (HZ), Germany
Copyright © 2023 Yang, Ma, Bi and Tang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Wei Bi, Yml3ZWk0NzYyJiN4MDAwNDA7c2luYS5jb20=; Jingqian Tang, dGpxc3d4JiN4MDAwNDA7am51LmVkdS5jbg==