Alexandro Andrade1,2*
Anderson D'Oliveira1,2
Henrique Pereira Neiva3,4
Gilberto Gaertner4
Whyllerton Mayron da Cruz1,2- 1Health and Sports Science Center – CEFID/Santa Catarina State University–UDESC, Florianópolis, Santa Catarina, Brazil
- 2Laboratory of Sports and Exercise Psychology–LAPE, Florianópolis, Santa Catarina, Brazil
- 3Department of Sport Sciences, University of Beira Interior, Covilhã, Portugal
- 4Research Center in Sports Sciences, Health Sciences and Human Development, CIDESD, Covilhã, Brazil
Introduction: Investigation of the psychological impact on soccer athletes during the pandemic is essential given their unique challenges, including training disruptions and competition postponements. Understanding these effects will allow the development of specific strategies to preserve the mental health and performance of elite athletes, contributing to effective interventions with both short and long-term benefits.
Objective: To analyze the impact of the COVID-19 pandemic on the psychological aspects and mental health of elite soccer athletes.
Method: The review adhered to PRISMA criteria, and the study protocol was registered in the International Prospective Register of Systematic Reviews (CRD42022341545). Searches were conducted until July 2023 in databases including Cochrane, PsycINFO, PubMed, Scopus, SPORTDiscus, and Web of Science. Only original, peer-reviewed studies in English, Portuguese, or Spanish assessing the impact of the COVID-19 pandemic on the psychological aspects and mental health of elite soccer athletes were included.
Results: The search identified 1,055 records and 43 studies were included in this review between 2020 and 2023. In total, the sample included 16,321 soccer athletes of different age groups. Anxiety, depression, mood states, and mental well-being were the most investigated variables. Increased levels of anxiety, depression, and worsening mental well-being were observed in elite soccer athletes. Maintaining fitness during the pandemic showed positive results. Other variables, such as coping, resilience, and sleep quality monitoring, were less widely investigated. Evaluating methodological quality was considered regular for observational and experimental studies.
Conclusion: The study reveals a negative impact of the COVID-19 pandemic on elite soccer athletes, considering psychological aspects and their mental health, notably heightened anxiety and depression. Observational methods predominated, showing mood swings linked to individual characteristics and fitness maintenance efforts. Studies with better-designed methodological approaches and controlled experimental interventions are recommended in the future to mitigate the negative effects of the pandemic on soccer players.
Systematic review registration: https://www.crd.york.ac.uk/prospero/display_record.php?, identifier (CRD42022341545).
Introduction
In 2020, the COVID-19 pandemic impacted the world in all areas and caused unprecedented extreme damage to the world sports calendar, a fact that had not occurred since World War 2 (IOC, 2020). In the absence of vaccines and antiviral drugs, non-pharmaceutical interventions implemented in response to virus damage were the only options available to slow and moderate the spread of the virus through the population (Kenyon, 2020; Mann et al., 2020). In addition to quarantine and isolation procedures for those who have been exposed to or infected with COVID-19, social distancing is applied as a strategy to reduce the transmission of COVID-19, with the practice of confinement and social isolation being the most effective and widely used (Haug et al., 2020).
Such factors have led to the need to study the impact of the COVID-19 pandemic on the psychological aspects and mental health of athletes. In addition, the complex psychosocial situation of confinement has caused important changes and serious damage to the quality and quantity of training of athletes, and these factors have brought many uncertainties about the future of the sports environment (Andreato et al., 2020). Factors such as the abrupt change in their daily routine, the home confinement measures adopted, and uncertainty about the date of return to activities can lead athletes to experience conditions that affect their mental health, including external sources of distress, anxiety, mood swings, and other concerns and tensions (Evli et al., 2020; Jansen, 2021; Romdhani et al., 2022).
The systematic reduction in training caused losses in physical performance capacity, which meant a loss of competitiveness on the return to competition, generating a cascade of losses that still need to be better understood. In addition to the physical and technical damage, the psychological impact is of great concern to the athlete. Thus, sports science professionals and scientists are challenged to help athletes deal with some of these relevant aspects in times of a pandemic. As a consequence, several recent recommendations suggest minimizing the negative impacts of the COVID-19 pandemic on athletes in general (Andreato et al., 2020; Girardi et al., 2020; Farooq et al., 2021) and in soccer (Jia et al., 2022). Predominantly, the athletes had to deal with the frustration of their goals and changes in their usual training routines (Zinner et al., 2020; Leguizamo et al., 2021).
Soccer arouses great interest in the scientific community, and given its importance in sports sciences and other areas, it is currently the most investigated sport modality (Kirkendall, 2020). A challenging situation is to establish a procedure with implications for their well-being and mental health, while at the same time enabling increased performance (Leguizamo et al., 2021). It is known that psychological factors predispose athletes and that changes in sports performance are common and should be considered in sports development and preparation programs (Dönmez et al., 2022). Recent studies have shown implications of the COVID-19 pandemic, with a negative impact on mental status during the pandemic, including concerns about the sporting future, which caused increased anxiety and stress, as well as worsened sleep quality in athletes of various modalities (Håkansson et al., 2020; Mon-López et al., 2020; Jurecka et al., 2021). To date, there are no systematic reviews on whether psychological interventions and approaches were used and if they were effective during the pandemic.
In this sense, the current systematic review with a specific focus on soccer, aims to form a knowledge base, providing information from the evidence with approaches based on sports psychology and analyzing the trends in the evidence. A recent review investigated the effect of the COVID-19 pandemic and its implications on the mental and emotional health of athletes in a generic way (Jia et al., 2022). The authors reported that this phenomenon is complex and multifaceted, as the lack of social interactions with coaches and teammates, the absence of continuous access to training facilities and direct contact with professionals, and the lack of active use of healthy coping mechanisms resulted in worsening mental health of athletes in the COVID-19 era (Jia et al., 2022). However, no systematic review has been conducted on the implications of the COVID-19 pandemic on psychological and mental health aspects, considering the specificity of the sport and the characteristics of elite soccer players.
Psychosocial factors, including disturbances of attention and emotional balance, control of levels of arousal, anxiety, stress, daily annoyances, and other negative life events are predictive of the performance and mental health of soccer players. In this sense, it is imperative to verify whether interventions based on psychological approaches can reduce and mitigate the impacts of these factors on athletes during the pandemic. Based on empirical data, the analysis of the impact that the COVID-19 pandemic has on the psychological aspects and mental health of soccer athletes aims to promote a better understanding of this phenomenon and contribute to the development of guidelines based on evidence, so that clubs and soccer professionals can implement solutions and strategies to reduce the damages and preserve or even increase the performance of athletes in different dimensions in the sport. This will be particularly useful in helping to increase integrative approaches to athletes’ performance and health. Thus, the present systematic review aims to analyze the impact of the COVID-19 pandemic on the psychological aspects and mental health of elite soccer athletes.
Methods
This is a systematic review of the literature that followed the criteria recommended by the PRISMA Declaration – Preferred Reporting Items for Systematic Reviews and Meta-Analyses (Page et al., 2021) registered in the International Prospective Register of Systematic Reviews–PROSPERO (CRD42022341545).
Search strategy
The searches for articles were conducted in July 2023, in scientific journals indexed in the Cochrane, PsycINFO, PubMed, Scopus, SPORTDiscus, and Web of Science databases, with a search period from 1st January 2020 to July 11 2023, and the descriptors are presented in Table 1.
Table 1. Search strategy in electronic databases.
The search and selection procedures of the articles were carried out by two researchers (WC and AD’O) independently. Any disagreements were resolved by a third party (AA).
Eligibility criteria for studies
Only peer-reviewed studies were included, taking into account the following criteria: (i) the study was required to be related to the COVID-19 pandemic and present analyses of data from empirical investigations including soccer athletes in the context of training, competitive performance, injury treatment, as well as retired athletes or those who had left the sport; (ii) the article was required to be written in English, Spanish, or Portuguese, with full text available. Studies with only abstracts available were not included, due to the impossibility of performing a full analysis.
For this review, the eligibility criteria were based on the strategy – PECOS – Population, Exposure, Comparator, Outcome, and Study Design (Morgan et al., 2018; Table 2).
Table 2. Inclusion and exclusion criteria of the studies selected for the review.
Study selection and data extraction
At this stage of the review, the Rayyan application, developed by the Qatar Computing Research Institute (Ouzzani et al., 2016), was used. The selection and extraction of data from the studies were carried out by two researchers (WC and AD’O) independently, and any disagreements were resolved by consensus discussion.
For the analysis and discussion of the results, the following data were extracted: characteristics of the sample (number of participants, sex, mean and age range, and competitive level of performance), instrument for evaluation of mental health variables and psychological aspects, type of study, research objective, year and language of publication, and main results.
For the analysis of Figure 1, we considered the dates of completion of the studies included in this review and the data of cumulative cases and deaths from COVID-19 according to the World Health Organization (2020).
Figure 1. Study flowchart following PRISMA guidelines.
Study quality assessment
The quality of the included studies was assessed using two tools – the Quality Assessment Tool for Observational Cohort and Cross-Sectional Studies and the Quality Assessment Tool for Before-After (Pre-Post) both from the National Institutes of Health (2021). Both tools include criteria that need to be met by the studies included in this review and at the end of the evaluation a score is assigned according to each criterion answered, for a “yes” answer, one point is added, and for “no,” “not applicable,” “not reported,” or “it is not possible to determine,” the value is assigned zero points. The Cohort and Cross-Sectional Studies tool – consists of an evaluation based on 14 criteria. A study-specific global score, ranging from zero to 14, was calculated by summing the scores of all criteria.
The tool for experimental studies (pre-post), contains 12 criteria, thus the overall score can vary from 0–12. A higher score indicates better quality of the study (National Institutes of Health, 2021). The evaluation was performed independently by two reviewers (WC and AD’O). Disagreements were resolved by consensus. When necessary, a third author (AA) was requested for the final opinion. The quality of the studies was not considered as an inclusion or exclusion criterion. Previous studies used these tools and demonstrated satisfactory applicability (Sarkies et al., 2017; Hayes et al., 2018).
The degree of agreement between the two evaluators was analyzed using the Cohen’s Kappa test. For the interpretation, the approach of Mchugh (2012) was used, which classifies the agreement as: None 0–4%; minimum 4–15%; weak 15–35%; moderate 35–63%; strong 64–81%; and nearly perfect 82–100% (McHugh, 2012).
Results
The search strategy identified 1,435 studies. After the duplicates were removed, 1,055 studies remained. Screening of abstracts identified 75 potentially eligible studies. A total of 43 original studies met the inclusion criteria (Figure 1 PRISMA flowchart).
Characteristics of the studies
From the 43 included studies, a general sample of 16,321 soccer athletes was identified in this systematic review, and the average number of participants was 388 athletes (7–16, 39). Most of the published studies include only soccer athletes in the sample (35/81.4%).
Researchers from diverse nations have contributed to scientific insights regarding the impact of the pandemic on the psychological aspects and mental health of soccer athletes. Among the 43 studies included in this review, the primary authors represent a wide array of countries: Turkey, Brazil, Chile, Italy, Spain, China, Iran, Germany, Australia, Austria, Belgium, Denmark, Egypt, the United States, France, the Netherlands, the United Kingdom, Norway, Slovenia, Serbia, and Sweden. This international collaboration underscores the global effort to comprehensively understand the effects of the pandemic on elite soccer athletes.
Some of the included studies (18/41.9%), did not report the country of origin of the athletes. Of the studies that reported the nationality, athletes of different nationalities were identified. Twenty studies (46.5%) included female and male athletes, 17 studies only male athletes, in three studies the athletes were only female (6.9%), and five studies did not report the sex of the participants. Most studies included adults and young people, representing 69.2% of the studies, except for two that included young athletes (mean age 12.6 years). Ten studies did not report the age of the participants.
Most studies included exclusively samples and data of soccer athletes (n = 34), and another nine studies included samples of soccer athletes with different sports modalities.
Regarding the study design, the majority were cross-sectional (42 of 43) and only one study design differs from the others, being non-randomized experimental. Seven studies presented a design with a longitudinal cross-sectional follow-up and three studies were cross-sectional and comparative (Table 3).
Table 3. Sample characteristics (number of athletes, sex, and age), study objectives and designs, athletes’ competitive level, result variables, instruments, and main results.
Characteristics of the instruments used
Different instruments were used to assess soccer athletes during the pandemic. Of the 43 studies included in this review, only one study did not describe the instrument used (Smith, 2021) Among the instruments applied in the published studies 39 were identified and widely used in studies with athletes, and three instruments were developed exclusively for research during the pandemic.
Studies on elite soccer athletes that examine the psychological impacts of the COVID-19 pandemic have extensively utilized well-established assessment tools, reflecting a rigorous approach to understanding the nuances of mental health. Notably, instruments such as the State–Trait Anxiety Inventory (STAI) and Profile of Mood States (POMS) have been employed to gauge anxiety states, depression, and mood variations among athletes. Additionally, widely recognized scales, such as the Patient Health Questionnaire (PHQ-9), Generalized Anxiety Disorder 7 (GAD-7), and Beck Anxiety Inventory have been adopted to specifically assess depressive and anxious symptoms.
Researchers have also recognized the unique psychological challenges within the sports context, leading to the utilization of specialized assessments. The Competitive State Anxiety Inventory-2 Revised (CSAI-2R) and the Instrument to verify the basic psychological needs exemplify this tailored approach, aiming to capture the distinctive psychological nuances experienced by elite soccer athletes.
In pursuit of a holistic understanding of the pandemic’s psychological impacts, some studies have taken a pioneering stance by developing customized instruments and employing novel methodologies. These include the creation of open-ended questions by the authors and the adaptation of questionnaires to meet the specific demands of the study. This adaptive strategy underscores the necessity for tools tailored to the unique circumstances of elite soccer athletes, offering a more nuanced comprehension of the psychological repercussions of the COVID-19 pandemic.
Athlete monitoring period during the COVID-19 pandemic
Most studies (29 out of 43) indicated the exact period of the pandemic in which the research was conducted. The majority of studies focused research on soccer athletes between March and June 2020 (23 out of 29), which is a period with a known high worldwide cumulative death rate of COVID-19, 540.267 cases. Five studies were conducted before this period (Figure 2).
Figure 2. Timeline of the periods when the studies were developed and the monitoring of soccer athletes during the COVID-19 pandemic. Adapted from Richardson et al. (2022). Cumulative case and death data are derived from the closest update provided by the World Health Organization (WHO, 2020) on the last day of each month.
Anxiety
The most widely investigated psychological variable was anxiety, representing 20.45% of the studies. Anxiety levels were the most common measure in the studies (Esteves et al., 2020, 2021; Evli et al., 2020; Håkansson et al., 2020; Ivarsson et al., 2021; Lima et al., 2021; Madsen et al., 2021; Mehrsafar et al., 2021; Wagemans et al., 2021). The results of most of the studies demonstrated increased anxiety during the COVID-19 pandemic.
Mental well-being
Mental well-being responses during the pandemic were investigated in 15.91% of studies (Grimson et al., 2021; Ivarsson et al., 2021; Jiménez-Barreto and Borges, 2021; Mavi Var et al., 2021; Merino-Muñoz et al., 2021; Smith, 2021; Villaseca-Vicuña et al., 2021; Wagemans et al., 2021; Marholz et al., 2022; Paravlic et al., 2022) The implications of the pandemic on the monitoring of mental well-being in soccer players present contradictory results and are discussed below.
Mood state
Eight studies (Mon-López et al., 2020; Aghababa et al., 2021; Han et al., 2021; Kesilmis et al., 2021; Villaseca-Vicuña et al., 2021; Wagemans et al., 2021; Montealegre-Mesa et al., 2023) assessed the mood swings of soccer athletes during the COVID-19 pandemic. Aghababa et al. (2021) found that due to the psychosocial situation of the COVID-19-related lockdown, the maintenance and execution of unique patterns of physical activity were not compensatory to the point of producing positive effects and changes in the mood states of soccer athletes (Aghababa et al., 2021).
Depression
Studies that analyzed depression in soccer players (13.64%), reported that during the emergency peak of the lockdown caused by the COVID-19 pandemic there was a significant increase in depression in elite soccer players, especially among those concerned about their future as players (Han et al., 2021; Leguizamo et al., 2021; Lima et al., 2021; Nassar et al., 2021; Dönmez et al., 2022).
Sleep quality
The evaluation of the sleep quality of the athletes was investigated in four studies and significant changes were observed in the duration and quality of sleep of soccer athletes (Facer-Childs et al., 2021; Han et al., 2021). The effects of home training during lockdown brought positive results in the sleep of athletes (Keemss et al., 2022; Romdhani et al., 2023).
Other psychological outcomes
Studies were identified that investigated soccer athletes and other less frequent outcomes, such as coping, resilience, psychological distress, and fear caused by the pandemic (Jansen, 2021; Lima et al., 2021; Katanic et al., 2022; Kobal et al., 2022; Vitali et al., 2022). All health outcomes identified in the studies included in this review and their frequencies are shown in Figure 3.
Figure 3. Frequencies of psychological and mental health variables investigated in the included studies (n = 43).
Evaluation of the quality of studies
Tables 4 5 present the general and specific classifications of the criteria on the evaluation of the quality of the studies (National Institutes of Health, 2021). The included observational studies scored an average of 7.00 (±2.26), ranging from 3 to 12. Based on this evaluation, the quality of the studies was generally considered regular (33 of 42), with 5 considered as of good methodological quality and four studies considered poor in the evaluation of quality. The agreement between the observers for all items was 85.6% (Table 4).
Table 4. Evaluation of the quality of cross-sectional and longitudinal studies.
Table 5. Evaluation of the quality of the experimental study.
The majority of the observational studies (37 out of 42) did not report the exposure levels of study participants in relation to the results, some (26 out of 42) also reported no information on sample power or size because the analyses are exploratory in nature. It was also observed that only two studies of the 42 evaluated indicated the appropriate statistical procedures to minimize confounding factors. Well-conducted cohort studies control for multiple potential confounding factors.
The experimental study included in the review presented a score of nine, considered regular quality. In the current study, statistical tests were presented to provide p-values for pre-post changes. The study provided sufficient information about the intervention in a consistent manner regarding the study population, as well as making all the measures performed on the study participants available in a clear and reliable manner. On the other hand, the calculation of the sample size was not provided, nor were the people who evaluated the results blinded to the exposures/interventions of the participants in any of the studies. Outcome measures were evaluated before and after the intervention. The agreement between observers for all items was 86.5% (Table 5).
Discussion
Overview and highlights
The present study aimed to analyze the impact of the COVID-19 pandemic on the psychological aspects and mental health of elite soccer athletes. Although a systematic review has recently been conducted including several sports modalities (Jurecka et al., 2021) to evaluate the effects of the pandemic on the physical activity, mental state, and quality of life of professional athletes, there is a need to deepen the searches and analyses, especially considering the most widely practiced and investigated modality in sports science (Kirkendall, 2020).
Regarding the nationality of the athletes investigated, 21 studies reported the origin of the athletes, who came from several different countries of the world. These data reveal the concern for the psychological aspects and mental health of soccer athletes in much of the world during the pandemic and related restrictions (de Souza et al., 2021; Kesilmis et al., 2021; Leguizamo et al., 2021; Keemss et al., 2022).
The current systematic review reports recent findings and summarizes the impact of the COVID-19 pandemic on soccer athletes, presenting rates of the main variables of psychological aspects and mental health measured during the pandemic and also showing a comprehensive approach in the selection of assessment tools for evaluating soccer athletes, emphasizing the importance of collecting not only overt symptoms but also sport-specific and individual factors experienced during the pandemic (Bernabe-Valero et al., 2021). The diverse array of instruments utilized contributes to richer understanding of the psychological impact of COVID-19 on elite soccer athletes, providing valuable insights for future research and interventions in sports science (Lee et al., 2023).
This multifaceted approach not only enhances our understanding of the subject within the specific context of elite soccer but also holds significance for its potential applicability across diverse populations and nationalities (Richardson et al., 2022). The inclusion of various instruments in the study not only enriches the depth of the analysis, but also increases the possibility of applying the findings in future studies.
Studies with heterogeneous samples have been reported in previous reviews focusing on the general population. Even so, considering the population of soccer athletes, it is important to reduce the risks of selection bias by considering homogeneous samples (Crossley et al., 2020).
Impact of COVID-19 on psychological aspects in soccer athletes
Undoubtedly, the stress generated by the need to maintain physical condition prior to the pandemic caused imbalances in the stimulus-recovery relationship (Faude et al., 2014). Perceived stress is a critical factor in burnout among athletes and a moderate effect size was reported for the correlation of this variable with depression (Sarmento et al., 2021). A systematic review and meta-analysis prior to the pandemic synthesized, in an analytical and rigorous manner, data on psychological and hormonal changes induced by soccer matches. When psychophysiological stress was assessed after soccer matches, cortisol changes were caused by alterations in cognitive anxiety, while testosterone changes were driven by alterations in mood state and social connection. In addition, it is highlighted that competitive levels should be considered as the main moderating variables of the relationship between soccer games and hormonal changes related to stress (Slimani et al., 2017).
Understanding factors such as athletes’ sleep quality, and other psychological variables, such as resilience and coping strategies is essential to develop effective management protocols that help soccer athletes maintain healthy sleep and, consequently, optimize their athletic performance (Bicalho et al., 2020; Madsen et al., 2021). Sleep quality has been less widely investigated relative to other psychological approaches, however it is important that athletes, coaches, and sports professionals work together to address these challenges and promote the overall health of athletes in contexts such as the COVID-19 pandemic (Nassar et al., 2021).
Impact of COVID-19 on the mental health of soccer athletes
A growing body of knowledge, analyzed here, indicates that anxiety and depression, as well as acute symptoms are usually mild or absent in this population.
Emerging evidence suggests that a considerable proportion of athletes may exhibit psychological alterations and persistent symptoms that can be potentially detrimental to performance and mental health (Bicalho et al., 2020; Ivarsson et al., 2021), which were not reversed with maintenance and training strategies outside the usual sports environment, suggesting that decisions to return to the game and training should be made with caution (Jansen, 2021).
In a previous review study, it was evidenced that the participation of soccer athletes at the male professional level could provide a certain protective effect for mental disorders or suicide (Morales et al., 2021). However, more research is needed with female athletes and other types of associated sports to corroborate the generalization about mental health aspects.
The evidence base on the mental health and well-being of elite athletes is limited by a dearth of high-quality systematic studies, including intervention trials. Based on current evidence, elite athletes appear to experience a broadly comparable risk of high-prevalence mental disorders relative to the general population. A higher risk for a mental health disorder may be experienced by elite athletes who are injured, approaching/in retirement, or experiencing performance difficulty. Although the importance of the mental health of the elite athlete is gaining greater attention, targeted and specific models of attention for the disorder have yet to be established for this group (Rice et al., 2016; Gouttebarge et al., 2022).
Strengths, innovations, and practical applications
The present study evaluated psychological aspects in the population of soccer athletes during the COVID-19 pandemic. Articles with this focus were collected from January 2020 to July 2023 and were systematically reviewed according to PRISMA guidelines.
The present review summarizes a robust body of evidence. From the results of the study, it seems appropriate to develop alternatives and support professional athletes during the COVID-19 pandemic. To improve indicators of mental health and overall athlete satisfaction and well-being during and after the pandemic, the development of guidelines related to the monitoring and control of aspects related to athletes’ mental health is recommended.
In the context of soccer, teams of experts working with athletes should pay special attention to alterations in psychological aspects and mental state before and during situations, such as in pandemic times. In the future, more studies with interventions and/or protocols that already have a positive impact on athletes in different modalities, such as mindfulness, sleep hygiene, relaxation, for example, should be performed and applied to athletes, without, however, disregarding the methodological limitations of the study designs. In addition, further studies should minimize or exclude potential confounding factors that reduce certainties in the conclusions of studies on this topic.
Limitations
Although this systematic review provides a comprehensive overview of elite soccer, it has limitations. The articles reviewed in this study were mostly cross-sectional. It was not possible to analyze the prevalence and incidence of the psychological variables investigated, and it was not possible to perform a meta-analysis. Potential factors, such as age variability, competitive level, and athletes’ experience may have hindered the strength of the association between psychological factors and mental health in the studies selected for this review.
Worsening psychological aspects were observed in most of the included studies, but this may not be causally related to COVID-19, given that most control parameters were not presented (e.g., uninfected athletes, infected athletes), including information on athletes with diagnoses of psychological problems prior to the pandemic, and lockdown.
This review also reveals that the absence of control groups or baseline data (i.e., before lockdown) for the assessment of the pandemic phenomenon in the soccer universe are potentially confounding factors (e.g., previous psychological problems of the pandemic, state or trait of anxiety, for example). Inconsistent data or lack of clarity in some included studies are relevant limitations of the literature that should be addressed in future investigations.
Only published articles were included in the review, the gray literature was not included. In addition, the use of an electronic questionnaire as a research tool may have influenced the response bias and the systematic bias given the rigor in controlling the context during the evaluations.
Despite all the limitations presented, it should be taken into account that the understanding of every phenomenon related to the COVID-19 pandemic in the sports universe is still recent and despite this it was possible to gather the information in a rigorous way, as presented in this review.
Conclusion
The results demonstrate the negative impact of the COVID-19 pandemic on the psychological aspects and mental health of elite soccer athletes during the emergency phase of the pandemic in the year 2020. Because it is a recent topic, most studies used observational methods. Among the most commonly observed effects were increased levels of anxiety, depression, and worsening mental well-being in elite soccer athletes. Studies have shown important mood swings related to athletes’ characteristics and maintaining fitness during the pandemic. For other variables, such as coping, resilience, and monitoring of sleep quality, although there are a reduced number of studies, positive results were shown for soccer athletes. Studies with better methodological designs with controlled experimental interventions are recommended in the future to mitigate the negative effects of the pandemic for this population of athletes.
It is crucial to acknowledge that athletes, especially soccer players, have faced unique challenges during the pandemic, such as disruptions in regular training, postponed competitions, and the need to adhere to strict health protocols. These adversities can have significant impacts on players’ performance and well-being, both in the short and long term.
Therefore, we urge researchers to carefully consider the design of their studies, ensuring that their methodological approaches are robust and comprehensive. This includes collecting data from players before, during, and after the pandemic to properly assess the full impact of these unusual circumstances.
Furthermore, the implementation of controlled experimental interventions is essential to identify effective strategies to support players, such as tailored fitness programs, psychological support, and stress management techniques. These interventions can help mitigate the negative effects of the pandemic and promote the well-being of players.
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Author contributions
AA: Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing. AD’O: Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing. HN: Formal analysis, Funding acquisition, Methodology, Resources, Writing – review & editing. GG: Formal analysis, Validation, Writing – original draft. WC: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work has been supported by the following Brazilian research agencies: National Council for Scientific and Technological Development (CNPq), Coordination for the Improvement of Higher Education Personnel—CAPES; Foundation for research and innovation support of the State of Santa Catarina- FAPESC, grant ref: 2019031000035 public call N°027/2020 and National Council for Scientific and Portuguese Foundation for Science and Technology (FCT), I.P., under project UIDB04045/2020.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Aghababa, A., Zamani Sani, S. H., Rohani, H., Nabilpour, M., Badicu, G., Fathirezaie, Z., et al. (2021). No evidence of systematic change of physical activity patterns before and during the COVID-19 pandemic and related mood states among Iranian adults attending team sports activities. Front. Psychol. 12, 1–9. doi: 10.3389/fpsyg.2021.641895
Andreato, L. V., Coimbra, D. R., and Andrade, A. (2020). Challenges to athletes during the home confinement caused by the COVID-19 pandemic. Strength Cond. J. 42, 1–5. doi: 10.1519/ssc.0000000000000563
Balyan, M., Zekioğlu, A., Başoğlu, U. D., Işık, T., and Taşçıoğlu, R. (2021). The relationship between nutrition and life satisfaction of football players in COVID-19 period. Prog. Nutr. 23, 1–11. doi: 10.23751/pn.v23iS1.11407
Bernabe-Valero, G., Melero-Fuentes, D., De Lima Argimon, I. I., and Gerbino, M. (2021). Individual differences facing the COVID-19 pandemic: the role of age, gender, personality, and positive psychology. Front. Psychol. 12, 1–12. doi: 10.3389/fpsyg.2021.644286
Bicalho, C. C. F., Melo, G. F., and Noce, F. (2020). Resilience of athletes: a systematic review based on a citation network analysis. Cuad. Psicol. del Deport. 20, 26–40. doi: 10.6018/cpd.391581
Crossley, K. M., Patterson, B. E., Culvenor, A. G., Bruder, A. M., Mosler, A. B., and Mentiplay, B. F. (2020). Making football safer for women: a systematic review and meta-analysis of injury prevention programmes in 11 773 female football (soccer) players. Br. J. Sports Med. 54, 1089–1098. doi: 10.1136/bjsports-2019-101587
de Souza, G., dos Santos, W., Paes, P., Fidelix, Y., de Paula Oliveira, L., da Costa, M., et al. (2021). Consequences of COVID-19 preventive measures on anxiety, stress and depression in football athletes. Soccer Soc. 23, 574–582. doi: 10.1080/14660970.2021.1939014
Dönmez, G., Özkan, Ö., Menderes, Y., Torgutalp, Ş. Ş., Karaçoban, L., Denerel, N., et al. (2022). The effects of home confinement on physical activity level and mental status in professional football players during COVID-19 outbreak. Phys. Sportsmed. 50, 157–163. doi: 10.1080/00913847.2021.1888630
Esteves, N. S., De Brito, M. A., Müller, V. T., Brito, C. J., Valenzuela Pérez, D. I., Slimani, M., et al. (2021). COVID-19 pandemic impacts on the mental health of professional soccer: comparison of anxiety between genders. Front. Psychol. 12, 1–7. doi: 10.3389/fpsyg.2021.765914
Esteves, N. S. A., de Brito, M. A., Soto, D. A. S., Müller, V. T., Aedo-Muñoz, E., Brito, C. J., et al. (2020). Effects of the COVID-19 pandemic on the mental health of professional soccer teams: epidemiological factors associated with state and trait anxiety. J. Phys. Educ. Sport 20, 3038–3045. doi: 10.7752/jpes.2020.413
Evli, F., Gidik, O., Cerit, E., and Corum, S. A. (2020). Anxiety levels of footballers in regional amateur and professional leagues during pandemic process introduction: results. Methodology 7Sp, 81–85. doi: 10.21276/ambi.2020.07.sp1.oa09
Facer-Childs, E. R., Hoffman, D., Tran, J. N., Drummond, S. P. A., and Rajaratnam, S. M. W. (2021). Sleep and mental health in athletes during COVID-19 lockdown. Sleep 44, 1–9. doi: 10.1093/sleep/zsaa261
Farooq, R. K., Rehman, S. U., Ashiq, M., and Siddique, N. (2021). Bibliometric analysis of coronavirus. XXX, 1–7. doi: 10.4103/jfcm.JFCM
Faude, O., Steffen, A., Kellmann, M., and Meyer, T. (2014). The effect of short-term interval training during the competitive season on physical fitness and signs of fatigue: a cross-over trial in high-level youth football players. Int. J. Sports Physiol. Perform. 9, 936–944. doi: 10.1123/ijspp.2013-0429
Girardi, M., Casolo, A., Nuccio, S., Gattoni, C., and Capelli, C. (2020). Detraining effects prevention: a new rising challenge for athletes. Front. Physiol. 11, 1–5. doi: 10.3389/fphys.2020.588784
Gouttebarge, V., Ahmad, I., Mountjoy, M., Rice, S., and Kerkhoffs, G. (2022). Anxiety and depressive symptoms during the COVID-19 emergency period: a comparative cross-sectional study in professional football. Clin. J. Sport Med. 32, 21–27. doi: 10.1097/JSM.0000000000000886
Grimson, S., Brickley, G., Smeeton, N. J., Abbott, W., and Brett, A. (2021). Physical activity on mental wellbeing in senior English premier league soccer players during the COVID-19 pandemic and the lockdown. Eur. J. Sport Sci. 22, 1916–1925. doi: 10.1080/17461391.2021.1976841
Håkansson, A., Jönsson, C., and Kenttä, G. (2020). Psychological distress and problem gambling in elite athletes during COVID-19 restrictions—a web survey in top leagues of three sports during the pandemic. Int. J. Environ. Res. Public Health 17, 1–17. doi: 10.3390/ijerph17186693
Han, Q., Li, X., and Wang, Z. (2021). How should athletes coping with COVID-19: focus on severity and psychological support. Front. Psychol. 12, 1–5. doi: 10.3389/fpsyg.2021.559125
Haug, N., Geyrhofer, L., Londei, A., Dervic, E., Desvars-Larrive, A., Loreto, V., et al. (2020). Ranking the effectiveness of worldwide COVID-19 government interventions. Nat. Hum. Behav. 4, 1303–1312. doi: 10.1038/s41562-020-01009-0
Hayes, C., Simmons, M., Simons, C., and Hopwood, M. (2018). Evaluating effectiveness in adolescent mental health inpatient units: a systematic review. Int. J. Ment. Health Nurs. 27, 498–513. doi: 10.1111/inm.12418
International Olympic Committee . (2020). The International Olympic Committee (IOC)’s Executive Board (EB) today received updates on the planning and preparations for the Olympic Games Tokyo 2020. Available at: https://olympics.com/ioc/news/tokyo-2020-presents-positioning-principles-for-re-planning-and-a-roadmap-to-the-games-in-2021-to-ioc-executive-board
Ivarsson, A., McCall, A., Mutch, S., Giuliani, A., Bassetto, R., and Fanchini, M. (2021). Mental health and well-being during COVID-19 lockdown: a survey case report of high-level male and female players of an Italian Serie a football club. Sci. Med. Footb. 5, 70–75. doi: 10.1080/24733938.2021.1962540
Jansen, P. (2021). Self-compassion and repetitive thinking in relation to depressive mood and fear of the future: an investigation during the 2020 coronavirus pandemic in semiprofessional football players. Ger. J. Exerc. Sport Res. 51, 232–236. doi: 10.1007/s12662-021-00712-y
Jia, L., Carter, M. V., Cusano, A., Li, X., Kelly, J. D., Bartley, J. D., et al. (2022). The effect of the COVID-19 pandemic on the mental and emotional health of athletes: a systematic review. Am. J. Sports Med. 51, 2207–2215. doi: 10.1177/03635465221087473
Jiménez-Barreto, I., and Borges, P. J. (2021). Effect of an ZOOM mediated home training program in women’s soccer during the COVID-19 pandemic on the rating of perceived exertion and support for basic psychological needs. Retos 41, 616–627. doi: 10.47197/RETOS.V0I41.82481
Jurecka, A., Skucińska, P., and Gądek, A. (2021). Impact of the SARS-CoV-2 coronavirus pandemic on physical activity, mental health and quality of life in professional athletes—a systematic review. Int. J. Environ. Res. Public Health 18:9423. doi: 10.3390/ijerph18179423
Katanic, B., Bjelica, D., Corluka, M., Preljevic, A., and Osmani, A. (2022). Motivational structure for sports practice during COVID-19 pandemic in professional football players. Sport Mont. 20, 127–131. doi: 10.26773/smj.221020
Keemss, J., Sieland, J., Pfab, F., and Banzer, W. (2022). Effects of COVID-19 lockdown on physical performance, sleep quality, and health-related quality of life in professional youth soccer players. Front. Sport. Act. Living 4, 1–13. doi: 10.3389/fspor.2022.875767
Kenyon, C. (2020). Flattening-the-curve associated with reduced COVID-19 case fatality rates- an ecological analysis of 65 countries. J. Infect. 81, e98–e99. doi: 10.1016/j.jinf.2020.04.007
Kesilmis, I., Yilmaz, O., and Celik, D. O. (2021). Effect of COVID-19 on amateur football: perspective of physical activity, nutrition, and mood. Int. J. Life Sci. Pharma Res. 11, 156–163.
Kirkendall, D. T. (2020). Evolution of soccer as a research topic. Prog. Cardiovasc. Dis. 63, 723–729. doi: 10.1016/j.pcad.2020.06.011
Kobal, R., Aquino, R., Carvalho, L., Serra, A., Sander, R., Gomes, N., et al. (2022). Does the number of substitutions used during the matches affect the recovery status and the physical and technical performance of elite Women’s soccer? Int. J. Environ. Res. Public Health 19:1541. doi: 10.3390/ijerph191811541
Lee, J. W., Song, S., Kim, Y. B., Park, S. B., and Han, D. H. (2023). Soccer’s AI transformation: deep learning’s analysis of soccer’s pandemic research evolution. Front. Psychol. 14:1244404. doi: 10.3389/fpsyg.2023.1244404
Leitner, M. C., and Richlan, F. (2021). Analysis System for Emotional Behavior in Football (ASEB-F): matches of FC Red Bull Salzburg without supporters during the COVID-19 pandemic. Humanit Soc Sci Commun. 8:14. doi: 10.1057/s41599-020-00699-1
Leguizamo, F., Olmedilla, A., Núñez, A., and Verdaguer, F. J. P. (2021). Personality, coping strategies, and mental health in high-performance athletes during confinement derived from the COVID-19 pandemic. Front. Public Health 8:561198. doi: 10.3389/fpubh.2020.561198
Li, J., Gao, H., Liu, P., and Zhong, C. (2020). Does Distance Produce Beauty? The Influence of COVID-19 Lockdown on the Coach-Athlete Relationship in a Chinese Football School. Front. Psychol. 11:560638. doi: 10.3389/fpsyg.2020.560638
Lima, Y., Denerel, N., Öz, N. D., and Senisik, S. (2021). The psychological impact of COVID-19 infection on athletes: example of professional male football players. Sci. Med. Footb. 5, 53–61. doi: 10.1080/24733938.2021.1933156
Madsen, E. E., Krustrup, P., Larsen, C. H., Elbe, A. M., Wikman, J. M., Ivarsson, A., et al. (2021). Resilience as a protective factor for well-being and emotional stability in elite-level football players during the first wave of the COVID-19 pandemic. Sci. Med. Footb. 5, 62–69. doi: 10.1080/24733938.2021.1959047
Mann, R. H., Clift, B. C., Boykoff, J., and Bekker, S. (2020). Athletes as community; athletes in community: COVID-19, sporting mega-events and athlete health protection. Br. J. Sports Med. 54, 1071–1072. doi: 10.1136/bjsports-2020-102433
Marholz, P. F. O., Contreras, L. M. V., and Diaz, J. B. (2022). Niveles de Ansiedad Rasgo y Bienestar en jugadores de fútbol profesional de Chile durante la cuarentena por COVID-19 (levels of trait anxiety and well-being in Chilean professional soccer players during the COVID-19 quarantine). Retos 44, 1037–1044. doi: 10.47197/retos.v44i0.91316
Mavi Var, S., Marangoz, I., and Var, L. (2021). Analysis of some problems faced by active athletes during COVID-19 isolation period. Beden Eğitimi ve Spor Bilim. Derg. 15, 366–378.
McHugh, M. L. (2012). Lessons in biostatistics interrater reliability: the kappa statistic. Biochem. Med. 22, 276–282. doi: 10.11613/BM.2012.031
Mehrsafar, A. H., Moghadam Zadeh, A., Jaenes Sánchez, J. C., and Gazerani, P. (2021). Competitive anxiety or coronavirus anxiety? The psychophysiological responses of professional football players after returning to competition during the COVID-19 pandemic. Psychoneuroendocrinology 129:105269. doi: 10.1016/j.psyneuen.2021.105269
Merino-Muñoz, P., Pérez-Contreras, J., Adasme-Maureira, F., and Aedo-Muñoz, E. (2021). Efectos en el estado de bienestar en periodo de confinamiento debido al COVID-19 en jugadores profesionales de fútbol. MHSalud Rev. en Ciencias del Mov. Hum. y Salud 19, 1–12. doi: 10.15359/mhs.19-1.2
Mon-López, D., García-Aliaga, A., Ginés Bartolomé, A., and Muriarte Solana, D. (2020). How has COVID-19 modified training and mood in professional and non-professional football players? Physiol. Behav. 227:113148. doi: 10.1016/j.physbeh.2020.113148
Montealegre-Mesa, L. M., Rincón-Bolívar, N. J., and Montealegre-Mesa, A. (2023). Carga de entrenamiento y respuesta psicológica de futbolistas en aislamiento por COVID-19. Rev. Digit. Act. Física y Deport. 9:2308. doi: 10.31910/rdafd.v9.n1.2023.2308
Morales, J. S., Castillo-García, A., Valenzuela, P. L., Saco-Ledo, G., Mañas, A., Santos-Lozano, A., et al. (2021). Mortality from mental disorders and suicide in male professional American football and soccer players: a meta-analysis. Scand. J. Med. Sci. Sport. 31, 2241–2248. doi: 10.1111/sms.14038
Morgan, R. L., Whaley, P., Thayer, K. A., and Schünemann, H. J. (2018). Identifying the PECO: a framework for formulating good questions to explore the association of environmental and other exposures with health outcomes. Environ. Int. 121, 1–24. doi: 10.1016/j.envint.2018.07.015.Identifying
Nassar, M. F., Allam, M. F., and Shata, M. O. (2021). Effect of COVID-19 lockdown on young Egyptian soccer players. Glob. Pediatr. Heal. 8:2333794X2110129. doi: 10.1177/2333794X211012980
National Institutes of Health . (2021). Study quality assessment tools. Available at: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools
Ouzzani, M., Hammady, H., Fedorowicz, Z., and Elmagarmid, A. (2016). Rayyan-a web and mobile app for systematic reviews. Syst. Rev. 5, 1–10. doi: 10.1186/s13643-016-0384-4
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 372, 1–9. doi: 10.1136/bmj.n71
Paravlic, A. H., Simunic, B., Pisot, S., Kleva, M., Teraz, K., Vogrin, M., et al. (2022). Lower-limb muscle contractile properties, explosive power and the subjective response of elite soccer players to the COVID-19 lockdown. Int. J. Environ. Res. Public Health 19:474. doi: 10.3390/ijerph19010474
Pété, E., Leprince, C., Lienhart, N., and Doron, J. (2022). Dealing with the impact of the COVID-19 outbreak: Are some athletes’ coping profiles more adaptive than others?. Eur J Sport Sci, 22, 237–247. doi: 10.1080/17461391.2021.1873422
Rice, S. M., Purcell, R., De Silva, S., Mawren, D., Mcgorry, P. D., and Parker, A. G. (2016). The mental health of elite athletes: a narrative systematic review. Sport. Med. 46, 1333–1353. doi: 10.1007/s40279-016-0492-2
Richardson, D. L., Tallis, J., Duncan, M. J., Clarke, N. D., and Myers, T. D. (2022). The ongoing effects of the COVID-19 pandemic on perceived physical activity, physical function and mood of older adults in the U. K: a follow-up study (March 2020–June 2021). Exp. Gerontol. 165:111838. doi: 10.1016/j.exger.2022.111838
Romdhani, M., Fullagar, H. H. K., Vitale, J. A., Nédélec, M., Rae, D. E., Ammar, A., et al. (2022). Lockdown duration and training intensity affect sleep behavior in an international sample of 1, 454 elite athletes. Front. Physiol. 13, 1–11. doi: 10.3389/fphys.2022.904778
Romdhani, M., Washif, J. A., Taylor, L., Chamari, K., Ammar, A., Al Horani, R., et al. (2023). Soccer players’ sleep quality and training load were affected by the COVID-19 lockdown: an international survey. Int. J. Sports Physiol. Perform. 18, 530–540. doi: 10.1123/IJSPP.2022-0187
Sarkies, M. N., Bowles, K. A., Skinner, E. H., Haas, R., Lane, H., and Haines, T. P. (2017). The effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare: a systematic review. Implement. Sci. 12:132. doi: 10.1186/s13012-017-0662-0
Sarmento, H., Frontini, R., Marques, A., Peralta, M., Ordoñez-Saavedra, N., Duarte, J. P., et al. (2021). Depressive symptoms and burnout in football players: a systematic review. Brain Sci. 11:1351. doi: 10.3390/brainsci11101351
Şenışık, S., Denerel, N., Köyağasıoğlu, O., and Tunç, S. (2021). The effect of isolation on athletes mental health during the COVID-19 pandemic. Phys Sportsmed. 49, 187–193. doi: 10.1080/00913847.2020.1807297
Slimani, M., Baker, J. S., Cheour, F., Taylor, L., and Bragazzi, N. L. (2017). Steroid hormones and psychological responses to soccer matches: insights from a systematic review and meta-analysis. PLoS One 12, e0186100–e0186119. doi: 10.1371/journal.pone.0186100
Smith, D. C. V. L. (2021). Footballers’ citizenship during COVID-19: a case study of premier league players’ community support. Int. Rev. Sociol. Sport 57, 980–997. doi: 10.1177/10126902211045679
Sun, S., Zhang, S. X., Jahanshahi, A. A., and Jahanshahi, M. (2021). Drilling under the COVID-19 pandemic: A diary study of professional football players’ mental health and workout performance. Stress Heal. 38, 3–18. doi: 10.1002/smi.3059
Villaseca-Vicuña, R., Pérez-Contreras, J., Merino-Muñoz, P., González-Jurado, J. A., and Aedo-Muñoz, E. (2021). Effects of COVID-19 confinement measures on training loads and the level of well-being in players from Chile women’s national soccer team. Rev. Fac. Med. 69, 1–7. doi: 10.15446/revfacmed.v69n1.88480
Vitali, F., Bisagno, E., Coco, M., Cadamuro, A., Maldonato, N. M., and Di Corrado, D. (2022). A moderated mediation analysis of the effects of the COVID-19 pandemic on well-being and sport readiness of Italian team sports players: the role of perceived safety of the training environment. Int. J. Environ. Res. Public Health 19:2764. doi: 10.3390/ijerph19052764
Wagemans, J., Catteeuw, P., Vandenhouten, J., Jansen, J., de Corte, X., Ceusters, C., et al. (2021). The impact of COVID-19 on physical performance and mental health—a retrospective case series of Belgian male professional football players. Front. Sport. Act. Living 3, 1–7. doi: 10.3389/fspor.2021.803130
World Health Organization . (2020). Number of COVID-19 cases reported to WHO. Available at: https://data.who.int/dashboards/covid19/cases?n=c
Zago, M., Lovecchio, N., and Galli, M. (2022). Players at home: Physical activity and quality of life in 12–17 years-old football (soccer) players during the Covid-19 lockdown. Int. J. Sports Sci. Coach. 17, 626–636. doi: 10.1177/17479541211041703
Zilli, J., Bennett, H., Mensch, J., and Monsma, E. (2021). The propensity of psychological strategies used by collegiate soccer players at risk for anxiety and depression. J. Study Sport. Athletes Educ. 17, 236–254. doi: 10.1080/19357397.2021.1924565
Zinner, C., Matzka, M., Leppich, R., Kounev, S., Holmberg, H.-C., and Sperlich, B. (2020). The impact of the German strategy for containment of coronavirus SARS-CoV-2 on training characteristics, physical activity and sleep of highly trained kayakers and canoeists: a retrospective observational study. Front. Sport. Act. Living 2:579830. doi: 10.3389/fspor.2020.579830
Keywords: athletes, anxiety, mood states, mental health, social isolation
Citation: Andrade A, D'Oliveira A, Neiva HP, Gaertner G and da Cruz WM (2024) Impact of the COVID-19 pandemic on the psychological aspects and mental health of elite soccer athletes: a systematic review. Front. Psychol. 14:1295652. doi: 10.3389/fpsyg.2023.1295652
Edited by:
Erkut Konter, Istanbul Gelişim University, TürkiyeReviewed by:
Laisa Liane Paineiras-Domingos, Federal University of Bahia (UFBA), BrazilDominika Wilczyńska, Gdansk University of Physical Education and Sport, Poland
Copyright © 2024 Andrade, D’Oliveira, Neiva, Gaertner and da Cruz. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Alexandro Andrade, YWxleGFuZHJvLmFuZHJhZGUucGhkQGdtYWlsLmNvbQ==, ORCID.org/0000-0002-6640-9314