Nacipe Jacob1Jefferson S. Novaes2,3
David G. Behm4
João G. Vieira2
Marcelo R. Dias2,5*
Jeferson M. Vianna2- 1Medical and Health Sciences College of Juiz de Fora - Suprema, Juiz de Fora, Brazil
- 2Postgraduate Program in Physical Education of Federal University of Juiz de Fora, Juiz de Fora, Brazil
- 3Department of Gymnastics, Federal University of Rio de Janeiro, Rio de Janeiro, Brazil
- 4School of Human Kinetics and Recreation, Memorial University of Newfoundland, St. John's, NL, Canada
- 5Laboratory of Exercise Physiology and Morphofunctional Assessment of Granbery Methodist College, Juiz de Fora, Brazil
Background: CrossFit® training is a high-intensity functional training program that aims to increase physical functional performance through biochemical responses, i.e., hormonal, metabolic, and inflammatory responses. Most hormonal, metabolic, and inflammatory changes induced by CrossFit® training have been reported in isolated clinical studies. The purpose of this review was to systematically explore the existing literature on characterization of hormonal, metabolic, and inflammatory responses resulting from CrossFit® training.
Methods: A systematic search of the literature was conducted in PubMed, Web of Science and Scopus from August 2019 to October 2019. Studies were selected through critical review of the content. Using specific keywords, 623 articles were found, of which 597 were excluded for ineligibility, and 25 were eligible. The papers were separated according to subject area: hormonal (n = 8), metabolic (n = 19), and inflammatory (n = 6) changes. All were published between 2015 and 2019.
Results: This review reveals potential effects of CrossFit® training on hormonal, metabolic, and inflammatory responses. However, studies had low levels of evidence and reliability due to methodological limitations.
Conclusion: In summary, the results showed a greater volume and intensity of workouts accentuate the responses, that are of paramount importance for improving understanding of the effects of CrossFit® training and serve as a basis for prescribing future exercise protocols.
Introduction
High-intensity functional training (HIFT) is a training program that emphasizes functional movements. HIFT uses a combination of movements, and self-selected time periods of work and rest (Feito et al., 2018). An example of HIFT is CrossFit® training, that is a constantly varied and high-intensity functional training program. The training consists of a combination of different exercise elements: cardiovascular (CV), gymnastic and weightlifting exercises (Glassman, 2017). The combination and variation of these different elements promotes an improvement in fitness. CrossFit® training session, i.e., the workout of the day (WOD), is structured into joint mobility, warm-up, a technical portion, and the main portion. WODs are performed with short or no breaks between exercises, repetitions, and rounds (Glassman, 2007). Usually, WODs are designed to perform the exercise in the shortest possible duration or to perform as many repetitions or rounds as possible (AMRAP) in a given period of time.
Exercise works as a stressor during and after its execution and can cause inflammation (Silveira et al., 2016). These responses, which can be induced by stressors and are vital for host defense and natural tissue homeostasis, initiate the elimination of noxious compounds and damaged tissue (Allen et al., 2015). Apparently, several hormonal (Kliszczewicz et al., 2018a; Mangine et al., 2018; Cadegiani et al., 2019), metabolic (Maté-Muñoz et al., 2018; Tibana et al., 2018; Feito et al., 2019a) and inflammatory (Michnik et al., 2017; Durkalec-Michalski et al., 2018) changes occur with CrossFit® practice. Emphasizing the strong relationship between the hormonal, metabolic, and inflammatory profiles that occur with systematic practice of this high-intensity activity is important (Coco et al., 2019; Tibana et al., 2019b). Thus, an understanding of the hormonal, metabolic, and inflammatory molecular changes is fundamental to establishing the response parameters that come with training.
Studies on the physiological changes resulting from CrossFit® training have been published, but they exhibit large methodological discrepancies, which presents difficulties in explaining the results. The studies present protocols with different time lengths (3.5–23.3 min), exercise modalities (CV, gymnastic, and/or weightlifting exercises), methods (for time or AMRAP), and intensities (absolute or relative load). In reviewing the literature, it was observed that most of the hormonal, metabolic, and inflammatory changes related to CrossFit® training have been reported in isolated clinical studies.
To date, no systematic review of such changes has been performed. The purpose of this review was to systematically review the existing literature on characterization of hormonal (testosterone, cortisol, growth hormone (GH), insulin-like growth factor 1 (IGF-1), adrenaline, noradrenaline, metabolic [lactate, glycemia, cholesterol, creatinine, glutamic oxaloacetic transaminase (GOT), glutamic pyruvic transaminase (GPT)], and inflammatory [interleukin (IL)-6, IL-10, creatine kinase (CK)] responses associated with CrossFit® training.
Methods
A systematic literature search was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (Liberati et al., 2009).
Eligibility Criteria
This research followed the PICOS strategy to develop the search criteria and determine which relevant articles to include or exclude.
1. Participants: Men and women over 18 years old.
2. Interventions: Any type of intervention that evaluates hormonal, metabolic and inflammatory changes that occur after training protocols based on CrossFit® training.
3. Comparators: The CrossFit® training protocols were compared, provided that there were different training methods.
4. Outcomes: The results reported changes related to hormonal (testosterone, cortisol, GH, IGF-1, adrenaline, and noradrenaline), metabolic (glycemia, cholesterol, creatinine, GOT, and GPT) and inflammatory (IL-6 and IL-10) parameters. CK, that is biomarkers of muscle damage, was included in inflammatory responses.
5. Study design: Randomized and non-randomized trials, using either cross-over or parallel groups, comparing different types of CrossFit® training interventions.
Selection Criteria
The specific inclusion criteria were as follows: (1) articles that were original research; (2) intervention based on CrossFit® training; (3) a sample of men and women; (4) studies that investigated at least one hormonal, metabolic, or inflammatory/muscle damage variable relevant to the analysis in the present study. Studies were excluded in the following cases: (1) duplicate articles; (2) articles that were not in the English language; (3) articles that presented training protocols not based on CrossFit® training; (4) articles with special populations; (5) articles that were systematic reviews, conference abstracts, dissertations, theses, and book chapters.
Search Methods for Identification of Studies
The systematic literature search was carried out until October 2019 using the following databases: PubMed, Web of Science and Scopus. The articles were searched using a combination of keywords corresponding to the theme of the review: CrossFit OR “high-intensity functional training” OR HIFT. Medical Subject Headings (MeSH) was consulted to check possible entry terms related to the keywords. After combining the research results and discarding duplicate studies in the databases, two researchers (NJ and MRD) independently selected titles and abstracts to identify relevant studies. The included articles were retrieved, read in full (full text) and independently assessed for eligibility by the same two researchers (NJ and MRD) according to the criteria described above. A meeting was held, and in the case of disagreement regarding the selection of articles, a third author (JN) was consulted to resolve the disagreement.
Data Collection and Analysis
Standardized data extraction forms were completed by two researchers (NJ and MRD) and verified by another researcher (JN). Information on the type of study design, characteristics of the participants, sample size, time of experience in the profile, data collection, CrossFit® training protocols, and main conclusions was extracted (see Tables 1–3). The entire study selection process is shown in Figure 1.
Table 1. Hormonal responses associated with CrossFit® training.
Table 2. Metabolic responses associated with CrossFit® training.
Table 3. Inflammatory responses associated with CrossFit® training.
Figure 1. Flow diagram of the study selection process.
Assessment of Risk of Bias in Included Studies
The Cochrane Collaboration's risk of bias assessment tool was used to evaluate the internal validity of the studies (Higgins et al., 2011). Selection bias (random sequence generation and allocation concealment), performance bias (blinding of participants and researchers), detection bias (blinding of outcome assessment), attrition bias (incomplete outcome data), reporting bias (selective reporting), and other biases (anything else, ideally pre-specified) were evaluated. A researcher (JGV) classified each of the factors described as low, unclear, or high risk of bias. Then a meeting was held with a second researcher (MRD) to discuss possible classification disagreements and make the final decision. In addition, a descriptive cross-sectional cohort study (Cadegiani et al., 2019) was not analyzed.
Results
The initial search identified 623 titles in the database. First, 269 duplicate titles were excluded. After a review of the titles and abstracts of 354 articles, 28 articles (4.5%) were selected for a complete full-text review. Finally, 25 articles were selected (8 articles on hormone responses, 19 on metabolic responses and 6 on inflammatory responses). All were published between 2015 and 2019, and most were of a cross-sectional design.
The study design was described as acute (n = 21; pre-training and post-training or comparison between groups), longitudinal (n = 3; up to 6 weeks of CrossFit® training) or descriptive of a cross-sectional cohort (n = 1; after training only).
Sample Characteristics
The articles evaluated a total of 427 subjects. The sample sizes ranged from 8 to 40 subjects. Among the subjects, 417 were CrossFit® trained or active for more than 3 months. In total, 345 subjects were men, 72 were women, and the sex of 10 participants was not specified. Most studies included men alone, 7 studies included men and women, and no studies enrolled only women.
CrossFit® Training Protocol
Different exercise protocols that are commonly prescribed in CrossFit® training were found. Four articles (Murawska-Cialowicz et al., 2015; Michnik et al., 2017; Cadegiani et al., 2019; Poderoso et al., 2019) did not describe the training protocol. The studies that described the training protocols analyzed participants who performed different combinations of multiple types of exercise modalities. CV, gymnastic and weightlifting exercises): gymnastic (n = 2; Shaw et al., 2015; Ahmad et al., 2019), G + W (n = 4; Fernandez-Fernandez et al., 2015; Escobar et al., 2016, 2017; Timón et al., 2019), CV + weightlifting (n = 6; Perciavalle et al., 2016; Kliszczewicz et al., 2017, 2018a,b; Coco et al., 2019; Feito et al., 2019a), and CV + gymnastic + weightlifting (n = 9; Tibana et al., 2016, 2018, 2019a,b; Maté-Muñoz et al., 2017, 2018; Durkalec-Michalski et al., 2018; Mangine et al., 2018, 2019).
The training intensity was verified in a few studies through heart rate (HR) assessment, in which the HR remained between 85.9 and 97.4% of the maximum HR (Fernandez-Fernandez et al., 2015; Murawska-Cialowicz et al., 2015; Kliszczewicz et al., 2018a,b; Maté-Muñoz et al., 2018; Tibana et al., 2018; Ahmad et al., 2019; Feito et al., 2019a). Regarding the WOD time, 10 studies used protocols with times <10 min (Fernandez-Fernandez et al., 2015; Kliszczewicz et al., 2017, 2018a,b; Maté-Muñoz et al., 2017, 2018; Mangine et al., 2018, 2019; Tibana et al., 2018; Timón et al., 2019), 13 studies used protocols with times between 10 and 19 min (Murawska-Cialowicz et al., 2015; Shaw et al., 2015; Escobar et al., 2016, 2017; Kliszczewicz et al., 2017, 2018a,b; Maté-Muñoz et al., 2017; Durkalec-Michalski et al., 2018; Mangine et al., 2018, 2019; Tibana et al., 2018; Feito et al., 2019a), and five studies used protocols with times over 20 min (Fernandez-Fernandez et al., 2015; Maté-Muñoz et al., 2017, 2018; Mangine et al., 2018; Tibana et al., 2019b).
The frequency of training was reported in only two longitudinal studies (Murawska-Cialowicz et al., 2015; Poderoso et al., 2019). Poderoso et al. (2019) and Murawska-Cialowicz et al. (2015) adopted 5 and 2 days a week, respectively, without describing the training protocol. One study did not report weekly training frequency (Michnik et al., 2017).
Hormonal Responses
Eight studies (Kliszczewicz et al., 2017, 2018a,b; Mangine et al., 2018, 2019; Cadegiani et al., 2019; Poderoso et al., 2019; Tibana et al., 2019b) investigated hormonal responses (see Table 1). The variables analyzed were testosterone and cortisol (Mangine et al., 2018; Cadegiani et al., 2019; Poderoso et al., 2019; Tibana et al., 2019a), GH and IGF-1 (Kliszczewicz et al., 2018a; Cadegiani et al., 2019), or adrenaline and noradrenaline (Kliszczewicz et al., 2017, 2018b; Cadegiani et al., 2019; Mangine et al., 2019).
As an acute effect, testosterone and cortisol increased after training and appeared to remain elevated 30 and 60 min after some training protocols (Mangine et al., 2018). Testosterone and cortisol returned to their initial values 48 h after training (Tibana et al., 2019a). In the only longitudinal study (Poderoso et al., 2019), testosterone was higher after the 6th month, and cortisol was lower after the 4th month. Comparing different groups (healthy men, men with overtraining, and inactive men), Cadegiani et al. (2019) showed that healthy men presented a higher testosterone level than men with overtraining, while cortisol was not different among them.
In the study by Kliszczewicz et al. (2018a), GH was higher 1 h after training involving CV and weightlifting exercises compared with weightlifting exercises only. Like testosterone, when compared between different groups, GH was higher in healthy men than in inactive men (Cadegiani et al., 2019). IGF-1 showed no differences soon after WODs or between different groups.
Adrenaline and noradrenaline were higher soon after training regardless of the WOD (Kliszczewicz et al., 2017, 2018b; Mangine et al., 2019). After 6 months of training, the resting adrenaline was not different, while noradrenaline was lower with overtraining (Cadegiani et al., 2019).
Metabolic Responses
Nineteen studies (Fernandez-Fernandez et al., 2015; Murawska-Cialowicz et al., 2015; Shaw et al., 2015; Escobar et al., 2016, 2017; Perciavalle et al., 2016; Tibana et al., 2016, 2018, 2019a; Kliszczewicz et al., 2017, 2018a; Maté-Muñoz et al., 2017, 2018; Durkalec-Michalski et al., 2018; Ahmad et al., 2019; Cadegiani et al., 2019; Coco et al., 2019; Feito et al., 2019a; Timón et al., 2019) investigated metabolic responses (see Table 2). The metabolic variables analyzed were lactate (Fernandez-Fernandez et al., 2015; Murawska-Cialowicz et al., 2015; Shaw et al., 2015; Escobar et al., 2016, 2017; Perciavalle et al., 2016; Tibana et al., 2016, 2018, 2019b; Maté-Muñoz et al., 2017, 2018; Durkalec-Michalski et al., 2018; Kliszczewicz et al., 2018a; Ahmad et al., 2019; Cadegiani et al., 2019; Coco et al., 2019; Feito et al., 2019a; Timón et al., 2019), glycemia (Shaw et al., 2015; Perciavalle et al., 2016; Tibana et al., 2016; Kliszczewicz et al., 2017; Durkalec-Michalski et al., 2018; Cadegiani et al., 2019; Coco et al., 2019; Timón et al., 2019), cholesterol (Shaw et al., 2015), creatinine (Cadegiani et al., 2019), GOT and GPT (Timón et al., 2019).
Most studies investigated lactate responses (17 studies). There was a consensus that lactate levels are high immediately after a CrossFit® training session. This increase seems to occur at the beginning of the training and persists for up to 30 min after the session (Tibana et al., 2018). Some studies presented differences between the different WODs (Tibana et al., 2016; Maté-Muñoz et al., 2017, 2018; Timón et al., 2019), and some found no differences (Fernandez-Fernandez et al., 2015; Durkalec-Michalski et al., 2018; Tibana et al., 2018, 2019b). Chronically, Murawska-Cialowicz et al. (2015) reported non-significant changes in lactate values after 3 months of CrossFit® training. Cadegiani et al. (2019), when evaluating healthy athletes and athletes with overtraining syndrome, found that healthy athletes had lower blood lactate levels than those with overtraining who followed an undescribed training protocol. The pre-WOD lactate values were ~2.9 mmol·L−1 for all studies. However, blood lactate responses after the protocols were similar regardless of the WOD time. The values presented were 10.15–18.38 mmol·L−1 for protocols with a time <10 min (Maté-Muñoz et al., 2017, 2018; Kliszczewicz et al., 2018a; Tibana et al., 2018; Timón et al., 2019), 5.95–16.56 mmol·L−1 for protocols with a time ranging from 10 to 19 min (Maté-Muñoz et al., 2017, 2018; Kliszczewicz et al., 2018a; Tibana et al., 2018; Timón et al., 2019) and 11.79–17.43 mmol·L−1 for protocols ≥20 min (Fernandez-Fernandez et al., 2015; Maté-Muñoz et al., 2017, 2018; Ahmad et al., 2019; Tibana et al., 2019b). The values presented were 6.34–14.0 mmol·L−1 for studies that did not report the duration of the protocols (Fernandez-Fernandez et al., 2015; Perciavalle et al., 2016; Tibana et al., 2016; Coco et al., 2019).
Glycemia was often investigated (8 studies). Similar to lactate, several studies showed an increase after independent WOD (Tibana et al., 2016; Kliszczewicz et al., 2017; Durkalec-Michalski et al., 2018; Timón et al., 2019), while other studies did not show changes in glycemic levels after training (Shaw et al., 2015; Perciavalle et al., 2016; Coco et al., 2019). Only the study by Tibana et al. (2016) showed that blood glucose changed after training as a function of the WOD type. Blood glucose did not change between healthy and overtraining syndrome athletes in an undescribed training protocol (Cadegiani et al., 2019).
Cholesterol, creatinine, GOT and GPT were each investigated in only one study. Cholesterol showed no differences after training (Shaw et al., 2015), and creatinine did not change after 6 months of CrossFit® training (Cadegiani et al., 2019). Timón et al. (2019) were the only researchers to evaluate GOT and GPT responses after training, and their results showed significant increases values independent of the WOD.
Inflammatory Responses
Six studies (Tibana et al., 2016, 2019a; Michnik et al., 2017; Durkalec-Michalski et al., 2018; Cadegiani et al., 2019; Timón et al., 2019) investigated inflammatory responses (see Table 2). Biomarkers of muscle damage analyzed were CK (Michnik et al., 2017; Durkalec-Michalski et al., 2018; Cadegiani et al., 2019; Tibana et al., 2019a; Timón et al., 2019), IL-6 and IL-10 (Tibana et al., 2016, 2019a).
CK seemed to increase after training (Durkalec-Michalski et al., 2018; Timón et al., 2019) or to decrease within 72 h after training (Tibana et al., 2019a). Michnik et al. (2017) found that after ingestion of green tea, CK decreased after training. As a chronic effect, there were no differences after 6 months of training (Cadegiani et al., 2019).
IL-6 increased after WOD-independent training, while IL-10 increased as a function of WOD characteristics (Tibana et al., 2016). Comparing five different WODs, IL-10 showed no differences after training (Tibana et al., 2019a).
Risk of Bias in Included Studies
Table 4 summarizes the results of the methodological quality assessment across all included studies and Figure 2 shows the percentage distribution of quality. Procedures for a random sequence generation and allocation concealment were unclear in 14 of 24 studies. A low risk of bias was found in three trials regarding blinding of participants/personnel. Six studies showed complete outcome data. Seven out of 24 studies showed high risk of “other bias.” These studies did not describe the training protocol or concealed participants' data.
Table 4. Risk of bias assessment.
Figure 2. Cochrane risk of bias assessment.
Discussion
The purpose of this review was to systematically examine the existing literature on characterization of hormonal, metabolic, and inflammatory responses associated with CrossFit® training. The results of this systematic review showed that there are still few studies for each observed variable. Of the 25 studies analyzed, all had different training protocols regarding the training stimulus administered. This methodological difference was found because CrossFit® training is constantly varied and consists of a combination of different exercise elements: CV, gymnastic and weightlifting exercises (Glassman, 2017). However, the hormonal, metabolic, and inflammatory changes induced by CrossFit® training seem to be related to the training variables, and the protocols with more volume and intensity provided greater biochemical responses. In addition, psychological factors, such as pre-competitive anxiety, can alter the physiological status of athletes (Mangine et al., 2018).
Hormonal Responses
The studies demonstrated that increases in testosterone and cortisol levels occurred after WODs, with longer recovery intervals (Mangine et al., 2018; Tibana et al., 2019a). However, testosterone and cortisol levels decreased after 48 h of training (Tibana et al., 2019a). Acute increases in testosterone may have different explanations: (a) transient increases in strength during training (Hooper et al., 2017); (b) repetitions with maximum effort, which generates additional overload (Ahtiainen et al., 2003). On the other hand, the elevation in cortisol levels, can be explained by psychological factors, as observed in different types of sport athletes (Casto and Edwards, 2016). The perception of the difficulty of the WODs and the stimulus to perform a task for time or AMRAP are other factors that can increase the psychological stress of CrossFit® training practitioners and create an environment conducive to an increase in cortisol (Mangine et al., 2019).
Some limitations were observed in the study by Mangine et al. (2018), who evaluated acute testosterone and cortisol changes. In a small sample of five men and five women, one woman was on an oral contraceptive (medroxyprogesterone). Testosterone and cortisol responses were similar to those in women's soccer, volleyball, and softball athletes (Edwards and O'Neal, 2009) and hockey players (Crewther et al., 2015). Further studies are needed to verify that such responses are consistent with women who participate in CrossFit® training.
Chronically, testosterone levels in men rose after 6 months of CrossFit® training, while cortisol levels decreased (Poderoso et al., 2019). The high-volume and high-intensity protocols with short rest intervals between sets tended to lead to greater hormonal changes (Kraemer and Ratamess, 2005). Previous studies have reported a significant increase in testosterone levels after high-intensity exercises in runners and master athletes of various modalities (Herbert et al., 2017; Nuuttila et al., 2017). Women did not present significant chronic testosterone and cortisol changes (Poderoso et al., 2019). It can be expected that women do not undergo major adaptations in testosterone levels due to their low responsiveness (Kraemer et al., 1998).
The training dose required to cause hormonal changes is difficult to determine. Notably, training with a greater volume promoted increases in GH concentrations (Kliszczewicz et al., 2018a) but did not alter catecholamine levels (Kliszczewicz et al., 2018b). Regardless of time, different intensity of exercises increased testosterone levels, while training with longer duration increased the concentration of cortisol (Mangine et al., 2018). It seems that isolated exercises become competitors when combined in a single training session. For example, when subjected to isolated resistance training, runners showed a decrease in testosterone and an increase in cortisol (Anderson et al., 2016). Performing endurance exercises before strength training can increase the cortisol and lactate concentrations in the blood of recreational strength training practitioners (Jones et al., 2016). We suggest that the performance of WODs with a predominance of CV exercises before weightlifting exercises results in unfavorable hormonal responses.
On the other hand, increases in testosterone levels may be closely related to the health of the participants. In a descriptive cross-sectional study, Cadegiani et al. (2019) showed that healthy CrossFit® training practitioners have higher levels of testosterone and GH and lower levels of noradrenaline than practitioners with overtraining syndrome. The higher levels of noradrenaline in practitioners with overtraining syndrome may be a compensatory attempt to maintain performance during exercise due to reduced conversion of catecholamines to metanephrines (Cadegiani et al., 2019). The fact that CrossFit® training has a high metabolic component may explain the increases in GH levels (Kliszczewicz et al., 2018a). Thus, increases in blood lactate can enhance GH levels due to their relationship, especially when the modality is not interval training but rather a more continuous exercise (Goto et al., 2005). Another factor that can influence increases in GH levels is the increased release induced by noradrenaline in the hypothalamus, which inhibits somatostatin, the main inhibitor of GH release in the pituitary gland (Kliszczewicz et al., 2018b). Unlike GH, IGF-1 does not increase significantly after a high-intensity functional training session (Kliszczewicz et al., 2018a). The lack of response from IGF-1 may be partially related to the regulatory role of GH in IGF-1 levels, affecting its post-exercise response (Duan and Xu, 2005). On the other hand, Borst et al. (2001) observed significant increases in IGF-1 in response to longitudinal training of 13 weeks.
Catecholamines showed acute elevations after WODs (Kliszczewicz et al., 2017, 2018b; Mangine et al., 2019). Generally, with high-intensity training, there is an increase in the sympathetic response and a concomitant need to increase hemodynamic parameters (Mangine et al., 2019). However, it was observed that 3 h after training, levels decreased compared to pre-exercise levels (Kliszczewicz et al., 2017). Kraemer et al. (2015) reported that catecholamine levels increased during resistance, aerobic, and combined training as the intensity increased. After training (5 and 15 min), the levels appeared to return to baseline in response to decreased physical activity and increased parasympathetic activity. Autonomic control attempts to re-establish homeostasis, which is likely the reason why noradrenaline decreased below the baseline in the Mangine et al. (2019) study.
When comparing the chronic hormonal responses of CrossFit® practitioners with other sport athletes, the responses may differ. From this perspective, Arruda et al. (2015) observed that young soccer players experienced a drop in testosterone levels as the season progressed, which appears to be different in men who practice CrossFit® training (Poderoso et al., 2019). CrossFit training is characterized by the combination and variation of different elements in the same session, i.e., CV, gymnastic and weightlifting. Thus, further studies are needed to compare hormonal responses in different sports.
Metabolic Responses
The main metabolic marker evaluated in CrossFit® training studies was blood lactate. An acute increased lactate concentration response was observed after training sessions (Fernandez-Fernandez et al., 2015; Murawska-Cialowicz et al., 2015; Shaw et al., 2015; Escobar et al., 2016; Perciavalle et al., 2016; Tibana et al., 2016, 2018, 2019a; Maté-Muñoz et al., 2017, 2018; Durkalec-Michalski et al., 2018; Kliszczewicz et al., 2018a; Coco et al., 2019; Timón et al., 2019) and remained elevated for up to 30 min after the end of the session (Tibana et al., 2018). In CrossFit® training, WODs generally do not have a standard break time, i.e., as the training is “for time” or AMRAP, the intervals are self-selected according to the suitability of the participants. Therefore, this characteristic can keep lactate elevated for a longer duration after the session (Goto et al., 2005).
As for chronic metabolic responses, the lack of change in lactate response may be the result of the intensity utilized for each WOD. It must also be considered that pre-training lactate was not registered (Murawska-Cialowicz et al., 2015). Thus, at present, chronic metabolic responses in CrossFit® training practitioners are inconclusive.
Blood glucose was another variable observed. According to Timón et al. (2019) and Kliszczewicz et al. (2017), the glycemic rate rises after a CrossFit® training session due to increased catecholamines. The increase in the glycemic rate in response to a training session is due to the need for greater utilization of glucose to meet the energy required for the sport, which has the particular characteristic of always being performed at high intensity (Glassman, 2017). However, other studies did not observe significant acute changes in blood glucose (Shaw et al., 2015; Perciavalle et al., 2016; Coco et al., 2019), and one study found that the results depend on the practitioner's performance status (Cadegiani et al., 2019). Only one study investigated chronic blood glucose responses with 8 weeks of HIFT and aerobic/resistance training (Feito et al., 2019b), reporting no significant differences in blood glucose responses between groups.
Cholesterol response does not appear to be affected by a CrossFit® training session (Shaw et al., 2015); apparently, the session time was insufficient (10-min AMRAP) to change total cholesterol responses. Hepatic transaminases (GOT and GPT) were analyzed to assess liver overload during exertion. In both WODs, there was a significant increase after exercise (Timón et al., 2019), and these levels remained high at 24 h only after WOD 2, which made the results curious given the higher intensity of WOD-2 compared to WOD-1. One study even claimed that intensive muscle exercise (e.g., weightlifting) can increase hepatocellular damage for up to 7 days after exercise (Pettersson et al., 2008). The accelerated metabolic demands of muscle exercise cannot be met without a significant liver response (Trefts et al., 2015).
Inflammatory Responses
Acute muscle damage responses through CK were investigated in three studies (Durkalec-Michalski et al., 2018; Tibana et al., 2019b; Timón et al., 2019). Durkalec-Michalski et al. (2018) found that CK levels increased significantly after benchmark “Fight Gone Bad” and incremental cycle ergometer testing. However, this study examined the effects of sodium bicarbonate intake on CrossFit® training performance and aerobic capacity. Although the primary objective of the study was to examine the effectiveness of a sodium bicarbonate supplementation protocol, the CK response was similar, regardless of the supplement, increasing after the WOD. Another study found an increase in CK level after different WODs, which continued for up to 24 h (Timón et al., 2019). These results are consistent with those of strength training, which were shown to increase CK levels in 58 individuals after performing 4 min of high-intensity interval resistance training. The high-intensity interval resistance training session consisted of eight sets of squats performed with the fastest speed and highest number of repetitions achievable for 20 s, with 10 s of rest between sets (Spada et al., 2018). Moreover, it seems that CK decreases after 72 h (Tibana et al., 2019a), for which we speculate that after 3 successive days of competition, athletes adapt to high-intensity stimuli. In addition, certain factors, such as level of training, muscle groups involved, and sex, can influence CK levels more than differences in exercise volume or type (Koch et al., 2014).
In addition to being an indicator of muscle damage, CK levels have been shown to be high in people with rhabdomyolysis (Honda et al., 2017; Meyer et al., 2017; Nadaf et al., 2018). The incidence of exertional rhabdomyolysis remains unclear, probably because exercise varies in intensity and individual tolerance. However, it remains controversial whether the intensity of the exercise was consistent with the markedly elevated levels of serum CK (Honda et al., 2017). Chen et al. (2019) found with resistance training, that CK levels are higher when training is on consecutive days. Thus, subjecting CrossFit® training practitioners to a higher volume and intensity of training for successive days may expose the practitioner to the risk of damage associated with muscle cell necrosis.
IL-6 and IL-10 were evaluated in two studies (Tibana et al., 2016, 2019a). Tibana et al. (2016) showed that after training the IL-6 and IL-10 levels increased in relation to baseline levels. IL-6 was considered an multifunctional cytokine produced partly by leukocytes as an inflammatory response to exercise (Suzuki et al., 2020). In addition, IL-6 release may be affected by carbohydrate bioavailability (Nieman et al., 2003), which has been suggested to be relevant to skeletal muscle energy supply (Petersen and Pedersen, 2005). An increase in IL-6 may trigger an increase in IL-10 (Petersen and Pedersen, 2005). Recently, Tibana et al. (2019a) found that IL-10 levels did not change significantly 24 h after 3 consecutive days of CrossFit® competition. In contrast, Heavens et al. (2014) showed that after an adapted protocol of functional fitness, muscle damage-related (CK) and inflammatory (IL-6) biomarkers increased significantly, with the peak being found 24 h after the session. Perhaps the sample differences explain the conflicting results; Tibana et al. (2019a) used men experienced in the training, while Heavens et al. (2014) studied inexperienced individuals. The body adapts so that a single training session protects against muscle damage resulting from subsequent sessions, i.e., the repeated bout effect (Hyldahl et al., 2017).
Conclusion
The present review demonstrates the potentially significant effect of CrossFit® training on hormonal, metabolic and inflammatory factors. However, studies evaluating such aspects have a low level of evidence and reliability due to methodological limitations and biases that hinder the convergence of results. Apparently, hormonal, metabolic, and inflammatory stress marker levels increase after CrossFit® training, regardless of the protocol used. However, a greater volume and intensity of workouts accentuate the responses. Some parameters are inconclusive, such as blood glucose and IL-6 and IL-10 levels, due to different results and the small number of studies. Thus, this review sheds light on specific knowledge gaps that should be further investigated. Nevertheless, the results are of paramount importance for improving understanding of the effects of CrossFit® training and serve as a basis for prescribing future exercise protocols.
Data Availability Statement
All relevant data is contained within the article. Further inquiries can be directed to the corresponding author.
Author Contributions
NJ structured and designed the research. NJ and MD carried out the review of studies. JGV and MD realized risk of bias. NJ, JN, JGV, MD, and JV contributed to the conception and writing of the article, reviewing, and editing the manuscript. DB corrected the final version and English grammar. All authors approved the final version.
Funding
This study was financed in part by the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior - Brasil (CAPES) - Finance Code 001, and by the Post Graduate Program in Physical Education, Federal University of Juiz de Fora (UFJF).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors appreciate the MSc Estevão Rios Monteiro (School of Physical Education and Sports, Federal University of Rio de Janeiro, Brazil) for his support.
Abbreviations
GH, Growth hormone; IGF-1, Insulin-like growth factor 1; GOT, Glutamic oxalacetic transaminase; GPT, Glutamic pyruvic transaminase; IL-6, Interleukin 6; IL-10, Interleukin 10; CK, Creatine Kinase; CV, Cardiovascular.
References
Ahmad, A., Jusoh, N., and Tengah, R. Y. (2019). Acute physiological responses and performance following subsequent CrossFit ‘CINDY’ workout with Zea Mays juice. Phys. Educ. Students 23, 57–63. doi: 10.15561/20755279.2019.0201
Ahtiainen, J. P., Pakarinen, A., Kraemer, W. J., and Häkkinen, K. (2003). Acute hormonal and neuromuscular responses and recovery to forced vs. maximum repetitions multiple resistance exercises. Int. J. Sports Med. 24, 410–418. doi: 10.1055/s-2003-41171
Allen, J., Sun, Y., and Woods, J. A. (2015). Exercise and the regulation of inflammatory responses. Prog. Mol. Biol. Transl. Sci. 135, 337–354. doi: 10.1016/bs.pmbts.2015.07.003
Anderson, T., Lane, A. R., and Hackney, A. C. (2016). Cortisol and testosterone dynamics following exhaustive endurance exercise. Eur. J. Appl. Physiol. 116, 1503–1509. doi: 10.1007/s00421-016-3406-y
Arruda, A. F., Aoki, M. S., Freitas, C. G., Spigolon, L. M., Franciscon, C., and Moreira, A. (2015). Testosterone concentration and lower limb power over an entire competitive season in elite young soccer players. J. Strength Cond. Res. 29, 3380–3385. doi: 10.1519/JSC.0000000000000993
Borst, S. E., De Hoyos, D. V., Garzarella, L. I., Vincent, K. E., Pollock, B. H., Lowenthal, D. T., et al. (2001). Effects of resistance training on insulin-like growth factor-I and IGF binding proteins. Med. Sci. Sports Exerc. 33, 648–653. doi: 10.1097/00005768-200104000-00021
Cadegiani, F. A., Kater, C. E., and Gazola, M. (2019). Clinical and biochemical characteristics of high-intensity functional training (HIFT) and overtraining syndrome: findings from the EROS study (The EROS-HIFT). J. Sports Sci. 37, 1296–1307. doi: 10.1080/02640414.2018.1555912
Casto, K. V., and Edwards, D. A. (2016). Testosterone, cortisol, and human competition. Horm. Behav. 82, 21–37. doi: 10.1016/j.yhbeh.2016.04.004
Chen, T. C., Yang, T. J., Huang, M. J., Wang, H. S., Tseng, K. W., Chen, H. L., et al. (2019). Damage and the repeated bout effect of arm, leg, and trunk muscles induced by eccentric resistance exercises. Scand. J. Med. Sci. Sports 29, 725–735. doi: 10.1111/sms.13388
Coco, M., Di Corrado, D., Ramaci, T., Di Nuovo, S., Perciavalle, V., Puglisi, A., et al. (2019). Role of lactic acid on cognitive functions. Phys. Sports Med. 47, 329–335. doi: 10.1080/00913847.2018.1557025
Crewther, B. T., Hamilton, D., Casto, K., Kilduff, L. P., and Cook, C. J. (2015). Effects of oral contraceptive use on the salivary testosterone and cortisol responses to training sessions and competitions in elite women athletes. Physiol. Behav. 147, 84–90. doi: 10.1016/j.physbeh.2015.04.017
Duan, C., and Xu, Q. (2005). Roles of insulin-like growth factor (IGF) binding proteins in regulating IGF actions. Gen. Comp. Endocrinol. 142, 44–52. doi: 10.1016/j.ygcen.2004.12.022
Durkalec-Michalski, K., Zawieja, E. E., Podgórski, T., Łoniewski, I., Zawieja, B. E., Warzybok, M., et al. (2018). The effect of chronic progressive-dose sodium bicarbonate ingestion on CrossFit-like performance: a double-blind, randomized cross-over trial. PLoS ONE. 13:e0197480. doi: 10.1371/journal.pone.0197480
Edwards, D. A., and O'Neal, J. L. (2009). Oral contraceptives decrease saliva testosterone but do not affect the rise in testosterone associated with athletic competition. Horm. Behav. 56, 195–198. doi: 10.1016/j.yhbeh.2009.01.008
Escobar, K. A., Morales, J., and Vandusseldorp, T. A. (2016). The effect of a moderately low and high carbohydrate intake on CrossFit performance. Int. J. Exerc. Sci. 9, 460–470.
Escobar, K. A., Morales, J., and Vandusseldorp, T. A. (2017). Metabolic profile of a crossfit training bout. J. Human Sport Exerc. 12, 1248–1255. doi: 10.14198/jhse.2017.124.11
Feito, Y., Giardina, M. J., Butcher, S., and Mangine, G. T. (2019a). Repeated anaerobic tests predict performance among a group of advanced CrossFit-trained athletes. Appl. Physiol. Nutr. Metab. 44, 727–735. doi: 10.1139/apnm-2018-0509
Feito, Y., Heinrich, K. M., Butcher, S. J., and Poston, W. S. C. (2018). High-intensity functional training (HIFT): definition and research implications for improved fitness. Sports 6, 76–95. doi: 10.3390/sports6030076
Feito, Y., Patel, P., Sal Redondo, A., and Heinrich, K. M. (2019b). Effects of eight weeks of high intensity functional training on glucose control and body composition among overweight and obese adults. Sports 7, 51–61. doi: 10.3390/sports7020051
Fernandez-Fernandez, J., Solana, R. S., Moya, D., Marin, J. M. S., and Ramón, M. M. (2015). Acute physiological responses during CrossFit® workouts. Eur. J. Hum. Mov. 35, 114–124.
Glassman, G. (2017). Level 1 Training Guide. CrossFit Inc. Available online at: http://library.crossfit.com/free/pdf/CFJ_English_Level1_TrainingGuide.pdf (accessed September 10, 2019).
Goto, K. A., Ishii, N. A., Kizuka, T. O., and Takamatsu, K. A. (2005). The impact of metabolic stress on hormonal responses and muscular adaptations. Med. Sci. Sports Exerc. 37, 955–963. doi: 10.1249/01.mss.0000170470.98084.39
Heavens, K. R., Szivak, T. K., Hooper, D. R., Dunn-Lewis, C., Comstock, B. A., Flanagan, S. D., et al. (2014). The effects of high intensity short rest resistance exercise on muscle damage markers in men and women. J. Strength Cond. Res. 28, 1041–1049. doi: 10.1097/JSC.0000000000000236
Herbert, P., Hayes, L. D., Sculthorpe, N. F., and Grace, F. M. (2017). HIIT produces increases in muscle power and free testosterone in male masters athletes. Endocr. Connect. 6, 430–436. doi: 10.1530/EC-17-0159
Higgins, J. P. T., Altman, D. G., Gøtzsche, P. C., Jüni, P., Moher, D., Oxman, A. D., et al. (2011). The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 343:d5928. doi: 10.1136/bmj.d5928
Honda, S., Kawasaki, T., Kamitani, T., and Kiyota, K. (2017). Rhabdomyolysis after high intensity resistance training. Intern Med. 56, 1175–1178. doi: 10.2169/internalmedicine.56.7636
Hooper, D. R., Kraemer, W. J., Focht, B. C., Volek, J. S., DuPont, W. H., Caldwell, L. K., et al. (2017). Endocrinological roles for testosterone in resistance exercise responses and adaptations. Sports Med. 47, 1709–1720. doi: 10.1007/s40279-017-0698-y
Hyldahl, R. D., Chen, T. C., and Nosaka, K. (2017). Mechanisms and mediators of the skeletal muscle repeated bout effect. Exerc. Sport Sci. Rev. 45, 24–33. doi: 10.1249/JES.0000000000000095
Jones, T. W., Howatson, G., Russell, M., and French, D. N. (2016). Effects of strength and endurance exercise order on endocrine responses to concurrent training. Eur. J. Sport Sci. 17, 326–334. doi: 10.1080/17461391.2016.1236148
Kliszczewicz, B., Buresh, R., Bechke, E. E., and Williamson, C. M. (2017). Metabolic biomarkers following a short and long bout of high-intensity functional training in recreationally trained men. J. Human Sport Exerc. 12, 710–718. doi: 10.14198/jhse.2017.123.15
Kliszczewicz, B., Markert, C. D., Bechke, E., Williamson, C., Clemons, K. N., Snarr, R. L., et al. (2018a). Acute effect of popular high-intensity functional training exercise on physiologic markers of growth. J. Strength Cond. Res. doi: 10.1519/JSC.0000000000002933. [Epub ahead of print].
Kliszczewicz, B., Williamson, C., Bechke, E., McKenzie, M., and Hoffstetter, W. (2018b). Autonomic response to a short and long bout of high-intensity functional training. J. Sports Sci. 36, 1872–1879. doi: 10.1080/02640414.2018.1423857
Koch, A. J., Pereira, R., and Machado, M. (2014). The creatine kinase response to resistance exercise. J. Musculoskelet Neuronal Interact. 14, 68–77.
Kraemer, W. J., Gordon, S. E., Fragala, M. S., Bush, J. A., Szivak, T. K., Flanagan, S. D., et al. (2015). The effects of exercise training programs on plasma concentrations of proenkephalin Peptide F and catecholamines. Peptides 64, 74–81. doi: 10.1016/j.peptides.2015.01.001
Kraemer, W. J., and Ratamess, N. A. (2005). Hormonal responses and adaptations to resistance exercise and training. Sports Med. 35, 339–361. doi: 10.2165/00007256-200535040-00004
Kraemer, W. J., Staron, R. S., Hagerman, F. C., Hikida, R. S., Fry, A. C., Gordon, S. E., et al. (1998). The effects of short-term resistance training on endocrine function in men and women. Eur. J. Appl. Physiol. Occup. Physiol. 78, 69–76. doi: 10.1007/s004210050389
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Loannidis, J. P. A., et al. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 6:e1000100. doi: 10.1371/journal.pmed.1000100
Mangine, G., Van Dusseldorp, T., Feito, Y., Holmes, A., Serafini, P., Box, A., et al. (2018). Testosterone and cortisol responses to five high-intensity functional training competition workouts in recreationally active adults. Sports 6:62. doi: 10.3390/sports6030062
Mangine, G. T., Kliszczewicz, B. M., Boone, J. B., Williamson-Reisdorph, C. M., and Bechke, E. E. (2019). Pre-anticipatory anxiety and autonomic nervous system response to two unique fitness competition workouts. Sports 7, 199–212. doi: 10.3390/sports7090199
Maté-Muñoz, J. L., Lougedo, J. H., Barba, M., Cañuelo-Márquez, A. M., Guodemar-Pérez, J., García-Fernández, P., et al. (2018). Cardiometabolic and muscular fatigue responses to different CrossFit® workouts. J. Sports Sci. Med. 17, 668–679.
Maté-Muñoz, J. L., Lougedo, J. H., Barba, M., García-Fernández, P., Garnacho-Castano, M. V., and Dominguez, R. (2017). Muscular fatigue in response to different modalities of CrossFit sessions. PLoS ONE 12:e0181855. doi: 10.1371/journal.pone.0181855
Meyer, M., Sundaram, S., and Schafhalter-Zoppoth, I. (2017). Exertional and CrossFit-induced rhabdomyolysis. Clin. J. Sport Med. 28, e92–e94. doi: 10.1097/JSM.0000000000000480
Michnik, A., Sadowska-Krepa, E., Domaszewski, P., Duch, K., and Pokora, I. (2017). Blood serum DSC analysis of well-trained men response to CrossFit training and green tea extract supplementation. J. Therm. Anal. Calorim. 130, 1253–1262. doi: 10.1007/s10973-017-6346-9
Murawska-Cialowicz, E., Wojna, J., and Zuwala-Jagiello, J. (2015). CrossFit training changes brain-derived neurotrophic factor and irisin levels at rest, after wingate and progressive tests, and improves aerobic capacity and body composition of young physically active men and women. J. Physiol. Pharmacol. 66, 811–821.
Nadaf, M., Lee, J. K., and Yang, J. H. (2018). CrossFit-induced rhabdomyolysis: a case report. Arthrosc. Orthop. Sports Med. 5, 29–31. doi: 10.14517/aosm17015
Nieman, D. C., Davis, J. M., Henson, D. A., Walberg-Rankin, J., Shute, M., Dumke, C. L., et al. (2003). Carbohydrate ingestion influences skeletal muscle cytokine mRNA and plasma cytokine levels after a 3-h run. J. Appl. Physiol. 94, 1917–1925. doi: 10.1152/japplphysiol.01130.2002
Nuuttila, O. P., Nikander, A., Polomoshnov, D., Laukkanen, J. A., and Häkkinen, K. (2017). Effects of HRV-guided vs. predetermined block training on performance, HRV and serum hormones. Int. J. Sports Med. 38, 909–920. doi: 10.1055/s-0043-115122
Perciavalle, V., Marchetta, N. S., Giustiniani, S., Borbone, C., Perciavalle, V., Petralia, M. C., et al. (2016). Attentive processes, blood lactate and CrossFit®. Phys. Sports Med. 44, 403–406. doi: 10.1080/00913847.2016.1222852
Petersen, A. M. W., and Pedersen, B. K. (2005). The anti-inflammatory effect of exercise. J. Appl. Physiol. 98, 1154–1162. doi: 10.1152/japplphysiol.00164.2004
Pettersson, J., Hindorf, U., Persson, P., Bengtsson, T., Malmqvist, U., et al. (2008). Muscular exercise can cause highly pathological liver function tests in healthy men. Br. J. Clin. Pharmacol. 65, 253–259. doi: 10.1111/j.1365-2125.2007.03001.x
Poderoso, R., Cirilo-Sousa, M., Júnior, A., Novaes, J., Vianna, J., Dias, M., et al. (2019). Gender differences in chronic hormonal and immunological responses to CrossFit®. Int. J. Environ. Res. Public Health 16:2577. doi: 10.3390/ijerph16142577
Shaw, S. B., Dullabh, M., Forbes, G., Brandkamp, J. L., and Shaw, I. (2015). Analysis of physiological determinants during a single bout of Crossfit. Int. J. Perf. Anal. Sport 15, 809–815. doi: 10.1080/24748668.2015.11868832
Silveira, L. S., Antunes, B. de M. M., Minari, A. L. A., dos Santos, R. V. T., Neto, J. C. R., and Lira, F. S. (2016). Macrophage polarization: implications on metabolic diseases and the role of exercise. Crit. Rev. Eukaryot. Gene Expr. 26, 115–132. doi: 10.1615/CritRevEukaryotGeneExpr.2016015920
Spada, T. C., Silva, J. M., Francisco, L. S., Marçal, L. J., Antonangelo, L., Zanetta, D. M., et al. (2018). High intensity resistance training causes muscle damage and increases biomarkers of acute kidney injury in healthy individuals. PLoS ONE 13:e0205791. doi: 10.1371/journal.pone.0205791
Suzuki, K., Tominaga, T., Ruhee, R. T., and Ma, S. (2020). Characterization and modulation of systemic inflammatory response to exhaustive exercise in relation to oxidative stress. Antioxidants 9:E401. doi: 10.3390/antiox9050401
Tibana, R., de Sousa, N., Prestes, J., and Voltarelli, F. (2018). Lactate, heart rate and rating of perceived exertion responses to shorter and longer duration CrossFit® training sessions. J. Funct. Morphol. Kinesiol. 3:60. doi: 10.3390/jfmk3040060
Tibana, R. A., de Almeida, L. M., Frade de Sousa, N. M., Nascimento, D. D. C., Neto, I. V., de Almeida, J. A., et al. (2016). Two consecutive days of extreme conditioning program training affects pro and anti-inflammatory cytokines and osteoprotegerin without impairments in muscle power. Front. Physiol. 7:260. doi: 10.3389/fphys.2016.00260
Tibana, R. A., Manuel Frade de Sousa, N., Prestes, J., da Cunha Nascimento, D., Ernesto, C., Falk Neto, J. H., et al. (2019b). Is perceived exertion a useful indicator of the metabolic and cardiovascular responses to a metabolic conditioning session of functional fitness? Sports 7, 161–172. doi: 10.3390/sports7070161
Tibana, R. A., Prestes, J., Sousa, N. F., de Souza, V. C., Nóbrega, O. D. T., Baffi, M., et al. (2019a). Time-course of changes in physiological, psychological and performance markers following a functional-fitness competition. Int. J. Exerc. Sci. 12, 904–918.
Timón, R., Olcina, G., Camacho-Cardeñosa, M., Camacho-Cardenosa, A., Martinez-Guardado, I., and Marcos-Serrano, M. (2019). 48-hour recovery of biochemical parameters and physical performance after two modalities of CrossFit workouts. Biol. Sport 36, 283–289. doi: 10.5114/biolsport.2019.85458
Keywords: CrossFit, high-intensity functional training, metabolism, physical functional performance, physiology
Citation: Jacob N, Novaes JS, Behm DG, Vieira JG, Dias MR and Vianna JM (2020) Characterization of Hormonal, Metabolic, and Inflammatory Responses in CrossFit® Training: A Systematic Review. Front. Physiol. 11:1001. doi: 10.3389/fphys.2020.01001
Received: 16 March 2020; Accepted: 23 July 2020;
Published: 28 August 2020.
Edited by:
Katsuhiko Suzuki, Waseda University, JapanReviewed by:
Yuri Feito, Kennesaw State University, United StatesKatsuji Aizawa, Senshu University, Japan
Copyright © 2020 Jacob, Novaes, Behm, Vieira, Dias and Vianna. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Marcelo R. Dias, ZGlhc21yJiN4MDAwNDA7Z21haWwuY29t