- 1Department of Animal Science, Veterinary College, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
- 2Department of Veterinary Clinics and Surgery, Veterinary College, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
This study's objective was to determine the effects of caffeine intake at various levels, incorporated in the layers' food, on performance and egg quality of hens. A total of 576 hens, aged 56 weeks, were used. The layers were fed rations containing 0 (control), 150, 300, or 450 ppm of caffeine for 12 weeks. During the experimental period, performance parameters (weight, feed consumption, and livability) and egg production and quality (weight, Haugh unit, percentages of yolk, albumen and eggshell, yolk color, eggshell thickness, and resistance, and calcium and phosphorus eggshell contents) were evaluated. The highest concentration of caffeine in the diet (450 ppm) promoted a significant increase in the mortality of hens (1.45% per week) compared to controls (0.23%). There was a reduction in feed consumption by hens, decreased egg production, and reduced eggshell thickness and percentage, with the increase of caffeine. The egg yolk percentage was increased, and the eggshell percentage was reduced in the groups treated with 300 and 450 ppm of caffeine. Furthermore, reduced eggshell thickness was found in all groups that received caffeine. However, it was found that 150 ppm of caffeine in the food did not cause significant changes in most egg production and quality parameters. In summary, caffeine consumption by laying hens increased mortality rate and promoted deleterious effects on chicken production and egg quality at concentrations of 300 and 450 ppm.
Background
Caffeine (1,3,7-trimethylxanthine) is a purine alkaloid synthesized using xanthosine formed from purine nucleotides (1). This compound is a known antagonist of adenosine A1, A2A, and A2B receptors in the central nervous system and peripheral tissues (2). Caffeine is found in plants such as coffee (Coffea spp.), tea plant (Camellia sinensis), cola (Cola nitida), cocoa (Theobroma cacao), maté (Ilex paraguariensis), and guaraná (Paullinia cupana) (1). Thus, humans regularly consume caffeine through the food and beverages derived from these plants; and in this process, large amounts of by-products are generated. These by-products can be used in animal feed, such as coffee husks (3), cocoa bean shell (4, 5), and green tea powder (6, 7). Due to the energy levels required by laying hens, fiber sources are essential, and they are being increasingly studied to improve their welfare due to changes in the speed of passage of food in the gastrointestinal tract and consequent reduction in mortality from cannibalism and to reduce the cost of feed (3). Wheat bran is the most used fiber source, but it has achieved high prices in tropical countries, and alternative fiber sources have been used.
Coffee husks contain high levels of fiber, and the concentration of crude proteins ranges from 6.9 to 12% (3, 8, 9). Coffee husks have been used as a component of food for animal species, including laying hens (3), pigs (10), sheep (8), and calves (9). Cocoa bean shells were found to contain 6.78–13.63% of crude protein and 12.75–33.0% of crude fiber (4, 5), and have been used for feeding a wide variety of livestock species (11). The addition of green tea powder to hens' food aims to improve egg nutritional quality by increasing vitamin E levels and reducing cholesterol and crude fat (7). The amount of caffeine in the fresh coffee husk is about 10.0 mg/g (12), from 1.59 to 4.21 mg/g in cocoa bean shells (13), and about 25.9 mg/g in green tea powder (7).
The quality of eggs produced was negatively affected in laying hens fed with by-products of caffeine-containing plants, such as coffee husks (3), cocoa bean shell (4), and green tea powder (6, 7). The adverse effects observed in egg production may be promoted by caffeine. However, no studies in the literature evaluated the effects of pure caffeine on egg quality, the performance of laying hens, and the safety of caffeine consumption.
Thus, the aim of this study was to determine the effects of caffeine intake (incorporated into hen feed at various levels) on the egg production and performance of laying hens. Our hypothesis is that caffeine consumption by laying hens might interfere with egg production and quality in a dose-dependent way. The generated data is useful for determining the amount of caffeine-containing plant by-products that could be used as feed ingredients, without affecting the health and performance of laying hens.
Materials and Methods
Animals
The experiment was conducted at the Experimental Farm “Prof. Hélio Barbosa” of the Veterinary School, Federal University of Minas Gerais (UFMG), located in the municipality of Igarapé, MG, Brazil. The Animal Use Ethics Committee of UFMG (protocol # 28/2018) approved all procedures described in this study. The possibility of animal death without euthanasia was stated in the study protocol submitted to the animal ethics committee because the expected mortality rate of laying hens ranges from 0.8 to 1.5% per week (14).
A total of 576 Lohmann LSL® laying hens aged 56 weeks were used. The hens were housed in a conventional, non-climatized laying house, equipped with cages at a density of 333 cm2/hen, with six hens per cage. Animal partitions were isolated by a wood splitter, preventing hens from accessing the feed from another partition. All hens were included in the experiment on the same date. Feeding was performed daily, and egg collection occurred four times a day. The light program used was 14 h of light/day, with 12 h of natural light and 2 h of artificial light (1 h of artificial light at dawn and 1 h in the early evening).
Experimental Design
The hens were distributed in 24 experimental plots for 12 experimental weeks, 1 week after dietary standardization. The hens selected for the experiment had weight uniformity. The experimental design was completely randomized of four treatments with three different amounts of caffeine (anhydrous caffeine, Sulfal, Belo Horizonte, MG, Brazil) per ton of feed: 0 (control), 150, 300, and 450 g/ton. The highest concentration was based in an earlier study that showed impaired egg production by laying hens fed coffee husks at 42.5 g/kg (3), that is expected to contain caffeine at ~10.0 mg/g (12), equal to 425 g of caffeine/ton of feed. Ingredients and nutritional composition of the basal diet are shown in Table 1. Hens received water and feed ad libitum.
Bodyweight was determined on the first and last days of the experimental period, and all hens from each partition were weighed together. Egg production was recorded daily; egg production per housed hen, and the percentage of weekly and total laying were calculated. Feed intake was determined weekly. Feed conversion was obtained by the ratio of the total feed consumed by the hens of each partition to the total weight of eggs laid in the same period (kg feed/kg eggs). The animals were monitored daily, and the number of hens was recorded daily to determine the mortality rate. All the research staff was previously trained for adequate animal care and handling.
Analysis of Eggs
Eggs were collected after experimental periods of 3, 7, and 12 weeks, when the hens were 59, 63, and 68 weeks old, respectively. All eggs produced on these days were identified and weighed. Four eggs per repetition were randomly separated for assessments of egg quality. Evaluated parameters were weight, Haugh unit (HU), percentages of yolk, albumen and eggshell, yolk color, eggshell thickness and resistance, and eggshell calcium and phosphorus content.
HU was determined using a HU measuring device (Ames model S-8400, Massachusetts, USA). The calculation of HU was based on albumen height (H) and egg weight (W), as follows: HU = 100 log10 (H – 1.7 W0.37 + 7.56) (15). Percentages of yolk, albumen, and eggshell were determined by the methods described by Wu et al. (16). The yolk color score was determined immediately after the egg was broken, comparing the color of the yolk to a color fan (DSM Yolk Color Fan, 2005—HMB 51548, Basel, Switzerland). The same evaluator performed all measurements of the yolk color score in the same location.
Eggshell thickness was measured using a digital micrometer (Ames, Massachusetts, USA), with an accuracy of 0.001 mm, in three distinct regions of the shell (apical, equatorial, and basal); results were obtained by the average of measures of the three regions. Eggshell resistance was measured through the compression eggshell fracture force test, using a texture analyzer (TA-XT2, Stable Micro Systems, Surrey, England), as described by Carvalho et al. (17). Calcium and phosphorus eggshell contents were pretreated following the method described by the Brazilian Compendium of Animal Nutrition (18).
Statistical Analysis
For the performance evaluations, the experimental design was entirely randomized (DIC), consisting of four treatments and six partitions with 24 hens in each.
For egg quality analysis, the experimental design was completely randomized, consisting of four treatments and 24 eggs per treatment, each egg being considered a repetition. For analysis of shell resistance, different eggs from the previously mentioned analysis (new sample collected) were used, likewise four eggs per repetition at 24 eggs per treatment with each egg being considered a repetition.
The results are presented as mean ± SEM. The data were analyzed with the aid of the SAS program and subjected to analysis of variance (ANOVA) to verify the significant effects between the simple factors; subsequently, a regression test between the treatments was performed. Additionally, ANOVA followed by Tukey test, and Kruskal-Wallis test followed by Student-Newman-Keuls were performed. The level of statistical significance was set at p < 0.05.
Results
The body weights on the last day of the experiment were significantly lower (p < 0.001) in groups fed 300 and 450 ppm of caffeine than in controls (Table 2). The body weight gain was lower (p < 0.001) in all groups that received caffeine than control group, but the feed consumption in the entire experimental period was impaired (p < 0.001) only in hens fed the largest dose of caffeine.
Table 2. Initial and final body weight (in kg), body weight gain (in kg), and feed consumption (in g/day) of laying hens fed rations containing different concentrations of caffeine for 12 weeks.
The number of hens that died during the experimental period was 4, 7, 12, and 25 in groups fed 0 (control), 150, 300, and 450 ppm of caffeine, respectively. All these hens were found dead without showing any noticeable sign of disease or pain, and the exact cause of death could not be determined. The log-rank test showed a significant difference (p < 0.0001) in mortality between the control and 450 ppm groups. However, there was no significant difference between the control group and the 150 ppm (p = 0.527) or the 300 ppm (p = 0.065) groups.
Both egg production and number of eggs per housed hen (Table 3) were significantly (p < 0.05) lower values in hens that consumed the highest concentration of caffeine in the diet. Feed conversion was worse in hens fed 450 ppm of caffeine vs. the control group.
Table 3. Number and percentage of produced eggs per laying hen and feed conversion in eggs (in g/egg) of hens fed rations containing different concentrations of caffeine for 12 weeks.
The average egg weight (Table 4) was reduced (p < 0.05) only in the group that received the highest caffeine dosage at 12 weeks of the experimental period. The HU (Table 5) showed higher values in eggs from hens fed all concentrations of caffeine vs. eggs from the control group after 12 weeks.
Table 4. Weight of the eggs (in g) produced by laying hens fed rations containing different concentrations of caffeine for 12 weeks.
Table 5. Haugh units of the eggs produced by laying hens fed rations containing different concentrations of caffeine for 12 weeks.
The percentages of egg components (yolk, albumen, and eggshell) of the produced eggs are shown in Table 6. Consumption of 300 and 450 ppm of caffeine in the diet increased the egg yolk percentage after 12 weeks of the experiment. Also, caffeine intake was responsible for reducing the eggshell percentage at all evaluations. On the other hand, the albumen percentage was not affected.
Table 6. Percentages of yolk, albumen, and eggshell of the eggs produced by laying hens fed rations containing different concentrations of caffeine for 12 weeks.
Thickness and strength of the eggshell and the yolk color score are presented in Table 7. At all concentrations, caffeine intake was responsible for lower (p < 0.05) eggshell thickness at all evaluated periods. However, caffeine reduced (p < 0.05) the strength of the eggshell after 4 weeks of the experiment, but there was no significant difference at later periods. Furthermore, there was interference (p < 0.05) in the yolk color score of eggs from laying hens exposed to caffeine after 8 and 12 weeks of the experimental period.
Table 7. Thickness and strength of the eggshell and the yolk color score of the eggs produced by laying hens fed rations containing different concentrations of caffeine for 12 weeks.
Discussion
Feed consumption was impaired in hens from the 450 ppm caffeine group. Caffeine might interfere with appetite, reducing energy intake (19, 20). However, the mechanism underlying this effect is still unclear. Furthermore, ingesting caffeine increases corporal energy consumption. Caffeine was found to increase the serum release of catecholamines (epinephrine, norepinephrine, and dopamine) (21) and the oxidation of lipids (22, 23).
The group fed 450 ppm caffeine showed an increased mortality rate, with a mortality rate of 1.45% per week, whereas the mortality rates of hens fed 0, 150, and 300 ppm caffeine were 0.23, 0.41, and 0.69%, respectively. The acceptable mortality rate for caged laying hens is up to 1.2% per week (14), then the group fed 450 ppm caffeine was the only one showing a high mortality rate. Increased mortality rates were also observed in broiler chicks that received caffeine. These chicks developed pulmonary hypertension syndrome or ascites, with right ventricular hypertrophy and an increased hematocrit (24). Furthermore, the stimulating effect of caffeine may induce the observed reduced feed consumption, generating an energy and protein deficit. Also, caffeine interferes with the proper function of the immune system (25, 26), which may have increased the susceptibility of hen chickens to infections.
The quality of produced eggs was negatively affected by feeding laying hens with by-products of caffeine-containing plants, such as coffee husks (3), cocoa bean shell (4), and green tea powder (6, 7). In this study, caffeine ingestion negatively affected the production and quality of eggs. The egg production per hen was reduced in those fed rations containing 300 or 450 ppm of caffeine. The egg weight was also reduced in the groups that consumed the diet containing the highest amount of caffeine after 12 weeks. Additionally, after 12 weeks, the percentage of yolk and the yolk color score increased in groups treated with 300 and 450 ppm of caffeine, and the HU was augmented in all groups that received caffeine. The reduced egg weight and increased yolk percentage, yolk color score, and HU are probable consequences of the eggs' lower water content.
The interference of caffeine with egg production can be attributed to the observed reduction in feed consumption that could, in turn, generate an energy and protein deficit. Another hypothesis is that caffeine might interfere directly with ovarian physiology. In a previous study, female rats fed caffeine showed increased ovarian production of estradiol and delayed vaginal opening (27). Furthermore, several studies evaluating women showed the consumption of coffee and other caffeinated beverages was linked to a longer delay before becoming pregnant. This observed effect was proportional to the number of ingested beverages (28–30), but there is no consensus that caffeine promotes this effect (31).
Another effect of caffeine observed in the present study was the harmful interference with the eggshell, characterized by the reduced thickness and shell percentage at all evaluations. These effects were also observed in laying hens fed rations containing 4.25% of coffee husk (3). The reduced thickness and percentage of eggshell may be attributed to caffeine interference on calcium metabolism due to increased urinary excretion of calcium and magnesium (32, 33). Caffeine may promote hypocalcemia due to an increased compensatory bone resorption rate and reduce bone mineral density in laboratory animals (34). In humans, caffeine intake at high doses increases the risk of developing osteopenia and osteoporosis (35) and, consequently, augments the possibility of fractures (36). Thus, it is feasible to suppose that caffeine ingestion raised the urinary calcium excretion of laying hens, resulting in a smaller amount of this mineral available for eggshell formation.
Conclusions
The present study reveals that caffeine consumption by laying hens increased the mortality rate and promoted deleterious effects on hen performance and egg quality when its concentration in the diet was 300 or 450 ppm. Consumption of up to 150 ppm of caffeine in the diet did not significantly interfere in hens or egg production. This concentration of caffeine in the diet is equivalent to ~15 kg of coffee husk, 35.6 kg of cocoa bean shell, and 5.7 kg of green tea powder per ton of feed, considering that the caffeine content in these compounds is ~10.0 mg/g (12), 4.21 mg/g (13), and 25.9 mg/g (7), respectively. However, doses above this value may have undesirable consequences on egg production and quality.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
This animal study was reviewed and approved by Animal Use Ethics Committee of the Universidade Federal de Minas Gerais—UFMG.
Author Contributions
BS-B and LL conceived and designed the experiments. MST, MVT, and TC performed the experiments. BS-B, LL, and MST analyzed the data. BS-B and MST drafted the manuscript. All authors read and approved the final manuscript.
Funding
This work was supported by the grant of the Conselho Nacional de Desenvolvimento Científico e Tecnológico—CNPq (grant #311182/2017-8).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1. Ashihara H, Crozier A. Caffeine: a well known but little mentioned compound in plant science. Trends Plant Sci. (2001) 6:407–13. doi: 10.1016/S1360-1385(01)02055-6
2. Fredholm BB, Yang J, Wang Y. Low, but not high, dose caffeine is a readily available probe for adenosine actions. Mol Aspects Med. (2017) 55:20–5. doi: 10.1016/j.mam.2016.11.011
3. Sousa LS, Carvalho TSM, Nogueira FA, Saldanha MM, Vaz DP, Bertechini AG, et al. Fiber source and xylanase on performance, egg quality, and gastrointestinal tract of laying hens. Rev Bras Zootec. (2019) 48:e20170286. doi: 10.1590/rbz4820170286
4. Olubamiwa O, Ikyo SM, Adebowale BA, Omojola AB, Hamzat RA. Effect of boiling time on the utilization of cocoa bean shell in laying hen feeds. Int J Poult Sci. (2006) 5:1137–9. doi: 10.3923/ijps.2006.1137.1139
5. Emiola IA, Ojebiyi OO, Akande TO. Performance and organ weights of laying hens fed diets containing graded levels of sun-dried cocoa bean shell (CBS). Int J Poult Sci. (2011) 10:987–90. doi: 10.3923/ijps.2011.987.990
6. Kojima S, Yoshida Y. Effects of green tea powder feed supplement on performance of hens in the late stage of laying. Int J Poult Sci. (2008) 7:491–6. doi: 10.3923/ijps.2008.491.496
7. Xia B, Liu Y, Sun D, Liu J, Zhu Y, Lu L. Effects of green tea powder supplementation on egg production and egg quality in laying hens. J Appl Anim Res. (2018) 46:927–31. doi: 10.1080/09712119.2018.1431240
8. Souza AL, Garcia R, Bernardino FS, Rocha FC, Valadares Filho SC, Pereira OG, et al. Casca de café em dietas de carneiros: consumo e digestibilidade. Rev Bras Zootec. (2004) 33:2170–6. doi: 10.1590/S1516-35982004000800030
9. Souza AL, Garcia R, Bernardino FS, Campos JMS, Valadares Filho SC, Cabral LS, et al. Casca de café em dietas para novilhas leiteiras: consumo, digestibilidade e desempenho. Rev Bras Zootec. (2006) 35:921–7. doi: 10.1590/S1516-35982006000300039
10. Parra ARP, Moreira I, Furlan AC, Paiano D, Scherer C, Carvalho PLO. Utilização da casca de café na alimentação de suínos nas fases de crescimento e terminação. Rev Bras Zootec. (2008) 37:433–42. doi: 10.1590/S1516-35982008000300008
11. Panak Balentić J, Ačkar ðD, Jokić S, Jozinović A, Babić J, Miličević B, et al. Cocoa shell: a by-product with great potential for wide application. Molecules. (2018) 23:1404. doi: 10.3390/molecules23061404
12. Murthy PS, Naidu MM. Sustainable management of coffee industry by-products and value addition—a review. Resour Conserv Recycl. (2012) 66:45–58. doi: 10.1016/j.resconrec.2012.06.005
13. Barbosa-Pereira L, Guglielmetti A, Zeppa G. Pulsed electric field assisted extraction of bioactive compounds from cocoa bean shell and coffee silverskin. Food Bioproc Technol. (2018) 11:818–35. doi: 10.1007/s11947-017-2045-6
14. Pereira DF, Vale MM, Zevolli BR, Salgado DD. Estimating mortality in laying hens as the environmental temperature increases. Rev Bras Cienc Avic. (2010) 12:265–71. doi: 10.1590/S1516-635X2010000400008
15. Brant AW, Otte WA, Norris KH. Recommend standards for scoring and measuring opened egg quality. Food Technol. (1951) 5:356–61.
16. Wu G, Bryant MM, Voitle RA, Roland DA. Effect of dietary energy on performance and egg composition of Bovans White and Dekalb White hens during phase I. Poult Sci. (2005) 84:1610–5. doi: 10.1093/ps/84.10.1610
17. Carvalho TSM, Sousa LS, Nogueira FA, Vaz DP, Saldanha MM, Triginelli MV, et al. Digestible methionine+cysteine in the diet of commercial layers and its influence on the performance, quality, and amino acid profile of eggs and economic evaluation. Poult Sci. (2018) 97:2044–52. doi: 10.3382/ps/pey036
18. Sindicato Nacional da Indústria de Alimentação Animal. Compêndio Brasileiro de Alimentação Animal. 4th ed. Sindirações: São Paulo (2013).
19. Bakuradze T, Parra GAM, Riedel A, Somoza V, Lang R, Dieminger N, et al. Four-week coffee consumption affects energy intake, satiety regulation, body fat, and protects DNA integrity. Food Res Int. (2014) 63:420–7. doi: 10.1016/j.foodres.2014.05.032
20. Schubert MM, Irwin C, Seay RF, Clarke HE, Allegro D, Desbrow B. Caffeine, coffee, and appetite control: a review. Int J Food Sci Nutr. (2017) 68:901–12. doi: 10.1080/09637486.2017.1320537
21. Kobayashi-Hattori K, Mogi A, Matsumoto Y, Takita T. Effect of caffeine on the body fat and lipid metabolism of rats fed on a high-fat diet. Biosci Biotechnol Biochem. (2005) 69:2219–23. doi: 10.1271/bbb.69.2219
22. Bracco D, Ferrarra JM, Arnaud MJ, Jéquier E, Schutz Y. Effects of caffeine on energy metabolism, heart rate, and methylxanthine metabolism in lean and obese women. Am J Physiol. (1995) 269:E671–8. doi: 10.1152/ajpendo.1995.269.4.E671
23. Velickovic K, Wayne D, Leija HAL, Bloor I, Morris DE, Law J, et al. Caffeine exposure induces browning features in adipose tissue in vitro and in vivo. Sci Rep. (2019) 9:9104. doi: 10.1038/s41598-019-45540-1
24. Kamely M, Torshizi MA, Rahimi S, Wideman RF. Caffeine causes pulmonary hypertension syndrome (ascites) in broilers. J Anim Sci. (2016) 94:1493–500. doi: 10.2527/jas.2015-0152
25. Steck RP, Hill SL, Weagel EG, Weber KS, Robison RA, O'Neill KL. Pharmacologic immunosuppression of mononuclear phagocyte phagocytosis by caffeine. Pharmacol Res Perspect. (2015) 25:e00180. doi: 10.1002/prp2.180
26. Al Reef T, Ghanem E. Caffeine: well-known as psychotropic substance, but little as immunomodulator. Immunobiology. (2018) 223:818–25. doi: 10.1016/j.imbio.2018.08.011
27. Kwak Y, Choi H, Bae J, Choi YY, Roh J. Peri-pubertal high caffeine exposure increases ovarian estradiol production in immature rats. Reprod Toxicol. (2017) 69:43–52. doi: 10.1016/j.reprotox.2017.01.007
28. Wilcox A, Weinberg C, Baird D. Caffeinated beverages and decreased fertility. Lancet. (1988) 2:1453–6. doi: 10.1016/S0140-6736(88)90933-6
29. Stanton KC, Gray RH. Effects of caffeine consumption on delayed conception. Am J Epidemiol. (1995) 142:1322–9. doi: 10.1093/oxfordjournals.aje.a117600
30. Hatch EE, Wise LA, Mikkelsen EM, Christensen T, Riis AH, Sørensen HT, et al. Caffeinated beverage and soda consumption and time to pregnancy. Epidemiology. (2012) 23:393–401. doi: 10.1097/EDE.0b013e31824cbaac
31. Gaskins AJ, Chavarro JE. Diet and fertility: a review. Am J Obstet Gynecol. (2018) 218:379–89. doi: 10.1016/j.ajog.2017.08.010
32. Heaney RP, Rafferty K. Carbonated beverages and urinary calcium excretion. Am J Clin Nutr. (2001) 74:343–7. doi: 10.1093/ajcn/74.3.343
33. Massey LK, Sutton RA. Acute caffeine effects on urine composition and calcium kidney stone risk in calcium stone formers. J Urol. (2004) 172:555–8. doi: 10.1097/01.ju.0000129413.87024.5c
34. Heaney RP. Effects of caffeine on bone and the calcium economy. Food Chem Toxicol. (2002) 40:1263–70. doi: 10.1016/S0278-6915(02)00094-7
35. Ibrahim NA, Nabil N, Ghaleb S. Pathophysiology of the risk factors associated with osteoporosis and their correlation to the T-score value in patients with osteopenia and osteoporosis in the United Arab Emirates. J Pharm Bioallied Sci. (2019) 11:364–72. doi: 10.4103/jpbs.JPBS_4_19
Keywords: caffeine, coffee husks, chicken, eggs, laying hens
Citation: Teixeira MdS, Triginelli MV, Costa TdA, Lara LJC and Soto-Blanco B (2020) Effects of Caffeine on Egg Quality and Performance of Laying Hens. Front. Vet. Sci. 7:545359. doi: 10.3389/fvets.2020.545359
Received: 24 March 2020; Accepted: 26 August 2020;
Published: 25 September 2020.
Edited by:
Javiera Cornejo Kelly, University of Chile, ChileReviewed by:
Cengiz Gokbulut, Balikesir University, TurkeyBegum Yurdakok Dikmen, Ankara University, Turkey
Mohamed E. Abd El-Hack, Zagazig University, Egypt
Vincenzo Tufarelli, University of Bari Aldo Moro, Italy
Copyright © 2020 Teixeira, Triginelli, Costa, Lara and Soto-Blanco. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Benito Soto-Blanco, benito@ufmg.br