Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 26 October 2020
Sec. Public Mental Health
This article is part of the Research Topic Outbreak Investigation: Mental Health in the Time of Coronavirus (COVID-19) View all 53 articles

Self-Perceived Stress During the Quarantine of COVID-19 Pandemic in Paraguay: An Exploratory Survey

  • 1Department of Psychiatry, School of Medical Sciences, National University of Asunción, San Lorenzo, Paraguay
  • 2Research Department, School of Medical Sciences, National University of Caaguazú, Coronel Oviedo, Paraguay
  • 3Department of Neuroscience, Medical School, Fundação do ABC, Santo André, Brazil
  • 4Department of Psychiatry, Medical School, University of São Paulo, São Paulo, Brazil
  • 5Department of Clinical and Experimental Medicine, University of Foggia, Foggia, Italy

Introduction: Any viral pandemic is a global health and mental health issue. The World Health Organization and mental health associations have warned that the current COVID-19 pandemic will lead to a drastic increase of stress-related conditions and mental health issues globally.

Materials and Methods: An online web-based survey has been launched from 10 to 15 April 2020 in Paraguay in order to collect information regarding the stress related to the quarantine during the COVID-19 pandemic. It has been spread through social media (“WhatsApp,” “Twitter,” and “Facebook”). Two thousand two hundred and six Paraguayan citizens, over 18 years of age, completed the survey voluntarily. Socio-demographics as well as ratings at Self-perceived Stress Scale have been collected and analyzed.

Results: Two thousand two hundred and six subjects (74.12% men) aged between 18 and 75 with an average of 34 ± 11 years old completed the survey. 12.42% (276 subjects) of sample reported a preexisting diagnosis of mental disorder, and 175 participants (7.93%) reported an increase of preexisting symptoms with the onset of COVID-19 quarantine. 41.97% of them had anxiety and 54.38% did not receive any specific treatment. The general population rated 18.10 ± 5.99 at Self-perceived Stress Scale, which indicates a moderate level of self-perceived stress. Significant association was found between higher levels of stress and female sex, being single, or reporting preexisting mental disorder, above all anxiety and depression (p < 0.01). In fact, in 63.87% of mentally ill subjects (n = 175), the quarantine has worsened symptoms of preexisting mental disorders.

Conclusion: This study suggests a stressful impact of COVID-19 pandemic, with the majority of participants reporting a moderate level of self-perceived stress. We suggest mental health services to provide a phone-based or web-based support to the general population in order to contrast the psychological impact of the pandemic. This approach may improve the accessibility to mental healthcare services in Paraguay, especially in times of social distancing.

Introduction

Any viral pandemic is a global health and mental health issue (1). The impact of a pandemic outbreak on the global health relies on the characteristics of the virus, evidence of rapid human-to-human transmission, the severity of the resulting disease, and the medical and non-medical resources available to control the impact of the virus (e.g., vaccines, treatment drugs, isolation protocols, economic resources to support the lockdown, etc.) (2). The Coronavirus SARS-CoV-2, causing the COVID-19 disease, has spread rapidly through several countries worldwide leading to a pandemic in March 2020 as recognized by the World Health Organization (WHO) (3, 4). In Paraguay, cases of infection have increased sharply in a few days as in the rest of the world (5). It has been argued that feelings of fear, uncertainty, loneliness as well as stress, anxiety, and depression have been reported in the general population worldwide after the outbreak of COVID-19 (6). Also, four potential stages of psychological response to the pandemic have been proposed: stress and fear, anxiety and panic, anger and denial, acceptance, and resolution (68). Also, isolation, quarantine and social distancing had a relevant impact on the subjective well-being and level of personal stress (8).

The World Health Organization as well as the international mental health associations have warned that the current COVID-19 pandemic will lead to a drastic increase of stress-related conditions and mental health issues globally (9). In fact, emerging reports have been documenting an increase of stress-related symptoms, anxiety and depression especially among vulnerable populations such as socially and economically disadvantaged people, chronically, and mentally ill populations (10, 11). Also, this condition may add severity to negative prognoses of physical as well as mental diseases with adjunctive difficulty in accessing health services (9, 12). For these reasons, psychological support and crisis interventions should be promoted to contrast the effects of the pandemic (10). Psychological support should be offered to vulnerable subjects, healthcare workers as well as to general population. Moreover, advices to the general population on how to cope with subjective stress during the pandemic may be helpful (10). Measures of stress in the epidemiological research may include three components: (a) environmental, including stressful life events; (b) psychological, which involves subjective experience and emotional response to stressors; and, (c) biomedical, which comprises the physiological systems involved in coping the stressful stimuli (13).

This survey aimed to investigate the level of stress perceived by the general population during the current COVID-19 global pandemic and quarantine in Paraguay (14). We expected to reveal a significant self-reported subjective stress on a large scale, above all among people reporting preexisting mental health problems. We employed The Perceived Stress Scale (PSS), a well-known and validated tool, originally developed in 1983, which scores the level of subjective perceived stress (e.g., feelings and thoughts; psychological component) related to conditions and stressful life events occurred in the last month (environmental component) Also, factors associated to higher perceived stress have been described.

Materials and Methods

This was an observational, cross-sectional study, based on an online survey launched from 10 to 15 April 2020, one month after the implementation of preventive actions (quarantine) according to the Decree 3442/20 of the Presidency of the Republic of Paraguay (15). Two thousand two hundred and six Paraguayan citizens, of both sexes, over 18 years of age, voluntarily completed the survey, nationally spread through social media (“WhatsApp,” “Twitter,” and “Facebook”). All participants received complete information about the aim of the study, privacy and data—processing. No payment has been foreseen for completing the survey.

The Spanish version of the Perceived Stress Scale-10 (EEP-10), as used by Remor in a validation-study with adults in Spain (16), has been employed in this study. This rating scale measures the perception of psychological stress during the last month, and reports on situations of daily life which are considered as stressful (specified as the outbreak of COVID-19 and quarantine in this survey). Also, it explores the level of stress experienced over the last month on a 5-point scale (0–never, 1 = almost never, 2 = once in a while, 3 = often, 4 = very often). Six of the 10 items are worded and scored in the non-reversed direction (i.e., “how often have you felt that you were unable to control the important things in your life”). Four of the 10 items are worded and scored in the reversed direction (i.e., “how often have you felt that things were going your way”) (17). The scale is easily understandable by the general population, independently of education level. Also, this scale shows an adequate reliability (α = 0.82, test-retest, r = 0.77), validity, and sensitivity (16).

The scale total score ranges from 0 to 40. Scores ranging from 0–13 would be considered as low self-perceived stress. Scores ranging from 14–26 would be considered as moderate self-perceived stress. Finally, scores ranging from 27–40 would be considered as high self-perceived stress (1719).

The study was approved by the Ethics Committee of the School of Medical Sciences at the National University of Caaguazú, Paraguay. Data were treated with confidentiality, equality, and justice, respecting the Helsinki principles. Participants who required a feedback from the questionnaire were invited to write down their email address and received information or specific helpful suggestions.

Data were stored in a Microsoft Office Excel 2013 file and processed with RStudio statistical package version 1.2.5033 for analysis. The results are expressed in tables of proportions. Associations were tested with Student's T distribution and ANOVA, as appropriate. Statistical significance was considered for p ≤ 0.05.

Results

Two thousand two hundred and six participants completed the web-based survey, 74.12% (n = 1,635) were men, aged from 18 to 75 with an average of 34 ± 11 years old. 49.77% (n = 1,098) were single and 77.24% (n = 1,704) reported an university education. 36.18% (n = 935) reported an independent work or working for a private enterprise. Socio-demographic characteristics of the sample are shown in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Socio-demographic characteristics of the sample (N = 2,206).

Participants were invited to report on their mental health, providing an answer to the following questions: Are you diagnosed with a mental disorder? If the answer is yes, could you indicate which one? Are you receiving any type of treatment? If the answer is yes, could you indicate what type? 12.42% (n = 274) reported a preexisting diagnosis of mental disorder and 63.87% of them (n = 175) considered that their symptoms have worsened with the start of the quarantine. 41.97% (n = 115/274) of them reported anxiety and 54.38% (n = 149) were not under any specific treatment. The information about the mental health of the participants is summarized in Table 2.

TABLE 2
www.frontiersin.org

Table 2. Mental health of participants: subjects reporting preexisting mental disorders (n = 274).

Regarding the Self-Perceived Stress Scale, the internal consistency of ratings with the Cronbach alpha was 0.84. The mean score of the population was 18.10 ± 5.99 (moderate stress level). 67.49% of people without mental illness also reported a moderate level of self-perceived stress, as well 71.17% of people with mental illness (p < 0.001). Reported stress levels are detailed in Table 3.

TABLE 3
www.frontiersin.org

Table 3. Self-Perceived stress levels in the sample.

The mean score of self-perceived stress among men was 16.82 ± 5.52 (moderate level) whereas women scored 18.54 ± 6.07 (also considered as a moderate level of self-perceived stress). Significant associations were found between stress scores and sex, marital status, reported preexisting mental disorders, and age (Table 4): women perceived more stress than men during the quarantine as well as single subjects and those self-reporting a preexisting mental illness (the size of the effect was based on a Cohen's d equal to 0.71). Lower age was significantly associated with higher SPS scores. In the bivariate comparison, the male-female pair was statistically significant with the Turkey test (p < 0.0001). Regarding marital status, all pairs were significant (p < 0.05) except for the married-widowed pair.

TABLE 4
www.frontiersin.org

Table 4. Factors associated to self-perceived stress in the sample (N = 2,206).

Mental health factors associated to higher levels of self-perceived stress included any preexisting diagnosis (Table 5), with a greater significant association for preexisting anxiety and depression (p < 0.01). In addition, 175 participants (7.93% of the whole sample or 63.87% of 274 mentally ill subjects) reported a subjective worsening of symptoms with the onset of COVID-19 quarantine.

TABLE 5
www.frontiersin.org

Table 5. Mental health factors associated to Self-perceived stress in mentally ill subjects (n = 274).

Discussion

Most of mentally ill subjects (63.87%) reported that COVID-19 quarantine has been worsening symptoms of preexisting mental disorders. As expected and warned by WHO (9), isolation and restrictions may exacerbate feelings of anxiety, fear and anger, especially among subjects suffering from preexisting mental distress (6, 20, 21). They also may be at higher risk of developing additional symptoms of post-traumatic stress disorder (20). Patients suffering from mental health disorders, because of the adjunctive perceived stress during the quarantine, need specific interventions in order to reduce the negative impact of infection and isolation on their own clinical outcome and quality of life (22). In addition, in our sample, there were no significant different levels of perceived stress among subjects with preexisting mental illness receiving or not- receiving any treatment (psychological or pharmacological).

Emerging symptoms among people without preexisting conditions, after the exposure to collective stressful events, such as depressive symptoms, irritability, insomnia, anxiety as well as functional neurological symptoms have been reported (23, 24). Our study confirmed significant levels of stress, even if different, among subjects with and without mental health conditions. Also, in the sample, greater stress has been perceived as associated to anxious and depressive symptoms, according to some previous studies on quarantine (25).

In 2015, during a quarantine in Korea and Ebola viral epidemic in Sierra Leone, greater stress was associated with the female sex, university education level (25, 26). In our survey, the association with female sex has been confirmed whereas no significant association was found with the education level: this may be due to a selection bias since most of participants (1,704; 77.24%) reported to be graduated. This may suggest that people (77.24% of sample) with higher level of education, as well as more accessibility to internet, completed the survey more easily than those with lower level of education.

The internal consistency of ratings found in this study was greater than those found in studies conducted in Colombia or Korea with a Cronbach alpha value of 0.65 and 0.70, respectively (27, 28). In fact, the internal consistency value (0.84) is relevant especially for a complex construct (such as perceived stress) measured in large heterogeneous sample (2,206 subjects from the general population) (29).

This survey was designed to measure the short term (10–15 April 2020) perceived stress following the first wave of COVID-19 and lockdown in the general population in Paraguay, it does not aim to measure the perceived stress among subjects with mental disorders specifically: the instrument used for the survey is adequate for this purpose. The survey was launched through some social networks and apps, as this allowed to reach a large part of general population in a short period of time, considering that in-person assessment would have been impossible due to the lockdown and social distancing measures imposed in the country. Questions regarding preexisting conditions were included in order to determine whether their presence could affect the perceived stress in the general population. Further research will be needed to determine the perceived stress in patients with mental disorders.

Limitations of the survey may include the absence of specific data on psychological or pharmacological interventions for subjects under treatment, as well as the lack of a comparison between the subjects with mental disorders and the general population: our numbers did not allow for any matched comparison. Another limitation of the design is the difficulty to separate the impact of the quarantine and the fear of the virus itself, there may be different factors that could be better measured with different designs. The use of social media to distribute the screening tool could negatively impact the ability to reach people with mental illness, and to reach the general population of Paraguay. The bias of the educational level could be attributed to a “self-selection” of people interested in joining the study and their level of access to social networks: considering the increased availability of internet for people with higher levels of education.

In conclusion, the general score of perceived stress during the quarantine period was 18.10 ± 5.99 (moderate self-perceived stress level). Significant associations were found between stress, female sex, and being single. It may be also understandable that social restrictions may worse loneliness among single subjects.

Considering the findings of this study, we suggest mental health services to provide a phone-based or web-based psychological support to the general population, when required by the general practitioner, and additional regular phone-based or web-based follow-up to all their users to contrast the effect of pandemic on preexisting mental disorders and prevent relapses or suicide (30, 31). This approach may improve the accessibility to mental healthcare services in Paraguay, especially in times of social distancing. It is of note that this may only be accomplished by an effort by public and/or private organizations in order to provide necessary equipment and resources to reach all levels of general population.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

The studies involving human participants were reviewed and approved by Ethics Committee, National University of Caaguazú. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

JT, CR-G, IB, MO'H, OG, and AV conceptualized the structure and design of the manuscript. JT, MO'H, IB, OG, IG, and JC-M wrote the first draft of the manuscript. CR-G and IB designed the first draft of the survey questionnaire. IB, JT, IG, JC-M, and AV analyzed the data. All authors provided critical intellectual contribution to the manuscript, reviewed, and approved the final version of the manuscript.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

1. Cuero C. La pandemia del COVID-19 [The COVID-19 pandemic]. Rev Médica Panamá. (2020) 40:1–2. doi: 10.37980/im.journal.rmdp.2020872

CrossRef Full Text | Google Scholar

2. Millán-Oñate J, Rodriguez-Morales AJ, Camacho-Moreno G, Mendoza-Ramírez H, Rodríguez-Sabogal IA, Álvarez-Moreno C. A new emerging zoonotic virus of concern: the 2019 novel coronavirus (SARS CoV-2). Infectio. (2020) 24:187–92. doi: 10.22354/in.v24i3.848

CrossRef Full Text | Google Scholar

3. Corman VM, Landt O, Kaiser M, Molenkamp R, Meijer A, Chu DK, et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Euro Surveill. (2020) 25:2000045. doi: 10.2807/1560-7917.ES.2020.25.3.2000045

CrossRef Full Text | Google Scholar

4. Park M, Cook AR, Lim JT, Sun Y, Dickens BL. A systematic review of COVID-19 epidemiology based on current evidence. J Clin Med. (2020) 9:967. doi: 10.3390/jcm9040967

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Ministerio de Salud y Bienestar Social de la República del Paraguay. COVID-19 - Información Sobre el Coronavirus [COVID-19 - Information on the Coronavirus]. Ministerio de Salud Pública y Bienestar Social de la República del Paraguay (2020). Available online at: https://www.mspbs.gov.py/covid-19.php?q=CORONAVIRUS&modo=1 (accessed May 1, 2020).

6. Torales J, O'Higgins M, Castaldelli-Maia JM, Ventriglio A. The outbreak of COVID-19 coronavirus and its impact on global mental health. Int J Soc Psychiatry. (2020) 66:317–20. doi: 10.1177/0020764020915212

CrossRef Full Text | Google Scholar

7. Ventriglio A, Bellomo A. Psychosocial IMPACTS of COVID−19 pandemic: the italian perspective. World Soc Psychiatry. (2020) 2:120–1. doi: 10.1016/j.psychres.2020.113316

CrossRef Full Text | Google Scholar

8. Ventriglio A, Watson C, Bhugra D. Pandemics, panic and prevention: stages in the life of COVID-19 pandemic. Int J Soc Psychiatry. (2020) 66:733–4. doi: 10.1177/0020764020924449

CrossRef Full Text | Google Scholar

9. Kaufman KR, Petkova E, Bhui KS, Schulze TG. A global needs assessment in times of a global crisis: world psychiatry response to the COVID-19 pandemic. BJPsych Open. (2020) 6:e48. doi: 10.1192/bjo.2020.25

CrossRef Full Text | Google Scholar

10. Bao Y, Sun Y, Meng S, Shi J, Lu L. 2019-nCoV epidemic: address mental health care to empower society. Lancet. (2020) 395:e37–8. doi: 10.1016/S0140-6736(20)30309-3

CrossRef Full Text | Google Scholar

11. Jones NM, Thompson RR, Dunkel Schetter C, Silver RC. Distress and rumor exposure on social media during a campus lockdown. Proc Natl Acad Sci USA. (2017) 114:11663–8. doi: 10.1073/pnas.1708518114

CrossRef Full Text | Google Scholar

12. Kim YG, Moon H, Kim SY, Lee YH, Jeong DW, Kim K, et al. Inevitable isolation and the change of stress markers in hemodialysis patients during the 2015 MERS-CoV outbreak in Korea. Sci Rep. (2019) 9:5676. doi: 10.1038/s41598-019-41964-x

CrossRef Full Text | Google Scholar

13. Kopp MS, Thege BK, Balog P, Stauder A, Salavecz G, Rózsa S, et al. Measures of stress in epidemiological research. J Psychosom Res. (2010) 69:211–25. doi: 10.1016/j.jpsychores.2009.09.006

CrossRef Full Text | Google Scholar

14. Colarossi N. China Locks Down Millions to Contain Coronavirus. Do Quarantines Work? - Business Insider. (2020). Available online at: https://www.businessinsider.com/quarantine-history-following-china-wuhan-coronavirus-lockdowns-2020–1 (accessed May 1, 2020).

15. Presidencia de la República del Paraguay. Decreto 3442 por el Cual se Dispone la Implementación de Acciones Preventivas Ante el Riesgo de Expansión del Coronavirus (COVID-19) al Territorio Nacional [Decree 3442 That Provides for the Implementation of Preventive Actions Against the Risk of Expansion of the Coronavirus (COVID-19) into the National Territory]. Presidencia de la República del Paraguay (2020) Available online at: https://www.presidencia.gov.py/archivos/documentos/DECRETO3442_724d4w8w.PDF (accessed May 1, 2020).

16. Remor E. Psychometric properties of a European Spanish version of the Perceived Stress Scale (PSS). Span J Psychol. (2006) 9:86–93. doi: 10.1017/S1138741600006004

CrossRef Full Text | Google Scholar

17. Perera MJ, Brintz CE, Birnbaum-Weitzman O, Penedo FJ, Gallo LC, Gonzalez P, et al. Factor structure of the Perceived Stress Scale-10 (PSS) across English and Spanish language responders in the HCHS/SOL sociocultural ancillary study. Psychol Assess. (2017) 29:320–8. doi: 10.1037/pas0000336

CrossRef Full Text | Google Scholar

18. Cohen S, Williamson G. Perceived stress in a probability sample of the United States. In: Spacapan S, Oskamp S, editors. The Social Psychology of Health: Claremont Symposium on Applied Social Psychology. Newburry Park, CA: Sage (1988). p. 31–67

Google Scholar

19. NH Department of Administrative Services. Perceived Stress Scale. NH Department of Administrative Services (2020). Available online at: https://das.nh.gov/wellness/docs/percieved%20stress%20scale.pdf (accessed May 1, 2020).

Google Scholar

20. Usher K, Bhullar N, Jackson D. Life in the pandemic: social isolation and mental health. J Clin Nurs. (2020) 29:2756–7. doi: 10.1111/jocn.15290

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Park JS, Lee EH, Park NR, Choi YH. Mental health of nurses working at a government-designated hospital during a MERS-CoV outbreak: a cross-sectional study. Arch Psychiatr Nurs. (2018) 32:2–6. doi: 10.1016/j.apnu.2017.09.006

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Kim HC, Yoo SY, Lee BH, Lee SH, Shin HS. Psychiatric findings in suspected and confirmed middle east respiratory syndrome patients quarantined in hospital: a retrospective chart analysis. Psychiatry Investig. (2018) 15:355–60. doi: 10.30773/pi.2017.10.25.1

CrossRef Full Text | Google Scholar

23. Guerriero RM, Pier DB, de Gusmão CM, Bernson-Leung ME, Maski KP, Urion DK, et al. Increased pediatric functional neurological symptom disorders after the boston marathon bombings: a case series. Pediatr Neurol. (2014) 51:619–23. doi: 10.1016/j.pediatrneurol.2014.07.011

CrossRef Full Text | Google Scholar

24. Douglas PK, Douglas DB, Harrigan DC, Douglas KM. Preparing for pandemic influenza and its aftermath: mental health issues considered. Int J Emerg Ment Health. (2009) 11:137–44.

PubMed Abstract | Google Scholar

25. Lee SM, Kang WS, Cho A-R, Kim T, Park JK. Psychological impact of the 2015 MERS outbreak on hospital workers and quarantined hemodialysis patients. Compr Psychiatry. (2018) 87:123–7. doi: 10.1016/j.comppsych.2018.10.003

CrossRef Full Text | Google Scholar

26. Jalloh MF, Li W, Bunnell RE, Ethier KA, O'Leary A, Hageman KM, et al. Impact of ebola experiences and risk perceptions on mental health in Sierra Leone, July 2015. BMJ Glob Health. (2018) 3:e000471. doi: 10.1136/bmjgh-2017-000471

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Campo-Arias A, Oviedo HC, Herazo E. Escala de estrés percibido-10: desempeño psicométrico en estudiantes de medicina de bucaramanga, Colombia [Perceived stress scale-10: psychometric performance in medical students from Bucaramanga, Colombia]. Rev Fac Med. (2014) 62:407–13. doi: 10.15446/revfacmed.v62n3.43735

CrossRef Full Text | Google Scholar

28. Lee EH. Review of the psychometric evidence of the perceived stress scale. Asian Nurs Res. (2012) 6:121–7. doi: 10.1016/j.anr.2012.08.004

CrossRef Full Text | Google Scholar

29. Pedrero Pérez EJ, Olivar Arroyo Á. Estrés percibido en adictos a sustancias en tratamiento mediante la escala de Cohen: propiedades psicométricas y resultados de su aplicación [Perceived stress in substance-users under treatment using the Cohen scale: psychometric properties and results of its application]. Anales Psicología. (2010) 26:302–9.

Google Scholar

30. Xiang YT, Yang Y, Li W, Zhang L, Zhang Q, Cheung T, et al. Timely mental health care for the 2019 novel coronavirus outbreak is urgently needed. Lancet Psychiatry. (2020) 7:228–9. doi: 10.1016/S2215-0366(20)30046-8

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Xiang YT, Zhao YJ, Liu ZH, Li XH, Zhao N, Cheung T, et al. The COVID-19 outbreak and psychiatric hospitals in China: managing challenges through mental health service reform. Int J Biol Sci. (2020) 16:1741–4. doi: 10.7150/ijbs.45072

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: COVID-19, pandemic, stress, perceived-stress, Paraguay, mental health

Citation: Torales J, Ríos-González C, Barrios I, O'Higgins M, González I, García O, Castaldelli-Maia JM and Ventriglio A (2020) Self-Perceived Stress During the Quarantine of COVID-19 Pandemic in Paraguay: An Exploratory Survey. Front. Psychiatry 11:558691. doi: 10.3389/fpsyt.2020.558691

Received: 03 May 2020; Accepted: 05 October 2020;
Published: 26 October 2020.

Edited by:

Alexandre Andrade Loch, University of São Paulo, Brazil

Reviewed by:

Martinus Theodorus Van De Bilt, University of São Paulo, Brazil
Heming Gao, Liaoning Normal University, China

Copyright © 2020 Torales, Ríos-González, Barrios, O'Higgins, González, García, Castaldelli-Maia and Ventriglio. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Julio Torales, anRvcmFsZXMmI3gwMDA0MDttZWQudW5hLnB5

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.