- 1Pediatric Health Research Center, Department of Pediatrics, Tabriz University of Medical Sciences, Tabriz, Iran
- 2Danesh Laboratory, Tabriz, Iran
Objective: The aim of this study was to investigate the level of resistin in children with and without sepsis hospitalized in the pediatric intensive care unit (PICU) and compare them to levels in healthy subjects in order to determine the trend of resistin levels in children in PICUs and also to identify the cut-off values for positive sepsis.
Methods: This was a case-control study conducted in 2014 at a children's hospital in Tabriz, Iran. Three groups were investigated, a case group comprised of patients with sepsis admitted to PICU and two control groups; one made up of patients admitted to PICU without sepsis and the other of healthy children. Variables included demographic, anthropometric (growth metric percentile), and clinical factors.
Results: Patients were randomized into control group A (n = 12, 48%), control group B (n = 11, 44%), and the sepsis group (n = 24, 47.1%). The difference in the means of resistin levels was significant on the first, fourth, and seventh days (P < 0.0001) in the case and control group A. Means comparisons in the case and control group B revealed significant differences on the fourth and seventh day (P = 0.005 and P < 0.0001, respectively) but not on the first day (P = 0.246). The trend of resistin levels increased in the septic group (F Huynh-Feldt = 37.83, P < 0.0001). The diagnostic accuracy of resistin level was high for discriminating sepsis (area under the receiver operating characteristic curve [AUC] 0.864 [SE = 0.41]). The sensitivity was 0.824 and specificity 0.72 with a cut-off point of 5.2 ng/ml on the first day.
Conclusion: In the present study, resistin level can be used as an indicator of sepsis in children admitted to PICU. However, the cut-off point based upon when a prediction could be made is different and is dependent on a variety of factors, such as control group and number of days since the first signs of sepsis.
Introduction
Sepsis is defined as a life-threatening condition that is created by the body's chemical response to infection (1). It has remained a global healthcare concern (2) and a major cause of morbidity and mortality in PICUs (3–6). More than half of the deaths in children under-five occur from infectious diseases, such as pneumonia and diarrhea, which can lead to sepsis (7, 8). This imposes considerable financial costs on PICUs (4–6). More attention should be given to sepsis in developing countries where infectious diseases are life-threatening and healthcare resources are limited and insufficient (7–9).
The prevalence of sepsis-associated morbidity and mortality among children ranged from 5.6 to 27.3 and 12.5 to 24.0%, respectively (10–12). This rate, however, is not clear in Iran.
A global review of 26 countries, the frequency and mortality rate of severe sepsis was estimated to be 8.2 and 25%, respectively (13).
According to worldwide studies, there is a rising trend in the prevalence of pediatric sepsis (13–16). This may be related to high survival rates of patients at risk of developing sepsis, including those suffering from disorders associated with immunodeficiency or prematurity (4, 14). This high survival rate, however, does not detract from the importance of this issue.
Predictor variables can be helpful in prediction and management of sepsis. Resistin is a type of adipokine secreted by adipose tissue of mice (17). In human-based studies, resistin is expressed at very low levels in adipocytes and is produced by neutrophils and macrophages (18, 19). Resistin levels are also higher in patients with cardiovascular disease, atherosclerosis, rheumatoid arthritis, diabetes, obesity with insulin resistance, and sepsis (20–28).
It has been reported that resistin levels in patients with sepsis alter during an ICU stay (29, 30). This can be considered as a probable indicator of sepsis in neonates (1). Alterations in resistin levels in septic patients have been reported often (3), but the results are contradictory according to whether these levels rise or fall (3).
The aims of the present study were to: (1) compare the levels of resistin in the case group and the two control groups (healthy and PICU control groups); (2) evaluate the trend of resistin levels on the first, fourth, and seventh days; and (3) diagnose the accuracy of resistin level for discriminating sepsis in children.
Materials and Methods
In this prospective study, a three-pronged strategy was used to compare groups. First was the inclusion of pediatric patients with sepsis admitted to PICU (case group) (50 cases). The second part involved pediatric patients without sepsis admitted to PICU (control group B) (22 cases) and the third included healthy children who had been referred to a health clinic for growth monitoring and had no clinical problems (control group A) (25 children). The first two groups (case and PICU control) included all patients who had been admitted to PICU from March to May 2014, while the third group included patients randomly selected from March to July 2014.
In this study, two control groups were specified due to the importance of the issue as well as the possibility of comparisons specific to each group. For example, duration of ventilation and length of PICU stay were variables that pertained to the PICU control group. This study was approved by the medical ethics committees of Tabriz University of Medical Sciences in April 2012.
Any children under 12 years of age admitted to PICU with sepsis were eligible for inclusion to the case group, any children under 12 years of age admitted to PICU without sepsis were eligible for inclusion to control group B, and any healthy children under 12 years of age referred to the health monitoring center were eligible for inclusion to control group A. Informed consent was obtained from the parents of all children included in this study. Exclusion criteria included: FBS > 400 mg/dl, failure to obtain a blood sample for resistin, genetic syndromes and major congenital anomalies, surgical conditions, cardiovascular dysfunction, and acute respiratory distress syndrome.
Variables
Variables that were measured in case controls (case and control groups A and B) included demographic variables (age and gender), growth metric percentile, and resistin on the first, forth, and seventh days. Mechanical ventilation history, duration of ventilation, and length of PICU stay were variables that were compared only in the case and control group B.
Growth Metric Percentile
In this study, a growth metric percentile based on gender, age, weight, and height, according to Centers for Disease Control and Prevention (CDC) growth calculator for 0 to 36 months and 2 to 20 years, was utilized (31, 32).
Sepsis Determination
Sepsis was defined according to the criteria proposed by the American College of Chest Physicians/Society of Critical Care Medicine (33). Systemic inflammatory response syndrome (criteria for this disease met if at least two of the following are present: core temperature of >38.5°C or <36°C, abnormal heart rate, tachypnea, and abnormal leucocyte count) in the presence of infection detected by laboratory testing (CRP and WBC counts) was used to diagnose sepsis (34, 35).
Statistical Analysis
Proportions regarding categorical variables and mean (standard deviation) or median (interquartile range [IQR]) for continuous variables were presented in deceptive statistics. Demographic differences within the groups were evaluated using the Mann-Whitney U test. Comparison between case and control groups based on resistin levels was performed using an independent sample t-test. The trend of resistin level was assayed by repeated measurement test. Accuracy was calculated using AUC. Statistical analysis was carried out using Predictive Analytics Software (PASW) statistics (version 18, SPSS Inc., Chicago, IL).
Results
This study was conducted on 93 children between the ages of 1 month to 12 years. In this study, the sepsis group (50 cases) was compared with two control groups; a healthy control group (control group A) including healthy children who had been referred to a health clinic for growth monitoring and had no clinical problems (25 children) and a hospital control group (control group B) including pediatric patients without sepsis admitted to PICU (22 children).
Overall, there were 12 boys (48.0%) in control group A, 10 (45%) in control group B and 24 (48.0%) in case group (X2 in case and control group A = 0.006; P = 0.57, X2 in case and control group B = 0.063; P = 0.498 and X2 in control group A and control group B group = 0.081; P = 0.50). The age variable were significantly different in the case and control group B (P = 0.006). The baseline characteristics (gender, age, and growth metric percentile) of case group (n = 50), control group A (n = 25), and control group B (n = 22) are presented in Table 1.
Table 1. The baseline characteristics (gender, age, and growth metric percentile) of case group (n = 50), control group A (Healthy control group) (n = 25) and control group B (PICU control group) (n = 22).
Of the 50 children, a 7-month-old infant deceased after 40 days of PICU stay; he was hospitalized for detection of pneumonia and had history of 240 h of ventilation.
The median (IQRs) of ventilation and PICU stay was 96 (100) h and 25 (19.75) days. These variables had significant differences in two groups of case and control group B (P = 0.011 and <0.0001, respectively). Resistin level on the seventh day had a positive correlation with PICU stay (r = 0.840) and mechanical ventilation (r = 0.657).
The mean (SD) of resistin(ng/m) in the first, fourth, and seventh days in the case group are as follows: 10.05 (0.46), 13.82 (5.62), and 19.44 (7.24), respectively, also this index was 4.82 (0.88) and 9.05 (2.72) on the first day, 5.15 (0.727) and 10.86 (3.24) on the fourth day, and 5.40 (0.66) and 12.32 (4.86) on the seventh day in control groups A and B, respectively (Figure 1).
The difference in resistin level means were statistically significant on case and control group A on the first day (t = −7.8, P < 0.0001), the fourth day (t = −10.82, P < 0.0001) and on the seventh day (t = −13.73, P < 0.0001). Comparison of means in the case and control group B was revealed to have significant differences on the fourth and seventh day (tfourth day = −2.87, P = 0.005 and tseventh day = −5.02, P < 0.0001) but not on the first day (tfirst day = −1.17, P = 0.246). Comparison of the two control groups showed significant differences as well (tfirst day = −7.24, P < 0.0001; tfourth day = −8.44, P < 0.0001 and; tseventh day = −6.91, P < 0.0001).
The trend of resistin levels significantly increased after onset and admission to PICU in the septic (case) group. This result was earned by repeated measurement analysis in the presence of age and gender (FHuynh−Feldt = 37.83, P < 0.0001) (Figure 2).
The AUC analysis was also calculated in order to estimate resistin levels on the first, fourth, and seventh day. The area under curve of sepsis level was 0.864 (SE = 0.41) for discriminating sepsis (sensitivity 82% and specificity 72% with a cut-off point of 5.2 ng/ml) on the first day. AUC of sepsis level on the fourth and seventh day were 0.987 (SE = 0.011) and 1.00 (SE = 0.0) respectively, with a cut-off point of 6.1 (sensitivity 98% and specificity 80%) and 7.5 (sensitivity 100% and specificity 100%). Findings of receiver operating characteristic analysis on case control group A and case control group B by age groups is accessible in Table 2.
Table 2. Distribution of area under the curve of resistin level, cut-off point, and diagnostic accuracy of sepsis by control groups, age and time.
Discussion
The present study demonstrated that resistin levels on the first, fourth, and seventh day were statistically associated with sepsis. This outcome was obtained though analysis on septic pediatric subjects (case group) and healthy subjects (control group A). Resistin on the fourth and seventh day had a significant relationship with the PICU subjects with sepsis compared to the PICU subjects without sepsis (control group B).
According to the findings of a 2009 German study by Koch (37), resistin serum concentrations were significantly higher in sepsis than in non-sepsis patients hospitalized in ICU. Findings of another study by Aliefendioglu on premature newborns in NICU (38) was in line with the results of the present study. These results were consistent with findings of other studies by Macdonald et al. (1) and Galtrey et al. (2).
A main finding of this study was the different results gained from comparing the case group with control group B in comparison with the case group and control group A. We grouped the two control groups by their resistin levels and it was revealed that control B had significantly higher resistin levels than control group A. Children admitted to PICU are patients with certain conditions, and the concentration of resistin in them can be increased by various factors. Therefore, the difference between the two control groups in terms of resistin was expected.
Considering that some variables are PICU-specific, it was therefore essential to investigate a PICU control group in our research. In the present study, it was observed that the level of resistin increased during PICU stay. We also found that resistin levels increased If a patient was mechanically ventilated.” This result was consistent with findings of some other studies (1, 2, 39). Based on the studies, the main cause of acute respiratory distress syndrome was sepsis. In addition, sepsis increased susceptibility to ventilator-induced lung injury (40, 41); therefore, the relationship between sepsis with the length of stay in PICU and mechanical ventilation is two sided.
The cut-off point for septic children (case group) admitted to PICU (aged 1 month to 12 years) compared to healthy children (control group A) was estimated at 5.2 ng/ml based upon a sensitivity of 0.824 and specificity equal to 0.72 on the first day. The cut-off points had no difference after grouping by age (cut-off point for 1 month to 2 years old was equivalent to 5.25; 25 months to 12 years, 5.1). The cut-off point measure in case control B was higher than case control A.
In a study performed on newborn infants, a cut-off value of 8 ng/ml (sensitivity = 0.93 and specificity = 0.95) was calculated (42). Whereas, another study on premature newborns reported a cut-off value of 5.0 (sensitivity = 0.74 and specificity = 0.46) (18). The cut-off point of 6 (sensitivity = 0.90, specificity = 0.57) was calculated according to an investigation on 150 neonates admitted to King Abdulaziz University (36).
In terms of limitations of this study, it should be noted that the sample size was low, so it was not possible to conduct a multiple analysis.
Conclusion
We found that certain levels of resistin on the first day can be used as a predictor of sepsis in neonates and children. However, the cut-off point based upon which a prediction can be made is controversial and dependent on a variety of factors including control group selection and time elapsed from the first signs of sepsis. This study demonstrated how the type of control group can affect the results.
Data Availability
The raw data supporting the conclusions of this manuscript will be made available by the authors, without undue reservation, to any qualified researcher.
Author Contributions
LS was the manager of project, and contributed to searching and analyzing. LS and NB contributed to clinical examinations. SP completed the paraclinical test. All authors contributed to the writing and editing of the manuscript.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1. Macdonald SPJ, Bosio E, Neil C, Arendts G, Burrows S, Smart L, et al. Resistin NGAL are associated with inflammatory response, endothelial activation and clinical outcomes in sepsis. Inflamm Res. (2017) 66:611–9. doi: 10.1007/s00011-017-1043-5
2. Galtrey EJ, Moss C, Cahill H. Usefulness of sepsis screening tools and education in recognizing the burden of sepsis on hospital wards. Crit Care. (2015) 19(Suppl. 1):3:14083. doi: 10.1186/cc14083
3. Hillenbrand A, Xu P, Zhou S, Blatz A, Weiss M, Hafner S, et al. Circulating adipokine levels and prognostic value in septic patients. J Inflamm. (2016) 13:30–7. doi: 10.1186/s12950-016-0138-z
4. Watson RS, Carcillo JA, Linde-Zwirble WT, Clermont G, Lidicker J, Angus DC. The epidemiology of severe sepsis in children in the United States. Am J Respir Crit Care Med. (2003) 167:695–701. doi: 10.1164/rccm.200207-682OC
5. Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. (2001) 29:1303–10. doi: 10.1097/00003246-200107000-00002
6. Thompson GC, Kissoon N: Sepsis in Canadian children: a national analysis using administrative data. Clin Epidemiol. (2014) 6:461–9. doi: 10.2147/CLEP.S72282
7. Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, et al. Child health epidemiology reference group of WHO and UNICEF: global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. (2012) 379:2151–61. doi: 10.1016/S0140-6736(12)60560-1
8. Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, et al. Global, regional, and national causes of child mortality in 2000–13, with projections to inform post-2015 priorities: an updated systematic analysis. Lancet. (2015) 385:430–40. doi: 10.1016/S0140-6736(14)61698-6
9. Kissoon N, Argent A, Devictor D. Intensive. Critical Care Societies-its global agenda. Pediatr Crit Care Med. (2009) 10:597–600. doi: 10.1097/PCC.0b013e3181a704c6
10. Jaramillo-Bustamante JC, Marín-Agudelo A, Fernández-Laverde M, Bareño-Silva J. Epidemiology of sepsis in pediatric intensive care units: first Colombian multicenter study. Pediatr Crit Care Med. (2012) 13:501–8. doi: 10.1097/PCC.0b013e31823c980f
11. Khan MR, Maheshwari PK, Masood K, Qamar FN, Haque AU. Epidemiology and outcome of sepsis in a tertiary care PICU of Pakistan. Ind J Pediatr. (2012) 79:1454–58. doi: 10.1007/s12098-012-0706-z
12. Vila Pérez D, Jordan I, Esteban E, García-Soler P, Murga V, Bonil V, et al. Prognostic factors in pediatric sepsis study, from the Spanish Society of Pediatric Intensive Care. Pediatr Infect Dis J. (2014) 33:152–7. doi: 10.1097/01.inf.0000435502.36996.72
13. de Souza DC, Shieh HH, Barreira ER, Ventura AM, Bousso A, Troster EJ. Epidemiology of sepsis in children admitted to PICUs in South America. Pediatr Crit Care Med. (2016) 17:727–34. doi: 10.1097/PCC.0000000000000847
14. Hartman ME, Linde-Zwirble WT, Angus DC, Watson RS. Trends in the epidemiology of pediatric severe sepsis. Pediatr Crit Care Med. (2013) 14:686–93. doi: 10.1097/PCC.0b013e3182917fad
15. Martin GS. Sepsis, severe sepsis and septic shock: changes in incidence, pathogens and outcomes. Expert Rev Anti Infect Ther. (2012) 10:701–6. doi: 10.1586/eri.12.50
16. Martin GS, Mannino DM, Eaton S, Moss M. The epidemiology of sepsis in the United States from 1979 through 2000. N Engl J Med. (2003) 348:1546–54. doi: 10.1056/NEJMoa022139
17. Steppan CM, Bailey ST, Bhat S, Brown EJ, Banerjee RR, Wright CM, et al. The hormone resistin links obesity to diabetes. Nature. (2001) 409:307–12. doi: 10.1038/35053000
18. Johansson L, Linne'r A, Sunde'n-Cullberg J, Haggar A, Herwald H, Lore' K, et al. Neutrophil-derived hyperresistinemia in severe acute streptococcal infections. J Immunol. (2009) 183:4047–54. doi: 10.4049/jimmunol.0901541
19. Savage DB, Sewter CP, Klenk ES, Segal DG, Vidal-Puig A, Considine RV, et al. Resistin /Fizz3 expressionin relation to obesity and peroxisome proliferator-activated receptor- gamma action in humans. Diabetes. (2001) 50:2199–202. doi: 10.2337/diabetes.50.10.2199
20. Yousef AA, Amr YM, Suliman GA. The diagnostic value of serum leptin monitoring and its correlation with tumor necrosis factor-alpha in critically ill patients: a prospective observational study. Crit Care. (2010) 14:R33. doi: 10.1186/cc8911
21. Robinson K, Prins J, Venkatesh B. Clinical review: adiponectin biology and its role in inflammation and critical illness. Crit Care. (2011) 15:221. doi: 10.1186/cc10021
22. Takeishi Y, Niizeki T, Arimoto T, Nozaki N, Hirono O, Nitobe J, et al. Serum resistin is associated with high risk in patients with congestive heart filure – a novel link between metabolic signals and heart failure. Circ J. (2007) 71:460–64. doi: 10.1253/circj.71.460
23. Shin HJ1, Park S, Yoon SJ, Choi DS, Cho DK, Kim JS, et al. Association between serum resistin and carotid intima media thickness in hypertensionpatients. Int J Cardiol. (2008) 125:79–84. doi: 10.1016/j.ijcard.2007.02.028
24. Chen BH, Song Y, Ding EL K, Roberts CH E, Manson J, Rifai N Circulating levels of resistin and risk of type 2 diabetes in men and women: results from two prospective cohorts. Diabetes Care. (2009) 32:329–34. doi: 10.2337/dc08-1625
25. Bostrom EA, Tarkowski A, Bokarewa M. Resistin isstored in neutrophil granules being released upon challengewith inflammatory stimuli. Biochim Biophys Acta. (2009) 1793:1894–900. doi: 10.1016/j.bbamcr.2009.09.008
26. Kunnari AM, Savolainen ER, Ukkola OH, Kesaniemi YA, Jokela MA. The expression of human resistin in different leucocyte lineages is modulated by LPS and TNFalpha. Regul Pept. (2009) 157:57–63. doi: 10.1016/j.regpep.2009.05.002
27. Johansson A, Claesson R, Hanstrom L, Sandstrom G, Kalfas S. Polymorphonuclear leukocyte degranulation induced by leukotoxin from Actino bacillus action mycetem comitans. J Periodontal Res. (2000) 35:85–9. doi: 10.1034/j.1600-0765.2000.035002085.x
28. Hillenbrand A, Knippschild U, Weiss M, Schrezenmeier H, Henne-Bruns D, Huber-Lang M. Sepsis induced changes of adipokines and cytokines - septic patients compared to orbidly obese patients. BMC Surg. (2010) 10:26. doi: 10.1186/1471-2482-10-26
29. Sunde'n-Cullberg J, Nystro..m T, Lee ML, Mullins GE, Tokics L, Andersson J, et al. Pronounced elevation of resistin correlates with severity of disease in severe sepsis and septic shock. Crit Care Med. (2007) 35:1536–42. doi: 10.1097/01.CCM.0000266536.14736.03
30. Vassiliadi DA, Tzanela M, Kotanidou A, Orfanos SE, Nikitas N, Armaganidis A, et al. Serial changes in adiponectin and resistin in critically ill patients with sepsis: associations with sepsis phase, severity, and circulating cytokine levels. J Crit Care. (2012) 27:400–9. doi: 10.1016/j.jcrc.2012.04.007
31. Styne DM, Arslanian SA, Connor EL, Farooqi IS, Murad MH, Janet H, et al. Pediatric obesity—assessment, treatment, and prevention: an endocrine society clinical practice guideline. J Clin Endocrinol Metab. (2017) 102:709–57. doi: 10.1210/jc.2016-2573
32. Centers for Disease Control and Prevention. National Center for Health Statistics.r for ealth Statistics Clinical Growth Charts. Available online at: https://www.cdc.gov/growthcharts/cdc_charts.htm (accessed June 26, 2019).
33. Koch A, Gressner OA, Sanson E, Tacke F, Trautwein C. Serum resistin levels in critically ill patients are associated with inflammation, organdysfunction and metabolism and may predict survival of non-septic patients. Crit Care. (2009) 13:R95. doi: 10.1186/cc7925
34. Balk RA. Systemic inflammatory response syndrome (SIRS). Virulence. (2014) 5:20–6. doi: 10.4161/viru.27135
35. Mathias B, Mira JC, Larson SD. Pediatric sepsis. Curr Opin Pediatr. (2016) 28:380–7. doi: 10.1097/MOP.0000000000000337
36. Khalifa A, Mabrouk MM, Al-Zahrani Akh, Taha AA, Eed EM. Diagnostic value of resistin and hepcidin in neonatal sepsis. IOSR J Biotechnol Biochem. (2018) 4:16–21. doi: 10.4103/jrms.JRMS_912_15
37. Patel KH, McElvania E. Diagnostic challenges and laboratory considerations for pediatric sepsis. J Appl Lab Med. (2019) 3:587–600. doi: 10.1373/jalm.2017.025908
38. Aliefendioglu D, Gürsoy T, Çaglayan O, Aktaş A, Ovali F. Can resistin be a new indicator of neonatal sepsis? Pediatr Neonatol. (2014) 55:53–7. doi: 10.1016/j.pedneo.2013.04.012
39. Cekmez F, Canpolat FE, Cetinkaya M, Aydinöz S, Aydemir G, Karademir F, et al. Diagnostic value of resistin and visfatin, in comparison with C-reactive protein, procalcitonin and interleukin-6 in neonatal sepsis. Eur Cytokine Netw. (2011) 22:113–7 doi: 10.1684/ecn.2011.0283
40. Zampieri FG, Mazza B. Mechanical ventilation in sepsis: a reappraisal. Shock. (2017) 47(1S Suppl. 1):41–6. doi: 10.1097/SHK.0000000000000702
41. Gordijn MS, Plötz FB, Kneyber MC. Fever during pediatric intensive care unit admission is independently associated with increased morbidity. J Intensive Care Med. (2009) 24:317–22. doi: 10.1177/0885066609340631
42. Tavladaki T, Spanaki AM, Dimitriou H, Kondili E, Choulaki C, Georgopoulos D, et al. Similar metabolic, innate immunity, and adipokine profiles in adult and pediatric sepsis versus systemic inflammatory response syndrome-a pilot study. Pediatr Crit Care Med. (2017) 18:e494–505. doi: 10.1097/PCC.0000000000001300
Keywords: sepsis, resistin, pediatric, intensive care unit, pediatrics
Citation: Saboktakin L, Bilan N, Ghalehgolab Behbahan A and Poorebrahim S (2019) Relationship Between Resistin Levels and Sepsis Among Children Under 12 Years of Age: A Case Control Study. Front. Pediatr. 7:355. doi: 10.3389/fped.2019.00355
Received: 20 February 2019; Accepted: 12 August 2019;
Published: 28 August 2019.
Edited by:
Paolo Biban, Integrated University Hospital Verona, ItalyReviewed by:
Oguz Dursun, Akdeniz University, TurkeyMarianne Nellis, Cornell University, United States
Copyright © 2019 Saboktakin, Bilan, Ghalehgolab Behbahan and Poorebrahim. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Lida Saboktakin, bGlkYXNhYm9rdGFraW5uJiN4MDAwNDA7Z21haWwuY29t