- 1Department of Pulmonary Medicine, Faculty of Medicine, Mustafa Kemal University, Antakya, Turkey
- 2Department of Pulmonary Medicine, Faculty of Medicine, Gazi University, Ankara, Turkey
- 3Department of Biostatistics, Faculty of Medicine, Gaziantep University, Gaziantep, Turkey
- 4Department of Pulmonary Medicine, Adana City Training and Research Hospital, University of Health Sciences, Adana, Turkey
- 5Department of Pulmonary Medicine, Faculty of Medicine, Çukurova University, Adana, Turkey
- 6Department of Pulmonary Medicine, Faculty of Medicine, Mersin University, Yenişehir, Turkey
- 7Department of Pulmonary Medicine, Faculty of Medicine, Kocaeli University, İzmit, Turkey
- 8Department of Pulmonary Medicine, Halil Şıvgın Cubuk State Hospital, Ankara, Turkey
- 9Department of Infectious Disease, Faculty of Medicine, Gazi University, Ankara, Turkey
- 10Department of Pulmonary Medicine, Faculty of Medicine, Hacettepe University, Ankara, Turkey
- 11Department of Pulmonary Medicine, Faculty of Medicine, Ufuk University, Ankara, Turkey
- 12Department of Pulmonary Disease, Cerrahpaşa Faculty of Medicine, Istanbul University-Cerrahpasa, Istanbul, Turkey
- 13Department of Infectious Disease and Clinical Microbiology, Faculty of Medicine, Kocaeli University, İzmit, Turkey
- 14Department of Pulmonary Medicine, Faculty of Medicine, Altunizade Acibadem Hospital, Acibadem University, Istanbul, Turkey
- 15Department of Infectious Disease, Kadıköy Florence Nightingale Hospital, Istanbul, Turkey
- 16Department of Pulmonary Medicine, Faculty of Medicine, Ataturk University, Erzurum, Turkey
- 17Department of Pulmonary Medicine, Faculty of Medicine, Erciyes University, Kayseri, Turkey
- 18Department of Pulmonary Medicine, Acibadem Maslak Hospital, Istanbul, Turkey
- 19Operating Room Services Department, Vocational School, Nişantaşı University, Istanbul, Turkey
- 20Department of Infectious Disease and Clinical Microbiology, Faculty of Medicine, Erciyes University, Kayseri, Turkey
- 21Department of Pulmonary Medicine, Faculty of Medicine, Dokuz Eylul University, Izmir, Turkey
- 22Department of Infectious Disease and Clinical Microbiology, Faculty of Medicine, Dokuz Eylul University, Izmir, Turkey
- 23Department of Pulmonary Medicine, Faculty of Medicine, Düzce University, Düzce, Turkey
- 24Department of Infectious Disease, Turkiye Gazetesi Private Hospital, Istanbul, Turkey
- 25Department of Infectious Diseases and Clinical Microbiology, Faculty of Medicine, Suleyman Demirel University, Isparta, Turkey
- 26Department of Pulmonary Medicine, Kestel State Hospital, Bursa, Turkey
- 27Department of Pulmonary Medicine, Faculty of Medicine, Ondokuz Mayıs University, Samsun, Turkey
- 28Department of Pulmonary Medicine, Faculty of Medicine, Gaziantep University, Gaziantep, Turkey
- 29Department of Pulmonary Medicine, Faculty of Medicine, Firat University, Elazı, Turkey
- 30Department of Pulmonary Medicine, Bilecik Training and Research Hospital, Bilecik, Turkey
- 31Department of Pulmonary Medicine, Faculty of Medicine, Zonguldak Bülent Ecevit University, Zonguldak, Turkey
- 32Department of Pulmonary Medicine, Yedikule Chest Diseases and Chest Surgery Training and Research Hospital, University of Health Science, Istanbul, Turkey
- 33Department of Pulmonary Medicine, Faculty of Medicine, Suleyman Demirel University, Isparta, Turkey
- 34Department of Pulmonary Medicine, Faculty of Medicine, Taksim, Acibadem University, Istanbul, Turkey
- 35Department of Internal Medicine, Faculty of Medicine, Dokuz Eylul University, Izmir, Turkey
- 36Department of Pulmonary Medicine, Kadıköy Florence Nightingale Hospital, Istanbul, Turkey
- 37Department of Pulmonary Medicine, Faculty of Medicine, Pamukkale University, Denizli, Turkey
- 38Department of Pulmonary Medicine, Ankara Memorial Hospital, Ankara, Turkey
- 39Department of Pulmonary Medicine, Faculty of Medicine, Trakya University, Edirne, Turkey
- 40Department of Thoracic Surgery, Atatürk Chest Diseases and Thoracic Surgery Training and Research Hospital, Ankara, Turkey
- 41Department of Pulmonary Medicine, School of Medicine, Başkent University, Ankara, Turkey
- 42Department of Pulmonary Medicine, Faculty of Medicine, Celal Bayar University, Manisa, Turkey
- 43Department of Pulmonary Medicine, Faculty of Medicine, Ege University, Izmir, Turkey
- 44Department of Pulmonary Medicine, Koç University School of Medicine, Istanbul, Turkey
- 45Koç University Research Center for Translational Medicine (KUTTAM), Koç University School of Medicine, Istanbul, Turkey
Background and objectives: Although several repurposed antiviral drugs have been used for the treatment of COVID-19, only a few such as remdesivir and molnupiravir have shown promising effects. The objectives of our study were to investigate the association of repurposed antiviral drugs with COVID-19 morbidity.
Methods: Patients admitted to 26 different hospitals located in 16 different provinces between March 11–July 18, 2020, were enrolled. Case definition was based on WHO criteria. Patients were managed according to the guidelines by Scientific Board of Ministry of Health of Turkey. Primary outcomes were length of hospitalization, intensive care unit (ICU) requirement, and intubation.
Results: We retrospectively evaluated 1,472 COVID-19 adult patients; 57.1% were men (mean age = 51.9 ± 17.7years). A total of 210 (14.3%) had severe pneumonia, 115 (7.8%) were admitted to ICUs, and 69 (4.7%) were intubated during hospitalization. The median (interquartile range) of duration of hospitalization, including ICU admission, was 7 (5–12) days. Favipiravir (n = 328), lopinavir/ritonavir (n = 55), and oseltamivir (n = 761) were administered as antiviral agents, and hydroxychloroquine (HCQ, n = 1,382) and azithromycin (n = 738) were used for their immunomodulatory activity. Lopinavir/ritonavir (β [95% CI]: 4.71 [2.31–7.11]; p = 0.001), favipiravir (β [95% CI]: 3.55 [2.56–4.55]; p = 0.001) and HCQ (β [95% CI]: 0.84 [0.02–1.67]; p = 0.046) were associated with increased risk of lengthy hospital stays. Furthermore, favipiravir was associated with increased risks of ICU admission (OR [95% CI]: 3.02 [1.70–5.35]; p = 0.001) and invasive mechanical ventilation requirement (OR [95% CI]: 2.94 [1.28–6.75]; p = 0.011).
Conclusion: Our findings demonstrated that antiviral drugs including lopinavir, ritonavir, and favipiravir were associated with negative clinical outcomes such as increased risks for lengthy hospital stay, ICU admission, and invasive mechanical ventilation requirement. Therefore, repurposing such agents without proven clinical evidence might not be the best approach for COVID-19 treatment.
Introduction
Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic started in Wuhan, China, at the end of 2019, and spread rapidly to many countries. The disease was termed COVID-19 by March 11, 2020. Globally, as of June 30, 2022, there have been more than 543 million confirmed cases of COVID-19, including 6.33 million deaths reported to the World Health Organization (WHO) (1).
Several repurposed antiviral agents have been administered in the treatment of COVID-19 worldwide (2–9). Although there are many ongoing studies, only a few drugs such as remdesivir and molnupiravir, which are not available in many countries, have shown promising effects. In Turkey, the treatment guidelines for adult patients with COVID-19 have been prepared and regularly updated by the Scientific Board of the Ministry of Health (SBMH), since March 2020 (10). While hydroxychloroquine (HCQ) was recommended for mild cases and lopinavir/ritonavir combination for moderate and severe patients with COVID-19 in the first version of this guideline, favipiravir was implemented as a new recommendation for progressive mild, moderate or severe cases in the second version, which was published on March 23, 2020. On April 2, 2020, the lopinavir/ritonavir combination was removed from moderate and severe cases and recommended only for pregnant patients (Figure 1). Eventually, favipiravir was widely accepted and used by pulmonologists for moderate and severe COVID-19 cases in Turkey.
Figure 1. The timeline for the treatment protocols applied by the guidelines by the Scientific Board of the Ministry of Health (SBMH) of Turkey.
Real-world data about the effectiveness of antiviral agents, including favipiravir, is limited. TTD-TURCOVID-19 is a registry that contains data from 26 centers in 16 different provinces and thus may be considered representative of Turkey. In this post hoc study, we aimed to investigate the association between antiviral agents, HCQ, and azithromycin and the morbidity of patients of COVID-19 using data from the TTD-TURCOVID-19 registry. Mortality data obtained in this registry have been previously published elsewhere (11).
Materials and methods
Study design
The study was approved by the Institutional Review Board of Gazi University Faculty of Medicine, Ankara, Turkey (356/22.05.2020), and partially supported by the Turkish Thoracic Society (TTS). The study analyzed retrospectively collected data from the hospital records to evaluate the clinical outcomes of hospitalized patients. No informed consent was required, because of the retrospective design of the study, and a waiver of informed consent was obtained for the study from the same institutional review board. All human studies conformed to the ethical principles for medical research involving human subjects, as set out in the World Medical Association Declaration of Helsinki. Patients admitted to 26 different hospitals (17 university hospitals, 2 large tertiary hospitals, 2 secondary care hospitals, and 5 private hospitals) located in 16 different provinces between March 11 and July 18, 2020, were consecutively enrolled, and the details of the study design were published previously (11). Briefly, the inclusion criteria were; (i) adult patients (age of ≥ 16 years) with a diagnosis of COVID 19 according to WHO criteria; a definite diagnosis (proven with a positive PCR test) or probable COVID-19 pneumonia based on a typical clinical presentation following contact with a patient who had a definite diagnosis, together with typical CT findings (predominantly peripheral ground glass opacities with or without areas of consolidation) but not confirmed with a PCR test (12), (ii) patients, who were treated with any of drugs including lopinavir, ritonavir, favipiravir, HCQ, or azithromycin. Patients who did not take any of treatment drugs, and those with incomplete records were excluded. All centers participated in the registry voluntarily following the call by the TTS for TTD-TURCOVID-19 registry.
The final diagnoses were made according to previously published guidelines (12–16). Accordingly, patients were diagnosed with a spectrum of asymptomatic, mild to moderate acute respiratory diseases, including non-severe pneumonia and severe/critical diseases, such as severe pneumonia, adult respiratory distress syndrome (ARDS), multiple organ dysfunction syndrome (MODS), sepsis or septic shock. More than one of these conditions could be registered in the database.
All patients were managed according to the SBMH treatment guidelines (10). Accordingly, patients received HCQ and/or lopinavir/ritonavir, whereas favipiravir was recommended for moderate or severe cases. If a mild case was unresponsive to the initial treatment with HCQ, either lopinavir/ritonavir or favipiravir was added to HCQ. In addition, oseltamivir was recommended for cases in which influenza could not be excluded. Thus, while oseltamivir took part in the early versions of the treatment guidelines regardless of the disease severity, it was removed from the updated guidelines published on April 12, 2020. Similarly, azithromycin was implemented according to physicians’ decision for possible or definitive COVID-19 cases with pneumonia; however, it was excluded from the guidelines in June 2020 (Figure 1).
The clinical data, comorbidities, final diagnoses, laboratory findings, drugs used in the treatment, adverse events, and complications were noted from hospital records. Prolonged QTc was defined as an increase of more than 60 ms (ΔQTc > 60 ms) in QTc intervals compared to pre-treatment ECG or a QTc of 500 ms or above (17). Acute hepatotoxicity and acute renal toxicity were noted by attending physicians based on hepatic test (alanine aminotransferase, ALT or aspartate aminotransferase, AST) abnormalities and renal function test (a reduction in glomerular filtration rate) abnormalities, respectively. The data were recorded in an internet-based database by attending physicians and were rechecked with the source documents for accuracy prior to the statistical analysis.
Primary outcomes of the study were the length of hospitalization, the requirement of an intensive care unit (ICU) and intubation during hospitalization. The secondary outcomes were related to QT prolongation in the electrocardiogram (ECG) and liver and renal function test abnormalities.
Statistical analysis
First, univariate analyses were performed to evaluate the association of treatments with morbidity outcomes. The Mann–Whitney U-test (for continuous variables) and chi-squared test (for categorical variables) were used, and odds ratios (ORs) and 95% confidence intervals (CIs) were calculated for categorical outcomes. Second, multivariate binary logistic regression models for categorical outcomes and generalized linear regression models for numerical outcomes were built to adjust for the effect of potential confounding factors on morbidities. Adjusted beta coefficients (β) and ORs were given to show the effect size in numerical and categorical variables, respectively. Clinically related variables were included in the model if significant at the 10% level according to the univariate analysis results. Multicollinearity was checked by calculating variance inflation factors. All univariate analyses were performed in SPSS for Windows version 22.0, and a two-sided P-value < 0.05 was defined as statistically significant.
Results
A total of 1,500 patients were recruited from the TTD-TURCOVID-19 registry (11). However, the records of treatment data of 8 patients were missing, and 20 patients did not take repurposed drugs for their treatment. Accordingly, the final number of our study population was 1,472 (Figure 2). Of these, the diagnosis was confirmed with PCR in 1,036 (70.4%), and 436 patients (29.6%) had highly probable COVID-19. Of the patients, 57.1% male and 25.4% were ≥ 65 years old (mean age ± SD = 51.9 ± 17.7 years). The median (interquartile range, IQR) for number of comorbidities was 0 (0–1). Of all cases, 1,129 (76.7%) were diagnosed with non-severe pneumonia, whereas 210 (14.3%) had severe pneumonia. A total of 115 (7.8%) were admitted to an ICU, and 69 (4.7%) were intubated during hospitalization. The data on the initial treatment setting were recorded for 1,317 patients. Most of these patients 1,161 (78.9%) were hospitalized in wards, 46 (3.1%) were admitted directly to the ICU, and 110 (7.5%) were treated as outpatients, whereas the initial treatment setting was not recorded in 155 patients (10.5%). The median (IQR) of duration of hospitalization including ICU stay, was 7 (5–12) days. Demographic characteristics, initial treatment setting, and final spectrum of the disease are summarized in Table 1.
Pharmacological therapy
Figure 3 shows the frequency of drugs given to the patients, either alone or in combination with other drugs. HCQ was the most frequently administered drug in the study population. Favipiravir was used in 328 (25.1%) patients. Of these, 307 were taking a combination of medications that included other antiviral or immunomodulatory drugs. Supplementary Figure 1 demonstrates distribution of patients with different drug combinations. A total of 396 patients received antibiotics, other than azithromycin. Overall, the median (IQR) of antibiotics consumed was 0 (0–1).
Figure 3. Frequency of the patients, who were administered any of the given drugs; either alone or in combination with other drugs.
Association of drugs with morbidity
The association of antiviral drugs with morbidity parameters such as the length of hospital stay, ICU need, and the requirement of invasive mechanical ventilation (IMV) were evaluated by univariate and generalized linear regression analyses (Table 2), and by univariate and multivariate binary logistic regression analyses (Tables 3, 4). There was a positive association between an increased risk of lengthy hospital stay and treatment with lopinavir/ritonavir (β [95% CI]: 4.71 [2.31–7.11]; p = 0.001), favipiravir (β [95% CI]: 3.55 [2.56–4.55]; p = 0.001), and HCQ (β [95% CI]: 0.84 [0.02–1.67]; p = 0.046), respectively. Similarly, favipiravir usage was associated with an increased risk of required symptoms for admittance to the ICU (OR [95% CI]: 3.02 [1.70–5.35]; p = 0.001) and IMV (OR [95% CI]: 2.94 [1.28–6.75]; p = 0.011).
Table 4. The association between the use of treatment drugs and the requirement for invasive mechanical ventilation.
Side effects of antiviral drugs
QTc prolongation was present in 37 (3%) of patients. The univariate and subsequent multivariate binary logistic regression analyses with multiple adjustments are shown in Table 5.
Acute hepatic and renal toxicity were present in 79 (6%) and 32 (2.4%) of the patients, respectively. While lopinavir/ritonavir was associated with increased risks both of hepatic (OR [95% CI]: 5.41 [2.30–12.68]; p = 0.001) and renal toxicity (OR [95% CI]: 5.07 [1.29–19.85]; p = 0.02), respectively, there was an association between favipiravir and increased risk of only hepatic toxicity (OR [95% CI]: 3.20 [1.88–5.46]; p = 0.001). Similarly, azithromycin was associated with an increase in the risk for hepatotoxicity (OR [95% CI]: 2.31 [1.34–2.39]; p = 0.003) (Table 6).
Discussion
In the current study, we investigated the association of antiviral drugs including favipiravir, oseltamivir, and lopinavir/ritonavir, and HCQ and azithromycin with morbidity measures such as length of hospital stay, admission to the ICU and IMV. None of the drugs showed an association with the improvement of clinical outcomes. In contrast, favipiravir, lopinavir/ritonavir and HCQ were associated with longer hospitalization. Furthermore, favipiravir was significantly associated with increased the risk of ICU admission and the requirement for IMV. Eventually, these findings suggest that favipiravir, lopinavir/ritonavir and HCQ can worsen the clinical outcomes of COVID-19 patients.
COVID-19 pandemic has challenged the physicians, scientists, and health care providers worldwide with both the increased number of patients and its mortal effects. This led to both physicians, the scientific community, and decision makers to consider repurposing the existing antiviral drugs, immunomodulators, even antibiotics in the treatment of the disease (2–9).
HCQ and azithromycin were used widely as immunomodulators worldwide at the beginning of the pandemic. Several in vitro studies and clinical trials showed that chloroquine had a significant effect on both clinical outcomes and viral clearance of SARS-CoV-2 (18, 19). Consequently, HCQ became a part of the standard regimen in the treatment of COVID-19 in China and many countries and states followed, such as Spain, Iran, Turkey and New York, United States (20). However, subsequent studies did not show clinical benefits from these drugs; therefore, the WHO and several other medical organizations opposed its use except in clinical trials (21–25). The U.S. Food and Drug Administration (FDA) revoked emergency use authorization for chloroquine and HCQ on June 15, 2020, and following results from its Interim Solidarity Trial, WHO discontinued HCQ and lopinavir/ritonavir treatment arms for COVID-19 on July 4, 2020 (21, 22).
In the light of these actions, HCQ was removed from treatment recommendations for COVID-19 in many countries. However, although azithromycin was removed from recommendations in June 2020, HCQ remained in SBMH guidelines until May 2021 (10). As a result, most of our study population used HCQ and azithromycin. When we analyzed our data on the clinical outcomes such as hospital stay, ICU admission, and IMV requirement, neither of these drugs showed a clinical benefit. In contrast, HCQ was associated with an increase in the risk of longer hospital stay.
An anti-influenza drug, oseltamivir, was also recommended by SBMH as an initial therapy for cases in which influenza was confirmed or could not be excluded because the time of the pandemic overlapped with the flu season in the Northern Hemisphere (10). Therefore, approximately half of the patients involved in this study received oseltamivir during the first wave of the pandemic. Unadjusted analysis revealed that oseltamivir was associated with longer hospital stays, and this association reverted with multiple adjustments.
Although the lopinavir/ritonavir combination was originally used for the treatment of acquired immunodeficiency syndrome, it was also included in a standard protocol as an initial treatment for SARS-CoV-1, since initial studies reported their clinical benefits (26–28). After an in vitro study showing the antiviral activity of lopinavir against SARS-CoV-2, the combination of the two drugs was implemented in the treatment of COVID-19 (29). However, several clinical trials failed to demonstrate the efficacy of lopinavir/ritonavir in COVID-19 (22, 30–32). Consequently, the lopinavir/ritonavir combination was removed from the guidelines by SBMH and reserved only for pregnant patients, April 2, 2020 (10). In the current study, lopinavir/ritonavir did not show a beneficial association with parameters studied. In contrast, its administration was associated with longer hospital stays, though it was used in a small proportion of patients during the first few weeks of the pandemic. Although unadjusted analysis showed that it was related to increases in the risks of ICU admission and the need for IMV, additional analysis showed that this increase was not significant for either condition.
Favipiravir is a purine nucleic acid analog that inhibits RNA-dependent RNA polymerase. It is used in Japan as an anti-influenza drug and was also approved for the treatment of COVID-19 patients in China in March 2020 after Wang et al. showed its in vitro efficacy against SARS-CoV-2 (18, 20). However, the drug was not included in guidelines from the WHO or the CDC (13, 33). Favipiravir was implemented as a new recommendation for progressive mild, moderate and severe cases in the SBMH Treatment Guidelines on March 23, 2020, and has retained its standing as a treatment for COVID-19 since then (10). This drug was widely accepted and used by pulmonologists who had to deal with those moderate and severe COVID-19 cases in Turkey during these first months of pandemic (10). Since favipiravir is thought to reduce the duration of symptoms in patients (34), the recommendation of the Ministry of Health of Turkey regarding favipiravir is still ongoing (10). Although some physicians in Turkey are reluctant to prescribe favipiravir to patients, most of them recommend it per SBMH guidelines (10) to avoid legal problems and inform the patient about the effects and adverse effects of the drug.
Our study does not confirm the recommendation by SBMH guidelines, as favipiravir was not associated with any improvement in clinical parameters studied in our study population. These findings are, however, in agreement with those of others, who reported that clinical recovery of patients receiving favipiravir was no better than that of patients receiving lopinavir/ritonavir, with respect to the length of hospital stay, ICU admission or intubations (35). Similarly, in another multicenter, randomized, interventional study, there was no difference between favipiravir, and chloroquine with respect to the length of hospitalization or the need for mechanical ventilation (36). A recent meta-analysis of 12 clinical trials did not show a significant difference in fatality rate and mechanical ventilation requirement between favipiravir treatment and standard care in moderate and severe COVID-19 patients (37).
In our study, favipavir was associated with longer hospitalization and increased risk of ICU admission and IMV requirement in our study population. In line with these findings, a retrospective study on 824 COVID-19 patients reported that ICU admission rates were significantly higher in patients treated with favipiravir (38). However, in their study evaluating the ICU admission rates of COVID-19 patients in two different time periods, i.e., before and after the addition of favipiravir, Guner et al. found that the percentage of cases admitted to the ICU dropped, while the intubation rate among ICU patients decreased after favipiravir was implemented (39). Although authors hypothesized that favipiravir might have played a role in decreasing ICU admissions and intubation rates, they could not unequivocally propose either clinical use of favipiravir or change in treatment algorithms in favor of it (39).
Although favipiravir was reported to have a well-characterized safety profile (40), it has common adverse events including gastrointestinal side effects, increases in serum levels of ALT, AST, and uric acid (40, 41), and prolongation of QT interval in ECG (42, 43). Hepatic and renal side effects, as well as QTc prolongation, may be encountered during lopinavir/ritonavir use for COVID-19 (30, 44). In our study population, lopinavir/ritonavir was associated with increased risks of both hepatic and renal toxicity, and favipiravir and azithromycin were associated with increased risk of hepatotoxicity. None of our drugs was associated with increased risk of QTc prolongation. Although there was a weak association between favipiravir use and QTc prolongation, further analysis, which was adjusted for concomitant HCQ, azithromycin use, number of antibiotics, presence of hypertension or heart failure, revealed that it was not significant.
Our study was not designed to investigate the mechanisms underlying the side effects of drugs that were used in the study patients; however, a possible explanation for the worse morbidity outcomes in lopinavir and favipiravir regimens could be due to the severity of the disease (35). Because, in the beginning of the pandemic, favipiravir was administered to severe or mild cases, which were unresponsive to the initial treatment of HCQ according to the SBMH treatment guidelines (10). However, these drugs retained their association with negative outcome parameters such as longer hospital stay, ICU admission and need of IMV, respectively, after further analysis adjusting these for disease severity, number of comorbidities, age, sex, and use of drugs including antibiotics, HCQ, and azithromycin. Another explanation for negative impacts of these drugs could be due, at least in part, to their adverse effects such as hepatotoxicity and nephrotoxicity.
On October 22, 2020, the FDA approved another anti-viral drug, remdesivir for the treatment of COVID-19 (45) on studies suggesting its beneficiary effects (46–48). In a double-blind, randomized, placebo-controlled trial in adults with COVID-19, remdesivir was found to be effective comparing to placebo in shortening the time to recovery in adults who were hospitalized with COVID-19 and had evidence of lower respiratory tract infection (48). Later, clinical trials reported positive effects of another repurposed anti-viral compound, molnupiravir during the pandemic (49, 50). In a phase 3, double-blind, randomized, placebo-controlled trial of 1,433 patients, molnupiravir reduced the risk of hospitalization or death in the study population (49). In the light of such randomized studies, on December 23, 2021, the FDA issued an emergency use authorization (EUA) for molnupiravir for the treatment of mild to moderate COVID-19 in adults (50). However, these drugs were not available, when we conducted our study.
A comprehensive overview concerning several repurposed drugs and the newly approved vaccines, concluded that repurposed drugs could only be complementary to newly approved SARS-CoV-2 vaccines to attain overall mitigation of the COVID-19 pandemic (51). Although repurposing the existing drugs could be a strategy in such conditions, this strategy should not be applied without the reliable scientific evidence supporting their safety and efficacy. Our study and others have demonstrated that drugs repurposed based on their limited in vitro cellular (18) and clinical effects (19, 34), may not show their efficacy in the clinical setting. They may even have adverse effects on patients’ health. Therefore, even under pandemic conditions, it is clearly unacceptable that some treatments are applied to patients without clear scientific evidence, contrary to the principles of evidence-based treatment (52).
This study has some limitations due to its retrospective nature. TTD-TURCOVID 19 was a country wide registry; therefore, all pulmonology clinics with COVID 19 management facilities were invited to take part in the study, and 26 centers including university hospitals, large tertiary hospitals, secondary care hospitals and private hospitals joined the study. The standards for patient assessment, monitorization, number of pulmonologists, data records, and data collection were not uniform and same in all centers. Therefore, there were missing of data on treatment protocol of patients, drugs used, and location where the initial treatment started. Although most of the centers recorded the data on adverse effects of the drugs such as hepatotoxicity, nephrotoxicity and QTc prolongation, these were not available for some patients. It was not possible to do a head-to-head comparison of drugs used, since the study period comprised the beginning and early months of the pandemic when there were many unknowns about treatment options and the urgent need to treat patients. Therefore, drugs that were found to have limited evidence of antiviral or anti-inflammatory activity against COVID-19 were implemented, and most of the patients received a combination of drugs.
Conclusion
Our study demonstrated that none of repurposed drugs for COVID-19 treatment had a positive association with clinical improvement. On contrary, favipiravir lopinavir/ritonavir and HCQ were associated with longer hospitalization, and additionally, favipiravir was significantly associated with increased the risk of ICU admission and the requirement for IMV suggesting that they can worsen the clinical outcomes of COVID-19 patients. Therefore, even under pandemic conditions, the principles of evidence-based treatment should not be dismissed, and effective pharmacologic agents with proven safety profile and efficacy should be applied.
Data availability statement
The original contributions presented in this study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving human participants were reviewed and approved by Institutional Review Board of Gazi University Faculty of Medicine, Ankara, Turkey (356/22.05.2020). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author contributions
CB, NKk, HBa, OI, FO, AS, ASC, BD, and AK designed the study. CB, NKk, PC, SAB, OKa, PA, II, AAk, YS, OB, EA, SM, CC, AD, BK, BB, HO, GO, ZT, BE, VA, OKi, ME, TU, OAl, EN, OAt, AAy, DC, YG, FF, FD, NKs, MT, GG, SA, TeT, TiT, OO, OD, PY, IB, HBo, IO, SB, BG, FB, OE, IH, HK, GS, OU, MA, GA, BD, EC, EG, OG, YH, MO, and ASC collected the data. SK and SAN analyzed the data. CB, NKk, SK, and HBa searched the literature and wrote the manuscript. CB, NKk, SK, SAB, PC, and HBa edited and revised manuscript according to journal’s instructions. CB, NKk, SK, PC, SAB, and HBa edited and controlled the final version of the manuscript. All authors approved the final version of the manuscript.
Funding
The study was partially funded by the Turkish Thoracic Society.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The reviewer BH declared a shared affiliation with the authors, II and AK to the handling editor at the time of review.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2022.894126/full#supplementary-material
Supplementary Figure 1. Distribution of patients with different drug combinations (Ose, Oseltamivir; HQC, Hydroxychloroquine; Azi, Azithromycin; Fav, Favipiravir; Lop/Ri, Lopinavir/Ritonavir).
References
1. World Health Organization. WHO coronavirus (covid-19) dashboard. Geneva: World Health Organization (2021).
2. Arshad S, Kilgore P, Chaudhry ZS, Jacobsen G, Wang DD, Huitsing K, et al. Treatment with hydroxychloroquine, azithromycin, and combination in patients hospitalized with COVID-19. Int J Infect Dis. (2020) 97:396–403. doi: 10.1016/j.ijid.2020.06.099
3. Catteau L, Dauby N, Montourcy M, Bottieau E, Hautekiet J, Goetghebeur E, et al. Low-dose hydroxychloroquine therapy and mortality in hospitalised patients with COVID-19: A nationwide observational study of 8075 participants. Int J Antimicrob Agents. (2020) 56:106144.
4. Covid-19 Risk and Treatments (Corist) Collaboration. Use of hydroxychloroquine in hospitalised COVID-19 patients is associated with reduced mortality: Findings from the observational multicentre Italian CORIST study. Eur J Intern Med. (2020) 82:38–47.
5. Doi Y, Hibino M, Hase R, Yamamoto M, Kasamatsu Y, Hirose M, et al. A prospective, randomized, open-label trial of early versus late favipiravir therapy in hospitalized patients with COVID-19. Antimicrob Agents Chemother. (2020) 64:e1897–1820. doi: 10.1128/AAC.01897-20
6. Geleris J, Sun Y, Platt J, Zucker J, Baldwin M, Hripcsak G, et al. Observational study of hydroxychloroquine in hospitalized patients with Covid-19. N Engl J Med. (2020) 382:2411–8. doi: 10.1056/NEJMoa2012410
7. Ivashchenko AA, Dmitriev KA, Vostokova NV, Azarova VN, Blinow AA, Egorova AN, et al. AVIFAVIR for treatment of patients with moderate coronavirus disease 2019 (COVID-19): Interim results of a phase II/III multicenter randomized clinical trial. Clin Infect Dis. (2021) 73:531–4. doi: 10.1093/cid/ciaa1176
8. Mitjà O, Corbacho-Monné M, Ubals M, Tebé C, Peñafiel J, Tobias A, et al. Hydroxychloroquine for early treatment of adults with mild Covid-19: A randomized-controlled trial. Clin Infect Dis. (2021) 73:e4073-e4081. doi: 10.1093/cid/ciaa1009
9. Rosenberg ES, Dufort EM, Udo T, Wilberschied LA, Kumar J, Tesoriero J, et al. Association of treatment with hydroxychloroquine or azithromycin with in-hospital mortality in patients with COVID-19 in New York state. JAMA. (2020) 323:2493–502. doi: 10.1001/jama.2020.8630
10. Ministry of Health Rot. Guideline for treatment of adult patients with covid-19. (2022). Available online at: https://covid19.saglik.gov.tr/Eklenti/43095/0/covid-19rehberieriskinhastayonetimivetedavi-12042022pdf.pdf. (accessed July 3, 2022).
11. Kokturk N, Babayigit C, Kul S, Duru Cetinkaya P, Atis Nayci S, Argun Baris S, et al. The predictors of COVID-19 mortality in a nationwide cohort of Turkish patients. Respir Med. (2021) 183:106433. doi: 10.1016/j.rmed.2021.106433
12. World Health Organization. World health organization Covid-19: Case definitions. Case definitions updated in public health surveillance for covid-19. Geneva: WHO (2020).
13. World Health Organization. Clinical management of covid-19: Interim guidance. Geneva: WHO (2020).
14. Ranieri VM, Rubenfeld GD, Thompson BT, Ferguson ND, Caldwell E, Fan E, et al. Acute respiratory distress syndrome: The Berlin definition. JAMA. (2012) 307:2526–33. doi: 10.1001/jama.2012.5669
15. Bone RC, Balk RA, Cerra FB, Dellinger RP, Fein AM, Knaus WA, et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. Chest. (1992) 101:1644–55. doi: 10.1378/chest.101.6.1644
16. Ravelli A, Minoia F, Davì S, Horne A, Bovis F, Pistorio A, et al. 2016 classification criteria for macrophage activation syndrome complicating systemic juvenile idiopathic arthritis: A European league against rheumatism/American College of rheumatology/paediatric rheumatology international trials organisation collaborative initiative. Ann Rheum Dis. (2016) 75:481–9.
17. Antoniou CK, Dilaveris P, Manolakou P, Galanakos S, Magkas N, Gatzoulis K, et al. QT prolongation and malignant arrhythmia: How serious a problem? Eur Cardiol. (2017) 12:112–20. doi: 10.15420/ecr.2017:16:1
18. Wang M, Cao R, Zhang L, Xinglou Y, Jia L, Mingyue X, et al. Remdesivir and chloroquine effectively inhibit the recently emerged novel coronavirus (2019-nCoV) in vitro. Cell Res. (2020) 30:269–71. doi: 10.1038/s41422-020-0282-0
19. Gao J, Tian Z, Yang X. Breakthrough: Chloroquine phosphate has shown apparent efficacy in treatment of COVID-19 associated pneumonia in clinical studies. Biosci Trends. (2020) 14:72–3. doi: 10.5582/bst.2020.01047
20. Wei PF. Diagnosis and treatment protocol for novel coronavirus pneumonia (trial version 7). Chin Med J. (2020) 133:1087–95. doi: 10.1097/CM9.0000000000000819
21. FDA. Coronavirus (covid-19) update: FDA revokes emergency use authorization for chloroquine and hydroxychloroquine. Maryland: FDA (2020).
22. Pan H, Peto R, Henao-Restrepo AM, Preziosi MP, Sathiyamoorthy V, Abdool Karim Q, et al. Repurposed antiviral drugs for covid-19 – interim WHO solidarity trial results. N Engl J Med. (2021) 384:497–511. doi: 10.1056/NEJMoa2023184
23. Cavalcanti AB, Zampieri FG, Rosa RG, Azevedo LCP, Veiga VC, Avezum A, et al. Hydroxychloroquine with or without azithromycin in mild-to-moderate covid-19. N Engl J Med. (2020) 383:2041–52. doi: 10.1056/NEJMx200021
24. Fiolet T, Anthony Guihur A, Edouard Rebeaud ME, Mulot M, Peiffer-Smadja N, Mahamat-Saleh Y. Effect of hydroxychloroquine with or without azithromycin on the mortality of coronavirus disease 2019 (COVID-19) patients: A systematic review and meta-analysis. Clin Microbiol Infect. (2021) 27:19–27. doi: 10.1016/j.cmi.2020.08.022
25. Furtado RHM, Berwanger O, Fonseca HA, Corrêa TD, Ferraz LR, Lapa MG, et al. Azithromycin in addition to standard of care versus standard of care alone in the treatment of patients admitted to the hospital with severe COVID-19 in Brazil (COALITION II): A randomised clinical trial. Lancet. (2020) 396:959–67. doi: 10.1016/S0140-6736(20)31862-6
26. Croxtall JD, Perry CM. Lopinavir/Ritonavir: A review of its use in the management of HIV-1 infection. Drugs. (2010) 70:1885–915. doi: 10.2165/11204950-000000000-00000
27. Yousefi B, Valizadeh S, Ghaffari H, Vahedi A, Karbalaei M, Eslami M. A global treatment for coronaviruses including COVID-19. J Cell Physiol. (2020) 235:9133–42. doi: 10.1002/jcp.29785
28. Chan KS, Lai ST, Chu CM, Tsui E, Tam CY, Wong MM, et al. Treatment of severe acute respiratory syndrome with lopinavir/ritonavir: A multicentre retrospective matched cohort study. Hong Kong Med J. (2003) 9:399–406.
29. Choy KT, Wong AY, Kaewpreedee P, Sia SF, Chen D, Hui KPY, et al. Remdesivir, lopinavir, emetine, and homoharringtonine inhibit SARS-CoV-2 replication in vitro. Antiviral Res. (2020) 178:104786. doi: 10.1016/j.antiviral.2020.104786
30. Cao B, Wang Y, Wen D, Liu W, Wang J, Fan G, et al. A trial of lopinavir-ritonavir in adults hospitalized with severe covid-19. N Engl J Med. (2020) 382:1787–99. doi: 10.1056/NEJMc2008043
31. Wu C, Chen X, Cai Y, Xia J, Zhou X, Xu S, et al. Risk factors associated with acute respiratory distress syndrome and death in patients with coronavirus disease 2019 pneumonia in Wuhan, China. JAMA Intern Med. (2020) 180:934–43. doi: 10.1001/jamainternmed.2020.0994
32. Recovery Collaborative Group. Lopinavir-ritonavir in patients admitted to hospital with COVID-19 (RECOVERY): A randomised, controlled, open-label, platform trial. Lancet. (2020) 396:1345–52.
33. Centers for Disease Control and Prevention. Interim clinical guidance for management of patients with confirmed coronavirus disease (covid-19). Atlanta GA: Centers for Disease Control and Prevention (2020).
34. Manabe T, Kambayashi D, Akatsu H, Kudo K. Favipiravir for the treatment of patients with COVID-19: A systematic review and meta-analysis. Br MC Infect Dis. (2021) 21:489. doi: 10.1186/s12879-021-06164-x
35. Solaymani-Dodaran M, Ghanei M, Bagheri M, Qazvini A, Vahedi E, Hassan Saadat S, et al. Safety and efficacy of favipiravir in moderate to severe SARS-CoV-2 pneumonia. Int Immunopharmacol. (2021) 95:107522. doi: 10.1016/j.intimp.2021.107522
36. Dabbous HM, Abd-Elsalam S, El-Sayed MH, Sherief AF, Ebeid FFS, El Ghafar MSA, et al. Efficacy of favipiravir in COVID-19 treatment: A multi-center randomized study. Arch Virol. (2021) 166:949–54. doi: 10.1007/s00705-021-04956-9
37. Özlüşen B, Kozan Ş, Akcan RE, Kalender M, Yaprak D, Peltek İB, et al. Effectiveness of favipiravir in COVID-19: A live systematic review. Eur J Clin Microbiol Infect Dis. (2021) 40:2575–83. doi: 10.1007/s10096-021-04307-1
38. Guner R, Hasanoglu I, Kayaaslan B, Aypak A, Akinci E, Bodur H, et al. Comparing ICU admission rates of mild/moderate COVID-19 patients treated with hydroxychloroquine, favipiravir, and hydroxychloroquine plus favipiravir. J Infect Public Health. (2021) 14:365–70. doi: 10.1016/j.jiph.2020.12.017
39. Guner AE, Surmeli A, Kural K, Yilmaz H, Kocayigit E, Sahin E, et al. ICU admission rates in Istanbul following the addition of favipiravir to the national COVID-19 treatment protocol. North Clin Istanb. (2021) 8:119–23. doi: 10.14744/nci.2021.60420
40. Pilkington V, Pepperrell T, Hill A. A review of the safety of favipiravir – a potential treatment in the COVID-19 pandemic? J Virus Erad. (2020) 6:45–51. doi: 10.1016/S2055-6640(20)30016-9
41. Joshi S, Parkar J, Ansari A, Vora A, Talwar D, Tiwaskar M, et al. Role of favipiravir in the treatment of COVID-19. Int J Infect Dis. (2021) 102:501–8. doi: 10.1016/j.ijid.2020.10.069
42. Chinello P, Petrosillo N, Pittalis S, Biava G, Ippolito G, Nicastri E, et al. Qtc interval prolongation during favipiravir therapy in an ebolavirus-infected patient. PLoS Negl Trop Dis. (2017) 11:e0006034. doi: 10.1371/journal.pntd.0006034
43. Naksuk N, Lazar S, Peeraphatdit TB. Cardiac safety of off-label COVID-19 drug therapy: A review and proposed monitoring protocol. Eur Heart J Acute Cardiovasc Care. (2020) 9:215–21. doi: 10.1177/2048872620922784
44. Sun J, Deng X, Chen X, Huang J, Huang S, Li Y, et al. Incidence of adverse drug reactions in COVID-19 patients in China: An active monitoring study by hospital pharmacovigilance system. Clin Pharmacol Ther. (2020) 108:791–7. doi: 10.1002/cpt.1866
45. U.S. Food and Drug Administration.FDA approves first treatment for COVID-19. (2020). Available online at: https://www.fda.gov/news-events/press-announcements/fda-approves-first-treatment-covid-19 (accessed April 15, 2022)
46. Spinner CD, Gottlieb RL, Criner GJ, Arribas López JR, Cattelan AM, Soriano Viladomiu A, et al. Effect of remdesivir vs standard care on clinical status at 11 days in patients with moderate COVID-19: A Randomized clinical trial. JAMA. (2020) 324:1048–57. doi: 10.1001/jama.2020.16349
47. Wit TJ, Kaka AJ, MacDonald R, Linskens EJ, Langsetmo L, Vela K, et al. Remdesivir for adults with COVID-19: A living systematic review for an American college of physicians practice points. Ann Intern Med. (2021) 174:209–20. doi: 10.7326/M20-5752
48. Beigel JH, Tomashek KM, Dodd LE, Mehta AK, Zingman BS, Kalil AC, et al. Remdesivir for the treatment of Covid-19-final report. N Engl J Med. (2020) 383:1813–26. doi: 10.1056/NEJMoa2007764
49. Jayk Bernal A, Gomes da Silva MM, Musungaie DB, Kovalchuk E, Gonzalez A, Delos Reyes V, et al. Molnupiravir for oral treatment of Covid-19 in nonhospitalized patients. N Engl J Med. (2022) 386:509–20. doi: 10.1056/NEJMoa2116044
50. U.S. Food and Drug Administration. Coronavirus (COVID-19) update: FDA Authorizes additional oral antiviral for treatment of COVID-19 in certain adults. (2021). https://www.fda.gov/news-events/press-announcements/coronavirus-covid-19-update-fda-authorizes-additional-oral-antiviral-treatment-covid-19-certain (accessed 15 April 2022)
51. Al-Karmalawy AA, Soltane R, Abo Elmaaty A, Tantawy MA, Antar SA, Yahya G, et al. Coronavirus disease (COVID-19) control between drug repurpising and vaccination: A comprehensive overview. Vaccines. (2021) 9:1317. doi: 10.3390/vaccines9111317
Keywords: antiviral agents, COVID-19 morbidity, length of hospitalization, ICU requirement, invasive mechanical ventilation
Citation: Babayigit C, Kokturk N, Kul S, Cetinkaya PD, Atis Nayci S, Argun Baris S, Karcioglu O, Aysert P, Irmak I, Akbas Yuksel A, Sekibag Y, Baydar Toprak O, Azak E, Mulamahmutoglu S, Cuhadaroglu C, Demirel A, Kerget B, Baran Ketencioglu B, Ozger HS, Ozkan G, Ture Z, Ergan B, Avkan Oguz V, Kilinc O, Ercelik M, Ulukavak Ciftci T, Alici O, Nurlu Temel E, Ataoglu O, Aydin A, Cetiner Bahcetepe D, Gullu YT, Fakili F, Deveci F, Kose N, Tor MM, Gunluoglu G, Altin S, Turgut T, Tuna T, Ozturk O, Dikensoy O, Yildiz Gulhan P, Basyigit I, Boyaci H, Oguzulgen IK, Borekci S, Gemicioglu B, Bayraktar F, Elbek O, Hanta I, Kuzu Okur H, Sagcan G, Uzun O, Akgun M, Altinisik G, Dursun B, Cakir Edis E, Gulhan E, Oner Eyuboglu F, Gultekin O, Havlucu Y, Ozkan M, Sakar Coskun A, Sayiner A, Kalyoncu AF, Itil O and Bayram H (2022) The association of antiviral drugs with COVID-19 morbidity: The retrospective analysis of a nationwide COVID-19 cohort. Front. Med. 9:894126. doi: 10.3389/fmed.2022.894126
Received: 11 March 2022; Accepted: 11 August 2022;
Published: 31 August 2022.
Edited by:
Esmaeil Mortaz, National Research Institute of Tuberculosis and Lung Diseases (NRITLD), IranReviewed by:
Burcin Halacli, Hacettepe University, TurkeyAhmed Mostafa, National Research Centre, Egypt
Juliana Ferreira, University of São Paulo, Brazil
Copyright © 2022 Babayigit, Kokturk, Kul, Cetinkaya, Atis Nayci, Argun Baris, Karcioglu, Aysert, Irmak, Akbas Yuksel, Sekibag, Baydar Toprak, Azak, Mulamahmutoglu, Cuhadaroglu, Demirel, Kerget, Baran Ketencioglu, Ozger, Ozkan, Ture, Ergan, Avkan Oguz, Kilinc, Ercelik, Ulukavak Ciftci, Alici, Nurlu Temel, Ataoglu, Aydin, Cetiner Bahcetepe, Gullu, Fakili, Deveci, Kose, Tor, Gunluoglu, Altin, Turgut, Tuna, Ozturk, Dikensoy, Yildiz Gulhan, Basyigit, Boyaci, Oguzulgen, Borekci, Gemicioglu, Bayraktar, Elbek, Hanta, Kuzu Okur, Sagcan, Uzun, Akgun, Altinisik, Dursun, Cakir Edis, Gulhan, Oner Eyuboglu, Gultekin, Havlucu, Ozkan, Sakar Coskun, Sayiner, Kalyoncu, Itil and Bayram. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hasan Bayram, aGFiYXlyYW1Aa3UuZWR1LnRy
†ORCID: Cenk Babayigit, orcid.org/0000-0001-9760-6081; Nurdan Kokturk, orcid.org/0000-0002-2889-7265; Seval Kul, orcid.org/0000-0002-4716-9554; Pelin Duru Cetinkaya, orcid.org/0000-0002-4428-8590; Sibel Atis Nayci, orcid.org/0000-0002-8415-5717; Serap Argun Baris, orcid.org/0000-0002-4429-9441; Oguz Karcioglu, orcid.org/0000-0002-6071-0851; Oya Baydar Toprak, orcid.org/0000-0001-7320-976X; Emel Azak, orcid.org/0000-0002-4532-2893; Zeynep Ture, orcid.org/0000-0001-6895-0318; Begum Ergan, orcid.org/0000-0003-2920-9214; Vildan Avkan Oguz, orcid.org/0000-0001-7648-7730; Oguz Kilinc, orcid.org/0000-0001-8923-4476; Merve Ercelik, orcid.org/0000-0003-4597-7168; Esra Nurlu Temel, orcid.org/0000-0003-4618-168X; Ozlem Ataoglu, orcid.org/0000-0002-3308-8219; Yusuf Taha Gullu, orcid.org/0000-0001-8165-234X; Fusun Fakili, orcid.org/0000-0002-1602-5240; Neslihan Kose, orcid.org/0000-0001-5241-4043; Muge Meltem Tor, orcid.org/0000-0003-2585-104X; Sedat Altin, orcid.org/0000-0001-7521-8651; Onder Ozturk, orcid.org/0000-0001-8570-2172; Oner Dikensoy, orcid.org/0000-0003-1161-6225; Pinar Yildiz Gulhan, orcid.org/0000-0002-5347-2365; Ilknur Basyigit, orcid.org/0000-0001-7706-9311; Hasim Boyaci, orcid.org/0000-0003-2744-9898; Sermin Borekci, orcid.org/0000-0002-0089-1312; Bilun Gemicioglu, orcid.org/0000-0001-5953-4881; Osman Elbek, orcid.org/0000-0002-8968-2436; Metin Akgun, orcid.org/0000-0003-3404-4274; Goksel Altinisik, orcid.org/0000-0001-6869-1301; Ebru Cakir Edis, orcid.org/0000-0002-8791-5144; Erkmen Gulhan, orcid.org/0000-0002-1143-9655; Fusun Oner Eyuboglu, orcid.org/0000-0002-1137-7108; Okkes Gultekin, orcid.org/0000-0001-9753-8744; Yavuz Havlucu, orcid.org/0000-0002-7441-288X; Metin Ozkan, orcid.org/0000-0002-5298-4916; Aysin Sakar Coskun, orcid.org/0000-0002-9280-8706; Abdullah Sayiner, orcid.org/0000-0002-6788-9727; Oya Itil, orcid.org/0000-0003-3545-4419; Hasan Bayram, orcid.org/0000-0002-5236-766X