- 1Facultad de Ingeniería y Negocios, Universidad de Las Américas, Sede Providencia, Santiago, Chile
- 2Departamento de Nutrición y Bioquímica, Facultad de Ciencias, Pontificia Universidad Javeriana, Sede Bogotá, Bogotá, Colombia
- 3Department of Molecular Genetics and Microbiology, Biological Sciences Faculty, Pontifical Catholic University of Chile, Santiago, Chile
- 4Universidad Externado de Colombia, Departamento de Matemáticas, Bogotá, Colombia
- 5Centro de Investigaciones Biológicas Margarita Salas (CIB-CSIC), Madrid, Spain
- 6Instituto de Ciencias Biomédicas, Universidad Autónoma de Chile, Santiago, Chile
- 7Research Center for the Development of Novel Therapeutic Alternatives for Alcohol Use Disorders, Santiago, Chile
The coronavirus disease 2019 pandemic accelerated drug/vaccine development processes, integrating scientists all over the globe to create therapeutic alternatives against this virus. In this work, we have collected information regarding proteins from SARS-CoV-2 and humans and how these proteins interact. We have also collected information from public databases on protein–drug interactions. We represent this data as networks that allow us to gain insights into protein–protein interactions between both organisms. With the collected data, we have obtained statistical metrics of the networks. This data analysis has allowed us to find relevant information on which proteins and drugs are the most relevant from the network pharmacology perspective. This method not only allows us to focus on viral proteins as the main targets for COVID-19 but also reveals that some human proteins could be also important in drug repurposing campaigns. As a result of the analysis of the SARS-CoV-2–human interactome, we have identified some old drugs, such as disulfiram, auranofin, gefitinib, suloctidil, and bromhexine as potential therapies for the treatment of COVID-19 deciphering their potential complex mechanism of action.
Introduction
The recent pandemic is caused by a coronavirus (CoV), which elicits severe acute respiratory syndrome (SARS), an infectious disease named COVID-19. Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) emerged in late 2019 in Wuhan, China, where a pneumonia of unknown cause was detected (Zhou et al., 2020). To date, more than 445 million people have been infected and it has caused the death of approximately 5.9 million people worldwide (World Health Organization, 2020). SARS-CoV-2 is a positive-sense RNA virus belonging to the Orthocoronavirinae family, as well as another disease-causing virus such as the Middle East respiratory syndrome (MERS-CoV) or SARS-CoV (Rothan and Byrareddy, 2020).
One of the most important characteristics of SARS-CoV-2 is its transmissibility dynamics because of its highly efficient transmission mechanisms. This infectious agent is usually spread in the respiratory system via inhalation of droplets and/or direct contact, leading to a manifestation of a respiratory dysfunction causing pneumonia in severe infections (Zhang et al., 2020). Interactions between the virus and the host cells are mediated by the direct contact between the spike protein on the virus surface and the ACE2 (angiotensin-converting enzyme 2) membrane receptor in humans, which is widely distributed in many tissues affecting different organs, such as the lungs, heart (Dhakal et al., 2020), kidneys (Fanelli et al., 2020), liver (Wang et al., 2020), and brain (Li et al., 2020), leading to multiorgan failure in severe cases in susceptible individuals (Hamming et al., 2004).
In January 2020, the first genome sequence of SARS-CoV-2 was published (Ren et al., 2020). In addition, to date, there are more than 1,500 entries related to SARS-CoV-2 in the Protein Data Bank (Berman et al., 2000) and 1.4 million assays related to SARS-CoV-2 from the ChEMBL database (Gaulton et al., 2012, 2017), which shows the relevance of this pandemic and the impact in the scientific community, generating a large amount of the data.
Apart from vaccines developed to prevent SARS-CoV-2 transmission and severe COVID-19, the lack of knowledge about potential therapeutic targets, both human and viral, delays the urgent need for effective antiviral development as effective COVID-19 treatments as well as to treat future waves of infection. At present, different approved therapeutic drugs and late-stage clinical drug candidates are being tested for COVID-19 treatment from a drug repurposing approach (Pandey et al., 2020; Sultana et al., 2020).
The basic principle involved in drug repurposing is the use of a previously characterized drug (with a knowledgeable safety assessment, preclinical testing, and formulation development) in other therapies, thus reducing the time required for a new drug to be developed (Talevi and Bellera, 2020). By contrast, it is well known that one of the main goals of systems pharmacology is to integrate and analyze multiomics and clinical data to contribute to the progress of the drug design pipeline, including the identification and characterization of key molecular targets for a given disease such as COVID-19. For instance, the construction of protein–protein, protein–drug, and protein–gene interaction networks, the elucidation of biological and therapeutical effects of the drugs studied, and the determination of possible drug interactions with other targets may lead to a polypharmacological profile according to the interaction with on- and off-targets (Boran and Iyengar, 2010). The ideal scenario would be developing a drug with positive therapeutic effects due to the increased on-target–drug interactions, which would reduce the adverse effects due to the decreased off-target–drug interactions (Iturriaga-Vásquez et al., 2015; Reyes-Parada and Iturriaga-Vasquez, 2016). Thus, the complex and resource-consuming drug design process is shifting from the reductionist 1-target <–> 1-drug model to a new paradigm where the drug polypharmacological profile is widely desired, especially for complex diseases such as COVID-19. The experimental and computational integration of systems biology into polypharmacology broadens the systems pharmacology definition to include the analysis of complex networks at different scales. This provides valuable information to characterize the therapeutic effects of drugs and obtain key elements in the development of new therapeutic alternatives (Zhao and Iyengar, 2012).
The identification of interactions between drugs and target proteins is a key area in genomic drug discovery (Gupta et al., 2021). Since experimental determination of ligand–protein interactions or potential drug–target interactions remains particularly challenging, effective in silico prediction methods using drug–target interactions can provide complementary and supporting evidence to experimental studies (Paul et al., 2021). Drug–protein interaction (DPI) networks do not have a bipartite structure when drug–drug and/or protein–protein interactions (PPIs) are present in the network (Galan-Vasquez and Perez-Rueda, 2021). When those interactions are not present in the network, the structure is not bipartite (Janga and Tzakos, 2009; Vogt and Mestres, 2010). In the case of SARS-CoV-2, several databases (such as ClinicalTrials, ChEMBL, DrugBank, and PubChem) contain relevant data to analyze bioactive ligand–protein interactions. In addition, with all the publications related to the COVID-19 pandemic published since late 2019, it is possible to obtain and characterize the SARS-CoV-2 interactome. In this work, we have collected SARS-CoV-2 interactome information from different research articles and databases. We characterize virus–human, virus–virus, and human–human protein interactions relevant to COVID-19. The data were analyzed using network pharmacology including reported drugs (from ChEMBL) that present activity against the identified proteins. With these data, we proposed consensus PPI and DPI networks involved in this disease and identified the FDA-approved drugs, namely, disulfiram, auranofin, gefitinib, suloctidil, and bromhexine, with polypharmacological profiles as good candidates for drug repurposing to treat COVID-19.
Materials and methods
Data curation of Human-SARS-CoV-2 interactome
Three datasets were used to build the human–SARS-CoV-2 interactome. The first source of data was a protein interaction map for 26 of the 29 SARS-CoV-2 proteins, and the human proteins physically interact with the viral proteins developed by Gordon et al. (2020). Thus, the data were retrieved from the Krogan’s Lab website (https://ppi.zoiclabs.io/#/- Last accession date 2021-08-31). The second dataset was obtained from the BioID-based interactome of the SARS-CoV-2 proteome (Samavarchi-Tehrani et al., 2020), which takes into account known interactions for SARS-CoV-2 available in BioGRID77 (version 3.5.188) (Stark et al., 2006). The third dataset was obtained from data available for SARS-CoV-2 proteins in the UniProt database (The UniProt Consortium, 2014).
Protein–protein interactions network (PPI)
We developed a pipeline using Knime analytics platform v4.3.0 (Berthold et al., 2009) to obtain human PPI from the STRING database (Szklarczyk et al., 2021) for each protein obtained in the three datasets previously mentioned. All these data were used to construct a human–virus PPI network using Cytoscape software v3.8.2 (Shannon et al., 2003). Then, both SARS-CoV-2 and human proteins were subjected to enrichment of significant Gene Ontology (GO) terms for biological process, molecular function, and cellular component using the UniProt database crossreference function from the GO database (Ashburner et al., 2000; Carbon et al., 2021) (Supplementary Table S1). Human–human protein interactions were also extracted from the STRING database.
Drug–protein interactions network (DPI)
DPI network is composed of two types of nodes: different drugs classified as small molecules and molecular targets defined as proteins present in humans or the SARS-CoV-2 virus.
We retrieved this information from the ChEMBL database in the section associated with SARS-CoV-2 (release: ChEMBL29, last accession date 2021-09-12). Then, we selected drugs with the following criteria: “small molecule,” “single-protein,” and report information on “max Phase” (0, 1, 2, 3, and 4), activity as IC50 (concentration at half-maximum inhibition) and Ki (inhibitor constant for the protein–inhibitor complex). For drugs that reported more than one IC50 or Ki value against a biological target, the highest reported value was considered. In addition, we searched for the target associated with each drug in the “single-protein” section of the ChEMBL database, and only targets from human or SARS-CoV-2 organisms were considered. This was conducted through multiple ChEMBL queries (Nowotka et al., 2017), using an in-house script to automate the process. Then, the data were filtered, and drugs (in phase = 4) that interact with an identified target were kept. Next, we use an activity threshold of 5 µM for IC50 and Ki reported activities and kept drugs under this value. We also include drugs with antiviral activity against SARS-CoV-2 recently studied by our group (Ginex et al., 2021). At last, using these data, a DPI network was built using Cytoscape. The pipeline constructed to accomplish the construction of the DPI network is available at https://cutt.ly/HYXDFz6.
Network analysis
For all the network analysis, R v4.1.1 (R Core Team (2018). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Available online at https://www.R-project.org/) was used to compute topological parameters for each protein and drug in both PPI and DPI networks to understand the relevance of each protein (node) in the network according to the graph theory (Badkas et al., 2021). The topological measures considered were degree, which in a graph is the number of edges that are incident to a vertex. Centrality (also known as eigenvector centrality or prestige score) is a measure of the influence of a node in a network that indicates those nodes connected to other nodes who themselves have high scores (it can be found with the eigenvalues of the adjacency matrix of the graph). Betweenness (also known as betweenness centrality) measures the number of shortest paths that pass through a node, detecting the amount of influence a node has over the flow of information in a graph. Pagerank gives an immediate evaluation of the regulatory relevance of a node; this algorithm was invented by the creators of Google and the idea comes from Markov chains and random walks in the graph. In addition, closeness (also known as closeness centrality) is calculated as the reciprocal of the sum of the length of the shortest paths between a given node and all other nodes in the graph. These topological measures were considered for the network analysis of both interaction networks because they may indicate the regulatory relevance of a node or the capability of communication between nodes in a network, either a protein or a drug. These parameters were obtained and normalized to identify the nodes with the best (top 50%) parameters, with exception of closeness, where the top 1% nodes were selected for further analysis. To identify those nodes that break down the network into two or more components or subnetworks when a specific node is removed, we conducted a network disconnection analysis using graph algorithms (Bang et al., 2019). The code used to perform the previously described network analysis is available at https://cutt.ly/UYXDLgy.
Results
PPI network for human and SARS-CoV-2
The human–SARS-CoV-2 PPI network is composed of 665 proteins, from which 26 proteins correspond to viral proteins, and the remaining 639 proteins are human interacting proteins. The network has 1,176 edges (connections between proteins). Having as a starting point the interactome presented by Krogan’s Lab (Gordon et al., 2020), which identified 332 viral–human interactions for 27 SARS-CoV-2 proteins, we constructed a viral–human protein–protein interactome enriched with an additional 307 human proteins obtained from other two datasets (see the materials and methods section), as well as an enrichment of the human PPIs using STRING database (Figure 1).
FIGURE 1. Protein–protein interaction (PPI) network between human–severe acute respiratory syndrome coronavirus 2 proteins. Viral and human proteins are shown in orange and gray, respectively. Proteins with crystallized structures deposited on the Protein Data Bank are shown as diamonds.
The topology parameters (degree, eigenvector centrality, betweenness, pagerank, and closeness) measured for the PPI network suggested a total of 31 proteins, 13 from SARS-CoV-2 (six of these are nonstructural proteins, which share the UniProt ID P0DTC1) and 18 from humans. These proteins met a threshold above 50% for a degree, eigenvector centrality, betweenness, and pagerank, as well as a threshold above 99% for closeness (Supplementary Table S2). Proteins were defined as top proteins because of their importance for the network connection, central role in protein communication, and potential regulators of the underlying biological process (Scardoni et al., 2015). The intersection of these proteins according to each topological parameter is represented in Supplementary Figure S1, where it is observed that there are 12 human proteins (CDK5RAP, CENPF, CEP112, CEP135, CEP250, CEP350, CEP43, CEP68, CNTRL, NIN, NINL, and PCNT) that are in the top 50% according to the eigenvector centrality parameter, and the CEP protein family is an active composition element of the centrosome, playing a key role in centriole biogenesis and cell cycle progression control (Kumar et al., 2013). Five human proteins (CISD2, RPL3, RPS27, RPS3, and SEC22B) and one viral protein (E) are in the top 50% according to degree and betweenness, and four viral proteins (N, Nsp8, Nsp9, and Orf8) are in the top 50% according to pagerank, degree, and betweenness. The M and Nsp7 viral proteins are in the top 50% according to closeness, pagerank, degree, and betweenness, and the human protein RAB1A and the viral protein Nsp14 are in the top 50% according to closeness and betweenness. Orf9b and Orf9c viral proteins are in the top 50% according to pagerank. Nsp13 is in the top 50% according to pagerank, eigenvector centrality, degree, and betweenness. The spike viral protein is in the top 50% according to pagerank and degree, and the viral protein Nsp12 is in the top 50% according to pagerank and betweenness (Supplementary Table S2).
The subnetwork composed of the 31 top proteins is presented in Supplementary Figure S2, where it can be observed that the viral proteins Nsp7, Nsp13, Nsp14, Orf8, M, E, and Spike are the most connected with human top proteins. The viral protein Nsp13 interacts with 12 human proteins (CNTRL, CEP68, CEP43, CEP350, CEP250, CEP135, CEP112, CENPF, CDK5RAP2, PCNT, NINL, and NINL); some of them belong to the CEP family and are localized in the centrosome, Golgi, and cytosol as shown by affinity purification–mass spectrometry results (Miserey-Lenkei et al., 2021). In COVID-19, Nsp13 damages physiological interactions in the structure of cilia through centrosome binding, disrupting the interaction between the centriole and cilia, leading to deciliation (Najafloo et al., 2021). Our analysis allows us to observe that these proteins are quite interconnected and that they are very important for the PPI network. Therefore, modulating one or more of these proteins could exert a significant effect on the interaction of the virus SARS-CoV-2 with the human host cells.
To identify key nodes using other parameters, we conducted a disconnection analysis using graph algorithms. The main idea is to remove a node from the network (Figure 1) and evaluate what happens to it. The disconnection analysis resulted in a total of 24 proteins, 2 human (RAB8A, which interacts with NSP7, and PRRC2B, which interacts with NSP12) and 22 viral proteins, which disconnected the graph in at least two components (Supplementary Table S3). There were six viral proteins common in the results of both the topological and disconnection analysis (Table 1).
TABLE 1. Proteins of the protein–protein interaction network that resulted as key proteins from the topological analysis and generated a graph disconnection in the cutoff analysis.
DPI network
There are 8,208 compounds associated with the SARS-CoV-2 virus in the ChEMBL database. Our first selection considered only drugs/compounds labeled as “small molecule,” and that interacts with a target labeled as “single-protein,” as well as with reported information on both “max Phase” (0, 1, 2, 3, or 4) and experimental activity (IC50 and Ki), which reduced our data set to 1999 drugs/compounds. For these 1,999 molecules, there are 1,279 associated targets from human or SARS-CoV-2 organisms. At last, considering only phase = 4 drugs (marketed drugs), activity threshold IC50 or Ki ≤ 5,000 nM, and adding reported drugs from literature, the total data set was 868 drugs and 683 targets. To visualize the data, we built a DPI network that had a total of 1,549 nodes (corresponding to proteins and drugs) and 5,017 edges. Moreover, we added five labels to identify each node: 1) yellow for human targets, 2) orange for viral targets, 3) red for drugs interacting with human targets, 4) green for drugs interacting with viral targets, and 5) blue for drugs that interact with both viral and human targets (Figure 2).
FIGURE 2. Drug–protein interaction (DPI) network. Human/viral proteins and drugs are shown as circles and diamonds, respectively.
In the DPI network (Figure 2), there are 680 human proteins (yellow) and 838 drugs (red) that interact with 499 of those human proteins. The remaining 181 human proteins interact with both groups of drugs at the same time (red and blue). The drug information obtained from the ChEMBL database does not allow us to differentiate which specific viral protein could be interacting with a given drug, unlike the PPI network, which does have information on specific viral proteins. Therefore, only two viral proteins are represented in the DPI network (orange), the replicase polyprotein 1 ab (R1AB-SARS2) and spike protein from SARS-CoV-2. Information from both PPI and DPI networks was merged, and 28 common human proteins were obtained (Supplementary Figure S3). Of these 28 common proteins found, we can highlight some that interact with more than one viral protein. For example, CISD2 reports eight interactions with viral proteins such as Orf3, Orf6, Orf7, Orf8, Nsp4, M, E, and Spike. CYP51A1 has interactions with three viral proteins, namely, Orf3, Nsp6, and E, and both HDAC2 and TBK1 proteins present two interactions with viral proteins. The first one is reported to interact with Nsp5 and Nsp13, and the second one with Nsp13 and Nsp6 as shown in Supplementary Figure S3.
With the filters applied to our pipeline, we found 17 drugs (green) interacting with both R1AB-SARS2 and spike viral proteins (Figure 2), from which 12 interact with R1AB-SARS2 and 5 drugs (ivermectin, ascorbic acid, dalcetrapib, nitazoxanide, and trifluoperazine) are reported to interact with the spike protein (Supplementary Table S4). The most relevant information obtained with the DPI networks was the identification of 13 drugs (blue) that interacts simultaneously with both viral and human proteins (Figure 2), which gives an indication that these drugs may have an antiviral potential because of their polypharmacological profile. In Figure 3, a DPI subnetwork is presented, where reported interactions of viral proteins with different drugs are shown in more detail. We focus on multitarget drugs that interact with both virus and human proteins (blue diamonds); among which, we can find tenatoprazole, lansoprazole, pyrothione zinc, bedaquiline, disulfiram, auranofin, thimerosal, hexachlorophene, gefitinib, suloctidil, and bromhexine. The human proteins (yellow) that interact with at least two drugs are highlighted with red borders. These proteins were considered key human targets because of their ability to be modulated by multitarget drugs that also interact with viral proteins. This viral/human polypharmacological effect could be the key behind its antiviral activity and is summarized in the multitarget interaction profile shown in Figure 4.
FIGURE 3. DPI subnetwork. Human and viral proteins are shown as yellow and orange circles, respectively. Drugs that interact only with viral targets are shown as green diamonds and drugs that interact with both viral and human targets as blue diamonds. Yellow circles with a red border represent human proteins interacting with at least two drugs, which also interact with one or more viral proteins.
FIGURE 4. Multitarget interaction profile of the potential antiviral drug. Diagram summarizing drug interactions to key human proteins (black) and viral proteins (orange).
These data reveal potentially repurposable drugs and new mechanisms of action for SARS-CoV-2 infection and COVID-19 treatment. Among the key targets, we found the adenosine A3 receptor (ADORA3), which is overexpressed in inflammatory cells. ADORA3 agonists induce downregulation of the NFkB signaling pathway, resulting in decreased TNF-α levels by monocytes and synoviocytes resulting in an anti-inflammatory effect. Adenosine has been proposed with the potential to act in acute lung injury as a local anti-inflammatory (Caracciolo et al., 2021). We identified that hexachlorophene, thimerosal, disulfiram, and auranofin interact with ADORA3. In addition, the alpha-2 adrenergic receptors (ADRA2A, ADRA2B, and ADRA2C) play a role in immune cell activity and inflammatory cytokine production. ADRA2 agonists moderate immune and inflammatory processes and improve oxygenation through physiologic respiratory parameters. ADRA2 agonists are believed to reduce mortality related to hyperinflammation and acute respiratory failure in COVID-19 patients, as well as to have immunomodulatory effects by maintaining endothelial junction integrity and reducing immune cell activity even when an inflammatory stimulus is present (Hamilton et al., 2022). We found that ADRA2A interacts with hexachlorophene, thimerosal, disulfiram, and auranofin; ADRA2B interacts with thimerosal, disulfiram, and auranofin; and ADRA2C interacts with hexachlorophene and thimerosal.
Our analysis showed five core proteins from the epidermal growth factor receptor (EGFR)/mitogen-activated protein kinase (MAPK) pathway interacting with the drugs shown in Figure 4: MAPK3, MAPK1, MAPK14, EGFR, and ERBB2. MAPKs are serine-threonine kinases, also known as extracellular signal-regulated kinases (ERKs). These proteins act in a signaling cascade that regulates proliferation, differentiation, and cell cycle progression in response to a variety of extracellular stimuli (Hutcheson et al., 2003) and are considered therapeutic targets for COVID-19 infection because of their involvement in the platelet activation processes leading to inflammation (Asiedu et al., 2021). EGFR and ERBB2 are transmembrane receptor tyrosine kinases from the erbB family and are involved in the EGFR pathway (Liang et al., 2021). It has been found that EGFR may modulate the wound healing response to SARS-CoV and that the EGFR pathway is a prime target for therapeutic interventions to reduce fibrosis after respiratory virus infection (Venkataraman and Frieman, 2017). SARS-CoV-2 has been demonstrated to have a dependence on the EGFR/MAPK signaling pathway. In an in vitro characterization of pulmonary fibrosis due to COVID-19, a dual antifibrotic and antiviral activity of EGFR/ErbB inhibitors has been identified in living host lung cells. This validation demonstrates the utility of targeting this pathway by EGFR/ErbB inhibitors, to achieve a downregulation of ERKs in COVID-19 treatment (Vagapova et al., 2021). In our analysis, MAPK3 interacts with disulfiram, hexachlorophene, and thimerosal; MAPK1 interacts with hexachlorophene and suloctidil; and EGFR, ERBB2, and MAPK14 interact with gefitinib and hexachlorophene.
Other targets found with our network pharmacology pipeline were the proto-oncogene tyrosine–protein kinase Fyn (FYN) and the Cytochrome P450 1A2 (CYP1A2). FYN interacts with gefitinib, hexachlorophene, and auranofin. Transcriptomic analysis suggests that FYN interacts with Spike in the infection process of SARS-CoV-2. In addition, there is evidence proving that the virus causes FYN dysregulation, an event linked with Αβ accumulation, Tau hyperphosphorylation, and innate immunity during COVID-19 (Vavougios et al., 2021). CYP1A2 is involved in drug metabolism and cholesterol synthesis. CYP1A2 showed a decrease of 53% during SARS-CoV-2 infection measured in blood samples from 18 COVID-19 patients, with an inverse correlation with interleukin 6 and C-reactive protein levels (Lenoir et al., 2021). CYP1A2 interacts with disulfiram and hexachlorophene.
Regarding viral proteins, we found that R1AB-SARS2 interacts with thimerosal, disulfiram, suloctidil, bromhexine, and tenatoprazole, and the spike protein interacts with gefitinib, auranofin, and hexachlorophene (Figure 4).
Discussion
In this work, we described the reconstruction and enrichment of biological and pharmacological knowledge to identify processes impacted by SARS-CoV-2 human infection. From both our PPI and DPI network analyses, which integrate the measure of topological parameters using graph theory mathematical formulations, node disconnection analysis, and network exploration, we found seven approved drugs capable to modulate simultaneously key proteins involved with biological processes associated with SARS-CoV-2 infection and COVID-19 disease (Figure 4).
It is worth mentioning that our PPI network between humans and viruses is the most complete and enriched network among those which have been reported because we integrated data from multiple available interactomes as well as curated databases such as UniProt. To build the DPI network, we retrieved data associated with SARS-CoV-2 available in the ChEMBL database as well as literature and proposed filters that allow obtaining drugs with significant bioactivity using their IC50 and Ki values. The results and subsequent analysis of both PPI and DPI networks can be easily reproducible and applicable to any target following the information available at https://github.com/ramirezlab/COVID-protein-drug-network.
The drugs identified in our analysis are not all suitable to be repurposed. For example, hexachlorophene interacts with 12 key human proteins as well as the spike protein but is indicated as a topical antiseptic used as a surgical scrub and skin cleanser and should not be taken orally, which impedes its repurposing for the treatment of COVID-19. Other drugs such as thimerosal (preservative) should be administered via cutaneous or ophthalmic route. Nevertheless, most of the identified drugs can be administrated via an oral route; thus, in addition to their polypharmacological profile, making them good candidates for drug repurposing against COVID-19. Among them, we find disulfiram (used to treat alcohol addiction), auranofin (antirheumatic), gefitinib (used as first-line therapy to treat nonsmall cell lung carcinoma), suloctidil (vasodilator), and bromhexine (mucolytic).
This network pharmacology workflow has enabled us to identify some relevant drugs as candidates for drug repurposing for the treatment of COVID-19 progression based on the viral and human protein interactions observed in our networks. Some of the drugs identified in the present study have in fact been proposed as candidates for the treatment of COVID-19 by different authors, for example, 1) disulfiram, where its uses are associated with a lower risk of COVID-19 (Fillmore et al., 2021); 2) auranofin, which inhibits SARS-CoV-2 replication and attenuates inflammation in human cells (Marzo and Messori, 2020; Rothan et al., 2020); 3) suloctidil, which was recommended for the treatment of COVID-19-induced exacerbation of asthma (Guo et al., 2021); and 4) gefitinib, which was reported to inhibit spike-driven fusion (Braga et al., 2021).
Another example is bromhexine, a mucolytic and antitussive agent, usually low cost and marketed without prescription, which was introduced in the market in 1963 under the brand name Bisolvon® (European Medicines Agency, 2015). It is indicated both for adults and pediatric population, for the management of a wide variety of respiratory conditions in most cases involving alterations in mucus secretion. It is generally well tolerated and has few adverse effects (Chang et al., 2014; Scaglione and Petrini, 2019). We have here found that bromhexine interacts with the R1AB-SARS2 protein, which encodes for 16 nonstructural proteins, and 14 of these are crucial in the process of SARS-CoV-2 replication and promote the activity of the catalytic nonstructural proteins (Malone et al., 2022). It is relevant to highlight that bromhexine has been initially identified as a potent inhibitor (IC50 = 0.75 µM) of the transmembrane serine protease 2 (TMPRSS2) of SARS-CoV (Shen et al., 2017), being involved also in the binding and infection (mainly via a nonendocytotic route) of SARS-CoV-2 to host cells (Gil et al., 2020). This interaction was found in our DPI network but not in the subnetwork because it is not significant (with respect to other interactions found where one drug interacts with two or more targets). In fact, this last year much work has been developed to understand the mechanism of action of bromhexine in SARS-CoV-2 infection. Recent studies ruled out that TMPRSS2 inhibition is responsible for the antiviral activity of bromhexine in SARS-CoV-2, as slight antiviral activity is reported in VeroE6 cells, which lack TMPRSS2 in their membranes (Matsuyama et al., 2020). The interactions with other viral proteins here found may be responsible for this direct viral inhibition. In addition, bromhexine reached clinical trials in the first months of the pandemic for hospitalized patients showing a reduction in the mortality rate in patients with COVID-19 (Ansarin et al., 2020).
It is important to note that our research has limitations, mainly given that our research was based on information from public databases with Ki and IC50 values reported for other research groups; some of these values were measured in Vero E6 cells, which are not necessarily suitable for all human cell–virus interaction studies. In addition, there may be false positive interactions between drug–protein and protein–protein because we depend on the reported bioactivity values, and in many cases, there is more than one bioactivity data reported for a given molecule, and some values are above or below the threshold defined in this study. Furthermore, the conditions of each reported experiment are not the same; thus, there could exist some skewness in the generated values, and as a result, the interactions reported in this research (DPI and PPI networks) would need further experimental assays for their validation. At last, it is worth noting that before starting new clinical trials, further pharmacokinetic/pharmacodynamic investigations should be considered (e.g., sufficient plasma concentrations and bioavailability) to consider reaching plasma concentrations sufficient to achieve the desired anti-SARS-CoV-2 effect.
Conclusions
The drugs identified in this work to be repurposed for the treatment of COVID-19 (disulfiram, auranofin, gefitinib, suloctidil, and bromhexine) and other related works reported in recent years show the great need to find efficient therapeutic alternatives to control the development of the infection in the current pandemic, for future waves and even for future infections by other viruses. The known mechanisms of the drugs often fail to explain why they have an antiviral effect against SARS-CoV-2, either by directly interacting with viral proteins or by modulating host cell mechanisms that allow the virus to complete its infection cycle. To find suitable candidates to be repurposed is important to tackle the problem in a different way, shifting the focus of the scientific community from “drug-reductionist” to “drug-holistic” network-based approaches in pharmacology. In this work, we aim to analyze the data that have been collected by several authors over the last few years in public databases and examine all these data within a polypharmacological context. We identified key targets in both SARS-CoV-2 and humans, as well as drugs that we consider worth moving forward to new clinical trials in patients with different characteristics. This will allow us to have a better understanding of how drug–antiviral effect develops and leads to a positive therapeutic effect for the treatment of COVID-19.
Data availability statement
The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found below: https://github.com/ramirezlab/COVID-protein-drug-network.
Author contributions
Conceptualization, DR; methodology, MA-A, TB, FS, and GC; software, DR; validation, MA-A, TB, FS, and GC; formal analysis, MA-A, TB, FS, JG, CG, AM, and DR; investigation, MA-A, TB, FS, GC, JG, CG, AM, and DR; resources, DR; data curation, MA-A; TB; writing—original draft preparation, MA-A, TB, and DR; writing—review and editing, MA-A, TB, FS, GC, JG, CG, AM, and DR; visualization, MA-A, TB, and DR; supervision, JG, CG, AM, and DR; project administration, DR; funding acquisition, DR. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the Agencia Nacional de Investigación y Desarrollo de Chile, grants No. COVID0199, REDES190074, and ACT210012, and the FONDECYT grant No. 1220656, and also by the European Commission–NextGenerationEU (Regulation EU 2020/2094), through CSIC’s Global Health Platform (PTI Salud Global).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fphar.2022.952192/full#supplementary-material
References
Ansarin, K., Tolouian, R., Ardalan, M., Taghizadieh, A., Varshochi, M., Teimouri, S., et al. (2020). Effect of bromhexine on clinical outcomes and mortality in COVID-19 patients: A randomized clinical trial. BioImpacts 10, 209–215. doi:10.34172/bi.2020.27
Ashburner, M., Ball, C. A., Blake, J. A., Botstein, D., Butler, H., Cherry, J. M., et al. (2000). Gene ontology: Tool for the unification of biology. The gene Ontology Consortium. Nat. Genet. 25, 25–29. doi:10.1038/75556
Asiedu, S. O., Kwofie, S. K., Broni, E., and Wilson, M. D. (2021). Computational identification of potential anti-inflammatory natural compounds targeting the p38 mitogen-activated protein kinase (MAPK): Implications for COVID-19-induced cytokine storm. Biomolecules 11, 653. doi:10.3390/biom11050653
Badkas, A., de Landtsheer, S., and Sauter, T. (2021). Topological network measures for drug repositioning. Brief. Bioinform. 22, bbaa357. doi:10.1093/bib/bbaa357
Bang, S., Son, S., Kim, S., and Shin, H. (2019). Disease pathway cut for multi-target drugs. BMC Bioinforma. 20, 74. doi:10.1186/s12859-019-2638-3
Berman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., et al. (2000). The protein Data Bank. Nucleic Acids Res. 28, 235–242. doi:10.1093/nar/28.1.235
Berthold, M. R., Cebron, N., Dill, F., Gabriel, T. R., Kötter, T., Meinl, T., et al. (2009). Knime - the konstanz information miner: Version 2.0 and beyond. SIGKDD Explor. Newsl. 11, 26–31. doi:10.1145/1656274.1656280
Boran, A. D. W., and Iyengar, R. (2010). Systems pharmacology. Mt. Sinai J. Med. 77, 333–344. doi:10.1002/msj.20191
Braga, L., Ali, H., Secco, I., Chiavacci, E., Neves, G., Goldhill, D., et al. (2021). Drugs that inhibit TMEM16 proteins block SARS-CoV-2 spike-induced syncytia. Nature 594, 88–93. doi:10.1038/s41586-021-03491-6
Caracciolo, M., Correale, P., Mangano, C., Foti, G., Falcone, C., Macheda, S., et al. (2021). Efficacy and effect of inhaled adenosine treatment in hospitalized COVID-19 patients. Front. Immunol. 12, 613070. doi:10.3389/fimmu.2021.613070
Carbon, S., Douglass, E., Good, B. M., Unni, D. R., Harris, N. L., Mungall, C. J., et al. (2021). The gene ontology resource: Enriching a GOld mine. Nucleic Acids Res. 49, D325–D334. doi:10.1093/nar/gkaa1113
Chang, C. C., Cheng, A. C., and Chang, A. B. (2014). Over-the-counter (OTC) medications to reduce cough as an adjunct to antibiotics for acute pneumonia in children and adults. Cochrane Database Syst. Rev. (3), CD006088. doi:10.1002/14651858.CD006088.pub4
Dhakal, B. P., Sweitzer, N. K., Indik, J. H., Acharya, D., and William, P. (2020). SARS-CoV-2 infection and cardiovascular disease: COVID-19 heart. Heart Lung Circ. 29, 973–987. doi:10.1016/j.hlc.2020.05.101
European Medicines Agency (2015). Ambroxol and bromhexine expectorants: Safety information updated risk of allergy and skin reactions included in the product information (article 31 referral- PRAC assessment report). Available at: www.ema.europa.eu/contact.
Fanelli, V., Fiorentino, M., Cantaluppi, V., Gesualdo, L., Stallone, G., Ronco, C., et al. (2020). Acute kidney injury in SARS-CoV-2 infected patients. Crit. Care 24, 155. doi:10.1186/s13054-020-02872-z
Fillmore, N., Bell, S., Shen, C., Nguyen, V., La, J., Dubreuil, M., et al. (2021). Disulfiram use is associated with lower risk of COVID-19: A retrospective cohort study. PLOS ONE 16, e0259061. doi:10.1371/journal.pone.0259061
Galan-Vasquez, E., and Perez-Rueda, E. (2021). A landscape for drug-target interactions based on network analysis. PLOS ONE 16, e0247018. doi:10.1371/journal.pone.0247018
Gaulton, A., Bellis, L. J., Bento, A. P., Chambers, J., Davies, M., Hersey, A., et al. (2012). ChEMBL: A large-scale bioactivity database for drug discovery. Nucleic Acids Res. 40, D1100–D1107. doi:10.1093/nar/gkr777
Gaulton, A., Hersey, A., Nowotka, M., Bento, A. P., Chambers, J., Mendez, D., et al. (2017). The ChEMBL database in 2017. Nucleic Acids Res. 45, D945–D954. doi:10.1093/nar/gkw1074
Gil, C., Ginex, T., Maestro, I., Nozal, V., Barrado-Gil, L., Cuesta-Geijo, M. Á., et al. (2020). COVID-19: Drug targets and potential treatments. J. Med. Chem. 63, 12359–12386. doi:10.1021/acs.jmedchem.0c00606
Ginex, T., Garaigorta, U., Ramírez, D., Castro, V., Nozal, V., Maestro, I., et al. (2021). Host-directed FDA-approved drugs with antiviral activity against SARS-CoV-2 identified by hierarchical in silico/in vitro screening methods. Pharmaceuticals 14, 332. doi:10.3390/ph14040332
Gordon, D. E., Jang, G. M., Bouhaddou, M., Xu, J., Obernier, K., White, K. M., et al. (2020). A SARS-CoV-2 protein interaction map reveals targets for drug repurposing. Nature 583, 459–468. doi:10.1038/s41586-020-2286-9
Guo, W., Cao, Y., Jiang, Z., Luo, H., Liu, H., and Xi, Y. (2021). Network-based analysis of the genetic effects of SARS-CoV-2 infection to patients with exacerbation of virus-induced asthma (VAE). Eur. PMC [Epub ahead of print]. doi:10.21203/RS.3.RS-948407/V1
Gupta, R., Srivastava, D., Sahu, M., Tiwari, S., Ambasta, R. K., Kumar, P., et al. (2021). Artificial intelligence to deep learning: Machine intelligence approach for drug discovery. Mol. Divers. 25, 1315–1360. doi:10.1007/s11030-021-10217-3
Hamilton, J. L., Vashi, M., Kishen, E. B., Fogg, L. F., Wimmer, M. A., Balk, R. A., et al. (2022). The association of an alpha-2 adrenergic receptor agonist and mortality in patients with COVID-19. Front. Med. 8, 797647. doi:10.3389/fmed.2021.797647
Hamming, I., Timens, W., Bulthuis, M., Lely, A., Navis, G., van Goor, H., et al. (2004). Tissue distribution of ACE2 protein, the functional receptor for SARS coronavirus. A first step in understanding SARS pathogenesis. J. Pathol. 203, 631–637. doi:10.1002/path.1570
Hutcheson, I. R., Knowlden, J. M., Madden, T.-A., Barrow, D., Gee, J. M. W., Wakeling, A. E., et al. (2003). Oestrogen receptor-mediated modulation of the EGFR/MAPK pathway in tamoxifen-resistant MCF-7 cells. Breast Cancer Res. Treat. 81, 81–93. doi:10.1023/A:1025484908380
Iturriaga-Vásquez, P., Alzate-Morales, J., Bermudez, I., Varas, R., and Reyes-Parada, M. (2015). Multiple binding sites in the nicotinic acetylcholine receptors: An opportunity for polypharmacolgy. Pharmacol. Res. 101, 9–17. doi:10.1016/j.phrs.2015.08.018
Janga, S. C., and Tzakos, A. (2009). Structure and organization of drug-target networks: Insights from genomic approaches for drug discovery. Mol. Biosyst. 5, 1536–1548. doi:10.1039/b908147j
Kumar, A., Rajendran, V., Sethumadhavan, R., and Purohit, R. (2013). CEP proteins: The knights of centrosome dynasty. Protoplasma 250, 965–983. doi:10.1007/s00709-013-0488-9
Lenoir, C., Terrier, J., Gloor, Y., Curtin, F., Rollason, V., Desmeules, J. A., et al. (2021). Impact of SARS‐CoV‐2 infection (COVID‐19) on cytochromes P450 activity assessed by the geneva cocktail. Clin. Pharmacol. Ther. 110, 1358–1367. doi:10.1002/cpt.2412
Li, Y., Bai, W., and Hashikawa, T. (2020). The neuroinvasive potential of SARS‐CoV2 may play a role in the respiratory failure of COVID‐19 patients. J. Med. Virol. 92, 552–555. doi:10.1002/jmv.25728
Liang, Y., Zhang, T., Ren, L., Jing, S., Li, Z., Zuo, P., et al. (2021). Cucurbitacin IIb induces apoptosis and cell cycle arrest through regulating EGFR/MAPK pathway. Environ. Toxicol. Pharmacol. 81, 103542. doi:10.1016/j.etap.2020.103542
Malone, B., Urakova, N., Snijder, E. J., and Campbell, E. A. (2022). Structures and functions of coronavirus replication–transcription complexes and their relevance for SARS-CoV-2 drug design. Nat. Rev. Mol. Cell Biol. 23, 21–39. doi:10.1038/s41580-021-00432-z
Marzo, T., and Messori, L. (2020). A role for metal-based drugs in fighting COVID-19 infection? The case of auranofin. ACS Med. Chem. Lett. 11, 1067–1068. doi:10.1021/acsmedchemlett.0c00190
Matsuyama, S., Nao, N., Shirato, K., Kawase, M., Saito, S., Takayama, I., et al. (2020). Enhanced isolation of SARS-CoV-2 by TMPRSS2-expressing cells. Proc. Natl. Acad. Sci. U. S. A. 117, 7001–7003. doi:10.1073/pnas.2002589117
Miserey-Lenkei, S., Trajkovic, K., D’Ambrosio, J. M., Patel, A. J., Čopič, A., Mathur, P., et al. (2021). A comprehensive library of fluorescent constructs of SARS‐CoV‐2 proteins and their initial characterisation in different cell types. Biol. Cell 113, 311–328. doi:10.1111/boc.202000158
Najafloo, R., Majidi, J., Asghari, A., Aleemardani, M., Kamrava, S. K., Simorgh, S., et al. (2021). Mechanism of anosmia caused by symptoms of COVID-19 and emerging treatments. ACS Chem. Neurosci. 12, 3795–3805. doi:10.1021/acschemneuro.1c00477
Nowotka, M. M., Gaulton, A., Mendez, D., Bento, A. P., Hersey, A., Leach, A., et al. (2017). Using ChEMBL web services for building applications and data processing workflows relevant to drug discovery. Expert Opin. Drug Discov. 12, 757–767. doi:10.1080/17460441.2017.1339032
Pandey, A., Nikam, A. N., Shreya, A. B., Mutalik, S. P., Gopalan, D., Kulkarni, S., et al. (2020). Potential therapeutic targets for combating SARS-CoV-2: Drug repurposing, clinical trials and recent advancements. Life Sci. 256, 117883. doi:10.1016/j.lfs.2020.117883
Paul, D., Sanap, G., Shenoy, S., Kalyane, D., Kalia, K., Tekade, R. K., et al. (2021). Artificial intelligence in drug discovery and development. Drug Discov. Today 26, 80–93. doi:10.1016/j.drudis.2020.10.010
R Core Team (2018). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Available at: https://www.R-project.org/, https://www.scirp.org/(S(lz5mqp453edsnp55rrgjct55))/reference/ReferencesPapers.aspx?ReferenceID=2342186 (Accessed November 30, 2021).
Ren, L.-L., Wang, Y.-M., Wu, Z.-Q., Xiang, Z.-C., Guo, L., Xu, T., et al. (2020). Identification of a novel coronavirus causing severe pneumonia in human: A descriptive study. Chin. Med. J. 133, 1015–1024. doi:10.1097/CM9.0000000000000722
Reyes-Parada, M., and Iturriaga-Vasquez, P. (2016). The development of novel polypharmacological agents targeting the multiple binding sites of nicotinic acetylcholine receptors. Expert Opin. Drug Discov. 11, 969–981. doi:10.1080/17460441.2016.1227317
Rothan, H. A., and Byrareddy, S. N. (2020). The epidemiology and pathogenesis of coronavirus disease (COVID-19) outbreak. J. Autoimmun. 109, 102433. doi:10.1016/j.jaut.2020.102433
Rothan, H. A., Stone, S., Natekar, J., Kumari, P., Arora, K., Kumar, M., et al. (2020). The FDA-approved gold drug auranofin inhibits novel coronavirus (SARS-COV-2) replication and attenuates inflammation in human cells. Virology 547, 7–11. doi:10.1016/j.virol.2020.05.002
Samavarchi-Tehrani, P., Abdouni, H., Knight, J. D., Astori, A., Samson, R., Lin, Z.-Y., et al. (2020). A SARS-CoV-2 – host proximity interactome. bioRxiv [Preprint]. doi:10.1101/2020.09.03.282103
Scaglione, F., and Petrini, O. (2019). Mucoactive agents in the therapy of upper respiratory airways infections: Fair to describe them just as mucoactive? Clin. Med. Insights. Ear Nose Throat 12, 1179550618821930. doi:10.1177/1179550618821930
Scardoni, G., Tosadori, G., Faizan, M., Spoto, F., Fabbri, F., Laudanna, C., et al. (2015). Biological network analysis with CentiScaPe: Centralities and experimental dataset integration. F1000Res. 3, 139. doi:10.12688/f1000research.4477.2
Shannon, P., Markiel, A., Ozier, O., Baliga, N. S., Wang, J. T., Ramage, D., et al. (2003). Cytoscape : A software environment for integrated models of biomolecular interaction networks. Genome Res. 13 (11), 2498–2504. doi:10.1101/gr.1239303.metabolite
Shen, L. W., Mao, H. J., Wu, Y. L., Tanaka, Y., and Zhang, W. (2017). TMPRSS2: A potential target for treatment of influenza virus and coronavirus infections. Biochimie 142, 1–10. doi:10.1016/j.biochi.2017.07.016
Stark, C., Breitkreutz, B.-J., Reguly, T., Boucher, L., Breitkreutz, A., and Tyers, M. (2006). BioGRID: A general repository for interaction datasets. Nucleic Acids Res. 34, D535–D539. doi:10.1093/nar/gkj109
Sultana, J., Crisafulli, S., Gabbay, F., Lynn, E., Shakir, S., Trifirò, G., et al. (2020). Challenges for drug repurposing in the COVID-19 pandemic era. Front. Pharmacol. 11, 588654. doi:10.3389/fphar.2020.588654
Szklarczyk, D., Gable, A. L., Nastou, K. C., Lyon, D., Kirsch, R., Pyysalo, S., et al. (2021). The STRING database in 2021: Customizable protein–protein networks, and functional characterization of user-uploaded gene/measurement sets. Nucleic Acids Res. 49, D605–D612. doi:10.1093/nar/gkaa1074
Talevi, A., and Bellera, C. L. (2020). Challenges and opportunities with drug repurposing: Finding strategies to find alternative uses of therapeutics. Expert Opin. Drug Discov. 15, 397–401. doi:10.1080/17460441.2020.1704729
The UniProt Consortium (2014). UniProt: A hub for protein information. Nucleic Acids Res. 43, D204–D212. doi:10.1093/nar/gku989
Vagapova, E. R., Lebedev, T. D., and Prassolov, V. S. (2021). Viral fibrotic scoring and drug screen based on MAPK activity uncovers EGFR as a key regulator of COVID-19 fibrosis. Sci. Rep. 11, 11234. doi:10.1038/s41598-021-90701-w
Vavougios, G. D., Breza, M., Mavridis, T., and Krogfelt, K. A. (2021). FYN, SARS-CoV-2, and IFITM3 in the neurobiology of Alzheimer’s disease. Brain Disord. 3, 100022. doi:10.1016/j.dscb.2021.100022
Venkataraman, T., and Frieman, M. B. (2017). The role of epidermal growth factor receptor (EGFR) signaling in SARS coronavirus-induced pulmonary fibrosis. Antivir. Res. 143, 142–150. doi:10.1016/j.antiviral.2017.03.022
Vogt, I., and Mestres, J. (2010). Drug-target networks. Mol. Inf. 29, 10–14. doi:10.1002/minf.200900069
Wang, Y., Liu, S., Liu, H., Li, W., Lin, F., Jiang, L., et al. (2020). SARS-CoV-2 infection of the liver directly contributes to hepatic impairment in patients with COVID-19. J. Hepatol. 73, 807–816. doi:10.1016/j.jhep.2020.05.002
World Health Organization (WHO). (2020). Coronavirus disease (COVID-19): Situation report, 209. World Health Organization. Available at: https://apps.who.int/iris/handle/10665/333897.
Zhang, R., Li, Y., Zhang, A. L., Wang, Y., and Molina, M. J. (2020). Identifying airborne transmission as the dominant route for the spread of COVID-19. Proc. Natl. Acad. Sci. U. S. A. 117, 14857–14863. doi:10.1073/pnas.2009637117
Zhao, S., and Iyengar, R. (2012). Systems pharmacology: Network analysis to identify multiscale mechanisms of drug action. Annu. Rev. Pharmacol. Toxicol. 52, 505–521. doi:10.1146/annurev-pharmtox-010611-134520
Keywords: protein–protein interaction network, protein–drug interaction network, drug repurposing, SARS-CoV-2, COVID-19, network pharmacology, polypharmacology
Citation: Alegría-Arcos M, Barbosa T, Sepúlveda F, Combariza G, González J, Gil C, Martínez A and Ramírez D (2022) Network pharmacology reveals multitarget mechanism of action of drugs to be repurposed for COVID-19. Front. Pharmacol. 13:952192. doi: 10.3389/fphar.2022.952192
Received: 24 May 2022; Accepted: 06 July 2022;
Published: 17 August 2022.
Edited by:
Krishna M. Padmanabha Das, Harvard Medical School, United StatesReviewed by:
Abhinav Dubey, Dana–Farber Cancer Institute, United StatesVerena Schöning, Bern University Hospital, Switzerland
Copyright © 2022 Alegría-Arcos, Barbosa, Sepúlveda, Combariza, González, Gil, Martínez and Ramírez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: David Ramírez, david.ramirez@uautonoma.cl
†These authors have contributed equally to this work and share first authorship