Vishwesh Venkatraman- Department of Chemistry, Norwegian University of Science and Technology, Trondheim, Norway
Discovering new drugs for disease treatment is challenging, requiring a multidisciplinary effort as well as time, and resources. With a view to improving hit discovery and lead compound identification, machine learning (ML) approaches are being increasingly used in the decision-making process. Although a number of ML-based studies have been published, most studies only report fragments of the wider range of bioactivities wherein each model typically focuses on a particular disease. This study introduces FP-MAP, an extensive atlas of fingerprint-based prediction models that covers a diverse range of activities including neglected tropical diseases (caused by viral, bacterial and parasitic pathogens) as well as other targets implicated in diseases such as Alzheimer’s. To arrive at the best predictive models, performance of ≈4,000 classification/regression models were evaluated on different bioactivity data sets using 12 different molecular fingerprints. The best performing models that achieved test set AUC values of 0.62–0.99 have been integrated into an easy-to-use graphical user interface that can be downloaded from https://gitlab.com/vishsoft/fpmap.
1 Introduction
Development of therapeutic drugs is an expensive affair with expected costs ranging from $1 billion to more than $2 billion (Schlander et al., 2021) depending on the therapeutic area and disease complexity. The molecular universe is very large with some estimates placing their number at over 1060 different drug-like molecules (Reymond and Awale, 2012). There now exist virtual databases such as SAVI (Patel et al., 2020), ZINC (Irwin et al., 2020), ENAMINE (Sadybekov et al., 2021) and the GDB (Reymond and Awale, 2012), that contain hundreds-of-millions to billions of diverse molecules that can be queried to find novel molecules of interest. Since making and testing all the interesting compounds is out of question, there is a need to weed out molecules that are not relevant to drug discovery, i.e., exclude those that exhibit less than acceptable biological activity. However, despite recent efforts (Gorgulla et al., 2020; Bender et al., 2021; Glaser et al., 2021; Gentile et al., 2022; Luttens et al., 2022) reliable simulation methods for large scale activity prediction still remain elusive.
To circumvent some of the challenges, machine learning (ML) approaches are being increasingly used for the prediction of biological activities (Cova and Pais, 2019; Lane et al., 2020; Elbadawi et al., 2021). Here, a wide variety of ML algorithms are trained to identify quantitative structure-activity relationships (Wu et al., 2020; Pillai et al., 2022) that are then used to generate predictions that are subsequently used to select the next screening subset, thereby facilitating more efficient use of time and resources (Dreiman et al., 2021; Graff et al., 2021). Key to the success of the models is the quality and amount of data, the molecular representation and the ML method. Although annotated data remains limited, public databases such as ChemBL (Gaulton et al., 2016) and concerted efforts to make data open access (Capuzzi et al., 2017; Wu et al., 2018; Kexin Huang, 2020) have spawned a number of machine learning projects (Mayr et al., 2018; Lane et al., 2020). Molecular representation plays a crucial role in machine learning and is problem-specific (David et al., 2020; Raghunathan and Priyakumar, 2021) with popular choices being fingerprints (bit string indicating absence/presence of features), molecular graphs (network of nodes and edges) and molecular embeddings (Jaeger et al., 2018). While a wide array of ML algorithms have been employed, there is no clear winner, although ensemble learning has been shown to yield good results across many data sets (Wu et al., 2020; Sabando et al., 2021).
To help researchers ease their way into drug discovery and carry out screening experiments, automated ML platforms and web-based tools have gained significant traction in recent years (Liu et al., 2019; Singh et al., 2020; Togo et al., 2022). While a great number of software and web tools are devoted to physicochemical properties, ADMET and ADMET-related filtering (Venkatraman, 2021; Xiong et al., 2021), prediction software that cover a broad range of biological activities are relatively fewer (Scotti et al., 2022). In many cases, the prediction software are limited to a single disease or class and largely operate as online prediction services that are not easily amenable to large scale screening (see Table 1 for a short summary of recently published software tools that provide online prediction services). Furthermore, in spite of a large number of published models, only a few are publicly accessible while many are part of proprietary collections (Ma et al., 2015; Aleksić et al., 2021). Cheminformatics web services and software for bioactivity prediction is indeed growing (Ruusmann et al., 2015) and a great many software and services such as VCCLab (Tetko et al., 2005) and DPubchem (Soufan et al., 2018) offer a platform for calculations of a comprehensive series of molecular properties and data analysis. Other services such as AssayCentral (www.collaborationspharma.com/assay-central) focus on allowing pharmaceuticals or individuals to leverage their internal databases. In a recent study, over 5,000 machine learning models built from data sets extracted from ChemBL have been made available on the AssayCentral platform (Lane et al., 2020).
TABLE 1. Table lists several open access software for drug activity prediction.
This article presents FP-MAP, a fast fingerprint-based bioactivity prediction tool to help identify active molecules for a number of pharmaceutically relevant targets. In particular FP-MAP sets out to assemble predictive models for diseases and targets for which there are currently no publicly available software. In order to build the models, 12 different fingerprints were trialled and the best-performing models (based on 5-fold cross-validated statistics) were retained. A pre-assessment step was carried out wherein the predictive ability of the fingerprint models was found to be comparable or an improvement over previously reported results for multiple data sets. For the different classification models computed for severely imbalanced data sets, moderate to high area under the ROC curve (AUC) values of 0.61–0.95 were obtained. FP-MAP currently offers 24 different classification models for rapid screening of compounds against a number of diseases caused by bacteria and parasites such as schistosomiasis, cholera and malaria as well as other targets implicated in diseases such as Alzheimer’s, cancer and cardiomyopathy. To facilitate the use of the models, the software has been made available as an easy to use graphical user interface and can be accessed from https://gitlab.com/vishsoft/fpmap.
2 Materials and methods
2.1 Data sets studied
In order to assess the predictive ability of the fingerprint-based machine learning models, multiple data set were analysed. A set of 79 pharmacologically important biological targets were initially used as a means to benchmark performance, proceeding which model performance was assessed on more challenging targets that are described briefly in the following sections.
2.1.1 Chemical toxicology
The toxicology data set includes 79 pharmacologically important biological targets (see Supplementary Table S1 in the SI). The compounds were extracted from ChemBL and ToxCast and were categorized as binders if the reported activities against the human protein targets (Ki/Kd/IC50/EC50) were ≤10 μM and as non-binders if activities were
2.1.2 ExcapeDB
The ExcapeDB (Sun et al., 2017) database comprises activity data of chemical compounds on an array of protein targets. The data were extracted from publicly available databases such as PubChem and ChEMBL. A set of 12 gene targets were evaluated in this study.
2.1.3 PubChem
An important source of data is the PubChem Bioassay (Kim et al., 2022) which contains small-molecule screening data. This study analyses multiple data sets drawn from the PubChem archive where the focus is primarily on rare diseases related to genetic disorders and neglected tropical diseases.
2.1.3.1 Bubonic plague
YopH (Yersinia outer protein H) is a protein essential for the virulence of yersinia pestis (Bubonic plague). The data set consists of ∼140,000 compounds that were part of a high throughput screening assay (https://pubchem.ncbi.nlm.nih.gov/bioassay/898) to identify compounds that can interfere with YopH functionality. Actives were defined as those with inhibition ≥50%.
2.1.3.2 Potassium channel blockers
The KCNQ1 (Potassium Voltage-Gated Channel Subfamily Q Member 1) gene codes for the potassium channel protein which is critical for electrical signaling in cells. In an effort to identify compounds that inhibit KCNQ1 potassium channels, a little over 300,000 compounds were assayed (https://pubchem.ncbi.nlm.nih.gov/bioassay/2642).
2.1.3.3 Trypanosoma brucei hexokinase
Trypanosoma brucei is a protozoan parasite that causes African sleeping sickness. Glucose metabolism is essential for the parasite, and hexokinases have been considered as important therapeutic targets. The data set consists of a little over 220,000 compounds (https://pubchem.ncbi.nlm.nih.gov/bioassay/1430) where the goal was to identify specific inhibitors of Trypanosoma brucei hexokinase activity (Morris et al., 2006). Compounds with more than 50% inhibition are considered to be active.
2.1.3.4 Antimalarials
The MMV St. Jude malaria data set (Verras et al., 2017) contains a set of 305,810 compounds that were assayed for malaria blood stage inhibitory activity.
2.1.3.5 Leishmania
Leishmaniasis is a neglected disease caused by protozoan parasites. Currently no safe vaccines exist. The data set earlier studied by Casanova-Alvarez et al. (2021), includes ∼ 196,000 compounds that have been tested for leishmania parasite growth and viability inhibition against Leishmania major promastigotes.
2.1.3.6 Activators of kallikrein-7
The chymotrypsin-like serine protease kallikrein-7 (K7) zymogen has been shown to play critical roles in skin diseases and tumour progression. K7 expression was significantly decreased in the brains of Alzheimer’s disease (AD) patients (Kidana et al., 2018). Compounds that can directly activate K7 without a requirement for proteolytic processing can enable development of new therapeutics for cancer, skin diseases, and AD. The data set contains over 350,000 compounds (https://pubchem.ncbi.nlm.nih.gov/bioassay/652039).
2.1.3.7 Dengue
Antiviral drugs against dengue infection are much needed with an estimated 4 billion people living in areas with a risk of dengue (https://www.who.int/news-room/fact-sheets/detail/dengue-and-severe-dengue). The data set consists of over 10,000 compounds (https://pubchem.ncbi.nlm.nih.gov/bioassay/540333) wherein active compounds showed inhibition of cytopathic effect-based assay greater than 13.25%.
2.1.3.8 VIM2 inhibitors
Antibiotic resistance caused by β-lactamase production presents significant challenges to the efficacy of β-lactam antibiotics. Given the paucity of new antibiotics, high throughput screening assay to identify inhibitors of the Verona Integron-Encoded Metallo-β-Lactamase 2 (VIM-2) have been carried out.
2.1.3.9 Cholera
Cholera is acute diarrhoeal disease caused by infection of the intestine with Vibrio cholerae bacteria. Due to the prevalence of multi-drug resistance in these bacteria new drugs to combat these pathogens are required. The data set contains over 130,000 compounds (https://pubchem.ncbi.nlm.nih.gov/bioassay/504770) of which 350 compounds showed potent cidal activity against V. cholerae.
2.1.3.10 Schistosomiasis
Caused by parasitic worms (such as Schistosoma mansoni), Schistosomiasis is prevalent in tropical and subtropical areas particularly among poor and rural communities with ≈90% of those requiring treatment living in Africa (https://www.who.int/news-room/fact-sheets/detail/schistosomiasis). Owing to the parasite becoming drug resistant and lack of suitable alternative therapies, new targets and drugs for schistosomiasis treatment are foremost importance. The data set contains over 300,000 compounds tested for inhibition of Thioredoxin glutathione reductase (https://pubchem.ncbi.nlm.nih.gov/bioassay/485364). Compounds defined as inconclusive were excluded from further analysis.
2.1.3.11 Glucocerebrosidase
The deficiency of β-glucocerebrosidase results in Gaucher disease, a rare genetic disorder for which there is no cure but can be controlled using drugs. The PubChem assay (https://pubchem.ncbi.nlm.nih.gov/bioassay/360) screens for small molecule inhibitors that could potentially act as molecular chaperones on the mutant forms β-glucocerebrosidase.
2.1.3.12 Leishmania
Available leishmaniasis treatments are limited and increasingly confronted by issues such as toxic side effects and chemoresistance. The data set includes close to 200,000 compounds assayed for Leishmania parasite growth inhibition https://pubchem.ncbi.nlm.nih.gov/bioassay/1063.
2.2 Molecular fingerprint representations
Molecular fingerprints have a long history of having been used in similarity searching (Muegge and Hu, 2022). Their popularity can be largely attributed to their ability to evaluate vast libraries of compounds using just a fraction of the resources and time (Venkatraman et al., 2022) that would otherwise be used with more compute intensive approaches. The fingerprint representations used in this study can be grouped into:
1. Those based on pre-defined generic substructures/keys (Bender et al., 2009) such as PUBCHEM (NCBI, 2009), Klekota-Roth (Klekota and Roth, 2008) and MACCS (Durant et al., 2002)
2. Circular topological fingerprints (Rogers and Hahn, 2010) that represent molecular structures using circular atom neighborhoods (defined by a radius). The extended connectivity fingerprints (ECFP) and feature-class fingerprints belongs to this group.
3. Topological path-based fingerprints in which linear/branched paths up to a certain length are enumerated and encoded. Here, RDKit topological fingerprints (Landrum, 2022) of path sizes 5, 6, and 7 bonds have been used.
Table 2 provides a summary of the fingerprints used for predictive modelling. Machine learning models for a total of 12 different fingerprints adapted from a set of fingerprints studied earlier by Riniker and Landrum (2013) were evaluated. These fingerprints have been widely used as molecular representations with applications in similarity searching and modelling structure-activity relationships (Zagidullin et al., 2021; Muegge and Hu, 2022; Orosz et al., 2022). The fingerprints were generated using available routines in open source cheminformatics software such as RDKit (Landrum, 2022) and the Chemistry Development Kit (Willighagen et al., 2017).
TABLE 2. Molecular fingerprints used for predictive modelling.
2.3 Modelling
Prior to modelling, a data cleaning step was followed wherein the SMILES were standardized and cleaned using MayaChemTools (Sud, 2016). Subsequently, for each data set, the available data was randomly split into calibration (80%) and test sets (20%). Model training was performed using random forests (Breiman, 2001) (RF) where the number of trees was set to 500. A 5-fold cross-validation on the training set was carried out to tune the parameter “mtry” (number of input features that will be randomly sampled at each split when creating the tree models). Prediction performances were subsequently assessed on the test set. The train/test splitting (80:20 ratio) was repeated 3 times to assess variability of the prediction performance and to rule out any significant impact on performance owing to selection. The RF models were built using the caret (Kuhn, 2022) and ranger (Wright and Ziegler, 2017) packages in R (R Core Team, 2022). The classification models were evaluated using the balanced accuracy score (Kelleher et al., 2015) which accounts for the skewness of the class distributions
Here, the sensitivity
In order to address the issue of applicability domain of the models, outlier detection using isolation forest (Liu et al., 2008) has been employed. Here, a test compound is assessed for its tendency to separate from the majority of samples using an isolation forest constructed from binary trees. Isolation forests make use of decision tree (are an unsupervised version of random forests) and work on the assumption that for non-outlier points, it takes a large number of splits to separate them into individual buckets (i.e., number of partitions that it takes to isolate a point). By contrast, anomalous points are likely to take much shorter paths for isolation. In this study, the isofor package in R was used to identify potential outliers.
3 Results and discussion
3.1 Performance benchmarking
The performance of the fingerprint models was first assessed on the 79 targets (data summary in Supplementary Table S1 in SI) earlier studied by Allen et al. (2020). The heatmap of the balanced accuracies in Supplementary Figure S1 in the SI shows that with the exception of some selected targets such as MAPK1, PTPN11 and hERG, the fingerprint models perform quite well with average accuracies (average of the BACC values across all targets) close to 0.90 for most targets (see Supplementary Figure S2 in the SI). The prediction results for the fingerprint models compare favourably with the metrics reported for deep learning neural networks (Allen et al., 2020) and can be attributed to the fact that the data sets are relatively balanced (positive data percentage of ≈50%). The fingerprint models were also evaluated against six types of cardiac toxicity outcomes: arrhythmia, cardiac failure, heart block, hERG toxicity, hypertension, and myocardial infarction (see Supplementary Table S1 in the SI). These data sets were previously studied by Iftkhar et al. (2022) who used a combination of graph-based signatures and fingerprints to identify models capable of identifying molecules likely to be toxic. Figure 1 summarizes the performance of the fingerprint models which as can be seen, achieve relatively better predictive performance in terms of the AUC.
FIGURE 1. Plot shows the average AUC values for each fingerprint model averaged over 6 cardiac toxicity related outcomes. Error bars indicate the variability (standard deviation) of the obtained AUCs. Individual prediction performances of the models can be seen in Supplementary Figuree S3 in the SI.
As further validation of the fingerprint models, predictive performance on a series of structurally diverse datasets consisting of 33,757 active and 21,152 inactive compounds for different breast cancer cell lines was also evaluated. The data sets were earlier studied by He et al. (2021), where a number of descriptor-based machine learning models such as naïve Bayes (NB), support vector machine (SVM), k-nearest Neighbors (KNN), extreme gradient boosting (XGB) as well as deep learning methods were tested. Comparison of the metrics obtained for fingerprint models with those reported by He et al. (2021) shows that the former achieve higher predictive accuracies with BACC
FIGURE 2. Plot shows the average BACC values for each fingerprint model averaged over 14 breast cancer cell lines. Error bars indicate the variability (standard deviation) of the obtained accuracies. A target-wise summary of the prediction performances of the models can be seen in Supplementary Figure S4 in the SI.
Overall, the performance on multiple data sets clearly shows that fingerprints have good predictive power. The majority of the data however, has minimal skew, i.e., near equal numbers of actives and inactives with some even displaying greater bias towards active compounds. Most machine learning approaches are likely to yield strong performances for such balanced data distributions. Data sets drawn from PubChem have typically strongly imbalance and the question is whether fingerprints can yield robust structure–activity relationship models for such data.
3.2 Performance evaluation of selected bioactivity data sets
Encouraged by the performance of the fingerprints on the different targets, model performance was further assessed on 24 different bioactivity data sets. Table 3 lists the balanced accuracies for the calibration/test sets (average of 3 independent trials) obtained for the targets. Although the performance varies, it is generally seen that the fingerprint models yield reasonable results even for cases with severe imbalance. The heatmap in Figure 3 shows that in a number of cases such as potassium channel inhibitors, KDM4E, LMNA and TARDBP, the selected fingerprints show only a marginal difference in performance with balanced accuracies ≈0.55. Among the fingerprints evaluated in this study, best results were frequently seen to perform well include AVALON, ECFP2/FCFP4/FCFP6 and RDK5.
TABLE 3. Table summarizes the random forest classification performance for the various data sets studied.
FIGURE 3. Heatmap of the 5-fold cross validated balanced accuracies (mean of 3 runs) achieved by the different fingerprint models.
The fingerprint performance was compared with that of a graph isomorphism network (Xu et al., 2019; Wu et al., 2021b) (GIN) which is a powerful graph neural network (GNN) for graph classification (Kim and Ye, 2020). Using the torchdrug (Zhu et al., 2022) machine learning framework, the GIN was built with 4 hidden layers (number of hidden units set to 256), using an Adam optimizer and binary cross entropy loss function with batch normalization applied to every hidden layer. The model was subsequently trained for 100 epochs with the splits for train/valid/test sets set to 60%, 20% and 20% respectively. The barplots in Figure 4 show the comparison of the test set AUCs (mean of 3 independent runs) achieved by the RF and GNN models. As can be seen from the plots, for the majority of the data sets, RF models achieve relatively better metrics while for others the performances are comparable.
FIGURE 4. Comparison of random forest fingerprint models with graph isomorphism networks for the test sets (average of 3 random selections).
For all data sets, isolation forest (built using 500 trees) based outlier scores were calculated. Here, values closer to 1 indicate potential outliers while those around 0.50 typically suggest average outlierness. Values closer to 0 are more difficult to categorize. Supplementary Figure S5 in the SI shows the histograms of the distributions of the calculated scores. Examination of the plots show that for most of the data sets studied here, a cutoff of 0.5 (for some a lower value is recommended) may be used as a decision threshold to identify potential outliers (see Supplementary Figure S6 in the SI). Compared with other distance based approaches [such as the local outlier factor (Breunig et al., 2000) and one-class support vector machines (Chen et al., 2013)] where the algorithms typically try to fit the regions where the training data is the heavily concentrated, isolation forests do not use any distance metrics and instead rely on the concept that an ensemble of random trees are likely to produce shorter path lengths for outliers.
The model performance although encouraging for some does need significant improvement especially for data sets where the availability of actives is quite low. While a case for balanced data sets can be made, the skewed ratio between active and inactive compounds is a realistic representation of the high-throughput screening hit rates that are typically
3.3 Performance on regression tasks
Given the relative success of the fingerprint-based RF classification models, an immediate question is whether the performances can be replicated for regression tasks. To this end, RF regression models were computed for a number of previously analysed data sets that used graph based signatures and other auxiliary attributes to identify potential candidates against mycobacterium tuberculosis (Pires and Ascher, 2020), cancer (Al-Jarf et al., 2021), and G protein-coupled receptors (Velloso et al., 2021) (GPCRs). A total of 1904 fingerprint-RF models were computed, spanning 36 different GPCRs, 8 organism-specific Mycobacteria species (M. avium, M. caseum, M. kansasii, M. phlei, M. tuberculosis, M. bovis, M. fortuitum, M. smegmatis and M. intracellulare) and 74 distinct cancer cell lines corresponding to 9 tumor types (renal, breast, CNS, colon, leukemia melanoma, non small cell lung, ovarian, prostate, and small cell lung). Supplementary Figures S7–S9 in the SI summarize the regression performances of the different fingerprints. When compared with the graph signature based approaches, although marginal improvements were seen for some cases, the overall performance measured in terms of the squared Pearson correlation (R2) was largely found to be comparable, with only models for tuberculosis yielding slightly lower R2 values (see Figure 5). The fingerprint performance observed for these data sets mirrors the trends seen for a number of ADMET-related responses that were studied in a previous article [see (Venkatraman, 2021)] and suggest that purely fingerprint-based models may have low predictive utility for regression.
FIGURE 5. Mean R2 obtained by the fingerprint models for different data sets (A) tuberculosis (Pires and Ascher, 2020) (B) GPCR (Velloso et al., 2021) and (C) Cancer Al-Jarf et al. (2021).
4 Software implementation and usage
Fingerprint calculations were carried out using the CDK (Willighagen et al., 2017) and RDKit (Landrum, 2022) libraries. Random forests models were built using the R (R Core Team, 2022) package ranger (Wright and Ziegler, 2017). The models were subsequently converted to predictive model markup language (PMML) which is an XML format that facilitates sharing of models between PMML compliant applications. For ease-of-use, a Java-based graphical user interface (see Figure 6) has been created which integrates the Java Evaluator API (https://github.com/jpmml) for model evaluation. In addition to the GUI, FP-MAP has also been made available as a command line interface.
FIGURE 6. Graphical user interface for FPMAP. Users can upload a SMILES file (“Batch processing”) or alternatively enter a single SMILES string for evaluation. Prediction results are written to the output file specified.
5 Conclusion
This article sets out to assemble a comprehensive catalogue of predictive models for small molecules with potential bioactivity against various targets and diseases. Previous studies have provided only fragments of the large spectrum of molecule pharmacodynamics and bioactivity prediction models, many of which are not easily accessible. Encouraged by the initial predictive performance of the fingerprints on over 80 targets for which close to 1,000 models were computed, machine learning algorithms were applied to a number of important targets for which freely accessible prediction models are not available (to the best of the author’s knowledge). For the 24 data sets included in the current release of the software, the fingerprint-based binary classification performances for severely imbalanced datasets ranged from moderate (AUC ≈0.61) to high (AUC >0.90) and outperform alternative approaches. FP-MAP provides a simple and easy to use platform for predicting activity of novel compounds as well as for benchmarking studies. As more and more curated data sets emerge (Béquignon et al., 2023; Buterez et al., 2023), future efforts will focus on expanding the palette of targets and diseases.
Data availability statement
Publicly available datasets were analyzed in this study. This data can be found here: https://doi.org/10.5281/zenodo.7983590.
Author contributions
VV conceived and designed the study, performed the data analysis and wrote the paper.
Funding
VV acknowledges financial support from the Research Council of Norway (Grant No. 262152).
Conflict of interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fchem.2023.1239467/full#supplementary-material
References
Adams, J., Agyenkwa-Mawuli, K., Agyapong, O., Wilson, M. D., and Kwofie, S. K. (2022). EBOLApred: a machine learning-based web application for predicting cell entry inhibitors of the ebola virus. Comput. Biol. Chem. 101, 107766. doi:10.1016/j.compbiolchem.2022.107766
Al-Jarf, R., de Sá, A. G. C., Pires, D. E. V., and Ascher, D. B. (2021). pdCSM-cancer: using graph-based signatures to identify small molecules with anticancer properties. J. Chem. Inf. Model. 61, 3314–3322. doi:10.1021/acs.jcim.1c00168
Aleksić, S., Seeliger, D., and Brown, J. B. (2021). ADMET predictability at boehringer ingelheim: state-of-the-art, and do bigger datasets or algorithms make a difference? Mol. Inf. 41, 2100113. doi:10.1002/minf.202100113
Aljarf, R., Tang, S., Pires, D. E. V., and Ascher, D. B. (2023). embryotox: using graph-based signatures to predict the teratogenicity of small molecules. J. Chem. Inf. Model. 63 (2), 432–441. doi:10.1021/acs.jcim.2c00824
Allen, T. E. H., Wedlake, A. J., Gelžinytė, E., Gong, C., Goodman, J. M., Gutsell, S., et al. (2020). Neural network activation similarity: a new measure to assist decision making in chemical toxicology. Chem. Sci. 11, 7335–7348. doi:10.1039/d0sc01637c
Bender, A., Jenkins, J. L., Scheiber, J., Sukuru, S. C. K., Glick, M., and Davies, J. W. (2009). How similar are similarity searching methods? A principal component analysis of molecular descriptor space. J. Chem. Inf. Model. 49, 108–119. doi:10.1021/ci800249s
Bender, B. J., Gahbauer, S., Luttens, A., Lyu, J., Webb, C. M., Stein, R. M., et al. (2021). A practical guide to large-scale docking. Nat. Protoc. 16, 4799–4832. doi:10.1038/s41596-021-00597-z
Béquignon, O. J. M., Bongers, B. J., Jespers, W., Ijzerman, A. P., van der Water, B., and van Westen, G. J. P. (2023). Papyrus: a large-scale curated dataset aimed at bioactivity predictions. J. Cheminformatics 15, 3. doi:10.1186/s13321-022-00672-x
Bosc, N., Felix, E., Arcila, R., Mendez, D., Saunders, M. R., Green, D. V. S., et al. (2021). Maip: a web service for predicting blood-stage malaria inhibitors. J. Cheminf 13, 13. doi:10.1186/s13321-021-00487-2
Breunig, M. M., Kriegel, H.-P., Ng, R. T., and Sander, J. (2000). Lof: identifying density-based local outliers. ACM SIGMOD Rec. 29, 93–104. doi:10.1145/335191.335388
Buterez, D., Janet, J. P., Kiddle, S. J., and Liò, P. (2023). MF-PCBA: multifidelity high-throughput screening benchmarks for drug discovery and machine learning. J. Chem. Inf. Model. 63, 2667–2678. doi:10.1021/acs.jcim.2c01569
Capuzzi, S. J., Kim, I. S.-J., Lam, W. I., Thornton, T. E., Muratov, E. N., Pozefsky, D., et al. (2017). Chembench: a publicly accessible, integrated cheminformatics portal. J. Chem. Inf. Model. 57, 105–108. doi:10.1021/acs.jcim.6b00462
Casanova-Alvarez, O., Morales-Helguera, A., Cabrera-Pérez, M. Á., Molina-Ruiz, R., and Molina, C. (2021). A novel automated framework for QSAR modeling of highly imbalanced leishmania high-throughput screening data. J. Chem. Inf. Model. 61, 3213–3231. doi:10.1021/acs.jcim.0c01439
Chen, Y., Qian, J., and Saligrama, V. “A new one-class SVM for anomaly detection,” in Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (IEEE), Vancouver, BC, Canada, May 2013. doi:10.1109/icassp.2013.6638322
Choo, H. Y., Wee, J., Shen, C., and Xia, K. (2023). Fingerprint-enhanced graph attention network (FinGAT) model for antibiotic discovery. J. Chem. Inf. Model. 63, 2928–2935. doi:10.1021/acs.jcim.3c00045
Cova, T. F. G. G., and Pais, A. A. C. C. (2019). Deep learning for deep chemistry: optimizing the prediction of chemical patterns. Front. Chem. 7, 809. doi:10.3389/fchem.2019.00809
David, L., Thakkar, A., Mercado, R., and Engkvist, O. (2020). Molecular representations in AI-driven drug discovery: a review and practical guide. J. Cheminf 12, 56. doi:10.1186/s13321-020-00460-5
Dreiman, G. H., Bictash, M., Fish, P. V., Griffin, L., and Svensson, F. (2021). Changing the HTS paradigm: AI-driven iterative screening for hit finding. SLAS Discov. 26, 257–262. doi:10.1177/2472555220949495
Durant, J. L., Leland, B. A., Henry, D. R., and Nourse, J. G. (2002). Reoptimization of MDL keys for use in drug discovery. J. Chem. Inf. Model. 42, 1273–1280. doi:10.1021/ci010132r
Elbadawi, M., Gaisford, S., and Basit, A. W. (2021). Advanced machine-learning techniques in drug discovery. Drug Discov. 26, 769–777. doi:10.1016/j.drudis.2020.12.003
Gaulton, A., Hersey, A., Nowotka, M., Bento, A. P., Chambers, J., Mendez, D., et al. (2016). The ChEMBL database in 2017. Nucleic Acids Res. 45, D945–D954. doi:10.1093/nar/gkw1074
Gentile, F., Yaacoub, J. C., Gleave, J., Fernandez, M., Ton, A.-T., Ban, F., et al. (2022). Artificial intelligence–enabled virtual screening of ultra-large chemical libraries with deep docking. Nat. Protoc. 17, 672–697. doi:10.1038/s41596-021-00659-2
Glaser, J., Vermaas, J. V., Rogers, D. M., Larkin, J., LeGrand, S., Boehm, S., et al. (2021). High-throughput virtual laboratory for drug discovery using massive datasets. Int. J. High. Perform. Comput. Appl. 35, 452–468. doi:10.1177/10943420211001565
Gorgulla, C., Boeszoermenyi, A., Wang, Z.-F., Fischer, P. D., Coote, P. W., Das, K. M. P., et al. (2020). An open-source drug discovery platform enables ultra-large virtual screens. Nature 580, 663–668. doi:10.1038/s41586-020-2117-z
Graff, D. E., Shakhnovich, E. I., and Coley, C. W. (2021). Accelerating high-throughput virtual screening through molecular pool-based active learning. Chem. Sci. 12, 7866–7881. doi:10.1039/d0sc06805e
He, S., Zhao, D., Ling, Y., Cai, H., Cai, Y., Zhang, J., et al. (2021). Machine learning enables accurate and rapid prediction of active molecules against breast cancer cells. Front. Pharmacol. 12, 796534. doi:10.3389/fphar.2021.796534
Iftkhar, S., de Sá, A. G. C., Velloso, J. P. L., Aljarf, R., Pires, D. E. V., and Ascher, D. B. (2022). cardiotoxcsm: a web server for predicting cardiotoxicity of small molecules. J. Chem. Inf. Model. 62, 4827–4836. doi:10.1021/acs.jcim.2c00822
Irwin, J. J., Tang, K. G., Young, J., Dandarchuluun, C., Wong, B. R., Khurelbaatar, M., et al. (2020). ZINC20—A free ultralarge-scale chemical database for ligand discovery. J. Chem. Inf. Model. 60, 6065–6073. doi:10.1021/acs.jcim.0c00675
Jaeger, S., Fulle, S., and Turk, S. (2018). Mol2vec: unsupervised machine learning approach with chemical intuition. J. Chem. Inf. Model. 58, 27–35. doi:10.1021/acs.jcim.7b00616
Kelleher, J. D., Namee, B. M., and D’Arcy, A. (2015). Fundamentals of machine learning for predictive data analytics: algorithms, worked examples, and case studies. Cambridge, Massachusetts, United States: The MIT Press.
Kexin Huang, T. F. (2020). Therapeutics data commons. Avaliable At: https://tdcommons.ai.
Kidana, K., Tatebe, T., Ito, K., Hara, N., Kakita, A., Saito, T., et al. (2018). Loss of kallikrein-related peptidase 7 exacerbates amyloid pathology in alzheimer’s disease model mice. EMBO Mol. Med. 10, e8184. doi:10.15252/emmm.201708184
Kim, B.-H., and Ye, J. C. (2020). Understanding graph isomorphism network for rs-fMRI functional connectivity analysis. Front. Neurosci. 14, 630. doi:10.3389/fnins.2020.00630
Kim, S., Chen, J., Cheng, T., Gindulyte, A., He, J., He, S., et al. (2022). PubChem 2023 update. Nucleic Acids Res. 51, D1373–D1380. doi:10.1093/nar/gkac956
Klekota, J., and Roth, F. P. (2008). Chemical substructures that enrich for biological activity. Bioinformatics 24, 2518–2525. doi:10.1093/bioinformatics/btn479
Kuhn, M. (2022). caret: classification and Regression Training. R package version 6.0-93. https://github.com/topepo/caret/.
Landrum, G. (2022). Rdkit: open-source cheminformatics. https://www.rdkit.org. Release: 2022.03.5.
Lane, T. R., Foil, D. H., Minerali, E., Urbina, F., Zorn, K. M., and Ekins, S. (2020). Bioactivity comparison across multiple machine learning algorithms using over 5000 datasets for drug discovery. Mol. Pharm. 18, 403–415. doi:10.1021/acs.molpharmaceut.0c01013
Liu, F. T., Ting, K. M., and Zhou, Z.-H. “Isolation forest,” in Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy, December 2008, 413–422. doi:10.1109/ICDM.2008.17
Liu, Z., Du, J., Fang, J., Yin, Y., Xu, G., and Xie, L. (2019). DeepScreening: a deep learning-based screening web server for accelerating drug discovery. Database 2019, baz104. doi:10.1093/database/baz104
Luttens, A., Gullberg, H., Abdurakhmanov, E., Vo, D. D., Akaberi, D., Talibov, V. O., et al. (2022). Ultralarge virtual screening identifies SARS-CoV-2 main protease inhibitors with broad-spectrum activity against coronaviruses. J. Am. Chem. Soc. 144, 2905–2920. doi:10.1021/jacs.1c08402
Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E., and Svetnik, V. (2015). Deep neural nets as a method for quantitative structure activity relationships. J. Chem. Inf. Model. 55, 263–274. doi:10.1021/ci500747n
Mayr, A., Klambauer, G., Unterthiner, T., Steijaert, M., Wegner, J. K., Ceulemans, H., et al. (2018). Large-scale comparison of machine learning methods for drug target prediction on ChEMBL. Chem. Sci. 9, 5441–5451. doi:10.1039/c8sc00148k
Morris, M. T., DeBruin, C., Yang, Z., Chambers, J. W., Smith, K. S., and Morris, J. C. (2006). Activity of a second trypanosoma brucei hexokinase is controlled by an 18-amino-acid c-terminal tail. Eukaryot. Cell 5, 2014–2023. doi:10.1128/ec.00146-06
Muegge, I., and Hu, Y. (2022). How do we further enhance 2d fingerprint similarity searching for novel drug discovery? Expert Opin. Drug Discov. 17, 1173–1176. doi:10.1080/17460441.2022.2128332
Ncbi, (2009). Pubchem subgraph fingerprint. https://ftp.ncbi.nlm.nih.gov/pubchem/specifications/pubchem_fingerprints.txt. Version: 1.3.
Orosz, Á., Héberger, K., and Rácz, A. (2022). Comparison of descriptor- and fingerprint sets in machine learning models for ADME-tox targets. Front. Chem. 10, 852893. doi:10.3389/fchem.2022.852893
Patel, H., Ihlenfeldt, W.-D., Judson, P. N., Moroz, Y. S., Pevzner, Y., Peach, M. L., et al. (2020). SAVI, in silico generation of billions of easily synthesizable compounds through expert-system type rules. Sci. Data 7, 384. doi:10.1038/s41597-020-00727-4
Pillai, N., Dasgupta, A., Sudsakorn, S., Fretland, J., and Mavroudis, P. D. (2022). Machine learning guided early drug discovery of small molecules. Drug Discov. 27, 2209–2215. doi:10.1016/j.drudis.2022.03.017
Pires, D. E. V., and Ascher, D. B. (2020). mycoCSM: using graph-based signatures to identify safe potent hits against mycobacteria. J. Chem. Inf. Model. 60, 3450–3456. doi:10.1021/acs.jcim.0c00362
Qureshi, A., Rajput, A., Kaur, G., and Kumar, M. (2018). HIVprotI: an integrated web based platform for prediction and design of HIV proteins inhibitors. J. Cheminf 10, 12. doi:10.1186/s13321-018-0266-y
R Core Team (2022). R: a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
Raghunathan, S., and Priyakumar, U. D. (2021). Molecular representations for machine learning applications in chemistry. Int. J. Quant. Chem. 122. doi:10.1002/qua.26870
Reymond, J.-L., and Awale, M. (2012). Exploring chemical space for drug discovery using the chemical universe database. ACS Chem. Neurosci. 3, 649–657. doi:10.1021/cn3000422
Riniker, S., and Landrum, G. A. (2013). Open-source platform to benchmark fingerprints for ligand-based virtual screening. J. Cheminformatics 5, 26. doi:10.1186/1758-2946-5-26
Rodrigues, C. H. M., Pires, D. E. V., and Ascher, D. B. (2021). pdCSM-PPI: using graph-based signatures to identify protein-protein interaction inhibitors. J. Chem. Inf. Model. 61, 5438–5445. doi:10.1021/acs.jcim.1c01135
Rogers, D., and Hahn, M. (2010). Extended-connectivity fingerprints. J. Chem. Inf. Model. 50, 742–754. doi:10.1021/ci100050t
Ross, J., Belgodere, B., Chenthamarakshan, V., Padhi, I., Mroueh, Y., and Das, P. (2022). Large-scale chemical language representations capture molecular structure and properties. Nat. Mach. Intell. 4, 1256–1264. doi:10.1038/s42256-022-00580-7
Ruusmann, V., Sild, S., and Maran, U. (2015). QSAR DataBank repository: open and linked qualitative and quantitative structure activity relationship models. J. Cheminf 7, 32. doi:10.1186/s13321-015-0082-6
Soufan, O., Ba-alawi, W., Magana-Mora, A., Essack, M., and Bajic, V. B. (2018). DPubChem: a web tool for QSAR modeling and high-throughput virtual screening. Sci. Rep. 8, 9110. doi:10.1038/s41598-018-27495-x
Sabando, M. V., Ponzoni, I., Milios, E. E., and Soto, A. J. (2021). Using molecular embeddings in QSAR modeling: does it make a difference? Brief. Bioinform 23, bbab365. doi:10.1093/bib/bbab365
Sadybekov, A. A., Sadybekov, A. V., Liu, Y., Iliopoulos-Tsoutsouvas, C., Huang, X.-P., Pickett, J., et al. (2021). Synthon-based ligand discovery in virtual libraries of over 11 billion compounds. Nature 601, 452–459. doi:10.1038/s41586-021-04220-9
Schlander, M., Hernandez-Villafuerte, K., Cheng, C.-Y., Mestre-Ferrandiz, J., and Baumann, M. (2021). How much does it cost to research and develop a new drug? A systematic review and assessment. PharmacoEconomics 39, 1243–1269. doi:10.1007/s40273-021-01065-y
Scotti, M. T., Herrera-Acevedo, C., de Menezes, R. P. B., Martin, H.-J., Muratov, E. N., de Souza Silva, Á. Í., et al. (2022). MolPredictX: online biological activity predictions by machine learning models. Mol. Inf. 41, 2200133. doi:10.1002/minf.202200133
Shao, J., Gong, Q., Yin, Z., Pan, W., Pandiyan, S., and Wang, L. (2022). S2dv: converting SMILES to a drug vector for predicting the activity of anti-HBV small molecules. Brief. Bioinform. 23, bbab593. doi:10.1093/bib/bbab593
Singh, N., Chaput, L., and Villoutreix, B. O. (2020). Virtual screening web servers: designing chemical probes and drug candidates in the cyberspace. Brief. Bioinform. 22, 1790–1818. doi:10.1093/bib/bbaa034
Sud, M. (2016). MayaChemTools: an open source package for computational drug discovery. J. Chem. Inf. Model. 56, 2292–2297. doi:10.1021/acs.jcim.6b00505
Sun, J., Jeliazkova, N., Chupakhin, V., Golib-Dzib, J.-F., Engkvist, O., Carlsson, L., et al. (2017). ExCAPE-DB: an integrated large scale dataset facilitating big data analysis in chemogenomics. J. Cheminf 9, 17. doi:10.1186/s13321-017-0203-5
Tetko, I. V., Gasteiger, J., Todeschini, R., Mauri, A., Livingstone, D., Ertl, P., et al. (2005). Virtual computational chemistry laboratory – design and description. J. Computer-Aided Mol. Des. 19, 453–463. doi:10.1007/s10822-005-8694-y
Tinivella, A., Pinzi, L., and Rastelli, G. (2021). Prediction of activity and selectivity profiles of human carbonic anhydrase inhibitors using machine learning classification models. J. Cheminf 13, 18. doi:10.1186/s13321-021-00499-y
Togo, M. V., Mastrolorito, F., Ciriaco, F., Trisciuzzi, D., Tondo, A. R., Gambacorta, N., et al. (2022). Tiresia: an eXplainable artificial intelligence platform for predicting developmental toxicity. J. Chem. Inf. Model. 63, 56–66. doi:10.1021/acs.jcim.2c01126
Velloso, J. P. L., Ascher, D. B., and Pires, D. E. V. (2021). pdCSM-GPCR: predicting potent GPCR ligands with graph-based signatures. Bioinform. Adv. 1, vbab031. doi:10.1093/bioadv/vbab031
Venkatraman, V., Colligan, T. H., Lesica, G. T., Olson, D. R., Gaiser, J., Copeland, C. J., et al. (2022). Drugsniffer: an open source workflow for virtually screening billions of molecules for binding affinity to protein targets. Front. Pharmacol. 13, 874746. doi:10.3389/fphar.2022.874746
Venkatraman, V. (2021). FP-ADMET: a compendium of fingerprint-based ADMET prediction models. J. Cheminf 13, 75. doi:10.1186/s13321-021-00557-5
Verras, A., Waller, C. L., Gedeck, P., Green, D. V. S., Kogej, T., Raichurkar, A., et al. (2017). Shared consensus machine learning models for predicting blood stage malaria inhibition. J. Chem. Inf. Model. 57, 445–453. doi:10.1021/acs.jcim.6b00572
Willighagen, E. L., Mayfield, J. W., Alvarsson, J., Berg, A., Carlsson, L., Jeliazkova, N., et al. (2017). The chemistry development kit (CDK) v2.0: atom typing, depiction, molecular formulas, and substructure searching. J. Cheminf 9, 33. doi:10.1186/s13321-017-0220-4
Wright, M. N., and Ziegler, A. (2017). ranger: a fast implementation of random forests for high dimensional data in C++ and R. J. Stat. Soft. 77, 1–17. doi:10.18637/jss.v077.i01
Wu, Z., Jiang, D., Hsieh, C.-Y., Chen, G., Liao, B., Cao, D., et al. (2021a). Hyperbolic relational graph convolution networks plus: a simple but highly efficient QSAR-modeling method. Brief. Bioinform. 22, bbab112. doi:10.1093/bib/bbab112
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., and Yu, P. S. (2021b). A comprehensive survey on graph neural networks. IEEE Trans. Neural Netw. Learn. Syst. 32, 4–24. doi:10.1109/tnnls.2020.2978386
Wu, Z., Ramsundar, B., Feinberg, E. N., Gomes, J., Geniesse, C., Pappu, A. S., et al. (2018). MoleculeNet: a benchmark for molecular machine learning. Chem. Sci. 9, 513–530. doi:10.1039/c7sc02664a
Wu, Z., Zhu, M., Kang, Y., Leung, E. L.-H., Lei, T., Shen, C., et al. (2020). Do we need different machine learning algorithms for qsar modeling? A comprehensive assessment of 16 machine learning algorithms on 14 qsar data sets. Brief. Bioinform. 22, bbaa321. doi:10.1093/bib/bbaa321
Xiong, G., Wu, Z., Yi, J., Fu, L., Yang, Z., Hsieh, C., et al. (2021). ADMETlab 2.0: an integrated online platform for accurate and comprehensive predictions of ADMET properties. Nucleic Acids Res. 49, W5–W14. doi:10.1093/nar/gkab255
Xu, K., Hu, W., Leskovec, J., and Jegelka, S. “How powerful are graph neural networks?,” in Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 2019.
Ye, Q., Chai, X., Jiang, D., Yang, L., Shen, C., Zhang, X., et al. (2021). Identification of active molecules against mycobacterium tuberculosis through machine learning. Brief. Bioinform. 22, bbab068. doi:10.1093/bib/bbab068
Zagidullin, B., Wang, Z., Guan, Y., Pitkänen, E., and Tang, J. (2021). Comparative analysis of molecular fingerprints in prediction of drug combination effects. Briefings Bioinforma. 22, bbab291. doi:10.1093/bib/bbab291
Zhang, R., Ren, S., Dai, Q., Shen, T., Li, X., Li, J., et al. (2022a). InflamNat: web-based database and predictor of anti-inflammatory natural products. J. Cheminf 14, 30. doi:10.1186/s13321-022-00608-5
Zhang, X., Mao, J., Wei, M., Qi, Y., and Zhang, J. Z. H. (2022b). HergSPred: accurate classification of hERG blockers/nonblockers with machine-learning models. J. Chem. Inf. Model. 62, 1830–1839. doi:10.1021/acs.jcim.2c00256
Zhu, Z., Shi, C., Zhang, Z., Liu, S., Xu, M., Yuan, X., et al. (2022). Torchdrug: a powerful and flexible machine learning platform for drug discovery. https://arxiv.org/abs/2202.08320
Keywords: fingerprints, random forests, neglected diseases, classification, regression, graph neural networks
Citation: Venkatraman V (2023) FP-MAP: an extensive library of fingerprint-based molecular activity prediction tools. Front. Chem. 11:1239467. doi: 10.3389/fchem.2023.1239467
Received: 13 June 2023; Accepted: 31 July 2023;
Published: 15 August 2023.
Edited by:
Ganna Gryn’ova, Heidelberg University, GermanyReviewed by:
Xiaohua Zhang, Lawrence Livermore National Laboratory (DOE), United StatesMaryam Salahinejad, Nuclear Science and Technology Research Institute (NSTRI), Iran
Copyright © 2023 Venkatraman. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Vishwesh Venkatraman, dmlzaHdlc2gudmVua2F0cmFtYW5AbnRudS5ubw==