Shihua Zhang
Cheng Zhang1†- 1College of Life Science and Health, Wuhan University of Science and Technology, Wuhan, China
- 2State Key Laboratory of Tea Plant Biology and Utilization, Anhui Agricultural University, Hefei, China
- 3Central Laboratory, Xiaogan Hospital Affiliated to Wuhan University of Science and Technology, Xiaogan, China
- 4School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan, China
- 5School of Life Science and Technology, Harbin Institute of Technology, Harbin, China
Accurate prediction of lymph-node metastasis in cancers is pivotal for the next targeted clinical interventions that allow favorable prognosis for patients. Different molecular profiles (mRNA and non-coding RNAs) have been widely used to establish classifiers for cancer prediction (e.g., tumor origin, cancerous or non-cancerous state, cancer subtype). However, few studies focus on lymphatic metastasis evaluation using these profiles, and the performance of classifiers based on different profiles has also not been compared. Here, differentially expressed mRNAs, miRNAs, and lncRNAs between lymph-node metastatic and non-metastatic groups were identified as molecular signatures to construct classifiers for lymphatic metastasis prediction in different cancers. With this similar feature selection strategy, support vector machine (SVM) classifiers based on different profiles were systematically compared in their prediction performance. For representative cancers (a total of nine types), these classifiers achieved comparative overall accuracies of 81.00% (67.96–92.19%), 81.97% (70.83–95.24%), and 80.78% (69.61–90.00%) on independent mRNA, miRNA, and lncRNA datasets, with a small set of biomarkers (6, 12, and 4 on average). Therefore, our proposed feature selection strategies are economical and efficient to identify biomarkers that aid in developing competitive classifiers for predicting lymph-node metastasis in cancers. A user-friendly webserver was also deployed to help researchers in metastasis risk determination by submitting their expression profiles of different origins.
Introduction
Regional lymph-node metastasis is an important predictor for tumor recurrence and survival in patients with aggressive cancers (Hermanek, 2000; Xu et al., 2018). The diagnosis of lymphatic metastasis in a certain cancer may be uncertain even after extensive clinical examinations, such as endosonography, magnetic resonance imaging, and computed tomography (Christensen et al., 2006; Obinu et al., 2018; Zeng et al., 2019). Cancer patients examined with ambiguous lymphatic metastasis usually suffer from uncontrolled disease progression and a short overall survival period (Biaoxue et al., 2011; Yang et al., 2019a). Though the prognosis depends on different factors including tumor cell type, primary site, dissemination ability, clinical intervention, and drug response, the low survival rate of patients may be mainly attributed to the unclear determination of lymph-node metastasis (Li et al., 2019; Sugimura and Yoshimura, 2019). Therefore, it is of great importance to accurately predict regional lymphatic metastasis in cancerous patients for early tumor spread detection and appropriate clinical decision-making.
With rapid development of high-throughput molecular profiling technologies, large amounts of expression data [mRNA and non-coding RNA (ncRNA) that includes microRNA (miRNA) and long non-coding RNA (lncRNA)] have been generated and are publicly available, which facilitate forecasting paradigms in tumor origin, cancerous or non-cancerous state, and cancer subtype by using these profiles (Perez-Diez et al., 2007; Rosenfeld et al., 2008; Jiang et al., 2009, 2010; Monzon et al., 2010; Varadhachary, 2013; Flippot et al., 2016). As a key prognostic factor in cancer prediction, lymphatic metastasis has also been evaluated in several attempts based on these molecular profiles and now become useful diagnostic algorithms (Moriya et al., 2009; Qu et al., 2018; Ma et al., 2019).
As well-recognized genetic biomarkers in cancers, genes have been large-scale profiled at the transcriptional level (mRNA) and the expression profiling has been used in several studies for lymph-node metastasis evaluation (Kikuchi et al., 2003; Wang et al., 2005). For example, Zhou et al. proposed a mRNA-based logistic regression model to discriminate lymph-node metastatic and non-metastatic cases in patients with oral tongue squamous cell carcinoma (Zhou et al., 2006). This classifier showed a high overall accuracy rate of 85% with a small number of gene markers. The expression profiles of miRNAs that are small non-coding RNAs regulating the expression of genes involved in biological processes such as tumor cell proliferation, migration, and invasion have also been utilized to predict lymph-node metastasis in cancers (Zhang et al., 2016; Cheng et al., 2018). For example, a recent study reported a miRNA classifier that screened a 4-miRNA signature based on differential expression analysis and quantitative expression validation and achieved a perfect sensitivity and specificity in lymph-node metastasis evaluation for breast cancer patients (Chen et al., 2018). LncRNAs are newly identified long non-coding RNAs that act as complicated regulatory roles in diverse biological processes (Alvarez-Dominguez et al., 2012; Ulitsky and Bartel, 2013; Fatica and Bozzoni, 2014; Jiang et al., 2014, 2015; Liu et al., 2018; Cheng et al., 2019) and even cancers (Gutschner and Diederichs, 2012; Mitobe et al., 2018; Wang et al., 2019). Sørensen et al. demonstrated the potentiality of forecasting lymphatic metastasis in breast cancer using lncRNA profiles (Sorensen et al., 2015). The authors established a lncRNA classifier based on support vector machine (SVM) algorithm that gained a high overall accuracy in prediction of lymphatic metastasis in breast cancer patients.
To our knowledge, the existing studies mostly applied a retrospective in-hospital strategy that seems to be procedure-tedious in patient surveying. In this process, several limiting factors such as individual difference, environmental change, and differentiated clinical management may be origins of noise and ultimately affect the classification performance (Bur et al., 2019; Reijnen et al., 2019). Instead, large samples of different molecular profiles available in public serve as useful resources for the development of machine leaning methods in lymph-node metastasis evaluation by computational biologists. As seen in existing studies, only a few types of common cancers have been focused. Indeed, large-scale genome sequencing projects (e.g., The Cancer Genome Atlas Program abbreviated as TCGA) for most cancers have been performed and thus all of them should be scheduled in clinical application. In addition, systematical comparison and evaluation of classifiers based on different profiles and algorithms may be necessary prior to establishment of promising prediction platforms.
With the above considerations, we established SVM classifiers based on different profiles to predict lymphatic metastasis in a spectrum of cancers. For these classifiers, novel feature selection strategies were adopted to screen differentially expressed signatures between lymph-node metastatic and non-metastatic groups in cancers. A total of 2,491 mRNA, 2,364 miRNA, and 2,491 lncRNA expression datasets were retrieved from TCGA to develop classifiers in nine representative cancers. The efficiency of these SVM classifiers was revealed having an overall accuracy of 81.25% on different profiles with small biomarker sets (seven biomarkers on average). We also compared these SVM classifiers with two other benchmark classifiers (K-Nearest Neighbor, KNN; Random Forest, RF) based on the same profiles, and our results showed that SVM classifiers had the better performance. To enable researchers to predict lymph-node metastasis in tumor samples of their interest, we made these SVM classifiers publicly available through an interface-concise webserver named LNMpredictor (http://lnmpredictor.wchoda.com).
Materials and Methods
Cancer Screening and Data Collection
Figure 1 shows the flowchart of our data collection, analysis, classifier construction, and webserver development. We firstly used the clinical TNM (Tumor, Node, and Metastatic classification index) staging data from TCGA to screen those cancers that have definite lymph-node metastasis in patients. In detail, cancers with an N- and T-index of 1–4 and an M-index of 0 were determined as lymph-node metastatic cases, and cancers with an N- and M-index of 0 and a T-index of 1–4 were determined as non-metastatic controls. It is notable that the cases with an M-index of 1–4 were filtered out to avoid the possible noise in modeling of lymph-node metastasis evaluation because distant organ metastasis co-existed with regional lymphatic metastasis in these cases. In total, nine types of cancers with clear TNM-based lymphatic metastasis classification information were retained. For these selected cancers, 2,491 mRNA, 2,364 miRNA, and 2,491 lncRNA expression profiles including normal, lymph-node metastatic, and non-metastatic samples were collected (see details in Table 1; note that sufficient samples of more than 10 in the above three groups were required for subsequent feature selection). The samples sequenced for mRNA, miRNA, and lncRNA profiles were selected from the Illumina platform wherein miRNA expression was specifically sequenced with the BCGSC (IlluminaHiSeq_miRNAseq) sequencing platform (that facilitates highly sensitive and specific detection of common human miRNAs). All the clinical and expression data of patients were retrieved using customized functions implemented in the R package TCGAbiolinks (Colaprico et al., 2016) and handled with our in-house Python scripts.
Figure 1. Schematic illustration of the workflow of data collection, analysis, classifier construction, and webserver development.
Table 1. Sample number of each cancer for mRNA, miRNA, and lncRNA profile, feature selection, training, and testing datasets.
Data Preprocessing
Gene expression quantification (a data type of TCGA) of mRNAs, miRNAs, and lncRNAs across samples was selected as molecular profiles for cancers as individual datasets. For each dataset of a given cancer, we discarded mRNAs, miRNAs, and lncRNAs that had missing values in more than 30% of all the samples. The remaining missing values were estimated using the impute.knn function implemented in the R package imput (http://www.bioconductor.org/packages/release/bioc/html/impute.html). Due to the fact that mRNAs and lncRNAs are fused as expression profiles for cancers in current TCGA sequencing platforms, we therefore separated them for their separate feature selection and profile-based classifier construction. For this purpose, in-house Python scripts were implemented based on the genomic annotation files (gencode.v30.basic.annotation.gff3 and gencode.v30.long_noncoding_RNAs.gtf ) of human mRNAs and lncRNAs retrieved from Gencode (https://www.gencodegenes.org) that provides high-quality reference gene annotation with experimental validation for human genomes.
Feature Selection
For each of the nine representative cancers, three rounds of feature extraction analysis were conducted for establishing practical classifiers that can achieve desirable classification performance with a small set of biomarkers (high relevance with target class and low redundancy in feature dimension), as follows: (1) we firstly screen differentially expressed mRNAs, miRNAs, and lncRNAs as biomarkers between lymph-node metastatic and non-metastatic groups in a certain cancer (significant P values were chosen the same as ≤ 0.01 for mRNA, miRNA, and lncRNA profiles); (2) from these biomarkers, differentially expressed ones between normal and diseased groups were re-screened, wherein the diseased group represented a pool of lymph-node metastatic and non-metastatic cases in a cancer (significant P values were set the same as in the first round of analysis); (3) finally, principal component analysis (PCA) was performed for dimensionality reduction if the re-screened biomarkers seemed high-dimensional. We used the R package DESeq2 that can estimate variance-mean dependence in count data from high-throughput sequencing assays and test for differential expression using the negative binomial distribution (Love et al., 2014), to identify differentially expressed mRNAs, miRNAs, or lncRNAs between case and control groups in the first two rounds of analysis, and dimensionality reduction was performed using the PCA function implemented in the Python package scikit-learn [a machine learning toolkit accessible at http://scikit-learn.org/stable/index.html (Swami and Jain, 2013)].
In the whole strategy, the first round of analysis ensures that the screened mRNA, miRNA, and lncRNA markers have strong relevance to lymph-node metastatic class in cancer samples, which is necessary for regional lymphatic metastasis evaluation. For this purpose, mRNAs, miRNAs, and lncRNAs with false discovery rate (FDR)-adjusted P ≤ 0.01 were screened as candidates that showed significantly different mean values between lymph-node metastatic and non-metastatic groups in certain cancers. We were also concerned about a prerequisite that the screened biomarkers should be related to a diseased state that involved lymph-node metastatic and non-metastatic substates in cancers. Therefore, the second round of analysis was implemented to discard ones that might have no roles in cancer progression and cause the possible bias in classification. From another perspective, this round of implementation can help lower the redundancy in feature dimension as that in the third round of analysis. Because of the much higher dimensionality of both mRNA and lncRNA profiles than that of miRNA profiles, we applied the PCA-based dimensionality reduction for mRNA and lncRNA profiles in our feature extraction analysis.
Classifier Construction and Webserver Development
The screened mRNAs, miRNAs, and lncRNAs from the above feature selection were considered as differentially expressed biomarkers for cancer lymph-node metastasis prediction. In this study, SVM-based machine learning algorithm was adopted as the classifying model that has been demonstrated to have good performance in many classification cases with different types of molecular profiles (Hira and Gillies, 2015; Singh and Sivabalakrishnan, 2015; Huang et al., 2018; Liu et al., 2019). As described above, our proposed feature selection strategy guaranteed the acquisition of a small set of biomarkers with a high prediction performance that is a main objective of the research in cancer prediction, including cancer origin prediction, tumor subtype classification, and cancerous and non-cancerous sample determination. With the same biomarker set, SVM classifiers based on different profiles were systematically compared with other two commonly used benchmark classifiers, KNN and RF, for a more comprehensive evaluation of the SVM algorithm. As to the imbalanced samples of lymph-node metastatic and non-metastatic groups in cancers, we adopted an under-sampling strategy to achieve balanced datasets in these two groups, which can avoid the imbalance problem and improve the SVM classifier performance (Jiang et al., 2013; Hazan et al., 2018). After this, all individual models were trained with a fivefold cross-validation to improve their prediction performance. With the trained SVM models, we developed a Python-based webserver named LNMpredictor to enable users to predict lymph-node metastasis in cancers by uploading mRNA, miRNA, or lncRNA expression profiles of their own labs. The webserver was constructed using a freely available and open source framework, Django (https://www.djangoproject.com). The trained SVM classifying models were stored as individual files by joblib, a Python package named scikit-learn (https://scikit-learn.org). The corresponding web interface was deployed by uWSGI (https://uwsgi-docs.readthedocs.io) and Nginx (http://nginx.org).
Results
Cancer and Sample Statistics
In this study, we focused on those cancers with clear measurement of lymph-node metastasis and adequate samples size, to construct different profiles based on SVM classifiers. The majority of the nine selected cancers are adenocarcinomas (~70%) together with squamous cell and urothelial carcinomas (account for ~20%), covering a wide range of organs or tissues, such as breast, lung, kidney, colon, bladder, cervix uteri, pancreas, and rectum (a total of eight organ or tissue types). Therefore, our strategy ensured a complete representation of main cancer types defined by their anatomic tissues or original organs. Among the cancers, lung-derived adenocarcinomas and squamous cell carcinoma were both presented due to their high lymph-node metastasis risk in clinical cases (Zhong et al., 2018; Deng et al., 2019). For the following classifier establishment, a total of 2,491 mRNA samples, 2,364 miRNA samples, and 2,491 lncRNA samples were respectively selected, wherein normal, lymph-node metastatic, and non-metastatic cases were separated for each cancer type and cancer-specific profiles (Table 1).
Feature Overview
Identifying efficient features for lymph-node metastasis prediction in different cancers is a key step for the construction of classifiers with high performance. To achieve this goal, we used differentially expressed mRNAs and ncRNAs (miRNAs and lncRNAs) between lymph-node metastatic and non-metastatic groups in a cancer as biomarkers that can differentiate between patients with and without lymph-node metastasis. Another concern about the selected feature is their sizes in different cancers with a given molecular profile. Logically, the first two rounds of analysis is necessary for all the profile types in true biomarker extraction. Indeed, miRNA profile has a quite low dimension (~1,880) compared with that of mRNA (45,312-dimension) and lncRNA (15,171-dimension) profiles. Therefore, for miRNA-based datasets with 1,881 common miRNAs in different cancers, we only adopted the first round of analysis for feature selection that can screen differentially expressed miRNAs as biomarker set with appropriate size (3–27 features, with an average of 12 miRNAs as biomarkers in all cancers; see details in Table 2). For both mRNA- and lncRNA-based datasets, the first two rounds of analysis were initially conducted. We observed that comparative numbers of biomarkers were obtained in the two rounds of analysis (see details in Table 2). However, the size of biomarker sets extracted from mRNA and lncRNA profiles in different cancers seemed unpractical with an average of 591 and 276 features. Therefore, the third round of analysis (PCA-based feature reduction) was implemented. After this reduction, we saw a similar size of biomarkers for mRNA and lncRNA profiles (six and four biomarkers on average), which is smaller than that in miRNA profile. Detailed information regarding the final extracted mRNA, miRNA, and lncRNA features is available in Supplementary Table 1. Among the screened mRNA and ncRNA features, miRNA biomarkers represented the real molecular entities because PCA-based feature reduction was not conducted in this study. We constructed an expression heatmap of differentially expressed miRNAs for all the cancer samples to demonstrate the rationality of our feature selection method, and the resulting Figure 2 showed the clear distinction of some cancer types with others due to their differentially expressed miRNA signatures in diverse cancer types.
Table 2. Number of mRNA, miR, and lncR signatures in feature selection and SVM performance using mRNA, miR, and lncR profiles.
Figure 2. Expression heatmap of differentially expressed miRNAs for all the cancer samples (nine cancer types). In the plot, nine cancer types (rows) were indicated, namely, bladder urothelial carcinoma (BLCA), breast invasive carcinoma (BRCA), cervical and endocervical cancers (CESC), colon adenocarcinoma (COAD), kidney renal clear cell carcinoma (KIRC), lung adenocarcinoma (LUAD), lung squamous cell carcinoma (LUSC), pancreatic adenocarcinoma (PAAD), and rectum adenocarcinoma (READ), and differentially expressed miRNA signatures (columns) were top-down placed according to the left–right ordinal cancer types.
Classifiers Performance Evaluation
The performance of a classifier is mainly determined by the quality and the number of extracted features (Saeys et al., 2007; Tang et al., 2014). In our strategy, differentially expressed mRNAs, miRNAs, and lncRNAs in lymph-node metastasis of cancers were selected as discriminatory features for different classifiers. For miRNA-based datasets, the optimal number of differentially expressed miRNAs was gained as biomarkers from the first round of feature extraction analysis (with only biological consideration), whereas the best performance of mRNA- and lncRNA-based classifiers were gained using all the three rounds of feature extraction analysis (with both biological consideration and PCA-based feature reduction). With the optimal selection of differentially expressed biomarkers, we used the SVM algorithm to train the classifiers and generated individual models. Here, samples of lymph-node metastatic and non-metastatic groups in each cancer for different profiles were balanced and then fed to SVM classification algorithm, and all the training for different classifiers went through a fivefold cross-validation. For a comprehensive evaluation of the algorithm, we compared the performance of SVM classifiers with other two benchmark classifiers (KNN and RF). The reported prediction results of the three kinds of classifiers based on different profiles are available in Supplementary Table 2, where detailed training and testing accuracies were provided for useful information on cancer lymph-node metastasis prediction. Our results showed that the SVM classifiers slightly outperformed both the KNN and RF classifiers with an average 2% increase. Table 2 shows the fivefold cross-validation training and testing accuracy of our SVM classifiers based on different profiles for the nine cancers. The lymph-node metastatic states in cancers correctly predicted by mRNA-, miRNA-, and lncRNA-based SVM predictors accounted for the majority of all TCGA cases, with overall testing accuracies of 81.00% (mRNA-based, interval: 67.96–92.19%), 81.97% (mRNA-based, interval: 70.83–95.24%), and 80.78% (lncRNA-based, interval: 69.61–90.00%) by average small size of features (6, 12, and 4). We also made these SVM classifiers publicly available in a webserver named LNMpredictor (http://lnmpredictor.wchoda.com) that aids researchers in predicting lymph-node metastasis by uploading their expression profiles of different types (Figure 3).
Figure 3. An overview of LNMpredictor that shows the tutorial, webserver portal, and document pages.
Discussion
Uncertain lymph-node metastasis in cancer diagnosis is a major limiting factor for patient survival and prognosis. A clear prediction of regional metastasis will aid in targeted tumor treatment and optimal clinical management. With massive amounts of expression profile data of different types available, machine learning methods have been widely applied in cancer prediction such as tumor origin, cancerous or non-cancerous state, and cancer subtype (Blaveri et al., 2005; Tang et al., 2018). Although attempts have focused on several cancer types using small samples of patient retrospective survey, the lymphatic metastasis evaluation of most cancers based on different profiles remained to be systematically explored with different prevalent classification algorithms, which should be conducted to improve the clinical evaluation and treatment of patients as efficient genomics diagnostic algorithms.
In this study, we applied an integrated analysis of clinical patient data (textual) and expression profile data (digital) of cancer cases. Using TNM-based staging and sample annotation information, we differentiated normal, lymph-node metastatic, and non-metastatic cases for each of the selected cancer types. Based on this, a novel feature selection strategy was proposed to identify differentially expressed mRNAs, miRNAs, and lncRNAs as discriminatory biomarkers in cancer lymph-node metastasis prediction. This feature extraction demonstrated its economy with small feature size, and also efficiency with high classification performance when used in SVM classifiers. For representative cancers, we showed that these classifiers had comparative results based on the same profiles. We also compared our SVM classifiers with other two benchmark classifiers (KNN and RF), and the results showed that the SVM classifiers had better performance. Given this, we developed a webserver that deployed SVM predictors to aid users in lymph-node metastasis forecasting by uploading their mRNA, miRNA, or lncRNA expression profiles of interested cancers.
The datasets for lymphatic metastasis prediction represented one main data regime (v > s), where v and s denote variable (i.e., gene) number and sample size, respectively. For mRNA, miRNA, and lncRNA-based dataset, v is much larger than s, which is particularly for mRNA and lncRNA cases (~2 orders of magnitude). As to miRNA profiles, the first round of feature extraction with only biological consideration ensured appropriate number of features to shape accurate classifiers. Instead, all three rounds of feature extraction, which considered both biological and mathematical aspects, was necessary for mRNA and lncRNA profiles in constructing competing classifiers. Thus, the differentiated feature extraction pipelines of different profiles depended much on nature of the data. In addition, we showed that classifiers with different profiles as well as different classification algorithms had the comparative prediction results, indicating the plasticity and efficiency of our feature extraction in lymph-node metastasis risk evaluation.
Apart from mRNA, miRNA, and lncRNA profiles, we can also consider other types of profiles (e.g., DNA methylation and protein) for lymph-node metastasis prediction. As an important epigenetic regulatory mechanism, DNA methylation has been large-scale profiled and extensively applied in cancer prediction, such as tumor classification and prognosis (Hu et al., 2019; Yang et al., 2019b). Therefore, the schedule of establishing classifiers with all profiles separated or integrated will enhance this related research. We also noted that the extracted biomarkers had strong heterogeneous property in different types of cancers, which may have specific contributions in certain lymph-node metastatic events and should be explored in further experimental studies. Moreover, international cancer sequencing projects have been performed, and the generated abundant expression profile data are accessible in ICGC [International Cancer Genome Consortium (Romeo-Casabona et al., 2012)], which may provide useful clues for improvement of prediction strategy from a cross-population perspective.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.
Author Contributions
SZ and CZ did the data analysis, developed the webserver, and wrote the paper. JD, RZ, and SY did the data analysis and anticipated the writing. BL gave useful suggestions. PW and WD supervised the project and revised the manuscript. All authors contributed to the article and approved the submitted version.
Funding
This work was funded by grants from the National Natural Science Foundation of China (Grant Nos. 31301248 and 31671357) and the Hubei Provincial Natural Science Foundation (Grant No. 2018CFB786).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcell.2021.605977/full#supplementary-material
References
Alvarez-Dominguez, J. R., Hu, W., and Lodish, H. F. (2012). Regulation of eukaryotic cell differentiation by long non-coding RNAs. Embo Rep. 13, 971–983. doi: 10.1038/embor.2012.145
Biaoxue, R., Xiguang, C., Hua, L., Hui, M., Shuanying, Y., Wei, Z., et al. (2011). Decreased expression of decorin and p57(KIP2) correlates with poor survival and lymphatic metastasis in lung cancer patients. Int. J. Biol. Markers 26, 9–21. doi: 10.5301/JBM.2011.6372
Blaveri, E., Simko, J. P., Korkola, J. E., Brewer, J. L., Baehner, F., Mehta, K., et al. (2005). Bladder cancer outcome and subtype classification by gene expression. Clin. Cancer Res. 11, 4044–4055. doi: 10.1158/1078-0432.CCR-04-2409
Bur, A. M., Holcomb, A., Goodwin, S., Woodroof, J., Karadaghy, O., Shnayder, Y., et al. (2019). Machine learning to predict occult nodal metastasis in early oral squamous cell carcinoma. Oral. Oncol. 92, 20–25. doi: 10.1016/j.oraloncology.2019.03.011
Chen, X., Wang, Y.-W., Zhu, W.-J., Li, Y., Liu, L., Yin, G., et al. (2018). A 4-microRNA signature predicts lymph node metastasis and prognosis in breast cancer. Human Pathol. 76, 122–132. doi: 10.1016/j.humpath.2018.03.010
Cheng, L., Hu, Y., Sun, J., Zhou, M., and Jiang, Q. (2018). DincRNA: a comprehensive web-based bioinformatics toolkit for exploring disease associations and ncRNA function. Bioinformatics 34, 1953–1956. doi: 10.1093/bioinformatics/bty002
Cheng, L., Wang, P., Tian, R., Wang, S., Guo, Q., Luo, M., et al. (2019). LncRNA2Target v2.0: a comprehensive database for target genes of lncRNAs in human and mouse. Nucleic Acids Res. 47, D140–D144. doi: 10.1093/nar/gky1051
Christensen, A., Bourke, J., Nielsen, M., Møller, H., Svendsen, L., Mogensen, A., et al. (2006). Detection rate of periintestinal lymph nodes. Ultraschall Med. Eur. J. Ultrasound 27, 360–363. doi: 10.1055/s-2005-858966
Colaprico, A., Silva, T. C., Olsen, C., Garofano, L., Cava, C., Garolini, D., et al. (2016). TCGAbiolinks: an R/Bioconductor package for integrative analysis of TCGA data. Nucleic Acids Res. 44:e71. doi: 10.1093/nar/gkv1507
Deng, H.-Y., Zeng, M., Li, G., Alai, G., Luo, J., Liu, L.-X., et al. (2019). Lung adenocarcinoma has a higher risk of lymph node metastasis than squamous cell carcinoma: a propensity score-matched analysis. World J. Surg. 43, 955–962. doi: 10.1007/s00268-018-4848-7
Fatica, A., and Bozzoni, I. (2014). Long non-coding RNAs: new players in cell differentiation and development. Nat. Rev. Genet. 15, 7–21. doi: 10.1038/nrg3606
Flippot, R., Malouf, G. G., Su, X., Mouawad, R., Spano, J.-P., and Khayat, D. (2016). Cancer subtypes classification using long non-coding RNA. Oncotarget 7:54082. doi: 10.18632/oncotarget.10213
Gutschner, T., and Diederichs, S. (2012). The hallmarks of cancer: a long non-coding RNA point of view. RNA Biol. 9, 703–719. doi: 10.4161/rna.20481
Hazan, H., Saunders, D. J., Khan, H., Patel, D., Sanghavi, D. T., Siegelmann, H. T., et al. (2018). BindsNET: a machine learning-oriented spiking neural networks library in python. Front. Neuroinform. 12:89. doi: 10.3389/fninf.2018.00089
Hermanek, P. (2000). Lymph nodes and malignant tumors. Zentralbl Chir. 125, 790–795. doi: 10.1055/s-2000-10046
Hira, Z. M., and Gillies, D. F. (2015). A review of feature selection and feature extraction methods applied on microarray data. Adv. Bioinformatics 2015:198363. doi: 10.1155/2015/198363
Hu, S., Yin, X., Zhang, G., and Meng, F. (2019). Identification of DNA methylation signature to predict prognosis in gastric adenocarcinoma. J. Cell Biochem. 120, 11708–11715. doi: 10.1002/jcb.28450
Huang, S., Cai, N., Pacheco, P. P., Narrandes, S., Wang, Y., and Xu, W. (2018). Applications of support vector machine (SVM) learning in cancer genomics. Cancer Genomics Proteomics 15, 41–51. doi: 10.21873/cgp.20063
Jiang, Q., Hao, Y., Wang, G., Juan, L., Zhang, T., Teng, M., et al. (2010). Prioritization of disease microRNAs through a human phenome-microRNAome network. BMC Syst. Biol. 4(Suppl. 1):S2. doi: 10.1186/1752-0509-4-S1-S2
Jiang, Q., Ma, R., Wang, J., Wu, X., Jin, S., Peng, J., et al. (2015). LncRNA2Function: a comprehensive resource for functional investigation of human lncRNAs based on RNA-seq data. BMC Genomics 16(Suppl. 3):S2. doi: 10.1186/1471-2164-16-S3-S2
Jiang, Q., Wang, G., Jin, S., Li, Y., and Wang, Y. (2013). Predicting human microRNA-disease associations based on support vector machine. Int. J. Data Min. Bioinform. 8, 282–293. doi: 10.1504/IJDMB.2013.056078
Jiang, Q., Wang, J., Wang, Y., Ma, R., Wu, X., and Li, Y. (2014). TF2LncRNA: identifying common transcription factors for a list of lncRNA genes from ChIP-Seq data. Biomed. Res. Int. 2014:317642. doi: 10.1155/2014/317642
Jiang, Q., Wang, Y., Hao, Y., Juan, L., Teng, M., Zhang, X., et al. (2009). miR2Disease: a manually curated database for microRNA deregulation in human disease. Nucleic Acids Res. 37, D98–104. doi: 10.1093/nar/gkn714
Kikuchi, T., Daigo, Y., Katagiri, T., Tsunoda, T., Okada, K., Kakiuchi, S., et al. (2003). Expression profiles of non-small cell lung cancers on cDNA microarrays: identification of genes for prediction of lymph-node metastasis and sensitivity to anti-cancer drugs. Oncogene 22, 2192–2205. doi: 10.1038/sj.onc.1206288
Li, N., Cui, M., Yu, P., and Li, Q. (2019). Correlations of lncrnas with cervical lymph node metastasis and prognosis of papillary thyroid carcinoma. OncoTargets Ther. 12:1269. doi: 10.2147/OTT.S191700
Liu, G., Hu, Y., Han, Z., Jin, S., and Jiang, Q. (2019). Genetic variant rs17185536 regulates SIM1 gene expression in human brain hypothalamus. Proc. Natl. Acad. Sci. U.S.A. 116, 3347–3348. doi: 10.1073/pnas.1821550116
Liu, G., Jin, S., Hu, Y., and Jiang, Q. (2018). Disease status affects the association between rs4813620 and the expression of Alzheimer's disease susceptibility gene TRIB3. Proc. Natl. Acad. Sci. U.S.A. 115, E10519–E10520. doi: 10.1073/pnas.1812975115
Love, M. I., Huber, W., and Anders, S. (2014). Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2. Genome Biol. 15:550. doi: 10.1186/s13059-014-0550-8
Ma, J., Zhang, L., Bian, H. R., Lu, Z. G., Zhu, L., Yang, P., et al. (2019). A noninvasive prediction nomogram for lymph node metastasis of hepatocellular carcinoma based on serum long noncoding RNAs. Biomed. Res. Int. 2019:1710670. doi: 10.1155/2019/1710670
Mitobe, Y., Takayama, K. I., Horie-Inoue, K., and Inoue, S. (2018). Prostate cancer-associated lncRNAs. Cancer Lett. 418, 159–166. doi: 10.1016/j.canlet.2018.01.012
Monzon, F. A., Medeiros, F., Lyons-Weiler, M., and Henner, W. D. (2010). Identification of tissue of origin in carcinoma of unknown primary with a microarray-based gene expression test. Diagnostic Pathol. 5:3. doi: 10.1186/1746-1596-5-3
Moriya, Y., Iyoda, A., Kasai, Y., Sugimoto, T., Hashida, J., Nimura, Y., et al. (2009). Prediction of lymph node metastasis by gene expression profiling in patients with primary resected lung cancer. Lung Cancer 64, 86–91. doi: 10.1016/j.lungcan.2008.06.022
Obinu, A., Gavini, E., Rassu, G., Maestri, M., Bonferoni, M. C., and Giunchedi, P. (2018). Lymph node metastases: importance of detection and treatment strategies. Expert opinion on drug delivery 15, 459–467. doi: 10.1080/17425247.2018.1446937
Perez-Diez, A., Morgun, A., and Shulzhenko, N. (2007). “Microarrays for cancer diagnosis and classification,” in Microarray Technology and Cancer Gene Profiling, ed S. Mocellin (New York, NY: Springer), 74–85.
Qu, A., Yang, Y., Zhang, X., Wang, W., Liu, Y., Zheng, G., et al. (2018). Development of a preoperative prediction nomogram for lymph node metastasis in colorectal cancer based on a novel serum miRNA signature and CT scans. EBioMedicine 37, 125–133. doi: 10.1016/j.ebiom.2018.09.052
Reijnen, C., Inthout, J., Massuger, L., Strobbe, F., Kusters-Vandevelde, H. V. N., Haldorsen, I. S., et al. (2019). Diagnostic accuracy of clinical biomarkers for preoperative prediction of lymph node metastasis in endometrial carcinoma: a systematic review and meta-analysis. Oncologist 24, e880–e890. doi: 10.1634/theoncologist.2019-0117
Romeo-Casabona, C., Nicolas, P., Knoppers, B. M., Joly, Y., Wallace, S. E., Chalmers, D., et al. (2012). Legal aspects of genetic databases for international biomedical research: the example of the International Cancer Genome Consortium (ICGC). Rev. Derecho Genoma Hum. 37, 15–34.
Rosenfeld, N., Aharonov, R., Meiri, E., Rosenwald, S., Spector, Y., Zepeniuk, M., et al. (2008). MicroRNAs accurately identify cancer tissue origin. Nat. Biotechnol. 26:462. doi: 10.1038/nbt1392
Saeys, Y., Inza, I., and Larrañaga, P. (2007). A review of feature selection techniques in bioinformatics. Bioinformatics 23, 2507–2517. doi: 10.1093/bioinformatics/btm344
Singh, R. K., and Sivabalakrishnan, M. (2015). Feature selection of gene expression data for cancer classification: a review. Procedia Comput Sci. 50, 52–57. doi: 10.1016/j.procs.2015.04.060
Sorensen, K. P., Thomassen, M., Tan, Q., Bak, M., Cold, S., Burton, M., et al. (2015). Long non-coding RNA expression profiles predict metastasis in lymph node-negative breast cancer independently of traditional prognostic markers. Breast Cancer Res. 17:55. doi: 10.1186/s13058-015-0557-4
Sugimura, H., and Yoshimura, K. (2019). Lymph node metastasis matters. J. Thoracic Dis. 11:S331. doi: 10.21037/jtd.2018.12.127
Swami, A., and Jain, R. (2013). Scikit-learn: Machine learning in python. J. Mach. Learn. Res. 12, 2825–2830. doi: 10.1524/auto.2011.0951
Tang, J., Alelyani, S., and Liu, H. (2014). “Feature selection for classification: a review,” in Data Classification: Algorithms and Applications (CRC Press), 37–64. doi: 10.1201/b17320
Tang, W., Wan, S., Yang, Z., Teschendorff, A. E., and Zou, Q. (2018). Tumor origin detection with tissue-specific miRNA and DNA methylation markers. Bioinformatics 34, 398–406. doi: 10.1093/bioinformatics/btx622
Ulitsky, I., and Bartel, D. P. (2013). lincRNAs: genomics, evolution, and mechanisms. Cell 154, 26–46. doi: 10.1016/j.cell.2013.06.020
Varadhachary, G. (2013). New strategies for carcinoma of unknown primary: the role of tissue-of-origin molecular profiling. Clin. Cancer Res. 19, 4027–4033. doi: 10.1158/1078-0432.CCR-12-3030
Wang, J.-Y., Lu, A.-Q., and Chen, L.-J. (2019). LncRNAs in ovarian cancer. Clin. Chim. Acta. 490, 17–27. doi: 10.1016/j.cca.2018.12.013
Wang, Y., Klijn, J. G., Zhang, Y., Sieuwerts, A. M., Look, M. P., Yang, F., et al. (2005). Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer. Lancet 365, 671–679. doi: 10.1016/S0140-6736(05)17947-1
Xu, Y., Xu, L., and Wang, J. (2018). Clinical predictors of lymph node metastasis and survival rate in papillary thyroid microcarcinoma: analysis of 3607 patients at a single institution. J. Surg. Res. 221, 128–134. doi: 10.1016/j.jss.2017.08.007
Yang, C., Ma, C., Li, Y., Mo, P., and Yang, Y. (2019a). High Tiam1 expression predicts positive lymphatic metastasis and worse survival in patients with malignant solid tumors: a systematic review and meta-analysis. Onco Targets Ther. 12, 5925–5936. doi: 10.2147/OTT.S191571
Yang, C., Zhang, Y., Xu, X., and Li, W. (2019b). Molecular subtypes based on DNA methylation predict prognosis in colon adenocarcinoma patients. Aging 11, 11880–11892. doi: 10.18632/aging.102492
Zeng, Y.-R., Yang, Q.-H., Liu, Q.-Y., Min, J., Li, H.-G., Liu, Z.-F., et al. (2019). Dual energy computed tomography for detection of metastatic lymph nodes in patients with hepatocellular carcinoma. World J. Gastroenterol. 25:1986. doi: 10.3748/wjg.v25.i16.1986
Zhang, L., Xiang, Z. L., Zeng, Z. C., Fan, J., Tang, Z. Y., and Zhao, X. M. (2016). A microRNA-based prediction model for lymph node metastasis in hepatocellular carcinoma. Oncotarget 7, 3587–3598. doi: 10.18632/oncotarget.6534
Zhong, K., Yang, F., Han, Q., Chen, J., and Wang, J. (2018). Skp2 expression has different clinicopathological and prognostic implications in lung adenocarcinoma and squamous cell carcinoma. Oncol. Lett. 16, 2873–2880. doi: 10.3892/ol.2018.9000
Keywords: lymph-node metastasis, molecular profiles, classifiers, webserver, biomarker
Citation: Zhang S, Zhang C, Du J, Zhang R, Yang S, Li B, Wang P and Deng W (2021) Prediction of Lymph-Node Metastasis in Cancers Using Differentially Expressed mRNA and Non-coding RNA Signatures. Front. Cell Dev. Biol. 9:605977. doi: 10.3389/fcell.2021.605977
Received: 14 September 2020; Accepted: 07 January 2021;
Published: 11 February 2021.
Edited by:
Lei Deng, Central South University, ChinaReviewed by:
Junwei Luo, Henan Polytechnic University, ChinaYongchun Zuo, Inner Mongolia University, China
Copyright © 2021 Zhang, Zhang, Du, Zhang, Yang, Li, Wang and Deng. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Pingping Wang, 353275499@qq.com; Wensheng Deng, dengwensheng@wust.edu.cn
†These authors have contributed equally to this work