Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 20 June 2022
Sec. Gastrointestinal Cancers: Hepato Pancreatic Biliary Cancers
This article is part of the Research Topic Clinicopathological Factors and Staging in Gastrointestinal Cancers View all 74 articles

Development and Validation of Nomogram for Predicting Survival of Primary Liver Cancers Using Machine Learning

Rui Chen,Rui Chen1,2Beining HouBeining Hou3Shaotian QiuShaotian Qiu4Shuai Shao,Shuai Shao4,5Zhenjun Yu,Zhenjun Yu1,2Feng Zhou,Feng Zhou1,2Beichen Guo,Beichen Guo1,2Yuhan Li,Yuhan Li1,2Yingwei Zhang*Yingwei Zhang6*Tao Han,,,*Tao Han1,2,4,5*
  • 1Department of Hepatology and Gastroenterology, Tianjin Union Medical Center, Tianjin Medical University, Tianjin, China
  • 2Department of Hepatology and Gastroenterology, The Third Central Clinical College of Tianjin Medical University, Tianjin, China
  • 3School of Computer Science and Technology, Dalian University of Technology, Dalian, China
  • 4Department of Hepatology and Gastroenterology, Tianjin Union Medical Center Affiliated to Nankai University, Tianjin, China
  • 5Department of Hepatology and Gastroenterology, Tianjin Third Central Hospital Affiliated to Nankai University, Tianjin, China
  • 6Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Beijing, China

Background and Aims: Primary liver cancer (PLC) is a common malignancy with poor survival and requires long-term follow-up. Hence, nomograms need to be established to predict overall survival (OS) and cancer-specific survival (CSS) from different databases for patients with PLC.

Methods: Data of PLC patients were downloaded from Surveillance, Epidemiology, and End Results (SEER) and the Cancer Genome Atlas (TCGA) databases. The Kaplan Meier method and log-rank test were used to compare differences in OS and CSS. Independent prognostic factors for patients with PLC were determined by univariate and multivariate Cox regression analyses. Two nomograms were developed based on the result of the multivariable analysis and evaluated by calibration curves and receiver operating characteristic curves.

Results: OS and CSS nomograms were based on age, race, TNM stage, primary diagnosis, and pathologic stage. The area under the curve (AUC) was 0.777, 0.769, and 0.772 for 1-, 3- and 5-year OS. The AUC was 0.739, 0.729 and 0.780 for 1-, 3- and 5-year CSS. The performance of the two new models was then evaluated using calibration curves.

Conclusions: We systematically reviewed the prognosis of PLC and developed two nomograms. Both nomograms facilitate clinical application and may benefit clinical decision-making.

Introduction

Primary liver cancer (PLC) is one of the most common malignancies of the digestive system, and its mortality rate in men and women has increased so that it now ranks fourth and seventh in terms of cancer-related deaths among global malignancies (1). Traditionally, tumors of the PLC at the pathological level can be subdivided into 3 groups: Hepatocellular carcinoma (HCC, comprising 75%-85% of cases), cholangiocarcinoma (CC, 10%-15%), and combined hepatocellular-cholangiocarcinoma (CHC) that is a rare primary liver cancer (2). Although the trend of PLC largely reflects the trend of HCC, there are notable exceptions (3). The main risk factors for liver cancer are chronic hepatitis B virus (HBV) or hepatitis C virus (HCV), eating aflatoxin-contaminated food, and heavy drinking. However, the main risk factors differ in different regions. As one of the malignant tumors, due to the low early diagnosis rate, high recurrence, and metastasis rate after resection, the 5-year survival rate of PLC has been maintained between 15% and 40% (2). With a poor prognosis and survival rates, HCC patients must have a long-term follow-up.

In the era of big data, various intelligent techniques can be used to optimize medical management plans, provide better patient care and treatment, improve population health and reduce costs (4). Surveillance, Epidemiology, and End Results (SEER) database, supported by the surveillance research program of the National Cancer Institute (NCI) Department of cancer control and Population Sciences, is one of the most representative large-scale tumor registration databases. It collects a large number of evidence-based medical data and provides systematic evidence and valuable first-hand information for clinicians’ evidence-based practice and clinical medical research (5). The Cancer Genome Atlas (TCGA) project was jointly launched by the NCI and the National Human Genome Research Institute. At present, there is clinical and genetic information of more than 11,000 tumor patients with 33 cancers of more than 20 tissue types. In addition, the fields of big data and machine learning integrate genomics and other omics, as well as electronic health records (EHRs) and other clinical data, which in turn have the potential to transform medicine. Machine learning algorithms can predict the risk of individual patients and more accurately determine which patients will benefit the most from specific treatment (6, 7).

Nomogram is a common prediction model used to predict and quantify the probability of clinical events. It is of great value for clinical decision-making and risk stratification, especially for cancer patients (8). The nomogram of breast cancer, lung cancer, liver cancer (911), and other malignancies can help patients to predict the risks and benefits of treatment (12) (5). In recent years, there have been relatively few systematic review studies of liver cancer by combing two separate databases. Therefore, we decided to combine SEER and TCGA databases to construct nomograms to predict the prognosis of PLC and help provide new horizons for treatment.

Materials and Methods

Data Collection

Clinical data were downloaded from the SEER data portal (www.seer.cancer.gov) and the TCGA data portal (https://portal.gdc.cancer.gov). Inclusion criteria included: a) complete clinical information; b) only one malignant primary tumor; c) the International Classification of Diseases for Oncology-3 (ICD-O-3) histology code: 8170/3: HCC, 8160/3: CC, 8180/3: CHC. Follow-up was suspended when patients with liver cancer died or lost contact. As SEER and TCGA data are open to the public, approval from a local ethics committee is not necessary.

The patient study variables we extracted and analyzed included baseline demographics and tumor characteristics. Baseline demographics include age(≤50y, 50–59y, 60 – 69y, 70–79y, ≥80y), race (White, Black, Other), gender (Female, Male) and time of diagnosis, survival time (months), follow-up and vital survival status. The main clinical variables were as follows: pathological type of liver cancer (HCC, CC, CHC), American Joint Committee on Cancer (AJCC) stage, and TNM staging were determined according to AJCC Cancer Staging Manual.

Overall survival (OS) or cancer-specific survival (CSS) was used as the endpoints of our study. OS represents the time duration from diagnosis to the date of death or last contact. CSS represents the time duration from diagnosis to the date of cancer death.

Statistical Analyses

To make full use of our data to build predictive models, we used python (version 3.8) to randomize data from SEER, taking the first 9161 as the training group, and the remaining 184 as the internal validation group while 172 patients from TCGA as the external validation group. We used the training group to build the prediction model and draw the nomogram. A validation group was used to validate the model.

For survival analyses, univariate Cox analysis was used to determine significant variables, defined as a p-value of less than 0.05, from clinical data. In all statistical analyses, P values were < 0.05 is considered significant. Univariate and multivariate Cox proportional hazards regression models were used to estimate hazard ratios (HR) and corresponding 95% confidential intervals (CI) for each potential prognostic variable. SPSS 25.0 (SPSS, Chicago, IL) was used for the above analysis. Based on the results of multivariate analysis, nomograms were developed to provide visual risk prediction. The nomogram was formulated based on the results of multivariate analysis using R software. The performance of the predictive prognostic model was evaluated by calculating the concordance index (c-index). Nomograms were calibrated for one -, three -, and five-year survival rates by comparing observed survival with predicted survival probabilities.

We performed statistical analysis with R version 4.1.2 (The R Foundation for Statistical Computing, Vienna, Austria). The software packages of R Project, such as “survival(3.2-13) survminer (0.4.9)”, “survival (3.2-13 rms 6.2-0 Hmisc 4.6-0 grid 4.1.2 lattice 0.20-45 Formula 1.2-4 ggplot2 3.3.5)”, “survival (3.2-13) rms (6.2-0)” and “survival (3.2-13) timeROC (0.4)” are used to draw Kaplan–Meier (KM), nomogram and calibration diagram and timeROC, while “timeroc” and “survival” are used to verify the model and conduct AUC analysis. All packages are installed by the Packages command installed from the R language functional network CRAN.

Results

Patient Characteristics

According to the screening criteria, the data of 66039 patients were extracted from the SEER database. Subsequently, the data of 54588 patients were excluded because they did not have complete data. The final sample included 11451 patients in the entire cohort. Among them, 9161 (80%) patients were used as a training set to establish a predictive nomogram. The remaining 2290 (20%) patients were used to validate the nomogram. The external validation cohort included 172 patients from TCGA (Supplementary Table 1). The clinicopathological features of the training and validation cohort are shown in Table 1. All patients had complete information on survival time and cause of death. The median survival time of patients with liver cancer in this sample was 13.0 months. The 1-year, 3-year, and 5-year OS rate in the SEER population was 36.1%, 9.4%, and 2.2% respectively. While the 1 -, 3 -, and 5-year CSS were 51.5%, 29.7% and 21.5%, respectively.

TABLE 1
www.frontiersin.org

Table 1 Characteristics of 11,451 patients with Primary Liver Cancer in SEER, n (%).

Univariate and Multivariate Cox Proportional Hazard Analysis

We performed univariate and multivariate analyses to identify prognostic factors associated with the survival of PLC patients in the training cohort. In the univariate analysis, older age, higher TNM stage, higher pathologic stage, CHC, and American Indian/Alaska Native can predict worse OS and CSS. However, ethnicity and gender had no significant effect on OS or CSS (Figures 1, 2).

FIGURE 1
www.frontiersin.org

Figure 1 OS for PLC patients stratified by (A) Age, p < 0.0001; (B) Ethnicity p = 0.990; (C) Gender, p = 0.640; (D) T-stage, p < 0.0001; (E) N-stage, p < 0.0001; (F) M-stage, p < 0.001; (G) Pathological Type, p < 0.0001; (H) Race, p < 0.0001; (I) Pathological Stage, p < 0.0001.

FIGURE 2
www.frontiersin.org

Figure 2 CSS for PLC patients stratified by (A) Age, p < 0.0001; (B) Ethnicity p = 0.960; (C) Gender, p = 0.370; (D) T-stage, p < 0.0001; (E) N-stage, p < 0.0001; (F) M-stage, p < 0.001; (G) Pathological Type, p < 0.0001; (H) Race, p = 0.770; (I) Pathological Stage, p < 0.0001.

Univariate Cox regression analysis of the training cohort revealed the role of the following parameters in predicting patient survival. Factors such as age, pathological type-CC, pathologic stage, stage T0, stage T1, and stage N were associated with patients’ prognoses. All the above variables were statistically significant (all P<0.05) and were included in multivariate analysis. Among these factors, the pathologic stage (c-index=0.669) and T stage (c-index=0.643) had higher discriminatory power in predicting PLC survival compared with other factors. In the Cox analysis, the maximum number of iterations was 20.

Variables involved in the multivariate analysis of OS include pathological types, pathologic stage, TNM stage, and age. According to multivariate analysis, patients with younger age, disease type of CC, lower TNM stage and adequate treatment had improved outcomes. These factors were then incorporated into the prediction model (Table 2).

TABLE 2
www.frontiersin.org

Table 2 Univariate and Multivariate Cox regression for OS.

Development and Validation of a Prognostic Nomogram

Factors from the multivariate analysis were used to develop nomograms to calculate 1-,3 -, and 5-year OS or CSS probabilities (Figure 3). Each prognostic parameter was scored according to its prognostic value. The total score was used to predict 1 -, 3 -, and 5-year OS and CSS. Furthermore, the total score for all variables was converted into an estimate of the probability of death. The distinction between survival probabilities and actual observations was assessed using the c-index. The value of the c-index fluctuates between 0.5 and 1.0 representing random chance and 1.0 represents fully corrected discrimination (13). The c-index of the prognostic nomogram for OS prediction was 0.702 (95% CI, 0.696–0.708) in the training cohort and 0.702 (95% CI, 0.689–0.714) in the internal validation cohort. We tested the nomogram using an internal receiver operating characteristic (ROC) curve in the training cohort. The area under the curve (AUC) was 0.777, 0.769 and 0.772 for 1-,3- and 5-year OS respectively, with 0.739, 0.729 and 0.780 for 1-,3- and 5-year CSS (Figure 4). The calibration plot shows good agreement between the internal and external validation cohorts (Figure 5) (Supplementary Figures 1, 2).

FIGURE 3
www.frontiersin.org

Figure 3 Prognostic nomogram predicting the probability of 1-, 3- and 5-year (A) overall survival (OS) and (B) cancer-specific survival (CSS). Each subtype within these significant independent variables was assigned a score on the point scale. The total score is projected to the bottom scale. API, Asian or Pacific Islander; W, White; B, Black; AI/AN, American Indian/Alaska Native.

FIGURE 4
www.frontiersin.org

Figure 4 (A–C) ROC curves for 1-, 3- and 5-year OS based on the nomogram. The AUC was 0.777,0.834 and 0.830, respectively; (D–F) ROC curves for 1-,3- and 5-year CSS. The AUC was 0.739,0.729 and 0.780, respectively.

FIGURE 5
www.frontiersin.org

Figure 5 (A–C) Calibration plots for 1-,3- and 5-year OS in the training cohort; (DF) Calibration plots for 1-,3- and 5-year CSS in the training cohort.

Discussion

Worldwide, PLC is a common cause of cancer-related death. PLC death rates are increasing faster than any other cancer (14). In addition, PLC is the second most lethal tumor after pancreatic cancer. HCC accounts for the majority of PLC (15). The increasing number of deaths due to HCC is an increasing concern (16). Disease and tumor-related factors have a great impact on the treatment of PLC (17). CC is an epithelial cell malignancy, and most CCs are well, moderately, and poorly differentiated adenocarcinomas, with other histological subtypes, rarely occurring. Most CCs are new-onset, with no risk factors identified (18). Moreover, CHC is a rare and aggressive variant with features of both HCC and CC, and it is unclear whether treatments commonly used for PLC are effective. The prognosis of CHC is particularly poor due to its aggressive nature. The estimated incidence of CHC ranges from 1% to 14.2% (19) (20).

In this research, patients diagnosed with PLC were included in the analysis. With more than 60000 patients, we included 9161 patients with complete clinical information in the training set from the SEER database and 172 patients from TCGA. By univariate analysis, race, age, pathologic stage, primary diagnosis, and T and N stage were all related to liver cancer progression. In addition, we conducted the multivariate analysis using these significant variables in univariate analysis. In multivariable analyses, we demonstrated that older age, higher pathological stage, and more advanced T and N stages were independently associated with poor overall survival in PLC.

PLC incidence rates vary by race/ethnicity and state, largely because of differences in the prevalence of major risk factors and, to some extent, because of different access to high-quality care (21) (22). We can also know that social status is associated with better survival. In this research, we analyzed the association between ethnicity and race with tumor survival and found that survival was slightly lower in the American Indian/Alaska Native and black.

Many studies have shown that the TNM stage may be an important prognostic factor in HCC (23) (24). In the present study, we analyzed the relationship between the TNM stage and tumor survival and found that the higher the TNM stage, the worse the survival.

Hence, we plotted the nomogram according to independent prognostic factors in the multivariate. The data used were derived from the SEER database, which ensured the validity and reliability of our conclusions, as well as the internal and external validity of the nomograms. To validate this value and prevent overfitting of the current model, it is necessary to validate a new nomogram. Moreover, we validated the predictive value of the model by using both internal and external validation cohorts. In addition, we measured the accuracy of this model by ROC curve and a calibration plot, and the larger the AUC, the higher the accuracy of the model. The training cohort AUC was 0.777,0.769 and 0.772 for 1-,3- and 5-year OS and 0.739,0.729 and 0.780 for 1-,3- and 5-year CSS. All these results indicated that the model had good accuracy for the prediction of liver cancer survival. Meanwhile, the calibration curve also validated the model’s prediction ability on the overall sample.

It has been reported that individualized prediction is considered a critical condition of predictive models (25). However, most current studies are based on a single database (26) (27). In this research, we mainly performed long-term follow-ups of patients with PLC. The main objective of this study was to use two databases to predict total and cancer-specific mortality in patients with liver cancer, which differs from currently published studies regarding predictive nomograms. The huge number of patients with PLC recorded in the SEER database helped us to build a more accurate model. In addition, the items included in the nomogram are common, easily accessible, and comprehensible items for physicians and patients in the clinic.

There are also relevant studies applied to predict cancer-specific diseases. Ni et al. (5) developed a hepatocellular carcinoma nomogram to predict cancer-specific mortality and overall mortality using the SEER database, which will help clinicians to obtain personal prediction information to determine whether patients are at high risk of death. Song et al. (28) created a pancreatic cancer survival nomogram to effectively predict patients’ survival and use it in clinical practice. Similarly, Wang et al. (29) developed and validated a new nomogram for pulmonary invasive mucinous adenocarcinoma based on the SEER database, which is expected to provide new ideas for treatment. All of these studies are based on a bioinformatics database such as the SEER database to develop nomograms for multiple cancers that predict CSS characteristics to help clinicians make clinical decisions. In this research, we used two bioinformatics databases (SEER and TCGA databases) and developed two nomograms simultaneously. Making clinical decisions more convenient and effective.

Although we have developed powerful nomograms, there are still several limitations that must be acknowledged. Potential prognostic factors available in public databases are limited. Further analysis with a more complete data set may enhance the predictive power of this tool. Data from SEER and TCGA that did not report underlying chronic liver disease, laboratory studies to assess liver function, calculation of Child-Pugh score, or details of tumor characteristics were missing, which would be important for further treatment and thus impact survival. However, data from the multicenter nature of the sources provide significant benefits. This model comprehensively evaluated the clinical features and treatment of liver cancer and provided ideas for improving the prognosis of liver cancer.

In conclusion, we conducted an analysis of the prognosis of PLC based on a large population in the SEER and TCGA databases. Reviewed the prognosis of PLC and developed and validated two new nomograms. We then elucidated the factors influencing the prognosis of PLC. These models give us a deeper understanding of PLC. They are expected to be used as stratification tools in clinical studies and as evidence for the development of interventions to improve survival.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.

Ethics Statement

This study was based on publicly available data from the SEER and TCGA database, and did not involve interaction with human subjects or the use of personally identifiable information. The study did not require informed consent for SEER and TCGA registration cases, and the author obtained a”limited use data agreement” from SEER. No trial registration was required.

Author Contributions

Software, formal analysis, investigation, and writing of the original draft (YZ and TH), acquisition of the data (BH), analysis and interpretation of data (SS, ZY, and SQ), drafted the manuscript (RC), critical revision of the manuscript for important intellectual content (BG and FZ), and study supervision (YL). All authors reviewed and commented on the manuscript and approved the final version.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.926359/full#supplementary-material

Supplementary Figure 1 | (A–C) Calibration plots for 1-,3- and 5-year OS in the internal validation cohort; (D–F) Calibration plots for 1-,3- and 5-year CSS in the internal validation cohort.

Supplementary Figure 2 | (A–C) Calibration plots for 1-,3- and 5-year OS in the external validation cohort.

Supplementary Table 1 | Characteristics of 172 patients with Primary Liver Cancer in TCGA.

Abbreviations

PLC, Primary liver cancer; HCC, Hepatocellular carcinoma; CC, Cholangiocarcinoma; CHC, Combined Hepatocellular-Cholangiocarcinoma; HBV, Chronic hepatitis B virus; HCV, Hepatitis C virus; SEER, Surveillance, Epidemiology, and End Results; NCI, National Cancer Institute; EHRs, The Cancer Genome Atlas (TCGA); electronic health records; OS, Overall survival; CSS, Cancer-specific survival.

References

1. Siegel RL, Miller KD, Fuchs HE, Jemal A. Cancer Statistics, 2021. CA Cancer J Clin (2021) 71:7–33. doi: 10.3322/caac.21654

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Kaplan DE, Mehta R, D'Addeo K, Gade TP, Taddei TH. Transarterial Chemoembolization Within First 3 Months of Sorafenib Initiation Improves Overall Survival in Hepatocellular Carcinoma: A Retrospective, Multi-Institutional Study With Propensity Matching. J Vasc Interv Radiol (2018) 29:540–9.e4. doi: 10.1016/j.jvir.2017.11.033

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin (2021) 71:209–49. doi: 10.3322/caac.21660

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Berwick DM, Nolan TW, Whittington J. The Triple Aim: Care, Health, and Cost. Health Aff (Millwood) (2008) 27:759–69. doi: 10.1377/hlthaff.27.3.759

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Xiaofeng N. Development and Evaluation of Nomograms to Predict the Cancer-Specific Mortality and Overall Mortality of Patients With Hepatocellular Carcinoma. BioMed Res Int (2021) 2021:1658403. doi: 10.1155/2021/1658403

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Weintraub WS, Fahed AC, Rumsfeld JS. Translational Medicine in the Era of Big Data and Machine Learning. Circ Res (2018) 123:1202–4. doi: 10.1161/CIRCRESAHA.118.313944

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Telenti A, Lippert C, Chang PC, DePristo M. Deep Learning of Genomic Variation and Regulatory Network Data. Hum Mol Genet (2018) 27:R63–71. doi: 10.1093/hmg/ddy115

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Balachandran VP, Gonen M, Smith JJ, DeMatteo RP. Nomograms in Oncology: More Than Meets the Eye. Lancet Oncol (2015) 16:e173–80. doi: 10.1016/S1470-2045(14)71116-7

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Li Y, Liu W, Zhao L, Gungor C, Xu Y, Song X, et al. Nomograms Predicting Overall Survival and Cancer-Specific Survival for Synchronous Colorectal Liver-Limited Metastasis. J Cancer (2020) 11:6213–25. doi: 10.7150/jca.46155

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Ma L, Deng K, Zhang C, Li H, Luo Y, Yang Y, et al. Nomograms for Predicting Hepatocellular Carcinoma Recurrence and Overall Postoperative Patient Survival. Front Oncol (2022) 12:843589. doi: 10.3389/fonc.2022.843589

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Shen Q, Hu G, Wu J, Lv L. A New Clinical Prognostic Nomogram for Liver Cancer Based on Immune Score. PLos One (2020) 15:e0236622. doi: 10.1371/journal.pone.0236622

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Xiao Z, Yan Y, Zhou Q, Liu H, Huang P, Zhou Q, et al. Development and External Validation of Prognostic Nomograms in Hepatocellular Carcinoma Patients: A Population Based Study. Cancer Manag Res (2019) 11:2691–708. doi: 10.2147/CMAR.S191287

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Wolbers M, Koller MT, Witteman JC, Steyerberg EW. Prognostic Models With Competing Risks: Methods and Application to Coronary Risk Prediction. Epidemiology (2009) 20:555–61. doi: 10.1097/EDE.0b013e3181a39056

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Ryerson AB, Eheman CR, Altekruse SF, Ward JW, Jemal A, Sherman RL, et al. Annual Report to the Nation on the Status of Cancer, 1975-2012, Featuring the Increasing Incidence of Liver Cancer. Cancer (2016) 122:1312–37. doi: 10.1002/cncr.29936

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Villanueva A. Hepatocellular Carcinoma. N Engl J Med (2019) 380:1450–62. doi: 10.1056/NEJMra1713263

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Jiaquan X. Trends in Liver Cancer Mortality Among Adults Aged 25 and Over in the United States, 2000-2016. NCHS Data Brief (2018) 314:1–8. doi: 10.1002/cncr.31869

CrossRef Full Text | Google Scholar

17. Llovet J, Brú C, Bruix J. Prognosis of Hepatocellular Carcinoma: The BCLC Staging Classification. Semin liver Dis (1999) 19:329–38. doi: 10.1055/s-2007-1007122

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Razumilava N, Gores GJ. Cholangiocarcinoma. Lancet (2014) 383:2168–79. doi: 10.1016/S0140-6736(13)61903-0

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Koh KC, Lee H, Choi MS, Lee JH, Paik SW, Yoo BC, et al. Clinicopathologic Features and Prognosis of Combined Hepatocellular Cholangiocarcinoma. Am J Surg (2005) 189:120–5. doi: 10.1016/j.amjsurg.2004.03.018

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Mitchell S W. Combined Hepatocellular Cholangiocarcinomas; Analysis of a Large Database. Clin Med Pathol (2008) 1:43–7. doi: 10.4137/cpath.s500

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Jemal A, Ward EM, Johnson CJ, Cronin KA, Ma J, Ryerson B, et al. Annual Report to the Nation on the Status of Cancer, 1975-2014, Featuring Survival. J Natl Cancer Inst (2017) 109. doi: 10.1093/jnci/djx030

CrossRef Full Text | Google Scholar

22. Krok-Schoen JL, Adams IK, Baltic RD, Fisher JL. Ethnic Disparities in Cancer Incidence and Survival Among the Oldest Old in the United States. Ethn Health (2020) 25:79–92. doi: 10.1080/13557858.2017.1395818

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Minagawa M, Ikai I, Matsuyama Y, Yamaoka Y, Makuuchi M. Staging of Hepatocellular Carcinoma: Assessment of the Japanese TNM and AJCC/UICC TNM Systems in a Cohort of 13,772 Patients in Japan. Ann Surg (2007) 245:909–22. doi: 10.1097/01.sla.0000254368.65878.da

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Chan AC, Fan ST, Poon RT, Cheung TT, Chok KS, Chan SC, et al. Evaluation of the Seventh Edition of the American Joint Committee on Cancer Tumour-Node-Metastasis (TNM) Staging System for Patients Undergoing Curative Resection of Hepatocellular Carcinoma: Implications for the Development of a Refined Staging System. HPB (Oxford) (2013) 15:439–48. doi: 10.1111/j.1477-2574.2012.00617.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Zhou X, Wang W, Wang C, Zheng C, Xu X, Ni X, et al. DPP4 Inhibitor Attenuates Severe Acute Pancreatitis-Associated Intestinal Inflammation via Nrf2 Signaling. Oxid Med Cell Longev (2019) 2019:6181754. doi: 10.1155/2019/6181754

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Hu C, Yang J, Huang Z, Liu C, Lin Y, Tong Y, et al. Diagnostic and Prognostic Nomograms for Bone Metastasis in Hepatocellular Carcinoma. BMC Cancer (2020) 20:494. doi: 10.1186/s12885-020-06995-y

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Zhang Z, Zhao X, Li Z, Wu Y, Liu Y, Li Z, et al. Development of a Nomogram Model to Predict Survival Outcomes in Patients With Primary Hepatic Neuroendocrine Tumors Based on SEER Database. BMC Cancer (2021) 21:567. doi: 10.1186/s12885-021-08337-y

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Song W, Miao D-L, Chen L. Nomogram for Predicting Survival in Patients With Pancreatic Cancer. OncoTargets Ther Volume (2018) 11:539–45. doi: 10.2147/OTT.S154599

CrossRef Full Text | Google Scholar

29. Wang Y, Liu J, Huang C, Zeng Y, Liu Y, Du J. Development and Validation of a Nomogram for Predicting Survival of Pulmonary Invasive Mucinous Adenocarcinoma Based on Surveillance, Epidemiology, and End Results (SEER) Database. BMC Cancer (2021) 21:148. doi: 10.1186/s12885-021-07811-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: primary liver cancer, SEER, TCGA, nomogram, cancer specific survival

Citation: Chen R, Hou B, Qiu S, Shao S, Yu Z, Zhou F, Guo B, Li Y, Zhang Y and Han T (2022) Development and Validation of Nomogram for Predicting Survival of Primary Liver Cancers Using Machine Learning. Front. Oncol. 12:926359. doi: 10.3389/fonc.2022.926359

Received: 22 April 2022; Accepted: 23 May 2022;
Published: 20 June 2022.

Edited by:

Sanjit Mukherjee, National Institutes of Health (NIH), United States

Reviewed by:

Pijush Das, CSIR - Indian Institute of Chemical Biology, India
Arijita Sarkar, University of Southern California, United States
Weiqi Rong, Chinese Academy of Medical Sciences and Peking Union Medical College, China

Copyright © 2022 Chen, Hou, Qiu, Shao, Yu, Zhou, Guo, Li, Zhang and Han. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yingwei Zhang, zhangyingwei@ict.ac.cn; Tao Han, hantaomd@126.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.