Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 06 January 2022
Sec. Digital Public Health
This article is part of the Research Topic Big Data Analytics for Smart Healthcare applications View all 109 articles

The Construction and Development of a Clinical Prediction Model to Assess Lymph Node Metastases in Osteosarcoma

  • 1Department of Orthopedics, Xianyang Central Hospital, Xianyang, China
  • 2Clinical Medical Research Center, Xianyang Central Hospital, Xianyang, China
  • 3Department of Spine Surgery, Second Affiliated Hospital of Dalian Medical University, Dalian, China
  • 4Department of Orthopaedics, The Second Hospital of Jilin University, Changchun, China
  • 5Department of Spine Surgery, Liuzhou People's Hospital, Liuzhou, China
  • 6Shulan International Medical College, Zhejiang Shuren University, Hangzhou, China
  • 7College of Information and Electrical Engineering, China Agricultural University, Beijing, China
  • 8Faculty of Medicine, Macau University of Science and Technology, Macau, Macao SAR, China

Background: This study aimed to construct a clinical prediction model for osteosarcoma patients to evaluate the influence factors for the occurrence of lymph node metastasis (LNM).

Methods: In our retrospective study, a total of 1,256 patients diagnosed with chondrosarcoma were enrolled from the SEER (Surveillance, Epidemiology, and End Results) database (training cohort, n = 1,144) and multicenter dataset (validation cohort, n = 112). Both the univariate and multivariable logistic regression analysis were performed to identify the potential risk factors of LNM in osteosarcoma patients. According to the results of multivariable logistic regression analysis, A nomogram were established and the predictive ability was assessed by calibration plots, receiver operating characteristics (ROCs) curve, and decision curve analysis (DCA). Moreover, Kaplan-Meier plot of overall survival (OS) was plot and a web calculator visualized the nomogram.

Results: Five independent risk factors [chemotherapy, surgery, lung metastases, lymphatic metastases (M-stage) and tumor size (T-stage)] were identified by multivariable logistic regression analysis. What's more, calibration plots displayed great power both in training and validation group. DCA presented great clinical utility. ROCs curve provided the predictive ability in the training cohort (AUC = 0.805) and the validation cohort (AUC = 0.808). Moreover, patients in LNN group had significantly better survival than that in LNP group both in training and validation group.

Conclusion: In this study, we constructed and developed a nomogram with risk factors, which performed well in predicting risk factors of LNM in osteosarcoma patients. It may give a guide for surgeons and oncologists to optimize individual treatment and make a better clinical decision.

Introduction

Osteosarcoma is a common malignant bone tumor. The primary treatment consisting of neoadjuvant therapy, surgery and postoperative chemotherapy have resulted in the 5-year overall survival rate of ~60% (1, 2). However, even with the treatment of surgery and chemotherapy, the prognosis for patients with metastatic osteosarcoma remains dismal (3, 4).The lung metastases, the primary target of metastasis in osteosarcoma, has five-year survival rates of ~30% (5, 6). In extrapulmonary metastatic osteosarcoma, patients with lymph node metastases (LNM) have worse clinical outcomes, with five-year survival rates of 10% (7). However, only 3% of patients with osteosarcoma are diagnosed with LNM, leading to the lack of adequate clinical data for exploring osteosarcoma LNM (8).Therefore, a population-based study to assess the LNM in osteosarcoma is imminent.

Furthermore, disease forecasting is a vital part of the medical research (918). As a visual prediction tool, nomogram lists each variable separately and assigns a corresponding score for each status (19). Based on these considerations, we mined the Surveillance, Epidemiology, and End Results (SEER) database to construct the nomogram and used data from four academic hospitals for independent validation. This study contributes to providing more personalized guidance for patient care and improving patients' prognosis.

Materials and Methods

Data Collection

In the present study, patients diagnosed with osteosarcoma between 2010 and 2016 were collected. The training group were extracted from the Surveillance, Epidemiology, and End Results (SEER) database with the SEER * Stat software version 8.3.6. And the third edition of the International Taxonomy of Oncology (ICDO-3), morphological code (9220) was used to identify osteosarcoma. The exclusion criteria of the training group were as follows: (1) patients with no positive pathology; (2) patients with unknown lymph node status and survival time; (3) more than one primary tumor.

Data of the validation group were obtained from four academic institutions, the Second Affiliated Hospital of Jilin University, the Second Affiliated Hospital of Dalian Medical University, the Liuzhou People's Hospital affiliated to Guangxi Medical University, and the Xianyang Central Hospital. And during the period of investigation, each center was responsible for the acquisition of data by three investigators. Two investigators were responsible for data extraction and the accuracy check was conducted by the third investigator. The exclusion criteria were consistent with the training group. For multicenter data, the study was approved by the ethics review committee of four medical institutions in China, the Second Affiliated Hospital of Jilin University, the Second Affiliated Hospital of Dalian Medical University, Liuzhou People's Hospital, and Xianyang Central Hospital (No. 2021-00-22) and was conducted in accordance with the guidelines of the Helsinki Declaration.

Demographic and clinical variables, including race, age, survival time, sex, primary site, grade, laterality, tumor size (T-stage), distance metastases (M-stage), surgery, radiation, chemotherapy, bone metastases and lung metastases were considered in this study.

Statistical Analysis

Continuous variables were expressed as mean ± standard deviation (SD), and categorical variables were expressed as frequency (proportions). The Student's t-test, Chi-square tests and Mann–Whitney tests were applied to continuous variables and categorical variables respectively with IBM SPSS Statistics version 26.0 (SPSS Inc., Chicago, Illinois, USA). Risk factors of the osteosarcoma were assessed using logistic regression. All analyzes were performed using R software version 3.6.2 (http://www.r-project.org/) including multiple R packages (Including regplot, rms, rmda and pROC). P values < 0.05 were considered statistically significant, and confidence intervals (CIs) were expressed as 95% confidence levels.

Construction, Validation and Clinical Utility of a Nomogram

The following variables were included in the univariate logistic regression analysis: race, age, survival time, sex, primary site, grade, laterality, tumor size, lymphatic metastasis, surgery, radiation, chemotherapy, bone metastases and lung metastases. According to the result of the univariate logistic regression analysis with the P value < 0.05, we performed the multivariable logistic regression analysis. And the Nomogram was constructed based on the results of multivariable logistic regression analysis with the P value < 0.05. Calibration plot and receiver operating characteristic (ROC) curves were used to evaluate the prediction performance of the nomogram. The higher the area under the curves (AUC) of ROC indicated the better model performance. In addition, the decision curve analysis (DCA) was used to evaluate the clinical utility of nomogram in decision-making. Based on the established nomogram, an interactive convenient web calculator was provided (https://drliwenle.shinyapps.io/LMOOapp/).

Results

Demographic Baseline Characteristics

As shown in Table 1, a total of 1,256 patients were enrolled. There was no statistically significant difference between the training group (n = 1,144) and validation group (n = 112) except the Race (P < 0.001) and Chemotherapy (P = 0.017).

TABLE 1
www.frontiersin.org

Table 1. Baseline data table of the training group and the validation group.

Additionally, these patients were divided into two subgroups according to the LNM in Table 2. There were no significant differences in race, sex, laterality and radiation between the lymph node negative group (LNN, n = 1,104) and the lymph node positive (or unable to evaluate) group (LNP, n = 152). However, the other characteristics showed significant differences between the two groups.

TABLE 2
www.frontiersin.org

Table 2. Patient baseline table of lymphatic metastases.

Univariate and Multivariable Logistic Regression Results

According to the univariate logistics regression analysis, we identified 10 prognostic factors including age, survival time, primary site, laterality, tumor size, lymph metastasis, surgery, chemotherapy, bone metastases and lung metastases in the training set (P < 0.05) (Table 3). Then, based on the above result, applying the multivariable logistics regression analysis, we figured out five independent prognostic factors including T-stage [TX: odds ratio (OR) 3.602,95%CI 1.710–5.483, P < 0.001], M-stage (M1: OR = 2.890, 1.463–5.709, P < 0.01), surgery (Yes: OR = 0.418, 0.247–0.706, P < 0.01), Chemotherapy (Yes: OR = 0.475, 0.267–0.819, P < 0.01)and Lung metastases (Unknown: OR = 9.407, 1.955–45.261, P < 0.01) (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Univariate and multifactorial logistic regression analysis of risk factors for Lymph node metastases in patients with osteosarcoma.

Construction and Validation of Nomogram for Chondrosarcoma Patients

The nomogram contained five risk factors confirmed to be statistically significant by logistic regression analysis, including T-stage, M-stage, surgery, chemotherapy and lung metastases (Figure 1A). Calibration chart of nomogram showed a good consistency in the training and validation groups (Figures 1B,C). The AUC values of nomogram were 0.805 (95% CI 0.781–0.827) and 0.808 (95% CI 0.723–0.877) in the training group and the validation group respectively (Figures 2A,B). Furthermore, the ROC curve demonstrated a superior performance of the nomogram compared to the single variable, including chemotherapy (AUC = 0.631, 95%CI 0.602 to 0.659), lung metastases (0.697, 0.669 to 0.723), M-stage (AUC = 0.592, 95%CI 0.563 to 0.621), surgery (AUC = 0.667, 95%CI 0.639 to 0.694) and T-stage (0.706, 95%CI 0.678 to 0.732). The statistical results of validation group were consistent with the training group as shown in Table 4. In addition, an online web calculator was designed (https://drliwenle.shinyapps.io/LMOOapp/).

FIGURE 1
www.frontiersin.org

Figure 1. (A) Nomogram for osteosarcoma patients. (B,C) are training cohorts and the validation cohorts calibration diagram respectively, which indicate good consistency.

FIGURE 2
www.frontiersin.org

Figure 2. ROC curves for the training and validation group. (A) training group; (B) validation group.

TABLE 4
www.frontiersin.org

Table 4. AUC of training group and validation group.

Clinical Applicability of the Nomogram

The Kaplan-Meier survival curves of training group were plotted (Figure 3A). The results revealed that the overall survival (OS) significantly decreased in patients with LNP comparing with the LNN (P < 0.001). Moreover, the threshold about 0.1 to 0.9 had the maximum benefit range of the model as shown in the DCA curve (Figures 3C,D). The Kaplan-Meier survival curves of validation group displayed the same trend between the two groups (P <0.001) (Figure 3B).

FIGURE 3
www.frontiersin.org

Figure 3. (A,B) The Kaplan-Meier survival analysis patients with osteosarcoma in training and validation group. (C,D) Nomogram decision curve (DCA) of the training and validation group.

Discussion

Osteosarcoma metastases, which are typically secondary to hematogenous dissemination and the occurrence of lymph system is extremely rare, have been identified to be significantly associated with poor prognosis (14, 7, 20, 21). Comparing to the most common lung metastases, osteosarcoma patients with lymph node involvement have a worse prognosis, suggesting that the invasion of the lymph nodes is an important indicator for the assessment of malignancy stage and the selection of a correct treatment protocol (22, 23).Meanwhile, studies points out that FDG-PET and 99mTc-labeled biomineralization nanoprobe are effective in early diagnosis of metastatic lymph nodes in osteosarcoma (2427). Therefore, real-time lymph node surveillance and radical treatment for osteosarcoma patients with a high risk of lymph node metastasis will improve patient survival (8). In this study, we identified five independent risk factors associated with LNM and provided a convenient nomogram prediction model and a web calculator on the basis of the model.

Surgery and chemotherapy are the most reliable and effective treatment options for prolonging the lives of patients and have been followed in several clinical trials (2830). According to the multivariable logistic analysis, chemotherapy and surgery were crucial prognostic indicators. Surgery and chemotherapy contributed to improve patient prognosis, which were consistent with the result of the KM survival curve. This suggests that timely and effective treatment plays an important role in controlling lymph node metastasis and enhancing OS (15, 17, 31, 32). Unfortunately, the relationship between radiotherapy and lymph node metastasis has not been proved. A possible reason for these results would be the uncertainty of radiation therapy in cancer treatment along with the development of radiation-associated osteosarcoma make the safety of chemotherapy need to be further ensured (33, 34).

Due to the lack of lymphatic drainage in normal cortical bone and spongy bone, LNM is rare in bone sarcomas (35, 36).Regional lymph node involvement in osteosarcoma may be owing to the infiltration of the enlarged tumor parenchyma into the periphery, such as the joint capsule or synovium, leading to dissemination into the lymphatic system (37, 38).Our study reported T-stage as a significant predictor of LNM, which was also consistent with previous findings (7).Meanwhile, because of the fact that the peak incidence of the osteosarcoma is 15–19 years of age, more than 80% of patients achieve limb salvage through surgery (4, 28, 38).In this respect, the surgeons need pay more attention to the status of the regional lymph nodes during the resection of larger osteosarcoma in order to eradicate the sarcoma and preserve the limb. M-stage indicates distant metastasis in osteosarcoma, and it is also a risk factor associated with LNM. In the study by Thampi et al. osteosarcoma lymphatic metastasis was significantly associated with distant metastasis (7).Furthermore, since the lung was the most important target organ for distant metastasis in osteosarcoma, we separated this variable from distant metastasis to emphasize the significant role played by lung metastasis in assessing lymph node status. Patients with lung metastases express the characteristic biomarker, such as KEAP, Matrix-Gla and Rab22a (3941). Considering the intense correlation we found between lung metastasis and lymph node involvement, these reported biomarkers would be triggers for LNM. Therefore, this provides inspiration to further molecular biology studies focusing on lymph node metastasis in osteosarcoma.

We constructed a novel nomogram to assess the risk of developing lymph node metastasis in osteosarcoma, and the discriminatory of any individual predictor was inferior to that of nomogram, suggesting that the nomogram model indicated promising prospects for tumor surveillance and clinical decision making. Although some predictive nomograms have been reported in previous studies, our study complements previous work. Compared to Dong et al.'s study, external independent validation consisting of multiple academic centers is a prominent feature of this study, and the inclusion of multiple ethnic groups enhances the credibility of the results (8). Moreover, we provide a convenient and digital prediction tool for users. By analyzing the clinical characteristics and associated risk factors, we improve the prediction of lymph node metastasis risk in osteosarcoma and provide a basis for individualized treatment and follow-up strategies. The web-based calculator constructed in this study is an easy-to-use clinical tool that helps to promote personalized treatment.

Finally, one obvious limitation in this study was that the statistically significant difference between the training group and validation groups in chemotherapy may have an influence on the results. Another limitation was the lack of a more thoroughly analysis due to the inadequacy of systematic and prospective data.

Conclusion

In conclusion, we constructed a novel nomogram model to predict risk factors for osteosarcoma patients developing LNM, including T-stage, M-stage, surgery, chemotherapy and lung metastases based on epidemiological characteristics obtained from the SEER database and the multicenter hospitals. By combining DCA curve, ROC curve, KM curve, web calculator and external validation, our nomogram provided an accurate assessment for individualized risk of lymph node metastasis which was helpful for clinicians to make better surgery decisions.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors without undue reservation.

Ethics Statement

The SEER database is a comprehensive data source developed based on population data and updated annually since its launch in 1973. It is public and identifiably accessible that data analysis is treated as non-human subjects by the Office for Human Research Protections. As such, no institutional review board approval and informed consent were required. For multicenter data, the study was approved by the ethics review committee of four medical institutions in China, the Second Affiliated Hospital of Jilin University, the Second Affiliated Hospital of Dalian Medical University, 291 Liuzhou People's Hospital, and Xianyang Central Hospital (No. 2021-00-22) and was conducted in accordance with the guidelines of the Helsinki.

Author Contributions

CY, RW, QL, and XL designed the study. WeL and SD performed the study, analyzed the data, and wrote the manuscript. BW and HW provided the expert consultations and clinical suggestions. CX and KZ conceived of the study, participated in its design and coordination. WaL and ZH helped to draft the manuscript. All authors reviewed the final version of the manuscript.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We thank China's multicenter for providing us individual patient data. The multicenter data were obtained from four medical institutions in China, the Second Affiliated Hospital of Jilin University, the Second Affiliated Hospital of Dalian Medical University, Liuzhou People's Hospital, and Xianyang Central Hospital.

Abbreviations

SEER, Surveillance, Epidemiology, and End Results database; ROC, receiver operating characteristic; DCA, decision curve analysis; CI, confidence interval; AUC, area under the curve; LNN, lymph node negative; LNM, lymph node metastases; ICD, International Classification of Diseases; SD, standard deviation; KM curves, Kaplan-Meier curves; OR, odds ratio.

References

1. Marina N, Smeland S, Bielack S, Bernstein M, Jovic G, Hook J, et al. “MAPIE vs MAP as postoperative chemotherapy in patients with a poor response to preoperative chemotherapy for newly-diagnosed osteosarcoma: results from EURAMOS-1 (Paper 032),” in Presented at Connective Tissue Oncology Society (2014).

2. Tian Z, Niu X, Yao W. Receptor tyrosine kinases in osteosarcoma treatment: which is the key target? Front Oncol. (2020) 10:1642. doi: 10.3389/fonc.2020.01642

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Kager L, Zoubek A, Pötschger U, Kastner U, Flege S, Kempf-Bielack B, et al. Primary metastatic osteosarcoma: presentation and outcome of patients treated on neoadjuvant Cooperative Osteosarcoma Study Group protocols. J Clin Oncol. (2003) 21:2011–8. doi: 10.1200/JCO.2003.08.132

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Hattori H, Yamamoto K. Lymph node metastasis of osteosarcoma. J Clin Oncol. (2012) 30:345–9. doi: 10.1200/JCO.2012.42.3384

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Kempf-Bielack B. Osteosarcoma relapse after combined modality therapy: an analysis of unselected patients in the Cooperative Osteosarcoma Study Group (COSS). J Clin Oncol. (2005) 23:559–68. doi: 10.1200/JCO.2005.04.063

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Zheng B, Zhou C, Qu G, Ren C, Yue B. VEGFR2 promotes metastasis and PD-L2 expression of human osteosarcoma cells by activating the STAT3 and RhoA-ROCK-LIMK2 pathways. Front Oncol. (2020) 10:543562. doi: 10.3389/fonc.2020.543562

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Thampi S, Matthay KK, Goldsby R, Dubois SG. Adverse impact of regional lymph node involvement in osteosarcoma. Eur J Cancer. (2013) 49:3471–6. doi: 10.1016/j.ejca.2013.06.023

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Dong Y, Wu W, Kang H, Xiong W, Li F. Risk factors of regional lymph node (RLN) metastasis among patients with bone sarcoma and survival of patients with RLN-positive bone sarcoma. Ann Transl Med. (2021) 9:48. doi: 10.21037/atm-20-4681

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Kumar R, Tripathi R, Marchang N, Srivastava G, Gadekallu TR, Xiong NN. A secured distributed detection system based on IPFS and blockchain for industrial image and video data security. J Parallel Distributed Comput. (2021) 152:128–43. doi: 10.1016/j.jpdc.2021.02.022

CrossRef Full Text | Google Scholar

10. Agrawal S, Sarkar S, Srivastava G, Maddikunta P, Gadekallu TR. Genetically optimized prediction of remaining useful life. Sustain Comput. (2021) 31:100565. doi: 10.1016/j.suscom.2021.100565

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Naeem A, Javed AR, Rizwan M, Abbas S, Gadekallu TR. DARE-SEP: a hybrid approach of distance aware residual energy-efficient SEP for WSN. IEEE Trans Green Commun Netw. (2021) 5:611–21. doi: 10.1109/TGCN.2021.3067885

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Gadekallu TR, Alazab M, Kaluri R, Maddikunta P, Parimala M. Hand gesture classification using a novel CNN-crow search algorithm. Complex Intell Syst. (2021) 7:1855–68. doi: 10.1007/s40747-021-00324-x

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Gadekallu TR, Manoj MK, Sivarama KS, Kumar N, Bhattacharya S. Blockchain based attack detection on machine learning algorithms for IoT based E-health applications. IEEE Internet Things Mag. (2020) 4:30–33. doi: 10.1109/IOTM.1021.2000160

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Tang Z, Zhu R, Lin P, He J, Wang H, Huang Q, et al. A hardware friendly unsupervised memristive neural network with weight sharing mechanism. Neurocomputing. (2019) 332:193–202. doi: 10.1016/j.neucom.2018.12.049

CrossRef Full Text | Google Scholar

15. Wu EQ, Hu D, Deng PY, Tang Z, Ren H. Nonparametric bayesian prior inducing deep network for automatic detection of cognitive status. IEEE Trans Cybern. (2020) 51:5483–96. doi: 10.1109/TCYB.20202°977267

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Tang Z, Chen Y, Ye S, Hu R, Chang S. Fully Memristive spiking-neuron learning framework and its applications on pattern recognition and edge detection. Neurocomputing. (2020) 403:80–7. doi: 10.1016/j.neucom.2020.04.012

CrossRef Full Text | Google Scholar

17. Wu EQ, Deng PY, Qu XY, Tang Z, Sheng RSF. Detecting fatigue status of pilots based on deep learning network using EEG signals. IEEE Trans Cogn Dev Syst. (2020) 13:575–85. doi: 10.1109/TCDS.2019.2963476

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Tang Z, Zhu R, Hu R, Chen Y, Chang S. A multilayer neural network merging image preprocessing and pattern recognition by integrating diffusion and drift memristors. IEEE Trans Cogn Dev Syst. (2020) 13:645–56. doi: 10.1109/TCDS.2020.3003377

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Balachandran VP, Gonen M, Smith JJ, Dematteo RP. Nomograms in oncology: more than meets the eye. Lancet Oncol. (2015) 16:e173–e80. doi: 10.1016/S1470-2045(14)71116-7

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Meazza C, Scanagatta P. Metastatic osteosarcoma: a challenging multidisciplinary treatment. Expert Rev Anticancer Ther. (2016) 16:543–56. doi: 10.1586/14737140.2016.1168697

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Wang T, Quan Y, Shen XS, Gadekallu TR, Wang W, Dev K, et al. Privacy-enhanced retrieval technology for the cloud-assisted internet of things. IEEE Trans Ind Inform. (2021) 14:1551–3203. doi: 10.1109/TII.2021.3103547

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Alitalo K. The lymphatic vasculature in disease. Nat Med. (2011) 17:1371–80. doi: 10.1038/nm.2545

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Wang W, Qiu C, Yin Z, Srivastava G, Gadekallu TR, Alsolami F, et al. Blockchain and PUF-based lightweight authentication protocol for wireless medical sensor networks. IEEE Internet Things J. (2021) 1–1. doi: 10.1109/JIOT.2021.3117762

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Xu Z, Wang Y, Han J, Xu Q, Ren J, Xu J, et al. Noninvasive multimodal imaging of osteosarcoma and lymph nodes using a 99mTc-labeled biomineralization nanoprobe. Anal Chem. (2018) 90:4529–34. doi: 10.1021/acs.analchem.7b04925

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Volker T, Denecke T, Steffen I, Misch D, Schonberger S, Plotkin M, et al. Positron emission tomography for staging of pediatric sarcoma patients: results of a prospective multicenter trial. J Clin Oncol. (2007) 25:5435. doi: 10.1200/JCO.2007.12.2473

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Wang W, Fida MH, Lian Z, Yin Z, Pham QV, Gadekallu TR, et al. Secure-enhanced federated learning for AI-empowered electric vehicle energy prediction. IEEE Consum Electron Mag. (2021). doi: 10.1109/MCE.2021.3116917

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Xiong H, Jin C, Alazab M, Yeh KH, Wang H, Gadekallu TRR, et al. On the design of blockchain-based ECDSA with fault-tolerant batch verication protocol for blockchain-enabled IoMT. IEEE J Biomed Health Inform. (2021). doi: 10.1109/JBHI.2021.3112693

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Ritter J, Bielack SS. Osteosarcoma. Ann Oncol. (2010) 21(Suppl 7):vii320–5. doi: 10.1093/annonc/mdq276

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Pramanik R, Agarwala S, Gupta YK, Thulkar S, Bakhshi S. Metronomic chemotherapy vs best supportive care in progressive pediatric solid malignant tumors: a randomized clinical trial. Jama Oncol. (2017) 3:1222–7. doi: 10.1001/jamaoncol.2017.0324

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Piperno-Neumann S, Le Deley MC, Rédini F, Pacquement H, Marec-Bérard P, Petit P, et al. Zoledronate in combination with chemotherapy and surgery to treat osteosarcoma (OS2006): a randomised, multicentre, open-label, phase 3 trial. Lancet Oncol. (2016) 17:1070–80. doi: 10.1016/S1470-2045(16)30096-1

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Huang Z, Hu C, Liu K, Yuan L, Hu C. Risk factors, prognostic factors, and nomograms for bone metastasis in patients with newly diagnosed infiltrating duct carcinoma of the breast: a population-based study. BMC Cancer. (2020) 20:1145. doi: 10.1186/s12885-020-07635-1

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Wu EQ, Zhou MC, Hu D, Zhu L, Ren H. Self-paced dynamic infinite mixture model for fatigue evaluation of pilots' brains. IEEE Trans Cybern. (2020) 2168–267. doi: 10.1109/TCYB.2020.3033005

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Siontis BL, Mchugh JB, Roberts E, Zhao L, Chugh R. Differential outcomes and biologic markers of radiation-associated vs. sporadic osteosarcoma: a single-institution experience. Front Oncol. (2020) 9:1523. doi: 10.3389/fonc.2019.01523

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Wu EQ, Zhu LM, Li GJ, Li HJ, Zhou GR. Nonparametric hierarchical hidden semi-markov model for brain fatigue behavior detection of pilots during flight. IEEE Trans Intell Transport Syst. (2021) 1–12. doi: 10.1109/TITS.2021.3052801

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Cleary MX, Fayad LM, Ahlawat S. Popliteal lymph nodes in patients with osteosarcoma: are they metastatic? Skeletal Radiol. (2020) 49:1807–17. doi: 10.1007/s00256-020-03498-6

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Wu EQ, Lin CT, Zhu LM, Tang ZR, Jie YW, Zhou GR. Fatigue detection of pilots' brain through brains cognitive map and multilayer latent incremental learning model. IEEE Trans Cybern. (2021) 1–13. doi: 10.1109/TCYB.2021.3068300

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Dirik Y, Çinar A, Yumrukçal F, Eralp L. Popliteal lymph node metastasis of tibial osteoblastic osteosarcoma. Int J Surg Case Rep. (2014) 5:840–4. doi: 10.1016/j.ijscr.2014.09.029

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Bielack SS, Kempf-Bielack B, Delling G, Exner GU, Flege S, Helmke K, et al. Prognostic factors in high-grade osteosarcoma of the extremities or trunk: an analysis of 1,702 patients treated on neoadjuvant cooperative osteosarcoma study group protocols. J Clin Oncol. (2002) 20:776–90. doi: 10.1200/JCO.2002.20.3.776

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Xu H, Zhu X, Bao H, Shek TW, Huang Z, Wang Y, et al. Genetic and clonal dissection of osteosarcoma progression and lung metastasis. Int J Cancer. (2018) 143:1134−42. doi: 10.1002/ijc.31389

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Zandueta C, Ormazábal C, Perurena N, Martínez-Canarias S, Zalacaín M, Julián MS, et al. Matrix-Gla protein promotes osteosarcoma lung metastasis and associates with poor prognosis. J Pathol. (2016) 239:438–49. doi: 10.1002/path.4740

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Liao D, Zhong L, Yin J, Zeng C, Wang X, Huang X, et al. Chromosomal translocation-derived aberrant Rab22a drives metastasis of osteosarcoma. Nat Cell Biol. (2020) 22:868–81doi: 10.1038/s41556-020-0522-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: nomogram, SEER, osteosarcoma, lymph node metastases, multicenter

Citation: Li W, Dong S, Wang B, Wang H, Xu C, Zhang K, Li W, Hu Z, Li X, Liu Q, Wu R and Yin C (2022) The Construction and Development of a Clinical Prediction Model to Assess Lymph Node Metastases in Osteosarcoma. Front. Public Health 9:813625. doi: 10.3389/fpubh.2021.813625

Received: 12 November 2021; Accepted: 06 December 2021;
Published: 06 January 2022.

Edited by:

Thippa Reddy Gadekallu, VIT University, India

Reviewed by:

Kun Liu, Beijing Friendship Hospital, China
Zhidong Zhu, Shanghai Outdo Biotech Co, China
Praveen Kumar, VIT University, India

Copyright © 2022 Li, Dong, Wang, Wang, Xu, Zhang, Li, Hu, Li, Liu, Wu and Yin. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Chengliang Yin, Y2hlbmdsaWFuZ3lpbiYjeDAwMDQwOzE2My5jb20=; Rilige Wu, d3JsZzExMTQmI3gwMDA0MDsxNjMuY29t; Qiang Liu, bTEzOTkyMDc5NjY4JiN4MDAwNDA7MTYzLmNvbQ==; Xiaoping Li, bGkteHAmI3gwMDA0MDt6anNydS5lZHUuY24=

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.