- 1Department of Ultrasound Diagnosis and Treatment, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Tianjin, China
- 2Key Laboratory of Cancer Prevention and Therapy, Tianjin’s Clinical Research Center for Cancer, Tianjin Medical University, Tianjin, China
- 3Department of Urology, Tianjin Occupational Diseases Precaution and Therapeutic Hospital, Tianjin, China
- 4Department of Urology, Tianjin First Central Hospital, Tianjin, China
- 5Department of Cardiology, Tianjin Chest Hospital, Tianjin University, Tianjin, China
Objective: To investigate the diagnostic efficacy of the clinical ultrasound imaging model, ultrasonographic radiomics model, and comprehensive model based on ultrasonographic radiomics for the differentiation of small clear cell Renal Cell Carcinoma (ccRCC) and Renal Angiomyolipoma (RAML).
Methods: The clinical, ultrasound, and contrast-enhanced CT(CECT) imaging data of 302 small renal tumors (maximum diameter ≤ 4cm) patients in Tianjin Medical University Cancer Institute and Hospital from June 2018 to June 2022 were retrospectively analyzed, with 182 patients of ccRCC and 120 patients of RAML. The ultrasound images of the largest diameter of renal tumors were manually segmented by ITK-SNAP software, and Pyradiomics (v3.0.1) module in Python 3.8.7 was applied to extract ultrasonographic radiomics features from ROI segmented images. The patients were randomly divided into training and internal validation cohorts in the ratio of 7:3. The Random Forest algorithm of the Sklearn module was applied to construct the clinical ultrasound imaging model, ultrasonographic radiomics model, and comprehensive model. The efficacy of the prediction models was verified in an independent external validation cohort consisting of 69 patients, from 230 small renal tumor patients in two different institutions. The Delong test compared the predictive ability of three models and CECT. Calibration Curve and clinical Decision Curve Analysis were applied to evaluate the model and determine the net benefit to patients.
Results: 491 ultrasonographic radiomics features were extracted from 302 small renal tumor patients, and 9 ultrasonographic radiomics features were finally retained for modeling after regression and dimensionality reduction. In the internal validation cohort, the area under the curve (AUC), sensitivity, specificity, and accuracy of the clinical ultrasound imaging model, ultrasonographic radiomics model, comprehensive model, and CECT were 0.75, 76.7%, 60.0%, 70.0%; 0.80, 85.6%, 61.7%, 76.0%; 0.88, 90.6%, 76.7%, 85.0% and 0.90, 92.6%, 88.9%, 91.1%, respectively. In the external validation cohort, AUC, sensitivity, specificity, and accuracy of the three models and CECT were 0.73, 67.5%, 69.1%, 68.3%; 0.89, 86.7%, 80.0%, 83.5%; 0.90, 85.0%, 85.5%, 85.2% and 0.91, 94.6%, 88.3%, 91.3%, respectively. The DeLong test showed no significant difference between the clinical ultrasound imaging model and the ultrasonographic radiomics model (Z=-1.287, P=0.198). The comprehensive model showed superior diagnostic performance than the ultrasonographic radiomics model (Z=4. 394, P<0.001) and the clinical ultrasound imaging model (Z=4. 732, P<0.001). Moreover, there was no significant difference in AUC between the comprehensive model and CECT (Z=-0.252, P=0.801). Both in the internal and external validation cohort, the Calibration Curve and Decision Curve Analysis showed a better performance of the comprehensive model.
Conclusion: It is feasible to construct an ultrasonographic radiomics model for distinguishing small ccRCC and RAML based on ultrasound images, and the diagnostic performance of the comprehensive model is superior to the clinical ultrasound imaging model and ultrasonographic radiomics model, similar to that of CECT.
Introduction
With the improvement of imaging techniques, the incidence of renal cell carcinoma (RCC) has been steadily increasing at a rate of 2%-4% every year (1), among which the proportion of patients diagnosed with small RCC (diameter ≤ 4 cm) has been constantly increasing (2). Recently, small renal tumors have become a hot topic in research. About 20-30% of small renal tumors are benign, and renal angiomyolipoma (RAML) is the most common pathology type (3). Clear cell renal cell carcinoma (ccRCC) is the most common pathology type of RCC. There’s a lack of typical malignant ultrasound features (necrosis or tumor embolism) in small renal tumors less than 4cm, which makes it difficult to discriminate small ccRCC from RAML. The low-fat content results in hypoechoicity on ultrasound in fat-poor renal angiomyolipoma (fpRAML), similar to small renal carcinomas. Transabdominal ultrasonography is a common method in preoperative imaging examination of renal tumors, but the small renal tumors may be ignored due to the above sonographic characteristics.
In clinical practice, the identification of ccRCC and RAML is mainly based on contrast-enhanced CT (CECT). However, CECT is an invasive procedure involving intravenous contrast injection, making it unsuitable for patients with renal dysfunction or iodine contrast allergies. Ultrasonography examination is widely used in clinical practice and is inexpensive, feasible, and reproducible. Moreover, the small ccRCC may be untypical on CECT, and their presentation could be easily confused with RAML, especially low-fat RAML (4). In case of an unclear diagnosis, a repeated examination is required during the follow-up period. So, repeated ultrasound examinations may be more acceptable to these patients. Improvement of the ultrasound diagnostic capability in clinical physical examination will be beneficial.
With the development of artificial intelligence, radiomics prediction models have gained attention in cancer diagnosis (5, 6). Radiomics can extract inaccessible feature data from medical images with high throughput and has great application prospects in predicting the biological behavior of tumors (7, 8). In recent years, few studies have been reported on ultrasonographic radiomics to identify small ccRCC. It is unclear whether the diagnostic performance could be improved using ultrasonographic radiomics in these patients. In this current study, we investigated the feasibility of ultrasonographic radiomics to discriminate ccRCC and RAML by constructing a clinical ultrasound imaging model, ultrasonographic radiomics model, and comprehensive model. We also compared the diagnostic efficacy between the above models and CECT.
Materials and methods
Study population
This retrospective study was approved by the ethics committee of Tianjin Medical University Cancer Institute and Hospital (bc2023079). From June 2018 to June 2022, 385 small renal tumor patients with a histological examination at Tianjin Medical University Cancer Institute (institution 1) were retrospectively recruited to construct training and internal validation cohorts of the model. Another 230 small renal tumor patients with a histological examination from Tianjin First Central Hospital, and Tianjin Occupational Diseases Precaution and Therapeutic Hospital (institutions 2 and 3) were retrospectively recruited, constituting an independent external validation cohort to verify the efficacy of the prediction model. The inclusion criteria were as follows: (1) patients performed an ultrasonic examination and CECT within 2 weeks before the operation, and the images of the tumor’s largest diameter were clear, (2) the diagnosis of ccRCC or RAML was confirmed by postoperative pathology, (3) patients had no previous history of other malignancies, (4) maximum diameter of renal tumor ≤ 4cm. The excluding standards were as follows: (1) there were significant artifacts in the ultrasound or CT images, (2) tumor components were predominantly cystic (the solid component was less than 25%) (9), and (3) incomplete clinical information on patients. As a result, 302 patients with 302 small renal tumors were finally enrolled in our study to construct ultrasonographic radiomics models and internal validation; and 69 patients for external validation (Figure 1). Patients in institution 1 were divided into the ccRCC group (n = 182; 107 men and 75 women; mean age 56.85 ± 10.71 years) and RAML group (n = 120; 57 men and 63 women; mean age 53.64 ± 12.23 years). The mean age of the external validation cohort was 55.72 ± 14.58 years (38 men and 31 women).
Ultrasonography and CT scanning methods and image analysis
Color Doppler ultrasonic diagnostic apparatus of PHILIPS EPIQ5, Toshiba Aplio 500, and 800 were used. Transabdominal ultrasound was performed using a convex array probe with 1~6MHz. Patients should be fasting for 8-12 hours to show the largest section of tumors clearly. We performed a multisectional examination of both kidneys in the supine, lateral, or prone position. Ultrasonographic features of renal tumors were recorded, including tumor location, maximum diameter, tumor boundaries, echo pattern, presence of calcifications, necrotic cystic degeneration, and blood flow signals.
Preoperative CECT was performed on multiple scanners: Siemens Somatom Definition, GE HiSpeed 16, and Philips Brilliance 64. Acquisition parameters were as follows: tube voltage, 120–140 kV; automated varied milliampere-second settings; collimation width, 1.5 mm. CT and CECT features included fat density assessment, peak enhancement degree, homogeneity of enhancement, and the velocity of contrast in and out.
Ultrasonographic and CECT imaging were independently assessed by two sonographers and two radiologists (all with more than 10 years of experience). They were blinded to the pathology results. When the diagnostic results were inconsistent, they reached a consensus through discussion. Clinical information of these patients was recorded, including sex, age, and clinical symptoms.
Segmentation and pre-processing of ultrasound images
The framework of this study is illustrated in Figure 2. Ultrasound images of the largest renal tumor cross-section were imported into ITK-SNAP software (version v 3.8.0, www.itksnap.org), and the tumor edges were manually outlined as the region of interest (ROI) by sonographer A with more than 10 years’ experience (Figure 3). Two weeks later, sonographer A and sonographer B (with 5 years of experience) made ROI outlining from 50 renal tumor images randomly, to assess intra- and inter-observer correlation coefficients (ICCs).
Figure 2 The main procedure performed in this study comprised four steps: (A) ultrasound imaging and tumor segmentation, (B) image processing and feature extraction, (C) feature selection, and (D) modeling, and Analysis.
Radiomics features extraction
Z-Score was performed to standardize the data of different orders before radiomics feature extraction. The Pyradiomics module of Python 3.8.7 (v3.0.1) was used to extract the radiomics features of ROIs, including shape-based features, first-order features, and structural texture features. The structural texture features included a gray level cooccurrence matrix (GLCM), gray level run-length matrix (GLRLM), gray level size zone matrix (GLSZM), and gray level dependence matrix (GLDM). ICCs were used to evaluate the agreement of feature extraction. The intra-observer ICC was calculated based on two feature extractions by sonographer A, and inter-observer ICC was calculated based on the features extracted firstly by sonographer A and subsequently by sonographer B. Features with better consistency (ICC > 0.9) were retained. The maximum relevance-minimum redundancy features were obtained by max-relevance and min-redundancy (MRMR) algorithm filtering. The covariance between ultrasound features was assessed by calculating the Variance Inflation Factor (VIF). Finally, the high-stability radiomics features were subjected to Spearman’s correlation analysis, with a correlation coefficient threshold of 0.7.
Construction of ultrasonographic radiomics model
The patients were randomly divided into training and internal validation cohorts in the ratio of 7:3. The Random forest algorithm (RFA) of the Sklearn module (Python 3.8.7) was applied to construct the clinical ultrasound imaging model, ultrasonographic radiomics model, and comprehensive model, to predict diagnostic efficacy for small ccRCCs. Both feature extraction and model construction used ten-fold cross-validation and parameter tuning to optimize the predictive performance.
Statistical analysis
All data were analyzed using the SPSS Statistics software version 23.0 (IBM, Armonk, NY, USA), Python3.8.7 and R software version 4.2.2. All categorical variables were expressed as numbers(n) and percentages, and continuous variables were expressed as mean value ± standard deviation (SD) or median ± inter-quartile range (IQR). χ² test was used to compare the clinical ultrasound characteristics between patients in ccRCC and RAML groups. The diagnostic ability of the ultrasound imaging model, ultrasonographic radiomics model, comprehensive model, and CECT for ccRCC were assessed by the receiver operating characteristic (ROC) curve, and the area under the curve (AUC), sensitivity, specificity, and accuracy of three models and CECT were calculated separately. The AUC values of different models and CECT were compared by the Delong test. The performance of the three models was evaluated by the Calibration Curve. Clinical Decision Curve Analysis was also applied to determine the net benefit of patients. P<0.05 was considered statistically significant.
Results
Comparison of clinical ultrasound and CECT characteristics
In this study, 302 small renal tumor patients, comprising 182 with ccRCC and 120 with RAML, were enrolled as the training and internal validation cohorts. There were significant differences in the distribution of gender, clinical symptoms, echo pattern, necrotic cystic degeneration, blood flow signals, CT presence of bulk fat, and homogeneity of enhancement, but no significant differences in age, location, tumor boundaries, calcification, peak enhancement degree, existent of fast-in and fast-out between the two groups (P<0.05, Table 1; Figures 4–6).
Figure 4 A 74-year-old man with a 1.9 × 1.4cm RAML. (A) Ultrasound demonstrated a mildly hyperechoic mass located in the middle pole of the right kidney (arrow). (B) CECT: the mass showed inhomogeneous hyperenhancement (arrow).
Figure 5 A 43-year-old man with a 3.5 × 3.4cm ccRCC. (A) Ultrasound showed a heterogeneous hypoechoic mass with intratumoral fluid areas located at the upper pole of the right kidney (arrows). (B) CECT: the tumor showed inhomogeneous hyperenhancement with many unenhanced areas (arrows).
Figure 6 A 64-year-old man with a 3.2 × 2.8cm ccRCC. (A) Ultrasound showed a heterogeneous hypoechoic mass with intratumoral fluid areas located at the upper pole of the right kidney (arrows). (B) CECT: the tumor showed inhomogeneous hyperenhancement with many unenhanced areas (arrows).
Selection of ultrasonographic radiomics features
The Pyradiomics software package extracted 491 ultrasonographic radiomics features. 9 ultrasonographic radiomics features were finally retained after regression dimensionality reduction processing, including 3 Shape, 1 GLRLM, 3 GLSZM, and 2 GLDM features. Spearman correlation heatmap of radiomics features is shown in Figure 7.
Figure 7 Spearman correlation heatmap of renal tumor ultrasonographic radiomics features. The color indicates a correlation: the darker the color, the higher the correlation (red indicates a positive correlation, and blue indicates a negative correlation).
Diagnostic efficacy of predictive models
In the internal validation cohort, AUC, sensitivity, specificity, and accuracy of the clinical ultrasound imaging model, ultrasonographic radiomics model, comprehensive model, and CECT for ccRCC diagnostic prediction were 0.75, 76.7%, 60.0%, 70.0%; 0.80, 85.6%, 61.7%, 76.0%; 0.88, 90.6%, 76.7%, 85.0% and 0.90, 92.6%, 88.9%, 91.1%, respectively. In the external validation cohort, AUC, sensitivity, specificity, and accuracy of the three models and CECT were 0.73, 67.5%, 69.1%, 68.3%; 0.89, 86.7%, 80.0%, 83.5%; 0.90, 85.0%, 85.5%, 85.2% and 0.91, 94.6%, 88.3%, 91.3%, respectively (Figure 8; Table 2). In the internal validation cohort, the DeLong test demonstrated no significant difference in AUC between the clinical ultrasound imaging model and ultrasonographic radiomics model (Z=-1.287, P=0.198), whereas the comprehensive model was superior to the ultrasonographic radiomics model (Z=4. 394, P<0.001) and clinical ultrasound imaging model (Z=4. 732, P<0.001). Moreover, there was no significant difference in AUC between the comprehensive model and CECT (Z=-0.252, P=0.801). The Calibration curve indicated a better performance of the comprehensive model (Figure 9), while Decision Curve Analysis showed a superior clinical utility of the comprehensive model (Figure 10).
Figure 8 ROC curves of clinical ultrasound imaging model, ultrasonographic radiomics model,. and comprehensive model in the internal (A) and external (B) validation cohort.
Table 2 Comparison of the predictive efficacy of clinical ultrasound imaging model, ultrasonographic radiomics model, comprehensive model, and CECT in the internal and external validation cohorts.
Figure 9 Calibration curves of the clinical ultrasound imaging model, ultrasonographic radiomics model, and comprehensive model in the internal (A) and external (B) validation cohort.
Figure 10 Decision curve analysis of clinical ultrasound imaging model, ultrasonographic radiomics model, and comprehensive model in the internal (A) and external (B) validation cohort.
Discussion
The clinical symptoms are usually untypical in patients with small ccRCC. Many patients are discovered incidentally during radiologic examinations (10, 11). It is also more complex considering clinical decision-making (12–14), including a variety of interventions available for these patients: renal tumor biopsy, partial nephrectomy, radical nephrectomy, thermal ablation, and follow-up monitoring (6, 15, 16). Therefore, the evaluation of imaging features of renal tumors has gradually evolved from morphological presentation to criteria based on histological features and molecular typing features (17, 18). Radiomics can quantitatively assess the heterogeneity of tumors and can be applied to differentiate renal carcinoma from RAML, assess the biological behavior of tumors, and predict the risk of recurrence or survival (19–21). Several studies have reported radiomics models established by CT or MR images, demonstrating their utility in identifying benign and malignant renal tumors and predicting pathological grading (22–25). However, reports on the establishment of radiomics models of ultrasound, the most convenient imaging examination for screening renal tumors, are rather rare.
In this study, the sensitivity of the internal validation cohort of the clinical ultrasound imaging model for the prediction of ccRCC was 76.7% and the accuracy was 70.0%. Although there were statistically significant differences in gender, clinical symptoms, echo pattern, necrotic cystic degeneration, and blood flow signals between patients in the ccRCC group and RAML group, 30.0% of small renal carcinomas were still misdiagnosed in this model. The reason may be that patients with small ccRCC do not have the specificity of clinical presentation and have a complex and varied pathohistological structure. Whereas ccRCC and fpRAML may exhibit some similar ultrasound characteristics (26, 27). The comprehensive model showed superior ability in predicting ccRCC, with 91% of sensitivity and 77% of specificity. The model extracted 491 ultrasonographic radiomics features, which were processed by regression dimensionality reduction, and finally retained 9 stable ultrasonographic radiomics features. Among them, Shape features described the morphological information of renal tumors. Major axis length, Mesh volume, and Sphericity described the similarity of renal tumor morphology to the standard sphere. Renal tumors in the RAML group had a smaller long-axis length and were closer to spherical than those in the ccRCC group. GLSZM was a count of the number of groups of interconnected neighboring pixels or voxels with the same gray level form the basis for the matrix (28). GLRLM provided information about the spatial distribution of runs of consecutive pixels with the same gray level, assessing the percentage of pixels or voxels within the ROI that are part of the runs and therefore reflect graininess (29). GLDM was also a count matrix that holds information about the number of “dependent” pixels and the number of occurrences of all pixels in the image. All the above three features belonged to texture features, which suggested that the tumors in the ccRCC group had poor texture consistency and a significant effect of non-periodic or speckled texture in ultrasound images compared to those in the RAML group. These findings indicated higher tumor heterogeneity in ccRCC. Compared with the RAML group, tumors in the ccRCC group had more irregular morphology, wider image signal distribution, and rougher texture features. So, combining ultrasonographic radiomics features and clinical ultrasound imaging features, the comprehensive model showed better diagnostic efficacy. The comprehensive model improved the sensitivity and accuracy of ccRCC prediction to 90.6% and 85.0%, which was similar to previous studies (20, 30–32). Our study suggested that ultrasonographic radiomics features could compensate for the shortcomings of clinical ultrasound imaging features and improve the predictive efficacy of small ccRCC. The Calibration Curve and Decision Curve Analysis of the three models also validated that the comprehensive model had a higher net benefit and a better performance in predicting patients with small ccRCC.
Our study had several improvements compared with the previous radiomics studies. Firstly, we compared the diagnostic efficacy between ultrasonographic radiomics models and CECT. Both of the these methods have high diagnostic efficiency and there was no significant difference between the comprehensive model and CECT. Moreover, an external validation cohort was used to assess the diagnostic performance of different models. The AUC of the comprehensive model was 0.90 in the external validation cohort, demonstrating a good predictive ability and robustness on new data. Thus, the comprehensive model based on ultrasonographic radiomics and clinical ultrasound imaging features could provide a convenient, inexpensive, and radiation-free examination for small ccRCC patients.
In this study, we applied a “multivariate filtering” feature selection method, the MRMR algorithm, to maximize the correlation between the imaging features and the prediction target as far as possible. Meanwhile, the correlation between the individual features was minimized as far as possible, with the help of high computational speed and high discriminative power. Features were selected from multiple perspectives to minimize information loss in our study, thus avoiding overfitting or underfitting of the predictive model. Moreover, we used the same ratio to divide the training and validation cohort in both ccRCC and RAML, to ensure the stability of the prediction results. Finally, we chose random forests to build the model classifiers to ensure high overfitting resistance and stability.
There are several limitations in this study. Firstly, the cases in this retrospective study are only from three medical institutions, and the results of the study may be subject to selection bias. Secondly, the ultrasound and CECT images in this study are from different diagnostic apparatuses, and there may be heterogeneity in the study images. In addition, the manual segmentation of outlining the ROI may reduce the reproducibility of this study. In the future, we will verify the stability of the results through multicenter prospective studies.
In conclusion, It is feasible to establish a diagnostic prediction model by ultrasonographic radiomics features in ccRCC and RAML with a maximum diameter of ≤4 cm, and we find that ultrasonographic radiomics features have great potential in identifying tumor heterogeneity in these patients. The comprehensive model showed a superior diagnostic ability in identifying ccRCC, which was similar to that of CECT, providing valuable information for clinicians to make personalized treatment decisions.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by Ethics Committee of Tianjin Medical University Cancer Institute and Hospital. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
Author contributions
FY: Writing – original draft, Conceptualization. DZ: Data curation, Writing – original draft. L-HZ: Data curation, Writing – original draft. Y-RM: Formal analysis, Writing – original draft. JM: Methodology, Writing – original draft. H-LW: Resources, Writing – review & editing. XW: Validation, Conceptualization, Writing – review & editing. C-WL: Conceptualization, Methodology, Visualization, Writing – review & editing. LP: Data curation. S-QY: Data curation.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by National Natural Science Foundation of China (82272008), Tianjin Key Medical Discipline(Specialty) Construction Project (TJYXZDXK-009A), and the Tianjin Health Research Project (ZD20018).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Abbreviations
ccRCC, clear cell Renal Cell Carcinoma; RAML, Renal Angiomyolipoma; CECT, contrast-enhanced CT; ROI, region of interest; AUC, Area under the ROC curve; GLCM, gray level cooccurrence matrix; GLRLM, gray-level run-length matrix; GLSZM, gray level size zone matrix; GLDM, gray level dependence matrix; ICCs, Interclass and intraclass correlation coefficients; MRMR, max-relevance and min-redundancy; VIF, Variance Inflation Factor; RFA, Random forest algorithm.
References
1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2018. CA Cancer J Clin. (2018) 68:7–30. doi: 10.3322/caac.21442
2. Kadomoto S, Makino T, Izumi K, Mizokami A. An important step in establishing a treatment strategy for small renal masses of clear cell renal cell carcinoma is based on the significance of adverse histopathologic features on tumor needle biopsy. Ann Transl Med. (2019) 7:S374. doi: 10.21037/atm
3. Finelli A, Ismaila N, Bro B, Durack J, Eggener S, Evans A, et al. Management of small renal masses: american society of clinical oncology clinical practice guideline. J Clin Oncol. (2017) 35:668–80. doi: 10.1200/JCO.2016.69.9645
4. Fang L, Bai K, Chen Y, Zhan J, Zhang Y, Qiu Z, et al. A comparative study of contrast-enhanced ultrasound and contrast-enhanced CT for the detection and characterization of renal masses. Biosci Trends. (2021) 15:24–32. doi: 10.5582/bst.2021.01026
5. Roussel E, Capitanio U, Kutikov A, Oosterwijk E, Pedrosa I, Rowe SP, et al. Novel imaging methods for renal mass characterization: A collaborative review. Eur Urol. (2022) 81:476–88. doi: 10.1016/j.eururo.2022.01.040
6. Carlo MI, Attalla K, Mazaheri Y, Gupta S, Yildirim O, Murray SJ, et al. Phase II study of neoadjuvant nivolumab in patients with locally advanced clear cell renal cell carcinoma undergoing nephrectomy. Eur Urol. (2022) 81:570–73. doi: 10.1016/j.eururo.2022.01.043
7. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036
8. Liang L, Zhi X, Sun Y, Li H, Wang J, Xu J, et al. A nomogram based on a multiparametric ultrasound radiomics model for discrimination between Malignant and benign prostate lesions. Front Oncol. (2021) 11:610785. doi: 10.3389/fonc.2021.610785
9. Silverman SG, Pedrosa I, Ellis JH, Hindman NM, Schieda N, Smith AD, et al. Bosniak classification of cystic renal masses, version 2019: an update proposal and needs assessment. Radiology. (2019) 292:475–88. doi: 10.1148/radiol.2019182646
10. Sun M, Thuret R, Abdollah F, Lughezzani G, Schmitges J, Tian Z, et al. Age-adjusted incidence, mortality, and survival rates of stage-specific renal cell carcinoma in North America: a trend analysis. Eur Urol. (2011) 59:135–41. doi: 10.1016/j.eururo.2010.10.029
11. Makino T, Kadomoto S, Izumi K, Mizokami A. Epidemiology and prevention of renal cell carcinoma. Cancers (Basel). (2022) 14(16):4059. doi: 10.3390/cancers14164059
12. Barata PC, Rini BI. Treatment of renal cell carcinoma: Current status and future directions. CA Cancer J Clin. (2017) 67:507–24. doi: 10.3322/caac.21411
13. Au L, Hatipoglu E, Robert de Massy M, Litchfield K, Beattie G, Rowan A, et al. Determinants of anti-PD-1 response and resistance in clear cell renal cell carcinoma. Cancer Cell. (2021) 39(11):1497–518.e11. doi: 10.1016/j.ccell.2021.10.001
14. Kang SK, Bjurlin MA, Huang WC. Management of small kidney tumors in 2019. JAMA. (2019) 321:1622–23. doi: 10.1001/jama.2019.1672
15. Sundaram M, Song Y, Rogerio JW, Zhang S, Bhattacharya R, Adejoro O, et al. Clinical and economic burdens of recurrence following nephrectomy for intermediate high- or high-risk renal cell carcinoma: A retrospective analysis of Surveillance, Epidemiology, and End Results-Medicare data. J Manag Care Spec Pharm. (2022) 28:1149–60. doi: 10.18553/jmcp.2022.22133
16. Bahadoram S, Davoodi M, Hassanzadeh S, Bahadoram M, Barahman M, Mafakher L. Renal cell carcinoma: an overview of the epidemiology, diagnosis, and treatment. G Ital Nefrol. (2022) 39(3):2022-vol3.
17. Dobyns AC, Coutelle NA, Suthumphong CY, Rodriguez PE, Castro G, Varella MH. Race/ethnicity and advanced stage of renal cell carcinoma in adults: results from surveillance, epidemiology, and end results program 2007-2015. Eur J Cancer Prev. (2022) 31:172–77. doi: 10.1097/CEJ.0000000000000689
18. Zhou Z, Qian X, Hu J, Ma X, Zhou S, Dai Y, et al. CT-based peritumoral radiomics signatures for Malignancy grading of clear cell renal cell carcinoma. Abdom Radiol (NY). (2021) 46:2690–98. doi: 10.1007/s00261-020-02890-z
19. Wang J, Tang J, Liu X, He D. A web-based prognostic nomogram for the cancer specific survival of elderly patients with T1-T3N0M0 renal pelvic transitional cell carcinoma based on the surveillance, epidemiology, and end results database. BMC Urol. (2022) 22:78. doi: 10.1186/s12894-022-01028-1
20. Zhang H, Yin F, Chen M, Yang L, Qi A, Cui W, et al. Development and Validation of a CT-Based Radiomics Nomogram for Predicting Postoperative Progression-Free Survival in Stage I-III Renal Cell Carcinoma. Front Oncol. (2022) 11:742547. doi: 10.3389/fonc.2021.742547
21. Zhao Y, Liu G, Sun Q, Zhai G, Wu G, Li ZC. Validation of CT radiomics for prediction of distant metastasis after surgical resection in patients with clear cell renal cell carcinoma: exploring the underlying signaling pathways. Eur Radiol. (2021) 31:5032–40. doi: 10.1007/s00330-020-07590-2
22. Moldovanu CG, Boca B, Lebovici A, Tamas-Szora A, Feier DS, Crisan N, et al. Preoperative predicting the WHO/ISUP nuclear grade of clear cell renal cell carcinoma by computed tomography-based radiomics features. J Pers Med. (2020) 11(1):8. doi: 10.3390/jpm11010008
23. Lin F, Ma C, Xu J, Lei Y, Li Q, Lan Y, et al. A CT-based deep learning model for predicting the nuclear grade of clear cell renal cell carcinoma. Eur J Radiol. (2020) 129:109079. doi: 10.1016/j.ejrad.2020.109079
24. Luo S, Wei R, Lu S, Lai S, Wu J, Wu Z, et al. Fuhrman nuclear grade prediction of clear cell renal cell carcinoma: influence of volume of interest delineation strategies on machine learning-based dynamic enhanced CT radiomics analysis. Eur Radiol. (2022) 32:2340–50. doi: 10.1007/s00330-021-08322-w
25. You MW, Kim N, Choi HJ. The value of quantitative CT texture analysis in differentiation of angiomyolipoma without visible fat from clear cell renal cell carcinoma on four-phase contrast-enhanced CT images. Clin Radiol. (2019) 74:547–54. doi: 10.1016/j.crad.2019.02.018
26. Li Q, Liu YJ, Dong D, Bai X, Huang QB, Guo AT, et al. Multiparametric MRI radiomic model for preoperative predicting WHO/ISUP nuclear grade of clear cell renal cell carcinoma. J Magn Reson Imaging. (2020) 52:1557–66. doi: 10.1002/jmri.27182
27. Yang G, Nie P, Yan L, Zhang M, Wang Y, Zhao L, et al. The radiomics-based tumor heterogeneity adds incremental value to the existing prognostic models for predicting outcome in localized clear cell renal cell carcinoma: a multicenter study. Eur J Nucl Med Mol Imaging. (2022) 49:2949–59. doi: 10.1007/s00259-022-05773-1
28. Thibault G, Angulo J, Meyer F. Advanced statistical matrices for texture characterization: application to cell classification. IEEE Trans BioMed Eng. (2014) 61:630–7. doi: 10.1109/TBME.2013.2284600
29. Mayerhoefer ME, Materka A, Langs G, Haggstrom I, Szczypinski P, Gibbs P, et al. Introduction to radiomics. J Nucl Med. (2020) 61:488–95. doi: 10.2967/jnumed.118.222893
30. Demirjian NL, Varghese BA, Cen SY, Hwang DH, Aron M, Siddiqui I, et al. CT-based radiomics stratification of tumor grade and TNM stage of clear cell renal cell carcinoma. Eur Radiol. (2022) 32:2552–63. doi: 10.1007/s00330-021-08344-4
31. Matsumoto S, Arita Y, Yoshida S, Fukushima H, Kimura K, Yamada I, et al. Utility of radiomics features of diffusion-weighted magnetic resonance imaging for differentiation of fat-poor angiomyolipoma from clear cell renal cell carcinoma: model development and external validation. Abdom Radiol (NY). (2022) 47:2178–86. doi: 10.1007/s00261-022-03486-5
Keywords: small renal tumor, clear cell renal cell carcinoma, ultrasound, radiomics, renal angiomyolipoma
Citation: Yang F, Zhang D, Zhao L-H, Mao Y-R, Mu J, Wang H-L, Pang L, Yang S-Q, Wei X and Liu C-W (2024) Prediction of clear cell renal cell carcinoma ≤ 4cm: visual assessment of ultrasound characteristics versus ultrasonographic radiomics analysis. Front. Oncol. 14:1298710. doi: 10.3389/fonc.2024.1298710
Received: 22 September 2023; Accepted: 08 July 2024;
Published: 23 July 2024.
Edited by:
Yuxiang Zhou, Mayo Clinic Arizona, United StatesReviewed by:
Fenglin Dong, The First Affiliated Hospital of Soochow University, ChinaXiao-Wan Bo, Tongji University, China
Copyright © 2024 Yang, Zhang, Zhao, Mao, Mu, Wang, Pang, Yang, Wei and Liu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Chun-Wei Liu, liuchunwei008@163.com; Xi Wei, weixi@tmu.edu.cn