An Ultrasonic-Based Radiomics Nomogram for Distinguishing Between Benign and Malignant Solid Renal Masses

Objectives: This study was conducted in order to develop and validate an ultrasonic-based radiomics nomogram for diagnosing solid renal masses.

Methods: Six hundred renal solid masses with benign renal lesions (n = 204) and malignant renal tumors (n = 396) were divided into a training set (n = 480) and a validation set (n = 120). Radiomics features were extracted from ultrasound (US) images preoperatively and then a radiomics score (RadScore) was calculated. By integrating the RadScore and independent clinical factors, a radiomics nomogram was constructed. The diagnostic performance of junior physician, senior physician, RadScore, and radiomics nomogram in identifying benign from malignant solid renal masses was evaluated based on the area under the receiver operating characteristic curve (ROC) in both the training and validation sets. The clinical usefulness of the nomogram was assessed using decision curve analysis (DCA).

Results: The radiomics signature model showed satisfactory discrimination in the training set [area under the ROC (AUC), 0.887; 95% confidence interval (CI), 0.860–0.915] and the validation set (AUC, 0.874; 95% CI, 0.816–0.932). The radiomics nomogram also demonstrated good calibration and discrimination in the training set (AUC, 0.911; 95% CI, 0.886–0.936) and the validation set (AUC, 0.861; 95% CI, 0.802–0.921). In addition, the radiomics nomogram model showed higher accuracy in discriminating benign and malignant renal masses compared with the evaluations by junior physician (DeLong p = 0.004), and the model also showed significantly higher specificity than the senior and junior physicians (0.93 vs. 0.57 vs. 0.46).

Conclusions: The ultrasonic-based radiomics nomogram shows favorable predictive efficacy in differentiating solid renal masses.

Introduction

Although the majority of renal masses are malignant, about 16% to 19% of renal tumors are reported to be benign (1–3). Clinically, renal cancers need to be surgically resected, whereas for benign renal neoplasms, especially for small renal masses, conservative management is performed. Unlike other cancers, there are currently no serum biomarkers available to confirm the identity of renal masses. Accurate preoperative identification of benign from malignant solid renal masses is challenging for a radiologist (4).

Percutaneous renal biopsy is an important pretreatment diagnostic procedure in the evaluation of indeterminate renal masses. However, the diagnostic accuracy of percutaneous biopsy ranges from 70% to 90%, and its role in clinical management remains unclear because of the negative predictive value and the possible complications, including bleeding, perirenal hematoma, hematuria, arteriovenous fistula formation, and pneumothorax (5–7). Thus, it is of vital importance to search for an accurate as well as safe and non-invasive diagnostic tool to distinguish benign from malignant solid renal masses in the preoperative clinical decision-making process.

Conventional B-mode ultrasound (US) is an easy, safe, and non-invasive procedure. It is currently the first-line imaging modality for detecting renal lesions and discriminating benign from malignant renal tumors. However, the visual interpretation of US images is generally based on the sonographers’ experience. Radiomics features can be computed from grayscale images to reflect the texture and morphology of tumors (8–11). Based on US images, radiomics has been applied to evaluate various tumors, including hepatocellular carcinomas, breast cancer, and thyroid carcinomas (12–15). However, to the best of our knowledge, no published study has applied ultrasonic-based radiomics to renal tumors. The purpose of this study was to develop and validate an ultrasonic-based radiomics nomogram for the differentiation between benign and malignant solid renal masses.

Material and Methods

Study Cohort and Imaging Dataset

We queried our institution’s electronic medical records to derive all surgically confirmed cases of renal masses between January 2013 and January 2018. A total of 1,998 confirmed renal masses were screened in this query: 1,777 malignant renal lesions and 221 benign renal lesions. In order to balance the proportion of malignant and benign renal masses, we randomly selected 442 malignant renal masses according to the hospitalization numbers. The inclusion criteria were as follows: 1) patients who had undergone US examination before treatment and the image quality of US was satisfactory for analysis and 2) patients with complete clinicopathological data. The exclusion criteria were as follows: 1) the pathological result of the surgical specimen was unclear, 2) the patient had undergone preoperative therapy (ablation therapy), and 3) the renal mass was not completely visible in the image. Finally, 597 patients with 600 renal masses were included in this study (Figure 1A). A summary of the patient characteristics is presented in Supplementary Material 1. The enrolled renal masses in this study were divided randomly into a training set (n = 480) and a validation set (n = 120). The distribution of tumors is detailed in Table 1. This study was approved by the Ethics Committee of Tianjin Medical University Cancer Institute and Hospital and informed consent was waived.

FIGURE 1

Figure 1 (A) Flowchart of the inclusion, exclusion, and grouping criteria for patients with renal masses. One patient had three clear cell RCCs. One patient had two clear cell RCCs. RCC, renal cell carcinoma. (B) Flowchart of the radiomics analysis of renal masses.

TABLE 1

Table 1 Clinical characteristics of patients in the training and validation sets.

US Image Acquisition

US examination was performed using the Philips iU22 system (Philips Ultrasound, Bothell, WA, USA) and Aplio 500 (Toshiba Medical Systems, Tokyo, Japan). The C5-1 probe was used for conventional ultrasound with a central frequency of 3–5 MHz. The gray image of the renal masses was available.

Workflow

The workflow of the radiomics analysis included tumor segmentation, feature extraction, feature selection, and radiomics signature construction and evaluation (Figure 1B).

Image Segmentation, Preprocessing, and Radiomics Feature Extraction

All US images were retrieved from the picture archiving and communication systems (PACS) for image segmentation and analysis in our institution. Lesions were segmented using ImageJ (https://imagej.nih.gov/ij/). A sonographer with more than 8 years of experience in US imaging of kidney neoplasms semiautomatically corrected the boundary of the lesion in each image of each individual patient. When the boundary is not determined, another experienced sonographer (with 20 years of experience in abdominal diagnosis) was consulted for a final opinion.

From each of the segmented objects, we applied existing automated computer programs to extract a set of 855 radiomic features for each patient with renal mass. These features were divided into four groups: 1) morphological features, such as area, largest diameter, length to width ratio, and roundness; 2) grayscale statistic (GSS) features calculated from the histogram of tumor voxel intensities, such as variance, skewness, and kurtosis; 3) texture feature, including gray-level co-occurrence matrix (GLCM), gray-level run-length matrix (GLRLM), gray-level size zone matrix (GLSZM), and neighborhood gray-tone difference matrix (NGTDM); and 4) wavelet feature. Details of the procedures for extraction of radiomic features are described in Supplementary Material 2. Z-score normalization was performed as preprocessing steps for data to guarantee the repeatability of the results.

Development of the Radiomics Signature Model

Dimension reduction of the features was conducted to minimize overfitting and reduce the bias from radiomics features in the modeling. Firstly, the Mann–Whitney U was used to select features that were highly related to the biomarkers. A significance level of 0.05 (p < 0.05) was set as the threshold. Secondly, an interfeature coefficient (R) between all possible pairs of features was subsequently used to eliminate high-dimensional feature redundancy. R >0.8 was the cutoff for strong relationships, in which one of two features with a lower p-value was excluded. Next, the least absolute shrinkage selection operator (LASSO) method was used to select the most important features with non-zero coefficients, and a RadScore was calculated for each patient. The process of radiomics feature extraction and analysis was performed in MATLAB 2018a (The MathWorks Inc., Natick, MA, USA) and R software (version 6.1, R Foundation for Statistical Computing, Vienna, Austria), respectively.

Development of a Radiomics Nomogram Model and the Performance of Different Models

The significant variables of the clinical factors and RadScore were integrated to build the radiomics nomogram model. We performed a calibration curve to graphically investigate the performance characteristics of the nomogram. The performance of each model for differentiating benign from malignant solid renal masses was evaluated based on the area under the ROC, accuracy, specificity, and sensitivity in both the training and validation sets. The difference in the AUC between the training and validation datasets was tested by the p-value of Delong’s test. The clinical usefulness of the nomogram was assessed using DCA which included two decision curves based on the radiomics signature and radiomics nomogram and could be demonstrated by calculating the net benefits for a range of threshold probabilities.

Image Analysis

The US findings were independently analyzed by two sonographers (XW and CL, with 20 and 5 years of experience, respectively), including size, location, shape, margin, and echogenicity.

Statistical Methods

The continuous variables were described as the mean ± standard deviation (x̅ ± s). The categorical data were presented as percentage or ratio. The logistic regression method was used for univariate and multivariate analysis in the training set. Statistical significance was set at p <0.05.

Results

Differences in the Clinical Features Between Benign and Malignant Patients

Detailed information on the clinical characteristics is shown in Table 1. There was a significant difference in sex (p < 0.001) and age (p < 0.001) between benign and malignant patients in the training set. Multiple logistic regression analysis showed that sex (p < 0.001, OR: 0.848; 95% CI: 0.804–0.894) remained as an independent predictor.

Radiomics Feature Selection and Radiomics Signature Model Building

Of the radiomics features, 855 features were reduced to 30 potential predictors on the basis of 480 renal masses in the training set (Figure 2), and these features were presented in the RadScore calculation formula (Supplementary Material 3). We compared the RadScores from the training and validation sets, respectively (Figure 3). The cutoff value was 0.633. There was a significant difference in the distributions of the RadScore of the benign and malignant groups in these two sets.

FIGURE 2

Figure 2 Feature selection using the least absolute shrinkage and selection operator (LASSO) binary logistic regression model. (A) Tuning parameter (lambda) selection in the LASSO model used 10-fold cross-validation via minimum criteria. (B) The gray line in the figure is the partial likelihood estimate corresponding to the optimal value of lambda. The optimal lambda value of 0.061 was chosen.

FIGURE 3

Figure 3 The boxplot of RadScore from the training set (A). The boxplot of RadScore from the validation set (B).

Development of a Radiomics Nomogram Model

Table 1 shows the results of the univariate and multivariate logistic regression analyses in the training set. Sex and RadScore were identified as independent factors for predicting the properties of solid renal masses (p < 0.001). Thus, the radiomics nomogram was developed using sex and radiomics score (Figure 4A). The calibration plots of this radiomics nomogram showed good calibration in the training and validation sets (Figures 4B, C). The performance of the radiomics signature model and the radiomics nomogram model for both the training and validation sets is presented in Table 2. Although the AUC of the radiomics signature model was slightly higher than that of the radiomics nomogram model, the discriminating ability of the radiomics model was comparable to that of the radiomics nomogram model (Figure 5, DeLong test: p = 0.221 for the training set, p = 0.760 for the validation set).

FIGURE 4

Figure 4 The radiomics nomogram and calibration curves for the radiomics nomogram. The radiomics nomogram, combining sex and RadScore, developed in the training set (A). Calibration curves for the radiomics nomogram in the training (B) and validation (C) sets.

TABLE 2

Table 2 Diagnostic performance of radiomics signature, radiomics nomogram, senior physician, and junior physician in the validation set.

FIGURE 5

Figure 5 The ROC curves of the radiomics signature, radiomics nomogram, senior physician, and junior physician in the validation set, respectively.

The DCAs based on the two models are presented in Figure 6. For the differentiation of benign from malignant renal masses, the nomogram model had a higher overall net benefit than the radiomics signature model across the majority of the range of reasonable threshold probabilities.

FIGURE 6

Figure 6 Decision curve analysis for two models. The y-axis indicates the net benefit; the x-axis indicates threshold probability. The red line and green line represent net benefit of the radiomics signature and the radiomics nomogram, respectively.

The Diagnostic Performance of the Radiomics Signature, Radiomics Nomogram, and Senior and Junior Physicians

Table 2 and Figure 5 show the diagnostic performance of the radiomics signature, radiomics nomogram, and senior and junior physicians in the validation set. There was a significant difference between the junior physician and the radiomics nomogram (DeLong p = 0.004), but there was no significant difference between the senior physician and the radiomics nomogram (DeLong p = 0.089). However, the specificity of the radiomics nomogram was significantly higher than that of the senior and junior physicians (0.93 vs. 0.57 vs. 0.46).

Discussion

Clinically, for the renal masses that are radiographically suspicious for renal cell carcinoma (RCC) without a pathology diagnosis, nephrectomy or nephron-sparing surgery is a standard management (16, 17). However, approximately 20%–30% of surgically removed renal masses are reported to be benign (1, 4, 18–21), and this may lead to overtreatment of benign renal tumors. Percutaneous needle biopsy is not used in all patients because of the uncertain effect and safety. Thus, there is a great and increasing need for accurate and non-invasive methods to distinguish benign from malignant renal masses before surgery. In this study, by combining US image radiomics and clinical characteristics, we developed a nomogram model that demonstrated good accuracy in differentiating benign from malignant renal masses.

In clinical practice, many imaging methods are used to distinguish between benign and malignant renal masses. US is currently the first-line imaging modality for renal tumor screening. Contrast-enhanced CT is the most commonly used imaging equipment for the evaluation of a renal tumor that requires further observation. With a superior soft-tissue contrast, MRI is particularly helpful to distinguish solid from cystic lesions. Contrast-enhanced US (CEUS) could be used to show the real-time tumor vascularization. Compared with US, these imaging procedures are more expensive, time-consuming, and less safe due to the use of nephrotoxic iodine contrast agents and ionizing radiation. Some reports have indicated the significance of CT- or MRI-based radiomics model in discriminating benign renal tumor from malignancies (22–29). However, there are no US-based radiomic studies used to identify renal tumors to date. Here, based on US images radiomics and combined with clinical characters, we developed a nomogram model that demonstrated good accuracy in differentiating benign from malignant renal masses.

In the present study, among the 855 extracted radiomics features, 30 features including texture and wavelet features were selected as the significant features to build the radiomics signature. The images in the benign group were more homogeneous in texture than the ones in the RCC group, which was consistent with previous reports and the diagnostic experience of the sonographer (22, 23).

Recently, radiomics showed excellent performance in differentiating benign and malignant renal masses (22–29). Hodgdon et al. developed a model incorporating CT texture features from 100 patients to differentiate angiomyolipomas (AMLs) from RCCs, which resulted in an AUC of 0.89 (22). Said et al. assessed the diagnostic value of MRI-based radiomics features using machine learning (ML) from 104 RCCs and 21 benign lesions, with the best diagnostic performance in the validation sets showing AUC of 0.73 (28). The radiomics model from our study achieved an AUC of 0.87 in the validation set, which was comparable to CT- or MRI-based radiomics. Moreover, the radiomics signature and nomogram model showed excellent diagnostic performance comparable to senior physician, indicating the potential significance of the model in clinical application in the hope that it will advance precision diagnostics, even for the junior physician without a wealth of experience in imaging diagnosis.

We further analyzed the false diagnosed cases. In general, classic AMLs consist of aberrant blood vessels, smooth muscle, and mature adipose tissue (30). They are markedly hyperechoic due to the presence of macroscopic fat (31, 32) (Figure 7A) and easy to distinguish from RCCs, which are more isoechoic or hypoechoic (Figure 7B). However, approximately 5% of AML cases lack macroscopic fat (Figure 7C), demonstrating sonographic appearances similar to those of RCC (33–35). In addition, most oncocytomas (Figure 7D) are isoechoic or hypoechoic to the renal parenchyma. It is difficult for the naked eye to identify oncocytomas. In this study, some cases of AMLs and oncocytomas were incorrectly described by sonographers as malignant masses. Thus, the overall diagnostic accuracy was lower in the sonographers than in the radiomics model. However, the sensitivity of the radiomics model was lower than that of the senior and junior physicians. In the validation set, 10 renal malignancies were mistaken as benign masses by the radiomics model. Six of the 10 cases were chromophobe RCC. Both chromophobe RCC and renal oncocytoma originate from intercalated cells of the collecting duct system and shared some overlapping morphologic, histochemical, immunohistochemical, and ultrastructural features (36, 37). This may be the reason for the incorrect diagnosis.

FIGURE 7

Figure 7 (A) A 42-year-old female patient with a strong hyperechoic tumor in the upper pole of the right kidney; the pathology report showed angiomyolipoma (AML). Representative ultrasound image (left). The echogenicity corresponds with a composition of fat. The pathological H&E staining image (middle, ×50) showed that the tumor was mainly composed of fat. S-100 immunohistochemical staining image (right, ×50) was used to label the lipid composition. (B) A 65-year-old male patient with a hypoechoic tumor located in the lower middle of the right kidney; the pathology report showed clear cell RCC. Representative ultrasound image (left). The pathological H&E staining image (middle, ×50). CA-IX immunohistochemical staining image (right, ×50) was used to label the clear cell RCC. (C) A 51-year-old female patient with a hypoechoic tumor located in the upper middle of the right kidney; the pathology report showed AML without visible fat. It was misdiagnosed as RCC by a sonographer. Representative ultrasound image (left). The pathological H&E staining image (middle, ×50) showed that the tumor was mainly composed of smooth muscle. SMA immunohistochemical staining image (right, ×50) was used to label the smooth muscle composition. (D) A 47-year-old female patient with a hypoechoic tumor located in the middle of the right kidney; the pathology report showed oncocytoma. It was misdiagnosed as RCC by a sonographer. Representative ultrasound image (left). The pathological H&E staining image (middle, ×50). CD117 immunohistochemical staining image (right, ×50) was used to label the oncocytoma.

Unexpectedly, in this study, the radiomics nomogram model in combination with the clinical factor did not show better performance compared with the radiomics model alone as shown in the study of Nie et al. (24). Their nomogram incorporating the CT-based radiomics and clinical factors outperformed the radiomics signature alone for differentiating AML from clear cell RCC. We propose that the discrepancies may be due to the sample size and pathological subtypes. In this study, a large cohort of 600 patients was analyzed and more pathological subtypes were included, except for AML and clear cell RCC. Sex was the only clinical signature in the nomogram of this study, suggesting that clinical factors in renal masses may contribute minimally to the differentiation of benign from malignant renal masses as reported in other cancers including ovarian, breast, and lung cancers (38–40). This observation merits further investigation.

It is noteworthy to point out the limitations of this study. First, its retrospective nature poses a potential selection bias. The US images used in this study were derived from two different US machines. This may lead to heterogeneity of the US images and further impact the performance of the radiomics score. Second, the samples were derived from a single institute, and the training and validation cohorts were split using a random split method. External validation using a prospectively recruited patient cohort and multicenter studies with a larger sample size to prove the robustness of our results are required. Third, manual region of interest (ROI) segmentation is time-consuming and complicated, especially for tumors without a well-defined boundary. Future studies should focus on the development of an automatic segmentation method for renal tumors with favorable reliability and reproducibility.

Conclusion

In conclusion, this study developed an ultrasonic–radiomic nomogram model that showed favorable predictive efficacy in preoperatively distinguishing benign renal masses from malignant tumors. As a non-invasive and quantitative method, the radiomics nomogram model may serve as an effective tool to supplement conventional imaging modalities for the clinical decision-making process.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding authors.

Ethics Statement

This study was reviewed and approved by the Ethics Committee of Tianjin Medical University Cancer Institute and Hospital (Approval No. bc2021124). The Ethics Committee waived the requirement of written informed consent for participation.

Author Contributions

WM and CL designed the study. CL and GQ wrote the original draft. JL, LQ, and XQW performed the analyses. TZ, XL, and SD collected the data. WM and XW contributed to the discussion and manuscript revision. All authors contributed to the article and approved the submitted version.

Funding

This study was supported by the scientific research program of Tianjin Education Commission (2020KJ131).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.847805/full#supplementary-material

References

1. Kutikov A, Fossett LK, Ramchandani P, Tomaszewski JE, Siegelman ES, Banner MP, et al. Incidence of Benign Pathologic Findings at Partial Nephrectomy for Solitary Renal Mass Presumed to be Renal Cell Carcinoma on Preoperative Imaging. Urology (2006) 68:737–40. doi: 10.1016/j.urology.2006.04.011

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Thompson RH, Hill JR, Babayev Y, Cronin A, Kaag M, Kundu S, et al. Metastatic Renal Cell Carcinoma Risk According to Tumor Size. J Urol (2009) 182:41–5. doi: 10.1016/j.juro.2009.02.128

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Frank I, Blute ML, Cheville JC, Lohse CM, Weaver AL, Zincke H. Solid Renal Tumors: An Analysis of Pathological Features Related to Tumor Size. J Urol (2003) 170:2217–20. doi: 10.1097/01.ju.0000095475.12515.5e

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Hindman N, Ngo L, Genega EM, Melamed J, Wei J, Braza JM, et al. Angiomyolipoma With Minimal Fat: Can it be Differentiated From Clear Cell Renal Cell Carcinoma by Using Standard MR Techniques? Radiology (2012) 265:468–77. doi: 10.1148/radiol.12112087

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Dyer R, DiSantis DJ, McClennan BL. Simplified Imaging Approach for Evaluation of the Solid Renal Mass in Adults. Radiology (2008) 247:331–43. doi: 10.1148/radiol.2472061846

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Pierorazio PM, Johnson MH, Patel HD, Sozio SM, Sharma R, Iyoha E, et al. Management of Renal Masses and Localized Renal Cancer. Rockville, Md: Agency for Healthcare Research and Quality (2016). AHRQ publication 16-EHC001-EF.

Google Scholar

7. Tomaszewski JJ, Uzzo RG, Smaldone MC. Heterogeneity and Renal Mass Biopsy: A Review of its Role and Reliability. Cancer Biol Med (2014) 11:162–72. doi: 10.7497/j.issn.2095-3941.2014.03.002

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Limkin EJ, Sun R, Dercle L, Zacharaki EI, Robert C, Reuzé S, et al. Promises and Challenges for the Implementation of Computational Medical Imaging (Radiomics) in Oncology. Ann Oncol (2017) 28:1191–206. doi: 10.1093/annonc/mdx034

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images are More Than Pictures, They are Data. Radiology (2016) 278:563–77. doi: 10.1148/radiol.2015151169

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: Extracting More Information From Medical Images Using Advanced Feature Analysis. Eur J Cancer (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Kumar V, Gu Y, Basu S, Berglund A, Eschrich SA, Schabath MB, et al. Radiomics: The Process and the Challenges. Magn Reson Imaging (2012) 30:1234–48. doi: 10.1016/j.mri.2012.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Yao Z, Dong Y, Wu G, Zhang Q, Yang D, Yu JH, et al. Preoperative Diagnosis and Prediction of Hepatocellular Carcinoma: Radiomics Analysis Based on Multi-Modal Ultrasound Images. BMC Cancer (2018) 18:1089. doi: 10.1186/s12885-018-5003-4

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Guo Y, Hu Y, Qiao M, Wang Y, Yu J, Li J, et al. Radiomics Analysis on Ultrasound for Prediction of Biologic Behavior in Breast Invasive Ductal Carcinoma. Clin Breast Cancer (2018) 18:e335–44. doi: 10.1016/j.clbc.2017.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Liang J, Huang X, Hu H, Liu Y, Zhou Q, Cao Q, et al. Predicting Malignancy in Thyroid Nodules: Radiomics Score Versus 2017 American College of Radiology (ACR) Thyroid Imaging, Reporting and Data System (TI-RADS). Thyroid (2018) 28:1024–33. doi: 10.1089/thy.2017.0525

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Liu T, Zhou S, Yu J, Guo Y, Wang Y, Zhou J, et al. Prediction of Lymph Node Metastasis in Patients With Papillary Thyroid Carcinoma: A Radiomics Method Based on Preoperative Ultrasound Images. Technol Cancer Res Treat (2019) 18:1533033819831713. doi: 10.1177/1533033819831713

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Campbell SC, Novick AC, Belldegrun A, Blute ML, Chow GK, Derweesh IH, et al. Guideline for Management of the Clinical T1 Renal Mass. J Urol (2009) 182:1271–9. doi: 10.1016/j.juro.2009.07.004

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Ljungberg B, Cowan NC, Hanbury DC, Hora M, Kuczyk MA, Merseburger AS, et al. EAU Guidelines on Renal Cell Carcinoma: The 2010 Update. Eur Urol (2010) 58:398–406. doi: 10.1016/j.eururo.2010.06.032

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Lane BR, Babineau D, Kattan MW, Novick AC, Gill IS, Zhou M, et al. A Preoperative Prognostic Nomogram for Solid Enhancing Renal Tumors 7 Cm or Less Amenable to Partial Nephrectomy. J Urol (2007) 178:429–34. doi: 10.1016/j.juro.2007.03.106

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Lindkvist Pedersen C, Winck-Flyvholm L, Dahl C, Azawi NH. High Rate of Benign Histology in Radiologically Suspect Renal Lesions. Danish Med J (2014) 61:A4932.

Google Scholar

20. Lee SH, Park SU, Rha KH, Choi YD, Hong SJ, Yang SC, et al. Trends in the Incidence of Benign Pathological Lesions at Partial Nephrectomy for Presumed Renal Cell Carcinoma in Renal Masses on Preoperative Computed Tomography Imaging: A Single Institute Experience With 290 Consecutive Patients. Int J Urol (2010) 17:512–6. doi: 10.1111/j.1442-2042.2010.02514.x

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Bauman TM, Potretzke AM, Wright AJ, Knight BA, Vetter JM, Figenshau RS. Partial Nephrectomy for Presumed Renal-Cell Carcinoma: Incidence, Predictors, and Perioperative Outcomes of Benign Lesions. J Endourol (2017) 31:412–7. doi: 10.1089/end.2016.0667

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Hodgdon T, McInnes MD, Schieda N, Flood TA, Lamb L, Thornhill RE. Can Quantitative CT Texture Analysis be Used to Differentiate Fat-Poor Renal Angiomyolipoma From Renal Cell Carcinoma on Unenhanced CT Images? Radiology (2015) 276:787–96. doi: 10.1148/radiol.2015142215

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Feng Z, Rong P, Cao P, Zhou Q, Zhu W, Yan Z, et al. Machine Learning-Based Quantitative Texture Analysis of CT Images of Small Renal Masses: Differentiation of Angiomyolipoma Without Visible Fat From Renal Cell Carcinoma. Eur Radiol (2018) 28:1625–33. doi: 10.1007/s00330-017-5118-z

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Nie P, Yang G, Wang Z, Yan L, Miao W, Hao D, et al. A CT-Based Radiomics Nomogram for Differentiation of Renal Angiomyolipoma Without Visible Fat From Homogeneous Clear Cell Renal Cell Carcinoma. Eur Radiol (2020) 30:1274–84. doi: 10.1007/s00330-019-06427-x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Sun X-Y, Feng Q-X, Xu X, Zhang J, Zhu F-P, Yang Y-H, et al. Radiologic-Radiomic Machine Learning Models for Differentiation of Benign and Malignant Solid Renal Masses: Comparison With Expert-Level Radiologists. AJR Am J Roentgenol (2020) 214:W44–54. doi: 10.2214/AJR.19.21617

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Erdim C, Yardimci AH, Bektas CT, Kocak B, Koca SB, Demir H, et al. Prediction of Benign and Malignant Solid Renal Masses: Machine Learning-Based CT Texture Analysis. Acad Radiol (2020) 27:1422–9. doi: 10.1016/j.acra.2019.12.015

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Varghese BA, Chen F, Hwang DH, Cen SY, Desai B, Gill IS, et al. Differentiation of Predominantly Solid Enhancing Lipid-Poor Renal Cell Masses by Use of Contrast-Enhanced CT: Evaluating the Role of Texture in Tumor Subtyping. AJR Am J Roentgenol (2018) 211:W288–96. doi: 10.2214/AJR.18.19551

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Said D, Hectors SJ, Wilck E, Rosen A, Stocker D, Bane O, et al. Characterization of Solid Renal Neoplasms Using MRI-Based Quantitative Radiomics Features. Abdom Radiol (NY) (2020) 45:2840–50. doi: 10.1007/s00261-020-02540-4

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Yang R, Wu J, Sun L, Lai S, Xu Y, Liu X, et al. Radiomics of Small Renal Masses on Multiphasic CT: Accuracy of Machine Learning–Based Classification Models for the Differentiation of Renal Cell Carcinoma and Angiomyolipoma Without Visible Fat. Eur Radiol (2020) 30:1254–63. doi: 10.1007/s00330-019-06384-5

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Katabathina VS, Vikram R, Nagar AM, Tamboli P, Menias CO, Prasad SR. Mesenchymal Neoplasms of the Kidney in Adults: Imaging Spectrum With Radiologic-Pathologic Correlation. Radiographics (2010) 30:1525–40. doi: 10.1148/rg.306105517

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Siegel CL, Middleton WD, Teefey SA, McClennan BL. Angiomyolipoma and Renal Cell Carcinoma: US Differentiation. Radiology (1996) 198:789–93. doi: 10.1148/radiology.198.3.8628873

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Jinzaki M, Ohkuma K, Tanimoto A, Mukai M, Hiramatsu K, Murai M, et al. Small Solid Renal Lesions: Usefulness of Power Doppler Us. Radiology (1998) 209:543–50. doi: 10.1148/radiology.209.2.9807587

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Oh TH, Lee YH, Seo IY. Diagnostic Efficacy of Contrast-Enhanced Ultrasound for Small Renal Masses. Korean J Urol (2014) 55:587–92. doi: 10.4111/kju.2014.55.9.587

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Charboneau JW, Hattery RR, Ernst EC 3rd, James EM, Williamson B Jr, Hartman GW. Spectrum of Sonographic Findings in 125 Renal Masses Other Than Benign Simple Cyst. AJR Am J Roentgenol (1983) 140:87–94. doi: 10.2214/ajr.140.1.87

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Xu ZF, Xu HX, Xie XY, Liu GJ, Zheng YL, Lu MD. Renal Cell Carcinoma and Renal Angiomyolipoma: Differential Diagnosis With Real-Time Contrastenhanced Ultrasonography. J Ultrasound Med (2010) 29:709–17. doi: 10.7863/jum.2010.29.5.709

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Lopez-Beltran A, Scarpelli M, Montironi R, Kirkali Z. 2004 WHO Classification of the Renal Tumors of the Adults. Eur Urol (2006) 49:798–805. doi: 10.1016/j.eururo.2005.11.035

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Tickoo SK, Amin MB. Discriminant Nuclear Features of Renal Oncocytoma and Chromophobe Renal Cell Carcinoma. Analysis of Their Potential Utility in the Differential Diagnosis. Am J Clin Pathol (1998) 110:782–7. doi: 10.1093/ajcp/110.6.782

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Wang C, Chen X, Luo H, Liu Y, Meng R, Wang M, et al. Development and Internal Validation of a Preoperative Prediction Model for Sentinel Lymph Node Status in Breast Cancer: Combining Radiomics Signature and Clinical Factors. Front Oncol (2021) 11:754843. doi: 10.3389/fonc.2021.754843

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Qi L, Chen D, Li C, Li J, Wang J, zhang C, et al. Diagnosis of Ovarian Neoplasms Using Nomogram in Combination With Ultrasound Image-Based Radiomics Signature and Clinical Factors. Front Genet (2021) 12:753948. doi: 10.3389/fgene.2021.753948

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Xie Y, Zhao H, Guo Y, Meng F, Liu X, Zhang Y, et al. A PET/CT Nomogram Incorporating SUVmax and CT Radiomics for Preoperative Nodal Staging in Non-Small Cell Lung Cancer. Eur Radiol (2021) 31:6030–8. doi: 10.1007/s00330-020-07624-9

PubMed Abstract | CrossRef Full Text | Google Scholar