Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 27 September 2021
Sec. Cancer Imaging and Image-directed Interventions
This article is part of the Research Topic Machine Learning Algorithm and Radiomics Analysis Based on Radiologic Imaging in Diagnosis and Prediction of Liver Tumors View all 9 articles

RGB Three-Channel SWE-Based Ultrasomics Model: Improving the Efficiency in Differentiating Focal Liver Lesions

Mei-Qing Cheng&#x;Mei-Qing Cheng1†Meng-Fei Xian&#x;Meng-Fei Xian1†Wen-Shuo TianWen-Shuo Tian1Ming-De LiMing-De Li1Hang-Tong HuHang-Tong Hu1Wei LiWei Li1Jian-Chao ZhangJian-Chao Zhang1Yang HuangYang Huang1Xiao-Yan XieXiao-Yan Xie1Ming-De Lu,Ming-De Lu1,2Ming Kuang,Ming Kuang1,2Wei WangWei Wang1Si-Min Ruan*Si-Min Ruan1*Li-Da Chen*Li-Da Chen1*
  • 1Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, Ultrasomics Artificial Intelligence X-Lab, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China
  • 2Department of Hepatobiliary Surgery, The First Affiliated Hospital of Sun Yat-Sen University, Guangzhou, China

Objective: To explore a new method for color image analysis of ultrasomics and investigate the efficiency in differentiating focal liver lesions (FLLs) by Red, Green, and Blue (RGB) three-channel SWE-based ultrasomics model.

Methods: One hundred thirty FLLs were randomly divided into training set (n = 65) and validation set (n = 65). The RGB three-channel and direct conversion methods were applied to the same color SWE images. Ultrasomics features were extracted from the preprocessing images establishing two feature data sets. The least absolute shrinkage and selection operator (LASSO) logistic regression model was applied for feature selection and model construction. Two models, named RGB model (based on RGB three-channel conversion) and direct model (based on direct conversion), were used to differentiate FLLs. The diagnosis performance of the two models was evaluated by area under the curve (AUC), calibration curves, decision curves, and net reclassification index (NRI).

Results: In the validation cohort, the AUC of the direct model and RGB model in characterization on FLLs were 0.813 and 0.926, respectively (p = 0.038). Calibration curves and decision curves indicated that the RGB model had better calibration efficiency and provided greater clinical benefits. NRI revealed that the RGB model correctly reclassified 7% of malignant cases and 25% of benign cases compared to the direct model (p = 0.01).

Conclusion: The RGB model generated by RGB three-channel method yielded better diagnostic efficiency than the direct model established by direct conversion method. The RGB three-channel method may be promising on ultrasomics analysis of color images in clinical application.

Introduction

Shear-wave elastography (SWE), as an elasticity-based US technique, is widely used in lesion characterization and liver stiffness assessment (14). It can quantitatively evaluate tissue stiffness by measuring the velocity (m/s) of shear wave or tissue elastic modulus (kPa). However, SWE is still operator dependent in the optimal region selection, and there are few established guidelines on how to acquire a satisfied SWE image, which resulted in interobserver variability and subjective diagnostic decision-making (5, 6).

Radiomics or ultrasomics is a promising field for image analysis, through extracting a high throughput of quantitative data from medical images for clinical application (7). Its potential to provide a better insight into tumor characteristics that fail to be appreciated by naked eyes facilitates a direct estimation of outcomes (8). Recent advances related to ultrasomics involved tumor detection, classification, staging, and therapeutic assessment. In tumor classification, ultrasomics is mainly based on an analysis of the grayscale image due to the heterogeneity of the tumor itself. However, interpreting color images is also required in clinical practice such as SWE image analysis. For color image analysis, the most common existing method is directly converted into a grayscale image, which is usually done by the following color-to-grayscale algorithms: Intensity, Luminance, Lightness, Value, and so on (9). According to human’s sensitivity to the R, G, and B colors, Lightness, which is based on the formula of gray intensity = 0.2126R + 0.7152G + 0.0722B, more closely corresponds to human perception and preferable in color image conversion, which is achieved via a nonlinear transformation of the RGB color space. However, it is not a lossless method for color to grayscale image conversion, which suffers from a domain shifting problem due to the overlaps of Red, Green, and Blue (RGB) channel values (9, 10). Other common analysis methods included RGB to grayscale elasticity map (5, 1114) and histogram-based color image analysis (15). The RGB to grayscale elasticity image is a lossless inverse procedure, but it required an intermediate image processing step (such as RGB to Stiffness conversion) for image analysis. The drawback of the latter method was that information about the object’s location, shape and texture are discarded.

A representative SWE image consists of a grayscale accompanied with a corresponding color SWE image. The RGB color model is composed of three primary channel values, which can reproduce a broad array of colors. Pixels are the smallest individual element of an RGB image, and each pixel consists of three-channel values forming 8-bit values (range, 0–255). RGB images contain additional discriminative information compared with grayscale images (16). A very large visual information can be produced at each pixel location by varying the relative contribution of each of the three-channel values. In the direct conversion method of SWE-based ultrasomics for FLLs differentiation, we found that direct conversion of SWE images into grayscale images could change the pixel values of the original image (10). This direct conversion method may result in a mismatch between the converted image and the original color image. Therefore, we proposed a novel method that generates three single-channel (R, G, and B, respectively) grayscale images from SWE images and extracted information from every single-channel image (named as RGB three-channel method). After this decomposition, the pixel gray value of every single-channel image was consistent with that of the original RGB color image. We speculated that the RGB three-channel method could retain and reflect the same characteristics of the original color image, reducing data loss due to direct image conversion.

Few studies have reported the color image analysis method for ultrasomics features extraction in FLLs. The current study was to evaluate the diagnostic performance of the RGB three-channel method and the direct conversion method, to see whether the new method yields better results on SWE-based ultrasomics for FLLs characterization.

Materials and Methods

This retrospective study was approved by the institutional ethics committee of our hospital, and written informed consent was obtained from all patients.

Patients

Between January 2015 and December 2016, 127 patients with 130 liver lesions who underwent SWE examination were included in this retrospective study. The inclusion criteria were (a) distinct liver lesions larger than 10 mm at the US, (b) lesions detected with a maximum distance of 8 cm from the surface of the skin to the center of the lesion, (c) pathological confirmed lesions or clinical diagnostic standard (described in reference standard) (17). Lesions that were previously treated or relapse from previously treated, adjacent to large vessels (hepatic arterial, hepatic vein, portal vein, and the inferior vena cava) and with poor SWE image quality were excluded.

Lesions were divided into the training and validation cohorts randomly in a ratio of 1:1. The inclusion flow chart for the study population is presented in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1 Inclusion flow chart for the study population.

Ultrasound Examination

SWE examinations were performed using an Aixplorer Ultrasound system (SuperSonic Imagine, Aix-en-Provence, France) equipped with the SC6-1 convex probe. One radiologist (TWS) performed the SWE examination independently according to the European Federation of Societies for Ultrasound in Medicine and Biology (EFSUMB) guidelines (18). During the examination, the patient was asked to hold their breath, and the operator should maintain immobilization for a few seconds without pressure for SWE image acquisition.

Reference Standard

All the histopathology results of the FLLs were confirmed by either surgical resection or US-guided biopsy except for hemangiomas. As to hemangiomas, the clinical diagnosis standard was both with typical characteristics (17) on contrast-enhanced ultrasonography (CEUS) and with at least 12 months of follow-up.

Image Conversion

Image conversion was performed using Python (version 3.8.5). The direct conversion was directly converting an SWE color image into a grayscale elasticity image. The RGB three-channel method was converting an SWE color image into three single-channel images (Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2 RGB image decomposition by the RGB three-channel method. A 56-year-old man with a 3.5-cm HCC in segment 2 of the liver. The depth from the body surface to the center of the lesion was <8 cm. (A) SWE color-code image. (B) Red channel. (C) Green channel. (D) Blue channel.

Ultrasomics Score

The region of interest (ROI) was delineated along the contour of the tumor by one radiologist (WW, with more than 15 years of liver imaging experience). ROI was manually drawn from the boundary of the index mass on the grayscale image, and the same ROI was copied and pasted to the corresponding location inside the SWE image as well as every single channel image. The features were extracted from the ROI of each converted image automatically. A total of 5,936 features were extracted from every single image. In total, 17,808 features were extracted by the combination of three single-channel images generated by the RGB three-channel method, whereas 5,936 features were extracted by the direct conversion method. Most of these features were highly redundant, causing the susceptibility of the classifier. The least absolute shrinkage and selection operator (LASSO) regression was used for features reduction and selection (19). Finally, based on the selected ultrasomics features, four classifiers, namely, Adaptive Boosting (AdaBoost), Logistic Regression (LR), Support Vector Machine (SVM), and Random Forest (RF), were respectively applied to construct the ultrasomics score for FLLs characterization (4, 20, 21). The score generated by the direct conversion method and the RGB three-channel method was named direct score and RGB score, respectively.

Technique for Oversampling

To alleviate the imbalanced medical dataset and mitigate the small data size, simple minority oversampling technique (SMOTE) (22) was applied to generate new synthetic samples at data level to create the balance between minority and majority classes.

Model Evaluation and Comparison

The direct score model and RGB score model were applied to FLLs characterization, and the results were verified in the validation cohort.

Discrimination

Receiver operating curves (ROC) were used to evaluate the discrimination performance of the direct model and the RGB model in differentiating malignant from benign FLLs in the validation cohorts. It was measured by the area under the curve (AUC). To compare the predictive effect of the direct score model with the RGB score model, we calculated the net reclassification index (NRI), which was the most widely used summary statistics to present the extent of the reclassification of the models.

Calibration curves were drawn for evaluating the accurate prediction of the two models in the validation cohort. The Brier Scores were compared between two models, and a small Brier Score (23) indicates high prediction accuracy and is well-calibrated.

Clinical Application

A decision curve analysis (DCA) was applied to demonstrate the clinical usefulness by estimating the standardized net benefit of the prediction models at different threshold probabilities. The benefit increased with the degree of the curve deviating from the baseline.

Statistical Analysis

Statistical analysis was performed by SPSS 21.0 for Windows (Chicago, IL), Python (version 3.8.5), R software (R Foundation for Statistical Computing, version 3.4.1; https://www.r-project.org/) and MedCalc Statistical Software version 18.5 (MedCalc Software bvba, Ostend, Belgium; http://www.medcalc.org; 2018). Chi-squared test or the Fisher exact test was used for categorical variables, and the two-sample t-test was for continuous variables in the comparison of the training and validation cohorts for baseline characteristics. Python (version 3.8.5) was applied for feature reduction and model building. LASSO regression was performed by the “sklearn” package for feature reduction. Based on “imblearn” package, SMOTE was used for upsampling and balancing the categories of training sample. The RF, SVM, adaboost, and LR classifiers were constructed by “sklearn” package. The ROC curves and the calculation of the AUC were conducted by the “pROC” package. The calibration curves and the DCA curves were plotted by the “Calibration Curves” package and “DecisionCurve” package, respectively. The R package “nricens” was used to perform NRI. A p < 0.05 (two-sided) was considered statistically significant.

Results

Patient Characteristics

One hundred twenty-seven patients with 130 lesions were enrolled in the study. Of the 130 FLLs, 90 FLLs were malignant, including hepatocellular carcinoma (n = 61), intrahepatic cholangiocarcinoma (n = 12), and liver metastasis (n = 17). Forty FLLs were benign with focal nodular hyperplasia (n = 8), hemangioma (n = 27), and inflammatory pseudotumor (n = 5). These 130 lesions were equally allocated to the training cohort and the validation cohort at random. There were 65 lesions in the training cohort including 45 malignant lesions and 20 benign lesions. After simple minority oversampling, the training cohort changed into 90 lesions with 45 malignancy and 45 benign lesions. The baseline characteristics of the two cohorts were compared in Table 1.

TABLE 1
www.frontiersin.org

Table 1 Clinical–pathological characteristics and ultrasomics score in the training and validation cohorts.

Feature Selection and Analysis of Ultrasomics

Of 130 FLLs, 30.8% (40/130) were benign and 69.2% (90/130) were malignant. Based on the two conversion methods, 5,936 features were extracted from the direct conversion method, whereas 17,808 features were extracted from the RGB three-channel method. After ultrasomics feature selection by LASSO regression, 29 features from the direct conversion method and 8 features from the RGB three-channel method were potential predictors for differentiating FLLs. The extracted features for model construction and the definitions of the features are presented in Supplementary Material.

Comparison of Two Ultrasomics Models

The AUCs of models using different classifiers are list in Table 2. The results showed that RF (AUC = 0.813 and 0.926 for direct model and RGB model, respectively) outperformed the other classifiers. RF has stability and effectiveness with high staging performance. The diagnostic sensitivity, specificity, and accuracy of the direct model using RF as a classifier were 86.7% (95% CI, 73.2%, 94.9%), 60.0% (95% CI, 36.1%, 80.9%), and 78.5% (95% CI, 58.4%, 103.2%), respectively, while those of the RGB model were 93.3% (95% CI, 81.7%, 98.6%), 85% (95% CI, 62.1%, 97.8%), and 90.8% (95% CI, 69.1%, 117.1%). The ROC curves were used to demonstrate the prediction accuracy of the two ultrasomics models in the validation cohort. The AUCs of the RGB model and the direct model for FLLs characterization were 0.926 (95% CI, 0.833–0.976) and 0.813 (95% CI, 0.697–0.899), respectively (p = 0.038) (Table 2), indicating that the RGB model was more effective in FLLs characterization (Figure 3). NRI was calculated for quantifying improvement in predicting the accuracy of the two ultrasomics models. NRI revealed that the RGB model exhibited a better reclassification in the FLLs discrimination. 7% of malignant lesions and 25% of benign ones were reclassified accurately in comparison with the direct model (p = 0.01) (Table 3).

TABLE 2
www.frontiersin.org

Table 2 Diagnostic performance of direct model and RGB model among different classifiers in the validation cohort.

FIGURE 3
www.frontiersin.org

Figure 3 Receiver operating characteristic (ROC) curves for the direct model and RGB model were performed in the validation cohort. The area under the curve for direct model US and RGB model were 0.813 (95% CI, 0.697–0.899) and 0.926 (95% CI, 0.833–0.976), respectively.

TABLE 3
www.frontiersin.org

Table 3 Evaluation the performance of direct model and RGB model of the validation cohort.

Calibration

In the validation cohort, the calibration curves were drawn to explore whether the predicted probability was well-agreed with the real probability in the direct model (Figure 4A) and RGB model (Figure 4B). The reliability of the calibration curves was assessed by the Brier Scores. A small Brier Score indicated high prediction accuracy and well calibration. The Brier Scores of the direct model and RGB model were 0.153 and 0.097, respectively, indicating the RGB model had a higher prediction accuracy and better agreement for the calibration curves compared with the direct model.

FIGURE 4
www.frontiersin.org

Figure 4 Calibration curves for (A) direct model and (B) RGB model performed in the validation cohort. The calibration curves demonstrated a statistical goodness-of-fit measurement of the models in the characterization of focal liver lesions. The solid line represented the performance of the models, and the dotted line represented an ideal model. The lesser the solid line deviated from the dotted line, the better the calibration of the model.

Clinical Application

DCAs of the direct score model and the RGB score model were compared in the validation cohort (Figure 5). The DCA curves revealed that at any given threshold probability, the RGB score model in predicting malignancy had a greater net benefit compared with that of the direct score model.

FIGURE 5
www.frontiersin.org

Figure 5 Decision curves for the direct model and RGB model were performed in the validation cohort.

Discussion

This retrospective study proposed a new RGB three-channel method for SWE-based ultrasomics color image analysis. The diagnostic performance of the RGB model generated by this method was tested in the validation cohort regarding discrimination, calibration, and clinical application. The RGB model exhibited superior diagnosis performance than the direct model, with AUC of 0.813 for direct model and 0.926 for RGB model. The RGB model outperformed the direct model concerning prediction accuracy, calibration, and clinical application. Images converted from the RGB three-channel method could well reflect the original information of the RGB color image, which reduced less data loss compared with the direct conversion method. This method captured more information and may be helpful in clinical practice.

Recently, the most common color image processing was directly converted into a grayscale image, which was based on the gray intensity = 0.2126R + 0.7152G + 0.0722B. This method is easy to apply, but the most important limitation is color information lost during the convention (10). To seek an easy and effective way on color image analysis for radiomics or ultrasomics, several research groups have proposed different methods for color image processing (5, 1115, 24). Bhatia et al. (11) separated the color components of the 2D-SWE image and generated a pure color-code image from removing the layer of the grayscale image. They established a prediction model in the identification between benign and malignant thyroid nodules by extracting 15 gray level co-occurrence matrix features (GLCM). The sensitivity, specificity, and AUC of this model reached 97.5%, and 90%, and 0.973, respectively. Gatos et al. (13, 14) developed an RGB-to-stiffness inverse mapping technique in assessing liver stiffness. This method presented excellent results in the evaluation of liver stiffness with an ACU of 0.87. The above methods required intermediate image processing step for color to grayscale conversion. Ma et al. (15) used a histogram-based color image analysis method in positron emission tomography computed tomography (PET-CT) image in the differentiation of nonsmall cell lung carcinoma subtypes. The drawback of this method was that information about the object’s location, shape, and texture was discarded. In their study, they combined texture and color features and got an AUC of 0.89 (95% CI, 0.78–1.00). Yao et al. (24) established a prediction model by extracting features of multimodal ultrasound images in FLLs characterization. The feature extraction method used in this study was built on sparse representation theory (SRT), which was different from the traditional Radiomics method. Based on this SRT method, color image analysis was more effective without the need to convert into grayscale images that occur in traditional radiomics analysis. However, the image processing and feature extraction process in their study required highly specialized skills in computer programming, which was hard to conduct in clinical applications. In this study, the RGB three-channel method was easier to implement than the above image processing methods, and according to our results, the RGB three-channel method can achieve a good diagnostic performance.

The RGB three channels in the SWE color image were mainly used to reflect the stiffness distribution of the lesion, from the lowest stiffness (dark blue) to the highest stiffness (red) and in between is green (5, 25). This study indicated the RGB three-channel method could better retain the original information without data loss compared with the direct conversion method, which was important for subsequent data mining. We hypothesized this reason may be due to the change of grayscale pixel value after direct conversion, consequently resulting in loss of color image data. In the RGB three-channel method, the original color image was converted into three single-channel grayscale images. Each grayscale image reflects the pixel values of each color component in the original color image, and the grayscale pixel value remained unchanged compared with the original color image.

Medical image analysis is based on the different grayscale values and textures between the lesion and normal tissue with the concept that image information can reveal the relation between underlying pathophysiology and quantitative features (8). However, color image analysis is also important in radiomics and ultrasomics. It can provide additional information for lesion characterization. SWE is a color-coded image with red, green, and blue reflecting the difference in stiffness according to the different propagation speeds of the shear wave in tissue. PET-CT image is a color-code image that can reflect metabolic information of the tissues by detecting the distribution of increased tracer uptake values (26). The brightness of color indicated the degree of tracer aggregation. In this study, we presented an RGB three-channel method for color image analysis on ultrasomics, which can retain as much information as the original color image. This method was easy to access with great potential for clinical application.

There were some drawbacks and limitations to this study. First, our study was limited by a small patient population, which may lead to overfitting and model instability. Second, our data were retrospectively collected from a single institution, which may limit generalizability to populations in other geographical regions. Besides, ROIs for features extraction were drawn manually, and the interobserver reproducibility was not evaluated. Finally, we did not apply deep learning networks in this study as presented in Gatos et al. (27) and Kagadis et al. (28) studies. Further studies with a larger sample size and the application of deep learning networks would be taken to assess the diagnosis performance of this new method for widespread implementation in clinical practice.

Conclusion

In conclusion, the RGB three-channel method for SWE-based ultrasomics analysis can effectively retain the original image information and improve the diagnostic performance in differentiating FLLs. Our research provides a new technique for how to better process ultrasomics analysis of color images and expand the clinical application of ultrasomics on color image analysis.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by The First Affiliated Hospital of Sun Yat-sen University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

Guarantors of integrity of entire study: M-QC, W-ST, M-DLi, H-TH, S-MR, and L-DC. Study concepts/study design or data acquisition or data analysis/interpretation: all authors. Manuscript drafting or manuscript revision for important intellectual content: all authors. Agrees to ensure any questions related to the work are appropriately resolved: all authors. Literature research: M-QC, W-ST, M-DLi, S-MR, and L-DC. Clinical studies: M-QC, W-ST, M-DLi, H-TH, WL, S-MR, and L-DC. Statistical analysis: M-QC, W-ST, J-CZ, YH, S-MR, and L-DC. Manuscript editing: M-QC, W-ST, X-YX, M-DLu, MK, WW, S-MR, and L-DC. Revison of the manuscript: M-FX and M-QC. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the National Nature Science Foundation of China (No: 81971630) and the Guangzhou Science and Technology Foundation (No: 201904010187).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2021.704218/full#supplementary-material.

Abbreviations

AUC, area under the curve; SWE, shear wave elastography; NRI, net reclassification index; DCA, decision curve analysis; LASSO, least absolute shrinkage and selection operator; ROC, receiver operating characteristic; ROI, region of interest; RGB, red, green, and blue; CI, confidence interval; FLLs, focal liver lesions; PET-CT, positron emission tomography computed tomography; SRT, sparse representation theory; AdaBoost, adaptive boosting; SVM, support vector machine; RF, random forest; LR, logistic regression.

References

1. Bojunga J, Herrmann E, Meyer G, Weber S, Zeuzem S, Friedrich-Rust M. Real-Time Elastography for the Differentiation of Benign and Malignant Thyroid Nodules: A Meta-Analysis. Thyroid (2010) 20(10):1145–50. doi: 10.1089/thy.2010.0079

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Leung VY, Shen J, Wong VW, Abrigo J, Wong GL, Chim AM, et al. Quantitative Elastography of Liver Fibrosis and Spleen Stiffness in Chronic Hepatitis B Carriers: Comparison of Shear-Wave Elastography and Transient Elastography With Liver Biopsy Correlation. Radiology (2013) 269(3):910–8. doi: 10.1148/radiol.13130128

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Tian WS, Lin MX, Zhou LY, Pan FS, Huang GL, Wang W, et al. Maximum Value Measured by 2-D Shear Wave Elastography Helps in Differentiating Malignancy From Benign Focal Liver Lesions. Ultrasound Med Biol (2016) 42(9):2156–66. doi: 10.1016/j.ultrasmedbio.2016.05.002

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Li W, Huang Y, Zhuang BW, Liu GJ, Hu HT, Li X, et al. Multiparametric Ultrasomics of Significant Liver Fibrosis: A Machine Learning-Based Analysis. Eur Radiol (2019) 29(3):1496–506. doi: 10.1007/s00330-018-5680-z

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Youk JH, Kwak JY, Lee E, Son EJ, Kim JA. Grayscale Ultrasound Radiomic Features and Shear-Wave Elastography Radiomic Features in Benign and Malignant Breast Masses. Ultraschall Med (2020) 41(4):390–6. doi: 10.1055/a-0917-6825

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Xiao Y, Zeng J, Niu L, Zeng Q, Wu T, Wang C, et al. Computer-Aided Diagnosis Based on Quantitative Elastographic Features With Supersonic Shear Wave Imaging. Ultrasound Med Biol (2014) 40(2):275–86. doi: 10.1016/j.ultrasmedbio.2013.09.032

CrossRef Full Text | Google Scholar

7. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: Extracting More Information From Medical Images Using Advanced Feature Analysis. Eur J Cancer (2012) 48(4):441–6. doi: 10.1016/j.ejca.2011.11.036

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More Than Pictures, They Are Data. Radiology (2016) 278(2):563–77. doi: 10.1148/radiol.2015151169

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Kanan C, Cottrell GW. Color-To-Grayscale: Does the Method Matter in Image Recognition? PLoS One (2012) 7(1):e29740. doi: 10.1371/journal.pone.0029740

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Cadik M. Perceptual Evaluation of Color-To-Grayscale Image Conversions. Comput Graphics Forum (2008) 27(7):1745–54. doi: 10.1111/j.1467-8659.2008.01319.x

CrossRef Full Text | Google Scholar

11. Bhatia KS, Lam AC, Pang SW, Wang D, Ahuja AT. Feasibility Study of Texture Analysis Using Ultrasound Shear Wave Elastography to Predict Malignancy in Thyroid Nodules. Ultrasound Med Biol (2016) 42(7):1671–80. doi: 10.1016/j.ultrasmedbio.2016.01.013

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Zhang Q, Xiao Y, Suo J, Shi J, Yu J, Guo Y, et al. Sonoelastomics for Breast Tumor Classification: A Radiomics Approach With Clustering-Based Feature Selection on Sonoelastography. Ultrasound Med Biol (2017) 43(5):1058–69. doi: 10.1016/j.ultrasmedbio.2016.12.016

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Gatos I, Tsantis S, Spiliopoulos S, Karnabatidis D, Theotokas I, Zoumpoulis P, et al. A Machine-Learning Algorithm Toward Color Analysis for Chronic Liver Disease Classification, Employing Ultrasound Shear Wave Elastography. Ultrasound Med Biol (2017) 43(9):1797–810. doi: 10.1016/j.ultrasmedbio.2017.05.002

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Gatos I, Tsantis S, Spiliopoulos S, Karnabatidis D, Theotokas I, Zoumpoulis P, et al. A New Computer Aided Diagnosis System for Evaluation of Chronic Liver Disease With Ultrasound Shear Wave Elastography Imaging. Med Phys (2016) 43(3):1428–36. doi: 10.1118/1.4942383

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Ma Y, Feng W, Wu Z, Liu M, Zhang F, Liang Z, et al. Intra-Tumoural Heterogeneity Characterization Through Texture and Colour Analysis for Differentiation of non-Small Cell Lung Carcinoma Subtypes. Phys Med Biol (2018) 63(16):165018. doi: 10.1088/1361-6560/aad648

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Ashraf R, Ahmed M, Jabbar S, Khalid S, Ahmad A, Din S, et al. Content Based Image Retrieval by Using Color Descriptor and Discrete Wavelet Transform. J Med Syst (2018) 42(3):44. doi: 10.1007/s10916-017-0880-7

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Claudon M, Dietrich CF, Choi BI, Cosgrove DO, Kudo M, Nolsøe CP, et al. Guidelines and Good Clinical Practice Recommendations for Contrast Enhanced Ultrasound (CEUS) in the Liver–Update 2012: A WFUMB-EFSUMB Initiative in Cooperation With Representatives of AFSUMB, AIUM, ASUM, FLAUS and ICUS. Ultraschall Med (2013) 34(1):11–29. doi: 10.1055/s-0032-1325499

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Bamber J, Cosgrove D, Dietrich CF, Fromageau J, Bojunga J, Calliada F, et al. EFSUMB Guidelines and Recommendations on the Clinical Use of Ultrasound Elastography. Part 1: Basic Principles and Technology. Ultraschall Med (2013) 34(2):169–84. doi: 10.1055/s-0033-1335205

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Sauerbrei W, Royston P, Binder H. Selection of Important Variables and Determination of Functional Form for Continuous Predictors in Multivariable Model Building. Stat Med (2007) 26(30):5512–28. doi: 10.1002/sim.3148

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Geurts P, Ernst D, Wehenkel L. Extremely Randomized Trees. Mach Learn (2006) 63(1):3–42. doi: 10.1007/s10994-006-6226-1

CrossRef Full Text | Google Scholar

21. Marée R, Geurts P, Wehenkel L. Random Subwindows and Extremely Randomized Trees for Image Classification in Cell Biology. BMC Cell Biol (2007) 8 Suppl 1(Suppl 1):S2. doi: 10.1186/1471-2121-8-s1-s2

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Fotouhi S, Asadi S, Kattan MW. A Comprehensive Data Level Analysis for Cancer Diagnosis on Imbalanced Data. J BioMed Inform (2019) 90:103089. doi: 10.1016/j.jbi.2018.12.003

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Guy S, Sermon-Cadd AM, Shepherd FM, Kitchen S, Bowyer AE. A Cost-Effective Approach to Factor Assay Calibration Using a Truncated Live Calibration Curve. Int J Lab Hematol (2019) 41(5):679–83. doi: 10.1111/ijlh.13087

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Yao Z, Dong Y, Wu G, Zhang Q, Yang D, Yu JH, et al. Preoperative Diagnosis and Prediction of Hepatocellular Carcinoma: Radiomics Analysis Based on Multi-Modal Ultrasound Images. BMC Cancer (2018) 18(1):1089. doi: 10.1186/s12885-018-5003-4

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Park HS, Kim YJ, Yu MH, Jung SI, Jeon HJ. Shear Wave Elastography of Focal Liver Lesion: Intraobserver Reproducibility and Elasticity Characterization. Ultrasound Q (2015) 31(4):262–71. doi: 10.1097/ruq.0000000000000175

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Nakanishi K, Ohsaki Y, Kurihara M, Nakao S, Fujita Y, Takeyama K, et al. Color Auto-Fluorescence From Cancer Lesions: Improved Detection of Central Type Lung Cancer. Lung Cancer (2007) 58(2):214–9. doi: 10.1016/j.lungcan.2007.06.009

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Gatos I, Tsantis S, Spiliopoulos S, Karnabatidis D, Theotokas I, Zoumpoulis P, et al. Temporal Stability Assessment in Shear Wave Elasticity Images Validated by Deep Learning Neural Network for Chronic Liver Disease Fibrosis Stage Assessment. Med Phys (2019) 46(5):2298–309. doi: 10.1002/mp.13521

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Kagadis GC, Drazinos P, Gatos I, Tsantis S, Papadimitroulas P, Spiliopoulos S, et al. Deep Learning Networks on Chronic Liver Disease Assessment With Fine-Tuning of Shear Wave Elastography Image Sequences. Phys Med Biol (2020) 65(21):215027. doi: 10.1088/1361-6560/abae06

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: ultrasonography, elasticity imaging techniques, machine learning, radiomics, liver

Citation: Cheng M-Q, Xian M-F, Tian W-S, Li M-D, Hu H-T, Li W, Zhang J-C, Huang Y, Xie X-Y, Lu M-D, Kuang M, Wang W, Ruan S-M and Chen L-D (2021) RGB Three-Channel SWE-Based Ultrasomics Model: Improving the Efficiency in Differentiating Focal Liver Lesions. Front. Oncol. 11:704218. doi: 10.3389/fonc.2021.704218

Received: 02 May 2021; Accepted: 02 September 2021;
Published: 27 September 2021.

Edited by:

Yi Dong, Fudan University, China

Reviewed by:

Elias Gatos, University of Patras, Greece
Laura J. Brattain, Massachusetts Institute of Technology, United States

Copyright © 2021 Cheng, Xian, Tian, Li, Hu, Li, Zhang, Huang, Xie, Lu, Kuang, Wang, Ruan and Chen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Si-Min Ruan, ruansm@mail2.sysu.edu.cn; Li-Da Chen, chenlda@mail.sysu.edu.cn

These authors have contributed equally to this work and share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.