- 1Department of Ultrasound, Nanchong Central Hospital, The Second Clinical Medical College, North Sichuan Medical College (University), Nanchong, Sichuan, China
- 2Department of Medical Ultrasound, Sichuan Provincial People's Hospital, University of Electronic Science and Technology of China, Chengdu, China
- 3Chinese Academy of Sciences Sichuan Translational Medicine Research Hospital, Chengdu, China
Objective: This study aims to evaluate the predictive model based on deep learning (DL) and radiomics features from contrast-enhanced ultrasound (CEUS) to predict early recurrence (ER) in patients with hepatocellular carcinoma (HCC).
Methods: One hundred seventy-two patients with HCC who underwent hepatectomy and followed up for at least 1 year were included in this retrospective study. The data were divided according to the 7:3 ratios of training and test data. The ResNet-50 architecture, CEUS-based radiomics, and the combined model were used to predict the early recurrence of HCC after hepatectomy. The receiver operating characteristic (ROC) curve and calibration curve were drawn to evaluate its diagnostic efficiency.
Results: The CEUS-based radiomics ROCs of the “training set” and “test set” were 0.774 and 0.763, respectively. The DL model showed increased prognostic value, the ROCs of the “training set” and “test set” were 0.885 and 0.834, respectively. The combined model ROCs of the “training set” and “test set” were 0.943 and 0.882, respectively.
Conclusion: The deep learning radiomics model integrating DL and radiomics features from CEUS was used to predict ER and achieve satisfactory performance. Its diagnostic efficiency is significantly better than that of the single model.
Introduction
The most common primary liver cancer is hepatocellular carcinoma (HCC) (1). HCCs are the third most common cause of cancer-related death and ranked sixth in terms of incident cases (2). Owing to the wide prevalence of hepatitis B, China has high incidence and mortality rates. Its mortality rate is only second (3, 4) to lung cancer. Although technologies for the diagnosis and treatment of HCC are evolving, its 5-year recurrence rate is as high as 60%–80% (1, 4, 5). Hepatectomy is a common choice for treating HCC; the 5-year survival rate was <15% (6). Early recurrence (ER) was defined as the recurrence occurring after the first year during follow-up; it is considered to be an important factor affecting the survival rate of patients (7–9). In clinical practice, there is a need to assess the risk of ER in order to guide further monitoring and treatment (10).
Contrast-enhanced ultrasound (CEUS) has the advantages of high repeatability, non-invasiveness, no radiation, extremely low incidence of adverse reactions, and no hepatorenal toxicity, and can reflect the continuous dynamic perfusion of tumor in real time. It is often used to predict the pathological characteristics that are related to the risk of ER: size, microvascular invasion, and differentiation (11–14). In recent years, CEUS has been tried to predict the ER of HCC before operation (15, 16), but the effect is not satisfactory. Radiomics is an emerging research field aiming to use the full potential of medical images (17). It can be used for high-throughput extraction of quantitative features such as shape, gray, texture, and wavelet in medical images (18, 19). Although radiomics is widely used in the diagnosis and prognosis by computed tomography (CT) and magnetic resonance imaging (MRI) (20–22), deep learning has attracted extensive attention given its high performance in image recognition. In fact, it can effectively improve the diagnostic accuracy of medical image interpretation and the objectivity of diagnosis (23, 24). The combination of DL classification network and radiomics framework in the integrated system has become an emerging trend to achieve good performance in clinical tasks (25–27). However, there are no studies on CEUS-based deep learning radiomics analysis ER of HCC after hepatectomy. The purpose of this study was to explore the ability of CEUS-based DL to predict ER of HCC before operation.
Methods
This retrospective study was approved by the research ethics committee. Each patient signed written informed consent before the examination. We collected data from 172 patients with HCC who underwent complete resection. All 172 patients with HCC underwent CEUS within 1 week before hepatectomy. Age, sex, history of hepatitis B or C, and AFP (<20µg/L,200-400µg/L) were included in the study. The dataset was assigned randomly to the training cohort or test cohort at a ratio of 7:3. The flow chart is illustrated in Figure 1.
Follow-up
All patients were followed up, and abdominal US or CT scanning and AFP were performed every 3 months. A recurrence is considered when a recurrent lesion in or outside the liver is determined by imaging technology. The primary endpoint was tumor ER, which was defined as new intra- or extrahepatic tumors occurring within 1 year after surgery (9, 16). If recurrence occurred after the first year during follow-up, the endpoint of the study was considered to be ER. The definition of recurrence-free was 1-year period from the date of surgery to the date of first recurrence or metastasis.
Ultrasonic examination
The US research was performed in Philips IU22 and EQIC7 systems and GE LOGIQ E9. All patients participating in this study fasted for a minimum of 8 h before the CEUS examination. The patients were asked to breath calmly. First, the upper abdomen was examined using grayscale US to locate the mass to be studied, and then, 2.4 ml of SonoVue was injected through the elbow vein by 5–10 ml of 0.9% saline. CEUS examination used low mechanical index (MI<0.1). The target lesion was continuously observed, and at least 3 min of digital movie clips were stored on the hard disk. According to the guidelines, it was divided into the arterial phases (AP) (0–30 s) and portal phases (PP) (30–120 s) (28). We selected three images for analysis: the tumor with US, the tumor in the AP on CEUS, and the tumor in the PP on CEUS.
Extraction of CEUS radiomics features and construction of CEUS radiomics model
The maximum section image of the lesion was imported into Mazda 4.6 software. Two radiologists with more than 5 years of experience in CEUS depict a region of interest (ROI). The CEUS radiomics features were extracted from the ultrasonic image ROI of each patient by Mazda software. The corresponding texture parameters were histogram parameters (mean value, variance, kurtosis, skewness, percentile, etc.), grayscale symbiosis matrix (energy, contrast, autocorrelation, entropy, symbiosis sum, etc.), run test (length non-uniformity, long run weight, short run weight, and grayscale heterogeneity), autoregressive model, wavelet transform (wavelet transform system), number (energy), and absolute gradient (gradient mean, variance, skewness, and kurtosis). The inter- and intra-class correlation coefficients (ICCs) were employed to evaluate the consistency and repeatability of the results delineated. The ROI selections were performed by two readers. There was a good agreement of the feature extraction when the ICCs was >0.75. The ROI selections of the remaining images was performed by reader 1.
All cases in the training cohort were used to train the prediction model. All cases in the test cohort were used to evaluate the performance of the model independently. Finally, z-score was adopted to standardize the data. First, features with ICCs >0.75 were retained. Then, the U-test and the least absolute shrinkage and selection operator (LASSO) were used to filter the most useful features further. Finally, the CEUS radiomics model was developed using random forest. The selected radiomics features were linearly combined with their weighting coefficients to generate a radiomics score for each patient.
Deep learning model
The proposed CNN retained the ResNet-50 network structure, which pre-trained on Imagene and adapted it to fit US data. Before model training, image processing operations such as rotation, horizontal or vertical flipping, random clipping, and random channel shifting were applied for data augmentation to generate more training images. These operations resemble the diversity observed in the real-world data and prevent overfitting. All the images were resized to 224 × 224 pixels and normalized.
As a small dataset was available, we adopted transfer learning and fine-tuning. We also performed feature extraction using pretrained models to take advantage of features learned from models trained on large datasets in the same domain. We set the learning rate as 1e−5 and applied the logistic optimizer to update the network parameters with batch size 24. The maximum iteration step was set to 1,000, and the learning rate decayed by one-half at 2,000 and 4,000 steps. The output prediction results of the ResNet-50 network were used as the classification results, and the cross-entropy of the prediction results and the labels was calculated as the loss function. This was done by instantiating a pretrained model and adding a feature extraction FC layer. The last 1,000 nodes of the FC layer were replaced with a specifically designed one FC layer with transfer learning initialized weights. Then, the parameters of the pretrained model were frozen, and only the classifier weights were updated during training. Deep learning model learned the high throughput image features, which could make full use of all embedded information in US images. Convolution operations were used to extract the features associated with each image, and the classifier was trained to determine the image class according to extracted features. By supervised classification, the label of input images was used to fine-tune the network and update the parameters and finally led to the most relevant features in the FC layer.
Feature selection and development of three prediction models
The ICC method, U-test, and LASSO with 10-fold cross-testing method were used to select characteristic parameters. We performed this process separately using previously extracted radiomics features and DL features to construct a radiomics model and the DL model, respectively. The RF was used to construct the radiomics model, and the support vector machine (SVM) was used to construct the deep learning model. Next, we performed a further post-fusion process using the radiomics model (RF algorithm) and the deep learning model (SVM algorithm) to make them jointly construct a combined prediction model. The architecture of the proposed CNN is shown in Figure 2.
Figure 2 The flow chart of CEUS-based deep learning radiomics analysis for predicting ER of HCC is shown.
Statistical methods
The R3.3.2 (http://www.R-project.org) software and Python 3.7 (http://www.python.org) software were used to conduct data statistical modeling and analysis. Pearson chi-square test and Fisher’s exact test were also used. The p-values <0.05 were considered statistically significant. Statistically significant results obtained from univariate analysis will be submitted to multiple logistic regression. In this study, area under the curve (AUC), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of ResNet-50 model were used. Radiomics model and comprehensive model were calculated.
Results
The clinicopathological features in the training set and testing test are shown in Table 1. A total of 172 patients and 68 cases had ER. Except for two cases of recurrent lesions in the lung and one case of bone metastasis, the rest of the 65 case recurred in the liver. Among 172 patients, according to the 7:3 segmentation data of training and test data, there were 121 patients in the training group, including 48 cases of recurrence within 1 year, and there were 73 cases without ER, with 104 men and 17 women, aged 48.3 ± 13.2 years. There were 51 cases in the training set, of which 20 cases recurred within 1 year and 31 cases had no ER; there were 43 men and 8 women, aged 52.9 ± 13.1 years.
Feature extraction and screening, and CEUS-based radiomics model development
A total of 918 CEUS radiomics features were extracted from each patient’s ultrasound image ROIs using the Mazda software package. Mann–Whitney U-test (non-normal variables) was performed on the omics features, and 543 features were eliminated (p>0.05). A highly collinear relationship existed between omics features. Before modeling, Pearson or Spearman correlation analysis was conducted on the remaining 375 image features. If the correlation of the two variables was more than 0.6, the variable with an overall higher correlation was excluded, and 14 features were eliminated. After LASSO regression analysis, 11 meaningful radiomics features were finally obtained (Figure 3A). The CEUS radiomics score was created according to the following formula: CEUS radiomics score= −0.111× US_Teta2-0.014× DP_Perc.01.-.009× AP_Perc.50.+0.006×PP_S.1.0.Correlat0.038×US_S.1.0.Correlat+0.055×AP_GrSkewness0.137×US_WavEnHL_s.5+0.151×AP_S.1.0.Correlat0.183×PP_WavEnHL_s.6+0.194×US_Mean0.325×US_135dr_GlevNonU.
Figure 3 Characteristics selected the radiomics and DL model. (A) 11 features and its coefficients for the radiomics model. (B) 16 features and its coefficients for the DL model.
A total of 7,144 deep learning features were extracted from each patient’s ultrasound images (from three type of US images) by the ResNet-50 network. The same feature selection steps were performed to select the most significant features. Finally, 16 deep features were retained to construct the further model (Figure 3B). The combined model was constructed based on 11 radiomics features and 16 depth features.
Diagnostic efficacy of three models in ER
The ROC curve for predicting the ER of HCC by CEUS radiomics was drawn; the AUCs of the training and testing samples were 0.774 and 0.763 (Figure 4), respectively. The accuracy, sensitivity, and specificity of the CEUS-based radiomics score in predicting ER of HCC were 0.727, 0.667, and 0.767, respectively, in the training cohort and 0.686, 0.600, and 0.742, respectively, in the testing cohort. In the CEUS-based DL model, the AUC in the training and testing cohorts were 0.885 and 0.834, respectively. The accuracy, sensitivity, and specificity of the CEUS-based DL in predicting ER of HCC were 0.785, 0.896, and 0.712, respectively, in the training samples and 0.686, 0.800, and 0.613, respectively, in the testing samples; stacking model based on the radiomics model and the deep learning model, the AUCs in the training and testing cohorts were 0.942 and 0.889, respectively. The accuracy, sensitivity, and specificity of the CEUS-based DL radiomics model in predicting ER of HCC were 0.868, 1.000, and 0.781, respectively, in the training cohort and 0.784, 0.900, and 0.710, respectively, in the testing cohort (Table 2). The decision curve analysis showed that the combined model predicts a good overall net income of ER (Figure 5).
Figure 4 The ROC of radiomics model, DL model and combined model in training cohort and testing cohort. (A) AUC of combined models in training cohorts (AUC of 0.911) was significantly higher than that of the radiomics model (AUC of 0.740) and DL model (AUC of 0.887). (B) AUC of combined models in testing cohorts (AUC of 0.840) was significantly higher than that of the radiomics model (AUC of 0.780) and DL model (AUC of 0.813).
Figure 5 The decision curve analysis for the combined model. (A) The decision curve analysis in the training cohort. (B) The decision curve analysis in the testing cohort.
Discussion
Hepatectomy is the most effective treatment for HCC; ER within 1 year is now recognized as a critical determinant for a poor prognosis (29, 30). In this study, we evaluated the applicability of radiomics model based on CEUS and CEUS DL for the ER of HCC. A CUES-based DL radiomics using 11 features from radiomics and 16 features from DL analysis exhibited satisfactory performance; the predictive AUCs on ER of HCC of the training and testing samples were 0.942 and 0.889, respectively. Simultaneously, the combination of radiomics and DL to establish the model demonstrates a better effect than a single model. The CEUS DL is easy to use and can promote personalized risk stratification and further treatment decision-making in patients with HCC.
The ER of HCC may be due to micrometastasis and invasive tumor biological behavior (31). SonoVue is a blood pool contrast agent, which possibly reflects the microvessel composition of HCC. Previous studies have demonstrated that the CEUS characteristics can effectively predict the MVI and differentiation of HCC (13, 32, 33); these results suggest that the characteristics of CEUS are closely related to the ER. Qin’s research found that washout is a predictor of ER of HCC (16). The risk of ER increases with the flushing speed. Washout represents a more invasive vascular composition to a certain extent. Hai bin Tu also believes that Li-Rads can effectively predict the ER of HCC (15). However, the classification is subjective and depends on the experience of the radiologist. Radiomics transforms medical images into high-throughput features to quantitatively evaluate tumor phenotypes (18). This technology can extract quantitative image features using a computer algorithm to detect high-dimensional image features. Therefore, imageomics is objective compared with the conventional image interpretation of radiologists. The former can thoroughly analyze the whole tumor and obtain equivalent or more information than that obtained using conventional radiology (34). Imaging features reflect the texture information of the tumor and are important signs of intratumor heterogeneity. Intratumoral heterogeneity may result from genomic heterogeneity, associated with poor prognosis (32). Our study extracted the radiomics features of lesions from CEUS images. The radiomics score is based on 11 selected radiomics features, further indicating the tumor texture characteristics. Our results demonstrate that the CEUS-based radiomics score can effectively predict the ER of HCC. ResNet-50 has been used in feature extraction with high stability and performance for medical image classification (35). ResNet-50 can detect and classify lesions by setting an anchor and a bounding box without separating the foreground from the background. Moreover, it can extract features directly from the lesion area and then combine multiple features to classify lesions (36). Furthermore, integrating DL and radiomics algorithms can achieve higher diagnostic efficiency than a single method, and its benefits have been reflected in different clinical applications (26, 37). By integrating ResNet50 and radiomics models, we have improved our diagnostic ability, with an AUC of 0.889, which is higher than that of a single model.
Additionally, the combined model demonstrates satisfactory distinction, which provides an easy-to-use, visual, and personalized tool for ER prediction, assisting the doctors in the early prediction of the ER of HCC and performing corresponding measures, which is highly significant for the effective treatment of patients.
Our retrospective study has some limitations. First, radiomics features are based on the CEUS images in the two phases, and some information may have been omitted. Second is due to the small sample size, which may lead to overfitting and low repeatability of the prediction results. Third, as ultrasonic examination primarily depends on the experience of operators, the difference in operators may lead to the difference in graphic quality.
In conclusion, we developed a DL radiomics model based on CEUS to predict ER and achieve satisfactory performance. Its diagnostic efficiency is significantly better than that of the radiomics model. The DL radiomics model can be used by clinicians to judge the risk of ER and more effectively manage patients after surgery.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Ethics statement
This study was reviewed and approved by The Second Clinical Medical College, North Sichuan Medical College (University). The patients/participants provided their written informed consent to participate in this study.
Author contributions
HZ and FH designed, coded, and tested the software tools and performed the analyses. HZ and FH provided the data and validated as expert the results. HZ and FH wrote the manuscript. All authors contributed to the article and approved the submitted version.
Funding
Disclosure of grants of other funding Sichuan Provincial Administration of Traditional Chinese Medicine (2018QN33).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fonc.2022.930458/full#supplementary-material
References
1. Forner A, Reig M, Bruix J. Hepatocellular carcinoma. Lancet (2018) 391:1301–14. doi: 10.1016/S0140-6736(18)30010-2
2. Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A, et al. Global cancer statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin (2021) 71:209–49. doi: 10.3322/caac.21660
3. Grandhi MS, Kim AK, Ronnekleiv-Kelly SM, Kamel IR, Ghasebeh MA, Pawlik TM. Hepatocellular carcinoma: From diagnosis to treatment. Surg Oncol (2016) 25:74–85. doi: 10.1016/j.suronc.2016.03.002
4. Chen W, Zheng R, Baade PD, Zhang S, Zeng H, Bray F, et al. Cancer statistics in China, 2015. CA Cancer J Clin (2016) 66:115–32. doi: 10.3322/caac.21338
5. Tabrizian P, Jibara G, Shrager B, Schwartz M, Roayaie S. Recurrence of hepatocellular cancer after resection: patterns, treatments, and prognosis. Ann Surg (2015) 261:947–55. doi: 10.1097/SLA.0000000000000710
6. Peery AF, Dellon ES, Lund J, Crockett SD, McGowan CE, Bulsiewicz WJ, et al. Burden of gastrointestinal disease in the united states: 2012 update. Gastroenterology (2012) 143:1179–87.e1173. doi: 10.1053/j.gastro.2012.08.002
7. Ning P, Gao F, Hai J, Wu M, Chen J, Zhu S, et al. Application of CT radiomics in prediction of early recurrence in hepatocellular carcinoma. Abdom Radiol (NY) (2020) 45:64–72. doi: 10.1007/s00261-019-02198-7
8. Shah SA, Greig PD, Gallinger S, Cattral MS, Dixon E, Kim RD, et al. Factors associated with early recurrence after resection for hepatocellular carcinoma and outcomes. J Am Coll Surg (2006) 202:275–83. doi: 10.1016/j.jamcollsurg.2005.10.005
9. Wu C, Yu S, Zhang Y, Zhu L, Chen S, Liu Y. CT-based radiomics nomogram improves risk stratification and prediction of early recurrence in hepatocellular carcinoma after partial hepatectomy. Front Oncol (2022) 12:a. doi: 10.3389/fonc.2022.896002
10. Poon RT, Fan ST, Ng IO, Lo CM, Liu CL, Wong J. Different risk factors and prognosis for early and late intrahepatic recurrence after resection of hepatocellular carcinoma. Cancer (2000) 89:500–7. doi: 10.1002/1097-0142(20000801)89:3<500::AID-CNCR4>3.0.CO;2-O
11. Zhou H, Sun J, Jiang T, Wu J, Li Q, Zhang C, et al. A nomogram based on combining clinical features and contrast enhanced ultrasound LI-RADS improves prediction of microvascular invasion in hepatocellular carcinoma. Front Oncol (2021) 11:699290. doi: 10.3389/fonc.2021.699290
12. Wang P, Nie F, Dong T, Wang G, Wang L, Fan X. Study on correlation between two-dimensional ultrasound, contrast-enhanced ultrasound and microvascular invasion in hepatocellular carcinoma. Clin Hemorheol Microcirc (2022) 80:97–106. doi: 10.3233/CH-211190
13. Fan PL, Ding H, Mao F, Chen LL, Dong Y, Wang WP. Enhancement patterns of small hepatocellular carcinoma (≤ 30 mm) on contrast-enhanced ultrasound: Correlation with clinicopathologic characteristics. Eur J Radiol (2020) 132:109341. doi: 10.1016/j.ejrad.2020.109341
14. Saito A, Yamamoto M, Katagiri S, Yamashita S, Nakano M, Morizane T. Early hemodynamics of hepatocellular carcinoma using contrast-enhanced ultrasound with sonazoid: Focus on the pure arterial and early portal phases. Glob Health Med (2020) 2:319–27. doi: 10.35772/ghm.2020.01092
15. Tu HB, Chen LH, Huang YJ, Feng SY, Lin JL, Zeng YY. Novel model combining contrast-enhanced ultrasound with serology predicts hepatocellular carcinoma recurrence after hepatectomy. World J Clin cases (2021) 9:7009–21. doi: 10.12998/wjcc.v9.i24.7009
16. Xiachuan Q, Xiang Z, Xuebing L, Yan L. Predictive value of contrast-enhanced ultrasound for early recurrence of single lesion hepatocellular carcinoma after curative resection. Ultrason Imaging (2019) 41:49–58. doi: 10.1177/0161734618815231
17. Parmar C, Leijenaar RT, Grossmann P, Rios Velazquez E, Bussink J, Rietveld D, et al. Radiomic feature clusters and prognostic signatures specific for lung and head & neck cancer. Sci Rep (2015) 5:11044. doi: 10.1038/srep11044
18. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: Extracting more information from medical images using advanced feature analysis. Eur J Cancer (2012) 48:441–6. doi: 10.1016/j.ejca.2011.11.036
19. Huang YQ, Liang CH, He L, Tian J, Liang CS, Chen X, et al. Development and validation of a radiomics nomogram for preoperative prediction of lymph node metastasis in colorectal cancer. J Clin Oncol (2016) 34:2157–64. doi: 10.1200/JCO.2015.65.9128
20. Wu M, Tan H, Gao F, Hai J, Ning P, Chen J, et al. Predicting the grade of hepatocellular carcinoma based on non-contrast-enhanced MRI radiomics signature. Eur Radiol (2019) 29:2802–11. doi: 10.1007/s00330-018-5787-2
21. Zhao Y, Wu J, Zhang Q, Hua Z, Qi W, Wang N, et al. Radiomics analysis based on multiparametric MRI for predicting early recurrence in hepatocellular carcinoma after partial hepatectomy. J Magn Reson Imaging (2021) 53:1066–79. doi: 10.1002/jmri.27424
22. Fontaine P, Riet FG, Castelli J, Gnep K, Depeursinge A, Crevoisier R, et al. Comparison of feature selection in radiomics for the prediction of overall survival after radiotherapy for hepatocellular carcinoma. Annu Int Conf IEEE Eng Med Biol Soc (2020) 2020:1667–70. doi: 10.1109/EMBC44109.2020.9176724
23. Shen YT, Chen L, Yue WW, Xu HX. Artificial intelligence in ultrasound. Eur J Radiol (2021) 139:109717. doi: 10.1016/j.ejrad.2021.109717
24. Zhang N, Li XT, Ma L, Fan ZQ, Sun YS. Application of deep learning to establish a diagnostic model of breast lesions using two-dimensional grayscale ultrasound imaging. Clin Imaging (2021) 79:56–63. doi: 10.1016/j.clinimag.2021.03.024
25. Gao W, Wang W, Song D, Yang C, Zhu K, Zeng M, et al. A predictive model integrating deep and radiomics features based on gadobenate dimeglumine-enhanced MRI for postoperative early recurrence of hepatocellular carcinoma. Radiol Med (2022) 127:259–71. doi: 10.1007/s11547-021-01445-6
26. Zheng X, Yao Z, Huang Y, Yu Y, Wang Y, Liu Y, et al. Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer. Nat Commun (2020) 11:1236. doi: 10.1038/s41467-020-15027-z
27. Wang J, Jiang J, Zhang D, Zhang YZ, Guo L, Jiang Y, et al. An integrated AI model to improve diagnostic accuracy of ultrasound and output known risk features in suspicious thyroid nodules. Eur Radiol (2022) 32:2120–9. doi: 10.1007/s00330-021-08298-7
28. Kono Y, Lyshchik A, Cosgrove D, Dietrich CF, Jang HJ, Kim TK, et al. Contrast enhanced ultrasound (CEUS) liver imaging reporting and data system (LI-RADS®): The official version by the American college of radiology (ACR). Ultraschall Med (2017) 38:85–6. doi: 10.1055/s-0042-124369
29. Shimagaki T, Yoshizumi T, Itoh S, Iseda N, Tomiyama T, Morinaga A, et al. The ratio of serum des-gamma-carboxy prothrombin to tumor volume as a new biomarker for early recurrence of resected hepatocellular carcinoma. Hepatol Res (2022) 52:381–9. doi: 10.1111/hepr.13750
30. Kobayashi T, Aikata H, Kobayashi T, Ohdan H, Arihiro K, Chayama K. Patients with early recurrence of hepatocellular carcinoma have poor prognosis. Hepatobiliary Pancreat Dis Int (2017) 16:279–88. doi: 10.1016/S1499-3872(16)60181-9
31. Li WF, Yen YH, Liu YW, Wang CC, Yong CC, Lin CC, et al. Preoperative predictors of early recurrence after resection for hepatocellular carcinoma. Am J Surg (2021) 223(5):945–50. doi:10.1016/j.amjsurg.2021.08.012
32. Hu HT, Wang Z, Huang XW, Chen SL, Zheng X, Ruan SM, et al. Ultrasound-based radiomics score: A potential biomarker for the prediction of microvascular invasion in hepatocellular carcinoma. Eur Radiol (2019) 29:2890–901. doi: 10.1007/s00330-018-5797-0
33. Zhu W, Qing X, Yan F, Luo Y, Li Y, Zhou X. Can the contrast-enhanced ultrasound washout rate be used to predict microvascular invasion in hepatocellular carcinoma? Ultrasound Med Biol (2017) 43:1571–80. doi: 10.1016/j.ultrasmedbio.2017.04.003
34. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature (2017) 542:115–8. doi: 10.1038/nature21056
35. Xie Y, Xia Y, Zhang J, Song Y, Feng D, Fulham M, et al. Knowledge-based collaborative deep learning for benign-malignant lung nodule classification on chest CT. IEEE Trans Med Imaging (2019) 38:991–1004. doi: 10.1109/TMI.2018.2876510
36. He XZ K, Ren S, Sun J. (2016). Deep residual learning for image recognition, in: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), . pp. 770–8.
Keywords: contrast-enhanced ultrasound, radiomics, AFP, hepatocellular carcinoma, early recurrence, deep learning
Citation: Zhang H and Huo F (2022) Prediction of early recurrence of HCC after hepatectomy by contrast-enhanced ultrasound-based deep learning radiomics. Front. Oncol. 12:930458. doi: 10.3389/fonc.2022.930458
Received: 28 April 2022; Accepted: 07 September 2022;
Published: 28 September 2022.
Edited by:
Po-Hsiang Tsui, Chang Gung University, TaiwanReviewed by:
Matteo Donadon, Università degli Studi del Piemonte Orientale, ItalyShugo Mizuno, Mie University, Japan
Weibin Wang, Ritsumeikan University, Japan
Copyright © 2022 Zhang and Huo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Fanding Huo, MTk1Njc1NzIxNEBxcS5jb20=