Skip to main content

ORIGINAL RESEARCH article

Front. Oncol., 07 December 2022
Sec. Breast Cancer
This article is part of the Research Topic AI Applications for Diagnosis of Breast Cancer View all 22 articles

Preoperative prediction of lymphovascular invasion in patients with T1 breast invasive ductal carcinoma based on radiomics nomogram using grayscale ultrasound

  • 1Department of Radiology, China-Japan Union Hospital of Jilin University, Changchun, China
  • 2Department of Ultrasound, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
  • 3Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China

Purpose: The aim of this study was to develop a radiomics nomogram based on grayscale ultrasound (US) for preoperatively predicting Lymphovascular invasion (LVI) in patients with pathologically confirmed T1 (pT1) breast invasive ductal carcinoma (IDC).

Methods: One hundred and ninety-two patients with pT1 IDC between September 2020 and August 2022 were analyzed retrospectively. Study population was randomly divided in a 7: 3 ratio into a training dataset of 134 patients (37 patients with LVI-positive) and a validation dataset of 58 patients (19 patients with LVI-positive). Clinical information and conventional US (CUS) features (called clinic_CUS features) were recorded and evaluated to predict LVI. In the training dataset, independent predictors of clinic_CUS features were obtained by univariate and multivariate logistic regression analyses and incorporated into a clinic_CUS prediction model. In addition, radiomics features were extracted from the grayscale US images, and the radiomics score (Radscore) was constructed after radiomics feature selection. Subsequent multivariate logistic regression analysis was also performed for Radscore and the independent predictors of clinic_CUS features, and a radiomics nomogram was developed. The performance of the nomogram model was evaluated via its discrimination, calibration, and clinical usefulness.

Results: The US reported axillary lymph node metastasis (LNM) (US_LNM) status and tumor margin were determined as independent risk factors, which were combined for the construction of clinic_CUS prediction model for LVI in pT1 IDC. Moreover, tumor margin, US_LNM status and Radscore were independent predictors, incorporated as the radiomics nomogram model, which achieved a superior discrimination to the clinic_CUS model in the training dataset (AUC: 0.849 vs. 0.747; P < 0.001) and validation dataset (AUC: 0.854 vs. 0.713; P = 0.001). Calibration curve for the radiomic nomogram showed good concordance between predicted and actual probability. Furthermore, decision curve analysis (DCA) confirmed that the radiomics nomogram had higher clinical net benefit than the clinic_CUS model.

Conclusion: The US-based radiomics nomogram, incorporating tumor margin, US_LNM status and Radscore, showed a satisfactory preoperative prediction of LVI in pT1 IDC patients.

1. Introduction

Lymphovascular invasion (LVI) refers to the presence of tumor cells in the lymphatic or vascular system surrounding invasive breast cancer (1, 2). LVI is positively associated with increased risk of axillary lymph node (ALN), distant metastasis, less responsive to chemotherapy, and locoregional recurrence (1, 3). Therefore, LVI has been considered as a major criteria for tumor staging, prognostic prediction, and the treatment choice (3, 4). Treatment decisions for T1 breast cancer usually need refer to the presence or absence of lymph node metastasis (5), which is often associated with LVI (1, 59). LVI had been proved as an independent prognostic factor in T1 breast cancer (9, 10), and patients with LVI may require more clinical decisions, including surgical type, the margin determination of surgery, and guiding more aggressive neoadjuvant treatment protocols for breast cancer patients (9, 11).

Currently, the presence of LVI is determined by postoperative pathology based on the primary tumor and peritumoral breast tissue (12, 13). However, several factors, such as partial sampling of tumors in preoperative biopsies, contractility of materials, and mechanical force-induced cell displacement, may complicate the postoperative assessment of LVI and lead to misdiagnosis (3, 14). Furthermore, preoperative neoadjuvant chemotherapy for breast cancer patients also makes it difficult to accurately evaluate LVI on the basis of postoperative specimens (3, 14).

Although preoperative biopsy can provide information about the histological type and immunohistochemistry of the tumor, biopsy is invasive and difficult to confirm LVI due to the small size of the tissue to be cut (12, 13). Therefore, it is necessary to find a simple, accurate and non-invasive method for preoperative prediction of tumor LVI, which would be of great significance for clinical decision-making in breast cancer (12).

Previous studies have demonstrated that preoperative breast mammography, digital breast tomosynthesis (DBT) or MRI can be effectively used for the prediction of LVI (1, 3, 6, 7, 15). Different from other imaging methods, US has the advantages of relatively low price, real-time, and reproducible operation, and is a reliable examination method for breast tumors in clinical work (16). Some CUS features had been demonstrated as the independent variables for predicting the presence of LVI in invasive breast cancer (8). Moreover, multiparametric ultrasound, especially contrast-enhanced ultrasound (CEUS), could also provide good discriminative value for predicting LVI (12). However, the cost of additional contrast-enhancement is higher and the examination time is longer (16). Additionally, the assessment of CUS features and the quantitative indicators of CEUS may be susceptible to subjective factors (12, 16).

Radiomics is a relatively new machine learning approach that provides high-throughput quantitative information on tumor shape, intensity, and texture (3, 6), which fail to be detected by naked eyes (17). Advances in radiomics-based US have increasingly highlighted its potential value for improving diagnosis, evaluating prognosis, and predicting response to treatment in breast carcinoma (1821). As a tool to determine the appropriate treatment for patients, nomogram was developed based on comprehensive data to allow the clinician to assess the associated clinical risk more accurately (18, 22). The nomogram incorporating US radiomics score had showed potential diagnostic capabilities for triple-negative breast cancer and fibroadenoma (18). On the other hand, nomogram based on US radiomics analysis exhibited high accuracy in predicting axillary lymph node (ALN) tumor burden in breast cancer patients (21). To date, few studies about US-based radiomocs nomogram have addressed the prediction of LVI in breast cancer.

At present, due to the improvement of people’s health consciousness and the increase of breast cancer screening, the diagnosis rate of T1 breast cancer has increased (16, 23), in which the most common histological type is invasive ductal carcinoma (IDC) (16). Thus, the purpose of our study was to investigate whether a nomogram based on radiomics analysis of US imaging could predict the status of LVI in patients with pathologically confirmed T1 (pT1) IDC.

2. Methods

2.1. Patients

This retrospective study was approved by the ethics committee of the Hubei Cancer Hospital (No.: LLHBCH2021YN-001), and the requirement to obtain informed consent was waived. 643 female patients with 771 breast carcinomas at the Hubei Cancer Hospital (Wuhan, People’s Republic of China) between September 2020 and August 2022 were consecutive included in this study.

All patients underwent ultrasonic examination within 1 month before operation and were satisfied as the following inclusion criteria (1): breast carcinoma pathologically confirmed by the specimens obtained from surgical resection; (2) no biopsy or medical treatment before US examinations; (3) lesions with complete histopathological, immunohistochemical and US data. The exclusion criteria were as follows: (1) patients with distant metastases or a history of other malignancies (n = 35); (2) patients with bilateral breast tumors or ipsilateral multifocal tumors of the breast (n = 79); (3) patients with other histologic types or other stages of breast cancer (n = 326) (4) poor quality images (n = 11).

Finally, 192 patients (mean age, 54.38 ± 11.27 years; range, 26 ~ 86 years) with 192 pT1 IDCs were eligible in our study, which were split into training and validation datasets with a 7:3 ratio by random sampling. The training and validation datasets included 134 patients and 58 patients, respectively. Figure 1A provides a flowchart of the patient selection process.

FIGURE 1
www.frontiersin.org

Figure 1 Flowchart of this study. (A) The patient selection process. (B) The workflow to construct and validate the radiomics nomogram.

2.2. US examination

All patients underwent US examination using EPIQ5 (Philips Ultrasound, Inc., Bothell, Washington, USA; L12-5 linear-array transducer probe, 5 ~ 12 MHz), Aixplorer ultrasound scanner (SuperSonic Imagine, France; SL15-4 linear-array transducer probe, 4 ~ 15 MHz), and Resona 7, Resona 8, Resona R9, Resona I9, and DC-65 (Mindray, Shenzhen, China; L14-5, L14-3, and L13-3 linear-array transducer probes, 3 ~ 14 MHz). The image settings for each examination, including time gain compensation, focus position and dynamic range, were optimized according to the manufacturer’s recommendations.

After physical examination, the whole breast was systematically examined. All cases were evaluated in the supine position, with the upper arm abducted and the bilateral breast fully exposed at the same time. The characteristics of sonogram were observed by routine ultrasonic scanning. The US images were obtained in both longitudinal and transverse sections.

2.3. Clinical information and US conventional features

The clinical information, including serum CA153, CA125, and carcinoembryonic antigen (CEA) levels, and body mass index (BMI), were acquired by reviewing the medical records. BMI was calculated by dividing the patient’s weight (kg) by the square of the height (m2), with a cutoff value of 24 kg/m2 for classification (24).

All US images were reviewed and analyzed by two experienced radiologists (both with more than 5 years of breast image diagnosis experience). The two radiologists were blinded to the patient’s clinicopathological information. The clearest and most complete US images were obtained in DICOM format. The following conventional ultrasound (CUS) features of breast tumors were recorded in concordance with prior studies (12, 18): (1) tumor location: upper outer quadrant, upper inner quadrant, lower outer quadrant, lower inner quadrant or other positions; (2) tumor size: maximum diameter; (3) tumor shape: regular (round or oval) or irregular; (4) tumor margin: circumscribed or not circumscribed (indistinct, angular, microlobulated, or spiculated); (5) tumor orientation: parallel or not parallel; (6) tumor echo pattern: hypoechoic, isoechoic, hyperechoic or heterogeneous; (7) microcalcifications: present or absent; (8) tumor posterior features: no posterior acoustic features, enhancement, shadowing or combined pattern. In addition, suspicious CUS features of axillary lymph node metastasis (LNM) were also evaluated, including rounded hypoechoic node complete or partial effacement of the fatty hilum, the ratio of long axis diameter to short axis diameter < 2, cortical thickening > 3 mm, nonhilar cortical blood flow on color Doppler images, complete or partial replacement of the node with an ill-defined or irregular mass and microcalcifications in the node (25). With one or more of the above-mentioned suspicious features, the US reported LNM (US_LNM) status was recorded as present; otherwise, it was recorded as absent. Differences in interpretation of breast tumor features or US_LNM status between the two radiologists were determined by another radiologist with more than 10 years of experience in breast imaging diagnosis.

2.4. Histopathological analysis

In all 192 cases, specimens of breast cancer were surgically resected and the diagnosis were histopathologically confirmed. Nottingham combined histological grading system was used to determine the histological grade (26). The expression levels of estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor 2 (HER-2), and Ki-67 antigen were measured through Immunohistochemical (IHC) analyses (16, 26). ≤1% of carcinoma nuclei with positive staining indicated that ER and PR were negative (16, 24, 26). The IHC score was - or 1 +, indicating that HER-2 was negative, while 3+ indicating the positive expression of HER-2. IHC score was 2 +, and fluorescence in situ hybridization (FISH) was negative, which also showed that HER-2 was negative (16, 26). The Ki-67 proliferation index was determined according to immunohistochemical analysis. An index of <14% was considered as low proliferation, while ≥14% is considered as high proliferation (12). According to previous study (27), patients were classified into the following four breast cancer subtypes: luminal A, luminal B, HER-2-positive, and triple-negative. LVI was defined as the presence of tumor cells within the lymphatic or vascular channels at the peritumoral region (6, 7), which was also identified by examining the primary tumor stained with endothelial-specific markers, including anti-CD34 and anti-D2-40 antibodies (6). The status of tumor LVI was defined as LVI-positive and LVI-negative.

2.5. Lesion segmentation and feature extraction in radiomics model

The ROI (region of interest) was manually delineated along the edge of the maximum diameter area for each tumor on grayscale US image. The work of Lesion segmentation was accomplished by Two radiologists (radiologist 1 and radiologist 2, both with more than 5 years of breast image diagnosis experience), who were blinded to the clinicopathological data.

Radiologist 1 drew all the ROIs by using 3D Slicer (version 4.11; http://www.slicer.org). To assess inter-observer reliability, radiologist 2 drew the ROIs in 40 randomly selected tumors. Additionally, to evaluate intra-observer reliability, Radiologist 1 then repeated the same procedure for second ROIs depiction from the 40 randomly selected images with an interval of 2 weeks period. Intraclass correlation coefficient (ICC) was then calculated to evaluate intra and inter-observer agreement for feature extraction. The intra and inter-observer ICC > 0.75 indicated good reproducibility of feature extraction.

Before feature extraction, image resampling and grayscale discretization were performed on the grayscale US image to achieve normalization (2830): firstly, the images were resampled by B-spline interpolation to a pixel size of 1 mm × 1 mm; secondly, the gray-level discretization was performed in the histogram with a fixed bin width of 25. Then, each patient yielded 939 radiomics features as follows (1): two-dimensional (2D) shape-based features (n=9); (2) first-order features (n=18); (3) gray level co-occurrence matrix (GLCM) features (n=24); (4) gray-level dependence matrix (GLDM) features (n=14); (5) gray-level run length matrix (GLRLM) features (n=16); (6) gray-level size zone matrix (GLSZM) features (n=16); (7) neighboring gray tone difference matrix (NGTDM) features (n=5) and (8) transform-filtered features (including wavelet, square, square root, logarithm, exponential, gradient) (n= 837). (1) ~ (7) were the radiomics features from original images (Table 1), while (8) were were the radiomics features from derived images which were obtained by applying filters to the original image. The feature extraction was implemented by the open-source Pyradiomics package (version 3.0.1; https://pyradiomics.readthedocs.io/en/v3.0.1/)

TABLE 1
www.frontiersin.org

Table 1 Original radiomics features extracted in current study.

2.6. Feature selection, Radscore establishment, and nomogram construction

2.6.1. Feature selection and Radscore establishment

Because of the poor reproducibility, the radiomics features with intra-ICC or inter-ICC ≤ 0.75 were initially excluded (31). Then, a training/validation dataset division (7:3) and features Z-score normalization were performed. Z-score normalization was used to convert different data to the same order of magnitude, so as to reduce the impact of different protocols and different operators on the US images, and to ensure that radiomics features were comparable (3234). The calculation formula of Z-score normalization was as follows (33): y = (x − µ)/σ. where µ is the mean and σ is the standard deviation.

After data preprocessing, two-sample t-test or Mann-Whitney U test was used to screen radiomic features with statistically significant differences (P < 0.05) in order to eliminate irrelevant features in the training dataset. Then, the Spearman rank sum test was used for correlation analysis to eliminate the redundancy. Among the features with correlation coefficient > 0.9, only one was retained and the rest was excluded. Finally, the least absolute shrinkage and selection operator (LASSO) was performed, with penalty parameter tuning conducted by 5-fold cross-validation, to obtain the optimal regularization coefficient (lambda, also namely λ). Selected features with non-zero coefficients were analyzed with a linear regression model and weighted by their respective coefficients to construct a radiomics signature, called Radscore.

2.6.2. Nomogram construction and model validation

In this study, 192 patients were randomly split into a training dataset (n = 134) and a validation dataset (n = 58). Univariate analyses were performed for the baseline patient characteristics, including clinic_CUS features and Radscore. Chi-square test or Fisher’s exact test was applied for categorical variables for training and validation datasets, while two-sample t-test or Mann-Whitney U test was used for continuous variables.

Univariable logistic regression analysis was performed to evaluate clinical information and CUS features (called clinic_CUS features), and to determine the potential predictor for LVI status in training dataset. And variables with P < 0.05 were subjected to subsequent multivariable logistic regression analysis, with a backward stepwise elimination method using the Akaike information criterion (AIC). The clinic_CUS features with P < 0.05 were confirmed as the final independent predictors to construct the clinic_CUS prediction model for LVI status. Then the Radscore and independent clinic_CUS features were combined, through multivariable logistic regression, to establish a radiomics nomogram prediction model. The variance inflation factor (VIF) was applied to estimate the collinearity diagnosis.

The potential predictive value of the established model was performed by receiver operating characteristic (ROC) curve analysis. The DeLong test was applied to compare differences between the areas under the curve (AUC). The goodness-of-fit of the radiomics nomogram was evaluated by Hosmer-Lemeshow test. We bootstrapped the data 1000 times to perform internal verification, drawing a calibration curve to verify the consistency between actual probability and the predicted probability. Decision curve analysis (DCA) was developed to ascertain the clinical utility of the radiomics nomogram by quantifying the net benefits at different threshold probabilities in the training and validation datasets (18). All procedures of building and validating radiomics nomogram model were shown in Figure 1B.

2.7. Statistical analysis

All statistical analyses were performed with R software (version4.1.3, http://www.Rproject.org) and SPSS software (version 26.0; Chicago, IL). Quantitative variables were expressed as mean ± standard deviation or medians (25% quantile, 75% quantile). Kolmogorov-Smirnov test and bartlett.test were used to evaluate the normality and homovariance of quantitative variables, so as to determine whether to use independent samples t-test or Mann Whitney U-test. Categorical data was analysed by chi-square test, or Fisher’s test. Intraclass correlation coefficient (ICC) was calculated to evaluate the agreement between intra- and inter-readers in the ROI delineation for radiomics feature extraction. Univariate and multivariate logistic regression were respectively used to select the significant predictors for building prediction models. The diagnostic performance to differentiate LVI status was performed by the area under the receiver operating curve (AUC) and the corresponding sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy. According to the AUC value, the diagnostic performance can be considered as high (AUC > 0.9), moderate (AUC = 0.7 ~ 0.9), or low (AUC = 0.5 ~ 0.7). Delong tests were performed to assess the differences in AUC values between different radiomics models. Hosmer-Lemeshow test was used to evaluate the goodness-of-fit of the radiomics nomogram. The calibration curve was applied to evaluate the consistency between actual probability and the predicted probability. Decision curve analysis (DCA) was developed to ascertain the clinical utility of different models. A 2-sided P value < 0.05 was considered a statistically significant difference. All packages of R4.1.3 that were listed in Table 2.

TABLE 2
www.frontiersin.org

Table 2 Major packages of R software applied in current study.

3. Results

3.1. Comparison of clinic_CUS features and construction of clinic_CUS model

Among the 192 patients with pT1 IDC, there were LVI-positive (n = 56) and LVI-negative (n = 136) cases. Included patients were divided into the training dataset (37 LVI -positive and 97 LVI -negative pT1 IDCs) and validation dataset (19 LVI -positive and 39 LVI -negative pT1 IDCs) randomly.

There were no significant differences in all the clinic_CUS features between the training dataset and the validation dataset (P = 0.131 ~ 0.940) (Table 3). The clinic_CUS features between LVI-positive and LVI-negative groups in the training and validation datasets are shown in Table 4.

TABLE 3
www.frontiersin.org

Table 3 Comparisons of baseline characteristics in the training and validation datasets.

TABLE 4
www.frontiersin.org

Table 4 Comparisons of baseline characteristics between LVI-positive and LVI-negative groups in the training and validation datasets.

In the univariable logistic regression analysis for clinic_CUS features, the initially selected risk predictors included BMI, CA153, CEA, tumor margin, US_LNM_status (all P < 0.05) (Table 5).

TABLE 5
www.frontiersin.org

Table 5 Univariate logistic analysis for the risk factors of LVI.

After the multivariable logistic regression analysis, tumor margin and US_LNM_status were regarded as independent clinic_CUS risk predictors for the LVI status (all P < 0.05) (Table 6). The VIF value of the two predictors was 1.177, indicating no significant collinearity.

TABLE 6
www.frontiersin.org

Table 6 Multivariate logistic analysis for the risk factors of LVI.

3.2. Feature selection and Radscore establishment

In this study, a total of 939 radiomics features for each patient were extracted from grayscale US images. We selected 858 features with high stability and reproducibility (ICCs > 0.75) for subsequent feature screening as follows.

Step 1: After the two-sample t-test or Mann-Whitney U test, 103 features remained.

Step 2: After eliminating redundancy by applying Spearman correlation analysis, the number of remaining features was 35.

Step 3: The features were reduced to 7 potential predictors with nonzero coefficients in the LASSO regression model, and the optimal lambda (λ) was chosen as 0.066 (Figure 2A, B; Figure 3A). The correlation analysis showed that the maximum correlation coefficient between the selected radiomic features was 0.59 (Figure 3B).

FIGURE 2
www.frontiersin.org

Figure 2 The selection of radiomics features in LASSO regression. (A) The association between binomial deviance and log (lambda) was plotted, and two vertical line were drawn via the minimum deviance and 1 standard error of the minimum deviance, respectively. Based on the minimum criteria, the optimal lambda was selected according to 5-fold cross-validation. (B) LASSO coefficient distribution of radiomics features by different log (lambda) values. The vertical line was drawn at the optimal value of λ, leading to 7 features with nonzero coefficients.

FIGURE 3
www.frontiersin.org

Figure 3 The selected radiomics features to construct the Radscore. (A) The coefficients of radiomics features in the construction of Radscore. (B) Heatmap depicting correlation coefficient matrix of the selected radiomics features associated with LVI. The degree of correlation between various features is shown in different shades of color.

The final remaining 7 radiomics features were incorporated into the calculation of Radscore with the following formula:

Radscore=(-1.014)+0.275*wavelet.LH_gldm_DependenceNonUniformityNormalized+ (-0.151)*wavelet.HL_glrlm_RunVariance+0.213*square_glszm_SizeZoneNonUniformityNormalized+0.049*wavelet.LL_glszm_SmallAreaLowGrayLevelEmphasis+0.013*squareroot_glrlm_LongRunLowGrayLevelEmphasis+ 0.028*logarithm_glszm_LowGrayLevelZoneEmphasis+0.010*logarithm_ngtdm_Busyness

There was no significant difference for Radscore between the training dataset and the validation dataset (P = 0.806)(Table 3). In both training and validation datasets, the LVI-positive group had significantly higher Radscores than those of the LVI-negative group (P < 0.001 and P=0.001, repectively). (Table 4). The optimal cut-off value of the Radscore for discriminating LVI status was -1.138 in the training dataset. We used this cut-off value to plot Radscore bar chart in the training (Figure 4A) and validation (Figure 4B) datasets.

FIGURE 4
www.frontiersin.org

Figure 4 Bar chart of Radscore in the training (A) and validation (B) datasets, and the y-axis refers to the Radscore minus the cut-off value (i.e., Radscore +1.138). Up and down bars refer to the predicted positive LVI and negative LVI status, respectively. Green and red bars represent the actual LVI status as positive and negative, respectively.

The Radscore presented good discrimination performance in predicting the status of LVI in both training and validation datasets (Table 7).

TABLE 7
www.frontiersin.org

Table 7 Diagnostic performance of the Radscore, clinical_CUS, and radiomics nomogram models in the training and validation datasets.

3.3. Construction and validation of radiomics nomogram

On multivariate logistic regression analysis for clinic_CUS features and Radscore, tumor margin, US_LNM_status and Radscore were identified as independent risk factors for predicting LVI status (Table 6). The VIF values of the three predictors were 1.000 ~ 1.175, indicating no significant collinearity. Therefore, tumor margin, US_LNM_status and Radscore constructed the preoperative radiomics nomogram model (Figure 5A).

FIGURE 5
www.frontiersin.org

Figure 5 The construction of radiomics nomogram and the ROC curves of Radscore, clinic_CUS, and radiomics nomogram models. (A) Radiomics nomogram model visualized and constructed with tumor margin, US_LNM status and Radscore. The ROC curves of the Radscore model, clinic_CUS model, and radiomics nomogram model in training (B) and validation (C) datasets.

The radiomics nomogram score (Nomoscore) for each patient was calculated using the following formula: Nomoscore = -1.228 + 1.875* margin+2.559×US_LNM_status+ 2.051× Radscore

The ROC curve indicated that the radiomics nomogram model had satisfactory performance and applicability with the AUC value of 0.849 (95% CI: 0.775 ~ 0.923) in training dataset and 0.854 (95% CI: 0.748 ~ 0.960) in validation dataset (Table 7). DeLong test was used to compare AUC values between Radscore, clinic_CUS model, and the radiomics nomogram model. In the training dataset, the radiomics nomogram model was significantly superior to the clinical model and Radscore model (P < 0.001 and P = 0.014, respectively). In the validation dataset, the radiomics nomogram model was significantly superior to the clinical model (P = 0.001), but not significantly superior to Radscore (P = 0.165). No significant difference in AUC values was found between the Radscore and the clinic_CUS model in the training dataset (P = 0.598) and in validation dataset (P = 0.567). The ROC curves of the three models in the training and validation datasets are shown in Figures 5B, C, respectively.

The calibration curve of the radiomics nomogram showed good agreement between the predicted LVI probabilities and the actual LVI status in both training and validation datasets (Figures 6A, B). The results of the Hosmer-Lemeshow test were not significant in both training and validation datasets (P = 0.550 and 0.812, respectively), indicating favorable goodness-of-fit of the radiomics nomogram.

FIGURE 6
www.frontiersin.org

Figure 6 Calibration curves of the radiomics nomogram in the training dataset (A) and validation dataset (B), respectively.

The DC showed that the radiomics nomogram model had higher net benefit than the Radscore and clinic_CUS models in predicting LVI in the training dataset (Figure 7A), when threshold probabilities ranged from 0.21 to 0.73. Similar results presented in the validation dataset (Figure 7B). The DCA demonstrated the clinical value of the radiomics nomogram model.

FIGURE 7
www.frontiersin.org

Figure 7 DCA for the clinical value assessment of the three models in the training dataset (A) and validation dataset (B), respectively. The X-axis indicates the threshold probability, and the Y-axis represents the net benefit. The gray line indicates the assumption that all patients are LVI-positive cases; the black line represents the assumption that all patients are LVI-negative cases. The red, green, and blue lines refer to the Radscore, clinic_CUS, and radiomics nomogram models, respectively.

4. Discussion

In our study, a Radscore derived from grayscale US image was developed and validated to predict the LVI status in patients with pT1 IDC. Moreover, the radiomics nomogram combining tumor margin, US_LNM and Radscore provides a direct, non-invasive way for preoperative prediction of LVI while exhibiting high accuracy in the individualized prediction of LVI.

T1 stage breast cancer has become the most commonly diagnosed invasive breast disease in developed countries (23). The incidence of LVI in T1 breast cancer is 13% ~ 27% (5). Among the 192 patients with pathologically confirmed T1 breast cancer in our study, the incidence of LVI is 29.2% (56/192), which is slightly higher than the results of previous studies. This may be related to the fact that all breast cancers included in this study were invasive ductal carcinoma. LVI is defined as the invasion of lymphatic vessel walls by tumor cells or the spread of carcinoma thrombus into the luminal cavity, which had been considered as a critical step in the relapse or progression of disseminated tumor cells (1, 6, 7). LVI was highlighted as a risk factor with important implications for survival in patients with T1 breast cancer (9, 10). The presence of LVI is not always able to be detected at biopsy, owing to the small tissue volume to be cut and obtained from the primary tumor (3, 12, 13); therefore, noninvasive prediction of LVI is necessary.

Previously, it had been demonstrated that the clinic_CUS features of breast carcinoma could distinguish LVI-positive from LVI-negative (8, 12). In our study, tumor margin and US_LNM status were independent predictors of LVI in the clinic_CUS model. Tumor margin showed significant difference in LVI-positive group and LVI-negative group, and LVI-positive breast tumors were more likely to present with not circumscribed margins than LVI-negative tumors. This is consistent with previous studies (6, 12, 22). Reasonable explanations may be that tumor microvascular invasion usually occurred in the peritumoral area, while undefined margin, especially spiculate margin, was associated with the infiltrative growth of the tumor into the peritumoral stroma (6). As another independent predictor for LVI in the clinic_CUS model, US_LNM was more common in LVI-positive than LVI-negative breast cancers. Previous studies (69) had also demonstrated that the presence of LVI was closely associated with axillary lymph node involvement, which were consistent with our study. Similarly, ZHOU et al. (12) and Tong et al. (8) all thought that suspicious findings on axillary US imaging were independent predictor for the presence of LVI. Moreover, LVI-positive were more likely to have nodal metastases than LVI-negative in T1 breast cancer patients (9), whereas lymph node metastases were naturally relatively low in T1 breast cancer (35), perhaps more likely to be LVI-positive at the time of lymph node metases.

Recently, some studies proposed that MRI-based and digital breast tomosynthesis (DBT)-based radiomis score were independent risk factors for predicting LVI status of breast cancer patients (3, 6, 7, 11). Their results demonstrated good predictive efficacy for LVI status of breast cancer. Compared with the prior MRI or DBT, grayscale US images were simpler and easier to obtain for radiomics analysis. In addition, US-based radiomics score had been shown to be of great value for the discrimination and prognostic assessment of breast tumor (1821), but had rarely been used to predict LVI, especially for small breast cancer. Therefore, we chose to use the US image for radiomics analysis in order to discover its potential value for predicting LVI in T1 stage IDC. In our study, Radscore was calculated by 7 radiomics features associated with the LVI status in the construction of Radscore model. All the selected 7 radiomics features were from transform-filtered texture features, including 2 GLRLM features, 1 NGTDM feature, 3 GLSZM features, and 1 GLDM feature, from which wavelet.LH_gldm_DependenceNonUniformityNormalized and square_glszm_SizeZoneNonUniformityNormalized were the dominant features in the construction of the Radscore.

The texture features could quantify the spatial variation in the architecture and function of breast cancer, which are suitable to assess the information of tumor heterogeneity (20, 34). The transform-filtered texture features could provide potential insight for quantifying tumor biological and multidimensional heterogeneity (6, 11, 30, 36). Many studies had found that transform-filtered texture features were useful in predicting the tumor benignity and malignancy, lymph node metastasis, gene expression, and the efficacy of neoadjuvant chemotherapy (11, 1820, 30, 36, 37), although some explanations of relationship between these complex features and tumor biology behavior remained to be elucidated (6). Some transform-filtered texture features from DBT and MRI could be incorporated as prediction model for the LVI status in breast cancer (6, 11), since the transform-filtered features may be associated with the tumor complex microstructure, such as tumor cell proliferation, local necrosis, hemorrhage, inflammation, and microcalcifications, etc in LVI-positive tumor (6, 7). Different imaging modalities contained different potential information about the microstructure and biological behavior of the tumor (6), thus US-based Radscore could also had certain value in predicting LVI in breast cancer. Our results revealed that LVI-positive pT1 IDCs exhibited higher scores on the grayscale US image based Radscore model, which may be attributed to the higher invasiveness and heterogeneity of LVI-positive tumors (6, 11).

US-based radiomics nomogram had been widely performed and demonstrated to be of great clinical value in oncology (18, 20, 21, 36, 38, 39). To our knowledge, our study is the first to utilize the US-based radiomics nomogram to preoperatively predict the LVI status in pT1 IDC. In this study, we developed and validated a US-based radiomics nomogram, constructed with three independent predictors, namely tumor margin, US_LNM status and Radscore. Our result revealed that the radiomics nomogram model, incorporating tumor margin, US_LNM status and US-based Radscore, exhibited a good discrimination ability for predicting LVI in pT1 IDC, with the AUC value of 0.849 (95% CI: 0.775~0.923) in the training dataset, and 0.854 (95% CI: 0.748~0.960) in the validation dataset. In addition, the radiomics nomogram model presented superior predictive performance to the clinical model both in training and validation datasets, and the radiomics nomogram model could be more intuitive and easily applied in distinguishing LVI status in pT1 IDC. The predictive performance of LVI in our research was similar to that in previous studies (6, 7, 11), which were based on MRI or DBT for radiomics nomogram construction. Moreover, the calibration curve for our radiomics nomogram model showed a good concordance between predicted and actual probability, and DCA demonstrated a higher clinical net benefit from the nomogram model. Thus, we strongly believe that the constuction of radiomics nomogram based on US image can be effectively applied to predict the status of LVI in pT1 IDC. Future research directions would be associated with other prognostic indicators or treatment assessment of breast carcinoma through US-based radiomics nomogram.

Our study has several limitations. Firstly, this study only included pT1 IDC. Other histological types or T stages of breast cancer would be included to increase the clinical applicability of this study. Secondly, this is a single center retrospective study, in which case selection bias may exist. Moreover, the sample size of this study is not large enough, so a larger sample and multicenter data would be deserved in the future. Thirdly, we manually delineated the maximum diameter level of the tumor as two-dimensional (2D) ROI, which could not represent the whole tumor. Fourthly, we only based on the grayscale US images for radiomics analysis. Multimodal ultrasound images, including elastography and CEUS imaging, would be performed in the future study. Fifthly, US images were acquired from multiple manufacturers in this study. Although we standardize the images before feature extraction and performed Z-score normalization for radiomics features, heterogeneity of images from different operators and different equipments may also have certain impact on experimental results. Finally, LVI usually indicates tumor invasion in peritumoral tissue, but radiomic analysis of the peritumoral ROI was not performed. Further studies are needed to verify this aspect as well.

In conclusion, radiomics features derived from grayscale US image may be potential biomarkers for predicting LVI of pT1 IDC. The proposed radiomics nomogram, incorporating tumor margin, US_LNM status and US-based Radscore, could provide a satisfactory predictive efficacy for LVI status and confer a higher clinical benefit for patients.

Data availability statement

The raw data supporting the conclusions of this article are available from the corresponding authors on reasonable request.

Ethics statement

The studies involving human participants were reviewed and approved by Hubei Cancer Hospital (No.: LLHBCH2021YN-001). Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements. Written informed consent was not obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.

Author contributions

FL, X-WC, and G-FL conceived and designed of the study. FL and S-EZ acquired the data. M-LX, FL, and S-EZ analyzed and/or interpreted of the data. M-LX and FL drafted the manuscript. M-LX, FL, X-WC, and G-FL revised the manuscript critically for important intellectual content. All authors contributed to the article and approved the submitted version.

Funding

This study was financially supported by Wu Jieping Medical Foundation (Project No. 320.6750.19089-40); Jilin Province Science and Technology Development Plan (Project No. 20220203113SF); National Natural Science Foundation of China (Project No. 52275006); Climbing Foundation Clinical Research Project of National Cancer Center (Project No. NCC201917B04).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Choi BB. Dynamic contrast enhanced-mri and diffusion-weighted image as predictors of lymphovascular invasion in node-negative invasive breast cancer. World J Surg Oncol (2021) 19:76. doi: 10.1186/s12957-021-02189-3

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Ryu YJ, Kang SJ, Cho JS, Yoon JH, Park MH. Lymphovascular invasion can be better than pathologic complete response to predict prognosis in breast cancer treated with neoadjuvant chemotherapy. Med (Baltimore) (2018) 97:e11647. doi: 10.1097/MD.0000000000011647

CrossRef Full Text | Google Scholar

3. Kayadibi Y, Kocak B, Ucar N, Akan YN, Yildirim E, Bektas S. Mri radiomics of breast cancer: machine learning-based prediction of lymphovascular invasion status. Acad Radiol (2022) 29:S126–34. doi: 10.1016/j.acra.2021.10.026

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Nijiati M, Aihaiti D, Huojia A, Abulizi A, Mutailifu S, Rouzi N, et al. Mri-based radiomics for preoperative prediction of lymphovascular invasion in patients with invasive breast cancer. Front Oncol (2022) 12:876624. doi: 10.3389/fonc.2022.876624

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lyu Z, Wang J, Kang L, Hu C, He H, Guan M, et al. Lymph node metastasis and prognostic analysis of 354 cases of t1 breast cancer. Zhōnghuá zhongliú zázhì (2014) 36:382–5. doi: 10.3760/cma.j.issn.0253-3766.2014.05.013

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Wang D, Liu M, Zhuang Z, Wu S, Zhou P, Chen X, et al. Radiomics analysis on digital breast tomosynthesis: preoperative evaluation of lymphovascular invasion status in invasive breast cancer. Acad Radiol (2022) 29:17732–82. doi: 10.1016/j.acra.2022.03.011

CrossRef Full Text | Google Scholar

7. Liu Z, Feng B, Li C, Chen Y, Chen Q, Li X, et al. Preoperative prediction of lymphovascular invasion in invasive breast cancer with dynamic contrast-enhanced-mri-based radiomics. J Magn Reson Imaging (2019) 50:847–57. doi: 10.1002/jmri.26688

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Tong YY, Sun PX, Zhou J, Shi ZT, Chang C, Li JW. The association between ultrasound features and biological properties of invasive breast carcinoma is modified by age, tumor size, and the preoperative axilla status. J Ultrasound Med (2020) 39:1125–34. doi: 10.1002/jum.15196

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Zhao Y, Yang N, Wang X, Huang Y, Zhou X, Zhang D. Potential roles of lymphovascular space invasion based on tumor characteristics provide important prognostic information in t1 tumors with er and her2 positive breast cancer. Clin Transl Oncol (2020) 22:2275–85. doi: 10.1007/s12094-020-02369-9

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Houvenaeghel G, Goncalves A, Classe JM, Garbay JR, Giard S, Charytensky H, et al. Characteristics and clinical outcome of t1 breast cancer: a multicenter retrospective cohort study. Ann Oncol (2014) 25:623–8. doi: 10.1093/annonc/mdt532

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Zhang J, Wang G, Ren J, Yang Z, Li D, Cui Y, et al. Multiparametric mri-based radiomics nomogram for preoperative prediction of lymphovascular invasion and clinical outcomes in patients with breast invasive ductal carcinoma. Eur Radiol (2022) 32:4079–89. doi: 10.1007/s00330-021-08504-6

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Zhou P, Jin C, Lu J, Xu L, Zhu X, Lian Q, et al. The value of nomograms in pre-operative prediction of lymphovascular invasion in primary breast cancer undergoing modified radical surgery: based on multiparametric ultrasound and clinicopathologic indicators. Ultrasound Med Biol (2021) 47:517–26. doi: 10.1016/j.ultrasmedbio.2020.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Igarashi T, Furube H, Ashida H, Ojiri H. Breast mri for prediction of lymphovascular invasion in breast cancer patients with clinically negative axillary lymph nodes. Eur J Radiol (2018) 107:111–8. doi: 10.1016/j.ejrad.2018.08.024

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Cheung SM, Husain E, Mallikourti V, Masannat Y, Heys S, He J. Intra-tumoural lipid composition and lymphovascular invasion in breast cancer via non-invasive magnetic resonance spectroscopy. Eur Radiol (2021) 31:3703–11. doi: 10.1007/s00330-020-07502-4

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Liu Z, Li R, Liang K, Chen J, Chen X, Li X, et al. Value of digital mammography in predicting lymphovascular invasion of breast cancer. BMC Cancer (2020) 20:274. doi: 10.1186/s12885-020-6712-z

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Xu M, Li F, Yu S, Zeng S, Weng G, Teng P, et al. Value of histogram of gray-scale ultrasound image in differential diagnosis of small triple negative breast invasive ductal carcinoma and fibroadenoma. Cancer Manag Res (2022) 14:1515–24. doi: 10.2147/CMAR.S359986

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Rigiroli F, Hoye J, Lerebours R, Lafata KJ, Li C, Meyer M, et al. Ct radiomic features of superior mesenteric artery involvement in pancreatic ductal adenocarcinoma: a pilot study. Radiology (2021) 301:610–22. doi: 10.1148/radiol.2021210699

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Du Y, Zha H, Wang H, Liu X, Pan J, Du L, et al. Ultrasound-based radiomics nomogram for differentiation of triple-negative breast cancer from fibroadenoma. Br J Radiol (2022) 95:20210598. doi: 10.1259/bjr.20210598

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Jiang M, Li CL, Luo XM, Chuan ZR, Lv WZ, Li X, et al. Ultrasound-based deep learning radiomics in the assessment of pathological complete response to neoadjuvant chemotherapy in locally advanced breast cancer. Eur J Cancer (2021) 147:95–105. doi: 10.1016/j.ejca.2021.01.028

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Zha HL, Zong M, Liu XP, Pan JZ, Wang H, Gong HY, et al. Preoperative ultrasound-based radiomics score can improve the accuracy of the memorial sloan kettering cancer center nomogram for predicting sentinel lymph node metastasis in breast cancer. Eur J Radiol (2021) 135:109512. doi: 10.1016/j.ejrad.2020.109512

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Gao Y, Luo Y, Zhao C, Xiao M, Ma L, Li W, et al. Nomogram based on radiomics analysis of primary breast cancer ultrasound images: prediction of axillary lymph node tumor burden in patients. Eur Radiol (2021) 31:928–37. doi: 10.1007/s00330-020-07181-1

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Ouyang FS, Guo BL, Huang XY, Ouyang LZ, Zhou CR, Zhang R, et al. A nomogram for individual prediction of vascular invasion in primary breast cancer. Eur J Radiol (2019) 110:30–8. doi: 10.1016/j.ejrad.2018.11.013

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Zhao Y, Liu Y, Xie S, Jiang Y, Shao Z. A nomogram predicting lymph node metastasis in t1 breast cancer based on the surveillance, epidemiology, and end results program. J Cancer (2019) 10:2443–9. doi: 10.7150/jca.30386

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Li Y, Chen Y, Zhao R, Ji Y, Li J, Zhang Y, et al. Development and validation of a nomogram based on pretreatment dynamic contrast-enhanced mri for the prediction of pathologic response after neoadjuvant chemotherapy for triple-negative breast cancer. Eur Radiol (2022) 32:1676–87. doi: 10.1007/s00330-021-08291-0

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Zheng X, Yao Z, Huang Y, Yu Y, Wang Y, Liu Y, et al. Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer. Nat Commun (2020) 11:1236. doi: 10.1038/s41467-020-15027-z

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Xu M, Tang Q, Li M, Liu Y, Li F. An analysis of ki-67 expression in stage 1 invasive ductal breast carcinoma using apparent diffusion coefficient histograms. Quant Imaging Med Surg (2021) 11:1518–31. doi: 10.21037/qims-20-615

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Goldhirsch A, Wood WC, Coates AS, Gelber RD, Thurlimann B, Senn HJ. Strategies for subtypes–dealing with the diversity of breast cancer: highlights of the st. gallen international expert consensus on the primary therapy of early breast cancer 2011. Ann Oncol (2011) 22:1736–47. doi: 10.1093/annonc/mdr304

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Ji G, Zhu F, Xu Q, Wang K, Wu M, Tang W, et al. Radiomic features at contrast-enhanced ct predict recurrence in early stage hepatocellular carcinoma: A multi-institutional study. Radiology (2020) 294:568–79. doi: 10.1148/radiol.2020191470

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Sun R, Limkin EJ, Vakalopoulou M, Dercle L, Champiat S, Han SR, et al. A radiomics approach to assess tumour-infiltrating cd8 cells and response to anti-pd-1 or anti-pd-l1 immunotherapy: An imaging biomarker, retrospective multicohort study. Lancet Oncol (2018) 19:1180–91. doi: 10.1016/S1470-2045(18)30413-3

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Ren S, Li Q, Liu S, Qi Q, Duan S, Mao B, et al. Clinical value of machine learning-based ultrasomics in preoperative differentiation between hepatocellular carcinoma and intrahepatic cholangiocarcinoma: a multicenter study. Front Oncol (2021) 11:749137. doi: 10.3389/fonc.2021.749137

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Zhang Y, Luo Y, Kong X, Wan T, Long Y, Ma J. A preoperative mri-based radiomics-clinicopathological classifier to predict the recurrence of pituitary macroadenoma within 5 years. Front Neurol (2021) 12:780628. doi: 10.3389/fneur.2021.780628

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Qin H, Wu Y, Lin P, Gao R, Li X, Wang X, et al. Ultrasound image-based radiomics: an innovative method to identify primary tumorous sources of liver metastases. J Ultrasound Med (2021) 40:1229–44. doi: 10.1002/jum.15506

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Peng Y, Lin P, Wu L, Wan D, Zhao Y, Liang L, et al. Ultrasound-based radiomics analysis for preoperatively predicting different histopathological subtypes of primary liver cancer. Front Oncol (2020) 10:1646. doi: 10.3389/fonc.2020.01646

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Xiong L, Chen H, Tang X, Chen B, Jiang X, Liu L, et al. Ultrasound-based radiomics analysis for predicting disease-free survival of invasive breast cancer. Front Oncol (2021) 11:621993. doi: 10.3389/fonc.2021.621993

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Jiao DC, Qiao JH, Zhu JJ, Wang LN, Ma YZ, Lu ZD, et al. [analysis of factors influencing the axillary lymph node metastasis and breast cancer-specific survival in patients with t1 breast cancer]. Zhonghua Yi Xue Za Zhi (2018) 98:3258–62. doi: 10.3760/cma.j.issn.0376-2491.2018.40.009

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Li Q, Jiang T, Zhang C, Zhang Y, Huang Z, Zhou H, et al. A nomogram based on clinical information, conventional ultrasound and radiomics improves prediction of malignant parotid gland lesions. Cancer Lett (2022) 527:107–14. doi: 10.1016/j.canlet.2021.12.015

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Wang S, Chen Y, Zhang H, Liang Z, Bu J. The value of predicting human epidermal growth factor receptor 2 status in adenocarcinoma of the esophagogastric junction on ct-based radiomics nomogram. Front Oncol (2021) 11:707686. doi: 10.3389/fonc.2021.707686

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Tang J, Tang J, Jiang S, Ma J, Xi X, Li H, et al. Nomogram based on radiomics analysis of ultrasound images can improve preoperative braf mutation diagnosis for papillary thyroid microcarcinoma. Front Endocrinol (Lausanne) (2022) 13:915135. doi: 10.3389/fendo.2022.915135

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Zhang D, Wei Q, Wu GG, Zhang XY, Lu WW, Lv WZ, et al. Preoperative prediction of microvascular invasion in patients with hepatocellular carcinoma based on radiomics nomogram using contrast-enhanced ultrasound. Front Oncol (2021) 11:709339. doi: 10.3389/fonc.2021.709339

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: lymphovascular invasion, breast invasive ductal carcinoma, ultrasound, radiomics, nomogram

Citation: Xu M-L, Zeng S-E, Li F, Cui X-W and Liu G-F (2022) Preoperative prediction of lymphovascular invasion in patients with T1 breast invasive ductal carcinoma based on radiomics nomogram using grayscale ultrasound. Front. Oncol. 12:1071677. doi: 10.3389/fonc.2022.1071677

Received: 16 October 2022; Accepted: 16 November 2022;
Published: 07 December 2022.

Edited by:

L. J. Muhammad, Federal University Kashere, Nigeria

Reviewed by:

Zekun Jiang, Sichuan University, China
Mingfu Gong, Xinqiao Hospital, China

Copyright © 2022 Xu, Zeng, Li, Cui and Liu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Fang Li, 178508491@qq.com; Xin-Wu Cui, cuixinwu@live.cn; Gui-Feng Liu, gfliu@jlu.edu.cn

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.