Atherosclerotic Plaque Tissue Characterization: An OCT-Based Machine Learning Algorithm With ex vivo Validation

There is a need to develop a validated algorithm for plaque characterization which can help to facilitate the standardization of optical coherence tomography (OCT) image interpretation of plaque morphology, and improve the efficiency and accuracy in the application of OCT imaging for the quantitative assessment of plaque vulnerability. In this study, a machine learning algorithm was implemented for characterization of atherosclerotic plaque components by intravascular OCT using ex vivo carotid plaque tissue samples. A total of 31 patients underwent carotid endarterectomy and the ex vivo carotid plaques were imaged with OCT. Optical parameter, texture features and relative position of pixels were extracted within the region of interest and then used to quantify the tissue characterization of plaque components. The potential of individual and combined feature set to discriminate tissue components was quantified using sensitivity, specificity, accuracy. The results show there was a lower classification accuracy in the calcified tissue than the fibrous tissue and lipid tissue. The pixel-wise classification accuracy obtained by the developed method, to characterize the fibrous, calcified and lipid tissue by comparing with histology, were 80.0, 62.0, and 83.1, respectively. The developed algorithm was capable of characterizing plaque components with an excellent accuracy using the combined feature set.

Introduction

Rupture of vulnerable atherosclerotic plaques is the leading cause of stroke and myocardial infarction (Cicha et al., 2011). These serious accidents often occur when plaques in the arteries suddenly rupture, causing thrombus and leading to the obstruction of the blood flow to the brain or the heart (Lekadir et al., 2017). Therefore, early and accurate prediction of individuals at high risk of plaque rupture could allow preventive, therapeutic, or surgical interventions to be taken to prevent such life-threatening events happening.

It is now well established that plaque components and morphology are the main factors in the determination of plaque vulnerability (Shah, 2003; Li et al., 2006a, b). Plaques with a large lipid core and a thin fibrous cap are more prone to rupture, whereas plaques containing calcified tissue may tend to be more stable (Arbab-Zadeh and Fuster, 2015). High-resolution intravascular optical coherence tomography (OCT) imaging has shown great promise in the identification and characterization of atherosclerotic plaque components, such as fibrous cap, calcification and lipid tissue, as well as the quantification of plaque areas and volume (Yabushita et al., 2002; Regar et al., 2013). Histological studies have shown the ability of OCT to separate fibrous, calcified and lipid tissue from the carotid artery (Zimarino et al., 2007; Matsumoto et al., 2014). Although OCT images present plaque morphological information with a relatively high resolution, it still relies on interpretation of the images by trained readers for the identification and quantitation of plaque components. Therefore, development of computational techniques is important to determine plaque components.

Levitz et al. (2004) published a quantitative study which demonstrated that OCT tissue characterization of atherosclerotic plaques could be conducted by measuring by the backscattering and attenuation coefficients. Their work showed that the coefficients has essential differences between fibrous, lipid and calcific plaques. The optical parameters were gradually enriched for atherosclerotic characterization in OCT quantitative studies (van der Meer et al., 2005a, b; Xu et al., 2008; Popescu et al., 2010; van Soest et al., 2010). However, tissue quantification using only optical parameters caused significant overlaps between different tissue types. In addition, discrepancies existed because of the different light sources and physical models. Later, Wang et al. (2010) proposed a different methodology using the morphology operation for semiautomatic segmentation of calcified plaques in OCT images. Then, a series of such studies were implemented to quantify plaque components, by combining optical parameters and texture features (Ughi et al., 2013), k means and texture features (Athanasiou et al., 2014), and least square optimization strategy to estimate the depth profiles in OCT data (Rico-Jimenez et al., 2016). Previous studies demonstrate the feasibility of atherosclerotic plaques segmentation based on machine learning algorithm, while the segmentation results were compared with manual annotation. Recently, the prevailing convolutional neural networks (CNN) were also applied to the classification of plaque components based on OCT images and demonstrated excellent results (Abdolmanafi et al., 2017, 2018; Gessert et al., 2019). However, it is still challenging to segment plaque components based on OCT imaging. Moreover, lack of ex vivo validation on the developed imaging processing methods is the other obstacle in this area.

This study was designed to characterize and identify the fibrous, calcified and lipid tissues based on the expert annotation using histology images. In the present study, we used optical parameters, texture features combined with relative position of pixels to analyze and delineate plaque components in OCT images. Validation algorithm was performed by comparing these results with those of corresponding histological sections of the ex vivo carotid plaques.

Materials and Methods

Carotid Plaque Tissue Collection

In this study, 31 patients with a high-grade (>70%) carotid stenosis scheduled for carotid endarterectomy (CEA) from October 2015 to December 2018 were included. The dissected specimens were used for both ex vivo OCT imaging and histology analysis. All participants provided a written informed consent prior to the enrollment and the study protocol was approved by the institutional ethics committee.

OCT Image Protocol and Preprocessing

OCT can acquire cross-sectional images (Figure 1C) of microscopic pathology structure of arterial wall. In the study, the OCT system used for the CEA plaque tissue imaging was a commercially available C7-XR with Dragonfly^TM catheter (2.7 F, C7-XR, St. Jude Medical Inc., St. Paul, MN, United States). The OCT system had high image resolutions of ∼15 μm, approximately 10 times finer than conventional intravascular ultrasound. Scan parameters were set as 100 frames/s, 54,000 A-scans/s, pullback speed of 20 mm/s, pullback length of ∼54.2 mm (Figure 1B). In average, the ex vivo specimen was imaged over 50–250 frames, depending upon the actual length of the samples.

FIGURE 1

Figure 1. Carotid plaque tissue and OCT imaging. (A) An intact CEA plaque tissue. (B) A longitudinal view of CEA tissue (A) with the C7-XR OCT system. (C) A cross-sectional OCT image from the vertical line (B).

Prior to OCT imaging, the specimens (Figure 1A) were flushed with phosphate buffered saline (PBS) to remove blood clots, washing out excess blood to reduce possible clutter artifacts. In order to accurately co-register the OCT images with the histological and immunohistochemistry sections, at each imaging site, photograph was taken and stored to eliminate the rotary bias on slices as much as possible. In each imaging site, an automatic pullback was performed to obtain images. Cross-sectional images (cartesian coordinate images) and lossless raw images (polar coordinate images) were acquired and stored on CD-ROMs for off-line process. It is worth noting that the raw images were used as input and the cross-sectional images were used as visualization.

Lumen segmentation is the primary step for plaque image analysis. The lumen boundary is solved by the classic optimization method, dynamic programming (DP) (Amini et al., 1990). More details about the algorithm refer to literature (Wang et al., 2012).

Figure 2 presents a flowchart of the training, testing procedures and the final performance evaluation. For the training procedure, after the preprocessing steps including automatic guide-wire and lumen segmentation, the optical parameters (OP), the texture features and relation position (RP) features were quantified. Based on these locally extracted values, the supervised pixel-wise classification was applied to train a classifier. The histology slices were used as the gold standard for manually delineating the train and test sets, and an intermediate color-coded image map depicting the different types of tissue was given by the trained classifier. The performance of the algorithm was evaluated by classification accuracy of the trained classifier output and the manual tissue map based on histology.

FIGURE 2

Figure 2. Flowchart of the tissue characterization used in the study.

Histopathology Analysis

After imaging, each carotid plaque tissue was cut into 1 cm serial transverse segments. Each embedded segment was marked in the same order with the corresponding OCT pullback and was serially sectioned into slices of 4 μm transverse sections, with a 40 μm interval perpendicular to the longitudinal axis of the artery. Sections were mounted on the slide glass substrates and then stained with Hematoxylin and Eosin (H&E), Masson’s trichrome, Oil Red O to show the structural and morphology information within the plaque sample. Figure 3 shows the process from the carotid tissue to the slice. The histopathology and immunostained sections were examined with an Axio Lab.A1 (Carl Zeiss, Germany), and the scanned histology images were analyzed using the Pannoramic Viewer image analysis software (Budapest, Hungary). The pathological classification of the plaque components was processed based on the modified American Heart Association (AHA)-classification (Stary et al., 1995).

FIGURE 3

Figure 3. Sample sectioning for histological analysis. (A) Carotid plaque tissue. (B) Embedding blocks with 1 cm intervals. (C) 40 μm interval slices. (D) 4 μm histology slices.

Histopathology and OCT Image Co-registration

The gross morphological features of OCT images such as lumen size and shape, wall size and shape, plaque configuration, as well as calcific plaques were used to adjust the cross-sectional orientation of the slices. Manual co-registration of the OCT images and the digitized histological slices was performed by two experts. The carotid bifurcation and the narrowest lumen (maximum stenosis) were used as the reference points of matching the histology slices and OCT images. The challenge is that the thickness of OCT imaging and histology slices was different. Every 0.1 cm plaque specimen could cover 5 OCT images in one pullback and 250 consecutive histology slices. We were able to use both ends of the plaque samples as additional registration points to co-register the OCT imaging with the histology slices.

Ground Truth Annotation

The images were annotated by the experts using ImageJ software (Girish and Vijayalakshmi, 2004), according to the registered histology slices. The photomicrograph representative of each tissue type is shown in Figure 4. The two expert independently assessed the plaque components by examining the slice, and outlined the corresponding regions on the OCT image. The three main plaque components were color-coded with a segmentation plugin (Schindelin et al., 2016), such as green for the fibrous tissue, white for the calcified tissue and pink for the lipid tissue. Considering the most important morphologic features of plaque tissue are in the superficial region, whereas it was just within the current OCT imaging capabilities. Therefore, the annotation depth was less than 1 mm from the vessel lumen into the deeper tissue when we defined the main analysis region of the three plaque components. This value is in agreement with the literatures reported in Holzapfel et al. (2005). Figure 5 shows the annotation results by the histology slices.

FIGURE 4

Figure 4. Photomicrographs demonstrating tissue components. (A) Low magnification Hematoxylin-Eosin staining reveals fibrous plaque consist of homogenous area that was clearly demarcated by high magnification box (left bottom). (B) Low magnification Alizazrin Red staining reveals calcified plaque consist of heterogeneous region that was clear and high-dense internal and external boundaries (middle bottom, high magnification box) (red arrows). (C) Low magnification Oil Red O staining shows lipid droplets (blue arrow).

FIGURE 5

Figure 5. Three groups of co-registration of the histology slices and the OCT images. (A1,B1,C1) are cross-sectional OCT image. (A2,B2,C2) are the expert 1 annotation OCT images. (A3,B3,C3) are the expert 2 annotation OCT images (A4,B4,C4) are the corresponding histology slices. Carotid atheroma demonstrates the fibrous region (green arrow), calcification region (red arrowhead) and lipid region (blue asterisk). The plaque morphology and calcified region allowed a precise co-registration between OCT and histology.

Reproducibility of Annotations

Although the expert performed the annotation, the decision to delineate various tissue map was varying degree subjective and thus prone to analyst variability. To better annotation OCT images, another analyst is necessary to test the reproducibility. To determine reproducibility of annotation results, the intraclass correlation coefficient (ICC) with 95% confidence interval (CI) was calculated to measure the level of agreement between two measurements.

Pixel-Wise Feature Extraction

Inversion Methods for Optical Parameters

OCT systems could acquire multiple OCT A-lines. The intensity of A-line value of the detected OCT signal < I_d(r) > can be modeled using a single scattering model according to the Lambert-Beer law (Lantos, 2014).

$$<I_d\left(r\right)\ge I_{0}T\left(r\right)\widehat{s}\left(r\right)\exp \left(-{\mathrm{\mu }}_t\left(r\right)\right)(1)$$

$$I_0=I^{\prime }{\mathrm{\mu }}_b(2)$$

where r indicates the penetration depth, μ_t the total attenuation coefficient and I₀ a scale factor, I′locally available intensity and μ_b the backscattering coefficient (van Soest et al., 2010). The attenuation coefficient μ_t(mm⁻¹) is a result of scattering and absorption. However, only scattering can be considered because the contribution of tissue absorption is very low at the near infrared wavelengths used in OCT (Qu et al., 1994). In addition, the OCT signal is influenced by focusing effects related to the confocal properties of the catheter (van Leeuwen et al., 2003), which can be described as:

$$T_r={\left[{\left(\frac{r-z_0}{z_R}\right)}^2+1\right]}^{-1\mathrm{/}2}(3)$$

Here T_r is the longitudinal point spread function (PSF), z₀is the position of the beam waist and z_R is the Rayleigh length. While $\widehat{s}$ in (1) represents the modulation due to the OCT depth scan response and is described as follow:

$$\widehat{s}\left(r\right)=\exp \left[-{\left(\frac{r-z_C}{z_W}\right)}^2\right](4)$$

While z_C is the center of the scan, and z_W is the half width of the roll-off function (Yun et al., 2004).

To reduce the dynamic range and sensitivity to noise of the fitted signal, (1) is linearized by logarithmic transformation:

$$\text{log}\left[⟨I_d\left(r\right)⟩\right]-\log \left[T_r\right]-\log \left[\widehat{s}\left(r\right)\right]=\log \left(I_0\right)-{\mathrm{\mu }}_t\left(r\right)(5)$$

The attenuation coefficient μ_t and constant parameter log⁡(I₀) were calculated using a linear least-square fit to the OCT A-lines for different layers and for different positions of the individual layers by an optimization process.

Texture Features

Texture features were extracted from the training set and the testing set images in order to be used for the classification of the plaque tissues. Texture refers to the spatial interrelationships and arrangement of the basic elements of an image. In the study, several texture features were selected as follows:

First order statistics (FOS) textures are directly related to the gray tone distribution of the pixel intensity and ignore inter-pixel correlations. In the paper, four parameters including mean value, standard deviation, skewness and kurtosis were extracted directly from the image. More details can be found in reference (Christodoulou et al., 2003b).

Gray level co-occurrence matrix (GLCM) is a powerful statistical tool for texture analysis, which is a tabulation of how often different combinations of pixel brightness values (gray levels) occur in an image (Soh and Tsatsoulis, 1999). In this paper, the distance was 1 and angle theta were 0°, 45°, 90°, and 135°. Seven features were computed based on the probability density functions (PDFS), including correlation, contract, dissimilarity, energy, entropy, homogeneity, maximum probability.

Neighborhood gray tone difference matrix (NGTDM) corresponds to the visual properties of the texture (Christodoulou et al., 2003a). The following five texture features were extracted form NGTDM, for a neighborhood size of 3 × 3: busyness, contrast, complexity, coarseness and texture length.

Fractal dimension (FD) is an index for characterizing the fractal patterns or sets by quantifying their complexity as a ratio of the change in detail to the change in scale (Soh and Tsatsoulis, 1999). In this paper, the image intensities were transformed to the FD domain using the differential box-counting algorithm (Liu et al., 2003) at various different scales and then displayed for plaque tissue identification.

The optical parameters were one-dimension information extracted by nonlinear fit, the texture feature sets (the four groups) were two-dimension features based on the local neighborhood operations, the sixth set was relative position of pixels (RP) (the x and y coordinate of each pixel). This RP features were used in combination with other feature sets during the experiment because of their natural and essential characterization. Table 1 presents the details of the feature sets.

TABLE 1

Table 1. Feature sets included in the study.

Random Forest Classifier

To handle the large training set, the random forest (RF) algorithm was selected (Breiman, 2001). RF is an ensemble of decision trees that combine a series of weak classifiers (i.e., binary trees) to achieve an accurate classification. In addition, the randomization allows the flexibility to explore a large feature space because it only considers a subset of features in each decision tree. The tuning parameters are Ntree (number of trees to grow) and Mtry (number of variables randomly sampled at each node). Each decision tree is independently produced and each node is split by the parameter Mtry. By growing the forest up to another parameter Ntree, the algorithm creates trees that have a high variance and a low bias. RF becomes increasingly popular in similar medical image classification applications because of its computational efficiency for large training data, ability to handle multiclass classification.

Statistical Analysis

Annotation regions were compared on a pixel-wise basis with the results of the RF classifier. The performances of the RF classification methods were compared based on the following model accuracy measures: sensitivity, specificity, accuracy (ACC) (Maroco et al., 2011). In order to avoid the correlation of the results, the training set contained 24 patients, and the testing set contained other 7 patients. The 10-folds cross-validation strategies were applied to estimate the classification performance of the method. The 50 images were randomly split into 10 subsets, each from random set of 5 images. The final statistical results for characterization of plaques component were then calculated based on each testing subset data. After the cross-validation, mean, standard deviation (SD) and median values were computed from the 10 testing set estimations of overall classification accuracy. All statistical analyses were conducted by using Matlab R2018a and related toolboxes (MathWork^®, Natick, MA, United States): image processing^TM and Parallel Computing^TM toolboxes.

Results

Reproducibility of OCT Images Annotations

Figure 6 illustrates the reproducibility results for the two annotations of the three plaque components by the two experts. Both annotation area1 and annotation area2 were in good agreement and displayed a strong linear trend (R² = 0.99). The fit lines had slopes of 1.02, and y-intercepts of 0.06 mm² (Figure 6B). A Bland-Altman statistic did not show bias together with narrow limits of agreement (Figure 6A).

FIGURE 6

Figure 6. Reproducibility results. (A) Regression analysis. (B) Bland–Altman plots showing agreement between observers for annotation area.

Manual vs Automatic Classification Result

The annotation results of the two experts show that excellent reproducibility of three plaque components based on the histology slices. Therefore, we choose the annotation result of expert 1 as the benchmark. Figure 7 illustrates examples of the automated classification results compared with histology, respectively, as well as manual annotation.

FIGURE 7

Figure 7. Three groups of manual and automated results. (A1,B1,C1) are cross-sectional OCT images from different carotid samples. (A2,B2,C2) are corresponding manual annotation results by expert 1. (A3,B3,C3) are automated annotation results by the algorithm. Color coding: green = fibrous tissue, white = calcified tissue, red = lipid tissue. (A4,B4,C4) are the corresponding histology images.

Accuracy of Carotid Plaque Classification

Table 2 shows the classification accuracy, sensitivity and specificity of the three plaque components using individual feature set and the combined feature set. The accuracy for the classification of the calcified tissue was lower than those of the fibrous and the lipid tissues. In general, moderate quantitative results were obtained with each individual feature set. The classification results of the three tissue types affect each other, in other words, each type tissue may be misclassified into the other two types. Especially, the fibrous components were often misclassified as the lipid components and vice versa. The highest and lowest classification accuracy of three tissue components were the lipid tissue (83.1%) and the calcified tissue (62.0%) using combination feature, respectively.

TABLE 2

Table 2. Results for each feature set of OCT image compared to the histology.

Results of Cross Validation

The results of the 10-folds cross validation are shown in Table 3, which reports mean, standard deviation and median values of the estimates of each classification accuracy. Compared to the fibrous tissue, classification accuracy of calcified and lipid tissue appeared a larger range. The fuse feature set (ALL) obtained the best compromising results between the three plaque tissues.

TABLE 3

Table 3. Result of 10 fold cross validation analysis.

Discussion

In this paper, we presented an algorithm for the characterization of atherosclerotic plaque components in OCT images and the validation using ex vivo carotid plaque tissue (Figure 2).

The present study shows an important finding that the combination of the optical parameters, the texture features and relative position can improve the quantification results, and the validation procedures further facilitated image interpretation. Different methods tend to extract different features, for example, the optical parameters reflect the relationship between the light and the plaque tissue in term of the physical or chemical properties, whereas the texture features reflect the spatial interrelationship of different tissue types. All misclassified tissue types were associated with the other two tissue types (e.g., the calcified tissue was often misclassified as the fibrous and the lipid tissues). The occurrence of the misclassification is mainly due to the blurring of the boundaries of the three main components. Although the literature indicates that the calcified region has a clear boundary, it is difficult to annotate an accurate tissue map in the pixel-wise way. In addition, more feature parameters may be needed to interpret the heterogeneity of OCT tissue components and further distinguish the plaque components.

Recently, CNN have shown remarkable success in medical image processing tasks such as disease classification (Kim et al., 2012), tumor segmentation (Kamnitsas et al., 2017; Harangi, 2018). Abdolmanafi et al. (2017, 2018) used CNN as feature extraction to characterize the layers of coronary arteries and the classification rate was up to 96% of second layer media. Later, they further classified the coronary artery pathological formations (calcification, fibrosis, normal intima, macrophage, media, neovascularization) using CNN as feature extractor, random forest as classifier and majority voting as classification calculation. Gessert et al. (2019) architected the ResNet50-32 and DenseNet-121 network in the different concatenation points and investigated the optimal abstraction level of feature fusion of polar and Cartesian OCT images. The result showed the combined model performed with an accuracy of 91.7%, a sensitivity of 90.9%, and a specificity of 92.4% of the plaque detection in OCT pullbacks. Tissue characterization by OCT images mainly relies on segmentation which is a necessary step for treatment planning in percutaneous coronary intervention (PCI). So far, the studies on the segmentation of plaque components in OCT images using deep learning approaches are very limited. The present study used histology slices as gold standard to annotate the training and testing images, which is a valuable contribution to the interpretation of OCT images and it demonstrates the feasibility of machine learning for plaque components segmentation. This study may provide a foundation for future deep learning-based OCT images classification studies, which will provide a useful tool for the identification of vulnerable plaques and aid the risk stratification of patients with luminal stenosis in the future.

Until now, most research has shown that an atherosclerotic plaque with a lipid or necrotic core and a thin fibrous cap is associated with an increased risk of plaque rupture and thrombus formation, resulting in an acute coronary event or progression of atherosclerosis (Havaei et al., 2017). Therefore, it is important to differentiate the fibrous and the necrotic tissue in order to distinguish a vulnerable and a stable plaque. The developed algorithm is able to characterize the difference between the fibrous and the lipid tissues, which can help in the identification of plaque vulnerability. In addition, fibrous cap rupture and subsequent plaque thrombosis are accompanied with a high macrophage content. Macrophages are inflammatory cells which lead the plaque destabilization by releasing proteolytic enzymes and other pro-inflammatory mediators. Moreover, macrophages tend to scatter light by large organelles (Di Vito et al., 2015). This leads to either a high attenuation coefficient or a high backscatter coefficient of OCT images. Therefore, a large lipid core is often accompanied by a large number of macrophages. Although some literature has shown that OCT is capable of identifying macrophages, the separation of the lipid tissue from the macrophage infiltration is still challenging. In other words, it is difficult to distinguish “poor signal” region in OCT images whether led by macrophage aggregation or infiltration or lipid tissue. In future studies, more data (histology sections and OCT images) may help to better classify the lipid tissues, inflammation regions etc.

Although this study is based on ex vivo CEA plaque samples, the OCT imaging of the various ex vivo plaque components is in agreement with those reported for in vivo studies (Mathews et al., 2011; Blackham et al., 2015). The effectiveness and efficiency of intravascular OCT imaging device were confirmed to be at least as good as the imaging information obtained from the ex vivo tissues and the OCT imaging was highly reproducible. In addition, the reproducibility of the imaging findings was obtained from arterial segments in patients and animals were identical in both in vivo and ex vivo images (Mathews et al., 2011). Therefore, it is possible to extend this study to the coronary arteries.

Despite the encouraging results, some limitations still remain. First, it was difficult to co-register OCT with histology because of the inherent differences in the longitudinal resolution between OCT (200 μm) and histology (4 μm). The limitation can be overcome by undertaking continuous histological slide preparation of vessel segments. Second, the data set annotation was performed according to the plaque components and shape of histology image using manual analysis by expert image readers as the ground truth. It is well known that the manual analysis of OCT images tends to cause inter-observer variability and intra-observer variability, and thus resulting in a relatively large deviation. Despite this, it is important to note that some studies have shown the influence of intra-observer on manual image analysis was scarce (Kini et al., 2017). Finally, this study is a single-center study with a relatively small study population. Future multicenter studies or a large amount of histological data would be required to fully test the developed algorithm before it can be used in clinical applications.

Conclusion

In this study, the combination of the optical parameters and the texture features of OCT images were extracted and used for characterization of carotid atherosclerotic tissue types. The algorithm was validated against histology slices, which were the “gold standard” as the evaluation criteria. This study shows that the developed approach can provide an effective tool for OCT-based plaque vulnerability assessment. Although the statistical results still need to be further improved before the computer-aided automatic segmentation method is applied in routine clinical practice, the fundamental research filled the gap in the quantification and characterization of atherosclerotic tissue types from OCT imaging.

Data Availability Statement

The datasets generated for this study are available on request to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by IEC for Clinical Research of Zhongda Hospital, Affiliated to Southeast University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

CH and ZhiL presented the concept and design of the work. CH performed lumen segmentation, the texture feature extraction and RF computations and drafted the manuscript. YH performed the optical parameters extraction. CH, JW, and YY analyzed the data. JW, ZhoL, and ZhiL provided suggestion and editing assistance. ZhiL critically revised the manuscript. All the authors approved the final version and made substantial contributions to this work.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors gratefully acknowledge financial support from the National Natural Science Foundation of China (Grant Nos. 11772093, 11972118, and 61821002) and ARC (FT140101152, DP200103492, and DP200101970).

References

Abdolmanafi, A., Duong, L., Dahdah, N., Adib, I. R., and Cheriet, F. (2018). Characterization of coronary artery pathological formations from OCT imaging using deep learning. Biomed. Opt. Express. 9, 4936–4957. doi: 10.1364/BOE.9.004936

PubMed Abstract | CrossRef Full Text | Google Scholar

Abdolmanafi, A., Duong, L., Dahdah, N., and Cheriet, F. (2017). Deep feature learning for automatic tissue classification of coronary artery using optical coherence tomography. Biomed. Opt. Express. 8, 1203–1220. doi: 10.1364/BOE.8.001203

PubMed Abstract | CrossRef Full Text | Google Scholar

Amini, A., Weymouth, T. E., and Jain, R. C. (1990). Using dynamic programming for solving variational problems in vision. IEEE Trans. Pattern Anal. Mach. Intell. 12, 855–867. doi: 10.1109/34.57681

CrossRef Full Text | Google Scholar

Arbab-Zadeh, A., and Fuster, V. (2015). The Myth of the “Vulnerable Plaque”: transitioning from a focus on individual lesions to atherosclerotic disease burden for coronary artery disease risk assessment. J. Am. Coll. Cardiol. 65, 846–855. doi: 10.1016/j.jacc.2014.11.041

PubMed Abstract | CrossRef Full Text | Google Scholar

Athanasiou, L. S., Bourantas, C. V., Rigas, G., Sakellarios, A. I., Exarchos, T. P., Siogkas, P. K., et al. (2014). Methodology for fully automated segmentation and plaque characterization in intracoronary optical coherence tomography images. J. Biomed. Opt. 19, 26009–26013. doi: 10.1117/1.JBO.19.2.026009

CrossRef Full Text | Google Scholar

Blackham, K. A., Kim, B. S., Jung, R. S., Badve, C., Manjila, S., Sila, C. A., et al. (2015). In vivo characterization of carotid neointimal hyperplasia by use of optical coherence tomography: before and after cutting balloon angioplasty. J. Neuroimag. 25, 1044–1049. doi: 10.1111/jon.12223

PubMed Abstract | CrossRef Full Text | Google Scholar

Breiman, L. (2001). Random forests. Mach. Learn. 45, 5–32. doi: 10.1023/A:1010933404324

CrossRef Full Text | Google Scholar

Christodoulou, C. I., Michaelides, S. C., and Pattichis, C. S. (2003a). Multifeature texture analysis for the classification of clouds in satellite imagery. IEEE Trans. Geosci. Remote Sens. 41, 2662–2668. doi: 10.1109/tgrs.2003.815404

CrossRef Full Text | Google Scholar

Christodoulou, C. I., Pattichis, C. S., Pantziaris, M., and Nicolaides, A. (2003b). Texture-based classification of atherosclerotic carotid plaques. IEEE Trans. Med. Imag. 22, 902–912. doi: 10.1109/tmi.2003.815066

PubMed Abstract | CrossRef Full Text | Google Scholar

Cicha, I., Wörner, A., Urschel, K., Beronov, K., Goppelt-Struebe, M., Verhoeven, E., et al. (2011). Carotid plaque vulnerability: a positive feedback between hemodynamic and biochemical mechanisms. Stroke 42, 3502–3510. doi: 10.1161/strokeaha.111.627265

PubMed Abstract | CrossRef Full Text | Google Scholar

Di Vito, L., Agozzino, M., Marco, V., Ricciardi, A., Concardi, M., Romagnoli, E., et al. (2015). Identification and quantification of macrophage presence in coronary atherosclerotic plaques by optical coherence tomography. Eur. Heart J.-Cardiovasc Imag. 16, 807–813. doi: 10.1093/ehjci/jeu307

PubMed Abstract | CrossRef Full Text | Google Scholar

Gessert, N., Lutz, M., Heyder, M., Latus, S., Leistner, D. M., Abdelwahed, Y. S., et al. (2019). Automatic plaque detection in IVOCT pullbacks using convolutional neural networks. IEEE Trans. Med. Imag. 38, 426–434. doi: 10.1109/tmi.2018.2865659

PubMed Abstract | CrossRef Full Text | Google Scholar

Girish, V., and Vijayalakshmi, A. (2004). Affordable image analysis using NIH Image/ImageJ. Ind. J. Cancer 41:47.

Google Scholar

Harangi, B. (2018). Skin lesion classification with ensembles of deep convolutional neural networks. J. Biomed. Inform. 86, 25–32. doi: 10.1016/j.jbi.2018.08.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., et al. (2017). Brain tumor segmentation with deep neural networks. Med. Image Anal. 35, 18–31. doi: 10.1007/978-3-319-75238-9_30

CrossRef Full Text | Google Scholar

Holzapfel, G. A., Sommer, G., Gasser, C. T., and Regitnig, P. (2005). Determination of layer-specific mechanical properties of human coronary arteries with nonatherosclerotic intimal thickening and related constitutive modeling. Am. J. Physiol. Hear. Circ. Physiol. 289, H2048–H2058. doi: 10.1152/ajpheart.00934.2004

PubMed Abstract | CrossRef Full Text | Google Scholar

Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., et al. (2017). Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Med. Image Anal. 36, 61–78. doi: 10.1016/j.media.2016.10.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, S. J., Lee, H., Kato, K., Yonetsu, T., Xing, L., Zhang, S., et al. (2012). Reproducibility of in vivo measurements for fibrous cap thickness and lipid arc by OCT. J. Am. Coll. Cardiol. 5, 1072–1074. doi: 10.1016/j.jcmg.2012.04.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Kini, A. S., Vengrenyuk, Y., Yoshimura, T., Matsumura, M., Pena, J., Baber, U., et al. (2017). Fibrous cap thickness by optical coherence tomography in vivo. J. Am. Coll. Cardiol. 69, 644–657. doi: 10.1016/j.jacc.2016.10.028

PubMed Abstract | CrossRef Full Text | Google Scholar

Lantos, C. (2014). Model-based imaging approach to quantify tissue structural properties in optical coherence tomography. Ph.D. dissertation, Dept. Biomed Eng, Houston Univ: Texas, TX.

Google Scholar

Lekadir, K., Galimzianova, A., Betriu, A., Del Mar, Vila, M., Igual, L., et al. (2017). A convolutional neural network for automatic characterization of plaque composition in carotid ultrasound. IEEE J. Biomed. Health Inform. 21, 48–55. doi: 10.1109/jbhi.2016.2631401

PubMed Abstract | CrossRef Full Text | Google Scholar

Levitz, D., Thrane, L., Frosz, M. H., Andersen, P. E., Andersen, C. B., Valanciunaite, J., et al. (2004). Determination of optical scattering properties of highly-scattering media in optical coherence tomography images. Opt. Express. 12, 249–259. doi: 10.1364/opex.12.00024

CrossRef Full Text | Google Scholar

Li, Z. Y., Howarth, S. P., Tang, T., and Gillard, J. H. (2006a). How critical is fibrous cap thickness to carotid plaque stability?-a flow plaque interaction model. Stroke 37, 1195–1199. doi: 10.1161/01.str.0000217331.61083.3b

CrossRef Full Text | Google Scholar

Li, Z. Y., Howarth, S., Trivedi, R. A., U-King-Im, J. M., Graves, M. J., Brown, A., et al. (2006b). Stress analysis of carotid plaque rupture based on in vivo high resolution MRI. J. Biomech. 39, 2611–2622. doi: 10.1016/j.jbiomech.2005.08.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, J. Z., Zhang, L. D., and Yue, G. H. (2003). Fractal dimension in human cerebellum measured by magnetic resonance imaging. Biophys. J. 85, 4041–4046. doi: 10.1016/S0006-3495(03)74817-6

CrossRef Full Text | Google Scholar

Maroco, J., Silva, D., Rodrigues, A., Guerreiro, M., Santana, I., and de Mendonca, A. (2011). Data mining methods in the prediction of dementia: a real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests. BMC Res. Notes 4:299. doi: 10.1186/1756-0500-4-299

PubMed Abstract | CrossRef Full Text | Google Scholar

Mathews, M. S., Su, J., Heidari, E., Levy, E. I., Linskey, M. E., and Chen, Z. (2011). Neuroendovascular optical coherence tomography imaging and histological analysis. Neurosurgery 69, 430–439. doi: 10.1227/NEU.0b013e318212bcb4

PubMed Abstract | CrossRef Full Text | Google Scholar

Matsumoto, H., Yako, R., Masuo, O., Hirayama, K., Uematsu, Y., and Nakao, N. (2014). A case of in-stent neoatherosclerosis 10 years after carotid artery stent implantation: observation with optical coherence tomography and plaque histological findings. Neurol. Med. Chir. (Tokyo). 54, 139–144. doi: 10.2176/nmc.cr2013-0063

PubMed Abstract | CrossRef Full Text | Google Scholar

Popescu, D. P., Flueraru, C., Mao, Y. X., Chang, S., and Sowa, M. G. (2010). Signal attenuation and box-counting fractal analysis of optical coherence tomography images of arterial tissue. Biomed. Opt. Express 1, 268–277. doi: 10.1364/boe.1.000268

PubMed Abstract | CrossRef Full Text | Google Scholar

Qu, J., Macaulay, C., Lam, S., and Palcic, B. (1994). Optical properties of normal and carcinomatous bronchial tissue. Appl. Opt. 33, 7397–7405. doi: 10.1364/AO.33.007397

PubMed Abstract | CrossRef Full Text | Google Scholar

Regar, E., Gnanadesigan, M., Van der Steen, A. F., and van Soest, G. (2013). Quantitative optical coherence tomography tissue-type imaging for lipid-core plaque detection. JACC-Cardiovasc Interv. 6, 891–892. doi: 10.1016/j.jcin.2012.11.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Rico-Jimenez, J. J., Campos-Delgado, D. U., Villiger, M., Otsuka, K., Bouma, B. E., and Jo, J. A. (2016). Automatic classification of atherosclerotic plaques imaged with intravascular OCT. Biomed. Opt. Express 7, 4069–4085. doi: 10.1364/BOE.7.004069

PubMed Abstract | CrossRef Full Text | Google Scholar

Schindelin, J., Kusztos, F., and Schmid, B. (2016). ImageJ plugin. 2016 May 26. Available fromat: https://imagej.net/Segmentation_Editor. (accessed 10 September, 2019).

Google Scholar

Shah, P. K. (2003). Mechanisms of plaque vulnerability and rupture. J. Am. Coll. Cardiol. 41, 15S–22S. doi: 10.1016/s0735-1097(02)02834-6

CrossRef Full Text | Google Scholar

Soh, L. K., and Tsatsoulis, C. (1999). Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices. IEEE Trans. Geosci. Remote Sens. 37, 780–795. doi: 10.1109/36.752194

CrossRef Full Text | Google Scholar

Stary, H. C., Chandler, A. B., Dinsmore, R. E., Fuster, V., Glagov, S., and Insull, W. Jr., et al. (1995). A definition of advanced types of atherosclerotic lesions and a histological classification of atherosclerosis: a report from the committee on vascular lesions of the council on arteriosclerosis. Am. Heart Association Circulation. 92, 1355–1374. doi: 10.1161/01.atv.15.9.1512

CrossRef Full Text | Google Scholar

Ughi, G. J., Adriaenssens, T., Sinnaeve, P., Desmet, W., and D’hooge, J. (2013). Automated tissue characterization of in vivo atherosclerotic plaques by intravascular optical coherence tomography images. Biomed. Opt. Express 4, 1014–1030. doi: 10.1364/BOE.4.001014

PubMed Abstract | CrossRef Full Text | Google Scholar

van der Meer, F. J., Faber, D. J., Baraznji Sassoon, D. M., Aalders, M. C., Pasterkamp, G., and van Leeuwen, T. G. (2005a). Localized measurement of optical attenuation coefficients of atherosclerotic plaque constituents by quantitative optical coherence tomography. IEEE Trans. Med. Imag. 24, 1369–1376. doi: 10.1109/tmi.2005.854297

PubMed Abstract | CrossRef Full Text | Google Scholar

van der, Meer FJ, Faber, D. J., Perrée, J., Pasterkamp, G., Sassoon, D. B., and van, Leeuwen TG (2005b). Quantitative optical coherence tomography of arterial wall components. Lasers Med. Sci. 20, 45–51. doi: 10.1007/s10103-005-0336-z

PubMed Abstract | CrossRef Full Text | Google Scholar

van Leeuwen, T. G., Faber, D. J., and Aalders, M. C. (2003). Measurement of the axial point spread function in scattering media using single-mode fiber-based optical coherence tomography. IEEE J. Sel. Top. Quantum Electron. 9, 227–233. doi: 10.1109/JSTQE.2003.813299

CrossRef Full Text | Google Scholar

van Soest, G., Goderie, T., Regar, E., Koljenović, S., van Leenders, G. L., and Gonzalo, N. (2010). Atherosclerotic tissue characterization in vivo by optical coherence tomography attenuation imaging. J. Biomed. Opt. 15:011105. doi: 10.1117/1.3280271

CrossRef Full Text | Google Scholar

Wang, Z., Chamie, D., Bezerra, H. G., Yamamoto, H., Kanovsky, J., Wilson, D. L., et al. (2012). Volumetric quantification of fibrous caps using intravascular optical coherence tomography. J. Biomed. Opt. 3, 1413–1426. doi: 10.1364/BOE.3.001413

PubMed Abstract | CrossRef Full Text | Google Scholar

Wang, Z., Kyono, H., Bezerra, H. G., Wang, H., Gargesha, M., Alraies, C., et al. (2010). Semiautomatic segmentation and quantification of calcified plaques in intracoronary optical coherence tomography images. J. Biomed. Opt. 15, 61711–61710. doi: 10.1117/1.3506212

CrossRef Full Text | Google Scholar

Xu, C. Y., Schmitt, J. M., Carlier, S. G., and Virmani, R. (2008). Characterization of atherosclerosis plaques by measuring both backscattering and attenuation coefficients in optical coherence tomography. J. Biomed. Opt. 13, 34003–34008. doi: 10.1117/1.2927464

CrossRef Full Text | Google Scholar

Yabushita, H., Bouma, B. E., Houser, S. L., Aretz, H. T., Jang, I. K., Schlendorf, K. H., et al. (2002). Characterization of human atherosclerosis by optical coherence tomography. Circulation 106, 1640–1645. doi: 10.1161/01.cir.0000029927.92825.f6

CrossRef Full Text | Google Scholar

Yun, S. H., Tearney, G. J., de Boer, J. F., and Bouma, B. E. (2004). Removing the depth-degeneracy in optical frequency domain imaging with frequency shifting. Opt. Express 12, 4822–4828. doi: 10.1364/opex.12.004822

PubMed Abstract | CrossRef Full Text | Google Scholar

Zimarino, M., Prati, F., Stabile, E., Pizzicannella, J., Fouad, T., Filippini, A., et al. (2007). Optical coherence tomography accurately identifies intermediate atherosclerotic lesions-an in vivo evaluation in the rabbit carotid artery. Atherosclerosis 193, 94–101. doi: 10.1016/j.atherosclerosis.2006.08.047

PubMed Abstract | CrossRef Full Text | Google Scholar