- 1Department of Medical Physics, University of Wisconsin, Madison, WI, United States
- 2Roy J. Carver Department of Biomedical Engineering, University of Iowa, Iowa, IA, United States
- 3Department of Animal Science, University of Wisconsin, Madison, WI, United States
- 4Department of Electrical and Computer Engineering, University of Iowa, Iowa, IA, United States
- 5Department of Radiation Oncology, University of Iowa, Iowa, IA, United States
- 6Department of Radiation Medicine, Oregon Health Sciences University, Portland, OR, United States
Vessel segmentation in the lung is an ongoing challenge. While many methods have been able to successfully identify vessels in normal, healthy, lungs, these methods struggle in the presence of abnormalities. Following radiotherapy, these methods tend to identify regions of radiographic change due to post-radiation therapytoxicities as vasculature falsely. By combining texture analysis and existing vasculature and masking techniques, we have developed a novel vasculature segmentation workflow that improves specificity in irradiated lung while preserving the sensitivity of detection in the rest of the lung. Furthermore, radiation dose has been shown to cause vascular injury as well as reduce pulmonary function post-RT. This work shows the improvements our novel vascular segmentation method provides relative to existing methods. Additionally, we use this workflow to show a dose dependent radiation-induced change in vasculature which is correlated with previously measured perfusion changes (R2 = 0.72) in both directly irradiated and indirectly damaged regions of perfusion. These results present an opportunity to extend non-contrast CT-derived models of functional change following radiation therapy.
1 Introduction
Vascular segmentation is an ongoing challenge. Several groups have attempted to develop robust vasculature segmentation algorithms. Of these, most models rely on knowledge about the features of vessels such as intensity, curvature, tubularity, centerline, and smoothness but all methods thus far face their own challenges (Jerman et al., 2015) (Sato et al., 1998) (Krissian et al., 2000) (Aylward and Bullitt, 2002) (Zhang et al., 2010) (Lavi et al., 2004) (Metz et al., 2007) (Buelow et al., 2005) (Agam et al., 2005) (Medical Imaging 2008: Image Processing, 2008).
In lung images, there is a natural contrast seen on CT imaging due to the high density difference between vessels and the lung parenchyma. Segmenting vessels in the lungs specifically has been addressed by various groups (Agam et al., 2005) (Xiao et al., 2011) (Shikata et al., 2004) (Medical Imaging 2008: Image Processing, 2008). However, all these methods struggle to address the issue that other structures besides vessels can have similar Hounsfield Unit (HU) intensities such as tumor nodules or dense lesions resulting from fibrosis, mucous, etc. Particularly, in regions of damaged lung, previous work has indicated that the algorithm struggles to distinguish damaged lung from vessel (Rudyanto et al., 2014).
Texture analysis presents an opportunity to identify particular radiographic abnormalities caused by medical intervention e.g. radiation therapy. These methods are robust and can identify several different textures in lung parenchyma such as ground glass, honeycombing, emphysema, consolidated, bronchovascular, and ground glass reticular (Uppaluri et al., 1997). In this work we use these texture analysis methods to improve upon existing vascular segmentation methods to produce a workflow capable of identifying vasculature accurately in the presence of damaged or abnormal lung tissue. Furthermore, we use this workflow to show a dose dependent radiation-induced change in vasculature which correlated with measured perfusion changes in both directly irradiated and indirectly damaged regions.
2 Methods
2.1 Swine model subject description
Previous studies have used the Wisconsin Miniature Swine (WMS) and detail their unique characteristics that make them an ideal model as well as show strong correlations between WMS and human response (Wallat et al., 2021) (Reed et al., 2010) (Wuschner et al., 2021a). In this work, two groups of five WMS (ten total) each received CT imaging and RT treatment. The swine ranged from 70–100 kg and were 14.4 ± 1.7 months of age. These two groups will be referred to as group A and group B, with differences between the groups described in the current section. All WMS were sedated to eliminate motion artifacts and mechanically ventilated to a consistent tidal volume of 1 L and respiratory rate of 15 breaths per minute matching the average tidal volume and respiratory rate of human subjects in a prospective clinical trial studying functional avoidance in the lung (NCT02843568). The animal care practices and all experimental procedures were approved by the University of Wisconsin Institutional Animal Care and Use Committee (IACUC). The drugs and methods of anesthesia and euthanasia were approved in compliance with American Veterinary Medical Association (AVMA) guidelines for anesthesia and euthanasia of swine. Both committees assured that all procedures were in compliance with ARRIVE guidelines.
2.1.1 Treatment schemes and imaging schedule
For all ten swine in groups A and B, CT images were acquired both pre- and 3 months post-RT. At each time point, subjects received a four-dimensional CT (4DCT) and dynamic contrast-enhanced perfusion scans. The dynamic perfusion scans were performed following the procedure detailed in Wuschner et al. (Wuschner et al., 2021a).
All subjects underwent a five fraction stereotactic body RT (SBRT) course of 12 Gy per fraction totaling 60 Gy, however the two groups of swine were treated with two different forms of image-guided radiation therapy, as described below. The differences in delivery system were due to clinical availability at the time of the study. Figure 1 shows a representative dose distribution that was delivered to subjects in each group. For all subjects, the contralateral lung did not receive dose above 5 Gy.
FIGURE 1. Delivered radiation dose distributions for WMS groups (A) and (B) show treatment differences. Group B had a more medial and cranial dose distribution with a smaller region of targeted high dose values.
In group A, the treatment planning target volume (PTV) was designated as the bifurcation of a vessel in the posterior base, near the left lateral chest wall, of the left lung. Treatment delivery was executed using an MRI-guided LINAC system (ViewRay, Cleveland Ohio) in order to maximize dose conformity and reduce the uncertainty of dose delivery due to respiratory motion. The ViewRay system continually monitors and gates treatment by acquiring 0.35 T MRI images and stopping treatment when the target is outside of the threshold view set.
For subjects in group B, the PTV was centered on a vessel and airway in the right upper lobe of the subject. This target location was selected to enable treatment response analysis to the directly irradiated vessels and distal pulmonary vasculature receiving moderate to low radiation doses. Treatments were delivered on the Radixact®linear accelerator with motion Synchrony treatment system (Accuray Incorporated, Sunnyvale, CA) in order to maximize dose conformity and reduce the uncertainty of dose delivery due to respiratory motion. Radixact®is a helical tomotherapy radiation therapy delivery system that contains an intrafraction motion management system called Synchrony®, which has been adapted from CK Synchrony (Schnarr et al., 2018). On the system, an x-ray tube and flat-panel kV imager are offset 90° from the megavoltage (MV) imager and beam. The kV imaging subsystem is used to periodically localize the target during treatment. For monitoring respiratory motion, light-emitting diodes (LEDs) were placed on the swines’ chest and identified with a camera mounted to the treatment table to provide the phase of respiration. The target can then be localized without implanted fiducials near the target using a motion correlation model. Further details of the model are described in Schnarr et al. (Schnarr et al., 2018).
For all swine, treatment fractions were delivered following a standard clinical SBRT schedule receiving each fraction with a day in between each delivery during weekdays and 2 days over the weekend. Subjects were mechanically ventilated to eight breaths per minute during treatments with inverted breathing to hold inhale longer than exhale.
2.2 Image analysis tools used
2.2.1 Feature-learning vascular segmentation
In the 2012 VESSEL12 Grand Challenge run in conjunction with the IEEE International Symposium on Biomedical Imaging, several different approaches to vascular segmentation on non-contrast CT were proposed (Rudyanto et al., 2014). The top scoring approach by Kiros et al. utilized multi-scale patch-based feature-learning and implements the sparse coding principles described by Coates et al. (Coates and Ng, 2011) (Kiros et al., 2014). Since this method does not require joint learning, features are learned efficiently and quickly (Kiros et al., 2014). Since the conclusion of the challenge, Konopczynski et al. have improved upon the work of Kiros et al. by extending the method to learn 3D features in an unsupervised manner in a multi-scale scheme using dictionary learning via least angle regression (Konopczynski et al., 2016). Their method improved upon the accuracy achieved by Kiros et al. from 96.66 ± 1.10% to 97.24 ± 0.90% on the principle VESSEL12 data set (Konopczynski et al., 2016). The VESSEL12 challenge separately evaluated the ability of segmentation methods to distinguish several types of dense abnormalities from vessels. The datasets for these categories consisted of non-contrast CT images that contained vessels in the presence of dense lesions, which include atelectasis, fibrosis, and adhesive straining, as well as mucus-filled bronchi, which are airways that instead of being clear, are filled with liquid such as mucus (Rudyanto et al., 2014). Many of these are characteristic of the radiographic change that is seen in post-RT radiotherapy patients. In these categories, the methods of Konopczynski et al. achieved a sensitivity of 0.95, but struggled in specificity (achieved 0.13) meaning it classified several things as vessels that were not. This code is open-source and is code that was used in the “Vessel Segmentation” step shown in Figure 3 (Rudyanto et al., 2014). The output of this code is a probability map that indicates the probability of a given voxel containing a vessel.
2.2.2 Texture analysis
To improve the specificity of the resulting vessel segmentation from the Konopczynski method described above, texture analysis was used to identify and remove false positives. The texture analysis method used is the Adaptive Multi-Feature Method (AMFM) developed by Uppaluri et al. at the University of Iowa (Uppaluri et al., 1997). This method classifies voxels of an input lung CT as one of seven textures: normal, ground glass, ground glass reticular, honeycombing, bronchvascular, emphysema, or consolidated.
The general procedure for performing the analysis is as follows. First, lung regions are identified on the CT scan using a multi-resolution convolutional neural network lung segmentaiton approach proposed by Gerard et al. (Gerard et al., 2020) (Gerard et al., 2021). Next, preprocessing was performed on the masked CT image using edgementation (Uppaluri et al., 1997). This method merges pixels in regions where the difference between the grey levels of adjacent pixels is small. From there, feature extraction is performed. The features extracted can be grouped into three categories; first order, second order, and the geometric fractal dimension. The first-order features were mean, variance, skewness, kurtosis, and grey-level entropy as described in Ferdeghini et al. (Ferdeghini et al., 1991). Eleven second order features were calculated. Five of these were derived from the run length matrix (short-run emphasis, long-run emphasis, grey-level non-uniformity, run-length non-uniformity, and run percentage) and the remaining six were derived from the co-occurrence matrix (angular second moment, entropy, inertia, contrast, correlation, and inverse difference moment) (Fleagle et al., 1994). The details of the geometric fractal dimension are detailed in Uppaluri et al. (Uppaluri et al., 1995). Each calculated feature is normalized for the size of the pixel and lung prior to optimal feature extraction. Optimal feature extraction is performed using the divergence method and correlation analysis with labeled training data that is classified as 1 of the seven textures by an experienced radiologist (Andrews and Swartzlander, 1973). Finally, classification is performed using a Bayesian classifier (Sonka et al., 1993).
Figure 2 shows the result of applying the AMFM texture analysis to a post-RT CT and masking it by voxels that were classified as vessels using the method described above. The vessel segmentation classifies several voxels in the area of the CT showing radiographic change as vessel that are likely false positives. Texture analysis shows that the voxels in this region are bronchovascular, consolidated, or ground-glass reticular which are expected radiation-induced textures. Therefore, by removing any voxels that are both classified as a vessel and classified by one of these textures, we can remove the false positives in the vessel segmentation.
FIGURE 2. Example of a post-RT CT scan showing radiographic damage (left frame), the resulting vessel segmentation (middle frame), and the texture classification for each voxel (right frame) that was classified as a vessel. The vessel segmentation classifies several voxels in the area of the CT showing radiographic change as vessel that are likely false positives. Texture analysis was performed over the entire lung and is shown masked by the voxels that were identified as vessel in the third panel. The textures of the voxels in the region of false-positives are bronchovascular, consolidated, or ground-glass reticular which are expected radiation-induced textures.
However it can also be seen that voxels that are clearly vessels in the right lung are classified as ground glass reticular. This is because the AMFM technique is designed to classify lung parenchyma, not vasculature. When the vasculature is large enough, the features of the vasculature are similar to that of ground glass reticular and thus they are classified as such. This does not occur with the smaller vasculature that are small enough such that their normalized do not classify as one of the removed textures. To address this, a third image processing step is needed to add back in the larger vasculature.
2.2.3 Lung and large vessel segmentation
To add in the larger vasculature, two lung masking techniques are used. The first is a multi-resolution convolutional neural network proposed by Gerard et al.to perform lung segmentation (Gerard et al., 2020) (Gerard et al., 2021). The lung segmentation produced by this generates a smooth boundary at the mediastinum which includes the large vessels filled in (see Figure 3). The second method is an optimal thresholding method which is utilized to generate a mask of well-aerated regions. The aerated mask is subsequently smoothed and small holes are filled using morphological operations thus leaving the large vasculature unmasked. The difference image between the lung segmentation and the aerated segmentation is used to identify large vasculature (Gerard, 2018).
FIGURE 3. Flowchart showing the workflow to produce vascular segmentations using the tools described.
2.3 Vascular segmentation workflow
The full vascular segmentation workflow is detailed in Figure 3. The 4DCT image is input into the vascular segmentation, AMFM texture, CNN lung segmentation, and aerated segmentation codes. The AMFM texture map is masked by the vessel segmentation such that only vessel classified voxels remain (determined using a threshold of p
2.4 Analysis of post-RT change
2.4.1 Group A
All post-RT scans were deformably registered to the pre-RT scan using a B-spline registration algorithm (Cao et al., 2012) (Yin et al., 2009). The transformation matrix produced in the registration was then applied to the post-RT vessel segmentation to allow for voxel-wise comparisons. Analysis was performed in four dose bins; voxels receiving “no dose” (
2.4.2 Group B
For the subjects in Group B, analysis was performed similarly to the subjects in Group A with the addition of analysis being split into direct and indirect change. The process for this analysis is summarized in Figure 4. Similarly to Group A, the pre and post-RT CTs are registered and the transformation matrix is used to bring the post-RT vessel map into the frame of reference of the pre-RT scan and dose distribution. However, in addition to masking by dose bin, the analysis is masked as being in either a “fed”, “not fed”, or “contralateral” region. Here “contralateral” refers to the left lung (left entirely unirradiated below 5 Gy), “fed” refers to regions that contain vasculature that branch from the vessel irradiated to the prescription dose, and “not fed” refers to regions that do not contain vasculature that branch from the vessel irradiated to the prescription dose. This results in 7 separate analysis regions (no, low, and medium dose in both the fed and not fed regions and the contralateral region). In each of these regions the percent change in volume of vasculature was calculated as described for group A using Eq. 1.
FIGURE 4. Flowchart showing the workflow to perform the indirect vascular change analysis using the tools described.
Additionally for these subjects, the perfusion change in each of the seven contours analyzed in the group B subjects was calculated from the contrast-CTs using the methodology described in Wuschner et al. (Wuschner et al., 2022).
3 Results
3.1 Improved vascular segmentation
An example of the vessel segmentation algorithm is shown in Figure 5. The post-RT original vessel segmentation classifies regions of radiographic change as vessel. When removing the ground glass reticular and bronchovascular voxels, in both the pre and post-RT examples it is observed that the larger vessels are no longer segmented. In the post-RT case it can also be seen that the radiographic change region is no longer classified as vessel. When large vasculature is added back in both pre and post-RT resultant vessel maps appear to be consistent with the vessels observed on the original CTs. Figures 6, 7 show the improvements made by the novel vessel segmentation in an axial slice of all of the subjects used in this work. In all subjects, it is clear that radiographic change is falsely classified as vessel in the original vessel segmentation method. This is further highlighted in Figure 8 where a side by side 3D rendering shows the effect of this false classification. The conventional method, in the regions denoted as having radiographic change, are so over-segmented that you cannot distinguish the true vasculature in this region and it just appears as a large condensed structure. However, when using the novel segmentation workflow presented in this work, we see that it appears specificity is improved in those regions of radiographic change while preserving the sensitivity of the segmentation in the rest of the lung. The improved workflow 3D rendering shows a connected vascular tree in these regions. In the group B swine, the result is more subtle but this is due to the fact that the radiographic change in these swine was not as drastic as the group A swine in a single axial slice. This is due to the differences in dose distribution delivered as well as differences in the size of vasculature irradiated.
FIGURE 5. Example of the vessel segmentation algorithm results for a pre-RT (top row) and post-RT (bottom row) example. From left to right: the original CT, the vessel segmentation denoting voxels classified as vessels in green, the result of removing voxels that were classified as both vessels and either ground glass reticular or bronchovascular (red), and finally the result of adding back in the large vessels (blue).
FIGURE 6. Segmentation results in the five Group (A) swine. Each column represents a subject where the top row shows the post-RT CT image in an axial slice showing the post-RT radiographic change. The middle row shows the original vessel segmentation overlayed on the CT in red which in all subjects classified damaged regions of the lung as vessel. The bottom row shows the result of the novel vessel segmentation workflow overlayed on the CT in green. In all subjects, the apparent quality of the vessel segmentation improves in the regions of radiographic change as indicated by the reduction in large connected regions being identified. The resulting segmentation appears to align with vessels that can be observed in the CT in both irradiated and non-irradiated regions.
FIGURE 7. Segmentation results in the five Group (B) swine. Each column represents a subject where the top row shows the post-RT CT image in an axial slice showing the post-RT radiographic change. The middle row shows the original vessel segmentation overlayed on the CT in red which in all subjects classified damaged regions of the lung as vessel. The bottom row shows the result of the novel vessel segmentation workflow overlayed on the CT in green. In all subjects, the apparent quality of the vessel segmentation improves in the regions of radiographic change as indicated by the reduction in large connected regions being identified. The resulting segmentation appears to align with vessels that can be observed in the CT in both irradiated and non-irradiated regions.
FIGURE 8. Example cropped 3D Rendering of an example subject. Circled regions show where the CT showed radiographic change post-RT. We see the result of the over-segmentation in the conventional method and the improvement on this using the proposed method.
3.2 Post-RT changes in vasculature
Figure 9 and Table 1 show a summary of the percent changes in volume of vessel in each of the dose bins. For the group B subjects, analysis is not split into fed and not fed regions in this figure. Each point on the graph is plotted at the center of the dose bin it represents and is the average percent change of the five subjects analyzed (Group A or Group B) or 10 subjects analyzed (All Swine). All data sets show strong linear correlation with dose where the reduction in vascular volume increases with increasing dose. However, there is a difference in behavior between Group A and Group B where Group A shows minimal change in the unirradiated dose bin (-3.3 ± 3.8%) while Group B shows a large change (-17.8 ± 5.3%).
FIGURE 9. Summary of percent changes in vessel volume as a function of dose. All groups show increasing reductions in vessel volume with increasing dose however the magnitude of the changes differs in behavior between groups (A) and (B). Group (A) shows minimal change in the unirradiated dose bin while Group (B) shows a large change.
TABLE 1. Summary of percent changes in vessel volume. Values in table are entered as average (standard deviation) of the 10 swine (all swine) or of the five swine (Group A or Group B). Statistically significant values (p
Figure 10 and Table 2 show a summary of the percent changes in volume of vessel in each of the dose bins with the additional group B analysis. All data sets still show strong linear correlation with dose where the reduction in vascular volume increases with increasing dose. The percent changes in the not fed regions are very similar to the group A percent changes while the fed regions show significantly higher magnitudes of change.
FIGURE 10. Summary of the percent changes in volume of vessel in each of the dose bins for the group (A) swine (all not fed), group (B) swine, and split group (B) swine results masked by being in a fed or not fed region. All data sets show strong linear correlation with dose where the reduction in vascular volume increases with increasing dose. The percent changes in the not fed regions are very similar to the group (A) percent changes while the fed regions show significantly higher magnitudes of change.
TABLE 2. Summary of percent changes in vessel volume. Values in table are entered as average (standard deviation) of the five swine in each group. Statistically significant values (p
3.3 Correlation of vasculature and perfusion change
Figure 11 and Table 3 show the relation between the percent change in vessel volume and the percent change in perfusion with each analysis contour labeled. The percent change in perfusion values were analyzed on the same subjects and same contours and were previously reported in Wuschner et al. (Wuschner et al., 2022). The perfusion study showed an indirect effect where the fed vessels, regardless of dose, experienced large, statistically significant compared to pre-RT, perfusion reductions. However, the not fed vessels did not experience statistically significant changes except in the mid dose vessels indicating that the perfusion reduction was dose dependent (in the case of not fed regions) but also dependent on location relative to highly irradiated regions (fed regions). The contralateral lung in the perfusion study experienced no statistically significant perfusion change. A line of best fit is drawn on Figure 11 and shows good correlation (R2 = 0.726) between the perfusion study results from our previous study, and the vascular change results in this study.
FIGURE 11. Change in vessel volume vs change in perfusion. Each point represents a different analysis contour and is the average of the five swine subjects with error bars representing the standard deviations in each metric.
TABLE 3. Summary of vessel volume percent change and perfusion percent change in each contour analyzed. Data in the table is the same as the data shown in Figure 11. Entries are written as the average (standard deviation) of the five subjects. Perfusion results are as reported in Wuschner et al. (Wuschner et al., 2022). Statistically significant values (p
4 Discussion
4.1 Improvements of vessel segmentation method
It can be noted that the results presented in this section are all qualitative. While the qualitative results are convincing and encouraging, we recognize that future work should involve further validation of this method using a quantitative analysis. To our knowledge however, there is no publicly available labeled ground-truth data-set for vascular segmentation in the presence of radiation-induced radiographic change or other similar high density lung damage that could be confused as vessel using standard segmentation methods. The only available ground-truth we are aware of only labels vasculature in normal healthy lungs which will not test the novelty of our segmentation workflow.
With this acknowledged, Figure 5 shows a clear qualitative improvement in accuracy in the segmentation. In the post-RT scan there is clear radiographic change in the slice shown in the right lung. The original vessel segmentation shown in green identifies this radiographic change as vasculature. This misclassification was consistent across subjects and highlights the limitations to using the vessel segmentation method developed by Konopczynski et al. (Konopczynski et al., 2016) alone.
In Figure 2 another example of this mis-classification is shown in the middle pane where the regions denoted in orange pick up radiographic damage in the left lung. This figure further shows the texture correspondence in these regions using the AMFM texture analysis where it is clear that the dorsal regions of the left lung, where the radiographic change and false vessel classification is observed, is comprised of ground glass reticular and bronchovascular textures. The effect of removing vessels of this classification is shown in the third pane from the left in Figure 5. It appears through qualitative inspection that the specificity is improved in the region showing radiographic change but in both the pre and post-RT cases the sensitivity is reduced in the detection of large vessels. Finally, the final pane shows the result of the third step where large vessels are added back in. Here we see the apparent quality of the vessel segmentation improves in both irradiated and non-irradiated regions and is now consistent with the observable vessels on the CT image.
Particularly to note, is that in the pre-RT scan, the original and final segmentations appear identical. This confirms for us that the step of removing textures is only necessary to reduce the false positives in the case of abnormal radiographic features. In this work where the swine lungs were healthy at pre-RT this serves to remove radiation-induced damage, but in the case of human subjects who may have lungs with pre-existing disease, this could be extended for use in pre-RT scans as well.
4.2 Changes in vasculature
All results show a linear relation between increasing dose and decreasing vessel volume suggesting that radiation dose causes vascular volume reduction. Potential mechanisms of this include constriction and atrophy. Vascular atrophy has already been observed in the Group A swine and the direct effects of this atrophy on perfusion were reported previously (Wuschner et al., 2021a). Pathological analysis on these swine has confirmed a loss of structure in the vascular wall in addition to reporting additional mechanisms of constriction as well as confirming the intraparenchymal hemorrhage hypotheses reported in (Wuschner et al., 2021a), (Wuschner et al., 2022), and (Marks et al., 2003) where vascular leakage was observed as a result of radiation dose delivered (Wuschner et al., 2021b).
However, there are a few differences between analysis groups that suggest unique physiological characteristics. Figure 10 shows the difference between the fed and not fed regions that received the same dose. The “fed” region receiving the same dose as the corresponding “not fed” region showed significantly larger magnitudes of reduction in vessel volume. We believe this to be indication of an “indirect effect” where regions receiving no or minimal dose experience large functional declines. This effect has been observed previously in several studies (Wallat et al., 2021) (Vicente et al., 2020) (Thomas et al., 2019) (Farr et al., 2018).
Furthermore, the results of the “not fed” regions agree closely with the results of the group A swine who were irradiated in an inferior region of the lung. This means the region irradiated in the group A swine was centered on a small vessel that did not bifurcate multiple times to feed additional vasculature. These swine did not even have regions that were “fed” and received no dose and some did not have vessels irradiated that were “fed” and irradiated to low dose. These swine therefore, only experienced direct damage where the damage to the region is dependent primarily to the dose it received. This is also true of the “not fed” regions in the group B swine. However, the “fed” regions of the group A swine are also dependent on the dose to feeding vasculature; meaning if there is morphological change in the anatomy of a vessel that feeds the region, there will be downstream reduction in perfusion.
4.3 Correlation between vessel and perfusion change
Figure 11 shows a strong correlation exists between the observed reductions in vasculature and the observed reductions in perfusion (R2 = 0.72). These results suggest that the change in vessel volume (a metric derived from a standard simulation 4DCT), is related to the change in perfusion to a region. Physiologically, this makes sense. Perfusion refers to the flow of blood through the capillary network surrounding the alveolar sacs. If the vascular tree is atrophied and blood cannot reach these capillaries, perfusion will reduce. Furthermore, the indirect effect will be magnified in the fed regions if blood leaks out of the vasculature several bifurcations prior to additional vasculature which supports why the percent changes in vessel volume are smaller than the percent changes in perfusion.
This combined with the dose dependency results shown in this work as well as our previous work (Wuschner et al., 2022) suggests that with enough subjects, a dose response model could be developed using the vascular tree as an input to predict the decline in perfusion to a region based on the dose it receives and the proximity of it to other locations receiving high dose on the vascular tree. This would allow for predictions in functional perfusion information to be made without the need for contrast.
This is a benefit for many reasons. The first benefit is for ease of integration into clinical workflow. Lung radiotherapy patients already receive a 4DCT in order to track lung motion and perform treatment planning. Previous perfusion studies have used methods such as SPECT or PET which require an additional scan and an injection of a radio-pharmaceutical (Ireland et al., 2007) (Farr et al., 2015a) (Thomas et al., 2019) (Marks et al., 2003) (Hopkins et al., 2012). The vascular maps can be derived from the same scans that are already used for treatment. While there are CT-derived perfusion scans, these all require the administration of iodine contrast. While being an additional step in clinical workflow, iodine can also be damaging to patient’s kidneys which is particularly important in the case of cancer patients who may already have compromised baseline renal function. Finally, these perfusion scans have limited field of view which limits the region of analysis and the number of vessels that can be analyzed. This leads to a large degree of variability in the perfusion derived measurements. This can be observed in Table 3 where the vessel change measurements have smaller standard deviations than the perfusion change measurements due to being able to analyze more vessels in the regions.
4.4 Comment on variability
There was a large degree of variability in these measurements as shown by the error bars on the plot in Figure 11 and those listed in Table 3. It is important to note that the sample size of this study was limited to only five subjects for this particular analysis since only the Group B swine were irradiated with enough distal vasculature and tissue to allow for this analysis. Notes on variations in response between subjects and potential causes for the large standard deviations in the perfusion work have previously been described by Wuschner et al. (Wuschner et al., 2022) and are applicable here as well. Future work should include extending this analysis to a larger pool of subjects to minimize the sensitivity of the average measurement to a single subject. Additionally, the new workflow, while it appears to yield a promising improvement, does still contain minor error which could contribute to some variability as well. Some of these errors can be visualized in Figure 5 where in the sub-pleural regions there are small regions segmented that do not look like vessels in the CT. This is likely due to errors in the aerated masking technique that struggles with damage that is so peripheral in the lung.
4.5 Application to functional avoidance radiation therapy
Lung cancer is one of the most commonly diagnosed cancers and is currently responsible for the highest percentage of cancer related deaths (American Cancer Society, 2022). A significant portion of these patients receive radiation therapy (RT) as part of their treatment depending on the stage of their cancer (American Cancer Society, 2022). However, many of these patients experience radiation-induced lung injuries as a result of treatment which decrease patient quality of life and can even be fatal (Marks et al., 2003).
Conventional methods use volumetric dose constraints to minimize toxicities, however these methods do not consider the local function of the lung which has been reported to be locally dependent and different by individual (Siva et al., 2015) (Farr et al., 2015b) (Faught et al., 2017) (Bates et al., 2009) (Vinogradskiy et al., 2013) (Yamamoto et al., 2011) (Shioyama et al., 2007).
Functional avoidance in RT treatment planning aims to do consider these personalized local dependencies by selectively avoiding high functioning regions of the lung. To do this, detailed dose response models are required. In recent years, multiple groups have begun developing these models and some have tested their efficacy in clinical trials (McDonald et al., 1995) (Mah and Dyk, 1988) (Mehta, 2005) (Graves et al., 2010) (Patton et al., 2018) (Koike et al., 2015) (Hopkins et al., 2012) (Zhang et al., 2010) (Vinogradskiy et al., 2013) (Wallat et al., 2020) (Wallat et al., 2021) (Bates et al., 2009) (Hoover et al., 2014) (Ireland et al., 2016) (Vicente et al., 2020). To date, the only prospective clinical trials using these techniques have been ventilation-based (Bayouth et al., 2019) and all non-contrast CT-derived methods have been exclusively ventilation based (Patton et al., 2018) (Vinogradskiy et al., 2013) (Vicente et al., 2020) (Castillo et al., 2021). This does not create a comprehensive model to accurately model the function regions that need avoidance. Perfusion based trials have been performed, however they have all been retrospective and utilized scans outside of normal clinical workflow which poses challenges as described previously (Ireland et al., 2007) (Siva et al., 2015) (Farr et al., 2015a) (Thomas et al., 2019). Having a bio-marker that can derive perfusion information from the same standard of care CT would allow for a more comprehensive model of function to be developed and tested in prospective clinical trials. Future work should involve performing these measurements on a large cohort of subjects to build a model then testing that model in a prospective clinical trial.
5 Conclusion
In this work we present a novel vascular segmentation workflow that shows significant observable improvements. Through qualitative inspection, it appears there is an improvement in accuracy in the presence of damage or abnormal radiographic features on a CT. Additionally we use this method to demonstrate a strong dose-response relationship on the morphology of segmented vasculature post-RT. Finally, we show that these measurements correlate with previously reported perfusion changes in the same subject cohort which presents an opportunity for this method to be a non-contrast CT-derived bio-marker for functional perfusion change. While future work should fully validate the method proposed via quantitative analysis, this work presents numerous potential benefits towards the advancement of functional avoidance treatment planning.
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The animal study was reviewed and approved by University of Wisconsin Institutional Animal Care and Use Committee.
Author contributions
Conceptualization, AW, J.R, GC, MF, EW, JB; methodology, AW, DS, JB; software, GC, EW, SG; validation, AW; formal analysis, AW; resources,JB.; data curation, AW, MF, EW, SG; writing—original draft preparation, AW; writing—review and editing, JB, MF, EW, JR, GC, SG; supervision, JB.; project administration, JB.; funding acquisition, JB. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the National Institutes of Health grant CA166703.
Acknowledgments
The authors would like to thank the following people: Jen Meudt and the students of the University Wisconsin Veterinary school for their assistance with animal husbandry, Accuray for providing a Radixact system for research purposes and assisting with technical support on the system throughout the swine treatments, and Jessica Miller and Michael Lawless for their assistance in developing the Dynamic Contrast CT protocol.
Conflict of interest
JR is a shareholder in VIDA Diagnostics, Inc., GC receives licensing fees from VIDA Diagnostics, Inc., and JB has ownership interest in MR Guidance, LLC.
MR Guidance has business activity with ViewRay, Inc., and while this project was not sponsored in any way by ViewRay, data were collected on the ViewRay MRIdian system.
Data were collected on a Radixact system (Accuray, Inc.) provided to UW-Madison under a research agreement (JB, PI)
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Agam G., Armato S., Wu C. (2005). Vessel tree reconstruction in thoracic CT scans with application to nodule detection. IEEE Trans. Med. Imaging 24, 486–499. doi:10.1109/TMI.2005.844167
Andrews H. C., Swartzlander E. E. (1973). Introduction to mathematical techniques in pattern recognition. IEEE Trans. Syst. Man, Cybern. SMC-3, 302. doi:10.1109/TSMC.1973.4309231
Aylward S., Bullitt E. (2002). Initialization, noise, singularities, and scale in height ridge traversal for tubular object centerline extraction. IEEE Trans. Med. Imaging 21, 61–75. doi:10.1109/42.993126
Bates E. L., Bragg C. M., Wild J. M., Hatton M. Q., Ireland R. H. (2009). Functional image-based radiotherapy planning for non-small cell lung cancer: A simulation study. Radiother. Oncol. 93, 32–36. doi:10.1016/j.radonc.2009.05.018
Bayouth J., Wallat E., Wuschner A., Flakus M., Patton T., Shao W., et al. (2019). Longitudinal changes in lung tissue elasticity following radiation therapy. San Antonio, Tx: AAPM Annual Meeting.
Buelow T., Wiemker R., Blaffert T., Lorenz C., Renisch S. (2005). “Automatic extraction of the pulmonary artery tree from multi-slice CT data,” in Proceeding of the Medical Imaging 2005: Physiology, Function, and Structure from Medical Images (SPIE), San Diego, California, United States, April 2005, 730. vol. 5746. doi:10.1117/12.595286
Cao K., Ding K., Reinhardt J. M., Christensen G. E. (2012). Improving intensity-based lung CT registration accuracy utilizing vascular information. Int. J. Biomed. Imaging 2012, 1–17. doi:10.1155/2012/285136
Castillo E., Nair G., Turner-Lawrence D., Myziuk N., Emerson S., Al-Katib S., et al. (2021). Quantifying pulmonary perfusion from non-contrast computed tomography. Med. Phys. 48, 1804–1814. doi:10.1002/mp.14792
Coates A., Ng A. Y. (2011). “The importance of encoding versus training with sparse coding and vector quantization,” in Proceedings of the 28th International Conference on International Conference on Machine Learning, Bellevue, Washington, USA (Bellevue, WA: OmniPress), 921–928.
Farr K. P., Kallehauge J. F., Møller D. S., Khalil A. A., Kramer S., Bluhme H., et al. (2015). Inclusion of functional information from perfusion SPECT improves predictive value of dose–volume parameters in lung toxicity outcome after radiotherapy for non-small cell lung cancer: A prospective study. Radiother. Oncol. 117, 9–16. doi:10.1016/j.radonc.2015.08.005
Farr K. P., Møller D. S., Khalil A. A., Kramer S., Morsing A., Grau C. (2015). Loss of lung function after chemo-radiotherapy for NSCLC measured by perfusion SPECT/CT: Correlation with radiation dose and clinical morbidity. Acta Oncol. 54, 1350–1354. doi:10.3109/0284186X.2015.1061695
Farr K. P., Khalil A. A., Møller D. S., Bluhme H., Kramer S., Morsing A., et al. (2018). Time and dose-related changes in lung perfusion after definitive radiotherapy for NSCLC. Radiother. Oncol. 126, 307–311. doi:10.1016/j.radonc.2017.11.008
Faught A. M., Miyasaka Y., Kadoya N., Castillo R., Castillo E., Vinogradskiy Y., et al. (2017). Evaluating the toxicity reduction with computed tomographic ventilation functional avoidance radiation therapy. Int. J. Radiat. Oncol. Biol. Phys. 99, 325–333. doi:10.1016/j.ijrobp.2017.04.024
Ferdeghini E. M., Pinamonti B., Picano E., Lattanzi F., Bussani R., Slavich G., et al. (1991). Quantitative texture analysis in echocardiography: Application to the diagnosis of myocarditis. J. Clin. Ultrasound 19, 263–270. doi:10.1002/jcu.1870190503
Fleagle S. R., Stanford W., Burns T., Skorton D. J. (1994). Feasibility of quantitative texture analysis of cardiac magnetic resonance imagery: Preliminary results, 23–32. doi:10.1117/12.174416
Gerard S. E. (2018). Multi-scale convolutional neural networks for segmentation of pulmonary structures in computed tomography. Ph.D. thesis. Iowa City: University of Iowa.
Gerard S. E., Herrmann J., Kaczka D. W., Musch G., Fernandez-Bustamante A., Reinhardt J. M. (2020). Multi-resolution convolutional neural networks for fully automated segmentation of acutely injured lungs in multiple species. Med. Image Anal. 60, 101592. doi:10.1016/j.media.2019.101592
Gerard S. E., Herrmann J., Xin Y., Martin K. T., Rezoagli E., Ippolito D., et al. (2021). CT image segmentation for inflamed and fibrotic lungs using a multi-resolution convolutional neural network. Sci. Rep. 11, 1455. doi:10.1038/s41598-020-80936-4
Graves P. R., Siddiqui F., Anscher M. S., Movsas B. (2010). Radiation pulmonary toxicity: From mechanisms to management. Semin. Radiat. Oncol. 20, 201–207. doi:10.1016/j.semradonc.2010.01.010
Hoover D. A., Capaldi D. P., Sheikh K., Palma D. A., Rodrigues G. B., Dar A. R., et al. (2014). Functional lung avoidance for individualized radiotherapy (FLAIR): Study protocol for a randomized, double-blind clinical trial. BMC Cancer 14, 934. doi:10.1186/1471-2407-14-934
Hopkins S. R., Wielpütz M. O., Kauczor H. U. (2012). Imaging lung perfusion. J. Appl. Physiol. 113, 328–339. doi:10.1152/japplphysiol.00320.2012
Ireland R. H., Bragg C. M., McJury M., Woodhouse N., Fichele S., van Beek E. J., et al. (2007). Feasibility of image registration and intensity-modulated radiotherapy planning with hyperpolarized helium-3 magnetic resonance imaging for non–small-cell lung cancer. Int. J. Radiat. Oncol. Biol. Phys. 68, 273–281. doi:10.1016/j.ijrobp.2006.12.068
Ireland R., Tahir B., Wild J., Lee C., Hatton M. (2016). Functional image-guided radiotherapy planning for normal lung avoidance. Clin. Oncol. 28, 695–707. doi:10.1016/j.clon.2016.08.005
Jerman T., Pernuš F., Likar B., Špiclin Z. (2015). Beyond frangi: An improved multiscale vesselness filter. doi:10.1117/12.2081147
Kiros R., Popuri K., Cobzas D., Jagersand M. (2014). “Stacked multiscale feature learning for domain independent medical image segmentation,” in International workshop on machine learning in medical imaging, 25–32. doi:10.1007/978-3-319-10581-9-4
Koike H., Sueyoshi E., Sakamoto I., Uetani M. (2015). Quantification of lung perfusion blood volume by dual-energy CT in patients with and without chronic obstructive pulmonary disease. J. Belg. Soc. Radiol. 99, 62–68. doi:10.5334/jbr-btr.865
Konopczynski T., Kroger T., Zheng L., Garbe C. S., Hesser J. (2016). “Automated multiscale 3D feature learning for vessels segmentation in Thorax CT images,” in Proceedings of the 2016 IEEE Nuclear Science Symposium, Medical Imaging Conference and Room-Temperature Semiconductor Detector Workshop (NSS/MIC/RTSD), Strasbourg, France, October 2016 (IEEE). doi:10.1109/NSSMIC.2016.8069570
Krissian K., Malandain G., Ayache N., Vaillant R., Trousset Y. (2000). Model-based detection of tubular structures in 3D images. Comput. Vis. Image Underst. 80, 130–171. doi:10.1006/cviu.2000.0866
Lavi G., Lessick J., Johnson P. C., Khullar D. (2004). Single-seeded coronary artery tracking in CT angiography. IEEE Nucl. Sci. Symposium Conf. Rec. 5, 3308–3311. doi:10.1109/nssmic.2004.1466397
Mah K., Dyk V. (1988). Quantitative measurement of changes in human lung density following irradiation. Radiotherapy Oncol. 11, 169–179. doi:10.1016/0167-8140(88)90253-8
Marks L., Yu X., Vujaskovic Z., Smalljr W., Folz R., Anscher M. (2003). Radiation-induced lung injury. Semin. Radiat. Oncol. 13, 333–345. doi:10.1016/S1053-4296(03)00034-1
McDonald S., Rubin P., Phillips T. L., Marks L. B. (1995). Injury to the lung from cancer therapy: Clinical syndromes, measurable endpoints, and potential scoring systems. Int. J. Radiat. Oncol. Biol. Phys. 31, 1187–1203. doi:10.1016/0360-3016(94)00429-O
Medical Imaging 2008: Image Processing (2008). Medical Imaging 2008: Image Processing, 6914. San Diego, CA: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series.
Mehta V. (2005). Radiation pneumonitis and pulmonary fibrosis in non-small-cell lung cancer: Pulmonary function, prediction, and prevention. Int. J. Radiat. Oncol. Biol. Phys. 63, 5–24. doi:10.1016/j.ijrobp.2005.03.047
Metz C., Schaap M., Van Der Giessen A., Van Walsum T., Niessen W. (2007). “Semi-automatic coronary artery centerline extraction in computed tomography angiography data,” in Proceeding of the 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro - Proceedings, Arlington, VA, USA, April 2007 (IEEE), 856–859. doi:10.1109/ISBI.2007.356987
Patton T. J., Bayouth J. E., Bednarz B. P., Fain S. B., Reinhardt J. M., Smilowitz J. (2018). Quantifying and modeling radiation therapy-induced ventilation changes and investigating the robustness of 4DCT-based functional avoidance. Madison, WI: Tech. rep.
Reed J., Krueger C., Shanmuganayagam D., Crenshaw T., Reichert J., Parrish J. (2010). Wisconsin miniature swine. Madison, WI: Tech. rep.
Rudyanto R. D., Kerkstra S., van Rikxoort E. M., Fetita C., Brillet P. Y., Lefevre C., et al. (2014). Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: The VESSEL12 study. Med. Image Anal. 18, 1217–1232. doi:10.1016/j.media.2014.07.003
Sato Y., Nakajima S., Shiraga N., Atsumi H., Yoshida S., Koller T., et al. (1998). Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images. Med. Image Anal. 2, 143–168. doi:10.1016/S1361-8415(98)80009-1
Schnarr E., Beneke M., Casey D., Chao E., Chappelow J., Cox A., et al. (2018). Feasibility of real-time motion management with helical tomotherapy. Med. Phys. 45, 1329–1337. doi:10.1002/mp.12791
Shikata H., Hoffman E. A., Sonka M. (2004). “Automated segmentation of pulmonary vascular tree from 3D CT images,” in Proceeding of the Medical Imaging 2004: Physiology, Function, and Structure from Medical Images (SPIE), San Diego, California, United States, April 2004, 107. vol. 5369. doi:10.1117/12.537032
Shioyama Y., Jang S. Y., Liu H. H., Guerrero T., Wang X., Gayed I. W., et al. (2007). Preserving functional lung using perfusion imaging and intensity-modulated radiation therapy for advanced-stage non–small cell lung cancer. Int. J. Radiat. Oncol. Biol. Phys. 68, 1349–1358. doi:10.1016/j.ijrobp.2007.02.015
Siva S., Thomas R., Callahan J., Hardcastle N., Pham D., Kron T., et al. (2015). High-resolution pulmonary ventilation and perfusion PET/CT allows for functionally adapted intensity modulated radiotherapy in lung cancer. Radiother. Oncol. 115, 157–162. doi:10.1016/j.radonc.2015.04.013
Sonka M., Hlavac V., Boyle R. (1993). Image processing analysis and machine vision chapman. Iowa City, IA: Hall Computing, 112–178.
Thomas H. M. T., Zeng J., Lee H. J., Sasidharan B. K., Kinahan P. E., Miyaoka R. S., et al. (2019). Comparison of regional lung perfusion response on longitudinal MAA SPECT/CT in lung cancer patients treated with and without functional tissue-avoidance radiation therapy. Br. J. Radiol. 92, 20190174. doi:10.1259/bjr.20190174
Uppaluri R., Mitsa T., Galvin J. R. (1995). Fractal analysis of high-resolution CT images as a tool for quantification of lung diseases, 133. doi:10.1117/12.209685
Uppaluri R., Mitsa T., Sonka M., Hoffman E. A., Lennan G. M. C. (1997). Quantification of pulmonary emphysema from lung computed tomography images. Am. J. Respir. Crit. Care Med. 156, 248–254. doi:10.1164/ajrccm.156.1.9606093
Vicente E., Modiri A., Kipritidis J., Hagan A., Yu K., Wibowo H., et al. (2020). Functionally weighted airway sparing (FWAS): A functional avoidance method for preserving post-treatment ventilation in lung radiotherapy. Phys. Med. Biol. 65, 165010. doi:10.1088/1361-6560/ab9f5d
Vinogradskiy Y., Diot Q., Kavanagh B., Schefter T., Gaspar L., Miften M. (2013). Spatial and dose-response analysis of fibrotic lung changes after stereotactic body radiation therapy. Med. Phys. 40, 081712. doi:10.1118/1.4813916
Wallat E., Flakus M., Wuschner A., Shao W., Christensen G., Reinhardt J., et al. (2020). Modeling the impact of out-of-phase ventilation on normal lung tissue response to radiation dose. Med. Phys. 47, 3233–3242. doi:10.1002/mp.14146
Wallat E. M., Wuschner A. E., Flakus M. J., Christensen G. E., Reinhardt J. M., Shanmuganayagam D., et al. (2021). Radiation-induced airway changes and downstream ventilation decline in a swine model. Biomed. Phys. Eng. Express 7, 065039. doi:10.1088/2057-1976/ac3197
Wuschner A. E., Wallat E. M., Flakus M. J., Shanmuganayagam D., Meudt J., Christensen G. E., et al. (2021). Radiation-induced Hounsfield unit change correlates with dynamic CT perfusion better than 4DCT-based ventilation measures in a novel-swine model. Sci. Rep. 11, 13156. doi:10.1038/s41598-021-92609-x
Wuschner A., Wallet E., Flakus M., Reinhardt J., Christensen G., Bayouth J., et al. (2021). “Measuring radiation-induced changes in perfusion with dynamic contrast-enhanced 4DCT and non-contrast lung density analysis in a novel swine model,” in Medical PHYSICS (Hoboken: Wiley).
Wuschner A. E., Flakus M. J., Wallat E. M., Reinhardt J. M., Shanmuganayagam D., Christensen G. E., et al. (2022). Measuring indirect radiation-induced perfusion change in fed vasculature using dynamic contrast CT. J. Pers. Med. 12, 1254. doi:10.3390/jpm12081254
Xiao C., Staring M., Shamonin D., Reiber J. H., Stolk J., Stoel B. C. (2011). A strain energy filter for 3D vessel enhancement with application to pulmonary CT images. Med. Image Anal. 15, 112–124. doi:10.1016/j.media.2010.08.003
Yamamoto T., Kabus S., Klinder T., Lorenz C., von Berg J., Blaffert T., et al. (2011). Investigation of four-dimensional computed tomography-based pulmonary ventilation imaging in patients with emphysematous lung regions. Phys. Med. Biol. 56, 2279–2298. doi:10.1088/0031-9155/56/7/023
Yin Y., Hoffman E. A., Lin C. L. (2009). Mass preserving nonrigid registration of CT lung images using cubic B-spline. Med. Phys. 36, 4213–4222. doi:10.1118/1.3193526
Keywords: lung perfusion, post-RT vascular change, pulmonary vasculature segmentation, radiation-induced damage, ct-derived perfusion
Citation: Wuschner AE, Flakus MJ, Wallat EM, Reinhardt JM, Shanmuganayagam D, Christensen GE, Gerard SE and Bayouth JE (2022) CT-derived vessel segmentation for analysis of post-radiation therapy changes in vasculature and perfusion. Front. Physiol. 13:1008526. doi: 10.3389/fphys.2022.1008526
Received: 31 July 2022; Accepted: 05 October 2022;
Published: 17 October 2022.
Edited by:
Lars Knudsen, Hannover Medical School, GermanyReviewed by:
Rui Carlos Sá, University of California, San Diego, United StatesSam Bayat, Université Grenoble Alpes, France
Copyright © 2022 Wuschner, Flakus, Wallat, Reinhardt, Shanmuganayagam, Christensen, Gerard and Bayouth. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Antonia E. Wuschner, antonia.wuschner@wisc.edu