- 1Department of Radiation Oncology, Fudan University Shanghai Cancer Center, Shanghai, China
- 2Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
Background and Purpose: To develop an artificial intelligence-based full-process solution for rectal cancer radiotherapy.
Materials and Methods: A full-process solution that integrates autosegmentation and automatic treatment planning was developed under a single deep-learning framework. A convolutional neural network (CNN) was used to generate segmentations of the target and the organs at risk (OAR) as well as dose distribution. A script in Pinnacle that simulates the treatment planning process was used to execute plan optimization. A total of 172 rectal cancer patients were used for model training, and 18 patients were used for model validation. Another 40 rectal cancer patients were used for an end-to-end evaluation for both autosegmentation and treatment planning. The PTV and OAR segmentation was compared with manual segmentation. The planning results was evaluated by both objective and subjective assessment.
Results: The total time for full-process planning without contour modification was 7 min, and an additional 15 min may require for contour modification and re-optimization. The PTV DICE similarity coefficient was greater than 0.85 for all 40 patients in the evaluation dataset while the DICE indices of the OARs also indicated good performance. There were no significant differences between the auto plans and manual plans. The physician accepted 80% of the auto plans without any further operation.
Conclusion: We developed a deep learning-based automatic solution for rectal cancer treatment that can improve the efficiency of treatment planning.
Introduction
Intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT) are widely used in current radiotherapy clinics due to their ability to achieve desired target dose conformity and sufficient sparing of critical structures (1). There are two core tasks in a typical IMRT or VMAT planning process: target volume and organ at risk (OAR) segmentation and treatment planning. The segmentation task is performed by a radiation oncologist, and the treatment planning is performed by a dosimetrist or physicist. Both tasks require significant knowledge, experience, and time to achieve a clinically acceptable quality (2). Meanwhile, due to the complexity of technologies and the differences in personal preferences, abilities, and technical understanding, inter-physician and inter-physicist variations are inevitable (3).
Manual segmentation of target volumes and OARs remains a time-consuming task in radiation oncology (4–6). In addition, intra- and interobserver variability for most treatment sites in segmentation and the heterogeneity in clinical practices have hindered our ability to systematically assess the quality of radiation therapy plans and are considered major sources of uncertainty (4). Recently, the emerging technology of deep learning has also provided the ability to identify and automatically segment tumors or OARs on medical images. The results from deep learning-based segmentation have been promising (6). Autosegmentation has the potential to reduce the contouring burden as well as the intra- and interobserver variability in contouring.
Similar to tumor or OAR segmentation, treatment planning is another critical task in radiotherapy. It may require considerable trial-and-error to obtain a clinically accepted plan even for an experienced medical physicist (7–9). To improve plan quality and efficiency, knowledge-based planning (KBP) and script-based automatic planning have been developed (7, 10). Recently, many studies have reported that deep learning-based automatic treatment planning may be promising (9, 11).
In addition to the above two core tasks, another high time-cost task is communication between oncologists and physicists. However, both groups of healthcare professionals may have a heavy clinical workload. For large cancer centers or multi-campus hospitals, physics departments and radiation oncologists’ working areas may be physically far apart. Furthermore, as the scale of radiotherapy departments continue to expand, the time and costs of communication will inevitably increase rapidly (12).
Since artificial intelligence and machine learning look promising for radiotherapy, we seek to integrate all these technologies to minimize unnecessary operations and explore the changes that this technology brings to radiotherapy workflows. In this study, we propose a fully automatic solution for rectal cancer IMRT treatment planning. It uses a deep-learning method to accomplish contour segmentation and dose distribution prediction. By integrating with the treatment planning system (TPS) script, the workflow of radiotherapy treatment planning can be optimized. The effect of the solution will also be evaluated by an end-to-end test.
Materials and Methods
This study consists of three parts as illustrated in Figure 1. The first part consists of model training. The second part demonstrates the full-process solution workflow regarding how to use this solution in routine clinical practices. The third part is an end-to-end evaluation of our full-process solution.
Patients and Dataset
A total of 230 neoadjuvant rectal cancer patients from 2016 to 2018 in our institution are enrolled. All patients’ tumor site was low-position (when tumor bottom is less than 10 cm away from anus). These patients were randomly selected from our clinical database with criteria of T3-4N+ staging. The planning CT was scanned one hour after bladder evacuation with the patient in the head-first supine (HFS) position. The detailed characteristics of the training, validation, and evaluation groups are presented in Table 1. In this concept study, the evaluation set consisted of only IMRT patients.
OAR and Target Segmentation
ROIs were segmented by radiation oncologists based on CT images. The left femoral head (LFH), right femoral head (RFH), bladder and clinical target volume (CTV) of the tumor were segmented. The planning target volume (PTV) consisted of a 1 cm 3D extension in all directions from the CTV. Oncologists may modify the PTV basing on their personal experience. Although small bowel and colon are very important normal organs (GI002, RTOG 0822) (13), they are not segmented in our routine clinic. For the purpose of evaluation, small bowel and colon are segmented with intelligent segmentation in uRT-TPOIS (R001.2.0.85208, United Imaging, Shanghai).
Full-Process Solution
A W-shaped net architecture based on our previous studies (9, 14) was used in this study, consisting of a combination of two U-net convolutional neural networks (CNN). To seamlessly integrate our clinical workflow, a Pinnacle3-based script was developed. The entire process started after the planning CT was imported into Pinnacle, and was triggered by radiation oncologist clicking a single script button. The CT image was sent to a deep learning server in the Pinnacle image format (.img file). The server then automatically ran a deep-learning model to predict the patient’s ROIs and dose distribution. Segmentation was saved in Pinnacle ROI format (.roi file) and sent back to Pinnacle automatically. At the same time, a patient-specific sub-script was generated. DVH index are calculated with the predicted dose distribution and are used for objective functions. This sub-script was also sent back to Pinnacle, and plan generation and optimization were performed. This sub-script automatically set the isocenter, beam angle, and optimization parameters (including all objective functions and IMRT hyperparameter settings) and started the optimization. No human intervention was required during the above processes.
All patients were prescribed 5,000 cGy in 25 fractions, and the prescription definition was 97% of the mean dose of the PTV based on our clinical routine. In this study, we only used the IMRT technique for evaluation, which could be easily changed to VMAT by changing the beam type. The isocenter was placed in the geometric center of the PTV. A photon beam with 6 MV energy is used. Seven beams were used in this study with a fixed angle (180, 230, 280, 320, 40, 80, 130 degrees) with direct machine parameter optimization (DMPO). The maximum number of segments was 50, while the minimum segment area was 10 cm2 and the minimum number of segment MUs was 6. A maximum of 50 iterations were used for optimization. PTV was chosen as the target with a dose of 5,000 cGy.
After the optimization and final dose calculation, the plan could be immediately reviewed by radiation oncologist. If the segmentation was not clinically accepted, the oncologist could modify the contour segmentation and reoptimize the plan with another click on a script button. The reoptimization process did not change the objective function.
Plan Optimization
We used the Pinnacle Auto-planning module to run plan optimization. The OAR optimization goals all used max DVH, and the priority was set as low. The dose objective functions were directly calculated from the predicted dose distribution. Table 2 shows detailed index for dose optimization. Normally, a maximum dose of 102% of the prescription and a minimum dose of 101% of the prescription dose were used for the target according to default setting of Pinnacle Auto-planning module.
Solution Performance Evaluation
Forty patients were enrolled for solution performance evaluation. The evaluation included two parts, physician assessment and objective criterion assessment.
For physician assessment, a radiation oncologist with 5 years of experience could carry out the whole process without the physicists’ help. Oncologist would assess the results of the autosegmentation and treatment planning sequentially, and were required to decide whether this plan (the Auto-plan) was suitable for delivery in the clinic. If not, the oncologist was required to provide opinions about the segmentation and plan. After that, the oncologist can modify the ROIs and trigger the reoptimization process by clicking another script button. Then, the radiation oncologist was required to reassess the plan (the Re-opt-plan). A senior oncologist who has been working for 32 years blindly reviewed all evaluation patient sets.
For objective criterion evaluation, segmentation was assessed by the dice similarity coefficient (DSC). The Auto-plan was assessed by dose-volume indices. As a retrospect study, manual segmentation and manual plans already exist. For the PTV, the max dose (D0.01), relative volume covered by 95% of the prescription dose (V95), relative volume covered by 99% of the prescription dose (V99), conformity index (CI), and homogeneity index (HI) were compared. In this study, HI and CI calculation were performed with the built-in algorithms of MIM (MIM Software Inc. Cleveland, OH, USA). The CI equals the ratio of the volume of the prescription dose line to that of the target, while the HI equals the ratio of the max and min doses for the target. For the femoral heads, D2, V25Gy, and V40Gy were compared, while V25Gy, V35Gy, and V45Gy were used for the bladder (15). For small bowel, V35Gy, V40Gy, V45Gy, and D2 were used while V50Gy and D2 are evaluated for colon (13). We used the manually segmented ROIs as the reference set for DVH calculation since manually segmented ROIs should be considered as the gold-standard in this study.
Paired sample t tests were used to evaluate the statistical significance of all the dose-volume parameters between the Auto-plan and the manually optimized plan (MO-plan), as well as between the Re-opt-plan and the MO-plan. To demonstrate the final performance of our solution, we combined patients without reoptimization and those with reoptimization into the solution. A p-value less than 0.05 was considered statistically significant.
Results
Full-Process Solution
With the physician assessment, among all 40 patients who underwent solution performance evaluation, 32 (80%) patients’ Auto-plans were clinically accepted without contour modification and reoptimization. Eight patients’ plans needed target (PTV) modification. After modification and reoptmization, evaluation set plans were reviewed by senior oncologist all became clinical acceptable. The whole process would take 7 min without contour modification for one patient. Contour modification cost average 13.3 min, ranging between 6 and 20 min. Reoptimizing process cost 5 min. In comparison, manual segmentation would take more than 30 min and manual plan would take 30–40 min.
Autosegmentation Assessment
The DSC between predicted and manual PTV segmentation was greater than 0.85 for all 40 patients (16). The mean DSC of the OARs was also greater than 0.75 but with some deviation. Here is detailed statistic (mean ± standard deviation): PTV 0.90 ± 0.02; CTV 0.87 ± 0.06; Bladder 0.80 ± 0.11; LFH 0.79 ± 0.10; RFH 0.80 ± 0.10. Figure 2 is demonstration of a certain patient’s segmentation comparison between manual segmentation and autosegmentation.
Auto-Planning Assessment
The dose-volume indices are presented in Table 3. There were no significant differences between the Auto-plan and the MO-plan for any of the OAR dose-volume indices except femoral head V25Gy, which was reduced by auto-planning. Volume dose for Auto-plan and Re-opt-plan of both small bowel and colon are higher than manual plan (exceeding IMRT planning constraints, but still under compliance criteria). Although there were no significant differences between auto-plan and manual plan for max dose. The PTV coverage was significantly lower for auto-planning without reoptimization. After contour modification and reoptimization, the PTV coverage was improved; the V99 was better than that of the manual plans, and the CI improved from 1.12 to 1.09. An example set of DVH curves was shown in Figure 3. This patient’s autogenerated plan was considered clinically unacceptable by our physician. After contour revision and plan reoptimization, the plan was considered acceptable.
Discussion
In this study, we developed an integrated solution for radiation segmentation and planning. This solution can significantly increase the efficiency of the whole workflow of radiotherapy. Two core radiotherapy tasks were integrated into one task with artificial intelligence. Since high-quality plans can be directly generated for 80% of rectal cancer patients by a physician alone, the communication cost could be largely reduced (17). Although 20% of the automatically generated plans were clinically unacceptable, with a reoptimization step, these plans become clinically acceptable.
In the oncologist’s evaluation, the quality of 80% of patients’ plans directly satisfied the clinical criteria following automatic segmentation and automatic planning. Twenty percent of the patients required contour modification and reoptimization. After reoptimization, all plans satisfied the clinical criteria. Dose differences between auto-plan and re-opt-plan are mainly arose by segmentation since we didn’t change any other parameters. The dose-volume index comparison also demonstrated that after reoptimization, the differences between the Auto-plans and the MO-plans were reduced.
The radiotherapy processes for rectal cancer in our institution, including segmentation and treatment planning, are consistent. All radiation oncologist and physicists followed one unified consensus in segmentation and treatment planning. This consensus was “learned” by the deep-learning neural network. It’s difficult to extend the entire scheme to multiple centers since enormous differences exist in segmentation and plan, especially when radiation oncologists have their own unique experiences besides contouring atlases. Though recent study has been focused on model adaption, lacking a unified guide is still a major hindrance to extend deep learning’s application (18).
There were differences in the HI and CI of the PTV and the indices of the femoral heads, however. We believe this was mainly caused by the Pinnacle Auto-planning module, which relaxes the PTV constraint to reduce some OAR doses. Although obtained a high DSC value for the PTV (>0.85), the system did not perform well in high-risk lymph node drainage areas and recrudescence areas. For example, the sacral, inferior mesenteric, internal lilac, external lilac, and inguinal lymph nodes are all considered high-risk clinical target volumes. We observed that these parts were frequently modified by physicians during the evaluation process. This indicated that a physician’s assessment and evaluation was still required. In clinical use, oncologist could modify segmentation of PTV while auto-planning is ongoing. If the segmentation doesn’t need modification, the plan can be evaluated immediately.
We evaluated radiation dose for small bowel and colon in this study. Although Auto-plan and Re-opt-plan dose for small bowel and colon are higher than MO-plan, they still met RTOG 0822 compliance criteria. Higher dose for small bowel and colon may be caused by lower dose for femoral heads. Since dose deposition along 90/270 degree decreased, dose deposition along 0/180 degree increased where small bowel and colon are located. Besides according to a phase 3 clinical trial in our center (19), the incidence of grade 3 or higher diarrhea was only 3.5% when combining pelvic irradiation concurrently with 5-Fu monotherapy.
This study combined knowledge-based and script-based planning. Script-based automatic approaches have been proven to have great potential for reducing workloads in clinical radiotherapy (20, 21). We use the Pinnacle Auto-planning module only because it is clinically implemented in our institution (22). Knowledge-based planning has been used to aid in the design of radiation treatment plans for decades (23). The main advantage of KBP is that it can provide an achievable goal before optimization. This goal may also reflect the physician’s tradeoff between target and OAR dose coverage. Here, we used deep learning to generate the dose distributions and transfer them to the TPS as DVH constraints. This is because at present we do not have an optimization engine that can directly incorporate dose distributions as its goal.
There were some limitations in this proof of concept study. First, the plan chosen for training might not be the optimal plan. As we have seen, with a slight compromise in PTV dose heterogeneity, our solution reduces the patient’s femoral head dose. This indicates that some routine clinical plans may not focus on reducing the femoral head dose. Meanwhile, although we predicted the dose distribution in every voxel, we do not use it directly in the optimization step. Because current commercial TPSs only accept DVH indices as optimize objectives, this can be improved in the future.
We chose rectal cancer to demonstrate our approach because it is simpler than cancers at other sites. These complex sites (such as the lung) have complex target segmentation and beam angle selection protocols. As it stands, our solution is not suitable for these sites. This requires further investigation.
Conclusion
The full-process solution developed in this study integrated automatic segmentation and treatment planning. This solution can significantly increase the efficiency of the whole workflow of radiotherapy.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material. Further inquiries can be directed to the corresponding authors.
Ethics Statement
The studies involving human participants were reviewed and approved by Fudan University Shanghai Cancer Center Institutional Review Board. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author Contributions
XX: paper writing. JZW: network framing. JP, JF: model training. YL, JZ, JFW, ZZ: segmentation and plan evaluation. YF: data collection. All authors contributed to the article and approved the submitted version.
Funding
This work is supported by the National Natural Science Foundation of China (No. 11675042, No. 11805039, No. 11805038) and the Imaging Funding of Fudan University Shanghai Cancer Center (YX201703) and the Shanghai Committee of Science and Technology Fund (19DZ1930902) and Xuhui District Artificial Intelligence Medical Hospital Cooperation Project (2020-009) and the Varian Research Grant (The deep learning based 3D dose prediction and automatic treatment planning).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
1. Zhao J, Hu W, Cai G, Wang J, Xie J, Peng J, et al. Dosimetric comparisons of VMAT, IMRT and 3DCRT for locally advanced rectal cancer with simultaneous integrated boost. Oncotarget (2016) 7(5):6345. doi: 10.18632/oncotarget.6401
2. Ouyang Z, Liu Shen Z, Murray E, Kolar M, LaHurd D, Yu N, et al. Evaluation of auto-planning in IMRT and VMAT for head and neck cancer. J Appl Clin Med Phys (2019) 20(7):39–47. doi: 10.1002/acm2.12652
3. van Rooij W, Dahele M, Ribeiro Brandao H, Delaney AR, Slotman BJ, Verbakel WF. Deep Learning-Based Delineation of Head and Neck Organs at Risk: Geometric and Dosimetric Evaluation. Int J Radiat Oncol Biol Phys (2019) 104(3):677–84. doi: 10.1016/j.ijrobp.2019.02.040
4. Cardenas CE, McCarroll RE, Court LE, Elgohari BA, Elhalawani H, Fuller CD, et al. Deep Learning Algorithm for Auto-Delineation of High-Risk Oropharyngeal Clinical Target Volumes With Built-In Dice Similarity Coefficient Parameter Optimization Function. Int J Radiat Oncol Biol Phys (2018) 101(2):468–78. doi: 10.1016/j.ijrobp.2018.01.114
5. Teguh DN, Levendag PC, Voet PW, Al-Mamgani A, Han X, Wolf TK, et al. Clinical validation of atlas-based auto-segmentation of multiple target volumes and normal tissue (swallowing/mastication) structures in the head and neck. Int J Radiat Oncol Biol Phys (2011) 81(4):950–7. doi: 10.1016/j.ijrobp.2010.07.009
6. Men K, Dai J, Li Y. Automatic segmentation of the clinical target volume and organs at risk in the planning CT for rectal cancer using deep dilated convolutional neural networks. Med Phys (2017) 44(12):6377–89. doi: 10.1002/mp.12602
7. Fan J, Wang J, Chen Z, Hu C, Zhang Z, Hu W. Automatic treatment planning based on three-dimensional dose distribution predicted from deep learning technique. Med Phys (2019) 46(1):370–81. doi: 10.1002/mp.13271
8. Mitchell RA, Wai P, Colgan R, Kirby AM, Donovan EM. Improving the efficiency of breast radiotherapy treatment planning using a semi-automated approach. J Appl Clin Med Phys (2017) 18(1):18–24. doi: 10.1002/acm2.12006
9. Fan J, Wang J, Zhang Z, Hu W. Iterative dataset optimization in automated planning: Implementation for breast and rectal cancer radiotherapy. Med Phys (2017) 44(6):2515–31. doi: 10.1002/mp.12232
10. Song Y, Wang Q, Jiang X, Liu S, Zhang Y, Bai S. Fully automatic volumetric modulated arc therapy plan generation for rectal cancer. Radiother Oncol (2016) 119(3):531–6. doi: 10.1016/j.radonc.2016.04.010
11. Ge Y, Wu QJ. Knowledge-based planning for intensity-modulated radiation therapy: A review of data-driven approaches. Med Phys (2019) 46(6):2760–75. doi: 10.1002/mp.13526
12. Buhler PM, Worden JD. Up, Down, and Sideways: High-Impact Verbal Communication for HR Professionals[M]. Society for Human Resource Management. (2013).
13. Garofalo MC, Berger AC, Hong T, Lerma F, Bendell J. A Phase Ii Evaluation Of Preoperative Chemoradiotherapy Utilizing Intensity Modulated Radiation Therapy (Imrt) In Combination With Capecitabine And Oxaliplatin For Patients With Locally Advanced Rectal Cancer. Int J Radiat Oncol Biol Phys (2011) 81(2):S3–4. doi: 10.1016/j.ijrobp.2011.06.008
14. Wang J, Lu J, Qin G, Shen L, Sun Y, Ying H, et al. Technical Note: A deep learning-based autosegmentation of rectal tumors in MR images. Med Phys (2018) 45(6):2560–4. doi: 10.1002/mp.12918
15. Vanderstraeten B, Goddeeris B, Vandecasteele K, van Eijkeren M, De Wagter C, Lievens Y. Automated Instead of Manual Treatment Planning? A Plan Comparison Based on Dose-Volume Statistics and Clinical Preference. Int J Radiat Oncol Biol Phys (2018) 102(2):443–50. doi: 10.1016/j.ijrobp.2018.05.063
16. Loi G, Fusella M, Lanzi E, Cagni E, Garibaldi C, Iacoviello G, et al. Performance of commercially available deformable image registration platforms for contour propagation using patient-based computational phantoms: A multi-institutional study. Med Phys (2018) 45(2):748–57. doi: 10.1002/mp.12737
17. Wang C, Zhu X, Hong JC, Zheng D. Artificial Intelligence in Radiotherapy Treatment Planning: Present and Future. Technol Cancer Res Treat (2019) 18:1533033819873922. doi: 10.1177/1533033819873922
18. Kandalan RN, Nguyen D, Rezaeian NH, Barragn-Montero AM, Breedveld S, Namuduri K, et al. Dose Prediction with Deep Learning for Prostate Cancer Radiation Therapy: Model adaptation to Different Treatment Planning Practices. Radiother Oncol (2020) 153:228–35. doi: 10.1016/j.radonc.2020.10.027
19. Zhang Z SX, Liu A. A multicenter randomized phase III trial of capecitabine with or without irinotecan driven by UGT1A1 in neoadjuvant chemoradiation of locally advanced rectal cancer (CinClare). J Clin Oncol (2019) 37(15_suppl):3510. doi: 10.1200/JCO.2019.37.15_suppl.3510
20. Nawa K, Haga A, Nomoto A, Sarmiento RA, Shiraishi K, Yamashita H, et al. Evaluation of a commercial automatic treatment planning system for prostate cancers. Med Dosim (2017) 42(3):203–9. doi: 10.1016/j.meddos.2017.03.004
21. Hazell I, Bzdusek K, Kumar P, Hansen CR. Automatic planning of head and neck treatment plans. J Appl Clin Med Phys (2016) 17(1):272–82. doi: 10.1120/jacmp.v17i1.5901
22. Xu H, Lu J, Wang J, Fan J, Hu W. Implement a knowledge-based automated dose volume histogram prediction module in Pinnacle(3) treatment planning system for plan quality assurance and guidance. J Appl Clin Med Phys (2019) 20(8):134–40. doi: 10.1002/acm2.12689
Keywords: full-process solution, AI, rectal cancer, radiotherapy, automatic planning
Citation: Xia X, Wang J, Li Y, Peng J, Fan J, Zhang J, Wan J, Fang Y, Zhang Z and Hu W (2021) An Artificial Intelligence-Based Full-Process Solution for Radiotherapy: A Proof of Concept Study on Rectal Cancer. Front. Oncol. 10:616721. doi: 10.3389/fonc.2020.616721
Received: 13 October 2020; Accepted: 22 December 2020;
Published: 03 February 2021.
Edited by:
Yidong Yang, University of Science and Technology of China, ChinaReviewed by:
Kuo Men, Chinese Academy of Medical Sciences and Peking Union Medical College, ChinaRuijie Yang, Peking University Third Hospital, China
Copyright © 2021 Xia, Wang, Li, Peng, Fan, Zhang, Wan, Fang, Zhang and Hu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Zhen Zhang, emhlbl96aGFuZ0BmdWRhbi5lZHUuY24=; Weigang Hu, amFja2h1d2dAZ21haWwuY29t
†These authors have contributed equally to this work