Systematic and Comprehensive Automated Ventricle Segmentation on Ventricle Images of the Elderly Patients: A Retrospective Study

Background and Objective: Ventricle volume is closely related to hydrocephalus, brain atrophy, Alzheimer's, Parkinson's syndrome, and other diseases. To accurately measure the volume of the ventricles for elderly patients, we use deep learning to establish a systematic and comprehensive automated ventricle segmentation framework.

Methods: The study participation included 20 normal elderly people, 20 patients with cerebral atrophy, 64 patients with normal pressure hydrocephalus, and 51 patients with acquired hydrocephalus. Second, get their imaging data through the picture archiving and communication systems (PACS) system. Then use ITK software to manually label participants' ventricular structures. Finally, extract imaging features through machine learning.

Results: This automated ventricle segmentation method can be applied not only to CT and MRI images but also to images with different scan slice thicknesses. More importantly, it produces excellent segmentation results (Dice > 0.9).

Conclusion: This automated ventricle segmentation method has wide applicability and clinical practicability. It can help clinicians find early disease, diagnose disease, understand the patient's disease progression, and evaluate the patient's treatment effect.

Introduction

The volume of the ventricle has always been closely related to degenerative brain diseases and traumatic brain injury. Researchers have also described that enlargement of the ventricles is an important characteristic of medical conditions such as schizophrenia, Parkinson's disease, Alzheimer's disease, hydrocephalus, and trauma to the brain (Silbert et al., 2003; Thompson et al., 2004; Chou et al., 2009; Liu et al., 2010; Cavedo et al., 2012; Khan et al., 2012; Anandh et al., 2016; Del et al., 2016; Owen et al., 2018; Kocaman et al., 2019; Lundervold et al., 2019). In some disease diagnosis guidelines, EI > 0.3 is often defined as ventricular enlargement (Relkin et al., 2005; Mori et al., 2012). However, some studies have shown that the correlation between EI and ventricle volume is only 0.619 (Toma et al., 2011). The measurement of EI is affected by different scan baselines and different measurement planes, which only reflects the local conditions of the ventricle at the selected level, and cannot fully assess the size of the ventricle (Ambarki et al., 2010). Moreover, EI is sensitive to the expansion of the ventricle to both sides, and the effect is not good when evaluating patients whose ventricle expands to the long axis (He et al., 2020). At the same time, in the normal elderly, the range of EI is relatively wide. Taking EI = 0.3 as the cut-off value, it is difficult to effectively distinguish between normal and enlarged ventricles (Brix et al., 2017). Therefore, when we need the volume of the ventricle, and the volume of the ventricle is measurable, then we should use it (Ambarki et al., 2010). Because of this, research on ventricle segmentation methods has brought much attention, and researchers have continuously optimized algorithms to make better and more accurate estimation (Chen et al., 2009; Coupe et al., 2011; Kempton et al., 2011; Poh et al., 2012; Qiu et al., 2015; Tang et al., 2015, 2018; Qian et al., 2017; Cherukuri et al., 2018; Shao et al., 2019; Dubost et al., 2020).

Volumetric measurement is the only method to directly determine the ventricular size. It is realized by segmentation, which can be roughly categorized into automated segmentation and manual segmentation (Huff et al., 2019). The manual segmentation technique is the gold standard for volumetric quantification of regional brain structures (Kocaman et al., 2019), but when dealing with more data, manual segmentation of the ventricles is time-consuming, subjective, and less reproducible (Chou et al., 2008; Liu et al., 2009; Poh et al., 2012). Therefore, it is highly in demand for an automated ventricle segmentation method to be developed and machine and deep learning based methods have emerged as the new era.

In the previous automated ventricle segmentation methods, researchers often conducted single-mode studies, i.e., segment either on CT images (Liu et al., 2010; Poh et al., 2012; Qian et al., 2017; Cherukuri et al., 2018) or MRI images (Qiu et al., 2015; Tang et al., 2015, 2018). Therefore, the developed automated ventricle segmentation methods were rarely interchangeable. Moreover, various algorithms might perform differently in segmenting different sections of the ventricles (Chen et al., 2009; Coupe et al., 2011; Shao et al., 2019; Dubost et al., 2020). Most previous machine learning (including deep learning) based studies were developed using images with a slice thickness of <3 mm, because at the same scanning distance, the smaller of the image thickness, the more images could be obtained, which could be more conducive for machine/deep learning algorithms to extract more image features (Xia et al., 2004; Coupe et al., 2011; Kempton et al., 2011). However, in clinical practice, due to time constraints, images with larger slice thicknesses are more common. Therefore, the clinical usage of these methods is relatively limited.

The reproducibility of machine/deep learning based algorithms across different scanners and pulse sequences had not always been comprehensively examined (Kempton et al., 2011). Moreover, their accuracy in different clinical populations and sensitivity to real changes in brain volume could still be improved. A larger slice thickness would increase the partial volume effect, which could have a significant negative impact on the algorithm accuracy. For example, the intraventricular calcified area located at the border of the ventricle may not be recognized. Some cerebellar ventricle areas (anterior, posterior, and inferior horns of the lateral ventricle) may not be recognized because they are not connected to the core of the lateral ventricle (Liu et al., 2010). In some automated ventricle segmentation methods, pathological ventricles were not included (Huff et al., 2019), but pathological ventricles are common in the elderly, especially in patients with acquired hydrocephalus, because they may have brain trauma, brain tumors, subarachnoid hemorrhage, and it becomes extremely difficult to delineate the ventricle from these patients. Previous literature also reported the segmentation of the ventricle of idiopathic Normal Pressure Hydrocephalus (iNPH) patients (Shao et al., 2019). These patients are prone to segmentation failure due to the enlarged ventricle. Therefore, our purpose is not only to optimize the algorithm and obtain more accurate results but more importantly, to make this automated ventricle segmentation method be more widely used and be trustworthy for clinical practice.

In summary, the goal of this study is to establish a deep learning based automated ventricle segmentation method that can be generally used for both CT and MRI images, and is versatile for both thin-layer and thick-layer images.

Methods

Participants

First, we selected the images of patients over 60 years old who underwent brain CT or MRI examinations at Shenzhen Second People's Hospital from January 1, 2016 to December 31, 2019. Second, as we aimed to delineate the ventricle and perform a comprehensive analysis, we chose the normal elderly, the elderly with brain atrophy, the elderly with idiopathic normal pressure hydrocephalus, and the elderly with acquired hydrocephalus people. Because the shape and size of the ventricles of these four types of patients are very representative, showing a trend from normal to severe, which can help us systematically and comprehensively analyze the ventricular system. Third, the diagnostic results of these patients were agreed upon by two radiologists with more than 10 years of work experience and strictly followed the disease diagnosis guidelines. Last but not least, due to a large number of normal elderly people and patients with brain atrophy, a large number of manual labeling would be infeasible. However, there is no obvious deformation of their ventricle structure, and it is easier for the automatic ventricle segmentation of the normal elderly and the elderly with brain atrophy. Therefore, we arranged the normal elderly and the elderly with brain atrophy in the order of the time of head imaging examination and numbered them, and made the numbers into small pieces of paper, and placed them in a large carton. Using a simple random sampling method, let 20 doctors in the radiology department randomly sample small pieces of paper. In the end, we randomly selected 20 normal elderly people and elderly people with brain atrophy for manual marking. The flowchart of the admission and exclusion of patients is shown in Figure 1, and the basic study population description is shown in Table 1.

FIGURE 1

Figure 1. Study flow chart for the inclusion of participants.

TABLE 1

Table 1. Demographic information of subjects used in this study.

Ethics Statement

This study was carried out in accordance with the recommendations of the Ethics Committee of The First Affiliated Hospital of Shenzhen University and Shenzhen Second People's hospital. All subjects gave written informed consent in accordance with the Declaration of Helsinki.

Imaging Protocol and Label

First, a CT scan of the head was performed on two CT instruments, one of which was SOMATOM Definition Flash from Siemens, Germany, and the other was SOMATOM Emotion 16 from Siemens, Germany. Secondly, MRI examinations were conducted using a 1.5T MR scanner (Avanto, Siemens, Erlangen, Germany), and a 3.0T MRI scanner (Prisma, Siemens, Erlangen, Germany). All images were stored in the picture archiving and communication systems (PACS).

Then manually delineation of the ventricle was conducted. For MRI images, we chose T1WI for manual labeling. The specific manual labeling process is as follows: (1) two radiologists with 10 years of clinical experience used ITK software to label the ventricles; (2) a senior radiologist with 20 years of clinical experience evaluated the delineation results of the ventricles and made adjustment if inaccurate manual labeling was found; and (3) for the controversial annotated cases, we invited a neurology expert and a neurosurgery expert to discuss, and modifications and the final annotation results were approved by them.

We defined the thick layer image when the scan layer thickness was >3 mm, and otherwise, it was defined as the thin layer image. Therefore, all images were classified into four groups, i.e., thin-slice CT images, thick-slice CT images, thin-slice MRI images, and thick-slice MRI images.

The Proposed Deep Learning Framework

In real-world scenarios, the thick-slice images are more easily obtained, while thin-slices images are rare, and it is more difficult for clinicians to annotate them. Moreover, the distribution of different image thicknesses can result in the domain shift problem that can confuse the deep learning models (Yan et al., 2019). Therefore, we proposed a thickness agnostic image segmentation model, which only required the annotation of thick-slice images for the model training.

Our goal is to utilize the unlabeled thin-slice images to minimize the performance gap between thick-slice and thin-slice images. In our model, the thick-slice images are denoted as $D_S=\left\{(x_s,y_s)|x_s\in R^{H\times W\times 3},y_s\in R^{H\times W}\right\}$, and the thin-slices images are represented as $D_T=\left\{x_t|x_t\in R^{H\times W\times 3}\right\}$.

With the increased development and application of deep learning methods, encoder-decoder based architectures (Milletari et al., 2016; Zhou et al., 2018) are widely used in medical image segmentation. The workflow of our proposed deep learning based framework is presented in Figure 2. For image feature extraction and reconstruction, we adopted ResNet-34, which was pre-trained on ImageNet datasets as the encoder of input images. For the decoder, sub-pixel convolution was used for constructing segmentation results since the deconvolution operation was computationally heavy and interpolation-based methods could not bring additional information to improve the segmentation. The sub-pixel convolution can be then represented as

$\begin{array}{ll}{F}^L=SP(W_L*F^{L-1}+b_L),& (1)\end{array}$

where SP(·) operator transforms and arranges a tensor with the shape of H × W × C × r² into a tensor shaped in rH × rW × C, F^L−1 and F^L are the input feature and output feature, W_L and b_L are the parameters of the sub-pixel convolution operator.

FIGURE 2

Figure 2. The workflow of proposed methods.

We took both thick-slice and thin-slice images as the input and optimized our model with the following objective function

$\begin{array}{ll}L(x_s,x_t)=L_S(p_s,y_s)+\lambda L_T(p_t),& (2)\end{array}$

where λ is a hyper-parameter for weighting the impact of L_s and L_T, p_s and p_t are the model's predictions of the segmentation probability shaped of H × W × C. L_S is the cross-entropy loss defined as follows

$\begin{array}{ll}{L}_S=-\frac{1}{HW}{\displaystyle \sum _{n=1}^{HW}}{\displaystyle \sum _{c=1}^C}{y}_s^{n,c}log{p}_t^{n,c}.& (3)\end{array}$

Since we expect our model to learn an accurate segmentation paradigm for both thick-slice images and thin-slice images, the L_T can be regarded as the distance between the probability distribution of the target domain (thin-slice domain) p_t and the uniform distribution $U=\frac{1}{C}$. Therefore, minimizing the distance between the two distributions enables classes to be more separable. Because it implicitly pushes the image features away from the decision boundary and makes alignment between two distributions. Mathematically, the objective function of thin-slice images is formulated as

$\begin{array}{ll}{L}_T=-D_f(p_t^{n,c}\left|\right|U)=-\frac{1}{C}{\displaystyle \sum _{c=1}^C}f(C{p}_t^{n,c}).& (4)\end{array}$

Most existing methods (Vu et al., 2019) would choose f (x) = x log x, which is alternatively named as the KL-divergence. However, one of the main obstacles is that when adopting KL-divergence for L_T as the objective function, the gradient of L_T would be extremely imbalanced between easy and hard samples. Taking the binary case as an example, the gradient can be computed as

$\begin{array}{ll}\frac{\partial L_T}{\partial p_t^{n,i}}=log\left(1-p_t^{n,i}\right)-log{p}_t^{n,i},& (5)\end{array}$

of which the increasing speed is faster as $p_t^{n,i}$ becomes larger.

Therefore, to mitigate the unbalancing problem represented above, instead of choosing f (x) = x log x, we select Pearson χ² divergence [i.e., f (x) = x² − 1] for L_T. Therefore, the gradient of L_T can be noted as

$\begin{array}{ll}\frac{\partial L_T}{\partial p_t^{n,i}}=2-4p_t^{n,i},& (6)\end{array}$

which balances the gradient between easy and hard samples. During model training, the above loss functions were optimized iteratively. For testing, we fed each slice of images as the input and get the predicted segmentation.

Result

Diagnostic Efficiency

For experiments, we collected thick-slice and thin-slice samples from iNPH patients with different modalities (MRI and CT) as Table 2 shows. It is of note that we only used the annotations from thick-slice images for our supervised deep learning. We investigated the performance of U-Net (Ronneberger et al., 2015) and U-Net++ (Zhou et al., 2018) on thin-slice and thick-slice images. Both U-Net and U-Net++ adopted encoders and decoders structure while using the middle features to maintain the information of images. As shown in Table 3, compared to conventional and state-of-the-art models, our method achieved significant improvement on both thick-slice and thin-slice images. To further illustrate, our method outperformed U-Net and U-Net++, which are commonly used in medical segmentation, by a large margin. Besides, with the help of a pre-trained ResNet-34 encoder, our model could gain at most 0.1 Dice coefficient on thick-slice images.

TABLE 2

Table 2. The number of thick-slice and thin-slice images used for our study.

TABLE 3

Table 3. Comparison results (Dice) of our method vs. other state-of-the-art methods.

Component Analysis

To examine the influence of each component in our method, we conducted ablation studies to verify the effectiveness of our method, and the results are summarized in Table 4. We can observe that if our model only trained on thick-slice images, we can get comparable results on thick slices but the model cannot perform well on thin-slice images as shown in the first row of Table 4. However, without the annotation from images, the prediction results would be extremely unreliable since the objective function reached the global minimum when the probability of each class was assigned the same value. Moreover, when incorporating both thick-slice and thin-slice images into the training under the proposed semi-supervised paradigm, our method could result in better performance on thin-slice images by at least 3.5% improvement on the Dice coefficient compared to the model in Exp 1, while it only sacrificed little performance on thick images. The rationale behind this is that our model can learn a shared feature representation for both thick-slice and thin-slice images, which can be beneficial for handling different types of images.

TABLE 4

Table 4. Dice coefficient comparison for our ablation studies.

Qualitative Analysis

Figure 3 shows the example segmentation results on randomly selected thin-slice images from the testing set for both MRI and CT modalities. In the second column of each modality, it can be observed that U-Net performed poorly on MRI images. Meanwhile, U-Net++, which is the updated version of U-Net, showed better predictions compared to the U-Net while they were still not accurate. Compared with the U-Net and U-Net++, our method achieved accurate results and could segment both MRI and CT images with high precision. Particularly, in the last row of the CT example, although the original image had low contrast, our method was still able to recognize each part and segmented the data accurately, which has demonstrated the robustness of our method. Divide patients with acquired hydrocephalus into Subarachnoid hemorrhage group, brain trauma group, and brain tumor group according to the cause of the disease. Using our method to automatically segment the images of the three groups of patients, the results of CT images show that the Dice of the three groups are 0.94, 0.95, and 0.94, respectively. The results of the MRI image showed that the Dice of the three groups were 0.91, 0.89, 0.92, respectively (Table 5).

FIGURE 3

Figure 3. The visualization of segmentation results for thin-slice with MRI images and CT images. (A) The completeness of segmentation indicates the performance of each model on MRI images in which our method achieves the best. (B) Our method is superior to other competing approaches on CT images, specifically for low contrast images (The last row).

TABLE 5

Table 5. Thick-slice image segmentation results(Dice) of acquired hydrocephalus.

Discussion

Through Figures 2, 3 and Tables 2–4, we can observe that our automated ventricle segmentation method can be successfully applied CT and MRI images with different thicknesses. More importantly, the segmentation results obtained are better (Dice > 0.9) compared to widely used U-Net and its advanced version U-Net++. There is no doubt that the proposed method is promising for different clinical scenarios.

Clinical Significance of the Automated Ventricle Segmentation

Changes in the shape and size of the ventricles are associated with many diseases, and relevance ventricular enlargement is a crucial marker of brain atrophy associated with normal or pathological aging processes (Schoemaker et al., 2019). Ventricular enlargement also represents a feasible short-term marker of disease progression in mild cognitive impairment and Alzheimer's disease (Nestor et al., 2008). Ventricular enlargement can occur early in the course of Parkinson's disease and is associated with cognitive decline (Apostolova et al., 2012). New/enlarging T2w lesions adjacent to the ventricle wall and thalamic atrophy are independently associated with lateral ventricular enlargement in multiple sclerosis (Sinnecker et al., 2020). Ventricular enlargement is also arguably the most consistent neuroanatomical biomarker present in schizophrenia (Sayo et al., 2012). Whether it is to detect early disease (Dalaker et al., 2011), evaluate the condition of the patient (Ferrarini et al., 2008), diagnose the disease (Relkin et al., 2005), evaluate the effect of surgery (Neikter et al., 2020) or other aspects, accurate measurement of the size of the ventricles has very important clinical significance (Shi et al., 2015).

When following patients with hydrocephalus, the timing for intervention is difficult to decide for clinicians. Therefore, by providing clinicians with an accurate measure of increased ventricle volume, automated ventricular segmentation techniques would give them more information to make their decisions (Qiu et al., 2015). The segmentation of ventricles provides quantitative measures on the changes of ventricles in the brain that form vital diagnostics information (Chen et al., 2009). The automated segmentation of ventricles can assist in making a differential diagnosis of ischemic stroke. The quantitative measurement of the ventricles can be helpful in a treatment, recovery, and follow-up process. The segmented ventricles can also serve as the reference in determining the spatial position of the infarct, which can provide useful information for treatment planning (Poh et al., 2012). Accurate and automated segmentation and labeling tools enable more sophisticated evaluations of the ventricular system in neurodegenerative diseases, cerebrospinal fluid disorders, as well as in normal aging (Shao et al., 2019). Various diseases affect the size and morphology of the ventricles, and knowledge of the normal and abnormal ventricular system is essential in understanding various pathological states. For these reasons, it is critical to extract the ventricular system to ascertain its morphology and volume (Xia et al., 2004). By manually labeling the ventricles, the time required to measure the volume and relative ventricle volume of each subject is about 30 min, which is acceptable in research, but obviously not feasible in clinical practice (Ambarki et al., 2010). Using the automatic ventricle segmentation method can save time significantly. Besides, the unsupervised segmentation method can leverage the dependency of labeled data which is more practical for a real-world scenario. For instance, Liu et al. (2019) utilized the quality of merged segmentation results to update the ensemble weights of different segmentation results in order to achieve accurate segmentation results. Meanwhile, Ganaye et al. (2018) took advantage of the invariant nature of the anatomical structure to improve the robustness of the segmentation results by applying semantic constraints.

Comparison Studies and the Advantages of Our Proposed Method

Huff et al. mentioned the limitations of their research for an automated ventricle segmentation method that all the studies were performed on similar CT scanners with similar acquisition parameters and identical slice thicknesses. No pathological ventricles were included in this study other than simply enlarged ventricles (Huff et al., 2019). In our research, we can see that data acquired from different scanners were validated, the thickness of the scan layer was also different, and pathological ventricles were also included. Qiu et al. (2015) outlined the limitations of their study as validated on a limited number of images since MR images of preterm neonates were usually not performed at our center unless a severe disease was suspected. Because of this, we did not deliberately make requests when selecting patients. As our goal is to automatically segment the ventricles, the image we chose must be systematic and comprehensive. The shape and size of the ventricles of the four groups of patients can represent the ventricles of the elderly cohort. Kocaman et al. (2019) performed a study on a small number of individuals. The actual sample size of our four groups of patients is large, and in clinical practice, these patients are relatively common. As the sample size increased, the results of our automated ventricle segmentation method were also gradually stabilized.

Xia et al. pointed out the limitations of their research on automated extraction of the ventricular system: When the slice thickness, especially in coronal and axial directions, is too high, the algorithm could not work satisfactorily. Most of the subjects tested did not have any pathology or major distortion of the ventricles (Xia et al., 2004). In our research, the thickness of the scan slice was no longer a confounding factor. Both thick-slice and thin-slice images could be processed with better ventricle segmentation results. At the same time, our patients included not only normal elderly people but also brain atrophy elderly people with slight changes in the ventricle shape and size. Besides, our proposed framework also performed well for iNPH patients with significant changes in the shape and size of the ventricles. More importantly, the elderly with acquired hydrocephalus with obvious changes in intracranial structures caused by trauma, tumor, hemorrhage, and other conditions were also included. Shao et al. mentioned in their brain ventricle parcellation work that the proposed network was also robust to white matter hyperintensities (WMH), which were often associated with NPH and located adjacent to the lateral ventricles. WMH can sometimes negatively affect the outcome of automated segmentation algorithms (Shao et al., 2019). Similarly, some of our patients were also NPH patients, and they had white matter hyperintensities around their lateral ventricles. Some patients with brain atrophy had a similar situation, but our ventricle segmentation framework could handle it.

Influence of Examination Type and Slice Thickness on Ventricle Segmentation

In clinical work, we often choose CT or MRI for head imaging examination. Both methods have their advantages and disadvantages. For CT, it is relatively convenient to operate, no need to worry about metal implantation, and the inspection speed is fast. But it has ionizing radiation to the human body, and it has a low signal to noise ratio and relatively low contrast. For MRI, it does not produce ionizing radiation and can provide better soft-tissue resolution, but its inspection time is long and may have considerable issues such as metal implantation and claustrophobia and other related problems (Chen et al., 2009; Liu et al., 2010; Coupe et al., 2011; Poh et al., 2012; Qian et al., 2017; Huff et al., 2019). It is well known that in medical images partial volume effect is inevitable. Reducing the slice thickness can reduce the partial volume effect. But for CT examinations, this means that patients have to receive more ionizing radiation, and for MRI examinations, the examination time will be longer. For deep learning, more content means more information, so thin-layer images are naturally the best choice. However, in clinical practice, because of the heavy burden for a large patient population, thick-slice scanning is still the most used acquisition method. But for the segmentation of the ventricles from thick-slice images, the number of images per patient is small, and the information that can be extracted is also limited. Coupled with the influence of the partial volume effect, it is often difficult to segment the boundaries of the ventricles from thick-slice images (Xia et al., 2004). The stroke area on the CT image is often adjacent or connected to the ventricle area, and the grayscale is similar, which increases the difficulty of accurately segmenting the ventricle (Qian et al., 2017). In addition, on the CT image, due to the noise and low contrast between the soft tissues, there is no obvious peak in the cerebrospinal fluid in the whole brain intensity histogram. This makes it difficult to find a suitable threshold for cerebrospinal fluid using traditional histogram-based segmentation methods (Liu et al., 2010). Part of the volume effect will affect the segmentation of the ventricle, especially on MR images with limited resolution (Coupe et al., 2011). Due to the partial volume effect, there exist transition regions between the Cerebrospinal fluid and gray matter, if these transition regions are completely excluded, the ventricular system is under-segmented, and some ventricular components, for example, the lateral ventricles, may be broken into several disconnected parts (Liu et al., 2009). The temporal horns and occipital poles of the ventricle can be separated from the main body. When the shape-based ventricle segmentation method and the ventricle segmentation method based on the regional growth technology are used, the results will be affected. In addition, the signal intensity of the choroidal plexus is similar to that of gray matter. When a simple threshold technique is used to segment the ventricle, the result will also be affected (Coupe et al., 2011). All in all, different imaging data and slice thickness have their advantages and disadvantages, and they also have a different impact on automated segmentation methods.

Limitations of Our Automated Ventricle Segmentation Framework

Because our current work was a retrospective study based on the elderly to establish a new systematic automated ventricle segmentation method. Therefore, our research might still have some limitations. First of all, because this study selected elderly patients, our method might have insufficient capacity to deal with pediatric patients. Secondly, because this was multi-center and multi-modal research, in terms of results, our goal was to perform well as a whole, so the expression of results in some respects was bound to be relatively weakened. When processing cross-hospital data, we need to handle extensive re-training of the model to ensure the accuracy of the running results. As a deep learning based model, the training data collected at one site are often unavailable to others due to privacy and legal issues (Wang et al., 2020a,b).

In future research, we will focus on extracting different imaging and biological features through deep learning of images, laboratory test results, and clinical information of patients with abnormal ventricles. We will achieve a systematic and comprehensive analysis of patients with ventricular abnormalities, and determine whether the patient has a certain disease that can cause ventricular abnormalities.

Conclusion

In order to systematically and comprehensively assess the size of the ventricle of elderly patients, we have established an automated ventricle segmentation method. This automated ventricle segmentation method can not only be applied to both CT and MRI images but can be also applied to images with different slice thicknesses. More importantly, it produces superior segmentation results. Deploying this automated ventricle segmentation method in the clinical scenarios can help doctors to find and diagnose early disease, evaluate the progress of the patient's condition, and inform the treatment planning for the patients. At the same time, the medical image scanning method and the slice thickness are no longer limitations for automated ventricle segmentation. There is no doubt that the proposed method will have a wide application in clinical studies.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

The studies involving human participants were reviewed and approved by Ethics Committee of The First Affiliated Hospital of Shenzhen University and Shenzhen Second People's hospital. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

XZ, QY, YJ, JX, and GY conceived and designed the study, contributed to data analysis, contributed to data interpretation, and contributed to the writing of the report. XZ, ZN, WM-S, EF, ZL, and JX contributed to the literature search. XZ and JX contributed to data collection. XZ, QY, YJ, and MW performed data curation and contributed to the tables and figures. All authors contributed to the article and approved the submitted version.

Funding

This work was supported in part by the Natural Science Foundation of Guangdong Province (2020A1515010918), in part by the Project of Shenzhen International Cooperation Foundation (GJHZ20180926165402083), in part by the Project of Shenzhen Basic Development Project (JCYJ 20190806164409040), in part by the Clinical Research Project of Shenzhen Health and Family Planning Commission (SZLY2018018), in part by the Hangzhou Economic and Technological Development Area Strategical Grant (Imperial Institute of Advanced Technology), in part by the European Research Council Innovative Medicines Initiative on Development of Therapeutics and Diagnostics Combatting Coronavirus Infections Award DRAGON: rapiD and secuRe AI imaging based diaGnosis, stratification, fOllow-up, and preparedness for coronavirus paNdemics (H2020-JTI-IMI2 101005122), and in part by the AI for Health Imaging Award CHAIMELEON: Accelerating the Lab to Market Transition of AI Tools for Cancer Management (H2020-SC1-FA-DTS-2019-1 952172).

Conflict of Interest

ZN and WM-S are employed by Aladdin Healthcare Technologies Ltd. QY, YJ, and MW are employed by Hangzhou Ocean's Smart Boya Co., Ltd., China and Mind Rank Ltd., China.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors would like to sincerely thank Meng-Yao Xu for her support and suggestions for the production of diagrams and tables throughout the entire project.

References

Ambarki, K., Israelsson, H., Wahlin, A., Birgander, R., Eklund, A., and Malm, J. (2010). Brain ventricular size in healthy elderly: comparison between Evans index and volume measurement. Neurosurgery 67, 94–99. doi: 10.1227/01.NEU.0000370939.30003.D1

PubMed Abstract | CrossRef Full Text | Google Scholar

Anandh, K. R., Sujatha, C. M., and Ramakrishnan, S. (2016). A method to differentiate mild cognitive impairment and Alzheimer in MR images using Eigen value descriptors. J. Med. Syst. 40:25. doi: 10.1007/s10916-015-0396-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Apostolova, L., Alves, G., Hwang, K. S., Babakchanian, S., Bronnick, K. S., and Larsen, J. P., et al. (2012). Hippocampal and ventricular changes in Parkinson's disease mild cognitive impairment. Neurobiol. Aging 33, 2113–2124. doi: 10.1016/j.neurobiolaging.2011.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Brix, M. K., Westman, E., Simmons, A., Ringstad, G. A., Eide, P. K., and Wagner-Larsen, K., et al. (2017). The Evans' Index revisited: new cut-off levels for use in radiological assessment of ventricular enlargement in the elderly. Eur. J. Radiol. 95, 28–32. doi: 10.1016/j.ejrad.2017.07.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Cavedo, E., Galluzzi, S., Pievani, M., Boccardi, M., and Frisoni, G. B. (2012). Norms for imaging markers of brain reserve. J. Alzheimers Dis. 31, 623–633. doi: 10.3233/JAD-2012-111817

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, W., Smith, R., Ji, S. Y., Ward, K. R., and Najarian, K. (2009). Automated ventricular systems segmentation in brain CT images by combining low-level segmentation and high-level template matching. BMC Med. Inform. Decis. Mak. 9 (Suppl. 1):S4. doi: 10.1186/1472-6947-9-S1-S4

PubMed Abstract | CrossRef Full Text | Google Scholar

Cherukuri, V., Ssenyonga, P., Warf, B. C., Kulkarni, A. V., Monga, V., and Schiff, S. J. (2018). Learning based segmentation of CT brain images: application to postoperative hydrocephalic scans. IEEE Trans. Biomed. Eng. 65, 1871–1884. doi: 10.1109/TBME.2017.2783305

PubMed Abstract | CrossRef Full Text | Google Scholar

Chou, Y. Y., Lepore, N., Avedissian, C., Madsen, S. K., Parikshak, N., and Hua, X., et al. (2009). Mapping correlations between ventricular expansion and CSF amyloid and tau biomarkers in 240 subjects with Alzheimer's disease, mild cognitive impairment and elderly controls. Neuroimage 46, 394–410. doi: 10.1016/j.neuroimage.2009.02.015

PubMed Abstract | CrossRef Full Text | Google Scholar

Chou, Y. Y., Lepore, N., de Zubicaray, G. I., Carmichael, O. T., Becker, J. T., Toga, A. W., et al. (2008). Automated ventricular mapping with multi-atlas fluid image alignment reveals genetic effects in Alzheimer's disease. Neuroimage 40, 615–630. doi: 10.1016/j.neuroimage.2007.11.047

PubMed Abstract | CrossRef Full Text | Google Scholar

Coupe, P., Manjon, J. V., Fonov, V., Pruessner, J., Robles, M., and Collins, D. L. (2011). Patch-based segmentation using expert priors: application to hippocampus and ventricle segmentation. Neuroimage 54, 940–954. doi: 10.1016/j.neuroimage.2010.09.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Dalaker, T. O., Zivadinov, R., Ramasamy, D. P., Beyer, M. K., Alves, G., and Bronnick, K. S., et al. (2011). Ventricular enlargement and mild cognitive impairment in early Parkinson's disease. Mov. Disord. 26, 297–301. doi: 10.1002/mds.23443

PubMed Abstract | CrossRef Full Text | Google Scholar

Del, R. E., Konishi, J., Bouix, S., Blokland, G. A., Mesholam-Gately, R. I., and Goldstein, J., et al. (2016). Enlarged lateral ventricles inversely correlate with reduced corpus callosum central volume in first episode schizophrenia: association with functional measures. Brain Imaging Behav. 10, 1264–1273. doi: 10.1007/s11682-015-9493-2

CrossRef Full Text | Google Scholar

Dubost, F., Bruijne, M., Nardin, M., Dalca, A. V., Donahue, K. L., and Giese, A. K., et al. (2020). Multi-atlas image registration of clinical data with automated quality assessment using ventricle segmentation. Med. Image Anal. 63:101698. doi: 10.1016/j.media.2020.101698

PubMed Abstract | CrossRef Full Text | Google Scholar

Ferrarini, L., Palm, W. M., Olofsen, H., van der Landen, R., Jan, B. G., and Westendorp, R. G., et al. (2008). MMSE scores correlate with local ventricular enlargement in the spectrum from cognitively normal to Alzheimer disease. Neuroimage 39, 1832–1838. doi: 10.1016/j.neuroimage.2007.11.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Ganaye, P. A., Sdika, M., and Benoit-Cattin, H. (2018). “Semi-supervised learning for segmentation under semantic constraint,” in International Conference on Medical Image Computing and Computer-Assisted Intervention (Cham: Springer), 595–602.

Google Scholar

He, W., Fang, X., Wang, X., Gao, P., Gao, X., and Zhou, X., et al. (2020). A new index for assessing cerebral ventricular volume in idiopathic normal-pressure hydrocephalus: a comparison with Evans' index. Neuroradiology 62, 661–667. doi: 10.1007/s00234-020-02361-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Huff, T. J., Ludwig, P. E., Salazar, D., and Cramer, J. A. (2019). Fully automated intracranial ventricle segmentation on CT with 2D regional convolutional neural network to estimate ventricular volume. Int. J. Comput. Assist. Radiol. Surg. 14, 1923–1932. doi: 10.1007/s11548-019-02038-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Kempton, M. J., Underwood, T. S., Brunton, S., Stylios, F., Schmechtig, A., and Ettinger, U., et al. (2011). A comprehensive testing protocol for MRI neuroanatomical segmentation techniques: evaluation of a novel lateral ventricle segmentation method. Neuroimage 58, 1051–1059. doi: 10.1016/j.neuroimage.2011.06.080

PubMed Abstract | CrossRef Full Text | Google Scholar

Khan, A. F., Drozd, J. J., Moreland, R. K., Ta, R. M., Borrie, M. J., and Bartha, R. (2012). A novel MRI-compatible brain ventricle phantom for validation of segmentation and volumetry methods. J. Magn. Reson. Imaging 36, 476–482. doi: 10.1002/jmri.23612

PubMed Abstract | CrossRef Full Text | Google Scholar

Kocaman, H., Acer, N., Koseoglu, E., Gultekin, M., and Donmez, H. (2019). Evaluation of intracerebral ventricles volume of patients with Parkinson's disease using the atlas-based method: a methodological study. J. Chem. Neuroanat. 98, 124–130. doi: 10.1016/j.jchemneu.2019.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, B., Gu, L., and Lu, F. (2019). “Unsupervised ensemble strategy for retinal vessel segmentation,” in International Conference on Medical Image Computing and Computer-Assisted Intervention (Cham: Springer).

Google Scholar

Liu, J., Huang, S., Ihar, V., Ambrosius, W., Lee, L. C., and Nowinski, W. L. (2010). Automatic model-guided segmentation of the human brain ventricular system from CT images. Acad. Radiol. 17, 718–726. doi: 10.1016/j.acra.2010.02.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, J., Huang, S., and Nowinski, W. L. (2009). Automatic segmentation of the human brain ventricles from MR images by knowledge-based region growing and trimming. Neuroinformatics 7, 131–146. doi: 10.1007/s12021-009-9046-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Lundervold, A. J., Vik, A., and Lundervold, A. (2019). Lateral ventricle volume trajectories predict response inhibition in older age-A longitudinal brain imaging and machine learning approach. PLoS ONE 14:e207967. doi: 10.1371/journal.pone.0207967

PubMed Abstract | CrossRef Full Text | Google Scholar

Milletari, F., Navab, N., and Ahmadi, S. A. (2016). “V-net: fully convolutional neural networks for volumetric medical image segmentation,” in 2016 Fourth International Conference on 3D Vision (3DV) (IEEE), 565–571.

Google Scholar

Mori, E., Ishikawa, M., Kato, T., Kazui, H., Miyake, H., Miyajima, M., et al. (2012). Guidelines for management of idiopathic normal pressure hydrocephalus: second edition. Neurol. Med. Chir. 52, 775–809. doi: 10.2176/nmc.52.775

PubMed Abstract | CrossRef Full Text | Google Scholar

Neikter, J., Agerskov, S., Hellstrom, P., Tullberg, M., Starck, G., and Ziegelitz, D., et al. (2020). Ventricular volume is more strongly associated with clinical improvement than the evans index after shunting in idiopathic normal pressure hydrocephalus. AJNR Am. J. Neuroradiol. 41, 1187–1192. doi: 10.3174/ajnr.A6620

PubMed Abstract | CrossRef Full Text | Google Scholar

Nestor, S. M., Rupsingh, R., Borrie, M., Smith, M., Accomazzi, V., and Wells, J. L., et al. (2008). Ventricular enlargement as a possible measure of Alzheimer's disease progression validated using the Alzheimer's disease neuroimaging initiative database. Brain 131 (Pt 9), 2443–2454. doi: 10.1093/brain/awn146

PubMed Abstract | CrossRef Full Text | Google Scholar

Owen, J. P., Bukshpun, P., Pojman, N., Thieu, T., Chen, Q., and Lee, J., et al. (2018). Brain MR imaging findings and associated outcomes in carriers of the reciprocal copy number variation at 16p11.2. Radiology 286, 217–226. doi: 10.1148/radiol.2017162934

PubMed Abstract | CrossRef Full Text | Google Scholar

Poh, L. E., Gupta, V., Johnson, A., Kazmierski, R., and Nowinski, W. L. (2012). Automatic segmentation of ventricular cerebrospinal fluid from ischemic stroke CT images. Neuroinformatics 10, 159–172. doi: 10.1007/s12021-011-9135-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Qian, X., Lin, Y., Zhao, Y., Yue, X., Lu, B., and Wang, J. (2017). Objective ventricle segmentation in brain CT with ischemic stroke based on anatomical knowledge. Biomed. Res. Int. 2017:8690892. doi: 10.1155/2017/8690892

PubMed Abstract | CrossRef Full Text | Google Scholar

Qiu, W., Yuan, J., Rajchl, M., Kishimoto, J., Chen, Y., and de Ribaupierre, S., et al. (2015). 3D MR ventricle segmentation in pre-term infants with post-hemorrhagic ventricle dilatation (PHVD) using multi-phase geodesic level-sets. Neuroimage 118, 13–25. doi: 10.1016/j.neuroimage.2015.05.099

PubMed Abstract | CrossRef Full Text | Google Scholar

Relkin, N., Marmarou, A., Klinge, P., Bergsneider, M., and Black, P. M. (2005). Diagnosing idiopathic normal-pressure hydrocephalus. Neurosurg. 57, S4–S16. doi: 10.1227/01.NEU.0000168185.29659.C5

CrossRef Full Text | Google Scholar

Ronneberger, O., Fischer, P., and Brox, T. (2015). “U-Net: convolutional networks for biomedical image segmentation,” in: Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. Lecture notes in computer science, Vol. 9351, eds N. Navab, J. Hornegger, W. Wells, and A. Frangi (Cham: Springer).

Google Scholar

Sayo, A., Jennings, R. G., and Van Horn, J. D. (2012). Study factors influencing ventricular enlargement in schizophrenia: a 20 year follow-up meta-analysis. Neuroimage 59, 154–167. doi: 10.1016/j.neuroimage.2011.07.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Schoemaker, D., Buss, C., Pietrantonio, S., Maunder, L., Freiesleben, S. D., and Hartmann, J., et al. (2019). The hippocampal-to-ventricle ratio (HVR): Presentation of a manual segmentation protocol and preliminary evidence. Neuroimage 203:116108. doi: 10.1016/j.neuroimage.2019.116108

PubMed Abstract | CrossRef Full Text | Google Scholar

Shao, M., Han, S., Carass, A., Li, X., Blitz, A. M., and Shin, J., et al. (2019). Brain ventricle parcellation using a deep neural network: application to patients with ventriculomegaly. Neuroimage Clin. 23:101871. doi: 10.1016/j.nicl.2019.101871

PubMed Abstract | CrossRef Full Text | Google Scholar

Shi, J., Stonnington, C. M., Thompson, P. M., Chen, K., Gutman, B., and Reschke, C., et al. (2015). Studying ventricular abnormalities in mild cognitive impairment with hyperbolic Ricci flow and tensor-based morphometry. Neuroimage 104, 1–20. doi: 10.1016/j.neuroimage.2014.09.062

PubMed Abstract | CrossRef Full Text | Google Scholar

Silbert, L. C., Quinn, J. F., Moore, M. M., Corbridge, E., Ball, M. J., and Murdoch, G., et al. (2003). Changes in premorbid brain volume predict Alzheimer's disease pathology. Neurology 61, 487–492. doi: 10.1212/01.WNL.0000079053.77227.14

PubMed Abstract | CrossRef Full Text | Google Scholar

Sinnecker, T., Ruberte, E., Schadelin, S., Canova, V., Amann, M., and Naegelin, Y., et al. (2020). New and enlarging white matter lesions adjacent to the ventricle system and thalamic atrophy are independently associated with lateral ventricular enlargement in multiple sclerosis. J. Neurol. 267, 192–202. doi: 10.1007/s00415-019-09565-w

PubMed Abstract | CrossRef Full Text | Google Scholar

Tang, X., Crocetti, D., Kutten, K., Ceritoglu, C., Albert, M. S., and Mori, S., et al. (2015). Segmentation of brain magnetic resonance images based on multi-atlas likelihood fusion: testing using data with a broad range of anatomical and photometric profiles. Front. Neurosci. 9:61. doi: 10.3389/fnins.2015.00061

PubMed Abstract | CrossRef Full Text | Google Scholar

Tang, X., Luo, Y., Chen, Z., Huang, N., Johnson, H. J., and Paulsen, J. S., et al. (2018). A fully-automated subcortical and ventricular shape generation pipeline preserving smoothness and anatomical topology. Front. Neurosci. 12:321. doi: 10.3389/fnins.2018.00321

PubMed Abstract | CrossRef Full Text | Google Scholar

Thompson, P. M., Hayashi, K. M., De Zubicaray, G. I., Janke, A. L., Rose, S. E., and Semple, J., et al. (2004). Mapping hippocampal and ventricular change in Alzheimer disease. Neuroimage 22, 1754–1766. doi: 10.1016/j.neuroimage.2004.03.040

PubMed Abstract | CrossRef Full Text | Google Scholar

Toma, A. K., Holl, E., Kitchen, N. D., and Watkins, L. D. (2011). Evans' index revisited: the need for an alternative in normal pressure hydrocephalus. Neurosurgery 68, 939–944. doi: 10.1227/NEU.0b013e318208f5e0

PubMed Abstract | CrossRef Full Text | Google Scholar

Vu, T., Jain, H., Bucher, M., Cord, M., and Pérez, P. (2019). “ADVENT: adversarial entropy minimization for domain adaptation in semantic segmentation,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2512–2521.

Google Scholar

Wang, C., Dong, S., Zhao, X., Papanastasiou, G., Zhang, H., and Yang, G. (2020a). SaliencyGAN: deep learning semisupervised salient object detection in the fog of IoT. IEEE Trans. Indus. Inform. 16, 2667–2676. doi: 10.1109/TII.2019.2945362

CrossRef Full Text | Google Scholar

Wang, C., Yang, G., Papanastasiou, G., Zhang, H., Rodrigues, J., and Albuquerque, V. (2020b). “Industrial cyber-physical systems-based cloud IoT edge for federated heterogeneous distillation,” in IEEE Transactions on Industrial Informatics, 1.

Google Scholar

Xia, Y., Hu, Q., Aziz, A., and Nowinski, W. L. (2004). A knowledge-driven algorithm for a rapid and automatic extraction of the human cerebral ventricular system from MR neuroimages. Neuroimage 21, 269–282. doi: 10.1016/j.neuroimage.2003.09.029

PubMed Abstract | CrossRef Full Text | Google Scholar

Yan, W., Wang, Y., Gu, S., Huang, L., Yan, F., Xia, L., et al. (2019). “The domain shift problem of medical image segmentation and vendor-adaptation by Unet-GAN,” in International Conference on Medical Image Computing and Computer-Assisted Intervention: (Cham Springer), 623–631.

Google Scholar

Zhou, Z., Siddicquee, M., Tajbakhsh, N., and Liang, J. (2018). UNet++: a nested U-Net architecture for medical image segmentation. Deep Learn Med Image Anal Multimodal Learn Clin Decis Support 11045, 3–11. doi: 10.1007/978-3-030-00889-5_1

PubMed Abstract | CrossRef Full Text | Google Scholar