- 1Department of Mechanical and Biomedical Engineering, Kangwon National University, Chuncheon, South Korea
- 2Daegu-Gyeongbuk Medical Innovation Foundation, Medical Device Development Center, Daegu, South Korea
- 3Department of Electrical and Electronic Engineering, Yonsei Univeristy, Seoul, South Korea
- 4Department of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
- 5Department of Health, Medicine and Caring Science, Linköping University, Linköping, Sweden
- 6Center for Medical Image Science and Visualization (CMIV), Linköping University, Linköping, Sweden
- 7Department of Cardiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, South Korea
Imaging hemodynamics play an important role in the diagnosis of abnormal blood flow due to vascular and valvular diseases as well as in monitoring the recovery of normal blood flow after surgical or interventional treatment. Recently, characterization of turbulent blood flow using 4D flow magnetic resonance imaging (MRI) has been demonstrated by utilizing the changes in signal magnitude depending on intravoxel spin distribution. The imaging sequence was extended with a six-directional icosahedral (ICOSA6) flow-encoding to characterize all elements of the Reynolds stress tensor (RST) in turbulent blood flow. In the present study, we aimed to demonstrate the feasibility of full RST analysis using ICOSA6 4D flow MRI under physiological conditions. First, the turbulence analysis was performed through in vitro experiments with a physiological pulsatile flow condition. Second, a total of 12 normal subjects and one patient with severe aortic stenosis were analyzed using the same sequence. The in-vitro study showed that total turbulent kinetic energy (TKE) was less affected by the signal-to-noise ratio (SNR), however, maximum principal turbulence shear stress (MPTSS) and total turbulence production (TP) had a noise-induced bias. Smaller degree of the bias was observed for TP compared to MPTSS. In-vivo study showed that the subject-variability on turbulence quantification was relatively low for the consistent scan protocol. The in vivo demonstration of the stenosis patient showed that the turbulence analysis could clearly distinguish the difference in all turbulence parameters as they were at least an order of magnitude larger than those from the normal subjects.
Introduction
Imaging hemodynamics plays an important role in the diagnosis of abnormal blood flow due to vascular and valvular diseases and monitoring the recovery of normal blood flow after surgical or interventional treatment (Ragosta, 2017; Members et al., 2021). Non-invasive measurement of hemodynamic parameters, such as velocity, pressure loss, and perfusion, has been an important marker for the management and therapy of patients with vascular diseases (Ragosta, 2017; Members et al., 2021).
While echocardiography is still a dominant imaging tool for assessing hemodynamics in clinics, volume acquisition of phase-contrast magnetic resonance imaging, also termed 4D flow MRI, is an emerging technique to characterize multi-dimensional features of hemodynamics (Caruthers et al., 2003; Falahatpisheh et al., 2016; Donati et al., 2017). 4D flow MRI quantifies not only the velocity and flow rate, but also provides various dynamic and kinematic properties of the blood flow, such as wall shear stress (WSS) (Barker et al., 2012; Bissell et al., 2013), turbulent kinetic energy (TKE) (Dyverfeldt et al., 2008; Dyverfeldt et al., 2009a; Dyverfeldt et al., 2013), vorticity (Kim et al., 2015; von Spiczak et al., 2015), pressure gradient (Ebbers et al., 2001; Krittian et al., 2012; Donati et al., 2015), and pulse wave velocity (PWV) (Markl et al., 2010; Markl et al., 2012). In addition, numerous applications of 4D flow MRI for different cardiac and vascular diseases have been introduced, and its clinical implications beyond conventional echocardiography or other diagnostic tools have been successfully demonstrated (Stankovic et al., 2014; Ha et al., 2016d; Soulat et al., 2020; Rizk, 2021).
Characterization of turbulent blood flow in the circulation system has received attention from researchers as it provides additional insights into the extent of spatiotemporal velocity fluctuation and the corresponding stress and energy. The development of turbulent flow dissipates kinetic energy into internal energy by viscous shear stress, which elevates the energy and pressure loss accordingly (Pope, 2001). The elevated viscous shear stress due to the stochastic velocity fluctuation also increases damage to the blood components, promoting hemolysis and thrombosis (Mustard et al., 1962; Smith et al., 1972; Sallam and Hwang, 1983; Lu et al., 2001; Yen et al., 2014). As the mechanical stimuli of turbulent flow are detected and transduced into endothelial cells, the pathophysiology of turbulence on the progression of atherosclerosis and vascular remodeling has also been investigated (Davies et al., 1986; Davies, 1989; Prado et al., 2006).
Although turbulence measurement using medical instruments is still challenging, there has been continuing research on turbulence quantification for developing novel hemodynamic markers. Previously, a catheter-based hot-film anemometer was used to quantify the turbulence level in the aortic flow. The turbulent intensity, frequency, and energy density of the normal and stenotic flows were, thus, successfully analyzed (Stein and Sabbah, 1976; Yamaguchi et al., 1983; Hanai et al., 1991). Since the catheter-based method is currently limited due to its invasiveness, turbulence characterization using non-invasive 4D flow MRI has been widely carried out (Dyverfeldt et al., 2006; Dyverfeldt et al., 2008; Dyverfeldt et al., 2009a; Dyverfeldt et al., 2013).
Conventional velocity measurement from the phase image of 4D flow MRI acquisition does not include turbulent flow features. The MRI sequence fills k-space data from multiple cardiac cycles. The reconstructed velocity field inherently is an ensemble average of many repeated signal acquisitions. As the reconstruction of the MRI signal using a discrete inverse Fourier transform gives the representative value of the whole spin signals within the voxel, the voxel data are also spatially averaged (Brown et al., 2014).
Recently, the application of 4D flow MRI for turbulence estimation has been widely demonstrated by utilizing the changes in MRI signal magnitude depending on intravoxel spin distribution (Dyverfeldt et al., 2006; Dyverfeldt et al., 2008; Dyverfeldt et al., 2009a; Dyverfeldt et al., 2013). Previously, TKE, which is the trace of the Reynolds stress tensor (RST), was estimated using the conventional 4D flow MRI sequence for the non-invasive measurement of turbulence in the aortic blood flow (Dyverfeldt et al., 2008). This 4D flow MRI sequence was further extended with a six-directional icosahedral (ICOSA6) flow-encoding scheme to measure all elements of RST, rather than only three diagonal elements, in turbulent flows (Ha et al., 2016e; Ha et al., 2017b; Haraldsson et al., 2018; Ha et al., 2019). Recently, it was found that multi-point flow encoding with a highly under-sampled acquisition successfully quantified the turbulence within ten minutes of scanning (Walheim et al., 2019).
Although preliminary studies on the quantification of full RST using extended 4D flow MRI have demonstrated its potential in medicine, the practical feasibility of turbulence analysis under physiological conditions has rarely been demonstrated. Most in vitro demonstrations have used the steady flow condition to optimize the experimental environments, such as signal-to-noise ratio (SNR) and scan time. A previous study demonstrating multi-point measurement for full RST analysis in two normal subjects and patients with valvular diseases has been the only in vivo study performed till date (Walheim et al., 2019). Therefore, questions still remain to be answered, for example; whether the turbulence analysis provides robust results and what happens if parameter dependency arises in cases for highly pulsatile flows, particularly for in vivo scan conditions.
This study aimed to investigate the performance of full RST analysis using ICOSA6 4D flow MRI under physiological conditions. First, we confirmed the feasibility of the turbulence analysis at different velocity encoding (Venc) conditions using in vitro experiments with a pulsatile flow condition. Second, a total of 12 normal subjects and one patient with aortic stenosis were scanned with the same sequence. The extent of the turbulence parameters from in vivo measurements was analyzed accordingly.
Materials and Methods
In-vitro Experimental Setup
In vitro measurements of 4D flow MRI were performed using an acrylic flow phantom and a cardiovascular-mimicking pulsatile flow pump (Figure 1). The stenotic phantom had a 50% reduction in length, which corresponds to a 75% reduction in area with a rectangular cross-sectional shape. The upstream and downstream diameters, without stenosis, were 25 mm. To minimize the entrance effect, 0.3 m of the straight inlet upstream of the stenosis was used to minimize the entrance effect. In addition, the same length of the outlet part was used downstream of the stenosis. The working fluids were a mixture of 60% water and 40% glycerol by mass. The density was 1,053.8 kg/m3, which corresponded to a dynamic viscosity of 3.72
Recruitment of Normal Subjects and Patient for In-Vivo Study
Twelve healthy volunteers and one patient with severe aortic stenosis were prospectively enrolled in this study. This study was approved by the Institutional Review Board of the Asan Medical Center (approval number: 2020-1698, Seoul, Korea). Written informed consent was obtained from all the participants. Normal subjects were confirmed to have no severe cardiovascular disease from the cardiology department before they were scanned using 4D flow MRI. One patient with severe aortic stenosis was registered for comparison with normal subjects. Echocardiography showed that the patient had a peak velocity of 4.7 m/s, which corresponds to the mean and peak pressure gradients of 53 and 89 mmHg, respectively. A demographic summary of the in vivo subjects is summarized in Table 1.
4D Flow MRI Measurement
The 4D flow MRI measurements for the in vitro experiments were as follows: A commercial 1.5T MRI scanner (1.5T Philips Achieva, Philips Medical Systems, Best, Netherlands) with a 32-channel torso coil performed the ICOSA6 sequence, which was modified to employ icosahedral flow encoding (six-directional) with a single flow-compensated reference encoding. Various velocity-encoding (Venc) parameter values (100–350 cm/s) were selected for the turbulence analysis, and 350 cm/s was used for velocity measurement. The echo time, temporal resolution, flip angle and matrix size were 2.5 ms, 3.9 ms, 10° and 128 × 128 × 25 (2.0 mm isotropic voxel), respectively. To obtain the shortest TE, a partial echo factor was set to 0.725. The total scan time for the in vitro study was approximately 30 min per case.
The 4D flow MRI parameters for the in vivo study, other than those described below, were the same as those for the in vitro experiments. A dStream Flex coil (Philips Medical Systems, Best, Netherlands) was used with various Venc parameters ranging from 80 to 100 cm/s for the normal subjects and 300 cm/s for the stenosis patient for turbulence quantification. TE and temporal resolution were slightly adjusted according to the scan condition, ranging from 1.9 to 2.7 ms and 3.8–4.4 ms, respectively. The matrix size range was 112–128 × 112–128 × 23–30 voxels (2.5–3.0 mm isotropic voxel). The scan time for the in vivo study was approximately 23 min.
Post-processing of 4D Flow MRI Data
Raw data were exported using Pack’n Go and reconstructed offline using ReconFrame (ReconFrame, Gyrotool LLC, Zurich, Switzerland). A custom MATLAB (The MathWorks, Inc., Natick, MA) code was used to solve the linear equations to recover the velocity vector and RST, as described in previous works (Ha et al., 2017a; Ha et al., 2019). To correct the background phase errors, a no-flow velocity field (flow off) was subtracted from the in vitro data (Ha et al., 2019) and weighted 2nd order fitting to static tissue was used for the in vivo data (Ebbers et al., 2008).
Magnitude and velocity images were imported into the ITK-SNAP software (v.3.8.0, University of Utah, Salt Lake City, UT) to segment the aortic flow region. The aorta was subdivided into the ascending aorta (AA), descending aorta (DA), and aortic arch (arch) by the brachiocephalic artery and the left subclavian artery (Figure 2). Aortic branches were excluded from the analysis.
4D Flow MRI Turbulence Quantification
The intravoxel velocity variance (IVVV) of the turbulent flow in I direction
where
Orthogonal components (velocity vectors u, v, and w) and covariance components (Reynolds stress tensor Rij, a six-element symmetric tensor in Eq. 2) can be simultaneously calculated by solving linear equations from six non-orthogonal velocity encodings (Figure 3) (Haraldsson et al., 2018; Ha et al., 2019).
The turbulent kinetic energy TKE with in the flow can be described from the IVVV of each direction as follows:
where
The maximum principal turbulent shear stress (MPTSS) was estimated using principal stress analysis. MPTSS can be calculated as follows:
where the
Turbulent production (TP) can directly be computed as follows (Ha et al., 2017a; Ha et al., 2019):
Here, Sij denotes the strain rate tensor of the velocity field. Voxel-wise integration of TP and multiplying the density provides a total TP with a unit of W or mW.
The turbulence parameters near the luminal surface were estimated separately to estimate the impact of turbulence on the vessel wall. Near-wall TKE (nwTKE), near-wall MPTSS (nwMPTSS), and near-wall TP (nwTP) were calculated as previously described (Ziegler et al., 2017). In short, for near-wall estimation, the number of turbulence parameters near the luminal surface was obtained using a convolution kernel with a 3
Statistics
A Shapiro–Wilk test was performed to check the normality of the data. The parametric data were described as mean ± standard deviation, while non-parametric data were described as median (1st quartile, 3rd quartile) throughout the manuscript.
Results
In-vitro Turbulence Quantification Under Pulsatile Flow
The ICOSA6 4D Flow MRI successfully visualized the pulsatile flow waveform that generated a strong jet flow through the stenosis (Figure 4). These turbulence parameters exhibited the highest values around the boundary layer of the jet flow. Turbulence parameters (TKE, MPTSS, and TP) started to increase during the early systole phase and reached a maximum at the peak systole phase of the cycle (Figures 4, 5). The mean and peak velocity during the pulsatile cycle were 0.83 m/s and 2.26 m/s and corresponding flow rates were 3.95 L/min and 13.1 L/min, respectively.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/774954/fbioe-09-774954-HTML-r1/image_m/fbioe-09-774954-g004.jpg)
FIGURE 4. Temporal variation of (A) Velocity, (B) turbulent kinetic energy (TKE), (C) maximum principal turbulent shear stress (MPTSS), (D) turbulence production (TP) through the stenosis at Venc of 200 cm/s.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/774954/fbioe-09-774954-HTML-r1/image_m/fbioe-09-774954-g005.jpg)
FIGURE 5. Temporal variation of (A) Flow rate, (B) total TKE, (C) Average MPTSS, (D) total TP, (E) Peak velocity, (F) nwTKE, (G) nwMPTSS, and (H) nwTP at different Venc parameters. Note that the flow rate and peak velocity are only measured at Venc of 350 cm/s.
The quality of turbulence quantification was dependent on the Venc parameter, which determines the SNR of the measurement (Figures 5, 6). The effect of the Venc-dependent SNR on turbulence quantification varied with the turbulence parameters. The measurement with a higher Venc resulted in a higher noise level in TKE (Figures 5, 6A). The maximum difference due to Venc was 26.9 and 10.3% for the mean and maximum total TKE, respectively (Table 2). In contrast, a higher Venc resulted in a noise-induced bias in the MPTSS and TP (Figures 6B,C). Mean and maximum MPTSS at Venc = 350 cm/s were 5.1 and 3.0 folds larger than those at Venc = 100 cm/s. Mean and maximum total TP at Venc = 350 cm/s were 2.4 and 1.4 folds larger than those at Venc = 100 cm/s. The near-wall turbulence parameters exhibited similar behaviors (Table 2).
In-vivo Turbulence Analysis
Twelve normal volunteers were scanned with the ICOSA6 sequence to perform flow and turbulence quantification. The blood flow through the aortic valve developed a high-velocity jet flow in the ascending aorta (Figure 7). TKE, MPTSS, and TP mapping at the peak systole phase clearly visualized the local development of turbulence with a reasonable SNR (Supplementary Figures S2–S5).
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/774954/fbioe-09-774954-HTML-r1/image_m/fbioe-09-774954-g007.jpg)
FIGURE 7. Comparison hemodynamics in normal subjects and patient with severe aortic stenosis. Note that representative normal subject (case #1) was used for color mapping. Values for the normal subject are median (1st quartile, 3rd quartile) of the data. Velocity, TKE, MPTSS and TP for all normal subjects are also shown in the Supplementary Figures S2–S5.
Most of the hemodynamic parameters of the normal subjects were within the confined range (Figure 8). The peak velocities of the normal subjects were 1.2 m/s (1.2 m/s, 1.3 m/s). Data are shown as median (1st quartile, 3rd quartile). The total TKE, MPTSS and TP of the normal subjects at the peak systole were 4.6 mJ (3.1 mJ, 5.9 mJ), 71.3 Pa (58.7 Pa, 79.8 Pa), 365.7 mW (263.8 mW, 425.0 mW), respectively. Among them, most of the turbulence was focused on the ascending aorta.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/774954/fbioe-09-774954-HTML-r1/image_m/fbioe-09-774954-g008.jpg)
FIGURE 8. Boxplot of peak systolic (A) velocity, (B) total TKE, (C) average MPTSS, (D) total TP and diastolic (E) velocity, (F) total TKE, (G) average MPTSS and (H) total TP.
The turbulence parameters at the diastolic phase were significantly smaller than those at the peak systolic phase. Total TKE and total TP were at least an order of magnitude smaller than those at the peak systolic phase. The average MPTSS was approximately one-third of that at the peak systole phase (Figure 8 and Table 3). The total TKE, MPTSS and total TP of the normal subjects at the diastolic phase were −0.2 mJ (−0.3 mJ, −0.1 mJ), 19.3 Pa (16.1 Pa, 22.1 Pa), 8.6 mW (6.6 mW, 12.3 mW), respectively. While the total TKE values at the diastolic phase were almost negligible regardless of the vascular region, almost half of the MPTSS and total TP developed at the ascending aorta.
The near-wall turbulence parameters were the largest in the ascending aorta (Table3 and Supplementary Figure S6). The nwTKE, nwMPTSS and nwTP of the ascending aorta at the peak systole were 69.0 J/m3 (47.7 J/m3, 78.2 J/m3), 80.4 Pa (72.2 Pa, 94.4 Pa), 5,634.0 W/m3 (4,175.9 W/m3, 6,771.9 W/m3), respectively, while those of the whole aorta were 44.1 J/m3 (34.8 J/m3, 57.4 J/m3), 72.1 Pa (61.2 Pa, 80.9 Pa), 3,620.8 W/m3 (3,160.1 W/m3, 4,627.6 W/m3), respectively. Diastolic nwTKE and nwTP were at least an order of magnitude smaller than those at the peak systolic phase. The nwMPTSS was approximately one-third of that at the peak systole phase (Table 3).
The in vivo demonstration of ICOSA6 turbulence quantification for a stenosis patient with an aortic velocity of 3.6 m/s showed that all turbulence parameters were at least an order of magnitude larger (Figure 7). The total TKE, MPTSS, and total TP of the patient at the peak systole were 27.8, 618.4 Pa and 7,636.4 mW, respectively.
Discussion
This study focuses on demonstrating the performance of full RST analysis using ICOSA6 4D flow MRI under physiological conditions. The key results of the study are as follows:
1) Turbulence quantification from in vitro pulsatile flow experiments can be affected by the SNR of the measurement. The effect of the Venc-dependent SNR on turbulence quantification varied with the turbulence parameters. While total TKE was less affected, MPTSS and TP had a noise-induced bias.
2) An in vivo study of normal subjects showed that most of the hemodynamic parameters were within the confined range. The impact of the subject-variability on turbulence quantification was relatively low for the consistent scan protocol.
3) The in vivo demonstration of the stenosis patient showed that the turbulence analysis could clearly distinguish the differences of all turbulence parameters as they were at least an order of magnitude larger than those from the normal subjects. The discrepancy between the normal and patient was much larger than the effect of SNR.
Validation of novel hemodynamic parameters under various conditions is crucial for the transition of a new biomarker from research to clinical routine. Since the TKE estimation using 4D flow MRI was demonstrated at the in vitro stenotic flow phantom (Dyverfeldt et al., 2006), various subsequent experiments confirmed the feasibility of the method under various measurement conditions (Dyverfeldt et al., 2006; Ha et al., 2016a; Petersson et al., 2016; Ziegler et al., 2017). Based on the results of in vitro experiments, TKE has been widely investigated as a clinical biomarker (Dyverfeldt et al., 2013; Zajac et al., 2015; Fredriksson et al., 2018; Ha et al., 2018). In contrast to TKE, other turbulence parameters from the RST have not yet been investigated. Since full RST measurements were demonstrated (Haraldsson et al., 2018), the following studies have attempted to study the accuracy and robustness of the RST measurement under limited steady flow conditions (Ha et al., 2020; Kim et al., 2021). The present study strengthens the feasibility of full RST analysis by adding the results under physiological pulsatile flow conditions. It is noted that the sample size for the in vivo normal study was small. We added one patient data set to show that the degree of turbulence in the patient is at least an order of magnitude higher than in the normal subjects. Elevated turbulence level in patients with valvular and vascular disease has also been reported previously (Dyverfeldt et al., 2008; Dyverfeldt et al., 2013). Adding a few more patients would not affect the results of the present study. Successful demonstration of RST analysis for a small group of in vivo studies will be an important bridge for upcoming large clinical trials.
The turbulence parameters from the full RST characterize different clinical aspects of turbulent flow. TKE is the kinetic energy associated with eddies in turbulent flow. Physically, TKE is a measure of how much turbulent energy is currently developed due to vascular coactation or valvular stenosis. The MPTSS indicates the extent to which shear stress is developed due to turbulence. Elevation of turbulent shear stress on the vessel wall or blood components can describe the risk of hemolysis (Grigioni et al., 1999). TP indicates how much TKE is produced, which will eventually dissipate. This indicates how much energy is taken from the mean flow to produce turbulence, and how much energy is dissipated into internal energy such as heat (Tennekes and Lumley, 1972). The TP has been investigated to indicate the irreversible pressure loss due to turbulence (Ha et al., 2019). Although conventional 4D flow MRI can also measure TKE, MPTSS and TP, it can only be estimated with full elements of the RST. The ICOSA6 4D flow MRI used in this study provides all turbulence parameters in compensation for three additional flow encodings and corresponding scan times.
The in vitro demonstration shows that the effect of the SNR on the turbulence quantification differs between the turbulence parameters. The Venc-dependent SNR adds the Gaussian noise distribution on TKE unless too much turbulence causes the flow-encoded signal magnitude to be less than the noise level (Dyverfeldt et al., 2009b; Ha et al., 2016a). Therefore, the choice of Venc affects the uncertainty of the TKE, but not the accuracy. The TKE results from the present study agree with those of previous studies. Compared to the measurement at the lowest Venc, higher Venc measurements showed larger noise-induced fluctuations (Figure 5). In contrast to TKE, MPTSS largely varied with the SNR. MPTSS is estimated from the eigenvalues of the RST, which are the solutions of the characteristic equation (Fung, 1977). The coefficients of the characteristic equation are obtained from the summation and multiplication of the RST elements. Therefore, the Gaussian noise distribution on the elements of the RST does not produce the same noise distribution on the MPTSS. When the MPTSS is expressed with the principal stress, it includes the square root of the principal stress squared. Therefore, a higher noise level increases the MPTSS, as shown in Figures 5, 6. The overestimation of MPTSS was also described in a previous study using Monte Carlo simulation (Walheim et al., 2019). While it was less obvious than MPTSS, TP also showed a Venc-dependent bias. The mean and maximum MPTSS at Venc = 350 cm/s were 5.1 and 3.0 folds larger than those at Venc = 100 cm/s, and the mean and maximum total TP were 2.4 and 1.4 folds larger at the same conditions. Considering that the clinical protocol for turbulence quantification using 4D flow MRI usually uses the same or similar parameters for all cohorts, such large discrepancies due to Venc-dependent SNR changes will only be shown in the worst-case scenario (Dyverfeldt et al., 2008; Dyverfeldt et al., 2013).
The subject-variability including subject-dependent SNR-variability played a minor role in turbulence quantification in the in vivo study. Hemodynamic parameters for the normal subjects were relatively similar despite a wide spectrum of age and corresponding height, weight, and cardiovascular indices (Figure 5 and Table 1). This was mostly because consistent scan parameters were used throughout the in vivo study. Venc between 80 cm/s to 100 cm/s and the voxel resolution between 2.5 and 3.0 mm were used for the normal subjects. Despite the in vitro experiments on steady flow, a previous study also showed that the turbulence quantification changes less than 11.5% for TKE and 33.9% for TP when the practical range of Venc between 100 cm/s and 200 cm/s was used (Ha et al., 2020). Walheim et al. also analyzed the effect of the SNR on the turbulence parameters (Walheim et al., 2019). Monte-Carlo simulation from the study also showed that SNR played a minor role in TKE and MPTSS compared to the effect of image resolution.
The feasibility of ICOSA6 4D flow MRI for patients with aortic stenosis showed that the turbulence analysis could clearly distinguish the differences in all turbulence parameters. TKE, MPTSS, and TP were at least an order of magnitude larger than those in the normal subjects. It is noteworthy that the optimum choice of Venc for 4D flow MRI turbulence quantification is related to the extent of turbulence in the flow. The use of a very small Venc value may result in excessive turbulence-related signal loss, which can lead to the underestimation of turbulence parameters owing to the Rician noise distribution (Dyverfeldt et al., 2009a). For this reason, usually, a larger Venc for stenotic flow than that for normal aortic flow is used (Dyverfeldt et al., 2013). Therefore, the turbulence parameters for the patient can be overestimated, particularly for the MPTSS and TP. Considering that the in vitro study showed that maximum MPTSS and TP at Venc = 350 cm/s were 3.0 folds and 1.4 folds larger than those at Venc = 100 cm/s, the elevation of turbulence parameters in the stenosis patient observed in this study is far beyond the effect of the Venc-dependency effect. However, care should be taken when turbulence parameters from different Venc parameters are to be compared.
It should be noted that turbulence measurement using 4D flow MRI can result in unphysical values, such as negative TKE at some voxels. This phenomenon is mostly due to background noise in the magnitude image. Since, the development of turbulence increases the signal loss in the flow-encoded image, the turbulence level is quantified by determining the signal loss in the flow-encoded image compared to the reference image (Dyverfeldt et al., 2009b). When turbulence-related signal loss is relatively small because the extent of turbulence is negligible or the first moment of bipolar gradient is too small to produce intravoxel dephasing, there are some chances for some voxels of the flow-encoded image have larger intensity than those of the reference image (Ha et al., 2016a). In contrast, the signal loss at the flow-encoded image quantifies the positive IVVV; a larger intensity in the flow-coded image is interpreted as negative IVVV. In general, this noise distribution affects the voxel-wise TKE but has less effect on the total TKE because the noise cancels out during the volumetric integration (Ha et al., 2016b). Despite volumetric integration, some extent of uncertainty may still affect the results, so that total TKE becomes negative when the turbulence is almost negligible (Ha et al., 2016b). To minimize the effect of noise on turbulence quantification, multi-Venc measurements have been used to optimize the results by finding the best possible estimates (Ha et al., 2019). A recent study filtered negative diagonal components of the RST to enforce positive IVVV (Marlevi et al., 2020). Filtering based on the physically realizable states of turbulence was also considered (Andersson et al., 2021).
The increased acquisition time of ICOSA6 4D flow MRI has been an inherent drawback for clinical use. Unlike conventional four-directional encoding, this sequence employs seven flow encodings, which increase the scan time by up to 75%. However, recent developments in various acceleration techniques, including compressed sensing and local low-rank, have been successfully applied to reduce the scan time without sacrificing the critical flow information (Zhang et al., 2015; Ma et al., 2019). In addition, Walheim et al. reported that faster turbulence quantification can be performed within ten minutes using highly under-sampled 5D flow MRI acquisition with locally low-rank image reconstruction (Walheim et al., 2019). We speculate that the scan time of turbulence quantification will become trivial as acceleration techniques are further developed.
It is noted that this study does not include the validation of MRI turbulence measurements against other engineering flow measurements. However, the feasibility and validation of MRI turbulence measurements have been previously demonstrated again laser Doppler anemometer (Dyverfeldt et al., 2006), particle image velocimetry (Knobloch et al., 2014; Ha et al., 2016c), and computational fluid dynamics (Petersson et al., 2016).
One of the limitations of the present study is that the uncertainty level of each measurement has not been presented. This would require multiple measurements of the same flow conditions, which is not feasible for in-vivo subjects due to the long scan time. Instead, the present study investigated the same flow conditions at different Venc and SNR. In addition, a level of uncertainty for in-vivo measurements has been studied by observing the range of the turbulence parameters in the normal cohort.
Another limitation of the present study is that the sample size for the in vivo normal study was small. The current results do not represent the true normal turbulence level. Based on the successful demonstration of turbulence analysis for a small group study, this will trigger upcoming large clinical trials. The atlas of turbulence parameters at different age, sex, and disease groups will be followed in the future.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Ethics Statement
The studies involving human participants were reviewed and approved by This study was approved by the Institutional Review Board of the Asan Medical Center (approval number: 2020-1698, Seoul, Korea). The patients/participants provided their written informed consent to participate in this study.
Author Contributions
HH, DK, DY designed the study and discussed the results; HH and KP contributed to the MRI experiments and data analysis; PD and TE contributed to the ICOSA6 MRI sequence and discussed the results; HH drafted the manuscript; all authors reviewed the manuscript.
Funding
This research was supported by the Basic Science Research Program through the National Research Foundation of Korea, which is funded by the Ministry of Education (NRF-2018R1D1A1A02043249, NRF-2021R1I1A3040346, NRF-2020R1A2C200384, NRF- 2021R1C1C1003481, NRF-2020R1A4A1019475). This research was also supported by the Basic Science Research Program and Medical Cluster R and D project, through the National Research Foundation of Korea (NRF), funded by the Ministry of Science, ICT and Future Planning (NRF-2020R1A2C2003843, HI19C0760).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fbioe.2021.774954/full#supplementary-material
References
Andersson, M., Karlsson, M., and Mechanobiology, M. I. (2021). Characterization of Anisotropic Turbulence Behavior in Pulsatile Blood Flow. Biomech. Model. Mechanobiol 20 (2), 491–506. doi:10.1007/s10237-020-01396-3
Barker, A. J., Markl, M., Bürk, J., Lorenz, R., Bock, J., Bauer, S., et al. (2012). Bicuspid Aortic Valve Is Associated with Altered wall Shear Stress in the Ascending Aorta. Circ. Cardiovasc. Imaging 5 (4), 457–466. doi:10.1161/circimaging.112.973370
Bissell, M. M., Hess, A. T., Biasiolli, L., Glaze, S. J., Loudon, M., Pitcher, A., et al. (2013). Aortic Dilation in Bicuspid Aortic Valve Disease. Circ. Cardiovasc. Imaging 6 (4), 499–507. doi:10.1161/circimaging.113.000528
Brown, R. W., Cheng, Y.-C. N., Haacke, E. M., Thompson, M. R., and Venkatesan, R. (2014). Magnetic Resonance Imaging: Physical Principles and Sequence Design. Hoboken, New Jersey: John Wiley & Sons.
Caruthers, S. D., Lin, S. J., Brown, P., Watkins, M. P., Williams, T. A., Lehr, K. A., et al. (2003). Practical Value of Cardiac Magnetic Resonance Imaging for Clinical Quantification of Aortic Valve Stenosis. Circulation 108 (18), 2236–2243. doi:10.1161/01.cir.0000095268.47282.a1
Davies, P. F., Remuzzi, A., Gordon, E. J., Dewey, C. F., and Gimbrone, M. A. (1986). Turbulent Fluid Shear Stress Induces Vascular Endothelial Cell Turnover In Vitro. Proc. Natl. Acad. Sci. 83 (7), 2114–2117. doi:10.1073/pnas.83.7.2114
Davies, P. (1989). How Do Vascular Endothelial Cells Respond to Flow? Physiology 4 (1), 22–25. doi:10.1152/physiologyonline.1989.4.1.22
Donati, F., Myerson, S., Bissell, M. M., Smith, N. P., Neubauer, S., Monaghan, M. J., et al. (2017). Beyond Bernoulli: Improving the Accuracy and Precision of Noninvasive Estimation of Peak Pressure Drops. Circ. Cardiovasc. Imaging 10 (1), e005207. doi:10.1161/CIRCIMAGING.116.005207
Donati, F., Figueroa, C. A., Smith, N. P., Lamata, P., and Nordsletten, D. A. (2015). Non-invasive Pressure Difference Estimation from PC-MRI Using the Work-Energy Equation. Med. Image Anal. 26 (1), 159–172. doi:10.1016/j.media.2015.08.012
Dyverfeldt, P., Gårdhagen, R., Sigfridsson, A., Karlsson, M., and Ebbers, T. (2009a). On MRI Turbulence Quantification. Magn. Reson. Imaging 27 (7), 913–922. doi:10.1016/j.mri.2009.05.004
Dyverfeldt, P., Gårdhagen, R., Sigfridsson, A., Karlsson, M., and Ebbers, T. (2009b). On MRI Turbulence Quantification. Magn. Reson. Imaging 27 (7), 913–922. doi:10.1016/j.mri.2009.05.004
Dyverfeldt, P., Hope, M. D., Tseng, E. E., and Saloner, D. (2013). Magnetic Resonance Measurement of Turbulent Kinetic Energy for the Estimation of Irreversible Pressure Loss in Aortic Stenosis. JACC: Cardiovasc. Imaging 6 (1), 64–71. doi:10.1016/j.jcmg.2012.07.017
Dyverfeldt, P., Kvitting, J.-P. E., Sigfridsson, A., Engvall, J., Bolger, A. F., and Ebbers, T. (2008). Assessment of Fluctuating Velocities in Disturbed Cardiovascular Blood Flow: In Vivo Feasibility of Generalized Phase-Contrast MRI. J. Magn. Reson. Imaging 28 (3), 655–663. doi:10.1002/jmri.21475
Dyverfeldt, P., Sigfridsson, A., Kvitting, J.-P. E., and Ebbers, T. (2006). Quantification of Intravoxel Velocity Standard Deviation and Turbulence Intensity by Generalizing Phase-Contrast MRI. Magn. Reson. Med. 56 (4), 850–858. doi:10.1002/mrm.21022
Ebbers, T., Haraldsson, H., Dyverfeldt, P., Sigfridsson, A., Warntjes, M. J. B., and Wigström, L. (2008). “Higher Order Weighted Least-Squares Phase Offset Correction for Improved Accuracy in Phase-Contrast MRI,” in Proceedings of the International Society for Magnetic Resonance in Medicine. 16, Toronto, Ontario, May 2008.
Ebbers, T., Wigström, L., Bolger, A. F., Engvall, J., and Karlsson, M. (2001). Estimation of Relative Cardiovascular Pressures Using Time-Resolved Three-Dimensional Phase Contrast MRI. Magn. Reson. Med. 45 (5), 872–879. doi:10.1002/mrm.1116
Falahatpisheh, A., Rickers, C., Gabbert, D., Heng, E. L., Stalder, A., Kramer, H.-H., et al. (2016). Simplified Bernoulli's Method Significantly Underestimates Pulmonary Transvalvular Pressure Drop. J. Magn. Reson. Imaging 43 (6), 1313–1319. doi:10.1002/jmri.25097
Fredriksson, A., Trzebiatowska‐Krzynska, A., Dyverfeldt, P., Engvall, J., Ebbers, T., and Carlhäll, C. J. (2018). Turbulent Kinetic Energy in the Right Ventricle: Potential MR Marker for Risk Stratification of Adults with Repaired Tetralogy of Fallot. J. Magn. Reson. Imaging 47 (4), 1043–1053. doi:10.1002/jmri.25830
Fung, Y.-c. (1977). A First Course in Continuum Mechanics. Englewood Cliffs: Cambridge University Press.
Grigioni, M., Daniele, C., D'avenio, G., and Barbaro, V. (1999). A Discussion on the Threshold Limit for Hemolysis Related to Reynolds Shear Stress. J. Biomech. 32 (10), 1107–1112. doi:10.1016/s0021-9290(99)00063-9
Ha, H., Lantz, J., Haraldsson, H., Casas, B., Ziegler, M., Karlsson, M., et al. (2016e). Assessment of Turbulent Viscous Stress Using ICOSA 4D Flow MRI for Prediction of Hemodynamic Blood Damage. Sci. Rep. 6 (1), 39773–39814. doi:10.1038/srep39773
Ha, H., Lantz, J., Ziegler, M., Casas, B., Karlsson, M., Dyverfeldt, P., et al. (2017a). Estimating the Irreversible Pressure Drop across a Stenosis by Quantifying Turbulence Production Using 4D Flow MRI. Sci. Rep. 7 (1), 46618–46714. doi:10.1038/srep46618
Ha, H., Hwang, D., Kim, G. B., Kweon, J., Lee, S. J., Baek, J., et al. (2016a). Estimation of Turbulent Kinetic Energy Using 4D Phase-Contrast MRI: Effect of Scan Parameters and Target Vessel Size. Magn. Reson. Imaging 34 (6), 715–723. doi:10.1016/j.mri.2016.03.008
Ha, H., Hwang, D., Kim, G. B., Kweon, J., Lee, S. J., Baek, J., et al. (2016b). Reply to Letter by Dyverfeldt and Ebbers Regarding the Article "Estimation of Turbulent Kinetic Energy Using 4D Phase-Contrast MRI: Effect of Scan Parameters and Target Vessel Size". Magn. Reson. Imaging 34 (9), 1338–1340. doi:10.1016/j.mri.2016.07.014
Ha, H., Kim, G. B., Kweon, J., Huh, H. K., Lee, S. J., Koo, H. J., et al. (2016c). Turbulent Kinetic Energy Measurement Using Phase Contrast MRI for Estimating the post-stenotic Pressure Drop: In Vitro Validation and Clinical Application. PLoS ONE 11 (3), e0151540. doi:10.1371/journal.pone.0151540
Ha, H., Kim, G. B., Kweon, J., Lee, S. J., Kim, Y.-H., Lee, D. H., et al. (2016d). Hemodynamic Measurement Using Four-Dimensional Phase-Contrast MRI: Quantification of Hemodynamic Parameters and Clinical Applications. Korean J. Radiol. 17 (4), 445–462. doi:10.3348/kjr.2016.17.4.445
Ha, H., Kvitting, J., Dyverfeldt, P., and Ebbers, T. (2019). Validation of Pressure Drop Assessment Using 4D Flow MRI‐based Turbulence Production in Various Shapes of Aortic Stenoses. Magn. Reson. Med. 81 (2), 893–906. doi:10.1002/mrm.27437
Ha, H., Lantz, J., Ziegler, M., Casas, B., Karlsson, M., Dyverfeldt, P., et al. (2017b). Estimating the Irreversible Pressure Drop across a Stenosis by Quantifying Turbulence Production Using 4D Flow MRI. Sci. Rep. 7, 46618. doi:10.1038/srep46618
Ha, H., Park, K. J., Dyverfeldt, P., Ebbers, T., and Yang, D. H. (2020). In Vitro experiments on ICOSA6 4D Flow MRI Measurement for the Quantification of Velocity and Turbulence Parameters. Magn. Reson. Imaging 72, 49–60. doi:10.1016/j.mri.2020.06.020
Ha, H., Ziegler, M., Welander, M., Bjarnegård, N., Carlhäll, C.-J., Lindenberger, M., et al. (2018). Age-related Vascular Changes Affect Turbulence in Aortic Blood Flow. Front. Physiol. 9, 36. doi:10.3389/fphys.2018.00036
Hanai, S., Yamaguchi, T., and Kikkawa, S. (1991). Turbulence in the Canine Ascending Aorta and the Blood Pressure. Biorheology 28 (1-2), 107–116. doi:10.3233/bir-1991-281-211
Haraldsson, H., Kefayati, S., Ahn, S., Dyverfeldt, P., Lantz, J., Karlsson, M., et al. (2018). Assessment of Reynolds Stress Components and Turbulent Pressure Loss Using 4D Flow MRI with Extended Motion Encoding. Magn. Reson. Med. 79 (4), 1962–1971. doi:10.1002/mrm.26853
Kim, D., Kang, J., Adeeb, E., Lee, G.-H., Yang, D. H., and Ha, H. (2021). Comparison of Four-Dimensional Flow Magnetic Resonance Imaging and Particle Image Velocimetry to Quantify Velocity and Turbulence Parameters. Fluids 6 (8), 277. doi:10.3390/fluids6080277
Kim, G. B., Ha, H., Kweon, J., Lee, S. J., Kim, Y.-H., Yang, D. H., et al. (2015). Post-stenotic Plug-like Jet with a Vortex Ring Demonstrated by 4D Flow MRI. Magn. Reson. Imaging 34, 371–375. doi:10.1016/j.mri.2015.11.010
Kim, J., Lee, Y., Choi, S., and Ha, H. (2020). Pulsatile Flow Pump Based on an Iterative Controlled Piston Pump Actuator as an In-Vitro Cardiovascular Flow Model. Med. Eng. Phys. 77, 118–124. doi:10.1016/j.medengphy.2019.10.020
Knobloch, V., Binter, C., Gülan, U., Sigfridsson, A., Holzner, M., Lüthi, B., et al. (2014). Mapping Mean and Fluctuating Velocities by Bayesian Multipoint MR Velocity Encoding-Validation against 3D Particle Tracking Velocimetry. Magn. Reson. Med. 71 (4), 1405–1415. doi:10.1002/mrm.24785
Krittian, S. B. S., Lamata, P., Michler, C., Nordsletten, D. A., Bock, J., Bradley, C. P., et al. (2012). A Finite-Element Approach to the Direct Computation of Relative Cardiovascular Pressure from Time-Resolved MR Velocity Data. Med. image Anal. 16 (5), 1029–1037. doi:10.1016/j.media.2012.04.003
Lu, P. C., Lai, H. C., and Liu, J. S. (2001). A Reevaluation and Discussion on the Threshold Limit for Hemolysis in a Turbulent Shear Flow. J. Biomech. 34 (10), 1361–1364. doi:10.1016/s0021-9290(01)00084-7
Ma, L. E., Markl, M., Chow, K., Huh, H., Forman, C., Vali, A., et al. (2019). Aortic 4D Flow MRI in 2 minutes Using Compressed Sensing, Respiratory Controlled Adaptive K-Space Reordering, and Inline Reconstruction. Magn. Reson. Med. 81 (6), 3675–3690. doi:10.1002/mrm.27684
Markl, M., Wallis, W., Brendecke, S., Simon, J., Frydrychowicz, A., and Harloff, A. (2010). Estimation of Global Aortic Pulse Wave Velocity by Flow-Sensitive 4D MRI. Magn. Reson. Med. 63 (6), 1575–1582. doi:10.1002/mrm.22353
Markl, M., Wallis, W., Strecker, C., Gladstone, B. P., Vach, W., and Harloff, A. (2012). Analysis of Pulse Wave Velocity in the Thoracic Aorta by Flow-Sensitive Four-Dimensional MRI: Reproducibility and Correlation with Characteristics in Patients with Aortic Atherosclerosis. J. Magn. Reson. Imaging 35 (5), 1162–1168. doi:10.1002/jmri.22856
Marlevi, D., Ha, H., Dillon-Murphy, D., Fernandes, J. F., Fovargue, D., Colarieti-Tosti, M., et al. (2020). Non-invasive Estimation of Relative Pressure in Turbulent Flow Using Virtual Work-Energy. Med. Image Anal. 60, 101627. doi:10.1016/j.media.2019.101627
Members, W. C., Otto, C. M., Nishimura, R. A., Bonow, R. O., Carabello, B. A., Erwin, J. P., et al. (2021). 2020 ACC/AHA Guideline for the Management of Patients with Valvular Heart Disease: a Report of the American College of Cardiology/American Heart Association Joint Committee on Clinical Practice Guidelines. J. J. Am. Coll. Cardiol. 77 (4), e25–e197.
Mustard, J. F., Murphy, E. A., Rowsell, H. C., and Downie, H. G. (1962). Factors Influencing Thrombus Formation In Vivo. Am. J. Med. 33 (5), 621–647. doi:10.1016/0002-9343(62)90243-7
Petersson, S., Dyverfeldt, P., Sigfridsson, A., Lantz, J., Carlhäll, C. J., and Ebbers, T. (2016). Quantification of Turbulence and Velocity in Stenotic Flow Using Spiral Three‐dimensional Phase‐contrast MRI. Magn. Reson. Med. 75 (3), 1249–1255. doi:10.1002/mrm.25698
Prado, C. M., Ramos, S. G., Alves-Filho, J. C., Elias, J., Cunha, F. Q., and Rossi, M. A. (2006). Turbulent Flow/low wall Shear Stress and Stretch Differentially Affect Aorta Remodeling in Rats. J. J. Hypertens. 24 (3), 503–515. doi:10.1097/01.hjh.0000209987.51606.23
Ragosta, M. (2017). Textbook of Clinical Hemodynamics E-Book. Amsterdam, Netherlands: Elsevier Health Sciences.
Rizk, J. (2021). 4D Flow MRI Applications in Congenital Heart Disease. Eur. Radiol. 31 (2), 1160–1174. doi:10.1007/s00330-020-07210-z
Sallam, A. M., and Hwang, N. H. (1983). Human Red Blood Cell Hemolysis in a Turbulent Shear Flow: Contribution of Reynolds Shear Stresses. Biorheology 21 (6), 783–797. doi:10.3233/bir-1984-21605
Smith, R. L., Blick, E. F., Coalson, J., and Stein, P. D. (1972). Thrombus Production by Turbulence. J. Appl. Physiol. 32 (2), 261–264. doi:10.1152/jappl.1972.32.2.261
Soulat, G., McCarthy, P., and Markl, M. (2020). 4D Flow with MRI. Annu. Rev. Biomed. Eng. 22, 103–126. doi:10.1146/annurev-bioeng-100219-110055
Stankovic, Z., Allen, B. D., Garcia, J., Jarvis, K. B., and Markl, M. (2014). 4D Flow Imaging with MRI. Cardiovasc. Diagn. Ther. 4 (2), 173–192. doi:10.3978/j.issn.2223-3652.2014.01.02
Stein, P. D., and Sabbah, H. N. (1976). Turbulent Blood Flow in the Ascending Aorta of Humans with normal and Diseased Aortic Valves. Circ. Res. 39 (1), 58–65. doi:10.1161/01.res.39.1.58
Tennekes, H., and Lumley, J. L. (1972). A First Course in Turbulence. Cambridge, Massachusetts: MIT press.
von Spiczak, J., Crelier, G., Giese, D., Kozerke, S., Maintz, D., and Bunck, A. C. (2015). Quantitative Analysis of Vortical Blood Flow in the Thoracic Aorta Using 4D Phase Contrast MRI. PloS one 10 (9), e0139025. doi:10.1371/journal.pone.0139025
Walheim, J., Dillinger, H., Gotschy, A., and Kozerke, S. (2019). 5D Flow Tensor MRI to Efficiently Map Reynolds Stresses of Aortic Blood Flow In-Vivo. Sci. Rep. 9 (1), 18794–18812. doi:10.1038/s41598-019-55353-x
Yamaguchi, T., Kikkawa, S., Yoshikawa, T., Tanishita, K., and Sugawara, M. (1983). Measurement of Turbulence Intensity in the center of the Canine Ascending Aorta with a Hot-Film Anemometer. J. biomechanical Eng. 105 (2), 177–187. doi:10.1115/1.3138403
Yen, J.-H., Chen, S.-F., Chern, M.-K., and Lu, P.-C. (2014). The Effect of Turbulent Viscous Shear Stress on Red Blood Cell Hemolysis. J. Artif. Organs 17 (2), 178–185. doi:10.1007/s10047-014-0755-3
Zajac, J., Eriksson, J., Dyverfeldt, P., Bolger, A. F., Ebbers, T., and Carlhäll, C.-J. (2015). Turbulent Kinetic Energy in normal and Myopathic Left Ventricles. J. Magn. Reson. Imaging 41 (4), 1021–1029. doi:10.1002/jmri.24633
Zhang, T., Pauly, J. M., and Levesque, I. R. (2015). Accelerating Parameter Mapping with a Locally Low Rank Constraint. Magn. Reson. Med. 73 (2), 655–661. doi:10.1002/mrm.25161
Keywords: magnetic resonace imaging, turbulence measurement, turbulent kinetic energy, turbulence production, hemodynamics
Citation: Ha H, Huh HK, Park KJ, Dyverfeldt P, Ebbers T, Kim D-H and Yang DH (2021) In-vitro and In-Vivo Assessment of 4D Flow MRI Reynolds Stress Mapping for Pulsatile Blood Flow. Front. Bioeng. Biotechnol. 9:774954. doi: 10.3389/fbioe.2021.774954
Received: 13 September 2021; Accepted: 16 November 2021;
Published: 07 December 2021.
Edited by:
Katherine Yanhang Zhang, Boston University, United StatesReviewed by:
Hui Tang, Hong Kong Polytechnic University, Hong Kong SAR, ChinaHarvey Ho, The University of Auckland, New Zealand
Copyright © 2021 Ha, Huh, Park, Dyverfeldt, Ebbers, Kim and Yang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Dong Hyun Yang, donghyun.yang@gmail.com
†These authors have contributed equally to this work and share last authorship