Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 30 November 2022
Sec. Cardiovascular Imaging
This article is part of the Research Topic Frontiers in Cardiovascular Medicine: Rising Stars 2022 View all 75 articles

3D modeling and printing for complex biventricular repair of double outlet right ventricle

\r\nJan Brüning,Jan Brüning1,2Peter KramerPeter Kramer3Leonid Goubergrits,Leonid Goubergrits1,4Antonia Schulz,Antonia Schulz5,6Peter MurinPeter Murin5Natalia SolowjowaNatalia Solowjowa7Titus Kuehne,,Titus Kuehne1,2,3Felix Berger,Felix Berger2,3Joachim PhotiadisJoachim Photiadis5Viktoria Heide-Marie Weixler,,*Viktoria Heide-Marie Weixler2,5,6*
  • 1Institute for Cardiovascular Computer-Assisted Medicine, Charité – Universitätsmedizin Berlin, Berlin, Germany
  • 2Partner Site Berlin, German Center for Cardiovascular Research (DZHK), Berlin, Germany
  • 3Department of Congenital Heart Disease/Pediatric Cardiology, German Heart Center Berlin, Berlin, Germany
  • 4Einstein Center Digital Future, Berlin, Germany
  • 5Department of Congenital Heart Surgery and Pediatric Heart Surgery, German Heart Center Berlin, Berlin, Germany
  • 6Berlin Institute of Health (BIH), Berlin, Germany
  • 7Department of Cardiothoracic and Vascular Surgery, German Heart Center Berlin, Berlin, Germany

Background: Double outlet right ventricle (DORV) describes a group of congenital heart defects where pulmonary artery and aorta originate completely or predominantly from the right ventricle. The individual anatomy of DORV patients varies widely with multiple subtypes classified. Although the majority of morphologies is suitable for biventricular repair (BVR), complex DORV anatomy can render univentricular palliation (UVP) the only option. Thus, patient-specific decision-making is critical for optimal surgical treatment planning. The evolution of image processing and rapid prototyping techniques facilitate the generation of detailed virtual and physical 3D models of the patient-specific anatomy which can support this important decision process within the Heart Team.

Materilas and methods: The individual cardiovascular anatomy of nine patients with complex DORV, in whom surgical decision-making was not straightforward, was reconstructed from either computed tomography or magnetic resonance imaging data. 3D reconstructions were used to characterize the morphologic details of DORV, such as size and location of the ventricular septal defect (VSD), atrioventricular valve size, ventricular volumes, relationship between the great arteries and their spatial relation to the VSD, outflow tract obstructions, coronary artery anatomy, etc. Additionally, physical models were generated. Virtual and physical models were used in the preoperative assessment to determine surgical treatment strategy, either BVR vs. UVP.

Results: Median age at operation was 13.2 months (IQR: 9.6-24.0). The DORV transposition subtype was present in six patients, three patients had a DORV-ventricular septal defect subtype. Patient-specific reconstruction was feasible for all patients despite heterogeneous image quality. Complex BVR was feasible in 5/9 patients (55%). Reasons for unsuitability for BVR were AV valve chordae interfering with potential intraventricular baffle creation, ventricular hypoplasia and non-committed VSD morphology. Evaluation in particular of qualitative data from 3D models was considered to support comprehension of complex anatomy.

Conclusion: Image-based 3D reconstruction of patient-specific intracardiac anatomy provides valuable additional information supporting decision-making processes and surgical planning in complex cardiac malformations. Further prospective studies are required to fully appreciate the benefits of 3D technology.

Introduction

Double outlet right ventricle (DORV) is a group of complex cardiac lesions, occurring in about 3-9/100,000 live births and is characterized by a malposition of the great arteries (aorta and pulmonary artery), which are both arising predominantly (>50%) or entirely from the right ventricle (RV) (1). There is a wide range of anatomic variation from a rather simple morphology of a ventricular septal defect (VSD) with overriding aorta to a complex one with transposition of the great arteries (TGA), outflow tract obstruction and a VSD. This certainly creates a heterogeneity in definition, classification and also surgical treatment options. Early classifications focused on morphological criteria based on the relationship between the VSD and the great arteries: 1. sub-aortic type, 2. sub-pulmonary type, 3. double committed type and 4. non-committed type (2). A more recent classification, adopted by the databases of the Society of Thoracic Surgeons and European Association of Cardiothoracic Surgery, classifies 4 subtypes of DORV according to their clinical aspect: 1. VSD-type, 2. Fallot-type, 3. TGA-type and 4. non-committed/remote VSD-type. This simplified classification, besides the location of the VSD, also considers the degree of right ventricular outflow tract obstruction (RVOTO). Based on these two criteria, together with ventricular dimensions, the degree of arterial malposition and possible additional cardiac malformations, surgical strategy has to be adapted. In complex cases, a careful individualized decision has to be made between feasibility of biventricular repair (BVR) or opting for univentricular palliation (UVP).

The non-physiological hemodynamics resulting from UVP may cause severe long-term complications and long-term outcome is therefore thought to be less favorable. Hence, BVR is the preferred approach (3). Current overall operative mortality rates for BVR in DORV patients of 6-7% are reported, however, the surgical feasibility and success rates are highly dependent on the morphological complexity (4, 5). Poorer outcome of BVR in patients with borderline ventricular hypoplasia or complex remote VSD morphology highlights the importance of careful preoperative assessment and surgical strategy planning (6). In general, ventricular hypoplasia, atrioventricular (AV) valve abnormalities, or unresolvable outflow tract obstruction are potential contraindications for BVR (7). In the non-committed or remote VSD-type, closure of the VSD to either artery may create a long intracavitary baffle with an acute angle resulting in high resistances and velocities and thus relevant pressure gradients or a potential baffle geometry that may cross the AV-valve inlet. Echocardiography is currently considered the reference standard in assessing cardiac anatomy and determining the preferable surgical approach in DORV patients (7). However, in patients, in whom surgical decision-making cannot be conclusively established based on echocardiography, new technologies such as 3D imaging can provide valuable additional information.

3D imaging techniques such as magnetic resonance imaging (MRI) (8) and computed tomography (CT) (9) are used increasingly frequent to visualize and analyze the anatomy of different complex congenital heart defects. These techniques allow visualization of the entire cardiovascular anatomy as well as measurements of relevant intracardiac dimensions and volumes (10). However, the representation of the 3D anatomy using two-dimensional (2D) slices perpendicular to each other, encumbers the assessment of the complex 3D structures and their position and orientation in relation to each other. These obstacles can be overcome by reconstruction of the 3D geometry of the patient-specific anatomy by means of image processing. This reconstruction can be performed using either CT or MRI data (11, 12). While several approaches and software packages exist to reconstruct the 3D surface geometry, manual interaction is usually required due to the complex anatomy and imaging artifacts. The resulting 3D reconstructions can then be visualized to better understand the complex anatomy.

In addition to approaches targeting visualization of the patient-specific 3D anatomy, physical models of it can be generated via 3D printing (1315). These 3D printed models were found to allow better assessment of the spatial orientation of relevant intracardiac structures (11, 16). First studies already demonstrated that 3D printing prior to surgery improved understanding and surgical outcome parameters such as mechanical ventilation time or duration of intensive care unit (ICU) stay (17). Thus, 3D reconstruction of the patient-specific anatomy, especially in combination with 3D printing, might enhance understanding of the anatomical features and therefore provide a viable solution for the demand of precise preoperative planning and decision-making, that arises from the complexity of congenital heart defects.

This retrospective study addresses two aspects: First, by summarizing our experience over the last five years, the feasibility of 3D image reconstruction and 3D printing from preoperative imaging data is assessed and their additional value compared to echocardiography for surgical treatment planning of complex DORV patients, in whom decision-making is inconclusive, is appraised. Second, anatomical measurements, such as the size of the VSD and the heart valves’ annuli, as well as the ventricular volumes are compared between routine echocardiographic measurements and measurements performed on the 3D reconstructions. This comparison aims to address the question, whether 3D reconstructions simply provide additional information on the complex anatomy and the position of the intracardiac structures with respect to each other, or whether relevant measurements can also be performed directly using these reconstructions.

Materials and methods

Patient cohort

After institutional review board approval (EA2/116/22), informed consent was waived for retrospective data analysis. All DORV patients, operated at our institution between July 2017 and 2022, in whom surgical decision-making between BVR or UPV could not be decided from preoperative echocardiography alone and therefore 3D-reconstruction and 3D-printing had been performed to support decision-making, were included in this study. Patients were excluded if surgical decision was made from standard preoperative echocardiographic assessment and no additional CT or MRI data was required. Both echocardiography and 3D image data from CT or MRI were analyzed for the included patients. Heart team meetings for determining the treatment decision were only performed with the additional information obtained via 3D reconstruction and 3D printing was available. Reasons for these individual cases to be perceived as complex and in need of additional information for treatment planning are presented in the results section.

Preoperative parameters such as age, weight, anatomical characteristics or previous catheter and surgical interventions were recorded. Additionally, intraoperative characteristics, such as type of procedure, total operating time, cardiopulmonary bypass time, intraoperative complications, and postoperative characteristics, such as total ventilation time, total intensive care unit stay, total hospital stay, postoperative complications, were obtained.

Preoperative echocardiographic measurements

Echocardiographic data concerning chamber sizes, AV-valve sizes and VSD morphology of included patients was retrospectively analyzed offline from digitally archived preoperative echocardiograms with a vendor-specific software (EchoPAC™ version 203; General Electric Vingmed Ultrasound AS, Horten, Norway). Measurements were performed according to current recommendations (18). For available parameters, Z-Scores were calculated (19, 20).

3D image data

The image data available for 3D reconstruction was heterogenous in quality. In eight patients a CT scan had been performed using a Siemens Somatom Definition Flash scanner (Siemens Healthcare GmbH, Erlangen, Germany). Tube currents were adapted individually according to the body mass (CARE Dose), whereas a constant tube voltage of 100 kV was used (CARE kV). Spatial resolution of the CT images varied from 0.27 × 0.27 mm2 to 0.40 × 0.40 mm2, based on the slice thickness of 0.50–0.70 mm and reconstruction increment of 0.40 mm. While the CT device used has a minimal slice thickness of 0.625 mm, the lower values result from overlapping acquisition and respective reconstruction of the image data. Image acquisition was not ECG gated to reduce applied radiation doses. For one patient, cardiac MRI had been performed using a 1.5 Tesla Philips Achieva scanner (Philips Medical Systems, Best, Netherlands) with a 5-element cardiac phased-array coil. For assessment of the end-diastolic anatomy, a balanced 3D steady-state-free-precession imaging sequence (3 signal averages, navigator gated, ECG triggered) was used.

3D image reconstruction

Reconstruction of the patient-specific anatomy from both CT and MR image data was performed using AmiraZIBEdition (v. 2022.3; Konrad-Zuse-Zentrum Berlin, Germany). The aim of this procedure was to label all image voxels belonging to the blood pool. No reconstruction of the myocardium was performed. Entirely manual tools as brushes, as well as semi-automatic tools as region growing algorithms were employed. Due to the heterogeneous and complex anatomies of the individual patients, automatic image reconstruction was not viable. Furthermore, the heterogenous image data as well as the uneven distribution of contrast agent in the heart chambers did not allow for specification of a standardized Hounsfield unit threshold to be used for all CT data sets. In general, lower thresholds between 80 and 200 Hounsfield units were used to identify voxels belonging to the blood pool. Distinct labels were generated for the left and right ventricle, the left and right atrium, as well as the aorta and pulmonary artery (see Figure 1). The labeling procedure was performed by progressing through the 3D image stacks slice by slice using axial, sagittal and coronal orientations. Each orientation had to be processed multiple times to correctly identify all relevant anatomical structures. If discernable, neither trabeculae nor papillary muscles of the left and right ventricle were included in the respective reconstructions. All reconstructions were performed by one engineering researcher with more than 10 years of experience in image reconstruction of various pathologies. After an initial draft, each reconstruction was discussed and evaluated with pediatric cardiac surgeons and corrected if necessary.

FIGURE 1
www.frontiersin.org

Figure 1. Illustration of the image-based reconstruction of a patient-specific anatomy using computed tomography (CT) data. The top panel shows the resulting 3D surface geometry of the patient. The lower left panel shows a CT image slice without labels. The grayscale window is set to a range from -500 to +500 Hounsfield units. This image is superimposed using the labels generated during image reconstruction in the lower right panel. Here, the left (LA) and right atrium (RA), as well as the left (LV) and right ventricle (RV) are highlighted.

3D model generation and anatomical measurements

From the final voxel mask, a rough initial surface was generated using a marching cubes algorithm implemented in AmiraZIBEdition. This initial surface was subsequently smoothed using a volume preserving smoothing algorithm implemented in JavaView (v.5.01) (21). Subsequently, the smoothed surface was imported into Meshmixer (v3.5, Autodesk, USA), where remaining topological errors were corrected. Most of these errors resulted from artificial connections between anatomically non-connected structures due to proximity of the respective voxel fields, as for example between the aorta and pulmonary artery. Finally, the separation of the different parts of the anatomy was realized on this surface geometry by manually selecting the saddle points indicating the mitral and tricuspid annulus, the perimeter of the VSD as well as the pulmonary and aortic annulus. While the voxel label field already contained separate labels for the different heart chambers, the limitations of the three cartesian orientations did not allow to correctly model the complex anatomy especially observed in the annuli of the atria-ventricular valves as well as the VSD. Finally, a separate surface geometry for the LV and RV, the left and right atrium, the aorta, the pulmonary artery, as well as all four valvular annulus planes and the VSD were stored as triangulated surface mesh. An example of the final surface reconstruction of one geometry together with the labeled CT images is presented in Figure 1. Different visualization strategies were identified for each patient together with pediatric cardiac surgeons. This a priori specification of visualizations was necessary to account for the short schedule available for each patient during heart team meetings. Visualization strategies included showing structures in transparent that obstructed relevant anatomical structures or showing cut-open surface geometries of the ventricles to better highlight in the intra-cardiac structures. Exemplary visualizations used during heart team meetings are provided for all patients as Supplementary material.

Using these reconstructed surfaces, several anatomical parameters were measured for each patient. These include the volume of the reconstructed LV and RV. Additional length measurements were obtained for the RV, by using a cutting plane mimicking the four-chamber view. Then, the maximum distance from the tricuspid annulus to the RV tip was measured within this plane. For each annulus plane as well as the VSD, the cross-sectional area A, the circumference C, and the hydraulic diameter (D = 4*A/C) were calculated. The distances from the VSD to the aortic as well as pulmonary valve annulus were calculated in two ways. First, the distance from the centers of mass of the VSD and the respective valve was calculated. Second, a cubic spline demonstrating the “route” was generated, connecting the centers of mass of the VSD and the respective valve annulus. Here, an additional point was generated halfway between both centers of mass. The position of this center point was manipulated manually, using AmiraZIBEdition, to ensure that the resulting spline lies within the reconstructed blood pool. These two distance measurements were calculated as an estimate of the required length of a tunnel reconstruction via a patch insertion (see Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Illustration of the anatomical measurements performed using the specific surface reconstructions of each patient. An exemplary 3D surface geometry is shown in the upper left panel. Top right) The distance from the center of mass of the ventricular septal defect (VSD) and the aortic and pulmonary valve annulus were measured automatically by two approaches. First, the shortest linear connection (arrow) was calculated. Second, a cubic spline (dashed line) was generated to calculate a more realistic curved path. Bottom left) For each valve annulus as well as the VSD, which is shown here exemplarily, the circumference C and the cross-sectional area A were measured. From those two measurements the hydraulic diameter D was calculated. Bottom right) The left (LV) and the right ventricle (RV) were separated from each other and the exact volume of the closed surface geometries of both structures was measured.

3D printing of selected models

Physical models of the patient-specific anatomy were 3D printed using either a Form 2 or a Form 3 (Formlabs, Massachusetts, USA) printer. Here, the surface geometry of the patient-specific blood pool was artificially extruded by a thickness of one millimeter using the extrude command in Meshmixer. Thus, a thin-shelled representation of the blood pool was reconstructed that aimed at mimicking the conventional view a surgeon will have during the procedure, by providing a positive model rather than the negative blood pool model. These models were then cut at a plane or contour identified together with a cardiac surgeon, resulting in two or more pieces allowing the assessment of intracardiac anatomy (the detailed procedure for preparing the 3D prints is provided as Supplementary material). All models were printed using rigid resin [Formlabs Clear Resin RS-F2-GPCL-04 or Gray Resin RS-F2-GPGR-04, Somerville (MA), USA], resulting in a stiff non-pliable model. This approach does not represent the patient-specific myocardium and is thus, not suited for assessment of tissue thicknesses. Two additional models were printed via selective laser sintering of polyamide using a commercial print-on-demand service.

Statistical analysis

Baseline, intraoperative and outcome measures for patients undergoing UVP vs. BVR are presented as median [interquartile range (IQR)] when reporting continuous data or as frequency (%) when reporting categorical data. Due to the small sample size, only descriptive statistics are given and no comparative analyses of patients undergoing UVP vs. BVR were performed. For the anatomical parameters that were calculated based on the surface reconstructions, average values for both subgroups as well as the entire sample were calculated. To compare echocardiographic measurements and measurements based on the 3D reconstructions, Pearson correlation was calculated for each parameter that was available from both approaches. This analysis was performed using IBM-SPSS version 24.0 (IBM-SPSS Inc, Armonk, NY).

Results

Patient characteristics

A total of 64 DORV patients were operated at our institution in the study period between 2017 and 2022; 18 patients received UVP, 43 BVR, one patient underwent 1 1/2 correction and two patients with interim palliations await intended BVR. Nine out of these 64 DORV patients, had preoperative 3D imaging performed since the surgical approach (BVR vs. UVP) could not be conclusively decided based on preoperative echocardiography and were included in this retrospective study. Median age within the study cohort was 13.2 months (IQR: 9.6–24.0) and median weight was 8.3 kg (IQR: 7.8–11.0). No genetic disorders or preterm births were present. Cardiac anatomy was complex among all patients with multiple additional cardiac malformations (see Table 1 for further details). The DORV-VSD subtype was found in three patients, six patients had a DORV-TGA morphology. Four patients had significant pulmonary valve stenosis/RVOTO prior to surgery, the remaining five patients underwent previous pulmonary artery banding before BVR or UVP (Table 1).

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics.

Preoperative echocardiographic data

Echocardiographic measurements are given in Table 2. Overall, the LV was rather small with an average LV end-diastolic volume Z-Score of -2.5 and end-diastolic diameter Z-Score of -3.6. The RV on the other hand was rather large with a RV end-diastolic area Z-Score of 1.7. In two patients, moderate AV-valve regurgitation was observed. Overall AV valve dimensions were normal (average Z-scores from -0.1 to -1.6). No obvious AV valve straddling was observed by echocardiography.

TABLE 2
www.frontiersin.org

Table 2. Preoperative echocardiographic characteristics.

Indications for requesting 3D reconstruction and printing

In all study cases, routine clinical information was considered to be insufficient for adequate treatment planning for various reasons. Primarily 3D reconstruction was proposed to assess, whether closure of the VSD to either the aorta or the pulmonary artery would create a potential outflow tract obstruction or an obstruction of the AV-valve inlet. In many cases ventricular volumes measured using echocardiography as well as initial assessment of the size and location of the VSD suggested BVR to be a valid strategy. While echocardiography can sufficiently visualize the structures of interest, namely the pulmonary and aortic valve, the VSD and the AV valve inlet, the geometry and spatial relationships of these structures can often only be apprehended insufficiently.

Reconstruction of the patient-specific anatomy

The patient-specific anatomy of all patients is shown in Figure 3. A rotating animation of the entire anatomy is provided for every patient as Supplementary material. Furthermore, the surface geometries of all regions of the cardiovascular anatomy are also made accessible as Supplementary material. The entire anatomy consisting of the LV/RV, the left and right atrium as well as the aorta and pulmonary artery was reconstructed for all patients except for patient #3, for whom the right atrium was not discernable due to a lack of contrast. For patient #1 the atrial septal wall was not visible in the CT image data so that a joint geometry was generated for the left and right atrium. The required time for image reconstruction varied from 4 to 12 h, depending on the complexity of the anatomy, the image contrast, and the image voxel resolution, as well as the necessary corrections and reviews together with the surgical experts. While most ventricular surface geometries are rather smooth and feature no marked signs of the trabeculae carneae, some patients’ reconstructions feature rather jagged ventricular geometries (e.g., patient #3. #5, #6).

FIGURE 3
www.frontiersin.org

Figure 3. Overview of all reconstructed surface geometries using the same color scheme for highlighting all anatomical structures. Patients with biventricular repair are shown with a gray background.

Qualitative considerations regarding the benefit of 3D reconstructions

One advantage arising from the availability of 3D representations of the patient-specific anatomy is that the spatial orientation of intracardiac structures can be assessed in a qualitative manner as well. Here pediatric cardiac surgeons as well as pediatric cardiologists considered the 3D visualization alone as already being helpful for understanding the usually complex anatomy. Manipulation of this 3D visualization, such as transparent representations of selected parts for example the right ventricle (see Figure 3) as well as the opportunity to freely manipulate the view’s orientation further helped to assess the size, shape and spatial relationship of different intracardiac structures as well as to understand surgical constraints imposed by the patient-specific anatomy.

Apart from quantitative measures as distances between the VSD and the AV valve annuli, qualitative assessment was considered to allow estimation of potential treatment strategies, such as tunnel orientations, lengths, and sizes. Two examples where the 3D visualization clearly highlighted whether BVR by surgical creation of a tunnel from the VSD toward the aortic valve annulus was feasible are shown in Figure 4. While BVR was possible in both patients, only in patient #8 connection from the VSD to the aortic valve was feasible. In patient #7, this tunnel would have been strongly bent and long due to the constraints imposed by the LV anatomy. In this patient a closure of the VSD toward the pulmonary artery and an additional arterial switch helped creating a straighter and shorter tunnel. The eventual surgical treatment performed in both patients matched these theoretical considerations.

FIGURE 4
www.frontiersin.org

Figure 4. Examples of the virtual treatment decision based on the 3D reconstructions for two patients (patient #7 and patient #8), for which biventricular repair (BVR) was feasible. The 3D reconstruction of the blood pool is shown in the left column, whereas the extruded, thin-walled geometry, superimposed with the relevant structures for treatment planning is shown in the second column. The virtual treatment strategy is shown in the third column, whereas the right column shows a photograph of a 3D print of the model. For patient #8 (upper row) BVR by creation of a tunnel from the ventricular septal defect (VSD) to the aorta (Ao) was considered feasible due to the size and orientation of these structures as well as the size of the left ventricle. In patient #7 the tunnel from VSD to Ao was considered to be too strongly bent and not feasible due to the orientation and shape of the VSD, whereas a connection from VSD to the pulmonary artery (PA) was considered feasible.

In addition to the 3D visualization, the 3D printed models were considered to offer additional understanding of the anatomy. While the 3D visualization was considered to be better suited to highlight different compartments and intracardiac structures, the 3D printed models were considered to be closer to the real surgical environment, even though the models were rigid, and the myocardium was not reconstructed in a patient-specific manner. A major advantage of the 3D printed models was the intrinsic understanding of the sizes and dimensions of different intracardiac structures. The missing pliability of the models was considered the major constraint, as having soft-tissue models might allow to already mimic different surgical procedures before the intervention.

Anatomical measurements based on surface reconstruction

The anatomical measurements which were performed on the reconstructed surface geometries are listed in Table 3. Here, all individual measurements as well as the average for all nine patients and the average values for the patients receiving UVP or BVR are provided, respectively. On average, the end-diastolic ventricular volumes were larger in the patients receiving BVR. In general, the RV volumes were larger than the LV volumes in both groups. The distances from the VSD to the pulmonary and aortic valve were similar when averaged for all patients. However, on average for the patients receiving UVP, larger distances to the aortic valve were observed compared to the pulmonary valve. In contrast, the distances between VSD and the two valves were similar in the BVR subgroup. However, similar to the ventricular volumes, these trends were not observed in all individual cases. In patient #1, who received UVP, distances where similar and in patient #5 for whom BVR was achieved, the distance to the aortic valve was larger than that to the pulmonary valve. Size measurement of the heart valves’ annuli and the VSD revealed that the VSD was considerably larger in UVP patients than in BVR patients. Similarly, the aortic annulus was larger in patients with BVR.

TABLE 3
www.frontiersin.org

Table 3. Preoperative anatomic features of DORV patients measured using 3D reconstructions.

Quantitative comparison between 3D-based measurements and echocardiographic assessment of anatomic parameters

Not all parameters that were evaluated via echocardiography were also measured using the 3D reconstructions. The average values of the LVEDV were similar between echocardiography and 3D reconstruction. Also, the trend of slightly larger LV volumes in the BVR group was observed in both approaches. A moderate correlation between both measurements of 0.67 was found. However, absolute volumes of several patients varied between both modalities (Tables 2, 3). For the RV length measurement an excellent correlation of 0.94 was found. The echocardiographic assessment of the VSD diameter revealed slightly larger VSD in patients receiving BVR than in those receiving UVP. However, the VSD diameters measured using the 3D reconstruction were larger in the UVP group. The correlation between both measurements was 0.50. Similar correlations were found for the TV and MV diameters. For the TV, correlation coefficients between echocardiography and 3D reconstruction were 0.70 and 0.59 for the four-chamber and parasternal long axis view, respectively. Those values were 0.36 and 0.40 for the MV respectively.

Patients’ outcome

Five patients underwent BVR, four UVP. Reasons why BVR was not feasible in all patients are given in Table 4. BVR was performed by creating an intraventricular baffle closing the VSD and connecting the LV to the aorta in three patients (3/5, 60%) and to the pulmonary artery with an additional arterial switch operation in two patients (2/5, 40%). In two patients (2/5, 40%) the existing VSD was enlarged during BVR. Among the four patients with UVP, one patient underwent Stage I palliation (Damus-Kaye-Stansel anastomosis with modified BT-Shunt), two patients received a Glenn procedure (Stage II palliation), and the remaining patient had a Fontan surgery (Stage III palliation).

TABLE 4
www.frontiersin.org

Table 4. Decision-making in DORV patients with UVP.

Discussion

DORV represents a heterogenous and complex group of congenital heart defects with considerably variable morphology. Patients frequently require thorough decision-making to ensure optimal treatment tailored for their specific anatomy.

BVR in DORV requires several anatomic prerequisites such as adequately sized ventricles, a VSD that can be rerouted toward either the aorta or the pulmonary artery, the ability to create an adequate outflow tract without compromising ventricular inflow, and a coronary anatomy that allows relocation in case an arterial switch is required. A conclusive decision between BVR vs. UVP is not always straightforward and therefore precise preoperative evaluation with optimal visualization of the anatomy is desired. 3D reconstruction or printing is a rather new technology, which could add additional information to the clinical routine assessment via echocardiography. If anatomy is not comprehended completely, surgical planning, execution and outcomes will be imperfect. Prior studies have demonstrated that improper patient selection for BVR, the generally desired approach, can result in inferior outcomes if anatomic prerequisites are not favorable (6).

The major aim of this study was to focus on this complex group of DORV patients, in which surgical decision-making based on preoperative echocardiography is inconclusive and to evaluate if 3D reconstruction and/or printing can help to better understand anatomy and guide surgical planning. Furthermore, we wanted to access the feasibility of 3D reconstruction and/or printing of the anatomy of DORV patients based on routine image data from CT and MRI and to evaluate whether clinically relevant anatomical measurements could also be performed using these reconstructions.

Benefits of 3D reconstruction and 3D printing

The overall feedback regarding the additional information provided by either 3D reconstruction and/or 3D printing from the heart team consisting of pediatric cardiac surgeons and pediatric cardiologists was favorable. The possibility of having the entire 3D information of the patient-specific anatomy available was considered beneficial for treatment planning. Furthermore, having 3D printed models allowed ad hoc assessment and evaluation of sizes, shapes, relationships, and orientations of various intracardiac structures. Thus, the general feedback from our clinical center matches the experience from other retrospective studies (1012).

According to members of the heart team, the main advantage provided by both 3D reconstruction and 3D printing was that different treatment strategies could be elaborated and discussed easier, as the entire intra-cardiac anatomy could be analyzed at once. For example, feasibility of a patch insertion to connect the VSD to either the pulmonary artery or the aorta could be assessed directly, as the theoretical path could be easier judged. Combined with the experience of the pediatric surgeons, potential obstructions of the AV valves or long narrow tunnels that would result in outflow tract obstruction could be easier identified when the entire information of the patient-specific anatomy was available. Interestingly, anatomical measurements performed using the 3D reconstructions, were of minor interest, as evaluation of the patency of the ventricular sizes and the size of the atrial septal defect were already considered to be well described by echocardiographic measurements. The main advantage was clearly seen in the qualitative information provided by either 3D reconstruction or 3D printed models, such as position, shape, and orientation of intracardiac structures.

In theory, this information about the patient-specific anatomy is already provided entirely by the 3D reconstructions. Furthermore, these simultaneously allow for strong versatility with respect to the choice of visualization, as for example in highlighting different anatomical structures, making structures transparent or being able to freely zoom and rotate the models. However, the feedback from members of the heart team with respect to the 3D printed models were very favorable of that approach, as it allows easy manipulation of the view, and the anatomy of the heart could be assessed ad hoc by touching and rotating the model freely. While the printed models still deviate from the real surgical situation, they were considered closer to this than the visualization on the computer screen. Furthermore, as the models were printed in their actual size, intra-cardiac structures were true to size, even though these sizes might not reflect the end-diastolic state perfectly A major advantage of the 3D printed models was, that they allowed to better describe and discuss treatment strategies by indicating them in the model.

However, 3D printing comes with an additional preparation step, as the models must be pre-processed and printed. Furthermore, depending on the complexity of the model, as well of the printing technology used, post-processing of the models can also require substantial time. In contrast, preparation of the visualizations of the purely digital 3D reconstructions also takes time and was not sufficiently interactive. This problem, however, might be overcome with training or dedicated software solutions allowing ad hoc changes of the visualization during the heart team meetings. Finally, common feedback was, that pliable models allowing deformation and probably even mock interventions would be favorable over rigid models.

Comparison of echocardiographic and reconstruction-based measurements

We also attempted to compare anatomical measurements performed on the reconstructions against echocardiographic measurements performed in clinical routine to assess whether 3D reconstructions could also be used for robust assessment of these parameters. While average measurements available from echocardiography and 3D reconstructions were reasonably comparable, individual measurements showed considerable variability. In particular the VSD diameter was measured substantially different with smaller diameters in UVP patients based on echocardiographic assessment and larger diameters in that the BVR group based on the 3D reconstructions. However, even though several average measurements agreed well, correlations between both modalities were not excellent. Only for the RV length a strong correlation was observed, whereas for all other parameters, correlations ranged between 0.36 and 0.70. One possible explanation for this is that the RV length measurement is defined in the four-chamber view, which was reproduced in the 3D reconstruction for this measurement. Thus, similarity of the evaluation planes could be achieved. Planar echocardiographic measurements are known to be less precise than volumetric measurements (22) and measurements in neonates are known to be operator dependent (23).

Quantifications of cardiac chamber volumes have important inherent limitations in both modalities. Since our CT protocols in children are generally not ECG gated due to higher radiation exposition with retrospective ECG gating, acquired 3D images are not reliably end-diastolic and therefore might underestimate end-diastolic volumes. Echocardiography using the modified Simpson’s method for LV volume measurement may also be inaccurate, especially in complex anatomies, due to incongruence of geometric assumptions but also resulting from poor acoustic windows or limited operator experience. Moreover, RV volumes cannot be reliably measured in conventional 2D echocardiography. Nonetheless, as current reference values are based on echocardiographic measurements and echocardiography allows assessment of the end-diastolic state, measurements based on 3D reconstructions are no viable substitute for assessing ventricular volumes yet. ECG-gated acquisition of CT image data might overcome this problem but would require higher radiation dosage. Also, MRI images are performed ECG-gated. However, due to the long acquisition times, MR imaging usually requires sedation of neonates to prevent motion artifacts and the image resolution is usually poorer than that of CT images.

Outlook

While the main benefit of 3D reconstruction and 3D printing was seen in providing a clear visualization of the entire cardiac anatomy at once and reconstruction-based measurements were of limited importance, these measurements could be beneficial in future. First, echocardiographic measurements are often performed in 2D representations. In this study, the morphology of the ventricles and VSDs was very complex in several patients. For example, the RV length measurement in the four-chamber view was not ideal to assess the maximum elongation of the ventricle. Furthermore, some VSD shapes featured marked ellipticity, which cannot be assessed using only one diameter measurement. In contrast, the 3D reconstruction provided the exact representation of all anatomical structures, allowing detailed measurements. If the 3D reconstruction procedure can be automated or at least standardized, this approach might allow anatomic quantification without operator biases. Furthermore, additional quantitative measures describing the complex anatomy, such as the orientation of intracardiac structures as well as the orientation of structures in relation to each other might be feasible. Here, parameters such as the angles between the valve annulus planes and the VSD, but also more complex and abstract measurements based on statistical shape analysis (24) can be thought of. Such parameters might allow to objectify the mostly qualitative nature of the additional information provided by either 3D reconstructions or 3D printing.

However, even if such parameters can be identified, 3D reconstruction and 3D printing can currently only be considered as an important complementary diagnostic tool, as not all aspects required for pre-operative treatment planning can be fully assessed from the reconstructions alone. For example, for assessment of the presence of straddling AV valve chordae passing through the VSD, additional echocardiographic examination will always be necessary. Also, identification of novel discriminating parameters for DORV cases eligible for BVR requires much larger sample sizes and a prospective study design, which might be the goal of future studies.

Limitations

Due to the retrospective nature of this study and the small numbers of patients, the benefits arising from 3D reconstruction and 3D printing of the patient-specific anatomy could only be assessed qualitatively. As 3D reconstruction and 3D printing was only performed for complex cases, where no clear treatment decision could be discerned from routine data, comparison of procedural outcomes of the patients investigated in this study against other patients was not possible. While the first studies aiming at quantification of the added benefit of these technologies exist (17, 25), the conduction of comparative studies of surgical success and/or performance parameters, with and without added information by either 3D reconstructions or 3D-printed models, is not trivial. Since there is neither a consensus nor a standardized approach for reconstruction of the patient-specific anatomy, each center has yet to evaluate these procedures individually to generate evidence and build confidence needed for a prospective investigation.

The reconstruction procedure used in this study requires extensive manual interaction of up to several hours. This surely will be a relevant limitation for any translational endeavors of this approach. However, due to the considerable heterogeneity, both in the patient-specific anatomy but also in the image data, this approach can be considered as beneficial in the current stage of research, as it allows to accurately assess the relevant aspects of the anatomy and mitigate imaging artifacts via the experience of the heart team. The advance of machine learning-based algorithms for image processing was already successful in providing automated tools for reconstruction of different anatomical structures (2628), including the heart (27), albeit mostly for those with normal physiology. For these approaches to be applicable for congenital heart defects, a joint effort by multiple centers is most likely required to provide the necessary case numbers and sufficiently heterogenous image data for the approach to be widely applicable. Such a database would also be extremely helpful in identifying anatomical parameters with predictive capabilities for BVR or the need for UVP.

One limitation with respect to the comparison between echocardiographic and 3D reconstruction-based parameters is, that both methods are subject to operator biases and uncertainties in its current state, making it impossible to discern the ground truth. Here, prospective studies might allow to assess the accuracy of both methods in more detail, as additional information can be acquired during the surgical intervention.

Conclusion

Image-based 3D reconstruction of the patient-specific intracardiac anatomy provides important additional information supporting decision-making process and surgical planning. While this information might be useful for further objectification of treatment, the approach is not yet commonly used in clinical routine. Here, one problem is the limited number of prospective studies aiming at quantification of the benefits for treatment-planning. Similarly, the question whether relevant measurements can also be performed directly using 3D reconstruction of the patient-specific anatomy and how these measurements compare against current gold-standard methods cannot be answered sufficiently without additional prospective investigations.

Data availability statement

The datasets presented in this study can be found in online repositories. The names of the repository/repositories and accession number(s) can be found in the article/Supplementary material.

Ethics statement

The studies involving human participants were reviewed and approved by Ethikkommission der Charité – Universitätsmedizin Berlin. Written informed consent from the participants’ legal guardian/next of kin was not required to participate in this study in accordance with the national legislation and the institutional requirements.

Author contributions

JB, PK, LG, AS, PM, NS, TK, FB, JP, and VW: conceptualization, investigation, and writing—review and editing. JB, PK, LG, and VW: data curation. JB, PK, and VW: formal analysis. JB, PK, LG, AS, NS, and VW: methodology. LG, PM, TK, FB, JP, and VW: supervision. JB: visualization. JB and VW: statistical analysis, interpretation of results, and writing—original draft. All authors contributed to the article and approved the submitted version.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fcvm.2022.1024053/full#supplementary-material

Movies illustrating the 3D geometry of all nine patients in a rotational animation as well as the reconstructed surface geometries, separated for left and right ventricle, left and right atrium, aorta, and pulmonary artery are provided as supplemental material via figshare.com (doi: 10.6084/m9.figshare.20465142, https://figshare.com/s/73e82de8b0ef82950dcb).

Abbreviations

AV, Atrioventricular; BT-shunt, Blalock-Taussig shunt; BVR, Biventricular repair; CT, Computed tomography; 3D/2D, Three/Two-dimensional; DORV, Double outlet right ventricle; ECMO, Extracorporeal membrane oxygenation; LV, Left ventricle; MRI, Magnetic resonance imaging; RV/RVOTO, Right ventricle/right ventricular outflow tract obstruction; TGA, Transposition of the great arteries; UVP, Univentricular palliation; VSD, Ventricular septal defect.

References

1. Obler D, Juraszek AL, Smoot LB, Natowicz MR. Double outlet right ventricle: aetiologies and associations. J Med Genet. (2008) 45:481–97. doi: 10.1136/jmg.2008.057984

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Lev M, Bharati S, Meng CC, Liberthson RR, Paul MH, Idriss F. A concept of double-outlet right ventricle. J Thorac Cardiovasc Surg. (1972) 64:271–81.

Google Scholar

3. Shimada M, Hoashi T, Nakata T, Ozawa H, Kurosaki K, Kitano M, et al. Surgical outcomes of biventricular repair for hypoplastic left ventricle with congenital mitral valve stenosis. World J Pediatr Congenit Heart Surg. (2019) 10:11–7. doi: 10.1177/2150135118808748

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Artrip JH, Sauer H, Campbell DN, Mitchell MB, Haun C, Almodovar MC, et al. Biventricular repair in double outlet right ventricle: surgical results based on the STS-EACTS International nomenclature classification☆. Eur J Cardiothorac Surg. (2006) 29:545–50. doi: 10.1016/j.ejcts.2005.12.038

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Villemain O, Belli E, Ladouceur M, Houyel L, Jalal Z, Lambert V, et al. Impact of anatomic characteristics and initial biventricular surgical strategy on outcomes in various forms of double-outlet right ventricle. J Thorac Cardiovasc Surg. (2016) 152:698.e–706.e. doi: 10.1016/j.jtcvs.2016.05.019

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Bradley TJ, Karamlou T, Kulik A, Mitrovic B, Vigneswaran T, Jaffer S, et al. Determinants of repair type, reintervention, and mortality in 393 children with double-outlet right ventricle. J Thorac Cardiovasc Surg. (2007) 134:967.e–73.e. doi: 10.1016/j.jtcvs.2007.05.061

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Meng H, Pang K-J, Li S-J, Hsi D, Yan J, Hu S-S, et al. Biventricular repair of double outlet right ventricle: preoperative echocardiography and surgical outcomes. World J Pediatr Congenit Heart Surg. (2017) 8:354–60. doi: 10.1177/2150135117692973

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Beekmana RP, Roest AAW, Helbing WA, Hazekamp MG, Schoof PH, Bartelings MM, et al. Spin echo MRI in the evaluation of hearts with a double outlet right ventricle: usefulness and limitations. Magn Reson Imaging. (2000) 18:245–53. doi: 10.1016/S0730-725X(99)00138-1

CrossRef Full Text | Google Scholar

9. Otton JM, Birbara NS, Hussain T, Greil G, Foley TA, Pather N. 3D printing from cardiovascular CT: a practical guide and review. Cardiovasc Diagn Ther. (2017) 7:507–26. doi: 10.21037/cdt.2017.01.12

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Kumar P, Bhatia M. Role of computed tomography in pre- and postoperative evaluation of a double-outlet right ventricle. J Cardiovasc Imaging. (2021) 29:205. doi: 10.4250/jcvi.2020.0196

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Garekar S, Bharati A, Chokhandre M, Mali S, Trivedi B, Changela VP, et al. Clinical application and multidisciplinary assessment of three dimensional printing in double outlet right ventricle with remote ventricular septal defect. World J Pediatr Congenit Heart Surg. (2016) 7:344–50. doi: 10.1177/2150135116645604

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Bharati A, Garekar S, Agarwal V, Merchant SA, Solanki N. MRA-based 3D-printed heart model—an effective tool in the pre-surgical planning of DORV. BJRcase Rep. (2016) 2:20150436. doi: 10.1259/bjrcr.20150436

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Yoo S-J, van Arsdell GS. 3D printing in surgical management of double outlet right ventricle. Front Pediatr. (2018) 5:289. doi: 10.3389/fped.2017.00289

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Dydynski PB, Kiper C, Kozik D, Keller BB, Austin E, Holland B. Three-dimensional reconstruction of intracardiac anatomy using CTA and surgical planning for double outlet right ventricle: early experience at a tertiary care congenital heart center. World J Pediatr Congenit Heart Surg. (2016) 7:467–74. doi: 10.1177/2150135116651399

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Mottl-Link S, Boettger T, Krueger JJ, Rietdorf U, Schnackenburg B, Ewert P, et al. Cast of complex congenital heart malformation in a living patient. Circulation. (2005) 112:e356–7. doi: 10.1161/CIRCULATIONAHA.105.547620

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Riesenkampff E, Rietdorf U, Wolf I, Schnackenburg B, Ewert P, Huebler M, et al. The practical clinical value of three-dimensional models of complex congenitally malformed hearts. J Thorac Cardiovasc Surg. (2009) 138:571–80. doi: 10.1016/j.jtcvs.2009.03.011

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Zhao L, Zhou S, Fan T, Li B, Liang W, Dong H. Three-dimensional printing enhances preparation for repair of double outlet right ventricular surgery. J Card Surg. (2018) 33:24–7. doi: 10.1111/jocs.13523

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Lopez L, Colan SD, Frommelt PC, Ensing GJ, Kendall K, Younoszai AK, et al. Recommendations for quantification methods during the performance of a pediatric echocardiogram: a report from the pediatric measurements writing Group of the American society of echocardiography pediatric and congenital heart disease council. J Am Soc Echocardiogr. (2010) 23:465–95. doi: 10.1016/j.echo.2010.03.019

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Cantinotti M, Scalese M, Murzi B, Assanta N, Spadoni I, De Lucia V, et al. Echocardiographic nomograms for chamber diameters and areas in caucasian children. J Am Soc Echocardiogr. (2014) 27:1279.e–92.e. doi: 10.1016/j.echo.2014.08.005

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Lopez L, Colan S, Stylianou M, Granger S, Trachtenberg F, Frommelt P, et al. Relationship of echocardiographic Z scores adjusted for body surface area to age, sex, race, and ethnicity: the pediatric heart network normal echocardiogram database. Circ Cardiovasc Imaging. (2017) 10:e006979. doi: 10.1161/CIRCIMAGING.117.006979

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Kuprat A, Khamayseh A, George D, Larkey L. Volume conserving smoothing for piecewise linear curves, surfaces, and triple lines. J Comput Phys. (2001) 172:99–118. doi: 10.1006/jcph.2001.6816

CrossRef Full Text | Google Scholar

22. Jenkins C, Moir S, Chan J, Rakhit D, Haluska B, Marwick TH. Left ventricular volume measurement with echocardiography: a comparison of left ventricular opacification, three-dimensional echocardiography, or both with magnetic resonance imaging. Eur Heart J. (2008) 30:98–106. doi: 10.1093/eurheartj/ehn484

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Smith A, Purna JR, Castaldo MP, Ibarra-Rios D, Giesinger RE, Rios DR, et al. Accuracy and reliability of qualitative echocardiography assessment of right ventricular size and function in neonates. Echocardiography. (2019) 36:1346–52. doi: 10.1111/echo.14409

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Elsayed A, Mauger CA, Ferdian E, Gilbert K, Scadeng M, Occleshaw CJ, et al. Right ventricular flow vorticity relationships with biventricular shape in adult tetralogy of fallot. Front Cardiovasc Med. (2022) 8:806107. doi: 10.3389/fcvm.2021.806107

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Hansen JH, Duong P, Jivanji SGM, Jones M, Kabir S, Butera G, et al. Transcatheter correction of superior sinus venosus atrial septal defects as an alternative to surgical treatment. J Am Coll Cardiol. (2020) 75:1266–78. doi: 10.1016/j.jacc.2019.12.070

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Fantazzini A, Esposito M, Finotello A, Auricchio F, Pane B, Basso C, et al. 3D automatic segmentation of aortic computed tomography angiography combining multi-view 2D convolutional neural networks. Cardiovasc Eng Technol. (2020) 11:576–86. doi: 10.1007/s13239-020-00481-z

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Chen C, Qin C, Qiu H, Tarroni G, Duan J, Bai W, et al. Deep learning for cardiac image segmentation: a review. Front Cardiovasc Med. (2020) 7:25. doi: 10.3389/fcvm.2020.00025

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Singh MK, Singh KK. A review of publicly available automatic brain segmentation methodologies, machine learning models, recent advancements, and their comparison. Ann Neurosci. (2021) 28:82–93. doi: 10.1177/0972753121990175

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: double outlet right ventricle (DORV), biventricular repair, 3D printing, congenital heart disease, image reconstruction

Citation: Brüning J, Kramer P, Goubergrits L, Schulz A, Murin P, Solowjowa N, Kuehne T, Berger F, Photiadis J and Weixler VH-M (2022) 3D modeling and printing for complex biventricular repair of double outlet right ventricle. Front. Cardiovasc. Med. 9:1024053. doi: 10.3389/fcvm.2022.1024053

Received: 20 August 2022; Accepted: 07 November 2022;
Published: 30 November 2022.

Edited by:

Giulia Elena Mandoli, University of Siena, Italy

Reviewed by:

Jenny Zablah, University of Colorado Hospital, United States
Zhonghua Sun, Curtin University, Australia

Copyright © 2022 Brüning, Kramer, Goubergrits, Schulz, Murin, Solowjowa, Kuehne, Berger, Photiadis and Weixler. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Viktoria Heide-Marie Weixler, weixler@dhzb.de

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.