Abstract
Computational preoperative planning offers the opportunity to reduce surgery time and patient risk. However, on soft tissues such as the breast, deviations between the preoperative and intraoperative settings largely limit the applicability of preoperative planning. In this work, we propose a high-performance accurate simulation model of the breast, to fuse preoperative information with the intraoperative deformation setting. Our simulation method encompasses three major elements: high-quality finite-element modeling (FEM), efficient handling of anatomical couplings for high-performance computation, and personalized parameter estimation from surface scans. We show the applicability of our method on two problems: 1) transforming high-quality preoperative scans to the intraoperative setting for fusion of preoperative planning data, and 2) real-time tracking of breast tumors for navigation during intraoperative radiotherapy. We have validated our methodology on a test cohort of nine patients who underwent tumor resection surgery and intraoperative radiotherapy, and we have quantitatively compared simulation results to intraoperative scans. The accuracy of our simulation results suggest clinical viability of the proposed methodology.
1 Introduction
Computational preoperative planning of surgical interventions entails multiple benefits, in particular reduced risk to the patient and shorter interds, computational preoperative planning has seen success in applications such as radiotherapy Calvo et al. (2014), neurosurgery Prada et al. (2014); Kahl et al. (2021); Nemoto et al. (2002), or orthognathic surgery AlcaƱiz et al. (2021).
Image-guided surgery on the breast, on the other hand, hardly benefits from computational preoperative planning. Due to the soft-tissue nature of the breast, there is often a large deviation between the preoperative and intraoperative deformation conditions, which complicates mapping any preoperative data to the intraoperative setting. To date, clinicians resort to three suboptimal options: 1) They rely on preoperative images, which unfortunately do not represent the deformed setting during surgery; 2) they may try to predict the deformation during surgery as part of the preoperative planning, but this is hardly feasible due to the unknown details of the surgery; 3) they can capture high-quality images during surgery, but this process is slow and it requires a readily available imaging system in the operating room.
We pay particular attention to tumor resection due to breast cancer and subsequent intraoperative radiation therapy (IORT) Vaidya et al. (2005); Vaidya (2007). IORT delivers a large dose of ionizing radiation to the tumor bed during surgery, thus maximizing the dose applied to the tumor while minimizing the dose applied to nearby healthy tissue. Preoperative planning of IORT involves calculation of a cumulative dose on a volume image that faithfully represents the patientās anatomy, and is successfully used in, e.g., neurosurgery Prada et al. (2014); Kahl et al. (2021); Nemoto et al. (2002). However, to date IORT is hardly possible on breast cancer surgery, due to the strong mismatch between preoperative and intraoperative settings. This mismatch is due to two major reasons, which cannot be predicted in advance. One major reason is surgical manipulation, such as tumor resection and retraction of mobile structures in the path of the beam. The other major reason is the insertion and motion of the IORT device (applicator).
In our work, we propose a high-performance yet accurate simulation model of the breast, to fuse preoperative information, e.g., high-quality CT images, with the intraoperative deformation setting. Our simulation method encompasses four major elements:
1) An efficient patient-specific finite-element (FEM) simulation model. A key feature of our method is to approach two major tasks of soft-tissue modeling, namely mesh preparation and mathematical modeling, in a cross-informed manner. In this way, we obtain a runtime simulation model that is accurate but efficient, as it avoids complex coupling of different anatomical elements and the need for high-resolution simulation meshes.
2) Estimation of personalized simulation parameters from multiple preoperative images. We obtain two preoperative images per patient, a CT scan and a surface scan, in two different configurations that span beyond the deformation from the preoperative to the intraoperative setting. By optimizing mechanical tissue parameters that accurately fit this deformation, we obtain a personalized soft-tissue model that is able to predict intraoperative deformations.
3) Deformation of a high-quality breast model from a preoperative CT scan to the intraoperative configuration. With the high-accuracy simulation model estimated as described above, we deform the preoperative breast model to the intraoperative configuration. Once in this intraoperative configuration, it is possible to execute IORT dose planning.
4) Real-time simulation of breast deformation, for high-accuracy intraoperative navigation. We further optimize the mesh complexity of the breast simulation model to enable real-time deformation during intraoperative navigation. The real-time simulation can take as input tracker data of the IORT applicator, and use these as boundary conditions to compute the breast deformation.
In Section 2.1 we list the input data of both our simulation methodology and experimental validation. In Section 2.2 we describe the FEM simulation model and how it is configured from patient-specific data. Then in Section 2.3 we describe the estimation of soft-tissue parameters.
In Section 3.2 we demonstrate the accuracy of breast deformation from preoperative to intraoperative settings. We have tested our methodology on a cohort of nine patients who underwent tumor resection surgery and IORT. For all these patients, we obtained preoperative data (a CT-scan in supine position and a surface scan in sitting position) as well as intraoperative data (a surface scan in surgical position and the position of the IORT applicator). We have estimated a personalized simulation model for each patient, and we have evaluated the accuracy of the deformation to the intraoperative configuration.
Finally, in Section 3.3, we demonstrate real-time simulation of breast deformation due to motion of the IORT applicator, suitable for intraoperative navigation.
Before describing the methods and results of our work, next we discuss related work. Much of the previous work on planning for breast interventions and IORT has focused on bridging the gap between preoperative data and the operative setting. We discuss work that follows different approaches, either navigation techniques, simulation techniques, or fusing preoperative images (CT, MRI, or mammography) with the intraoperative setting.
1.1 Related work-navigation
Navigation is a problem that has received important commercial attention. There are multiple available commercial navigation systems, but they typically target specific applications. Some of the most prominent examples are: SurgicEye, for imaging of sentinel lymph; Aesculap, for orthopaedics; or Medtronic, for neurosurgery. Unfortunately, none of these systems combines preoperative imaging, such as CT or MRI, with intraoperative navigation. Therefore, they cannot accommodate preoperative planning data.
In addition to commercial systems, there is also important research on navigation. For the particular problem of breast cancer, there are works that have proposed navigation solutions for breast biopsy Treepong et al. (2014), and for sonography-guided breast surgery Ungi et al. (2016). In this project, we propose matching the input anatomy to intraoperative tracking data and use soft-tissue simulation methods to estimate the deformation. Based on this deformation, one could compute the required dose distribution solution on a deformed high-resolution image of the patientās anatomy, overcoming the problem of geometric mismatch between the preoperative images and the operative setting during irradiation.
1.2 Related work-soft-tissue models
The first task in devising a soft-tissue model of the breast is to segment and mesh its geometry. As we discuss later in Section 2.2, we follow the most common approach of obtaining a CT-scan in supine position, and segmenting and meshing this CT-scan. However, the scanning position differs from the surgical position, and we must deform the model. Recently, citeMazier2021 have introduced a different approach, as they initialize the geometry of the breast directly in surgical position. They do this by quickly morphing a geometric breast template to a surface scan obtained in surgical position. As their template is endowed with surgical drawings that aid in planning, they also obtain personalized surgical drawings. In a way, we solve the same morphing task, but our model also enjoys mechanical response, while theirs is only geometric. Therefore, we can further deform the breast model, e.g., for runtime navigation.
Multiple previous works have attempted high-quality FEM simulation of the soft-tissue in the breast. Those works can be largely classified into three groups based on the specific problems that they target: compression of the breast under two rigid plates Tanner et al. (2006b); Azar et al. (2001); Pathmanathan et al. (2008); Han et al. (2012), deformation due to gravity loading Han et al. (2011); Tanner et al. (2006b); Danch-Wierzchowska et al. (2016) and surgical planning or outcome prediction Lapuebla-Ferri et al. (2011); del Palomar et al. (2008).
The majority of the methods execute FEM analysis using tetrahedral meshes; however, hexahedral meshes have also been used Pathmanathan et al. (2008); Tanner et al. (2006b). In recent works, hexahedral meshes are gaining popularity, at least on the brain and other organs Miller et al. (2010); Wittek et al. (2010); Alkhatib et al. (2022), specially as they are complemented with methods that support complex geometries Bui et al. (2019). The various methods also differ in terms of the discretization complexity of the models, ranging from hundreds of elements Tanner et al. (2006b), to thousands of elements Pathmanathan et al. (2008), or even tens of thousands of elements Tanner et al. (2006a); Han et al. (2012). We tune the mesh complexity to optimize the balance between accuracy and performance depending on the target problem.
1.3 Related work-material properties
In the simulation of soft tissue in the breast, the various previous works differ in their choice of material model as well. Some authors used linear elastic materials (e.g., Tanner et al. (2006a)), while others used nonlinear hyperelastic materials (e.g., Tanner et al. (2006b)). Comparative studies indicate that hyper-elastic materials provide higher accuracy, which is expected given the potential large deformation of the breast. In particular, the incompressible Neo-Hookean material provided the best results when comparing deformations in standing and prone positions Griesenauer et al. (2014). Some works have analyzed the parameterization of the incompressible Neo-Hookean material, in particular the stiffness for the energy term of the first invariant (typically denoted as C1 or μ/2, with the shear modulus μ computed as E/2 (1 + ν) in terms of Young modulus E and Poissonās ratio ν). Optimal values range between C1 = 0.13Ā kPa Tanner et al. (2006a) and C1 = 0.08Ā kPa Rajagopal et al. (2008). Griesenauer et al. Griesenauer et al. (2014) recommend using the average value of C1 = 0.105Ā kPa.
One important conclusion from previous work is the large variability in material parameters across subjects. Using deterministic approaches for parameter adjustment has proven significantly limited, and sensitivity analysis and uncertainty quantification are necessary to obtain results including confidence intervals Biehler et al. (2015); Sankaran and Marsden (2011); Hauseux et al. (2017, 2018); Rego et al. (2021). Motivated by this variability, we carry out a personalized fitting of the soft-tissue properties of the breast.
Beyond the material model, previous works also differ in terms of the degree of heterogeneity in the breast models. Some works Han et al. (2012); Tanner et al. (2006b,a) have used different tissue classes: fibro-glandular, fat and skin. Other works Danch-Wierzchowska et al. (2016), on the other hand, differentiate only between internal (muscle, thorax and internal organs) and external tissue (breast tissue including fat and surrounding skin).
1.4 Related work-adaptive meshes
For one of our target applications, runtime navigation, we use adaptive simulation meshes that maximize mesh resolution at areas of interest. Adaptive meshing is a long-standing idea, even in the context of dynamic mesh adaptivity Wu et al. (2001). We use a fixed adaptive mesh, as the region of interest, i.e., the region surrounding the tumor, is known in advance. Recent works evaluate the actual error introduced by discretization from a rigorous mathematical perspective Wittek et al. (2010); Bui et al. (2018a, 2019, 2018b); Duprez et al. (2020). Interestingly, the actual resolution and distribution of the discretization may vary considerable depending on the error metric used. Therefore, our meshing approach could be further enhanced by introducing a goal-oriented error estimate.
2 Materials and methods
In this section, we describe how we create patient-specific soft-tissue models of the breast. In our modeling methodology we follow two fundamental principles:
⢠We approach mesh preparation and mathematical modeling in a cross-informed manner, to produce simulation models that maximize efficiency.
⢠We obtain patient-specific data in multiple configurations, to estimate best-matching soft-tissue parameters.
The section starts with a description of the input data. Next, it describes the mathematical simulation model, the initialization of the model from imaging data, and the definition of boundary conditions. Finally, the section covers the estimation of soft-tissue parameters.
2.1 Input data
To create a personalized model of the patientās breast, we leverage multiple input data. First, we acquire a high-quality CT scan in a pose similar to the surgical configuration. In particular, we use a CT scan in supine position with arms lifted. Using this CT scan, we extract the 3D simulation model, as we discuss in more detail in the next section.
However, using the CT scan alone poses several challenges. While the configuration is close to the surgical position, it is not fully accurate, as the surgical bed may slightly reoriented. But most importantly, the CT scan does not capture the mechanical response of the breast tissue.
To estimate soft-tissue mechanical parameters, we capture two 3D surface scans of the patientās torso: one 3D scan in the same supine position as the CT scan, , and another 3D scan in a relaxed sitting position, . The deformation between these two 3D scans is larger than the deformation during surgery, and it allows us to robustly estimate simulation parameters, as we discuss later in Section 2.3. We use 3D scans instead of CT scans to minimize radiation on the patient.
Furthermore, for validation purposes, we also acquire a 3D scan during surgery. Note that this last scan is not part of the modeling and simulation methodology; it was captured only for validation as part of this study. Figure 1 shows all three 3D scans captured for each patient.
FIGURE 1
2.2 Simulation model
Our approach to model the breast is to identify soft and rigid anatomical elements in the region of interest, as shown in Figure 2, define efficient coupling boundary conditions between them, and solve the tissue deformation using FE analysis. This approach mimics previous work for the simulation of orthognathic surgery AlcaƱiz et al. (2021), but applied to breast simulation. We follow this approach to simulate both the interaction between the soft-tissue and stiff or bone tissue, as well as to handle contact between the breast soft-tissue and the IORT applicator.
FIGURE 2
We start by segmenting rigid or stiff tissue in the breast area in the input CT scan. In particular, we segment jointly the ribs, intercostal muscle and the pectoralis muscle. These all form a single continuous rigid body in the simulation, which we refer to as chest wall in the rest of the text. In addition, we segment separately the remaining skin tissue. Finally, we limit the simulation mesh to a region of interest centered on the breast, by picking a central point and a radius. We use 3D Slicer for segmentation tasks and to create the initial mesh. However, this mesh is too detailed, and then we use Meshmixer to obtain the final simulation mesh.
To build the FE simulation model, we integrate a strain energy density and a gravity potential on the volume of the breast soft-tissue. Instead of rotating the chest wall to represent different configurations of the torso, we keep the chest wall fixed and we rotate the gravity vector. Furthermore, this approach allows us to circumvent the estimation of an undeformed configuration for the breast soft-tissue. The breast is deformed in supine position where the mesh is initialized, due to the action of gravity forces, but we define the undeformed position simply by applying a negative gravity vector. Simulating an arbitrary rotation of the torso amounts to first applying this negative gravity vector and then adding the rotated gravity.
We compute the gravity potential aswith Ļ the breast mass density (which we define as the density of water), g the gravity vector for the configuration to be simulated, and x the deformationdisplacement of the tissue point.
We define the elastic energy aswith Ψ(F) the constitutive model of the breast soft-tissue and F the deformation gradient. Following previous work, we use a Neohookean model . Recall that C1 = μ/2, which is the material parameter typically estimated in the literature.
The simulation mesh defines a discretization of the deformationdisplacement field x on the breast mesh domain Ī©, and we approximate the integrals of elastic energy and gravity potential using finite elements. In our work, we have used tetrahedral finite elements. We also separate degrees of freedom coupled to the rigid parts, xrigid, and free degrees of freedom, xfree. Then, the computation of static breast deformationsdisplacements x can be posed as an optimization problem, with the rigid parts as boundary conditions:
We solve this optimization to predict the breast deformation every time we change the boundary conditions xrigid. We do this using Newtonās method, with a conjugate gradient solver for the solution of linear systems of equations. We refer the reader to AlcaƱiz et al. (2021) for details.
2.3 Estimation of soft-tissue parameters
For preoperative planning and/or intraoperative navigation, the breast soft-tissue must be simulated in configurations defined by the intraoperative transformation of the clinical bed. While this configuration is similar to the supine position of the CT-scan, as shown in Figure 1, we estimate soft-tissue parameters by fitting a larger deformation. This approach ensures that the deformations in the intraoperative setting do not extrapolate to far unknown situations. In particular, we estimate soft-tissue parameters to best match the transformation of the breast from supine to sitting position, as shown in Figure 1.
We choose to estimate a homogeneous breast soft-tissue material, defined by its Young modulus, to avoid overfitting problems. As we discuss later in the results section, this parameterization provides sufficient accuracy for our target applications.
We initialize the Young modulus to a value of E = 0.609Ā kPa, corresponding to the average value of C1 = 0.105Ā kPa from the literature (as discussed in Section 1.3), and Poissonās ratio of ν = 0.45. Then we execute a patient-specific optimization process, to estimate the Young modulus such that a tranformation of the 3D scan in supine position best matches the 3D scan in sitting position. We depict this optimization process schematically in Figure 3. Formally, the optimization is expressed as follows:
FIGURE 3
Given a tentative Young modulus E and the gravity vector in sitting position gsitting, we compute the deformationdisplacement of the breast xsitting by solving the simulation problem (Eq. 3). Using this deformation, we transform (denoted by function T) the 3D scan in supine position , and we register the result to the 3D scan in sitting position , to compute a registration error. Based on this registration error, we further optimize the Young modulus E.
Our modeling and estimation approach is limited by its treatment of gravity, described above in Section 2.2. In supine position the breast is deformed, under internal stress. Due to the nonlinearity of the tissue, this underlying stress produces an error as the gravity vector is rotated. A more sound approach would require estimating the rest position of the breast together with the soft-tissue parameters, such that both the sitting and supine deformations are met under the appropriate boundary conditions. Other works have already explored undoing the effect of gravity for breast modeling Mazier et al. (2022); MƮra et al. (2018). However, while potentially more accurate, this approach introduces a high number of degrees of freedom in the optimization and makes it substantially more nonlinear. Since the supine position is close to the surgical position, we find approach to be a sufficient compromise. This is validated by our experiments.
3 Experiments and results
In this section, we discuss the experiments carried out to validate our simulation methodology. We start with a detailed description of the test cohort and the estimation of soft-tissue parameters following the approach described in Section 2.3. Then, we perform quantitative evaluation of the accuracy and performance of the simulation model, on the two target deformation problems: deformation of the breast from preoperative configuration to intraoperative configuration, and real-time deformation for intraoperative navigation. Deformation to the preoperative configuration enables cross-validation of the soft-tissue model, as we measure its accuracy on a test configuration not used for model training.
3.1 Test cohort and parameter estimation
We performed the study on a cohort of nine patients; all of them underwent tumor resection surgery and IORT, and we acquired preoperative and intraoperative scans (one CT-scan and three 3D surface scans, as discussed previously in Section 2.1). All data was acquired at Hospital Universitario Doctor NegrĆn, with approval of the hospitalās ethics committee, and with informed consent from all the patients.
Table 1 lists details of all patients in the cohort. The age range was 51ā84Ā years, tumors were located on both left 6) and right breasts (3), in different locations on the breast (some centered, some near skin and/or the chest wall), and the size of breasts ranged from small to large. Figure 4 highlights the simulation mesh and the location of the tumor for one particular patient in the cohort (patient #2). Table 1 also lists the inclination of the surgical in the intraoperative setting. This information was used for defining the gravity vector g in the deformation from the preoperative to the intraoperative configuration.
TABLE 1
| ID | Age | Breast | Size | Tumor Position | AP (°) | LAT (°) | Mesh (tets) | Young (kPa) |
|---|---|---|---|---|---|---|---|---|
| 1 | 60 | Left | Medium | Near chest wall | 5 | 4 | 8,227 | 0.8 |
| 2 | 55 | Left | Large | Near skin | 5 | 4 | 11,672 | 0.9 |
| 3 | 83 | Right | Medium | Centered | 5 | 4 | 11,828 | 1.2 |
| 4 | 56 | Left | Medium | Centered | 7 | 7 | 12,235 | 0.6 |
| 5 | 53 | Left | Medium | Centered | 7 | 4 | 11,739 | 0.5 |
| 6 | 51 | Left | Small | Near skin and chest wall | 9 | 5 | 4,997 | 1.2 |
| 7 | 84 | Left | Small | Near skin and chest wall | 6 | 7 | 6,712 | 0.4 |
| 8 | 69 | Right | Small | Near skin and chest wall | 9 | 5 | 5,444 | 0.3 |
| 9 | 61 | Right | Large | Centered | 10 | 6 | 12,947 | 2.0 |
Characteristics of the nine patients analyzed in the study, including age, breast characteristics, tumor position, anteroposterior (AP) and lateral (LAT) inclination of the surgical bed, mesh size (in tetrahedra) of the simulated volume, and estimated Young modulus.
FIGURE 4
Following the procedure described in Section 2.3, and using the preoperative 3D surface scans in supine and sitting positions, we estimate the Young modulus for the breast simulation models of all patients. Table 1 includes the size of the simulation mesh for each patient, as well as the Young modulus resulting from the estimation.
3.2 Deformation to the intraoperative setting and cross-validation
One of the applications of the soft-tissue breast simulation is to deform a preoperative CT scan to the intraoperative configuration, and thus plan the dose for IORT Valdivieso-Casique et al. (2015). Here, we measure the error produced by our model in this deformation. As the intraoperative data was not used for estimating the soft-tissue model, this test serves for cross-validation.
The deformation error is most relevant in the volume near the tumor, as this is the location where the radiotherapy dose will be planned. However, we lack a CT scan in intraoperative configuration, hence we cannot locate the tumor in this configuration. As an alternative, we use the preoperative and intraoperative surface 3D scans to measure deformation error. Specifically, we locate the tumor on the preoperative CT scan, we find the point on the surface that is closest to the tumor, and then we identify a region of interest (ROI) of roughly 2-cm-radius centered on this point, as shown in Figure 5. We chose this ROI following advice from clinical experts, as a sufficiently large region in the proximity of the tumor.
FIGURE 5
Table 2 shows the deformation error from preoperative to intraoperative configuration on the ROI, for all patients in the cohort. In all cases, the error within the ROI is below 5Ā mm. We initialize the simulation mesh in preoperative supine position, we apply the orientation corresponding to the intraoperative configuration to each patient (see Table 1), and we compute the deformation of the breast tissue. With this deformation, we transform the preoperative 3D surface scan, we register the result to the intraoperative 3D surface scan, and we measure the signed-distance error within the ROI. Table 2 shows the input simulation mesh in supine position, as well as the deformed mesh in the intraoperative configuration. The fitting error could be reduced by allowing heterogeneous soft-tissue parameters across the breast, but this could easily incur in overfitting error, due to the scarcity of deformation examples.
TABLE 2
| Tumor location | Error | Tumor location | Error | |
|---|---|---|---|---|
![]() | ![]() | ![]() | ![]() | ![]() |
| Patient 1 | Patient 2 | |||
![]() | ![]() | ![]() | ![]() | |
| Patient 3 | Patient 4 | |||
![]() | ![]() | ![]() | ![]() | |
| Patient 5 | Patient 6 | |||
![]() | ![]() | ![]() | ![]() | |
| Patient 7 | Patient 8 | |||
![]() | ![]() | |||
| Patient 9 | ||||
Quantitative evaluation of the deformation error between preoperative and intraoperative setting. We initialize the simulation mesh in preoperative supine position, we apply the orientation corresponding to the intraoperative configuration to each patient (see Table 1), and we compute the deformation of the breast tissue. With this deformation, we transform the preoperative 3D surface scan, we register the result to the intraoperative 3D surface scan, and we measure the error on the region-of-interest (ROI) closest to the tumor. The colors indicate signed-distance error (in mm) between the simulation result and the actual intraoperative 3D scan. In all cases, the error in the ROI is below 5Ā mm.
3.3 Real-time deformation for intraoperative navigation
The other major application of the soft-tissue breast simulation is to enable real-time tracking of the tumor during navigation for IORT. We start with the tumor in the preoperative configuration, and then we transform it to the intraoperative configuration based on the orientation of the surgical bed as discussed in the previous section. During IORT, it is possible to track in real-time the position and orientation of the IORT applicator, and we use this transformation as boundary conditions for real-time simulation of breast deformation, and hence track the tumorās location. Figure 6 depicts an example IORT applicator mesh inserted in the breast simulation mesh.
FIGURE 6
To deform the breast from preoperative to intraoperative setting, we use a high-resolution simulation mesh, as this deformation is not necessarily interactive. However, for real-time tracking, deformations must be interactive. Therefore, we have validated the ability to compute real-time deformations with sufficient accuracy.
For this test, we have used the simulation mesh of patient #3, but we have downsized the original simulation mesh from 11,828 tetrahedra to 1,581 tetrahedra. We have selected this resolution by trial-and-error, to hit a good performance-accuracy trade-off. As discussed in Section 1.4, more advanced adaptive meshing methods could be used, e.g., considering goal-based error metrics. We have designed a motion of the applicator of roughly 8.7Ā mm (5Ā mm in each coordinate axis), subdivided into 10 steps. For each step, we have solved the deformation problem of the breast soft-tissue, as described in Section 2.2, using the configuration of the rigid applicator as boundary conditions.
Each simulation step was computed in 30Ā ms, on a commodity processor. This performance indicates that real-time simulation can be sustained if the velocity at which the clinician moves the applicator is under 29Ā mm/s, which is well above the practical needs. Figure 6 shows the initial simulation mesh of this test, including the applicator; the final mesh after moving the applicator 8.7Ā mm, and per-vertex distances between both meshes.
4 Discussion
In this work, we have described a methodology for modeling and simulation of the breast. The focus of our methodology is to find a good balance between simulation accuracy and performance, allowing fast updates of the breast soft-tissue deformation even interactively. We have confirmed that the method is applicable to a diverse range of breast sizes and tumor morphologies.
In the paper, we have performed preliminary testing toward two possible applications of fast soft-tissue simulation. Full development of these applications would require, however, additional technology components.
For preoperative planning of intra-operative radiotherapy, breast soft-tissue simulation could be used in the following way. The simulation model should be meshes in supine position, based on the available CT-scan, as we do. Then, the simulation model is deformed from supine to surgical position, as done in our experiments described in Section 3.2. Using this deformation, it is possible to deform the input CT-scan, using a volume image resampling method Gascon et al. (2013); Aguilera et al. (2015). Radiotherapy planning could be executed in two possible ways. One approach would be simulate dose planning on the pre-operative anatomy Valdivieso-Casique et al. (2015) and then transform the dose planning along with the CT-scan. Another approach would be to execute fast dose simulation on the transformed CT-scan, perhaps initialized by the transformed dose.
For intraoperative navigation, breast soft-tissue simulation could be used in the following way. A tracking method can be used to obtain in real-time the 3D configuration of surgical tools. This 3D configuration can be used as boundary conditions for soft-tissue simulation, as shown for the IORT applicator in our experiments described in Section 3.3. With fast soft-tissue simulation, the deformation of the breast is updated interactively, and the location of the tumor can be displayed to the surgeon together with the tracked configuration of the surgical tool, e.g., using augmented reality displays Azimi et al. (2012).
The various applications of runtime breast simulation are the main lines for future work. In addition to developing and integrating the complementary technology components discussed above, they require formal clinical testing and validation beyond the scope of this paper.
From a pure methodological perspective, our work also admits future improvements. One of the possible improvements, for higher accuracy of the breast simulation model, is to consider a heterogeneous tissue distribution. However, as mentioned earlier, estimating a more complex tissue model also requires more training data, i.e., breast scans under different deformations. One of the relevant aspects of our modeling methodology is that meshing and mechanical modeling are cross-informed, such that the couplings between anatomical elements can be efficiently simulated. Cross-information of these two aspects could be raised to yet another level, through adaptive meshes that are material aware. This, however, would require a combined solution to the meshing and material estimation problems. Another possible improvement is to maximize the efficiency of the quasi-static simulation method, by designing a faster solver tailored to the problem at hand. Finally, yet another possible improvement is to fully automate the creation of the soft-tissue model from the input data, thus reducing the practical overhead to deploy the solution in practice. This could be done through data-driven methods based on machine learning, which have seen recent success on soft-tissue modeling problems Mendizabal et al. (2019); Meister et al. (2020).
Statements
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided their written informed consent to participate in this study.
Author contributions
PA, CV, JP, and AG contributed to Conceptualization, Methodology, Software, Formal Analysis, Investigation and Resources. PA, CV, and BP contributed to the Clinical Validation. PA and MO wrote the Original draft Preparation and Review and Editing. CI and MO contributed to Project administration and Funding acquisition.
Funding
This project has received funding from the European Unionās Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 764644. This paper only contains the authorās views and the Research Executive Agency and the Commission are not responsible for any use that may be made of the information it contains. The project is also partially funded by FEDER/Spanish Ministry of Science and Innovation, grant RTC-2017-5878-1.
Acknowledgments
The authors thank the Department of Radiotherapic Oncology of Hospital Universitario Doctor Negrin (Las Palmas de Gran Canaria, Spain) led by Marta Lloret, and specially Beatriz Pinar, for the help and advise in the data gathering process.
Conflict of interest
PA and CI were employed by the company GMV Innovating Solutions.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisherās note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
AguileraA. R.SalasA. L.PerandrĆ©sD. M.OtaduyM. A. (2015). A parallel resampling method for interactive deformation of volumetric models. Comput. Graph. X.53, 147ā155. 10.1016/j.cag.2015.10.002
2
AlcaƱizP.PĆ©rezJ.GutiĆ©rrezA.BarreiroH.VillalobosĆngelMirautD.et al (2021). Soft-tissue simulation for computational planning of orthognathic surgery. J. Pers. Med.11, 982. 10.3390/jpm11100982
3
AlkhatibF.BourantasG. C.WittekA.MillerK. (2022). Generation of patient-specific structured hexahedral mesh of aortic aneurysm wall. 10.48550/ARXIV.2206.06175
4
AzarF. S.MetaxasD. N.SchnallM. D. (2001). Methods for modeling and predicting mechanical deformations of the breast under external perturbations. Med. Image Anal.2208, 1ā27. 10.1016/s1361-8415(01)00053-6
5
AzimiE.DoswellJ.KazanzidesP. (2012). Augmented reality goggles with an integrated tracking system for navigation in neurosurgery. Proc. - IEEE Virtual Real., 123ā124. 10.1109/VR.2012.6180913
6
BiehlerJ.GeeM. W.WallW. A. (2015). Towards efficient uncertainty quantification in complex and large-scale biomechanical problems based on a bayesian multi-fidelity scheme. Biomech. Model. Mechanobiol.14, 489ā513. 10.1007/s10237-014-0618-0
7
BuiH. P.TomarS.BordasS. P. (2019). Corotational cut finite element method for real-time surgical simulation: Application to needle insertion simulation. Comput. Methods Appl. Mech. Eng.345, 183ā211. 10.1016/j.cma.2018.10.023
8
BuiH. P.TomarS.CourtecuisseH.AudetteM.CotinS.BordasS. P. (2018a). Controlling the error on target motion through real-time mesh adaptation: Applications to deep brain stimulation. Int. J. Numer. Method. Biomed. Eng.34, e2958. 10.1002/cnm.2958
9
BuiH. P.TomarS.CourtecuisseH.CotinS.BordasS. P. (2018b). Real-time error control for surgical simulation. IEEE Trans. Biomed. Eng.65, 596ā607. 10.1109/TBME.2017.2695587
10
CalvoF. A.MurilloL. A.SallabandaM.Martinez-VillanuevaJ.SoleC. V. (2014). Imaging opportunities for treatment planning in intraoperative electron beam radiotherapy (ioert): Developments in the context of radiance system. Rep. Pract. Oncol. Radiother.19, 239ā245. 10.1016/j.rpor.2013.05.004
11
Danch-WierzchowskaM.BorysD.Bobek-BilewiczB.JarzabM.SwierniakA. (2016). Simplification of breast deformation modelling to support breast cancer treatment planning. Biocybern. Biomed. Eng.36, 531ā536. 10.1016/j.bbe.2016.06.001
12
del PalomarA. P.CalvoB.HerreroJ.LópezJ.DoblarĆ©M. (2008). A finite element model to accurately predict real deformations of the breast. Med. Eng. Phys.30, 1089ā1097. 10.1016/j.medengphy.2008.01.005
13
DuprezM.BordasS. P. A.BuckiM.BuiH. P.ChoulyF.LlerasV.et al (2020). Quantifying discretization errors for soft tissue simulation in computer assisted surgery: A preliminary study. Appl. Math. Model.77, 709ā723. 10.1016/j.apm.2019.07.055
14
GasconJ.EspaderoJ. M.PerezA. G.MadridU.TorresR.OtaduyM. A. (2013). āFast deformation of volume data using tetrahedral mesh rasterization,ā in Proc. Of the ACM SIGGRAPH/eurographics symposium on computer animation.
15
GriesenauerR. H.WeisJ. A.ArlinghausL. R.MeszoelyI. M.MigaM. I.GriesenauerR. H.et al (2014). Comparison of different material models to simulate 3-d breast deformations using finite element analysis. Ann. Biomed. Eng.42, 843ā857. 10.1007/s10439-013-0962-8
16
HanL.HipwellJ. H.TannerC.TaylorZ.MertzanidouT.CardosoJ.et al (2012). Development of patient-specific biomechanical models for predicting large breast deformation. Phys. Med. Biol.57, 455ā472. 10.1088/0031-9155/57/2/455
17
HanL.HipwellJ.MertzanidouT.CarterT.ModatM.OurselinS.et al (2011). A hybrid fem-based method for aligning prone and supine images for image guided breast surgery. Proc. - Int. Symposium Biomed. Imaging, 1239ā1242. 10.1109/ISBI.2011.5872626
18
HauseuxP.HaleJ. S.BordasS. P. (2017). Accelerating Monte Carlo estimation with derivatives of high-level finite element models. Comput. Methods Appl. Mech. Eng.318, 917ā936. 10.1016/j.cma.2017.01.041
19
HauseuxP.HaleJ. S.CotinS.BordasS. P. (2018). Quantifying the uncertainty in a hyperelastic soft tissue model with stochastic parameters. Appl. Math. Model.62, 86ā102. 10.1016/j.apm.2018.04.021
20
KahlK. H.BalagiannisN.HƶckM.SchillS.RoushanZ.ShibanE.et al (2021). Intraoperative radiotherapy with low-energy x-rays after neurosurgical resection of brain metastasesāAn augsburg University medical center experience. Strahlenther. Onkol.197, 1124ā1130. 10.1007/s00066-021-01831-z
21
Lapuebla-FerriA.del PalomarA. P.HerreroJ.JimĆ©nez-MocholĆA. J. (2011). A patient-specific fe-based methodology to simulate prosthesis insertion during an augmentation mammoplasty. Med. Eng. Phys.33, 1094ā1102. 10.1016/j.medengphy.2011.04.014
22
MazierA.BilgerA.ForteA. E.PeterlikI.HaleJ. S.BordasS. P. (2022). Inverse deformation analysis: An experimental and numerical assessment using the fenics project. Eng. Comput.10.1007/s00366-021-01597-z
23
MeisterF.PasseriniT.MihalefV.TuysuzogluA.MaierA.MansiT. (2020). Deep learning acceleration of total Lagrangian explicit dynamics for soft tissue mechanics. Comput. Methods Appl. Mech. Eng.358, 112628. 10.1016/j.cma.2019.112628
24
MendizabalA.MƔrquez-NeilaP.CotinS. (2019). Simulation of hyperelastic materials in real-time using deep learning. Med. Image Anal.59, 101569. 10.1016/j.media.2019.101569
25
MillerK.WittekA.JoldesG.HortonA.Dutta-RoyT.BergerJ.et al (2010). Modelling brain deformations for computer-integrated neurosurgery. Int. J. Numer. Method. Biomed. Eng.26, 117ā138. 10.1002/cnm.1260
26
MĆ®raA.CartonA. K.MullerS.PayanY. (2018). A biomechanical breast model evaluated with respect to mri data collected in three different positions. Clin. Biomech.60, 191ā199. 10.1016/j.clinbiomech.2018.10.020
27
NemotoK.OgawaY.MatsushitaH.TakedaK.TakaiY.YamadaS.et al (2002). Intraoperative radiation therapy (iort) for previously untreated malignant gliomas
28
PathmanathanP.GavaghanD. J.WhiteleyJ. P.ChapmanS. J.BradyJ. M. (2008). Predicting tumor location by modeling the deformation of the breast. IEEE Trans. Biomed. Eng.55, 2471ā2480. 10.1109/TBME.2008.925714
29
PradaF.BeneM. D.MatteiL.CasaliC.FilippiniA.LegnaniF.et al (2014). Fusion imaging for intra-operative ultrasound-based navigation in neurosurgery. J. Ultrasound17, 243ā251. 10.1007/s40477-014-0111-8
30
RajagopalV.LeeA.ChungJ. H.WarrenR.HighnamR. P.NashM. P.et al (2008). Creating individual-specific biomechanical models of the breast for medical image analysis. Acad. Radiol.15, 1425ā1436. 10.1016/j.acra.2008.07.017
31
RegoB. V.WeissD.BersiM. R.HumphreyJ. D. (2021). Uncertainty quantification in subject-specific estimation of local vessel mechanical properties. Int. J. Numer. Method. Biomed. Eng.37, e3535. 10.1002/cnm.3535
32
SankaranS.MarsdenA. L. (2011). A stochastic collocation method for uncertainty quantification and propagation in cardiovascular simulations. J. Biomech. Eng.133, 031001. 10.1115/1.4003259
33
TannerC.SchnabelJ. A.HillD. L.HawkesD. J.LeachM. O.HoseD. R.et al (2006b). Model-based registration of x-ray mammograms and mr images of the female breast. Phys. Med. Biol.15, 1425ā1436. 10.1088/0031-9155/57/2/455
34
TannerC.SchnabelJ. A.HillD. L.HawkesD. J.LeachM. O.HoseD. R. (2006a). Factors influencing the accuracy of biomechanical breast models. Med. Phys.33, 1758ā1769. 10.1118/1.2198315
35
TreepongB.TanaiutchawootN.WiratkapunC.SuthakornJ. (2014). āOn the design and development of a breast biopsy navigation system: Path generation algorithm and system with its gui evaluation,ā in 2014 IEEE-EMBS international conference on biomedical and health informatics. Bali, Indonesia: BHI, 273ā276. 10.1109/BHI.2014.6864356
36
UngiT.GauvinG.LassoA.YeoC. T.PezeshkiP.VaughanT.et al (2016). Navigated breast tumor excision using electromagnetically tracked ultrasound and surgical instruments. IEEE Trans. Biomed. Eng.63, 600ā606. 10.1109/TBME.2015.2466591
37
VaidyaJ. S. (2007). Partial breast irradiation using targeted intraoperative radiotherapy (targit). Nat. Clin. Pract. Oncol.4, 384ā385. 10.1038/ncponc0850
38
VaidyaJ. S.TobiasJ. S.BaumM.WenzF.Kraus-TiefenbacherU.DāSouzaD.et al (2005). Targeted intraoperative radiotherapy (targit): An innovative approach to partial-breast irradiation. Seminars Radiat. Oncol.15, 84ā91. 10.1016/j.semradonc.2004.10.007
39
Valdivieso-CasiqueM. F.RodrĆguezR.RodrĆguez-BescósS.LardĆesD.GuerraP.LedesmaM. J.et al (2015). Radiance-a planning software for intra-operative radiation therapy. Transl. Cancer Res.4, 196ā209. 10.3978/j.issn.2218-676X.2015.04.05
40
WittekA.JoldesG.CoutonM.WarfieldS. K.MillerK. (2010). Patient-specific non-linear finite element modelling for predicting soft organ deformation in real-time; application to non-rigid neuroimage registration. Prog. Biophysics Mol. Biol.103, 292ā303. 10.1016/j.pbiomolbio.2010.09.001
41
WuX.DownesM. S.GoktekinT.TendickF. (2001). Adaptive nonlinear finite elements for deformable body simulation using dynamic progressive meshes. Comput. Graph. Forum20, 349ā358. 10.1111/1467-8659.00527
Summary
Keywords
soft-tissue simulation, finite-element model, IORT, breast tumor resection, preoperative planning, navigation
Citation
AlcaƱiz P, Vivo de Catarina C, GutiƩrrez A, PƩrez J, Illana C, Pinar B and Otaduy MA (2022) Soft-tissue simulation of the breast for intraoperative navigation and fusion of preoperative planning. Front. Bioeng. Biotechnol. 10:976328. doi: 10.3389/fbioe.2022.976328
Received
23 June 2022
Accepted
07 September 2022
Published
28 September 2022
Volume
10 - 2022
Edited by
Jose Manuel Garcia-Aznar, University of Zaragoza, Spain
Reviewed by
Feng Li, Qingdao University of Science and Technology, China
StƩphane Pierre Alain Bordas, University of Luxembourg, Luxembourg
Updates
Copyright
© 2022 Alcañiz, Vivo de Catarina, Gutiérrez, Pérez, Illana, Pinar and Otaduy.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Patricia AlcaƱiz, patricia.aladren41@gmail.com
This article was submitted to Biomechanics, a section of the journal Frontiers in Bioengineering and Biotechnology
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.


















