Skip to main content

ORIGINAL RESEARCH article

Front. Public Health, 16 September 2022
Sec. Digital Public Health

Prediction of corneal astigmatism based on corneal tomography after femtosecond laser arcuate keratotomy using a pix2pix conditional generative adversarial network

  • 1Shenzhen Eye Hospital, Jinan University, Shenzhen Eye Institute, Shenzhen, China
  • 2Department of Cataract, Shanxi Eye Hospital, Taiyuan, China
  • 3First Hospital of Shanxi Medical University, Taiyuan, China
  • 4College of Biomedical Engineering, Taiyuan University of Technology, Taiyuan, China
  • 5Department of Ophthalmology, First Affiliated Hospital of Huzhou University, Huzhou, China
  • 6Taiyuan Central Hospital of Shanxi Medical University, Taiyuan, China
  • 7Department of Intelligence and Automation, Taiyuan University, Taiyuan, China
  • 8Graphics and Imaging Laboratory, University of Girona, Girona, Spain

Purpose: This study aimed to develop a deep learning model to generate a postoperative corneal axial curvature map of femtosecond laser arcuate keratotomy (FLAK) based on corneal tomography using a pix2pix conditional generative adversarial network (pix2pix cGAN) for surgical planning.

Methods: A total of 451 eyes of 318 nonconsecutive patients were subjected to FLAK for corneal astigmatism correction during cataract surgery. Paired or single anterior penetrating FLAKs were performed at an 8.0-mm optical zone with a depth of 90% using a femtosecond laser (LenSx laser, Alcon Laboratories, Inc.). Corneal tomography images were acquired from Oculus Pentacam HR (Optikgeräte GmbH, Wetzlar, Germany) before and 3 months after the surgery. The raw data required for analysis consisted of the anterior corneal curvature for a range of ± 3.5 mm around the corneal apex in 0.1-mm steps, which the pseudo-color corneal curvature map synthesized was based on. The deep learning model used was a pix2pix conditional generative adversarial network. The prediction accuracy of synthetic postoperative corneal astigmatism in zones of different diameters centered on the corneal apex was assessed using vector analysis. The synthetic postoperative corneal axial curvature maps were compared with the real postoperative corneal axial curvature maps using the structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR).

Results: A total of 386 pairs of preoperative and postoperative corneal tomography data were included in the training set, whereas 65 preoperative data were retrospectively included in the test set. The correlation coefficient between synthetic and real postoperative astigmatism (difference vector) in the 3-mm zone was 0.89, and that between surgically induced astigmatism (SIA) was 0.93. The mean absolute errors of SIA for real and synthetic postoperative corneal axial curvature maps in the 1-, 3-, and 5-mm zone were 0.20 ± 0.25, 0.12 ± 0.17, and 0.09 ± 0.13 diopters, respectively. The average SSIM and PSNR of the 3-mm zone were 0.86 ± 0.04 and 18.24 ± 5.78, respectively.

Conclusion: Our results showed that the application of pix2pix cGAN can synthesize plausible postoperative corneal tomography for FLAK, showing the possibility of using GAN to predict corneal tomography, with the potential of applying artificial intelligence to construct surgical planning models.

Introduction

Among patients undergoing cataract surgery, corneal astigmatism is a sizable component of ametropia, with an estimated 50% of patients with cataract exhibiting more than 1.0 diopter (D) (1). Residual corneal astigmatism ≥ 0.75 D might induce symptomatic blur, reducing uncorrected visual acuity and causing halos and ghosting of images (2). Multifocal or extended depth-of-focus intraocular lens (IOL) technologies with diffractive optics are even less forgiving, and patients receiving such IOLs can be affected by as little as 0.5 D of residual refractive astigmatism (3, 4). In one study comprising over 100,000 individuals undergoing cataract surgery in the UK, 78% had astigmatism of ≥ 0.5 D (5), which is a similar rate (78.79%) in China (6). Postoperative astigmatism is an important cause of emmetropia even after routine surgery (7). Therefore, managing preexisting corneal astigmatism at the time of cataract surgery is critical for achieving excellent visual outcomes and meeting patients' expectations for complete, spectacle-free visual rehabilitation (8).

Over the past decade, manual arcuate keratotomy has been performed to reduce preexisting astigmatism during cataract surgery. However, because of the lack of reproducibility in incision depth, length, and alignment (9), the manual arcuate keratotomy procedure has been associated with unpredictable results and complications (10).

The introduction of femtosecond laser technology to arcuate keratotomy has improved the precision of incision parameters (arc length, diameter, and depth of the incision), with a reported mean difference between the intended and achieved laser incision sizes of 0.1 mm (11). However, most femtosecond laser arcuate keratotomy (FLAK) surgical planning is based on empirical adjustment of the manual arcuate keratotomy nomogram. Postoperative correction results and predictability of residual astigmatism are difficult to achieve in refractive cataract surgery (12, 13).

Based on clinical needs, several studies have been conducted on surgical planning for FLAK (1317). Most of the studies have applied vector analysis based on surgical outcomes and performed linear regression to produce a nomogram (1315), including our previous study (16). Operators analyzed the linear relationship between the surgical parameters and results based on the numerical data of the surgical design. However, factors that influence the outcome of FLAK correction are multifactorial and complex. The incision causes an overall change in corneal morphology. However, corneal deformation has non-uniform effects in different corneal zones. Corneal tomography is able to display overall and localized corneal deformation.

We considered the possibility of using corneal tomography, which provides richer information on deformation, as a data source for surgical planning model design. Generative adversarial networks (GANs) (17) are a family of unsupervised machine learning algorithms that have demonstrated their merits by generating synthetic images and solving image-to-image translation problems in the natural image domain (18). By combining surgical parameters to generate a reasonable postoperative corneal tomography, a GAN may be able to achieve this task. To the best of our knowledge, the concept of applying GAN to construct a surgical prediction model for FLAK based on raw data from corneal tomography has not been previously proposed.

This study aimed to evaluate the accuracy of FLAK postoperative corneal tomography generated by applying GAN and to assess the feasibility of applying raw corneal tomography data for the FLAK surgical planning model.

Materials and methods

Study population

This study was approved by the institutional review board and adhered to the tenets of the Declaration of Helsinki. After a detailed explanation, informed consent was obtained from each patient prior to enrollment.

This study followed the tenets of the Declaration of Helsinki, in compliance with applicable national and local ethics requirements. The Institutional Review Board of Shanxi Eye Hospital approved this single-center retrospective analysis and waived the need for patient consent. This retrospective study included patients who underwent combined femtosecond laser-assisted cataract surgery and penetrating FLAKs using a LenSx laser (Alcon Laboratories, Inc.) between February 2018 and May 2020 at the Shanxi Eye Hospital.

The inclusion criteria were as follows: patients with cataract and preexisting regular corneal astigmatism who desired to undergo mono- or multifocal IOL implantation and patients completing a 3-month follow-up period. The exclusion criteria were as follows: eyes with irregular astigmatism, keratoconus, and previous corneal refractive treatment.

All patients underwent a full ophthalmological examination. Corneal tomography was performed using an Oculus Pentacam (Optikgeräte GmbH, Wetzlar, Germany). Eye alignment evaluations and measurements with good quality (graded as “ok”) obtained using Pentacam were used in the final analysis. All measurements were performed in a semidark room with undilated pupils.

Paired or single anterior penetrating FLAKs were performed at an 8.0-mm optical zone with a depth of 90% using a LenSx laser (Alcon Laboratories, Inc.). The astigmatic magnitude and axis used for the calculations were determined by the surgeon (SZ) based on preoperative corneal data from Pentacam. The arcuate keratotomy length was determined according to the surgeon's previously published nomogram (17). The arc length ranged from 25 to 65°. After the laser procedure, a main limbal incision was created using femtosecond laser.

Data preprocessing

We constructed datasets, which collected preoperative and postoperative corneal tomography data of 318 patients; raw data were obtained from Oculus Pentacam HR. It consists of a rotating Scheimpflug camera and the Pentacam software. A total of 318 patients were followed up for 3 months to obtain postoperative corneal tomography data. The data from Pentacam were exported, and the raw data table (CSV format) was imported into the database. The data format was a circle with a radius of 3.5 mm centered on the cornea vertex, and the radius of curvature of each point on the circle was 0.1-mm unit.

Corneal curvature information was resolved by reading CSV data; subsequently, the curvature data were converted into refractive power data by the conversion formula of radius of curvature and refractive power. Then, corneal tomography could be visualized. The formula can be expressed as follows:

Dpt=(1.3375-1)×1000R    (1)

where Dpt refers to the diopter and R refers to the radius of curvature. Then, the mean value of the refractive power at all points was calculated and ranked to determine the diameter with the highest mean value of refractive power in the 3-mm zone. A Pentacam-like axial curvature map could be displayed, the effect of which is shown in Figure 1. The specific implementation process is as follows:

FIGURE 1
www.frontiersin.org

Figure 1. Pseudo-color visualization of corneal tomography: the left image is the axial curvature map derived from the Pentacam; the right image is the pseudo-color map synthesized based on the refractive power values of each point of the cornea (same patient).

The inputs to the model included two-dimensional corneal curvature 141 × 141 matrices, one-dimensional AK arc length, AK axis position, and patient age. On the one hand, to ensure the dimensional consistency of the input data, the age was normalized to between 0 and 1 and upsampled into two-dimensional information; the AK arc length and axial position information were used to draw AK arc length and axial position maps (AK incision maps). The corneal curvature of the corneal tomography was normalized between 0 and 1. The normalized corneal curvature information, age information after dimensionalization, and AK position map were concatenated together as the final input of the model, as shown in Figure 2.

FIGURE 2
www.frontiersin.org

Figure 2. Inputs to the predictive model.

Modeling

A GAN deep learning network was selected as the base model. The training process was divided into two stages: the first stage involved fixing the discriminator, training the generator, and saving the generated data in the buffer pool; if the probability of fake data being similar to real data was low, the discriminator fed the result back to the generator for self-optimization. The second stage involved fixing the generator, training the discriminator, and using the real and fake data in the buffer pool to train the discriminator. The cycle was repeated until the loss functions of the generator and discriminator reached equilibrium as follows:

minGmaxDV(D,G)=Ex~pdata(x)[logD(x)]                            +Ez~pz(z)[log(1-D(G(z)))]    (2)

The Unet network model was used as the generator of the GAN network to extract the preoperative corneal tomography, age, AK arc length, and other features, which can be used to extract abstract features while preserving more image details with low-level features and can enhance the fineness of the corneal tomography prediction. The detailed structure is shown in Figure 3, in which a multilayer convolutional neural network (CCN) was used to extract the key features of the patient corneal data. In the upsampling stage, the feature maps were upsampled by transposed convolution for image generation. A postoperative corneal tomography prediction map was generated.

FIGURE 3
www.frontiersin.org

Figure 3. Unet network structure diagram.

The goal of generating the discriminator module of the adversarial network was to distinguish real corneal tomography from predicted corneal tomography, and the input was either real postoperative or predicted corneal tomography. The loss value of this module can improve the discriminatory ability of the discriminator, and more importantly, the weight value of the generator module can be optimized to improve the quality of the prediction results of the generator module. The prediction model was built using a combination of the two networks (Figure 4).

FIGURE 4
www.frontiersin.org

Figure 4. Structure of the postoperative corneal tomography prediction model.

Optimizing the training model

The experiments were performed using the Ubuntu 18.04 system, the programming language used was Python 3.6, the deep learning framework was PyTorch, and the hardware environment was i7-8700 CPU and GTX-1080Ti GPU.

In the aspect of data, the accuracy of the model was largely dependent on the quality of the training dataset. This study acquired real medical record images from the clinic and continuously fed new data into the dataset in subsequent clinical applications of the system, thus keeping the model in a constant learning and optimization process.

In the aspect of algorithm, there are many derivative versions of the GAN model. By experimenting with multiple algorithmic approaches and referring to relevant literature to determine the relative optimal solution of the model, we finally settled on using the pix2pix network model as the basis for the experiments. Pix2Pix is an end-to-end method that can perform not only the tasks of a normal GAN model, but also a general method in the field of image generation by introducing conditional parameters to control the mapping of input data to target data. For example, it can render the color of the input image and change the shape of the input image to the shape of the target image.

Evaluation of model performance

The synthetic postoperative corneal axial curvature maps were compared with the real postoperative corneal axial curvature maps using the structural similarity index measure (SSIM) and peak signal-to-noise ratio (PSNR). The specific formula is as follows:

PSNR=10·log10(MAXI2MSE)

where MAX is the maximum value of the image color data and MSE is the mean square error defined as follows:

MSE=1mni=0m-1j=0n-1[Ireal(i,j)-Ifake(i,j)]2,

where Ireal and Ifake are the real and generated fake postoperative data, respectively, and m and n are the size of the image. Similar evaluation indices include SSIM, which can be expressed as follows:

SSIM(x,y)=(2μxμy+c1)(2σxy+c2)(μx2+μy2+c1)(σx2+σy2+c2)

where x and y are the real and generated fake postoperative data, respectively, μ is the mean value, and σ is the variance. Normally, c1 and c2 are constants, c1=(0.01·MAX)2 and c2=(0.03·MAX)2. SSIM and PSNR are generally larger and better, where SSIM closer to 1 means that the real data are more similar to the generated data.

The Alpin vector method was used to analyze astigmatism correction outcomes. Target-induced astigmatism (TIA) was defined as the amount of astigmatism the surgeon intended to induce was equal to preoperative corneal astigmatism. The difference vector (DV), defined as the amount of astigmatism that must be corrected postoperatively to finally reach the intended target astigmatism, was equal to the postoperative corneal astigmatism. Surgically induced astigmatism (SIA) represents astigmatic changes achieved by surgery. The correction index was defined as the ratio of SIA to TIA with a value > 1.0, indicating overcorrection, and < 1.0, indicating undercorrection.

The Pearson correlation coefficient was used to compare the synthetic and real DV and SIA. The mean absolute error (MAE) of the SIA was compared between synthetic and real tomography postoperatively.

Results

A total of 65 pairs of corneal axial curvature matrices were assigned to the test set. In the test set, the mean (standard deviation) astigmatism magnitude was 1.25 (0.52) D in 3-mm zone. The additional baseline clinical characteristics are shown in Tables 1, 2.

TABLE 1
www.frontiersin.org

Table 1. Patient's demographics.

TABLE 2
www.frontiersin.org

Table 2. Distribution of preoperative and postoperative astigmatism in different zones of the cornea in the training and test sets.

Vector analysis of real and synthetic postoperative corneal axial curvature

Vector analysis of postoperative real and synthetic DV in the 1-, 3-, and 5-mm zones: 0.69 ± 0.47 and 0.63 ± 0.57 D for real and synthetic astigmatism in the 1-mm zone (p = 0.200), 0.63 ± 0.38 and 0.64 ± 0.47 D in the 3-mm zone (p = 0.598), and 0.57 ± 0.34 and 0.60 ± 0.40 D in the 5-mm zone (p = 0.218) (Figure 5 and Table 3).

FIGURE 5
www.frontiersin.org

Figure 5. Vector analysis of postoperative real and synthetic DV in the 1-mm, 3-mm, and 5-mm zones. (A) The real postoperative DV of the 1-mm zone. (B) The synthetic postoperative DV of the 1-mm zone. (C) The real postoperative DV of the 3-mm zone. (D) The synthetic postoperative DV of the 3-mm zone. (E) The real postoperative DV of the 5-mm zone. (F) The synthetic postoperative DV of the 5-mm zone.

TABLE 3
www.frontiersin.org

Table 3. Vector analysis of real and synthetic postoperative corneal axial curvature in different diameter zone.

Vector analysis of real and synthetic SIA for 1-, 3-, and 5-mm zones: 1.00 ± 0.56 and 1.01 ± 0.60 D for 1-mm zone real SIA and synthetic SIA (p = 0.683), 1.05 ± 0.52 and 1.09 ± 0.55 D for the 3-mm zone (p = 0.081), and 1.02 ± 0.51 and 1.05 ± 0.53 D for the 5-mm zone (p = 0.135) (Figure 6 and Table 3).

FIGURE 6
www.frontiersin.org

Figure 6. Vector analysis of postoperative real and synthetic SIA in the 1-mm, 3-mm, and 5-mm zones. (A) The real postoperative SIA of the 1-mm zone. (B) The synthetic postoperative SIA of the 1-mm zone. (C) The real postoperative SIA of the 3-mm zone. (D) The synthetic postoperative SIA of the 3-mm zone. (E) The real postoperative SIA of the 5-mm zone. (F) The synthetic postoperative SIA of the 5-mm zone.

The correlation between real and synthetic postoperative astigmatism (DV) in the 1-, 3-, and 5-mm zones and the correlation graph between real and synthetic SIA (Figure 7): the correlation coefficient between synthetic and real postoperative astigmatism (DV) in the 3-mm zone was 0.89, and the correlation coefficient between SIA was 0.93.

FIGURE 7
www.frontiersin.org

Figure 7. Postoperative real vs. synthetic DV and real vs. synthetic SIA correlation graph for 1-mm, 3-mm, and 5-mm zones. (A) The correlation between real and synthetic DV in the 1-mm zone. (B) The correlation between real and synthetic DV in the 3-mm zone. (C) The correlation between real and synthetic DV in the 5-mm zone. (D) The correlation between real and synthetic SIA in the 1-mm zone. (E) The correlation between real and synthetic SIA in the 3-mm zone. (F) The correlation between real and synthetic SIA in the 5-mm zone.

The MAEs of SIA for real and synthetic postoperative corneal axial curvature maps in the 1-, 3-, and 5-mm zones were 0.20 ± 0.25, 0.12 ± 0.17, and 0.09 ± 0.13 D, respectively.

Objective image evaluation metrics

The L1 loss of the model training is shown in Figure 8. The PSNR and SSIM results for different corneal zones are listed in Table 4. The average SSIM and PSNR of the 3-mm zone were 0.86 ± 0.04 and 18.24 ± 5.78, respectively. The results show that the corneal axial curvature generated by the model after FLAK can simulate the real corneal axial curvature. Preoperative corneal tomography and postoperative real and synthetic corneal tomography images are shown in Figure 9.

FIGURE 8
www.frontiersin.org

Figure 8. L1 loss between the preoperative and postoperative corneal axial curvature maps during the training.

TABLE 4
www.frontiersin.org

Table 4. PSNR and SSIM of different corneal zone.

FIGURE 9
www.frontiersin.org

Figure 9. Preoperative and postoperative corneal tomography of five different cases. The first column is the preoperative corneal tomography, the middle is the real postoperative corneal tomography, and the last column is the synthetic corneal tomography.

Discussion

Our present study applied pix2pix to raw data derived from Scheimpflug, which can generate reasonable (plausible quality) corneal tomography after FLAK and shows promising applications for further construction of personalized surgical planning models. To the best of our knowledge, this study is the first essential step in investigating the possibility of using GANs to generate postoperative corneal tomography maps for FLAK planning.

Three main approaches have been used for the surgical planning of FLAK correction of corneal astigmatism.

First, empirical adjustments were performed based on the manual AK nomogram. Ganesh (19) applied the CATALYS femtosecond laser cataract surgery platform to perform penetrating FLAK, and preoperative planning used 8/10 of the recommended arc length of the Donnenfeld manual corneal limbal release incision nomogram (20) as the arc length for FLAK. Wang et al. used 9/11 of its recommended arc length to perform the procedure (16). Baharozian empirically adjusted the Donnenfeld nomogram based on the type of astigmatism to eliminate the effect of posterior corneal surface astigmatism on correction outcomes (13). Lüdeke et al. (3) and Chan et al. (21) used the Wallace and Woodcock manual AK nomogram for surgical planning, with a correction based on postoperative results, and the AK arc length was only correlated with preoperative astigmatism. Löffler et al. (22) used the manual AK nomogram designed by Wang (23), which added the effect of patient age and astigmatism type on correction effects.

All the above surgical planning was based on clinical experience of adjustment or direct application of the manual AK nomogram, with limited predictability of the correction outcomes. A more precise nomogram for surgical planning must be established for the clinical application of FLAK (12, 15).

Second, based on the postoperative correction effect of FLAK, linear regression was applied to correct the surgical planning nomogram by applying vector analysis. In 2016, we performed femtosecond laser penetrating AK based on the Donnenfeld nomogram, using its suggested arc length of 8/11, and performed a vector analysis of postoperative residual astigmatism by applying multiple linear regression to produce a nomogram, which was used to plan the AK arc length by three influencing factors: type of astigmatism, age, and target correction (16). In 2019, Visco used the Nichamin–Woodcock nomogram to perform surgery on 189 eyes, which was also based on vector analysis of postoperative outcomes, to amend the nomogram and add surgical planning for the younger age group (21–45 years) (15). In 2021, also based on linear regression, Wendelstein modified the nomogram, the influencing factors were only arc length and age. However, the type of astigmatism was not analyzed (4). The surgeon analyzed the linear relationship between the surgical parameters and outcomes based on the numerical data for surgical design. However, factors influencing the correction effect of FLAK were multifactorial and complex. The corneal deformation caused by the incision is different from the central to the peripheral cornea, which is not a linear change and therefore leads to poor prediction of the surgical result.

Third, the model for planning FLAK was based on a corneal biomechanical finite element model. Day performed FLAK based on the Stevens' nomogram (24) and found that corneal biomechanical properties had an independent influence on the correction outcome (25, 26). Byun's findings corroborated with Day's analysis (27). Truffer proposed a finite element model based on corneal biomechanics for femtosecond laser intrastromal AK planning, where different surgical parameters can be simulated using this computer model to determine the optimal surgical plan (12). This model demonstrated the possibility of integrating a simulation model to correct corneal astigmatism.

Considering that FLAK incision leads to redistribution of corneal tissue stress and different deformations in different zones of the cornea, an average value of astigmatism cannot be used as the correction target to plan the surgery. Therefore, our study proposes to apply the corneal axial curvature map containing all corneal aberration information as raw data for FLAK surgical planning, which is more accurate. Therefore, our study applied deep learning techniques to analyze the pattern of changes in surgical parameters and corneal tomography for the prediction of postoperative corneal tomography.

Artificial intelligence has been widely used in the medical field. The development of deep learning techniques, particularly CNNs and GANs, can effectively analyze image information. The GAN model has received significant attention since its appearance in 2014 (17), and it can accomplish graph-to-graph, text-to-graph, and text-to-text generations. Therefore, it is widely used for data augmentation and image prediction to extract mathematical relationships from data distribution to match input and output data and automatically synthesize medical images. It is implemented using a system of two neural networks competing in a two-player zero-sum game: discriminator and generator networks. The integrated network performance effectively generates new, plausible image samples. Ophthalmology-related studies have also been progressively conducted and reported in the fields of image synthesis for retinal optical coherence tomography (OCT) (28), anterior segment OCT (29), ocular surface images (30), and corneal tomography (31). Currently, the main algorithms include progressive GANs, conditional GANs (cGANs), image-to-image GANs (pix2pix), and cyclic GANs. Among them, the most widely used GAN architecture is pix2pix, which contains an image-to-image transformation framework (18). The generator part of the pix2pix network uses a U-Net network structure to generate synthetic images directly from the input images by means of layer-hopping connections, which can achieve better generation results. Son et al. (32) applied an algorithm similar to the pix2pix architecture that improves the segmentation accuracy of retinal vessels and optic discs in fundus images. Yu et al. applied pix2pix to synthesize realistic color fundus photographs to expand the dataset (33). Pix2pix has also performed well in segmenting the nerve fiber layer, Bruch's membrane, and choroid-scleral border of retinal OCT images (34).

Liu et al. showed that the pix2pix model can generate post-injection OCT images using pre-injection images for early prognostic prediction (35). cGAN was applied by Lee et al. and trained on pre-injection and post-injection OCT images and fluorescein angiography and indocyanine green angiography images to predict changes in post-injection OCT images (36) to assist clinicians and patients in understanding the effect of interventions on disease prognosis (37). These studies demonstrate the potential of GAN networks for generating high-quality prognostic images.

Abdelmotaal et al. applied a domain-specific CNN based on color-coded Scheimpflug to discriminate keratoconus, subclinical keratoconus, and normal corneal images at levels that may be useful in clinical practice when screening candidates for refractive surgery (38). They used pix2pix to synthesize corneal tomography images, which can overcome issues related to small datasets and class imbalance when training computer-aided diagnostic models (31). These studies demonstrated the possibility of using pix2pix to generate corneal tomography. Different from our study, they input the image information directly, whereas we input the curvature value matrix of each point. These data do not need to be manually labeled, which ensures data standardization and improves the efficiency and accuracy of data acquisition.

The limitations of this study include the fact that the model was developed without applying corneal biomechanical parameters, which are considered one of the factors influencing the outcome of FLAK correction, although age parameters were incorporated. In addition, this model did not incorporate FLAK procedures with different arc incision diameters and depths, and the applicability of the model requires further extension. A follow-up study was conducted based on expanding the amount of data to include corneal biomechanical parameters and finite element models and incorporating data from different surgical parameters and femtosecond laser surgical platforms for model construction to further improve the accuracy of surgical prediction.

In this study, we applied a pix2pix network to construct a postoperative prediction model for the FLAK correction of astigmatism based on corneal tomography features to address the clinical need for a lack of precise surgical planning models. This showed that the model had a significant predictive effect, which verified the validity and feasibility of the algorithm for predicting postoperative corneal astigmatism.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author contributions

ZZ: conception and design, analysis, and interpretation of data, writing the manuscript, critical revision of the manuscript, given final approval. NC and GZ: data preprocessing, optimizing the training model, evaluation of model performance, critical revision of the manuscript, given final approval. YL: data collection, critical revision of the manuscript, given final approval. JS and XL: data collection, analysis and interpretation of data, critical revision of the manuscript, given final approval. SZ: conception and design, performing surgeries, critical revision of the manuscript, given final approval. All authors contributed to the article and approved the submitted version.

Funding

The work was supported by Shanxi Provincial Department of Science and Technology Research Grant (No. 201601D021142) and partially supported by Shanxi Provincial Health Care Committee Research Fund (No. 2020039), the Fund for Shanxi 1331 Project and the Scientific Innovation Plan of Universities in Shanxi Province (No. 2021L575), the Shanxi Scholarship Council of China (No. 2020-149), and the Salming Project of Medicine in Shenzhen (No. SZSM201812091).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Vitale S, Ellwein L, Cotch MF, Ferris FL III, Sperduto R. Prevalence of refractive error in the United States, 1999–2004. Arch Ophthalmol. (2008) 126:1111–9. doi: 10.1001/archopht.126.8.1111

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Nichamin LD. Astigmatism control. Ophthalmol Clin North Am. (2006) 19:485–93. doi: 10.1016/j.ohc.2006.07.004

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Lüdeke I, Gonnermann J, Jørgensen J, Neuhann T, McKay K, Fleischer M, et al. Refractive outcomes of femtosecond laser-assisted secondary arcuate incisions in patients with residual refractive astigmatism after trifocal intraocular lens implantations. J Cataract Refract Surg. (2019) 45:28–34. doi: 10.1016/j.jcrs.2018.08.024

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Wendelstein JA, Hoffmann PC, Mariacher S, Wingert T, Hirnschall N, Findl O, et al. Precision and refractive predictability of a new nomogram for femtosecond laser-assisted corneal arcuate incisions. Acta Ophthalmol. (2021) 99:e1297–306. doi: 10.1111/aos.14837

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Day AC, Dhariwal M, Keith MS, Ender F, Perez Vives C, Miglio C, et al. Distribution of preoperative and postoperative astigmatism in a large population of patients undergoing cataract surgery in the UK. Br J Ophthalmol. (2019) 103:993–1000. doi: 10.1136/bjophthalmol-2018-312025

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Wu Z, Liu C, Chen Z. Prevalence and age-related changes of corneal astigmatism in patients undergoing cataract surgery in Northern China. J Ophthalmol. (2020) 2020:6385098. doi: 10.1155/2020/6385098

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Lee H, Kim TI, Kim EK. Corneal astigmatism analysis for toric intraocular lens implantation: precise measurements for perfect correction. Curr Opin Ophthalmol. (2015) 26:34–8. doi: 10.1097/ICU.0000000000000119

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Wang J, Zhao J, Xu J, Zhang J. Evaluation of the effectiveness of combined femtosecond laser-assisted cataract surgery and femtosecond laser astigmatic keratotomy in improving post-operative visual outcomes. BMC Ophthalmol. (2018) 18:161. doi: 10.1186/s12886-018-0823-1

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Chan TC, Ng AL, Cheng GP, Wang Z, Woo VC, Jhanji V. Corneal astigmatism and aberrations after combined femtosecond-assisted phacoemulsification and arcuate keratotomy: two-year results. Am J Ophthalmol. (2016) 170:83–90. doi: 10.1016/j.ajo.2016.07.022

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Mingo-Botín D, Muñoz-Negrete FJ, Won Kim HR, Morcillo-Laiz R, Rebolleda G, Oblanca N. Comparison of toric intraocular lenses and peripheral corneal relaxing incisions to treat astigmatism during cataract surgery. J Cataract Refract Surg. (2010) 36:1700–8. doi: 10.1016/j.jcrs.2010.04.043

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Nagy ZZ, Filkorn T, Takács AI, Kránitz K, Juhasz T, Donnenfeld E, et al. Anterior segment oct imaging after femtosecond laser cataract surgery. J Refract Surg. (2013) 29:110–2. doi: 10.3928/1081597X-20130117-05

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Truffer O, Abler D, Pajic B, Grabner G, Kraker H, Büchler P. Optimization of surgical parameters based on patient-specific models: application to arcuate keratotomy. J Cataract Refract Surg. (2019) 45:1084–91. doi: 10.1016/j.jcrs.2019.02.022

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Baharozian CJ, Song C, Hatch KM, Talamo JH. A novel nomogram for the treatment of astigmatism with femtosecond-laser arcuate incisions at the time of cataract surgery. Clin Ophthalmol. (2017) 11:1841–8. doi: 10.2147/OPTH.S141255

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Wendelstein JA, Hoffmann PC, Schwarzenbacher L, Fischinger IR, Hirnschall N, Menapace R, et al. Lasting effects: seven year results of the castrop nomogram for femtosecond laser-assisted paired corneal arcuate incisions. Curr Eye Res. (2022) 47:225–32. doi: 10.1080/02713683.2021.1975761

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Visco DM, Bedi R, Packer M. Femtosecond laser-assisted arcuate keratotomy at the time of cataract surgery for the management of preexisting astigmatism. J Cataract Refract Surg. (2019) 45:1762–9. doi: 10.1016/j.jcrs.2019.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Wang L, Zhang S, Zhang Z, Koch DD, Jia Y, Cao W, et al. Femtosecond laser penetrating corneal relaxing incisions combined with cataract surgery. J Cataract Refract Surg. (2016) 42:995–1002. doi: 10.1016/j.jcrs.2016.04.020

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. Generative adversarial networks. Commun ACM. (2020) 63:139–44. doi: 10.1145/3422622

CrossRef Full Text | Google Scholar

18. Phillip Isola J-YZ, Tinghui Zhou, Alexei A. Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. (2017). p:1125–34.

PubMed Abstract | Google Scholar

19. Ganesh S, Brar S, Reddy Arra R. Comparison of astigmatism correction between anterior penetrating and intrastromal arcuate incisions in eyes undergoing femtosecond laser-assisted cataract surgery. J Cataract Refract Surg. (2020) 46:394–402. doi: 10.1097/j.jcrs.0000000000000069

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Dimitri TA, Jorge LA, Soledad CM, Joelle AH. Surgical Management of Astigmatism, 1st Edn. New Delhi: Jaypee Brothers Medical Publishers (2020).

21. Chan TC, Cheng GP, Wang Z, Tham CC, Woo VC, Jhanji V. Vector analysis of corneal astigmatism after combined femtosecond-assisted phacoemulsification and arcuate keratotomy. Am J Ophthalmol. (2015) 160:250–5.e2. doi: 10.1016/j.ajo.2015.05.004

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Löffler F, Böhm M, Herzog M, Petermann K, Kohnen T. Tomographic analysis of anterior and posterior and total corneal refractive power changes after femtosecond laser-assisted keratotomy. Am J Ophthalmol. (2017) 180:102–9. doi: 10.1016/j.ajo.2017.05.015

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Wang L, Misra M, Koch DD. Peripheral corneal relaxing incisions combined with cataract surgery. J Cataract Refract Surg. (2003) 29:712–22. doi: 10.1016/S0886-3350(02)01838-2

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Moorfields Eye Hospital. (2017). Intrastromal AK Nomogram calculator V3 Julian Stevens 2015. Available online at: www.femtoemulsification.com (accessed December 3, 2017).

25. Day AC, Lau NM, Stevens JD. Nonpenetrating femtosecond laser intrastromal astigmatic keratotomy in eyes having cataract surgery. J Cataract Refract Surg. (2016) 42:102–9. doi: 10.1016/j.jcrs.2015.07.045

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Day AC, Stevens JD. Predictors of femtosecond laser intrastromal astigmatic keratotomy efficacy for astigmatism management in cataract surgery. J Cataract Refract Surg. (2016) 42:251–7. doi: 10.1016/j.jcrs.2015.09.028

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Byun YS, Kim S, Lazo MZ, Choi MH, Kang MJ, Lee JH, et al. Astigmatic correction by intrastromal astigmatic keratotomy during femtosecond laser-assisted cataract surgery: factors in outcomes. J Cataract Refract Surg. (2018) 44:202–8. doi: 10.1016/j.jcrs.2017.11.018

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Zheng C, Xie X, Zhou K, Chen B, Chen J, Ye H, et al. Assessment of generative adversarial networks model for synthetic optical coherence tomography images of retinal disorders. Transl Vis Sci Technol. (2020) 9:29. doi: 10.1167/tvst.9.2.29

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Zheng C, Bian F, Li L, Xie X, Liu H, Liang J, et al. Assessment of generative adversarial networks for synthetic anterior segment optical coherence tomography images in closed-angle detection. Transl Vis Sci Technol. (2021) 10:34. doi: 10.1167/tvst.10.4.34

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Yoo TK, Choi JY, Kim HK, Ryu IH, Kim JK. Adopting low-shot deep learning for the detection of conjunctival melanoma using ocular surface images. Comput Methods Programs Biomed. (2021) 205:106086. doi: 10.1016/j.cmpb.2021.106086

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Abdelmotaal H, Abdou AA, Omar AF, El-Sebaity DM, Abdelazeem K. Pix2pix conditional generative adversarial networks for scheimpflug camera color-coded corneal tomography image generation. Transl Vis Sci Technol. (2021) 10:21. doi: 10.1167/tvst.10.7.21

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Son J, Park SJ, Jung KH. Towards accurate segmentation of retinal vessels and the optic disc in fundoscopic images with generative adversarial networks. J Digit Imaging. (2019) 32:499–512. doi: 10.1007/s10278-018-0126-3

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Yu Z, Xiang Q, Meng J, Kou C, Ren Q, Lu Y. Retinal image synthesis from multiple-landmarks input with generative adversarial networks. Biomed Eng Online. (2019) 18:62. doi: 10.1186/s12938-019-0682-x

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Heisler M, Bhalla M, Lo J, Mammo Z, Lee S, Ju MJ, et al. Semi-supervised deep learning based 3d analysis of the peripapillary region. Biomed Opt Express. (2020) 11:3843–56. doi: 10.1364/BOE.392648

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Liu Y, Yang J, Zhou Y, Wang W, Zhao J, Yu W, et al. Prediction of oct images of short-term response to Anti-Vegf treatment for neovascular age-related macular degeneration using generative adversarial network. Br J Ophthalmol. (2020) 104:1735–40. doi: 10.1136/bjophthalmol-2020-316300

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Lee H, Kim S, Kim MA, Chung H, Kim HC. Post-treatment prediction of optical coherence tomography using a conditional generative adversarial network in age-related macular degeneration. Retina. (2021) 41:572–80. doi: 10.1097/IAE.0000000000002898

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Liu TYA, Farsiu S, Ting DS. Generative adversarial networks to predict treatment response for neovascular age-related macular degeneration: interesting, but is it useful? Br J Ophthalmol. (2020) 104:1629–30.

PubMed Abstract | Google Scholar

38. Abdelmotaal H, Mostafa MM, Mostafa ANR, Mohamed AA, Abdelazeem K. Classification of color-coded scheimpflug camera corneal tomography images using deep learning. Transl Vis Sci Technol. (2020) 9:30. doi: 10.1167/tvst.9.13.30

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: femtosecond laser arcuate keratotomy, corneal tomography, conditional generative adversarial network, surgical planning, deep learning model

Citation: Zhang Z, Cheng N, Liu Y, Song J, Liu X, Zhang S and Zhang G (2022) Prediction of corneal astigmatism based on corneal tomography after femtosecond laser arcuate keratotomy using a pix2pix conditional generative adversarial network. Front. Public Health 10:1012929. doi: 10.3389/fpubh.2022.1012929

Received: 06 August 2022; Accepted: 29 August 2022;
Published: 16 September 2022.

Edited by:

Yanwu Xu, Baidu, China

Reviewed by:

Xu Chen, Shanghai Aier Eye Hospital, China
Hongcheng Huang, Chongqing University of Posts and Telecommunications, China

Copyright © 2022 Zhang, Cheng, Liu, Song, Liu, Zhang and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Junyang Song, ze8068e@163.com; Suhua Zhang, cfykys@163.com; Guanghua Zhang, jieming1022@126.com

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.