Skip to main content

ORIGINAL RESEARCH article

Front. Med., 18 December 2023
Sec. Ophthalmology

Agreement, repeatability, and reproducibility of quantitative retinal layer assessment using swept-source and spectral-domain optical coherence tomography in eyes with retinal diseases

Huiyuan Hou
Huiyuan Hou1*Mary K. DurbinMary K. Durbin1Nevin El-NimriNevin El-Nimri1Jeffrey L. FischerJeffrey L. Fischer2Srinivas R. Sadda,Srinivas R. Sadda3,4
  • 1Topcon Healthcare, Oakland, NJ, United States
  • 2Fischer Laser Eye Center, Willmar, MN, United States
  • 3Doheny Eye Institute, Pasadena, CA, United States
  • 4Department of Ophthalmology, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA, United States

Purpose: To evaluate the agreement and precision of retinal thickness measurements obtained using swept-source optical coherence tomography (SS-OCT) and spectral-domain OCT (SD-OCT) in healthy eyes and eyes with retinopathy.

Methods: This cross-sectional prospective study involved three DRI-OCT Triton (SS-OCT) and three 3D-OCT-1 Maestro (SD-OCT) devices. One of each device (Maestro and Triton) was paired with a single operator. Healthy subjects and patients with retinal diseases were recruited, with study eye and testing order randomized. At least 3 scans per eye were captured for wide scan (12 mm × 9 mm-Triton and Maestro) and macular cube scan (7 mm × 7 mm-Triton, 6 mm × 6 mm-Maestro). Thickness of the full retina, ganglion cell layer + inner plexiform layer (GCL+), and ganglion cell complex (GCL++) were obtained from wide scan and cube scans. Agreement of the measurements between the Triton and Maestro was evaluated by Bland–Altman analysis and Deming regression for each group. Repeatability and reproducibility were assessed using a two-way random effect analysis of variance (ANOVA) model for each parameter by group.

Results: Twenty-five healthy subjects (25 eyes) and 26 patients with retinal diseases (26 eyes), including, but not limited to, age-related macular degeneration, macular hole, and diabetic retinopathy were recruited. Overall, the measurement differences between Triton and Maestro were <6 μm (mean differences of full retina, GCL++, and GCL+ thickness were ≤5.5 μm, 1.3 μm, and 2.8 μm, respectively) and not statistically significant across the parameters. The repeatability and reproducibility estimates indicate high precision in both devices and groups. Across all the parameters, the repeatability limit was ≤7.6 μm for Triton and ≤12.7 μm for Maestro; reproducibility limit was ≤9.2 μm for Triton and ≤14.4 μm for Maestro. In eyes with retinal pathology, the repeatability coefficient of variation (CV)% was ≤2.6% for Triton and ≤3.4% for Maestro; reproducibility CV% was ≤3.3% for Triton and ≤3.5% for Maestro.

Conclusion: Both Triton SS-OCT and Maestro SD-OCT provide reliable measurements of retinal thickness in healthy eyes and eyes with retinal diseases. Excellent agreement between the two devices indicates interoperability when testing healthy eyes or eyes with retinal pathology. These findings support the use of thickness measurements from Triton SS-OCT and Maestro SD-OCT in clinical practice.

Introduction

Optical coherence tomography (OCT) is an indispensable imaging technology that enables the capture of in vivo, non-invasive images of the retina and choroid (1). OCT technology has greatly improved over the years since it was first introduced. The development of Fourier domain OCT has facilitated improving both resolution and speed over time-domain OCT (2, 3). The two types of Fourier domain detection are spectral-domain OCT (SD-OCT) and swept-source domain OCT (SS-OCT) (3). SS-OCT devices generally offer higher scanning speed than SD-OCT (4, 5) and utilize longer wavelengths, allowing better visualization of deep structures such as the choroid, lamina cribrosa, and sclera (6, 7). The high-speed wavelength tuning laser known as swept source, digital data acquisition and processing technology enable SS-OCT to mitigate the signal roll-off observed for SD-OCT (7). The longer wavelength light source also provides greater penetration that renders SS-OCT optimal for imaging eyes with media opacity (7). On the other hand, because axial resolution scales with the square of the central wavelength and the inverse of the bandwidth of the applied light source, SD-OCT devices typically have higher axial resolution than SS-OCT (6). As the two main commercially available OCT systems, each technology has distinct benefits. To facilitate their clinical application and optimization, it is important to thoroughly compare measurements obtained with SS-OCT and SD-OCT systems.

Volumetric scan images and automated retinal thickness measurements generated by the OCT systems are used clinically to qualitatively and quantitatively evaluate the different layers of the retina, facilitating the diagnosis and monitoring of various ocular diseases such as age-related macular degeneration (AMD) and macular edema from various causes (1, 8, 9). It is now known that many retinal disorders that initially affect the outer retina can lead to subsequent alterations in the inner retina including the retinal ganglion cell (RGC) layer; moreover, degenerative loss of inner retinal layers can occur in early diabetic retinopathy (10). These have resulted in increasing interest in the quantitative assessment of the inner retinal layers, separately from the overall retinal thickness (11). Before one can confidently use measurements from either SS-OCT or SD-OCT in clinical trials or clinical practice, establishing repeatability and reproducibility is critical to judge whether differences between individuals or changes in these measurements over time are of significance (12). Repeatability establishes the variability expected in a measurement over time if nothing changes, while reproducibility considers comparisons of data obtained from different devices and different operators, which might happen in a clinic with multiple instruments, in a multi-site practice, or in the context of multicenter clinical trials (13). A comparison of the repeatability and reproducibility of SS-OCT and SD-OCT as well as an evaluation of the agreement of their measurements would provide essential information regarding their ability to produce reliable examination results and their potential interchangeability in a clinical setting.

The aim of the present study was to evaluate the agreement, repeatability, and reproducibility of thickness measurements of various retinal layers using SS-OCT (DRI OCT Triton, Topcon Inc., Tokyo, Japan) which scans at speeds of 100,000 A scans per second and SD-OCT (3D OCT-1 Maestro, Topcon Inc., Tokyo, Japan) which operates at 50,000 A scans per second, in healthy eyes and eyes with various retinal pathologies.

Methods

The protocol of this prospective study was approved by the IntegReview Institutional Review Boards (3815 S. Capital of Texas Hwy, Suite 320, Austin, TX 78704), and the methodology adheres to the tenets of the Declaration of Helsinki for research involving human subjects and to the Health Insurance Portability and Accountability Act. The recruitment started on March 13, 2017, and ended on April 26, 2017. Written informed consent was obtained from all subjects.

Participants

The following ocular examinations were performed on each eye of each subject to determine eligibility for the study: best-corrected visual acuity (BCVA), refraction, slit lamp biomicroscopy, ophthalmoscopy, intraocular pressure (IOP) and visual field (VF; standard automated perimetry, Humphrey Field Analyzer; 24-2 Swedish interactive threshold algorithm; Carl Zeiss Meditec, Inc., Dublin, California).

In order to be included in this study, subjects had to be 18 years of age or older on the date of informed consent, be able to understand the written informed consent, be willing to participate as evidenced by signing the informed consent and had IOP ≤21 mmHg bilaterally. Exclusion criteria included being unable to tolerate ophthalmic imaging, having ocular media that precluded obtaining acceptable OCT images, having narrow angles that would preclude dilation, and having a history of systemic diseases or medications that might affect the measurements, such as leukemia, dementia or multiple sclerosis, or concomitant use of hydroxychloroquine or chloroquine.

Healthy subjects (Healthy group) had BCVA 20/40 or better and normal ocular health bilaterally (non-visually impairing cataract was acceptable). Both eyes must have met all normal eligibility criteria prior to study eye randomization. An additional exclusion criterion for the Healthy group was evidence of VF defects consistent with glaucomatous optic nerve damage based on at least one of the following two findings: a cluster of 3 or more points in an expected location of the pattern deviation (PD) depressed below the 5% level, at least 1 of which was depressed below the 1% level; or having glaucoma hemi-field test flagged on the VF report as being “outside normal limits.”

Subjects with retinal disease (Retina group) were included if they were diagnosed with a retinal pathology including, but not limited to AMD, diabetic macular edema, diabetic retinopathy, macular hole, and epiretinal membrane. Subjects were excluded from the Retina group if they had glaucoma, ocular surface disease, or any ocular pathology other than retinal disease in the study eye (non-visually impairing cataract was acceptable). The eye with the specific pathology was deemed the study eye. If both eyes were eligible, then one eye was randomly selected to be the study eye.

Optical coherence tomography scans

In this study, 3 SS-OCT devices (DRI OCT Triton, Topcon Inc., Tokyo, Japan) and 3 SD-OCT devices (3D OCT-1 Maestro, Topcon Inc., Tokyo, Japan) were employed. Three operators were paired with one Triton and one Maestro each to create three distinct operator/device configurations. Eligible subjects were randomized to select the testing order of the operator/device configuration. All OCT imaging was performed in one session, with breaks at the discretion of the subject. The scan types included wide scan (12 mm × 9 mm-both devices) and macular cube scan (7 mm × 7 mm-Triton, 6 mm × 6 mm-Maestro). For each scan type, a minimum of 3 scans was performed per eye for each configuration of operator/device. Additional scans were acquired by the operator if the scan quality was determined to be unacceptable. Parameter measurements included thickness of the full retina in nine sectors as defined by the early treatment of diabetic retinopathy study (ETDRS), ganglion cell layer (GCL) + inner plexiform layer (IPL) (GCIPL/abbreviated on the instrument reports and in this study to GCL+), and ganglion cell complex (GCC/abbreviated on the instrument reports and in this study to GCL++).

Two imaging experts reviewed each scan independently for image quality acceptance in a randomized fashion. Key aspects of a scan to consider for acceptable image quality were: (1) overall signal strength, (2) local weak signal, (3) poor centration of key structures (fovea not in center of macula scans), (4) eye movements, (5) clipping of the retina (scan is too high or too low and the full retina is chopped off), (6) segmentation failure, and (7) improper placement of the macula grid. Acceptable quality scan passed each of these image quality tests. All scans deemed unacceptable were not included in the data analysis.

Statistical analysis

Continuous variables were analyzed using descriptive statistics, including total number (n), mean, standard deviation (SD), and median, and categorical variables were summarized using percentages.

Agreement analysis of OCT B-scan image quality between the Triton and Maestro was performed by group. Cross-tabulation of the grading results between the study devices was provided by grader and group.

The first acceptable scan from each scan type (wide scan and macular cube scan) from the Triton and Maestro was used for agreement analyses. Bland–Altman analysis was used to calculate the mean difference and limits of agreement (LOA), and Deming regression was used to calculate the intercept and slope for linear fitting model.

All acceptable scans from the Triton and Maestro were used in the precision analysis, which was based on a two-way random effect analysis of variance (ANOVA) model. This ANOVA model included the operator/device, eye, and interaction between operator/device and eye as variance components. The repeatability and reproducibility limits and coefficient of variation in percentage (CV%) were calculated as follows: repeatability SD = square root of the residual variance; reproducibility SD = square root of the sum of the operator/device variance, the interaction variance, and the residual variance; repeatability limit = 2.8 x repeatability SD; reproducibility limit = 2.8 × reproducibility SD; repeatability CV% = (repeatability SD)/intercept × 100%; reproducibility CV% = (reproducibility SD)/intercept × 100%.

The sample size was determined based on the 95% LOA and the two-way random effect ANOVA model for precision. To acquire at least 90% power at a one-sided significance level of 5% using an F-test to detect a variance of operator/device effect that was 50% of the total variance, it was determined that a sample size of 21 eyes per population was sufficient. Statistical software SAS 9.3 (SAS Institute, Cary, North Carolina) was used for all calculations. p-values less than 0.05 were considered statistically significant.

Results

Eleven subjects did not meet the eligibility criteria and one subject withdrew consent. Twenty-five healthy subjects (25 eyes) and 26 retinal disease subjects (26 eyes) were included. Demographic and ocular characteristics of the study subjects are summarized in Table 1. The Retina group was older in age and had worse BCVA than the Healthy group. Retinal disease diagnoses included macular degeneration (n = 10), epiretinal membrane (n = 12), macular hole (n = 3), cystoid macular edema (n = 3), diabetic retinopathy (n = 1), and other retinal diseases (n = 15). The Retina group study eyes may have had more than one diagnosis.

TABLE 1
www.frontiersin.org

Table 1. Demographics and ocular characteristics of study subjects.

Overall, good agreement of B scan image quality between the Triton SS-OCT and Maestro SD-OCT was found.

In general, Bland–Altman analysis showed that the measurement differences between Triton and Maestro were less than 6 μm across the parameters. Deming regression showed most of the slopes of the fitting model between Triton and Maestro were close to +1, and most of the 95% confidence intervals (CI) for intercept contained 0 and CI for slope contained 1.

Specifically, for the thickness of different retinal layers, the mean measurements were similar from the corresponding scan types of the two devices [Triton wide scan vs. Maestro wide scan (12 mm × 9 mm for both) and Triton macular cube scan (7 mm × 7 mm) vs. Maestro macular cube scan (6 mm × 6 mm)]. Triton showed slightly lower measurements of the full retina (Table 2, absolute value of mean differences ≤5.5 μm) and GCL+ (Supplementary Table S1, absolute value of mean differences ≤2.8 μm) thickness compared to the Maestro in both healthy eyes and eyes with retinal disease. For GCL++ thickness (Table 3), Triton showed higher measurements from the wide scan and lower measurements from the macular cube scan in eyes with retinal disease. These measurement differences were small (mean difference <6 μm) and not statistically significant. Overall, excellent agreement was found across all measurements in both groups. Representative Bland–Altman plots and Deming regression plots are shown in Figures 1, 2 indicating good agreement of full retinal thickness measurements from both wide scan and macular cube scan between Triton and Maestro in eyes with retinal disease.

TABLE 2
www.frontiersin.org

Table 2. Full retinal thickness agreement between Triton and Maestro.

TABLE 3
www.frontiersin.org

Table 3. Ganglion cell complex thickness agreement between Triton and Maestro.

FIGURE 1
www.frontiersin.org

Figure 1. Agreement of full retina thickness measurements from the wide scan between Triton SS-OCT and Maestro SD-OCT in eyes with retinal disease. (A) Bland–Altman plots show all the average measurement differences between the two devices are less than 4 μm. (B) Deming regression plots of full retina thickness from the wide scan. The plots illustrate the fitted linear models (red line) and the identity lines (Triton measurement = Maestro measurement, slope = 1) (black line). Intercepts and slops are shown as mean (95% confidence interval). All slopes are very close to +1.

FIGURE 2
www.frontiersin.org

Figure 2. Agreement of full retina thickness measurements from the macular cube scan of Triton SS-OCT and Maestro SD-OCT in eyes with retinal disease. (A) Bland–Altman plots show all the average measurement differences between the two devices are less than 6 μm. (B) Deming regression plots of full retina thickness from the macular cube scan. The plots illustrate the fitted linear models (red line) and the identity lines (Triton measurement = Maestro measurement, slope = 1) (black line). Intercepts and slopes are shown as mean (95% confidence interval) indicate good agreement of the measurements between Triton and Maestro.

Overall, the repeatability and reproducibility estimates (reproducibility/repeatability limit and CV%) indicate high precision in both devices. Table 4 presents the repeatability and reproducibility for the full retinal thickness of the Healthy and Retina groups. The CV%s range between 0% and 1% for the Triton device; in comparison, Maestro had higher CV%s with a maximum of 1.8%. When comparing to the Retina group, the precision estimates were generally lower in the Healthy group with repeatability limits less than 4 μm and reproducibility limits less than 6 μm for Triton, and repeatability limits less than 10 μm and reproducibility less than 12 μm for Maestro. In general, the wide scan measurements had slightly inferior repeatability/reproducibility limits and CV%s compared with the macular cube measurements. Supplementary Table S2 and Table 5 summarize the repeatability and reproducibility estimates of GCIPL/GCL+ and GCC/GCL++ thickness measurements in Healthy and Retina groups. The repeatability and reproducibility of GCIPL/GCL+ thickness measurements were both good in Triton and Maestro (Supplementary Table S2). For both devices, all the limits were less than 7.2 μm. As expected, the repeatability and reproducibility limits of the Retina group were generally higher than that of the Healthy group. In the Healthy group, all the repeatability and reproducibility CV%s of both Triton and Maestro ranged between 0% and 1% with only 1 exception. In the Retina group, the range of repeatability CV%s of wide scan was 0.8% to 2.6% for the Triton and 1.1% to 3.3% for the Maestro; and the range of repeatability CV%s of macular cube scan was 0.7% to 1.9% for the Triton and also 0.7% to 1.9% for the Maestro. The same trends were found for the reproducibility CV%s.

TABLE 4
www.frontiersin.org

Table 4. Repeatability and reproducibility of full retina thickness measurements.

TABLE 5
www.frontiersin.org

Table 5. Repeatability and reproducibility of ganglion cell complex thickness measurements.

Similarly, the repeatability and reproducibility of GCC/GCL++ thickness measurements were both good and mostly comparable between the two devices (Table 5). All the limits of repeatability and reproducibility were less than 10 μm, and the limits of the Retina group were higher. In the Healthy group, all the repeatability and reproducibility CV%s of both Triton and Maestro were ≤1%; CV%s of the Retina group were higher-the maximum repeatability and reproducibility CV%s for the Triton were 1.1% and 1.5% for the wide scan, and 1.1% and 1.3% for the macular cube scan, respectively; and for the Maestro, the maximum repeatability and reproducibility CV%s were 3.0% and 3.0% for the wide scan, and 1.8% and 2.1% for the macular cube scan.

Discussion

This study found excellent agreement and good repeatability and reproducibility of the full retina, GCIPL/GCL+, and GCC/GCL++ thickness measurements obtained using the Triton SS-OCT and Maestro SD-OCT in healthy eyes and eyes with retinal disease.

Establishing the margins of repeatability and reproducibility for OCT-based measurements is important to support use of such metrics in clinical practice and in clinical studies is important. The accurate measurement of retinal layers has a particularly important role in the diagnosis and management of retinal diseases. Studying repeatability enables an identification of genuine clinical change from naturally occurring measurement variability. Clinicians can then define a threshold to recognize when a true change in a condition has occurred, which may then be employed in clinical practice to decide whether further treatment is necessary or to identify a therapeutic response (14, 15). Reproducibility is relevant to multicenter clinical trials because measurements acquired at multiple sites with various operators and devices will be assessed, but it is also relevant at clinics that have multiple devices and operators, or practices where a patient may visit satellite locations (13). Because SS-OCT and SD-OCT are the two main commercially available OCT systems in retinal practices, it is crucial to understand if they can provide reliable measurements and to evaluate the underlying interchangeability.

Several studies have investigated the agreement of thickness measurements between SS-OCT and SD-OCT. Lee et al. (16) evaluated agreement of the measurements from the macular cube scan between SS-OCT (DRI-OCT, Topcon) and SD-OCT (Cirrus HD-OCT, Carl Zeiss Meditec) in healthy eyes, and found that SD-OCT yielded larger GCIPL thickness values than SS-OCT, which is consistent with the current study finding that Maestro showed higher thickness measurements. This is expected because a smaller measurement region (Triton 7 mm × 7 mm vs. Maestro 6 mm × 6 mm) contains a relatively larger proportion of thicker retinal areas (16). However, contrary to this study, the study by Lee et al. (16) showed that the differences in thickness measurements between the DRI-OCT and Cirrus HD-OCT were statistically significant, with a mean difference that was approximately 5 fold larger than the current study. This discrepancy could be mainly due to the obvious different measurement regions in their study, which includes a 6 mm diameter circle for the DRI-OCT and a 4.8 mm × 4 mm elliptical annulus for Cirrus. This assumption has been confirmed by a study by Yang et al. (17). Yang et al. (17) found excellent agreement of GCIPL thickness between SS-OCT wide scan (DRI-OCT, Topcon) and SD-OCT macular cube scan (Cirrus HD-OCT, Carl Zeiss Meditec) for healthy eyes using identical measurement regions and segmentations between the two devices (17). To sum these studies up, agreement of OCT measurements mainly depends on the segmentation algorithm (18) and the measurement region/grid. Retinal pathology adversely affects the agreement, consistent with findings from this study, in which eyes with retinal disease had larger measurement differences between the Triton and Maestro.

Despite the good repeatability and reproducibility of both devices in our study, we found several factors that appeared to affect retinal thickness measurement precision. First, as expected and consistent with other studies (13), the repeatability and reproducibility in eyes with retinal disease were worse compared with healthy eyes. We postulate that retinal pathology in these eyes may have contributed to higher variability of measurements in this cohort by affecting foveal detection, grid positioning, and segmentation. However, the repeatability and reproducibility within this cohort remained good, with repeatability CV%s of less than 2.6% for Triton and less than 3.4% for Maestro; and reproducibility CV%s less than 3.3% for Triton and less than 3.5% for Maestro. Second, in this study, despite Triton SS-OCT generally having lower precision estimates than the Maestro SD-OCT, particularly in eyes with retinal disease, both devices provided reliable measurements with high repeatability and reproducibility. Studies to compare precision of retinal thickness measurements of SS-OCT and SD-OCT are limited, especially in eyes with retinal disease. One study by Lee et al. (16) reported similar repeatability of GCIPL thickness measurement between SS-OCT (DRI-OCT, Topcon) and SD-OCT (Cirrus HD-OCT, Carl Zeiss Meditec) in healthy eyes (16). Image quality has a positive correlation with OCT-based measurements and is an essential factor affecting measurement reliability (1923). In Lee’s study (16), the Cirrus HD-OCT and DRI-OCT devices had similar rates of poor-quality scans. In the current study, all included images had acceptable quality that may have minimized quality variations, thereby facilitating good precision. This indicates the potential benefit of primary quality control by operators in real-world setting. Similar precision of measurements from Triton SS-OCT and Maestro SD-OCT are expected given the fact that they have only minor differences in axial resolution and pixel calibration factor, and they use similar software and algorithms.

We also found that scan type had an influence on the measurement precision, although the direction of the difference varied across parameters. For full retinal thickness, the wide scan measurements were slightly less repeatable and reproducible compared with macular cube scan measurements; for GCIPL/GCL+ and GCC/GCL++ thickness, precision of wide and macular cube scans were mostly comparable; Triton wide scan had better repeatability and reproducibility in comparison with Maestro wide scan, while for the macular cube scan, the precision of the two devices was mostly comparable. The wide scan type covers both the macular and circumpapillary areas, and has several advantages over the macular cube scan, including reducing imaging time, minimizing alignment errors, and reducing fixation errors (24, 25). However, the advantages of minimizing alignment errors and reducing fixation errors likely did not contribute to the results of this study, because such errors may have been filtered out by allowing technicians to scan subjects multiple times in order to acquire an image with acceptable quality as defined by each device manufacturer’s user instructions. The expected better precision results of wide scans are likely to be seen in a real-world setting. Application of wide scan in clinical practice has been suggested in glaucoma management (24, 26). Given that retinal pathologies often go beyond the macula and are not isolated to the relatively small region of the macular cube scan, adoption of a wide scan into clinical practice may provide significant benefits in the imaging of retinal disorders and has been used for detection of various retina diseases (2628). However, evaluation of wide scan measurement precision is lacking in eyes with retinal disease. This study found high precision of wide scan measurements of GCIPL/GCL+ and GCC/GCL++ thickness but lower precision in full retinal thickness. For instance, reproducibility limits of average GCIPL and GCC thickness from the wide scan were only 2.0 μm and 2.7 μm for Triton, and 2.3 μm and 3.2 μm for Maestro. However, in terms of full retinal thickness, the reproducibility limits across sectors were higher; <9.2 μm for Triton and <14.4 μm for Maestro. The underlying rationale is unclear, but these results highlight the consideration of consistent device and scan type between patients or over time in the same patient when full retinal thickness is of interest.

Our study has several limitations. First, with 25 eyes for the Healthy group and 26 eyes for the Retina group, the sample size for this study is comparatively modest. The ANOVA model and the 95% LOA were used to estimate the sample size, and 21 eyes per group were judged suitable. For the Retina group, this study included a variety of different retina diseases with relatively few eyes having one specific disease, thus, we were unable to determine whether the type of disease had an impact on repeatability and reproducibility. Future research on this topic may be of interest. Second, there was a difference in age between the cohort with retinal disease and the healthy cohort. However, unlike RNFL thickness, age is not a limiting factor in achieving reliable retinal thickness (29). Besides, all estimates were calculated by cohort without inter-group comparison. Yet, this variation should be taken into consideration when interpreting the results.

Conclusion

In conclusion, this study demonstrated excellent agreement of retinal thickness measurements between the Triton SS-OCT and Maestro SD-OCT, as well as high precision of all measurements obtained using the two devices, in healthy eyes and eyes with retinal disease. These findings strongly support the use of Triton SS-OCT and Maestro SD-OCT to provide reliable and interchangeable test results of retinal layer measurements in clinical practice.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by IntegReview Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

HH: Conceptualization, Data curation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing. MD: Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. NE-N: Visualization, Writing – original draft, Writing – review & editing. JF: Data curation, Investigation, Methodology, Writing – review & editing. SS: Conceptualization, Visualization, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

The authors appreciate Tony Ko, Zhenguo Wang, and Jacqueline Armani from Topcon Healthcare for their assistance.

Conflict of interest

HH, MD and NE-N were employed by Topcon Healthcare. SS received research support from Topcon, Nidek, Heidelberg, Centervue, Optos, and Carl Zeiss Meditec; SS was a consultant for Amgen, Allergan, Regeneron, Bayer, Roche/Genentech, Novartis, Apellis, Iveric, Nanoscope, Astellas, Alexion, Biogen, Boehringer Ingelheim, Oxurion, Catalyst, Notal, 4DMT, Optos, Heidelberg, and Centervue.

The remaining author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2023.1281751/full#supplementary-material

References

1. Adhi, M, and Duker, JS. Optical coherence tomography—current and future applications. Curr Opin Ophthalmol. (2013) 24:213–21. doi: 10.1097/ICU.0b013e32835f8bf8

CrossRef Full Text | Google Scholar

2. Yaqoob, Z, Wu, J, and Yang, C. Spectral domain optical coherence tomography: a better OCT imaging strategy. Biotechniques. (2005) 39:S6–S13. doi: 10.2144/000112090

CrossRef Full Text | Google Scholar

3. Mrejen, S, and Spaide, RF. Optical coherence tomography: imaging of the choroid and beyond. Surv Ophthalmol. (2013) 58:387–429. doi: 10.1016/j.survophthal.2012.12.001

CrossRef Full Text | Google Scholar

4. Lee, B, Chen, S, Moult, EM, Yu, Y, Alibhai, AY, Mehta, N, et al. High-speed, ultrahigh-resolution spectral-domain OCT with extended imaging range using reference arm length matching. Trans Vis Sci Technol. (2020) 9:12. doi: 10.1167/tvst.9.7.12

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Schmetterer, L, Scholl, H, Garhöfer, G, Janeschitz-Kriegl, L, Corvi, F, Sadda, SR, et al. Endpoints for clinical trials in ophthalmology. Prog Retin Eye Res. (2023) 97:101160. doi: 10.1016/j.preteyeres.2022.101160

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Rabiolo, A, Fantaguzzi, F, Montesano, G, Brambati, M, Sacconi, R, Gelormini, F, et al. Comparison of retinal nerve fiber layer and ganglion cell-inner plexiform layer thickness values using spectral-domain and swept-source OCT. Trans Vis Sci Technol. (2022) 11:27. doi: 10.1167/tvst.11.6.27

CrossRef Full Text | Google Scholar

7. Michalewska, Z, and Nawrocki, J. Atlas of swept source optical coherence tomography. 1st ed. Cham: Springer (2017). 1 p.

Google Scholar

8. Mwanza, JC, and Budenz, DL. New developments in optical coherence tomography imaging for glaucoma. Curr Opin Ophthalmol. (2018) 29:121–9. doi: 10.1097/ICU.0000000000000452

CrossRef Full Text | Google Scholar

9. Lamin, A, Oakley, JD, Dubis, AM, Russakoff, DB, and Sivaprasad, S. Changes in volume of various retinal layers over time in early and intermediate age-related macular degeneration. Eye. (2019) 33:428–34. doi: 10.1038/s41433-018-0234-9

CrossRef Full Text | Google Scholar

10. Barber, AJ, and Baccouche, B. Neurodegeneration in diabetic retinopathy: potential for novel therapies. Vis Res. (2017) 139:82–92. doi: 10.1016/j.visres.2017.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

11. García-Ayuso, D, Di Pierdomenico, J, Vidal-Sanz, M, and Villegas-Pérez, MP. Retinal ganglion cell death as a late Remodeling effect of photoreceptor degeneration. Int J Mol Sci. (2019) 20:4649. doi: 10.3390/ijms20184649

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Giani, A, Deiro, AP, and Staurenghi, G. Repeatability and reproducibility of retinal thickness measurements with spectral-domain optical coherence tomography using different scan parameters. Retina. (2012) 32:1007–12. doi: 10.1097/IAE.0b013e31822f5660

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Lei, J, Durbin, MK, Shi, Y, Uji, A, Balasubramanian, S, Baghdasaryan, E, et al. Repeatability and reproducibility of superficial macular retinal vessel density measurements using optical coherence tomography angiography En face images. JAMA Ophthalmol. (2017) 135:1092–8. doi: 10.1001/jamaophthalmol.2017.3431

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Comyn, O, Heng, LZ, Ikeji, F, Bibi, K, Hykin, PG, Bainbridge, JW, et al. Repeatability of spectralis OCT measurements of macular thickness and volume in diabetic macular edema. Invest Ophthalmol Vis Sci. (2012) 53:7754–9. doi: 10.1167/iovs.12-10895

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Tah, V, Keane, P, Esposti, S, Allimuthu, J, Chen, F, Cruz, L, et al. Repeatability of retinal thickness and volume metrics in neovascular age-related macular degeneration using the Topcon 3DOCT-1000. Indian J Ophthalmol. (2014) 62:941–8. doi: 10.4103/0301-4738.143936

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Lee, SY, Bae, HW, Kwon, HJ, Seong, GJ, and Kim, CY. Repeatability and agreement of swept source and spectral domain optical coherence tomography evaluations of thickness sectors in normal eyes. J Glaucoma. (2017) 26:e46–53. doi: 10.1097/IJG.0000000000000536

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Yang, Z, Tatham, AJ, Weinreb, RN, Medeiros, FA, Liu, T, and Zangwill, LM. Diagnostic ability of macular ganglion cell inner plexiform layer measurements in glaucoma using swept source and spectral domain optical coherence tomography. PLoS One. (2015) 10:e0125957. doi: 10.1371/journal.pone.0125957

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Pierro, L, Gagliardi, M, Iuliano, L, Ambrosi, A, and Bandello, F. Retinal nerve fiber layer thickness reproducibility using seven different OCT instruments. Invest Ophthalmol Vis Sci. (2012) 53:5912. doi: 10.1167/iovs.11-8644

CrossRef Full Text | Google Scholar

19. Yang, H, Lee, HS, Bae, HW, Seong, GJ, Kim, CY, and Lee, SY. Effect of image quality fluctuations on the repeatability of thickness measurements in swept-source optical coherence tomography. Sci Rep. (2020) 10:13897. doi: 10.1038/s41598-020-70852-y

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cheung, CYL, Leung, CKS, Lin, D, Pang, CP, and Lam, DSC. Relationship between retinal nerve Fiber layer measurement and signal strength in optical coherence tomography. Ophthalmology. (2008) 115:1347–1351.e2. doi: 10.1016/j.ophtha.2007.11.027

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Wu, Z, Huang, J, Dustin, L, and Sadda, SR. Signal strength is an important determinant of accuracy of nerve fiber layer thickness measurement by optical coherence tomography. J Glaucoma. (2009) 18:213–6. doi: 10.1097/IJG.0b013e31817eee20

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Cheung, CY, Chen, D, Wong, TY, Tham, YC, Wu, R, Zheng, Y, et al. Determinants of quantitative optic nerve measurements using spectral domain optical coherence tomography in a population-based sample of non-glaucomatous subjects. Invest Ophthalmol Vis Sci. (2011) 52:9629. doi: 10.1167/iovs.11-7481

CrossRef Full Text | Google Scholar

23. Hardin, JS, Taibbi, G, Nelson, SC, Chao, D, and Vizzeri, G. Factors affecting cirrus-HD OCT optic disc scan quality: a review with case examples. J Ophthalmol. (2015) 2015:1–16. doi: 10.1155/2015/746150

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Hong, EH, Shin, YU, Kang, MH, Cho, H, and Seong, M. Wide scan imaging with swept-source optical coherent tomography for glaucoma diagnosis. PLoS One. (2018) 13:e0195040. doi: 10.1371/journal.pone.0195040

CrossRef Full Text | Google Scholar

25. Domínguez-Vicent, A, Kensén, J, Ramsay, MW, Brautaset, R, and Venkataraman, AP. Precision and agreement of individual and simultaneous macular and optic disc volumetric measurements with spectral domain optical coherence tomography. Front Med. (2021) 8:764236. doi: 10.3389/fmed.2021.764236

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Hood, DC, De Cuir, N, Blumberg, DM, Liebmann, JM, Jarukasetphon, R, Ritch, R, et al. A single wide-field OCT protocol can provide compelling information for the diagnosis of early glaucoma. Trans Vis Sci Technol. (2016) 5:4. doi: 10.1167/tvst.5.6.4

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Breher, K, Ohlendorf, A, and Wahl, S. Myopia induces meridional growth asymmetry of the retina: a pilot study using wide-field swept-source OCT. Sci Rep. (2020) 10:10886. doi: 10.1038/s41598-020-67940-4

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Reznicek, L, Kolb, JP, Klein, T, Mohler, KJ, Wieser, W, Huber, R, et al. Wide-field megahertz OCT imaging of patients with diabetic retinopathy. J Diabetes Res. (2015) 2015:1–5. doi: 10.1155/2015/305084

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Alamouti, B, and Funk, J. Retinal thickness decreases with age: an OCT study. Br J Ophthalmol. (2003) 87:899–901. doi: 10.1136/bjo.87.7.899

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: optical coherence tomography, repeatability, reproducibility, agreement, retinopathy

Citation: Hou H, Durbin MK, El-Nimri N, Fischer JL and Sadda SR (2023) Agreement, repeatability, and reproducibility of quantitative retinal layer assessment using swept-source and spectral-domain optical coherence tomography in eyes with retinal diseases. Front. Med. 10:1281751. doi: 10.3389/fmed.2023.1281751

Received: 23 August 2023; Accepted: 04 December 2023;
Published: 18 December 2023.

Edited by:

Solmaz Abdolrahimzadeh, Sapienza University of Rome, Italy

Reviewed by:

Mengxi Shen, University of Miami Health System, United States
Ana Rita Santos, Association for Innovation and Biomedical Research on Light and Image (AIBILI), Portugal

Copyright © 2023 Hou, Durbin, El-Nimri, Fischer and Sadda. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Huiyuan Hou, hhou@topcon.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.