Skip to main content

REVIEW article

Front. Cell Dev. Biol., 25 October 2024
Sec. Molecular and Cellular Pathology
This article is part of the Research Topic Artificial Intelligence Applications in Chronic Ocular Diseases, Volume II View all 11 articles

The application of artificial intelligence in diabetic retinopathy: progress and prospects

Xinjia XuXinjia Xu1Mingchen ZhangMingchen Zhang2Sihong HuangSihong Huang1Xiaoying LiXiaoying Li1Xiaoyan Kui
Xiaoyan Kui3*Jun Liu,,
Jun Liu1,4,5*
  • 1Department of Radiology, The Second Xiangya Hospital of Central South University, Changsha, China
  • 2Beijing Tongren Hospital, Capital Medical University, Beijing, China
  • 3School of Computer Science and Engineering, Central South University, Changsha, Hunan, China
  • 4Clinical Research Center for Medical Imaging in Hunan Province, Changsha, China
  • 5Department of Radiology Quality Control Center in Hunan Province, Changsha, China

In recent years, artificial intelligence (AI), especially deep learning models, has increasingly been integrated into diagnosing and treating diabetic retinopathy (DR). From delving into the singular realm of ocular fundus photography to the gradual development of proteomics and other molecular approaches, from machine learning (ML) to deep learning (DL), the journey has seen a transition from a binary diagnosis of “presence or absence” to the capability of discerning the progression and severity of DR based on images from various stages of the disease course. Since the FDA approval of IDx-DR in 2018, a plethora of AI models has mushroomed, gradually gaining recognition through a myriad of clinical trials and validations. AI has greatly improved early DR detection, and we’re nearing the use of AI in telemedicine to tackle medical resource shortages and health inequities in various areas. This comprehensive review meticulously analyzes the literature and clinical trials of recent years, highlighting key AI models for DR diagnosis and treatment, including their theoretical bases, features, applicability, and addressing current challenges like bias, transparency, and ethics. It also presents a prospective outlook on the future development in this domain.

1 Introduction

In the prelude to our discourse, it is foretold that by the year 2045, the count of adults aged 20 to 79 afflicted with diabetes will soar to no less than 235 million souls, with the regions of greater structural poverty bearing the heaviest burden of both diagnosed and undetected cases (Joanne et al., 2012; Lm et al., 2013; Tan and Wong, 2022; Harreiter and Roden, 2023; Home, Resources, diabetes, L. with, Acknowledgement, FAQs, Contact, 2024). Diabetic retinopathy (DR), as the most common and fundamental ocular complication of diabetes, is projected to increase to a global burden of 160.5 million cases by 2,045 (Teo et al., 2021; Yao et al., 2024). It is a chronic eye disease influenced by a multitude of factors, often lurking in the shadows of the early non-proliferative stage without overt clinical symptoms, yet detectable through a series of examinations (Tien et al., 2009). As DR progresses, with the formation of neovascularization and other developments, it can lead to a cascade of complications, such as diabetic macular edema (DME) and other macular diseases, which are among the most severe vision-threatening conditions but not easily detected by machines in their early stages (Sundaram et al., 2023; Wu et al., 2024). To prevent irreversible vision loss, early detection and ongoing monitoring of diabetic retinopathy are extremely important (Sussman et al., 1982; Pedro et al., 2016; Wei and Acy, 2018; Resnikoff et al., 2020).

AI stands as a beacon of hope, adept at mitigating the challenges of substandard healthcare and scarce resources in regions where the incidence of DR runs rampant (Varadarajan et al., 2020; Dong et al., 2022). So far, AI models powered by machine learning and algorithms have been used to help diagnose and treat diabetic retinopathy. The models, combined with various diagnostics, offer increased sensitivity and specificity, greatly assisting doctors in DR detection and management. Yet, the journey is not without its trials; biases, cost-effectiveness, and transparency are but a few of the many hurdles that lay before us (Dsw et al., 2017; Andrzej et al., 2020; Anand et al., 2023).

In this comprehensive treatise, we delve into the current state of AI in diabetic retinopathy diagnosis, treatment, and surveillance, with the goal of exposing existing shortcomings and mapping out a strategy for enhancement and creative advancement (Figure 1).

Figure 1
www.frontiersin.org

Figure 1. Introduction for AI in DR.

2 Applications of artificial intelligence in diabetic retinopathy

2.1 AI models based on imagistic output approaches

Diabetic retinopathy is characterized by a relatively clear chronic ocular fundus disease course (Table1, 2). Common methods for examining diabetic retinopathy include fundus photography, fluorescein angiography (FFA), optical coherence tomography (OCT), and even retinal smartphone photography is gradually being applied in the examination of diabetic retinopathy. AI models primarily diagnose the severity of diabetic retinopathy by analyzing the results of these examination methods, thereby suggesting corresponding treatment plans. AI assistance in diabetic retinopathy now also focuses on evaluating treatment, forecasting disease outcomes, and predicting the course of retinal lesions. Table 3 provides a detailed display of the advantages and disadvantages, applicability, and corresponding AI models used for these diagnostic methods.

Table 1
www.frontiersin.org

Table 1. International clinical diabetic retinopathy severity grading criteria (Antonetti et al., 2012; Stitt et al., 2016).

Table 2
www.frontiersin.org

Table 2. Stages of diabetic retinopathy in China (Xiaoxin, 2023).

Table 3
www.frontiersin.org

Table 3. Characteristics and applications of imaging examination (Gulshan et al., 2016).

The main models and their characteristics are as follows (Figure 2).

Figure 2
www.frontiersin.org

Figure 2. Main AI options in DR.

2.1.1 Fundus photography

Analyzing fundus photographs is one of the most advanced directions in DR AI models, with many approved or in-use models relying on this approach for diagnosis or staging. Here are the translations of some prominent models.

IDx-DR, approved by the FDA in 2018, is the first medical device to use artificial intelligence to detect more than mild DR in adults with diabetes (Rajesh et al., 2023). This software utilizes deep learning algorithms, particularly convolutional neural networks, to analyze fundus images taken with the Topcon NW400 retinal camera (Andrzej et al., 2020; Commissioner, 2020). Convolutional Neural Networks (CNNs), a form of deep learning architecture, are extensively applied in areas like image and video recognition, as well as natural language processing. They adeptly extract features from input data through a structured sequence of layers. The fundamental workflow, as shown in Figure 3, encompasses: ingesting input data, identifying local features via convolutional layers, applying non-linear transformations with activation layers, downsizing feature dimensions through pooling layers, possibly bolstering generalization with normalization layers, synthesizing features in fully connected layers, and concluding with predictions made by the output layer. Throughout training, CNNs use loss functions to assess the difference between predicted and actual labels, adjusting weights through backpropagation. Optimization techniques such as gradient descent are employed to fine-tune parameters, ensuring consistent validation performance. Post-training, the model undergoes assessment on the test set and is subsequently ready for deployment in real-world visual tasks like image classification and object detection. The algorithm, trained on a large dataset of annotated images, can identify and classify retinal lesions such as microaneurysms, hemorrhages, and neovascularization. Doctors upload digital images of the patient’s retina to a cloud server running the IDx-DR software (Goldstein et al., 2023). If the image quality meets the standards, the software provides one of two results: 1) “More than mild DR detected: refer to an eye care professional” or 2) “More than mild DR not detected; rescreen in 12 months” (Commissioner, 2020). Compared to stringent human grading standards, the algorithm has a sensitivity of 87.2% and a specificity of 90.7%. Currently, the IDx-DR algorithm has been rebranded as LumineticsCore (Rajesh et al., 2023). In contrast to the IDx-DR 2.0, the IDx-DR X2.1 represents an advanced hybrid system that employs several Convolutional Neural Networks (CNNs). These networks are trained to identify signs of bleeding, exudates, and other pathological changes, in addition to the regular anatomy of the retina. They are seamlessly incorporated into a traditional framework akin to other prototype IDPs. The analytical software categorizes results into four distinct outputs: 1) Negative: suggesting an absence or only a mild degree of diabetic retinopathy (DR), 2) rDR: indicating the presence of referable diabetic retinopathy, 3) vtDR: indicating vision-threatening diabetic retinopathy, 4) Low image quality: signifying issues with the examination protocol or substandard image quality. This apparatus applies a suite of CNN-based detectors to each image captured during the examination. These detectors are meticulously trained and calibrated to discern both the normal anatomy, such as the optic disc and fovea, and the telltale signs of DR, including hemorrhages, exudates, and neovascularization (Michael et al., 2016). The latest FDA-approved version, IDx-DR 2.3, shows improved capability in reading ungradable images and higher processing speed compared to version 2.0, although the DR classification algorithm remains unchanged (Libres, 2024). However, its performance varies with different detection standards, primarily influenced by factors such as image quality, ethnicity, and the graders (Hansen et al., 2015; Andrzej et al., 2020).

Figure 3
www.frontiersin.org

Figure 3. Steps for diagnosing DR with CNN.

Besides IDx-DR, EyeArt, as another extensively tested model approved by the FDA in 2020, is a deep learning-based classification tool developed by Eyenuk (Yingfeng et al., 2012). It is primarily designed for healthcare providers to automatically detect more than mild diabetic retinopathy (mtmDR) and vision-threatening diabetic retinopathy (vtDR) in adults who have not been previously diagnosed with these conditions (Businesswire, 2024). This detection is performed using fundus images taken with Canon CR-2 AF and Canon CR-2 Plus AF cameras. EyeArt is the first FDA-approved autonomous AI technology capable of simultaneously detecting mtmDR and vtDR in both primary care and eye care settings through a single test. Additionally, EyeArt is the first FDA-approved autonomous AI technology that can provide diagnostic outputs for both eyes of a patient. The accuracy and sensitivity of EyeArt have been subjects of debate. According to clinical trials conducted by the developers, EyeArt demonstrated a sensitivity of 96% and specificity of 88% for detecting mtmDR, and a sensitivity of 92% and specificity of 94% for detecting vtDR. All eyes with an ETDRS score of 43 or higher were accurately identified as mtmDR positive. In a clinical study conducted in the UK, EyeArt showed a sensitivity of 95.7% and a specificity of 54.0% (Heydon et al., 2021). In a prospective study in the US, the sensitivity for mtmDR was 95.5% and the specificity was 85.0% (Eli et al., 2021). In a recent community screening, the diagnostic accuracy was 81% (101/124 eyes), and the referral accuracy was 83% (103/124 eyes) (Vought et al., 2023). These results indicate that EyeArt’s performance can vary significantly depending on the tested population and reference standards.

In addition to EyeArt and IDx-DR, several other AI models have received Class IIa certification (CE Mark) in the European Union (EU), including Retmarker, Google, and the Singapore Eye Lesion Analyzer (SELENA) (Anand et al., 2023). Here are some brief introductions.

RetmarkerDR uses a feature-based machine learning model to screen for DR and detect biomarkers such as microaneurysms (MAs) (Retmarker, 2024b). It primarily relies on fundus images for diagnosis and is distinguished by its ability to compare current images with previous ones to assess disease progression (Andrzej et al., 2020). Although angiography is the gold standard for detecting microaneurysms, it is an invasive procedure that not all patients can tolerate. There is a significant correlation between MA turnover rates based on angiography and those based on retinal imaging (Rajesh et al., 2023). RetmarkerDR employs an advanced proprietary co-registration algorithm that automatically overlays retinal images and complements state-of-the-art MA detectors to calculate important rates related to MA turnover (formation and disappearance rates) (Haritoglou et al., 2014; Pappuru et al., 2019). This software can detect the rate of new microaneurysm formation and the disappearance of old microaneurysms, known as “microaneurysm turnover” (Pappuru et al., 2019; Li et al., 2019). This capability not only helps in detecting DR progression but also in evaluating the efficacy of treatments such as dexamethasone (Takamura et al., 2023). The specificity and sensitivity of RetmarkerDR’s early DR screening function have varied across different trials, but generally, both specificity and sensitivity have exceeded 90% (Sa, 2024a; Sa, 2024b; Retmarker, 2024a), although further research on its biomarker detection capabilities is needed.

Google developed a convolutional neural network-based algorithm for detecting DR in 2016, similar to IDX-DR (Gulshan et al., 2016). The algorithm was validated on multiple datasets, including EyePACS, Messidor-2, and a nationwide DR screening program in Thailand (Gulshan et al., 2019). On the Messidor-2 dataset, the algorithm achieved a sensitivity of 96.1% and a specificity of 93.9% in high-sensitivity settings, and a sensitivity of 87.0% and a specificity of 98.5% in high-specificity settings (Andrzej et al., 2020). In Thai primary care centers, the algorithm showed 91.4% sensitivity and 95.4% specificity in detecting severe non-proliferative DR, proliferative DR, or referable DME, surpassing a U.S. retinal specialist panel’s consensus (Paisan et al., 2022). User feedback suggests the AI system’s prompt results are helpful for referrals, yet uploading images can be difficult. Additionally, the algorithm occasionally deems images ungradable, requiring re-imaging or manual review (Ian Gerard et al., 2024).

SELENA, developed by the Singapore Eye Research Institute (SERI), is a deep learning-based system designed to enhance the efficiency of DR screening by analyzing fundus photographs (Gulshan et al., 2016). It also provides referral recommendations and grades the severity of DR. It was based on VGGNet, which is also a type of Convolutional Neural Network (CNN) like that of IDx-DR. The development of SELENA utilized multi-ethnic datasets to ensure its applicability across different ethnic groups (Wong et al., 2021). From (Wong et al., 2021), in primary validation datasets, SELENA demonstrated outstanding performance in detecting referable DR, with an AUC of 0.936, sensitivity of 90.5%, and specificity of 91.6%. For vision-threatening DR, SELENA achieved an AUC of 0.958, sensitivity of 100%, and specificity of 91.1%. Additionally, SELENA can detect glaucoma and age-related macular degeneration (AMD), showing high efficiency in these areas as well (Andrzej et al., 2020). To assess real-world viability, SELENA was evaluated in a mobile unit in Zambia, achieving an AUC of 0.973, 92.25% sensitivity, and 89.04% specificity for detecting referable DR, proving its effectiveness across different populations and limited-resource environments (Valentina et al., 2019). Furthermore, SELENA has shown excellent performance in epidemiological studies, significantly reducing the time and cost required for manual assessments. In one trial, SELENA was 360 times faster than manual evaluation, and the risk factors identified by SELENA, including diabetes duration, HbA1c levels, and systolic blood pressure, were consistent with those identified manually (Rajesh et al., 2023). The outcomes were comparable, underscoring SELENA’s strength in handling large datasets. The Singapore team intends to broaden SELENA’s use, integrating OCT for enhanced glaucoma detection and forecasting myopia, aiming for personalized healthcare (Wong et al., 2021).

Beyond the FDA and EU-approved models above, other promising models are yet to receive market release approval.

For instance, the Bosch DR algorithm can generate AI outputs based on non-mydriatic, single-field fundus images, as well as perform grading assessments using seven-field stereoscopic, mydriatic ETDRS imaging on the same eye (Pritam et al., 2017). EasyDL, developed by Baidu, utilizes the publicly available Kaggle diabetic retinopathy dataset and employs transfer learning techniques to establish an AI diagnostic model for fundus image analysis. It has demonstrated good performance in both training and testing sets, achieving an accuracy rate of over 91% and an AUC of 0.935 (Cao et al., 2022).

It is noteworthy that the model DeepDR along with its evolved version DeepDR Plus, can be considered a significant breakthrough in AI research for diabetic retinopathy (DR) lesions.

DeepDR, developed by Professor Jia Weiping’s team from the Department of Endocrinology and Metabolism at the Sixth People’s Hospital Affiliated to Shanghai Jiao Tong University, the Shanghai Diabetes Institute, and the Shanghai Diabetes Clinical Medical Center, is based on the world’s largest fundus image database. The system comprises three subsidiary networks: an image quality assessment network, a lesion detection network, and a diabetic retinopathy (DR) grading network. It employs a pre-trained model known as ResNet for feature extraction and leverages Mask-RCNN for task-specific architecture design, catering to image classification or segmentation tasks. By applying transfer learning techniques, DeepDR is fine-tuned on a labeled DR grading dataset, thereby enhancing its capabilities in lesion detection and segmentation performance. It employs a multi-task learning framework with enhanced transfer learning to automatically diagnose the full spectrum of DR, from mild to proliferative stages. Additionally, it provides real-time feedback on the quality of fundus images and performs lesion segmentation (Ling et al., 2021).

DeepDR Plus, a recent advancement in AI for DR diagnostics by Shanghai Jiao Tong University and Tsinghua University, has created an early warning system for DR complications. This system uses deep learning to analyze retinal image sequences and accurately predict DR progression, potentially informing new global screening and prevention strategies. From their new article (Ling et al., 2024), DeepDR Plus evolved from its predecessor, DeepDR, and has been developed, validated, and externally tested. The system encompasses a metadata model, a fundus image model, and a combined model. The fundus image model utilizes the ResNet-50 architecture as a feature extractor and enhances significant parts of the feature map through a self-attention mechanism. Initially, the system was pre-trained using 717,308 retinal images from 179,327 diabetic patients. Following this, a multiethnic dataset comprising 118,868 images of 29,868 diabetic patients was employed to train and validate the DeepDR Plus system. The system predicts event timings by estimating survival functions, using a fixed-size Weibull mixture model to simulate individual survival distributions. The deep learning network’s parameters are optimized by maximizing the likelihood function through self-supervised pre-training with MoCo v2, improving feature extraction. In predicting DR progression, the system achieved concordance indexes ranging from 0.754 to 0.846 and integrated Brier scores between 0.153 and 0.241 for all time points up to 5 years. The system’s validation in real-world studies showed that DeepDR Plus’s personalized screening intervals could extend the average interval to 31.97 months, from 12, and reduce the delayed detection rate of DR progression to 0.18%. This capability allows DeepDR Plus to support individualized risk assessment and management of DR by predicting the risk of DR progression within the next 5 years from a single retinal examination. The system can reduce unnecessary screenings, increase screening efficiency, potentially extend screening intervals, and minimize delayed detection of severe DR progression. Furthermore, its integration into clinical and digital workflows can facilitate personalized intervention strategies for the management of diabetic retinopathy.

Moreover, the process of uploading and processing images has become increasingly convenient and affordable. Systems such as Medios AI, EyeArt, and PhelcomNet have achieved high accuracy in diagnosing fundus images captured by smartphones (Pedro et al., 2016; Hasan and Siddiqui, 2023).

In summary, as the most mainstream and cost-effective method in current research, AI based on fundus photography has achieved many results in the early screening, prognosis, and disease progression monitoring of DR, but still needs to further improve its sensitivity and specificity.

2.1.2 OCT and OCTA

Optical Coherence Tomography (OCT) serves as a primary diagnostic tool with high-quality equipment that makes it easy to detect any harmful changes. OCT is particularly effective for visualizing various retinal layers and has been extensively researched for diagnosing retinal diseases. For instance, by integrating features manually extracted from Regions of Interest (ROI) with the VGG16 Convolutional Neural Network (CNN) model, OCT imaging has been used to diagnose conditions such as macular edema, macular hole, central serous retinopathy, choroidal neovascularization and pigment epithelium detachment (Ibrahim et al., 2020). Many AI models based on OCT are primarily used for monitoring conditions such as edema and degeneration in the macula (Gulshan et al., 2019; Sheng et al., 2022; Lam et al., 2024). With the introduction of network for automatic quantification of macular edema (Tsuboi et al., 2023) and integration networks that segment multiple layers of the retina, the detection and grading of DR using OCT scans have achieved high accuracy and specificity (ElTanboly et al., 2017; Sandhu et al., 2018; Li et al., 2019; Ghazal et al., 2020).

A recent study (Elgafi et al., 2022) segmented retinal layers, extracted 3D features (including first-order reflectivity and the 3D thickness of each OCT layer), and employed a backpropagation neural network for classification. The results showed that the system achieved an accuracy of 96.81% using Leave-One-Subject-Out (LOSO) cross-validation. Integrating multi-layer features enhances DR detection accuracy. 3D features provide better lesion detail capture than 2D, surpassing single-feature and other ML methods.

Additionally, Optical Coherence Tomography Angiography (OCTA) can be used to identify retinal diseases. OCTA provides detailed views of the eye’s vasculature and retina. Research (Eladawi et al., 2018) has created a DR detection system utilizing OCTA images, extracting features like FAZ area, vessel density, and caliber through segmentation. These features were analyzed using a Support Vector Machine (SVM) classifier, achieving an accuracy of 94.3%, sensitivity of 97.9%, and specificity of 87%. Another study (Heisler et al., 2020) using integrated deep learning techniques trained a network on the VGG19 architecture, achieving a best accuracy of 92%, outperforming other architectures. Research (Le et al., 2020) using the VGG16 CNN architecture to diagnose DR with OCTA reported an accuracy, specificity, and sensitivity of 87.27%, 90.82%, and 83.76%, respectively.

Further studies have combined OCT and OCTA modalities to identify different levels of DR. For example, one study (Sandhu et al., 2020) used both OCTA and OCT to grade Non-Proliferative Diabetic Retinopathy (NPDR) in 111 patients. For OCTA, they extracted features such as vessel density, FAZ size, vessel caliber, and the number of intersections and bifurcations. For OCT, they performed retinal layer segmentation and extracted features from each layer, represented by thickness, reflectivity, and curvature. Finally, a Random Forest classifier was used for classification, achieving an accuracy of 96%, sensitivity of 100%, and specificity of 94%.

In summary, OCT offers high accuracy, particularly in cases where there is suspicion of a series of macular complications caused by vascular changes. However, due to its relatively higher cost and the already high accuracy of fundus photography, the widespread adoption of OCT models is comparatively limited.

2.1.3 FFA

Fluorescein Fundus Angiography (FFA) is also a common method for fundus examination in detecting DR. Under an ophthalmoscope, what is deemed a “normal” fundus may reveal microaneurysms and microvascular changes during angiography. Early neovascular buds and areas of non-perfusion are not easily detectable with an ophthalmoscope, but they can be clearly observed through FFA, which is currently still the gold standard for retinal vasculature (Yang et al., 2022). However, due to its invasive nature and complexity, AI models using FFA for early DR screening are less common.

The earliest researchers proposed an automatic method for detecting Neovascularization of the Posterior Pole (NPA) in FFA images of patients with diabetic macular edema, laying the foundation for intelligent guidance in laser applications (Jin et al., 2020). Additionally, there is also research on a Multi-Path Cascade U-net (MCU-net) architecture for blood vessel segmentation in FFA sequence images, indicating its potential application in the quantitative analysis of vascular morphology in FFA sequence images (Gang et al., 2021; Ghassemi et al., 2021; Gao et al., 2023). Deep learning algorithms have been used to detect leakage points in Central Serous Chorioretinopathy (CSC) from dynamic FFA images (Chen et al., 2021).

In the most recent study (Gao et al., 2023), a research team collected and annotated a large number of FFA images, training a CNN model to recognize image quality, localization, eye side, imaging phase, and various lesions associated with DR. The results showed that the ResNet18 model performed excellently in pre-diagnostic assessment and lesion detection, with accuracy comparable to junior ophthalmologists. This study not only underscores AI’s potential to improve ophthalmic diagnostics but also suggests the model could enhance medical services, especially in resource-limited areas.

Despite some limitations, such as the singularity of the dataset source and the restriction of lesion types, the study lays the groundwork for future multi-center, multi-disease type FFA image analysis and automatic report generation.

In addition to AI models based on the aforementioned fundus photography, OCT, and FFA, alternative approaches include AI models for ultra-widefield retinal imaging, such as DeepUWF-plus and RETFound, which extend traditional fundus photography. However, these newer models lack extensive clinical trials. Moreover, there are hybrid approaches that combine one or two of the aforementioned techniques, like OCT and FFA. Due to limitations in length, these are not further discussed here.

2.2 AI model based on pathophysiological characteristics

In addition to diagnosing and treating DR through direct imaging of retinal lesions, AI can also be utilized based on other pathophysiological characteristics of DR. However, research in this area is relatively limited. These models support comprehensive and differential DR diagnosis from a mechanistic perspective. These models support comprehensive and differential DR diagnosis from a mechanistic perspective. This field warrants further research and investment.

2.2.1 Blood glucose

Hyperglycemia, one of the primary causes of DR, is crucial for early screening and referral. Continuous glucose monitoring (CGM) systems, supported by portable devices, facilitate a deeper understanding of patients’ blood glucose level trends, including the amplitude, direction, timing, and frequency of glucose fluctuations (Jan et al., 2016). However, due to the multifactorial nature of DR, it is necessary to incorporate multiple metrics [such as Time in Range (TIR) and Mean Blood Glucose (MBG)] within CGM systems to accurately reflect the relationship between complications and CGM data (Irl, 2015; Yang et al., 2021).

Moreover, DR’s nonlinear nature challenges traditional risk models (Keith et al., 2014), a challenge that traditional risk prediction models cannot adequately address. To overcome the limitations of CGM data analysis in constructing risk forecasting models, researchers from the School of Information Science and Engineering at Northeastern University, in collaboration with the Sixth People’s Hospital of Shanghai Jiao Tong University and the Shanghai Diabetes Clinical Center, have proposed the consideration of deep learning techniques, which can effectively uncover nonlinear relationships (Tao et al., 2023).

In July 2023, they introduced a novel model known as the Double Deep Latent Autoencoder (DDLA) (Tao et al., 2024). From (Tao et al., 2024), this model uses CNN and Long Short-Term Memory (LSTM) networks to analyze time-series data, improving feature extraction and classification. The process involves feature extraction, handling missing data, feature fusion, and diagnosis through a fully connected network, culminating in the use of a softmax layer to output the most likely type of the current sample (either DR or non-DR in T2D patients). Preliminary results show an accuracy of 0.89 and a specificity of 0.97 for T2D patients. Further clinical trials are needed to validate its effectiveness in managing DR.

2.2.2 Proteomics

DR is driven by multiple factors, including hyperglycemia, inflammation, and vascular dysfunction. Proteomic analysis can identify various cell-specific protein markers involved in these processes, providing auxiliary insights into the cellular drivers of DR and their roles at different disease stages (Wolf et al., 2023). Initially, aqueous humor (AH) and vitreous fluid samples are collected from patients for liquid biopsy (Gold et al., 2010). High-resolution proteomics via aptamer assays identifies numerous proteins, which are then integrated with scRNA-seq data from diverse ocular and extraocular cells (Tavé van et al., 2020; Joseph et al., 2021; Pradeep et al., 2021; Wolf et al., 2022; Wolf et al., 2023). This integration allows for the identification of the detected proteins’ cellular origins, thereby pinpointing markers unique to specific cells. AI models can extract local spatial features and global temporal dependencies, enabling the prediction of disease progression.

From Wolf et al. (2023) we can see that in the aqueous fluid of individuals with DR, changes in the expression of marker proteins from immune cells (B cells, macrophages, neutrophils, T cells, and mast cells), vascular endothelial cells, pericytes, and retinal glial cells, as well as liver proteins, have been observed. Studies have identified liver-derived proteins in DR as being associated with the acute phase response, acute inflammatory response, coagulation, and wound healing (Wolf et al., 2023). Immune cells, particularly macrophages, play a key role in the progression of late-stage DR in humans (Lee et al., 2015). Regarding the key factor of neovascularization used for staging DR, 58 angiogenic proteins showed different expression levels in DR. Twenty-nine of these proteins were elevated in both stages of the disease, whereas the remaining 29 were uniquely elevated in PDR and not in NPDR. Detecting these proteins through the model helps provide a comprehensive understanding of the current stage of DR. Additionally, therapeutic targets such as VEGFA for both PDR and NPDR can help guide more targeted treatment strategies.

In summary, this model provides a comprehensive risk assessment, distinguishing between NPDR and PDR based on the expression of angiogenic proteins and other markers. This approach provides a thorough molecular risk assessment for DR and aids in detecting other diseases for differential diagnosis and broad screening. Current research in this area is still relatively limited, warranting further attention and investment. In addition to these markers used in AI models, numerous studies are currently exploring similar markers. For instance, we can analyze angiogenic properties through core proteins and proteoglycans to predict the efficacy of anti-VEGF drugs (Low et al., 2021), all of which could be incorporated into future AI models for predicting and monitoring disease progression and treatment status.

The aforementioned models primarily focus on analyzing various retinal surface or cross-sectional images, which generally have inherent limitations. Firstly, building a large and diverse database is essential for the model’s broad training and applicability. Sample diversity, including ethnic variations, image clarity, and pupil dilation status, is critical for ensuring model accuracy and generalization to new images.

In practical applications, to enhance the model’s accuracy and reliability, choose AI models trained on similar databases or adjust input image resolution, capture conditions, and parameters to match the training data.

Furthermore, the model’s interpretability and robustness should be considered, ensuring that the model can still provide stable and accurate analytical results in the face of poor image quality or noise. This may necessitate further algorithm optimization and model tuning to enhance the model’s adaptability to various image variations.

3 Prospects and challenges of AI in the diagnosis of DR

3.1 AI technology issues and challenges

3.1.1 Bias and prejudice issues

AI algorithms necessarily undergo pre-training and training through databases, which may involve statistical methods (Valentina et al., 2019). Since the essence of a database is a sample derived from the population, it can possess all kinds of biases that can occur in samples and statistical processes, such as selection bias and confounding bias, etc., (Sheng et al., 2022). To boost the algorithm’s accuracy, we need to expand the dataset, diversify sample types, and adjust the algorithm for optimal sample sizes. Also, integrating multi-parameter and regression analyses, as well as managing standardized variables and parameters, is crucial. Addressing algorithmic biases, such as those from dataset imbalances, requires more and varied samples (Popescu Patoni et al., 2023). Feature selection bias mainly occurs because some important clinical indicators are ignored in the feature extraction, which requires cooperation with clinical doctors to comprehensively enter or select the most symbolic reference indicators (Sheng et al., 2022). The algorithm excels on familiar datasets but struggles with new ones, highlighting the need for continuous training to improve its generalization (Poly et al., 2023). In the improvement of algorithms, the “black box” poses a substantial challenge. AI models, especially deep learning models, are usually inexplicable to the outside world, and their decision-making process lacks transparency (Dey et al., 2022). This implies that while these models can precisely detect image patterns and diagnose, their reasoning process remains unclear. This lack of transparency makes it hard for users, including doctors and patients, to grasp the model’s mechanisms, limiting deep understanding, utilization, and enhancement of the AI. It also complicates the oversight of the machine’s decision-making, affecting its accountability and verifiability (Ghassemi et al., 2021). To solve these problems, researchers and developers are exploring explainable AI (XAI), local interpretation, model simplification, etc., At the same time, the government and related departments also need to formulate relevant policies and regulations, requiring AI systems to provide a certain degree of transparency and interpretability (Muhammad and Bendechache, 2024). A range of strategies is required to establish a rigorous and orderly AI environment.

3.1.2 More development directions of AI

Multimodal imaging, combining data from various imaging modalities, will be an important area of growth, providing richer data for AI analysis (Zhenwei et al., 2024). Integrating various examination results such as OCT, FFA, and fundus photography into comprehensive analysis will offer a more detailed perspective on retinal conditions and improve the sensitivity and specificity of diagnosis (Xinyu et al., 2023). AI can analyze big data by integrating various factors like imaging with blood sugar levels and risk factors, using deep learning to identify image features such as vascular abnormalities, exudation, retinal edema, etc., to jointly calculate the DR risk probability. AI algorithms enhance analysis accuracy by preprocessing images through noise reduction, contrast adjustment, and normalization (Moor et al., 2023). Additionally, they utilize multimodal data to predict the progression of DR, patient responses to treatment, and assess the risk of other difficult-to-detect diabetes-related complications, such as diabetic nephropathy, which are based on microvascular lesions like DR (Lakshminarayanan et al., 2021). We can develop AI models capable of identify patterns of comorbidities such as diabetic nephropathy and cardiovascular diseases. In summary, there are too many areas worth improving and innovating.

3.2 Clinical improvement

In advancing AI technology, the collaboration between computer professionals and clinical doctors is crucial. Clinicians play a significant role, as many AI models are tested by comparing their performance against doctors’ diagnoses, using existing cases as training data (Nakayama et al., 2023). The accuracy of these models, including their specificity and sensitivity, is often evaluated based on clinician outcomes, which directly impacts test effectiveness. While the primary DR grading system follows international standards, if these do not support effective AI training, alternative grading methods can be considered (Gulshan et al., 2016). Moreover, AI should enhance DR diagnosis and monitoring, particularly by refining the referral process upon detecting suspicious lesions, to leverage AI’s potential for efficient screening. Additionally, Though there is no definitive evidence that different diabetes types cause unique retinopathy symptoms, some studies have shown that they may have different incidence rates, disease courses, pathogenic mechanisms, metabolomic characteristics, variable response to treatments (Romero-Aroca et al., 2017; Eid et al., 2019; Matuszewski et al., 2020; Nakayama et al., 2021). The need for AI model design to distinguish between types like Type 1 and Type 2 diabetes for detailed analysis is an important area for healthcare professionals to advance AI in clinical settings. Continuously refining DR diagnostic methods is essential for enhancing its detection rate. Additionally, we need to focus more on pathophysiological and biochemical mechanisms at the molecular level to discover more biomarkers for diagnosis and prediction. All of these require ophthalmologists, endocrinologists, and radiologists to work together to find appropriate solutions.

3.3 Selection of AI model

Once an AI model is created, we must not only know how to improve it but also how to utilize it effectively. When selecting a model, fully consider the actual situation. For example, in the early stages of diabetes, if resources and patient health allow, an AI model based on FFA (Joseph et al., 2021) can be chosen for its accuracy. However, for convenience and non-invasive screening, an AI model based on fundus photography might be more appropriate (Lam et al., 2024). If you want to monitor the course of DR development, you can use the Singapore model SELENA (Wong et al., 2021) or the DeepDR Plus (Lam et al., 2024) from China. And if you want to make a differential diagnosis or evaluate the effectiveness of treatment targets in the case of multiple eye diseases, you can use molecular diagnostic models (Wolf et al., 2022). For long-term screening and management of early and mild cases of diabetes, you can first use a DR diagnostic model based on (Liu et al., 2023) for screening and then refer.

3.4 Cost-effectiveness solution of AI model research

AI in DR diagnosis streamlines preliminary screening for doctors, particularly useful for high-volume medical facilities (Chung et al., 2024). It automates and continuously performs preliminary diagnostic tasks, ensuring accuracy and sensitivity, reducing misdiagnosis and related medical costs (Chung et al., 2024). Additionally, AI enables telemedicine, benefiting remote patients by reducing travel expenses and time (Gunasekeran et al., 2020).

However, despite the long-term cost savings, the initial investment in AI systems can be substantial. This includes software licensing, hardware procurement (such as high-performance computing resources), and professional training costs (Nakayama et al., 2023). Besides this, AI models must regularly incorporate new medical findings and data, necessitating ongoing research and development, maintenance, and upgrades to maintain their precision and efficacy (Ruamviboonsuk et al., 2021).

Research suggests that in DR screening, the most cost-effective approach is a semi-automated system where AI performs an initial assessment, followed by human review of DR-positive cases. However, in low-income regions, where AI screening is most needed, the cost-effectiveness of AI may be diminished by technology investment challenges, hindering AI adoption (Cleland et al., 2023). Addressing the affordability of AI is a critical issue that must not be overlooked.

3.5 Ethical issues

Beyond technical and efficacy concerns, ethical issues also merit attention. This includes data privacy and security, the “black box” challenges of technical safety and responsibility, trust in AI by both medical professionals and patients, and algorithmic bias (Abdullah et al., 2021). These are all significant considerations in the AI realm.

4 Conclusion

After an integrated analysis of the current literature and clinical trials, we have reached the conclusion that AI for DR diagnostics is evolving positively, enhancing diagnostic efficiency and accuracy while easing the workload and facilitating remote healthcare. Yet, challenges and opportunities lie ahead. To propel the further development of AI in DR treatment, we must foster interdisciplinary cooperation to innovate and integrate AI into clinical practice, addressing ethical, legal, and trust issues to ensure AI genuinely aids medical professionals and serves the wellbeing of the populace.

Author contributions

XX: Conceptualization, Writing–original draft, Writing–review and editing, Resources, Supervision. MZ: Supervision, Writing–review and editing, Investigation. SH: Writing–review and editing, Methodology. XL: Writing–review and editing, Methodology. XK: Funding acquisition, Writing–review and editing. JL: Conceptualization, Funding acquisition, Supervision, Writing–review and editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This research was funded by the National Natural Science Foundation of China (81671671), the National Defense Science and Technology Collaborative Innovation Major Project of Central South University (2021gfcx05), Clinical Research Center for Medical Imaging in Hunan Province (2020SK4001), the Science and Technology Innovation Program of Hunan Province (2021RC4016), and Scientific Research Program of Hunan Provincial Health Commission (202209044797), the National Natural Science Foundation of China (U22A2034, 62177047), High Caliber Foreign Experts Introduction Plan funded by MOST, Major Program from Xiangjiang Laboratory under Grant (23XJ02005), and Central South University Research Programme of Advanced Interdisciplinary Studies (2023QYJC020).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Abdullah, Y. I., Schuman, J. S., Shabsigh, R., Caplan, A., and Al-Aswad, L. A. (2021). Ethics of artificial intelligence in medicine and ophthalmology. Asia-Pac. J. Ophthalmol. Phila. Pa 10, 289–298. doi:10.1097/APO.0000000000000397

CrossRef Full Text | Google Scholar

Anand, E. R., Oliver, Q. D., Lee, C. S., and Lee, A. Y. (2023). Artificial intelligence and diabetic retinopathy: AI framework, prospective studies, head-to-head validation, and cost-effectiveness. Diabetes Care 46, 1728–1739. doi:10.2337/dci23-0032

PubMed Abstract | CrossRef Full Text | Google Scholar

Andrzej, G., Brona, P., Lim, G., Paisan, R., Gavin, S. W. T., Michael, A., et al. (2020). Artificial intelligence for diabetic retinopathy screening: a review. Eye Lond. Engl. 34, 451–460. doi:10.1038/s41433-019-0566-0

CrossRef Full Text | Google Scholar

Antonetti, D. A., Klein, R., and Gardner, T. W. (2012). Diabetic retinopathy. N. Engl. J. Med. 366, 1227–1239. doi:10.1056/NEJMra1005073

PubMed Abstract | CrossRef Full Text | Google Scholar

Businesswire (2024). Eyenuk announces FDA clearance for EyeArt autonomous AI system for diabetic retinopathy screening | business wire. Available at: https://www.businesswire.com/news/home/20200805005495/en/Eyenuk-Announces-FDA-Clearance-for-EyeArt-Autonomous-AI-System-for-Diabetic-Retinopathy-Screening (Accessed July 6, 2024).

Google Scholar

Cao, Q., Wang, C., Wan, J., Wang, J., and Yang, Q. (2022). Development and validation of an artificial intelligence grading and diagnostic model for diabetic fundus lesions based on EasyDL. New Med. 53, 361–365. doi:10.3969/j.issn.0253-9802.2022.05.012

CrossRef Full Text | Google Scholar

Chen, M., Jin, K., You, K., Xu, Y., Wang, Y., Yip, C.-C., et al. (2021). Automatic detection of leakage point in central serous chorioretinopathy of fundus fluorescein angiography based on time sequence deep learning. Graefes Arch. Clin. Exp. Ophthalmol. 259, 2401–2411. doi:10.1007/s00417-021-05151-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Chung, Y.-C., Kao, Y.-W., Huang, Y.-C., Chen, P.-E., Liao, S.-C., Liu, C.-K., et al. (2024). Cost-effectiveness of diabetic retinopathy screening for newly diagnosed type 2 diabetic patients: a nationwide population-based propensity score-matched cohort study. Asia-Pac. J. Ophthalmol. Phila. Pa 13, 100071. doi:10.1016/j.apjo.2024.100071

CrossRef Full Text | Google Scholar

Cleland, C. R., Rwiza, J., Evans, J. R., Gordon, I., MacLeod, D., Burton, M. J., et al. (2023). Artificial intelligence for diabetic retinopathy in low-income and middle-income countries: a scoping review. BMJ Open Diabetes Res. Care 11, e003424. doi:10.1136/bmjdrc-2023-003424

PubMed Abstract | CrossRef Full Text | Google Scholar

Commissioner (2020). FDA permits marketing of artificial intelligence-based device to detect certain diabetes-related eye problems. FDA. Available at: https://www.fda.gov/news-events/press-announcements/fda-permits-marketing-artificial-intelligence-based-device-detect-certain-diabetes-related-eye (Accessed July 5, 2024).

Google Scholar

Dey, S., Chakraborty, P., Kwon, B. C., Dhurandhar, A., Ghalwash, M., Suarez Saiz, F. J., et al. (2022). Human-centered explainability for life sciences, healthcare, and medical informatics. Patterns N. Y. N. 3, 100493. doi:10.1016/j.patter.2022.100493

PubMed Abstract | CrossRef Full Text | Google Scholar

Dong, L., He, W., Zhang, R., Ge, Z., Wang, Y. X., Zhou, J., et al. (2022). Artificial intelligence for screening of multiple retinal and optic nerve diseases. JAMA Netw. Open 5, e229960. doi:10.1001/jamanetworkopen.2022.9960

PubMed Abstract | CrossRef Full Text | Google Scholar

Dsw, T., Carol Yim-Lui, C., Gilbert, L., Gavin, S. W. T., Nguyen, Q. D., Alfred, G., et al. (2017). Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA 318, 2211–2223. doi:10.1001/jama.2017.18152

PubMed Abstract | CrossRef Full Text | Google Scholar

Eid, S., Sas, K. M., Abcouwer, S. F., Feldman, E. L., Gardner, T. W., Pennathur, S., et al. (2019). New insights into the mechanisms of diabetic complications: role of lipids and lipid metabolism. Diabetologia 62, 1539–1549. doi:10.1007/s00125-019-4959-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Eladawi, N., Elmogy, M., Khalifa, F., Ghazal, M., Ghazi, N., Aboelfetouh, A., et al. (2018). Early diabetic retinopathy diagnosis based on local retinal blood vessel analysis in optical coherence tomography angiography (OCTA) images. Med. Phys. 45, 4582–4599. doi:10.1002/mp.13142

PubMed Abstract | CrossRef Full Text | Google Scholar

Elgafi, M., Sharafeldeen, A., Elnakib, A., Elgarayhi, A., Alghamdi, N. S., Sallah, M., et al. (2022). Detection of diabetic retinopathy using extracted 3D features from OCT images. Sensors 22, 7833. doi:10.3390/s22207833

PubMed Abstract | CrossRef Full Text | Google Scholar

Eli, I., David, L., Bruce, B., Viral, N. S., Steven, S., Carl, D. R., et al. (2021). Pivotal evaluation of an artificial intelligence system for autonomous detection of referrable and vision-threatening diabetic retinopathy. JAMA Netw. Open 4, e2134254. doi:10.1001/jamanetworkopen.2021.34254

PubMed Abstract | CrossRef Full Text | Google Scholar

ElTanboly, A., Ismail, M., Shalaby, A., Switala, A., El-Baz, A., Schaal, S., et al. (2017). A computer-aided diagnostic system for detecting diabetic retinopathy in optical coherence tomography images. Med. Phys. 44, 914–923. doi:10.1002/mp.12071

PubMed Abstract | CrossRef Full Text | Google Scholar

Gang, S., Liu, X., and Yu, X. (2021). Multi-path cascaded U-net for vessel segmentation from fundus fluorescein angiography sequential images. Comput. Methods Programs Biomed. 211, 106422. doi:10.1016/j.cmpb.2021.106422

PubMed Abstract | CrossRef Full Text | Google Scholar

Gao, Z., Pan, X., Shao, J., Jiang, X., Su, Z., Jin, K., et al. (2023). Automatic interpretation and clinical evaluation for fundus fluorescein angiography images of diabetic retinopathy patients by deep learning. Br. J. Ophthalmol. 107, 1852–1858. doi:10.1136/bjo-2022-321472

PubMed Abstract | CrossRef Full Text | Google Scholar

Ghassemi, M., Oakden-Rayner, L., and Beam, A. L. (2021). The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digit. Health 3, e745–e750. doi:10.1016/S2589-7500(21)00208-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Ghazal, M., Ali, S. S., Mahmoud, A. H., Shalaby, A. M., and El-Baz, A. (2020). Accurate detection of non-proliferative diabetic retinopathy in optical coherence tomography images using convolutional neural networks. IEEE Access 8, 34387–34397. doi:10.1109/ACCESS.2020.2974158

CrossRef Full Text | Google Scholar

Gold, L., Ayers, D., Bertino, J., Bock, C., Bock, A., Brody, E. N., et al. (2010). Aptamer-based multiplexed proteomic technology for biomarker discovery. PloS One 5, e15004. doi:10.1371/journal.pone.0015004

PubMed Abstract | CrossRef Full Text | Google Scholar

Goldstein, J., Weitzman, D., Lemerond, M., and Jones, A. (2023). Determinants for scalable adoption of autonomous AI in the detection of diabetic eye disease in diverse practice types: key best practices learned through collection of real-world data. Front. Digit. Health 5, 1004130. doi:10.3389/fdgth.2023.1004130

PubMed Abstract | CrossRef Full Text | Google Scholar

Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., et al. (2016). Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402–2410. doi:10.1001/jama.2016.17216

PubMed Abstract | CrossRef Full Text | Google Scholar

Gulshan, V., Rajan, R. P., Widner, K., Wu, D., Wubbels, P., Rhodes, T., et al. (2019). Performance of a deep-learning algorithm vs manual grading for detecting diabetic retinopathy in India. JAMA Ophthalmol. 137, 987–993. doi:10.1001/jamaophthalmol.2019.2004

PubMed Abstract | CrossRef Full Text | Google Scholar

Gunasekeran, D. V., Ting, D. S. W., Tan, G. S. W., and Wong, T. Y. (2020). Artificial intelligence for diabetic retinopathy screening, prediction and management. Curr. Opin. Ophthalmol. 31, 357–365. doi:10.1097/ICU.0000000000000693

PubMed Abstract | CrossRef Full Text | Google Scholar

Hansen, M. B., Abràmoff, M. D., Folk, J. C., Mathenge, W., Bastawrous, A., and Peto, T. (2015). Results of automated retinal image analysis for detection of diabetic retinopathy from the nakuru study, Kenya. PLoS ONE 10, e0139148. doi:10.1371/journal.pone.0139148

PubMed Abstract | CrossRef Full Text | Google Scholar

Haritoglou, C., Kernt, M., Neubauer, A., Gerss, J., Oliveira, C. M., Kampik, A., et al. (2014). Microaneurysm formation rate as a predictive marker for progression to clinically significant macular edema in nonproliferative diabetic retinopathy. Retina Phila. Pa 34, 157–164. doi:10.1097/IAE.0b013e318295f6de

PubMed Abstract | CrossRef Full Text | Google Scholar

Harreiter, J., and Roden, M. (2023). Diabetes mellitus – Definition, Klassifikation, Diagnose, Screening und Prävention (Update 2023). Wien. Klin. Wochenschr. 135, 7–17. doi:10.1007/s00508-022-02122-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Hasan, S. U., and Siddiqui, M. A. R. (2023). Diagnostic accuracy of smartphone-based artificial intelligence systems for detecting diabetic retinopathy: a systematic review and meta-analysis. Diabetes Res. Clin. Pract. 205, 110943. doi:10.1016/j.diabres.2023.110943

PubMed Abstract | CrossRef Full Text | Google Scholar

Heisler, M., Karst, S., Lo, J., Mammo, Z., Yu, T., Warner, S., et al. (2020). Ensemble deep learning for diabetic retinopathy detection using optical coherence tomography angiography. Transl. Vis. Sci. Technol. 9, 20. doi:10.1167/tvst.9.2.20

PubMed Abstract | CrossRef Full Text | Google Scholar

Heydon, P., Egan, C., Bolter, L., Chambers, R., Anderson, J., Aldington, S., et al. (2021). Prospective evaluation of an artificial intelligence-enabled algorithm for automated diabetic retinopathy screening of 30 000 patients. Br. J. Ophthalmol. 105, 723–728. doi:10.1136/bjophthalmol-2020-316594

PubMed Abstract | CrossRef Full Text | Google Scholar

Home, Resources, diabetes, L. with, Acknowledgement, FAQs, Contact (2024). IDF diabetes atlas. Available at: https://libres.csu.edu.cn/vpn/249/https/MSVXCZUFPSTYGZLVNSRYGLUQPJUB/ (Accessed June 30, 2024).

Google Scholar

Ian Gerard, B., Stephen, R. K., Edel, M., Darragh, G., Robert, A., Louise, O., et al. (2024). Addressing technical failures in a diabetic retinopathy screening program. Clin. Ophthalmol. Auckl. N. Z. 18, 431–440. doi:10.2147/OPTH.S442414

CrossRef Full Text | Google Scholar

Ibrahim, M., Fathalla, K., and Youssef, S. (2020). HyCAD-OCT: a hybrid computer-aided diagnosis of retinopathy by optical coherence tomography integrating machine learning and feature maps localization. Appl. Sci. 10, 4716. doi:10.3390/app10144716

CrossRef Full Text | Google Scholar

Irl, B. H. (2015). Glycemic variability and diabetes complications: does it matter? Of course it does. Diabetes Care 38, 1610–1614. doi:10.2337/dc14-2898

PubMed Abstract | CrossRef Full Text | Google Scholar

Jan, B., Ramiro, A., Petronella, G.-D., Jens, K., and Raimund, W. (2016). Novel glucose-sensing technology and hypoglycaemia in type 1 diabetes: a multicentre, non-masked, randomised controlled trial. Lancet lond. Engl. 388, 2254–2263. doi:10.1016/S0140-6736(16)31535-5

CrossRef Full Text | Google Scholar

Jin, K., Pan, X., You, K., Wu, J., Liu, Z., Cao, J., et al. (2020). Automatic detection of non-perfusion areas in diabetic macular edema from fundus fluorescein angiography for decision making using deep learning. Sci. Rep. 10, 15138–15147. doi:10.1038/s41598-020-71622-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Joanne, W. Y. Y., Rogers, S. L., Ryo, K., Ecosse, L. L., Jonathan, W. K., Toke, B., et al. (2012). Global prevalence and major risk factors of diabetic retinopathy. Diabetes Care 35, 556–564. doi:10.2337/dc11-1909

PubMed Abstract | CrossRef Full Text | Google Scholar

Joseph, C., Rachel, Q., Darin, Z., Sanja, B., Birthe, D., Nicky, M., et al. (2021). A single cell atlas of human cornea that defines its development, limbal progenitor cells and their interactions with the immune cells. Ocul. Surf. 21, 279–298. doi:10.1016/j.jtos.2021.03.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Keith, A. A. F., Gordon, F., Etienne, P., Wei, H., Rogers, S. L., Rogers, S. L., et al. (2014). Should patients with acute coronary disease be stratified for management according to their risk? Derivation, external validation and outcomes using the updated GRACE risk score. BMJ Open 4, e004425. doi:10.1136/bmjopen-2013-004425

PubMed Abstract | CrossRef Full Text | Google Scholar

Lakshminarayanan, V., Kheradfallah, H., Sarkar, A., and Jothi Balaji, J. (2021). Automated detection and diagnosis of diabetic retinopathy: a comprehensive survey. J. Imaging 7, 165. doi:10.3390/jimaging7090165

PubMed Abstract | CrossRef Full Text | Google Scholar

Lam, C., Wong, Y. L., Tang, Z., Hu, X., Nguyen, T. X., Yang, D., et al. (2024). Performance of artificial intelligence in detecting diabetic macular edema from fundus photography and optical coherence tomography images: a systematic review and meta-analysis. Diabetes Care 47, 304–319. doi:10.2337/dc23-0993

PubMed Abstract | CrossRef Full Text | Google Scholar

Le, D., Alam, M., Yao, C. K., Lim, J. I., Hsieh, Y.-T., Chan, R. V. P., et al. (2020). Transfer learning for automated OCTA detection of diabetic retinopathy. Transl. Vis. Sci. Technol. 9, 35. doi:10.1167/tvst.9.2.35

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, R., Wong, T. Y., and Sabanayagam, C. (2015). Epidemiology of diabetic retinopathy, diabetic macular edema and related vision loss. Eye Vis. Lond. Engl. 2, 17. doi:10.1186/s40662-015-0026-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Shen, L., Shen, M., Tan, F., and Qiu, C. S. (2019). Deep learning based early stage diabetic retinopathy detection using optical coherence tomography. Neurocomputing 369, 134–144. doi:10.1016/j.neucom.2019.08.079

CrossRef Full Text | Google Scholar

Ling, D., Bin, S., Tingli, C., Qiaang, F., Gordon, F., Gordon, F., et al. (2024). A deep learning system for predicting time to progression of diabetic retinopathy. Nat. Med. 30, 584–594. doi:10.1038/s41591-023-02702-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Ling, D., Liang, W., Li, H., Cai, C., Wu, Q., Kong, H., et al. (2021). A deep learning system for detecting diabetic retinopathy across the disease spectrum. Nat. Commun. 12, 3242. doi:10.1038/s41467-021-23458-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, Y.-F., Ji, Y.-K., Fei, F.-Q., Chen, N.-M., Zhu, Z.-T., and Fei, X.-Z. (2023). Research progress in artificial intelligence assisted diabetic retinopathy diagnosis. Int. J. Ophthalmol. 16, 1395–1405. doi:10.18240/ijo.2023.09.05

PubMed Abstract | CrossRef Full Text | Google Scholar

Lm, R., Magliano, D. J., Lemesurier, R., Hr, T., Pz, Z., and Je, S. (2013). Prevalence of diabetic retinopathy in Type 2 diabetes in developing and developed countries. Diabet. Med. J. Br. Diabet. Assoc. 30, 387–398. doi:10.1111/dme.12119

CrossRef Full Text | Google Scholar

Low, S. W. Y., Vaidya, T., Gadde, S. G. K., Mochi, T. B., Kumar, D., Kassem, I. S., et al. (2021). Decorin concentrations in aqueous humor of patients with diabetic retinopathy. Life 11, 1421. doi:10.3390/life11121421

PubMed Abstract | CrossRef Full Text | Google Scholar

Matuszewski, W., Stefanowicz-Rutkowska, M. M., Szychlińska, M., and Bandurska-Stankiewicz, E. (2020). Differences in risk factors for diabetic retinopathy in type 1 and type 2 diabetes mellitus patients in north-east Poland. Med. Kaunas. Lith. 56, 177. doi:10.3390/medicina56040177

CrossRef Full Text | Google Scholar

Michael, D. A., Lou, Y., Ali, E., Warren, C., Ryan, A., James, C. F., et al. (2016). Improved automated detection of diabetic retinopathy on a publicly available dataset through integration of deep learning. Invest. Ophthalmol. Vis. Sci. 57, 5200–5206. doi:10.1167/iovs.16-19964

PubMed Abstract | CrossRef Full Text | Google Scholar

Moor, M., Banerjee, O., Abad, Z. S. H., Krumholz, H. M., Leskovec, J., Topol, E. J., et al. (2023). Foundation models for generalist medical artificial intelligence. Nature 616, 259–265. doi:10.1038/s41586-023-05881-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Muhammad, D., and Bendechache, M. (2024). Unveiling the black box: a systematic review of Explainable Artificial Intelligence in medical image analysis. Comput. Struct. Biotechnol. J. 24, 542–560. doi:10.1016/j.csbj.2024.08.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Nakayama, L. F., Zago Ribeiro, L., Novaes, F., Miyawaki, I. A., Miyawaki, A. E., de Oliveira, J. A. E., et al. (2023). Artificial intelligence for telemedicine diabetic retinopathy screening: a review. Ann. Med. 55, 2258149. doi:10.1080/07853890.2023.2258149

PubMed Abstract | CrossRef Full Text | Google Scholar

Nakayama, Y., Yamaguchi, S., Shinzato, Y., Okamoto, S., Millman, J. F., Yamashiro, K., et al. (2021). Retrospective exploratory analyses on gender differences in determinants for incidence and progression of diabetic retinopathy in Japanese patients with type 2 diabetes mellitus. Endocr. J. 68, 655–669. doi:10.1507/endocrj.EJ20-0630

PubMed Abstract | CrossRef Full Text | Google Scholar

Paisan, R., Richa, T., Rory, S., Variya, N., Kornwipa, H., and Apinpat, K. (2022). Real-time diabetic retinopathy screening by deep learning in a multisite national screening programme: a prospective interventional cohort study. Lancet Digit. Health 4, e235–e244. doi:10.1016/S2589-7500(22)00017-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Pappuru, R. K. R., Ribeiro, L., Lobo, C., Alves, D., and Cunha-Vaz, J. (2019). Microaneurysm turnover is a predictor of diabetic retinopathy progression. Br. J. Ophthalmol. 103, 222–226. doi:10.1136/bjophthalmol-2018-311887

PubMed Abstract | CrossRef Full Text | Google Scholar

Pedro, R.-A., Marc, B.-B., Aliccia, P.-R., Maribel, L.-G., Raul, N.-G., and Raquel, V. (2016). Diabetic macular edema pathophysiology: vasogenic versus inflammatory. J. Diabetes Res. 2016, 2156273. doi:10.1155/2016/2156273

PubMed Abstract | CrossRef Full Text | Google Scholar

Poly, T. N., Islam, M. M., Walther, B. A., Lin, M. C., and Jack Li, Y.-C. (2023). Artificial intelligence in diabetic retinopathy: bibliometric analysis. Comput. Methods Programs Biomed. 231, 107358. doi:10.1016/j.cmpb.2023.107358

PubMed Abstract | CrossRef Full Text | Google Scholar

Popescu Patoni, S. I., Muşat, A. A. M., Patoni, C., Popescu, M.-N., Munteanu, M., Costache, I. B., et al. (2023). Artificial intelligence in ophthalmology. Romanian J. Ophthalmol. 67, 207–213. doi:10.22336/rjo.2023.37

CrossRef Full Text | Google Scholar

Pradeep, G., Kiyofumi, H., Ying, C., Zeng, Y., Bar, M., Hu, L., et al. (2021). Multi-species single-cell transcriptomic analysis of ocular compartment regulons. Nat. Commun. 12, 5675. doi:10.1038/s41467-021-25968-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Pritam, B., Nita, S., Smitha, S. K., Dhawan, B., Aratee, P., Davesh, K., et al. (2017). Sensitivity and specificity of automated analysis of single-field non-mydriatic fundus photographs by Bosch DR Algorithm-Comparison with mydriatic fundus photography (ETDRS) for screening in undiagnosed diabetic retinopathy. PloS One 12, e0189854. doi:10.1371/journal.pone.0189854

PubMed Abstract | CrossRef Full Text | Google Scholar

Rajesh, A. E., Davidson, O. Q., Lee, C. S., and Lee, A. Y. (2023). Artificial intelligence and diabetic retinopathy: AI framework, prospective studies, head-to-head validation, and cost-effectiveness. Diabetes Care 46, 1728–1739. doi:10.2337/dci23-0032

PubMed Abstract | CrossRef Full Text | Google Scholar

Resnikoff, S., Lansingh, V. C., Washburn, L., Felch, W., Gauthier, T.-M., Taylor, H. R., et al. (2020). Estimated number of ophthalmologists worldwide (International Council of Ophthalmology update): will we meet the needs? Br. J. Ophthalmol. 104, 588–592. doi:10.1136/bjophthalmol-2019-314336

PubMed Abstract | CrossRef Full Text | Google Scholar

Retmarker (2024a). G_2018_EASDEC_Joao_Ramos.pdf. Available at: https://www.retmarker.com/wp-content/uploads/2020/07/G_2018_EASDEC_Joao_Ramos.pdf (Accessed July 6, 2024).

Google Scholar

Retmarker (2024b). RTM_EN_brochure_biomarker.pdf. Available at: https://www.retmarker.com/wp-content/uploads/docs/biomarker/RTM_EN_brochure_biomarker.pdf (Accessed July 6, 2024).

Google Scholar

Romero-Aroca, P., Navarro-Gil, R., Valls-Mateu, A., Sagarra-Alamo, R., Moreno-Ribas, A., and Soler, N. (2017). Differences in incidence of diabetic retinopathy between type 1 and 2 diabetes mellitus: a nine-year follow-up study. Br. J. Ophthalmol. 101, 1346–1351. doi:10.1136/bjophthalmol-2016-310063

PubMed Abstract | CrossRef Full Text | Google Scholar

Ruamviboonsuk, P., Chantra, S., Seresirikachorn, K., Ruamviboonsuk, V., and Sangroongruangsri, S. (2021). Economic evaluations of artificial intelligence in ophthalmology. Asia-Pac. J. Ophthalmol. Phila. Pa 10, 307–316. doi:10.1097/APO.0000000000000403

CrossRef Full Text | Google Scholar

Sa, R. (2024a). Abstract EASDEC 2019 – diabetic retinopathy screening deep learning-based approach.

Google Scholar

Sa, R. (2024b). Abstract EASDEC 2019 – gradeability evaluation.

Google Scholar

Sandhu, H. S., Elmogy, M., Taher Sharafeldeen, A., Elsharkawy, M., El-Adawy, N., Eltanboly, A., et al. (2020). Automated diagnosis of diabetic retinopathy using clinical biomarkers, optical coherence tomography, and optical coherence tomography angiography. Am. J. Ophthalmol. 216, 201–206. doi:10.1016/j.ajo.2020.01.016

PubMed Abstract | CrossRef Full Text | Google Scholar

Sandhu, H. S., Eltanboly, A., Shalaby, A., Keynton, R. S., Schaal, S., and El-Baz, A. (2018). Automated diagnosis and grading of diabetic retinopathy using optical coherence tomography. Invest. Ophthalmol. Vis. Sci. 59, 3155–3160. doi:10.1167/iovs.17-23677

PubMed Abstract | CrossRef Full Text | Google Scholar

Sheng, B., Chen, X., Li, T., Ma, T., Yang, Y., Bi, L., et al. (2022). An overview of artificial intelligence in diabetic retinopathy and other ocular diseases. Front. Public Health 10, 971943. doi:10.3389/fpubh.2022.971943

PubMed Abstract | CrossRef Full Text | Google Scholar

Stitt, A. W., Curtis, T. M., Chen, M., Medina, R. J., McKay, G. J., Jenkins, A., et al. (2016). The progress in understanding and treatment of diabetic retinopathy. Prog. Retin. Eye Res. 51, 156–186. doi:10.1016/j.preteyeres.2015.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Sundaram, S., Selvamani, M., Raju, S. K., Ramaswamy, S., Islam, S., Cha, J.-H., et al. (2023). Diabetic retinopathy and diabetic macular edema detection using ensemble based convolutional neural networks. Diagnostics 13, 1001. doi:10.3390/diagnostics13051001

PubMed Abstract | CrossRef Full Text | Google Scholar

Sussman, E. J., Tsiaras, W. G., and Soper, K. A. (1982). Diagnosis of diabetic eye disease. JAMA J. Am. Med. Assoc. 247, 3231. doi:10.1001/jama.1982.03320480047025

PubMed Abstract | CrossRef Full Text | Google Scholar

Takamura, Y., Yamada, Y., Morioka, M., Gozawa, M., Matsumura, T., and Inatani, M. (2023). Turnover of microaneurysms after intravitreal injections of faricimab for diabetic macular edema. Invest. Ophthalmol. Vis. Sci. 64, 31. doi:10.1167/iovs.64.13.31

PubMed Abstract | CrossRef Full Text | Google Scholar

Tan, T.-E., and Wong, T. Y. (2022). Diabetic retinopathy: looking forward to 2030. Front. Endocrinol. 13, 1077669. doi:10.3389/fendo.2022.1077669

CrossRef Full Text | Google Scholar

Tao, R., Li, H., Lu, J., Huang, Y., Wang, Y., Lu, W., et al. (2024). DDLA: a double deep latent autoencoder for diabetic retinopathy diagnose based on continuous glucose sensors. Med. Biol. Eng. Comput. 62, 3089–3106. doi:10.1007/s11517-024-03120-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Tao, R., Yu, X., Lu, J., Wang, Y., Lu, W., Zhang, Z., et al. (2023). A deep learning nomogram of continuous glucose monitoring data for the risk prediction of diabetic retinopathy in type 2 diabetes. Phys. Eng. Sci. Med. 46, 813–825. doi:10.1007/s13246-023-01254-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Tavé van, Z., Yan, W., McAdams, A., Peng, Y. R., Shekhar, K., Regev, A., et al. (2020). Cell atlas of aqueous humor outflow pathways in eyes of humans and four model species provides insight into glaucoma pathogenesis. Proc. Natl. Acad. Sci. U. S. A. 117, 10339–10349. doi:10.1073/pnas.2001250117

PubMed Abstract | CrossRef Full Text | Google Scholar

Teo, Z. L., Tham, Y.-C., Yu, M., Chee, M. L., Rim, T. H., Cheung, N., et al. (2021). Global prevalence of diabetic retinopathy and projection of burden through 2045: systematic review and meta-analysis. Ophthalmology 128, 1580–1591. doi:10.1016/j.ophtha.2021.04.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Tien, Y. W., Mkaya, M., Ronald, K., Michael, L., Harry, F., Marisol, H.-M., et al. (2009). Rates of progression in diabetic retinopathy during different time periods: a systematic review and meta-analysis. Diabetes Care 32, 2307–2313. doi:10.2337/dc09-0615

PubMed Abstract | CrossRef Full Text | Google Scholar

Tsuboi, K., You, Q. S., Guo, Y., Wang, J., Flaxel, C. J., Bailey, S. T., et al. (2023). Automated macular fluid volume as a treatment indicator for diabetic macular edema. J. Vitr. Dis. 7, 226–231. doi:10.1177/24741264231164846

CrossRef Full Text | Google Scholar

Valentina, B., Lim, Z. W., Lim, G., Quang, D. N., Xie, Y., and Yip, M. Y. T. (2019). Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. Lancet Digit. Health 1, e35–e44. doi:10.1016/S2589-7500(19)30004-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Varadarajan, A. V., Bavishi, P., Ruamviboonsuk, P., Chotcomwongse, P., Venugopalan, S., Narayanaswamy, A., et al. (2020). Predicting optical coherence tomography-derived diabetic macular edema grades from fundus photographs using deep learning. Nat. Commun. 11, 130. doi:10.1038/s41467-019-13922-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Vought, R., Vought, V., Shah, M., Szirth, B., and Bhagat, N. (2023). EyeArt artificial intelligence analysis of diabetic retinopathy in retinal screening events. Int. Ophthalmol. 43, 4851–4859. doi:10.1007/s10792-023-02887-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Wei, W., and Acy, C. Y. L. (2018). Diabetic retinopathy: pathophysiology and treatments. Int. J. Mol. Sci. 19, 1816. doi:10.3390/ijms19061816

PubMed Abstract | CrossRef Full Text | Google Scholar

Wolf, J., Boneva, S., Rosmus, D.-D., Agostini, H., Schlunck, G., Wieghofer, P., et al. (2022). Deciphering the molecular signature of human hyalocytes in relation to other innate immune cell populations. Invest. Ophthalmol. Vis. Sci. 63, 9. doi:10.1167/iovs.63.3.9

PubMed Abstract | CrossRef Full Text | Google Scholar

Wolf, J., Rasmussen, D. K., Sun, Y. J., Vu, J. T., Wang, E., Espinosa, C., et al. (2023). Liquid-biopsy proteomics combined with AI identifies cellular drivers of eye aging and disease in vivo. Cell 186, 4868–4884.e12. doi:10.1016/j.cell.2023.09.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Wong, D. C. S., Kiew, G., Jeon, S., and Ting, D. (2021). “Singapore eye lesions analyzer (SELENA): the deep learning system for retinal diseases,” in Artificial intelligence in ophthalmology. Editor A. Grzybowski (Cham: Springer International Publishing), 177–185. doi:10.1007/978-3-030-78601-4_13

CrossRef Full Text | Google Scholar

Wu, G., Hu, Y., Zhu, Q., Liang, A., Du, Z., Zheng, C., et al. (2024). Development and validation of a simple and practical model for early detection of diabetic macular edema in patients with type 2 diabetes mellitus using easily accessible systemic variables. J. Transl. Med. 22, 523. doi:10.1186/s12967-024-05328-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Xiaoxin, L. (2023). Updates to the clinical diagnosis and treatment guidelines for diabetic retinopathy in China (2022 edition) — revised based on evidence-based medicine. Chin. J. Ophthalmol. 39, 91–94. doi:10.3760/cma.j.cn511434-20230208-00055

CrossRef Full Text | Google Scholar

Xinyu, Z., Lin, Z., Yu, S., Jun, X., Xie, L., Xu, Y., et al. (2023). An artificial intelligence system for the whole process from diagnosis to treatment suggestion of ischemic retinal diseases. Cell Rep. Med. 4, 101197. doi:10.1016/j.xcrm.2023.101197

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, J., Yang, X., Zhao, D., Wang, X., Wei, W., and Yuan, H. (2021). Association of time in range, as assessed by continuous glucose monitoring, with painful diabetic polyneuropathy. J. Diabetes Investig. 12, 828–836. doi:10.1111/jdi.13394

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, Z., Tan, T.-E., Shao, Y., Wong, T. Y., and Li, X. (2022). Classification of diabetic retinopathy: past, present and future. Front. Endocrinol. 13, 1079217. doi:10.3389/fendo.2022.1079217

PubMed Abstract | CrossRef Full Text | Google Scholar

Yao, J., Lim, J., Lim, G. Y. S., Ong, J. C. L., Ke, Y., Tan, T. F., et al. (2024). Novel artificial intelligence algorithms for diabetic retinopathy and diabetic macular edema. Eye Vis. 11, 23. doi:10.1186/s40662-024-00389-y

CrossRef Full Text | Google Scholar

Yingfeng, Z., Mingguang, H., and Nathan, C. (2012). The worldwide epidemic of diabetic retinopathy. Indian J. Ophthalmol. 60, 428–431. doi:10.4103/0301-4738.100542

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhenwei, Z., Callie, D., and Yanni, M. P. (2024). Advances in structural and functional retinal imaging and biomarkers for early detection of diabetic retinopathy. Biomedicines 12, 1405. doi:10.3390/biomedicines12071405

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: artificial intelligence, diabetic retinopathy, diagnosis, prospects, images, molecular marker

Citation: Xu X, Zhang M, Huang S, Li X, Kui X and Liu J (2024) The application of artificial intelligence in diabetic retinopathy: progress and prospects. Front. Cell Dev. Biol. 12:1473176. doi: 10.3389/fcell.2024.1473176

Received: 30 July 2024; Accepted: 15 October 2024;
Published: 25 October 2024.

Edited by:

Huihui Fang, Nanyang Technological University, Singapore

Reviewed by:

Susanne Mohr, Michigan State University, United States
Lianqun Wu, Fudan University, China

Copyright © 2024 Xu, Zhang, Huang, Li, Kui and Liu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xiaoyan Kui, eHlrdWlAY3N1LmVkdS5jbg==; Jun Liu, anVubGl1MTIzQGNzdS5lZHUuY24=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.