- 1Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, China
- 2Institute of Biomedical Engineering, Peking University Shenzhen Graduate School, Shenzhen, China
- 3Shenzhen Bay Laboratory, Institute of Biomedical Engineering, Shenzhen, China
- 4National Biomedical Imaging Center, Peking University, Beijing, China
- 5Institute of Medical Technology, Peking University Health Science Center, Peking University, Beijing, China
- 6Department of Neurology, Xuanwu Hospital, Capital Medical University, Beijing, China
- 7Department of Cardiology, Beijing Yanhua Hospital, Beijing, China
- 8Cardio-Metabolic Medicine Center, Fuwai Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing, China
Background: Ischemic stroke (IS) is one of the most common serious secondary diseases of atrial fibrillation (AF) within 1 year after its occurrence, both of which have manifestations of ischemia and hypoxia of the small vessels in the early phase of the condition. The fundus is a collection of capillaries, while the retina responds differently to light of different wavelengths. Predicting the risk of IS occurring secondary to AF, based on subtle differences in fundus images of different wavelengths, is yet to be explored. This study was conducted to predict the risk of IS occurring secondary to AF based on multi-spectrum fundus images using deep learning.
Methods: A total of 150 AF participants without suffering from IS within 1 year after discharge and 100 IS participants with persistent arrhythmia symptoms or a history of AF diagnosis in the last year (defined as patients who would develop IS within 1 year after AF, based on fundus pathological manifestations generally prior to symptoms of the brain) were recruited. Fundus images at 548, 605, and 810 nm wavelengths were collected. Three classical deep neural network (DNN) models (Inception V3, ResNet50, SE50) were trained. Sociodemographic and selected routine clinical data were obtained.
Results: The accuracy of all DNNs with the single-spectral or multi-spectral combination images at the three wavelengths as input reached above 78%. The IS detection performance of DNNs with 605 nm spectral images as input was relatively more stable than with the other wavelengths. The multi-spectral combination models acquired a higher area under the curve (AUC) scores than the single-spectral models.
Conclusions: The probability of IS secondary to AF could be predicted based on multi-spectrum fundus images using deep learning, and combinations of multi-spectrum images improved the performance of DNNs. Acquiring different spectral fundus images is advantageous for the early prevention of cardiovascular and cerebrovascular diseases. The method in this study is a beneficial preliminary and initiative exploration for diseases that are difficult to predict the onset time such as IS.
1. Introduction
Cardiovascular diseases are the leading cause of mortality and disability worldwide, accounting for 32% of all death, and a major cause of rising healthcare costs (1). Of the cardiovascular diseases, atrial fibrillation (AF) is the most general type of cardiac arrhythmia. AF makes the rapid contractions of the heart weaker than normal contractions, resulting in a slower flow of blood in the atrium and further the formation of blood clots. When a clot leaves the heart, travels to the brain, and blocks blood flow through cerebral arteries, an ischemic stroke (IS) may occur (2). IS accounts for about 80% of stroke cases worldwide, while stroke have become a leading cause of morbidity and mortality worldwide (3).
AF is a major and independent risk factor for IS, making it a common and serious secondary disease of AF, and carries a fivefold increased risk of stroke (4). AF-related stroke cases are more severe than other types of stroke (5). Approximately 15%–30% of patients with AF are asymptomatic, and symptoms such as impaired functions may not be directly associated with the onset or recurrences of arrhythmia (6). Although the cause of approximately one-third of IS occurrences is unknown, silent paroxysmal AF is the most presumed etiology, especially in middle-aged healthy individuals, and it is predominantly the cause of IS rather than the trigger (7). It is reported that 61% of AF patients have IS within 1 year of their AF diagnoses, but only 13.6% received the most common warfarin therapy within 30 days of diagnosis (4). Therefore, the prevention of stroke secondary to AF can significantly reduce the rate of disability and mortality.
The general manifestations of the development of IS are blood vessel ischemia and hypoxia (8), as well as decreased vessel density and reduced oxygen metabolism in the retina (8–10). These eye-related symptoms are due to the anatomic and developmental characteristics of the eye, which is an extension of the central nervous system (CNS) (11, 12). These shared anatomical and physiological features make the eyes a good target for brain research. Since the vasculatures of the eye and the heart are exposed to the same intrinsic and environmental factors, various features in the retina may reflect the systemic health of the cardiovascular system as well as the associated risks (13, 14). Markers of cardiovascular diseases are also manifested in the eye, such as hypertensive retinopathy and cholesterol embolism (14). As a common cardiovascular disease, AF decreases cardiac output by 20%–30%. Blood supply is also reduced along the CNS, causing ischemia and hypoxia of the entire CNS including the retina (15, 16) and the reduced retinal blood flow (17). Hence, the fundus involved to blood oxygen and blood flow is an important window for studying AF and AF secondary IS.
Technological advancements have led to the non-invasive visualization of blood vessels and imaging of the fundus (14). However, there is a rich collection of capillaries in the fundus (13), and microvasculature and macrovasculature are mutually affected in an intertwined manner (18). Machine learning, especially deep learning, can help capture the subtle differences in image information to identify abnormalities. Deep learning has also been leveraged for a variety of classification and prediction tasks (19). For example, deep learning combined with retinal images has been studied in the diagnosis of cardiovascular conditions (20) and stroke (21). Further, taking into consideration, the retina responds differently to lights at different wavelengths since it contains the protein photopsin in modified conformations to enable activation by light at different wavelengths (22). Therefore, in the present study, three representative deep neural networks (DNNs), Inception V3 (23), ResNet50 (24), and SE50 (25), based on fundus images at different wavelengths, were used to predict the occurrence risk of IS secondary to AF.
2. Materials and methods
2.1. Participants
This prospective study was conducted in Beijing, with a total of 150 AF and 100 IS recruited participants. The inclusion criteria of AF participants were as follows: (1) Chinese Han population, (2) aged 45–85 years old, (3) diagnosed with AF, (4) without a history of IS or symptoms of dizziness and headache, and (5) with no stroke at least for 1 year after the occurrence of AF (information obtained from the subsequent follow-up). The exclusion criteria were as follows: (1) neuropsychiatric disorders, (2) ophthalmic diseases, especially fundus diseases, and other diseases obviously affecting the eyes, and (3) any other serious physical illnesses or injuries.
The inclusion criteria of IS participants included the following: (1) Chinese Han population, (2) aged 45–85 years old, and (3) diagnosed with IS with an unknown cause or with a history of the diagnosis of AF/symptoms of persistent palpitations and arrhythmia in the last year. The exclusion criteria included the following: (1) neuropsychiatric disorders and other neurological diseases; (2) ophthalmic diseases, especially fundus diseases, and other diseases obviously affecting the eyes; and (3) other serious physical illnesses or injuries.
Sociodemographic data, including age, years of education, and current body mass index (BMI), were collected. Clinical data, including a history of substance abuse and dependence, were obtained according to medical records and self-reports and confirmed by the next of kin and family members.
The present study was approved by the ethics committee of Beijing Yanhua Hospital and Beijing Xuanwu Hospital of Capital Medical University and performed in accordance with the Declaration of Helsinki, with obtained written informed consent.
2.2. Laboratory tests and statistical analysis
The BMI, systolic and diastolic blood pressure, and selected biochemical markers (high-density lipoprotein, low-density lipoprotein, aspartate aminotransferase, alanine aminotransferase, gamma-glutamyl transferase, triglyceride, total cholesterol, glucose, and uric acid) of the participants were recorded. These data were from the case notes and routine laboratory tests of the participants.
The normality of all variables was assessed using the Kolmogorov–Smirnov test. The high-density lipoprotein, low-density lipoprotein, aspartate transaminase, gamma-glutamyl transferase, triglyceride, cholesterol, and glucose were not normally distributed. Subsequently, the Mann–Whitney rank sum test, one-way analysis of variance, and chi-square analysis were used to compare differences of general demographic and clinical data between groups (Table 1). All statistical analyses were performed using the IBM SPSS Statistics software for Windows, Version 20.0 (IBM Corp., Armonk, NY, USA) with a significance level of 0.05 and a two-sided test.
2.3. Data set
The data set consisted of fundus images of the participants with AF and with IS at 548, 605, and 810 nm wavelengths obtained by the fundus multi-spectral imaging system (26, 27).
AF has a fivefold increased risk of stroke (4), and nearly 31% of the patients diagnosed with AF had secondary IS (28). However, approximately 30% of AF patients had no obvious symptoms, and AF is often diagnosed after IS had occurred, especially in middle-aged healthy people, so the patients with IS of unknown etiology are usually considered to have IS caused by asymptomatic paroxysmal AF (7). Consequently, the patients with IS in this study were considered as patients with IS secondary to AF. It has also been reported that some ocular symptoms of neuropsychiatric diseases occur up to 5 years before classical symptoms, and retinal pathological manifestations may precede symptoms of the brain (29). For instance, fundus vascular changes were reported several years before the onset of IS in chronic central diseases, while microvasculature and macrovasculature are affected in an intertwined manner (18). Therefore, it is assumed that the patients with IS have had microscopic pathological manifestations at least 1 year before stroke onset; however, these pathological symptoms cannot be observed by the naked eye, especially in the fundus blood vessels. Furthermore, 61% of the patients with AF were diagnosed with IS within 1 year (4). Therefore, in this study, the IS participants who reported a history of AF or complained of palpitations and arrhythmia were regarded as patients who would suffer from IS within 1 year after AF (defined as the IS group). Since it was difficult to follow up with AF patients about whether they developed IS due to the high dropout rate in outpatient follow-up, the little possibility to predict the exact time of stroke onset in patients with AF within 1 year, and the difficulty to contact patients after their stroke had occurred; consequently, it is a beneficial and advantageous preliminary exploration to regard the fundus images of IS participants who reported a history of AF or complained of palpitations and arrhythmia within the last year as the fundus images of patients who would suffer from IS within 1 year after AF. The AF participants in this study were defined as AF group.
2.4. Data preprocessing
The original fundus images were pre-processed according to the following process. First, each image was cropped along the fundus imaging area and normalized to the size of 512 × 512. Second, contrast limited adaptive histogram equalization (CLAHE) was utilized to enhance the content of each spectral fundus image. The illustrated examples of image pre-processed at different wavelengths are shown in Figure 1.
Figure 1. The examples of image pre-processed at different wavelengths. (A) The original fundus images. (B) The pre-processed fundus images.
2.5. Deep neural network
Three representative DNNs (Inception V3, ResNet50, SE50) were used to validate the detection performance of IS based on multi-spectral fundus images. Specifically, the single-spectral fundus images and the multi-spectral combinations of images at 548, 605, and 810 nm wavelengths were respectively taken as input images to train the models. For multi-spectral combinations, extra convolution kernels were used to extract the desired features. The output value of each mode can be interpreted as an approximate probability of IS occurrence, which ranges from 0 to 1. The decision threshold that predicts IS occurrence based on the model output value was set at 0.5. It took 100 epochs to finish the entire training phase. The training procedure utilized the Adam optimizer with a learning rate of 0.001, a cross-entropy loss function, and a minibatch size of 32.
2.6. Performance evaluation
The predictive performance of DNN models was assessed by the receiver operating characteristic (ROC) curves and the area under the curve (AUC) scores of the ROC. Furthermore, the performance was quantitatively evaluated by the accuracy (Acc), sensitivity (Sen), specificity (Spe), positive predictive value (PPV), negative predictive value (NPV), and F1 score. The evaluation metrics were defined as follows:
where TP, FP, TN, and FN represent “True Positive,” “False Positive,” “True Negative,” and “False Negative,” respectively.
In addition, we performed global average pooling on the convolutional feature maps before the final output layer (softmax) and used those as features for a fully-connected layer that produces the desired output. Subsequently, the attention map was obtained by projecting back the weights of the output layer onto the convolutional feature maps (30).
2.7. Hardware configuration
All DNNs were implemented in PyTorch and trained on an Ubuntu 16.04.12 LST system of x86_64 architecture. The experimental hardware equipment of this system consisted of the Intel Xeon 2.30 GHz CPU with 502 GB RAM and four NVIDIA TITAN RTX GPUs.
3. Results
3.1. Demographic characteristics
Table 1 shows the demographic and clinical characteristics of AF and IS patients, which showed consistent with the actual characteristics of the two diseases. All the participants had no history of substance abuse or dependence.
3.2. The performance of deep network models for predicting the incidence of AF secondary IS
The evaluation of the three DNN models for the prediction of IS incidence in AF patients are demonstrated in Table 2. The ROC curve is used to evaluate the performance of a binary diagnostic classification method, and its AUC determines the inherent ability of the model to discriminate between groups. Figure 2 shows the predictive performance using ROC curves of different DNNs with different spectral fundus images as input. From the AUC, the multi-spectral classification models had a better prediction performance, especially when all the three wavelengths were used for model training. The attention map could reflect the importance of the image regions. Figure 3 illustrates the heat map of attention, and the IS group had significantly more heat map areas than the AF group.
Figure 2. The ROC curves of DNNs using different spectral fundus images as input. (A) The ROC curves of Inception V3 with single or multi-spectral fundus images. (B) The ROC curves of ResNet50 with single or multi-spectral fundus images. (C) The ROC curves of SE50 with single or multi-spectral fundus images.
Figure 3. An example picture showing the attention heat map of ResNet50. The highlighted area is the attention distribution used by DNN for prediction. (A) The original 548 nm fundus image and its attention heat map of AF group (left) and IS group (right). (B) The original 605 nm fundus image and its attention heat map of AF group (left) and IS group (right). (C) The original 810 nm fundus image and its attention heat map of AF group (left) and IS group (right).
4. Discussion
This study demonstrated that the probability of secondary IS in AF patients could be predicted based on multi-spectrum fundus images using deep learning. The accuracy of all DNNs using the single-spectral images or multi-spectral combinations of 548, 605, or 810 nm wavelengths as input reached above 78%, which is better than the logistic regression method reported by Jung et al. (31). The IS detection performance of DNNs using the 605 nm spectral images as input was relatively more stable than using other spectral images. The multi-spectral combination models can acquire an AUC of 0.954, which is at least 0.41 higher than the single-spectral models, suggesting that acquiring different spectral fundus images is advantageous since they might show different pathological microscopic features.
A large portion of the central nervous system is dedicated to vision, and visual problems are prodromal symptoms of IS events, but the treatment for stroke-related vision loss remains limited (32). The non–image-forming or non-visual functions of photoreceptive systems are primarily dependent on melanopsin (33). Melanopsin is expressed by the intrinsically photosensitive retinal ganglion cells (ipRGCs), which are a part of retinal ganglion cells (33). The ipRGCs are the principal conduits for all light input to the non–image-forming visual responses and also receive input from the rod/cone photoreceptors (34), which means that the role of the ipRGCs in non-vision involves the whole photoreceptive system of the eye. The non–image-forming or non-visual responses of the ipRGCs to light include the alignment of the internal clock of the body to the environmental day/night cycle, such as the sleep–wake cycle regulation and the modulation of mood (34). Since the disturbance of sleep circadian has been identified as an independent risk factor for IS (35, 36), this suggests that IS probably related to light through the ipRGCs.
The light was transmitted to the ipRGCs, and they depolarize and project to the suprachiasmatic nucleus (SCN), which further radiates widely to other regions and coordinates the internal circadian synchronization. Disruptions to these biological rhythms can cause abnormal physical changes and diseases including cardiovascular and cerebrovascular diseases (37). For instance, disrupted circadian rhythms are linked to a higher risk of stroke. The disruption of circadian rhythms prior to ischemic events could lead to a prothrombotic state resulting in a heightened predisposition for enhanced stroke damage and poor outcome (38). A recent study reported that chronic circadian disruption increased infarct volume in mice with middle cerebral artery occlusion (39). In human studies, a rotating shift work disrupts circadian rhythms, which is associated with an increased risk of stroke in women with shift work (40). Also, insomnia exacerbates stroke outcomes, including visual impairment (41). Interestingly, it was found that post-stroke patients experienced improved cognitive function and sleep after the 24h naturalistic lighting rehabilitation units (42), certainly pointing to the non-visual effect of light. Post-stroke depression may be related to complex circuitries involving the cortical and subcortical regions (43), and sunlight therapy was reported to improve the mental health of post-stroke patients (42), which was consequently speculated to be related to the ipRGCs signals acting on other brain regions through SCN brain regions.
In the current study, several DNN models to predict the occurrence risk of secondary IS in AF patients based on multi-spectral fundus images all had a good performance, which might attribute to the pathological microscopic changes in the fundus caused by IS itself and its relationship with the circadian rhythm and mood (for example, by the ipRGCs), which are not recognized by the human eye. It is also reasonable to speculate that these long-term, latent, or hidden symptoms in stroke patients may be reflected in the microscopic changes of fundus morphology and then in different spectra. Meanwhile, studies on the relationship between AF, circadian rhythms, and mood are still in their infancy (44). AF is naturally linked to the eye through the vascular system. Some cardiovascular diseases have been found to be related to specific features of the retinal structure and microvessels, suggesting that microvessels and macrovessels are mutually affected in an interwoven manner in heart diseases (18). Consequently, it can be speculated that AF and IS may be presented with different pathological microscopic changes in the fundus.
In addition, the data from this study demonstrated that IS detection performance of DNNs using 605 nm spectral images as input was relatively more stable than using other spectral images, which might be associated with the characteristics of melanopsin or ipRGCs itself. Previously, longer-wavelength photons (∼590–620 nm, including 605 nm, as used in this study) were reported to increase the conductivity of light by triggering chromophore regeneration and increasing the overall intrinsic photosensitivity of the ipRGCs, while shorter-wavelength lights (∼480 nm) favors phototransduction but decreases the overall subsequent intrinsic photosensitivity of the ipRGCs. At intermediate wavelengths near 515 nm (close to 548 nm in this study), the two processes are in equilibrium, which might be embodied by the comfort of green light to the human eye. The orange light (589 nm, close to 605 nm of our study) was consequently demonstrated to activate greater brain activity in several regions of the frontal lobes, which are alertness and cognition, providing strong evidence in favor of a cognitive role for melanopsin (33). The occurrence of stroke-related cognitive impairment has been extensively investigated (45). Neuroanatomical lesions caused by IS on strategic areas such as the hippocampus and white matter might contribute to the pathogenesis of stroke-related cognitive impairment (46). While the 548 nm—and 605 nm—spectral images are often used to calculate blood oxygen saturation, including the fundus multi-spectral imaging system used in this study (26, 27). AF is associated with an increased risk of IS and with post-stroke dementia, which might make its related cognitive impairment common. Although AF without a stroke may also increase the risk for cognitive dysfunction, this is mostly linked to multi-infarct dementia (47). The 810 nm spectral light was mostly used in the low-level laser therapy of transcranial laser therapy as a suitable alternative treatment for stroke (48), and the low-level laser therapy could alter intracellular signaling and change redox states (48, 49). Therefore, in this study, subtle changes in the fundus images at different wavelengths that might not be observed by the human eye or not be presented by mathematical equation could be distinguished by machine learning. This also provides an explanation for the distinguishing of IS from AF by deep learning based on the multi-spectral fundus images. Furthermore, the current data revealed that the multi-spectral classification models had a greater AUC than the single-spectral classification models. Particularly, the best IS prediction performance was obtained when all the three wavelengths were used for model training. The encouraging outcome from the study suggests that biological imaging features of different wavelengths are advantageous to be integrated for IS prediction based on the excellent feature extraction capability of DNNs.
These conclusions can also be reflected in the heat map of attention shown in Figure 3, where the tracks of the attention area all follow the direction of blood vessels, and the IS group had significantly more heat map areas than the AF group. Although the model will inevitably allocate its attention to noisy or high-frequency areas (such as edges) due to the limitations of data volume and the impact of image noise, our model still exhibits different attention distributions in the IS and AF groups, supporting our conclusion. In Figures 3A,B, the trace of the heat map region is more obviously distributed along the blood vessels, which is consistent with the light characteristics of 548 and 605 nm spectral images and their use in the calculation of blood oxygen saturation (50). Figure 3C shows a divergent trend, which is consistent with the view that stroke may be a chronic inflammation of the global brain (51) and is similar to the reason why 810 nm light can be used to treat stroke with transcranial laser. Nevertheless, that has to be verified by more samples.
There are some limitations to this study. First, there was a difference between the age of participants in the AF and IS group, and the age of the AF group was older than that of the IS group, which might be seen as a confounder when interpreting the results. Second, a larger number of participants might further support the results of this study. Finally, although there are no validation sets in this study, as a prospective and exploratory study, it is considered to provide a new vision and thought for the research of chronic cardiovascular diseases such as AF. We will also continue to collect samples to further verify our conclusions.
5. Conclusion
The probability of secondary IS occurring in AF patients could be predicted based on multi-spectrum fundus images using deep learning, and combinations of multi-spectrum images improved the prediction performance of DNNs. Acquiring different spectral fundus images is advantageous since they might show different pathological microscopic features. Considering the convenience and non-invasiveness of measuring the eye, this will provide a new clue for the early prevention of cardiovascular and cerebrovascular diseases. More importantly, the method in this study is a beneficial preliminary and initiative exploration for diseases that are difficult to predict the onset time, such as IS.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.
Ethics statement
The studies involving human participants were reviewed and approved by the Ethics Committee of Beijing Yanhua Hospital and Beijing Xuanwu Hospital of Capital Medical University. The patients/participants provided their written informed consent to participate in this study.
Author contributions
Concept and design: HZ and QR. Drafting of the manuscript: HL. Analysis or interpretation of data: HL and MG. Acquisition of data: HS, XW, YC, GL, YL, and HZ. Supervision: HZ, QR, and ZX. Access to data and data analysis: HZ and QR had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by National Natural Science Foundation of China (61875123, 82061Y0031), Shenzhen Science and Technology Program (JCYJ20200109140603831, KQTD20180412181221912), National Biomedical Imaging Facility Grant and Shenzhen Nanshan Innovation and Business Development Grant.
Acknowledgments
The authors would like to thank all the participants for their willingness to participate in the study and the time that they devoted to the study. We thank the help of Fan Wang (Beijing Hui-Long-Guan Hospital) for the design of this study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The reviewer GL declared a shared affiliation with the authors HS and XW to the handling editor at the time of review.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Abbreviations
AF, atrial fibrillation; IS, ischemic stroke; BMI, body mass index; ANOVA, one-way analysis of variance; SD, standard deviation; ROC, receiver operating characteristic; AUC, area under the curve scores; SCN, suprachiasmatic nucleus; ipRGCs, intrinsically photosensitive retinal ganglion cells.
References
1. World Health Organization. Cardiovascular diseases (CVDs) fact sheet. https://www.who.int/en/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds) (accessed January 18, 2021).
2. Essa H, Hill AM, Lip GYH. Atrial fibrillation and stroke. Card Electrophysiol Clin. (2021) 13:243–55. doi: 10.1016/j.ccep.2020.11.003
3. Virani SS, Alonso A, Benjamin EJ, Bittencourt MS, Callaway CW, Carson AP, et al. Heart disease and stroke statistics—2020 update: a report from the American Heart Association. Circulation. (2020) 141:e139–596. doi: 10.1161/CIR.0000000000000757
4. Son MK, Lim NK, Kim HW, Park HY. Risk of ischemic stroke after atrial fibrillation diagnosis: a national sample cohort. PLoS One. (2017) 12:e0179687. doi: 10.1371/journal.pone.0179687
5. Sanders G.D., Lowenstern A., Borre E, Chatterjee R, Goode A, Sharan L, et al. Stroke prevention in patients with atrial fibrillation: a systematic review update. Rockville, MD: Agency for Healthcare Research and Quality (US) (2018). Comparative Effectiveness Reviews, No. 214.
6. Rienstra M, Lubitz SA, Mahida S, Magnani JW, Fontes JD, Sinner MF, et al. Symptoms and functional status of patients with atrial fibrillation: state of the art and future research opportunities. Circulation. (2012) 125:2933–43. doi: 10.1161/CIRCULATIONAHA.111.069450
7. Jaakkola J, Mustonen P, Kiviniemi T, Hartikainen JE, Palomaki A, Hartikainen P, et al. Stroke as the first manifestation of atrial fibrillation. PLoS One. (2016) 11:e0168010. doi: 10.1371/journal.pone.0168010
8. Ferdinand P, Roffe C. Hypoxia after stroke: a review of experimental and clinical evidence. Exp Transl Stroke Med. (2016) 8:9. doi: 10.1186/s13231-016-0023-0
9. Matei N, Leahy S, Auvazian S, Thomas B, Blair NP, Shahidi M. Relation of retinal oxygen measures to electrophysiology and survival indicators after permanent, incomplete ischemia in rats. Transl Stroke Res. (2020) 11:1273–86. doi: 10.1007/s12975-020-00799-9
10. Liu B, Hu Y, Ma G, Xiao Y, Zhang B, Liang Y, et al. Reduced retinal microvascular perfusion in patients with stroke detected by optical coherence tomography angiography. Front Aging Neurosci. (2021) 13:628336. doi: 10.3389/fnagi.2021.628336
11. Moss HE. Retinal vascular changes are a marker for cerebral vascular diseases. Curr Neurol Neurosci Rep. (2015) 15:40. doi: 10.1007/s11910-015-0561-1
12. Ptito M, Bleau M, Bouskila J. The retina: a window into the brain. Cells. (2021) 10(12):3269. doi: 10.3390/cells10123269
13. Flammer J, Konieczka K, Bruno RM, Virdis A, Flammer AJ, Taddei S. The eye and the heart. Eur Heart J. (2013) 34:1270–8. doi: 10.1093/eurheartj/eht023
14. Poplin R, Varadarajan AV, Blumer K, Liu Y, Mcconnell MV, Corrado GS, et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng. (2018) 2:158–64. doi: 10.1038/s41551-018-0195-0
15. Alpert JS, Petersen P, Godtfredsen J. Atrial fibrillation: natural history, complications, and management. Annu Rev Med. (1988) 39:41–52. doi: 10.1146/annurev.me.39.020188.000353
16. Post M, Goslawski W, Modrzejewska M, Wielusinski M, Kazmierczak J, Lubinski W. Electrophysiological function of the retina and optic nerve in patients with atrial fibrillation. Doc Ophthalmol. (2015) 131:53–62. doi: 10.1007/s10633-015-9498-6
17. Courtie E, Veenith T, Logan A, Denniston AK, Blanch RJ. Retinal blood flow in critical illness and systemic disease: a review. Ann Intensive Care. (2020) 10:152. doi: 10.1186/s13613-020-00768-3
18. Gupta K, Reddy S. Heart, eye, and artificial intelligence: a review. Cardiol Res. (2021) 12:132–9. doi: 10.14740/cr1179
19. Zheng Y, Guo Z, Zhang Y, Shang J, Yu L, Fu P, et al. Rapid triage for ischemic stroke: a machine learning-driven approach in the context of predictive, preventive and personalised medicine. EPMA J. (2022) 13:285–98. doi: 10.1007/s13167-022-00283-4
20. Chang J, Ko A, Park SM, Choi S, Kim K, Kim SM, et al. Association of cardiovascular mortality and deep learning-funduscopic atherosclerosis score derived from retinal fundus images. Am J Ophthalmol. (2020) 217:121–30. doi: 10.1016/j.ajo.2020.03.027
21. Qu Y, Zhuo Y, Lee J, Huang X, Yang Z, Yu H, et al. Ischemic and haemorrhagic stroke risk estimation using a machine-learning-based retinal image analysis. Front Neurol. (2022) 13:916966. doi: 10.3389/fneur.2022.916966
22. Ludwig Pe J.R, Czyz CN. Physiology, eye. In: Ludwig PE, Jessu R, Czyz CN, editors. Statpearls, Treasure Island, FL: StatPearls Publishing (2022). https://www.ncbi.nlm.nih.gov/books/NBK470322/
23. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)). IEEE; Las Vegas, NV, USA: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016). p. 2818–26.
24. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)). IEEE; Las Vegas, NV, USA: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016). p. 770–8.
25. Hu J, Shen L, Sun G. Squeeze-and-excitation networks. IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE; Salt Lake City, UT, USA: IEEE/CVF Conference on Computer Vision and Pattern Recognition (2018). p. 7132–41
26. Feng X, Jin Z, Zhou Z, Gao M, Jiang C, Hu Y, et al. Retinal oxygen kinetics imaging and analysis (ROKIA) based on the integration and fusion of structural-functional imaging. Biomed Opt Express. (2022) 13:5400–17. doi: 10.1364/BOE.465991
27. Feng X, Yu Y, Zou D, Jin Z, Zhou C, Liu G, et al. Functional imaging of human retina using integrated multispectral and laser speckle contrast imaging. J Biophotonics. (2022) 15:e202100285. doi: 10.1002/jbio.202100285
28. Hayden DT, Hannon N, Callaly E, Ni Chroinin D, Horgan G, Kyne L, et al. Rates and determinants of 5-year outcomes after atrial fibrillation-related stroke: a population study. Stroke. (2015) 46:3488–93. doi: 10.1161/STROKEAHA.115.011139
29. Salobrar-Garcia E, Mendez-Hernandez C, Hoz R, Ramirez AI, Lopez-Cuenca I, Fernandez-Albarral JA, et al. Ocular vascular changes in mild Alzheimer’s disease patients: foveal avascular zone, choroidal thickness, and ONH hemoglobin analysis. J Pers Med. (2020) 10(4):231. doi: 10.3390/jpm10040231
30. Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE; Salt Lake City, UT, USA: IEEE/CVF Conference on Computer Vision and Pattern Recognition (2018). p. 2921–9.
31. Jung S, Song MK, Lee E, Bae S, Kim YY, Lee D, et al. Predicting ischemic stroke in patients with atrial fibrillation using machine learning. Front Biosci. (2022) 27:80. doi: 10.31083/j.fbl2703080
32. Pula JH, Yuen CA. Eyes and stroke: the visual aspects of cerebrovascular disease. Stroke Vasc Neurol. (2017) 2:210–20. doi: 10.1136/svn-2017-000079
33. Chellappa SL, Ly JQ, Meyer C, Balteau E, Degueldre C, Luxen A, et al. Photic memory for executive brain responses. Proc Natl Acad Sci USA. (2014) 111:6087–91. doi: 10.1073/pnas.1320005111
34. Mure LS. Intrinsically photosensitive retinal ganglion cells of the human retina. Front Neurol. (2021) 12:636330. doi: 10.3389/fneur.2021.636330
35. Singer J, Gustafson D, Cummings C, Egelko A, Mlabasati J, Conigliaro A, et al. Independent ischemic stroke risk factors in older Americans: a systematic review. Aging. (2019) 11:3392–407. doi: 10.18632/aging.101987
36. Fodor DM, Marta MM, Perju-Dumbrava L. Implications of circadian rhythm in stroke occurrence: certainties and possibilities. Brain Sci. (2021) 11(7):865. doi: 10.3390/brainsci11070865
37. Castanon-Cervantes O, Wu M, Ehlen JC, Paul K, Gamble KL, Johnson RL, et al. Dysregulation of inflammatory responses by chronic circadian disruption. J Immunol. (2010) 185:5796–805. doi: 10.4049/jimmunol.1001026
38. Liu JA, Walton JC, Devries AC, Nelson RJ. Disruptions of circadian rhythms and thrombolytic therapy during ischemic stroke intervention. Front Neurosci. (2021) 15:675732. doi: 10.3389/fnins.2021.675732
39. Ramsey AM, Stowie A, Castanon-Cervantes O, Davidson AJ. Environmental circadian disruption increases stroke severity and dysregulates immune response. J Biol Rhythms. (2020) 35:368–76. doi: 10.1177/0748730420929450
40. Brown DL, Feskanich D, Sanchez BN, Rexrode KM, Schernhammer ES, Lisabeth LD. Rotating night shift work and the risk of ischemic stroke. Am J Epidemiol. (2009) 169:1370–7. doi: 10.1093/aje/kwp056
41. Khot SP, Morgenstern LB. Sleep and stroke. Stroke. (2019) 50:1612–7. doi: 10.1161/STROKEAHA.118.023553
42. Wang SJ, Chen MY. The effects of sunlight exposure therapy on the improvement of depression and quality of life in post-stroke patients: a RCT study. Heliyon. (2020) 6:e04379. doi: 10.1016/j.heliyon.2020.e04379
43. Wijeratne T, Sales C. Understanding why post-stroke depression may be the norm rather than the exception: the anatomical and neuroinflammatory correlates of post-stroke depression. J Clin Med. (2021) 10(8):1674. doi: 10.3390/jcm10081674
44. Fu Y, He W, Ma J, Wei B. Relationship between psychological factors and atrial fibrillation: a meta-analysis and systematic review. Medicine. (2020) 99:e19615. doi: 10.1097/MD.0000000000019615
45. De Souza MFD, Cardoso MGF, Vieira ELM, Rocha NP, Vieira T, Pessoa AE, et al. Clinical correlates of social cognition after an ischemic stroke: preliminary findings. Dement Neuropsychol. (2021) 15:223–9. doi: 10.1590/1980-57642021dn15-020010
46. Sun JH, Tan L, Yu JT. Post-stroke cognitive impairment: epidemiology, mechanisms and management. Ann Transl Med. (2014) 2:80. doi: 10.3978/j.issn.2305-5839.2014.08.05
47. Gross AF, Stern TA. The cognitive impact of atrial fibrillation. Prim Care Companion CNS Disord. (2013) 15(1):PCC.12f01471. doi: 10.4088/PCC.12f01471
48. Peplow PV. Neuroimmunomodulatory effects of transcranial laser therapy combined with intravenous tPA administration for acute cerebral ischemic injury. Neural Regen Res. (2015) 10:1186–90. doi: 10.4103/1673-5374.162687
49. Sharma SK, Kharkwal GB, Sajo M, Huang YY, De Taboada L, Mccarthy T, et al. Dose response effects of 810 nm laser light on mouse primary cortical neurons. Lasers Surg Med. (2011) 43:851–9. doi: 10.1002/lsm.21100
50. Hafen BB, Sharma S. Oxygen saturation. In: Hafen BB, Sharma S, editors. StatPearls. Treasure Island, FL: StatPearls Publishing LLC (2022). https://www.ncbi.nlm.nih.gov/books/NBK525974/
Keywords: ischemic stroke, atrial fibrillation, deep learning, fundus image, multi-spectrum
Citation: Li H, Gao M, Song H, Wu X, Li G, Cui Y, Li Y, Xie Z, Ren Q and Zhang H (2023) Predicting ischemic stroke risk from atrial fibrillation based on multi-spectral fundus images using deep learning. Front. Cardiovasc. Med. 10:1185890. doi: 10.3389/fcvm.2023.1185890
Received: 17 March 2023; Accepted: 5 June 2023;
Published: 1 August 2023.
Edited by:
Oliver Faust, Sheffield Hallam University, United KingdomReviewed by:
Guangzhi Liu, Beijing Anzhen Hospital, Capital Medical University, ChinaEmiliano Raúl Diez, CONICET Institute of Medicine and Experimental Biology of Cuyo (IMBECU), Argentina
© 2023 Li, Gao, Song, Wu, Li, Cui, Li, Xie, Ren and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Haitao Zhang ZHJfemhhbmdoYWl0YW9AMTI2LmNvbQ== Qiushi Ren cmVucXNoQGNvZS5wa3UuZWR1LmNu