- 1Department of Neurology, Jeonbuk National University Medical School and Hospital, Jeonju, South Korea
- 2Research Institute of Clinical Medicine of Jeonbuk National University, Jeonju, South Korea
- 3Biomedical Institute of Jeonbuk National University Hospital, Jeonju, South Korea
- 4Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, South Korea
- 5Neuroscience Center, Samsung Medical Center, Seoul, South Korea
- 6Cell and Gene Therapy Institute (CGTI), Research Institute for Future Medicine, Samsung Medical Center, Seoul, South Korea
- 7Alzheimer's Disease Convergence Research Center, Samsung Medical Center, Seoul, South Korea
Visuospatial dysfunction is a common symptom in patients with Alzheimer's disease (AD). To more focus on copying processes rather than on finally completed figures, we conceptually split the copying processes into three stages: visuoperceptual function, visuoconstructional function, and working memory function. We constructed perceptual and working spaces to investigate the different stages of copying, and then, we compared the number and duration of fixations and saccades and the number of switches across the two spaces. We used eye-tracking glasses to assess eye-tracking metrics in patients with early-onset AD (EOAD), patients with late-onset AD (LOAD), and normal control (NC) participants while they copied the simplified Rey–Osterrieth complex figure test (RCFT). Regarding eye metrics on the perceptual space, the number and duration of fixations were greater in both groups of patients with AD than in the NC participants group (number: EOAD vs. NC: p < 0.001, LOAD vs. NC: p = 0. 003/ duration: EOAD vs. NC: p < 0.001, LOAD vs. NC: p < 0.001). On the working space, the number and duration of fixations were greater in the patients with EOAD than in the patients with LOAD and NC participants (number: EOAD vs. LOAD: p = 0. 007, EOAD vs. NC: p = 0. 001/duration: EOAD vs. LOAD: p = 0. 008, EOAD vs. NC: p = 0. 002). The number of saccades and switching was higher in patients with EOAD than in NC participants (p < 0.001). The eye-tracking metrics from the simplified RCFT correlated with the neuropsychological test scores. Patients with EOAD and LOAD achieved the same level of performance at the simplified and original RCFT scores. However, patients with EOAD than LOAD showed a greater number and duration of fixations on the working space and more frequent switching between the perceptual and working spaces, which may reflect more cognitive efforts to achieve the same level of performance.
Introduction
Visuospatial function is the ability to identify, integrate, and analyze space and visual form of objects and their spatial relations (1). Visuospatial dysfunction is a common symptom in patients with Alzheimer's disease (AD). This could be especially true in early-onset AD (EOAD), in which non-memory issues, including visuospatial processing, can be compromised as much as memory (2). Nevertheless, only a few studies have compared patients with EOAD and late-onset AD (LOAD) in terms of their visuospatial. functioning (3–7), and their results are inconsistent. A study showed that greater visuospatial impairment in patients with EOAD compared to patients with LOAD (6). Other studies showed that patients with EOAD had lower visuoconstructional function compared to patients with LOAD (4, 7). This inconsistency might stem from the test difficulty and AD severity or might indicate that the conventional scoring methods of visuospatial tests cannot show detailed differences.
The Rey–Osterrieth complex figure test (RCFT) is commonly used to assess patients' visuospatial behavior in patients with AD (8). The conventional scoring system of RCFT focuses on the shape and positional accuracy of the final drawings. However, individuals' drawing processes used to complete the figure have not been investigated fully, especially in patients with EOAD vs. LOAD. Previous studies suggest that the successful copying of figures such as RCFT requires neural or cognitive processes that include elementary visual function, visuospatial perception, basic motor and visuomotor coordination, attention/executive function, working memory, and planning and organizational abilities (9). However, after excluding factors such as elementary sensory/motor function and visuomotor coordination, we can narrow these processes down to three components. Normally, when people draw a complex figure, they look first at the target figure to perceive and hold the visual information and then draw the picture in the allocated space, going back and forth to complete the drawing. Therefore, as has been proposed in the previous studies (10, 11), first we conceptually split the copying processes into two essential components. The first component is when individuals are looking closely at the sample figure, which reflects the visuoperceptual function. The second component is when drawing or constructing the figure that the subject has seen in the perceptual space, which reflects the visuoconstructional function. Then, we added another component (the third component), which is when individuals are holding the information of the sample figure on the visuospatial sketchpad (12), reflecting the working memory function. Earlier studies also underscored the importance of visual memory or working memory when participants copy target figures (13, 14).
We posited that evaluation of copying processes would be more sensitive in detecting visuospatial abnormalities in patients with AD than would the conventional visual rating of RCFT that only scores shape and position of the completed figures. We also postulated that eye-tracking measurement would be useful in assessing the copying processes. Several studies have shown that eye-tracking measurement could be helpful for evaluating visual cognition (15–18). Eye-tracking metrics such as fixation, saccade, and smooth pursuit correlated with Mini-Mental State Examination (MMSE) scores (17), standard visuospatial test scores (16), and cortical thickness (15). However, previous studies used simple tasks such as saccade–antisaccade tasks, which are different from clinical settings where patients copy a target figure on a paper using a pen. Therefore, we requested participants draw a simplified version of RCFT in an experimental setting similar to a conventional neuropsychological test setting and obtained eye metrics related to the three stages of visual processing (visuoperceptual, visuoconstructive, and working memory). We hypothesized that the eye-tracking measurement in assessing the copying processes could serve as surrogate markers that help to detect early stages of AD. Despite inconsistencies, most studies suggest that visuospatial or visuoconstructive functions are more impaired in patients with EOAD than those with LOAD. Therefore, we further tried to fractionate drawing impairments by looking at whether patients with EOAD and LOAD differed in terms of the visuoperceptual, visuoconstructive, and working memory aspects of drawing.
Materials and Methods
Participant Recruitment
Participants were selected from those who visited the Memory Disorder Clinic at Samsung Medical Center in Seoul, Korea, between 1 June 2017 and 30 September 2018. This study group contained 19 EOAD, 19 LOAD, and 16 normal control (NC) participants. All patients with AD fulfilled the probable AD criteria proposed by the National Institute of Neurological and Communicative Disorders and Stroke and by the Alzheimer's Disease and Related Disorders Association (NINCDS-ADRDA) (19) and had MMSE score ≥ 10 and CDR ranging from 1 to 2 and therefore were diagnosed with mild to moderate AD. None of the patients with AD fulfilled the criteria for posterior cortical atrophy (PCA) (20, 21) or logopenic variant of primary progressive aphasia (22). Patients were divided into EOAD and LOAD groups based on the age of onset determined through an in-depth interview. Age of onset was defined as the first cognitive symptom based on an interview with close caregivers who saw the patient at least one time a week (23). We interviewed the caregiver about the first symptom of cognitive decline using the method proposed in the previous study (24). Patients with EOAD were defined as those whose first symptoms occurred between the ages of 45 and 65 years (25, 26). Patients with LOAD were defined as those whose first symptoms occurred after the age of 65 years (27). The NC participants were age-matched healthy controls aged 54–65 years, their scores on the neuropsychological battery were within one standard deviation of those of the age- and education-matched mean, and their MMSE score was 25 or higher (Table 1).
We consecutively recruited participants who satisfied the following criteria: (i) normal or corrected-to-normal visual acuity, (ii) more than 6 years of education, (iii) completion of a standardized neuropsychological battery: the Seoul Neuropsychological Screening Battery (SNSB) (31, 32), the Mini-Mental State Examination (MMSE) test (33), and (iv) magnetic resonance imaging (MRI). Participants were evaluated via extensive diagnostic procedures, including detailed clinical interviews and neuropsychological testing, blood tests, imaging (MRI and positron emission tomography [PET] scans), and a clinical consensus of neurologists, neuropsychologists, and radiologists. We excluded participants with diseases that could affect cognitive function. Individuals with moderate or severe vision loss (visual acuity <0.3) or a very low MMSE score (lower cutoff at 10) or an education level lower than the 6th grade were excluded from this study. All experimental procedures were performed in compliance with the protocols approved by the Institutional Review Board of Samsung Medical Center, and written informed consent was obtained from all the participants.
Neuropsychological Assessments
All participants underwent a standardized neuropsychological battery called the SNSB (31, 32), which consists of the following tests. Attention and working memory were assessed with the forward and backward digit span tests (34); language was tested using the Korean version of the Boston naming test (K-BNT) (35); calculation was tested with three items each for addition, subtraction, multiplication, and division; visuospatial function was assessed with the Rey–Osterrieth complex figure test (RCFT) (8); memory function was assessed using immediate and delayed recall of the Seoul Verbal Learning Test (SVLT) (36) and RCFT; and frontal-executive function was tested with the phonemic and semantic Controlled Oral Word Association Test (COWAT) (37) and the Stroop word/color reading test (38). Participants also were tested with the MMSE, Clinical Dementia Rating (CDR) and CDR sum of box, and Geriatric Depression Scale (GDS) for assessing general cognition and depression.
Experimental Apparatus
We used SMI Eye-Tracking Glasses 2 Wireless (SMI ETG 2w, SensoMotoric Instruments, Germany), which record binocular eye movements at a 120 Hz sampling rate and a 1,280 x 960 pixel resolution scene camera. The eye tracker has a reported gaze estimation accuracy of 0.5° and precision of 0.1°. The experimental equipment to measure the figure-copying performance consisted of a digital tablet (size = 12 inches, resolution = 2,160 x 1,440, Samsung Galaxy Book 12, Samsung Electronics, Suwon, Korea) and a digital pen (nib diameter = 0.7 mm, pressure = 4,096, S-pen, Samsung Electronics, Suwon, Republic of Korea).
Experimental Design
Calibration
Participants were instructed to wear the eye-tracking glasses and look at a static calibration point in the middle of the tablet for 5 s. While the participant was looking at the point, the experimenter adjusted the participant's focus to the center of the tablet using the recording computer. After calibration, points appeared at several random positions on the tablet for 1 s each, and we tested whether the participant's gaze followed them well. The experiment was started when the participants performed the procedure well; otherwise, calibration was repeated whenever necessary.
Simplified RCFT Copying
In previous research, we modified the original RCFT into a simpler version and validated our simplified RCFT against the original RCFT (39). Our simplified RCFT comprises 4 global (large rectangle and diagonal, horizontal, and vertical crosses) and 4 local (a square, double circles, three triangles, and four arrows) components (Figure 1A). We scored our simplified RCFT in terms of both accuracy and placement, and our scoring complied with the Meyers and Meyers' standardized scoring of the original RCFT. Raw scores ranged from 0.0 to 16.0.
Figure 1. Drawing from the simplified RCFT and an illustration of eye-tracking metrics. (A) Modified figure from previous publication (39). The simplified RCFT was shown on a tablet computer (size = 12 in, resolution = 2,160 x 1,440, Samsung Galaxy Book 12, Samsung Electronics, Suwon, Korea) with a screen width of 162 mm and a screen height of 258 mm. The upper half was defined as the “perceptual space,” and the lower half was defined as the “working space.” The simplified Rey figure presented in the perceptual space was 152 mm in width and 95 mm in height. The left, right, and upper margins were 30 mm. The blue text, markers, and background colors were not presented to the participants. (B) An illustration of the eye movements made by a normal individual while drawing the simplified RCFT for 15 s. We measured three indices from the eye movements: (1) fixations, (2) saccades, and (3) switches between the two AOIs. The purple circles indicate fixations, and the size of each circle indicates the duration of the fixation. The purple lines connecting the fixations indicate saccades. The red lines across the blue perceptual space and red working space indicate switches between the two spaces. AOI, area of interest; RCFT, Rey–Osterrieth complex figure test.
The participants in this study performed the simplified RCFT while wearing the eye-tracking glasses. We defined the upper half of the portrait-oriented screen as the “perceptual space” and the lower half as the “working space” (Figure 1A). The sample figure of the simplified RCFT was presented in the perceptual space. We postulated that fixations or saccades in perceptual space may reflect a visuoperceptual component; fixations or saccades in working space may reflect a visuoconstructional component; switches (saccades) between the two spaces may reflect a working memory component.
Prior to the task, the experimenter delivered the following instructions: “A sample figure will appear in the upper half of this tablet when the task starts. Please copy the figure with this pen. Try to use the empty area below as much as possible. This pen does not have an eraser. You cannot change your drawing. If you make a mistake, forget about it and keep going with the rest. Take your time, and let me know when you are done.” The completion time of this simplified RCFT was defined as the time interval from the moment immediately after the oral instruction was given to the moment when the participant announced that they had completed the drawing.
The pen the participants used was a digital pen for pen trajectory data acquisition. The digital pen data from a subset of the individuals who participated in this study were previously published elsewhere (39).
Measurement of Eye-Tracking Metrics
We used SMI BeGaze version 3.4 analysis software to map gaze data from the scene videos, which is called semantic gaze mapping, and to quantify multiple participant data (40). As illustrated in Figure 1B, we measured three metrics from participants' eye movements for the two areas of interest (AOIs), the perceptual space and the working space: (1) number and duration of fixations in the perceptual and working spaces, (2) number and duration of saccades in the perceptual and working spaces, and (3) switches between the perceptual space and the working space.
1. Number and duration of fixations: Fixations were defined as groups of consecutive points within a particular dispersion. The minimum fixation duration was 80 ms and the maximum dispersion value was 100px (41). We measured the number and average duration of fixations on the two AOIs. We also calculated the ratio of the number and duration of fixations between the two AOIs (working space/perceptual space).
2. Number and duration of saccades: Saccades were defined as fast eye movements that occurred when participants shifted their gaze from one target to the other. A peak is defined as the peak value of velocities above the peak threshold of 40°/s. The peak could indicate a saccade if the distance between the start and end exceeds the minimum saccade duration of 22 ms and the single peak value lies in the range of 20–80% of the distance between the start and end (41). We measured the number and average duration of saccades.
3. Switching between two AOIs: Switches were defined as saccades made from one AOI to the other. We measured the number of switches between the two AOIs.
Statistical Analysis
To validate the simplified Rey figures, we used the Pearson correlation to compare conventional RCFT scores with those of the simplified RCFT. To determine consistency among raters, we calculated an intraclass correlation coefficient (ICC). A two-way random-effect model based on single rating and absolute agreement assessed the inter-rater repeatability. We used the Kolmogorov–Smirnov test to verify the normality of the demographics, cognitive profile data, and eye-tracking metrics. We used the Kruskal–Wallis (KW) test to examine statistical differences between groups at a significance level of p = 0.05 because the variables did not follow a normal distribution. We performed post hoc comparisons using Dunn's pairwise tests. We used the chi-square test or Fisher's exact test for categorical variables followed by Bonferroni post hoc analysis. To test whether the eye-tracking metrics correlated with age or education, we used Pearson's correlation. We performed multiple linear regression to provide a way of adjusting for the completion time. To test correlations between the eye-tracking metrics and neuropsychological test scores in combined EOAD and LOAD groups, we used Pearson's correlation. We performed all statistical analyses using SPSS version 24.0 for Windows.
Results
Clinical Information and Cognitive Profiles
This study group comprised 19 patients with EOAD, 19 patients with LOAD, and 16 NCs. Among them, 18 of 19 EOAD, 7 of 19 LOAD, and 4 of 16 NC underwent either florbetaben (19/29) or flutemetamol (10/29) amyloid PET. Amyloid PET positivity was interpreted according to the guidelines of each PET ligand (20, 29). All patients with AD tested positive, and all NC participants tested negative in their amyloid scans. Age (p < 0.001) and education (p = 0. 012) differed among the EOAD, LOAD, and NC participants. Patients with EOAD and LOAD showed the poorer performance in attention, language function, visuospatial function, memory, and frontal/executive function testing than the NC participants. There were no significant differences between EOAD and LOAD in dementia severity and level of depression. The prevalence of APOE4 carriers among the NC participants (0%, 0/12) was significantly lower than that among the patients with EOAD (66.7%, 12/18) and LOAD (42.1%, 8/19) (Table 1).
Validity and Inter-rater Reliability of the Simplified Rey–Osterrieth Complex Figure Test
The copying results from the simplified RCFT were scored separately by three raters (two neuropsychologists and one neurologist). The ICC for inter-rater reliability was excellent, 0.99 (95% CI: 97–0.99, p <0.001). All participants completed both simplified and original RCFTs. The average scores (mean ± standard deviation) of the three raters on the simplified and original RCFT scores were 9.4 ± 4.7 and 20.0 ± 12.4 in patients with EOAD, 10.4 ± 5.2 and 21.8 ± 13.2 in patients with LOAD, and 14.6 ± 1.1 and 34.2 ± 1.7 in NC participants, respectively. The groups differed significantly (Kruskal–Wallis test, p < 0.001), and the post hoc test showed that the visual rating scores in both the simplified and original RCFT were lower in both groups of patients with AD than among the NC participants (Dunn's pairwise tests, EOAD vs. NC: p < 0.001 and p <0.001, LOAD vs. NC: p = 0. 002 and p < 0.001,). However, the performances of the patients with EOAD and LOAD did not differ from each other. There was a linear relationship between the average scores of the three raters on the simplified RCFT and original RCFT scores (r = 0.792; p < 0.001).
Eye-Tracking Metrics
Before analyzing the eye-tracking data, we reviewed it carefully and excluded the data that were not appropriate. A number of four participants were excluded because of program input error. A number of one participant was excluded because of visual disturbance. Therefore, the eye-tracking metrics were analyzed from a total of 17 patients with EOAD, 16 patients with LOAD, and 16 NC participants. None of the eye-tracking metrics showed any significant correlation with age or education. After data collection and gaze mapping were completed, graphical representations of the eye movements over the scene were developed for further analysis. The eye-gaze patterns of all participants were mapped onto three information-format images. Table 2 shows the statistical analysis results for the eye-tracking metrics and the completion times. Patients with EOAD and LOAD showed longer completion time than the NC participants, but there was no significant difference between the EOAD and LOAD groups (Table 2).
Number and Duration of Fixations
There was an overall trend observed that the patients with EOAD showed a greater number and duration of fixations compared with the patients with LOAD. The patients with LOAD showed a similar trend compared with NC participants. However, statistical analyses only showed that the total number of fixations was higher in the patients with EOAD than among the NC participants (Dunn's pairwise tests, p < 0.001,). Patients with EOAD and LOAD did not differ in terms of total fixation number. The total fixations duration was longer in both patient with AD groups than among the NC participants (Dunn's pairwise tests, EOAD vs. NC: p < 0.001, LOAD vs. NC: p = 0.043).
The median total number of fixations was 282 in patients with EOAD, 182 in patients with LOAD, and 118 in NC participants (Figure 2A). The number of fixations on the perceptual AOI was higher in the AD groups than in the NC group (Dunn's pairwise tests, EOAD vs. NC: p < 0.001, LOAD vs. NC: p = 0. 003) (Figure 2B). The number of fixations on the working AOI was higher in the patients with EOAD than in the patients with LOAD and NC participants (Dunn's pairwise tests, EOAD vs. LOAD: p = 0. 007, EOAD vs. NC: p = 0. 001) (Figure 2C). The ratio of the number of fixations between the two AOIs (working space/perceptual space) was lower in the patients with AD than in the NC participants (Dunn's pairwise tests, EOAD vs. NC: p = 0. 005, LOAD vs. NC: p = 0. 002) (Figure 2D).
Figure 2. The number of fixations. (A) Patients with EOAD showed more frequent fixations than NC participants. (B) Patients with EOAD and LOAD showed more frequent fixations on the perceptual space AOI than the NC participants. (C) Patients with EOAD showed more frequent fixations on the working space AOI than the LOAD and NC participants. (D) Patients with EOAD and LOAD showed a higher ratio (working/perceptual space) of fixations on the AOIs than the NC participants. AOI, area of interest; EOAD, early-onset Alzheimer's disease; LOAD, late-onset Alzheimer's disease; NC, normal control. *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001.
The median total fixation duration was 105 s in patients with EOAD, 60 s in patients with LOAD, and 41 s in NC participants (Figure 3A). The fixation duration on the perceptual space AOI was longer among patients with AD than NC participants (Dunn's pairwise tests, EOAD vs. NC: p < 0.001, LOAD vs. NC: p < 0.001) (Figure 3B). The fixation duration on the working space AOI was longer among patients with EOAD than patients with LOAD and NC participants (Dunn's pairwise tests, EOAD vs. LOAD: p = 0. 008, EOAD vs. NC: p = 0. 002) (Figure 3C). The ratio of the fixation duration between the two AOIs (working space/perceptual space) was lower in both AD groups than in the NC group (Dunn's pairwise tests, EOAD vs. NC: p = 0. 001, LOAD vs. NC: p < 0.001) (Figure 3D).
Figure 3. The fixation duration. (A) The total fixations duration was longer in both patient groups with AD than among the NC participants. (B) Patients with EOAD and LOAD showed longer fixation durations on the perceptual space AOI than NC participants. (C) Patients with EOAD showed longer fixation durations on the working space AOI than LOAD and NC participants. (D) Patients with EOAD and LOAD showed a lower ratio (working/perceptual space) of fixation durations on the AOIs than NC participants. AOI, area of interest; EOAD, early-onset Alzheimer's disease; LOAD, late-onset Alzheimer's disease; NC, normal control. *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001.
Multiple linear regression analyses with completion time (Table 2) as a covariate showed that after adjusting for completion time, only the ratio of number (working/perceptual AOI) (p < 0.001) and the ratio of duration (working/perceptual AOI) (p < 0.001) measurements were associated with both AD vs. NC group differences. Multiple linear regression analyses with completion time (Table 2) as a covariate showed that number (p = 0. 026) and duration (p = 0. 008) of fixations on the working AOI were associated with EOAD vs. LOAD group differences.
Number and Duration of Saccades
The median number of saccades was 267 in the EOAD group, 169 in the LOAD group, and 105 in the NC group, and those differences were significant (KW test, p < 0.001). The number of saccades was higher in patients with EOAD than in NC participants (Dunn's pairwise tests, p < 0.001, EOAD vs. NC) (Figure 4A). The median total duration of saccades was 4.34 s in EOAD, 3.99 s in LOAD, and 4.32 s in NC participants, and those differences among groups were not significant (KW test, p = 0.587).
Figure 4. Results for saccades and switching. (A) Patients with EOAD showed more frequent saccades than NC participants. (B) Patients with EOAD showed more frequent switching than patients with LOAD and NC participants did. EOAD, early-onset Alzheimer's disease; LOAD, late-onset Alzheimer's disease; NC, normal control. *p < 0.05, **p < 0.01, ***p < 0.001, ****p < 0.0001.
Switches Between the Two AOIs
The median number of switches was 80 in patients with EOAD, 50 in patients with LOAD, and 36 in NC participants, which was a significant difference among groups (KW test, p < 0.001). The number of switches was higher in the EOAD group than in the LOAD and NC groups (Dunn's pairwise tests, EOAD vs. LOAD: p = 0. 049, EOAD vs. NC: p < 0.001) (Figure 4B).
Correlation Between the Eye-Tracking Metrics and the Scores of Neuropsychological Tests
We compared the eye-tracking metrics with the scores of neuropsychological tests after data from EOAD and LOAD individuals were combined (Table 3).
Table 3. The correlation coefficient between eye-tracking metrics and neuropsychological test scores in the combined EOAD and LOAD groups.
The total number of fixations correlated negatively with calculation, RCFT copying, COWAT phonemic, and Stroop test scores. The number of fixations on the perceptual AOI also correlated negatively with calculation, RCFT copying, and Stroop test scores. The number of fixations on the working AOI negatively correlated with digit span backward and calculation scores. The ratio of the number of fixations between the two AOIs (working space/perceptual space) correlated positively with calculation, RCFT copying, RCFT recognition, COWAT animal and supermarket, and Stroop test scores.
The total fixations duration correlated negatively with calculation, RCFT copying, COWAT phonemic, and Stroop test scores. The fixation duration on the perceptual AOI correlated negatively with calculation, RCFT copying, and Stroop test scores. The number of fixations on the working AOI did not correlate with any of the scores. The ratio of the fixation duration between the two AOIs (working space/perceptual space) correlated positively with calculation, RCFT copying, COWAT (animal/supermarket /phonemic), and Stroop test scores.
The number of saccades correlated negatively with calculation, RCFT copying, COWAT (supermarket /phonemic), and Stroop test scores. The duration of saccades did not correlate with any of the scores. The number of switches correlated negatively with calculation.
Discussion
In this study, we used eye-tracking glasses to assess eye-tracking metrics in patients with EOAD, patients with LOAD, and NC participants while they copied the simplified RCFT, which was created and validated in our previous study (39). We constructed perceptual and working AOIs to investigate the different stages of copying, and then, we compared the number and duration of fixations and saccades, and number of switches across the two AOIs, between the two patient groups with AD and the NC participants. In summary, the total number and duration of fixations showed an overall trend to decrease in the order of EOAD, LOAD, and NC participants. Statistical analyses showed that the total number of fixations was greater in the patients with EOAD than the NC participants; the total fixation duration of both patient groups with AD was longer in than that of the NC participants. On the perceptual AOI, the number and duration of fixations were greater in both patient groups with AD than in the NC participants. On the working AOI, the number and duration of fixations were greater in the patients with EOAD than in the patients with LOAD and NC participants. The number of saccades was greater in patients with EOAD than in NC participants. The number of switches was greater in the EOAD group than in the patients with LOAD and NC participants. The eye-tracking metrics from the simplified RCFT correlated with the neuropsychological test scores.
Several studies have shown that eye-tracking measurements could be useful in evaluating visual cognition (15–18). However, previous studies used simple targets, such as a cross or a circle, and asked participants to look at static (fixation) or moving (pursuit) targets or engage in saccade–antisaccade tasks, which might be insufficient for evaluating complex visuospatial and visuoconstructional functioning (15, 16, 18). In contrast, we created an experimental setting almost identical to a conventional neuropsychological test setting in which participants copy a complex figure. The only difference between our experimental setting and the standard neuropsychological test setting was that participants wore an eye tracker. We even used a lightweight (47 g) glasses-type eye tracker that did not restrict head movement or eye blinking to closely simulate a natural copying process.
Furthermore, we divided the copying process into three stages: looking closely at the sample figure to reflect visuoperceptual function; holding the information about the sample figure in the visuospatial sketchpad (12) to reflect working memory function, and drawing or constructing the figure seen in the perceptual space to reflect visuoconstructional function. Previous studies also employed the decomposition of copying processes into input (visuoperception) and output components that were labeled under different names such as visuoconstruction or graphic production (10, 11). Other studies highlighted aspects of working memory when drawing complex figures (13, 14). For instance, the closing-in phenomenon, a common behavior seen in patients with AD, might be a typical example that can be explained by a working memory hypothesis (42, 43). Briefly, patients with AD were requested to draw figures or lines that varied in the complexity and showed that the more complex the target figures were, the nearer the patients drew toward the target, which can be compensatory strategies to overcome visuospatial working memory deficits (42, 43).
Overall, there was a trend that our patients with AD showed a greater number and duration of fixations compared with NC participants, when the results on the perceptual and working AOIs were combined. The patients with AD also showed a longer fixation duration and greater number of fixations on the perceptual AOI than the NC participants. Multiple linear regression analyses adjusting for completion time further supported our results such that the ratio of number (working/perceptual AOI) and the ratio of duration (working/perceptual AOI) measurements were associated with both AD vs. NC group differences. Fixations are stationary points for the eyes and represent a visual intake of information. Therefore, an increased number of fixations and fixation duration on the perceptual AOI indicate an increase in target processing times. We also found that the number and duration of fixations on perceptual AOI showed a moderate to strong negative correlation with calculation, RCFT copying, and Stroop test scores. These results support that increased number and duration of fixations on perceptual AOI can represent impairment in frontoparietal function. Consistent with our results, previous studies have demonstrated that patients with AD show abnormal eye-tracking metrics, including fixations, during simple tasks (17, 44, 45). While visually searching for a target in a distracting environment, patients with AD had a notably greater number of fixations and longer fixation duration than the NC participants (44, 45). On the other hand, when NC participants and patients with AD are asked only to look at a target picture without the pressure of remembering or copying the figure, the fixation metric results vary from study to study (46). Therefore, taking previous studies and our study together, the results indicated that a greater number and duration of fixations on perceptual AOI are required while visually encoding complex figures, a neurobehavior that might be related to visuoperceptual dysfunctions in patients with AD. Regarding the mechanism of longer fixations in our patients with AD compared to controls, we simply attributed it to the assumption that patients with AD spend more time encoding the visual information. However, we cannot exclude the possibility that patients with AD with parietal and frontal injuries lost their inhibitory control for salient stimuli; therefore, once they fixate their gaze on certain stimuli, they may have difficulty disengaging from those stimuli, resulting in longer fixations.
Unlike the fixations on the perceptual AOI, where the two AD groups were comparable, the EOAD group showed a greater number of fixations and longer fixation duration on the working AOI compared with the patients with LOAD. Multiple linear regression after adjusting for the completion time of drawing also supported the EOAD vs. LOAD group difference in terms of number and duration of fixations on the working AOI. These results suggest that patients with EOAD are more impaired in their visuoconstructional functioning, as assessed by number of fixations and fixation duration on the working AOI, than patients with LOAD because the two patient groups with AD had the same level of visuoperceptual deficits as assessed by number of fixations and duration on the perceptual AOI. Our results support a previous study that showed severe visuoconstructional dysfunction in the patients with EOAD than LOAD, whereas visuospatial functioning, probably visuoperceptual functioning, did not differ significantly between them (7). Why patients with EOAD have more severe visuoconstructional dysfunction (as assessed by the number of fixations and fixation duration on the working AOI) than patients with LOAD remains unclear. However, visuoconstructional tasks require strategies for planning, structuring, and coordination. Therefore, we speculate that the executive functions that are responsible for those strategies were more impaired in patients with EOAD than in LOAD (7). Alternative account might be that it has been known that frontal involvement is more severe in patients with EOAD than LOAD (47) when they have reached the same level of disease severity, therefore, motor perseveration of hand and eye movements associated with frontal injury might have contributed to the longer fixations in the working space.
Patients with EOAD, not LOAD, showed more frequent saccades than NC participants. Saccades are rapid eye movements that occur between fixations. Various saccadic dysfunctions have been reported in patients with AD (46), but previous studies have focused on the performance of antisaccade tasks in a restricted experimental design (18). In contrast, our participants were not asked to perform pro- or antisaccade tasks; they were instead exposed to an everyday experimental setting of drawing a picture. According to the Posner paradigm, visual attention is divided into three steps: disengagement of current focus, which is known to be associated with the frontoparietal network; movement to the selected target; and engagement with the selected target, which is also known to be associated with the frontoparietal network (48). The frontoparietal network is thus a partly overlapping circuit for both the disengagement and engagement steps. However, the disengagement step is more associated with the dorsal frontoparietal network (including the frontal eye field, the superior parietal lobule, and the intraparietal sulcus), and the engagement step is more associated with the ventral frontoparietal network (including the frontal eye field, the middle and inferior frontal gyri, and the temporoparietal junction). It is well known that temporoparietal atrophy is a marker of AD pathology, and FDG-PET (47) and MRI studies (49, 50) have shown that patients with EOAD have more parietal injury than patients with LOAD. The posterior parietal cortex is essential in controlling both eye movements and attention (51). Therefore, patients with AD, especially patients with EOAD, might have shown more frequent saccades as a result of bilateral parietal dysfunction.
Patients with EOAD also switched between the two AOIs more frequently than the patients with LOAD and NC participants. Switches are saccades between the perceptual space (blue rectangle) and the working space (red rectangle) (Figure 1B). More frequent switching between the two figures could indicate that patients with EOAD have more severe working memory deficits than patients with LOAD and NC participants. To copy a figure, one has to remember the target figure (working memory) from the perceptual AOI for a while, but if the working memory is impaired, the participant would need to study the figure repeatedly.
The strengths of our study are that, to our knowledge, this is the first paper to separately investigate eye-tracking behaviors in perceptual and working spaces while participants draw a complex figure in a user-friendly environment or natural drawing setting that could happen in daily life. Second, we assessed not only the final copying score of each completed figure but also subjects' eye behaviors during the process of drawing. Among eye-tracking metrics, number and duration of fixations on the perceptual space AOI discriminated patients with EOAD or LOAD from NC participants. These eye-tracking metrics might be more sensitive than the final copying scores in detecting early signs of AD. Moreover, increased number and duration of fixations on the working space AOI and number of switches can help to distinguish patients with EOAD from LOAD. Patients with EOAD and LOAD achieved comparable levels of performance with simplified RCFT and original RCFT scores. However, Patients with EOAD showed greater number and duration of fixations on the working space AOI and more frequent switching between AOIs, which might reflect more mental efforts to achieve the similar level of performance. In that way, our study broadens the understanding of the visuoperceptual and visuoconstructional impairment patterns of patients with EOAD and LOAD. However, our study also has the limitation that although RCFT performances involve multiple domains of cognitive and neural processes from basic motor and visual functions to visuomotor coordination and attention/executive function in addition to higher levels of visuospatial function, we simplified this complicated process into three components. To minimize the effect of basic visual and motor functions, we excluded participants with visual and motor problems from this study. Nevertheless, the effects of factors we did not address in this study should be investigated in the future studies. Also, our data did not support our hypothesis that patients with EOAD and LOAD would differ in terms of total number and duration of fixation and number of saccade, which might be due to the relatively small sample size. Therefore, future standardization studies with a large number of healthy participants are warranted. In addition, we need to compare eye-tracking metrics during the copying process in patients with a different disease severity and between amyloid positive and negative patients.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by Institutional Review Board of Samsung Medical Center. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
DN, JChi, and BL contributed to conception and design of the study. KK performed the statistical analysis and wrote the first draft of the manuscript. JCho organized the database and wrote sections of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.
Funding
This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) NRF 2020R1G1A1102644, the National Research Council of Science and Technology (NST) grant by the Korea government (MSIP) (No. CRC15 04 KIST), and the Fund of Biomedical Research Institute, Jeonbuk National University Hospital.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Abbreviations
AD, Alzheimer's disease; AOIs, Areas of interest; CDR, Clinical Dementia Rating; COWAT, Controlled Oral Word Association Test; EOAD, Early-onset Alzheimer's disease; K-BNT, Korean version of the Boston naming test; LOAD, Late-onset Alzheimer's disease; MMSE, Mini-Mental State Examination; MRI, Magnetic resonance imaging; NC, Normal control; RCFT, Rey–Osterrieth complex figure test; SNSB, Seoul Neuropsychological Screening Battery; SVLT, Seoul Verbal Learning Test.
References
1. Dickerson BC, Atri A. Dementia: Comprehensive Principles and Practice. Oxford: Oxford University Press 2014. p. 705.
2. Mendez MF. Early-onset Alzheimer's disease: nonamnestic subtypes and type 2 AD. Arch Med Res. (2012) 43:677–85. doi: 10.1016/j.arcmed.2012.11.009
3. Fujimori M, Imamura T, Yamashita H, Hirono N, Ikejiri Y, Shimomura T, et al. Age at onset and visuocognitive disturbances in Alzheimer disease. Alzheimer Dis Assoc Disord. (1998) 12:163–6. doi: 10.1097/00002093-199809000-00007
4. Frisoni GB, Pievani M, Testa C, Sabattoli F, Bresciani L, Bonetti M, et al. The topography of grey matter involvement in early and late onset Alzheimer's disease. Brain. (2007) 130:720–30. doi: 10.1093/brain/awl377
5. Koedam EL, Lauffer V, van der Vlies AE, van der Flier WM, Scheltens P, Pijnenburg YA. Early-versus late-onset Alzheimer's disease: more than age alone. J Alzheimers Dis. (2010) 19:1401–8. doi: 10.3233/JAD-2010-1337
6. Smits LL, Pijnenburg YA, Koedam EL, van der Vlies AE, Reuling IE, Koene T, et al. Early onset Alzheimer's disease is associated with a distinct neuropsychological profile. J Alzheimers Dis. (2012) 30:101–8. doi: 10.3233/JAD-2012-111934
7. Joubert S, Gour N, Guedj E, Didic M, Gueriot C, Koric L, et al. Early-onset and late-onset Alzheimer's disease are associated with distinct patterns of memory impairment. Cortex. (2016) 74:217–32. doi: 10.1016/j.cortex.2015.10.014
8. Cherrier MM, Mendez MF, Dave M, Perryman KM. Performance on the Rey-Osterrieth Complex Figure Test in Alzheimer disease and vascular dementia. Neuropsychiatry Neuropsychol Behav Neurol. (1999) 12:95–101.
9. Shin MS, Park SY, Park SR, Seol SH, Kwon JS. Clinical and empirical applications of the Rey-Osterrieth Complex Figure Test. Nat Protoc. (2006) 1:892–9. doi: 10.1038/nprot.2006.115
10. Bouaziz S, Magnan A. Contribution of the visual perception and graphic production systems to the copying of complex geometrical drawings: a developmental study. Cogn Dev. (2007) 22:5–15. doi: 10.1016/j.cogdev.2006.10.002
11. Tchalenko J, Chris Miall R. Eye-hand strategies in copying complex lines. Cortex. (2009) 45:368–76. doi: 10.1016/j.cortex.2007.12.012
12. Baddeley A. The episodic buffer: a new component of working memory? Trends Cogn Sci. (2000) 4:417–23. doi: 10.1016/S1364-6613(00)01538-2
13. Serra L, Fadda L, Perri R, Caltagirone C, Carlesimo GA. The closing-in phenomenon in the drawing performance of Alzheimer's disease patients: a compensation account. Cortex. (2010) 46:1031–6. doi: 10.1016/j.cortex.2009.08.010
14. Ambron E, Piretti L, Lunardelli A, Coslett HB. Closing-in Behavior and Parietal Lobe Deficits: Three Single Cases Exhibiting Different Manifestations of the Same Behavior. Front Psychol. (2018) 9:1617. doi: 10.3389/fpsyg.2018.01617
15. Shakespeare TJ, Kaski D, Yong KX, Paterson RW, Slattery CF, Ryan NS, et al. Abnormalities of fixation, saccade and pursuit in posterior cortical atrophy. Brain. (2015) 138:1976–91. doi: 10.1093/brain/awv103
16. Pavisic IM, Firth NC, Parsons S, Rego DM, Shakespeare TJ, Yong KXX, et al. Eyetracking metrics in young onset Alzheimer's disease: a window into cognitive visual functions. Front Neurol. (2017) 8:377. doi: 10.3389/fneur.2017.00377
17. Oyama A, Takeda S, Ito Y, Nakajima T, Takami Y, Takeya Y, et al. Novel method for rapid assessment of cognitive impairment using high-performance eye-tracking technology. Sci Rep. (2019) 9:12932. doi: 10.1038/s41598-019-49275-x
18. Wilcockson TDW, Mardanbegi D, Xia B, Taylor S, Sawyer P, Gellersen HW, et al. Abnormalities of saccadic eye movements in dementia due to Alzheimer's disease and mild cognitive impairment. Aging (Albany NY). (2019) 11:5389–98. doi: 10.18632/aging.102118
19. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR Jr, Kawas CH, et al. The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement. (2011) 7:263–9. doi: 10.1016/j.jalz.2011.03.005
20. Crutch SJ, Lehmann M, Schott JM, Rabinovici GD, Rossor MN, Fox NC. Posterior cortical atrophy. Lancet Neurol. (2012) 11:170–8. doi: 10.1016/S1474-4422(11)70289-7
21. Crutch SJ, Schott JM, Rabinovici GD, Murray M, Snowden JS, van der Flier WM, et al. Consensus classification of posterior cortical atrophy. Alzheimers Dement. (2017) 13:870–84. doi: 10.1016/j.jalz.2017.01.014
22. Gorno-Tempini ML, Hillis AE, Weintraub S, Kertesz A, Mendez M, Cappa SF, et al. Classification of primary progressive aphasia and its variants. Neurology. (2011) 76:1006–14. doi: 10.1212/WNL.0b013e31821103e6
23. Kang SJ, Jeong Y, Lee BH, Baek MJ, Kwon JC, Chin J, et al. How early are initial symptoms recognized in Korean patients with Alzheimer's disease? Int J Geriatr Psychiatry. (2004) 19:699–700. doi: 10.1002/gps.1121
24. Sano M, Devanand DP, Richards M, Miller LW, Marder K, Bell K, et al. A standardized technique for establishing onset and duration of symptoms of Alzheimer's disease. Arch Neurol. (1995) 52:961–6. doi: 10.1001/archneur.1995.00540340045012
25. Mendez MF. Early-onset Alzheimer disease. Neurol Clin. (2017) 35:263–81. doi: 10.1016/j.ncl.2017.01.005
26. Mendez MF. Early-onset Alzheimer disease and its variants. Continuum. (2019) 25:34–51. doi: 10.1212/CON.0000000000000687
27. Rabinovici GD. Late-onset Alzheimer disease. Continuum. (2019) 25:14–33. doi: 10.1212/CON.0000000000000700
28. Belloy ME, Napolioni V, Greicius MD. A quarter century of APOE and Alzheimer's disease: progress to date and the path forward. Neuron. (2019) 101:820–38. doi: 10.1016/j.neuron.2019.01.056
29. Curtis C, Gamez JE, Singh U, Sadowsky CH, Villena T, Sabbagh MN, et al. Phase 3 trial of flutemetamol labeled with radioactive fluorine 18 imaging and neuritic plaque density. JAMA Neurol. (2015) 72:287–94. doi: 10.1001/jamaneurol.2014.4144
30. Barthel H, Gertz HJ, Dresel S, Peters O, Bartenstein P, Buerger K, et al. Cerebral amyloid-beta PET with florbetaben (18F) in patients with Alzheimer's disease and healthy controls: a multicentre phase 2 diagnostic study. Lancet Neurol. (2011) 10:424–35. doi: 10.1016/S1474-4422(11)70077-1
31. Kang SH, Park YH, Lee D, Kim JP, Chin J, Ahn Y, et al. The cortical neuroanatomy related to specific neuropsychological deficits in Alzheimer's continuum. Dement Neurocogn Disord. (2019) 18:77–95. doi: 10.12779/dnd.2019.18.3.77
32. Kang Y, Jahng S, Na DL. Seoul Neuropsychological Screening Battery (SNSB). 2nd ed. Incheon: Human Brain Research and Consulting (2012).
33. Kang Y, Na DL, Hahn S. A validity study on the Korean Mini-Mental State Examination (K-MMSE) in dementia patients. J Korean Neurol Assoc. (1997) 15:300–8.
34. Kang YW, Na DL, Chin J. A normative study of the digit span test for the elderly. Korean J Clin Psychol. (2002) 21:911–22.
35. Kim H, Na DL. Normative data on the Korean version of the Boston naming test. J Clin Exp Neuropsychol. (1999) 21:127–33. doi: 10.1076/jcen.21.1.127.942
36. Kang YW, Na DL. Seoul Verbal Learning Test (SVLT). Incheon: Human Brain Research and Consulting Co (2003).
37. Kang YW, Chin J, Na DL, Lee J, Park JS. A normative study of the Korean version of controlled oral word association test(COWAT) in the elderly. Korean J Clin Psychol. (2000) 19:385–92.
38. Lee JH, Kang YW, Na DL. Efficiencies of stroop interference indexes in healthy older adults and dementia patients. Korean J Clin Psychol. (2000) 19:807–18.
39. Kim KW, Lee SY, Choi JD, Chin J, Lee BH, Na DL, et al. A comprehensive evaluation of the copying process of a complex figure in early- and late-onset Alzheimer's disease: quantitative analysis of digital pen data. J Med Internet Res. (2020) 22:e18136. doi: 10.2196/preprints.18136
40. Henderson JM. Human gaze control during real-world scene perception. Trends Cogn Sci. (2003) 7:498–504. doi: 10.1016/j.tics.2003.09.006
42. Ambron E, Della Sala S. A critical review of closing-in. Neuropsychology. (2017) 31:105–17. doi: 10.1037/neu0000295
43. Lee BH, Chin J, Kang SJ, Kim EJ, Park KC, Na DL. Mechanism of the closing-in phenomenon in a figure copying task in Alzheimer's disease patients. Neurocase. (2004) 10:393–7. doi: 10.1080/13554790490892194
44. Molitor RJ, Ko PC, Ally BA. Eye movements in Alzheimer's disease. J Alzheimers Dis. (2015) 44:1–12. doi: 10.3233/JAD-141173
45. Rosler A, Mapstone M, Hays-Wicklund A, Gitelman DR, Weintraub S. The “zoom lens” of focal attention in visual search: changes in aging and Alzheimer's disease. Cortex. (2005) 41:512–9. doi: 10.1016/S0010-9452(08)70191-6
46. Ramzaoui H, Faure S, Spotorno S. Alzheimer's disease, visual search, and instrumental activities of daily living: a review and a new perspective on attention and eye movements. J Alzheimers Dis. (2018) 66:901–25. doi: 10.3233/JAD-180043
47. Kim EJ, Cho SS, Jeong Y, Park KC, Kang SJ, Kang E, et al. Glucose metabolism in early onset versus late onset Alzheimer's disease: an SPM analysis of 120 patients. Brain. (2005) 128:1790–801. doi: 10.1093/brain/awh539
48. Posner M, Walker J, Friedrich F, Rafal R. Effects of parietal injury on covert orienting of attention. J Neurosci. (1984) 4:1863–74. doi: 10.1523/JNEUROSCI.04-07-01863.1984
49. Na HK, Kang DR, Kim S, Seo SW, Heilman KM, Noh Y, et al. Malignant progression in parietal-dominant atrophy subtype of Alzheimer's disease occurs independent of onset age. Neurobiol Aging. (2016) 47:149–56. doi: 10.1016/j.neurobiolaging.2016.08.001
50. Cho H, Jeon S, Kang SJ, Lee JM, Lee JH, Kim GH, et al. Longitudinal changes of cortical thickness in early- versus late-onset Alzheimer's disease. Neurobiol Aging. (2013) 34:1921.e9–.e15. doi: 10.1016/j.neurobiolaging.2013.01.004
Keywords: Alzheimer's disease, Rey–Osterrieth complex figure, eye-tracking, visuospatial dysfunction, copying process
Citation: Kim KW, Choi J, Chin J, Lee BH and Na DL (2022) Eye-Tracking Metrics for Figure-Copying Processes in Early- vs. Late-Onset Alzheimer's Disease. Front. Neurol. 13:844341. doi: 10.3389/fneur.2022.844341
Received: 28 December 2021; Accepted: 12 April 2022;
Published: 16 May 2022.
Edited by:
Victoria Susan Pelak, University of Colorado, United StatesReviewed by:
Keir Xin Xian Yong, University College London, United KingdomHans van der Steen, Erasmus University Rotterdam, Netherlands
Trevor Jeremy Crawford, Lancaster University, United Kingdom
Copyright © 2022 Kim, Choi, Chin, Lee and Na. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Duk L. Na, dukna@skku.edu; dukna@naver.com