- 1Department of Psychology, University of Wisconsin-Milwaukee, Milwaukee, WI, United States
- 2Department of Psychiatry & Behavioral Sciences, University of California, Davis, Davis, CA, United States
Introduction: Recent work challenged past findings that documented relational memory impairments in autism. Previous studies often relied solely on explicit behavioral responses to assess relational memory integrity, but successful performance on behavioral tasks may rely on other cognitive abilities (e.g., executive functioning) that are impacted in some autistic individuals. Eye-tracking tasks do not require explicit behavioral responses, and, further, eye movements provide an indirect measure of memory. The current study examined whether memory-specific viewing patterns toward scenes differ between autistic and non-autistic individuals.
Methods: Using a long-term memory paradigm that equated for complexity between item and relational memory tasks, participants studied a series of scenes. Following the initial study phase, scenes were re-presented, accompanied by an orienting question that directed participants to attend to either features of an item (i.e., in the item condition) or spatial relationships between items (i.e., in the relational condition) that might be subsequently modified during test. At test, participants viewed scenes that were unchanged (i.e., repeated from study), scenes that underwent an “item” modification (an exemplar switch) or a “relational” modification (a location switch), and scenes that had not been presented before. Eye movements were recorded throughout.
Results: During study, there were no significant group differences in viewing directed to regions of scenes that might be manipulated at test, suggesting comparable processing of scene details during encoding. However, there was a group difference in explicit recognition accuracy for scenes that underwent a relational change. Marginal group differences in the expression of memory-based viewing effects during test for relational scenes were consistent with this behavioral outcome, particularly when analyses were limited to scenes recognized correctly with high confidence. Group differences were also evident in correlational analyses that examined the association between study phase viewing and recognition accuracy and between performance on the Picture Sequence Memory Test and recognition accuracy.
Discussion: Together, our findings suggest differences in the integrity of relational memory representations and/or in the relationships between subcomponents of memory in autism.
1. Introduction
Autism is a neurodevelopmental disorder characterized by persistent difficulties with social interaction and communication, in addition to the presence of restricted and repetitive behaviors, interests, or activities (American Psychiatric Association, 2013). Although these behavioral hallmarks are criterial for an autism diagnosis, other aspects of cognition are also atypical in autism. For example, weaknesses in executive functioning and attention are reliably reported (Wainwright-Sharp and Bryson, 1993; Burack, 1994; Belmonte and Yurgelun-Todd, 2003; Landry and Bryson, 2004; Solomon et al., 2008, 2009; Mostert-Kerckhoffs et al., 2015; Lai et al., 2017; see Demetriou et al. (2018), Keehn et al. (2013) for reviews), and studies indicate that weaknesses in episodic memory are present as well (see Boucher et al. (2012), Cooper and Simons (2019), Desaunay et al. (2020a), Griffin et al. (2021) for reviews). Notably, differences in episodic memory have not always been reported in past work. One reason for contradictory findings may be that tasks used in some prior studies were susceptible to other forms of cognitive dysfunction in autistic individuals. For instance, direct tests of memory (e.g., recognition tasks that require deliberative processing and decision making) may be more reliant on executive functioning abilities than indirect measures of memory (e.g., measures that do not require explicit memory decisions), and executive functioning abilities are a well-documented weakness in autistic individuals. Additionally, some published studies used incidental encoding tasks (i.e., learning tasks without explicit instructions to memorize materials), which are likely to be more challenging for autistic individuals, who often show attentional difficulties relative to their non-autistic peers. Therefore, it is possible that previously reported memory difficulties in autism are a consequence of conflated cognitive requirements of specific tasks that have been used rather than evidence for true memory difficulties. The current study was designed to help adjudicate conflicting findings by employing both direct (i.e., explicit recognition) and indirect (i.e., eye-tracking) measures of memory performance in a task with experimental conditions matched for difficulty and more controlled encoding requirements.
Predicted episodic memory weaknesses in autistic persons are not unwarranted, as there are documented structural and functional connectivity differences in brain regions that contribute to episodic memory in autism. Research conducted with non-autistic participants reports that dissociable regions of the medial temporal lobes (MTL), including the hippocampus and perirhinal cortex, support long-term declarative memory (Eichenbaum et al., 2007; Konkel et al., 2008; Ranganath, 2010). Past studies indicate that the hippocampus is critical for the binding of associative, spatial, and temporal relationships between items in memory (i.e., relational memory), while the perirhinal cortex is identified as a key player in item-specific memory (Ryan et al., 2000; Davachi et al., 2003; Hannula et al., 2006; Staresina and Davachi, 2008; see Davachi (2006) for review). Consistent with behavioral reports of relational memory difficulties in autistic individuals, structural abnormalities in the hippocampus are reported in postmortem studies in this population (Bauman and Kemper, 2005; Fetit et al., 2021) and in structural imaging studies of hippocampal development (Reinhardt et al., 2020).
Neuroimaging studies, conducted with non-autistic individuals, also indicate that structures in the frontal and parietal lobes contribute to episodic memory encoding and retrieval (see Kim (2010), Spaniol et al. (2009) for reviews). The prefrontal cortex supports the organization of information in working memory during encoding, source monitoring during retrieval, post-retrieval selection of goal-relevant information, and self-referential processing that permits the integration of retrieved memories with prior knowledge (e.g., Dobbins and Wagner, 2005; Schlichting and Preston, 2015; see Blumenfeld and Ranganath (2007), Fletcher and Henson (2001) for reviews). Activation in the posterior parietal cortex is associated with the subjective experience of recollection, high confidence source memory judgments, attention to retrieved content, and the online representation and maintenance of retrieved representations over time (Cabeza et al., 2008; Ciaramelli et al., 2017; see Moscovitch et al. (2016), Rugg and Vilberg (2013) for reviews).
Postmortem studies and structural imaging work indicate volumetric differences in frontal and parietal brain regions in autistic individuals relative to controls (Ecker et al., 2010; Fetit et al., 2021; although see Trontel et al., 2015), and functional neuroimaging studies demonstrate abnormalities in functional connectivity between the prefrontal cortex, parietal regions, and the hippocampus in autistic individuals (e.g., Ben Shalom, 2003; Barnea-Goraly et al., 2014; Cooper et al., 2017b; Banker et al., 2021; Li et al., 2022). For example, attenuated functional connectivity between the hippocampus and fronto-parietal networks is reported during retrieval, accompanied by lower levels of retrieval accuracy, in autistic individuals (Cooper et al., 2017b). Another study documents reduced activation in the left posterior hippocampus and enhanced PFC activation during encoding, which may indicate more effortful encoding for these individuals (Gaigg et al., 2015).
The combination of structural and functional differences in memory-associated brain areas observed in autism align with reported weaknesses on long-term memory tasks requiring retrieval of details diagnostic of the encoding experience (Boucher and Warrington, 1976; Boucher, 1981; Bowler et al., 1997). Specifically, autistic individuals make fewer subjective, recollection-related responses (e.g., “remember” responses in remember-know paradigms; e.g., Bowler et al., 2007; Cooper et al., 2015), exhibit reduced confidence in judgments of mnemonic accuracy (i.e., metamemory; e.g., Wojcik et al., 2013; Grainger et al., 2014; Cooper et al., 2016), and demonstrate poorer recall of autobiographical memories (e.g., Lind and Bowler, 2010). Consistent with these observations, individuals diagnosed with autism have a disproportionate weakness in relational memory with relatively intact memory for individual items (Bigham et al., 2010; Bowler et al., 2014; Desaunay et al., 2020b). Indeed, relational memory difficulties are documented across a range of stimuli (e.g., abstract and realistic objects, words, etc.) and across different types of relational memory tasks (e.g., inter-object, object-location, object-color, object-action, and object-voice pairing tasks; Lind and Bowler, 2009; Bigham et al., 2010; Bowler et al., 2014; Cooper et al., 2017b; Desaunay et al., 2020b). Such findings are in line with the relational binding account of episodic memory in autism (Bowler et al., 2011), which posits that autistic individuals show a selective weakness in hippocampus-dependent binding of items and contexts but a relative sparing of memory for items alone.
Importantly, the relational binding account has not always been supported by previous findings. Some studies report that autistic individuals show difficulties restricted to item memory (Solomon et al., 2016; Cooper et al., 2017a), weaknesses in both item and relational memory (Cooper et al., 2015; Massand and Bowler, 2015; Ring et al., 2016; Semino et al., 2018; Mogensen et al., 2020), or intact item and relational memory (Souchay et al., 2013; Lind et al., 2014; Ring et al., 2015, 2017; Hogeveen et al., 2020). One possible explanation for discrepant findings is that task complexity differed across item-specific and relational memory tasks in these experiments (e.g., as in Bowler et al., 2014). Indeed, in past work, tests of item-specific memory have typically required participants to recognize a single item from the encoding phase, while tests of relational memory required participants to remember multiple elements of the encoding scenario. Further supporting the potential influence of this confound on prior work, autistic individuals have shown difficulties with processing “complex” information (e.g., complex conceptual structure/organization of material and/or retrieval tasks that require higher levels of cognitive control) across a range of cognitive tasks (complex information processing model; Minshew and Goldstein, 1998, 2001). Thus, it is conceivable that reports from previous studies are in conflict because task demands are typically quite different for item-specific and relational memory tests.
To address this problem, Cooper et al. (2015) utilized a long-term memory task with item-specific and relational memory conditions that were well-matched for task difficulty. During encoding, autistic and non-autistic adults studied computer-generated scenes that contained pre-defined “critical” items. Subsequently, in a corresponding test phase, participants were presented with previously studied and new (i.e., never presented) scenes, and some of the studied scenes were modified. When scenes were modified, rather than repeated, the critical item was either replaced with a different exemplar (i.e., item-specific change) or had moved to a new spatial location (i.e., relational change). Participants were instructed to determine, for each test scene, whether it was repeated, modified, or new. Importantly, the experiment was designed so that memory for item-specific detail and spatial relationships was assessed in the context of the same set of scenes, and pilot testing had confirmed that performance was well-matched across conditions (Hannula et al., 2015). Results indicated that autistic individuals identified significantly fewer modified scenes in both the item-specific and relational memory conditions relative to their non-autistic peers and that autistic participants were less likely to endorse successfully identified scenes as recollected. Thus, when task-difficulty is well-matched across conditions, it appears that the memory weakness is not limited to relational memory (Cooper et al., 2015).
It is important to note, however, that much of the past work investigating long-term episodic memory in autistic individuals, including Cooper et al.’s (2015) study, has relied solely on explicit behavioral responses (e.g., button-press recognition responses). This is problematic because complex instructions and/or button-press mappings in these experiments depend on the integrity of additional cognitive processes (Luck and Gold, 2008) that are impacted in autistic individuals (e.g., cognitive control; Schmitt et al., 2018; see Tonizzi et al. (2021) for review). Moreover, other aspects of previously published studies (e.g., relatively uncontrolled encoding conditions) make it difficult to determine whether results provide evidence of true memory difficulties or are a secondary consequence of attentional and executive processing differences during encoding. For example, in Cooper et al.’s (2015) work, participants were instructed to try and remember the appearance and location of the objects in the scene. However, autistic individuals show difficulties with the disengagement of attention (see Keehn et al. (2013) for review) and inefficient attentional filtering of information (e.g., Burack, 1994; Murphy et al., 2014; Keehn et al., 2019), which may have interfered with the initial exploration and encoding of information in scenes during the study phase and may have led to reported memory weaknesses. In sum, specific task requirements may result in the conflation of cognitive processes that are differentially impacted in autistic individuals, and these differences may account for reported discrepancies in autistic performances on episodic memory tests.
Therefore, other methods may be useful in disentangling contradictory findings. One method used to index memory indirectly is eye tracking. An advantage of this method is that eye movements can be recorded throughout an experiment, which means that researchers can pinpoint when (i.e., at what stage of processing – encoding vs. retrieval) there are differences in performance (e.g., differences in scene exploration) that may contribute to reported memory difficulties in special populations. Past eye-tracking studies with healthy, college-age participants demonstrate that when a stimulus is presented repeatedly, participants make fewer fixations and sample fewer distinct regions of a picture with each repetition (i.e., Althoff and Cohen, 1999; Ryan et al., 2000, 2007; Heisz and Shore, 2008). Additionally, the number of fixations made during encoding is positively correlated with recognition accuracy during test (Pertzov et al., 2009; Molitor et al., 2014; Olsen et al., 2014) and, during retrieval, viewing patterns distinguish previously studied scenes that have been modified from those that are repeated without a change (e.g., Ryan et al., 2000).
In one representative example, Hannula et al. (2010a,b) used the task subsequently adopted by Cooper et al. (2015) but also incorporated a second, controlled encoding phase. During this second encoding phase, participants viewed the same set of scenes that were presented during the first encoding phase, but now each scene was accompanied by an orally-presented “yes/no” question orienting a participant’s attention to either the features of a “critical” item (i.e., an ‘item-specific’ orienting question) or to the spatial location of a “critical” item (i.e., a ‘spatial relational’ orienting question) that might be modified in the test phase. Use of orienting questions during the encoding task ensured that participants attended to the very same information that might be manipulated subsequently, meaning that any differences in retrieval performance were less likely due to differences in attention to critical objects during encoding. At test, participants spent more time fixating the critical regions of repeated (versus novel) scenes because attention had been directed to these regions by the orienting questions during the second encoding phase. Additionally, a disproportionate amount of time was spent viewing critical regions of modified (versus repeated) scenes, including the empty regions of scenes when a relational change had been made (i.e., the location originally occupied by the critical object, now empty). Because eye movements are more likely to be made toward objects than to empty regions of a scene (Yarbus, 1967), these viewing time differences represent particularly compelling evidence for the influence of relational memory on eye-movement behavior (see also Ryan et al. (2000)).
Further evidence for the sensitivity of eye movements to item-specific and relational memory comes from previous work with clinical populations. For instance, in the study described above (Hannula et al., 2010b), individuals diagnosed with schizophrenia showed a disproportionate deficit in the eye-movement-based relational memory effect relative to healthy comparison participants. This outcome is similar to impairments reported when amnesic patients with MTL damage are tested in comparable experiments. Specifically, amnesic patients show standard effects of stimulus repetition in patterns of viewing, but eye-movement-based relational memory effects are impaired (e.g., Ryan et al., 2000). In studies of autism, eye tracking has been used to examine the exploration of social stimuli (with differences in viewing reported; see Chita-Tegmark (2016); Papagiannopoulou et al. (2014) for reviews), but only a handful of previous studies have used this method to address questions about the integrity of long-term memory (Loth et al., 2011; Ring et al., 2017; Cooper et al., 2017a).
In general, published eye-tracking studies indicate that viewing effects (e.g., gaze time, number of fixations, fixation duration) are similar between autistic and non-autistic individuals during encoding, suggesting attention to scenes during encoding is unaffected in autism (Loth et al., 2011; Cooper et al., 2017a). However, when correlational analyses are conducted to examine associations between viewing patterns and subsequent memory, results suggest that viewing patterns may not predict subsequent memory performance to the same degree in autistic and non-autistic participants (Loth et al., 2011; Ring et al., 2017; Cooper et al., 2017a). It is proposed that these differences point to a problem at the time of retrieval, rather than encoding, in autistic individuals (Cooper et al., 2017a), since differences in memory performance occur during the retrieval phase and are accompanied by similar eye-movement patterns during encoding. Consistent with this conclusion, past work measuring retrieval-related viewing patterns indicate that fixation ‘reinstatement’ (i.e., extent to which viewing patterns from study are reinstated during test) is reduced for recollected scenes in autistic relative to non-autistic participants, while reinstatement patterns for non-recollected scenes are not different between groups (Cooper et al., 2017a), potentially indicating that memory weaknesses reported in autism are due to a disrupted recollection-related retrieval process (cf. Griffin et al., 2021).
To our knowledge, one eye-tracking study has explicitly used a relational memory task in an autism population (Ring et al., 2017), and results revealed between-groups differences in retrieval-related eye movements. During test phase trials, three locations were marked in previously studied scenes – one corresponding to the location that was occupied by a studied object and two previously unoccupied locations. On every trial, participants were either presented with the originally encoded object or a new, unstudied object. In each case, they were required to place the object in one of the marked scene locations. For “include” trials, they were to put the object in its originally studied location; for “exclude” trials, they were to put the object in one of the two new locations (i.e., process dissociation procedure; Jacoby, 1991). If unable to remember the object or the location, participants were told to choose one of the available locations (i.e., a measure of potential position-based bias for the set of counterbalanced new objects). Results indicated that both groups of participants were equally likely to place the object in its original location on “exclude” trials (a measure of implicit memory) but that individuals with autism were less likely to put the object in its original location on “include” trials (a measure of explicit memory). Eye-tracking results revealed that, during encoding, non-autistic individuals spent more time viewing objects that were subsequently placed correctly during test relative to autistic individuals. In addition, autistic participants spent less time looking at target locations during “include” trials and non-target locations during “exclude” trials compared to the non-autistic participants. Collectively, these results are consistent with reports that relational memory is disrupted in autism, and, further, differences were evident not only in direct measures of performance but also when memory was measured indirectly, using eye movement data.
In a key departure from previously published studies, eye-tracking data was recorded here in a task that examined both item-specific and relational memory. Importantly, as indicated earlier, a norming experiment demonstrated that these experimental conditions were equated for difficulty (Hannula et al., 2010b) to ensure viewing effects could not be attributed to differential task complexity. Specifically, we examined whether memory-specific viewing patterns to realistic, non-social scenes differed between autistic and non-autistic individuals. Participants first viewed a set of scenes while being instructed to memorize the scene. Following the initial study phase, scenes were re-presented, accompanied by an orienting question (e.g., “Is the hat on the chair?”). Participants were told to respond to the question, which encouraged them to attend to specific objects in the scenes that might be subsequently manipulated (i.e., exchanged with different exemplar or moved to different spatial location) during the test phase. This ‘orienting’ question was intended to reduce the burden on attentional resources and executive functions that may be compromised in autism. During test, participants viewed scenes that were unchanged (i.e., repeated from study), scenes that underwent an “item” change (an exemplar switch) or a “relational” change (a location switch), and scenes that were not presented during the encoding phase. Both direct (i.e., recognition responses) and indirect (i.e., eye movement) measures of memory were recorded.
Consistent with results reported in Cooper et al.’s (2015) study that used the same scenes and a similar task, one possibility was reduced explicit recognition accuracy for modified scenes in the autistic group, whether the change was item-specific or relational. The few studies examining eye-movement behavior in autism suggest that between-group differences in basic viewing patterns might not be evident during encoding. It is possible though that there may be reductions in the positive correlations between encoding-related eye movements and subsequent memory performance, as reported previously in autism (Loth et al., 2011; Ring et al., 2017; Cooper et al., 2017a). During test, eye movement effects sensitive to memory for spatial relationships might be selectively reduced in autism, an outcome consistent with the relational binding hypothesis (Bowler et al., 2011). However, if the problem in autism is related to the initial processing of relational information (e.g., during encoding), then use of an orienting question during the second study block should reduce or eliminate the relational memory difficulty because these questions encourage participants to attend to and process the same relationships that might be modified at test. In sum, use of direct and indirect measures of memory, together with well-matched item-specific and relational memory conditions, was expected to aid in disambiguating contradictory findings reported in the autism episodic memory literature.
2. Method
2.1. Participants
Forty participants (18 autistic, 22 non-autistic) were recruited during the second wave of data collection from a cohort-sequential study (Neurodevelopment of cognitive control in autism: adolescence to young adulthood; 1R01MH106518) of autistic and non-autistic persons without intellectual disability (IQ ≥ 70) through the University of California (UC) Davis MIND Institute and Imaging Research Center. Two participants in the non-autistic group were removed from analysis because the number of test block trials with unreliable eye-tracking data was more than two standard deviations above the group mean. Therefore, the sample carried forward for analysis included 18 autistic individuals and 20 non-autistic individuals. This sample size was comparable to, or greater than, the sample size from previously published studies using the same task (i.e., Cooper et al. (2015) – 24 participants per group; Hannula et al. (2010b) – 16 participants per group). With this sample size, we had sufficient power (80.4%) to detect large effects for group differences (d = 0.9) with alpha set to 0.05, two-tailed.
Written, informed consent was obtained from participants in accordance with the UC Davis Institutional Review Board. Participants received a gift card for their participation. To be included in the study, all participants were required to be between the ages of 12 and 24 and to have a Full Scale IQ of 70 or above on the Wechsler Abbreviated Scale of Intelligence – 2nd Edition (WASI-II; Wechsler, 2011). Participants were not permitted to be taking psychotropic medications at the time of their enrollment in the study. Participants were also excluded from participation if they had a diagnosis of epilepsy or another neurological disorder and/or if imaging was contraindicated. Autistic participants were required to have a community diagnosis of autism and were required to meet criteria for autism on a DSM-5 Criteria Checklist for autism (American Psychiatric Association, 2013) and on the Autism Diagnostic Observation Schedule – 2nd Edition (ADOS-2; Lord et al., 2000), which were administered by a licensed clinician at the UC Davis MIND Institute. Non-autistic participants were not included in the study if they had a community diagnosis of autism, attention-deficit/hyperactivity disorder, or any neurodevelopmental disorder, had a first-degree family member with autism, had reported Axis I psychopathology, or surpassed a cut-off value of 11 on the Social Communication Questionnaire (SCQ; Rutter et al., 2003), suggestive of an autism diagnosis.
Table 1 provides basic descriptive statistics for each group on the following characteristics: gender, chronological age, WASI-II (Wechsler, 2011) Full Scale IQ (FSIQ-4), and WASI-II index scores (Verbal Comprehension Index [VCI] and Perceptual Reasoning Index [PRI]). There were no significant differences between groups on age, WASI-II FSIQ-4, or WASI-II index scores, F’s ≤ 1.61, p’s ≥ 0.21. In Table 1, scores on the semi-structured ADOS-2 (Lord et al., 2000) are also provided for individuals in the autistic group, including the calibrated severity score (CSS) and severity scores in the Social Affect (SA) and Restricted, Repetitive Behavior (RRB) domains. Table 2 presents scores on select tests from the NIH Toolbox® Cognition Battery used to assess symptoms related to inattention/impulsivity, executive dysfunction, working memory, and episodic memory (Akshoomoff et al., 2013), including scores on the Flanker Inhibitory Control and Attention Test (FICA), Dimensional Change Card Sort Test (DCCS), Picture Sequence Memory Test (PSM), and List Sorting Working Memory Test (LSWM). There were significant differences between groups on two executive functioning tasks (FICA, DCCS), Welch’s F’s ≥ 6.20, p’s ≤ 0.020, ω2’s ≥ 0.12, and on an episodic memory test (PSM), F (1, 36) = 5.35, p = 0.027, ηp2 = 0.13, with higher scores in the non-autistic group compared to the autistic group across all three measures. There were no significant group differences on a working memory task (LSWM), F (1, 36) = 0.52, p = 0.47.
2.2. Materials and apparatus
Sixty-four computer-generated indoor and outdoor scenes (800 × 600 pixels) created using Punch! Home Design Software (Encore, Inc., El Segundo, CA) by Hannula et al. (2006, 2010b) were used in the current study. Three versions of each scene were developed – an original version, a version in which a designated critical item was switched with a different exemplar (i.e., an item manipulation), and a version in which that same critical item had been moved to a similarly plausible location (i.e., a relational manipulation; see Figure 1A). The total stimulus sample included 192 scenes. When critical objects switched spatial locations in the relational condition, objects were moved equally often from left, in the original scene, to right, in the manipulated scene, and vice versa. Scenes were presented at a resolution of 1,012 × 762 pixels, and scenes subtended 28.61 (width) by 21.74 (height) degrees of visual angle, from a viewing distance of 70 cm. Scenes were displayed on a monitor with 1,980 × 1,200-pixel resolution and a refresh rate of 60 Hz. Additionally, two orienting questions were created for each scene. One question was designed to orient attention to the features of a critical object and the other to the spatial relationship between a critical object and its surroundings (examples are provided in Figure 1B). The purpose of the orienting question was to direct the viewer’s attention to critical properties of the scenes that might be manipulated during the subsequent test block.
Figure 1. Representative scene and associated orienting questions. (A) Example of a representative scene – the original scene, the version of that scene with an item manipulation, and the version of that scene with a relational manipulation. (B) Item (in blue) and relational (in orange) orienting question for the scene shown above (A).
Eye movements were recorded with an Eyelink 1,000 Plus eye-tracking system (SR Research LTD: Ontario, Canada). This system has a temporal resolution of 1,000 Hz and head-supported spatial resolution of 0.01°. Eye movements were identified as saccades using an automated algorithm that requires a minimum velocity of 30°/s and a minimum acceleration of 8,000°/s2. Experiment Builder software package (SR Research LTD: Ontario, Canada) was used to display the experiment, and Data Viewer software package (SR Research LTD: Ontario, Canada) was used to extract the eye-tracking data.
2.3. Design and procedure
After participants gave their consent to participate, they were seated 70 cm from the computer monitor and a chinrest was adjusted to a comfortable position. An automated 9-point calibration process was then performed to align fixations with screen coordinates before the experiment began; this process was repeated as necessary until calibration was successful, and a drift correction procedure was used before each trial to ensure accurate tracking throughout the experiment. Prior to completing the experiment, instructions were provided. Twelve practice study trials (six each in Study Blocks 1 and 2) and eight practice test trials were used to ensure that participants understood the task. During the practice test trials, participants were given feedback on their performance. Scenes viewed during study and test were presented side-by-side to afford participants the opportunity to become familiar with the types of scene manipulations they may encounter. Eye movements were recorded in each phase of the experiment.
2.3.1. Study Block 1
Following practice, participants were shown 48 scenes during Study Block 1 (see Figure 2A). Sixteen of these scenes were ‘repeated’ during test (i.e., same version of the scene was re-presented), 16 underwent an item manipulation at test (i.e., henceforth referred to as the “item” condition), and 16 underwent a relational manipulation at test (i.e., henceforth referred to as the “relational” condition). Participants were instructed to view the scenes and attempt to commit each scene to memory. Every trial began with a central fixation cross; the trial could not be initiated by the experimenter until the participant fixated the center of the screen. Each scene was presented for a duration of 8 s.
Figure 2. Trial structure and event timing. (A) During Study Block 1, central fixation was followed by a scene (8 s). (B) During Study Block 2, central fixation was followed by a scene (5 s), accompanied by an orally presented orienting question to which participants responded via button press. (C) During the test block, central fixation was followed by a scene (6 s). Participants indicated via button press whether the scene was the “same,” “modified,” or “new” and provided a confidence rating, when prompted.
2.3.2. Study Block 2
During Study Block 2, the same 48 scenes were presented again in a new random order (see Figure 2B). When participants fixated the center of the screen, the experimenter initiated the trial, and a scene was presented for 5 s. Now, each scene was accompanied by a corresponding orienting question (pre-recorded and presented over speakers), initiated 500 ms after scene onset. The question directed the participant’s attention either to features of a critical object (if the scene was assigned to the “item” condition) or to the spatial relationship between a critical object and its surroundings (if the scene was assigned to the “relational” condition). For scenes assigned to the “repeated” condition, half were presented with an item-specific orienting question and half were presented with a relational orienting question. Participants were instructed to respond “yes,” “no,” or “don’t know” to the orienting question via a button press, while the picture was in view.
2.3.3. Test Block
Participants saw 64 scenes during the Test Block (see Figure 2C). Sixteen scenes were the exact image seen during study (i.e., “repeated” scenes), 16 scenes had undergone an item manipulation (i.e., “item” scenes), 16 scenes had undergone a relational manipulation (i.e., “relational” scenes), and 16 scenes were new (i.e., “novel” scenes). Critically, a yoked design was used; three participants saw the exact same version of a scene during test, but different encoding experiences meant the scene was manipulated for one participant, repeated for another, and novel for a third (see Figure 3). This yoked design means that any differences in viewing, across conditions, could not be due to differences in features of the scenes presented during the test phase. Instead, any differences in viewing patterns would be directly attributable to differences in encoding history. Scenes were presented equally often as repeated, manipulated, and novel across participants.
Figure 3. Yoking procedure at test. Representative example of a yoked scene during (A) study and (B) test for three different participants. Scenes during test were identical across participants but varied by encoding history.
Following central fixation, the experimenter initiated the trial, and a scene was presented for 6 s. After the scene disappeared from the screen, participants were prompted to respond via button press whether the scene was the “same” as one they had studied, had been “modified” somehow, or was “new.” Then, participants were asked to rate their recognition confidence on a scale from 1 (“just guessing”) to 3 (“absolutely certain”) with a button-press response. In each case, response options remained on the screen until a response was made. At the end of the experiment, participants were debriefed.
2.3.4. Data processing and analysis
Trials were flagged and removed from analyses when eye position was lost or unreliable. As in previously published work (e.g., Hannula et al., 2010b), trials were removed if the total viewing time directed to the scene was less than 65% of the trial duration. This resulted in the loss of 2.14% of trials (SD = 2.98%) across autistic and non-autistic participants. Two participants from the non-autistic group were removed from all analyses because the number of test block trials flagged as bad was more than two standard deviations above the group mean (28 and 55% of the trials, respectively). To examine differences in processing of and attention toward critical items, orienting question accuracy was calculated for button-press responses made during Study Block 2. Corrected recognition scores were calculated to determine whether explicit memory performance during the Test Block differed between groups. As was done by Cooper et al. (2015), the percentage of studied (repeated and modified) scenes mistakenly endorsed as “new” (i.e., Novel False Alarms) was subtracted from the percentage of novel scenes that were identified correctly (i.e., Novel Hits) to examine memory for scenes. Corrected recognition scores sensitive to memory for scene detail were calculated separately for the item and relational conditions by subtracting the percentage of repeated scenes incorrectly endorsed as “modified” from the percentage of item and relational scenes identified correctly, respectively. This measure provides us with information about how effectively participants could discriminate between studied scenes that went on to be manipulated and studied scenes that remained the same.
Three regions of interest were drawn for each scene to examine viewing effects. One of these regions marked the boundaries of the whole scene (i.e., “scene” region), one marked the current location of the critical object (i.e., “filled” region), and one marked the location where the critical object used to be located (i.e., “now-empty” region) when a relational change was made. The boundaries of the “filled” and “empty” regions were drawn in Adobe Photoshop to extend 25 pixels beyond the horizontal and vertical limits of the critical object. Fixations outside the bounds of the “scene” region were discarded from analyses, and total viewing time, used as the denominator in our proportion of total viewing time measures, was the summed duration of fixations made to the scene itself (rather than the full duration of scene presentation; see Hannula et al. (2010a) for details). For the Study Blocks, regions of interest analyses were based on viewing directed to each scene’s “filled” location (i.e., location occupied by the critical object). Scenes presented during the study blocks (i.e., scenes in the repeated, item, and relational conditions) were subdivided based on whether they were presented with an item-specific or relational orienting question during Study Block 2. For the Test Block, region of interest analyses were based on viewing directed to the “filled” location for scenes that underwent an item change (along with their yoked repeated and novel counterparts) and viewing directed to both the “filled” and “empty” locations for scenes that underwent a relational change (along with their yoked repeated and novel counterparts).
To determine whether there were differences in viewing between groups during Study Blocks 1 and 2, the average number of fixations made to whole scenes (collapsed across conditions) was examined, along with the proportion of total viewing time directed to the filled critical region of scenes accompanied by item-specific and relational orienting questions (collapsed across to-be-repeated and to-be-manipulated scenes). As in previous work (Hannula et al., 2010b), we calculated two separate memory indices to examine viewing patterns from the Test Block. Our first index, memory for repetition, was used to determine whether there were differences in viewing due to memory for the scenes themselves, absent any modification. Viewing of the critical region(s) within novel scenes (i.e., scenes presented for the first time during test) was subtracted from viewing of the analogous region(s) within repeated scenes (presented during study and test). The second index, memory for detail, was used to determine whether item-specific and/or relational changes affected viewing of the critical region(s). In this case, viewing of the critical region(s) within repeated scenes (presented during study and test) was subtracted from viewing of the analogous region(s) within manipulated scenes (in which an item or relational change occurred at test). We utilized these two calculated indices to examine two eye-movement measures: the proportion of total viewing time directed to critical scene region(s) and the duration of the first gaze (in ms) to the filled region. For the first gaze analysis, the durations of consecutive fixations to the filled region in the first gaze following scene presentation were summed. The first gaze began with the first entry into the filled region and ended when the participant looked at a different scene location. Empty locations, in the relational condition, were not included in the first gaze analysis because so few fixations were made to that part of the scene.
2.3.4.1. Statistical contrasts
Analyses were conducted in SPSS Statistics (Version 28.0). All tests were two-sided and p-values <0.05 were considered statistically significant. Levene’s test was used to examine homogeneity of variances before conducting independent samples t-tests and repeated measures ANOVAs. Age and gender were included as covariates when marginal or significant group differences were documented. Partial eta-squared (ηp2) and Cohen’s d were calculated as effect size indices.
Additionally, Bayes factors, giving evidence for the null hypothesis over the alternative hypothesis (BF01), were calculated to determine whether reported results were likely to have been obtained under the null or alternative hypothesis or whether results did not favor either hypothesis. A Bayes factor (BF01) greater than 3 provides evidence for the null hypothesis, and a value less than 0.33 provides evidence for the alternative hypothesis, while any value between 3 and 0.33 is inconclusive.
Finally, Pearson’s correlations were calculated to examine associations between viewing patterns during study (i.e., proportion of total viewing time to filled regions in studied scenes), viewing patterns during test (i.e., detailed-based proportion of total viewing time and first gaze duration), and recognition memory performance (i.e., corrected recognition scores). Specifically, we examined four types of associations: 1) association between critical region viewing for scenes paired with item orienting questions during study and detail-based viewing for scenes with an item change during test, 2) association between critical region viewing for scenes paired with relational orienting questions during study and detail-based viewing for scenes with a relational condition during test, 3) association between critical region viewing for scenes paired with item orienting questions during study and item corrected recognition scores, and 4) association between critical region viewing for scenes paired with relational orienting questions during study and relational corrected recognition scores. Additionally, Pearson’s correlations were calculated between Picture Sequence Memory Test (PSM) scores, corrected recognition scores, and viewing during test (i.e., detail-based proportion of total viewing time and first gaze duration). Two-tailed p-values are reported for each correlation. We used Fisher’s r-to-z transformation to statistically compare correlations between groups. Pearson’s correlation coefficients were transformed into z-scores using Fisher’s transformation formula: z = ½*ln ((1 + r)/(1-r)). Z-scores for each group were then statistically compared using the test statistic: zobserved = (z1-z2)/sqrt ((1/(N1-3)) + (1/(N2-3)). Using a p-value of 0.05 to determine statistical significance, a zobserved value > +1.96 or < −1.96 was considered significant.
3. Results
3.1. Behavioral performance
3.1.1. Orienting questions (Study Block 2)
Two autistic participants were removed from the orienting question analysis because they used the wrong buttons to make responses on a subset of trials; therefore, analyses were based on data from 16 autistic participants and 20 non-autistic participants. Most often, participants made correct responses to the orienting questions (autistic participants: M = 89.32%, SD = 7.97%; non-autistic participants: M = 89.90%, SD = 7.41%). There was no significant difference in orienting question response accuracy between autistic and non-autistic participants, t (34) = 0.22, p = 0.83, Cohen’s d = 0.08, BF01 = 4.01.
3.1.2. Recognition
On average, scenes were most often identified correctly at test (autistic participants: M = 81.16% correct, SD = 11.54%; non-autistic participants: M = 87.03% correct, SD = 7.14%). Further evaluation of the data indicated that more than half of the scenes were recognized correctly and with high confidence by both groups (autistic participants: M = 51.56% correct high confidence trials, SD = 18.86%; non-autistic participants: M = 60.31% correct high confidence trials, SD = 18.04%). Table 3 provides a full accounting of accuracy and confidence across scene types, for both groups.
Table 3. Scene recognition accuracy and confidence ratings for autistic and non-autistic participants.
3.1.2.1. Memory for scenes
To determine whether there were general differences in memory for scenes, corrected recognition scores were calculated by subtracting novel false alarms (repeated and modified scenes called “new”) from novel hits for each group of participants (see Figure 4A). Results from an independent samples t-test indicated that there was not a significant between-groups difference in the ability to distinguish new from old scenes, t (36) = 1.31, p = 0.20, Cohen’s d = 0.43, BF01 = 2.01.
Figure 4. Recognition memory for scenes and scene details. Corrected recognition accuracy for (A) memory for scenes index (percentage of novel hits – percentage of novel false alarms) by group. Corrected recognition accuracy for (B) memory for scene details index (percentage of modified hits – percentage of modified false alarms) by group and scene type. Error bars represent standard error of the mean.
3.1.2.2. Memory for scene detail
Two corrected recognition scores sensitive to memory for detail were calculated by subtracting the percentage of modified false alarms (i.e., repeated scenes called “modified”) from the percentage of modified hits, one for scenes with item changes and one for scenes with relational changes (see Figure 4B). A repeated measures ANOVA, with factors for the group (autistic, non-autistic), scene type (item change, relational change), and their interaction, was calculated. There was a marginal effect of group, F (1, 36) = 3.53, p = 0.07, ηp2 = 0.09, but neither the main effect of scene type nor the interaction was significant, F’s ≤ 1.53, p’s ≥ 0.22, ηp2’s ≤ 0.04. As was done by Cooper et al. (2015), independent samples t-tests were calculated to determine whether the group difference was significant for item changes, relational changes, or both. There was no significant group difference in corrected recognition scores sensitive to memory for item changes, t (36) = 1.46, p = 0.15, Cohen’s d = 0.48, BF01 = 1.69. There was, however, a significant group difference in corrected recognition scores sensitive to relational memory, t (36) = 2.10, p = 0.04, Cohen’s d = 0.68, BF01 = 0.67. This group difference in relational memory was marginal after adjusting for age and gender, F (1, 34) = 3.83, p = 0.059, ηp2 = 0.10.
3.1.2.3. High confidence recognition
Since specific weaknesses in recollection and high-confidence responding are reported in autism (e.g., Bowler et al., 2007; Cooper et al., 2015), we also examined whether group differences in memory for scenes and memory for scene detail were evident when analyses were limited to trials with high-confidence responses (see Figure 5). Two participants, one from each group, were excluded from the memory for scenes analysis because there were either no high-confidence hits for novel scenes or no high-confidence false alarms for repeated and modified scenes. Results from an independent samples t-test indicated that there was not a significant group difference in memory for scenes, t (34) = 1.20, p = 0.24, Cohen’s d = 0.40, BF01 = 2.22 (see Figure 5A).
Figure 5. Recognition memory for scenes and scene details for high confidence correct trials. (A) Memory for scenes (percentage of novel hits – percentage of novel false alarms) by group, limited to scenes identified correctly and with high confidence. (B) Memory for scene details (percentage of modified hits – percentage of modified false alarms) by group and scene type, limited to scenes identified correctly and with high confidence. Error bars represent standard error of the mean.
Next, we examined high-confidence memory for scene detail. Two autistic participants were excluded from this analysis. One participant did not have any high-confidence hits for scenes with an item change, and the other participant did not have any high-confidence hits for either type of manipulated scene. In addition, because several participants did not have any high-confidence false alarms to repeated scenes (i.e., repeated scenes called “modified), the false alarm rate was calculated by including novel scenes (i.e., both repeated and novel scenes called “modified” with high confidence were included in the calculated false alarm rate). Results from a repeated measures ANOVA revealed marginal effects of scene type (item change, relational change), F (1, 34) = 3.07, p = 0.09, ηp2 = 0.08, and group (autistic, non-autistic), F (1, 34) = 3.86, p = 0.06, ηp2 = 0.10, but the interaction was not significant, F (1, 34) = 0.08, p = 0.79, ηp2 = 0.002. As above, results from independent samples t-tests indicated that there was a significant group difference in relational memory, t (34) = 2.16, p = 0.04, Cohen’s d = 0.72, BF01 = 0.60, but not item memory, t (34) = 1.67, p = 0.11, Cohen’s d = 0.56, BF01 = 1.27 (see Figure 5B). In this case, the group difference for relational memory remained significant after adjusting for age and gender, F (1, 32) = 4.49, p = 0.042, ηp2 = 0.12.
3.2. Viewing behavior
3.2.1. Study blocks
One objective of this work was to determine whether there were group differences in viewing behavior during encoding that might correspond to differences in the operation of cognitive processes that can affect memory performance (e.g., attention to critical scene regions). Two measures were used to examine between-groups differences in scene viewing during the study blocks: number of scene fixations and proportion of total viewing time directed to the filled critical region of encoded scenes.
3.2.1.1. Number of fixations to studied scenes
First, we calculated the average number of fixations to whole scenes, collapsed across conditions, and without considering specific regions of interest. For Study Block 1, there was not a significant difference in the average number of scene fixations between autistic (M = 24.44, SD = 3.59) and non-autistic participants (M = 22.98, SD = 2.70), t (36) = 1.43, p = 0.16, Cohen’s d = 0.46, BF01 = 1.75. However, for Study Block 2, autistic participants (M = 15.39, SD = 1.41) made significantly more fixations to scenes than non-autistic participants (M = 13.87, SD = 1.69), t (36) = 2.98, p = 0.005, Cohen’s d = 0.98, BF01 = 0.12. The overall decrease (for both groups) in the number of fixations across study blocks is at least in part due to the reduction in scene presentation time (i.e., 8 s in Study Block 1 versus 5 s in Study Block 2).
3.2.1.2. Proportion of total viewing time to the filled critical region of studied scenes
Next, we examined whether there were differences in the proportion of total viewing time directed to the filled critical region of studied scenes – the location occupied by an object. We did not examine the proportion of total viewing time to empty critical regions because they were not meaningful (i.e., had never been occupied by an object) at this point in the experiment. For this analysis, all of the studied scenes, regardless of whether they went on to be repeated or manipulated during test, were subdivided by the type of orienting question (item-specific, relational) they were paired with during Study Block 2. Repeated measures ANOVAs with the factors group (autistic, non-autistic) and question type (item-specific, relational) were calculated separately for Study Block 1 and Study Block 2.
In Study Block 1 (see Figure 6A), there were no significant main effects or interactions, F’s ≤ 1.15, p’s ≥ 0.29, ηp2’s ≤ 0.031. Bayes factors were in favor of the null hypothesis – i.e., no group differences in the proportion of total viewing time directed to the filled region of scenes paired with item-specific or relational questions, BF01 = 3.65 and BF01 = 3.23, respectively.
Figure 6. Proportion of total viewing time directed to the filled critical region of to-be-manipulated scenes in (A) Study Block 1 and (B) Study Block 2, subdivided by group and question type. Error bars represent standard error of the mean.
In Study Block 2 (see Figure 6B), there was a significant main effect of question type, F (1, 36) = 41.56, p < 0.001, ηp2 = 0.54, with more viewing directed to the filled region for scenes paired with item-specific than relational questions. There was no significant main effect of group and no significant interaction, F’s ≤ 0.80, p’s ≥ 0.38, ηp2’s ≤ 0.022. Bayes factors indicated that the data were inconclusive regarding group differences in viewing directed to the filled region of scenes paired with item-specific questions, BF01 = 2.66, but were in favor of the null hypothesis for scenes paired with relational questions, BF01 = 3.54.
As can be seen in Figure 6, the proportion of total viewing time directed to the filled critical region was greater in Study Block 2 than in Study Block 1. This is because orienting questions, used in Study Block 2, required participants to inspect the critical objects and/or their relative locations. Reduced viewing of the filled critical region for scenes paired with relational (versus item-specific) orienting questions in Study Block 2 likely occurs because these questions encouraged exploration of an object relative to something else in the scene. In contrast, item-specific orienting questions asked about characteristics of the object itself.
3.2.1.3. High confidence proportion of total viewing time to the filled critical region
To determine whether there were any between-groups differences in viewing directed to the filled critical region of studied scenes that went on to be correctly recognized and endorsed with high confidence, we backsorted the study phase data by test block performance. In other words, we binned study trials by subsequent test phase accuracy (i.e., correct, incorrect) and recognition confidence (i.e., high, middle, low). This analysis was limited to scenes that would go on to be modified in the test block. Repeated scenes were excluded because several participants did not have any high-confidence correct recognition responses in the repeated scene condition. In addition, two participants from the autistic group were excluded from these backsorted analyses. In one case, there were no high-confidence correct responses to scenes with item changes; in the other case, there were no high-confidence correct responses to any of the manipulated scenes. Repeated measures ANOVAs with the factors scene type (item, relational) and group (autistic, non-autistic) were calculated separately for Study Block 1 and Study Block 2.
In Study Block 1 (see Figure 7A), there was no difference in the proportion of total viewing time directed to the filled region across question types or groups, F’s ≤ 0.06, p’s ≥ 0.81, ηp2’s ≤ 0.002, nor was there a significant interaction, F (1, 34) = 0.009, p = 0.92, ηp2 < 0.0001. As when analyses were based on all trials, Bayes factors were in favor of the null hypothesis – i.e., no group differences in the proportion of total viewing time directed to the filled region of scenes accompanied by item-specific or relational questions, BF01 = 4.02 and BF01 = 4.08, respectively.
Figure 7. Proportion of total viewing time directed to the filled critical region of to-be-manipulated scenes in (A) Study Block 1 and (B) Study Block 2, subdivided by group and question type, and limited to the subset of scenes identified correctly and with high confidence. Error bars represent standard error of the mean.
In Study Block 2 (see Figure 7B), there was a significant effect of question type, F (1, 34) = 26.05, p < 0.001, ηp2 = 0.43, but there was not a significant group effect or a question type by group interaction, F’s ≤ 2.45, p’s ≥ 0.13, ηp2’s ≤ 0.067. As when analyses were based on all trials, Bayes factors indicated that the data were inconclusive regarding group differences in viewing directed to the filled region of scenes associated with item-specific questions, BF01 = 2.16, but were in favor of the null hypothesis for scenes paired with relational questions, BF01 = 3.94.
Once again, more time was spent looking at the filled region of scenes paired with item-specific questions than with relational questions, likely due to differences in processing requirements associated with these types of questions (see Figure 7).
3.2.2. Test block
Another major objective of this work was to assess group differences in viewing behavior during the test phase. As described above, we calculated two difference scores – memory for repetition (repeated scene viewing minus novel scene viewing) and memory for detail (modified scene viewing minus repeated scene viewing) – to examine viewing patterns during test. Difference scores were calculated for two eye-movement measures: proportion of total viewing time directed to critical scene region(s) and the duration of the first gaze (in ms) made to the filled region. Independent samples t-tests were calculated to compare the proportion of total viewing time directed to the filled critical region in item scenes, the filled critical region in relational scenes, and the empty critical region in relational scenes for the proportion of viewing time measure. First gaze analyses were limited to the filled region.
3.2.2.1. Proportion of viewing time to filled and empty critical regions of test scenes
First, we examined differences in the proportion of total viewing time to critical regions of test scenes. For scenes in the item condition, there were no significant group differences in repetition- or detail-based proportion of total viewing time to the filled critical region, t’s ≤ 1.26, p’s ≥ 0.22, Cohen’s d’s ≤ 0.43, BF01 = 3.36 and 2.13, respectively. Likewise, for scenes in the relational condition, there were no significant group differences in repetition- or detail-based proportion of total viewing time to either the filled or empty critical region, t’s ≤ 1.14, p’s ≥ 0.26, Cohen’s d’s ≤ 0.38, BF01 repetition filled = 4.17, BF01 repetition empty = 3.82, BF01 detail filled = 2.40, BF01 detail empty = 4.21. As can be seen in Figure 8A, participants from both groups spent more time looking at the critical region(s) of repeated scenes than the same region(s) of novel scenes (i.e., positive-going difference scores), a likely consequence of the orienting questions during encoding. Participants from both groups also spent more time looking at the critical region(s) of manipulated scenes than the same region(s) of repeated scenes (i.e., positive-going difference scores), an index of memory for scene detail, as illustrated in Figure 8B.
Figure 8. Proportion of total viewing time directed to critical regions of scenes for (A) Memory for Repetition index (viewing to repeated scenes – viewing to novel scenes) and (B) Memory for Detail index (viewing to manipulated scenes – viewing to repeated scenes), subdivided by group, scene type, and critical region for scenes presented during Test Block. Error bars represent standard error of the mean.
3.2.2.1.1. High confidence proportion of total viewing time to filled and empty regions
Targeted analyses were performed to examine whether there were any viewing time differences for scenes correctly recognized and endorsed with high confidence (see Figure 9). For this analysis, like before, data from 16 autistic participants and 20 non-autistic participants were included. As above, two autistic participants were dropped from the analysis because there were no high-confidence correct trials for modified scenes with item or item and relational manipulations. Furthermore, difference scores (i.e., memory for repetition and detail) were not calculated for the high-confidence analyses because several participants from both groups identified fewer than 3 repeated scenes correctly with high confidence. Therefore, these analyses were based on proportion of total viewing time to the critical region(s) of modified scenes recognized correctly with high-confidence responses. Results from an independent-samples t-test indicated that there was not a significant group difference in the proportion of total viewing time directed to the filled region of scenes with an item change, t (34) = 1.15, p = 0.26, Cohen’s d = 0.33, BF01 = 2.32, but that this difference was marginal for the filled region of scenes with a relational change, t (34) = 1.90, p = 0.066, Cohen’s d = 0.61, BF01 = 0.91. The proportion of total viewing time was lower for the autistic group than for the non-autistic group. There was no significant group difference in proportion of viewing to the empty critical region, t (34) = 0.77, p = 0.45, Cohen’s d = 0.25, BF01 = 3.17. The group difference in the relational condition for the filled region became significant after adjusting for age and gender, F (1, 32) = 4.21, p = 0.048, ηp2 = 0.12.
Figure 9. Proportion of total viewing time directed to critical regions of scenes, subdivided by group, scene type, and critical region for scenes presented during Test Block, and limited to scenes that were identified correctly with high confidence. Error bars represent standard error of the mean.
3.2.2.2. First gaze duration to the filled region of test scenes
We also examined differences in the duration of the first gaze made to the filled critical region (see Figure 10). For scenes in the item condition, there were no significant group differences in the duration of the first gaze directed to the filled critical region for the repetition-based difference score or the detail-based difference score, t’s ≤ 0.41, p’s ≥ 0.69, Cohen’s d’s ≤ 0.13, BF01’s ≥ 3.91. For scenes in the relational condition, there was no significant group difference in first gaze for the repetition-based difference score, t (36) = 0.93, p = 0.72, Cohen’s d = 0.30, BF01 = 2.88, but there was a marginal group difference in duration of first gaze for the detail-based difference score, t (36) = 1.88, p = 0.068, Cohen’s d = 0.62, BF01 = 0.94, with non-autistic participants spending more time looking at the now-filled regions relative to autistic participants. This group difference for detail-based viewing in the relational condition remained marginally significant after adjusting for age and gender, F (1, 34) = 2.96, p = 0.095, ηp2 = 0.080.
Figure 10. First gaze duration (ms) to filled critical region of scenes for (A) Memory for Repetition index (viewing to repeated scenes – viewing to novel scenes) and (B) Memory for Detail index (viewing to manipulated scenes – viewing to repeated scenes), subdivided by group and scene type for scenes presented during Test Block. Error bars represent standard error of the mean.
3.2.2.2.1. High confidence first gaze duration to the filled region
Analyses were performed to determine whether there were differences in first gaze duration toward scenes that were identified correctly with high confidence (see Figure 11). As above, two autistic participants were dropped from this analysis, and difference scores were not calculated because there were so few high-confidence trials for repeated scenes. For scenes with an item change, there was no significant group difference in duration of first gaze, t (34) = 0.92, p = 0.36, Cohen’s d = 0.30, BF01 = 2.84. However, there remained a marginal group difference in first gaze to the filled region for scenes with relational changes, t (34) = 1.91, p = 0.065, Cohen’s d = 0.65, BF01 = 0.89. This group difference in the relational condition remained marginal after adjusting for age and gender, F (1, 32) = 3.03, p = 0.091, ηp2 = 0.087.
Figure 11. First gaze duration (ms) to the filled critical region of scenes, subdivided by group and scene type during Test Block, and limited to scenes identified correctly and with high confidence. Error bars represent standard error of the mean.
3.3. Correlation analyses
Pearson’s correlations (r) were calculated to determine whether viewing time to the filled critical region during the study blocks was associated with memory-based (i.e., detail-based) viewing effects and/or recognition performance in the test block. For this set of analyses the average proportion of total viewing time to the filled region of studied scenes was calculated separately for scenes paired with item-specific and relational orienting questions, collapsed across study blocks, for each participant. This grand average (i.e., proportion of total viewing time directed to the filled region during the study phase) was used in all reported analyses. Two test block measures were used to determine whether study phase viewing time was correlated with test block viewing directed to the filled critical region for item-specific and relational scenes separately. These two measures were the memory for detail difference scores for 1) proportion of viewing time and 2) first gaze duration, which provide us an estimate of viewing time to the critical region due to memory for the original item or the spatial position of the critical item in the test block. Corrected recognition scores for scenes with an item and relational change were also included in the correlation analyses.
3.3.1. Correlations between study and test viewing
First, we compared study and test viewing patterns. For scenes containing an item change, there were no significant correlations between study and test phase viewing patterns for either autistic participants, r’s ≤ 0.34, p’s ≥ 0.17, or non-autistic participants, r’s ≤ 0.16, p’s ≥ 0.50. Additionally, there were no significant correlations between study and test phase viewing for scenes containing a relational change for autistic participants, r’s ≤ 0.25, p’s ≥ 0.32, or non-autistic participants, r’s ≤ 0.24, p’s ≥ 0.30. Unsurprisingly, there were no significant group differences in correlations between study and testing viewing patterns, z’s ≤ 0.54, p’s > 0.05.
3.3.2. Correlations between study viewing and recognition performance
Next, we calculated correlations between study viewing patterns and test recognition memory. For scenes that underwent an item change, there was a significant positive correlation between study viewing and item memory for non-autistic participants, r = 0.51, p = 0.022, but no significant correlation for autistic participants, r = −0.20, p = 0.43. In contrast, for scenes that underwent a relational change, there was a marginal negative correlation between study viewing and relational memory for autistic participants, r = −0.45, p = 0.059, but no significant correlation for non-autistic participants, r = 0.19, p = 0.43. However, only the correlation between study viewing and item recognition memory was significantly different between groups, z = −2.16, p < 0.05. All other between-group differences in these correlations were not significant, z’s ≤ 1.91, p’s > 0.05.
3.3.3. Correlations between PSM scores, test viewing, and recognition performance
Finally, we calculated Pearson’s correlations to compare Picture Sequence Memory Test (PSM) scores with item-specific and relational corrected recognition memory scores and detail-based (i.e., memory-based) viewing patterns during the Test Block. There was a significant positive correlation between PSM scores and item memory for non-autistic participants, r = 0.44, p = 0.051, but not for autistic participants, r = −0.16, p = 0.53. In contrast, there was a significant negative correlation between PSM scores and first gaze duration for scenes in the relational condition for autistic participants, r = −0.53, p = 0.025, but not for non-autistic participants, r = −0.11, p = 0.64. None of the between-group differences in these correlations were significant, z’s ≤ 1.79, p’s > 0.05.
4. Discussion
The current study examined whether memory-specific viewing patterns to realistic, non-social scenes differed between autistic and non-autistic individuals. Here, we employed an eye-tracking paradigm that equated difficulty across item-specific and relational conditions (i.e., Hannula et al., 2010b; Cooper et al., 2015) to control for potential differences in task complexity that may have contributed to past findings. In addition, we used both direct (i.e., explicit responses) and indirect (i.e., eye movements) measures of memory to examine performance. Orienting question accuracy was not significantly different between groups during Study Block 2, suggesting that both groups attended to relevant scene regions when prompted. In Study Block 2, autistic individuals made more scene fixations than non-autistic participants, but there was no evidence for differential viewing of the filled critical region across groups in either study block. Therefore, this difference in total number of scene fixations did not affect time spent viewing the scene region that would be modified in the item and relational conditions during test.
Behaviorally, both autistic and non-autistic participants could distinguish between studied and non-studied scenes. While there was no significant difference in accuracy for scenes that underwent an item change, autistic participants showed a marginal reduction in relational memory accuracy across all trials and a significant reduction in relational memory accuracy for high-confidence trials relative to their non-autistic peers. Additionally, evaluation of the eye-tracking data indicated that both groups showed evidence of memory-based viewing effects (i.e., greater viewing of filled regions of modified scenes relative to analogous regions of yoked novel and repeated scenes) during test. However, autistic individuals spent a marginally smaller proportion of total viewing time on, and demonstrated marginally shorter initial gazes toward, relational changes in scenes relative to their non-autistic counterparts for all trials (for the gaze duration index) and for high-confidence trials (for both the proportion of total viewing time and gaze duration indices). Further, the group difference in proportion of total viewing time for high-confidence trials was significant when adjustments were made for age and gender. Taken together, our recognition and eye-movement measures provide converging evidence for a selective weakness in relational memory in autism.
Correlational analyses revealed no significant between-group differences in associations between performance on a standardized episodic memory task (i.e., Picture Sequence Memory Test) and viewing during test or recognition memory. However, viewing patterns during the study phase were correlated with subsequent recognition accuracy, as has been reported previously (Loth et al., 2011; Ring et al., 2017; Cooper et al., 2017a). Specifically, for scenes assigned to the item condition, there was a positive association between critical region viewing during the study phase and the successful recognition of scenes with item-specific changes for the non-autistic group, but no similar effect for the autistic group, and this between-groups difference was statistically significant. In contrast, there was a marginal, negative association between study phase viewing and relational memory for the autistic group, though here, there was not a significant between-groups difference. Overall, these outcomes suggest that viewing patterns during encoding may not always predict test phase outcomes in the same way and/or to the same degree in autistic and non-autistic participants, as reported previously by Cooper et al. (2017a).
As outlined above, past work demonstrates that episodic memory processes are atypical in autism. However, the type of representational content impacted by episodic memory difficulties is contested, with some authors reporting weaknesses restricted to item-specific memory (Solomon et al., 2016; Cooper et al., 2017a) and others reporting selective relational memory difficulties (Lind and Bowler, 2009; Bigham et al., 2010; Bowler et al., 2014; Cooper et al., 2017b; Desaunay et al., 2020b), weaknesses in both item and relational memory (Massand and Bowler, 2015; Ring et al., 2016; Semino et al., 2018; Mogensen et al., 2020), or no item-specific or relational memory difficulties (Souchay et al., 2013; Lind et al., 2014; Ring et al., 2015, 2017; Hogeveen et al., 2020). One proposed explanation for contradictory findings is the differential complexity of past item-specific and relational memory tasks (see Cooper and Simons (2019) for review), an issue that Cooper et al. (2015) attempted to address by utilizing a behavioral task that ours is similar to, with materials developed to equate item-specific and relational memory processing demands. Their work showed that autistic individuals identified fewer scenes with item and relational changes than their non-autistic peers, a finding taken as evidence for a potential weakness in both item-specific and relational memory (Cooper et al., 2015).
Because task demands of the current study were closely matched to Cooper et al. (2015), one may question why we only observed group differences in relational recognition performances rather than in both item-specific and relational recognition performances. Importantly, it should be noted that the sample size of the current study was sufficient to detect large effect sizes (d = 0.9) but may have been underpowered to detect more subtle effects. However, we did observe significant and marginal group differences in relational memory and memory-based viewing effects for scenes with a relational change. Further, Cooper et al. (2015) reported larger effect sizes for their item memory group differences as compared to their relational memory group differences. Thus, our sample size should have been sufficient to detect a group difference in both item and relational memory. It is possible that the addition of a second study block, which provided participants with a directed viewing task (i.e., via orienting questions) as well as a second opportunity to view scenes, mitigated attentional or executive processing difficulties that would have otherwise impacted explicit recognition memory for items in the autistic group in our study. Indeed, this hypothesis aligns with past work demonstrating improvements in recognition memory performance in autistic participants when explicit encoding instructions are provided (Gaigg et al., 2008; Bowler et al., 2010; Cooper et al., 2017a) and is consistent with the task support hypothesis, which proposes that autistic individuals’ memory improves when they are provided with “supports” during a memory task (e.g., cues in a recognition memory paradigm; Bowler et al., 2004). However, despite the use of a controlled encoding task here, relational memory could not be rescued in the autistic group relative to the non-autistic group, an outcome consistent with past findings that suggest relational memory is selectively or disproportionately compromised in autistic individuals (Lind and Bowler, 2009; Bigham et al., 2010; Bowler et al., 2014; Cooper et al., 2017b; Desaunay et al., 2020b). The group difference in relational recognition accuracy was marginal when all of the trials were included in our analyses and significant for high-confidence trials, which reinforces prior reports that autistic persons show attenuated memory confidence for correct memories (Wojcik et al., 2013; Grainger et al., 2014; Cooper et al., 2016). Importantly, significant group differences in memory confidence judgments were limited to measures that were sensitive to relational memory in the current study, a finding similar to past work that has documented reduced high-confidence, recollection-related memory in autism (Bowler et al., 2007; Cooper et al., 2015, 2017a).
A strength of the current experiment was the use of eye-tracking methods during both study and test blocks. In contrast to discrete recognition responses, eye-tracking data is recorded continuously, allowing us to examine how scenes are viewed during encoding and retrieval. Of the few previous eye-tracking studies examining encoding-related viewing behavior, none reported differences between autistic and non-autistic groups (Loth et al., 2011; Cooper et al., 2017a). This result was generally replicated here, as there was not a significant group difference in proportion of total viewing time directed to the critical object in either study block. One possibility is that well-matched viewing patterns during the study phase means that the scenes were processed comparably by participants from both groups. However, it is also possible that, while viewing patterns are similar, the depth of processing between groups, in the absence of specific task instructions, is not. The orienting questions in our experiment may have been instrumental in this regard, encouraging participants to pay close attention to the very same details of scenes that might be modified at test. Future studies, with larger sample sizes, should systematically manipulate the use of orienting questions to further examine whether and how they affect recognition performance and eye-movement-based memory effects in autism.
In contrast to results from encoding, subtle differences in retrieval-related eye movements were observed for autistic participants in the present study, in a manner that was consistent with the relational memory weakness observed in recognition memory accuracy. Past eye-tracking studies documented differences in memory-based eye-movement behaviors (Ring et al., 2017; Cooper et al., 2017a). Specifically, in a relational memory paradigm, it was reported that autistic participants spent less time viewing critical scene regions as compared to their non-autistic counterparts (Ring et al., 2017). While memory-based viewing results in our experiment trended in the same general direction, with autistic participants showing reduced viewing to critical regions associated with a relational change, our group differences were relatively small and were sometimes only observed when we analyzed high-confidence responses separately. Several factors may account for the difference in the strength of this effect between our current work and previous findings. One possibility is that our results did not reach statistical significance due to low statistical power (e.g., Bayes factors that indicated evidence for group differences was inconclusive). However, another possibility is that differences in the demands of the retrieval tasks in previously published studies and our current study affected the outcomes. For instance, participants were required to switch between two different retrieval tasks in Ring et al.’s (2017) study. Sometimes, they had to place a presented object in the location where it had been studied in the scene previously (on “explicit” trials), and sometimes they had to avoid that location, placing the object in a new spot (on “implicit” trials). This kind of task-switching may have placed greater demands on other cognitive functions, such as cognitive flexibility (i.e., set shifting), which seems to be a weakness for autistic individuals (e.g., Van Eylen et al., 2011; Andreou et al., 2022; although see Geurts et al., 2009). Importantly, results from our study suggest that eye-movement-based relational memory effects are modestly impaired even in the absence of task-switching demands and even when the encoding task encourages processing of the very same relationships that are changed during the test phase. Collectively then, these results provide converging evidence for a selective reduction in viewing effects that are sensitive to relational memory in autism.
Consistent with previous results showing differences in high confidence responding or recollection (Bowler et al., 2007; Cooper et al., 2015, 2017a) as well as with explicit recognition results reported here, when high confidence recognition trials were examined separately, marginal group differences remained and/or emerged in relational, memory-based viewing at test. These viewing time differences suggest that even when relational scenes are identified correctly with high confidence at test, there may be differences in how relationships amongst scene elements are processed by autistic individuals. Specifically, autistic individuals demonstrated a reduction in proportion of total viewing time directed to the filled region of scenes that contained a relational change and also showed shorter initial gaze durations toward critical regions of those scenes. Together with significant reductions in recognition performance for this same set of relational scenes, our results support the hypothesis that there is a disruption in recollection-related retrieval processes in autism, which appear to be selective to relational memory (Cooper et al., 2017a). Therefore, subtle differences in retrieval-related relational memory processes and/or the quality of relational memory representations (e.g., subjective quality) may exist, consistent with findings reported in past work (Lind and Bowler, 2009; Bigham et al., 2010; Bowler et al., 2014; Cooper et al., 2017b; Desaunay et al., 2020b). Of note, other processing differences, such as group differences in criteria for confidence judgments or group differences in mnemonic cues used to make confidence judgments, could partially explain the marginal effects that emerged during analysis of high-confidence trials. However, these explanations are unable to fully account for intact effects in the item-specific condition and results from the relational condition based on the full set of trials, which also provided evidence for a relational memory weakness for autistic participants.
Importantly, the absence of group differences in item-specific memory in our work should not be taken as evidence for equivalent memory processes in autistic and non-autistic individuals. For example, despite explicit memory performances that appear comparable between autistic and non-autistic individuals, electrophysiological studies report differences in magnitude and/or spatial location of event-related potentials (ERPs) associated with memory retrieval (Massand et al., 2013; Massand and Bowler, 2015; Desaunay et al., 2020b) and imaging studies document hyper-recruitment and connectivity differences between autistic and non-autistic individuals (Hogeveen et al., 2020), suggesting that compensatory neural processes may contribute to seemingly intact behavioral memory performances. Indeed, the results of correlation analyses in the present study were suggestive of processing differences between groups. Consistent with prior work (e.g., Cooper et al., 2017a), we observed a relationship between viewing during study and subsequent recognition performances. However, these relationships were different between the autistic and non-autistic groups. For example, the correlation between viewing during study and item recognition in non-autistic individuals was absent for the autistic group. Further, though the association was not significantly different between groups, the direction of a marginally significant association between viewing during study and relational memory for the autistic group was opposite that which we might expect, with a smaller proportion of viewing toward the critical region during study being associated with better relational memory in the autistic group. Altogether, these findings suggest that correlations between indirect and direct measures of memory may be sensitive to subtle differences between groups that are not observed when these types of measures are examined separately.
Several limitations of the current study should be considered. First, specific characteristics of the sample included here may have impacted our findings. For example, the autistic individuals who participated in this study were without co-morbid intellectual disability diagnoses (IQ ≥ 70); thus, results may not be generalizable to an autistic population with intellectual disability. Further, the age range of participants, spanning from adolescence to young adulthood in both groups, may have obscured or attenuated episodic memory differences between groups. Notably, the neural circuits associated with memory continue to develop from early childhood and adolescence to adulthood (Naveh-Benjamin, 2000; Grady et al., 2003; DeMaster et al., 2014). Therefore, it is possible that item memory weaknesses, for example, may only emerge later in adulthood for autistic individuals, when development of these networks is more fully matured. With these caveats in mind, the current study contributes to the growing body of evidence that documents disproportionate relational memory difficulties in autism, even when structured encoding conditions are provided and the complexity of memory tasks is equated. In future work, indirect measures of memory (i.e., eye movements) and judgments of mnemonic accuracy should be simultaneously collected because more subtle group differences may emerge when limiting analyses to high-confidence responses.
In conclusion, relational memory differences between autistic and non-autistic individuals persist, even with a controlled encoding task, and direct and indirect memory indices are useful in fully characterizing these nuanced memory effects. Reductions in recognition accuracy and memory-based viewing in the autistic group, for high confidence and correctly identified relational scenes in particular, suggest that previously reported relational memory weaknesses may have been accurately identified in past work, consistent with the relational binding account of episodic memory in autism (Bowler et al., 2011). Further, differences in the association between study phase viewing and recognition accuracy between groups suggest dissimilarities in underlying processes that contribute to learning and/or retrieval of learned information for autistic and non-autistic individuals. Taken together, our findings suggest differences in the integrity of relational memory representations and/or the relationships between memory subcomponents in autism.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by UC Davis Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. Written informed consent for participation in this study was provided by the participants’ legal guardians/next of kin.
Author contributions
GM: methodology, software, formal analysis, visualization, writing – original draft, and writing – review and editing. DH: methodology, software, formal analysis, visualization, writing – original draft, writing – review and editing, and supervision. AG: investigation and writing – review and editing. A-MI: formal analysis and writing – review and editing. JR: writing – review and editing. MS: funding acquisition (NIMH #1R01MH106518), project administration, writing – review and editing, and supervision. All authors contributed to the article and approved the submitted version.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Akshoomoff, N., Beaumont, J. L., Bauer, P. J., Dikmen, S. S., Gershon, R. C., Mungas, D., et al. (2013). NIH Toolbox Cognition battery (CB): Composite scores of crystallized, fluid, and overall cognition. Monogr. Soc. Res. Child. Dev. 78, 119–132. doi: 10.1111/mono.12038
Althoff, R. R., and Cohen, N. J. (1999). Eye-movement based memory effect: A reprocessing effect in face perception. J. Exp. Psychol. 25, 997–1010. doi: 10.1037//0278-7393.25.4.997
American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (5th). American Psychiatric Publishing. Washington, DC
Andreou, M., Konstantopoulos, K., and Peristeri, E. (2022). Cognitive flexibility in autism: Evidence from young autistic children. Autism Res. 15, 2296–2309. doi: 10.1002/aur.2828
Banker, S. M., Gu, X., Schiller, D., and Foss-Feig, J. H. (2021). Hippocampal contributions to social and cognitive deficits in autism spectrum disorder. Trends Neurosci. 44, 793–807. doi: 10.1016/j.tins.2021.08.005
Barnea-Goraly, N., Frazier, T. W., Piacenza, L., Minshew, N. J., Keshavan, M. S., Reiss, A. L., et al. (2014). A preliminary longitudinal volumetric MRI study of amygdala and hippocampal volumes in autism. Prog. Neuropsychopharmacol. Biol. Psychiatry. 48, 124–128. doi: 10.1016/j.pnpbp.2013.09.010
Bauman, M., and Kemper, T. (2005). Neuroanatomic observations of the brain in autism: A review and future directions. Int. J. Dev. Neurosci. 23, 183–187. doi: 10.1016/j.ijdevneu.2004.09.006
Belmonte, M. K., and Yurgelun-Todd, D. A. (2003). Functional anatomy of impaired selective attention and compensatory processing in autism. Cogn. Brain Res. 17, 651–664. doi: 10.1016/S0926-6410(03)00189-7
Ben Shalom, D. (2003). Memory in autism: Review and synthesis. Cortex 39, 1129–1138. doi: 10.1016/S0010-9452(08)70881-5
Bigham, S., Boucher, J., Mayes, A., and Anns, S. (2010). Assessing recollection and familiarity in autistic spectrum disorders: Methods and findings. J. Autism Dev. Disord. 40, 878–889. doi: 10.1007/s10803-010-0937-7
Blumenfeld, R. S., and Ranganath, C. (2007). Prefrontal cortex and long-term memory encoding: an integrative review of findings from neuropsychology and neuroimaging. Neuroscientist 13, 280–291. doi: 10.1177/1073858407299290
Boucher, J. (1981). Immediate free recall in early childhood autism: Another point of behavioural similarity with the amnesic syndrome. Br. J. Psychol. 72, 211–215. doi: 10.1111/j.2044-8295.1981.tb02177.x
Boucher, J., Mayes, A., and Bigham, S. (2012). Memory in autistic spectrum disorder. Psychol. Bull. 138, 458–496. doi: 10.1037/a0026869
Boucher, J., and Warrington, E. K. (1976). Memory deficits in early infantile autism: Some similarities to the amnesic syndrome. Br. J. Psychol. 67, 73–87. doi: 10.1111/j.2044-8295.1976.tb01499.x
Bowler, D. M., Gaigg, S. B., and Gardiner, J. M. (2010). Multiple list learning in adults with autism spectrum disorder: Parallels with frontal lobe damage or further evidence of diminished relational processing? J. Autism Dev. Disord. 40, 179–187. doi: 10.1007/s10803-009-0845-x
Bowler, D. M., Gaigg, S. B., and Gardiner, J. M. (2014). Binding of multiple features in memory by high-functioning adults with autism spectrum disorder. J. Autism Dev. Disord. 44, 2355–2362. doi: 10.1007/s10803-014-2105-y
Bowler, D., Gaigg, S., and Lind, S. (2011). “Memory in autism: Binding, self and brain” in Research the Autism Spectrum: Contemporary Perspectives. eds. I. Roth and P. Rezaie (Cambridge: Cambridge University Press), 316–346.
Bowler, D. M., Gardiner, J. M., and Berthollier, N. (2004). Source memory in adolescents and adults with Asperger’s syndrome. J. Autism Dev. Disord. 34, 533–542. doi: 10.1007/s10803-004-2548-7
Bowler, D. M., Gardiner, J. M., and Gaigg, S. B. (2007). Factors affecting conscious awareness in the recollective experience of adults with Asperger’s syndrome. Conscious. Cogn. 16, 124–143. doi: 10.1016/j.concog.2005.12.001
Bowler, D. M., Matthew, N. J., and Gardiner, J. M. (1997). Asperger’s syndrome and memory: Similarity to autism but not amnesia. Neuropsychologia 35, 65–70. doi: 10.1016/S0028-3932(96)00054-1
Burack, J. A. (1994). Selective attention deficits in persons with autism: Preliminary evidence of an inefficient attentional loss. J. Abnorm. Psychol. 103, 535–543. doi: 10.1037/0021-843X.103.3.535
Cabeza, R., Ciaramelli, E., Olson, I. R., and Moscovitch, M. (2008). The parietal cortex and episodic memory: An attentional account. Nat. Rev. Neurosci. 9, 613–625. doi: 10.1038/nrn2459
Chita-Tegmark, M. (2016). Attention allocation in ASD: A review and meta-analysis of eye-tracking studies. Res. Dev. Disabil. 3, 209–223. doi: 10.1007/s40489-016-0077-x
Ciaramelli, E., Faggi, G., Scarpazza, C., Mattioli, F., Spaniol, J., Ghetta, S., et al. (2017). Subjective recollection independent from multifeatural context retrieval following damage to the posterior parietal cortex. Cortex 91, 114–125. doi: 10.1016/j.cortex.2017.03.015
Cooper, R. A., Plaisted-Grant, K. C., Baron-Cohen, S., and Simons, J. S. (2016). Reality monitoring and metamemory in adults with autism spectrum conditions. J. Autism Dev. Disord. 46, 2186–2198. doi: 10.1007/s10803-016-2749-x
Cooper, R. A., Plaisted-Grant, K. C., Baron-Cohen, S., and Simons, J. S. (2017a). Eye movements reveal a dissociation between memory encoding and retrieval in adults with autism. Cognition 159, 127–138. doi: 10.1016/j.cognition.2016.11.013
Cooper, R. A., Plaisted-Grant, K. C., Hannula, D. E., Ranganath, C., Baron-Cohen, S., and Simons, J. S. (2015). Impaired recollection of visual scene details in adults with autism spectrum conditions. J. Abnorm. Psychol. 124, 565–575. doi: 10.1037/abn0000070
Cooper, R. A., Richter, F. R., Bays, P. M., Plaisted-Grant, K. C., Baron-Cohen, S., and Simons, J. S. (2017b). Reduced hippocampal functional connectivity during episodic memory retrieval in autism. Cereb. Cortex 27, 888–902. doi: 10.1093/cercor/bhw417
Cooper, R. A., and Simons, J. S. (2019). Exploring the neurocognitive basis of episodic recollection in autism. Psychon. Bull. Rev. 26, 163–181. doi: 10.3758/s13423-018-1504-z
Davachi, L. (2006). Item, context and relational episodic encoding in humans. Curr. Opin. Neurobiol. 16, 693–700. doi: 10.1016/j.conb.2006.10.012
Davachi, L., Mitchell, J. P., and Wagner, A. D. (2003). Multiple routes to memory: Distinct medial temporal lobe processes build item and source memories. Proc. Natl. Acad. Sci. U. S. A. 100, 2157–2162. doi: 10.1073/pnas.0337195100
DeMaster, D., Pathman, T., Lee, J. K., and Ghetti, S. (2014). Structural development of the hippocampus and episodic memory: Developmental differences along the anterior/posterior axis. Cereb. Cortex 24, 3036–3045. doi: 10.1093/cercor/bht160
Demetriou, E. A., Lampit, A., Quintana, D. S., Naismith, S. L., Song, Y. J. C., Pye, J. E., et al. (2018). Autism spectrum disorders: A meta-analysis of executive function. Mol. Psychiatry 23, 1198–1204. doi: 10.1038/mp.2017.75
Desaunay, P., Briant, A. R., Bowler, D. M., Ring, M., Gérardin, P., Baleyte, J., et al. (2020a). Memory in autism spectrum disorder: A meta-analysis of experimental studies. Psychol. Bull. 146, 377–410. doi: 10.1037/bul0000225
Desaunay, P., Clochon, P., Doidy, F., Lambrechts, A., Wantzen, P., Wallois, F., et al. (2020b). Exploring the event-related potentials’ time course of associative recognition in autism. Autism Res. 11, 1998–2016. doi: 10.1002/aur.2384
Dobbins, I. G., and Wagner, A. D. (2005). Domain-general and domain-sensitive prefrontal mechanisms for recollecting events and detecting novelty. Cereb. Cortex 15, 1768–1778. doi: 10.1093/cercor/bhi054
Ecker, C., Marquand, A., Mourão-Miranda, J., Johnston, P., Daly, E. M., Brammer, M. J., et al. (2010). Describing the brain in autism in five dimensions – Magnetic Resonance Imaging-assisted diagnosis of Autism Spectrum Disorder using a multiparameter classification approach. J. Neurosci. 30, 10612–10623. doi: 10.1523/JNEUROSCI.5413-09.2010
Eichenbaum, H., Yonelinas, A. R., and Ranganath, C. (2007). The medial temporal lobe and recognition memory. Annu. Rev. Neurosci. 30, 123–152. doi: 10.1146/annurev.neuro.30.051606.094328
Fetit, R., Hillary, R. F., Price, D. J., and Lawrie, S. M. (2021). The neuropathology of autism: A systematic review of post-mortem studies of autism and related disorders. Neurosci. Biobehav. Rev. 129, 35–62. doi: 10.1016/j.neubiorev.2021.07.014
Fletcher, P. C., and Henson, R. N. A. (2001). Frontal lobes and human memory: Insights from functional neuroimaging. Brain 124, 849–881. doi: 10.1093/brain/124.5.849
Gaigg, S. B., Bowler, D. M., Ecker, C., Calvo-Merino, B., and Murphy, D. G. (2015). Episodic recollection difficulties in ASD result from atypical relational encoding: Behavioral and neural evidence. Autism Res. 8, 317–327. doi: 10.1002/aur.1448
Gaigg, S. B., Gardiner, J. M., and Bowler, D. M. (2008). Free recall in autism spectrum disorder: The role of relational and item-specific encoding. Neuropsychologia 46, 938–992. doi: 10.1016/j.neuropsychologia.2007.11.011
Geurts, H. M., Corbett, B., and Solomon, M. (2009). The paradox of cognitive flexibility in autism. Trends Cogn. Sci. 13, 74–82. doi: 10.1016/j.tics.2008.11.006
Grady, C. L., McIntosh, A. R., and Craik, F. I. (2003). Age-related differences in the functional connectivity of the hippocampus during memory encoding. Hippocampus 13, 572–586. doi: 10.1002/hipo.10114
Grainger, C., Williams, D. M., and Lind, S. E. (2014). Metacognition, metamemory, and mindreading in high-functioning adults with autism spectrum disorder. J. Abnorm. Psychol. 123, 650–659. doi: 10.1037/a0036531
Griffin, J. W., Bauer, R., and Gavett, B. E. (2021). The episodic memory profile in autism spectrum disorder: A Bayesian meta-analysis. Neuropsychol. Rev. 32, 316–351. doi: 10.1007/s11065-021-09493-5
Hannula, D. E., Althoff, R. R., Warren, D. E., Riggs, L., Cohen, N. J., and Ryan, J. D. (2010a). Worth a glance: Using eye movements to investigate the cognitive neuroscience of memory. Front. Hum. Neurosci. 4:166. doi: 10.3389/fnhum.2010.00166
Hannula, D. E., Ranganath, C., Ramsay, I. S., Solomon, M., Yoon, J., Niendam, T. A., et al. (2010b). Use of eye movement monitoring to examine item and relational memory in schizophrenia. Biol. Psychiatry 68, 610–616. doi: 10.1016/j.biopsych.2010.06.001
Hannula, D. E., Tranel, D., Allen, J. S., Kirchhoff, B. A., Nickel, A. E., and Cohen, N. J. (2015). Memory for items and relationships among items embedded in realistic scenes: Disproportionate relational memory impairments in amnesia. Neuropsychology 29, 126–138. doi: 10.1037/neu0000119
Hannula, D. E., Tranel, D., and Cohen, N. J. (2006). The long and short of it: Relational memory impairments in amnesia, even at short lags. J. Neurosci. 26, 8352–8359. doi: 10.1523/JNEUROSCI.5222-05.2006
Heisz, J. J., and Shore, D. I. (2008). More efficient scanning for familiar faces. J. Vis. 8, 1–10. doi: 10.1167/8.1.9
Hogeveen, J., Krug, M. K., Geddert, R. M., Ragland, J. D., and Solomon, M. (2020). Compensatory hippocampal recruitment supports preserved episodic memory in autism spectrum disorder. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 5, 97–109. doi: 10.1016/j.bpsc.2019.08.009
Jacoby, L. L. (1991). A process dissociation framework: Separating automatic from intentional uses of memory. J. Mem. Lang. 30, 513–541. doi: 10.1016/0749-596X(91)90025-F
Keehn, B., Müller, R., and Townsend, J. (2013). Atypical attentional networks and the emergence of autism. Neurosci. Biobehav. Rev. 37, 164–183. doi: 10.1016/j.neubiorev.2012.11.014
Keehn, B., Westerfield, M., and Townsend, J. (2019). Brief report: Cross-modal capture: Preliminary evidence of inefficient filtering in children with autism spectrum disorder. J. Autism Dev. Disord. 49, 385–390. doi: 10.1007/s10803-018-3674-y
Kim, H. (2010). Dissociating the roles of the default-mode, dorsal, and ventral networks in episodic memory retrieval. NeuroImage 50, 1648–1657. doi: 10.1016/j.neuroimage.2010.01.051
Konkel, A., Warren, D. E., Duff, M. C., Tranel, D. N., and Cohen, N. J. (2008). Hippocampal amnesia impairs all manner of relational memory. Front. Hum. Neurosci. 2:15. doi: 10.3389/neuro.09.015.2008
Lai, C. L. E., Lau, Z., Lui, S. S. Y., Lok, E., Tam, V., Chan, Q., et al. (2017). Meta-analysis of neuropsychological measures of executive functioning in children and adolescents with high-functioning autism spectrum disorder. Autism Res. 10, 911–939. doi: 10.1002/aur.1723
Landry, R., and Bryson, S. E. (2004). Impaired disengagement of attention in young children with autism. J. Child Psychol. Psychiatry 45, 1115–1122. doi: 10.1111/j.1469-7610.2004.00304.x
Li, G., Chen, M., Li, G., Wu, D., Lian, C., Sun, Q., et al. (2022). Volumetric analysis of amygdala and hippocampal subfields for infants with autism. J. Autism Dev. Disord. 53, 2475–2489. doi: 10.1007/s10803-022-05535-w
Lind, S. E., and Bowler, D. M. (2009). Recognition memory, self-other source memory, and theory-of-mind in children with autism spectrum disorder. J. Autism Dev. Disord. 39, 1231–1239. doi: 10.1007/s10803-009-0735-2
Lind, S. E., and Bowler, D. M. (2010). Episodic memory and episodic future thinking in adults with autism. J. Abnorm. Psychol. 119, 896–905. doi: 10.1037/a0020631
Lind, S. E., Bowler, D. M., and Raber, J. (2014). Spatial navigation, episodic memory, episodic future thinking, and theory of mind in children with autism spectrum disorder: Evidence for impairments in mental simulation? Front. Psychol. 5:1411. doi: 10.3389/fpsyg.2014.01411
Lord, C., Risi, S., Lambrecht, L., Cook, E. H. Jr., Leventhal, B. L., DiLavore, P. C., et al. (2000). The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism. J. Autism Dev. Disord. 30, 205–223. doi: 10.1023/A:1005592401947
Loth, E., Gómez, J. C., and Happé, F. (2011). Do high-functioning people with autism spectrum disorder spontaneously use event knowledge to selectively attend to and remember context-relevant aspects in scenes? J. Autism Dev. Disord. 41, 945–961. doi: 10.1007/s10803-010-1124-6
Luck, S. J., and Gold, J. M. (2008). The translation of cognitive paradigms for patient research. Schizophr. Bull. 34, 629–644. doi: 10.1093/schbul/sbn036
Massand, E., and Bowler, D. M. (2015). Atypical neurophysiology underlying episodic and semantic memory in adults with autism spectrum disorder. J. Autism Dev. Disord. 45:s10803-013-1869-9. doi: 10.1007/s10803-013-1869-9
Massand, E., Bowler, D. M., Mottron, L., Hosein, A., and Jemel, B. (2013). ERP correlates of recognition memory in autism spectrum disorder. J. Autism Dev. Disord. 43, 2038–2047. doi: 10.1007/s10803-012-1755-x
Minshew, N. J., and Goldstein, G. (1998). Autism as a disorder of complex information processing. Ment. Retard. Dev. Disabil. Res. Rev. 4, 129–136. doi: 10.1002/(SICI)1098-2779(1998)4:2<129::AID-MRDD10>3.0.CO;2-X
Minshew, N. J., and Goldstein, G. (2001). The pattern of intact and impaired memory functions in autism. J. Child Psychol. Psychiatry Allied Discip. 42, 1095–1101. doi: 10.1111/1469-7610.00808
Mogensen, R. L. H., Hedegaard, M. B., Olsen, L. R., and Gebauer, L. (2020). Linking the puzzle pieces of the past: A study of relational memory in children with autism spectrum disorder. Autism Res. 13, 1959–1969. doi: 10.1002/aur.2379
Molitor, R. J., Ko, P. C., Hussey, E. P., and Ally, B. A. (2014). Memory-related eye movements challenge behavioral measures of pattern completion and pattern separation. Hippocampus 24, 666–672. doi: 10.1002/hipo.22256
Moscovitch, M., Cabeza, R., Winocur, G., and Nadel, L. (2016). Episodic memory and beyond: The hippocampus and neocortex in transformation. Annu. Rev. Psychol. 67, 105–134. doi: 10.1146/annurev-psych-113011-143733
Mostert-Kerckhoffs, M. A. L., Staal, W. G., Houben, R. H., and de Jonge, M. V. (2015). Stop and change: Inhibition and flexibility skills are related to repetitive behavior in children and young adults with autism spectrum disorders. J. Autism Dev. Disord. 45, 3148–3158. doi: 10.1007/s10803-015-2473-y
Murphy, J. W., Foxe, J. J., Peters, J. B., and Molholm, S. (2014). Susceptibility to distraction in autism spectrum disorder: Probing the integrity of oscillatory alpha-band suppression mechanisms. Autism Res. 7, 442–458. doi: 10.1002/aur.1374
Naveh-Benjamin, M. (2000). Adults age differences in memory performance; Test of an associative deficit hypothesis. J. Exp. Psychol. Learn. Mem. Cogn. 26, 1170–1187. doi: 10.1037//0278-7393.26.5.1170
Olsen, R. K., Chiew, M., Buchsbaum, B. R., and Ryan, J. D. (2014). The relationship between delay period eye movements and visuospatial memory. Journal of Vision 14(1), 1–11. doi: 10.1167/14.1.8
Papagiannopoulou, E. A., Chitty, K. M., Hermens, D. F., Hickle, I. B., and Lagopoulos, J. (2014). A systematic review and meta-analysis of eye-tracking studies in children with autism spectrum disorders. Soc. Neurosci. 9, 610–632. doi: 10.1080/17470919.2014.934966
Pertzov, Y., Avidan, G., and Zohart, E. (2009). Accumulation of visual information across multiple fixations. J. Vis. 9, 1–12. doi: 10.1167/9.10.2
Ranganath, C. (2010). Binding items and contexts. Curr. Dir. Psychol. Sci. 19, 131–137. doi: 10.1177/0963721410368805
Reinhardt, V. P., Iosif, A., Libero, L., Heath, B., Rogers, S. J., Ferrer, E., et al. (2020). Understanding hippocampal development in young children with autism spectrum disorder. J. Am. Acad. Child. Adolesc. Psychiatry 59, 1069–1079. doi: 10.1016/j.jaac.2019.08.008
Ring, M., Bowler, D. M., and Gaigg, S. B. (2017). An eye-movement study of relational memory in adults with autism spectrum disorder. J. Autism Dev. Disord. 47, 2981–2991. doi: 10.1007/s10803-017-3212-3
Ring, M., Gaigg, S. B., and Bowler, D. M. (2015). Object-location memory in adults with autism spectrum disorder. Autism Res. 8, 609–619. doi: 10.1002/aur.1478
Ring, M., Gaigg, S. B., and Bowler, D. M. (2016). Relational memory processes in adults with autism spectrum disorder. Autism Res. 9, 97–106. doi: 10.1002/aur.1493
Rugg, M. D., and Vilberg, K. L. (2013). Brain networks underlying episodic memory retrieval. Curr. Opin. Neurobiol. 23, 255–260. doi: 10.1016/j.conb.2012.11.005
Rutter, M., Bailey, A., and Lord, C. (2003). Social Communication Questionnaire. Los Angeles, CA: Western Psychological Services.
Ryan, J. D., Althoff, R. R., Whitlow, S., and Cohen, N. J. (2000). Amnesia is a deficit in relational memory. Psychol. Sci. 11, 454–461. doi: 10.1111/1467-9280.00288
Ryan, J. D., Hannula, D. E., and Cohen, N. J. (2007). The obligatory effects of memory on eye movements. Memory 15, 508–525. doi: 10.1080/09658210701391022
Schlichting, M. L., and Preston, A. R. (2015). Memory integration: Neural mechanisms and implications for behavior. Curr. Opin. Behav. Sci. 1, 1–8. doi: 10.1016/j.cobeha.2014.07.005
Schmitt, L. M., White, S. P., Cook, E. H., Sweeney, J. A., and Mosconi, M. W. (2018). Cognitive mechanisms of inhibitory control deficits in autism spectrum disorder. J. Child Psychol. Psychiatry 59, 586–595. doi: 10.1111/jcpp.12837
Semino, S., Ring, M., Bowler, D. M., and Gaigg, S. B. (2018). The influence of task demands, verbal ability, and executive functions on item and source memory in autism spectrum disorder. J. Autism Dev. Disord. 48, 184–197. doi: 10.1007/s10803-017-3299-6
Solomon, M., McCauley, J. B., Iosif, A. M., Carter, C. S., and Ragland, J. D. (2016). Cognitive control and episodic memory in adolescents with autism spectrum disorders. Neuropsychologia 89, 31–41. doi: 10.1016/j.neuropsychologia.2016.05.013
Solomon, M. S., Ozonoff, S. J., Cummings, N., and Carter, C. S. (2008). Cognitive control in autism spectrum disorders. Int. J. Dev. Neurosci. 26, 239–247. doi: 10.1016/j.ijdevneu.2007.11.001
Solomon, M., Ozonoff, S. J., Ursu, S., Ravizza, S., Cummings, N., Ly, S., et al. (2009). The neural substrates of cognitive control deficits in autism spectrum disorders. Neuropsychologia 47, 2515–2526. doi: 10.1016/j.neuropsychologia.2009.04.019
Souchay, C., Wojcik, D. Z., Williams, H. L., Crathern, S., and Clarke, P. (2013). Recollection in adolescents with autism spectrum disorder. Cortex 49, 1598–1609. doi: 10.1016/j.cortex.2012.07.011
Spaniol, J., Davidson, P. S. R., Kim, A. S. N., Han, H., Moscovitch, M., and Grady, C. L. (2009). Event-related fMRI studies of episodic encoding and retrieval: Meta-analyzes using activation likelihood estimation. Neuropsychologia 47, 1765–1779. doi: 10.1016/j.neuropsychologia.2009.02.028
Staresina, B. P., and Davachi, L. (2008). Selective and shared contributions of the hippocampus and perirhinal cortex to episodic item and associative encoding. J. Cogn. Neurosci. 20, 1478–1489. doi: 10.1162/jocn.2008.20104
Tonizzi, I., Giofrè, D., and Usai, M. C. (2021). Inhibitory control in autism spectrum disorders: Meta-analyses on indirect and direct measures. J. Autism Dev. Disord. 52, 4949–4965. doi: 10.1007/s10803-021-05353-6
Trontel, H. G., Duffield, T. C., Bigler, E. D., Abildskov, T. J., Froehlich, A., Prigge, M. B. D., et al. (2015). Mesial temporal lobe and memory function in autism spectrum disorder: An exploration of volumetric findings. J. Clin. Exp. Neuropsychol. 37, 178–192. doi: 10.1080/13803395.2014.997677
Van Eylen, L., Boets, B., Steyaert, J., Evers, K., Wagemans, J., and Noens, I. (2011). Cognitive flexibility in autism spectrum disorder: Explaining the inconsistencies? Res. Autism Spectr. Disord. 5, 1390–1401. doi: 10.1016/j.rasd.2011.01.025
Wainwright-Sharp, J. A., and Bryson, S. E. (1993). Visual orienting deficits in high-functioning people with autism. J. Autism Dev. Disord. 23, 1–13. doi: 10.1007/BF01066415
Wechsler, D. (2011). Weschler Abbreviated Scale of Intelligence – II (WASI-II) [Database record]. APA PsycTests. Washington, DC
Wojcik, D. Z., Moulin, C. J. A., and Souchay, C. (2013). Metamemory in children with autism: Exploring ‘feeling of knowing’ in episodic and semantic memory. Neuropsychology 27, 19–27. doi: 10.1037/a0030526
Keywords: ASD, autism, episodic memory, relational memory, eye tracking
Citation: Minor GN, Hannula DE, Gordon A, Ragland JD, Iosif A-M and Solomon M (2023) Relational memory weakness in autism despite the use of a controlled encoding task. Front. Psychol. 14:1210259. doi: 10.3389/fpsyg.2023.1210259
Edited by:
Dorit Ben Shalom, Ben-Gurion University of the Negev, IsraelReviewed by:
Zhong-Xu Liu, University of Michigan–Dearborn, United StatesDermot Bowler, City University of London, United Kingdom
Copyright © 2023 Minor, Hannula, Gordon, Ragland, Iosif and Solomon. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Marjorie Solomon, marsolomon@ucdavis.edu