Skip to main content

BRIEF RESEARCH REPORT article

Front. Cognit., 04 September 2024
Sec. Attention

Individual differences in visuo-spatial working memory capacity and prior knowledge during interrupted reading

  • 1University of Stuttgart, Institute of Educational Science, Department of Teaching and Learning with Intelligent Systems, Stuttgart, Germany
  • 2Department of Psychology, University of Potsdam, Potsdam, Germany
  • 3University of Stuttgart, Institute for Visualization and Interactive Systems, Department of Computer Science, Stuttgart, Germany
  • 4University of Stuttgart, Institute for Literary Studies, Department of English Literatures and Cultures, Stuttgart, Germany

Interruptions are often pervasive and require attentional shifts from the primary task. Limited data are available on the factors influencing individuals' efficiency in resuming from interruptions during digital reading. The reported investigation—conducted using the InteRead dataset—examined whether individual differences in visuo-spatial working memory capacity (vsWMC) and prior knowledge could influence resumption lag times during interrupted reading. Participants' vsWMC capacity was assessed using the symmetry span (SSPAN) task, while a pre-test questionnaire targeted their background knowledge about the text. While reading an extract from a Sherlock Holmes story, they were interrupted six times and asked to answer an opinion question. Our analyses revealed that the interaction between vsWMC and prior knowledge significantly predicted the time needed to resume reading following an interruption. The results from our analyses are discussed in relation to theoretical frameworks of task resumption and current research in the field.

1 Introduction

Consider this scenario: you are reading an article on your computer for your research project. As you immerse yourself in the reading (primary task), you are notified that you have received an email about planning your upcoming business trip (secondary task). After carefully reading the instructions contained in the email, you need to refocus your attention on the article. Interruptions, acting as a pervasive source of distraction, frequently redirect our attention to secondary tasks, leading to negative consequences across different contexts. For instance, interruptions in health care can impair concentration levels and essential clinical information processing in physicians during daily attending rounds (Armendariz et al., 2021). Distractions have also often been linked to a decline in driving performance (Stutts et al., 2005). Moreover, frequent interruptions, such as those from social media and extensive messaging, can reduce overall productivity and negatively impact academic performance (Rosen et al., 2013).

Among educational contexts, reading can serve as both a source of entertainment and as a means of transmitting knowledge (Chevet et al., 2022c). As such it is a demanding task both to learn and teach (Wijekumar et al., 2012). The pervasive use of digital devices often results in interruptions during reading, diverting attention to alternative tasks and causing a shift from the ongoing activity to a new one (Chevet et al., 2022a). While numerous studies have analyzed the characteristics of interruptions and how disruptive they can be on performance (Trafton et al., 2005, 2003; Wirzberger and Russwinkel, 2015), there has been relatively less emphasis on specific individual differences influencing how we can efficiently recover from interruptions (Bai et al., 2014; Drews and Musters, 2015; Meys and Sanderson, 2013). Nevertheless, exploring the impact of such characteristics on interruption recovery during reading has the potential to deepen our understanding of the cognitive process of task resumption. Furthermore, it could fundamentally improve the design of adaptive learning systems and teaching practices for reading purposes.

Prior research on interruptions has mostly examined memory processes during resumption, with the Memory for Goals theory (Altmann and Trafton, 2002) being a prominent activation-based framework in this domain. Informed by the cognitive theory of adaptive control of thoughts-rational (ACT-R) (Anderson and Lebiere, 1998), this theory assumes that we allocate our attention and cognitive resources to the task with the most active goal representations in our memory. Altmann and Trafton (2002) attributed the disruption caused by an interruption to the time necessary to reactivate goal representations in our memory upon resuming the task. To measure resumption performance, Trafton et al. (2003) introduced the concept of resumption lag as the time required to re-focus on the primary task following an interruption. Prior research have identified predictors of resumption performance, particularly in procedural and emergency tasks (Bai et al., 2014; Drews and Musters, 2015; Foroughi et al., 2016b; Joslyn and Hunt, 1998; Seamster et al., 1993). Preliminary findings suggested a potential influence of individual differences in reading habits, comprehension and multitasking skills on resumption performance during reading (Altamura et al., 2022). Among others, Foroughi et al. (2016a) reported interruptions to have a detrimental effect on reading comprehension for subjects with lower WMC. Moreover, variations in WMC influenced the level of mind wandering and text comprehension during a reading task (Schurer and Schubert, 2019). Despite the acknowledged impact of such individual characteristics on interruption recovery, its extent remains unclear due to limited data (Bai et al., 2014; Drews and Musters, 2015; Meys and Sanderson, 2013), particularly for interrupted reading tasks.

Previous findings have highlighted the significance of spatial representations in task resumption, a perceptual process not covered by the Memory for Goals theory (Ratwani and Trafton, 2008; Cane et al., 2012). In visual search research, resuming an interrupted task was found to be faster than starting one, indicating that some spatial configurations of the search display was retained during interruptions (Lleras et al., 2005). In more complex tasks, findings showed inconsistencies, likely due to the variety of experimental tasks and tests and the exclusive use of reaction time as measurement of resumption lag. Higher mental rotation task scores were correlated with shorter resumption times in a video cassette recorder programming task interrupted by pursuit tracking, whereas paper folding task scores did not predict performance (Werner et al., 2011). Conversely, variations in spatial abilities measured by the Mental Rotations Test (Peters et al., 1995) did not impact resumption time or accuracy during arithmetic tasks interrupted by lexical decision tasks (Meys and Sanderson, 2013). However, prior work using eye-tracking data to explore resumption found that individuals can return accurately close to the last fixated area during a task requiring them to type odd numbers from a list, as evidenced by their fixation behavior (Ratwani and Trafton, 2008). Besides, interruptions involving mental rotation caused longer and less accurate resumption than arithmetic problems (Ratwani and Trafton, 2008).

During reading instead, previous research demonstrated that we rely to some extent on our limited memory for the location of words and information within the text (Inhoff and Weger, 2005; Rothkopf, 1971). In interrupted reading, shorter resumption lags were achieved by visually signaling the last word that was read before an interruption occurred (Cane et al., 2012). Specifically, readers spent significantly less time re-reading the pre-interruption text when the last word was highlighted, aligning with previous findings on the signaling effect in multimedia learning (Schneider et al., 2018). Jo et al. (2015) applied this support strategy to develop a gaze-based digital bookmarking tool, demonstrating significantly reduced resumption times in highlighted conditions compared to a non-highlighted one. Upon resumption, readers also frequently re-read portions of text they had already covered before the interruption, as indicated by their eye movements (Cane et al., 2012; Chevet et al., 2022a). Resumption during reading therefore involves not only reinstating previously read information in memory, but in particular locating the point of interruption in the text, hence drawing on spatial memory (Cane et al., 2012). However, while these studies pointed at an association between spatial memory and resumption time during reading (Cane et al., 2012), none of them employed psychometric measurements of spatial memory. Studies measuring spatial ability typically focused on skills like mental spatial manipulation and visualization, but remembering spatial configurations is likely more important for task resumption (Meys and Sanderson, 2013).

Representations from previous knowledge stored in long-term memory guide readers in the process of deriving meaning from texts (Kintsch and van Dijk, 1978; Van Dijk and Kintsch, 1983). As a result, prior knowledge functions as a good predictor of reading comprehension (Abdelaal and Sase, 2014). Readers with a greater prior knowledge about the text exhibited improved skills in filtering out irrelevant information, hence a better processing and understanding of the text (McCarthy et al., 2018; Schurer and Schubert, 2019).

Studies investigating prior knowledge in the context of interrupted reading remain limited. These studies defined prior knowledge simply as familiarity or non-familiarity with the content of the reading material, based on the participants' educational background, neglecting the multiple dimensions of prior knowledge in text comprehension (McCarthy and McNamara, 2021). Findings from McNamara and Kintsch (1996) showed that mid-sentence interruptions during unfamiliar and difficult paragraphs result in longer reading times per sentence, as opposed to familiar paragraphs. More recently, Chevet et al. (2022b) observed increased fixations per character when readers lack prior knowledge about an expository text, regardless of the presence of interruptions. Similarly, prior knowledge had no impact on readers' attention, measured as frequency of mind wandering episodes during reading of an expository hypertext (Schurer and Schubert, 2019).

Nevertheless, prior knowledge significantly enhances perceptual processing during learning, allowing for more efficient integration and retrieval of new information, which is critical for problem-solving and deeper comprehension (Chi et al., 1982; Schnotz, 2002). The link between prior knowledge and visuo-spatial processing has been indeed previously addressed in theoretical frameworks of multimedia learning. Readers construct multiple representations of a text (Schnotz, 2002). They form a surface representation with linguistic details. Moreover, they build a mental model—or situation model in narrative comprehension (Van Dijk and Kintsch, 1983)—that integrates text content with domain-specific background knowledge (Schnotz, 2002). Such models are therefore complex, multi-sensory representations that integrate information from visual perception, prior knowledge, and potentially other sensory inputs (Mayer, 1997; Schnotz, 2002). While previous research has found evidence of a relevant link between prior knowledge and visuo-spatial processing in text comprehension and learning (Schnotz, 2002; Taub and Azevedo, 2019), this relationship has yet to be explored in the context of interrupted reading.

The present study addresses the need for research on the association between spatial memory and resumption time during interrupted reading using a psychometric test of spatial memory. Additionally, this study tackles the limited data on the role of the multiple dimensions of prior knowledge during resumption in reading. It thus examines how variations in visuo-spatial working memory capacity (vsWMC) and prior knowledge influence resumption lags after interruptions, building upon the significance of these cognitive factors in learning and text comprehension. We specifically hypothesize that: (H1) individuals with higher vsWMC scores should exhibit lower resumption lags following an interruption during reading; (H2) individuals with higher scores in prior knowledge on the content of the text should exhibit lower resumption lags following an interruption during reading.

To test these hypotheses, we built on the existing InteRead dataset for interrupted reading (Zermiani et al., 2024), since it includes detailed annotations of resumption lag times, and comprehensive pre- and post-test measurements. In particular, pre-test measures provide scores for participants' vsWMC and prior knowledge regarding the reading material, consisting of a long fictional text. vsWMC was measured through a Symmetry Span (SSPAN) task, whereas prior knowledge was assessed using a customized questionnaire, targeting different dimensions such as the participants' familiarity with the specific genre and characteristics of the selected fiction (Zermiani et al., 2024). We thus analyzed the influence of the provided individual scores on the annotated resumption times. To determine if other reader-related factors affect resumption time, we also analyzed pre- and post-test measures known to influence reading behavior, such as reading habits—frequency and print vs. digital media (Altamura et al., 2022), reading comprehension (Chevet et al., 2022a), and perceived reading experience (Chevet et al., 2022c), which have been linked to attentional shifts and disruptions during reading. We present novel preliminary findings suggesting that the interaction of vsWMC and prior knowledge may be a stronger predictor of resumption performance during interrupted reading, compared to their effect as individual predictors.

2 Method

The InteRead dataset was designed for investigating the impact of interruptions on reading behavior (Zermiani et al., 2024). InteRead comprises eye-tracking data collected from 50 participants engaged in an interrupted reading task of an English fictional text. The interruptions were strategically introduced throughout the reading task to investigate how participants manage and resume their reading following such disruptions.

2.1 Dataset overview

A total of 50 adult participants (Mage = 27.78, SDage = 5.65, 30 female) with no diagnosed attention or reading disorders and normal or corrected-to-normal eyesight were included in the in-person laboratory study underlying the chosen dataset. English proficiency was assessed to include only native speakers or those with C1 proficiency, demonstrated by an IELTS score of 6.5+ or an equivalent standard. Based on their reported educational background, the subjects can be broadly grouped into the following categories (with the number of subjects in parentheses): computer science (17), pedagogy (7), linguistics (6), architecture (5), English (3), mechanical engineering (3), psychology (2), music (2), bio-engineering (1), materials science (1), secondary education (1), and social science (1).

The data collection consisted of a pre-test phase, the interrupted reading task involving eye tracking, and a post-test phase. The pre-test questionnaire presented standard demographic questions, a prior knowledge questionnaire—designed to assess participants' background knowledge on Sherlock Holmes stories and their familiarity with the crime genre—as well as a SSPAN task. The prior knowledge questionnaire consisted of 12 items, with a reported overall scale reliability of α = 0.83 (Zermiani et al., 2024). The questionnaire targeted three dimensions: detailed knowledge about Sherlock Holmes stories, with multiple-choice questions (e.g., “Who is the author of Sherlock Holmes?” or “What is the name of Sherlock Holmes' landlady?”); target-domain knowledge about previous exposure to crime fiction and related media, with yes/no agreement statements [e.g., “I have recently read a detective/crime fiction story.” or “I have recently seen a film or a TV adaptation of Sherlock Holmes (for example, the BBC series Sherlock).”]; and general knowledge about participants' interest in the crime genre, with 6-point Likert scale agreement statements (e.g., “I usually recommend reading detective/crime fiction books.” or “When deciding for a new book to read, I often pick a detective/crime fiction story.”) (Zermiani et al., 2024). All items were summed up to achieve prior knowledge total scores. The SSPAN task (Kane et al., 2004; Shah et al., 1996) represents a vested approach to assess vsWMC. From the various possibilities for implementation, we reproduced Unsworth et al. (2009)'s version of the SSPAN, following the outlined paradigm design as closely as possible. In detail, as storage task, participants had to recall the sequence of colored squares in a 4 × 4 grid after each square was displayed for 650 ms. Additionally, a processing task required to judge the vertical symmetry of grids with black squares displaying different shapes. Participants completed three blocks of trials, with the number of colored squares to recall as well as symmetry judgments randomly varying from two to five per trial respectively (Unsworth et al., 2009). Following established procedures (Foster et al., 2015; Redick et al., 2012), the participants' partial recall scores and the symmetry accuracy were calculated from the SSPAN task (Zermiani et al., 2024). The partial recall score refers to the sum of the squares recalled in the correct position, regardless of whether the entire sequence of squares was recalled in the correct order. It ranges from 0 to 42. The symmetry accuracy corresponds to the proportion of correct symmetry judgments. Additionally, in the pre-test, participants answered two questions regarding their leisure reading frequency and their preferred reading medium (Zermiani et al., 2024).

For the interrupted reading task, participants were asked to read an excerpt (28 pages) from the Arthur Conan Doyle's Sherlock Holmes story “The Adventure of the Speckled Band.” Six fixed pages contained an interruption, consisting of a dialog box that hid the text and prompted participants to answer an opinion question within 60 seconds. The questions, unrelated to the story, focused on everyday situations and general debate topics and were selected from Pashler et al. (2013). Building on previous evidence related to the seductive detail effect (Harp and Mayer, 1998), which describes how extraneous but interesting information hampers attention and learning, the opinion questions aimed at ensuring an adequate scope of interrupting potential. The questions were delivered as text items, since seductive texts have been demonstrated to particularly capture participants' attention (Rey, 2012). Furthermore, to reduce the possibility for subvocal rehearsal of the page content, thereby engaging the phonological loop (Baddeley, 1992), the questions required participants to think deeply and provide written content. Such interactive interrupting task thus aimed to substantially occupy participants' cognitive resources and disrupt both verbal and visual processing, in line with Oulasvirta and Saariluoma (2006). Interruptions were triggered when subjects' eye movements hit a pre-established target word, following previous approaches (Cane et al., 2012; Jo et al., 2015). To measure task performance following the interruptions, Zermiani et al. (2024) obtained participants' resumption lags, defined as as the time interval between the end of an interruption to the first stable reading pattern in the pre-interruption text. Resumption lags were manually annotated from the gaze data by two human annotators using a visualization and annotation tool (Zermiani et al., 2024).

The post-test survey partially consisted of four multiple-choice reading comprehension questions, to ensure the participants had mindfully read the story, and six statements on their reading experience related to the experiment, rated on 6-point Likert scales. Such statements included four items from the story world absorption scale (Kuijpers et al., 2014) and an item for participants' level of annoyance toward the interruptions they encountered (Zermiani et al., 2024).

2.2 Scoring

While the above-described variables and their corresponding scores were already included in the dataset, we calculated additional scores based on the available data through supplementary procedures. Reading frequency in InteRead was assessed based on the selected option to the question “How often do you read for enjoyment? (0) Never, (1) 1–2 times a week, (2) 2–3 times a week, (3) 4–5 times a week, (4) Everyday” (Zermiani et al., 2024). After observing the data distribution for this question, we opted for categorizing participants into three frequency groups to obtain a well-balanced bins distribution: low-frequency readers—subjects who never read for enjoyment (n = 10); medium-frequency readers—subjects who read between one and three times per week for enjoyment (n = 29); high-frequency readers—subjects who read more than three times a week for enjoyment (n = 8). In addition, to obtain the score indicating the preferred reading medium, we categorized participants into print vs. digital reading medium, based on their selected answer to the question “What medium do you choose to read from?”: (0) Print book, (1) E-book, (2) Computer, (3) Smartphone, (4) Other (Zermiani et al., 2024).

For reading experience, we followed a standard approach, which considers the Likert scales as an approximately continuous variable (Johnson and Creech, 1983). To achieve that, we assigned scores to the extreme points of each Likert scale, thereby creating a continuous range of values. Consequently, participants' scores per Likert scale were transformed to values within this range. By combining all six Likert scales related to the questionnaire, we obtained an individual reading experience score for each participant on a continuous scale.

2.3 Statistical analyses

To investigate the proposed effects of vsWMC and prior knowledge on resumption times, we used a standard linear mixed-effects model building on the R lme4 package1 (Bates et al., 2015) and the lmerTest package2 (Kuznetsova et al., 2017) to obtain p-values for fixed effects. Our model included resumption lags as criterion variable; and partial recall scores from the SSPAN task, prior knowledge scores, as well as their interaction as predictor variables. We included subject ID and page as random effects to account for multiple data points over different pages by the same participants, since each individual had, on average, six resumption lags, resulting in a total of 272 observations. All predictor variables were normalized.

In addition, we aimed to verify if other reader-related factors had influenced resumption time. We used a similar linear mixed-effects model for that purpose. In particular, the model had the resumption lags as criterion variable; the partial recall score, prior knowledge, their interaction, reading frequency, print vs. digital reading medium, reading comprehension and reading experience as predictor variables. The same random effects were included.

3 Results

To ensure that the processing component of the SSPAN task was adequately included, we opted for a data-driven approach and excluded participants who scored 2 SD points below the processing performance mean (Richmond et al., 2022). This resulted in the exclusion of three subjects, hence a total sample size of n = 47 (see Table 1 for more detailed descriptive statistics).

Table 1
www.frontiersin.org

Table 1. Descriptive statistics for resumption lag, partial recall score, and prior knowledge.

The linear mixed-effects model related to our hypotheses operated on nobs = 272 and obtained a conditional R2 of 0.23. Taken as individual predictors, vsWMC (β = –0.19, CI = –0.58−0.19, SE = 0.19, t(43.71) = –0.99, p = 0.327) and prior knowledge (β = 0.02, CI = –0.34−0.38, SE = 0.18, t(43.99) = 0.10, p = 0.916) resulted in non-significant contributions. However, the interaction between vsWMC and prior knowledge significantly predicted resumption lags (β = –0.34, CI = −0.65–−0.02, SE = 0.16, t(45.53) = –2.08, p = 0.043). Figure 1 displays variations in the interaction between vsWMC and prior knowledge with respect to the obtained groups. To better understand and visualize these effects, we performed a median split of the prior knowledge score (Mdn = 10) and dichotomized our sample into high (n = 23, M = 16.8, SD = 4.56) vs. average-low prior knowledge readers (n = 24, M = 5.88, SD = 2.82), following previous approaches (Altamura et al., 2022; Taub and Azevedo, 2019). Calculating separate Pearson correlations for each subsample, we find a non-significant correlation between vsWMC and resumption lag times for participants with an average-low prior knowledge score [r(22)= 0.06, p = 0.760]. By contrast, those with high prior knowledge exhibited a non-significant trend toward a moderate negative correlation [r(21) = –0.40, p = 0.053].

Figure 1
www.frontiersin.org

Figure 1. Interaction effect of vsWMC and prior knowledge on resumption lags. Interaction plot showing the effect of vsWMC (x-axis) and resumption lag, in seconds (y-axis), for the average-low (in blue) and high (in orange) prior knowledge groups. The respective bands represent the 95% confidence intervals of the estimates.

The linear mixed-effects model related to our additional inspections also operated on nobs = 272 and obtained a conditional R2 of 0.23. None of the additional predictors under analysis—reading frequency, print vs. digital reading medium, reading comprehension and reading experience—had a significant effect on resumption lag. The effect of the interaction between vsWMC and prior knowledge on resumption lag instead remained significant (p = 0.046). Complete results for these analyses can be found in Table 2.

Table 2
www.frontiersin.org

Table 2. Results of the linear mixed-effects model for the additional analyses.

4 Discussion

Understanding how individual cognitive differences impact how quick we resume reading after interruptions is crucial for optimizing learning and reading efficiency. This study examined the influence of vsWMC and prior knowledge on resumption lags during a reading task interrupted by opinion questions. Specifically, building on current research gaps in the field, our study assesses vsWMC with an independent psychometric test, and addresses the limited data on the multiple dimensions of prior knowledge in interrupted reading. Initially, we hypothesized that higher vsWMC (H1) and greater prior knowledge (H2) would lead to quicker resumption times. Contrary to our hypotheses, these factors did not predict resumption times when considering the inspected factors separately. However, we found a significant interaction between vsWMC and prior knowledge on resumption lag. Further analyses indicated that reading frequency, medium preference, comprehension, and experience were not significant predictors of resumption time, but a significant interaction between vsWMC and prior knowledge was confirmed.

Regarding H1, our findings showed a non-significant effect of vsWMC on resumption lag times. This result aligns with Meys and Sanderson (2013), who also reported a lack of significant effect of spatial memory on recovery time during an interrupted arithmetic task. Werner et al. (2011) instead found a significant relationship between spatial ability scores from a mental rotation task and resumption performance, which became non-significant when considering scores from a paper-folding task. Notably, Meys and Sanderson (2013) pointed out that although some studies have provided evidence for the role of spatial memory and visual search mechanisms in resumption (Cane et al., 2012; Lleras et al., 2005; Ratwani and Trafton, 2008), they were not based on independent psychometric tests of spatial skills. Our observed results provide further support for the limited effect of individual variations in vsWMC on recovery speed. Besides, the reading material used in InteRead belongs to the crime fiction genre, which, with its well-known storylines and the popular figure of Sherlock Holmes, might minimize the need for activating vsWMC. To substantiate this assumption, further experiments are needed that incorporate various genres or literary texts from different time periods. For example, comparing contemporary literature to medieval texts or examining more descriptive passages vs. dynamic ones within the same story could provide valuable insights on whether relying on vsWMC during resumption is mediated by text characteristics.

Regarding H2, our results indicated a non-significant impact of prior knowledge on resumption time, in line with previous work. While Chevet et al. (2022b) showed changes in reading gaze behavior when subjects lack prior knowledge on the text, this effect indeed occurred regardless of the presence of interruptions. Schurer and Schubert (2019) similarly displayed no effect of prior knowledge on attention during reading. These studies, however, only explored prior knowledge in relation to expository texts or paragraphs, with participants being either familiar or unfamiliar with the topic of the text. Interestingly, previous findings also suggested that expository texts would prompt learners to integrate their prior knowledge with learning content more than narrative texts (Wolfe and Woodwyk, 2010). Our findings may indicate that prior knowledge is not a significant cognitive factor for reading resumption and attentional processes, even in narratives. However, further research is necessary to compare expository and narrative texts as well as different reading goals, such as learning or entertainment, within the context of interrupted reading.

Furthermore, we observed that the combined influence of vsWMC and prior knowledge significantly impacts resumption performance. Specifically, readers with high prior knowledge about Sherlock Holmes stories and the crime genre resumed increasingly faster with simultaneously higher vsWMC. Our findings are in line with previous conclusions drawn by Foroughi et al. (2016a), who suggested that readers with low WMC struggle to distinguish between irrelevant and relevant cues upon resumption, resulting in lower performance. They also concluded that readers may need a great familiarity with the particular type and content of a text (i.e., domain-specific expertise) to quickly retrieve information from their long-term working memory (Foroughi et al., 2016a). We postulate that the interaction between vsWMC and prior knowledge may facilitate the resumption process. A stronger integration of vsWMC and prior knowledge might thus allow for discriminating textual information faster upon resumption, retrieving background information more efficiently, resulting in lower resumption times. While the Memory for Goals theory did not consider the role of perceptual processing and the spatial memory component (Ratwani and Trafton, 2008), our results emphasize the necessity of considering both spatial and non-spatial components in understanding the resumption process in reading. In the context of text comprehension and multimedia learning, these findings support theoretical integration between prior knowledge and visuo-spatial processing (Schnotz, 2002). More precisely, readers with high prior knowledge and greater vsWMC are likely more skillful at constructing and storing mental models of the text, facilitating easier reactivation upon resumption. Although visually highlighting the word where an interruption occurred significantly sustains resumption (Cane et al., 2012; Jo et al., 2015), future research should investigate how this support varies while considering individual differences in prior knowledge and vsWMC. Such insights could enhance the design of intelligent tutoring systems and reading applications, providing personalized resumption support. Our results may also suggest that educators should integrate visuo-spatial skills, often insufficiently fostered in classrooms (Mathewson, 1999), with traditional text comprehension training to improve students' resumption performance during reading.

Our additional analyses indicated that reading frequency, reading medium, reading comprehension and reading experience did not significantly predict resumption performance. The non-significant effect of reading frequency and medium is in agreement with previous preliminary research showing that print and digital reading weekly hours had no significant correlation with gaze behavior during resumption (Altamura et al., 2022). While most prior studies showed no evidence of interruptions negatively impacting comprehension, a few studies also found both negative and positive effects (Chevet et al., 2022a). However, prior work evaluating comprehension during interrupted reading either designed extensive questionnaires (Chevet et al., 2022a) or used well-established reading comprehension tasks such as the SAT (Foroughi et al., 2015). The short questionnaire underlying the InteRead dataset might be not sufficiently reliable for a thorough assessment of reading comprehension. Regarding the perceived reading experience instead, similar results are found in Chevet et al. (2022c), where the relation between attentional disruption and enjoyment of the reading experience lacks significant impacts. Nevertheless, our additional analyses confirmed the strong predictive power of the interaction between vsWMC and prior knowledge in determining resumption speed.

Limitations of this research include reliance on a single dataset, hence a limited generalizability to different materials. Future work could extend the current investigation with more diverse samples, reading material and assessment metrics as well as explore additional factors that may impact resumption behavior. The type of interruption may also represent a limitation. Although the interrupting task used in InteRead aimed to minimize the potential for subvocal rehearsal, previous research has utilized various types of interruptions, often yielding different results (Cauchard et al., 2012; Katidioti et al., 2016; Wirzberger and Rey, 2018). Future research should further investigate how different interruption types affect reading resumption times. Lastly, InteRead relies on manual annotation of gaze data for detecting resumption lags (Zermiani et al., 2024). This could be limited by subjective variations among raters. Implementing and evaluating gaze-based resumption detection algorithms may enhance reliability and objectivity in future studies.

In conclusion, the presented work contributes to further understanding how individual differences in cognitive factors, such as vsWMC and prior knowledge, impact the time required to recover from interruptions during reading. These insights have significant implications for the design of adaptive learning technologies and educational interventions tailored to individual needs. Our findings underscore the complex relationship between these cognitive factors and reading resumption performance, suggesting potential future research and practical applications in education.

Data availability statement

Publicly available datasets were analyzed in this study. This data can be found here: https://doi.org/10.17605/OSF.IO/43J5F.

Ethics statement

This work was approved by the Ethics Committee of the University of Stuttgart (approval number Az. 22-018). Since this research was conducted with a publicly available dataset containing non-identifiable human data, no human participants were involved in the presented analyses. Additional written informed consent was therefore not required in accordance with the national legislation and institutional requirements.

Author contributions

FZ: Conceptualization, Formal analysis, Investigation, Methodology, Validation, Writing – original draft. PD: Formal analysis, Validation, Writing – original draft. FS: Software, Writing – review & editing. SB: Methodology, Resources, Writing – review & editing. AB: Conceptualization, Supervision, Writing – review & editing. MW: Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. Data collection for this research was supported by the Federal Ministry of Science, Research, and the Arts Baden-Württemberg as part of the Research Seed Capital funding scheme (grant number Az. 33-7533.-30-10/75/3). The authors also acknowledge the support of the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation under the DFG reference number UP 31/1) for the Stuttgart Research Focus Interchange Forum for Reflecting on Intelligent Systems (IRIS).

Acknowledgments

The authors thank the International Max Planck Research School for Intelligent Systems (IMPRS-IS) for supporting Francesca Zermiani. We also acknowledge the use of ChatGPT-3.5 by OpenAI during the preparation of this work to improve language clarity and readability in the manuscript. After using this tool, the authors reviewed and edited the content as needed and take full responsibility for the content of the published article.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1. ^Version 1.1.28.

2. ^Version 3.1.3.

References

Abdelaal, N. M., and Sase, A. S. (2014). Relationship between prior knowledge and reading comprehension. Adv. Lang. Liter. Stud. 5, 125–131. doi: 10.7575/aiac.alls.v.5n.6p.125

Crossref Full Text | Google Scholar

Altamura, L., Salmerón, L., and Kammerer, Y. (2022). “Instant messaging multitasking while reading: a pilot eye-tracking study,” in 2022 Symposium on Eye Tracking Research and Applications, ETRA '22 (Association for Computing Machinery), 1–6. doi: 10.1145/3517031.3529237

Crossref Full Text | Google Scholar

Altmann, E., and Trafton, J. (2002). Memory for goals: an activation-based model. Cogn. Sci. 26, 39–83. doi: 10.1207/s15516709cog2601_2

Crossref Full Text | Google Scholar

Anderson, J. R., and Lebiere, C. (1998). The Atomic Components of Thought. New York: Lawrence Erlbaum Associates Publishers.

Google Scholar

Armendariz, J., Tamayo, C., Slade, J., Belitskaya-Lévy, I., Gray, C., and Allaudeen, N. (2021). Interruptions to attending physician rounds and their effect on resident education. J. Grad. Med. Educ. 13, 266–275. doi: 10.4300/JGME-D-20-00698.1

PubMed Abstract | Crossref Full Text | Google Scholar

Baddeley, A. (1992). Working memory. Science 255, 556–559. doi: 10.1126/science.1736359

PubMed Abstract | Crossref Full Text | Google Scholar

Bai, H., Jones, W. E., Moss, J., and Doane, S. M. (2014). Relating individual differences in cognitive ability and strategy consistency to interruption recovery during multitasking. Learn. Individ. Differ. 35, 22–33. doi: 10.1016/j.lindif.2014.07.002

Crossref Full Text | Google Scholar

Bates, D., Mächler, M., Bolker, B., and Walker, S. (2015). Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48. doi: 10.18637/jss.v067.i01

Crossref Full Text | Google Scholar

Cane, J. E., Cauchard, F., and Weger, U. W. (2012). The time-course of recovery from interruption during reading: eye movement evidence for the role of interruption lag and spatial memory. Quart. J. Exper. Psychol. 65, 1397–1413. doi: 10.1080/17470218.2012.656666

PubMed Abstract | Crossref Full Text | Google Scholar

Cauchard, F., Cane, J., and Weger, U. (2012). Influence of background speech and music in interrupted reading: an eye-tracking study. Appl. Cogn. Psychol. 26, 381–390. doi: 10.1002/acp.1837

Crossref Full Text | Google Scholar

Chevet, G., Baccino, T., Marlot, L., Vinter, A., and Drai-Zerbib, V. (2022a). Effects of interruption on eye movements and comprehension during reading on digital devices. Learn. Instr. 80:101565. doi: 10.1016/j.learninstruc.2021.101565

PubMed Abstract | Crossref Full Text | Google Scholar

Chevet, G., Baccino, T., Vinter, A., and Drai-Zerbib, V. (2022b). “Effect of prior knowledge on re-reading behavior after an interruption and text comprehension,” in European Conference on Eye Movements.

Google Scholar

Chevet, G., Baccino, T., Vinter, A., and Drai-Zerbib, V. (2022c). What breaks the flow of reading? A study on characteristics of attentional disruption during digital reading. Front. Psychol. 13:987964. doi: 10.3389/fpsyg.2022.987964

PubMed Abstract | Crossref Full Text | Google Scholar

Chi, M. T., Glaser, R., and Rees, E. (1982). “Expertise in problem solving,” in Advances in the psychology of human intelligence, ed. R. J. Sternberg (Hillsdale, NJ: Erlbaum), 7–75.

Google Scholar

Drews, F. A., and Musters, A. (2015). Individual differences in interrupted task performance: one size does not fit all. Int. J. Hum. Comput. Stud. 79, 97–105. doi: 10.1016/j.ijhcs.2015.01.003

Crossref Full Text | Google Scholar

Foroughi, C. K., Barragán, D., and Boehm-Davis, D. A. (2016a). Interrupted reading and working memory capacity. J. Appl. Res. Mem. Cogn. 5, 395–400. doi: 10.1016/j.jarmac.2016.02.002

Crossref Full Text | Google Scholar

Foroughi, C. K., Werner, N. E., Barragán, D., and Boehm-Davis, D. A. (2015). Interruptions disrupt reading comprehension. J. Exper. Psychol. 144, 704–709. doi: 10.1037/xge0000074

PubMed Abstract | Crossref Full Text | Google Scholar

Foroughi, C. K., Werner, N. E., McKendrick, R., Cades, D. M., and Boehm-Davis, D. A. (2016b). Individual differences in working-memory capacity and task resumption following interruptions. J. Exper. Psychol. 42, 1480–1488. doi: 10.1037/xlm0000251

PubMed Abstract | Crossref Full Text | Google Scholar

Foster, J. L., Shipstead, Z., Harrison, T. L., Hicks, K. L., Redick, T. S., and Engle, R. W. (2015). Shortened complex span tasks can reliably measure working memory capacity. Memory Cogn. 43, 226–236. doi: 10.3758/s13421-014-0461-7

PubMed Abstract | Crossref Full Text | Google Scholar

Harp, S., and Mayer, R. (1998). How seductive details do their damage: a theory of cognitive interest in science learning. J. Educ. Psychol. 90, 414–434. doi: 10.1037/0022-0663.90.3.414

Crossref Full Text | Google Scholar

Inhoff, A. W., and Weger, U. W. (2005). Memory for word location during reading: eye movements to previously read words are spatially selective but not precise. Memory Cogn. 33, 447–461. doi: 10.3758/BF03193062

PubMed Abstract | Crossref Full Text | Google Scholar

Jo, J., Kim, B., and Seo, J. (2015). “EyeBookmark: assisting recovery from interruption during reading,” in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15 (Association for Computing Machinery), 2963–2966. doi: 10.1145/2702123.2702340

Crossref Full Text | Google Scholar

Johnson, D. R., and Creech, J. C. (1983). Ordinal measures in multiple indicator models: a simulation study of categorization error. Am. Sociol. Rev. 48, 398–407. doi: 10.2307/2095231

Crossref Full Text | Google Scholar

Joslyn, S., and Hunt, E. (1998). Evaluating individual differences in response to time-pressure situations. J. Exper. Psychol. 4:16. doi: 10.1037//1076-898X.4.1.16

PubMed Abstract | Crossref Full Text | Google Scholar

Kane, M. J., Hambrick, Z., Tuholski, S., Wilhelm, O., Payne, T., and Engle, R. (2004). The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning. J. Exper. Psychol. 133, 189–217. doi: 10.1037/0096-3445.133.2.189

PubMed Abstract | Crossref Full Text | Google Scholar

Katidioti, I., Borst, J., Van Vugt, M., and Taatgen, N. (2016). Interrupt me: external interruptions are less disruptive than self-interruptions. Comput. Human Behav. 63, 906–915. doi: 10.1016/j.chb.2016.06.037

Crossref Full Text | Google Scholar

Kintsch, W., and van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychol. Rev. 85, 363–394. doi: 10.1037/0033-295X.85.5.363

Crossref Full Text | Google Scholar

Kuijpers, M., Hakemulder, F., Tan, E., and Doicaru, M. (2014). Exploring absorbing reading experiences: developing and validating a self-report scale to measure story world absorption. Sci. Study Lit. 4, 89–122. doi: 10.1075/ssol.4.1.05kui

PubMed Abstract | Crossref Full Text | Google Scholar

Kuznetsova, A., Brockhoff, P. B., and Christensen, R. H. B. (2017). lmertest package: tests in linear mixed effects models. J. Stat. Softw. 82, 1–26. doi: 10.18637/jss.v082.i13

Crossref Full Text | Google Scholar

Lleras, A., Rensink, R., and Enns, J. (2005). Rapid resumption of interrupted visual search: new insights on the interaction between vision and memory. Psychol. Sci. 16, 684–688. doi: 10.1111/j.1467-9280.2005.01596.x

PubMed Abstract | Crossref Full Text | Google Scholar

Mathewson, J. H. (1999). Visual-spatial thinking: an aspect of science overlooked by educators. Sci. Educ. 83, 33–54. doi: 10.1002/(SICI)1098-237X(199901)83:1<33::AID-SCE2>3.0.CO;2-Z

Crossref Full Text | Google Scholar

Mayer, R. (1997). Multimedia learning: are we asking the right questions? Educ. Psychol. 32, 1–19. doi: 10.1207/s15326985ep3201_1

Crossref Full Text | Google Scholar

McCarthy, K., Guerrero, T., Kent, K., Allen, L., McNamara, D., Chao, S.-F., et al. (2018). Comprehension in a scenario-based assessment: Domain and topic-specific background knowledge. Discour. Proc. 55, 1–15. doi: 10.1080/0163853X.2018.1460159

Crossref Full Text | Google Scholar

McCarthy, K., and McNamara, D. (2021). The multidimensional knowledge in text comprehension framework. Educ. Psychol. 56, 1–19. doi: 10.1080/00461520.2021.1872379

Crossref Full Text | Google Scholar

McNamara, D., and Kintsch, W. (1996). “Working memory in text comprehension: interrupting difficult text,” in Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society (London: Routledge), 1–20.

Google Scholar

Meys, H. L., and Sanderson, P. M. (2013). “The effect of individual differences on how people handle interruptions,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting (Los Angeles, CA: Sage Publications). doi: 10.1177/1541931213571188

Crossref Full Text | Google Scholar

Oulasvirta, A., and Saariluoma, P. (2006). Surviving task interruptions: investigating the implications of long-term working memory theory. Int. J. Hum. Comput. Stud. 64, 941–961. doi: 10.1016/j.ijhcs.2006.04.006

Crossref Full Text | Google Scholar

Pashler, H., Kang, S. H. K., and Ip, R. Y. (2013). Does multitasking impair studying? Depends on timing. Appl. Cogn. Psychol. 27, 593–599. doi: 10.1002/acp.2919

Crossref Full Text | Google Scholar

Peters, M., Laeng, B., Latham, K., Jackson, M., Zaiyouna, R., and Richardson, C. (1995). A redrawn vandenberg and kuse mental rotations test: different versions and factors that affect performance. Brain Cogn. 28, 39–58. doi: 10.1006/brcg.1995.1032

PubMed Abstract | Crossref Full Text | Google Scholar

Ratwani, R. M., and Trafton, J. G. (2008). Spatial memory guides task resumption. Visual Cogn. 16, 1001–1010. doi: 10.1080/13506280802025791

Crossref Full Text | Google Scholar

Redick, T. S., Broadway, J. M., Meier, M. E., Kuriakose, P. S., Unsworth, N., Kane, M. J., et al. (2012). Measuring working memory capacity with automated complex span tasks. Eur. J. Psychol. Assess. 28, 164–171. doi: 10.1027/1015-5759/a000123

PubMed Abstract | Crossref Full Text | Google Scholar

Rey, G. D. (2012). A review of research and a meta-analysis of the seductive detail effect. Educ. Res. Rev. 7, 216–237. doi: 10.1016/j.edurev.2012.05.003

Crossref Full Text | Google Scholar

Richmond, L., Burnett, L., Morrison, A., and Ball, H. (2022). Performance on the processing portion of complex working memory span tasks is related to working memory capacity estimates. Behav. Res. Methods 54, 780–794. doi: 10.3758/s13428-021-01645-y

PubMed Abstract | Crossref Full Text | Google Scholar

Rosen, L. D., Mark Carrier, L., and Cheever, N. A. (2013). Facebook and texting made me do it: Media-induced task-switching while studying. Comput. Human Behav. 29, 948–958. doi: 10.1016/j.chb.2012.12.001

Crossref Full Text | Google Scholar

Rothkopf, E. Z. (1971). Incidental memory for location of information in text. J. Verbal Learn. Verbal Behav. 10, 608–613. doi: 10.1016/S0022-5371(71)80066-X

Crossref Full Text | Google Scholar

Schneider, S., Beege, M., Nebel, S., and Rey, G. D. (2018). A meta-analysis of how signaling affects learning with media. Educ. Res. Rev. 23, 1–24. doi: 10.1016/j.edurev.2017.11.001

Crossref Full Text | Google Scholar

Schnotz, W. (2002). Towards an integrated view of learning from text and visual displays. Educ. Psychol. Rev. 14, 101–120. doi: 10.1023/A:1013136727916

Crossref Full Text | Google Scholar

Schurer, T., and Schubert, T. (2019). Working memory capacity but not prior knowledge impact on readers' attention and text comprehension. Front. Educ. 5:26. doi: 10.3389/feduc.2020.00026

Crossref Full Text | Google Scholar

Seamster, T. L., Redding, R. E., Cannon, J. R., Ryder, J. M., and Purcell, J. A. (1993). Cognitive task analysis of expertise in air traffic control. Int. J. Aviat. Psychol. 3, 257–283. doi: 10.1207/s15327108ijap0304_2

Crossref Full Text | Google Scholar

Shah, P., Miyake, A., and Miyake, A. (1996). The separability of working memory resources for spatial thinking and language processing: an individual differences approach. J. Exper. Psychol. 125, 4–27. doi: 10.1037/0096-3445.125.1.4

PubMed Abstract | Crossref Full Text | Google Scholar

Stutts, J., Feaganes, J., Reinfurt, D., Rodgman, E., Hamlett, C., Gish, K., et al. (2005). Driver's exposure to distractions in their natural driving environment. Accident Anal. Prev. 37, 1093–1101. doi: 10.1016/j.aap.2005.06.007

PubMed Abstract | Crossref Full Text | Google Scholar

Taub, M., and Azevedo, R. (2019). How does prior knowledge influence eye fixations and sequences of cognitive and metacognitive SRL processes during learning with an intelligent tutoring system? Int. J. Artif. Intell. Educ. 29, 1–28. doi: 10.1007/s40593-018-0165-4

Crossref Full Text | Google Scholar

Trafton, J., Altmann, E., and Brock, D. (2005). “Huh, what was I doing? How people use environmental cues after an interruption,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 49. doi: 10.1037/e577392012-053

Crossref Full Text | Google Scholar

Trafton, J., Altmann, E. M., Brock, D. P., and Mintz, F. E. (2003). Preparing to resume an interrupted task: Effects of prospective goal encoding and retrospective rehearsal. Int. J. Hum. Comput. Stud. 58, 583–603. doi: 10.1016/S1071-5819(03)00023-5

Crossref Full Text | Google Scholar

Unsworth, N., Redick, T. S., Heitz, R. P., Broadway, J. M., and Engle, R. W. (2009). Complex working memory span tasks and higher-order cognition: a latent-variable analysis of the relationship between processing and storage. Memory 17, 635–654. doi: 10.1080/09658210902998047

PubMed Abstract | Crossref Full Text | Google Scholar

Van Dijk, T. A., and Kintsch, W. (1983). Strategies of Discourse Comprehension. New York: Academic Press.

Google Scholar

Werner, N. E., Cades, D. M., Boehm-Davis, D. A., Chang, J., Khan, H., and Thi, G. (2011). “What Makes Us Resilient to Interruptions? Understanding the role of individual differences in resumption,” in Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 296–300. doi: 10.1177/1071181311551062

Crossref Full Text | Google Scholar

Wijekumar, K. K., Meyer, B. J., and Lei, P. (2012). Large-scale randomized controlled trial with 4th graders using intelligent tutoring of the structure strategy to improve nonfiction reading comprehension. Educ. Technol. Res. Dev. 60, 987–1013. doi: 10.1007/s11423-012-9263-4

Crossref Full Text | Google Scholar

Wirzberger, M., and Rey, G. D. (2018). Attention please! Enhanced attention control abilities compensate for instructional impairments in multimedia learning. J. Comput. Educ. 5, 243–257. doi: 10.1007/s40692-018-0106-0

Crossref Full Text | Google Scholar

Wirzberger, M., and Russwinkel, N. (2015). Modeling interruption and resumption in a smartphone task: an ACT-R approach. I-Com 14, 147–154. doi: 10.1515/icom-2015-0033

Crossref Full Text | Google Scholar

Wolfe, M. B., and Woodwyk, J. M. (2010). Processing and memory of information presented in narrative or expository texts. Br. J. Educ. Psychol. 80, 341–362. doi: 10.1348/000709910X485700

PubMed Abstract | Crossref Full Text | Google Scholar

Zermiani, F., Dhar, P., Sood, E., Kögel, F., Bulling, A., and Wirzberger, M. (2024). “InteRead: an eye tracking dataset of interrupted reading,” in Proceedings of the 31st Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), 1–16.

Google Scholar

Keywords: resumption, reading, interruption, visuo-spatial working memory, prior knowledge, individual differences

Citation: Zermiani F, Dhar P, Strohm F, Baumbach S, Bulling A and Wirzberger M (2024) Individual differences in visuo-spatial working memory capacity and prior knowledge during interrupted reading. Front. Cognit. 3:1434642. doi: 10.3389/fcogn.2024.1434642

Received: 18 May 2024; Accepted: 19 August 2024;
Published: 04 September 2024.

Edited by:

Stefano Lasaponara, Sapienza University of Rome, Italy

Reviewed by:

Kristen Pammer, The University of Newcastle, Australia
James Hugo Smith-Spark, London South Bank University, United Kingdom

Copyright © 2024 Zermiani, Dhar, Strohm, Baumbach, Bulling and Wirzberger. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Francesca Zermiani, ZnJhbmNlc2NhLnplcm1pYW5pJiN4MDAwNDA7aWZlLnVuaS1zdHV0dGdhcnQuZGU=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.