This article is a commentary on:
Neurophysiological constraints on the eye-mind link
Sebastian Wallot
Damian Kelty-Stephen- 1Department for Culture and Society, Interacting Minds Centre, Aarhus University, Aarhus, Denmark
- 2Department of Psychology, Grinnell College, Grinnell, IA, USA
A commentary on
Neurophysiological constraints on the eye-mind link
by Reichle, E. D., and Reingold, E. M. (2013). Front. Hum. Neurosci. 7:361. doi: 10.3389/fnhum.2013.00361
Reichle and Reingold (2013) presented the hypothesis that parafoveal preview is a requirement for the average fixation during reading in order for lexical processing to control eye movements. Taking 240 ms as the customary fixation duration in reading a single word, they arrive at their conclusion by decomposing these 240 ms into stages of a strictly serial-processing model. This subtractive accounting finds the visual system coming up short so long as lexical processing is strictly foveal, that is, so long as lexical processing addresses only the word directly in front of the fovea during a fixation. Neurophysiological estimates of latencies in retinal transmission to the brain and in visual encoding leave little more than 60 ms for lexical processing and 90 ms for programming the next saccade. Reichle and Reingold's solution to this processing bottleneck is to propose that lexical processing of the next word usually begins parafoveally, that is, during the fixation of the current word.
We question the generality of the solution that Reichle and Reingold (2013) offer. Rather the observation of comparatively short fixation durations may tie in with a wider range of findings on remarkably fast response times in which cognitive, neural, and physiological events unfolding at various time scales conspire to poise the human organism for a variety of stimuli and dramatically reduce the time needed to arrive at sensible response from stimulus onset (Wallot and Van Orden, 2012). We argue that the solution to the problem can be found by investigating the contextual constraints organizing cognitive activity.
Paravfoveal Processing
The requirement of parafoveal processing to make this serial temporal accounting work raises as many questions as it may resolve. For instance, word skipping rates (counting out refixations) during reading vary between 20% and 50% (Starr and Rayner, 2001; Demberg and Keller, 2008), suggesting that parafoveal preview will often not precede foveal fixation, leaving later fixations to resolve the processing bottleneck all over again. Also, the proposed role for parafoveal fixation suggests that the very first fixation during reading must be on average longer than the subsequent fixations, as no parafoveal preview is possible. However, this is not borne out in empirical data (e.g., Rayner, 1977).
It is noteworthy that the temporal accounting behind proposals for parafoveal fixations depend heavily on the centrality of local lexical features for text reading (Rayner and Reichle, 2010). However, the availability of general invariants on the sub-lexical, lexical, or syntactic scale of reading are in doubt (see Frost, 2012). Complicating matters further, local lexical features (such as word frequency) play no substantial role in connected text reading (Wallot et al., 2013). Hence, insofar as one considers text reading as the target phenomenon that theories of reading should explain, it is questionable whether local lexical features are really at the core of naturalistic reading.
Saccades, Fixations, and Power-Law Scale Invariance
Reliable algorithmic classifications of eye movements along a fault line between saccades and fixations has been elusive (Karsh and Breitenbach, 1983) and algorithmic differences in fixation identification lead to diverging results (Salvucci and Goldberg, 2000). When examined strictly in terms of distances between consecutive samples of an eye-tracking device, the distribution of the raw eye-movement record conforms to a unimodal power-law-like distribution. Hence, fixations and saccades do not reveal themselves in terms of a bi-modal (or multimodal, for the case of microsaccades; e.g., Rolfs, 2009) distribution. The scale-invariant, power-law-like form suggests that eye-movement fluctuations are a scale-free process (Stephen and Mirman, 2010; Coey et al., 2012), where the smallest fluctuations (i.e., the eye's tremor during a fixation) blend seamlessly with the largest fluctuations (i.e., long saccadic movements; see Figure 1). The scale-invariance in eye-movement fluctuations only exacerbates the algorithmic challenge of identifying a context-general threshold for distinguishing fixational from saccadic fluctuations in behavioral eye-tracking data.
FIGURE 1
Figure 1. Scaling in eye-movement fluctuations. (A) Record of horizontal eye-gaze positions in pixels during text reading. The data were recorded using an ASL D6 eye-tracker (sampling rate: 60 Hz; resolution: 0.25°), with 1 pixel ≈0.02°. (B) Difference of position-record (Gaze step-size) from (A). In this record, periods of large fluctuations indicate saccadic movements, and periods of small fluctuations indicate fixations. (C) Histogram of gaze steps from (C). (D) Log-log plot of the right side of Gaze step-size distribution. The logarithm of the Gaze step-size falls linearly off as a function of the logarithm of the number of Gaze steps. However, notice the deviation form linearity on the graph for the smallest step-sizes. This deviation occurs at around a step-size of 10 px., and might be the results of aliasing effects due to the minimal spatial resolution of the eye-tracking system.
Constraints as Solution?
The dominant interpretation of power law relationships in empirical data is that they reflect subtle coordination of very many nested constraints, driven by the slowest time-scale constraints and cascading downwards into progressively faster bodily and neuro-cognitive events, each constraining and shaping the next (Van Orden et al., 2003; Ihlen and Vereijken, 2010). For the case of eye-movements during reading, scale invariance implicates factors on broader time-scales than those for individual-word lexical processing, such as reader expertise and the text's emerging meaning (Wallot et al., 2013), or the experimental protocol (Van Orden et al., 2010). Constraints delimit the amount of necessary information processing by setting up the organization of the neuro-cognitive system in a way that only relevant information needs to be processed as opposed to whole possible informational content of a stimulus (van Rooij, 2012; Wallot and Van Orden, 2012). The serial model requiring parafoveal preview appears to imply that each word is an entirely new obstacle to be reckoned with as though the neuro-cognitive system had not already processed hundreds of words leading up to it.
The problem that fast reading times pose might not arise so much from neurophysiological limits but from the premise that only short-range factors (i.e., lexical word features) lead serially to short-range effects (i.e., fixation durations). Scale invariance in eye-movements (Stephen and Mirman, 2010; Coey et al., 2012; Kelty-Stephen and Mirman, 2013) and written language (Montemurro and Pury, 2002) motivates a re-conceptualization of the reading process in terms of cascade formalisms. Cascades constitute a class of formalisms characterizing random processes as the hierarchical spreading or clustering of events nested across very many scales (e.g., words nested within sentences within paragraphs within passages; Turcotte et al., 2002). Importantly, they manifest in the scale-invariant properties indicative of nonlinear correlations across space or time. Such cascade-driven nonlinear dependence across time entail that fixation and saccade are not, as Reichle and Reingold (2013) suggest, chained together as serially independent events. Parafoveal preview resolves a paradox inherited from the purely serial model of reading. Cascade-based models of reading might allow for fast reading times exactly by taking at face value the possibility that our perceptual systems allow us to read through coordination of sub-processes across different time-scales and across words, sentences, or texts.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Coey, C. A., Wallot, S., Richardson, M. J., and Van Orden, G. (2012). On the structure of measurement noise in eye-movements. J. Eye-Mov. Res. 5, 1–10.
Demberg, V., and Keller, F. (2008). Data from eye-tracking corpora as evidence for theories of syntactic processing complexity. Cognition 109, 193–210. doi: 10.1016/j.cognition.2008.07.008
Frost, R. (2012). Towards a universal model of reading. Behav. Brain Sci. 35, 263–329. doi: 10.1017/S0140525X11001841
Ihlen, E. A. F., and Vereijken, B. (2010). Interaction-dominant dynamics in human cognition: Beyond 1/f fluctuation. J. Exp. Psychol. Gen. 139, 436–463. doi: 10.1037/a0019098
Karsh, R., and Breitenbach, F. W. (1983). “Looking at looking: the amorphous fixation measure,” in Eye Movements and Psychological Functions: International Views, eds R. Groner, C. Menz, D. F. Fisher, and R. A. Monty (Hillsdale, NJ: Erlbaum), 53–64.
Kelty-Stephen, D. G., and Mirman, D. (2013). Gaze fluctuations are not additively decomposable: Reply to Bogartz and Staub. Cognition 126, 128–134. doi: 10.1016/j.cognition.2012.09.002
Montemurro, M. A., and Pury, P. A. (2002). Long-range fractal correlations in literary corpora. Fractals 10, 451–461. doi: 10.1142/S0218348X02001257
Rayner, K. (1977). Visual attention in reading: eye movements reflect cognitive processes. Mem. Cogn. 5, 443–448. doi: 10.3758/BF03197383
Rayner, K., and Reichle, E. D. (2010). Models of the reading process. Wiley Interdiscip. Rev. Cogn. Sci. 1, 787–799. doi: 10.1002/wcs.68
Reichle, E. D., and Reingold, E. M. (2013). Neurophysiological constraints on the eye-mind link. Front. Hum. Neurosci. 7:361. doi: 10.3389/fnhum.2013.00361
Rolfs, M. (2009). Microsaccades: small steps on a long way. Vision Res. 49, 2415–2441. doi: 10.1016/j.visres.2009.08.010
Salvucci, D. D., and Goldberg, J. H. (2000). “Identifying fixations and saccades in eye-tracking protocols,” in Proceedings of the Eye Tracking Research and Applications Symposium (New York, NY: ACM Press), 71–78. doi: 10.1145/355017.355028
Starr, M. E., and Rayner, K. (2001). Eye movements during reading: some current controversies. Trends Cogn. Sci. 5, 156–163. doi: 10.1016/S1364-6613(00)01619-3
Stephen, D. G., and Mirman, D. (2010). Interactions dominate the dynamics of visual cognition. Cognition 115, 154–165. doi: 10.1016/j.cognition.2009.12.010
Turcotte, D. L., Malamud, B. D., Guzzetti, F., and Reichenbach, P. (2002). Self-organization, the cascade model, and natural hazards. Proc. Natl. Acad. Sci. U.S.A. 99, 2530–2537. doi: 10.1073/pnas.012582199
Van Orden, G., Holden, J. G., and Turvey, M. T. (2003). Self-organization of cognitive performance. J. Exp. Psychol. Gen. 132, 331–350. doi: 10.1037/0096-3445.132.3.331
Van Orden, G., Kello, C. T., and Holden, J. G. (2010). Situated behavior and the place of measurement in psychological theory. Ecol. Psychol. 22, 24–43. doi: 10.1080/10407410903493145
van Rooij, I. (2012). Self-organization takes time too. Top. Cogn. Sci. 4, 63–71. doi: 10.1111/j.1756-8765.2011.01173.x
Keywords: eye-movement fluctuations, reading, fixations, saccades, scale invariance, ultrafast reading times
Citation: Wallot S and Kelty-Stephen D (2014) Constraints are the solution, not the problem. Front. Hum. Neurosci. 8:324. doi: 10.3389/fnhum.2014.00324
Received: 09 December 2013; Accepted: 30 April 2014;
Published online: 20 May 2014.
Edited by:
John J. Foxe, Albert Einstein College of Medicine, USAReviewed by:
Daniel Belyusar, Massachusetts Institute of Technology, USAMark Richard Harwood, City College of New York, USA
Copyright © 2014 Wallot and Kelty-Stephen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: sewa@hum.au.dk