Rony Hirschhorn
Ofer Kahane
Inbal Gur-Arie2
Nathan Faivre
Liad Mudrik- 1Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
- 2School of Psychological Sciences, Tel-Aviv University, Tel-Aviv, Israel
- 3Laboratoire de Psychologie et Neurocognition (LPNC), CNRS UMR 5105, Université Grenoble Alpes, Grenoble, France
In the ongoing research of the functions of consciousness, special emphasis has been put on integration of information: the ability to combine different signals into a coherent, unified one. Several theories of consciousness hold that this ability depends on – or at least goes hand in hand with – conscious processing. Yet some empirical findings have suggested otherwise, claiming that integration of information could take place even without awareness. Trying to reconcile this apparent contradiction, the “windows of integration” (WOI) hypothesis claims that conscious access enables signal processing over large integration windows. The hypothesis applies to integration windows defined either temporally, spatially, or semantically. In this review, we explain the hypothesis and re-examine it in light of new studies published since it was suggested. In line with the hypothesis, these studies provide compelling evidence for unconscious integration, but also demonstrate its limits with respect to time, space, and semantic distance. The review further highlights open questions that still need to be pursued to demonstrate the applicability of the WOI hypothesis as a guiding principle for understanding the depth and scope of unconscious processes.
Introduction
What are the relations between integration and consciousness? This question has not ceased to intrigue scholars across disciplines (for review, see Mudrik et al., 2014) and is still unresolved. Integration – defined here as a process whereby individual signals are combined to a novel, unified representation – has been repeatedly suggested to be tightly related to consciousness (Dehaene and Changeux, 2011; Oizumi et al., 2014; Ruffini, 2017; Safron, 2020). Yet the nature of these relations is unclear, some studies report evidence for different types of integrative processes taking place without awareness (to be reviewed below; a few examples are the integration of 3D objects: Cho and He, 2019; integration of names and professions: Scott et al., 2018; and integration of successive arrows: Tu et al., 2020). On the other hand, others negate these findings and either report no evidence for unconscious integration (e.g., no difference between congruent and incongruent masked idioms: Zhou et al., 2016) or show that previous findings fail to replicate (e.g., Moors et al., 2016a; Rabagliati et al., 2018).
A possible explanation for these conflicting findings was put forward as part of the Windows of Integration hypothesis (WOI; Mudrik et al., 2014). According to this suggestion, the need for conscious processing in integrating two or more representations into a novel one depends on the size of the integration window, which can be defined spatially, temporally, or semantically1. And so, integration can occur both with and without consciousness for small windows of integration, but only consciously for larger ones. This hypothesis seemed to reconcile previous findings, as unconscious integration in those studies was indeed typically confined to small integration windows (e.g., short distances between integrated stimuli, short intervals between them, or a small semantic distance).
Yet in recent years, new studies have tackled the question of unconscious integration, allowing us to revisit the original hypothesis and see if it is borne out by the data, should be updated or completely abandoned. In this narrative review, we describe the main findings of these papers (published since 2013; for a full list and classification of papers, see Supplementary Data, and for a review of earlier effects, see Mudrik et al., 2014), and try to classify them according to window size. Note that this is not a quantitative review nor a meta-analysis; hence, we take the authors’ interpretation of their findings at face value and do not attempt to assess the statistical reliability of the effects.
Windows of Integration
We define integration as the formation of a unified representation from distinct signals spread over time, space, or semantic distances.
Semantic integration refers to combining the meaning of two symbols into a new one. This ability to judge the relations between two elements and to integrate them into a new representation is sometimes referred to as relational processing (Goodwin and Johnson-Laird, 2005; Zucker and Mudrik, 2019). It is often claimed to underlie processes like word and sentence comprehension (van Gaal et al., 2014), arithmetic operations (Sklar et al., 2012), similarity judgments (Liu et al., 2016), and categorization (Ruch et al., 2016; Biderman et al., 2020). Accordingly, such integration is prominent and has been widely studied in a myriad of processes, ranging from perceptual processing (Bar, 2004) to verbal and conceptual ones (Halford et al., 2010). The Semantic Processing Integration Window (SPIW) is defined by the semantic distance between the units of integrated information, which could also be defined in terms of semantic complexity; the more complex the integration (i.e., the more semantic processing it requires), the bigger the window.
Temporal integration refers to the combination of sequential inputs into a unified representation (Mudrik et al., 2014; Faivre and Koch, 2014b). It allows perceiving events as unfolding in time (Faivre and Koch, 2014a,b; Salomon et al., 2016; Moors et al., 2017b), inferring the relations between successive events (Tzovara et al., 2015a; Schlossmacher et al., 2020; Tu et al., 2020), or combining them into one meaningful signal (Zhou et al., 2016; Yang et al., 2017; Nakamura et al., 2018; Mongelli et al., 2019; Tu et al., 2019b). This type of integration, too, can take place over windows of varying sizes, defined here as Temporal Integration Windows (TIWs). Operationally speaking, this is defined as “the maximal delay between two events for which a response differs from the summed responses associated with each event” (Faivre and Koch, 2014b). Note that this definition is different from other usages of “temporal integration window” in the literature; for example, some use it to refer to the brain’s temporal “resolution” (Arnett and Di Lollo, 1979; Blake and Lee, 2005; Wutz et al., 2016), a topic that has been the focus of recent clinical (Stevenson et al., 2014; Zhou et al., 2018) and developmental research (Freschl et al., 2019; Ronconi et al., 2020) and is related to hypotheses about whether consciousness is continuous or discrete (for a review, see Herzog et al., 2020).
Finally, spatial integration is defined across space; that is, combining information or signals located at different places in space, into one representation. This can take place throughout the visual field, both within the foveal region, which occupies about 2° in the center of the visual field and is characterized by high acuity (Curcio et al., 1987; Cohen et al., 2020), and within the parafoveal and the peripheral regions surrounding it (Rayner, 2009). Notably, we are referring here to the visual spatial area, as most studies in the field have focused on visual processing (in line with the seminal framework by Crick and Koch, 2003), yet spatial integration can also take place over the auditory, somatosensory and even olfactory space. In all cases, integration is a combination between two signals, that are spatially distinct. Accordingly, Spatial Integration Windows (SIWs) are defined based on the (physical) distance between the integrated signals. Thus, the larger the distance between elements, the larger the integration window.
For all integration types, the WOI hypothesis can be broken down to two parts. The first holds that unconscious integration can take place for small integration windows (henceforth, WOIH1). The second states that this will not be the case for large windows; there, conscious processing would be needed for integration to occur (WOIH2). Inspecting the literature, no clear-cut answer emerges with respect to these premises across types of integration windows (Figure 1), especially since very few studies put the hypotheses to a direct test, by manipulating window size within one study. Still, when the mutual influences between window types are taken into account (for example, when semantic differences are considered with respect to studies that probed temporal integration) and when the studies are grouped together under the WOI framework, the main principle does seem to be confirmed, especially for the semantic domain, which constitutes the lion’s share of the data.
Figure 1. An illustration of findings of studies of unconscious integration published since 2013, outlined according to SPIW, TIW, and SIW. For all panels, red markers indicate experiments that were interpreted by the authors as suggesting no integration over that window, and green markers represent experiments that were interpreted by the authors as showing positive evidence for unconscious integration. (A) SPIW: the x axis denotes the number of integrated items, and the y axis describes the type of stimuli in the experiment, ordered in ascending complexity, as interpreted by the authors. Marker size describes the level of cognitive complexity the task required, as interpreted by the authors (in ascending order: similarity judgment, congruency, classification, language integration, holistic integration, and problem solving. In the absence of a clear metric of complexity, the suggested order is based on our assessment of the required cognitive effort). (B) TIW: the x axis denotes the duration of the integration window, and the y axis describes the type of stimuli in the experiment, ordered in ascending complexity, as interpreted by the authors. Marker size describes the level of cognitive complexity of the task, as interpreted by the authors (in ascending order: shape processing, motion inference, congruency, classification, language integration). (C) SIW: the x axis denotes the visual angle of the area captured by the integrated items, and the y axis describes the complexity of the visual stimulus, as interpreted by the authors (in increasing order: line, shape, 3D, size illusion, and illusory contour). Experiments that belong to the same research paper are marked with an identical shape.
Semantic Processing Integration Window
Words are the most common stimulus used in unconscious semantic integration studies (e.g., Zabelina et al., 2013; van Gaal et al., 2014; Scott et al., 2018; Mongelli et al., 2019). Many studies found evidence supporting WOIH1, reporting different forms of unconscious integration between two and sometimes even three words, mostly at the pre-sentence level, for tasks that seem to require relatively shallow processing; behaviorally, response-time congruency effects were evoked by categorically related pairs of words, compared to unrelated pairs (e.g., Pear and Orange vs. Pear and Hammer in Tu et al., 2019a). Similarly, a two-item integration was also found between words and non-words, and between words and pictorial stimuli (Ruch et al., 2016). Surprisingly, this effect was reported to last for 15–25 min, as opposed to typical findings in the field that are short-lived (Greenwald et al., 1996). Another study reported integration between three masked Chinese words that either form or do not form an idiom with a sequentially presented visible target (Tu et al., 2019b; see further discussion in the TIW section). However, note that the latter finding could simply rely on familiarity or well-established templates for these idioms, rather than on semantic integration between the words to form a sentence-level understanding. Using EEG, unconscious integration between two simultaneously presented words [a modifier (very/not) and an adjective] was reported, when a similar N400 effect (held by some to index semantic integration; Kutas and Federmeier, 2011) was found for masked and unmasked words (van Gaal et al., 2014). And with fMRI, differences were found between meaningful sentences and non-words rendered unconscious (Axelrod et al., 2015), though it is more likely that this represents differential processing between words and non-words, irrespective of integration (accordingly, it was not included in the figure).
Unconscious two-item associations are not restricted to the visual domain; in one study, the relations between pairs of unconsciously presented visual and auditory digits were processed, but only following conscious training (Faivre et al., 2014). A more recent study found that subliminal associations can be formed between two visually presented words, auditorily presented ones, and visual-auditory ones even without prior conscious training (Scott et al., 2018). Taken together with the abovementioned visual studies, these findings support WOIH1, suggesting that some forms of semantic integration, mostly involving two and sometimes three items at the pre-sentence level, are indeed possible even without awareness.
The data tells a more complicated story when it comes to WOIH2. Here, the ultimate test lies in studies that include some manipulation of window size, so to directly probe the hypothesis within one experiment. Unfortunately, such studies are relatively rare (though there are more in the spatial domain; see the SIW section below). One study did inspect subjects’ ability to integrate an unconsciously perceived contextual cue and a visible ambiguous stimulus (Biderman et al., 2020). There, unconsciously perceived numbers (12 and 14) or letters (A and C) biased the classification of the visible ambiguous stimulus that could be interpreted as B or 13. Interestingly, similar facilitation was not found when the invisible contextual inducers formed a word with the visible ambiguous stimulus, suggesting that unconscious integration was limited to the categorical level and did not occur at the lexical one, in line with WOIH2.
Yet another way to assess this hypothesis is to examine studies that did not find evidence for unconscious integration, and contrast them with studies that did: do they differ in the size of probed SPIW? Overall, the answer seems to be positive, at least under the interpretation we suggest here. First, integration that involves more complicated, deeper processing (i.e., greater semantic complexity which can be considered as a larger SPIW), is less likely to occur unconsciously, much like the conclusion of the B/13 study above. For example, an ERP study failed to find differences between waveforms evoked by masked word-pairs that either correctly or incorrectly described a subsequent visible target picture (Mongelli et al., 2019). There, the task involved integrating the meaning of two independent words into a short sentence with a subject and verb, as opposed to the studies reviewed above that probed similarity judgments (Tu et al., 2019a) or the integration of a word and a modifier (van Gaal et al., 2014). Sentence-level reading was put into question in another recent study (Rabagliati et al., 2018) that failed to replicate an earlier finding (Sklar et al., 2012) of unconscious integration of four-to-five-word sentences, or even two-word phrases (note that these studies inevitably also manipulate either spatial distance or temporal one, depending on whether the stimuli are presented simultaneously or sequentially). An interesting example is a study that presented problems (or riddles) where three seemingly unrelated words (e.g., pine, crab, and sauce) were related to a fourth word (here, apple), without being related to each other (Zabelina et al., 2013). These riddles were preceded by either the same three words or different ones, rendered invisible. Subjects were better at solving these problems following the presentation of the same words, compared with different ones, which seemingly suggests relatively deep semantic integration. Intriguingly, however, the effect was only found when subjects indicated that they solved the problem analytically, rather than based on insight. The authors argued that the lack of effect across all trial types indicates that semantic integration actually did not take place; if it had, they explain, it should have been observed also in the insight condition. Instead, they claim that suppressed words evoked enough semantic priming to activate associations that are related to correct solutions, even without integration (e.g., automatic spread of activation). If we accept their claim for lack of integration, this supports WOIH2, as this study requires the integration of relatively large number of items (as most findings support unconscious integration within a two-item SPIW size, while a three-item SPIW is less prevalent), and – more importantly – a much deeper semantic processing than the one required in the studies where effects were found.
Moving to non-verbal stimuli, unconscious integration was implied for simple stimuli comprised of object-pairs; the latter broke suppression faster when they were congruently positioned (i.e., mirror above sink) than incongruently positioned (i.e., sink above mirror; Stein et al., 2015). Yet object-scene relations, which require higher-level of integration, have been recently shown to require conscious processing, as opposed to earlier reports (Mudrik et al., 2011; Mudrik and Koch, 2013); this was demonstrated both behaviorally (Moors et al., 2016a; Biderman and Mudrik, 2018) and using fMRI (Faivre et al., 2019). Finally, in face processing, congruency effects of valence-relations in subliminal pairs of faces were found both at the neural (Tu et al., 2013) and behavioral (Liu et al., 2016) levels. However, when contextual effects requiring holistic processing of faces were probed, no effects were found (Axelrod and Rees, 2014). Though it might be claimed that holistic processing is deeper than valence similarity judgment, this claim is highly speculative and requires further research.
Taken together, the above studies seem to support the WOI hypothesis, showing first that semantic integration can occur within small SPIWs, and second that this capacity declines and eventually diminishes as complexity of information and depth of processing increases.
Temporal Integration Window
As for temporal integration, there are two types of studies that probed conscious and unconscious integration over time. One line of research did so by suppressing moving stimuli and checking if motion was processed. There, some studies found evidence for motion processing that lasts as long as a few seconds (Salomon et al., 2016; Moors et al., 2017b). Notably, however, deciphering the exact TIWs in such studies is somewhat problematic, as we cannot know for sure which portion of the movement was processed (i.e., what was the actual TIW). To explain, even if the presented motion lasts for a whole second, it might be that processing takes place over the last/first tens of milliseconds (though not for all papers; See Salomon et al., 2016 for an example for such exception), not integrating over the entire period (for a discussion of motion as part of the continuous vs. discrete consciousness debate, see again Herzog et al., 2020). Thus, it might be more informative to focus on the second line of research, where two (or more) distinct stimuli, spaced in time, must be integrated to elicit differential responses. There, the only way to process the relations between the two stimuli, or to combine them into a new meaning, would be to integrate over the time window between them.
Much like in the semantic integration section, only one study parametrically manipulated the temporal distance between stimuli, using EEG to find evidence for integration of words presented at different inter-stimulus intervals (Nakamura et al., 2018). Reminiscent of Faivre and Koch (2014b), the paper reports unconscious integration of words in a sentence over small TIWs, but not large ones (notably, this effect was only found in EEG and not behaviorally). This again supports both WOIH1 and WOIH2, though the effect might also be explained by semantic complexity, since in this study, longer TIWs translated into more words. Additional support for WOIH2 can be found in studies using series of auditory stimuli with both local and global deviations. These studies typically find local unconscious integration (Faugeras et al., 2012; Tzovara et al., 2015a), while global integration – spanning over larger windows and notably more stimuli – is under debate (cf. Naccache et al., 2015; Tzovara et al., 2015b), in line with WOIH2. On the other hand, two papers found integration over much larger windows (Hung and Hsieh, 2020, TIW: 1,333 ms; Schlossmacher et al., 2020, TIW: 3,300 ms), which stands in sharp contradiction to the findings by Nakamura and colleagues reported above. How can these discrepancies be reconciled within one framework?
A possible solution lies in the type of integration probed in each of these studies, or the interplay between temporal and semantic integration windows. In Hung and Hsieh’s study, where unconscious integration over a large TIW was found, the integration was syntactic, while in the Nakamura et al. paper, it was semantic. In the study by Schlossmacher and colleagues, a series of visual stimuli was presented, and EEG indicated deviation processing, so again – high-level semantic integration was not required. Presumably, there might be a dependency between temporal and semantic integration windows, so that for lower-level integration (semantic-wise), unconscious processes can take place over larger temporal windows (Hung and Hsieh, 2020). For higher-level semantic relations, conversely, unconscious integration might either diminish with respect to TIW size (Nakamura et al., 2018), or be needed even for smaller TIWs (van Gaal et al., 2014; Zhou et al., 2016; Yang et al., 2017; Mongelli et al., 2019; Tu et al., 2019b). Thus, it could be that the temporal domain is secondary to the semantic one. Indeed, for the same TIW (96 ms) and paradigm (masking), one study found unconscious integration of the relation between two arrows (Tu et al., 2020), while another study failed to find unconscious integration of two words (Tu et al., 2019b). This hints that the temporal window over which unconscious integration can take place might differ with the degrees of semantic relations. Notably, in the absence of studies that attempted to find high-level semantic effects over large temporal windows, the picture is partial, so at this point, this suggestion is only based on anecdotal findings, and more research is needed to determine if the WOI hypothesis is correct with respect to the temporal domain. Such research should systematically manipulate both temporal and semantic windows, to disentangle the effects each of them has on the prospects of integration occurring without awareness.
Spatial Integration Window
Unlike the semantic and temporal windows, SIW-size manipulations (accomplished by changing the area captured by the stimulus or using stimuli of different sizes, measured by visual angle) are more common in unconscious processing studies (Fahrenfort et al., 2017; Chen et al., 2018; Cho and He, 2019; Sabary et al., 2020). Yet these manipulations did not seem to evoke differential patterns within each study (i.e., either an effect was found for all distances, or it was not found for any of them), perhaps since the different SIWs were relatively close to each other [e.g., 1.9 vs. 1.4° in one study (Cho and He, 2019), or 4, 4.8, 5.85, and 6.66° in another (Sabary et al., 2020)]. Collapsing all these studies together, while taking into account other studies that only probed one SIW, suggests that unconscious integration can generally take place for windows smaller than 3° (Chen et al., 2018, SIW: 2.6°; Cheng et al., 2019, SIW: 2.26°; Cho and He, 2019, SIW: 1.0, 1.4, and 1.9°; Li and Li, 2015, SIW: 2.26 and 2.76°; and Poscoliero et al., 2013, SIW: 1.5°), thus supporting WOIH1. For larger windows, the results are less coherent; some studies point to a lack of unconscious integration for windows larger than 4° (Chen et al., 2018, SIW: 7.7°; Del Pin et al., 2017, SIW: 8.25°; Devyatko et al., 2019, SIW: 4.0°, 5.65°; Kimchi et al., 2018, SIW: 4.25°; Sabary et al., 2020, SIW: 4.0, 4.8, 5.85, and 6.66°), while others find integration in similar and even larger windows (Chen et al., 2018, SIW: 4.8°; Devyatko et al., 2019, SIW: 4.0° and 5.65°; Kimchi et al., 2018, SIW: 4.25°; Montoro et al., 2014, SIW: 5.3°; Nakashima and Sugita, 2018, SIW: 4.5°; and Vandenbroucke et al., 2014, SIW: 12.6°). Note that in all these studies, two or more stimuli presented centrally had to be integrated to form a coherent representation, and window size refers to the area over which this integration took place [an exception is the study by Cho and He (2019), where a 3D cube was presented, and had to be integrated to yield an orientation-adaptation effect; we included it here as it was indeed interpreted by the authors as a case of structural organization and integration].
How can this discrepancy in findings for unconscious spatial integration over medium and large-sized windows be explained? One possible explanation relates to the method used for rendering stimuli unconscious. Attention-based paradigms, such as inattentional blindness (IB) and attentional blink (AB), seem to allow unconscious spatial integration over surprisingly large SIWs (Fahrenfort et al., 2017, AB, SIW: 7.4, 7.7, and 9.4°; Vandenbroucke et al., 2014, IB, SIW: 12.6°), that was not found using masking (Fahrenfort et al., 2017). This pattern was also demonstrated when evidence for unconscious integration of a stimulus using IB (Pitts et al., 2012) was not replicated with masking (Pitts et al., 2014). Interestingly though, studies directly comparing between Continuous Flash Suppression (CFS; Tsuchiya and Koch, 2005) and masking reported unconscious integration for masked stimuli, but no indication for integration of the same stimuli under CFS (Kimchi et al., 2018; Devyatko et al., 2019). Even with small SIWs, in studies of unconscious integration of a Kanizsa configuration (Kanizsa, 1976), integration was reported when using masking (Poscoliero et al., 2013, SIW: 1.5°) but not under CFS (Moors et al., 2016b, SIW: 1.4°). These findings are consistent with the hypothesis that stimulus integration under CFS is limited (Moors et al., 2017a; but see Sklar et al., 2018). Thus, it seems like attentional paradigms allow more unconscious spatial integration than CFS, and conflicting findings are found for masking (for more discussion about the difference between paradigms, see Izatt et al., 2014; Breitmeyer, 2015).
And so, both stimulus complexity and the method by which stimuli are rendered unconscious impact unconscious integration, beyond the size of the SIW as defined by visual angles. Similar to TIWs, then, the complexities of the data require further empirical examination, while controlling for the above factors.
Concluding Remarks
Taken together, the studies reviewed here provide suggestive though insufficient evidence for the WOI hypothesis; its first claim – WOIH1 – does seem to be confirmed by the data, as multiple studies report integration of information without awareness. Yet what is still suggestive at this point, is that this effect depends on window size; there is evidence in that direction, especially when examining SPIWs, which were more widely studied than TIWs or SIWs: semantic integration does seem to depend on the number of integrated items as well as the complexity of the semantic relations between them. A more complicated, yet somewhat similar, image emerges for TIWs and SIWs. There, for the most part, studies do follow WOIH2, showing that unconscious integration is more likely to be found for smaller temporal/spatial windows. However, some studies either fail to find integration for small windows or find integration for large ones. The picture becomes clearer when the findings are inspected through a multi-dimensional prism, also taking semantic complexity into account. In both the temporal and spatial domains, semantic relations and/or complexity seem to be critical in determining whether integration can take place unconsciously or not. Especially for the temporal domain, there is not enough data to inspect the effect of increasing the TIW within the same level of semantic complexity. This further strengthens the need for dedicated studies that would test the WOI hypothesis directly, by manipulating one type of window while keeping other windows constant. Currently, there are simply not enough studies that test the effect of window size directly, without confounding factors.
In sum, the WOI hypothesis aims at delineating the borders between integration processes that require conscious perception and those that can occur without awareness. This guiding principle seems to be supported to some extent by recent findings in consciousness studies; however, more data is needed to provide a definitive answer on the matter, especially with respect to the temporal and spatial domains. Generally speaking, this review also highlights the often-overlooked complexities of studying unconscious processing, which might explain conflicting findings in the field. Unconscious processes depend not only on the manipulation of interest, but on many additional factors that might affect the results, much like we saw here with both the temporal and spatial windows studies. In our field, the devil really is in the details (see also Rothkirch and Hesselmann, 2017), so future studies should take that into account when designing their experiments, to make sure the critical feature of interest is isolated, with minimal influences from other domains.
Author Contributions
RH, IG-A, and OK searched the literature, reviewed all relevant manuscripts, and discussed them with LM. RH focused on temporal integration windows, OK on semantic integration windows, and IG-A on spatial. RH combined these sections and wrote the manuscript, prepared the figure and the Supplementary Table. NF and LM reviewed and edited the manuscript. All authors contributed to the article and approved the submitted version.
Funding
LM is a CIFAR Tanenbaum Fellow in the Brain, Mind, and Consciousness program. This study was supported by the Israel Science Foundation (Grant No. 1847/16).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We thank Asael Sklar, Yusuke Nakashima, Simon Del Pin, and Mikel Jimenez for their responses to our questions, which helped us make sure we are accurately estimating the windows of integration in their manuscripts.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2020.617187/full#supplementary-material
Footnotes
- ^ The original hypothesis also referred to multi-modal integration windows, defined by the number of integrated modalities. Since this has been seldomly studied, multi-modal windows are not included in this review.
References
Arnett, J. L., and Di Lollo, V. (1979). Visual information processing in relation to age and to reading ability. J. Exp. Child Psychol. 27, 143–152. doi: 10.1016/0022-0965(79)90066-3
Axelrod, V., and Rees, G. (2014). Conscious awareness is required for holistic face processing. Consciousness Cogn. 27, 233–245. doi: 10.1016/j.concog.2014.05.004
Axelrod, V., Bar, M., Rees, G., and Yovel, G. (2015). Neural Correlates of Subliminal Language Processing. Cereb. Cortex 25, 2160–2169. doi: 10.1093/cercor/bhu022
Biderman, D., Shir, Y., and Mudrik, L. (2020). B or 13? Unconscious Top-Down Contextual Effects at the Categorical but Not the Lexical Level. Psychol. Sci. 31, 663–667. doi: 10.1177/0956797620915887
Biderman, N., and Mudrik, L. (2018). Evidence for Implicit—But Not Unconscious—Processing of Object-Scene Relations. Psychol. Sci. 29, 266–277. doi: 10.1177/0956797617735745
Blake, R., and Lee, S. H. (2005). The role of temporal structure in human vision. Behav. Cogn. Neurosci. Rev. 4, 21–42. doi: 10.1177/1534582305276839
Breitmeyer, B. G. (2015). Psychophysical “blinding” methods reveal a functional hierarchy of unconscious visual processing. Consciousness Cogn. 35, 234–250. doi: 10.1016/j.concog.2015.01.012
Chen, L., Qiao, C., Wang, Y., and Jiang, Y. (2018). Subconscious processing reveals dissociable contextual modulations of visual size perception. Cognition 180, 259–267. doi: 10.1016/j.cognition.2018.07.014
Cheng, K., Yang, K., Qin, L., Zhuo, Y., and Yan, H. (2019). Perceptual load modulates contour integration in conscious and unconscious states. PeerJ. 7:e7550. doi: 10.7717/peerj.7550
Cho, S., and He, S. (2019). Size-invariant but location-specific object-viewpoint adaptation in the absence of awareness. Cognition 192:104035. doi: 10.1016/j.cognition.2019.104035
Cohen, M. A., Botch, T. L., and Robertson, C. E. (2020). The limits of color awareness during active, real-world vision. Proc. Natl. Acad. Sci. U S A 117, 13821–13827. doi: 10.1073/pnas.1922294117
Crick, F., and Koch, C. (2003). A framework for consciousness. Nat. Neurosci. 6, 119–126. doi: 10.1038/nn0203-119
Curcio, C. A., Sloan, K. R., Packer, O., Hendrickson, A. E., and Kalina, R. E. (1987). Distribution of cones in human and monkey retina: Individual variability and radial asymmetry. Science 236, 579–582. doi: 10.1126/science.3576186
Dehaene, S., and Changeux, J. P. (2011). Experimental and Theoretical Approaches to Conscious Processing. Neuron 70, 200–227. doi: 10.1016/j.neuron.2011.03.018
Del Pin, S. H., Sandberg, K., Bibby, B. M., and Overgaard, M. (2017). Weak experiences sufficient for creating illusory figures that influence perception of actual lines. PLoS One 12:e0175339. doi: 10.1371/journal.pone.0175339
Devyatko, D., Sabary, S., and Kimchi, R. (2019). Perceptual organization of line configurations: Is visual awareness necessary? Consciousness Cogn. 70, 101–115. doi: 10.1016/j.concog.2019.02.005
Fahrenfort, J. J., Van Leeuwen, J., Olivers, C. N. L., and Hogendoorn, H. (2017). Perceptual integration without conscious access. Proc. Natl. Acad. Sci. U S A 114, 3744–3749. doi: 10.1073/pnas.1617268114
Faivre, N., and Koch, C. (2014a). Inferring the direction of implied motion depends on visual awareness. J. Vis. 14:4. doi: 10.1167/14.4.4
Faivre, N., and Koch, C. (2014b). Temporal structure coding with and without awareness. Cognition 131, 404–414. doi: 10.1016/j.cognition.2014.02.008
Faivre, N., Dubois, J., Schwartz, N., and Mudrik, L. (2019). Imaging object-scene relations processing in visible and invisible natural scenes. Sci. Rep. 9, 1–13. doi: 10.1038/s41598-019-38654-z
Faivre, N., Mudrik, L., Schwartz, N., and Koch, C. (2014). Multisensory Integration in Complete Unawareness: Evidence From Audiovisual Congruency Priming. Psychol. Sci. 25, 2006–2016. doi: 10.1177/0956797614547916
Faugeras, F., Rohaut, B., Weiss, N., Bekinschtein, T., Galanaud, D., Puybasset, L., et al. (2012). Event related potentials elicited by violations of auditory regularities in patients with impaired consciousness. Neuropsychologia 50, 403–418. doi: 10.1016/j.neuropsychologia.2011.12.015
Freschl, J., Melcher, D., Kaldy, Z., and Blaser, E. (2019). Visual temporal integration windows are adult-like in 5- to 7- year-old children. J. Vis. 19:5. doi: 10.1167/19.7.5
Goodwin, G. P., and Johnson-Laird, P. N. (2005). Reasoning about relations. Psychol. Rev. 112:468. doi: 10.1037/0033-295X.112.2.468
Greenwald, A. G., Draine, S. C., and Abrams, R. L. (1996). Three cognitive markers of unconscious semantic activation. Science 273, 1699–1702. doi: 10.1126/science.273.5282.1699
Halford, G. S., Wilson, W. H., and Phillips, S. (2010). Relational knowledge: The foundation of higher cognition. Trends Cogn. Sci. 14, 497–505. doi: 10.1016/j.tics.2010.08.005
Herzog, M. H., Drissi-Daoudi, L., and Doerig, A. (2020). All in Good Time: Long-Lasting Postdictive Effects Reveal Discrete Perception. Trends Cogn. Sci. 24, 826–837. doi: 10.1016/j.tics.2020.07.001
Hung, S., and Hsieh, P. (2020). Subliminal temporal integration of linguistic information. PsyArXiv 2020, 1–23. doi: 10.31234/osf.io/ak8y6
Izatt, G., Dubois, J., Faivre, N., and Koch, C. (2014). A direct comparison of unconscious face processing under masking and interocular suppression. Front. Psychol. 5:659. doi: 10.3389/fpsyg.2014.00659
Kanizsa, G. (1976). Subjective contours. Sci. Am. 234, 48–53. doi: 10.1038/scientificamerican0476-48
Kimchi, R., Devyatko, D., and Sabary, S. (2018). Can perceptual grouping unfold in the absence of awareness? Comparing grouping during continuous flash suppression and sandwich masking. Consciousness Cogn. 60, 37–51. doi: 10.1016/j.concog.2018.02.009
Kutas, M., and Federmeier, K. D. (2011). Thirty years and counting: Finding meaning in the N400 component of the event-related brain potential (ERP). Ann. Rev. Psychol. 62, 621–647. doi: 10.1146/annurev.psych.093008.131123
Li, Y., and Li, S. (2015). Contour integration, attentional cuing, and conscious awareness: An investigation on the processing of collinear and orthogonal contours. J. Vis. 15:10. doi: 10.1167/15.16.10
Liu, C., Sun, Z., Jou, J., Cui, Q., Zhao, G., Qiu, J., et al. (2016). Unconscious processing of facial emotional valence relation: Behavioral evidence of integration between subliminally perceived stimuli. PLoS One 11:e0162689. doi: 10.1371/journal.pone.0162689
Mongelli, V., Meijs, E. L., van Gaal, S., and Hagoort, P. (2019). No language unification without neural feedback: How awareness affects sentence processing. NeuroImage 202:116063. doi: 10.1016/j.neuroimage.2019.116063
Montoro, P. R., Luna, D., and Ortells, J. J. (2014). Subliminal Gestalt grouping: Evidence of perceptual grouping by proximity and similarity in absence of conscious perception. Consciousness Cogn. 25, 1–8. doi: 10.1016/j.concog.2014.01.004
Moors, P., Boelens, D., van Overwalle, J., and Wagemans, J. (2016a). Scene Integration Without Awareness: No Conclusive Evidence for Processing Scene Congruency During Continuous Flash Suppression. Psychol. Sci. 27, 945–956. doi: 10.1177/0956797616642525
Moors, P., Hesselmann, G., Wagemans, J., and van Ee, R. (2017a). Continuous Flash Suppression: Stimulus Fractionation rather than Integration. Trends Cogn. Sci. 21, 719–721. doi: 10.1016/j.tics.2017.06.005
Moors, P., Wagemans, J., and De-Wit, L. (2017b). Causal events enter awareness faster than non-causal events. PeerJ. 5:e2932. doi: 10.7717/peerj.2932
Moors, P., Wagemans, J., Van Ee, R., and De-Wit, L. (2016b). No evidence for surface organization in Kanizsa configurations during continuous flash suppression. Atten. Percep. Psychophy. 78, 902–914. doi: 10.3758/s13414-015-1043-x
Mudrik, L., and Koch, C. (2013). Differential processing of invisible congruent and incongruent scenes: A case for unconscious integration. J. Vis. 13:24. doi: 10.1167/13.13.24
Mudrik, L., Breska, A., Lamy, D., and Deouell, L. Y. (2011). Integration without awareness: Expanding the limits of unconscious processing. Psychol. Sci. 22, 764–770. doi: 10.1177/0956797611408736
Mudrik, L., Faivre, N., and Koch, C. (2014). Information integration without awareness. Trends Cogn. Sci. 18, 488–496. doi: 10.1016/j.tics.2014.04.009
Naccache, L., King, J. R., Sitt, J., Engemann, D., El Karoui, I., Rohaut, B., et al. (2015). Neural detection of complex sound sequences or of statistical regularities in the absence of consciousness? Brain 138:e395. doi: 10.1093/brain/awv190
Nakamura, K., Makuuchi, M., Oga, T., Mizuochi-Endo, T., Iwabuchi, T., Nakajima, Y., et al. (2018). Neural capacity limits during unconscious semantic processing. Eur. J. Neurosci. 47, 929–937. doi: 10.1111/ejn.13890
Nakashima, Y., and Sugita, Y. (2018). Size-contrast illusion induced by unconscious context. J. Vis. 18:16. doi: 10.1167/18.3.16
Oizumi, M., Albantakis, L., and Tononi, G. (2014). From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0. PLoS Comput. Biol. 10:e1003588. doi: 10.1371/journal.pcbi.1003588
Pitts, M. A., Martínez, A., and Hillyard, S. A. (2012). Visual processing of contour patterns under conditions of inattentional blindness. J. Cogn. Neurosci. 24, 287–303. doi: 10.1162/jocn_a_00111
Pitts, M. A., Metzler, S., and Hillyard, S. A. (2014). Isolating neural correlates of conscious perception from neural correlates of reporting one’s perception. Front. Psychol. 5:1078. doi: 10.3389/fpsyg.2014.01078
Poscoliero, T., Marzi, C. A., and Girelli, M. (2013). Unconscious priming by illusory figures: The role of the salient region. J. Vis. 13:27. doi: 10.1167/13.5.27
Rabagliati, H., Robertson, A., and Carmel, D. (2018). The importance of awareness for understanding language. J. Exp. Psychol. 147:190. doi: 10.1037/xge0000348
Rayner, K. (2009). The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search. Q. J. Exp. Psychol. 62, 1457–1506. doi: 10.1080/17470210902816461
Ronconi, L., Melcher, D., and Franchin, L. (2020). Investigating the role of temporal processing in developmental dyslexia: Evidence for a specific deficit in rapid visual segmentation. Psychonom. Bulletin Rev. 27, 724–734. doi: 10.3758/s13423-020-01752-5
Rothkirch, M., and Hesselmann, G. (2017). What we talk about when we talk about unconscious processing - A plea for best practices. Front. Psychol. 8:835. doi: 10.3389/fpsyg.2017.00835
Ruch, S., Züst, M. A., and Henke, K. (2016). Subliminal messages exert long-term effects on decision-making. Neurosci. Consciousness 1, 1–9. doi: 10.1093/nc/niw013
Ruffini, G. (2017). An algorithmic information theory of consciousness. Neurosci. Consciousness 3:nix019. doi: 10.1093/nc/nix019
Sabary, S., Devyatko, D., and Kimchi, R. (2020). The role of visual awareness in processing of global structure: Evidence from the perceptual organization of hierarchical patterns. Cognition 205:104442. doi: 10.1016/j.cognition.2020.104442
Safron, A. (2020). An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic. Front. Art. Int. 3:30. doi: 10.3389/frai.2020.00030
Salomon, R., Goldstein, A., Vuillaume, L., Faivre, N., Hassin, R. R., and Blanke, O. (2016). Enhanced discriminability for nonbiological motion violating the two-thirds power law. J. Vis. 16:12. doi: 10.1167/16.8.12
Schlossmacher, I., Dellert, T., Pitts, M., Bruchmann, M., and Straube, T. (2020). Differential effects of awareness and task relevance on early and late ERPs in a no-report visual oddball paradigm. J. Neurosci. 40, 2906–2913. doi: 10.1523/JNEUROSCI.2077-19.2020
Scott, R. B., Samaha, J., Chrisley, R., and Dienes, Z. (2018). Prevailing theories of consciousness are challenged by novel cross-modal associations acquired between subliminal stimuli. Cognition 175, 169–185. doi: 10.1016/j.cognition.2018.02.008
Sklar, A. Y., Deouell, L. Y., and Hassin, R. R. (2018). Integration despite Fractionation: Continuous Flash Suppression. Trends Cogn. Sci. 22, 956–957. doi: 10.1016/j.tics.2018.07.003
Sklar, A. Y., Levy, N., Goldstein, A., Mandel, R., Maril, A., and Hassin, R. R. (2012). Reading and doing arithmetic nonconsciously. Proc. Natl. Acad. Sci. U S A 109, 19614–19619. doi: 10.1073/pnas.1211645109
Stein, T., Kaiser, D., and Peelen, M. V. (2015). Interobject grouping facilitates visual awareness. J. Vis. 15:10. doi: 10.1167/15.8.10
Stevenson, R. A., Siemann, J. K., Schneider, B. C., Eberly, H. E., Woynaroski, T. G., Camarata, S. M., et al. (2014). Multisensory temporal integration in autism spectrum disorders. J. Neurosci. 34, 691–697. doi: 10.1523/JNEUROSCI.3615-13.2014
Tsuchiya, N., and Koch, C. (2005). Continuous flash suppression reduces negative afterimages. Nat. Neurosci. 8, 1096–1101. doi: 10.1038/nn1500
Tu, S., Liu, C., Zhu, S. S., Jou, J., Zhou, Y., and Wan, S. (2019a). The Semantic Integration Between Two Subliminally Perceived Words Simultaneously Presented at Different Locations. J. Psycholinguis. Res. 48, 1087–1110. doi: 10.1007/s10936-019-09648-9
Tu, S., Martens, U., Zhao, G., Pan, W., Wang, T., Qiu, J., et al. (2013). Subliminal faces with different valence: Unconscious mismatch detection indicates interactions between unconscious processing. World J. Neurosci. 3, 298–306. doi: 10.4236/wjns.2013.34041
Tu, S., Wan, S., Jou, J., Ma, Y., Zhao, G., and Pan, W. (2019b). Can unconscious sequential integration of semantic information occur when the prime Chinese characters are displayed from left to right? Atten. Percep. Psychophy. 82, 1221–1229. doi: 10.3758/s13414-019-01816-2
Tu, S., Zhu, S., Liang, Q., Jou, J., Wan, S., Zhao, G., et al. (2020). Unconscious integration of sequentially presented subliminal arrow pointing directions. Aus. J. Psychol. 72, 82–92. doi: 10.1111/ajpy.12252
Tzovara, A., Simonin, A., Oddo, M., Rossetti, A. O., and De Lucia, M. (2015a). Neural detection of complex sound sequences in the absence of consciousness. Brain 138, 1160–1166. doi: 10.1093/brain/awv041
Tzovara, A., Simonin, A., Oddo, M., Rossetti, A. O., and De Lucia, M. (2015b). Reply: Neural detection of complex sound sequences or of statistical regularities in the absence of consciousness? Brain 138:e396. doi: 10.1093/brain/awv186
van Gaal, S., Naccache, L., Meuwese, J. D. I., van Loon, A. M., Leighton, A. H., Cohen, L., et al. (2014). Can the meaning of multiple words be integrated unconsciously? Philosop. Transac. R Soc. B 369:20130212. doi: 10.1098/rstb.2013.0212
Vandenbroucke, A. R. E., Fahrenfort, J. J., Sligte, I. G., and Lamme, V. A. F. (2014). Seeing without knowing: Neural signatures of perceptual inference in the absence of report. J. Cogn. Neurosci. 26, 955–969. doi: 10.1162/jocn_a_00530
Wutz, A., Muschter, E., van Koningsbruggen, M. G., Weisz, N., and Melcher, D. (2016). Temporal Integration Windows in Neural Processing and Perception Aligned to Saccadic Eye Movements. Curr. Biol. 26, 1659–1668. doi: 10.1016/j.cub.2016.04.070
Yang, Y. H., Tien, Y. H., Yang, P. L., and Yeh, S. L. (2017). Role of consciousness in temporal integration of semantic information. Cogn. Affect. Behav. Neurosci. 17, 954–972. doi: 10.3758/s13415-017-0525-9
Zabelina, D. L., Guzman-Martinez, E., Ortega, L., Grabowecky, M., Suzuki, S., and Beeman, M. (2013). Suppressed semantic information accelerates analytic problem solving. Psychonom. Bull. Rev. 20, 581–585. doi: 10.3758/s13423-012-0364-1
Zhou, H.-Y., Cai, X.-L., Weigl, M., Bang, P., Cheung, E. F. C., and Chan, R. C. K. (2018). Multisensory temporal binding window in autism spectrum disorders and schizophrenia spectrum disorders: A systematic review and meta-analysis. Neurosci. Biobehav. Rev. 86, 66–76. doi: 10.1016/j.neubiorev.2017.12.013
Zhou, J., Lee, C. L., Li, K. A., Tien, Y. H., and Yeh, S. L. (2016). Does temporal integration occur for unrecognizable words in visual crowding? PLoS One 11:e0149355. doi: 10.1371/journal.pone.0149355
Keywords: consciousness, unconscious processing, integration, windows of integration, visual perception, unconscious integration
Citation: Hirschhorn R, Kahane O, Gur-Arie I, Faivre N and Mudrik L (2021) Windows of Integration Hypothesis Revisited. Front. Hum. Neurosci. 14:617187. doi: 10.3389/fnhum.2020.617187
Received: 14 October 2020; Accepted: 18 December 2020;
Published: 14 January 2021.
Edited by:
Shen Tu, Guizhou University of Finance and Economics, ChinaReviewed by:
Ting Wang, Chongqing University of Arts and Sciences, ChinaZhang Peng, Tianjin Normal University, China
Copyright © 2021 Hirschhorn, Kahane, Gur-Arie, Faivre and Mudrik. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Liad Mudrik, mudrikli@tauex.tau.ac.il