Abstract
A number of influential theories posit that visual awareness relies not only on the initial, stimulus-driven (i.e., feedforward) sweep of activation but also on recurrent feedback activity within and between brain regions. These theories of awareness draw heavily on data from masking paradigms in which visibility of one stimulus is reduced due to the presence of another stimulus. More recently transcranial magnetic stimulation (TMS) has been used to study the temporal dynamics of visual awareness. TMS over occipital cortex affects performance on visual tasks at distinct time points and in a manner that is comparable to visual masking. We draw parallels between these two methods and examine evidence for the neural mechanisms by which visual masking and TMS suppress stimulus visibility. Specifically, both methods have been proposed to affect feedforward as well as feedback signals when applied at distinct time windows relative to stimulus onset and as a result modify visual awareness. Most recent empirical evidence, moreover, suggests that while visual masking and TMS impact stimulus visibility comparably, the processes these methods affect may not be as similar as previously thought. In addition to reviewing both masking and TMS studies that examine feedforward and feedback processes in vision, we raise questions to guide future studies and further probe the necessary conditions for visual awareness.
INTRODUCTION
The exact mechanism by which visual awareness arises and the neural circuits involved in generating this experience are greatly debated (Crick and Koch, 1995; Zeki and Bartels, 1998; Lamme, 2000, 2006a; Dehaene and Naccache, 2001; Dennett, 2001; Rees et al., 2002; Cooney and Gazzaniga, 2003; Crick and Koch, 2003; Lamme, 2003; Tong, 2003; Block, 2005; Lamme, 2006a; Zeki, 2008). However, many theories assume that some version of recurrent activity or feedback is necessary for awareness. Here we review findings from visual masking and transcranial magnetic stimulation (TMS) studies of visual suppression. In both paradigms visual awareness of a stimulus is disrupted at distinct points in time from the onset of the stimulus, and thus they have been used to elucidate the relationship between feedforward and feedback processes in awareness. The overlap in the windows of visual suppression with these two methods has been proposed to reflect a similar mechanism by which stimulus visibility is impaired (Breitmeyer et al., 2004a). That is, forward visual masking and TMS applied before the onset of a stimulus have been suggested to reflect interference with the feedforward visual processes; backward visual masking and TMS applied after the onset of the stimulus have been implicated in interference with the feedback visual processes. A closer examination of more recent studies, however, suggests that TMS effects that have been previously attributed to disruption of feedback processes may also reflect interference with feedforward visual processing. Additionally, there is increasing evidence that TMS can modulate alpha frequency oscillations that in turn can impact visual awareness. Such findings complicate the interpretation of TMS effects on awareness. For example, the documented influences of pre-stimulus alpha oscillations on awareness raise the possibility that the visual masks or TMS stimulation that precede the target may impact awareness by changing the brain state prior to the onset of the target. We argue that despite the current lack of clarity regarding their neural mechanisms, both visual masking and TMS are useful methods for studying the neural conditions necessary for visual awareness.
THE VISUAL SYSTEM AND THE FEEDFORWARD-FEEDBACK FRAMEWORK
The visual system has abundant anatomical feedforward and feedback connections that are organized in a hierarchical manner (DeYoe and Van Essen, 1988; Felleman and Van Essen, 1991; Van Essen et al., 1992; Merigan and Maunsell, 1993; Felleman et al., 1997; Lamme and Roelfsema, 2000; Bullier, 2001). Initially, information enters the cortex in a feedforward manner. Electrophysiological studies in humans indicate that the visual signal from the retina reaches the primary visual cortex, V1, in 55–70 ms after stimulus onset (Wilson et al., 1983; Baseler and Sutter, 1997; Luck et al., 1997; Vanni et al., 2001; Foxe and Simpson, 2002; Di Russo et al., 2003; Boehler et al., 2008). However, it is worthy to note that the magnocellular and parvocellular pathways have different response latencies (Maunsell and Gibson, 1992; Schmolesky et al., 1998), with the magnocellular pathway responding earlier and maintaining approximately 10–15 ms advantage over the parvocellular pathway across areas in the early visual cortex (Schmolesky et al., 1998). From V1 information travels to temporal, parietal, and frontal cortices via feedforward connections in the ventral and dorsal streams (Ungerleider, 1985). Importantly, information not only propagates forward, but laterally and backwards; that is, hierarchically higher areas send signals to lower areas via feedback connections (DeYoe and Van Essen, 1988; Felleman and Van Essen, 1991; Van Essen et al., 1992; Merigan and Maunsell, 1993; Lamme and Roelfsema, 2000; Bullier, 2001) and information within an area is transformed via lateral neural connections (Felleman and Van Essen, 1991).
The role of feedback processes in vision as well as when and how they are initiated is still debated. Feedback amplifies and focuses activity of neurons in lower visual areas (Hupé et al., 1998, 2001). However, the function of such modulation is contested. Some argue that feedback is involved primarily in attentional modulation of the feedforward sweep (Macknik and Martinez-Conde, 2007), while others postulate that feedback modulates activity in early sensory areas based on expectations or to minimize prediction error (Rao and Ballard, 1999; Panichello et al., 2012). Several other models fall within a general “frame-and-fill” approach where feedback serves to fill in details of an initially established scene (Bullier, 2001; Hochstein and Ahissar, 2002; Bar, 2003; Ahissar and Hochstein, 2004; Bar et al., 2006; Chen et al., 2007; Kveraga et al., 2007; Ahissar et al., 2009; Peyrin et al., 2010). Regardless of its specific function, it is argued that this feedback activity is an essential component of an emergent visual awareness (Di Lollo et al., 2000; Enns and Di Lollo, 2000; Lamme, 2000, 2006a; Lamme and Roelfsema, 2000; Lamme et al., 2002; Tong, 2003; Breitmeyer, 2007; Fahrenfort et al., 2007, 2008). While these theories concur that feedback is necessary for awareness, we note that they should not be construed as arguing that feedback is sufficient for awareness. For example, feature integration can be modulated over hundreds of milliseconds even though the actual stimuli fail to reach awareness (Otto et al., 2006; Plomp et al., 2009; Scharnowski et al., 2009; Rüter et al., 2010), suggesting that while information is maintained in the visual system (presumably due to recurrent processing) additional factors determine whether it eventually becomes a conscious percept (e.g., see Herzog et al., 2007). In the context of visual awareness we explicitly define recurrent feedback as activity that encompasses recurrent processing within and among adjacent areas as well as reentrant activity from hierarchically higher to lower brain areas, the latter of which reside in the early visual cortex. Importantly, recurrent feedback occurs after and as a result of the initial feedforward signal. We will use “recurrent” and “feedback” as synonyms throughout.
It has been a challenge to establish the exact timing of these neural events because they are dependent on stimulus properties, species-specific neural architecture, and experimental procedures. For example, because magno and parvo cells exhibit distinct spatial frequency and contrast sensitivities (Kaplan and Shapley, 1986; DeYoe and Van Essen, 1988; Livingstone and Hubel, 1988; Van Essen et al., 1992; Schyns and Oliva, 1994; Sincich and Horton, 2005), the physical properties of the stimulus modulate signal arrival time in V1 and higher visual areas (Baseler and Sutter, 1997; Schmolesky et al., 1998; Alexander et al., 2005; Foxe et al., 2008). Nonetheless, some have estimated that activity occurring prior to 100 ms post-stimulus onset in the human brain corresponds to a feedforward signal, whereas feedback impacts activity in a later time period, 100 ms or more after stimulus onset (e.g., Fahrenfort et al., 2007; Boehler et al., 2008). However, if the definition of feedback encompasses any recurrent activity, as ours does, then such activity could also occur before 100 ms (e.g., Nowak et al., 1995; Foxe and Simpson, 2002). As will become clear in subsequent sections, it is difficult to pinpoint specifically when feedback might be playing a role in awareness, but by considering both visual masking and TMS studies together, we argue that the presence of both feedforward and feedback processes can be inferred.
It has been argued that some natural stimuli, such as real-world objects, animals, or scenes, can be perceived on the feedforward sweep; that is, observers can successfully identify such stimuli with presentation times that are too short to allow for feedback (Thorpe et al., 1996; VanRullen and Thorpe, 2001; Rousselet et al., 2002; VanRullen and Koch, 2003; VanRullen, 2007; Schmidt and Schmidt, 2009; Koivisto et al., 2014a). In these studies feedback is typically conceived although not explicitly defined as activity from higher to lower neural areas and, in particular, activity from frontal regions involved in decision making projecting to occipitotemporal areas. Others have argued that identification of such natural stimuli may rely on very fast feedback processes (Bar, 2003; Bar et al., 2006; Kveraga et al., 2007). However, we note that the concept of feedback processes as well as masking methods used in these ultra-rapid presentation paradigms do not strictly preclude recurrent processing and thus they cannot be taken as strong evidence against the idea that awareness requires feedback activity. We return to this issue in the next section.
Numerous theories and methods of visual masking exist, and the nuances of these models are beyond the scope of this review. Most models fit within the general framework of feedforward and feedback processing that we discuss in this paper. However, for completeness sake, we direct an interested reader to several excellent reviews that discuss alternative methods and theories of visual masking (Breitmeyer and Ganz, 1976; Breitmeyer, 1984; Bachmann, 1994; Francis, 1997, 2000; Di Lollo et al., 2000; Enns and Di Lollo, 2000; Breitmeyer and Öǧmen, 2000, 2006; Francis and Herzog, 2004; Macknik, 2006; Ansorge et al., 2007; Kouider and Dehaene, 2007; Hermens et al., 2008; Ghose et al., 2012; Goodhew et al., 2013; Bachmann and Francis, 2014).
SUPPRESSING STIMULI FROM AWARENESS: BACKWARD MASKING
VISUAL MASKING
Visual masking occurs when perception of one stimulus, a target, is reduced by the presence of a second stimulus, a mask. The strength of masking is quantified as the reduction in the visibility of some aspect of the target (e.g., its shape). In forward masking the mask stimulus precedes the to-be-discriminated target; in backward masking the mask follows the to-be-discriminated target. Metacontrast is a specific case of backward masking in which spatially contiguous but non-overlapping stimuli are used. Because the target and mask do not overlap spatially, and thus do not stimulate the same retinal cells, any interaction between the target, and the mask must occur primarily at the cortical level. In line with this idea, target visibility is strongly impaired under dichoptic presentation conditions in which target and mask stimuli are presented separately to each eye (Kolers and Rosner, 1960; Schiller and Smith, 1968; Weisstein, 1971; Breitmeyer and Kersey, 1981). Here, the visual signals from each stimulus can only interact at post-retinal levels.
By varying the stimulus onset asynchrony (SOA) between the target and the mask one can track the change in the visibility of the target with respect to the onset of the mask. Metacontrast typically yields U-shaped target visibility functions (see Figure 1). The exact SOAs of optimal masking vary from study to study due to differences in experimental parameters and criterion the subject is asked to adapt (Kahneman, 1968; Breitmeyer and Öǧmen, 2006). In general, however, metacontrast masking produces the strongest suppression of target visibility at approximately a 50 ms SOA while preserving stimulus visibility at the earlier SOAs (e.g., Breitmeyer, 1978; Enns and Di Lollo, 1997; Breitmeyer et al., 2008; for reviews see Breitmeyer and Öǧmen, 2000, 2006; Figure 1). This pattern of results indicates that the strongest interaction between target and mask neural events occurs when they are separated by several tens of milliseconds rather than immediately.
FIGURE 1
The non-monotonic, U-shaped visibility of target function differs markedly from integration masking in which masking is most effective at an SOA of 0 ms and decreases in effectiveness monotonically with increasing SOAs (e.g., Hellige et al., 1977). This pattern of results suggests (nearly) immediate interactions between neural target and mask signals rather than after some delay. In other words, the very same SOAs that produce maximal integration masking (typically obtained when the target and mask spatially overlap) produce little or no masking during metacontrast (when target and mask do not spatially overlap). Whereas integration masking is largest when the mask is near in time to the feedforward signal of the target, metacontrast masking specifically circumvents that form of masking and instead affects some later processes beyond the initial feedforward signal.
Metacontrast and integration masking are also thought to differ in terms of where in the visual processing stream they occur. Integration masking is thought to occur when the target and mask stimulate common retinal and early cortical cells, resulting in an integration of target and mask signals starting at the earliest stages of processing (Weisstein, 1972; Breitmeyer, 1978; Hellige et al., 1979; Michaels and Turvey, 1979; Breitmeyer and Öǧmen, 2006). Metacontrast masking, on the other hand, is designed to minimize retinal integration and is thought to primarily reflect cortical interactions. It has been argued, however, that even these non-spatially overlapping stimuli may in fact be integrated (as opposed to interrupted, as it is sometimes described), although presumably at later levels of the visual system than the classic “integration masking” effects (Herzog and Koch, 2001; Otto et al., 2006; Plomp et al., 2009; Scharnowski et al., 2009; Rüter et al., 2010). In general, when masking methods are used to investigate awareness, care should be taken regarding the assumptions about the mechanism by which stimuli were suppressed from awareness. With this in mind, whenever relevant to our discussion we will only draw on evidence from masking studies with overlapping stimuli if cortical interactions between target and mask stimuli can be inferred (also see Breitmeyer and Öǧmen, 2006, for a further discussion on this point). Also, note that the latency differences between magnocellular and parvocellular channels are accommodated within the range of retinocortical transmission times discussed below, and thus we do not separate out the contributions of these pathways to visual masking effects and awareness.
TRANSCRANIAL MAGNETIC STIMULATION
Another way in which to bypass sensory signal interactions in areas before V1 is to directly stimulate visual cortex with TMS. The rapid changes in the magnetic field generated by a TMS coil can induce electrical activity in the brain through the scalp and skull, thus non-invasively stimulating the brain area under the coil. In their seminal paper, Amassian et al. (1989) applied TMS to the occipital pole at varying SOAs relative to the stimulus onset. Reminiscent of metacontrast masking results, they found that occipital TMS reduced stimulus visibility when applied 80–100 ms after stimulus onset. Since then further research has confirmed that single-pulse TMS reduces target visibility in distinct temporal epochs when applied to the occipital pole, stimulation of which has since been shown to include V1, V2, and even V3 (Kammer et al., 2005b; McKeefry et al., 2009; Thielscher et al., 2010; Salminen-Vaparanta et al., 2012). This suppression of visibility effect has been more consistently reported as a window centered at a post-stimulus SOA of 100 ms (Amassian et al., 1989; Paulus et al., 1999; Corthout et al., 1999a,b, 2002; Heinen et al., 2005; Kammer et al., 2005b; Kammer, 2007a; Sack et al., 2009; Camprodon et al., 2010; de Graaf et al., 2011a, 2012a; Koivisto et al., 2011b; Railo and Koivisto, 2012; Emmanouil et al., 2013; Allen et al., 2014; Tapia et al., 2014; Figure 1). Several studies have also reported an additional and very late post-stimulus TMS effect at 200 to 280 ms after the onset of the stimulus (Allen et al., 2014), some in tasks that required animal categorization and relied on figure-ground segmentation processes (Heinen et al., 2005; Camprodon et al., 2010; Koivisto et al., 2011a).
Unlike in visual masking, where both target and mask enter the visual system via the retina, in TMS masking studies an externally induced TMS event applied directly over EVC affects an internal event in EVC that was initiated at the retina. Given that the retinocortical transmission time varies from 55 to 70 ms and averages around 60 ms (Wilson et al., 1983; Baseler and Sutter, 1997; Vanni et al., 2001; Foxe and Simpson, 2002; Boehler et al., 2008), any effect of TMS must first account for this retinocortical transmission time. For example, if we assume that it takes approximately 60 ms after the stimulus onset before TMS can directly interact with the incoming visual signal, then an effect of TMS on visibility at the 100 ms SOA would mean that TMS had its effect on the visual information approximately 40 ms after the sensory signal reached EVC.
After a retinocortical transmission adjustment is made, we can begin to compare SOAs in visual and TMS masking studies (see also Railo and Koivisto, 2012). Figure 1 shows target visibility functions in metacontrast and post-stimulus TMS studies with the 60 ms adjustment. The 50 ms backward masking effect dovetails with post-stimulus TMS effects at an EVC-adjusted SOA of 40 ms (i.e., 100 ms post-stimulus onset). In other words, visual and TMS masking paradigms impair stimulus visibility at comparable time windows, suggesting that they affect the same visual process(es) that are critical for visual awareness (Breitmeyer et al., 2004a; Lamme, 2006b; Breitmeyer, 2007).
NEURAL MECHANISMS
Data regarding the neural effects of backward masking is consistent with the idea that the mask interferes with feedback rather than an initial feedforward signal of the target. Single cell responses during backward masking have been recorded from a number of different primate brain areas involved in visual processing. In area V1 metacontrast masks suppress spike activity in a later time window (post-100 ms) while the early neural response is generally unaffected (Bridgeman, 1980; Macknik and Livingstone, 1998). Similarly, masking specifically disrupts signals responsible for differentiating figure from ground which occur in a later time window (post-100 ms), whereas it has no effect on the early signals (pre-100 ms) which reflect orientation differences of the elements comprising the figure-ground stimuli (Lamme et al., 2002). Because figure-ground segmentation depends on feedback from extrastriate areas to V1 (Lamme et al., 1998), these results suggest that the mask interferes with the feedback processing of the target. Furthermore, only the late, but not the early component of V1 responses correlates with behavioral reports of stimulus visibility, with higher neural activation observed for seen stimuli (Bridgeman, 1980; Lamme et al., 2000; Supèr et al., 2001).
Electroencephalography recordings with humans reveal similar findings to those of single-cell recording studies. Fahrenfort et al. (2007) presented texture-defined target stimuli and partially overlapping backward masks to human observers during a target detection task. In trials where the target was seen (i.e., not masked), three stages of visual processing indicated the presence of a figure (target) against a background. The first stage, which occurred during the first 110 ms after stimulus onset and was apparent in occipito-temporal electrode activity, was interpreted to reflect an initial feedforward activation of the visual system extending into the ventral stream. A second stage, which started at 110 ms after stimulus onset and was apparent in occipital electrodes, was interpreted as reflecting a reactivation of occipital regions due to recurrent feedback. A distinct third stage, which occurred around 200 to 300 ms and was apparent in occipito-temporal electrodes activity, was interpreted as reflecting an additional wave of recurrent activity. Importantly, the authors found that in trials where target was masked (i.e., not seen), both the second and third stages were no longer apparent; only the first stage of processing was unaffected by masking. In other words, the stages indicative of recurrent feedback were affected most, supporting the position that backward masks interrupt feedback processing of the target stimuli in the visual cortex. Together, single cell recording and human neuroimaging studies suggest that backward masking interrupts the later but not the initial neural response; these two stages of processing have been attributed to feedback and feedforward processing, respectively, (Fahrenfort et al., 2007, 2008; Boehler et al., 2008).
With this mechanism of masking in mind let us return briefly to studies that employ overlapping target and mask stimuli to make inferences about feedforward and feedback processes and their contribution to visual awareness. As discussed earlier, stimuli that overlap in space activate identical cells along the visual processing pathway allowing masking to occur due to sensory signal integration at pre-cortical levels. Because these studies typically employ pattern masks, successful discrimination of natural stimuli under ultra-rapid presentation conditions (i.e., target-to-mask SOAs of less than 100 ms) likely indicate poor integration masking rather than scene processing that does not require feedback; that is, fairly high target accuracy even at the shortest SOAs (Bacon-Macé et al., 2005; Walther et al., 2009; Loschky et al., 2010) may indicate that the masks used to interfere with natural scenes are simply in effectively integrated with the feedforward signal of the target. Indeed, both faces and scenes are most effectively masked by face and scene stimuli, respectively, (Loffler et al., 2005; Loschky et al., 2010), suggesting that other masks (e.g., noise) may be too simple or may not be effectively integrated with the rich feedforward signal from natural images. With these methodological considerations in mind we argue that data obtained using ultra-rapid presentation paradigms do not strictly preclude recurrent processing and thus they cannot be taken as strong evidence against the idea that awareness depends on feedback processes (see also Koivisto et al., 2014a). In fact, as mentioned earlier, some evidence exists to suggest that TMS over the occipital pole might interfere with feedback signals from scene stimuli in a 100 ms and later time window (Camprodon et al., 2010; Koivisto et al., 2011a).
The neural mechanisms behind TMS-induced reduction of stimulus visibility are less clear, due primarily to unknown variation in retinocortical transmission time. If we accept a retinocortical transmission time of 60 ms (Railo and Koivisto, 2012), then the timing of TMS-induced masking is comparable to that of backward visual masking. Thus, the classic post-stimulus TMS effect at 100 ms, like visual masking, could be attributed to interference with feedback processing in the EVC (Corthout et al., 1999a,b; Breitmeyer et al., 2004a; Lamme, 2006b; Breitmeyer, 2007; Allen et al., 2014). Even given some variability in retinocortical transmission time, it has been argued that such a late effect is unlikely to be due to TMS interference with the initial feedforward sweep (Celebrini et al., 1993; Merigan and Maunsell, 1993; Nowak et al., 1995; Schmolesky et al., 1998; Lamme and Roelfsema, 2000) and instead is likely due to interference with feedback processes (Breitmeyer et al., 2004a; Lamme, 2006b; Breitmeyer, 2007). The idea that feedback to EVC is required for visual awareness is supported by joint backward masking and TMS studies. Here in trials where target’s visibility is suppressed by a visual mask, if TMS is applied at around 100 ms after the onset of the mask, target stimulus visibility greatly increases while that of the mask is suppressed by TMS. Such unmasking of the target and masking of the mask by TMS has been taken as evidence of recurrent feedback processing in EVC (Amassian et al., 1993; Ro et al., 2003).
To directly test similarities and differences between metacontrast and TMS, Railo and Koivisto (2012) compared masking effects using identical target stimuli with the same group of participants. Both methods impaired subjective target visibility ratings in comparable time windows; the optimal masking SOA was 33 ms in metacontrast and 75 ms in TMS trials. Assuming a retinocortical transmission time of 60 ms, Railo and Koivisto (2012) suggest that TMS interference with visual processing occurs slightly earlier than with metacontrast masks. Interestingly, neither TMS nor metacontrast impaired subjects’ ability to simply detect the target in a 2-alternative forced choice location task. These data suggest that while feedback may be necessary for subjective reports of awareness, the intact feedforward signal may be sufficient to enable above chance detection in a forced-choice location task (VanRullen and Koch, 2003; VanRullen, 2007).
Although the timing of the TMS and visual masking effects obtained by Railo and Koivisto (2012) can be accommodated in the common framework of interference with feedback processes in EVC, the fact that the TMS effect occurs slightly earlier (depending on actual retinocortical transmission time) than visual masking raises an alternative view. It has been suggested that TMS in this time window may interrupt (some of the) feedforward in addition to feedback activity (Sack et al., 2009; Koivisto et al., 2011b; de Graaf et al., 2012a, 2014; Miyawaki et al., 2012; Railo and Koivisto, 2012). There are several reasons to consider this hypothesis. The range of SOAs that are lumped into the classical TMS suppression window not only vary from 60 to 140 ms but can extend over tens of milliseconds (Amassian et al., 1989; Corthout et al., 1999a,b, 2002; Kammer et al., 2005b; Sack et al., 2009; Camprodon et al., 2010; de Graaf et al., 2011b, 2012a; Koivisto et al., 2011a,b; Jacobs et al., 2012b; Railo and Koivisto, 2012; Allen et al., 2014; Tapia et al., 2014). This suggests that the earliest effects might be occurring as sensory information is just arriving in EVC and raises a possibility that TMS interferes with multiple visual processes in a wide window (Koivisto et al., 2011b; de Graaf et al., 2014).
The hypothesis that the 100 ms TMS suppression window may reflect interference with (some of the) feedforward in addition to (multiple recurrent) feedback processes (Camprodon et al., 2010; Koivisto et al., 2011b; de Graaf et al., 2012a, 2014; Miyawaki et al., 2012; Railo and Koivisto, 2012) is only now being considered in empirical investigations. Here, paradigms that allow differentiating between feedforward and feedback processes are especially useful. The framework of visual awareness we have adapted for this review specifically states that feedback is required for awareness, while feedforward processes are sufficient to “prime” selective motor responses (Lamme and Roelfsema, 2000; Breitmeyer, 2007). This view is supported by masked priming studies (Klotz and Wolff, 1995; Klotz and Neumann, 1999; Vorberg et al., 2003). Here, a visual masking paradigm is adapted to measure priming by varying the similarity between the target-prime and mask-probe. Responses to the mask-probe are faster when the two stimuli match on a to-be-discriminated feature (e.g., color) as compared to when they do not. Interestingly, the target-prime affects responses to the mask-probe both in trials when the target-prime is seen and when its visibility is suppressed by the subsequent mask-probe. We and others (e.g., Lamme and Roelfsema, 2000; Chen and Treisman, 2009; Tapia and Breitmeyer, 2011) have interpreted this pattern of results as indicating that the feedforward sweep of activity elicited by the target-prime is sufficient to produce priming even though the target-prime fails to reach awareness due to the interruption of its feedback processes by the mask-probe. Masked priming effects have been consistently reported for various stimuli in a metacontrast paradigm (e.g., Klotz and Neumann, 1999; Schmidt, 2002; Vorberg et al., 2003; Breitmeyer et al., 2004b, 2005, 2007; Enns and Oriet, 2007; Breitmeyer and Hanif, 2008; Kentridge et al., 2008; Ro et al., 2009; Schmidt and Schmidt, 2010; Tapia et al., 2010, 2011, 2013; Tapia and Breitmeyer, 2011).
If post-stimulus TMS over EVC at around 100 ms interrupts solely feedback processes, we would also expect similar (i.e., feedforward-supported) effects in TMS paradigms; that is, we would expect to obtain priming from a TMS-masked target. Alternatively, if post-stimulus TMS also interferes with (some of the) feedforward processes during this time window, performance on tasks that rely on feedforward activity should be impaired; that is, we would expect priming to be diminished when the target is suppressed by TMS. Only a handful of studies have investigated this hypothesis to date, but they all show that priming is either reduced (Sack et al., 2009; Railo et al., 2012) or entirely absent (Jacobs et al., 2012a; Persuh and Ro, 2013) at TMS SOAs ranging from 60 to 100 ms post-stimulus, suggesting that TMS in this range might be interfering with feedforward processes.
It is difficult to draw clear conclusions about feedforward and feedback processes from these studies not only because there are only a few of them, but also because the experimental procedures used differ among the studies. TMS stimulation parameters (e.g., intensity, shape of coil) should be systematically explored in the priming task as they have been shown to differentially affect performance in other paradigms (Beckers and Hömberg, 1991; Kammer et al., 2005a; Hallett, 2007; de Graaf et al., 2011a; Reichenbach et al., 2011). Additionally, differences between behavioral tasks should also be examined. For example, it is not known whether priming effects differ between paradigms in which TMS is applied either between presentation of target-prime and mask-probe (Persuh and Ro, 2013), during (Railo et al., 2012) or at the end of this stimulus sequence (Sack et al., 2009; Jacobs et al., 2012a; Railo et al., 2012). Moreover, assessing target-prime visibility during the same (e.g., Persuh and Ro, 2013) or separate sets of trials (e.g., Jacobs et al., 2012a) might also lead to different results (Lin and Murray, 2014). A combination of any of these factors might influence when and if priming with TMS is observed. Nonetheless, we believe that this line of inquiry will yield significant insights into feedforward and feedback contributions to visual awareness once these experimental procedures are fine-tuned.
In summary, although it has been previously argued that the 100 ms post-stimulus window reflects TMS interference with feedback processing in EVC, data from the newest studies suggest that the classical TMS window of suppression might in fact encompass both the feedforward and feedback processes, with lower SOAs tapping into the feedforward and later SOAs tapping into the feedback activity (Koivisto et al., 2011b; de Graaf et al., 2012a, 2014; Miyawaki et al., 2012). Hence, while there is ample evidence to suggest that metacontrast and TMS interfere with feedback processes, future research should inform the effects of TMS on feedforward activity as well as how and why this method of masking differs from that of metacontrast.
SUPPRESSING STIMULI FROM AWARENESS: FORWARD MASKING
VISUAL MASKING
Given that feedforward processes precede and initiate feedback processes, it should also be possible to interfere with the initial feedforward sweep of activity and reduce stimulus visibility. Paracontrast is thought to be one such example. It is a specific case of forward masking that, like metacontrast masking, involves spatially non-overlapping target and mask stimuli. Unlike in metacontrast masking, here the mask stimulus precedes the target, and is thus thought to interfere with feedforward processing of the target. As in backward masking, varying the SOA between the target and the mask reveals distinct windows of visual suppression (Figure 2). In paracontrast strongest suppression of target visibility is obtained at SOAs around -170 to -100 ms and -10 ms (Cavonius and Reeves, 1983; Kaitz et al., 1985; Öǧmen et al., 2003; Breitmeyer et al., 2006).
FIGURE 2
TRANSCRANIAL MAGNETIC STIMULATION
As in forward visual masking paradigms, TMS can also be applied before the onset of a visual stimulus. Pre-stimulus TMS impairs target visibility at a range of SOAs spanning from -80 to -10 ms (Corthout et al., 1999b, 2002, 2003; Laycock et al., 2007; de Graaf et al., 2011a; Jacobs et al., 2012b, 2014). Interestingly, pre-stimulus TMS at -20 ms shows retinotopically specific effects, that is reducing stimulus visibility only in specific locations, while TMS at -50 ms exhibits a global reduction of stimulus visibility regardless of where the stimulus was presented (Jacobs et al., 2014). Post-stimulus TMS effects shortly after the onset of the target (SOA effects at 0, 10, 20–60 ms; Beckers and Hömberg, 1991; Paulus et al., 1999; Corthout et al., 1999a,b, 2002, 2003) have also been reported (Figure 2).
NEURAL MECHANISMS
Behavioral and especially neural effects of paracontrast are much less studied than those of metacontrast. This is likely due in part to the fact that paracontrast produces much weaker suppression than metacontrast (Alpern, 1953; Weisstein, 1972). Single-cell recordings in primate V1 reveal that paracontrast reduces the initial neural activity associated with the onset response of the target and slightly reduces subsequent excitatory after-discharge due to target offset (Macknik and Livingstone, 1998). Thus, it has been proposed that paracontrast masks interfere primarily with the incoming feedforward activity of the target (Breitmeyer and Öǧmen, 2006; Breitmeyer, 2007).
The neural consequence of the pre- and early post-stimulus TMS reduction of visibility is under question. Post-stimulus effects of SOAs up to 60 ms have been difficult to replicate consistently (Kammer, 2007a,b). Moreover, the SOAs of optimal suppression in pre-stimulus TMS studies, like in paracontrast, are quite varied (Beckers and Hömberg, 1991; Paulus et al., 1999; Corthout et al., 1999a,b, 2002, 2003; Laycock et al., 2007; de Graaf et al., 2011a; Jacobs et al., 2012b, 2014). In fact, some pre-stimulus TMS effects have been attributed primarily to eye-blink artifacts (Corthout et al., 1999b, 2011) raising questions as to whether it is a neural effect at all. More recent work, however, has shown that in trials where no eye-blinks occurred stimulus visibility was still significantly impaired with pre-stimulus TMS at -80 and -60 ms SOAs (Jacobs et al., 2012b, 2014).
Even with the masking effect localized to the cortex, the relationship between the pre-stimulus TMS effects and para- and metacontrast masking is still under debate. The early post-stimulus TMS effects at SOAs up to 60 ms have been explicitly attributed to TMS interruption of the feedforward sweep (Corthout et al., 1999a). However, given retinocortical transmission time, TMS applied earlier than that would presumably affect the visual cortex before the visual signal arrives there. Hence, it has been suggested that the pre-stimulus and early post stimulus TMS effects reflect changes in pre-stimulus brain activity, such as changes in alpha power or phase, rather than a direct effect on the evoked activity of the target (de Graaf et al., 2011a; Jacobs et al., 2012b, 2014). Such suggestions also raise the possibility that paracontrast masks also change brain states, such as those related to alpha power and phase. Moreover, although paracontrast and pre-stimulus and early post stimulus effects on stimulus visibility (when TMS SOAs have been adjusted for retinocortical delay) overlap in time, they do not align as nicely as with backward visual and TMS masks (see Figure 2). Of course, these conclusions critically depend on actual retinocortical transmission time. If one accepts that the backward masking effects of TMS and visual masks are comparable, then it is tempting to conclude that paracontrast and forward masking effects with TMS tap into the same visual mechanism of processing, this time interference with the feedforward signal (Corthout et al., 1999a,b; Breitmeyer et al., 2004a; Breitmeyer, 2007). As we have argued above, the post-stimulus TMS window likely reflects TMS interference with the incoming feedforward signal. If pre-stimulus TMS also affects the feedforward sweep, it may do this indirectly, by altering the brain state. Clearly, more research is needed on this issue.
WHERE IS FEEDBACK COMING FROM?
Transcranial magnetic stimulation lends itself nicely to investigating temporal dynamics of visual processing because, unlike visual masks, it can be used to selectively interrupt activity in distinct visual areas (e.g., Pitcher et al., 2009). The timing of visual suppression effects when different regions are stimulated can inform us about the timing of feedforward and feedback processes between the stimulated areas. In a seminal study Pascual-Leone and Walsh (2001) provided evidence that feedback to V1 from V5/MT+ was necessary for the perception of motion. TMS over V5/MT+ produces the perception of moving spots of light (i.e., moving phosphenes). However, when TMS was applied to EVC between 5 and 45 ms after it was applied to V5/MT+, the perception of motion significantly decreased. Because TMS over EVC only interfered with motion perception subsequent to the V5/MT+ stimulation (motion suppression peaked at 25 ms post- V5/MT+ TMS), the result has been interpreted as TMS interference with feedback coming from V5/MT+ to EVC. Similar conclusions have been reached by others; that is, the perception of motion requires a feedforward and feedback exchange of activity between EVC and V5/MT+ (e.g., Silvanto et al., 2005a,b; Laycock et al., 2007; Koivisto et al., 2010).
This exchange of activity between EVC and extrastriate cortex is not limited to V5/MT+. Koivisto et al. (2011a) applied TMS to EVC and lateral occipital cortex (LOC) while participants categorized whether a briefly flashed image contained an animal or not, and rated their subjective visibility. TMS over EVC impaired categorization speed and subjective stimulus visibility ratings at SOAs from 90 to 210 ms after stimulus onset, whereas TMS over LOC affected categorization speed and subjective ratings only at the post-stimulus SOA of 150 ms. Such a pattern of data is consistent with the hypothesis that recurrent interactions between EVC and later regions, in this case LOC, are necessary for visual awareness, with the first suppression intervals produced by EVC and LOC stimulation corresponding to interference with feedforward signals and the later suppression window (at 210 ms) corresponding to interference with feedback from LOC into EVC.
TMS studies discussed thus far suggest that at least one source of feedback to EVC, which is needed for awareness, comes from extrastriate regions. However, a number of other brain areas have been implicated in awareness that might also act as a source of feedback to EVC. It is commonly argued that awareness arises due to interactions between fronto-parietal and occipito-temporal areas (e.g., for a review see Beck et al., 2001; Driver and Vuilleumier, 2001; Rees, 2001; Crick and Koch, 2003; Baars, 2005; Dehaene et al., 2006; Tononi and Koch, 2008). Studies with patients (e.g., unilateral neglect) and with TMS suggest that fronto-parietal regions are not incidental to awareness but critical to it (Driver and Vuilleumier, 2001; Turatto et al., 2004; Beck et al., 2006). Nonetheless, the exact dynamics of interactions between fronto-parietal and occipito-temporal regions are still under investigation.
One candidate for the source of feedback to EVC is the parietal lobe because of its abundant feedforward and feedback connections with occipito-temporal cortex (Felleman and Van Essen, 1991; Webster et al., 1994; Lewis and Van Essen, 2000). To test this possibility, Koivisto et al. (2014b) applied TMS to the EVC and the intraparietal sulcus (IPS). They found that shape visibility was impaired by EVC TMS at post-stimulus SOAs of 60, 90, and 120 ms, while TMS over IPS disrupted performance in the same task only at an SOA of 90 ms (Koivisto et al., 2014b). These results complement those from the authors’ earlier study where TMS over LOC impaired visibility in a relatively late time window (150 ms; Koivisto et al., 2011a), except that the IPS effect occurred earlier. In other words, both studies implicate recurrent interactions between EVC and higher-level areas, point to the importance of both the feedforward and feedback signals to awareness, and begin to address when and where that feedback is coming from.
Recently it was shown that phosphene sensations can be elicited with TMS applied over the parietal cortex, i.e., regions corresponding to the P3/P4 electrode sites (Marzi et al., 2009), and that these percepts are similar albeit less vivid than occipitally induced phosphenes (Fried et al., 2011; Mazzi et al., in press). Additionally, when TMS is applied to parietal areas that elicit phosphenes, occipital cortex exhibits activity 20 to 40 ms after parietal stimulation (Parks et al., 2013 and in preparation). The occipital activity is in line with the existence of feedback connections between parietal and occipito-temporal regions (Felleman and Van Essen, 1991; Webster et al., 1994; Lewis and Van Essen, 2000) as well as other data showing that TMS to parietal cortex can modulate activity in EVC (Ruff et al., 2008; Silvanto et al., 2009). What is not yet clear is whether the experience of parietal phosphenes (i.e., phenomenal awareness) requires the interplay of activity between parietal and EVC. Indeed, it is currently unknown whether occipital and parietal phosphenes arise from the same (Fried et al., 2011) or different neural mechanism given that parietally induced phosphenes have been reported in the blind visual field of two hemianopic patients (Mazzi et al., in press; see also Tapia et al., 2014).
The frontal lobes have also been implicated in visual awareness. The general “frame-and-fill” approach (Bullier, 2001; Chen et al., 2007) to visual processing posits that magnocellular channels project a rapid but coarse feedforward representation of the stimulus to higher cortical areas in the dorsal pathway and to the prefrontal cortex (Bullier, 2001; Peyrin et al., 2010; Tapia and Breitmeyer, 2011). Then, projections from these areas, activated by the initial magnocellular signals, potentiate or “frame” the processing along the slower ventral parvocellular pathway that carries the “fill” information, e.g., detailed form and color that are necessary for constructing a high-resolution representation of a visual object (Chen et al., 2007; Tapia and Breitmeyer, 2011; Breitmeyer, 2014). A specific version (Bar, 2003; Bar et al., 2006; Kveraga et al., 2007) of this “frame-and-fill” approach additionally posits that the prefrontal cortex projects directly to and modulates processing in the inferotemporal cortex (IT).
Finally, microstimulation of or TMS to frontal eye fields (FEF) have been shown to modulate neural responses in striate and extrastriate visual areas (Moore and Armstrong, 2003; Ruff et al., 2006, 2008; Silvanto et al., 2006; Taylor et al., 2007). The FEFs are considered a part of the dorsal attention network (Corbetta and Shulman, 2002). Given the link between attention and awareness and the connectivity of the FEF, these regions seem a reasonable candidate for awareness-related feedback to EVC. However, this feedback is yet to be shown to be critical to awareness. Given this complex neural network, the exact mechanism by which fronto-parietal regions generate feedback to EVC and contribute to visual awareness is yet to be determined and all of these candidates need to be probed further.
THE NCCs OF VISUAL AWARENESS
Awareness is an emergent property of the brain and arises amidst other equally complex processes. Therefore, trying to pinpoint the neural correlate of consciousness (NCC) or more specifically of visual awareness may be misleading. For instance, there may be prerequisite conditions for the “true” NCC (or NCC-proper) to emerge as well as events that consistently arise as a result of awareness. The distinctions among these three NCCs have been discussed eloquently and in detail elsewhere (e.g., Aru et al., 2012; de Graaf et al., 2012b) and are inherently difficult to tease apart. Here we concentrate on the prerequisites of consciousness, or NCC-prerequisites, as some of the reported TMS effects are likely to fall into this category. Prerequisites include conditions set prior to the onset of a stimulus that by themselves cannot elicit a percept of that stimulus. Thus, as argued above, the pre-stimulus TMS effects (and possibly some of the early post stimulus effects) very likely achieve their effects by modulating brain states that influence how subsequent sensory information will be processed (Thut et al., 2006; Gilbert and Sigman, 2007; Mathewson et al., 2009; Summerfield and Egner, 2009).
Ongoing alpha oscillations (8-12 Hz) not only reflect a brain state that has been implicated in visual awareness, but they are also modulated by TMS. Visibility of a masked target in metacontrast fluctuates as a function of power and phase of occipito-temporal EEG alpha (Mathewson et al., 2009, 2010, 2012). Increased pre-stimulus alpha power has been associated with lower detection rates using a wide range of stimuli (e.g., Ergenoglu et al., 2004; Palva et al., 2005; Romei et al., 2008; van Dijk et al., 2008; Wyart and Tallon-Baudry, 2008; Busch et al., 2009; Mathewson et al., 2009). These changes in power have been linked to changes in attentional state (Worden et al., 2000; Thut et al., 2006; Mathewson et al., 2014). Others have argued that alpha power is an indication of the general level of excitability of the visual cortex, with high alpha power representing a general inhibition of ongoing processing (Klimesch et al., 2007; Mathewson et al., 2011). Consistent with this idea, Romei et al. (2008) have shown that identical TMS pulses over visual cortex are less likely to elicit visual phosphenes when alpha power over posterior cortical areas is high. Together these results suggest that the power and phase of alpha oscillations are indicative of a brain state that influences whether a subsequent stimulus will reach awareness.
Interestingly, even when alpha power is high there appear to be mechanisms that modulate awareness. Specifically, stimulus visibility varies as a function of alpha phase and is observed only under high alpha conditions (Mathewson et al., 2009, 2011, 2012). For instance, in metacontrast paradigm, depending on whether the target appears during a peak or trough in the alpha cycle it will be more or less likely to be detected (Mathewson et al., 2009, 2010, 2012). Similarly, alpha phase predicts whether or not participants will experience a TMS induced occipital phosphene (Dugué et al., 2011). Moreover, it is possible to induce alpha with either periodic visual stimuli (Mathewson et al., 2010, 2012; de Graaf et al., 2013; Spaak et al., 2014) or repetitive TMS (rTMS) over parietal cortex (Thut et al., 2011; Jaegle and Ro, 2014) and produce phase-dependent changes in stimulus detection performance. Romei et al. (2010) stimulated occipital and parietal cortex with rTMS at alpha (10 Hz), theta (5 Hz), and beta (20 Hz) frequency and found that stimulation only at the alpha frequency significantly correlated with stimulus visibility. Together these findings suggest that alpha is causally involved in shaping perception and, hence, both its phase and power reflect the brain state that can be labeled as NCC-prerequisites. Interestingly, activity in frontoparietal attention areas has been shown to correlate with the posterior alpha that predicts detection of visual stimuli (Mathewson et al., 2014), suggesting once again that pre-stimulus alpha may reflect attentional states.
Given the timing of alpha and optimal backwards masking SOAs, it is possible that alpha oscillations impact both the target and mask. Specifically, optimal backward masking SOAs with visual and TMS masks (when retinocortical transmission time is accounted for) fall within the half cycle of alpha. Indeed, the timing is such that if the target appears in an inhibitory phase of alpha, the mask will fall in the excitatory phase, potentially increasing the chances that the feedforward signal from the mask will interfere with the target (see Figure 3). Of course, it is equally likely that the target appears during the excitatory phase of alpha, resulting in poorer masking and better detection of the target. Such a mechanism could explain why metacontrast masking rarely occurs on 100% of trials. Alpha phase alone cannot account for backward masking more generally, however, because alpha power is low when a study participant is fully engaged in the task. In this case, phase has little to no effect on stimulus visibility, yet metacontrast masking still occurs during low alpha power states, albeit at a reduced rate compared to trials occurring during high alpha power states (Mathewson et al., 2009). Further research is needed to understand the relationship between alpha power and phase, and paracontrast and pre-stimulus TMS effects. Because TMS pulses in a range of modalities have been shown to reset alpha (Mathewson et al., 2012; Romei et al., 2012), it is possible that a visual mask or TMS pulse impacts alpha and this in turn may explain some of reported pre-stimulus effects.
FIGURE 3
Finally, with regard to the NCCs we note that most data collected on consciousness are just that, correlates. We still do not know what conditions give rise to the experience of consciousness. However, we argue that the visual masking and TMS literature reviewed here suggests that feedforward and feedback signals are not only correlated with awareness, but necessary for it. We are not suggesting, however, that such signals are sufficient for awareness. We do not suppose, for instance, that any set of neurons wired in a recurrent fashion should result in awareness (Herzog et al., 2007). Indeed, feedback likely confers some other advantage such as allowing for integration of information (Oizumi et al., 2014) or resonance between top-down expectations and bottom-up input (Grossberg, 2013).
CONCLUSION
To summarize, visual masking paradigms and TMS to EVC affect stimulus visibility in distinct time windows. Backward visual (metacontrast) and post-stimulus TMS masking effects have been thought to occur due to interference with feedback processes that are required for visual awareness, while forward visual (paracontrast) and pre-stimulus as well as early post-stimulus TMS effects have been proposed to reflect interference with the initial feedforward activity. Recent empirical evidence, however, suggests that the parallels between metacontrast and TMS masking might not be as straightforward as previously thought. While metacontrast occurs due to the mask interfering with feedback processes of the target, post-stimulus TMS possibly interrupts not only the feedback but also (some of the) feedforward processes. Additionally, forward masking (paracontrast) was thought to reflect interference with feedforward processing, but recent work looking at alpha oscillations raises the possibility that pre- and early post-stimulus TMS influence stimulus visibility by affecting the brain state prior to target onset. Future research should also inform the involvement of feedforward activity in post-stimulus TMS masking window and elucidate how and why this method of masking differs from that of metacontrast. Additionally, assessing the exact retinocortical transmission time for visual stimuli and specific time windows of suppression with TMS and visual masks should help disentangle feedforward and feedback contributions to visual processing in these paradigms. Finally, exploring the contributions of oscillatory alpha power and phase will help establish the necessary and sufficient conditions to visual awareness by parsing out prerequisites from NCC-proper.
Statements
Acknowledgments
We thank Bruno Breitmeyer and Christianne Jacobs for sharing their data for our figures. This work was supported by NIH R01EY022605 to Diane M. Beck.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
REFERENCES
1
AhissarM.HochsteinS. (2004). The reverse hierarchy theory of visual perceptual learning.Trends Cogn. Sci.8457–464. 10.1016/j.tics.2004.08.011
2
AhissarM.NahumM.NelkenI.HochsteinS. (2009). Reverse hierarchies and sensory learning Reverse hierarchies and sensory learning.Philos. Trans. R. Soc. Lond. B Biol. Sci.364285–299. 10.1098/rstb.2008.0253
3
AlexanderK. R.RajagopalanA. S.SeipleW.ZemonV. M.FishmanG. A. (2005). Contrast response properties of magnocellular and parvocellular pathways in retinitis pigmentosa assessed by the visual evoked potential.Invest. Ophthalmol. Vis. Sci.462967–2973. 10.1167/iovs.05-0231
4
AllenC. P. G.SumnerP.ChambersC. D. (2014). The timing and neuroanatomy of conscious vision as revealed by TMS-induced blindsight.J. Cogn. Neurosci.261507–1518. 10.1162/jocn_a_00557
5
AlpernM. (1953). Metacontrast.J. Opt. Soc. Am.43648–657. 10.1364/JOSA.43.000648
6
AmassianV. E.CraccoR. Q.MaccabeeP. J.CraccoJ. B.RudellA. P.EberleL. (1989). Suppression of visual perception by magnetic coil stimulation of human occipital cortex.Electroencephalogr. Clin. Neurophysiol.74458–462. 10.1016/0168-5597(89)90036-1
7
AmassianV. E.CraccoR. Q.MaccabeeP. J.CraccoJ. B.RudellA. P.EberleL. (1993). Unmasking human visual perception with the magnetic coil and its relationship to hemispheric asymmetry.Brain Res.65312–316. 10.1016/0006-8993(93)91757-J
8
AnsorgeU.FrancisG.HerzogM. H.ÖǧmenH. (2007). Visual masking and the dynamics of human perception, cognition, and consciousness: a century of progress, a contemporary synthesis, and future directions.Adv. Cogn. Psychol.31–8. 10.2478/v10053-008-0009-0
9
AruJ.BachmannT.SingerW.MelloniL. (2012). Distilling the neural correlates of consciousness.Neurosci. Biobehav. Rev.36737–746. 10.1016/j.neubiorev.2011.12.003
10
BaarsB. J. (2005). Global workspace theory of consciousness: toward a cognitive neuroscience of human experience.Prog. Brain Res.15045–53. 10.1016/S0079-6123(05)50004-9
11
BachmannT. (1994). Psychophysiology of Visual Masking. The Fine Structure Of Conscious Experience.Commack: Nova. Bachmann.
12
BachmannT.FrancisG. (2014). Visual Masking: Studying Perception, Attention, and Consciousness.Amsterdam: Elsevier.
13
Bacon-MacéN.MacéM. J.-M.Fabre-ThorpeM.ThorpeS. J. (2005). The time course of visual processing: backward masking and natural scene categorisation.Vision Res.451459–1469. 10.1016/j.visres.2005.01.004
14
BarM. (2003). A cortical mechanism for triggering top-down facilitation in visual object recognition.J. Cogn. Neurosci.15600–609. 10.1162/089892903321662976
15
BarM.KassamK. S.GhumanA. S.BoshyanJ.SchmidtA. M.DaleA. M.et al (2006). Top-down facilitation of visual recognition.Proc. Natl. Acad. Sci. U.S.A.103449–454. 10.1073/pnas.0507062103
16
BaselerH. A.SutterE. E. (1997). M and P components of the VEP and their visual field distribution.Vision Res.37675–690. 10.1016/S0042-6989(96)00209-X
17
BeckD. M.MuggletonN.WalshV.LavieN. (2006). Right parietal cortex plays a critical role in change blindness.Cereb. Cortex16712–717. 10.1093/cercor/bhj017
18
BeckD.ReesG.FrithC. D.LavieN. (2001). Neural correlates of change detection and change blindness.Nat. Neurosci.4645–650. 10.1038/88477
19
BeckersG.HömbergV. (1991). Impairment of visual perception and visual short term memory scanning by transcranial magnetic stimulation of occipital cortex.Exp. Brain Res.87421–432. 10.1007/BF00231859
20
BlockN. (2005). Two neural correlates of consciousness.Trends Cogn. Sci.946–52. 10.1016/j.tics.2004.12.006
21
BoehlerC. N.SchoenfeldM. A.HeinzeH. J.HopfJ.-M. (2008). Rapid recurrent processing gates awareness in primary visual cortex.Proc. Natl. Acad. Sci. U.S.A.1058742–8747. 10.1073/pnas.0801999105
22
BreitmeyerB. G. (1978). Metacontrast masking as a function of mask energy.Bull. Psychon. Soc.1250–52. 10.3758/BF03329621
23
BreitmeyerB. G. (1984). Visual Masking: An Integrative Approach.Oxford: Oxford University Press. 10.2478/v10053-008-0010-7
24
BreitmeyerB. G. (2007). Visual masking: past accomplishments, present status, future developments.Adv. Cogn. Psychol.39–20. 10.2478/v10053-008-0010-7
25
BreitmeyerB. G. (2014). Contributions of magno- and parvocellular channels to conscious and non-conscious vision.Philos. Trans. R. Soc. Lond. Biol. Sci.36920130213. 10.1098/rstb.2013.0213
26
BreitmeyerB. G.GanzL. (1976). Implications of sustained and transient channels for theories of visual pattern masking, saccadic suppression and information processing.Psychol. Rev.831–36. 10.1037/0033-295X.83.1.1
27
BreitmeyerB. G.HanifW. (2008). Change of mind’ within and between nonconscious (masked) and conscious (unmasked) visual processing.Conscious. Cogn.17254–266. 10.1016/j.concog.2007.08.001
28
BreitmeyerB. G.KerseyM. (1981). Backward masking by pattern stimulus offset.J. Exp. Psychol. Hum. Percept. Perform.7972–97710.1037/0096-1523.7.5.972
29
BreitmeyerB. G.KafaligönülH.ÖǧmenH.MardonL.ToddS.ZieglerR. (2006). Meta- and paracontrast reveal differences between contour- and brightness-processing mechanisms.Vision Res.462645–2658. 10.1016/j.visres.2005.10.020
30
BreitmeyerB. G.ÖǧmenH. (2000). Recent models and findings in visual backward masking: a comparison, review, and update.Percept. Psychophys.621572–1595. 10.3758/BF03212157
31
BreitmeyerB. G.ÖǧmenH. (2006). Visual Masking: Time Slices Through Conscious and Unconscious Vision.New York: Oxford University Press. 10.1093/acprof:oso/9780198530671.001.0001
32
BreitmeyerB. G.ÖǧmenH.RamonJ.ChenJ. (2005). Unconscious and conscious priming by forms and their parts.Visual Cogn.12720–736. 10.1080/13506280444000472
33
BreitmeyerB. G.RoT.ÖǧmenH. (2004a). A comparison of masking by visual and transcranial magnetic stimulation: implications for the study of conscious and unconscious visual processing.Conscious. Cogn.13829–843. 10.1016/j.concog.2004.08.007
34
BreitmeyerB. G.RoT.SinghalN. S. (2004b). Unconscious color priming occurs at stimulus- not percept-dependent levels of processing.Psychol. Sci.15198–202. 10.1111/j.0956-7976.2004.01503009.x
35
BreitmeyerB. G.RoT.ÖǧmenH.ToddS. (2007). Unconscious, stimulus-dependent priming and conscious, percept-dependent priming with chromatic stimuli.Percept. Psychophys.69550–557. 10.3758/BF03193912
36
BreitmeyerB. G.TapiaE.KafaligönülH.ÖǧmenH. (2008). Metacontrast masking and stimulus contrast polarity.Vision Res.482433–2438. 10.1016/j.visres.2008.08.003
37
BridgemanB. (1980). Temporal response characteristics of cells in monkey striate cortex measured with metacontrast masking and brightness discrimination.Brain Res.196347–364. 10.1016/0006-8993(80)90400-X
38
BullierJ. (2001). Integrated model of visual processing.Brain Res. Brain Res. Rev.3696–107. 10.1016/S0165-0173(01)00085-6
39
BuschN. A.DuboisJ.VanRullenR. (2009). The phase of ongoing EEG oscil- lations predicts visual perception.J. Neurosci.297869–7876. 10.1523/JNEUROSCI.0113-09.2009
40
CamprodonJ. A.ZoharyE.BrodbeckV.Pascual-LeoneA. (2010). Two phases of V1 activity for visual recognition of natural images.J. Cogn. Neurosci.221262–1269. 10.1162/jocn.2009.21253
41
CavoniusC. R.ReevesA. J. (1983). “The interpretation of metacontrast and contrast-flash spectral sensitivity functions,” inColor Vision: Physiology and PsychophysicsedsMollonJ. D.SharpeL. T. (London: Academic Press) 471–478.
42
CelebriniS.ThorpeS.TrotterY.ImbertM. (1993). Dynamics of orientation coding in area V1 of the awake primate.Vis. Neurosci. 10:811–825. 10.1017/S0952523800006052
43
ChenC.-M.LakatosP.ShahA. S.MehtaA. D.GivreS. J.JavittD. C.et al (2007). Functional anatomy and interaction of fast and slow visual pathways in macaque monkeys.Cereb. Cortex171561–1569. 10.1093/cercor/bhl067
44
ChenZ.TreismanA. (2009). Implicit perception and level of processing in object-substitution masking.Psychol. Sci.20560–567. 10.1111/j.1467-9280.2009.02328.x
45
CooneyJ. W.GazzanigaM. S. (2003). Neurological disorders and the structure of human consciousness.Trends Cogn. Sci.7161–165. 10.1016/S1364-6613(03)00058-5
46
CorbettaM.ShulmanG. L. (2002). Control of goal-directed and stimulus-driven attention in the brain.Nat. Rev. Neurosci.3201–215. 10.1038/nrn755
47
CorthoutE.HallettM.CoweyA. (2002). Early visual cortical processing suggested by transcranial magnetic stimulation.Neuroreport131163–1166. 10.1097/00001756-200207020-00018
48
CorthoutE.HallettM.CoweyA. (2003). Interference with vision by TMS over the occipital pole: a fourth period.Neuroreport14651–655. 10.1097/01.wnr.0000058220.74643.52
49
CorthoutE.HallettM.CoweyA. (2011). TMS-induced blinking assessed with high-speed video: optical disruption of visual perception.Exp. Brain Res.210243–250. 10.1007/s00221-011-2626-y
50
CorthoutE.UttlB.WalshV.HallettM.CoweyA. (1999a). Timing of activity in early visual cortex as revealed by transcranial magnetic stimulation.Neuroreport10:2631–263410.1097/00001756-199908200-00035
51
CorthoutE.UttlB.ZiemannU.CoweyA.HallettM. (1999b). Two periods of processing in the (circum)striate visual cortex as revealed by transcranial magnetic stimulation.Neuropsychologia37137–145. 10.1016/S0028-3932(98)00088-8
52
CrickF.KochC. (1995). Are we aware of neural activity in primary visual cortex?Nature375121–123. 10.1038/375121a0
53
CrickF.KochC. (2003). A framework for consciousness.Nat. Neurosci.6119–26. 10.1038/nn0203-119
54
de GraafT. A.CornelsenS.JacobsC.SackA. T. (2011a). TMS effects on subjective and objective measures of vision: Stimulation intensity and pre- versus post-stimulus masking.Conscious. Cogn.201244–1255. 10.1016/j.concog.2011.04.012
55
de GraafT. A.HerringJ.SackA. T. (2011b). A chronometric exploration of high-resolution “sensitive TMS masking” effects on subjective and objective measures of vision.Exp. Brain Res.20919–27. 10.1007/s00221-010-2512-z
56
de GraafT. A.GoebelR.SackA. T. (2012a). Feedforward and quick recurrent processes in early visual cortex revealed by TMS?NeuroImage61651–659. 10.1016/j.neuroimage.2011.10.020
57
de GraafT. A.HsiehP.-J.SackA. T. (2012b). The “correlates” in neural correlates of consciousness.Neurosci. Biobehav. Rev.36191–197. 10.1016/j.neubiorev.2011.05.012
58
de GraafT. A.GrossJ.PatersonG.RuschT.SackA. T.ThutG. (2013). Alpha-band rhythms in visual task performance: phase-locking by rhythmic sensory stimulation.PLoS ONE8:e60035. 10.1371/journal.pone.0060035.t002
59
de GraafT. A.KoivistoM.JacobsC.SackA. T. (2014). The chronometry of visual perception: review of occipital TMS masking studies.Neurosci. Biobehav. Rev.45C295–304. 10.1016/j.neubiorev.2014.06.017
60
DehaeneS.ChangeuxJ. P.NaccacheL.SackurJ.SergentC. (2006). Conscious, preconscious, and subliminal processing: a testable taxonomy.Trends Cogn. Sci.10204–211. 10.1016/j.tics.2006.03.007
61
DehaeneS.NaccacheL. (2001). Towards a cognitive neuroscience of consciousness: basic evidence and a workspace framework.Cognition791–37. 10.1016/S0010-0277(00)00123-2
62
DennettD. (2001). Are we explaining consciousness yet?Cognition79221–237. 10.1016/S0010-0277(00)00130-X
63
DeYoeE. A.Van EssenD. C. (1988). Concurrent processing streams in monkey visual cortex.Trends Neurosci.11219–226. 10.1016/0166-2236(88)90130-0
64
Di LolloV.EnnsJ. T.RensinkR. A. (2000). Competition for consciousness among visual events: the psychophysics of reentrant visual processes.J. Exp. Psychol. Gen.129481–507. 10.1037/0096-3445.129.4.481
65
Di RussoF.MartinezA.HillyardS. A. (2003). Source analysis of event-related cortical activity during visuo-spatial attention.Cereb. Cortex13486–499. 10.1093/cercor/13.5.486
66
DriverJ.VuilleumierP. (2001). Perceptual awareness and its loss in unilateral neglect and extinction.Cognition7939–88. 10.1016/S0010-0277(00)break00124-4
67
DuguéL.MarqueP.VanRullenR. (2011). The phase of ongoing oscillations mediates the causal relation between brain excitation and visual perception.J. Neurosci.3111889–11893. 10.1523/JNEUROSCI.1161-11.2011
68
EmmanouilT. A.AviganP.PersuhM.RoT. (2013). Saliency affects feedforward more than feedback processing in early visual cortex.Neuropsychologia511497–503. 10.1016/j.neuropsychologia.2013.04.013
69
EnnsJ.Di LolloV. (1997). Object substitution: a new form of masking in unattended visual locations.Psychol. Sci.8135–140. 10.1111/j.1467-9280.1997.tb00696.x
70
EnnsJ. T.Di LolloV. (2000). What’s new in visual masking?Trends Cogn. Sci.4345–352. 10.1016/S1364-6613(00)01520-5
71
EnnsJ. T.OrietC. (2007). Visual similarity in masking and priming: the critical role of task relevance.Adv. Cogn. Psychol.3211–226. 10.2478/v10053-008-0026-z
72
ErgenogluT.DemiralpT.BayraktarogluZ.ErgenM.BeydagiH.UresinY. (2004). Alpha rhythm of the EEG modulates visual detection performance in humans.Brain Res. Cogn. Brain Res.20376–383. 10.1016/j.cogbrainres.2004.03.009
73
FahrenfortJ. J.ScholteH. S.LammeV. A. F. (2007). Masking disrupts reentrant processing in human visual cortex.J. Cogn. Neurosci.191488–1497. 10.1162/jocn.2007.19.9.1488
74
FahrenfortJ. J.ScholteH. S.LammeV. A. F. (2008). The spatiotemporal profile of cortical processing leading up to visual perception.J. Vis.81–12. 10.1167/8.1.12.Introduction
75
FellemanD. J.Van EssenD. C. (1991). Distributed hierarchical processing in the primate cerebral cortex.Cereb. Cortex11–47. 10.1093/cercor/1.1.1
76
FellemanD. J.XiaoY.McClendonE. (1997). Modular organization of occipito-temporal pathways: cortical connections between visual area 4 and visual area 2 and posterior inferotemporal ventral area in macaque monkeys.J. Neurosci.173185–3200.
77
FoxeJ. J.SimpsonG. V. (2002). Flow of activation from V1 to frontal cortex in humans. A framework for defining “early” visual processing.Exp. Brain Res.142139–150.
78
FoxeJ. J.StrugstadE. C.SehatpourP.MolholmS.PasiekaW.SchroederC. E.et al (2008). Parvocellular and magnocellular contributions to the initial generators of the visual evoked potential: high-density electrical mapping of the “C1” component.Brain Topogr.2111–21. 10.1007/s10548-008-0063-4
79
FrancisG. (1997). Cortical dynamics of lateral inhibition: metacontrast masking.Psychol. Rev.104572–594. 10.1037/0033-295X.104.3.572
80
FrancisG. (2000). Quantitative theories of metacontrast masking.Psychol. Rev.107768–785. 10.1037/0033-295X.107.4.768
81
FrancisG.HerzogM. H. (2004). Testing quantitative models of backward masking.Psychon. Bull. Rev.11104–112. 10.3758/BF03206468
82
FriedP. J.Elkin-FrankstonS.RushmoreR. J.HilgetagC. C.Valero-CabreA. (2011). Characterization of visual percepts evoked by noninvasive stimulation of the human posterior parietal cortex.PLoS ONE6:e27204. 10.1371/journal.pone.0027204
83
GhoseT.HermensF.HerzogM. H. (2012). How the global layout of the mask influences masking strength.J. Vis.12:9. 10.1167/12.13.9
84
GilbertC. D.SigmanM. (2007). Brain states: top-down influences in sensory processing.Neuron54677–696. 10.1016/j.neuron.2007.05.019
85
GoodhewS. C.PrattJ.DuxP. E.FerberS. (2013). Substituting objects from consciousness: a review of object substitution masking.Psychon. Bull. Rev.20859–877. 10.3758/s13423-013-0400-9
86
GrossbergS. (2013). Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world.Neural Netw.371–47. 10.1016/j.neunet.2012.09.017
87
HallettM. (2007). Transcranial magnetic stimulation: a primer.Neuron55187–199. 10.1016/j.neuron.2007.06.026
88
HeinenK.JolijJ.LammeV. A. F. (2005). Figure-ground segregation requires two distinct periods of activity in V1: a transcranial magnetic stimulation study.Neuroreport161483–1487. 10.1097/01.wnr.0000175611.26485.c8
89
HelligeJ. B.WalshD. A.LawrenceV. W.CoxP. J. (1977). The importance of figural relationships between target and mask.Percept. Psychophys.21285–286. 10.3758/BF03214243
90
HelligeJ. B.WalshD. A.LawrenceV. W.PrasseM. (1979). Figural relationship effects and mechanisms of visual masking.J. Exp. Psychol. Hum. Percept. Perform.588–100. 10.1037/0096-1523.5.1.88
91
HermensF.LuksysG.GerstnerW.HerzogM. H.ErnstU. (2008). Modeling spatial and temporal aspects of visual backward masking.Psychol. Rev.115 p83-p100. 10.1037/0033-295X.115.1.83
92
HerzogM.KochC. (2001). Seeing properties of an invisible object: feature inheritance and shine-through.Proc. Natl. Acad. Sci. U.S.A.984271–4275. 10.1073/pnas.071047498
93
HerzogM. H.EsfeldM.GerstnerW. (2007). Consciousness and the small network argument.Neural Netw.201054–1056. 10.1016/j.neunet.2007.09.001
94
HochsteinS.AhissarM. (2002). View from the top: hierarchies and reverse hierarchies in the visual system.Neuron36791–804. 10.1016/S0896-6273(02)01091-7
95
HupéJ. M.JamesA. C.GirardP.LomberS. G.PayneB. R.BullierJ. (2001). Feedback connections act on the early part of the responses in monkey visual cortex.J. Neurophysiol.85134–145.
96
HupéJ. M.JamesA. C.PayneB. R.LomberS. G.GirardP.BullierJ. (1998). Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons.Nature394784–787. 10.1038/29537
97
JacobsC.de GraafT. A.GoebelR.SackA. T. (2012a). The temporal dynamics of early visual cortex involvement in behavioral priming.PLoS ONE7:e48808. 10.1371/journal.pone.0048808
98
JacobsC.GoebelR.SackA. T. (2012b). Visual awareness suppression by pre-stimulus brain stimulation: a neural effect.Neuroimage59616–624. 10.1016/j.neuroimage.2011.07.090
99
JacobsC.de GraafT. A.SackA. T. (2014). Two distinct neural mechanisms in early visual cortex determine subsequent visual processing.Cortex 59C, 1–11. 10.1016/j.cortex.2014.06.017
100
JaegleA.RoT. (2014). Direct control of visual perception with phase-specific modulation of posterior parietal cortex.J. Cogn. Neurosci.26422–432. 10.1162/jocn
101
KahnemanD. (1968). Method, findings, and theory in studies of visual masking.Psychol. Bull.70404–425. 10.1037/h0026731
102
KaitzM.MonitzJ.NesherR. (1985). Electrophysiological correlates of visual masking.Int. J. Neurosci.28261–268. 10.3109/00207458508985393
103
KammerT. (2007a). Masking visual stimuli by transcranial magnetic stimulation.Psychol. Res.71659–666. 10.1007/s00426-006-0063-5
104
KammerT. (2007b). Visual masking by transcranial magnetic stimulation in the first 80 milliseconds.Adv. Cogn. Psychol.3177–179. 10.2478/v10053-008-0023-2
105
KammerT.PulsK.ErbM.GroddW. (2005a). Transcranial magnetic stimulation in the visual system. II. Characterization of induced phosphenes and scotomas.Exp. Brain Res.160129–140. 10.1007/s00221-004-1992-0
106
KammerT.PulsK.StrasburgerH.HillN. J.WichmannF. A. (2005b). Transcranial magnetic stimulation in the visual system. I. The psychophysics of visual suppression.Exp. Brain Res.160118–128. 10.1007/s00221-004-1991-1
107
KaplanE.ShapleyR. M. (1986). The primate retina contains two types of ganglion cells with high and low contrast sensitivity.Proc. Natl. Acad. Sci. U.S.A.832755–2757. 10.1073/pnas.83.8.2755
108
KentridgeR. W.NijboerT. C. W.HeywoodC. A. (2008). Attended but unseen: Visual attention is not sufficient for visual awareness.Neuropsychologia46864–869. 10.1016/j.neuropsychologia.2007.11.036
109
KlimeschW.SausengP.HanslmayrS. (2007). EEG alpha oscillations: the inhibition-timing hypothesis.Brain Res. Rev.5363–88. 10.1016/j.brainresrev.2006.06.003
110
KlotzW.NeumannO. (1999). Motor activation without conscious discrimination in metacontrast masking.J. Exp. Psychol. Hum. Percept. Perform.25976–992. 10.1037//0096-1523.25.4.976
111
KlotzW.WolffP. (1995). The effect of a masked stimulus on the response to the masking stimulus.Psychol. Res.5892–101. 10.1007/BF00571098
112
KoivistoM.KastratiG.RevonsuoA. (2014a). Recurrent processing enhances visual awareness but is not necessary for fast categorization of natural scenes.J. Cogn. Neurosci.26223–231. 10.1162/jocn
113
KoivistoM.LähteenmäkiM.KaasinenV.ParkkolaR.RailoH. (2014b). Overlapping activity periods in early visual cortex and posterior intraparietal area in conscious visual shape perception: a TMS study.Neuroimage 84C, 765–774. 10.1016/j.neuroimage.2013.09.051
114
KoivistoM.MäntyläT.SilvantoJ. (2010). The role of early visual cortex (V1/V2) in conscious and unconscious visual perception.Neuroimage51828–834. 10.1016/j.neuroimage.2010.02.042
115
KoivistoM.RailoH.RevonsuoA.VanniS.Salminen-VaparantaN. (2011a). Recurrent processing in V1/V2 contributes to categorization of natural scenes.J. Neurosci.312488–2492. 10.1523/JNEUROSCI.3074-10.2011
116
KoivistoM.RailoH.Salminen-VaparantaN. (2011b). Transcranial magnetic stimulation of early visual cortex interferes with subjective visual awareness and objective forced-choice performance.Conscious. Cogn.20288–298. 10.1016/j.concog.2010.09.001
117
KolersP.RosnerB. S. (1960). On visual masking (metacontrast): dichoptic observations.Am. J. Psychol.732–21. 10.2307/1419113
118
KouiderS.DehaeneS. (2007). Levels of processing during non-conscious perception: a critical review of visual masking.Philos. Trans. R. Soc. Lond. B Biol. Sci.362857–875. 10.1098/rstb.2007.2093
119
KveragaK.BoshyanJ.BarM. (2007). Magnocellular projections as the trigger of top-down facilitation in recognition.J. Neurosci.2713232–13240. 10.1523/JNEUROSCI.3481-07.2007
120
LammeV. A. F. (2000). Neural mechanisms of visual awareness: a linking proposition.Brain and Mind1385–406. 10.1023/A:1011569019782
121
LammeV. A. F. (2003). Why visual attention and awareness are different.Trends Cogn. Sci.712–18. 10.1016/S1364-6613(02)00013-X
122
LammeV. A. F. (2006a). Towards a true neural stance on consciousness.Trends Cogn. Sci.10494–501. 10.1016/j.tics.2006.09.001
123
LammeV. A. F. (2006b). Zap! Magnetic tricks on conscious and unconscious vision.Trends Cogn. Sci.10193–195. 10.1016/j.tics.2006.03.002
124
LammeV. A. F.RoelfsemaP. R. (2000). The distinct modes of vision offered by feedforward and recurrent processing.Trends Neurosci.23571–579. 10.1016/S0166-2236(00)01657-X
125
LammeV. A. F.SupèrH.LandmanR.RoelfsemaP. R.SpekreijseH. (2000). The role of primary visual cortex (V1) in visual awareness.Vision Res.401507–1521. 10.1016/S0042-6989(99)00243-6
126
LammeV. A. F.SupèrH.SpekreijseH. (1998). Feedforward, horizontal, and feedback processing in the visual cortex.Curr. Opin. Neurobiol.8529–535. 10.1016/S0959-4388(98)80042-1
127
LammeV. A. F.ZipserK.SpekreijseH. (2002). Masking interrupts figure-ground signals in V1.J. Cogn. Neurosci.141044–1053. 10.1162/089892902320474490
128
LaycockR.CrewtherD. P.FitzgeraldP. B.CrewtherS. G. (2007). Evidence for fast signals and later processing in human V1/V2 and V5/MT+: a TMS study of motion perception.J. Neurophysiol.981253–1262. 10.1152/jn.00416.2007
129
LewisJ. W.Van EssenD. C. (2000). Mapping of architectonic subdivisions in the macaque monkey, with emphasis on parieto-occipital cortex.J. Comp. Neurol.42879–111. 10.1002/1096-9861(20001204)428:1<79::AID-CNE7>3.0.CO;2-Q
130
LinZ.MurrayS. (2014). Priming of awareness or how not to measure visual awareness.J. Vis.141-17. 10.1167/14.1.27
131
LivingstoneM.HubelD. (1988). Segregation of form, color, movement, and depth: anatomy, physiology, and perception.Science240740–749. 10.1126/science.3283936
132
LofflerG.GordonG. E.WilkinsonF.GorenD.WilsonH. R. (2005). Configural masking of faces: evidence for high-level interactions in face perception.Vision Res.452287–2297. 10.1016/j.visres.2005.02.009
133
LoschkyL. C.HansenB. C.SethiA.PydimarriT. N. (2010). The role of higher order image statistics in masking scene gist recognition.Atten. Percept. Psychophys.72427–444. 10.3758/APP
134
LuckS. J.ChelazziL.HillyardS. A.DesimoneR. (1997). Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex.J. Neurophysiol.7724–42
135
MacknikS. L. (2006). Visual masking approaches to visual awareness.Prog. Brain Res.155:177-215 10.1016/S0079-6123(06)55011-3
136
MacknikS. L.LivingstoneM. S. (1998). Neuronal correlates of visibility and invisibility in the primate visual system.Nat. Neurosci.1144–149. 10.1038/393
137
MacknikS. L.Martinez-CondeS. (2007). The role of feedback in visual masking and visual processing.Adv. Cogn. Psychol.3125–152. 10.2478/v10053-008-0020-5
138
MarziC. A.ManciniF.SavazziS. (2009). Interhemispheric transfer of phosphenes generated by occipital versus parietal transcranial magnetic stimulation.Exp. Brain Res.192431–441. 10.1007/s00221-008-1496-4
139
MathewsonK. E.BeckD. M.RoT.MaclinE. L.LowK. A.FabianiM.et al (2014). Dynamics of alpha control: preparatory suppression of posterior alpha oscillations by frontal modulators revealed with combined EEG and event-related optical signal.J. Cogn. Neurosci.262400–2415. 10.1162/jocn
140
MathewsonK. E.FabianiM.GrattonG.BeckD. M.LlerasA. (2010). Rescuing stimuli from invisibility: inducing a momentary release from visual masking with pre-target entrainment.Cognition115186–191. 10.1016/j.cognition.2009.11.010
141
MathewsonK. E.GrattonG.FabianiM.BeckD. M.RoT. (2009). To see or not to see: prestimulus alpha phase predicts visual awareness.J. Neurosci.292725–2732. 10.1523/JNEUROSCI.3963-08.2009
142
MathewsonK. E.LlerasA.BeckD. M.FabianiM.RoT.GrattonG. (2011). Pulsed out of awareness: EEG alpha oscillations represent a pulsed-inhibition of ongoing cortical processing.Front. Psychol.2:99. 10.3389/fpsyg.2011.00099
143
MathewsonK. E.PrudhommeC.FabianiM.BeckD. M.LlerasA.GrattonG. (2012). Making waves in the stream of consciousness: entraining oscillations in EEG alpha and fluctuations in visual awareness with rhythmic visual stimulation.J. Cogn. Neurosci.242321–2333. 10.1162/jocn_a_00288
144
MaunsellJ. H. R.GibsonJ. R. (1992). Visual response latencies in striate cortex of the macaque monkey.J. Neurophysiol.681332–1344.
145
MazziC.ManciniF.SavazziS.(in press). Can IPS reach visual awareness without V1? Evidence from TMS in healthy subjects and hemianopic patients.Neuropsychologia [Epub ahead of print].
146
McKeefryD. J.GouwsA.BurtonM. P.MorlandA. B. (2009). The noninvasive dissection of the human visual cortex: using fMRI and TMS to study the organization of the visual brain.Neuroscientist15489–506. 10.1177/1073858409334424
147
MeriganW. H.MaunsellJ. H. R. (1993). How parallel are the primate visual pathways?Annu. Rev. Neurosci.16369–402. 10.1146/annurev.ne.16.030193.002101
148
MichaelsC. F.TurveyM. T. (1979). Central sources of visual masking: indexing structures supporting seeing at a single brief glance.Psychol. Res.411–61. 10.1007/BF00309423
149
MiyawakiY.ShinozakiT.OkadaM. (2012). Spike suppression in a local cortical circuit induced by transcranial magnetic stimulation.J. Comput. Neurosci.33405–419. 10.1007/s10827-012-0392-x
150
MooreT.ArmstrongK. M. (2003). Selective gating of visual signals by microstimulation of frontal cortex.Nature421370–373. 10.1038/nature01341
151
NowakL. G.MunkM. H. J.GirardP.BullierJ. (1995). Visual latencies in areas V1 and V2 of the macaque monkey.Vis. Neurosci.12371-384. 10.1017/S095252380000804X
152
ÖǧmenH.BreitmeyerB. G.MelvinR. (2003). The what and where in visual masking.Vision Res.431337–1350. 10.1016/S0042-6989(03)00138-X
153
OizumiM.AlbantakisL.TononiG. (2014). From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0.PLoS Comput. Biol.10:e1003588. 10.1371/journal.pcbi.1003588
154
OttoT. U.ÖgmenH.HerzogM. H. (2006). The flight path of the phoenix—the visible trace of invisible elements in human vision.J. Vis.61079–1086. 10.1167/6.10.7
155
PalvaS.Linkenkaer-HansenK.Naata- nenR.PalvaJ. M. (2005). Early neural correlates of conscious somatosensory perception.J. Neurosci.255248–525810.1523/JNEUROSCI.0141-05.2005
156
PanichelloM. F.CheungO. S.BarM. (2012). Predictive feedback and conscious visual experience.Front. Psychol.3:620. 10.3389/fpsyg.2012.00620
157
ParksN. A.BeckD.LowK. A.MaclinE. L.TapiaE.SavazziS.et al (2013). Dynamic measurement of functional connectivity using simultaneous fast optical imaging and magnetic stimulation. New Horizons in Human Optical Imaging. Psychophysiology50 S14. 10.1111/psyp.12109
158
Pascual-LeoneA.WalshV. (2001). Fast backprojections from the motion to the primary visual area necessary for visual awareness.Science292510–512. 10.1126/science.1057099
159
PaulusW.KorinthS.WischerS.TergauF. (1999). Differential inhibition of chromatic and achromatic perception by transcranial magnetic stimulation of the human visual cortex.Neuroreport101245–1248. 10.1097/00001756-199904260-00017
160
PersuhM.RoT. (2013). Unconscious priming requires early visual cortex at specific temporal phases of processing.J. Cogn. Neurosci.251493–503. 10.1162/jocn
161
PeyrinC.MichelC. M.SchwartzS.ThutG.SeghierM.LandisT.et al (2010). The neural substrates and timing of top-down processes during coarse-to-fine categorizatin of visual scenes: a combined fMRI and ERP study.J. Cogn. Neurosci.222768–2780. 10.1162/jocn.2010.21424
162
PitcherD.CharlesL.DevlinJ. T.WalshV.DuchaineB. (2009). Triple dissociation of faces, bodies, and objects in extrastriate cortex.Curr. Biol.19319–324. 10.1016/j.cub.2009.01.007
163
PlompG.MercierM. R.OttoT. U.BlankeO.HerzogM. H. (2009). Non-retinotopic feature integration decreases response-locked brain activity as revealed by electrical neuroimaging.Neuroimage48405–414. 10.1016/j.neuroimage.2009.06.031
164
RailoH.KoivistoM. (2012). Two means of suppressing visual awareness: A direct comparison of visual masking and transcranial magnetic stimulation.Cortex48333–343. 10.1016/j.cortex.2010.12.001
165
RailoH.Salminen-VaparantaN.HenrikssonL.RevonsuoA.KoivistoM. (2012). Unconscious and conscious processing of color rely on activity in early visual cortex: a TMS study.J. Cogn. Neurosci.24819–829. 10.1162/jocn_a_00172
166
RaoR. P.BallardD. H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects.Nat. Neurosci.279–87. 10.1038/4580
167
ReesG. (2001). Neuroimaging of visual awareness in patients and normal subjects.Curr. Opin. Neurobiol.11:150–156. 10.1016/S0959-4388(00)00190-2
168
ReesG.KreimanG.KochC. (2002). Neural correlates of consciousness in humans.Nat. Rev. Neurosci.3261–270. 10.1038/nrn783
169
ReichenbachA.WhittingstallK.ThielscherA. (2011). Effects of transcranial magnetic stimulation on visual evoked potentials in a visual suppression task.Neuroimage541375–1384. 10.1016/j.neuroimage.2010.08.047
170
RoT.BreitmeyerB.BurtonP.SinghalN. S.LaneD. (2003). Feedback contributions to visual awareness in human occipital cortex.Curr. Biol.131038–1041. 10.1016/S0960-9822(03)00337-3
171
RoT.SinghalN. S.BreitmeyerB. G.GarciaJ. O. (2009). Unconscious processing of color and form in metacontrast masking.Atten. Percept. Psychophys.7195–103. 10.3758/APP
172
RomeiV.BrodbeckV.MichelC.AmediA.Pascual-LeoneA.ThutG. (2008). Spontaneous fluctuations in posterior alpha-band EEG activity reflect variability in excitability of human visual areas.Cereb. Cortex182010–2018. 10.1093/cercor/bhm229
173
RomeiV.GrossJ.ThutG. (2010). On the role of prestimulus alpha rhythms over occipito-parietal areas in visual input regulation: correlation or causation?J. Neurosci.308692–8697. 10.1523/JNEUROSCI.0160-10.2010
174
RomeiV.GrossJ.ThutG. (2012). Sounds reset rhythms of visual cortex and corresponding human visual perception.Curr. Biol.8807–813. 10.1016/j.cub.2012.03.025
175
RousseletG. A.Fabre-ThorpeM.ThorpeS. J. (2002). Parallel processing in high-level categorization of natural images.Nat. Neurosci.5629–630. 10.1038/nn866
176
RuffC. C.BestmannS.BlankenburgF.BjoertomtO.JosephsO.WeiskopfN.et al (2008). Distinct causal influences of parietal versus frontal areas on human visual cortex: evidence from concurrent TMS-fMRI.Cereb. Cortex18817–827. 10.1093/cercor/bhm128
177
RuffC. C.BlankenburgF.BjoertomtO.BestmannS.FreemanE.HaynesJ. D.et al (2006). Concurrent TMS- fMRI and psychophysics reveal frontal influences on human reti- notopic visual cortex.Curr. Biol.161479–1488. 10.1016/j.cub.2006.06.057
178
RüterJ.KammerT.HerzogM. H. (2010). When transcranial magnetic stimulation (TMS) modulates feature integration.Eur. J. Neurosci.321951–1958. 10.1111/j.1460-9568.2010.07456.x
179
SackA. T.van der MarkS.SchuhmannT.SchwarzbachJ.GoebelR. (2009). Symbolic action priming relies on intact neural transmission along the retino-geniculo-striate pathway.Neuroimage44284–293. 10.1016/j.neuroimage.2008.07.030
180
Salminen-VaparantaN.KoivistoM.NoreikaV.VanniS.RevonsuoA. (2012). Neuronavigated transcranial magnetic stimulation suggests that area V2 is necessary for visual awareness.Neuropsychologia501621–1627. 10.1016/j.neuropsychologia.2012.03.015
181
ScharnowskiF.RuterJ.JolijJ.HermensF.KammerT.HerzogM. H. (2009). Long-lasting modulation of feature integration by transcranial magnetic stimulation.J. Vision.91–10. 10.1167/9.6.1
182
SchillerP. H.SmithM. C. (1968). Monoptic and dichoptic metacontrast.Percept. Psychophys.193237–239. 10.3758/BF03212735
183
SchmidtF.SchmidtT. (2010). Feature-based attention to unconscious shapes and colors.Atten. Percept. Psychophys.721480–1494. 10.3758/APP
184
SchmidtT. (2002). The finger in flight: real-time motor control by visually masked color stimuli.Psychol. Sci.13112–118. 10.1111/1467-9280.00421
185
SchmidtT.SchmidtF. (2009). Processing of natural images is feedforward: a simple behavioral test.Atten. Percept. Psychophys.71594–606. 10.3758/APP.71.3.594
186
SchmoleskyM. T.WangY.HanesD. P.ThompsonK. G.LeutgebS.SchallJ. D.et al (1998). Signal timing across the macaque visual system.J. Neurophysiol.793272–3278.
187
SchynsP. G.OlivaA. (1994). From blobs to boundary edges: Evidence for time- and spatial-scale-dependent scene recognition.Psychol. Sci.5195–200. 10.1111/j.1467-9280.1994.tb00500.x
188
SilvantoJ.CoweyA.LavieN.WalshV. (2005a). Striate cortex (V1) activity gates awareness of motion.Nat. Neurosci.8143–144. 10.1038/nn1379
189
SilvantoJ.LavieN.WalshV. (2005b). Double dissociation of V1 and V5/MT activity in visual awareness.Cereb. Cortex151736–1741. 10.1093/cercor/bhi050
190
SilvantoJ.LavieN.WalshV. (2006). Stimulation of human frontal eye fields modulates sensitivity of extrastriate visual cortex.J. Neurophysiol.96941–945. 10.1152/jn.00015.2006
191
SilvantoJ.MuggletonN.LavieN.WalshV. (2009). The perceptual and functional consequences of parietal top-down modulation on the visual cortex.Cereb. Cortex19327–330. 10.1093/cercor/bhn091
192
SincichL. C.HortonJ. C. (2005). The circuitry of V1 and V2: Integration of color, form, and motion.Annu. Rev. Neurosci.28303–326. 10.1146/annurev.neuro.28.061604.135731
193
SpaakE.de LangeF. P.JensenO. (2014). Local entrainment of α oscillations by visual stimuli causes cyclic modulation of perception.J. Neurosci.343536–3544. 10.1523/JNEUROSCI.4385-13.2014
194
SummerfieldC.EgnerT. (2009). Expectation (and attention) in visual cognition.Trends Cogn. Sci.13403–409. 10.1016/j.tics.2009.06.003
195
SupèrH.SpekreijseH.LammeV. A. F. (2001). Two distinct modes of sensory processing observed in monkey primary visual cortex (V1).Nat. Neurosci.4304–310. 10.1038/85170
196
TapiaE.BreitmeyerB. G. (2011). Visual consciousness revisited: magnocellular and parvocellular contributions to conscious and nonconscious vision.Psychol. Sci.22934–942. 10.1177/0956797611413471
197
TapiaE.BreitmeyerB. G.BroylesE. C. (2011). Properties of spatial attention in conscious and nonconscious visual information processing.Conscious. Cogn.20426–431. 10.1016/j.concog.2010.07.001
198
TapiaE.BreitmeyerB. G.JacobJ.BroylesE. C. (2013). Spatial attention effects during conscious and nonconscious processing of visual features and objects.J. Exp. Psychol. Hum. Percept. Perform.39745–756. 10.1037/a0030112
199
TapiaE.BreitmeyerB. G.ShoonerC. R. (2010). Role of task-directed attention in nonconscious and conscious response priming by form and color.J. Exp. Psychol. Hum. Percept. Perform.3674–87. 10.1037/a0017166
200
TapiaE.MazziC.SavazziS.BeckD. M. (2014). Phosphene-guided transcranial magnetic stimulation of occipital but not parietal cortex suppresses stimulus visibility.Exp. Brain Res.2321989–1997. 10.1007/s00221-014-3888-y
201
TaylorP. C. J.NobreA. C.RushworthM. F. S. (2007). FEF TMS affects visual cortical activity.Cereb. Cortex17391–399. 10.1093/cercor/bhj156
202
ThielscherA.ReichenbachA.UǧurbilK.UludaǧK. (2010). The cortical site of visual suppression by transcranial magnetic stimulation.Cereb. Cortex20328–338. 10.1093/cercor/bhp102
203
ThorpeS. J.FizeD.MarlotC. (1996). Speed of processing in the human visual system.Nature381520–522. 10.1038/381520a0
204
ThutG.NietzelA.BrandtS. A.Pascual-LeoneA. (2006). Alpha-band electroencephalographic activity over occipital cortex indexes visuospatial attention bias and predicts visual target detection.J. Neurosci.269494–9502. 10.1523/JNEUROSCI.0875-06.2006
205
ThutG.VenieroD.RomeiV.MiniussiC.SchynsP.GrossJ. (2011). Rhythmic TMS causes local entrainment of natural oscillatory signatures.Curr. Biol.211176–1185. 10.1016/j.cub.2011.05.049
206
TongF. (2003). Primary visual cortex and visual awareness.Nat. Rev. Neurosci.4219–29. 10.1038/nrn1055
207
TononiG.KochC. (2008). The neural correlates of consciousness: an update.Ann. N. Y. Acad. Sci.1124239–261. 10.1196/annals.1440.004
208
TurattoM.SandriniM.MiniussiC. (2004). The role of the right dor- solateral prefrontal cortex in visual change awareness.Neuroreport152549–255210.1097/00001756-200411150-00024
209
UngerleiderL. G. (1985). “The corticocortical pathways for object recognition and spatial perception,” inPattern Recognition MechanismsedsChagasC.GattasR.GrossC. (Vatican City: Pontifical Academy of Sciences) 21–7.
210
van DijkH.SchoffelenJ. M.OostenveldR.JensenO. (2008). Prestimulus oscillatory activity in the alpha band predicts visual discrimination ability.J. Neurosci.281816–1823. 10.1523/JNEUROSCI.1853-07.2008
211
Van EssenD. C.AndersonC. H.FellemanD. J. (1992). Information processing in the primate visual system: an integrated systems perspective.Science255419–423. 10.1126/science.1734518
212
VanniS.TanskanenT.SeppaM.UutelaK.HariR. (2001). Coinciding early activation of the human primary visual cortex and anteromedial cuneus.Proc. Natl. Acad. Sci. U.S.A.982776–2780. 10.1073/pnas.041600898
213
VanRullenR. (2007). The power of the feed-forward sweep.Adv. Cogn. Psychol.3167–176. 10.2478/v10053-008-0022-3
214
VanRullenR.KochC. (2003). Visual selective behavior can be triggered by a feed-forward process.J. Cogn. Neurosci.15209–217. 10.1162/089892903321208141
215
VanRullenR.ThorpeS. J. (2001). The time course of visual processing: From early perception to decision-making.J. Cogn. Neurosci.13454–461. 10.1162/08989290152001880
216
VorbergD.MattlerU.HeineckeA.SchmidtT.SchwarzbachJ. (2003). Different time courses for visual perception and action priming.Proc. Natl. Acad. Sci. U.S.A.1006275–6280. 10.1073/pnas.0931489100
217
WaltherD. B.CaddiganE.Fei-FeiL.BeckD. M. (2009). Natural scene categories revealed in distributed patterns of activity in the human brain.J. Neurosci.2910573–10581. 10.1523/JNEUROSCI.0559-09.2009
218
WebsterM. J.BachevalierJ.UngerleiderL. G. (1994). Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys.Cereb. Cortex5470–483. 10.1093/cercor/4.5.470
219
WeissteinN. (1971). W-shaped and U-shaped functions obtained for monoptic and dichoptic disk–disk masking.Percept. Psychophys.9275–278. 10.3758/BF03212647
220
WeissteinN. (1972). “Metacontrast,” in Handbook Of Sensory PhysiologyVol. 7/4Visual PsychophysicsedsJamesonD.HurvichL. M. (New York: Springer) 233–272.
221
WilsonC. L.BabbT. L.HalgrenE.CrandallP. H. (1983). Visual receptive fields, and response properties of neurons in human temporal lobe, and visual pathways.Brain106473–502. 10.1093/brain/106.2.473
222
WordenM. S.FoxeJ. J.WangN.SimpsonG. V. (2000). Anticipatory biasing of visuospatial attention indexed by retinotopically specific alpha-band electroencephalography increases over occipital cortex.J. Neurosci.20 RC63.
223
WyartV.Tallon-BaudryC. (2008). Neural dissociation between visual awareness and spatial attention.J. Neurosci.282667–2679. 10.1523/JNEUROSCI.4748-07.2008
224
ZekiS. (2008). The disunity of consciousness.Prog. Brain Res.16811–18. 10.1016/S0079-6123(07)68002-9
225
ZekiS.BartelsA. (1998). The asynchrony of consciousness.Proc. R. Soc. B Biol. Sci.2651583–1585. 10.1098/rspb.1998.0475
Summary
Keywords
TMS, visual masking, awareness, feedforward, feedback, alpha oscillations, alpha phase, alpha power
Citation
Tapia E and Beck DM (2014) Probing feedforward and feedback contributions to awareness with visual masking and transcranial magnetic stimulation. Front. Psychol. 5:1173. doi: 10.3389/fpsyg.2014.01173
Received
13 June 2014
Accepted
26 September 2014
Published
21 October 2014
Volume
5 - 2014
Edited by
Talis Bachmann, University of Tartu, Estonia
Reviewed by
Michael Herzog, École Polytechnique Fédérale de Lausanne, Switzerland; Tom Alexander De Graaf, Maastricht University, Netherlands
Copyright
© 2014 Tapia and Beck.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Evelina Tapia, Beckman Institute, University of Illinois Urbana-Champaign, 405 N Mathews Avenue, Urbana, IL 61801, USA e-mail: evelinatapia@gmail.com
This article was submitted to Consciousness Research, a section of the journal Frontiers in Psychology.
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.