Hulusi Kafaligonul
Bruno G. Breitmeyer
Haluk Öğmen- 1National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey
- 2Department of Psychology, University of Houston, Houston, TX, USA
- 3Center for Neuro-Engineering and Cognitive Science, University of Houston, Houston, TX, USA
- 4Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA
Hierarchical processing is key to understanding vision. The visual system consists of hierarchically organized distinct anatomical areas functionally specialized for processing different aspects of a visual object (Felleman and Van Essen, 1991). These visual areas are interconnected through ascending feedforward projections, descending feedback projections, and projections from neural structures at the same hierarchical level (Lamme et al., 1998). Even though accumulating evidence suggests that these three projections play fundamentally different roles in perception, their distinct functional roles in visual processing are still subject to debate (Lamme and Roelfsema, 2000). The focus of this Research Topic was the roles of feedforward and feedback projections in vision. In fact, our motivation to edit this Research Topic was threefold: (i) to provide current views on the functional roles of feedforward and feedback projections for the perception of specific visual features, (ii) to invite recent views on how these functional roles contribute to the distinct modes of visual processing, (iii) to provide recent methodological views to identify distinct functional roles of feedforward and feedback projections and corresponding neural signatures. As summarized below, these aims are largely achieved thanks to fourteen contributions to this issue.
Feedforward and Feedback Projections for Different Aspects of a Visual Object
The cortical areas and the way they connect with each other lead to distinct pathways functionally specialized for processing different aspects of a visual object (Van Essen and Gallant, 1994). For example, the ventral processing stream has been associated with object recognition and identification. Romeo and Supèr (2014) have constructed a feedforward spiking hierarchical model for simulating IT cortex along the ventral stream. The simulation results indicate that figure-ground segregation occurs at an earlier level of processing relative to the level at which shape selection takes place. Wyatte et al. (2014) propose that object recognition requires more than feedforward processing. By reviewing a number of studies, they first differentiate two types of additional processing along the ventral stream: (i) early, short-distance (local) recurrent processes, and (ii) late, long-distance feedback processes related to attention. They further propose that early local recurrent feedback plays a functionally distinct role in attention-independent stimulus disambiguation, since it facilitates object recognition well before the onset of any attentional influences. Wutz and Melcher (2014) provide a review on temporal window for object recognition and individuation. They propose that mid-level vision adopts a temporal window whose duration is short enough for picking out separate objects (without appreciable smearing of their retinal images when they move), while simultaneously being long enough to integrate sufficient sensory information for accurate detection. Based on psychophysical and neurophysiological data, they suggest that phase synchronization plays a key role in this process by coordinating feedforward and feedback involved in complex and dynamic visual scenes. Several studies in this collection emphasize the role of feedback projections at different levels of processing within the ventral stream. Layton et al. (2014) propose a dynamic hierarchical model which can effectively perform figure-ground segregation in visual scenes with multiple objects. Their results indicate that the inhibitory feedback sharpens the population activity in the “lower stage” and that the dynamic balancing of feedforward signals with specific feedback mechanisms is crucial to identifying figural region. Furthermore, Layher et al. (2014) describe a model architecture to investigate the role of feedback mechanisms in learning new categories of visual objects. They basically use two types of feedback mechanisms to achieve seamless and automatic acquisition of category representation by an unsupervised learning mechanism integrated into a recurrent network architecture. Hence, they not only address the classic stability/plasticity dilemma but also elucidate how the predictive power of feedback mechanisms together with the feedforward sweep realize associative memory. Contour integration has been considered to be another crucial stage of visual object recognition. By varying the inter-element properties in a perceptual fading paradigm, Strother and Alferov (2014) focus on the individual roles of bottom-up feedforward and top-down feedback processing in such integration. In agreement with previous reports, their findings highlight the importance of feedforward processes in primary visual cortex (V1) and shape-related feedback from higher-tier visual cortical areas for contour integration.
Roles of Feedforward and Feedback Projections in Different Modes of Visual Processing
Accumulating evidence from modeling and experimental studies indicates that feedforward and feedback projections play important roles in different modes of visual processing and attention. However, their distinct contributions are still controversial. Khorsand et al. (2015) set the stage for feedforward and feedback contributions to the exogenous attentional selection. Bottom-up exogenous attention has been considered to rely only on feedforward processing of the external inputs. However, Khorsand et al. (2015) review recent experimental and theoretical studies supporting the view that stimulus dependent processing involves feedback connections and signals running in top-down direction of the hierarchy as well. Their review raises an important conceptual issue and provides an account of feedforward and feedback contributions to exogenous attentional shifts. In another study, Rensink (2014) identifies different levels of processing for iconic memory by using a modified visual search paradigm. Besides feedforward processing, he highlights the importance of two types of feedback projections (due to horizontal connections within a level as well as links between different levels) for iconic memory. He further characterizes “iconic,” “preattentive,” and “attentive” representations within this framework. As briefly mentioned above, based on the literature about visual object recognition, Wyatte et al. (2014) dissociate the late top-down processing originating from frontoparietal areas from early recurrent local projections within the ventral processing stream. They also review some studies emphasizing that this late top-down processing to striate cortex provides attentional support for salient or behaviorally-relevant features.
Explaining Various Visual Phenomena by Feedforward and Feedback Processes
The notions of feedforward and feedback processing have been extensively used to explain various visual phenomena. Di Lollo et al. (2013) hypothesizes that reentrant (feedback) processing gives the best account for a form of visual masking called object substitution masking (OSM). On the other hand, Põder et al. (2014) presents the contrasting view that reentrant processing is not necessary to explain OSM and that the attentional gating model is the simplest and most reasonable explanation for OSM results. Silverstein (2015) takes an interesting approach to examine the roles of feedforward and feedback processes in visual backward masking. Using a biophysical model of V1 and V2, he explains visual processing in terms of interacting cortical attractors. The simulation results indicate that both feedforward and feedback processes predict several aspects of backward masking. Additionally, Petro et al. (2014) focus on the functional role of cortical feedback projections on V1. By reviewing the most current theory and experimental data, they discuss how top-down feedback signals conveying information from higher-processing stages (e.g., prediction, reward, memory and behavioral context) are involved in shaping sensory processing in V1 and hence, explain recent experimental findings along this direction.
A contrasting view is provided by Clarke et al. (2014), who argue against the usefulness of making feedforward and feedback distinctions for explaining experimental results. They tested three existing models with different local/global and feedback/feedforward characteristics to see whether they can account for some recent findings on visual crowding. All three models failed to predict the results even qualitatively. Clarke et al. (2014) discuss these model failures within the context of a broader view and suggest that the dichotomies such as feedforward/feedback and local/global may not be useful for scientists designing experiments to understand vision. Bachmann (2014) argues another interesting point. He basically posits that experimental findings that have been proposed to support models of specific top-down re-entrant processing could equally support those with a generic, non-specific feedback loop.
Taken together, the research topic presents a timely addition to the field of vision research and to understanding the functional principles of brain in general. It provides an update on the roles of feedforward and feedback projections in several but not all types of visual processing. For example, an update about the roles of feedforward and feedback projections in motion processing (mostly carried out by the dorsal pathway) is missing. The advent of optogenetics and neuroimaging has provided additional remarkable investigative tools. How these recent techniques will contribute to the prevailing arguments of feedforward and feedback projections in vision is still open. We hope this issue will inspire the readers and act as a catalyst for future work on the issues of feedforward and feedback processes in vision.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We would like to thank all the contributors, reviewers and the Frontiers staff for helping us make this Research topic possible. HK was supported by a Co-Funded Brain Circulation Fellowship (TUBITAK 112C010).
References
Bachmann, T. (2014). A hidden ambiguity of the term “feedback” in its use as an explanatory mechanism for psychophysical visual phenomena. Front. Psychol. 5:780. doi: 10.3389/fpsyg.2014.00780
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Clarke, A. M., Herzog, M. H., and Francis, G. (2014). Visual crowding illustrates the inadequacy of local vs. global and feedforward vs. feedback distinctions in modeling visual perception. Front. Psychol. 5:1193. doi: 10.3389/fpsyg.2014.01193
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Di Lollo, V. (2014). Reentrant processing mediates object substitution masking: comment on Põder (2013). Front. Psychol. 5:819. doi: 10.3389/fpsyg.2014.00819
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Felleman, D. J., and Van Essen, D. C. (1991). Distributed hierarchical processing in the primate cerebral cortex. Cereb. Cortex 1, 1–47. doi: 10.1093/cercor/1.1.1
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Khorsand, P., Moore, T., and Soltani, A. (2015). Combined contributions of feedforward and feedback inputs to bottom-up attention. Front. Psychol. 6:155. doi: 10.3389/fpsyg.2015.00155
Lamme, V. A. F., and Roelfsema, P. R. (2000). The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23, 571–579. doi: 10.1016/S0166-2236(00)01657-X
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Lamme, V. A. F., Supèr, H., and Spekreijse, H. (1998). Feedforward, horizontal, and feedback processing in the visual cortex. Curr. Opin. Neurobiol. 8, 529–535. doi: 10.1016/S0959-4388(98)80042-1
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Layher, G., Schrodt, F., Butz, M. V., and Neumann, H. (2014). Adaptive learning in a compartmental model of visual cortex—how feedback enables stable category learning and refinement. Front. Psychol. 5:1287. doi: 10.3389/fpsyg.2014.01287
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Layton, O. W., Mingolla, E., and Yazdanbakhsh, A. (2014). Neural dynamics of feedforward and feedback processing in figure-ground segregation. Front. Psychol. 5:972. doi: 10.3389/fpsyg.2014.00972
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Petro, L. S., Vizioli, L., and Muckli, L. (2014). Contributions of cortical feedback to sensory processing in primary visual cortex. Front. Psychol. 5:1223. doi: 10.3389/fpsyg.2014.01223
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Põder, E. (2014). The changing picture of object substitution masking: reply to Di Lollo (2014). Front. Psychol. 5:1004. doi: 10.3389/fpsyg.2014.01004
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Rensink, R. A. (2014). Limits to the usability of iconic memory. Front. Psychol. 5:971. doi: 10.3389/fpsyg.2014.00971
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Romeo, A., and Supèr, H. (2014). A feed-forward spiking model of shape-coding by IT cells. Front. Psychol. 5:481. doi: 10.3389/fpsyg.2014.00481
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Silverstein, D. N. (2015). A computational investigation of feedforward and feedback processing in metacontrast backward masking. Front. Psychol. 6:6. doi: 10.3389/fpsyg.2015.00006
Strother, L., and Alferov, D. (2014). Inter-element orientation and distance influence the duration of persistent contour integration. Front. Psychol. 5:1273. doi: 10.3389/fpsyg.2014.01273
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Van Essen, D. C., and Gallant, J. L. (1994). Neural mechanisms of form and motion processing in the primate visual system. Neuron 13, 1–10. doi: 10.1016/0896-6273(94)90455-3
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Wutz, A., and Melcher, D. (2014). The temporal window of individuation limits visual capacity. Front. Psychol. 5:952. doi: 10.3389/fpsyg.2014.00952
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Wyatte, D., Jilk, D. J., and O'Reilly, R. C. (2014). Early recurrent feedback facilitates visual object recognition under challenging conditions. Front. Psychol. 5:674. doi: 10.3389/fpsyg.2014.00674
PubMed Abstract | Full Text | CrossRef Full Text | Google Scholar
Keywords: vision, visual system, feedforward, feedback, mechanisms
Citation: Kafaligonul H, Breitmeyer BG and Öğmen H (2015) Feedforward and feedback processes in vision. Front. Psychol. 6:279. doi: 10.3389/fpsyg.2015.00279
Received: 22 February 2015; Accepted: 25 February 2015;
Published: 12 March 2015.
Edited and reviewed by: Philippe G. Schyns, University of Glasgow, UK
Copyright © 2015 Kafaligonul, Breitmeyer and Öğmen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hulusi Kafaligonul, hulusi@bilkent.edu.tr