Remy Allard
Jocelyn Faubert
Denis G. Pelli- 1Aging in Vision and Action Laboratory, Université Pierre et Marie Curie, Paris, France
- 2Visual Psychophysics and Perception Laboratory, Universiteì de Montréal, Montréal, QC, Canada
- 3Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
Auditory noise is a sound, a random variation in air pressure. More generally, random “noise” can be introduced into any stimulus, including a visual display. Noise added to the stimulus can probe the computations underlying perception of the stimulus. With power and precision, the noise, by restricting the information available, places fundamental constraints on attainable performance and processing strategy. WWII research on radar led to mathematical theorems about detectability of signals in noise, i.e., Signal Detection Theory (Peterson et al., 1954), which allow human performance to be expressed on an absolute scale of efficiency, 0–100% (Tanner and Birdsall, 1958; Pelli and Farell, 1999). Auditory noise revealed the channels of hearing in studies at Bell Labs that characterized how telephone line noise limits perception of speech (Fletcher, 1953). Studies of visual effects of photographic, x-ray, and video noise (reviewed in Pelli, 1981) led to pioneering work with artificially injected noise by Rose (1957), Stromeyer and Julesz (1972), and Solomon and Pelli (1994). Added visual noise has been widely used to characterize the computations underlying various visual tasks (e.g., detection, discrimination, letter and face recognition, search, averaging, selective attention, perceptual learning) in various populations (e.g., older adults, amblyopes, migrainers, dyslexic children). Different kinds of noise probe different aspects of the computation. For instance, spectrally filtered noise is used to determine the frequencies relevant to a given visual task (e.g., letter identification, Solomon and Pelli, 1994). Noise masking of one attribute (e.g., in luminance, color, or texture) can reveal whether another attribute is processed separately (e.g., Gegenfurtner and Kiper, 1992; Allard and Faubert, 2007, 2008). Noise image classification can reveal the visual features the observer uses to perform a visual task (e.g., Eckstein and Ahumada, 2002). Noise is also often used to characterize what limits sensitivity, such as internal noise (Pelli, 1981; Pelli and Farell, 1999; Lu and Dosher, 2008). This Research Topic issue explores effective ways to use noise to probe visual function.
“Noise” in perception experiments generally means unpredictable variation in some aspect of the stimulus. Typically, the stimulus consists of a luminance signal plus an unpredictable noise. Less often, another parameter of the signal, e.g., orientation, varies unpredictably (e.g., Dakin, 1999; Solomon, 2010; Allard and Cavanagh, 2012). Added noise is often white: A random sample, independent and identically distributed, is added to each pixel's luminance. The extent of the noise is restricted, or “localized,” by a window in space and time. The spatiotemporal spectrum of the noise can be restricted by bandpass filtering to a range of orientation and frequency. Added noise that varies across space is sometimes called “pixel noise.” Most of the studies in this Research Topic issue added noise to the signal; two studies randomly jittered parameters of the signal.
In this Research Topic issue, Jeon et al. (2014) added localized white noise to investigate developmental changes in orientation discrimination through childhood. Interpreting their data using the Perceptual Template Model (Lu and Dosher, 2008), to see how the model parameters change with age, they find that increasing age reduces internal additive noise, reduces internal multiplicative noise, and improves external noise exclusion. Using a similar noise paradigm, Chou et al. (2014) find that localized attention facilitated contrast detection due to signal enhancement, whereas object-based attention facilitated detection due to external noise exclusion. Letter identification is mediated by an octave-wide spatial frequency channel (Solomon and Pelli, 1994). Young and Smithson (2014) use spatially bandpass noise to reveal the letter identification channel in the presence of optical distortions, and find changes in the central spatial frequency of the letter-identification channel. Hall et al. (2014) find that adding white noise increased the center spatial frequency of the letter-identification channel for large but not small letters. Using pixel noises with different spectral profiles, Abbey and Eckstein (2014) find that performance approaches that of the mathematical ideal in a free-localization task (i.e., high spatial uncertainty), but is much lower in a fixed-location task (i.e., low spatial uncertainty), indicating that the human detection strategy is well-adapted to free-localization tasks. Gold (2014) use pixel noise to investigate the visual information used by the observer during a size-contrast illusion. By correlating the observers' classification decision with each pixel of the noise stimuli, they find that the spatial region used to estimate the size of the target is influenced by the size of surrounding irrelevant elements. Taylor et al. (2014) use pixel noise both as a target and a mask. The target noise is bandpass-filtered in orientation and spatial frequency, whereas the mask is white noise. They find that information used to detect the target is more optimal in the orientation domain than in the frequency domain, suggesting that observers can adjust the bandwidth of their channels in orientation, but not in spatial frequency.
Several studies examine how visual processing is affected by the extent and bandwidth of applied noise. Baker and Vilidaite (2014) provide EEG evidence that white noise masks have a suppressive gain control effect on neural responses to grating stimuli. Happily, Allard and Faubert (2014b) note that suppressive gain control would not affect threshold measurements in white noise. Studying motion perception, Allard and Faubert (2014a) find similar orientation and direction thresholds with and without temporally extended noise, but greater direction thresholds in temporally localized noise. This shows that the processing strategy underlying motion perception depends on the noise duration. Consistent with previous studies on contrast sensitivity (Allard and Cavanagh, 2011; Allard et al., 2013), they conclude that to measure equivalent input noise of motion processing, noise should be temporally extended (e.g., displayed continually).
Two studies randomly jittered a signal parameter. In an electrophysiological study, Németh et al. (2014) use phase noise, produced by randomizing phases in the Fourier domain, making the stimulus unrecognizable without affecting its spectral energy. Thus, sensitivity to phase noise suggests involvement in recognition. They find that phase-noise amplifies the P1 response to cars in the right hemisphere, but not in the left hemisphere, and that, conversely, phase-noise amplifies the P1 response to faces in the left hemisphere, but not in the right hemisphere. Lidestam et al. (2014) evaluate the effect of informational and energetic auditory noise on visual speechreading. They found that only informational auditory noise (i.e., four-talker babble) interfered with speechreading, which suggests that phonological processing is also involved in speechreading.
In sum, this Research Topic issue shows several ways to use diverse kinds of noise to probe visual processing.
Author Contributions
RA wrote the editorial, which was substantially improved by DP and proof read by JF.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
Thanks to Nick Blauch, Aenne Brielmann, and Xiuyun Wu for helpful comments, and a special thanks to Najib Majaj and Manoj Raghavan. The redaction of this editorial and the organisation of this research topic were supported by ANR-Essilor SilverSight Chair and NSERC-Essilor Industrial Chair.
References
Abbey, C. K., and Eckstein, M. P. (2014). Observer efficiency in free-localization tasks with correlated noise. Front. Psychol. 5:345. doi: 10.3389/fpsyg.2014.00345
Allard, R., and Cavanagh, P. (2011). Crowding in a detection task: external noise triggers change in processing strategy. Vis. Res. 51, 408–416. doi: 10.1016/j.visres.2010.12.008
Allard, R., and Cavanagh, P. (2012). Different processing strategies underlie voluntary averaging in low and high noise. J. Vis. 12:6. doi: 10.1167/12.11.6
Allard, R., and Faubert, J. (2007). Double dissociation between first- and second-order processing. Vis. Res. 47, 1129–1141. doi: 10.1016/j.visres.2007.01.010
Allard, R., and Faubert, J. (2008). First- and second-order motion mechanisms are distinct at low but common at high temporal frequencies. J. Vis. 8, 1–17. doi: 10.1167/8.2.12
Allard, R., and Faubert, J. (2014a). Motion processing: the most sensitive detectors differ in temporally localized and extended noise. Front. Psychol. 5:426. doi: 10.3389/fpsyg.2014.00426
Allard, R., and Faubert, J. (2014b). To characterize contrast detection, noise should be extended, not localized. Front. Psychol. 5:749. doi: 10.3389/fpsyg.2014.00749
Allard, R., Renaud, J., Molinatti, S., and Faubert, J. (2013). Contrast sensitivity, healthy aging and noise. Vis. Res. 92, 47–52. doi: 10.1016/j.visres.2013.09.004
Baker, D. H., and Vilidaite, G. (2014). Broadband noise masks suppress neural responses to narrowband stimuli. Front. Psychol. 5:763. doi: 10.3389/fpsyg.2014.00763
Chou, W.-L., Yeh, S.-L., and Chen, C.-C. (2014). Distinct mechanisms subserve location- and object-based visual attention. Front. Psychol. 5:456. doi: 10.3389/fpsyg.2014.00456
Dakin, S. C. (1999). Orientation variance as a quantifier of structure in texture. Spatial Vis. 12, 1–30. doi: 10.1163/156856899X00012
Eckstein, M. P., and Ahumada, A. J. (2002). Classification images: a tool to analyze visual strategies. J. Vis. 2, 1x. doi: 10.1167/2.1.i
Gegenfurtner, K. R., and Kiper, D. C. (1992). Contrast detection in luminance and chromatic noise. J. Opt. Soc. Am. A 9, 1880–1888. doi: 10.1364/JOSAA.9.001880
Gold, J. M. (2014). Information processing correlates of a size-contrast illusion. Front. Psychol. 5:142. doi: 10.3389/fpsyg.2014.00142
Hall, C. M., Wang, S., Bhagat, R., and McAnany, J. J. (2014). Effect of luminance noise on the object frequencies mediating letter identification. Front. Psychol. 5:663. doi: 10.3389/fpsyg.2014.00663
Jeon, S. T., Maurer, D., and Lewis, T. L. (2014). Developmental mechanisms underlying improved contrast thresholds for discriminations of orientation signals embedded in noise. Front. Psychol. 5:977. doi: 10.3389/fpsyg.2014.00977
Lidestam, B., Holgersson, J., and Moradi, S. (2014). Comparison of informational versus energetic masking effects on speechreading performance. Front. Psychol. 5:639. doi: 10.3389/fpsyg.2014.00639
Lu, Z.-L., and Dosher, B. A. (2008). Characterizing observers using external noise and observer models: assessing internal representations with external noise. Psychol. Rev. 115, 44–82. doi: 10.1037/0033-295X.115.1.44
Németh, K., Kovács, P., Vakli, P., Kovács, G., and Zimmer, M. (2014). Phase noise reveals early category-specific modulation of the event-related potentials. Front. Psychol. 5:367. doi: 10.3389/fpsyg.2014.00367
Pelli, D. G. (1981). The Effects of Visual Noise. Department of Physiology. Cambridge: Cambridge University. Available online at: https://psych.nyu.edu/pelli/pubs/pelli1981thesis.pdf
Pelli, D. G., and Farell, B. (1999). Why use noise? J. Opt. Soc. Am. A 16, 647–653. doi: 10.1364/JOSAA.16.000647
Peterson, W. W., Birdsall, T. G., and Fox, W. C. (1954). The theory of signal detectability. Trans. IRE Prof. Group Inf. Theory 4, 171–212. doi: 10.1109/TIT.1954.1057460
Rose, A. (1957). Quantum effects in human vision. Adv. Biol. Med. Phys. 2, 211–242. doi: 10.1016/B978-1-4832-3111-2.50009-2
Solomon, J. A. (2010). Visual discrimination of orientation statistics in crowded and uncrowded arrays. J. Vis. 10, 1–16. doi: 10.1167/10.14.19
Solomon, J. A., and Pelli, D. G. (1994). The visual filter mediating letter identification. Nature 369, 395–397. doi: 10.1038/369395a0
Stromeyer, I. I. I. C. F., and Julesz, B. (1972). Spatial-frequency masking in vision: critical bands and spread of masking. J. Opt. Soc. Am. 62, 1221–1232. doi: 10.1364/JOSA.62.001221
Tanner, W. P. Jr., and Birdsall, T. G. (1958). Definitions of d' and η as psychophysical measures. J. Acoust. Soc. Am. 30, 922–928. doi: 10.1121/1.1909408
Taylor, C. P., Bennett, P. J., and Sekuler, A. B. (2014). Evidence for adjustable bandwidth orientation channels. Front. Psychol. 5:578. doi: 10.3389/fpsyg.2014.00578
Keywords: noise, equivalent input noise, linear amplifier model, perceptual template model, noise image classification, bandpass noise, contrast jitter, phase noise
Citation: Allard R, Faubert J and Pelli DG (2015) Editorial: Using Noise to Characterize Vision. Front. Psychol. 6:1707. doi: 10.3389/fpsyg.2015.01707
Received: 05 October 2015; Accepted: 22 October 2015;
Published: 16 November 2015.
Edited and reviewed by: Philippe G. Schyns, University of Glasgow, UK
Copyright © 2015 Allard, Faubert and Pelli. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Remy Allard, remy.allard@inserm.fr