Skip to main content

ORIGINAL RESEARCH article

Front. Comput. Neurosci., 27 March 2018

The Importance of Spatial Visual Scene Parameters in Predicting Optimal Cone Sensitivities in Routinely Trichromatic Frugivorous Old-World Primates

  • 1Centre for Intelligent Sensing, Queen Mary University of London, London, United Kingdom
  • 2School of Life Sciences, University of Sussex, Brighton, United Kingdom
  • 3School of Biological and Chemical Sciences, Queen Mary University of London, London, United Kingdom
  • 4Institute for Advanced Study, Berlin, Germany

Computational models that predict the spectral sensitivities of primate cone photoreceptors have focussed only on the spectral, not spatial, dimensions. On the ecologically valid task of foraging for fruit, such models predict the M-cone (“green”) peak spectral sensitivity 10–20 nm further from the L-cone (“red”) sensitivity peak than it is in nature and assume their separation is limited by other visual constraints, such as the requirement of high-acuity spatial vision for closer M and L peak sensitivities. We explore the possibility that a spatio-chromatic analysis can better predict cone spectral tuning without appealing to other visual constraints. We build a computational model of the primate retina and simulate chromatic gratings of varying spatial frequencies using measured spectra. We then implement the case study of foveal processing in routinely trichromatic primates for the task of discriminating fruit and leaf spectra. We perform an exhaustive search for the configurations of M and L cone spectral sensitivities that optimally distinguish the colour patterns within these spectral images. Under such conditions, the model suggests that: (1) a long-wavelength limit is required to constrain the L cone spectral sensitivity to its natural position; (2) the optimal M cone peak spectral sensitivity occurs at ~525 nm, close to the observed position in nature (~535 nm); (3) spatial frequency has a small effect upon the spectral tuning of the cones; (4) a selective pressure toward less correlated M and L spectral sensitivities is provided by the need to reduce noise caused by the luminance variation that occurs in natural scenes.

1. Introduction

Young's (1802) trichromatic theory of colour vision recognises that the retina must compromise between spectral and spatial sampling of the optical image. The implications of the dual function for the retina remain to be fully explored, but there is much diversity amongst vertebrates in both photoreceptor spectral sensitivities and their spatial layout, which may depend both on retinal physiology and visual ecology (Osorio and Vorobyev, 2005). Primate trichromacy is of particular interest because of the uneven spectral distribution of the S, M, and L cones (at 440, 535, and 562 nm, respectively; Stockman and Sharpe, 2000; Surridge et al., 2003), the apparently random arrangement of L and M cones in varying ratios (Mollon and Bowmaker, 1992; Bowmaker et al., 2003), and the fact that both L and M cones contribute to the luminance mechanism.

Most accounts of primate trichromacy evaluate colour discrimination for tasks such as finding food without regard to the spatial layout of the cones (Mollon, 1989; Osorio and Vorobyev, 1996; Regan et al., 1998; Sumner and Mollon, 2000a; Dominy and Lucas, 2001; Lewis and Zhaoping, 2006; Melin et al., 2013). Generally, these studies predict the optimal value of λmaxM closer to λmaxL than to λmaxS, but, nonetheless, at a wavelength 10–20 nm shorter than its actual value of 535 nm. To account for the disparity between the observed and predicted values of λmaxM it is sometimes proposed that the spectral separation of the L and M pigments is limited by the costs to spatial vision of having spectrally separated inputs to the luminance system (Mollon, 1989; Williams et al., 1991; Nagle and Osorio, 1993; Osorio et al., 1998; Rucker and Osorio, 2008). If there is indeed a trade-off between spatial and chromatic coding in natural images, one might speculate that the observed value of λmaxM corresponds to the optimal compromise to the problem recognised by Young (1802).

Psychophysical experiments comparing trichromats with dichromats that lack either M or L cones would support a trade-off of spatial and colour vision if the trichromats demonstrated inferior luminance vision due to the decorrelation of their M and L cone spectral sensitivities. Dichromats have been shown to have a foraging advantage under certain conditions, such as laboratory experiments (Jägle et al., 2006; Janáky et al., 2014), low-light (Caine et al., 2010), and discovering colour-camouflaged insects (Melin et al., 2007, 2010). However, single-cell recordings from the lateral geniculate nucleus of dichromatic and trichromatic marmosets suggest that the evolution of red-green colour vision has not come at a cost for spatial vision (Martin et al., 2011). Therefore, it appears that while there is a trade-off between spatial and chromatic vision, it is not pervasive across viewing scenarios, and its cause at a neural level has not yet been identified.

What is missing from previous models that predict the optimal cone spectral sensitivities is a consideration of spatio-chromatic signals that takes account of how the trichromatic eye encodes coloured patterns. Models of purely spectral coding (e.g., Osorio and Vorobyev, 1996), generally overlook the consequences of the spatial properties of the receptor array, and the fact that colour vision has to locate small objects, such as fruit amongst leaves, despite its relatively poor spatial acuity (Mullen, 1985; but see: Párraga et al., 2000, 2002). Our goal is to determine whether the optimal primate spectral sensitivities can be better predicted via a spatio-chromatic analysis than via a purely spectral analysis that does not consider spatial dimensions. We follow conventional understanding in assuming that the primate colour vision system has three main components (Mollon, 1989; Regan et al., 2001): the luminance system, which benefits from closer λmaxM and λmaxL; the blue-yellow opponent system, which benefits from large separation of λmaxS from λmaxM and λmaxL, and the red-green opponent system, which is a relatively recent evolutionary innovation unique to primates.

Primates include a diverse range of visual phenotypes, including dichromats, polymorphic trichromats and routine trichromats (for an extensive review, see Surridge et al., 2003). The model presented in this paper is intended to be a general model of primate retinal processing for spatio-chromatic spectral sensitivity prediction in primate/mammalian species. We use the case study of catarrhines foraging for fruit to guide model parameter settings. In addition to the peak sensitivities mentioned above, we make the following assumption: the catarrhine foveola is the key retinal region underlying red-green spatio-chromatic vision (Martin et al., 2011), so the greatest influence on spectral tuning can be captured by modelling only L and M cones because these are the majority, if not sole, photoreceptor class in the foveola (Ahnelt and Kolb, 2000), and only the single-cone centre midget retinal ganglion cells (Lennie et al., 1991). We refer to this model as a “parvocellular” model, though it does not include the P cells of the LGN.

We develop a computational spatio-chromatic model of the primate retina and implement the case study of the catarrhine foveola and foraging for fruits. We use the model to predict performance as a function of M and L cone spectral sensitivities under various conditions, then relate the model predictions to observations of photoreceptor spectral tuning. We test the model on databases of simulated spectral images, produced by placing recorded spectra of fruit and leaves into grating patterns. Given a physiologically realistic retina model which spatio-chromatically predicts the optimal M and L cone spectral sensitivities, we perform four sets of simulations to address the following questions: (i) How does varying the set of spectra used to model the visual environment affect the predicted M and L spectral sensitivities? (ii) Is a long-wavelength limit required to constrain the L cone spectral sensitivity to its observed position? (iii) Can better predictions of the optimal spectral sensitivities be achieved by a spatio-chromatic analysis than a purely spectral analysis? (iv) Does the variation in luminance that occurs across the spatial dimensions in natural scenes affect the optimal position of the M cone spectral sensitivity?

2. Model

We build a computational model of the retinal aspects of the primate parvocellular channel to determine the performance of all λmaxM and λmaxL combinations for the task of detecting patterns composed of fruit and leaf spectra. We use datasets of two-colour grating patterns containing fruit or leaf spectra at each pixel: the spatio-chromatic challenge is to discriminate regions of one class (material) from those of the other. To investigate the effects of spatial frequency on spectral sensitivity tuning, we run separate simulations on gratings at a range of spatial frequencies.

Figure 1 presents the neural systems included in our model of parvocellular processing for the red-green and luminance systems. Figure 2 presents the full processing pipeline, with the neural systems inside the central light grey box. The model produces a performance score, zj, for each spectral sensitivity pair (λmax,jM,λmax,jL), by testing the ability of (λmax,jM,λmax,jL) to spatio-chromatically distinguish fruit and leaf regions across a database of spectral images. A spectral image is an image of size Nx × Ny × Nλ, where Nx and Ny are the sizes of the horizontal and vertical spatial dimensions, and Nλ is the number of wavelength samples in the spectral dimension. Only two spectra—one fruit and one leaf—are used to build each spectral image.

FIGURE 1
www.frontiersin.org

Figure 1. The neural systems included in the model. The visual scene is a section of a chromatic grating, with the spatial dimensions marked as x and y, and the spectral dimension marked as λ. The quantal catches of the M and L cone photoreceptors are illustrated as green and red circles, respectively, and the cones are randomly arranged in the photoreceptor mosaic. The retinal ganglion cell receptive fields are shown as yellow concentric circles, with the approximate weighting of the cones depicted as greyscale circles and the + and − indicating whether the sub-unit (centre or surround) is ON or OFF. The centres take input from only a single cone, while the surrounds take input from multiple cones and do not discriminate between M and L types; the size of the receptive fields is approximate for 3 standard deviations. We assume that the cortex can learn the centre identity of retinal ganglion cells (Wachtler et al., 2007), which we represent here as a separation of ON-centre signals into L-ON-centre and M-ON-centre signals, and OFF-centre signals into L-OFF-centre and M-OFF-centre signals. Both L-ON-centre and M-OFF-centre are excited when the L cones in their receptive fields are relatively more active than the M cones, so their combination (a matrix summation) gives the final red-green signal, which holds high values in red regions, low values in green regions, and gives complete coverage of the scene. Similarly, the luminance signal is formed by a combination of L-ON-centre and M-ON-centre signals. The design of this model was inspired by that presented in Stockman et al. (2014).

FIGURE 2
www.frontiersin.org

Figure 2. Pipeline of our retina model. The dark grey box represents a loop over all spectral sensitivity pairs. The light grey box represents a loop over all spectral images (and is the biological model, as depicted in Figure 1). For a given pair of peak sensitivities (λmax,jM, λmax,jL), an M and an L cone spectral sensitivity is created. These are then assigned to the M and L positions in mosaic A to produce spectral sensitivity mosaic Cj. A given spectral image, Pi, is then presented to the system and the quantal catch matrix, Qij, is calculated. The retinal ganglion cell (RGC) layer performs colour opponent processing (via centre-surround opponent receptive fields) to create a matrix of OFF-centre RGC responses, GijOFF, and a matrix of ON-centre RGC responses, GijON. In the Channel integration block, the GijON and GijOFF matrices are split into LijON, MijON, LijOFF, and MijOFF matrices via the cone-type identifier matrices, L and M. The red-green signal is then created as Oij = LijON+MijOFF and the luminance signal as Oij = LijON + MijON. This concludes the biological model. The remaining block produces a measure, zj, of performance of the jth spectral sensitivity pair via comparison of Oij or Oij with the reference pattern, P¯.

2.1. Spectral Sensitivity Mosaic Creation

We simulate a spatio-spectral photoreceptor mosaic, C, of size Nx × Ny × Nλ by assigning a cone spectral sensitivity of length Nλ in each location of an Nx × Ny spatial mosaic. Let (λmax,jM,λmax,jL) be the jth pair of peak sensitivity values drawn from a database of Ns pairs. Let A = (axy)Nx × Ny be a matrix describing the spatial arrangement of M and L cones, where the elements are cone type labels: axy ∈ {M, L}. Let ψ(λ,λmax,jaxy) be a function that returns the value at wavelength λ of a spectral sensitivity with peak sensitivity at λmax,jaxy. To build the spatio-spectral mosaic for the jth spectral sensitivity pair, we extend the formulation in Sumner and Mollon (2000b) to include spatial dimensions as:

Cj(x,y,λ)=10Δ(λ)ψ(λ,λmax,jaxy) ,    (1)

where x and y are the cone (pixel) coordinates; λ is wavelength sampling positions drawn from the Nλ-length vector of all wavelength sampling positions, Λ; and Δ(λ) gives the combined wavelength-dependent optical densities of the lens and macular pigment at wavelength λ. Thus, Equation (1) gives the spectral sensitivity at wavelength λ of a cone of type axy (either M or L), adjusted to account for the ocular media.

2.2. Quantal Catch

To simulate viewing of the scene, we present the system with a spectral image, Pi, of the same spatial and spectral dimensions as Cj (Nx × Ny × Nλ) and follow previous works (Kelber et al., 2003) by calculating quantal catch at each spatial location to produce an Nx × Ny quantal catch matrix, Qij, where:

Qij(x,y)=λΛPi(x,y,λ)Cj(x,y,λ).    (2)

It is assumed that the illuminant is already included with the spectral image. Notice that Equation (2) does not discriminate between cone types, so matrix Qij contains the quantal catches of both M and L cones.

2.3. Receptive Field Creation

We model the opponent processing of retinal ganglion cells (RGCs) as Difference of Gaussians (Soodak, 1986). Let WON be an ON-centre OFF-surround receptive field and WOFF be an OFF-centre ON-surround receptive field. Each of these is formed as a two-dimensional circularly symmetrical Difference of Gaussians. Because of the symmetry, we define a 2D Gaussian, N(μ, σ), using a scalar mean, μ, and scalar standard deviation, σ, as:

N (μ, σ)=exp ( ( (xμ)2+ (yμ)22σ2)).    (3)

The two receptive fields can then be defined as sums of zero-mean Gaussians with different standard deviations, as:

  WON=N(0,σc)ωN(0,σs),WOFF=WON,    (4)

where σc and σs are the scalar standard deviations of the centre and surround Gaussians, respectively, and ω allows the sensitivity of the surround receptive field to be adjusted with respect to that of the centre.

Note that the receptive field does not discriminate between cone types, so this is a non-selective receptive field model. In order to achieve colour opponency, the centre must have high cone purity (draw input predominantly from one cone type). In the present work, we only model the single-cone centres of RGCs in the foveola, so cone purity of centres is 100%.

2.4. Opponent Processing

Next, we model the opponent processing of the ON-centre and OFF-centre RGCs. It is likely that midget RGCs cannot discriminate between L and M cones (Paulus and Kroger-Paulus, 1983; Benson et al., 2014), so let all ON-centre RGC responses be held in a Nx × Ny matrix, GijON. Moreover, let GijOFF be an equivalent matrix of OFF-centre RGC responses. These are computed as:

  GijON = QijWON,GijOFF = QijWOFF,    (5)

where * represents the convolution operation. Notice that both cone types (M and L) in Qij are involved in the convolution; i.e., this is a model of non-selective RGC centres and surrounds, so colour opponency is achieved by the fact that the centre contains only a single cone—the spectral sensitivity of the single-cone centre is exactly the same as that of its single cone, while the spectral sensitivity of the surround is a mixture of the spectral sensitivities of M and L cones.

The convolution operation in Equation (5) produces Nw − 1 pixels that incur border effects in GijON and GijOFF, where Nw is the length of each dimension of the window containing the receptive field. These are artefacts, they are removed prior to measuring performance.

2.5. Cone-Type Identifier Matrix Creation

The quantal catches of both cone types are contained within the same matrix, Qij, but subsequent steps treat M and L cones differently. From the given photoreceptor mosaic, we create two logical matrices, L and M, which act as pointers to cones of their respective type in Qij, as:

       L=(lxy)Nx×Ny,   lxy={0if axy=1if axy=,     M=(mxy)Nx×Ny, mxy=1lxy.    (6)

2.6. Channel Integration

We now have two matrices of RGC responses: GijON contains both L ON-centre and M ON-centre (we will refer to these as LijON and MijON) responses, and GijOFF contains both L OFF-centre and M OFF-centre (LijOFF and MijOFF) responses. To build a red-green signal, we require: (i) only the RGCs that are excited by “reddish” stimuli; (ii) RGCs with both M and L centre so as to achieve full coverage of the scene. These two conditions are met by LijON and MijOFF. Assuming the cortex can learn RGC centre identities from the statistics of their activations (Wachtler et al., 2007), then LijON=LGijON and MijOFF=MGijOFF. So, the red-green matrix of outputs to the cortex, Oij, is calculated as:

Oij=LGijON+MGijOFF.    (7)

Similarly, the luminance signal, Oj, is a combination of L and M centre RGC signals for full scene coverage, but only those with ON-centre receptive fields (which is equivalent to GijON). This is calculated as:

Oij=LGijON+MGijON=GijON.    (8)

Note that the matrices Oij and Oij are inputs to the cortex; therefore, no attempt has been made to model the spatial integration that is thought to occur in the cortex, but for which the mechanism has not yet been revealed (Solomon and Lennie, 2007).

3. Settings for the Parvocellular Channel

This section explains the parameter settings of the simulations. We first specify the parameter settings of the biological model, including the photoreceptor mosaic, spectral sensitivities and receptive fields. Following this, we describe the creation of the database of spectral images, and finish by describing the performance measure.

3.1. Animal Model

Ideally, we would use the parameter settings (e.g., focal length, transmission of optical media) of trichromatic primates at the time when they diverged from dichromats. However, such information is not available. Unless otherwise stated, we use humans as models since the data is more comprehensive than for other species, and, where comparisons have been made, values tend to be similar across primate species (Cooper and Robson, 1969; Snodderly et al., 1984; Tovée et al., 1992).

3.2. The Photoreceptor Mosaic

For computational convenience, we model the photoreceptor mosaic as a square grid (Benson et al., 2014). This is a simplification of the hexagonal grid found in the primate eye (Hofer et al., 2005) that eases the computation and description, but does not affect our results because within one simulation we compare all spectral sensitivity pairs on exactly the same mosaic. For convenience and efficiency, we model one cone as equal in size to one pixel. In the human fovea, the minimal centre-to-centre spacing of cones is 1120 degrees visual arc, or 2.5 μm (Wandell, 1995), so we define one pixel as 1120×1120 degrees visual arc.

To demonstrate the advantage of spatio-chromatic modelling to estimate optimal spectral sensitivity tuning, we focus upon the spectral tuning of the cones that underlie the red-green system. For this reason, we only model the central region of the primate foveola, which contains no S cones. In humans, the S-cone-free region is around 20/60 degrees across (100 μm, or 40 cones) (Bumsted and Hendrickson, 1999), though it is smaller in macaques, at around 9/60 degrees across (45 μm, or 18 cones) (de Monasterio et al., 1985). However, varying the size of the mosaic does not affect any calculations, so we do not strictly limit ourselves to the size found in nature. Instead we choose the horizontal and vertical photoreceptor mosaic dimensions, Nx and Ny, to match the size of the spectral images.

For the L:M ratio of the photoreceptor mosaic, we use 1:1. This ratio has been observed as average in most non-human primates (Mollon and Bowmaker, 1992), so we assume the earliest trichromatic ancestor was similar. Though large variation has been observed in this ratio (Deeb et al., 2000), we do not include this in our simulation because it is not clear whether this variation existed in the earliest primate that evolved trichromacy and it is also not yet clear what mechanisms assure similar colour vision performance across different L:M ratios (Brainard et al., 2000).

To assign cone identities to the mosaic, let A = (axy)Nx × Ny be the photoreceptor mosaic, and axy ∈ {M, L} be the cone identity at pixel (x, y). In the primate retina, L and M cones have a locally random arrangement (Mollon and Bowmaker, 1992). Thus, we randomly assign each axy with a 0.5 chance to be M, otherwise it is L.

3.3. Spectral Sensitivities

For the combined wavelength-dependent optical densities of the lens and macular pigment, Δ, we follow Sumner and Mollon (2000a) in using those of humans, as given in Wyszecki and Stiles (1982). For the function which generates the spectral sensitivities from the peak sensitivities, ψ(·, ·), we use the peak wavelength-dependent nomogram described in Stockman and Sharpe (2000) and the resulting absorbance curves are converted to absorptance curves.

3.4. Receptive Fields

The size of the receptive fields is chosen to match that in the primate fovea in having a single cell centre (Calkins and Sterling, 1996), which is achieved by σc = 0.25 cones (95% of the volume of a Gaussian falls within 2 standard deviations either side of the mean, and 4σc = 1). The size of the surround is determined from the centre-to-surround ratio as: σcs = 0.15 (Croner and Kaplan, 1995), which yields σs = 1.66 cones (95% of the Gaussian is covered by a diameter of 4σs = 6.67 cones). Nw, the length of each dimension of the window that contains the receptive field, is set to 9 cones. This accommodates slightly less than three standard deviations each side of the mean (6σs = 9.96), but allows us to keep a single cone in the centre of the window. For our fixed receptive field size, we verified that this window size did not influence results by running a comparison test with Nw = 11 cones and observed no difference in the results. It has been shown that the relative sensitivities of centre and surround are highly variable from cell to cell, but that the sensitivity of the surround is, on average, 55% weaker than that of the centre (Croner and Kaplan, 1995). We use this average value by setting ω = 0.55.

3.5. Spectral Image Database

We use grating patterns rather than images of natural scenes because this allows us to vary spatial frequency in a well-defined manner. To emulate the sinusoidal gratings commonly used in psychophysical studies (Mullen, 1985; Brainard et al., 2008; Lee et al., 2012), we create two-colour grating patterns containing ecologically valid reflectance spectra in each pixel (spectral images). Each spectral sensitivity pair's performance is measured as its ability to maximise the distinctiveness of the spatial pattern; i.e., the sinusoidal grating. The highest spatial frequency used is 4 cycles per degree, as it has been shown that significant chromatic aberration affects the retinal image at spatial frequencies above 4 cycles per degree (Flitcroft, 1989). The exact spatial frequencies, in cycles per degree, are {4, 2, 1, 0.5}, which equates to {30, 60, 110, 222} cones (1 cone = 1 pixel) per cycle, or {1560,3060,5560,11160} degrees visual arc, respectively. The creation of a spectral image is demonstrated in Figure 3, and other spectral images vary in the spatial frequency of the grating (A), the fruit spectrum (B), and the set of luminance coefficients (D).

FIGURE 3
www.frontiersin.org

Figure 3. Creation of a spectral image. (A) The reference pattern, P¯, is a 2D matrix in which the black and white pixels represent leaf and fruit positions, respectively. The axis dimensions are in pixels, and 1 pixel = 1 cone = 1/120 degrees visual arc. This example grating is 4 cycles per degree (15 pixels per bar). (B) Example spectra of a fruit (red) and leaf (green). (C) A 3D matrix is created by placing a leaf spectrum in the wavelength (λ) dimension in each black pixel in the reference pattern, a fruit spectrum in each white pixel and a weighted mixture at the grey pixels. The colours are for convenience and to match those used for the spectra in (B). Though not shown, the illuminant is applied to each spectrum at this step. (D) The coefficients used to model luminance variation are contained in a 2D matrix of the same dimensions as P¯. (E) luminance variation is included in the 3D image by multiplying all values in the λ dimension by the coefficient in the respective (x,y) pixel position. (F) The point-spread function (PSF) of the lens is different at each wavelength. The blue and red lines show cross-sections of the PSF at 400 and 700 nm, respectively, and for all other wavelengths the PSF is between these extremes. (G) The spectral image, Pi, is completed by convolving each wavelength layer with its respective PSF.

All spectral images in one simulation use the same spatial pattern: P¯ = (p¯xy)Nx×Ny,p¯xy[0, 1], which is also used as the reference pattern with which the model outputs are compared. For each simulation, we create the database of spectral images, PiNx×Ny×Nλ, i=1,2,,Nf. Let siNλ be the ith target spectrum in the database of Nf target spectra, and let sbNλ be the mean of all background leaf spectra. For each pixel position (x, y) in Pi, the spectrum is composed from the target and background incident spectra, si and sb, as  p¯xysi+(1- p¯xy)sb.

The spectra are taken from the Cambridge database of natural spectra (Regan et al., 1998; Sumner and Mollon, 2000b), which contains a variety of spectra recorded from fruits eaten by several primate species, and mature leaves from the same environments. The spectra are provided at 4 nm sampling intervals, and we truncate them to the primate visual range of 400–700 nm, so Nλ = 76 and Λ = {400, 404, 408, …, 700}. The number of images in the database matches the number of spectra in the Cambridge database: Nf = 1139 fruits. Note that each spectral image, Pi, is created from only two spectra: one target and one background, where the background spectrum is always the mean of all (409) mature leaves, as has been done in previous work (Chittka and Menzel, 1992; Osorio and Vorobyev, 1996). We also tested using randomly selected background leaf spectra in each pixel rather than the mean, but this had no effect on the results. For one set of simulations, we use spectra of Munsell chips (Parkkinen et al., 1989). In this case, there is no constant background spectrum for all images. Instead, for each image, we draw two spectra from the dataset randomly and without replacement.

Prior to building the images, the illuminant was added to all spectra as: s = is′, where s′ is the original spectrum, iNλ is the illuminant, and ⊙ is the element-wise multiplication operator. We tested using three different illuminants: the D65 standard illuminant and two for forest areas in French Guiana and Uganda. We found that all three illuminants resulted in the same set of optimal spectral sensitivities, and so have selected to present only the results produced using the Ugandan forest illuminant from the Cambridge dataset (Regan et al., 1998; Sumner and Mollon, 2000b).

In natural scenes, there is far more variance in luminance compared to chromaticity (Ruderman et al., 1998; Wachtler et al., 2001), mainly due to the effects of shadows. Such effects are characterised as multiplicative factors on the reflected spectrum (Rubin and Richards, 1982). Though natural scenes may also contain some additive effects due to reflectance, we assume that these would be small enough to be negligible, as the specularities they cause would only occur when the surface was at a certain angle relative to the eye, and the animal could move its head to change this. Therefore, we do not include any additive reflectance effects. We included luminance variation by creating greyscale images which capture the 1/f power spectrum typically observed in natural images (Field, 1987; Billock, 2000; Millane et al., 2003), where f is the spatial frequency, and then using the pixel values as coefficients for the spectra in our images (1/f noise is also known as Pink noise). We used a set of 49 natural leafy scenes gathered from an internet search with the constraints that the images must contain only leaves, branches and sky, with branches and sky being minimal. These images were all converted to greyscale. We then performed a Fast Fourier Transform (FFT) on each image and used the median in each pixel value to create average magnitude and phase images. We verified that the resulting power spectrum was a close fit with the 1/f slope, then these median values were transformed back into the spatial domain via inverse FFT. An example luminance coefficient image is shown in Figure 3D.

The wavelength-dependent refractive effect of the lens is, strictly, a part of the biological model rather than the image model. However, as this is constant across all images and regardless of the cone spectral sensitivities, we include it in the spectral images. To account for the refractive effect of the lens, we apply a pixelwise point-spread function to all spectral images by convolving each wavelength layer of the spectral images with a wavelength appropriate Airy disk. The Airy disk is created using the data available for humans: lens refractive index = 1.406 (Garner et al., 1998), focal length = 21.3 mm (Van Norren and Tiemeijer, 1986), pupil diameter = 5 mm (Liang and Williams, 1997), and for each wavelength λ ∈ Λ. The line spread functions for the shortest and longest wavelengths we use, λ = 400 nm and λ = 700 nm, are shown in Figure 3F.

Vertical image size is Ny = 30 cones (pixels). Horizontal image size, Nx, is dependent on spatial frequency, such that each image contains two cycles of the sinusoidal grating. Specifically, this gives Nx ∈ {60, 120, 220, 444} cones (pixels).

3.6. Performance Measure

We measure the ability of each peak sensitivity pair (λmax,jM,λmax,jL), to facilitate the discrimination of chromatic gratings. We make the assumption that the cortical cells receiving input from the parvocellular channel attempt to estimate the input image (Manning and Brainard, 2010). The jth peak sensitivity pair's estimate of the ith image is stored in matrices of outputs to the cortex: Oij for the red-green signal and Oij for the luminance signal. Moreover, as we simulate the spectral images, the reference pattern, P¯, is known, so the performance is measured as the similarity between the reference pattern and the matrices of outputs to the cortex. Here, we will describe how the performance measure is calculated for the red-green signal by comparison of Oij and P¯. Performance of the luminance signal is measured in the same manner—simply replace Oij with Oij and zj with zj.

After finding Oij for all i = 1, 2, …, Nf images, we compare them all with the reference pattern, P¯, and produce a single measure of the performance, zj, of spectral sensitivity pair j. Values in P¯ vary from 1 in target locations to 0 in background locations, while Oij contains positive values in cells which are redder than their local neighbourhood (determined by the size of the receptive field surround) and negative values in cells which are greener than their local neighbourhood. To ensure Oij and P¯ are in the same range, we normalise Oij to [0, 1] prior to the comparison. As all spectral images in one simulation have the same spatial pattern, P¯ is the same for all Pi. To measure the similarity between a single Oij and P¯, we use the Peak Signal-to-Noise Ratio, which is commonly used in image processing for comparing a reference and filtered image (Drew and Bergner, 2007). Its calculation is based upon Mean Square Error, but taking into account the maximal possible signal power. As such, this performance is maximal for the spectral sensitivity pair that causes the greatest mean distance in red-green space between all fruits and the background leaves. The performance measure, zj, is calculated as:

zj = i = 1NfPSNR(Oij,P¯)Nf,    (9)

where PSNR(·, ·) is the is the Peak-Signal-to-Noise Ratio of the two arguments, defined as:

PSNR (Oij,P¯)=10 log10peakval2 MSE (Oij,P¯),    (10)

where MSE(Oij,P¯) is the Mean Square Error of its two arguments. In Equation (10), peakval = 1 is the peak value that the signal can take, and the logarithm converts the result to decibels. The spatial performance is implicit because the red-green value at a given location in Oij is a function of the activations of all cones in a local neighbourhood (determined by the size of the RGC receptive field). Oij will contain noise which arises because: (i) the receptive field surrounds synapse both M and L cones (they are non-selective), and the ratio of L:M cones differs from surround to surround due to the random mosaic arrangement; (ii) the luminance variation can cause the activations of the cones stimulated by the spectra of the same material to be less correlated than cones stimulated by the spectra of different materials, particularly for very similar spectra. Noise of the first type should be minimised by smaller λmaxL-λmaxM, while noise of the second type will favour some separation, with the amount being dependent upon the nature of the spectra. The best performing spectral sensitivity pair is the one that maximises the chromatic signal described by P¯ while minimising noise.

4. Results

We address four questions: (i) How does varying the set of spectra used to model the visual environment affect the predicted M and L spectral sensitivities? (ii) Is a long-wavelength limit required to constrain the L cone spectral sensitivity to its observed position? (iii) Can better predictions of the optimal spectral sensitivities be achieved by a spatio-chromatic analysis than a purely spectral analysis? (iv) Does the variation in luminance that occurs across the spatial dimensions in natural scenes affect the optimal position of the M cone spectral sensitivity?

The search parameters for the four sets of simulations are given in Table 1 and described in detail below. Random photoreceptor mosaics were used in all simulations. As this causes some variation in the resulting optimal peak sensitivities, all simulations were repeated multiple times with differently seeded mosaics. One “set” of simulations includes all simulations for the different spatial frequencies of 4, 2, 1 and 0.5 cycles per degree. Our primary focus is the red-green system, but in the Optimal λmaxM simulations, we also provide results for the luminance system to illustrate the relative superiority of the red-green system on the fruit foraging task.

TABLE 1
www.frontiersin.org

Table 1. Search parameters for the four sets of simulations.

4.1. Varied Spectra Simulations

We aim to determine whether a spatio-chromatic parvocellular channel model will predict highly overlapping M and L spectral sensitivities even if a spectrally rich model of the environment is used. This is a control to ensure that the spatio-chromatic model is not biased toward predicting spectral sensitivities similar to those found in primates. We use a database of spectra of Munsell chips (Parkkinen et al., 1989) to create the spectral images, vary both spectral sensitivities over the range: λmax,jM,λmax,jL{490, 500, 510, , 550, 560}, and apply the constraint λmax,jLλmax,jM. Each simulation is repeated 50 times on differently seeded random mosaics.

The results show that discrimination performance increases the more separated λmaxM and λmaxL become, as shown in the performance plot in Figure 4A. Accordingly, the optimal peak spectral sensitivities are: λmaxM= 490 nm and λmaxL= 560 nm. Performance plots at all spatial frequencies were qualitatively similar, so only the result for 4 cycles per degree gratings is shown.

FIGURE 4
www.frontiersin.org

Figure 4. Performance plots for all pairs of peak sensitivities using spectral images created from spectra of (A) Munsell chips of wide variety of colours, and (B) fruit and leaves. The performance of each pair of peak sensitivities is represented by a colour: blues are low performance, reds are high performance (performance is z score (Equation 9) normalised to [0,1] for display purposes). On each dataset, the plots at all spatial frequencies were highly similar, so only those for 4 cycles per degree gratings are shown. In (B), we highlight the absolute optimal peak sensitivity pair (black triangle) and the long wavelength limited (λmaxL 562 nm) optimal peak sensitivity pair (black circle).

4.2. Long-Wavelength Limit Simulations

We aim to determine whether a spatio-chromatic model requires a long-wavelength limit of λmaxL 562 nm to constrain the L cone spectral sensitivity to its observed position, rather than a longer wavelength. We assume the task is foraging for fruit and perform an exhaustive search where both peak sensitivities, λmaxM and λmaxL, vary. We apply the constraint that λmaxLλmaxM. The minimum and maximum of 490 and 598 nm cover the range over which mammal LWS opsins exist (Jacobs, 2009), with an additional ~40 nm in the longwave direction to investigate whether the optimal L cone peak would lie at a longer wavelength than found in nature if no biological constraints applied, i.e., λmax,jM,λmax,jL{490, 494, 498, , 594, 598}. Each simulation is repeated 50 times on differently seeded random mosaics.

The results are presented in Figure 4B. The performance plots at all spatial frequencies were qualitatively similar, so only the result for 4 cycles per degree gratings is shown. On all simulations, λmaxL occupies the longest wavelength possible, and for any given λmaxM, performance is always better if λmaxL> 562 nm. When both λmax are at relatively short wavelengths (i.e., when the mean of the two is shorter than ~540 nm), discrimination performance is lower than the nearest configuration for which λmaxM=λmaxL (at which point this ceases to be a red-green signal and becomes a luminance signal). The absolute optimum configuration occurs at λmaxL= 598 nm and λmaxM= 521.6 nm, whereas when the long-wavelength limit is applied, the optimum λmaxM is 525.8 nm. The extreme optimal λmaxM on individual runs were 518 and 526 nm—this variation is due to the random “seeding” of the photoreceptor mosaic between simulation repetitions and, to a lesser degree, of the luminance coefficients between images. These results guided us to limit the search range for subsequent simulations sets to 515 λmaxM 535 nm in 1 nm increments and λmaxL= 562 nm (discrimination performance is always better for λmaxL at longer wavelengths, so this is equivalent to λmaxL 562 nm).

4.3. Optimal λmaxM Simulations

We aim to determine whether the optimal position of the M cone spectral sensitivity is more accurately predicted by a spatio-chromatic analysis than by a purely spectral analysis in which spatial dimensions are not considered. We assume the ecological task of foraging for fruit, as this facilitates comparison with the purely spectral analyses of previous works (Osorio and Vorobyev, 1996; Regan et al., 1998; Sumner and Mollon, 2000a; Lewis and Zhaoping, 2006). We use the results of the long-wavelength limit simulations to limit our search space, thereby facilitating a higher-resolution (smaller increment between λmax positions) search. As λmaxL always occupies the longest wavelength available, fixing λmaxL= 562 nm is equivalent to λmaxL 562 nm. The search interval is reduced to 1 nm, and we increase the number of repetitions with differently seeded mosaics to 100. As our model produces both red-green and luminance signals that are sent to the cortex, we also demonstrate the spatio-chromatic advantage of the red-green system over the luminance system for the task of fruits foraging.

The results are presented numerically in the upper row of Table 2 and visually in Figure 5. For the red-green system (Figure 5A), the optimal λmaxM= ~525 nm, with standard deviations of ~1 nm and a 95% confidence interval of <0.5 nm at all spatial frequencies. There is a small but significant change in λmaxM with spatial frequency [p = 8.9 × 10−12, α = 0.01, two-sample t-test between data for highest (λmaxM= 525.8 nm) and lowest (λmaxM= 524.84 nm) spatial frequencies]. The red-green system performs relatively better than the luminance system (Figure 5B) at all λmaxM positions in the range we tested. For both systems, discrimination performance increases as spatial frequency decreases. Means, standard deviations and confidence intervals are not given for the luminance system as the optimal λmaxM always occurs at the longest wavelength available. A note on the results of the luminance system: while it is typical to observe size-tuned responses in the luminance system, our results do not show this. Instead, the tuning curves for lower spatial frequencies have higher z scores. It has been observed that contrast sensitivity and the band-pass shape decrease as luminance levels decrease (Enroth-Cugell and Robson, 1966). As our goal here is to provide a comparison for the red-green system, we have used the same spectral images, and these contain fruit and leaf spectra are highly similar in intensity. Thus, the higher performance at lower spatial frequencies is a result of the low contrast of red-green gratings to the luminance system.

TABLE 2
www.frontiersin.org

Table 2. The optimal λmaxM across spatial frequencies for the red-green system when spectral images are generated with (upper row) and without (bottom row) luminance variation.

FIGURE 5
www.frontiersin.org

Figure 5. Performance of λmaxM at different spatial frequencies, when spectral images contain natural luminance variation. (A) Performance of the red-green system. Mean optimal λmaxM are shown as black diamonds with error bars showing standard deviations. (B) Performance of the luminance system. z score (Equation 9) is the mean over 100 repetitions on differently seeded random mosaics. Key: cpd = cycles per degree.

4.4. Luminance Variation Simulations

We aim to determine the effect that luminance variation has on the position of the optimal λmaxM. luminance variation is a source of spatial noise—i.e., it causes different regions of the cone image to be active to different degrees even when stimulated by the same material. As such, it is a noise source that could not be included in previous works that did not model spatial dimensions. We applied the long-wavelength limit by fixing λmaxL= 562 nm, and used a broader but coarser search range for λmaxM of 440–560 nm as during testing we observed a shift to shorter wavelengths. As our aim with this test is only to identify qualitative shifts in the optimal λmaxM due to luminance variation, we reduce the sampling interval to 10 nm. To remove the luminance variation, the luminance coefficients are all set to 1 when creating the spectral images.

The results are presented numerically in the bottom row of Table 2 and visually in Figure 6. Without luminance variation, λmaxM in the range 440–500 nm lead to similar performance, but at longer wavelengths than ~500 nm, performance decreases with wavelength. There is a significant effect of spatial frequency, with the optimal λmaxM occurring at a longer wavelength for higher spatial frequencies (p = 5.2 × 10−31, α = 0.01, two-sample t-test between data for highest and lowest spatial frequencies: λmaxM= 483.68 nm and λmaxM= 444.38 nm, respectively).

FIGURE 6
www.frontiersin.org

Figure 6. Performance of λmaxM for the red-green system at different spatial frequencies, when spectral images contain no luminance variation. z score (Equation 9) is the mean over 100 repetitions on differently seeded random mosaics. Mean optimal λmaxM are shown as black diamonds with error bars showing standard deviations. The four lines are for different spatial frequencies. Key: cpd = cycles per degree.

5. Discussion

Trichromatic primate retinas encode chromatic and spatial information with a single 2-dimensional array of photoreceptors. Here we have shown that for the task of discriminating chromatic gratings formed of natural fruit and leaf spectra, and in the presence of natural luminance variation, the predicted optimal tuning of λmaxM= 525 nm is close to the naturally observed value of 535 nm. By comparison, models that consider chromatic responses independently of space predict a shorter wavelength λmaxM, assuming fixed λmaxS and λmaxL (Osorio and Vorobyev, 1996; Regan et al., 1998; Sumner and Mollon, 2000a; Lewis and Zhaoping, 2006). This result assumes that λmaxL is fixed at its natural value of about 562 nm; in common with some (Osorio and Vorobyev, 1996; Lewis and Zhaoping, 2006) other models we find the value of λmaxL 562 nm is suboptimal, implying that some factor other than spatio-chromatic discrimination (as modelled here) limits the evolutionary shift of the pigment to longer wavelengths: possibly the effects of dark-noise (Ala-Laurila et al., 2004). The optimal value of λmaxM is affected by the luminance variation, which causes λmaxM to occur closer to λmaxL than it would if luminance were perfectly uniform across the scene. We also confirmed that the particular reflectance spectra of fruit and leaves are significant in setting this optimum, as a very different optimum (with much less spectral overlap) is predicted when the more diverse spectra of Munsell chips are used to build the images.

This more accurate prediction of the M cone spectral sensitivity has an important implication for the role of the luminance system in constraining the separation of λmaxM from λmaxL. Previously, it was believed that the requirement of the luminance system for a more correlated signal provided a selective pressure for more overlapping M and L cone spectral sensitivities (Osorio et al., 1998; Vorobyev, 2004) that was strong enough to drive λmaxM from its computationally predicted optimal position to its naturally observed position—a shift of around 20 nm. However, our spatio-chromatic analysis results in the discrepancy between the predicted and observed λmaxM being reduced to around 10 nm. This suggests that the purported selective pressure from the luminance system may be weak, in which case, the luminance system may not be greatly impaired by the decorrelation of M and L cone spectral sensitivities. This is in agreement with the recent empirical finding that high-acuity luminance vision is not worse in trichromatic female marmosets than in their dichromatic male counterparts, despite the fact that the parvocellular channel of the trichromats also carries the red-green signal (Martin et al., 2011). However, a number of studies on human dichromats have reported advantages over trichromats in certain laboratory conditions (Dain and King-Smith, 1981; Schwartz, 1994; Jägle et al., 2006; Sharpe et al., 2006; Melin et al., 2007, 2010; Caine et al., 2010; Janáky et al., 2014), and further research will be required before this question is answered definitively.

We predict the M cone spectral tuning by modeling the detectability of chromatic gratings; a task which can be compared to that of finding fruit amongst leaves in a complex natural environment (cf. Párraga et al., 1998, 2002). In addition to a red-green signal, the model generates a luminance signal. Comparing the exhaustive search results for the red-green and luminance systems, we observe that red-green vision leads to higher discrimination performance at all λmaxM in the range tested. This supports the theory that M and L cone spectral sensitivities are well-adapted for fruit foraging (Osorio and Vorobyev, 1996), but says nothing about how this task compares with other tasks implicated in the spectral tuning of primate M and L cones, such as young-leaf foraging (Sumner and Mollon, 2000a, 2003) or social signalling (Changizi et al., 2006; Hiramatsu et al., 2017), or whether the facilitation of fruit foraging was the underlying cause of the evolution of primate trichromacy. The only other scenario upon which the model was tested was the database of highly varied spectra which was used as a control to ensure that our model was not biased toward predicting highly correlated M and L cone spectral sensitivities (Figure 4A).

There is a small but significant change in λmaxM with spatial frequency between the lowest and highest spatial frequencies tested. Despite the high significance of this result, the small difference in the optimal λmaxM between the highest and lowest spatial frequencies (1.1 nm) and the fact that other neighbouring λmaxM have only slightly lower performance—as shown by the performance curves in Figure 5A— suggest this effect may be negligible.

The effect the luminance variation which occurs in natural scenes has upon spectral sensitivities was investigated via a comparison of the optimal λmaxM when natural luminance variation is (Figure 5A) and is not (Figure 6) included in the spectral images. Without luminance variation, our model predicts the optimal λmaxM in the range 440–500 nm. Such a distributed configuration of the peak sensitivities is typical of colour vision systems, as seen in many animals with colour vision (Osorio and Vorobyev, 2008) and demonstrated here using Munsell spectra, which cover the full colour gamut of for trichromatic primates. In the luminance variation simulations, the only source comes from the sampling of the scene by different cone types at different locations. At the higher spatial frequencies, there are fewer cones per cycle, so the noise introduced by the random cone mosaic has a greater impact, and leads to the optimum λmaxM occurring around 500 nm, whereas at the lower spatial frequencies, it tends to the shortest wavelength it can occupy (440 nm). Because this spatial-frequency-dependent effect on the optimal peak sensitivity is largely lost when luminance variation is included in the spectral images, this suggests that the tuning of λmaxM= 525 nm in the Optimal λmaxM simulations is heavily influenced by luminance variation. This conclusion is similar to that of (Sumner and Mollon, 2000a), who found that the high correlation of M and L spectral sensitivities minimised the variance in chromaticities of the background leaves.

Author Contributions

TM devised the concept, created the model, and wrote the manuscript; DO gave substantial contributions to the concept, interpretation of data, and drafting of the manuscript; AC gave substantial contributions to the concept, and drafting of the manuscript; LC gave substantial contributions to the concept, interpretation of data, and drafting of the manuscript.

Funding

This work was funded by the EPSRC.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Ahnelt, P. K., and Kolb, H. (2000). The mammalian photoreceptor mosaic-adaptive design. Prog. Retin. Eye Res. 19, 711–777. doi: 10.1016/S1350-9462(00)00012-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Ala-Laurila, P., Donner, K., and Koskelainen, A. (2004). Thermal activation and photoactivation of visual pigments. Biophys. J. 86, 3653–3662. doi: 10.1529/biophysj.103.035626

PubMed Abstract | CrossRef Full Text | Google Scholar

Benson, N. C., Manning, J. R., and Brainard, D. H. (2014). Unsupervised learning of cone spectral classes from natural images. PLoS Comput. Biol. 10:e1003652. doi: 10.1371/journal.pcbi.1003652

PubMed Abstract | CrossRef Full Text | Google Scholar

Billock, V. A. (2000). Neural acclimation to 1/f spatial frequency spectra in natural images transduced by the human visual system. Phys. D 137, 379–391. doi: 10.1016/S0167-2789(99)00197-9

CrossRef Full Text | Google Scholar

Bowmaker, J. K., Parry, J. W. L., and Mollon, J. D. (2003). “The arrangement of L and M cones in human and a primate retina,” in Normal and Defective Colour Vision, eds J. D. Mollon, J. Pokorny, and K. Knoblauch (New York, NY: Oxford University Press), 39–50.

Google Scholar

Brainard, D. H., Roorda, A., Yamauchi, Y., Calderone, J. B., Metha, A., Neitz, M., et al. (2000). Functional consequences of the relative numbers of L and M cones. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 17, 607–614. doi: 10.1364/JOSAA.17.000607

PubMed Abstract | CrossRef Full Text | Google Scholar

Brainard, D. H., Williams, D. R., and Hofer, H. (2008). Trichromatic reconstruction from the interleaved cone mosaic: Bayesian model and the color appearance of small spots. Vision Res. 8, 1–23. doi: 10.1167/8.5.15

PubMed Abstract | CrossRef Full Text | Google Scholar

Bumsted, K., and Hendrickson, A. E. (1999). Distribution and development of short-wavelength cones differ between Macaca monkey and human fovea. J. Comp. Neurol. 403, 502–516. doi: 10.1002/(SICI)1096-9861(19990125)403:4<502::AID-CNE6>3.0.CO;2-N

PubMed Abstract | CrossRef Full Text | Google Scholar

Caine, N. G., Osorio, D., and Mundy, N. I. (2010). A foraging advantage for dichromatic marmosets (Callithrix geoffroyi) at low light intensity. Biol. Lett. 6, 36–38. doi: 10.1098/rsbl.2009.0591

PubMed Abstract | CrossRef Full Text | Google Scholar

Calkins, D. J., and Sterling, P. (1996). Absence of spectrally specific lateral inputs to midget ganglion cells in primate retina. Nature 381, 613–615. doi: 10.1038/381613a0

PubMed Abstract | CrossRef Full Text | Google Scholar

Changizi, M. A., Zhang, Q., and Shimojo, S. (2006). Bare skin, blood and the evolution of primate colour vision. Biol. Lett. 2, 217–221. doi: 10.1098/rsbl.2006.0440

PubMed Abstract | CrossRef Full Text | Google Scholar

Chittka, L., and Menzel, R. (1992). The evolutionary adaptation of flower colours and the insect pollinators' colour vision. J. Comp. Physiol. 171, 171–181.

Google Scholar

Cooper, G. F., and Robson, J. G. (1969). The yellow colour of the lens of man and other primates. J. Physiol. 203, 411–417. doi: 10.1113/jphysiol.1969.sp008871

PubMed Abstract | CrossRef Full Text | Google Scholar

Croner, L. J., and Kaplan, E. (1995). Receptive fields of P and M ganglion cells across the primate retina. Vis. Res. 35, 7–24. doi: 10.1016/0042-6989(94)E0066-T

PubMed Abstract | CrossRef Full Text | Google Scholar

Dain, S. J., and King-Smith, P. E. (1981). Visual thresholds in dichromats and normals; the importance of post-receptoral processes. Vis. Res. 21, 573–580. doi: 10.1016/0042-6989(81)90103-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Deeb, S. S., Diller, L. C., Williams, D. R., and Dacey, D. M. (2000). Interindividual and topographical variation of L:M cone ratios in monkey retinas. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 17, 538–544. doi: 10.1364/JOSAA.17.000538

PubMed Abstract | CrossRef Full Text | Google Scholar

de Monasterio, F. M., McCrane, E. P., Newlander, J. K., and Schein, S. J. (1985). Density profile of blue-sensitive cones along the horizontal meridian of macaque retina. Invest. Ophthalmol. Vis. Sci. 26, 289–302.

PubMed Abstract | Google Scholar

Dominy, N. J., and Lucas, P. W. (2001). Ecological importance of trichromatic vision to primates. Nature 410, 363–366. doi: 10.1038/35066567

PubMed Abstract | CrossRef Full Text | Google Scholar

Drew, M. S., and Bergner, S. (2007). Spatio-Chromatic Decorrelation of Color Image Compression. Technical Report, TR:2007-09, School of Computing Science, Simon Fraser University. Available online at: http://fas.sfu.ca/pub/cs/TR/2007/CMPT2007-09.pdf

Google Scholar

Enroth-Cugell, C., and Robson, J. G. (1966). The contrast sensitivity of retinal ganglion cells of the cat. J. Physiol. 187, 517–552. doi: 10.1113/jphysiol.1966.sp008107

PubMed Abstract | CrossRef Full Text | Google Scholar

Field, D. J. (1987). Relations between the statistics of natural images and the response properties of cortical cells. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 4, 2379–2394. doi: 10.1364/JOSAA.4.002379

PubMed Abstract | CrossRef Full Text | Google Scholar

Flitcroft, D. I. (1989). The interactions between chromatic aberration, defocus and stimulus chromaticity: implications for visual physiology and colorimetry. Vis. Res. 29, 349–360. doi: 10.1016/0042-6989(89)90083-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Garner, L. F., Chuan, S. O., and Smith, G. (1998). Refractive index of the crystalline lens in young and aged eyes. Clin. Exp. Opt. 81, 145–150. doi: 10.1111/j.1444-0938.1998.tb06772.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hiramatsu, C., Melin, A. D., Allen, W. L., Dubuc, C., and Higham, J. P. (2017). Experimental evidence that primate trichromacy is well suited for detecting primate social colour signals. Proc. R. Soc. B 284:20162458. doi: 10.1098/rspb.2016.2458

PubMed Abstract | CrossRef Full Text | Google Scholar

Hofer, H., Carroll, J., Neitz, J., Neitz, M., and Williams, D. R. (2005). Organization of the human trichromatic cone mosaic. J. Neurosci. 25, 9669–9679. doi: 10.1523/JNEUROSCI.2414-05.2005

PubMed Abstract | CrossRef Full Text | Google Scholar

Jacobs, G. H. (2009). Evolution of colour vision in mammals. Philos. Trans. R. Soc. B 364, 2957–2967. doi: 10.1098/rstb.2009.0039

PubMed Abstract | CrossRef Full Text | Google Scholar

Jägle, H., de Luca, E., Serey, L., Bach, M., and Sharpe, L. T. (2006). Visual acuity and X-linked color blindness. Graefes Arch. Clin. Exp. Ophthalmol. 244, 447–453. doi: 10.1007/s00417-005-0086-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Janáky, M., Borbely, J., Benedek, G., Kocsis, B. P., and Braunitzer, G. (2014). Achromatic luminance contrast sensitivity in X-linked color-deficient observers: an addition to the debate. Vis. Neurosci. 31, 99–103. doi: 10.1017/S0952523813000400

PubMed Abstract | CrossRef Full Text | Google Scholar

Kelber, A., Vorobyev, M., and Osorio, D. (2003). Animal colour vision–behavioural tests and physiological concepts. Biol. Rev. Camb. Philos. Soc. 78, 81–118. doi: 10.1017/S1464793102005985

PubMed Abstract | CrossRef Full Text | Google Scholar

Lee, B. B., Shapley, R. M., Hawken, M. J., and Sun, H. (2012). Spatial distributions of cone inputs to cells of the parvocellular pathway investigated with cone-isolating gratings. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 29, A223–A232. doi: 10.1364/JOSAA.29.00A223

PubMed Abstract | CrossRef Full Text | Google Scholar

Lennie, P., Haake, P. W., and Williams, D. R. (1991). “The design of chromatically opponent receptive fields,” in Computational Models of Visual Processing, eds M. S. Landy and J. A. Movshon (Cambridge, MA: The MIT Press), 71–82.

Google Scholar

Lewis, A., and Zhaoping, L. (2006). Are cone sensitivities determined by natural color statistics? J. Vis. 6, 285–302. doi: 10.1167/6.3.8

PubMed Abstract | CrossRef Full Text | Google Scholar

Liang, J., and Williams, D. R. (1997). Aberrations and retinal image quality of the normal human eye. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 14, 2873–2883. doi: 10.1364/JOSAA.14.002873

PubMed Abstract | CrossRef Full Text | Google Scholar

Manning, J. R., and Brainard, D. H. (2010). Optimal design of photoreceptor mosaics: why we do not see color at night. Vis. Neurosci. 26, 5–19. doi: 10.1017/S095252380808084X

CrossRef Full Text | Google Scholar

Martin, P. R., Blessing, E. M., Buzás, P., Szmajda, B. A., and Forte, J. D. (2011). Transmission of colour and acuity signals by parvocellular cells in marmoset monkeys. J. Physiol. 589, 2795–2812. doi: 10.1113/jphysiol.2010.194076

CrossRef Full Text | Google Scholar

Melin, A. D., Fedigan, L. M., Hiramatsu, C., Sendall, C. L., and Kawamura, S. (2007). Effects of colour vision phenotype on insect capture by a free-ranging population of white-faced capuchins, Cebus capucinus. Anim. Behav. 73, 205–214. doi: 10.1016/j.anbehav.2006.07.003

CrossRef Full Text | Google Scholar

Melin, A. D., Fedigan, L. M., Young, H. C., and Kawamura, S. (2010). Can color vision variation explain sex differences in invertebrate foraging by capuchin monkeys? Curr. Zool. 56, 300–312.

Google Scholar

Melin, A. D., Hiramatsu, C., Parr, N. A., Matsushita, Y., Kawamura, S., and Fedigan, L. M. (2013). The behavioral ecology of color vision: considering fruit conspicuity, detection distance and dietary importance. Int. J. Primatol. 35, 258–287. doi: 10.1007/s10764-013-9730-8

CrossRef Full Text | Google Scholar

Millane, R. P., Alzaidi, S., and Hsiao, W. H. (2003). “Scaling and power spectra of natural images,” in Proceedings of Image and Vision Computing New Zealand, (Palmerston North), 148–153.

Google Scholar

Mollon, J. D. (1989). “Tho' she kneel'd in that place where they grew…” The uses and origins of primate colour vision. J. Exp. Biol. 146, 21–38.

Google Scholar

Mollon, J. D., and Bowmaker, J. K. (1992). The spatial arrangement of cones in the primate fovea. Nature 360, 677–679. doi: 10.1038/360677a0

PubMed Abstract | CrossRef Full Text | Google Scholar

Mullen, K. T. (1985). The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings. J. Physiol. 359, 381–400. doi: 10.1113/jphysiol.1985.sp015591

PubMed Abstract | CrossRef Full Text | Google Scholar

Nagle, M. G., and Osorio, D. (1993). The tuning of human photopigments may minimize red-green chromatic signals in natural conditions. Proc. R. Soc. B 252, 209–213. doi: 10.1098/rspb.1993.0067

PubMed Abstract | CrossRef Full Text | Google Scholar

Osorio, D., Ruderman, D. L., and Cronin, T. W. (1998). Estimation of errors in luminance signals encoded by primate retina resulting from sampling of natural images with red and green cones. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 15, 16–22. doi: 10.1364/JOSAA.15.000016

PubMed Abstract | CrossRef Full Text | Google Scholar

Osorio, D., and Vorobyev, M. (1996). Colour vision as an adaptation to frugivory in primates. Proc. R. Soc. B 263, 593–599. doi: 10.1098/rspb.1996.0089

PubMed Abstract | CrossRef Full Text | Google Scholar

Osorio, D., and Vorobyev, M. (2005). Photoreceptor spectral sensitivities in terrestrial animals: adaptations for luminance and colour vision. Proc. R. Soc. B 272, 1745–1752. doi: 10.1098/rspb.2005.3156

PubMed Abstract | CrossRef Full Text | Google Scholar

Osorio, D., and Vorobyev, M. (2008). A review of the evolution of animal colour vision and visual communication signals. Vis. Res. 48, 2042–2051. doi: 10.1016/j.visres.2008.06.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Parkkinen, J. P. S., Hallikainen, J., and Jaaskelainen, T. (1989). Characteristic spectra of Munsell colors. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 6, 318–322. doi: 10.1364/JOSAA.6.000318

CrossRef Full Text | Google Scholar

Párraga, C. A., Brelstaff, G., Troscianko, T., and Moorehead, I. R. (1998). Color and luminance information in natural scenes. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 15, 563–569. doi: 10.1364/JOSAA.15.000563

PubMed Abstract | CrossRef Full Text | Google Scholar

Párraga, C. A., Troscianko, T., and Tolhurst, D. J. (2000). The human visual system is optimised for processing the spatial information in natural visual images. Curr. Biol. 10, 35–38. doi: 10.1016/S0960-9822(99)00262-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Párraga, C. A., Troscianko, T., and Tolhurst, D. J. (2002). Spatiochromatic properties of natural images and human vision. Curr. Biol. 12, 483–487. doi: 10.1016/S0960-9822(02)00718-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Paulus, W., and Kroger-Paulus, A. (1983). A new concept of retinal colour coding. Vis. Res. 23, 529–540. doi: 10.1016/0042-6989(83)90128-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Regan, B. C., Julliot, C., Simmen, B., Vienot, F., Charles-Dominique, P., and Mollon, J. D. (2001). Fruits, foliage and the evolution of primate colour vision. Philos. Trans. R. Soc. B 356, 229–283. doi: 10.1098/rstb.2000.0773

PubMed Abstract | CrossRef Full Text | Google Scholar

Regan, B. C., Julliot, C., Simmen, B., Viénot, F., Charles-Dominique, P., and Mollon, J. D. (1998). Frugivory and colour vision in Alouatta seniculus, a trichromatic platyrrhine monkey. Vis. Res. 38, 3321–3327. doi: 10.1016/S0042-6989(97)00462-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Rubin, J. M., and Richards, W. A. (1982). Color vision and image intensities: when are changes material? Biol. Cybern. 45, 215–226. doi: 10.1007/BF00336194

PubMed Abstract | CrossRef Full Text | Google Scholar

Rucker, F. J., and Osorio, D. (2008). The effects of longitudinal chromatic aberration and a shift in the peak of the middle-wavelength sensitive cone fundamental on cone contrast. Vis. Res. 48, 1929–1939. doi: 10.1016/j.visres.2008.06.021

PubMed Abstract | CrossRef Full Text | Google Scholar

Ruderman, D. L., Cronin, T. W., and Chiao, C. C. (1998). Statistics of cone responses to natural images: implications for visual coding. J. Opt. Soc. Am. A. 15, 2036–2045. doi: 10.1364/JOSAA.15.002036

CrossRef Full Text | Google Scholar

Schwartz, S. H. (1994). Spectral sensitivity of dichromats: role of postreceptoral processes. Vis. Res. 34, 2983–2990. doi: 10.1016/0042-6989(94)90270-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Sharpe, L. T., de Luca, E., Hansen, T., Jagle, H., and Gegenfurtner, K. R. (2006). Advantages and disadvantages of human dichromacy. J. Vis. 6, 213–223. doi: 10.1167/6.3.3

PubMed Abstract | CrossRef Full Text | Google Scholar

Snodderly, D. M., Brown, P. K., Delori, F. C., and Auran, J. D. (1984). The macular pigment. I. Absorbance spectra, localization, and discrimination from other yellow pigments in primate retinas. Invest. Ophthalmol. Vis. Sci. 25, 660–673.

PubMed Abstract | Google Scholar

Solomon, S. G., and Lennie, P. (2007). The machinery of colour vision. Nat. Rev. Neurosci. 8, 276–286. doi: 10.1038/nrn2094

PubMed Abstract | CrossRef Full Text | Google Scholar

Soodak, R. E. (1986). Two-dimensional modeling of visual receptive fields using Gaussian subunits. Proc. Natl. Acad. Sci. U.S.A. 83, 9259–9263. doi: 10.1073/pnas.83.23.9259

PubMed Abstract | CrossRef Full Text | Google Scholar

Stockman, A., Petrova, D., and Henning, G. B. (2014). Color and brightness encoded in a common L- and M-cone pathway with expansive and compressive nonlinearities. J. Vis. 14, 1–32. doi: 10.1167/14.3.1

PubMed Abstract | CrossRef Full Text | Google Scholar

Stockman, A., and Sharpe, L. T. (2000). The spectral sensitivities of the middle- and long-wavelength-sensitive cones derived from measurements in observers of known genotype. Vis. Res. 40, 1711–1737. doi: 10.1016/S0042-6989(00)00021-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Sumner, P., and Mollon, J. D. (2000a). Catarrhine photopigments are optimized for detecting targets against a foliage background. J. Exp. Biol. 203, 1963–1986.

PubMed Abstract | Google Scholar

Sumner, P., and Mollon, J. D. (2000b). Chromaticity as a signal of ripeness in fruits taken by primates. J. Exp. Biol. 203(Pt 13), 1987–2000.

PubMed Abstract | Google Scholar

Sumner, P., and Mollon, J. D. (2003). “Did primate trichromacy evolve for frugivory or folivory?” in Normal and Defective Colour Vision, eds J. D. Mollon, J. Pokorny, and K. Knoblauch (Oxford: Oxford Scholarship Online), 21–30.

Google Scholar

Surridge, A. K., Osorio, D., and Mundy, N. I. (2003). Evolution and selection of trichromatic vision in primates. Trends Ecol. Evol. 18, 198–205. doi: 10.1016/S0169-5347(03)00012-0

CrossRef Full Text | Google Scholar

Tovée, M. J., Bowmaker, J. K., and Mollon, J. D. (1992). The relationship between cone pigments and behavioural sensitivity in a New World Monkey (Callithrix jacchus jacchus). Vis. Res. 32, 867–878. doi: 10.1016/0042-6989(92)90029-I

PubMed Abstract | CrossRef Full Text | Google Scholar

Van Norren, D., and Tiemeijer, L. F. (1986). Spectral reflectance of the human eye. Vis. Res. 26, 313–320. doi: 10.1016/0042-6989(86)90028-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Vorobyev, M. (2004). Ecology and evolution of primate colour vision. Clin. Exp. Opt. 87, 230–238. doi: 10.1111/j.1444-0938.2004.tb05053.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Wachtler, T., Doi, E., Lee, T. W., and Sejnowski, T. J. (2007). Cone selectivity derived from the responses of the retinal cone mosaic to natural scenes. J. Vis. 7:6. doi: 10.1167/7.8.6

PubMed Abstract | CrossRef Full Text | Google Scholar

Wachtler, T., Lee, T. W., and Sejnowski, T. J. (2001). Chromatic structure of natural scenes. J. Opt. Soc. Am. A Opt. Image Sci. Vis. 18, 65–77. doi: 10.1364/JOSAA.18.000065

PubMed Abstract | CrossRef Full Text | Google Scholar

Wandell, B. A. (ed.). (1995). “The photoreceptor mosaic,” in Foundations of Vision (Sunderland, MA: Sinauer Associates). Available online at: https://foundationsofvision.stanford.edu/chapter-3-the-photoreceptor-mosaic/

Google Scholar

Williams, D. R., Sekiguchi, N., Haake, W., Brainard, D. H., and Packer, O. (1991). “The cost of trichomacy for spatial vision,” in From Pigments to Perception, eds A. Valberg and B. B. Lee (New York, NY: Plenum Press), 11–22.

Wyszecki, G., and Stiles, W. S. (1982). Color Science. New York, NY: Wiley Ed.

Young, T. (1802). On the theory of light and colours. Philos. Trans. R. Soc. Lond. 92, 12–48. doi: 10.1098/rstl.1802.0004

CrossRef Full Text

Keywords: colour vision, cones, parvocellular, photoreceptor cells, primate, red-green system, spatio-chromatic, spectral sensitivity

Citation: Matthews T, Osorio D, Cavallaro A and Chittka L (2018) The Importance of Spatial Visual Scene Parameters in Predicting Optimal Cone Sensitivities in Routinely Trichromatic Frugivorous Old-World Primates. Front. Comput. Neurosci. 12:15. doi: 10.3389/fncom.2018.00015

Received: 24 July 2017; Accepted: 28 February 2018;
Published: 27 March 2018.

Edited by:

Yoram Burak, Hebrew University of Jerusalem, Israel

Reviewed by:

Gregor Kovacic, Rensselaer Polytechnic Institute, United States
Max Snodderly, University of Texas at Austin, United States

Copyright © 2018 Matthews, Osorio, Cavallaro and Chittka. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Tristan Matthews, t.w.matthews@qmul.ac.uk

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.