- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
During aesthetically appealing visual experiences, visual content provides a basis for computation of affectively tinged representations of aesthetic value. How this happens in the brain is largely unexplored. Using engaging video clips of natural landscapes, we tested whether cortical regions that respond to perceptual aspects of an environment (e.g., spatial layout, object content and motion) were directly modulated by rated aesthetic appeal. Twenty-four participants watched a series of videos of natural landscapes while being scanned using functional magnetic resonance imaging (fMRI) and reported both continuous ratings of enjoyment (during the videos) and overall aesthetic judgments (after each video). Although landscape videos engaged a greater expanse of high-level visual cortex compared to that observed for images of landscapes, independently localized category-selective visual regions (e.g., scene-selective parahippocampal place area and motion-selective hMT+) were not significantly modulated by aesthetic appeal. Rather, a whole-brain analysis revealed modulations by aesthetic appeal in ventral (collateral sulcus) and lateral (middle occipital sulcus, posterior middle temporal gyrus) clusters that were adjacent to scene and motion selective regions. These findings suggest that aesthetic appeal per se is not represented in well-characterized feature- and category-selective regions of visual cortex. Rather, we propose that the observed activations reflect a local transformation from a feature-based visual representation to a representation of “elemental affect,” computed through information-processing mechanisms that detect deviations from an observer’s expectations. Furthermore, we found modulation by aesthetic appeal in subcortical reward structures but not in regions of the default-mode network (DMN) nor orbitofrontal cortex, and only weak evidence for associated changes in functional connectivity. In contrast to other visual aesthetic domains, aesthetically appealing interactions with natural landscapes may rely more heavily on comparisons between ongoing stimulation and well-formed representations of the natural world, and less on top-down processes for resolving ambiguities or assessing self-relevance.
Introduction
Interactions with the natural environment can be highly impactful and aesthetically rewarding. Natural landscapes are rich sources of beauty, pleasure, awe and fascination (Kaplan, 1995; Keltner and Haidt, 2003; Eisenberger et al., 2010; Augustin et al., 2012; Brielmann et al., 2020), aesthetic properties that likely contribute to the documented beneficial effects of spending time in nature, such as improved cognition, creative problem solving, life satisfaction, mental health and well-being (Atchley et al., 2012; Bratman et al., 2015a, b; Twohig-Bennett and Jones, 2018; Chang et al., 2020).
Whereas a wealth of detail is known about how the human brain represents what is in our visual environment (e.g., category-specific representations of content; Malach et al., 1995; Kanwisher et al., 1997; Epstein and Kanwisher, 1998; Haxby et al., 2001), how that environment is changing (Tootell et al., 1995) and how we interact with it (Ungerleider and Mishkin, 1982; Goodale and Milner, 1992; Kravitz et al., 2011b) there is much less known about how such interactions become endowed with aesthetic qualities. It is clear that aesthetic evaluations involve not only the visual system but also processes for making meaning and for computing valuation (see Chatterjee and Vartanian, 2014; Vessel, 2020). Yet there is little agreement on precisely how neural representations of visual content inform computations of aesthetic appeal.
More specifically, within visual cortex it is unclear whether information about the aesthetic appeal of a scene is present in the same cortical regions that represent perceptual aspects of that scene such as content, layout or movement. The most well studied scene-selective region using functional magnetic resonance imaging (fMRI) is in the parahippocampal gyrus (PHG) or adjacent collateral sulcus (CoS); when identified by a contrast of activation for scenes vs. images of isolated objects, this region is referred to as the “parahippocampal place area” (PPA; Epstein and Kanwisher, 1998). It is thought to represent aspects of a scene that can be used to identify it as a particular place (Epstein, 2020) including its spatial boundaries (Park et al., 2011), 3D structure and geometry (Epstein and Ward, 2010; Walther et al., 2011), and relevant contextual associations (Bar and Aminoff, 2003). Two additional scene-selective regions have also been identified, namely the retrosplenial cortex (RSC; Aguirre et al., 1996; Epstein, 2008) on the medial surface and the “occipital place area” (OPA; Nakamura et al., 2000; Dilks et al., 2013) on the lateral surface.
Several studies have reported increased activity in or near the PPA in response to preferred scenes, but the evidence is far from conclusive. Yue et al. (2007) reported greater activity for preferred vs. non-preferred scenes (a mixture of indoor and outdoor) in right, but not left PPA. A study of ‘sublime’ natural landscapes found increased activity in an extensive portion of the ventral occipitotemporal cortex (VOT) stretching from fusiform gyrus to PHG and underlying posterior hippocampus (Ishizu and Zeki, 2014); yet as no scene-selective localizer was performed, the location of activation relative to PPA was unclear. Another study reported that attractiveness ratings of natural landscapes were correlated with subthreshold activity changes in PHG and CoS, but that only activity in the object-selective lateral occipital complex (LO), and not place-selective PPA, was significantly correlated with place attractiveness (Pegors et al., 2015). Ratings of beauty of interior architecture images have also been found to correlate with activity in PHG and middle occipital gyrus (MOG; Vartanian et al., 2013b). Finally, a study comparing several aesthetic domains found spatial patterns of activity in VOT that were predictive of aesthetic appeal for natural landscapes, and stronger responses in both PPA and object-selective ventral object area (VOA) for appealing vs. non-appealing natural landscapes, interior and exterior architecture (Vessel et al., 2019).
Though less directly relevant for scenes, studies investigating whether aesthetic appeal of faces is represented in regions of the face-selective network have reported mixed results, with some studies showing effects in fusiform face area (FFA; Kanwisher et al., 1997) (Chatterjee et al., 2009; Pegors et al., 2015) and others not (Vartanian et al., 2013a; Hartung et al., 2019).
Our primary aim was thus to identify modulations correlated with aesthetic appeal in visual brain regions for experiences with landscapes, and to understand how such activity relates to well-characterized representations of perceptual features such as scene layout. To do so, we curated a set of artistically engaging video clips of natural landscapes (30 s duration). Natural landscapes have a strong capacity to invoke aesthetic engagement (Kant, 1790/1987; Brielmann et al., 2020). Importantly, an analysis of scene shape is critical for evaluation of landscape videos, which should lead to strong engagement of scene-selective regions (PPA, OPA, and RSA). We identified these regions using independent functional localizers in each individual and used them to directly test whether aesthetic appeal modulated activity in feature-selective regions of visual cortex.
The use of videos of natural scenes adds another feature, motion, whose representation in visual cortex is also well characterized. Similar to the scene-selective areas, it is unclear whether area hMT+ (human middle temporal complex), a core region for the computation of visual motion (Tootell et al., 1995; Beauchamp et al., 2003), is modulated by aesthetic appeal. To date only one study, using kinetic dot patterns, has tested whether activity in hMT+ was greater for aesthetically appealing patterns of motion (Zeki and Stutters, 2012). Although they did not use a functional localizer approach, group-level sensitivity for aesthetic appeal did appear to overlap with motion selectivity in the approximate location of hMT+. We therefore included an independent localizer for motion selectivity and tested whether hMT+ activity was modulated by aesthetic appeal.
In addition to this primary aim, our design also allowed us to address two further questions. Our secondary aim sought to test whether aesthetically appealing experiences with natural landscapes engage medial prefrontal cortex (mPFC), orbitofrontal cortex (OFC) or nodes of the default-mode network (DMN). Many studies have reported that aesthetically appealing stimuli are associated with greater fMRI activation in portions of prefrontal cortex that support valuation and emotion (Brown et al., 2011; Chatterjee and Vartanian, 2016). This finding appears particularly robust for cultural artifacts such as artwork. Modulations of aesthetic appeal have been reported below the superior rostral sulcus (SRS) in medial orbitofrontal cortex (mOFC) for visual artwork (Kawabata and Zeki, 2004; Lacey et al., 2011) and music (Blood and Zatorre, 2001). Sensitivity to aesthetic appeal has also been reported in or above the SRS in mPFC for visual artworks (Vartanian and Goel, 2004; Vessel et al., 2012), abstract patterns (Jacobsen et al., 2006), architecture (Vartanian et al., 2013b) and for non-visual stimuli such as music (Ishizu and Zeki, 2011) and mathematical beauty (Zeki et al., 2014). In addition, several nodes of the DMN, a network of functionally connected regions that mediates aspects of internally directed thought (Raichle et al., 2001; Andrews-Hanna, 2012) have also been found to be engaged for artworks rated as strongly moving (Vessel et al., 2012, 2013; Belfi et al., 2019).
However, the question of whether portions of the prefrontal cortex or DMN are engaged by aesthetically appealing natural scenes is an unsettled issue. Using a whole-brain activation analysis, one study reported effects in prefrontal regions for aesthetic appeal of diverse scenes (Kirk, 2008) while another reported no effect (Yue et al., 2007). A study using images of natural landscapes reported activity correlated with aesthetic appeal in mPFC, but only when small-volume correction was applied using an a priori defined region-of-interest (ROI; Pegors et al., 2015), whereas a recent study using awe-inducing videos of natural landscapes reported less activation in mPFC and other DMN nodes (posterior cingulate cortex; PCC) when compared to neutral videos (VanElk et al., 2019). Using multivariate methods, three separate studies have found that patterns of activation in portions of mOFC, mPFC and the DMN contain information about aesthetic appeal of either natural landscapes (Pegors et al., 2015; Vessel et al., 2019) or about rated valence of affective pictures (Chikazoe et al., 2014); however, one of these found no differences in average activation for high vs. low appeal natural landscapes, despite strong pattern-related predictability (Vessel et al., 2019). In contrast, the evidence for increased mOFC/mPFC activation for attractive faces is more consistent (Aharon et al., 2001; O’Doherty et al., 2003; Kim et al., 2007; Smith et al., 2010; Tsukiura and Cabeza, 2011). We therefore sought to assess whether aesthetically appealing movies of natural landscapes would lead to significant modulation of average fMRI activity in a priori defined nodes of the DMN (including mPFC) or orbitofrontal cortex.
Our third aim was to assess whether feature-selective visual regions show increased functional connectivity with reward or DMN regions for aesthetically appealing experiences with natural landscapes. One possible mechanism by which visual information is transformed into a representation of aesthetic appeal is through an increase in coordinated activity between visual regions and subcortical reward, prefrontal or DMN regions. An increase in functional connectivity between content-related visual regions and ventromedial prefrontal cortex (vMPFC) has been reported during valuation judgments of t-shirt designs (Lim et al., 2013), and also between auditory cortices and nucleus accumbens for rewarding music (Salimpoor et al., 2013). Due to their dynamically changing nature, videos are more likely to induce fluctuations in visual regions that can then be tracked across the brain. We computed a measure of functional connectivity between sensory, reward and DMN regions for each video, and tested whether this connectivity was correlated with ratings of aesthetic appeal.
In addition to increasing engagement (Cutting et al., 2011; van der Meer et al., 2020) and allowing for a more robust measure of functional connectivity, the use of videos has several other advantages over images. Narrative film can create attentional synchrony across participants (Loschky et al., 2015). Yet natural landscape videos also appear to reduce agreement across individuals for which clips they find most appealing, compared to static images of landscape (Isik and Vessel, 2019). Methodologically, this allows for better separation of fMRI effects attributable to differences in content vs. differences in appeal: when people don’t find the same stimuli appealing, stimulus features can be ruled out as the primary cause of appeal-related modulations of brain activity (Vessel et al., 2012). Movies of landscapes also better reflect the ways people typically engage with natural environments, such as when one walks through a forest to explore, changes their view to take in an expansive vista or watches light and clouds move across a landscape. The popularity of artistic drone and time-lapse footage of natural landscapes on video sharing and social media websites attest to the power of natural landscape to engage and move us.
To test these hypotheses, twenty-four observers watched 30 s video clips of natural landscapes while being scanned using fMRI. During the clips, observers were asked to continuously rate their enjoyment using a hand-held dial. After the clip ended, observers then used the same dial to rate the overall intensity of their aesthetic experience. We found that ROIs sensitive to specific perceptual features such as scene layout and motion were strongly activated by the landscape movies, but were not clearly modulated by overall aesthetic appeal. Rather, a whole-brain analysis revealed several regions sensitive to aesthetic appeal of dynamic natural landscapes that were adjacent to, or only partially overlapping with, these ROIs representing specific perceptual features. Beyond the visual system, we observed that subcortical regions of the basal ganglia were modulated by aesthetic appeal, but that no modulation by aesthetic appeal could be detected in prefrontal and DMN regions using reasonable thresholds. Finally, functional connectivity between visual ROIs and reward or DMN ROIs was only weakly modulated by aesthetic appeal, failing to survive a stringent corrections threshold.
These results suggest that features that drive aesthetic appeal per se are not represented in core visual regions that are selective for specific visual features such as scene layout and motion, but rather in cortex adjacent to these regions. Additionally, we present evidence that, at least for movies of natural landscapes, the neural basis for aesthetic appeal does not depend on either large-scale activation in prefrontal cortex nor on functional connectivity between content-selective visual regions and reward or DMN regions.
Materials and Methods
Participants
Twenty-six participants were recruited for this study and paid for their participation. Two participants were excluded, one due to excessive motion (mean framewise displacement > 0.5 mm) and one due to missing behavioral data, leaving a final group of 24 participants (13 f; 18 right-handed, 24.7 ± 6.8 years of age). Informed consent was obtained in accordance with a protocol approved by the Medical Ethics Committee of Goethe University Frankfurt and was signed by all participants before the experiments.
Stimuli and Procedures
Stimuli were 30 s video clips of landscapes collected from video streaming websites (e.g., YouTube or Vimeo) or from non-narrative cinematic films. The movies consisted of aerial drone shots, point-of-view shots or time-lapse photography depicting different types of natural landscapes (e.g., mountain, forest, ocean, river). They had clear artistic intent conveyed through the selection of depicted content, light conditions, use of camera techniques, and presence of changes throughout the duration of the clip (e.g., movement of camera, changes in weather or time of day). To ensure that aesthetic engagement was mainly driven by the landscape content, videos did not include human beings, animals or other objects. Forty movies were clipped to 30 s length using Adobe Premier Pro and saved with the same aspect ratio (16:9), resolution (1280 × 720 px) and video compression method (H.264). Movie stimuli were presented using PsychoPy2 (v1.85.2) and MovieStim3 (Peirce, 2008) at the center of the screen (approximate field-of-view 27°× 15°). All experimental stimuli were delivered using MRI-compatible VisuaStim goggles system (Resonance Technology) with a display resolution of 800 × 600, 30° horizontal field of view and a refresh rate of 60 Hz.
Participants completed a 6-min resting state scan in which they were asked to fixate a central fixation cross on a gray background. In the following four runs (8 movies each), participants viewed 32 landscape movies in an order counterbalanced across participants. Each movie trial began with a 10 s fixation period, followed by a 30 s movie presentation with no fixation requirement, followed by a 4 s response period (Figure 1A). A fifth run contained repeated presentations of 8 movies shown during the earlier runs (same movies for all participants) as a way to assess consistency of neural (not reported here) and behavioral responses. One movie clip was removed from further analysis due to a technical problem, leaving 31 trials in the main analysis and 7 trials in the consistency analysis. The duration for each run was 6 min and 4 s including a 2 s initial and 10 s final blank period.
Figure 1. A continuous rating paradigm for assessing individual aesthetic enjoyment of landscape videos. (A) Schematic description of one experimental trial measuring continuous aesthetic responses to dynamically changing visual experiences. Participants viewed 30 s movie clips of landscapes while making continuous ratings of their moment-to-moment enjoyment. This was followed by an overall rating indicating the intensity of the aesthetic experience from the whole movie. Both responses were given using a rotary dial. (B) The histogram of overall ratings collapsed across all participants shows that most ratings were above the ‘indifference’ point (marked here as 0). (C) However, the distribution of overall ratings as illustrated with boxplots suggests marked differences across people in terms of their overall aesthetic ratings (Diamond is the mean, center line is the median, bottom and top edges of the box indicate the 25th and 75th percentiles. Whiskers extend to the most extreme data points and black circles indicate individual outliers). (D) Measure of agreement across participants (“mean-minus-one” correlation, see Materials and Methods) for overall and continuous ratings. Each circle represents the MM1 value for one participant and the gray dashed lines connect the MM1 values computed with overall and continuous ratings for the same participant. Diamonds are mean MM1 values across participants; error bars are 95% confidence intervals. (E) Continuous rating traces given by each participant for one movie clip (with the median MM1c value). In general, movie clips were rated differently by different participants, in terms of their overall mean liking and variability over time.
During the videos, participants were asked to make continuous evaluations of their aesthetic enjoyment using a rotary dial. They were told to move the dial to the right if they were feeling more enjoyment or pleasure and to the left if they were feeling less enjoyment or pleasure when watching the video clip (“How much are you enjoying the clip at each moment?”). After the video clip finished playing, participants were given 4 s and asked to make a summary aesthetic judgment (“How intense was your aesthetic experience overall?”). Participants were instructed to give ratings of their subjective aesthetic experience of the clips and that they should base their judgments on their personal experience. They were told that they might have a more intense aesthetic experience for many different reasons, such as a clip being experienced as beautiful, profound or emotionally moving. Responses were collected using a custom-made MRI compatible rotary dial (Current Designs, Philadelphia, United States) positioned at their side. The dial had stops at the 9 and 3 o’clock positions and haptic feedback on the 12 o’clock position indicating extreme negative, extreme positive and neutral enjoyment, respectively. Participants were instructed to position the dial at the 12 o’clock neutral position before the start of each trial. This design allowed the participants to give ratings ranging from negative to positive without the need for visual feedback that would interfere with a visual experience. Before the experiment, observers were given practice with visual feedback on how to use the dial to help them calibrate their responses.
After the video runs, participants completed two functional localizer scans: a place, face, object, body localizer (PFOB localizer) and motion (hMT+) localizer. The PFOB localizer contained blocks of places, faces, objects, scrambled objects and bodies without faces. This scan consisted of five blocks of each stimulus type, during which the participant performed a “1-back” task responding each time an exact repeat of an image appeared. Each block contained 16 stimulus images (image size = 20°× 20°) each presented for 800 ms with a 200 ms inter-stimulus-interval. In the hMT+ localizer participants viewed alternating blocks of biological point-light actions, position-scrambled point-light controls, and static frames of the scrambled point-light control condition (Grossman and Blake, 2002; Vangeneugden et al., 2014). Each pattern consisted of 12 dots; the scrambled animations contained the same motion vectors as the biological ones, but the initial starting positions of the dots were randomized (details of the biological motion sequences are described in Grossman and Blake, 2002). There were 14 stimulation blocks for each condition and four rest blocks. The stimulation blocks consisted of five dot-pattern stimuli presented for 1 s with a 1 s inter-stimulus-interval. The dot stimuli appeared in a rectangle that subtended approximately 20°× 22° visual angle. Again, participants performed a “1-back” task to maintain attention. For both functional localizer tasks participants were instructed to maintain strict fixation. Stimuli were displayed using Matlab (Mathworks, Inc., 2016b) with Psychophysics Toolbox (Brainard, 1997, Pelli, 1997, Psychtoolbox-3).
Data Acquisition and Preprocessing
Behavioral Data
Data for both continuous and overall ratings were scaled to range between −1 and 1. Continuous data were collected with a sampling rate of 60 Hz and down sampled to 10 Hz. Overall ratings given at the end of each movie were categorized into four bins and were used in the whole-brain activation analysis and ROI activation analysis. The binning was done for each participant separately by discretizing the values of the overall ratings into four bins based on quartiles.
fMRI Data Acquisition
Functional magnetic resonance imaging data collection was carried out at University of Frankfurt’s Brain Imaging Center, using a 3-T Siemens Trio scanner and an eight-channel phased array head coil (Siemens). The blood oxygen level dependent (BOLD) signal was measured using 32 3 mm slices (2 mm + 50% distance factor) that were acquired in an oblique orientation of approximately 20° to the anterior commissure-posterior commissure (AC-PC) axis to reduce the signal dropouts in the ventral prefrontal cortex (in plane resolution 3 mm × 3 mm, TR = 2s, TE = 30 ms, Flip Angle = 90°). The standard Siemens sequence was customized to include an additional slice-wise z shimming (−1.3 mT/m). Before every functional scan a short EPI (3 TR) with opposite phase encoding direction was collected for use in phase unwarping during preprocessing.
A high-resolution (1 mm3) anatomical volume (MPRAGE sequence) was obtained after the functional scans. Data were converted from DICOM to NIFTI and structured according to the BIDS standard (Gorgolewski et al., 2016) using Heudiconv (version 0.51). Neuroimaging data was preprocessed using fMRIPprep 1.1.8 (Esteban et al., 2018). The details of the anatomical preprocessing steps for the T1 weighted (T1w) image can be found here: https://fmriprep.org/en/1.1.8/workflows.html#. As for the functional scans, for each of the 8 BOLD runs per participant, first a reference volume and its skull-stripped version were generated using a custom methodology of fMRIPrep. A deformation field to correct for susceptibility distortions was estimated based on two echo-planar imaging (EPI) references with opposing phase-encoding directions using 3dQwarp (AFNI) (Cox and Hyde, 1997)2. Based on the estimated susceptibility distortion, an unwarped BOLD reference was calculated for a more accurate co-registration with the anatomical reference. The BOLD reference was then co-registered to the T1w reference using bbregister (FreeSurfer) which implements boundary-based registration (Greve and Fischl, 2009). Co-registration was configured with nine degrees of freedom to account for distortions remaining in the BOLD reference. Head-motion parameters with respect to the BOLD reference (transformation matrices, and six corresponding rotation and translation parameters) were estimated before spatiotemporal filtering using MCFLIRT [FSL 5.0.9 (Jenkinson et al., 2012)]. The BOLD time-series were resampled into their original, native space by applying a single, composite transform to correct for head-motion and susceptibility distortions. Automatic removal of motion artifacts using independent component analysis (ICA-AROMA, Pruim et al., 2015) was performed on the preprocessed BOLD time-series in MNI space after spatial smoothing with an isotropic, Gaussian kernel of 6 mm FWHM (full-width half-maximum). Corresponding “non-aggressively” denoised runs were produced after such smoothing. Several confounding time-series were calculated based on the preprocessed BOLD: framewise displacement (FD), DVARS (Derivative of rms VARiance over voxelS) and three region-wise global signals. FD and DVARS were calculated for each functional run, both using their implementations in Nipype (Power et al., 2014). The three global signals were extracted from the cerebrospinal fluid (CSF), the white matter (WM), and the whole-brain masks. Additionally, a set of physiological regressors were extracted to allow for component-based noise correction [CompCor (Behzadi et al., 2007)]. Principal components were estimated after high-pass filtering the preprocessed BOLD time-series (using a discrete cosine filter with 128s cut-off) for the anatomical correction (aCompCor) and temporal (tCompCor) variants. Six tCompCor components were then calculated from the top 5% variable voxels within a mask covering the subcortical regions. This subcortical mask was obtained by heavily eroding the brain mask, which ensures it does not include cortical GM regions. For aCompCor, six components were calculated within the intersection of the aforementioned mask and the union of CSF and WM masks calculated in T1w space, after their projection to the native space of each functional run (using the inverse BOLD-to-T1w transformation). Gridded (volumetric) resamplings were performed using antsApplyTransforms (ANTs), configured with Lanczos interpolation to minimize the smoothing effects of other kernels (Lanczos, 1964). The internal operations of fMRIPrep use Nilearn 0.4.2 (Abraham et al., 2014) mostly within the functional processing workflow.
Data Analysis
Agreement Analysis
Agreement for overall and continuous ratings across participants was quantified by using a “mean-minus-one” (MM1) correlation measure (Vessel et al., 2018). To calculate the MM1 scores for overall ratings we took each individual’s ratings and computed Pearson correlations with the average ratings of all other (N-1) individuals. This procedure produces an r score for each individual indicating how much this person is in agreement with the rest of the participants. We applied a similar leave-one-out framework to calculate a measure of agreement for continuous ratings in which one participant’s rating timecourse was correlated with the average of all others (mean-minus-one “continuous” correlation, MM1c). This procedure results in a participant-by-movie array that was then averaged across movies to obtain one value per participant indicating how much this person was in agreement with the rest of the participants for their moment-to-moment ratings. To obtain average across-observer MM1c scores, we first transformed individual r-values to z-values, computed the mean and 95% confidence intervals, and then transformed those scores back to r-values (Bronstad and Russell, 2007).
To quantify idiosyncratic and shared contributions to the overall aesthetic ratings we estimated proportions of “shared” and “private” taste with a variance decomposition method (Germine et al., 2015) with a modification proposed by Martinez et al. (2020) to more correctly handle participants who show negative agreement. By using the movie overall ratings from the last run of the experiment which contained repetitions of previously seen movies (nr of movies = 7) we partitioned the total variance of responses into non-repeatable vs. repeatable variance and then subdivided the repeatable variance into shared vs. individual variance.
Motion Energy Calculation
A measure of motion energy for each video clip was computed by applying a Gabor jet simple cell model (Yue et al., 2012; Margalit et al., 2016) to each frame and then computing a vector of framewise differences in the model output. This model was used as opposed to a simpler pixelwise motion energy metric because it more closely resembles the information thought to be encoded by the early visual system (Lades et al., 1993). To explore whether participants’ aesthetic ratings were affected by the motion energy in the movies we calculated Pearson correlations between participants’ continuous rating scores and the framewise motion energy values (downsampled to 10 Hz to match the sampling rate of the ratings) as well as participants’ overall ratings and the average motion energy value for each movie.
Identification of Participant-Specific Regions of Interest
Participant-specific maps of the DMN were obtained using the rest scan. High-pass filtering at 0.005 Hz and spatial smoothing with 6-mm FWHM Gaussian filter were applied using FSL to the non-aggressively cleaned fmriprep output in MNI space (Pruim et al., 2015). Then, we applied group-average independent component analysis (ICA) using FSL’s MELODIC tool. Because we were interested in obtaining macroscale functional networks we selected a lower order model with 20 components (Ray et al., 2013). The spatial maps from the group-average analysis were used to generate participant-specific versions of each map and associated timeseries using dual regression (Beckmann et al., 2009). First, for each participant, the group-average set of spatial maps was regressed (as spatial regressors in a multiple regression) into the participant’s 4D space-time dataset. This results in a set of participant-specific timeseries, one per group-level spatial map. Next, those timeseries were regressed (as temporal regressors, again in a multiple regression) into the same 4D dataset, resulting in a set of participant-specific spatial maps, one per group-level spatial map. These ICA components were compared to a set of predefined network maps (Smith et al., 2009) using Pearson correlation. The component with the highest correlation to the Smith et al. DMN map (Smith et al., 2009) was then thresholded (FDR < 0.05, cluster size > 100 voxels) and visually inspected to ensure that its spatial distribution appeared similar to the canonical DMN. A set of five subregions (anterior medial prefrontal cortex, aMPFC; dorsal medial prefrontal cortex, dMPFC; ventral medial prefrontal cortex, vMPFC; posterior cingulate cortex, PCC; inferior parietal lobule, IPL) were identified in each hemisphere by masking the thresholded DMN maps with a set of “master” ROIs delineated on the Freesurfer fsaverage brain and transformed back to MNI space (Belfi et al., 2019). These master ROIs, which each covered a contiguous region of cortex larger than the corresponding DMN subregion in any one participant, were drawn from the distribution of locations of these subregions observed in an independent sample of 16 participants (Vessel et al., 2019). This method was used in order to identify previously characterized, spatially specific nodes of the DMN from each individual’s own functional connectivity in a manner that required minimal manual intervention. These maps were then transformed back to participants’ T1 space for further analysis (for a surface visualization of the master ROIs see, Figure 2A).
Figure 2. Strength of BOLD activation vs. baseline and effect of aesthetic appeal in visual, default-mode and reward networks. (A) Nineteen a priori regions of interest (ROIs) from three networks were identified and mean signal from each ROI was extracted for each participant. (B) Activations in each ROI for viewing landscape movies (vs. baseline). All visual ROIs were strongly engaged by landscape movies, with pericalcarine, LO, and OPA showing the strongest activation. *Indicates greater and †indicates lesser activation compared to a resting baseline (C) Beta values from a univariate activation analysis in a priori visual ROIs did not reveal significant differences across 4 different levels of aesthetic appeal. In B, C, boxplots display the median (center line), the 25th and 75th percentiles (box edges) and extrema (whiskers). Filled circles represent scores for each participant and points outside the reach of the whiskers are individual outliers; N = 24.
Data from the PFOB and hMT+ localizers were analyzed with standard random-effects general linear models (FSL FEAT) after high pass filtering with 100 s cut-off. For the PFOB localizer we used separate predictors for face, object, scene, body and scrambled object blocks. Face-selective voxels were identified by contrasting face blocks to the average of the object, scene, and scrambled object blocks and object-selective voxels were identified by contrasting object blocks to the average of the face, scene and scrambled object blocks. Similarly, scene-selective voxels were identified by contrasting scene blocks to the average of the face, object and scrambled object blocks. For the hMT+ localizer we modeled separate predictors for position scrambled point-light controls, static frames of the scrambled point-light control conditions and biological point-light actions. To localize hMT+, position-scrambled point-light control stimuli (consisting of moving dots with local, non-coherent motion) were contrasted with static frames of these scrambled actions (Vangeneugden et al., 2014). The biological point light action stimuli, typically used to localize pSTS, were not used for this study.
To define participant-specific ROIs we adopted the group-constrained participant-specific ROI definition procedure (Fedorenko et al., 2010; Julian et al., 2012). This procedure involves taking individual participants’ thresholded (z > 2.3, cluster threshold p < 0.05) activation maps and overlaying them on top of each other in a common stereotaxic space (MNI) to create probabilistic overlap maps for each contrast of interest. We created these probabilistic maps for each contrast and transformed them to Freesurfer’s fsaverage surface (mri_vol2surf) to be able to visualize and delineate each target region of interest. The parahippocampal place area (PPA), occipital place area (OPA) and retrosplenial cortex (RSC) were identified as the set of scene-selective voxels in the collateral sulcus, transverse occipital sulcus and medial parietal cortex (Epstein and Kanwisher, 1998; Nasr et al., 2011), the fusiform face area (FFA) was identified as the set of contiguous voxels showing face selectivity in the fusiform gyrus (Kanwisher et al., 1997), hMT+ was identified as the set of motion selective voxels in middle temporal cortex (Huk et al., 2002; Vangeneugden et al., 2014) and object-selective lateral occipital cortex (LO) was identified as the voxels situated posterior to hMT+ in the dorsal-caudal subdivision of lateral occipital complex (Grill-Spector et al., 2001). These regions of interest, similar to the master ROIs described above, were then used to identify participant-specific functional ROIs after being transformed to participants’ T1 space and intersected with individuals’ own thresholded activation maps.
Pericalcarine and basal ganglia ROIs [Nucleus Accumbens (NAc), Caudate, Putamen, Pallidum] were defined anatomically based on Freesurfers “aparc” automatic segmentation and orbitofrontal cortex (OFC) ROIs [lateral OFC (lOFC), medial OFC (mOFC), mid anterior OFC (maOFC)] were identified with the OFC atlas (Öngür et al., 2003) included in FreeSurfer’s library. All ROIs were individually identified (laterally) and then combined to form bilateral ROIs. Average time series from each bilateral ROI were extracted using Nilearn’s NiftiLabelsMasker (Abraham et al., 2014). At the end of this procedure, 19 ROIs were created for most participants with the exception of four participants missing IPL and one participant missing vMPFC.
Activation Analysis of a priori ROIs
General linear model activation analyses were implemented in Python using Nistats (Abraham et al., 2014) and nltools (Chang et al., 2018) to characterize univariate activation in a priori ROIs in response to landscape movies (vs. baseline). Average timeseries data from voxels in each ROI were high pass filtered (0.01 Hz), detrended and z scored. The data across four runs were concatenated, design matrices were created by entering task block regressors for 30 s movie-on periods (separately for each four aesthetic appeal levels) and for overall rating response periods (4 s). The regressors were then convolved with a canonical hemodynamic response function (HRF). Motion parameters representing 3 translation and 3 rotation time-courses, their temporal derivatives, and quadratic terms of both were also included in the design matrices. From the resulting regression weights, linear contrasts for all movies vs. resting baseline were computed for each ROI and then compared to zero baseline at the group level using one-sample t-tests and corrected for multiple comparisons using Bonferroni correction (0.05/number of ROIs). The significance of the aesthetic appeal effect was tested using linear mixed effects analysis (with lmer function from lme4; Bates et al., 2015, implemented in R version 3.4.3) by adding linear contrasts for 4 vs. 1 and 4 vs. 321 aesthetic appeal and including intercepts for participants as random effects.
Whole Brain fMRI Analysis
Whole-brain fMRI data were analyzed with standard general linear models using tools from the FSL library [3 v5.0.11, FEAT, v6.00 (Smith et al., 2004) and Freesurfer]. Data were smoothed using a 5 mm Gaussian filter and high pass filtered (at 90 s). In the first level, a general linear model (GLM) analysis was implemented to extract separate parameter estimates for each of the 31 movie trials within every voxel in T1 space. Six motion parameters (three rotation and three translation), aCompCor (Behzadi et al., 2007) and FD (Power et al., 2014) values were added as nuisance regressors in this GLM. To identify regions showing sensitivity to overall aesthetic ratings of videos a second level fixed-effects analysis was computed with the responses of each participant on each of the four possible aesthetic appeal levels coded as separate regressors. Average motion energy values were calculated for each video and added as nuisance regressors. To identify regions sensitive to aesthetic appeal (4 vs. 1) and to further isolate processes particular to strong aesthetic responses (4 vs. 321) we computed two contrasts of interest for each participant. These contrast maps were then transformed to the Freesurfer group surface fsaverage (mri_vol2surf) after additional smoothing using a 5 mm FWHM kernel and a one-sample group mean statistical test was applied (mri_glmfit). The results were corrected for multiple comparisons using cluster-wise thresholding derived from Monte-Carlo simulations (mri_glmfit-sim) with a voxel-wise threshold of p < 0.001 and a cluster threshold of 0.05. We ran Freesurfer’s volumetric pipeline separately for the subcortical regions with the same parameters. Statistical corrections were done using three spaces (right, left hemisphere and subcortical).
Functional Connectivity Analyses
To obtain timeseries to use in the functional connectivity (FC) analysis, non-smoothed functional images were denoised using Nilearn (Abraham et al., 2014). We implemented voxel-wise confound regression by regressing out signals from six aCompCor components, 24 motion parameters representing 3 translation and 3 rotation time-courses, their temporal derivatives, and quadratic terms of both, outlier frames with FD > 0.5 mm and DVARS (Power et al., 2012) with a threshold of ±3 SD, together with their temporal derivatives, task effects and their temporal derivatives (Whitfield-Gabrieli and Nieto-Castañón, 2012), and any general linear trend. Time series were filtered using a 0.008–0.2 Hz band-pass filter.
First we extracted mean time series for each of the 19 ROIs (Figure 2A) separately for each run using Nilearn (Abraham et al., 2014). Then, we picked time points corresponding to each movie trial by controlling for delays due to the hemodynamic response function (HRF) (Whitfield-Gabrieli and Nieto-Castañón, 2012). In this procedure, we first convolved task block regressors with the HRF and applied a filter to retain only positive values of the resultant time series. This filter was applied to the original time series to retain 15 time points for each movie trial. Then, we calculated Pearson’s correlation coefficients between the mean signal time-course of node i and the mean signal time-course of node j, for all pairs of ROIs, for each movie trial. Finally, Fisher’s transformation was employed to convert Pearson’s correlation coefficients to normally distributed z-scores. This procedure resulted in 31 × 19 × 19 correlation matrices for each participant where the first dimension represents the number of movie trials and the last two dimensions a symmetric matrix containing 171 unique pairwise correlation values (edges). For each participant and edge, we computed linear regressions predicting the FC estimates with linear and quadratic regressors to explore connectivity patterns that showed modulations with aesthetic appeal. As a result of these regression analyses for both contrasts, we obtained t-values for every participant and edge. To identify edges with connectivity modulations that were different than zero we computed one sample t-tests for every edge with the values from each participant and computed significance, correcting for multiple comparisons using FDR.
Analysis with continuous ratings
To identify changes in FC related to specific moments of change in observers’ continuous ratings, we used a technique called multiplication of temporal derivatives (MTD) with a window length of 3 (7 total time points; Shine et al., 2015). We performed GLM analyses to model the MTD connectivity estimates using regressors created from the continuous ratings that indicated moments of change toward increasing or decreasing aesthetic enjoyment. The MTD timeseries and the regressors were concatenated across runs. The regressors were convolved with an HRF and downsampled to 0.5 Hz to match the time resolution of the functional data. Only three key nodes were included in this analysis: PPA, aMPFC and PCC. For the three unique comparisons that were possible across these three edges we compared the t-values for each regressor obtained from the GLM analyses for each participant with paired t-tests.
Results
Idiosyncratic Patterns of Aesthetic Enjoyment
Participants viewed movie clips of natural landscapes while rating their subjective level of aesthetic enjoyment at each moment (continuous rating), followed by a discrete judgment indicating the intensity of their aesthetic experience (overall rating; Figure 1A).
Despite mostly favorable overall ratings (Figure 1B), observers expressed a high degree of individuality, both in their distributions of responses and also in which clips they found most aesthetically appealing. Some observers tended to use only a small range of the scale, while others spread ratings across the full range (Figure 1C). The amount of “shared taste,” quantified by computing a “mean-minus-one” (MM1) correlation between each participant and group-averaged ratings (see Methods) was MM1 = 0.40 (95% CI 0.31–0.48; Figure 1D left). This is lower than the degree of agreement previously reported for still images of landscapes (MM1 = 0.60, 95% CI 0.53–0.66, Vessel et al., 2018). Partitioning the repeatable variance into shared and individual components (Germine et al., 2015; Martinez et al., 2020, see Materials and Methods) revealed that 12% of the variance in overall ratings was shared across participants, whereas 88% was attributable to individual taste.
To explore how subjective aesthetic enjoyment changed over time, we inspected the trial-by-trial continuous rating time series and again found large differences in individual responses, both across movies but also across participants. A measure of moment-to-moment agreement across participants (mean-minus-one “continuous” correlation, MM1c, see Materials and Methods) was MM1c = 0.61 (95% CI 0.52–0.69; Figure 1D, right) suggesting that moment-to-moment ratings were in fact more stable across people than overall ratings. Figure 1E depicts the continuous ratings from each participant for one movie (selected for showing the median MM1c score). Despite the higher average agreement on this measure, it is still clear that participants often showed divergent continuous rating profiles for the same movie, ranging from strongly liked to disliked, and from mostly flat to dynamically fluctuating.
A measure of motion energy computed from each video (see Materials and Methods) revealed that the amount of motion was not a significant driver of continuous nor overall aesthetic ratings: the mean correlation between participants’ continuous ratings and framewise motion energy was r = 0.03 (95% CI 0.01–0.04), and the mean correlation between average motion energy across each entire clip and overall ratings was r = 0.15 (95% CI 0.08–0.22).
Landscape Movies Engaged Early Visual as Well as Ventral and Lateral Occipitotemporal Cortex
We characterized the strength of fMRI BOLD response to landscape movies in visual, reward and default-mode (DMN) brain regions using a set of independently defined regions-of-interest (ROIs; see Methods; Figure 2B). As expected, landscape movies strongly engaged all visual regions tested (Pericalcarine, FFA, LO, hMT+, OPA, PPA, RSC, t-tests vs. resting baseline, all p’s < 0.003, Bonferroni corrected). Highest average responses were observed in pericalcarine, LO, OPA and PPA. On the contrary, DMN regions were not, on average, consistently modulated by the landscape movies. Within reward regions, the lateral OFC was significantly activated by the landscape movies when compared to a resting baseline (one sample t-test, t = 5.49, p < 0.003, Bonferroni corrected), whereas the nucleus accumbens showed less activation compared to a resting baseline (one sample t-test, t = −5.34, p < 0.003, Bonferroni corrected).
Despite showing responsivity to the landscape movies, none of the a priori visual ROIs were significantly modulated by rated aesthetic appeal (Figure 2C), nor were reward or DMN ROIs (not shown). To overcome differences in scale use across observers, overall ratings from each participant were used to split the movies into four levels of aesthetic appeal. Contrasts of highly appealing vs. low appealing trials (“4 vs. 1”; Supplementary Table S1) and highly appealing vs. all other trials (“4 vs. 321”; Supplementary Table S2) did not reveal any significant modulations after correcting for multiple comparisons. At a less stringent, uncorrected threshold of p < 0.01, only OPA showed greater activity for highly appealing movies vs. other trials (4 vs. 321 contrast, p = 0.007).
Aesthetically Appealing Movies of Natural Landscapes Engage Portions of Occipitotemporal Cortex and the Basal Ganglia
Looking beyond the a priori ROIs, a whole-brain analysis revealed several posterior cortical regions whose activity was modulated by aesthetic appeal. A contrast of high- vs. low- appeal movies (4 vs. 1) revealed activity in right and left collateral sulcus (CoS) and left posterior middle temporal gyrus (pMTG; Figure 3 white outlines, Table 1). A contrast of high-rated trials vs. all other trials (4 vs. 321) produced activations that overlapped with the 4 vs. 1 contrast in the CoS of both hemispheres and in the left posterior MTG, as well as an additional activation cluster in the middle occipital sulcus (MOS; Figure 3 solid red, Table 1).
Figure 3. Brain regions modulated by aesthetic appreciation of landscape movies. Significant clusters of activations from a whole-brain beta series GLM analysis are shown for group contrasts of 4 vs. 1 (white outlines) and 4 vs. 321 (solid red: cortical, red outline: subcortical) levels of aesthetic appeal. N = 24. Black outlines show the scene-selective regions as found by the functional localizer task. PPA, parahippocampal place area; OPA, occipital place area; NAc, Nucleus Accumbens.
Table 1. MNI coordinates for activations found in a whole-brain beta series GLM analysis for 4 vs. 1 and 4 vs. 321 contrasts.
Interestingly, the locations of these clusters sensitive to aesthetic appeal were adjacent to or even partly overlapping with regions of known stimulus selectivity from the localizer scans. The ventrally located clusters in CoS from both appeal contrasts partially overlapped with scene-selective cortex (PPA) as identified by the separate scene localizer scan, in both right and left hemispheres. In the right hemisphere, the effect of aesthetic appeal was shifted anterior and lateral from PPA, and in the left hemisphere it was shifted laterally. On the lateral surface, the more anterior appeal-sensitive cluster in pMTG was mostly anterior to the motion-sensitive hMT+, showing only a small degree of overlap, while the posterior cluster in MOS was situated between hMT+ and the scene-selective OPA (Figure 3).
The contrast of high-rated trials vs. all other trials (4 vs. 321) also produced a large subcortical cluster spanning several nuclei of the basal ganglia, including dorsal striatum (head of caudate [10, 12, 2], anterior putamen [24, 0, −2]) and anterior pallidum [20, 0, 0]. A small portion of this cluster also extended into ventral striatum [10, 7, −6] and anterior insula [39, 5, −6].
Topographical Relationship Between Effects of Stimulus Content vs. Aesthetic Appeal for both Movies and Images of Natural Landscapes
We sought to more closely examine the topographical relationship between modulations of cortical activity by stimulus content vs. by aesthetic appeal. Using data from this experiment, recorded as observers judged the aesthetic appeal of movies of natural landscapes, as well as data from a previously published experiment in which a different set of observers made aesthetic judgments about still images of natural landscapes (Vessel et al., 2019), we compared content-related activations for both still images and movies with observed modulations by highly appealing stimuli (Figure 4).
Figure 4. Comparison of stimulus-induced and appeal-related activations for both movies and still images of natural landscapes. Significant clusters from stimulus vs. baseline and aesthetic appeal contrasts (4 vs. 321) from two experiments were rendered on Freesurfer’s fsaverage cortical surface. Solid warm colors illustrate movie vs. baseline contrast (yellow) and effect of high appeal movies (4 vs. 321, red). Outlined cold colors illustrate still images vs. baseline contrast (teal) and effect of high appeal images (4 vs. 321, purple) obtained with static natural landscape images from Vessel et al. (2019). Top: inflated surfaces showing a ventral view of right (RH) and left (LH) hemispheres, and lateral and medial views of the left hemisphere. Bottom: flattened left hemisphere. Movie N = 24, Image N = 16.
In comparison to still images of landscapes (landscape images vs. resting baseline, blue outline), movies activated a greater extent of cortex (landscape movies vs. resting baseline, solid yellow, Supplementary Table S3), particularly dorsally, on both the lateral and medial surfaces. Activations for movies covered more of the lateral occipital cortex and extended into inferior and superior parietal regions. Additionally, movies of landscapes activated a region of inferior frontal gyrus and lateral orbitofrontal cortex on the left hemisphere and three more clusters around inferior frontal sulcus, inferior frontal gyrus and superior frontal sulcus on the right hemisphere. On the other hand, still images of landscapes produced activations in the isthmus of the posterior cingulate gyrus (retrosplenial cortex), as well as several prefrontal locations, including middle frontal and precentral gyri and small portions of lateral orbitofrontal gyrus and insula.
Turning to the modulations by aesthetic appeal, we found that the clusters on the lateral surface that showed greater activity for aesthetically appealing movies of natural landscapes (pMTG and MOS, Figure 4, filled red) sit at the anterior edge of the movie vs. baseline activation. This was not the case for the ventrally situated clusters in CoS. In addition, none of these clusters strongly overlapped the effect of aesthetic appeal observed for still images of natural landscapes, which extended across parts of the fusiform gyrus, lateral occipital cortex and inferior and middle temporal gyri (Figure 4, purple outline; data from Vessel et al., 2019).
Changes in Functional Connectivity Associated with Aesthetic Appeal
We tested the hypothesis that aesthetic appeal is associated with changes in functional connectivity between content-sensitive visual regions and reward and DMN networks. To do so, we computed functional connectivity (FC) scores between each pair of a priori ROIs from the three networks, separately for each movie stimulus, using Pearson correlation (see Materials and Methods). We then modeled the trialwise FC estimates as a function of each observers’ overall aesthetic ratings using both linear and quadratic regressors, separately for each observer, and tested the resulting t-scores from these regressions for significance at the group level using one-sample t-tests (corrected for multiple comparisons using false discovery rate, FDR with q < 0.05; Benjamini and Hochberg, 1995).
Connectivity between our a priori ROIs was only weakly related to overall aesthetic appeal, as none of the edges tested in this analysis surpassed this stringent multiple comparisons threshold. However, when we examine the (uncorrected) pattern of average connectivity, several noteworthy relationships do emerge. For the linear effect of aesthetic appeal (Figure 5, lower half), connectivity between NAc and several visual regions increased with increasing aesthetic appeal [NAc:pericalcarine t(23) = 2.60, NAc:hMT+ t(23) = 2.14, NAc:OPA t(23) = 2.21], and NAc also showed increasing connectivity with several orbitofrontal regions [NAc:lOFC t(23) = 2.67, NAc:maOFC t(23) = 2.76]. PCC, a core DMN region, showed stronger FC with OPA with increasing aesthetic appeal [PCC:OPA, t(23) = 2.36]. Increased connectivity was also observed between two nodes of scene-selective cortex, PPA:RSC t(23) = 2.08, and between mOFC:hMT+, t(23) = 2.24. The quadratic effect of aesthetic appeal was included to identify edges with highest FC for extreme values of aesthetic appeal regardless of direction (U-shaped relationship; Figure 5, upper half). Connectivity between the caudate and several sensory regions was modulated by aesthetic appeal in a quadratic fashion [caudate:FFA t(23) = 3.10, caudate:OPA t(23) = 3.11, caudate:PPA t(23) = 2.35], as was FC between several DMN and reward regions [pallidum:aMPFC t(23) = 4.01, caudate:dMPFC t(23) = 2.34, pallidum:PCC t(23) = 2.30, aMPFC:maOFC t(23) = 2.13], and within several nodes of the reward network [caudate:pallidum t(23) = 3.22, caudate:lOFC t(23) = 2.66, putamen:mOFC t(23) = 2.29, pallidum:lOFC t(23) = 2.20, NAc:maOFC t(23) = 2.29]. Pericalcarine also showed a U-shaped relationship with one DMN [Pericalc:dMPFC t(23) = 2.31] and one reward node [Pericalc:Putamen t(23) = 2.17]. Finally, the connection between IPL and NAc showed a negative quadratic relationship to aesthetic appeal [IPL:NAc t(19) = −2.45].
Figure 5. Predicting trial-wise functional connectivity estimates between a priori ROIs from visual, reward and DMN networks. FC scores were computed between each pair of a priori ROIs, separately for each movie stimulus, and modeled as a function of overall aesthetic ratings using both linear and quadratic regressors. Heat maps show t-scores from group level one-sample t-tests, conducted with the t-scores from the regressions for each edge. For the linear effect of aesthetic appeal (lower half), FC modulations were observed mainly between nucleus accumbens (NAc) and sensory ROIs and NAc and OFC ROIs (see text). For the quadratic effect (upper half) FC modulations were found between reward and sensory ROIs, between reward and DMN ROIs and within reward ROIs. N = 24. No scores were significant at q < 0.05 corrected for multiple-comparisons (false-discovery rate). One edge, (pallidum:aMPFC quadratic) was less than p < 0.001 (uncorrected).
We performed an additional analysis to test for possible changes in connectivity linked to moment-to-moment changes in aesthetic appeal, using observers’ continuous ratings of enjoyment. Restricting our analysis to 3 key ROIs (PPA, aMPFC, PPC) we modeled dynamic (time series) estimates of FC computed using the multiplication of temporal derivatives method (MTD, see Materials and Methods) with regressors coding for either positive or negative moments of change. None of the edges reached significance.
Discussion
A core component of visual aesthetic experiences is the transformation of information about the contents of perception to a representation of aesthetic appeal. Using functionally defined ROIs, a robust approach more often used in studies of high-level vision, we tested whether independently localized posterior regions of the brain that represent perceptual features (e.g., scene layout or motion) are themselves modulated by aesthetic appeal. Using movies of natural landscapes, we found strong engagement of scene-selective regions in ventral (PPA) and medial (RSC) occipitotemporal cortex, as well as in lateral portions of visual cortex including scene-selective OPA, object-selective LO and motion sensitive hMT+. However, activity in these feature-selective regions was not significantly modulated by rated aesthetic appeal. Instead, we found greater activity for highly appealing movies in regions that were adjacent to and only partially overlapping with the feature selective ROIs, both on the ventral (bilateral CoS) and lateral (left pMTG and MOS) cortical surfaces. A large cluster spanning several nuclei of the right basal ganglia also showed increased activity for highly appealing movies. These findings suggest that regions representing core visual features such as scene shape and motion are not directly modulated by aesthetic appeal. Rather, adjacent cortex may be involved in the computation of information that is more directly relevant for aesthetic valuation. Additionally, contrary to what has been observed for artworks, we did not find evidence for modulation of prefrontal or default-mode regions correlated with aesthetic appeal. Finally, we did not find strong evidence for modulation of functional connectivity between feature-selective visual regions and nodes of reward or default-mode networks.
In contrast to previous studies using static images of scenes (Yue et al., 2007) and natural landscapes (Vessel et al., 2019), we did not find direct modulation by aesthetic appeal in scene-selective PPA, identified using an independent localizer scan (contrast of scenes vs. objects). Rather, a whole brain analysis identified bilateral clusters in CoS immediately adjacent to and partially overlapping with PPA that were more activated by the most appealing natural landscape videos. Note that at the level of individual observers, appeal-related effects were not reliably found in PPA. The apparent overlap on the left hemisphere is due to differences in the precise location of ROIs in individual observers compared to the rendered location of PPA on the group-averaged surface. These findings are generally consistent with many studies that have previously reported modulations by aesthetic appeal in portions of the ventral visual pathway (the “what” pathway; Goodale and Milner, 1992) thought to support an analysis of object and scene identity, though the precise locations of these activations have not been systematically investigated, and appear to vary with stimulus category (see Vessel, 2020).
Highly appealing movies of natural landscapes also led to greater activation in two clusters on the lateral surface, pMTG and MOS. Whereas modulation of lateral visual regions by aesthetic appeal has been reported in MOG for indoor built environments (Vartanian et al., 2013b), in hMT+ for kinetic dot patterns (Zeki and Stutters, 2012) and in LO for natural landscapes (Pegors et al., 2015) this is the first report of modulation by aesthetic appeal of natural landscape stimuli dorsal to LO. Similar to what was found on the ventral surface, these activations did not fall directly within scene-selective OPA nor motion-selective hMT+, but were rather adjacent. Increased engagement for dorsolateral portions of visual cortex, extending toward the dorsal visual stream (the “where” or “how” pathway; Goodale and Milner, 1992; Kravitz et al., 2011a), is likely a natural consequence of introducing motion in the stimuli (e.g., Zhao et al., 2020). However, modulation of the dorsal visual stream by aesthetic appeal is not well documented or understood (though see Calvo-Merino et al., 2008; Calvo-Merino et al., 2010; Zardi et al., 2021) for studies linking the aesthetics of dance and activity in extrastriate body area (Downing et al., 2001).
From Visual Content to Aesthetic Appeal
Given previous work supporting the direct modulation of feature- or category-selective regions by aesthetic appeal (scenes in PPA but also for attractive faces in FFA, e.g., Iaria et al., 2008; Chatterjee et al., 2009; Pegors et al., 2015), it has been proposed that these regions might be directly involved in computations of aesthetic value (Chatterjee et al., 2009). Yet the results presented here suggest some care is needed. One important caveat is that only a subset of previous studies on aesthetic appeal have employed independent functional localizers, making it difficult to evaluate whether appeal-related activations fall precisely within feature- or category-selective regions. Furthermore, it is difficult to assess the degree to which appeal-related effects have been dissociated from stimulus-related effects across the literature. Faces and landscapes, in particular, tend to generate high agreement across people in which images they find appealing (“shared taste”; Hönekopp, 2006; Vessel et al., 2018). Thus, it is possible that previously reported activations in category-selective regions did not reflect a local representation of aesthetic appeal, but rather residual imbalances in visual features that were associated with aesthetic appeal and also led to greater activation of category-selective regions. For example, facial averageness correlates positively with average attractiveness ratings (Rhodes, 2006) and is also known to modulate FFA (Said et al., 2010) (albeit in the opposite direction). On the other hand, appeal-related activations have also been reported in occipitotemporal regions for stimulus sets with almost no shared taste, such as visual artworks (Vessel et al., 2012). Given that the movies used in this experiment generated low levels of agreement across participants’ overall ratings (only 12% “shared” variance), and no relationship was observed between motion energy measures and rated aesthetic appeal, it is likely that the activations reported here reflect processes related to aesthetic appeal rather than low-level stimulus characteristics. This may be one reason why the activations reported here appear mostly adjacent to, rather than in, category-selective PPA, hMT+ and OPA. This leaves us with the question of what is actually driving the observed responses. There are at least two potential answers to this question.
One possibility is that these activations adjacent to category-selective regions encode higher-level features that, while still “visual,” are not well captured by typical localizer contrasts. In the case of the ventral visual pathway, this could include factors such as visual openness (the degree to which a scene provides a wide angle of view; Greene and Oliva, 2009) and concreteness (the degree to which an image depicts specific representational content; Chatterjee et al., 2010). Both of these factors have been shown to be positively correlated with aesthetic ratings (Franz et al., 2005; Biederman and Vessel, 2006; Vartanian et al., 2015; Iigaya et al., 2020) and to modulate neural activity in higher level visual regions (though for openness in the opposite direction) (Henderson et al., 2011; Iigaya et al., 2020). In the case of the dorsal visual pathway, this may include higher-order motion cues (such as that observed in clouds), responses to optic flow, object tracking, or the degree to which a landscape affords exploration. If this were the case, the activations reported here (and potentially those observed in other studies of visual appeal) might reflect the extraction of such higher-order, non-local visual properties rather than true sensitivity to aesthetic appeal.
An alternative interpretation is that these activations adjacent to the category-selective regions reflect a transformation from a purely feature-based representation to a more complex, processing-based representation that reflects how a stimulus relates to an observers’ expectations, associations and past experiences. Information-based theories of aesthetic appeal propose that experiences are most pleasurable when they have the capacity to be understood while still providing novel information to the observer (Biederman and Vessel, 2006; Schmidthuber, 2010; Schoeller and Perlovsky, 2016) and thus optimize information acquisition. In the music domain, several recent studies have provided support for this idea, finding that pleasure in melodic sequences is highest when uncertainty (predictability, entropy) and surprise are balanced (Cheung et al., 2019; Gold et al., 2019). The movies used in this study afforded many opportunities for such novel, richly interpretable experiences, particularly given their use of novel viewpoints (from drones, helicopters or hard-to-reach locations), changes in perspective (panning, flying) and temporal modifications (double speed, time-lapse). These movies allowed participants to have experiences with the natural environment that are outside the typical range of experience, but not so strange as to be uninterpretable. The higher activation that we observed in CoS, MOS, and pMTG for highly appealing movies may therefore reflect a process that is not linked to any specific set of visual features, but rather to the informational richness of the observers’ experiences, which in turn results in reward and pleasure. More broadly, the wide variety of appeal-related activations reported in the ventral visual pathway for many different categories of stimuli may reflect such interactions between bottom-up stimulus-driven activity and top-down sense-making.
These sense-making processes likely represent an elemental form of affect. While affective factors such as valence (pleasure, displeasure) and arousal may only be explicitly represented in other, more specialized structures (Salzman and Fusi, 2010; Berridge and Kringelbach, 2013) there is accumulating evidence suggesting that affect related schemas (e.g., value, emotion) are embedded in the human visual system (Kragel et al., 2019) and that affective predictions already emerge during the early stages of visual object recognition (Barrett and Bar, 2009). Such local operations, occurring in sensory hierarchies, may contribute to affective appraisals of novelty and coping potential (Roseman and Smith, 2001; Silvia, 2005).
In a related manner, contextual associations, semantic interpretations and imagery triggered by a stimulus can also influence aesthetic appeal (Palmer and Schloss, 2010; Vessel and Rubin, 2010; Gartus and Leder, 2014; Belfi et al., 2018; Belfi, 2019; Levitan et al., 2020). Contextual associations, crucial for making sense of a scene, have been linked to activation in the parahippocampal gyrus (Aminoff et al., 2007), potentially overlapping with PPA. Stimuli that activate a broad network of semantic and contextual associations evoke strong activity in later stages of the ventral visual pathway that mediate object and scene recognition (Bar and Aminoff, 2003; Aminoff et al., 2007), increasing the interpretability of an experience and its associated pleasure (Biederman and Vessel, 2006). Several recent studies have reported activations falling anterior to the scene-selective regions in response to recall of scene-related visual information (Silson et al., 2019; Bainbridge et al., 2020). The activation cluster we found in the right CoS, just anterior to the PPA, may reflect engagement of memory-based representations of scene imagery and associations, in interaction with the ongoing stimulus. A similarly local mechanism, tuned to the detection of broadly associative activity in later states of perceptual pathways, could link such activity to affect (Biederman and Vessel, 2006). More generally, the transition from stimulus-linked activity to affectively tinged representations may align with other proposed gradients in higher sensory and associative regions, reflecting increasingly complex representations along a posterior to anterior gradient from hMT+ to perisylvian fissure; this transition has been suggested to represent a form of abstraction (Kable et al., 2002; Chatterjee, 2010).
Movies Versus Still Images
When comparing the areas associated with aesthetic appeal of movies vs. images of landscapes, we found greatly increased engagement of lateral and dorsal regions for appealing movies. For the field, this finding points to the need for visual neuroaesthetics to avoid a narrow focus on the ventral visual pathway. On the ventral surface, we found that while appeal-related activations for movies were in the CoS and PHG, appeal for static images appeared to more strongly engage parts of the fusiform gyrus and LO. One possibility for this difference is that the increase in ecological validity afforded by movies improved their capacity to invoke contextual associations compared to scenes. Alternatively, the presence of motion-induced depth cues in movies may have driven attentional focus to scene shape and layout. Static images, lacking such cues, may permit greater attention to flow to individual object representations, and thus engage object-selective cortex such as LO to a greater degree. If this were the case, future research might test the prediction that aesthetic judgments of images are more determined by object content, whereas judgments of movies may be more related to scene shape than to object content. A final explanation to consider for some of the observed differences is that certain activations reported for static images may reflect short-lived effects related to the onset of a stimulus that are not maintained over the course of a 30 s movie.
Engagement of Subcortical Reward Circuitry During Aesthetic Experiences With Natural Landscapes
We found a large cluster of activation extending over several nuclei of the right basal ganglia that responded more strongly to highly appealing movies, compared to other movies. This cluster was primarily contained within dorsal striatum structures such as caudate nucleus and putamen and included only a small fraction of ventral striatum (NAc). There is some discrepancy in the neuroaesthetics literature as to which structures of the basal ganglia are more relevant for aesthetic appeal, given that studies have reported activations in different areas (see Vessel, 2020). One study from the music domain proposed distinct roles for dorsal and ventral striatum in aesthetically appealing experiences; they proposed that activation in the caudate (dorsal striatum) is related to the anticipation of peak moments of pleasure, whereas NAc activation is involved in the consummatory aspects of musically induced pleasure (Salimpoor et al., 2011). A related proposal from the decision-making literature posits that dorsal striatum performs an “actor” function of learning and habit formation (Maia, 2009) and reward expectation (Delgado et al., 2000, 2003) and ventral striatum performs a “critic” function, representing actual rewards and reward prediction error (Schultz et al., 1992; Setlow et al., 2003; Wan and Peoples, 2006). Although this is a compelling theory, it failed to find support in a recent study that showed an opposite pattern for moments of poetry-evoked chills (Wassiliwizky et al., 2017) and in work implicating the NAc in tracking uncertainty during music rather than peak pleasure (Cheung et al., 2019).
An alternative explanation for the differential roles of ventral and dorsal striatum during aesthetically rewarding moments relates to the time scale of the reward prediction, rather than anticipation or consumption per se. Studies investigating reward prediction at different time scales have found that a number of areas in the limbic loop, including the ventral striatum, are involved in the prediction of immediate rewards; dorsal striatum, a part of the motor loop, was found to be involved in future reward prediction (Tanaka et al., 2004). The activation of dorsal striatum in response to aesthetically appealing landscape movies (this study) and images (Yue et al., 2007; Ishizu and Zeki, 2014) might relate to the fact that many of the pleasing features of landscapes relate to potential reward such as the potential for habitat, for exploration, for resource availability, or for monitoring one’s surroundings – environmental conditions favorable to survival (Rostrup, 2014).
Lack of Modulation in Prefrontal and DMN Structures by Aesthetic Appeal
A secondary aim of this study was to evaluate whether aesthetically appealing natural landscapes lead to greater activation in mPFC, OFC or in nodes of the DMN. Many studies have reported modulation by aesthetic appeal in portions of mPFC, particularly in or around the superior rostral sulcus (Vessel, 2020). The mPFC, particularly vMPFC, is strongly implicated in the representation of subjective value (Bartra et al., 2013), and portions of the mPFC are also part of the DMN (Raichle et al., 2001; Andrews-Hanna et al., 2010). This finding has been particularly robust for aesthetically appealing artworks (Kawabata and Zeki, 2004; Vartanian and Goel, 2004; Lacey et al., 2011; Vessel et al., 2012; Belfi et al., 2019). In the current study, we did not find significant modulation by aesthetic appeal in mPFC, nor in independently localized nodes of the DMN, using both whole-brain and ROI-based analyses. One previous study with images of natural landscapes found sensitivity to landscape appeal only when using a small-volume correction in an a priori defined vMPFC ROI (Pegors et al., 2015). On the other hand, more sensitive, pattern-based analyses have found more robust information about the appeal of natural landscape images in mPFC (Pegors et al., 2015) and several nodes of the DMN (Vessel et al., 2019). However, more direct evidence for overall activation of DMN, mPFC or mOFC by landscapes is sparse.
The discrepancy between activation-based and pattern-based analyses may point to the relevance of spatial scale. Aesthetic appeal for landscapes may be represented in mPFC and other DMN nodes at a spatial scale that is too fine to survive an activation-based analysis, which requires a degree of spatial smoothing and averaging across observers. However, this possibility does not address the discrepancies observed for different aesthetic domains: sparse evidence for mPFC activation by appealing landscapes, but more robust evidence for appealing visual artworks.
One potential avenue for explaining this discrepancy may come from a differential contribution of bottom-up vs. top-down processing to appealing experiences with landscapes vs. artworks. Aesthetic experiences with artworks, more so than those with landscapes, may engage explicit, effortful top-down mechanisms supporting sense-making, imagery and resolution of ambiguities (Muth et al., 2015) incorporation of art-specific knowledge (Belke et al., 2006; Leder and Nadal, 2014), evaluation of artistic intent (Bullot and Reber, 2013) and assessments of self-relevance (Vessel et al., 2013; Pelowski et al., 2017). On the other hand, aesthetic experiences with natural landscapes, while clearly still engaging predictive and sense-making processes, may depend to a greater degree on bottom-up perceptual analyses and comparison to well-formed categorical representations of the natural world (Balling and Falk, 1982; Kaplan and Kaplan, 1989) developed over a lifetime of experience. Several lines of evidence support this interpretation. An experiment with natural landscape movies that evoked the feeling of awe (Keltner and Haidt, 2003), an aesthetic emotion closely related to beauty and being moved (Schindler et al., 2017), found that such movies were associated with a reduced sense of self and also reduced activity in core nodes of the DMN (mPFC, PCC; VanElk et al., 2019). Behaviorally, observers tend to agree on which natural landscapes they find appealing (high shared taste), but show much more individual taste for aesthetic judgments of artwork and architecture (Vessel et al., 2018). This increased agreement is due to the highly consistent way in which different observers semantically interpret a real-world scene compared to abstract images or artworks (Vessel and Rubin, 2010; Schepman et al., 2015; Leder et al., 2016) which itself may be a consequence of the behavioral relevance of understanding the physical landscape for everyday living, compared to a relative lack of daily relevance for assessments of artwork. Aesthetic responses to landscapes, then, may engage a set of interpretation processes that, while still able to generate surprise, contextual associations and rich interpretability, are more automated, more stereotyped, and less top-down. Indeed, a recent wave of research on nature’s capacity to reduce stress and improve cognitive functioning (Berman et al., 2008; Bratman et al., 2015a, b) posits that the “restorative” benefits of interacting with nature are on account of the natural environment’s ability to capture attention in a relatively effortless manner, while providing a degree of “mild fascination” (Kaplan and Kaplan, 1989).
Interestingly, in this and a previous study (Isik and Vessel, 2019) we observed that across-observer agreement for overall assessments of aesthetic appeal for movies of natural landscapes was significantly lower than that previously reported for still images of natural landscapes (Vessel et al., 2018). However, across-observer agreement for moment-to-moment ratings of enjoyment was higher. These findings suggest that moment-to-moment enjoyment of landscape movies may be a more bottom-up process without much need for integration from top-down mechanisms, but that subsequent overall assessments of these movies, performed after watching each clip, may draw on more top-down processes than is typical for images of natural landscape.
Weak Evidence of Changes in Functional Connectivity Associated with Aesthetic Appeal
Our third aim was to test whether category-selective visual regions are functionally connected with prefrontal (Lim et al., 2013) or reward (Salimpoor et al., 2013) regions in a manner that is modulated by aesthetic appeal. Although we did observe a degree of FC modulation correlated with aesthetic appeal, particularly in connection with NAc, the effects were weak and did not reach statistical significance. Furthermore, although studies have reported increases in DMN’s intra-functional coupling during experiences with preferred music (Wilkins et al., 2014), we found only weak modulations involving DMN nodes for aesthetic appeal of natural landscape videos.
However, due to several limitations, it may be too soon to completely rule out the presence of such FC modulations. For example, it is possible that the moment-to-moment responses to the clips might not have varied enough to drive detectable fluctuations in functional connectivity; this possibility derives some support from an inspection of the continuous ratings, which were relatively flat for some observers. Additionally, the overall ratings skewed heavily positive, potentially resulting in a relatively weak contrast between the psychological states associated with high-rated and low-rated clips. This may have affected our ability to detect associated changes in functional network modulations. Alternatively, it is also possible that reward and DMN regions integrated information over time in a manner that blurred out such content-related fluctuations in functional connectivity (Simony et al., 2016). A further potential limitation may be related to length of the clips. It is possible that a 30 s time window (15 timepoints) was too brief for detecting FC fluctuations against a background of other high-frequency noise fluctuations in the BOLD signal. Some studies suggest using longer stimulus durations and sliding window correlations over longer window lengths in order to resolve lower frequency fluctuations of interest (Sakoǧlu et al., 2010). Finally, it is possible that brain connectivity dynamics may be more susceptible to alteration or masking by the requirement to make simultaneous, continuous ratings. Although existing behavioral (Isik and Vessel, 2019) and fMRI (Hutcherson et al., 2005) evidence provides no strong support for the alteration of participants’ aesthetic experiences due to simultaneous continuous ratings, several studies have claimed that explicit evaluations have an effect on functional connectivity dynamics (for music listening; Bogert et al., 2016; Liu et al., 2017).
Conclusion
Natural landscapes are rich sources of aesthetic appeal, and by virtue of their central role in research on visual perception, can also serve as an important bridge between the fields of scene perception and neuroaesthetics. We conclude that aesthetic appeal per se is likely not represented in well-characterized feature- and category-selective regions of the visual system. Rather, we propose that modulations by aesthetic appeal observed in the visual system reflect a transformation from a feature-based visual representation to a representation of elemental affect, computed through information-processing mechanisms that rely on the detection of deviations from an observer’s expectations and activation of richly interpretable semantic and contextual associations. While the exact nature of these transformations remains unclear, we believe that these findings bring a new perspective to the difficult problem of how the brain computes affectively marked appraisals of aesthetic appeal from representations of visual content.
Our findings also hint at a potentially important difference between different aesthetic domains. While interactions between bottom-up and top-down processes likely play a role in the appreciation of all aesthetic experiences, the balance of these interactions may differ from one domain to the next. The evidence suggests that aesthetically appealing experiences with natural landscapes, in contrast to those with visual artworks, engage top-down processes supported by prefrontal cortex to a lesser degree.
Data Availability Statement
The raw data supporting the conclusion of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by the Medical Ethics Committee of Goethe University Frankfurt. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
AI and EV designed the study, interpreted the results, and wrote the manuscript together. AI collected and analyzed the data. Both authors contributed to the article and approved the submitted version.
Funding
This work was supported by The Max Planck Society.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors would like to thank Emily Grossman for providing motion dot stimuli, Brian Gonzalez for assistance with landscape videos, A. Chatterjee and C. Honey for discussions about design and analysis. Daniela van Hinsberg and Sébastien Nikolay for help in data collection, Omer Faruk Gulban for help in programming, and Dejan Draschkow for advice on statistics.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnhum.2021.676032/full#supplementary-material
Footnotes
- ^ https://github.com/nipy/heudiconv
- ^ https://fmriprep.org/en/1.1.8/api/index.html#phase-encoding-polarity-pepolar-techniques
- ^ https://fsl.fmrib.ox.ac.uk/fsl/fslwiki
References
Abraham, A., Pedregosa, F., Eickenberg, M., Gervais, P., Mueller, A., Kossaifi, J., et al. (2014). Machine learning for neuroimaging with scikit-learn. Front. Neuroinform. 8:14. doi: 10.3389/fninf.2014.00014
Aguirre, G. K., Detre, J. A., Alsop, D. C., and D’Esposito, M. (1996). The parahippocampus subserves topographical learning in man. Cereb. Cortex 6, 823–829. doi: 10.1093/cercor/6.6.823
Aharon, I., Etcoff, N., Ariely, D., Chabris, C. F., O’Connor, E., and Breiter, H. C. (2001). Beautiful faces have variable reward value. Neuron 32, 537–551. doi: 10.1016/s0896-6273(01)00491-3
Aminoff, E., Gronau, N., and Bar, M. (2007). The parahippocampal cortex mediates spatial and nonspatial associations. Cereb. Cortex 17, 1493–1503. doi: 10.1093/cercor/bhl078
Andrews-Hanna, J. R. (2012). The brain’s default network and its adaptive role in internal mentation. Neuroscientist 18, 251–270. doi: 10.1177/1073858411403316
Andrews-Hanna, J. R., Reidler, J. S., Sepulcre, J., Poulin, R., and Buckner, R. L. (2010). Functional-anatomic fractionation of the brain’s default network. Neuron 65, 550–562. doi: 10.1016/j.neuron.2010.02.005
Atchley, R. A., Strayer, D. L., and Atchley, P. (2012). Creativity in the wild: improving creative reasoning through immersion in natural settings. PLoS One 7:e51474. doi: 10.1371/journal.pone.0051474
Augustin, M. D., Wagemans, J., and Carbon, C. C. (2012). All is beautiful? generality vs. specificity of word usage in visual aesthetics. Acta Psychol. 139, 187–201. doi: 10.1016/j.actpsy.2011.10.004
Bainbridge, W. A., Hall, E. H., and Baker, C. I. (2020). Distinct representational structure and localization for visual encoding and recall during visual imagery. Cereb. Cortex 31, 1898–1913. doi: 10.1093/cercor/bhaa329
Balling, J. D., and Falk, J. H. (1982). Development of visual preference for natural environments. Environ. Behav. 14, 5–28. doi: 10.1177/0013916582141001
Bar, M., and Aminoff, E. (2003). Cortical analysis of visual context. Neuron 38, 347–358. doi: 10.1016/s0896-6273(03)00167-3
Barrett, L. F., and Bar, M. (2009). See it with feeling: affective predictions during object perception. Philos. Trans. R. Soc. B: Biol. Sci. 364, 1325–1334. doi: 10.1098/rstb.2008.0312
Bartra, O., McGuire, J. T., and Kable, J. W. (2013). The valuation system: a coordinate-based meta-analysis of bold fMRI experiments examining neural correlates of subjective value. NeuroImage 76, 412–427. doi: 10.1016/j.neuroimage.2013.02.063
Bates, D., Mächler, M., Bolker, B., and Walker, S. (2015). Fitting linear mixed-effects models using lme4. J. Statist. Softw. 67, 1–48. doi: 10.18637/jss.v067.i01
Beauchamp, M. S., Lee, K. E., Haxby, J. V., and Martin, A. (2003). fMRI responses to video and point-light displays of moving humans and manipulable objects. J. Cogn. Neurosci. 15, 991–1001. doi: 10.1162/089892903770007380
Beckmann, C. F., Mackay, C., Filippini, N., and Smith, S. M. (2009). Group comparison of resting-state FMRI data using multi-subject ICA and dual regression. NeuroImage 47:S148. doi: 10.1016/S1053-8119(09)71511-3
Behzadi, Y., Restom, K., Liau, J., and Liu, T. T. (2007). A component based noise correction method (CompCor) for BOLD and perfusion based fMRI. NeuroImage 37, 90–101. doi: 10.1016/j.neuroimage.2007.04.042
Belfi, A. M. (2019). Emotional valence and vividness of imagery predict aesthetic appeal in music. Psychomusicol. Music Mind Brain 29, 128–135. doi: 10.1037/pmu0000232
Belfi, A. M., Vessel, E. A., Brielmann, A. A., Isik, A. I., Chatterjee, A., Leder, H., et al. (2019). Dynamics of aesthetic experience are reflected in the default-mode network. NeuroImage 188, 584–597. doi: 10.1016/j.neuroimage.2018.12.017
Belfi, A. M., Vessel, E. A., and Starr, G. G. (2018). Individual ratings of vividness predict aesthetic appeal in poetry. Psychol. Aesthetics Creat. Arts 12, 341–350. doi: 10.1037/aca0000153
Belke, B., Leder, H., and Augustin, M. D. (2006). Mastering style. effects of explicit style-related information, art knowledge and affective state on appreciation of abstract paintings. Psychol. Sci. 48, 115–134.
Benjamini, Y., and Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. Ser. B (Methodological) 57, 289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x
Berman, M. G., Jonides, J., and Kaplan, S. (2008). The cognitive benefits of interacting with nature. Psychol. Sci. 19, 1207–1212. doi: 10.1111/j.1467-9280.2008.02225.x
Berridge, K. C., and Kringelbach, M. L. (2013). Neuroscience of affect: brain mechanisms of pleasure and displeasure. Curr. Opin. Neurobiol. 23, 294–303. doi: 10.1016/j.conb.2013.01.017
Biederman, I., and Vessel, E. A. (2006). Perceptual pleasure and the Brain: a novel theory explains why the brain craves information and seeks it through the senses. Am. Sci. 94, 247–253. doi: 10.1511/2006.3.247
Blood, A. J., and Zatorre, R. J. (2001). Intensely pleasurable responses to music correlate with activity in brain regions implicated in reward and emotion. Proc. Natl. Acad. Sci. U S A. 98, 11818–11823. doi: 10.1073/pnas.191355898
Bogert, B., Numminen-Kontti, T., Gold, B., Sams, M., Numminen, J., Burunat, I., et al. (2016). Hidden sources of joy, fear, and sadness: explicit versus implicit neural processing of musical emotions. Neuropsychologia 89, 393–402. doi: 10.1016/j.neuropsychologia.2016.07.005
Bratman, G. N., Daily, G. C., Levy, B. J., and Gross, J. J. (2015a). The benefits of nature experience: improved affect and cognition. Landscape Urban Plann. 138, 41–50. doi: 10.1016/j.landurbplan.2015.02.005
Bratman, G. N., Hamilton, J. P., Hahn, K. S., Daily, G. C., and Gross, J. J. (2015b). Nature experience reduces rumination and subgenual prefrontal cortex activation. Proc. Natl. Acad. Sci. U S A. 112, 8567–8572. doi: 10.1073/pnas.1510459112
Brielmann, A. A., Nuzzo, A., and Pelli, D. G. (2020). Beauty, the feeling. Res. Square 1–24. doi: 10.21203/rs.3.rs-103908/v1
Bronstad, P. M., and Russell, R. (2007). Beauty is in the “we” of the beholder: greater agreement on facial attractiveness among close relations. Perception 36, 1674–1681. doi: 10.1068/p5793
Brown, S., Gao, X., Tisdelle, L., Eickhoff, S. B., and Liotti, M. (2011). Naturalizing aesthetics: brain areas for aesthetic appraisal across sensory modalities. NeuroImage 58, 250–258. doi: 10.1016/j.neuroimage.2011.06.012
Bullot, N. J., and Reber, R. (2013). The artful mind meets art history: toward a psycho-historical framework for the science of art appreciation. Behav. Brain Sci. 36, 123–180. doi: 10.1017/S0140525X12000489
Calvo-Merino, B., Jola, C., Glaser, D., and Haggard, P. (2008). Towards a sensorimotor aesthetics of performing art. Conscious Cogn. 17, 911–922. doi: 10.1016/j.concog.2007.11.003
Calvo-Merino, B., Urgesi, C., Orgs, G., Aglioti, S. M., and Haggard, P. (2010). Extrastriate body area underlies aesthetic evaluation of body stimuli. Exp. Brain Res. 204, 447–456. doi: 10.1007/s00221-010-2283-6
Chang, C., Cheng, G., Nghiem, T., Song, X., Oh, R., Richards, D. R., et al. (2020). Social media, nature, and life satisfaction: global evidence of the biophilia hypothesis. Sci. Rep. 10:4125. doi: 10.1038/s41598-020-60902-w
Chang, L., Jolly, E., Cheong, J. H., Burnashev, A., and Chen, P.-H. A. (2018). cosanlab/nltools: 0.3.11. Genève: Zenodo, doi: 10.5281/zenodo.2229813
Chatterjee, A., Thomas, A., Smith, S. E., and Aguirre, G. (2009). The neural response to facial attractiveness. Neuropsychology 23, 135–143. doi: 10.1037/a0014430
Chatterjee, A., and Vartanian, O. (2014). Neuroaesthetics. Trends Cogn. Sci. 18, 370–375. doi: 10.1016/j.tics.2014.03.003
Chatterjee, A., and Vartanian, O. (2016). Neuroscience of aesthetics. Ann. N. Y. Acad. Sci. 1369, 172–194. doi: 10.1111/nyas.13035
Chatterjee, A., Widick, P., Sternschein, R., Smith, W., and Bromberger, B. (2010). The assessment of art attributes. Empirical Stud. Arts 28, 207–222. doi: 10.2190/EM.28.2.f
Cheung, V. K. M., Harrison, P. M. C., Meyer, L., Pearce, M. T., Haynes, J. D., and Koelsch, S. (2019). Uncertainty and surprise jointly predict musical pleasure and amygdala, hippocampus, and auditory cortex activity. Curr. Biol. 29, 4084–4092.e4. doi: 10.1016/j.cub.2019.09.067
Chikazoe, J., Lee, D. H., Kriegeskorte, N., and Anderson, A. K. (2014). Population coding of affect across stimuli, modalities and individuals. Nat. Neurosci. 17, 1114–1122. doi: 10.1038/nn.3749
Cox, R. W., and Hyde, J. S. (1997). Software tools for analysis and visualization of fMRI data. NMR Biomed. 10, 171–178. doi: 10.1002/(sici)1099-1492(199706/08)10:4/5<171::aid-nbm453>3.0.co;2-l
Cutting, J. E., Brunick, K. L., DeLong, J. E., Iricinschi, C., and Candan, A. (2011). Quicker, faster, darker: changes in hollywood film over 75 years. I-Perception 2, 569–576. doi: 10.1068/i0441aap
Delgado, M. R., Locke, H. M., Stenger, V. A., and Fiez, J. A. (2003). Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn. Affect. Behav. Neurosci. 3, 27–38. doi: 10.3758/CABN.3.1.27
Delgado, M. R., Nystrom, L. E., Fissell, C., Noll, D. C., and Fiez, J. A. (2000). Tracking the hemodynamic responses to reward and punishment in the striatum. J. Neurophysiol. 84, 3072–3077. doi: 10.1152/jn.2000.84.6.3072
Dilks, D. D., Julian, J. B., Paunov, A. M., and Kanwisher, N. (2013). The occipital place area is causally and selectively involved in scene perception. J. Neurosci. 33, 1331–1336. doi: 10.1523/JNEUROSCI.4081-12.2013
Downing, P. E., Jiang, Y., Shuman, M., and Kanwisher, N. (2001). A cortical area selective for visual processing of the human body. Science 293, 2470–2473. doi: 10.1126/science.1063414
Eisenberger, R., Sucharski, I. L., Yalowitz, S., Kent, R. J., Loomis, R. J., Jones, J. R., et al. (2010). The motive for sensory pleasure: enjoyment of nature and its representation in painting, music, and literature. J. Pers. 78, 599–638. doi: 10.1111/j.1467-6494.2010.00628.x
Epstein, R. A. (2008). Parahippocampal and retrosplenial contributions to human spatial navigation. Trends Cogn. Sci. 12, 388–396. doi: 10.1016/j.tics.2008.07.004
Epstein, R. A. (2020). “Spatial knowledge and navigation,” in The Cognitive Neurosciences, 6th Edn, eds D. Poeppel, G. R. Mangun, and M. S. Gazzaniga (Cambridge, MA: MIT Press), 809–816.
Epstein, R. A., and Kanwisher, N. (1998). A cortical representation of the local visual environment. Nature 392, 598–601. doi: 10.1038/33402
Epstein, R. A., and Ward, E. J. (2010). How reliable are visual context effects in the parahippocampal place area? Cereb. Cortex 20, 294–303. doi: 10.1093/cercor/bhp099
Esteban, O., Markiewicz, C. J., Blair, R. W., Moodie, C. A., Isik, A. I., Erramuzpe, A., et al. (2018). fMRIPrep: a robust preprocessing pipeline for functional MRI. Nat. Methods 16, 111–116. doi: 10.1038/s41592-018-0235-4
Fedorenko, E., Hsieh, P.-J., Nieto-Castañón, A., Whitfield-Gabrieli, S., and Kanwisher, N. (2010). New method for fMRI investigations of language: defining ROIs functionally in individual subjects. J. Neurophysiol. 104, 1177–1194. doi: 10.1152/jn.00032.2010
Franz, G., von, der Heyde, M., and Bülthoff, H. H. (2005). An empirical approach to the experience of architectural space in virtual reality—exploring relations between features and affective appraisals of rectangular indoor spaces. J. Environ. Psychol. 14, 165–172. doi: 10.1016/j.autcon.2004.07.009
Gartus, A., and Leder, H. (2014). The white cube of the museum versus the gray cube of the street: the role of context in aesthetic evaluations. Psychol. Aesthet. Creat. Arts 8, 311–320. doi: 10.1037/a0036847
Germine, L., Russell, R., Bronstad, P. M., Blokland, G. A., Smoller, J. W., Kwok, H., et al. (2015). Individual aesthetic preferences for faces are shaped mostly by environments. Not Genes. Curr. Biol. 25, 2684–2689. doi: 10.1016/j.cub.2015.08.048
Gold, B. P., Mas-Herrero, E., Zeighami, Y., Benovoy, M., Dagher, A., and Zatorre, R. J. (2019). Musical reward prediction errors engage the nucleus accumbens and motivate learning. Proc. Natl. Acad. Sci. U S A. 116, 3310–3315. doi: 10.1073/pnas.1809855116
Goodale, M. A., and Milner, A. D. (1992). Separate visual pathways for perception and action. Trends Neurosci. 15, 20–25. doi: 10.1016/0166-2236(92)90344-8
Gorgolewski, K. J., Auer, T., Calhoun, V. D., Craddock, R. C., Das, S., Duff, E. P., et al. (2016). The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Sci. Data 3:160044. doi: 10.1038/sdata.2016.44
Greene, M. R., and Oliva, A. (2009). Recognition of natural scenes from global properties: seeing the forest without representing the trees. Cogn. Psychol. 58, 137–176. doi: 10.1016/j.cogpsych.2008.06.001
Greve, D. N., and Fischl, B. (2009). Accurate and robust brain image alignment using boundary-based registration. NeuroImage 48, 63–72. doi: 10.1016/j.neuroimage.2009.06.060
Grill-Spector, K., Kourtzi, Z., and Kanwisher, N. (2001). The lateral occipital complex and its role in object recognition. Vis. Res. 41, 1409–1422. doi: 10.1016/S0042-6989(01)00073-6
Grossman, E. D., and Blake, R. (2002). Brain areas active during visual perception of biological motion. Neuron 35, 1167–1175. doi: 10.1016/S0896-6273(02)00897-8
Hartung, F., Jamrozik, A., Rosen, M. E., Aguirre, G., Sarwer, D. B., and Chatterjee, A. (2019). Behavioural and neural responses to facial disfigurement. Sci. Rep. 9:8021. doi: 10.1038/s41598-019-44408-8
Haxby, J. V., Gobbini, M. I., Furey, M. L., Ishai, A., Schouten, J. L., and Pietrini, P. (2001). Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293, 2425–2430. doi: 10.1126/science.1063736
Henderson, J. M., Zhu, D. C., and Larson, C. L. (2011). Functions of parahippocampal place area and retrosplenial cortex in real-world scene analysis: an fMRI study. Vis. Cogn. 19, 910–927. doi: 10.1080/13506285.2011.596852
Hönekopp, J. (2006). Once more: is beauty in the eye of the beholder? Relative contributions of private and shared taste to judgments of facial attractiveness. J. Exp. Psychol. Hum. Percept. Perform. 32, 199–209. doi: 10.1037/0096-1523.32.2.199
Huk, A. C., Dougherty, R. F., and Heeger, D. J. (2002). Retinotopy and functional subdivision of human areas MT and MST. J. Neurosci. 22, 7195–7205. doi: 10.1523/jneurosci.22-16-07195.2002
Hutcherson, C. A., Goldin, P. R., Ochsner, K. N., Gabrieli, J. D. E., Feldman Barrett, L., and Gross, J. J. (2005). Attention and emotion: does rating emotion alter neural responses to amusing and sad films? NeuroImage 27, 656–668. doi: 10.1016/j.neuroimage.2005.04.028
Iaria, G., Fox, C., Waite, C., Aharon, I., and Barton, J. (2008). The contribution of the fusiform gyrus and superior temporal sulcus in processing facial attractiveness: neuropsychological and neuroimaging evidence. Neuroscience 155, 409–422. doi: 10.1016/j.neuroscience.2008.05.046
Iigaya, K., Yi, S., Wahle, I. A., Tanwisuth, K., and Doherty, J. P. O. (2020). Aesthetic preference for art emerges from a weighted integration over hierarchically structured visual features in the brain. BioRxiv [preprint] doi: 10.1101/2020.02.09.940353
Ishizu, T., and Zeki, S. (2011). Toward a brain-based theory of beauty. PLoS One 6:e21852. doi: 10.1371/journal.pone.0021852
Ishizu, T., and Zeki, S. (2014). A neurobiological enquiry into the origins of our experience of the sublime and beautiful. Front. Hum. Neurosci. 8:891. doi: 10.3389/fnhum.2014.00891
Isik, A. I., and Vessel, E. A. (2019). Continuous ratings of movie watching reveal idiosyncratic dynamics of aesthetic enjoyment. PLoS One 14:e0223896. doi: 10.1371/journal.pone.0223896
Jacobsen, T., Schubotz, R. I., Höfel, L., and Cramon, D. Y. V. (2006). Brain correlates of aesthetic judgment of beauty. NeuroImage 29, 276–285. doi: 10.1016/j.neuroimage.2005.07.010
Jenkinson, M., Beckmann, C. F., Behrens, T. E., Woolrich, M. W., and Smith, S. M. (2012). FSL 1. NeuroImage 62, 782–790.
Julian, J. B., Fedorenko, E., Webster, J., and Kanwisher, N. (2012). An algorithmic method for functionally defining regions of interest in the ventral visual pathway. NeuroImage 60, 2357–2364. doi: 10.1016/j.neuroimage.2012.02.055
Kable, A. J. W., Lease-Spellmeyer, J., and Chatterjee, A. (2002). Neural substrates of action event knowledge. J. Cogn. Neurosci. 14, 795–805. doi: 10.1162/08989290260138681
Kanwisher, N., McDermott, J. H., and Chun, M. M. (1997). The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 17, 4302–4311. doi: 10.1098/Rstb.2006.1934
Kaplan, R., and Kaplan, S. (1989). The Experience of Nature: A Psychological Perspective. Cambridge: Cambridge University Press.
Kaplan, S. (1995). The restorative benefits of nature: toward an integrative framework. J. Environ. Psychol. 15, 169–182. doi: 10.1016/0272-4944(95)90001-2
Kawabata, H., and Zeki, S. (2004). Neural correlates of beauty. J. Neurophysiol. 91, 1699–1705. doi: 10.1152/jn.00696.2003
Keltner, D., and Haidt, J. (2003). Approaching awe, a moral, spiritual, and aesthetic emotion. Cogn. Emot. 17, 297–314. doi: 10.1080/02699930302297
Kim, H., Adolphs, R., O’Doherty, J. P., and Shimojo, S. (2007). Temporal isolation of neural processes underlying face preference decisions. Proc. Natl. Acad. Sci. U S A. 104, 18253–18258. doi: 10.1073/pnas.0703101104
Kirk, U. (2008). The neural basis of object-context relationships on aesthetic judgment. PLoS One 3:e3754. doi: 10.1371/journal.pone.0003754
Kragel, P. A., Reddan, M. C., LaBar, K. S., and Wager, T. D. (2019). Emotion schemas are embedded in the human visual system. Sci. Adv. 5:eaaw4358. doi: 10.1126/sciadv.aaw4358
Kravitz, D. J., Peng, C. S., and Baker, C. I. (2011a). Real-world scene representations in high-level visual cortex: it’s the spaces more than the places. J. Neurosci. 31, 7322–7333. doi: 10.1523/JNEUROSCI.4588-10.2011
Kravitz, D. J., Saleem, K. S., Baker, C. I., and Mishkin, M. (2011b). A new neural framework for visuospatial processing. Nat. Rev. Neurosci. 12, 217–230. doi: 10.1038/nrn3008
Lacey, S., Hagtvedt, H., Patrick, V. M., Anderson, A., Stilla, R., Deshpande, G., et al. (2011). Art for reward’s sake: visual art recruits the ventral striatum. NeuroImage 55, 420–433. doi: 10.1016/j.neuroimage.2010.11.027
Lades, M., Vorbrüggen, J. C., Buhmann, J., Lange, J., von, der Malsburg, C., et al. (1993). Distortion invariant object recognition in the dynamic link architecture. IEEE Trans. Comp. 42, 300–311. doi: 10.1109/12.210173
Lanczos, C. (1964). Evaluation of noisy data. J. Soc. Indus. Appl. Mathematics Ser. B Numer. Anal. 1, 76–85. doi: 10.1137/0701007
Leder, H., Goller, J., Rigotti, T., and Forster, M. (2016). Private and shared taste in art and face appreciation. Front. Hum. Neurosci. 10:155. doi: 10.3389/fnhum.2016.00155
Leder, H., and Nadal, M. (2014). Ten years of a model of aesthetic appreciation and aesthetic judgments: the aesthetic episode - Developments and challenges in empirical aesthetics. Br. J. Psychol. (London, England: 1953) 105, 443–464. doi: 10.1111/bjop.12084
Levitan, C., Winfield, E., and Sherman, A. (2020). Grumpy toddlers and dead pheasants: visual art preferences are predicted by preferences for the depicted objects. Psychol. Aesthet. Creat. Arts 14, 155–161. doi: 10.1037/aca0000240
Lim, S., O’Doherty, J. P., and Rangel, A. (2013). Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus. J. Neurosci. 33, 8729–8741. doi: 10.1523/JNEUROSCI.4809-12.2013
Liu, C., Brattico, E., Abu-Jamous, B., Pereira, C. S., Jacobsen, T., and Nandi, A. K. (2017). Effect of explicit evaluation on neural connectivity related to listening to unfamiliar music. Front. Hum. Neurosci. 11:611. doi: 10.3389/fnhum.2017.00611
Loschky, L. C., Larson, A. M., Magliano, J. P., and Smith, T. J. (2015). What would jaws do? the tyranny of film and the relationship between gaze and higher-level narrative film comprehension. PLoS One 10:e0142474. doi: 10.1371/journal.pone.0142474
Maia, T. V. (2009). Reinforcement learning, conditioning, and the brain: successes and challenges. Cogn. Affect. Behav. Neurosci. 9, 343–364. doi: 10.3758/CABN.9.4.343
Malach, R., Reppas, J. B., Benson, R. R., Kwong, K. K., Jiang, H., Kennedy, W. A., et al. (1995). Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc. Natl. Acad. Sci. U S A. 92, 8135–8139. doi: 10.1073/pnas.92.18.8135
Margalit, E., Biederman, I., Herald, S. B., Yue, X., von, and der Malsburg, C. (2016). An applet for the Gabor similarity scaling of the differences between complex stimuli. Attent. Percept. Psychophys. 78, 2298–2306. doi: 10.3758/s13414-016-1191-7
Martinez, J. E., Funk, F., and Todorov, A. (2020). Quantifying idiosyncratic and shared contributions to judgment. Behav. Res. Methods 52, 1428–1444. doi: 10.3758/s13428-019-01323-0
Muth, C., Hesslinger, V. M., and Carbon, C.-C. (2015). The appeal of challenge in the perception of art: how ambiguity, solvability of ambiguity, and the opportunity for insight affect appreciation. Psychol. Aesthet. Creat. Arts 9, 206–216. doi: 10.1037/a0038814
Nakamura, K., Kawashima, R., Sato, N., Nakamura, A., Sugiura, M., Kato, T., et al. (2000). Functional delineation of the human occipitotemporal areas related to face and scene processing a PET study. Brain 123, 1903–1912. doi: 10.1093/brain/123.9.1903
Nasr, S., Liu, N., Devaney, K. J., Yue, X., Rajimehr, R., Ungerleider, L. G., et al. (2011). Scene-Selective cortical regions in human and nonhuman primates. J. Neurosci. 31, 13771–13785. doi: 10.1523/JNEUROSCI.2792-11.2011
O’Doherty, J. P., Winston, J., Critchley, H., Perrett, D., Burt, D. M., and Dolan, R. J. (2003). Beauty in a smile: the role of medial orbito frontal cortex in facial attractiveness. Neuropsychologia 41, 147–155. doi: 10.1016/S0028-3932(02)00145-8
Öngür, D., Ferry, A. T., and Price, J. L. (2003). Architectonic subdivision of the human orbital and medial prefrontal cortex. J. Comparat. Neurol. 460, 425–449. doi: 10.1002/cne.10609
Palmer, S. E., and Schloss, K. B. (2010). An ecological valence theory of human color preference. Proc. Natl. Acad. Sci. U S A. 107, 8877–8882. doi: 10.1073/pnas.0906172107
Park, S., Brady, T. F., Greene, M. R., and Oliva, A. (2011). Disentangling scene content from spatial boundary: complementary roles for the parahippocampal place area and lateral occipital complex in representing real-world scenes. J. Neurosci. 31, 1333–1340. doi: 10.1523/JNEUROSCI.3885-10.2011
Pegors, T. K., Kable, J. W., Chatterjee, A., and Epstein, R. A. (2015). Common and unique representations in pFC for face and place attractiveness. J. Cogn. Neurosci. 27, 959–973. doi: 10.1162/jocn_a_00777
Peirce, J. W. (2008). Generating stimuli for neuroscience using psychoPy. Front. Neuroinform. 2:10. doi: 10.3389/neuro.11.010.2008
Pelowski, M., Markey, P. S., Forster, M., Gerger, G., and Leder, H. (2017). Move me, astonish medelight my eyes and brain: the Vienna Integrated Model of top–down and bottom–up processes in Art Perception (VIMAP) and corresponding affective, evaluative, and neurophysiological correlates. Phys. Life Rev. 21, 80–125. doi: 10.1016/j.plrev.2017.02.003
Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., and Petersen, S. E. (2012). Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion. NeuroImage 59, 2142–2154. doi: 10.1016/j.neuroimage.2011.10.018
Power, J. D., Mitra, A., Laumann, T. O., Snyder, A. Z., Schlaggar, B. L., and Petersen, S. E. (2014). Methods to detect, characterize, and remove motion artifact in resting state fMRI. NeuroImage 84, 320–341. doi: 10.1016/j.neuroimage.2013.08.048
Pruim, R. H. R., Mennes, M., van Rooij, D., Llera, A., Buitelaar, J. K., and Beckmann, C. F. (2015). ICA-AROMA: a robust ICA-based strategy for removing motion artifacts from fMRI data. NeuroImage 112, 267–277. doi: 10.1016/j.neuroimage.2015.02.064
Raichle, M. E., MacLeod, A. M., Snyder, A. Z., Powers, W. J., Gusnard, D. A., and Shulman, G. L. (2001). A default mode of brain function. Proc. Natl. Acad. Sci. U S A. 98, 676–682. doi: 10.1073/pnas.98.2.676
Ray, K. L., McKay, D. R., Fox, P. M., Riedel, M. C., Uecker, A. M., Beckmann, C. F., et al. (2013). ICA model order selection of task co-activation networks. Front. Neurosci. 7:237. doi: 10.3389/fnins.2013.00237
Rhodes, G. (2006). The evolutionary psychology of facial beauty. Annu. Rev. Psychol. 57, 199–226. doi: 10.1146/annurev.psych.57.102904.190208
Roseman, I., and Smith, C. (2001). “Appraisal theory: overview, assumptions, varieties, controversies,” in Appraisal Processes in Emotion: Theory, Methods, Research, eds K. R. Scherer, A. Schorr, and T. Johnstone (Oxford: Oxford University Press), 3–19. doi: 10.1037/13490-001
Rostrup, N. (2014). “Environmental neuroaesthetics: landscapes, places and architecture,” in An Introduction to Neuroaesthetics: the Neuroscientific Approach to Aesthetic Experience, Artistic Creativity and Arts Appreciation, ed. J. O. Lauring (Copenhagen: Museum Tusculanum Press, University of Copenhagen), 185–210.
Said, C. P., Dotsch, R., and Todorov, A. (2010). The amygdala and FFA track both social and non-social face dimensions. Neuropsychologia 48, 3596–3605. doi: 10.1016/j.neuropsychologia.2010.08.009
Sakoǧlu, Ü, Pearlson, G. D., Kiehl, K. A., Wang, Y. M., Michael, A. M., and Calhoun, V. D. (2010). A method for evaluating dynamic functional network connectivity and task-modulation: application to schizophrenia. Magnet. Resonance Mater. Phys. Biol. Med. 23, 351–366. doi: 10.1007/s10334-010-0197-8
Salimpoor, V. N., Benovoy, M., Larcher, K., Dagher, A., and Zatorre, R. J. (2011). Anatomically distinct dopamine release during anticipation and experience of peak emotion to music. Nat. Neurosci. 14, 257–262. doi: 10.1038/nn.2726
Salimpoor, V. N., van den Bosch, I., Kovacevic, N., McIntosh, A. R., Dagher, A., and Zatorre, R. J. (2013). Interactions between the nucleus accumbens and auditory cortices predict music reward value. Science 340, 216–219. doi: 10.1126/science.1231059
Salzman, C. D., and Fusi, S. (2010). Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. Annu. Rev. Neurosci. 33, 173–202. doi: 10.1146/annurev.neuro.051508.135256
Schepman, A., Rodway, P., and Pullen, S. J. (2015). Greater cross-viewer similarity of semantic associations for representational than for abstract artworks. J. Vis. 15:12. doi: 10.1167/15.14.12
Schindler, I., Hosoya, G., Menninghaus, W., Beermann, U., Wagner, V., Eid, M., et al. (2017). Measuring aesthetic emotions: a review of the literature and a new assessment tool. PLoS One 12:e0178899. doi: 10.1371/journal.pone.0178899
Schmidthuber, J. (2010). Formal theory of creativity & intrinsic motivation (1990-2010). IEEE Trans. Autonomous Mental Dev. 2, 1–18. doi: 10.1111/1467-8691.00185
Schoeller, F., and Perlovsky, L. (2016). Aesthetic chills: knowledge-acquisition, meaning-making, and aesthetic emotions. Front. Psychol. 7:1093. doi: 10.3389/fpsyg.2016.01093
Schultz, W., Apicella, P., Scarnati, E., and Ljungberg, T. (1992). Neuronal activity in monkey ventral striatum related to the expectation of reward. J. Neurosci. 12, 4595–4610. doi: 10.1523/jneurosci.12-12-04595.1992
Setlow, B., Schoenbaum, G., and Gallagher, M. (2003). Neural encoding in ventral striatum during olfactory discrimination learning. Neuron 38, 625–636. doi: 10.1016/S0896-6273(03)00264-2
Shine, J. M., Koyejo, O., Bell, P. T., Gorgolewski, K. J., Gilat, M., and Poldrack, R. A. (2015). Estimation of dynamic functional connectivity using multiplication of temporal derivatives. NeuroImage 122, 399–407. doi: 10.1016/j.neuroimage.2015.07.064
Silson, E. H., Gilmore, A. W., Kalinowski, S. E., Steel, A., Kidder, A., Martin, A., et al. (2019). A posterior–anterior distinction between scene perception and scene construction in human medial parietal cortex. J. Neurosci. 39, 705–717. doi: 10.1523/JNEUROSCI.1219-18.2018
Silvia, P. J. (2005). Cognitive appraisals and interest in visual art: exploring an appraisal theory of aesthetic emotions. Empir. Stud. Arts 23, 119–133. doi: 10.2190/12AV-AH2P-MCEH-289E
Simony, E., Honey, C. J., Chen, J., Lositsky, O., Yeshurun, Y., Wiesel, A., et al. (2016). Dynamical reconfiguration of the default mode network during narrative comprehension. Nat. Commun. 7:12141. doi: 10.1038/ncomms12141
Smith, D., Hayden, B. Y., Truong, T. K., Song, A. W., Platt, M. L., and Huettel, S. A. (2010). Distinct value signals in anterior and posterior ventromedial prefrontal cortex. J. Neurosci. 30, 2490–2495. doi: 10.1523/JNEUROSCI.3319-09.2010
Smith, S. M., Fox, P. T., Miller, K. L., Glahn, D. C., Fox, P. M., Mackay, C. E., et al. (2009). Correspondence of the brain’s functional architecture during activation and rest. Proc. Natl. Acad. Sci. U S A. 106, 13040–13045. doi: 10.1073/pnas.0905267106
Smith, S. M., Jenkinson, M., Woolrich, M. W., Beckmann, C. F., Behrens, T. E. J., Johansen-Berg, H., et al. (2004). Advances in functional and structural MR image analysis and implementation as FSL. NeuroImage 23, 208–219. doi: 10.1016/j.neuroimage.2004.07.051
Tanaka, C. S., Doya, K., Okada, G., Ueda, K., Okamoto, Y., and Yamawaki, S. (2004). Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat. Neurosci. 7, 887–893. doi: 10.1038/nn1279
Tootell, R. B., Reppas, J. B., Kwong, K. K., Malach, R., Born, R. T., Brady, T. J., et al. (1995). Functional analysis of human MT and related visual cortical areas using magnetic resonance imaging. J. Neurosci. 15, 3215–3230. doi: 10.1523/jneurosci.15-04-03215.1995
Tsukiura, T., and Cabeza, R. (2011). Remembering beauty: roles of orbitofrontal and hippocampal regions in successful memory encoding of attractive faces. NeuroImage 54, 653–660. doi: 10.1016/j.neuroimage.2010.07.046
Twohig-Bennett, C., and Jones, A. (2018). The health benefits of the great outdoors: a systematic review and meta-analysis of greenspace exposure and health outcomes. Environ. Res. 166, 628–637. doi: 10.1016/j.envres.2018.06.030
Ungerleider, L. G., and Mishkin, M. (1982). “Two cortical visual systems,” in Analysis of Visual Behavior, eds D. J. Ingle, M. A. Goodale, and R. J. Mansfield (Cambridge, MA: MIT Press), 549–586.
van der Meer, J. N., Breakspear, M., Chang, L. J., Sonkusare, S., and Cocchi, L. (2020). Movie viewing elicits rich and reliable brain state dynamics_supp. Nat. Commun. 11:5004. doi: 10.1038/s41467-020-18717-w
VanElk, M., Arciniegas Gomez, M. A., Zwaag, W., Schie, H. T., and Sauter, D. (2019). The neural correlates of the awe experience: reduced default mode network activity during feelings of awe. Hum. Brain Mapp. 40:hbm.24616. doi: 10.1002/hbm.24616
Vangeneugden, J., Peelen, M. V., Tadin, D., and Battelli, L. (2014). Distinct neural mechanisms for body form and body motion discriminations. J. Neurosci. 34, 574–585. doi: 10.1523/JNEUROSCI.4032-13.2014
Vartanian, O., and Goel, V. (2004). Neuroanatomical correlates of aesthetic preference for paintings. Neuroreport 15, 893–897. doi: 10.1097/01.wnr.00001
Vartanian, O., Goel, V., Lam, E., Fisher, M., and Granic, J. (2013a). Middle temporal gyrus encodes individual differences in perceived facial attractiveness. Psychol. Aesthet. Creat. Arts 7, 38–47. doi: 10.1037/a0031591
Vartanian, O., Navarrete, G., Chatterjee, A., Fich, L. B., Leder, H., Modroño, C., et al. (2013b). Impact of contour on aesthetic judgments and approach-avoidance decisions in architecture. Proc. Natl. Acad. Sci. U S A. 110, 10446–10453. doi: 10.1073/pnas.1301227110
Vartanian, O., Navarrete, G., Chatterjee, A., Fich, L. B., Gonzalez-Mora, J. L., Leder, H., et al. (2015). Architectural design and the brain: effects of ceiling height and perceived enclosure on beauty judgments and approach-avoidance decisions. J. Environ. Psychol. 41, 10–18. doi: 10.1016/j.jenvp.2014.11.006
Vessel, E. A., Isik, A. I., Belfi, A. M., Stahl, J. L., and Starr, G. G. (2019). The default-mode network represents aesthetic appeal that generalizes across visual domains. Proc. Natl. Acad. Sci. U S A. 116, 19155–19164. doi: 10.1073/pnas.1902650116
Vessel, E. A., Maurer, N., Denker, A. H., and Starr, G. G. (2018). Stronger shared taste for natural aesthetic domains than for artifacts of human culture. Cognition 179, 121–131. doi: 10.1016/j.cognition.2018.06.009
Vessel, E. A., and Rubin, N. (2010). Beauty and the beholder: highly individual taste for abstract, but not real-world images. J. Vis. 10, 18.1–14. doi: 10.1167/10.2.18
Vessel, E. A., Starr, G. G., and Rubin, N. (2012). The brain on art: intense aesthetic experience activates the default mode network. Front. Hum. Neurosci. 6:66. doi: 10.3389/fnhum.2012.00066
Vessel, E. A., Starr, G. G., and Rubin, N. (2013). Art reaches within: aesthetic experience, the self and the default mode network. Front. Neurosci. 7:258. doi: 10.3389/fnins.2013.00258
Vessel, E. A. (2020). “Neuroaesthetics”, in Reference Module in Neuroscience and Biobehavioral Psychology. ed. S. Della Salla (Amsterdam: Elsevier), 1–10. doi: 10.1016/B978-0-12-809324-5.24104-7
Walther, D. B., Chai, B., Caddigan, E., Beck, D. M., and Fei-Fei, L. (2011). Simple line drawings suffice for functional MRI decoding of natural scene categories. Proc. Natl. Acad. Sci. U S A. 108, 9661–9666. doi: 10.1073/pnas.1015666108
Wan, X., and Peoples, L. L. (2006). Firing patterns of accumbal neurons during a pavlovian-conditioned approach task. J. Neurophysiol. 96, 652–660. doi: 10.1152/jn.00068.2006
Wassiliwizky, E., Koelsch, S., Wagner, V., Jacobsen, T., and Menninghaus, W. (2017). The emotional power of poetry: neural circuitry, psychophysiology and compositional principles. Soc. Cogn. Affect. Neurosci. 12, 1229–1240. doi: 10.1093/scan/nsx069
Whitfield-Gabrieli, S., and Nieto-Castañón, A. (2012). Conn: a functional connectivity toolbox for correlated and anticorrelated brain networks. Brain Connect. 2, 125–141. doi: 10.1089/brain.2012.0073
Wilkins, R., Hodges, D., Laurienti, P., Steen, M., and Burdette, J. (2014). Network science and the effects of music preference on functional Brain connectivity: from beethoven to eminem. Sci. Rep. 4:6130. doi: 10.1038/srep06130
Yue, X., Biederman, I., Mangini, M. C., Malsburg, C., von, der, et al. (2012). Predicting the psychophysical similarity of faces and non-face complex shapes by image-based measures. Vis. Res. 55, 41–46. doi: 10.1016/j.visres.2011.12.012
Yue, X., Vessel, E. A., and Biederman, I. (2007). The neural basis of scene preferences. Neuroreport 18, 525–529. doi: 10.1097/WNR.0b013e328091c1f9
Zardi, A., Carlotti, E. G., Pontremoli, A., and Morese, R. (2021). Dancing in your head: an interdisciplinary review. Front. Psychol. 12:649121. doi: 10.3389/fpsyg.2021.649121
Zeki, S., Romaya, J. P., Benincasa, D. M. T., and Atiyah, M. F. (2014). The experience of mathematical beauty and its neural correlates. Front. Hum. Neurosci. 8:68. doi: 10.3389/fnhum.2014.00068
Zeki, S., and Stutters, J. (2012). A brain-derived metric for preferred kinetic stimuli. Open Biol. 2:120001. doi: 10.1098/rsob.120001
Keywords: fMRI, neuroaesthetics, naturalistic stimuli, landscape movies, scene preference, aesthetic appeal, elemental affect, value
Citation: Isik AI and Vessel EA (2021) From Visual Perception to Aesthetic Appeal: Brain Responses to Aesthetically Appealing Natural Landscape Movies. Front. Hum. Neurosci. 15:676032. doi: 10.3389/fnhum.2021.676032
Received: 04 March 2021; Accepted: 29 June 2021;
Published: 21 July 2021.
Edited by:
Andy C. H. Lee, University of Toronto, CanadaReviewed by:
Alexander Kranjec, Duquesne University, United StatesAlexander John Bies, Gonzaga University, United States
Copyright © 2021 Isik and Vessel. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ayse Ilkay Isik, aWxrYXkuaXNpa0BhZS5tcGcuZGU=