Emotion Elicitation: A Comparison of Pictures and Films

Pictures and film clips are widely used and accepted stimuli to elicit emotions. Based on theoretical arguments it is often assumed that the emotional effects of films exceed those of pictures, but to date this assumption has not been investigated directly. The aim of the present study was to compare pictures and films in terms of their capacity to induce emotions verified by means of explicit measures. Stimuli were (a) single pictures presented for 6 s, (b) a set of three consecutive pictures with emotionally congruent contents presented for 2 s each, (c) short film clips with a duration of 6 s. A total of 144 participants rated their emotion and arousal states following stimulus presentation. Repeated-measures ANOVAs revealed that the film clips and 3-picture version were as effective as the classical 1-picture method to elicit positive emotions, however, modulation toward positive valence was little. Modulation toward negative valence was more effective in general. Film clips were less effective than pictorial stimuli in producing the corresponding emotion states (all p < 0.001) and were less arousing (all p ≤ 0.02). Possible reasons for these unexpected results are discussed.

Introduction

There is a longstanding tradition in psychological research of trying to create emotional states in the laboratory for scientific aims. Several methods have been described, including hypnosis (i.e., Bower, 1983) and imagery (e.g., Lang, 1979), music (e.g., Sutherland et al., 1982), facial muscle movements (Ekman et al., 1983), interaction with trained confederates (e.g., Ax, 1953), the Velten-/self-statement technique (repeating phrases with emotional content, Velten, 1968) and even drugs and sleep deprivation (cf. Martin, 1990; Hagemann et al., 1999). Some of these methods bring ethical problems (e.g., drug intake, use of deception) and/or problems of standardization.

One widely used and accepted method for induction of emotional states that does not involve deception and that can be easily standardized, is the use of pictures. The International Affective Picture System (IAPS; Lang et al., 2005) provides such a set of standardized photographs. It has the advantage of being an internationally known method, is available for all researchers to use and normative ratings have been collected and provided by the authors since 1992. IAPS pictures have been used in a wide range of research topics and are typically shown for a duration of 6 s (e.g., Vrana et al., 1988; Bernat et al., 2006; Codispoti et al., 2006; Rhudy et al., 2007). Some studies have also varied the presentation, from subliminal application (Ruys and Stapel, 2008) to 2.5 s duration only (Chiew and Braver, 2011) and up to 8 s (Amrhein et al., 2004). A variation of the usually implemented version, which has shown good results with respect to emotional impact, is the presentation of three successive images with congruent emotional and thematic content for 2 s each (Godinho et al., 2006).

In addition to the IAPS, film clips have also been widely used and accepted as stimuli in the field of emotion research (i.e., McHugo et al., 1982; Gross and Levenson, 1995; Schaefer et al., 2010; Bartolini, 2011). Films have been used for many decades with the first use of film clips for emotion elicitation described in 1930, in a study of the effects of anger, fear and sexual arousal on blood pressure (Scott, 1930). Since then, many studies have used films as emotion elicitors to study phenomena such as sad mood induced smoking behavior (Fucito and Juliano, 2009), emotional modulation of the acoustic startle reflex (Kaviani et al., 1999), the readiness for affective reactions related with frontal brain-asymmetry (Tomarken et al., 1990) and the effect of emotion on eating behavior (Macht et al., 2002).

Films share most of the advantages that pictures offer, like their capability of being standardized and have been argued to be even more advantageous. In contrast to static pictures, films are dynamic and thus thought to be more similar to real life. Film technical elements (Camera-movement, Editing, Sound etc.) can be used to emphasize actions and their emotional meaning (Mikunda, 2002). Thus, Gross and Levenson (1995) state: “Films also have a relatively high degree of ecological validity, in so far as emotions are often evoked by dynamic visual and auditory stimuli that are external to the individual” (p. 88).

Indeed, findings of a previous review attest film clips have the capacity to elicit emotions successfully in most subjects (Martin, 1990). Another review, as well as a meta-analysis, conclude that films effectively induce emotions and even surpass the potential of methods like the Velten technique, hypnosis, or offering presents, especially in relation to the induction of positive emotions (Gerrards-Hesse et al., 1994; Westermann et al., 1996). Surprisingly, none of these comparisons included static pictures as emotional stimuli. The only studies to our knowledge that have compared pictures and films, aimed to provoke the very specific emotional reactions to sexual stimulation and found films to be more effective (Heiman, 1980; Julien and Over, 1988). However, even though there are many theoretical arguments in favor of films, very little empirical evidence can be found.

To address this lack of research we developed a set of film clips that is formally comparable to the already established IAPS pictures, by reducing each film clip to 6 s in duration. We exploited the advantages of films in accordance with findings from the field of film studies, and eliminated potential weaknesses of current databases regarding within set comparability to ensure reliability (e.g., the varying lengths of film clips).

Emotional effects induced by presentation of the stimuli were quantified using a paper-and-pencil version of the Self-Assessment Manikin scale (SAM; Lang et al., 2005). Although implicit measures of affective processing prove to be a highly valuable means to get a profound insight into non-conscious affective processing, in this study we concentrated on conscious effects detectable by using explicit ratings only.

The aim of this study was to test the effectiveness of this film set regarding modulatory effects on emotion by comparing it to that of the established IAPS dataset. We hypothesized that short film clips would be at least as effective as static pictures in inducing positive and negative emotional states. Secondly, we aimed to test the effectiveness of a third condition consisting of three emotionally congruent pictures shown successively, as this may be a promising variant to the classic picture paradigm for successful induction of emotions.

Materials and Methods

Participants

A total of 144 students participated voluntarily in the experiment, who were recruited through locally placed notices. Five subjects had to be excluded from the analysis due to either incorrectly completing the rating form or extreme mood states prior to the experiment, leading to biased ratings. Out of the remaining 139 participants, with a mean age of 25 (SD 6) years, 59.7% were female and 40.3% were male. The overall pre study mood was slightly positive (Mean 6.3, SD 1.3, range 3–9), and participants were relatively calm, but also wide-awake and attentive (Mean 4.4, SD 1.3, range 1–7). This study was performed according to the Declaration of Helsinki and was approved by the local ethics committee.

Stimulus Material

For the film condition, we selected fictional live-action films, only excluding those that were expected to cause side effects (i.e., that were produced in the period of silent film, shot in black-and-white or that used outdated technologies to create film-effects). Furthermore, only mainstream films were chosen which followed the classic Hollywood film style, the so called continuity system (Bordwell, 2006), as they conventionally aim for viewers to experience quite specific and intense emotional responses. They are also produced according to a standardized film style that promotes their emotional impact on every filmic level—using specific lighting, camera-angles or sound, standardized scenes and genre-specific actors. The selected films therefore allow for a database that fulfills the requirement of comparability of the film clips within the database.

Before choosing the films we conducted a preliminary study with 27 participants who were asked to recollect films or film scenes that they remembered to be particularly moving. These films, along with mainstream films from three local video stores, were analyzed for their emotional content from a scientific filmologic point of view. This was based on the analysis, whether the clips contained coherent emotional content (either positive or negative) in its subdivisions (aesthetic/technical aspects like light or music, action and characters, symbolism, and production aspects). Finally, 80 film clips were selected, all of them produced in Hollywood Style between the time span of 1979 and 2007. The film clips were classified for emotional effect¹ and underwent preliminary testing with six participants. Forty of the film clips were categorized as stimuli that induce positive emotions (amusement, happiness, love), and 40 as stimuli that induce negative emotions (fear, disgust, sadness, see Table 1).

TABLE 1

Table 1. Description of film clips.

For the 1-picture condition (1pic), 40 images were selected that induce positive emotions and 40 images that induce negative emotions. Fifty five of these were gathered from the IAPS database². Additional pictures with more human body related contents, independent of the IAPS pictures, were needed for the purpose of a following study based on the data obtained here. Therefore, 11 additional pictures were selected by the authors for that study and another 14 pictures were included that have already been used in a previous study (Godinho et al., 2006). These pictures showed positive contents (amusement and love) comparable to that shown in IAPS pictures.

For the 3-picture condition (3pic), 40 image sequences for the induction of a positive emotion state and 40 image sequences for the induction of a negative emotion state were produced, each image sequence consisting of three emotionally congruent images. As every stimulus in this condition consisted of three single images, there were many more images needed than were available. For this reason, every image in this condition was used twice (mirror-inverted once), so that 120 pictures had to be selected—60 pictures for the induction of a negative emotion state and 60 pictures for the induction of a positive emotion state. Among these, 90 pictures were chosen from the IAPS³, 26 pictures from the Godinho et al. (2006) study and four pictures were selected additionally by the authors.

Assessment of Emotional Modulation

A paper-and-pencil version of the Self-Assessment Manikin scale (SAM; Lang et al., 2005) was used to acquire (dis)pleasure and arousal ratings of the subjects after presentation of the pictures and films. Both are ordinal scales for valence and arousal, illustrated by little manikins depicting five steps from unhappy to happy (valence) and from calm to excited (arousal), respectively. Subjects indicated how they felt by marking the corresponding symbol or the place between two symbols, resulting in a 9-point-rating scale with “5” representing neutral valence and average arousal. Each stimulus was followed by the rating instruction, resulting in a rating for each film, picture and picture sequence.

Procedure and Experimental Design

Information about the nature as well as the time and place of the experiment was provided on locally posted notices as well as the Internet. A total of four experimental sessions with 35 subjects on average took place in the lecture room of the Institute of Film Studies, in the University of Mainz, Germany. After being welcomed by the experimenters, subjects were informed about the experimental procedure and were provided with the SAM rating forms. Participants were instructed in particular to look intensely at the presented stimuli, not to look away even if they might want to and to let the pictures and films affect them. Immediately prior to the experiment, participants were asked to rate their momentary mood and arousal via the 9-point SAM rating scale. After the room was darkened, the films and pictures were shown on a big screen. There was a short break after the first half of the experiment. At the end of the presentation, all of the SAM scales were collected by the experimenters. Altogether, the experiment lasted approximately 1 h.

There were three experimental conditions: one image shown for 6 s (1pic), three consecutive images of the same valence and with similar content presented for 2 s each (3pic) and a short film clip of 6 s (film). The presentation time was therefore the same for all three conditions. Altogether, 240 stimuli (80 in each condition) were to be rated. As the authors expected this amount to be too demanding for a single experimental session (in the sense that subjects' interest and concentration would decrease), the picture and film stimuli were split into two parallel sets of 120, with 40 stimuli per condition (i.e., 20 negative film clips, 20 positive film clips, 20 negative single pictures, 20 positive single pictures, 20 negative picture sequences and 20 positive picture sequences). Seventy three subjects were presented set 1 and 71 were presented set 2. Within each set, the stimuli were grouped into blocks of 20 pictures or picture sequences or film clips each. Every five consecutive stimuli within each block were of the same emotional valence (positive or negative). The conditions (i.e., stimulus types) were arranged in different orders within the two sets to avoid order effects.

Data Analysis

The valence and arousal ratings (dependent variables) were averaged by stimulus quality (positive, negative). To examine the effects of the condition (1pic, 3pic, film), repeated-measures analyses of variance (ANOVA) with condition as within-subject factor, were conducted. Although the authors aimed to distribute all stimuli equally in the two sets, effects of the set could not be ruled out a priori. Therefore, set was initially included as a predictor (between-subject factor) for both variables; yet the main effects of the set on valence ratings were not significant (p = 0.197). The condition*set interaction effect on the valence ratings was significant for negative stimuli (p ≥ 0.029, partial η² = 0.03), but follow-up comparisons were not significant for either pair (all p ≥ 0.233). For positive stimuli the interaction was only significant by trend and the effect size was small (p = 0.05, partial η² = 0.02). We consequently removed set as a predictor for the valence ratings. However, for the arousal ratings, the condition*set interaction effects as well as follow-up comparisons were significant, therefore separate repeated-measures ANOVAS were calculated for set 1 and 2.

Gender was included in the final model as a between-subject factor for both variables, as effects of gender on valence and arousal ratings are well-known (cf. norm data by Lang et al., 2005).

To overcome potential sphericity problems, Greenhouse-Geisser-corrected values are reported. If not otherwise reported, in the case of significant results, paired t-tests were calculated with Bonferroni adjustment for multiple comparisons.

Partial eta-squared (partial η²) was used as the effect size for F-tests and Cohen's d was used for mean comparisons. Effect sizes are interpreted following Cohen's guidelines (1977): a partial η² of 0.01, 0.06, and 0.14 as well as a d of 0.2, 0.5, and 0.8 are considered as small, medium and large, respectively.

Results

The statistics of all results described below is shown in our Supplementary Material.

Valence Ratings

Positive and Negative Stimuli—Changes Compared to Baseline

Positive stimuli, regardless of whether picture or film, resulted in positive SAM valence ratings. Yet, with a mean valence rating of 6.4 following the positive pictures and films (SD ≤ 0.8 for all three conditions), there was no significant change found in comparison to the mean baseline mood state (6.3 ± 1.3 SD). This contrasts with the valence ratings following negative stimuli, which were clearly below and significantly different from the baseline measures (3pic: 2.9 ± 0.9; 1pic: 3.0 ± 0.9; film: 3.8 ± 0.9).

Positive Stimuli—Effects of Stimulus Condition and Gender

The repeated-measures ANOVA for positive stimuli (see Figure 1A) yielded a trend for a main effect of the stimulus condition, F_{(1.8, 248.9)} = 2.683, p = 0.076; partial η² = 0.019. Follow-up comparisons yielded a slight difference between the 1pic condition and the 3pic condition, which just failed to reach significance (p = 0.051, d = 0.13), with the 1pic condition evoking slightly lower valence ratings. A further finding was that the main effect of gender was significant, F_(1,137) = 12.124, p = 0.001, partial η² = 0.081, with women rating their emotions following the presentation of stimuli with positive contents significantly more positively than men.

FIGURE 1

Figure 1. Valence ratings by stimulus condition and gender. Data presented as group means ± standard deviations. Higher ratings represent more positive emotion states. For results of significance tests see text. (A) Positive stimuli. (B) Negative stimuli.

Negative Stimuli—Effects of Stimulus Condition and Gender

The ANOVA for negative stimuli suggested the stimulus condition main effect was highly significant, F_(1.6,223.5) = 196.3, p < 0.000, partial η² = 0.589. Emotion ratings following negative stimuli were significantly more negative in the 3-picture condition than in the film condition (p < 0.000, d = 0.97) and the 1-picture condition (p = 0.030, d = 0.11). In addition, the 1-picture condition yielded more negative emotion ratings than the film condition (p < 0.000, d = 0.89). The main effect of gender was also significant, F_(1,137) = 12.009, p = 0.001, partial η² = 0.081, with women generally reporting stronger negative emotion states than men, following negative stimuli. The stimulus condition*gender interaction was also significant, F_{(1.631, 223.462)} = 4.272, p = 0.022, partial η² = 0.03, thus moderating the aforementioned relationships. The difference in valence ratings between the film condition and the 1pic and 3pic condition, respectively, was highly significant for both men and women with large effect sizes (all p < 0.000, all d ≥ 0.83), but the difference between the 1-picture and the 3-picture condition was significant for women only, with a small effect size (p < 0.000, d = 0.18) (see Figure 1B).

Arousal Ratings

Positive Stimuli—Set 1

In set 1, the ANOVA yielded a significant main effect of the stimulus condition, F_{(1.6, 110.2)} = 5.9, p = 0.007, partial η² = 0.079 (see Figure 2A). Follow-up comparisons show that the film condition yielded higher arousal ratings than the 3pic condition (p = 0.021, d = 0.33). No further significant effects were found.

FIGURE 2

Figure 2. Arousal ratings by stimulus condition and gender. Data presented as group means ± standard deviations. Higher ratings represent higher arousal. For results of significance tests see text. (A) Set 1 positive stimuli. (B) Set 2 positive stimuli. (C) Set 1 negative stimuli. (D) Set 2 negative stimuli.

Positive Stimuli—Set 2

A significant main effect of the stimulus condition, F_{(1.8, 122.8)} = 21.8, p < 0.000, partial η² = 0.246 was also found in set 2 with films (p < 0.000, d = 0.53) and the 3pic condition (p < 0.000, d = 0.41), eliciting significantly higher arousal ratings than the 1pic condition, respectively. In addition, ANOVA yielded a trend for a gender effect, F_(1,67) = 3.9, p = 0.052, partial η² = 0.055. Women's ratings were slightly higher than men's (see Figure 2B).

Negative Stimuli—Set 1

The ANOVA with set 1 data yielded a significant main effect of the stimulus condition, F_{(1.6, 111.1)} = 58.0, p < 0.000, partial η² = 0.460 with all pairwise comparisons being significant at level p < 0.000 (1pic-3pic d = 0.3, 1pic-film d = 0.52, 3pic-film d = 0.82). The main effect of gender was also significant, F_(1,68) = 9.4, p = 0.003, partial η² = 0.121, with women being more aroused by the negative stimuli than men.

A significant stimulus condition*gender interaction, F_{(1.6, 111.1)} = 5.3, p < 0.010, partial η² = 0.072 complemented the main effects. For both men and women, the 3pic condition yielded the highest arousal ratings, followed by the 1pic condition which was then followed by the film condition. Yet, these differences are somewhat stronger in women than in men (3pic-film p < 0.000, d = 1.22 [women] vs. p = 0.001, d = 0.52 [men]; 3pic-1pic p < 0.000, d = 0.45 [women] vs. p = 0.012, d = 0.19 [men]; 1pic-film p < 0.000, d = 0.73 [women] vs. p = 0.007, d = 0.33 [men]; see Figure 2C).

Negative Stimuli—Set 2

The ANOVA with set 2 data also yielded a significant main effect of the stimulus condition, F_{(1.4, 96.1)} = 5.2, p = 0.015, partial η² = 0.071. Follow up comparisons revealed that in set 2, as in set 1, the 3pic condition led to highest arousal ratings, significantly higher than the ratings in the 1pic condition (p = 0.002, d = 0.17) and in the film condition (p = 0.020, d = 0.33), respectively (see Figure 2D). Also, the main effect of gender was significant, F_(1,67) = 8.9, p = 0.004, partial η² = 0.118. Women showed higher arousal than men following the presentation of the set 2 negative stimuli.

Discussion

This study aimed to compare pictures and film clips with respect to their capacity to elicit emotions, as currently this has not been systematically investigated. We also aimed to assess the effectiveness of a set of short film clips that were developed for this purpose, as well as the effectiveness of a 3-picture condition. The short film clips produced the corresponding emotion: By means of absolute ratings, negative film clips led to negative emotion ratings and positive film clips led to positive emotion ratings. However, in relation to baseline valence ratings, only modulation following presentation of negative content was significant. Overall they were similar to pictures at evoking positive emotion and arousal states but pictures were even more efficient in evoking negative emotion. The following sections describe and discuss the results in more detail.

It is important to note in advance, that the meaning of the term “emotion” as used in this report is restricted to the conscious perception of an affective state and its modulation induced by the visual (pictures) and multimodal (film clips) stimuli, expressed as explicit measure that was captured by SAM ratings of valence and arousal. The authors are aware of the fact that there are several definitions of “emotions” in a much broader setting, and concepts of how emotions may be separated from, or linked to consciousness (Rolls, 1992), how emotions may emerge from subcortical “raw affect” through limbic and neocortical processing (Solms and Panksepp, 2012; Walla and Panksepp, 2013), which is underlined by very recent evidence that affective processing is indeed taking place at subcortical level already (Schepman et al., 2015). Ongoing investigations of the role of autonomic responses, cellular and network level responses in experimental models of emotion substantially improved our understanding on how emotion processing might occur (LeDoux, 1992).

Effects of Gender

It is well-known that women are emotionally more expressive (Kring and Gordon, 1998), at least with respect to negative cues (Bradley et al., 2001b). Therefore, it is not surprising that some studies have found more pronounced emotion ratings for women (e.g., Gross and Levenson, 1995; Hagemann et al., 1999), but not all studies found this (e.g., Philippot, 1993). Our data clearly suggests an effect of gender in the sense that women's subjective feelings (valence) are modulated stronger by affective stimuli.

Emotion Elicitation (Valence and Arousal Ratings)

With regard to the positive range of emotionality, short film clips and the 3-picture variant were as effective in creating the desired emotional valence as the classical 1-picture condition. For arousal ratings the two stimulus sets had to be analyzed separately, thus common conclusions among the sets must be drawn cautiously. Our results suggest that the pictures with positive content evoke somewhat lower arousal than the film clips, although this effect was not consistently significant.

Looking at the negative stimuli, our results suggest that the film clips were clearly less effective than both picture variants in producing negative emotions. This corresponds to the finding, that negative film clips led to lower emotional arousal than at least the negative 3pic variant (this difference was statistically significant in both sets whereas the difference between film clips and the 1pic variant was significant in set 1 only).

The reason could be that the film clips might have been simply too short. For reasons of comparability with the pictorial stimuli and to exclude confounding effects of stimulus duration, we produced film clips with a length of 6 s each, which is the typical presentation time for IAPS images, which is much shorter than clips used in other film studies (e.g., Gross and Levenson, 1995: average length 151 s; Hewig et al., 2005: average length 113 s; Bartolini, 2011: average length 206 s). However, the induction of emotions by film clips is a process even more complex than elicitation of emotions by pictures, since it not only comprises visual, but multimodal afferent information processing in real-time with both explicit and implicit information. The film‘s narration is supported not only by perceptual elements (i.e., lighting, camera-angle or the use of colors) but also by its dramaturgic structure. The entire effect of a film evolves during the playing time and peaks at its ending. Though a film might cause approximate affects within a single sequence or scene and even within one shot, a strict limitation of a clip to 6 s, regardless of its dramaturgic form, might narrow down its emotional power. The most effective results, in terms of emotional response, were achieved by “timeless” sequences without fundamental dramaturgic function (e.g., Amélie, Along came Polly) or sub-sequences that hadn't been noticeably edited (e.g., Mr. Bean, Bruce Almighty). In negative clips, the strongest results were achieved when actions were shown in total (e.g., American History X, Texas Chain Saw Massacre). Whereas static images show the results of a previous action, the film sequences usually rely on the action part as being the emotion elicitor.

A further reason might be that the photographs used show real humans suffering whereas Hollywood films tell fictitious stories, which allows for a greater emotional distance. However, if this was the case, then why were there no differences in producing positive emotions? Either the positive film clips were also too short (which means that longer positive clips would have the potential to elicit much stronger emotions than pictures) or there are other unknown valence-specific reasons. Recent findings suggest that positively and negatively valenced emotion ratings are influenced conversely by the length of film clips (Bartolini, 2011).

Another possibility is the potential effect of novelty of the stimuli on the strength of emotional modulation. Whereas the film clips in larger parts were known to the participants (clips from “Hollywood movies”), IAPS and the additional pictures were typically unknown prior to the presentation. It is well known that novel or deviant stimuli in general elicit larger brain responses, like, e.g., the P300 and late sensory components of pain related potentials (Sutton et al., 1965; Legrain et al., 2002). Since these potentials reflect responses to phasic sensory stimuli, other stimuli that contain emotionally relevant content may yield increased responses due to reinforcement mechanisms (Rolls, 1992). Since the modulatory effect was not generally less for the film condition but differentially changed (mostly equally or less effective than pictures, however more effective to elicit arousal in clips with positive content), novelty alone is unlikely to be the main reason for the findings.

The 3-picture Condition

In assessing the 3-picture variant, results showed no advantage over the classic 1-picture condition regarding the induction of positive mood, and, in terms of arousal induction, there may be even a slight disadvantage in comparison to the film condition (set 1 only). Nevertheless, to induce a state of negative mood, the 3-picture condition turned out to be significantly more effective than films and, at least in women, the classic 1-picture version. This is supported by the arousal ratings following the presentation of the 3pic condition, which in both sets and for both sexes were consistently the highest. In relation to the finding that pictures were more effective than films, this could be due to the possibility that multiple images add up to an even stronger effect in the sense of “more images—more impact.”

Limitations of the Study

Positive stimuli did not induce a significant positive effect on valence ratings, regardless of whether picture or film, whereas negative stimuli resulted in a highly significant effect toward the negative end of the scale compared to baseline ratings (mean: 6.2).

This means that participants were already in a mildly positive mood before the experiment began (which may be due to the perspective of being able to participate in a diverting experiment instead of attending their usual lecture) which could not, on average, be increased by the experimental manipulation to a significant amount. One reason could be that it may be easier to experimentally produce negative affective states than positive ones. This assumption is supported by a meta-analysis (Westermann et al., 1996) in which the authors state that at least half of the included emotion induction methods are significantly more effective for negative than for positive mood states. Another reason, which is not independent from the first, could be that the positive emotion induced by positive film clips and pictures was just in line with and hence completely “absorbed” by the prevailing (positive) mood, in other words a ceiling effect, while the negative stimuli benefitted from being in contrast to the baseline state of mood. To exclude the possibility that the results were distorted due to the elevated baseline mood, further analyses were performed including control for the pre-experimental state of emotion. However, the results were left unaffected.

A second potential limitation of this study concerns the exclusivity of explicit measures used. Pictures with affective contents do not only yield responses in form of valence and arousal ratings but can also elicit autonomic and cortical reactions as well as reflex behaviors, with the startle reflex perhaps as best candidate to reflect implicit emotional processing (Bradley et al., 2001a; Walla et al., 2011). As this study used explicit measures only, none of these responses were recorded. Although effects of the affective stimuli could be shown by the use of explicit measures and were discussed in detail, a study further investigating this topic using implicit measures in addition to explicit ratings could be of additional value.

Furthermore, the film clips used in this study have not been previously validated, and still captures from the validated movie clips might serve as a potential additional control.

Conclusions

Several conclusions can be drawn from the data obtained in this study. First of all and most importantly, short film clips seem to be an effective method for eliciting emotions. Secondly, short film clips do not appear to be better than pictures at evoking emotion and arousal states, but further research needs to be done to see whether this result can be replicated. The question of whether this is due to the length of the film clips or to inherent stimulus qualities, such as the artificiality of films, and if there are valence-specific effects, also needs to be addressed. If the effects found for the explicit consciousness based measures are also true for implicit measures (e.g., autonomic responses) needs to be investigated.

Author Contributions

All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication.

Funding

This study was supported by Deutsche Forschungsgemeinschaft DFG KFO 256-IP6 and SFB 1158.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2016.00180

Footnotes

1. ^A film classification in terms of concrete emotions was conducted to assure a certain variance within each valence and for reasons of further research. Table 1 comprises this classification. However, for this study it is of no concern.

2. ^IAPS numbers 2095, 2205, 2703, 2730, 3000, 3010, 3015, 3051, 3060, 3063, 3071, 3130, 3170, 3180, 3181, 3261, 3266, 3350, 3530, 3550.1, 4606, 4607, 4608, 4611, 4626, 4641, 4651, 4653, 5626, 5629, 5760, 5833, 6212, 6260, 6510, 6540, 6560, 6830, 8186, 9040, 9050, 9250, 9252, 9253, 9410, 9433, 9560, 9570, 9571, 9622, 9800, 9810. The additional pictures are provided by the authors by request.

3. ^IAPS numbers 1463, 1811, 2070, 2080, 2095, 2170, 2205, 2340, 2341, 2360, 2550, 2655, 2703, 2730, 3000, 3005.1, 3010, 3015, 3051, 3060, 3063, 3071, 3101, 3130, 3150, 3170, 3180, 3181, 3230, 3261, 3266, 3350, 3400, 3500, 3530, 3550.1, 4606, 4607, 4608, 4611, 4626, 4641, 4651, 4653, 4656, 5621, 5626, 5629, 5760, 5833, 6212, 6260, 6300, 6360, 6510, 6540, 6560, 6821, 6830, 7380, 8080, 8170, 8186, 8190, 8210, 8370, 8400, 9040, 9050, 9220, 9250, 9252, 9253, 9300, 9405, 9410, 9433, 9560, 9570, 9571, 9582, 9592, 9594, 9600, 9622, 9635.1, 9800, 9810, 9910, 9921. The additional pictures are provided by the authors by request.

References

Amrhein, C., Mühlberger, A., Pauli, P., and Wiedemann, G. (2004). Modulation of event-related brain potentials during affective picture processing: a complement to startle reflex and skin conductance response? Int. J. Psychophysiol. 54, 231–240. doi: 10.1016/j.ijpsycho.2004.05.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Ax, A. F. (1953). The physiological differentiation between fear and anger in humans. Psychosom. Med. 15, 433–442. doi: 10.1097/00006842-195309000-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

Bartolini, E. E. (2011). Eliciting Emotion with Film: Development of a Stimulus Set. Thesis, Wesleyan University, Middletown, CT.

Bernat, E., Patrick, C. J., Benning, S. D., and Tellegen, A. (2006). Effects of picture content and intensity on affective physiological response. Psychophysiology 43, 93–103. doi: 10.1111/j.1469-8986.2006.00380.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Bordwell, D. (2006). The Way Hollywood Tells It: Story and Style in Modern Movies. Berkeley, CA: University of California Press.

Google Scholar

Bower, G. (1983). Affect and cognition. Philos. Trans. R. Soc. Lond. 302B, 387–402. doi: 10.1098/rstb.1983.0062

CrossRef Full Text | Google Scholar

Bradley, M. M., Codispoti, M., Cuthbert, B. N., and Lang, P. J. (2001a). Emotion and motivation I: defensive and appetitive reactions in picture processing. Emotion 1, 276–298. doi: 10.1037/1528-3542.1.3.276

PubMed Abstract | CrossRef Full Text | Google Scholar

Bradley, M. M., Codispoti, M., Sabatinelli, D., and Lang, P. J. (2001b). Emotion and motivation II: sex differences in pictures processing. Emotion 1, 300–319. doi: 10.1037/1528-3542.1.3.300

PubMed Abstract | CrossRef Full Text | Google Scholar

Chiew, K. S., and Braver, T. S. (2011). Neural circuitry of emotional cognitive conflict revealed through facial expressions. PLoS ONE 6:e17635. doi: 10.1371/journal.pone.0017635

PubMed Abstract | CrossRef Full Text | Google Scholar

Codispoti, M., Ferrari, V., and Bradley, M. M. (2006). Repetitive picture processing: autonomic and cortical correlates. Brain Res. 1068, 213–220. doi: 10.1016/j.brainres.2005.11.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Cohen, J. (1977). Statistical Power Analysis for the Behavioral Sciences, Rev Edn. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.

Ekman, P., Levenson, R. W., and Friesen, W. V. (1983). Autonomic nervous system activity distinguishes among emotions. Science 221, 1208–1210. doi: 10.1126/science.6612338

PubMed Abstract | CrossRef Full Text | Google Scholar

Fucito, L. M., and Juliano, L. M. (2009). Depression moderates smoking behavior in response to a sad mood induction. Psychol. Addict. Behav. 23, 546–551. doi: 10.1037/a0016529

PubMed Abstract | CrossRef Full Text | Google Scholar

Gerrards-Hesse, A., Spies, K., and Hesse, F. W. (1994). Experimental induction of emotional states and their effectiveness: a review. Br. J. Psychol. 85, 55–78. doi: 10.1111/j.2044-8295.1994.tb02508.x

CrossRef Full Text | Google Scholar

Godinho, F., Magnin, M., Frot, M., Perchet, C., and Garcia-Larrea, L. (2006). Emotional modulation of pain: is it the sensation or what we recall? J. Neurosci. 26, 11454–11461. doi: 10.1523/JNEUROSCI.2260-06.2006

PubMed Abstract | CrossRef Full Text | Google Scholar

Gross, J. J., and Levenson, R. W. (1995). Emotion elicitation using films. Cogn. Emot. 9, 87–108. doi: 10.1080/02699939508408966

CrossRef Full Text | Google Scholar

Hagemann, D., Nauman, E., Maier, S., Becker, G., Lürken, A., and Bartussek, D. (1999). The assessment of affective reactivity using films: validity, reliability and sex differences. Pers. Individ. Dif. 26, 627–639. doi: 10.1016/S0191-8869(98)00159-7

CrossRef Full Text | Google Scholar

Heiman, J. R. (1980). Female sexual response patterns: interactions of physiological, affective, and contextual cues. Arch. Gen. Psychiatry 37, 1311–1316. doi: 10.1001/archpsyc.1980.01780240109013

PubMed Abstract | CrossRef Full Text | Google Scholar

Hewig, J., Hagemann, D., Seifert, J., Gollwitzer, M., Naumann, E., and Bartussek, D. (2005). A revised film set for the induction of basic emotions. Cogn. Emot. 19, 1095–1109. doi: 10.1080/02699930541000084

CrossRef Full Text

Julien, E., and Over, R. (1988). Male sexual arousal across five modes of erotic stimulation. Arch. Sex. Behav. 17, 131–143. doi: 10.1007/BF01542663

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaviani, H., Gray, J. A., Checkley, S. A., Kumari, V., and Wilson, G. D. (1999). Modulation of the acoustic startle reflex by emotionally-toned film-clips. Int. J. Psychophysiol. 32, 47–54. doi: 10.1016/S0167-8760(98)00063-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Kring, A. M., and Gordon, A. H. (1998). Sex differences in emotion: expression, experience and physiology. J. Pers. Soc. Psychol. 74, 686–703. doi: 10.1037/0022-3514.74.3.686

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, P. J. (1979). A bio-informational theory of emotional imagery. Psychophysiology 16, 495–512. doi: 10.1111/j.1469-8986.1979.tb01511.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, P. J., Bradley, M. M., and Cuthbert, B. N. (2005). International Affective Picture System (IAPS): Affective Ratings of Pictures and Instruction Manual. Technical Report A-6. Gainesville, FL: University of Florida.

Google Scholar

LeDoux, J. E. (1992). “In search of an emotional system in the brain: leaping from fear to emotion and consciousness,” in The Cognitive Neurosciences, ed M. S. Gazzaniga (Cambridge, MA: MIT Press), 1049–1061.

Legrain, V., Guérit, J. M., Bruyer, R., and Plaghki, L. (2002). Attentional modulation of the nociceptive processing into the human brain: selective spatial attention, probability of stimulus occurrence, and target detection effects on laser evoked potentials. Pain 99, 21–39. doi: 10.1016/S0304-3959(02)00051-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Macht, M., Roth, S., and Ellgring, H. (2002). Chocolate eating in healthy men during experimentally induced sadness and joy. Appetite 39, 147–158. doi: 10.1006/appe.2002.0499

PubMed Abstract | CrossRef Full Text | Google Scholar

Martin, M. (1990). On the induction of mood. Clin. Psychol. Rev. 10, 669–697. doi: 10.1016/0272-7358(90)90075-L

PubMed Abstract | CrossRef Full Text | Google Scholar

McHugo, G. J., Smith, C. A., and Lanzetta, J. T. (1982). The structure of self-reports of emotional responses to film segments. Motiv. Emot. 6, 365–385. doi: 10.1007/BF00998191

CrossRef Full Text | Google Scholar

Mikunda, C. (2002). Kino spüren. Strategien der Emotionalen Filmgestaltung. Wien: Facultas Universitätsverlag.

Philippot, P. (1993). Inducing and assessing differentiated emotion-feeling states in the laboratory. Cogn. Emot. 7, 171–193. doi: 10.1080/02699939308409183

CrossRef Full Text | Google Scholar

Rhudy, J. L., McCabe, K. M., and Williams, A. E. (2007). Affective modulation of autonomic reactions to noxious stimulation. Int. J. Psychophysiol. 63, 105–109. doi: 10.1016/j.ijpsycho.2006.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Rolls, E. T. (1992). “A theory of emotion and consciousness, and its application to understanding the neural basis of emotion,” in The Cognitive Neurosciences, ed M. S.Gazzaniga (Cambridge, MA: MIT Press), 1091–1115.

PubMed Abstract

Ruys, K. I., and Stapel, D. A. (2008). The secret life of emotions. Psychol. Sci. 19, 385–391. doi: 10.1111/j.1467-9280.2008.02097.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Schaefer, A., Nils, F., Sanchez, X., and Philippot, P. (2010). Assessing the effectiveness of a large database of emotion-eliciting films: a new tool for emotion researchers. Cogn. Emot. 24, 1153–1172. doi: 10.1080/02699930903274322

CrossRef Full Text | Google Scholar

Schepman, A., Rodway, P., and Pritchard, H. (2015). Right-lateralized unconscious, but not conscious, processing of affective environmental sounds. Laterality. doi: 10.1080/1357650x.2015.1105245. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Scott, J. C. (1930). Systolic blood-pressure fluctuations with sex, anger, and fear. Comp. Psychol. 10, 97–114. doi: 10.1037/h0073671

CrossRef Full Text | Google Scholar

Solms, M., and Panksepp, J. (2012). The ‘Id’ knows more than the ‘Ego’ admits: neuropsychoanalytic and primal consciousness perspectives on the interface between affective and cognitive neuroscience. Brain Sci. 2, 147–175. doi: 10.3390/brainsci2020147

PubMed Abstract | CrossRef Full Text | Google Scholar

Sutherland, G., Newman, B., and Rachman, S. (1982). Experimental investigations of the relationship between mood and intrusive unwanted cognitions. Br. J. Med. Psychol. 55, 127–138. doi: 10.1111/j.2044-8341.1982.tb01491.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Sutton, S., Braren, M., Zubin, J., and John, E. R. (1965). Evoked-potential correlates of stimulus uncertainty. Science 150, 1187–1188. doi: 10.1126/science.150.3700.1187

PubMed Abstract | CrossRef Full Text | Google Scholar

Tomarken, A. J., Davidson, R. J., and Henriques, J. B. (1990). Resting frontal brain asymmetry predicts affective response to films. J. Pers. Soc. Psychol. 59, 791–801. doi: 10.1037/0022-3514.59.4.791

PubMed Abstract | CrossRef Full Text | Google Scholar

Velten, E. (1968). A laboratory task fort he induction of mood states. Behav. Res. Ther. 6, 473–482. doi: 10.1016/0005-7967(68)90028-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Vrana, S. R., Spence, E. L., and Lang, P. J. (1988). The startle probe response: a new measure of emotion? J. Abnorm. Psychol. 97, 487–491. doi: 10.1037/0021-843X.97.4.487

PubMed Abstract | CrossRef Full Text | Google Scholar

Walla, P., Brenner, G., and Koller, M. (2011). Objective measures of emotion related to brand attitude: a new way to quantify emotion-related aspects relevant to marketing. PLoS ONE 6:e26782. doi: 10.1371/journal.pone.0026782

PubMed Abstract | CrossRef Full Text | Google Scholar

Walla, P., and Panksepp, J. (2013). Neuroimaging Helps to Clarify Brain Affective Processing Without Necessarily Clarifying Emotions, Novel Frontiers of Advanced Neuroimaging, ed K. Fountas. InTech. Available online at: http://www.intechopen.com/books/novel-frontiers-of-advanced-neuroimaging

Westermann, R., Spies, K., Stahl, G., and Hesse, F. W. (1996). Relative effectiveness and validity of mood induction procedures: a meta-analysis. Eur. J. Soc. Psychol. 26, 557–580.

Google Scholar