Arthur M. Jacobs1,2,3*
Melissa L.-H. Võ4
Benny B. Briesemeister1
Markus Conrad2,5
Markus J. Hofmann1,6
Lars Kuchinke2,7
Jana Lüdtke1,2
Mario Braun1,8- 1Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
- 2Cluster of Excellence “Languages of Emotion”, Freie Universität Berlin, Berlin, Germany
- 3Dahlem Institute for Neuroimaging of Emotion, Berlin, Germany
- 4Scene Grammar Lab, Department of Cognitive Psychology, Goethe University Frankfurt, Frankfurt, Germany
- 5Department of Cognitive, Social and Organizational Psychology, Universidad de La Laguna, San Cristóbal de La Laguna, Spain
- 6Department of Psychology, General and Biological Psychology, University of Wuppertal, Wuppertal, Germany
- 7Experimental Psychology and Methods, Faculty of Psychology, Ruhr Universität Bochum, Bochum, Germany
- 8Centre for Cognitive Neuroscience, Universität Salzburg, Salzburg, Austria
Reading is not only “cold” information processing, but involves affective and aesthetic processes that go far beyond what current models of word recognition, sentence processing, or text comprehension can explain. To investigate such “hot” reading processes, standardized instruments that quantify both psycholinguistic and emotional variables at the sublexical, lexical, inter-, and supralexical levels (e.g., phonological iconicity, word valence, arousal-span, or passage suspense) are necessary. One such instrument, the Berlin Affective Word List (BAWL) has been used in over 50 published studies demonstrating effects of lexical emotional variables on all relevant processing levels (experiential, behavioral, neuronal). In this paper, we first present new data from several BAWL studies. Together, these studies examine various views on affective effects in reading arising from dimensional (e.g., valence) and discrete emotion features (e.g., happiness), or embodied cognition features like smelling. Second, we extend our investigation of the complex issue of affective word processing to words characterized by a mixture of affects. These words entail positive and negative valence, and/or features making them beautiful or ugly. Finally, we discuss tentative neurocognitive models of affective word processing in the light of the present results, raising new issues for future studies.
Introduction
The aim of this paper is to discuss the contribution of a lexical data-base, the BAWL, to the study of affective and aesthetic processes in reading. We start with a short overview of studies using the BAWL in a variety of experimental settings that investigate a wide range of questions covering perceptual-attentional, memory, affective-aesthetic, or social-emotional issues. We then present a re-analysis of the original BAWL data (Võ et al., 2006) suggesting that both discrete emotion and embodiment or semantic richness variables also affect processing of the BAWL words. Results of three new studies from our lab investigating affective lexical semantics are subsequently discussed: one uses a special version of the BAWL to look at affective lexical semantics in children, one uses a novel class of stimuli that have a clear bivalent affective semantic structure, and the last one looks at what makes words beautiful or ugly. The paper ends with a discussion of tentative neurocognitive models of affective word recognition in the light of results from this and other recent publications addressing the How, Where, and When questions of valence ratings and decisions.
Experimental research on visual word recognition and reading has long neglected the fact that those high-dimensional symbolic stimuli called words have properties relating to our bodily sensations and actions, as well as to our affective system. Thus, popular models of visual word recognition, text processing, or reading remained completely silent with regard to potential affective or aesthetic effects of words (Jacobs, 2011). This might come as a surprise considering that early theoreticians of language, such as Freud (1891) or Bühler (1934), already argued that both spoken and written words are embodied stimuli with the potential to elicit overt and covert sensory-motor and affective responses. For example, Bühler introduced the notion of “Sphärengeruch” (spheric fragrance of words), according to which words have a substance, and the actions they serve - speaking, reading, thinking, feeling – are themselves substance-controlled. He gives the example of the word “Radieschen” (garden radish) that can evoke red or white color impressions, crackling sounds, or earthy smells and spicy tastes in the minds of readers and transport them either into a garden or to a dinner table, which creates an entirely different “sphere” as, say, the word “ocean”. The renaissance of Bühler's ideas in recent theories of symbol grounding, embodied cognition, or neural re-use (Niedenthal, 2007; Anderson, 2010; Willems and Casasanto, 2011) can explain why evolutionary young cultural objects like words can evoke basic and fiction emotions as well as aesthetic feelings at the subjective-experiential level of observation, and also activate affective processing networks at the neuronal level. As outlined in Schrott and Jacobs (2011) the challenge here is to bridge the gap between neurobiological theories of emotion, as perhaps best represented by Panksepp's (1998) core affect systems theory, and complex (psycho-)linguistic models, as exemplified by Jakobson's (1960) extended version of Bühler's (1934) ‘organon model’ of language functions. Since evolution had no time to invent a proper affective system for art reception, even less so for reading, the emotional and aesthetic processes we experience when reading must be somehow linked to the ancient neuronal affect circuits we share with all mammals. As a concise name for the latter assumption about the emotion-language link we have coined the term ‘Panksepp-Jakobson hypothesis’ (Jacobs and Schrott, 2013; Jacobs, 2015b), which finds indirect or direct support in many papers from our lab and others (e.g., Cupchik, 1994; Kneepkens and Zwaan, 1994; Miall and Kuiken, 1994; Oatley, 1994; Kuchinke et al., 2005; Kissler et al., 2007; Hofmann et al., 2009; Schacht and Sommer, 2009; Briesemeister et al., 2011a,b; Altmann et al., 2012, 2014; Bohrn et al., 2012a,b, 2013; Briesemeister et al., 2012, 2014a,b; Ponz et al., 2013; Hofmann and Jacobs, 2014; Hsu et al., 2014; Jacobs, 2014a,b; Hsu et al., 2015a,b,c).
The “Berlin Affective Word List” (BAWL) As a Basic Tool for Studying Affective and Aesthetic Processes in Reading
Limbach's (2004) wonderful book presenting the results of the election of the most beautiful German words over many years, makes readers discover impressive examples for the fact that even 9-year old children can find discrete emotions, such as joy, or feelings of beauty in single words and can also convincingly argue why (Schrott and Jacobs, 2011). These examples leave no doubt that words can be positive or negative, beautiful or ugly, more or less exciting or calming, evoke mental images of sensory-motor events, or feelings of happiness. They also support the notion of one-word poetry, i.e., that single utterances or words—even outside lyrical contexts—can fulfill what Jakobson called the poetic function and cause aesthetic emotions (Jakobson, 1960; Jacobs and Kinder, 2015).
However, introspections and intuitions about how words can evoke affective and aesthetic processes are one thing; experimentally demonstrating this is yet another. Here we will not immerse into discussions on what emotions are (Kagan, 2010). Rather, we focus on the empirical demonstration of different word properties and their influence on recognition processes that can be meaningfully related to theories of emotion covering a wide spectrum from the classical valence/pleasantness and arousal/activation dimensions of words, to discrete emotion and embodied cognition features, as estimated by ratings of joy/happiness, disgust, or smelling.
To provide a basic tool for researchers interested in affective reading processes in the German language, we have over the last 10 years developed the BAWL—providing valence, arousal, and imageability ratings for approximately 3000 German words. Table 1 summarizes more than 50 studies (until November 2014) that have used words from the BAWL to study effects of affective word properties (other studies not included here have used the BAWL to control for affective word properties, e.g., Briesemeister et al., 2009; Hofmann et al., 2011; Hsu et al., 2014, 2015a,b,c). The majority of these studies used single words and employed an explicit valence decision task (VDT) or an implicit1 lexical decision task (LDT). But also various memory tasks with mostly valence as the independent variable (IV) and a variety of dependent variables (DVs) have been used to explore effects on sublexical, lexical, and supralexical levels.
Table 1. Summary of studies using the BAWL for stimulus manipulations.
These studies show that the BAWL is a popular tool for bridging the language—emotion gap in research and that its stimuli are well cross-validated at the three relevant processing levels: experiential (e.g., subjective ratings, self-reports; Võ et al., 2006; Schnitzspahn et al., 2012), behavioral and psychophysiological (e.g., response times, heart rate, startle reflex, oculo- and pupillometric responses; Kuchinke et al., 2007; Võ et al., 2008; Bayer et al., 2011; Briesemeister et al., 2011a,b; Herbert et al., 2013), and neuronal (fMRI, EEG, fNIRS, and TMS or tDCS; Kuchinke et al., 2005, 2006; Hofmann et al., 2009; Conrad et al., 2011; Bayer et al., 2012a,b; Schlochtermeier et al., 2013; Tempel et al., 2013; Weigand et al., 2013a,b; Briesemeister et al., 2014a,b; Gärtner and Bajbouj, 2014; Hsu et al., 2014; Recio et al., 2014), as well as in computational-information technological and cartographic studies (Pak and Paroubek, 2010; Garcia Becerra, 2012; Hauthal and Burghardt, 2014).
Complementing the “Affective Norms for English Words” (ANEW; Bradley and Lang, 1999), the Sussex Affective Word List (SAWL; Citron et al., 2012), or the “Affective Norms for German Sentiment Terms” (ANGST; Schmidtke et al., 2014a), which rely on a dimensional theory of emotion a la Wundt, Lang, or Russell, a recent version of the BAWL, the DENN-BAWL, is also compatible with discrete emotion theories, such as Darwin's or Panksepp's (Briesemeister et al., 2011a, 2014a,b). Even more recent extensions include a multilingual version of the BAWL containing more than 6000 words allowing comparisons between German, Spanish, English, and French (Schmidtke et al., 2014a), and preliminary versions for testing children, the kidBAWL, including embodiment ratings (eBAWL), the noun-noun compound/NNC-BAWL, special versions for clinical applications (cBAWL; Gole et al., 2012; Kometer et al., 2012; Herbert et al., 2013; Gärtner and Bajbouj, 2014), and one for experiments in neuroaesthetics (bBAWL). As shown in the following sections, the BAWL can be used to estimate the emotion potential of lexical or supralexical units, and is complemented at the sublexical level by the EMOPHON tool, allowing to estimate the affective value of sublexical units (Aryani et al., 2013). Together these tools offer the possibility to obtain estimates of the emotion potential and aesthetic aspects not only for single words but also for supralexical units like text passages, poems, or songs, as evidenced by recent studies from our lab (Jacobs et al., 2013; Hsu et al., 2014, 2015a,b,c; Lüdtke et al., 2014; Jacobs, 2015a,b).
BAWL06 Reanalysis of Valence Decision Response Times (VDRTs) With a Combination of Exploratory Factor Analysis and Increasingly Complex Linear Mixed Models (LMM)
Researchers interested in affective word properties face the challenge to single out effects of features like valence from more than 50 quantifiable factors known to affect word recognition performance (Graf et al., 2005). Apart from valence and arousal, the about 3000 words validated in our first two BAWL papers (Võ et al., 2006, 2009) are characterized by a dozen relevant psycholinguistic variables, such as word length, neighborhood density or frequency, allowing to disentangle possible affective effects from those factors often confounded with valence or arousal, e.g., imageability (Kousta et al., 2011; Westbury et al., 2013).
In the original paper introducing the BAWL (Võ et al., 2006; henceforth BAWL06), we presented VDRTs as a function of valence ratings for 360 German words and obtained a slightly asymmetric, inverse U-shaped curve, mean RTs being shortest for positive words, followed by negative, and neutral ones. The valence ratings accounted for about 50% of mean RT variance (for a subset of 360 words), thus leaving 50% unaccounted for. Since then, the words in the BAWL have been updated by a number of additional features. So, here we ran a reanalysis of the original data to see which other variables may account for the remaining 50% of variance. Likely candidates are other affective-semantic variables like arousal and imageability, (sub)lexical variables like frequency, number of syllables, or neighborhood density, and discrete emotion variables (Briesemeister et al., 2011a, 2014a,b). Moreover, some recent work has provided evidence that words also possess the potential to evoke bodily sensations and mental imagery associated with the sensory-motor system, one nontrivial source of semantic information (Bühler, 1934; Andrews et al., 2009). We thus also took into account variables related to sensory experience (Juhasz et al., 2011) and body object interaction (Siakaluk et al., 2008), sometimes being considered as parts of a metavariable affecting word recognition called semantic richness (Pexman et al., 2008; Yap et al., 2012). In doing so, we followed a mixed approach combining available data for variables such as word frequency or discrete emotion ratings (from the DENN-BAWL) with newly collected ratings of embodiment features. To reduce complexity, the latter were submitted to an exploratory factor analysis which is useful to find possible (latent) factor structures underlying a larger number of variables. This resulted in a tentative three factor solution. A total of 14 variables were then submitted to a stepwise LMM to explore which type (e.g., affective-semantic vs. embodiment) and combination of variables may have played a role in determining the BAWL06 VDRT data (see Appendix in Supplementary Materials for details).
DENN-BAWL and eBAWL: Discrete Emotion and Embodiment Features Structure of BAWL06 Words
A fine-grained analysis of the 175 words of the BAWL06 for which we had discrete emotion ratings revealed a maximum of 91 (52%) words for which joy/happiness was the “dominant” associated emotion (i.e., maximum rating value of all five discrete emotions), 35 (20%) anger words, 32 (18.5%) fear words, only 10 sad words (6%), and a minimum of six disgust words (3.5%). The “top 3” (i.e., joy rating > 2.5/5) joy words were: SONNE (sun), MEER (sea), and SOMMER (summer), the top anger-related words: STAU (traffic jam), ARROGANZ (arrogance), and GEIZ (avarice), the top fear words: GIFT (poison), UNHEIL (calamity), and MORD (murder), the top sad words: LEID (distress), TRENNUNG (separation), and FRIEDHOF (graveyard), and the top disgust words: GESTANK (stink), ÜBEL (evil), and BAKTERIE (bacteria). However, as a matter of fact, a lot of words do not really have a dominant emotion associated with it, but are clearly ambi- or polyvalent, e.g., the word “rocket” (RAKETE) shares a mean joy rating of 1.95 with a mean anger value of 2, and a valence rating of -0.8. Now, is this word neutral or negative, or does it rather have a mixed affective-semantic structure (Briesemeister et al., 2012)? Other striking examples emphasizing our point are words like SCHLAG (“blow” or “strike”), for which two negative emotions with an opposite approach-avoidance structure compete (average anger value = 2.8, fear value = 2.7), or SCHULD (“guilt”), for which we have a perfectly balanced trivalent structure (anger, sadness, and fear = 2.3).
To examine possible effects of embodied cognition, we collected the following embodiment ratings for about 700 German words (see Appendix A1 in Supplementary Materials), asking to what extent subjects associate a word with seeing/SEE, hearing/HEA, smelling/SME, tasting/TAS, touching/TOU, feeling/sensing/FEE, or moving/MOV (eBAWL, cf. McRae et al., 2005). Looking at the dominant embodiment ratings for all BAWL06 words available (N = 193), we found a maximum of 116 (60%) words for which seeing was the dominant sensory-motor association, 53 feeling words (27%), nine hearing words (5%), six tasting (3%), five touch words (2.5%), three moving words (1.5%), and a minimum of only one smell word (0.05%). As an illustration, the highest embodiment or E-index (sum of all seven ratings) of all words had: MEER (sea; 31.0), followed by HONIG (honey; 25.9), SCHWESTER (sister; 25.9), and ZIGARRE (cigar; 25.8); the lowest had ZWECK (purpose; 9.8), followed by ZUFALL (chance 10.5), RABATT (discount; 10.7), and SPIONAGE (espionage; 10.9). Similarly to the mixed discrete emotion structure, the BAWL06 words also seem to have a mixed embodied feature structure, as exemplified by words like WAFFE (“weapon”) with very similar ratings for: touch (4.88), seeing (4.82), and hearing (4.53), or TRENNUNG (“separation”): seeing (4.76), and feeling (4.53).
An exploratory factor analysis (maximum likelihood/varimax) on the seven embodiment variables revealed a significant three-factor structure accounting for about 55% of the variance with acceptable eigenvalues (2.3, 1.4, 1.2). TAS and SME were related to Factor 1 (Taste), TOU and SEE to Factor 2 (Grasp), MOV and HEA to Factor 3 (Move), and FEE only marginally to Factor 3. These three factors were also included in the following analyses.
Stepwise LMM Approach with Three Affective-Semantic, Three (Sub)lexical, Five Discrete Emotion, and Three Embodiment Variables
The previous analyses indicated that the BAWL06 words have a complex mixed affective-semantic structure that likely contributes to variance in dependent measures such as VDRT or LDRT. We tested this assumption using a stepwise LMM approach whose advantages in psycholinguistic research using two random factors (i.e., participants and words) have been discussed elsewhere (e.g., Baayen et al., 2008; Kliegl et al., 2010; Janssen, 2012; Kuchinke and Lux, 2012; Yap et al., 2012; Lüdtke et al., 2014). Following Janssen (2012), a statistical model of the data using log-transformed VDRT2 as dependent variable was built from a null model (two random effects only: participants and words) by stepwise adding all main fixed effects3 for three affective-semantic (valence/V, arousal/A, imageability/I), three (sub)lexical (logF, syllables/S, and N), five discrete emotions (joy/happiness/HA, anger/AN, fear/FE, sadness/SA, and disgust/DI), and three embodiment variables (Taste, Grasp, Move). We then started with four simple unmixed models (Affective-Semantic, Lexical, Discrete, Embodiment), after which we entered the eight variables that yielded significant effects in those four models into a complex mixed (CoMi) model using V, A, Syl, HA, AN, SA, Taste, and Grasp as fixed effects (see Table 2). As an additional control model, we tested an LMM combining all 14 variables (14 V model) of the four unmixed models (independently of the significance of their effects). The two best-fitting were also the most complex models (CoMi and 14 V) which could not be discriminated on the basis of the AICc values4. A chi-square test using the log-likelihood data (i.e., likelihood ratio test) revealed a significant difference [chi-square (df = 6) = 28, p < 0.001] favoring the 14 V model.
Table 2. Results of stepwise LMM analysis.
What emerges from these results is a more complex picture than back in 2006: depending on which variables are entered into LMM or standard multiple regression analyses, VDRTs can be affected by all four groups of variables analyzed here: affective-semantic, (sub)lexical, discrete emotion, and embodiment. This fits with results from the above mentioned studies showing effects of both discrete emotion and embodiment or semantic richness variables. To what extent those variables interact with each other (and variables not considered here) in influencing simple or transformed RTs from valence/lexical decision or other reading tasks is an issue for future studies. A related question is to what extent rating variables like valence and happiness, arousal and fear, or disgust and smell tap into the same underlying mental/neuronal processes (Westbury et al., 2013, 2014). We believe this issue cannot be decided on the basis of more or less exploratory LMM or regression analyses alone, but requires the research strategy of functional overlap modeling by help of computer models of visual word recognition that have sufficient structure to not only simulate effects of lexical variables, but also of the other three types of factors analyzed here (Jacobs and Grainger, 1994; Grainger and Jacobs, 1996; Hofmann and Jacobs, 2014). We will discuss first steps into this direction at the end of this paper.
Affective Lexical Semantics in Children: The KidBAWL
Effects of dimensional and discrete affective word features are now well documented for adult subjects. However, we are not aware of similar studies using the ANEW or SAWL, for instance, on children. The already mentioned examples from Limbach's (2004) book and observations from daily life suggest, though, that children are already aware of emotional and even aesthetic properties of single words. We thus ran a first study using an adapted mini-version of the BAWL (N = 90 words compatible with text book vocabulary for age groups 7–12) on a sample of 20 children between age 7 and 12 to see to what extent the results obtained with adults could be replicated or extended (see Appendix in Supplementary Materials for Method details). The children rated these words (normally distributed on the variables valence and arousal, as taken from the BAWL06/09 databases) on valence and arousal, and additionally reported if the word was unknown or hard to imagine (imageability check). The ratings of all 20 children showed both strong valence and arousal effects and an LMM with six relevant fixed effects (valence, arousal, imageability5, syllables, frequency, and N) and two random effects (participants, words) showed that the standard (i.e., adult) valence and arousal values from the original BAWL were significant predictors of the children's valence ratings [t ratio (valence) = 15.37; p < 0.0001; t ratio (arousal) = −3.13; p < 0.0001], whereas only BAWL arousal was a significant predictor for the arousal ratings of the children [t ratio (arousal) = 7.36; p < 0.0001].
Figure 1A shows how well the adult valence ratings predict those of the children across the entire valence range: the overall correlation is high (r = 0.91; p < 0.0001) suggesting that in general at the level of categories (negative, neutral, positive) children of that age group have about the same concept of valence and/or the same judgment behavior as adults. If one breaks this down to the three valence categories, the correlations reveal a more differentiated picture: For the 30 negative words, only a quadratic correlation was significant (t ratio = −2.1; p < 0.045) suggesting that children use a wider range of negative ratings including extreme values, e.g., the noun GEWALT (violence) and the verb MORDEN (to kill) had more extreme z-values for children than for adults (−2.2 vs. −1.4 and −2 vs. −1.4, respectively). For the 30 neutral words, the linear correlation was significant (t ratio = 2.1; p < 0.046), whereas for the 30 positive words no significant correlation could be observed in this sample. This is due to extreme discrepancies for words like the verb KÜSSEN (to kiss) which had a much less positive z-value (0.3) for children than for adults (1.4). An even extremer example is the adverb OPTIMAL (optimal) with a z-value of 0.02 for children compared to 1.3 for adults. In contrast, the nouns MAMA (mama) or NATUR (nature) evoked more positive judgments in children (both 1.5) than in adults (both 1.2).
Figure 1. (A,B) Valence and arousal ratings (z-values) for children as a function of the original BAWL ratings (adults).
Figure 1B shows how well the adult arousal ratings predict those of the children: the correlation is significant but not perfect (r = 0.67; p < 0.0001; Schmidtke et al., 2014a, already document that arousal ratings generally appear to be less reliable than valence ratings). The higher intercept of the children's ratings might suggest that either they felt more aroused by the words or were more biased toward choosing higher arousal values.
Although due to the small sample size of participants and words these results might not be representative, they raise interesting questions for future studies in this underresearched field: Is there a general tendency for children to judge words associated with aggression or violence more negatively than adults? How do affective semantic fields develop over life span, and which role does age of acquisition play in this?
To generate more research questions for future studies on affective lexical semantics, we also looked at individual items and how they differ with regard to the variation in children's valence or arousal responses. The three “least stable” words concerning valence ratings were KILLER (killer), TUMOR (tumor), and TERROR (terror) with standard deviations of ≥1.5. The three most stable were NATUR (nature), TOPFIT (topfit), and MAMA (mama) with std ≤0.5. Figure 2 shows why KILLER is affectively so ambivalent and MAMA so unambiguous: some children find KILLER very negative, but others seem to think the opposite, its mean valence being slightly positive (2.6/5). In contrast, the affective semantics for the word MAMA seem stable, all subjects seeing it on the “good” side of the valence scale. Although all our items were compatible with text books for children of that age group and we analyzed only words judged to be familiar, the level of comprehension for items like KILLER or OPTIMAL (see above) might, of course, still differ much more for children than for adults. This is supported by the fact that—in contrast to adults—for neutral and positive words, imageability was a significant predictor of children's valence ratings (r2 = 0.21, p < 0.012; r2 = 0.15, p < 0.035, respectively).
Figure 2. Distribution of valence ratings (1–5) for two example words from the kidBAWL.
Our aim here is not to enter into test- or measurement theoretic issues, but to illustrate some of the complexities of trying to determine which subject- and item-related factors influence valence and arousal responses with high-dimensional word stimuli. In standard papers involving the BAWL, ANEW or similar databases, such “qualitative” analyses are not presented, but they are helpful when it comes to developing “hot” process models of reading that include affective aspects, as discussed later.
Affectively Bivalent Words: The NNC-BAWL
The above KILLER example demonstrates that words can appear to have a mixed or ambivalent affective semantic structure as a result of averaging ratings across different subjects (Briesemeister et al., 2012). But can they also have an intrinsically mixed or polyvalent structure, and, if so, how valid are our valence measures? We examined this question empirically using the novel case of affectively bivalent noun-noun compounds (NNCs). One motivation for this were the results of recent computational studies using co-occurrence analyses of ultra-large databases (>10 billion words; Shaoul and Westbury, 2009; Warriner et al., 2013) to estimate the semantic structure of emotion words (Westbury et al., 2013, 2014). They demonstrated computationally that an important factor contributing to the mixed affective semantic structure of words is the “company they appear in,” thus confirming Andrews et al.'s (2009) model of lexical semantics. Using very large sample sizes, such objective co-occurrence analyses are helpful for complementing subjective rating studies, as evidenced by our recent finding that valence, arousal, or imageability judgments can be largely or entirely accounted for by two computational measures: the size and density of a word's context and the multiple emotional associations of the word (Westbury et al., 2013, 2014). Next, we present a study in which we varied the valence of the “company” of a word being part of an NNC to examine how within-word valence (in)congruities affect ratings and VDRTs.
Uni- And Bivalent NNCs
Take the word SEXBOMB and try to judge its valence and arousal. Given that the word is familiar and its processing therefore largely automatized the task is perhaps not too difficult and you will most likely rate it as positive and arousing (as average ratings suggest) despite the fact that its second component (the head) is a negative fear word. Apparently, the first word (the modifier) here is dominant for affective semantics. But what about the neologism BOMBSEX? Probably you read this word for the very first time and therefore it will take a bit longer to evaluate its emotion potential, likely due to the interactive and concurrent integration of phonological, morphosyntactic, and semantic features into a complex meaning gestalt which involves the left inferior frontal gyrus (LIFG) as a neuronal key structure (Forgacs et al., 2012). This integration process might be hindered by the feeling that the first word of the NNC is, in principle, negative, whereas the second is positive, thus creating a valence conflict which might interfere with interpreting, fluent word recognition, and the overall valence rating.
In order to examine the effects of such valence conflicts on word processing, in a recent study using the VDT we created 120 novel NNCs (10–16 letters long; see Appendix in Supplementary Materials for Method details). The NNCs were divided into four valence categories based upon the BAWL06/09 ratings for each of the two words constituting an NNC (negative valence from -3 to -1.3; positive valence from 1.3 to 3): positive-positive (PP, e.g., DUSCHVENUS/shower-venus), negative-negative (NN; PICKELHORROR/pimple-horror), positive-negative (PN; JUGENDFREITOD/youth-suicide), and negative-positive (NP; MIGRÄNEHOBBY/migrane-hobby). Participants first carried out a VDT, followed by ratings for each word on the following dimensions: valence (−3 to 3), arousal (1–5), imageability (1–7), and comprehensibility (1–7). The results of a One-Way ANOVA showed that compound type had a significant effect on VDRTs (F = 19.16; p < 0.0001), and post-hoc t-tests showed that both incongruous conditions had longer RTs than the congruous ones (PN: 1.95s ≤ NP: 1.98s > NN: 1.69s ≤ PP: 1.74s; all ps < 0.0001), but did not differ significantly from each other.
Another question we asked was to what extent the rated NNC valence was determined by the valence of the two nouns (as rated independently in the BAWL06/09 studies). The box-plots in Figure 3 show that the clearest results were obtained—as could be expected—for congruous NNCs (PP, NN) with a slight advantage for double negatives, where all 30 compounds were rated as negative, whereas 4/30 PP words were rated as negative although both components were positive. The interesting result is that both incongruous NNCs had almost identical distributions and means both being rated as negative (NP: −0,85; PN: −0.83), suggesting a negativity bias or negative valence dominance for bivalent NNCs, independent of whether head or modifier are negative. Comprehensibility was ranked as follows: PP > NN ≥ PN ≥ NP, the latter three not differing significantly from each other. This finding can be explained by the fact that positive words provide a greater amount of semantic associations (Hofmann et al., 2011; Hofmann and Jacobs, 2014). Thus, semantic activation can spread across these associative pathways, and thereby elicit a positivity bias during meaning construction, an interesting hypothesis to be tested in future research (see also Lüdtke and Jacobs, this issue). Arousal was ranked: NN > NP ≥ PP ≥ NP, the only significant difference being between NN and NP.
Figure 3. Boxplot of valence ratings (−3 to +3) as a function of NNC type. −−, NN; −+, NP; +−, PN; ++, PP.
Overall, the results indicate that valence conflicts in compounds interfere with meaning construction and raise important issues for future studies, e.g., about the time course and neuronal correlates of processing affective and other emotional or non-emotional semantic features of words (Briesemeister et al., 2014a,b). Such uni- or bivalent NNCs can be useful stimuli in studies on combinatorial semantic processing and metaphor comprehension (Forgacs et al., 2012), conflict resolution, affective word processing requiring stronger valence conditions (i.e., double-positive or –negative words), affective priming (Fazio, 2001), or cultural and existential neuroscience (Silveira et al., 2013). For example, Graupmann et al. (2013) used novel NNCs constructed from BAWL09 words (e.g., ENTENBUMERANG/duck-boomerang) as “meaning threat primes” in a recent study on cultural preferences.
What Makes Words Beautiful or Ugly? The bBAWL
In the above mentioned book on the most beautiful German words (Limbach, 2004), the 9 year old Sylwan Wiese explains why the word LIBELLE (dragonfly) is the most beautiful for him: it has three “Ls” which is his preferred letter. This makes the word glide so well on his tongue (which is not the case for all German words). He also loves seeing them wobble and finds that the word expresses this feeling, that it ensures that one is not afraid of these insects. A deeper analysis uncovers more cues like the fact that the first four letters (LIBE-) phonologically form and perhaps unsconsciously evoke the German word for “love” (LIEBE), or that the last four (-ELLE) conjure feminine associations. Importantly, the child already mentions three cues for the beauty of words, a phonological one (the Ls), a perceptual one (the wobbling), and an affective-semantic (no fear), which supports the view that both associations with discrete emotions and embodied cognitions play a role in aesthetic appreciations of words.
The literature on word recognition and reading, however, is astonishingly mute when it comes to the issue why words can be beautiful or ugly (Schrott and Jacobs, 2011; see Bohrn et al., 2013, for an exception). In a pilot study we therefore collected 450 words from databases like the most beautiful and most ugly German words, dictionaries of German adolescent language, and the BAWL06/09 (see Appendix A5 in Supplementary Materials for Method details). Twenty subjects rated them on valence, arousal, familiarity, imageability, and beauty. Stepwise regression analyses showed that of all possible models beauty was best predicted by valence and familiarity (r2lin = 0.77; RMSE = 0.47; AICc = 608), while arousal and imageability did not account for a significant part of variance in our sample. Most interestingly, the most beautiful word in our sample was LIBELLE with a mean rating of 6.1/7, followed by MORGENRÖTE (aurora, 5.9), and MITTSOMMERNACHT (midsummernight, 5.8).
That valence predicts beauty ratings fits with the classical notion shared by scholars as different as Kant, Gadamer, or Ramashandran that pleasure is a necessary key component of aesthetic feelings (Jacobs, 2015b). That both pleasure and familiarity contribute to the subjective beauty of verbal material was also shown in a recent fMRI study by Bohrn et al. (2013) on German proverbs, which confirmed a major hypothesis of the neurocognitive poetics model of literary reading (Jacobs, 2011, 2015a,b) claiming that ancient neural systems associated with pleasure or disgust (e.g., ventral striatum; anterior insula/aINS) are involved in aesthetic feelings concerning verbal material, i.e., the Panksepp–Jakobson hypothesis mentioned in the introduction. Concerning the backside of beauty, i.e., ugliness, another recent study combining intracranial and surface EEG also confirmed this hypothesis by showing that as early as 200 ms post-stimulus the aINS significantly responded to disgusting words (Ponz et al., 2013). Such results challenge standard “cold cognitive” models of word recognition and reading, which so far ignore affective features of words and do not include subcortical or limbic structures in the “reading network” (cf. Hofmann and Jacobs, 2014).
To obtain an idea about which semantic features contribute to the beauty or ugliness of words, we ran a hierarchical cluster analysis over the five rated variables yielding an adequate set of 13 clusters (cubic clustering criterion = 2.5). Table A1 (Appendix in Supplementary Materials) gives 10 example words of the extreme clusters 1 and 12. The most beautiful words of Cluster 1 overall described nine phenomena from nature (animals, flowers, rainbow etc.) and four states/objects of wellness (e.g., coziness), all rated high on beauty, valence, and imageability, and low on arousal. In contrast, the overall 24 “ugliest” words from cluster 12 were almost all swear words associated with genitalia.
Naturally, our pilot study on the beauty of words is only a beginning. The above re-analysis of the BAWL06 data as well as the intuitive evidence by the contributors to the book “The most beautiful German word” suggest that associations with dimensional and discrete emotions, as well as embodied features also contribute to beauty ratings, as probably do sublexical factors such as phoneme valence (Aryani et al., 2013, in press), and phonological iconicity (Schmidtke et al., 2014b), or lexical ones like the sound image of words (Ullrich et al., this issue).
Toward a Neurocomputational Model of the VDT and Affective Word Recognition
The above results from various studies using the BAWL as a tool for revealing aspects of the processing of affective words have shed light on different factors affecting valence or lexical decisions in adults and children with simple or complex words. They can thus motivate and constrain the development of “hot” process models of word recognition, sentence comprehension, or text processing that would include affective and aesthetic processes (Jacobs, 2015a,b). In the following, we would like to discuss some elementary features of such a model starting with computational aspects and ending with three tentative neurocognitive models. The aim of these models is to help answer the question How exactly subjects go about when judging the valence of high-dimensional “symbolic” stimuli like words, as in the VDT. Related questions to be answered by any neurocomputational process model concern the Where (functional, neuroanatomical) and When of the effects observed with affective words (cf. Kissler et al., 2006; Citron, 2012; Hofmann and Jacobs, 2014). While the behavioral data presented in this paper do not directly speak to the latter two questions, the studies using BAWL stimuli from our lab and others, summarized in Table 1, do so and thus—together with other literature—provide a basis for the following theoretical considerations.
Perhaps the most basic information provided by the above studies with regard to such modeling projects is that already seven to 12 year old children show a well developed ability to judge the valence and arousal of words indicating that they have access to their affective semantic features. Whether these are the result of contextual learning/evaluative conditioning processes (Fritsch and Kuchinke, 2013), or some other unknown mechanism linking emotional and embodied experiences to words is still an open question, though. It seems safe to assume, however, that the processes determining valence and arousal values are triggered by some visual and/or linguistic features of a word which are perceived before a valence decision takes place. In principle, these features could be of sublexical or lexical origin, or both, and—if we assume automatic phonological recoding of written words and multiple embodied associations (Bühler, 1934; Jacobs et al., 1998; Yap et al., 2012)—they can be visual, phonological, multi-sensory-motor, or some combination. If in analogy to the model by Andrews et al. (2009) the affective meaning of words is best understood as the result of learning the statistical structure underlying a single joint distribution of both experiential and distributional data, then valence and arousal could be seen as semantic supra-features that result from (i) neural activation patterns distributed over the sensory-motor representations of their referents (experiential aspect) and (ii) the linguistic company the words keep, i.e., the size and density of their context, as computationally modeled using co-occurrence statistics (Hofmann and Jacobs, 2014).
The second message of the present empirical results and previous literature for model construction is that the experiential aspect would include both associations with discrete emotions and embodied features, whereas the distributional aspect would include partial or full transfer of the valence and arousal features of the context words to the target word via affective spreading activation (Hofmann and Jacobs, 2014). The distributional aspects would hypothetically contribute less strongly to the arousal value than the experiential ones, if arousal is considered the more direct and body-related variable of the two. A recent computational study by Westbury et al. (2014) indeed suggests that arousal ratings are associated more strongly with autonomic reactivity than valence, predicted by co-occurrence similarity to emotion labels naming automatic emotional reactions (e.g., the words HUMILIATION, LUST, and PANIC). In contrast, the best computational model of valence ratings was very different, and had a clear structure suggesting that they are highly associated with four dimensions: potency (strong-weak), happiness, approachability (bad-pleasure), and anger/rage.
A third message of our results is that models of affective word processing should take into account the mixed affective semantic structure (or ambi- and polyvalence) of many words, whether for simple nouns like KILLER or for more complex NNCs like SEXBOMB. This calls for a change in methodology when studying affective word recognition, using both a bipolar and a bivariate approach to see which one provides a better fit to the data (Briesemeister et al., 2012). A final dispatch of the present data for future models of affective and aesthetic word recognition is that valence and familiarity likely play a greater role than arousal and imageability for the judged beauty of words.
Computational Models of Affective Word Recognition
Computational models of affective word recognition must specify Where and When in the model the factors arousal, valence, or semantic associations exert their influence and How these factors interact in determining a valence or lexical decision. Given the success of interactive activation models (IAMs) in predicting “cold” word recognition performance in the LDT and in making the underlying processes transparent, i.e., algorithmically concrete (e.g., Grainger and Jacobs, 1996; Hofmann and Jacobs, 2014), they also are a good candidate for simulating “hot” affective word processing in the VDT or LDT. First steps in this direction were made with the models of Siegle et al. (2002) and Kuchinke (2007) whose MROMe (Multiple Read-Out Model emotional) could account for faster lexical decisions in positive words (Kuchinke et al., 2005, 2007) by an evaluation mechanism added to the original MROM (Grainger and Jacobs, 1996). However, it could not predict RT differences between positive and negative words, such as the RT advantage for positive words found in Võ et al. (2006), or Briesemeister et al. (2011a,b). A further development trying to overcome limitations of previous models is the Associative Read-Out Model (AROM; Hofmann et al., 2011) which extends the scope of IAMs by introducing explicit memory and semantic representations necessary for implementing emotional aspects. Using this model, Hofmann and Jacobs (2014) presented evidence suggesting that positive valence effects can be explained by semantic cohesion (i.e., the higher semantic-associative cohesiveness of affective words compared to neutral ones), as suggested by Phelphs et al. (1998). A future neurocomputational model trying to account for the How of affective and aesthetic word recognition should augment the aforementioned models with clear predictions regarding the Where and When, i.e., the neurofunctional/-anatomical locus and time-course of valence (or other affective) effects. However, the time for a unified model does not seem to be ripe yet, since currently this could be done from at least three different theoretical perspectives which are sketched in the following section.
Bipolar Perspective
Regarding the neurofunctional Where question, from a first perspective viewing valence as a bipolar construct, Amy and aIns activations—or an amygdalar-hippocampal network (Kensinger and Corkin, 2004)—are primarily associated with arousal, whereas valence is most often associated with OFC (Lewis et al., 2007), ventral anterior (as well as posterior and subgenual) cingulate cortex (vACC; Maddock et al., 2003), inferior frontal (Briesemeister et al., 2014b) or a prefrontal cortex-amygdalar network (Kensinger and Corkin, 2004; Schlochtermeier et al., 2013). When looking at the When question, i.e., temporal word recognition ERP effects of valence and arousal (see Citron, 2012; or Kissler et al., 2006, for reviews) there is evidence that arousal comes first (N1; Hofmann et al., 2009; Kissler and Herbert, 2012), followed by valence (early posterior negativity/EPN, late positivity complex/LPC; Recio et al., 2014), with reward being in between (P2; Schacht et al., 2012). But there is also data suggesting that valence comes first (P1; e.g., Bayer et al., 2012a), followed by arousal (EPN; Bayer et al., 2012b). All these results were obtained with BAWL or ANEW-type words, but appear somewhat inconsistent, sometimes even from within the same lab (e.g., Bayer et al., 2010, 2011; Palazova et al., 2011; Rellecke et al., 2011): some data suggest very early “pre-lexical” effects of valence (P1), others late, “post-lexical” effects (LPC)6. It also remains unclear to what extent valence and arousal effects on ERPs interact (Citron et al., 2014; Recio et al., 2014), or are confounded with effects of discrete emotional information like joy or disgust (N1; Briesemeister et al., 2014a,b; EPN; Ponz et al., 2013). At the behavioral and peripheral-physiological levels, word valence influences RTs and ratings, presumably triggered by discrete emotion and/or embodied features, and albeit to a much lesser and more uncertain degree also autonomous nervous system variables, like corrugator, electrodermal, and pupillary activity (Võ et al., 2008; Bayer et al., 2011, but see Kuchinke et al., 2007 for null findings in LDT). However, much as for neuroimaging data, results are inconsistent, sometimes showing shorter RTs for positive words, sometimes for negatives, sometimes no advantage compared to neutral words (Hofmann and Jacobs, 2014).
Bivariate Perspective
A second perspective views valence as a bivariate construct (e.g., Norris et al., 2010; Briesemeister et al., 2012), relating it to notions of reward and behavioral activation (positivity) vs. punishment and behavioral inhibiton (negativity). In this perspective, positivity is neuroanatomically most often associated with the basal ganglia (BG) including the ventral striatum (VS), left frontal pole (lFP), mOFC, vmPFC, pCC, and SMA, whereas negativity is rather associated with insula, right amygdala (rAmy), PAG, rdACC, lOFC, dmPFC, and deep cerebellar areas (Maddock et al., 2003). We are not aware of studies answering the When question of positivity vs. negativity activation, but Norris et al. (2010) summarize behavioral, peripheral-physiological, and ERP research supporting the negativity bias and positivity offset hypotheses of this perspective and thus providing indirect evidence for it.
Interactive Perspective
Finally, a third theoretical perspective merits discussion, because some results suggest that valence and arousal affect processing of emotional stimuli in an interactive way (Herbert and Kissler, 2010; Citron et al., 2014). According to this perspective, stimuli with negative valence (e.g., bitter taste) or high arousal (e.g., a loud noise) elicit a withdrawal tendency and corresponding mental set, because they represent a possible threat. In contrast, stimuli with positive valence (e.g., sweets) or with low arousal (e.g., a newsletter) elicit an approach tendency because they are perceived as safe (Briesemeister et al., 2013). These two tendencies are hypothesized to be initiated independently at a pre-attentive level and subsequently integrated in order to evaluate the stimulus for further action. This perspective predicts that positive low-arousal and negative high-arousal stimuli (are easier to process, because they elicit congruent tendencies (approach and withdrawal, respectively), whereas positive high-arousal and negative low-arousal stimuli are more difficult to process because they elicit conflicting approach-withdrawal tendencies. At the neurofunctional level, Citron et al. (2014) recently reported evidence for this perspective showing greater neural activation within right insular cortex in response to stimuli evoking conflicting approach-withdrawal tendencies (i.e., positive high-arousal and negative low-arousal words; PosHi; NegLo) compared to stimuli evoking congruent approach vs. withdrawal tendencies (i.e., positive low-arousal and negative high-arousal words; PosLo; NegHi). Further supporting evidence comes from ERP studies in favor of the approach-withdrawal assumption and the idea of the emotional and motivational embodiment of words (Herbert and Kissler, 2010; Herbert et al., 2012, 2013).
These considerations are sketched in the hypothetical diagrams of Figure 4. Figure 4A sketches the bipolar model of valence. Figure 4B sketches the bivariate interpretation of valence, arousal being left out, because it plays no key role in this perspective, which also makes no specific hypotheses with regard to differential effects of bivariate valence on RTs or ratings7 (Norris et al., 2010). Finally, Figure 4C sketches the interactive view. Note that all models incorporate the view that valence and arousal are affective super-features derived from experiential and/or distributional word properties including discrete and embodied features processed during an earlier phase (Briesemeister et al., 2014a,b).
Figure 4. (A–C) Diagrams showing hypothetical relations between affective word variables and their effects at the behavioral, brain-electrical, and neurofunctional levels. Continuous-line arrows assume strong relations, interrupted and dotted lines weaker, more questioneable ones. Abbreviations: (A) EDA, Electrodermal activity; Amy, amygdala; aIns, anterior insula; EPN, early posterior negativity; LPC, late posterior complex; OFC, orbitofrontal cortex; vACC; ventral anterior cingulate cortex. (B) BG, basal ganglia; VS, ventral striatum; lFP, left frontal pole; mOFC, medial orbitofrontal cortex; vmPFC, ventromedial prefrontal cortex; pCC, posterior cingulate cortex; SMA, supplementary motor area; rAMy, right amygdala; PAG, periaqueductal gray; rdACC, right dorsal anterior cingulate cortex; lOFC, left orbitofrontal cortex; dmPFC, dorsomedial prefrontal cortex; Cereb, cerebellum. (C) PosLoAro, positive valence, low arousal; NegHiAro, negative valence, high arousal; PosHiAro, positive valence, high arousal; NegLoAro, negative valence, low arousal; rIns, right Insula; lphG, left parahippocampal gyrus.
Conclusion
The present paper offers an overview about the lessons we learned from previous versions of the BAWL, and discusses some future perspectives characterizing the affective connotation of words on embodied, developmental, discrete-emotion, and aesthetic dimensions of meaning. This enriched perspective on word processing is further complemented by analyses based on the co-occurrence of words that either reduce the dimensions of meaning or explain positivity by semantic processes. These approaches provide a first step toward neuro-computationally concrete models of affective word, sentence, and text processing, which we see as the major challenge for the future (Jacobs, 2015a,b).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This research was supported by the DFG-funded Cluster of Excellence “Languages of Emotion,” Freie Universität Berlin. We thank Teresa Sylvester for the idea to apply the BAWL to children and her help in stimulus preparation, and Anne Maria Kiesewetter, Alexander Darrall, Tobias Bernklau, Valentina Elias, Marvin Franke und Jan Pütz for their help in data acquisition. We also thank Sascha Tamm and Michael Kuhlmann for technical support.
Supplementary Material
The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fpsyg.2015.00714/abstract
Footnotes
1. ^Implicit with regard to the affective processing of words.
2. ^Initial analyses showed that using logRT instead of RT improved model fits significantly (cf. Janssen, 2012).
3. ^In order to keep the analyses simple given the total number of variables, and since logRT transforms can have nonlinear effects on interactions (Kliegl et al., 2010), we did not introduce any interaction terms into the present LMM analyses. Future studies should look into theoretically and empirically well founded interactions between the 20 variables examined here (cf. Yap et al., 2012).
4. ^The thumb rule is that a difference of 10 points is usually significant (Janssen, 2012).
5. ^Adult ratings taken from the BAWL06/09 studies.
6. ^The notions pre- and post-lexical can easily be interpreted in the framework of serial stage models of word recognition, but require a more differentiated definition when using nonlinear dynamic processing models from e.g., the IAM family. This is because in IAM-type models, the lexical feedback loop changes activation at the sub- or prelexical levels (e.g., letters, syllables). Thus, in this model context “prelexical” would mean a pure bottom-up effect, not affected by any lexical feedback. Since lexical feedback typically requires four to seven processing cycles to show sublexical effects, any “prelexical” effect predicted from such models must occur extremely early.
7. ^With the exception of mood ratings.
References
Altmann, U., Bohrn, I. C., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2012). The power of emotional valence–from cognitive to affective processes in reading. Front. Hum. Neurosci. 6:192. doi: 10.3389/fnhum.2012.00192
Altmann, U., Bohrn, I. C., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2014). Fact vs fiction–how paratextual information shapes our reading processes. Soc. Cogn. Affect. Neur. 9, 22–29. doi: 10.1093/scan/nss098
Anderson, M. L. (2010). Neural reuse: a fundamental organizational principle of the brain. Behav. Brain Sci. 33, 245–266. doi: 10.1017/S0140525X10000853
Andrews, M., Vigliocco, G., and Vinson, D. (2009). Integrating experiential and distributional data to learn semantic representations. Psychol. Rev. 116, 463–498. doi: 10.1037/a0016261
Aryani, A., Jacobs, A. M., and Conrad, M. (2013). Extracting salient sublexical units from written texts: “Emophon,” a corpus-based approach to phonological iconicity. Front. Psychol. 4:654. doi: 10.3389/fpsyg.2013.00654
Aryani, A., Kraxenberger, M., Ullrich, S., Jacobs, A. M., and Conrad, M. (in press). Measuring the Basic Affective Tone in Poetry Using Phonological Iconicity and Subsyllabic Salience. Psychol. Aesthet. Creat. Arts.
Baayen, R. H., Davidson, D. J., and Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. J. Mem. Lang. 59, 390–412. doi: 10.1016/j.jml.2007.12.005
Bayer, M., Sommer, W., and Schacht, A. (2010). Reading emotional words within sentences: the impact of arousal and valence on event-related potentials. Int. J. Psychophysiol. 78, 299–307. doi: 10.1016/j.ijpsycho.2010.09.004
Bayer, M., Sommer, W., and Schacht, A. (2011). Emotional words impact the mind but not the body: evidence from pupillary responses. Psychophysiology 48, 1554–1562. doi: 10.1111/j.1469-8986.2011.01219.x
Bayer, M., Sommer, W., and Schacht, A. (2012a). P1 and beyond: functional separation of multiple emotion effects in word recognition. Psychophysiology 49, 959–969. doi: 10.1111/j.1469-8986.2012.01381.x
Bayer, M., Sommer, W., and Schacht, A. (2012b). Font size matters–emotion and attention in cortical responses to written words. PLoS ONE 7:e36042. doi: 10.1371/journal.pone.0036042
Bayer, M., and Schacht, A. (2014). Event-related brain responses to emotional words, pictures, and faces–a cross-domain comparison. Front. Psychol. 5:1106. doi: 10.3389/fpsyg.2014.01106
Böttcher, S., and Dreisbach, G. (2013). Socially triggered negative affect impairs performance in simple cognitive tasks. Psychol. Res. 78, 151–165. doi: 10.1007/s00426-013-0488-6
Bohrn, I. C., Altmann, U., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2012a). Old proverbs in new skins –an FMRI study on defamiliarization. Front. Psychol. 3:204. doi: 10.3389/fpsyg.2012.00204
Bohrn, I. C., Altmann, U., and Jacobs, A. M. (2012b). Looking at the brains behind figurative language –A quantitative meta-analysis of neuroimaging studies on metaphor, idiom, and irony processing. Neuropsychologia 50, 2669–2683. doi: 10.1016/j.neuropsychologia.2012.07.021
Bohrn, I. C., Altmann, U., Lubrich, O., Menninghaus, W., and Jacobs, A. M. (2013). When we like what we know - A parametric fMRI analysis of beauty and familiarity. Brain Lang. 124, 1–8. doi: 10.1016/j.bandl.2012.10.003
Bradley, M. M., and Lang, P. J. (1999). Affective Norms for English Words (ANEW): Stimuli Instruction, and Affective Ratings Technical Report C-1. Gainesville, FL: University of Florida.
Briesemeister, B. B., Hofmann, M. J., Tamm, S., Kuchinke, L., Braun, M. M., and Jacobs, A. M. (2009). The pseudohomophone effect: evidence for an orthography-phonology-conflict. Neurosci. Lett. 455, 124–128. doi: 10.1016/j.neulet.2009.03.010
Briesemeister, B. B., Kuchinke, L., and Jacobs, A. M. (2011a). Discrete emotion norms for nouns - Berlin Affective Word List (DENN-BAWL). Behav. Res. Methods 43, 441–448. doi: 10.3758/s13428-011-0059-y
Briesemeister, B. B., Kuchinke, L., and Jacobs, A. M. (2011b). Discrete emotion effects on lexical decision response times. PLoS ONE 6:e23743. doi: 10.1371/journal.pone.0023743
Briesemeister, B. B., Kuchinke, L., and Jacobs, A. M. (2012). Emotional valence–A bipolar continuum or two independent dimensions? SAGE Open 2, 1–12, doi: 10.1177/2158244012466558
Briesemeister, B. B., Tamm, S., Heine, A., and Jacobs, A. M. (2013). Approach the good, withdraw from the bad–A review on frontal alpha asymmetry measures in applied psychological research. Psychology 4, 261–267. doi: 10.4236/psych.2013.43A039
Briesemeister, B. B., Kuchinke, L., and Jacobs, A. M. (2014a). Emotion word recognition: discrete information effects first, continuous later? Brain Res. 1564, 62–71. doi: 10.1016/j.brainres.2014.03.045
Briesemeister, B. B., Kuchinke, L., Jacobs, A. M., and Braun, M. (2014b). Emotions in reading: dissociation of happiness and positivity. Cogn. Affect. Behav. Neurosci. 15, 287–298. doi: 10.3758/s13415-014-0327-2
Casasanto, D., Jasmin, K., Brookshire, G., and Gijssels, T. (2014). “The QWERTY effect: how typing shapes word meanings and baby names,” in Paper Presented at the 36th Annual Conference of the Cognitive Science Society (Quebec City), 23–26.
Citron, F. M. (2012). Neural correlates of written emotion word processing: a review of recent electrophysiological and hemodynamic neuroimaging studies. Brain Lang. 122, 211–226. doi: 10.1016/j.bandl.2011
Citron, F. M. M., Weekes, B. S., and Ferstl, E. C. (2012). How are affective word ratings related to lexico-semantic properties? Evidence from the Sussex Affective Word List (SAWL). Appl. Psycholinguist. 35, 313–331. doi: 10.1017/S0142716412000409
Citron, F. M. M., Grey, M. A., Critchley, H. D., Weekes, B. S., and Ferstl, E. C. (2014). Emotional valence and arousal affect reading in an interactive way: neuroimaging evidence for an approach-withdrawal framework. Neuropsychologia 56, 79–89. doi: 10.1016/j.neuropsychologia.2014.01.002
Conrad, M., Recio, G., and Jacobs, A. M. (2011). The time course of emotion effects in first and second language processing: a cross-cultural ERP study with German–Spanish bilinguals. Front. Psychol. 2:351. doi: 10.3389/fpsyg.2011.00351
Cupchik, G. C. (1994). Emotion in aesthetics: reactive and reflective models. Poetics 23, 177–188. doi: 10.1016/0304-422X(94)00014-W
Dieler, A. C., Plichta, M. M., Dresler, T., and Fallgatter, A. J. (2010). Suppression of emotional words in the Think/No-Think paradigm investigated with functional near-infrared spectroscopy. Int. J. Psychophysiol. 78, 129–135. doi: 10.1016/j.ijpsycho.2010.06.358
Dreisbach, G., and Fischer, R. (2012). Conflicts as aversive signals. Brain Cogn. 78, 94–98. doi: 10.1016/j.bandc.2011.12.003
Eder, A. B., Rothermiund, K., and De Houwer, J., and Hommel, B. (2014). Directive and incentive functions of affective action consequences: an ideomotor approach. Psychol. Res. doi: 10.1007/s00426-014-0590-4. [Epub ahead of print].
Fazio, R. H. (2001). On the automatic activation of associated evaluations: an overview. Cogn. Emot. 15, 115–141. doi: 10.1080/0269993004200024
Forgacs, B., Bohrn, I. C., Baudewig, J., Hofmann, M. J., Pleh, C., and Jacobs, A. M. (2012). Neural correlates of combinatorial semantic processing of literal and figurative noun-noun compound words. Neuroimage 63, 1432–1442. doi: 10.1016/j.neuroimage.2012.07.029
Freud, S. (1891). Zur Auffassung der Aphasien: Eine kritische Studie (On Aphasia: A Critical Study). Wien: Deuticke.
Fritsch, N., and Kuchinke, L. (2013). Acquired affective associations induce emotion effects in word recognition: an ERP study. Brain Lang. 124, 75–83. doi: 10.1016/j.bandl.2012.12.001
Fritz, J., and Dreisbach, G. (2013). Conflicts as aversive signals: conflict priming increases negative judgments for neutral stimuli. Cogn. Affect. Behav. Neurosci. 13, 311–317. doi: 10.3758/s13415-012-0147-1
Fritz, J., and Dreisbach, G. (2014). The time course of the aversive conflict signal. Exp. Psychol. 62, 30–39. doi: 10.1027/1618-3169/a000271
Frühholz, S., Jellinghaus, A., and Herrmann, M. (2011). Time course of implicit processing and explicit processing of emotional faces and emotional words. Biol. Psychol. 87, 265–274. doi: 10.1016/j.biopsycho.2011.03.008
Fuge, P., Aust, S., Fan, Y., Weigand, A., Gärtner, M., Feeser, A., et al. (2014). Interaction of early life stress and corticotropin-releasing hormone receptor gene: effects on working memory. Biol. Psychiat. 76, 888–894. doi: 10.1016/j.biopsych.2014.04.016
Gärtner, M., and Bajbouj, M. (2014). Encoding-related EEG oscillations during memory formation are modulated by mood state. Soc. Cogn. Affect. Neurosci. 24, 2014. doi: 10.1093/scan/nst184
Garcia Becerra, D. (2012). Modeling Collective Emotions in Online Communities. Ph.D. dissertation, ETH Zürich.
Gole, M., Köchel, A., Schäfer, A., and Schienle, A. (2012). Threat engagement, disengagement, and sensitivity bias in worry-prone individuals as measured by an emotional go/no-go task. J. Behav. Ther. Exp. Psycol. 43, 532–539. doi: 10.1016/j.jbtep.2011.07.002
Graf, R., Nagler, M., and Jacobs, A. M. (2005). Factor analysis of 57 variables in visual word recognition. Z. Psychol. 213, 205–218. doi: 10.1026/0044-3409.213.4.205
Grainger, J., and Jacobs, A. M. (1996). Orthographic processing in visual word recognition: a multiple read-out model. Psychol. Rev. 103, 518–565. doi: 10.1037//0033-295X.103.3.518
Graupmann, V., Peres, I., Michaely, T., Meindl, T., Frey, D., Reiser, M., et al. (2013). Culture and its neurofunctional correlates when death is in mind. Neurosci. Lett. 548, 239–243. doi: 10.1016/j.neulet.2013.05.062
Grimm, S., Weigand, A., Kazzer, P., Jacobs, A. M., and Bajbouj, M. (2012). Neural mechanisms underlying the integration of emotion and working memory. Neuroimage 61, 1188–1194. doi: 10.1016/j.neuroimage.2012.04.004
Hauthal, E., and Burghardt, D. (2014). Mapping space-related emotions out of user-generated photo metadata considering grammatical issues. Cartogr. J. doi: 10.1179/1743277414Y.0000000094
Heister, J., and Kliegl, R. (2012). “Comparing word frequencies from different German text corpora,” in Lexical Resources in Psycholinguistic Re-search, Vol. 3, eds K.-M. Würzner and E. Pohl (Potsdam: Cognitive Science Series), 27–44.
Herbert, C., and Kissler, J. (2010). Startle reflex modulation during shallow and deep processing of emotional words. Int. J. Psychophysiol. 76, 64–71. doi: 10.1016/j.ijpsycho.2010.02.004
Herbert, C., Deutsch, R., Platte, P., and Pauli, P. (2012). No fear, no panic: probing negation as a means for emotion regulation. Soc. Cogn. Affect. Neurosci. 8, 654–661. doi: 10.1093/scan/nss043
Herbert, C., Kübler, A., and Vögele, C. (2013). Risk for eating disorders modulates startle-responses to body words. PLoS ONE 8:e53667. doi: 10.1371/journal.pone.0053667
Hofmann, M. J., Kuchinke, L., Tamm, S., Võ, M. L. H., and Jacobs, A. M. (2009). Affective processing within 1/10th of a second: high arousal is necessary for early facilitative processing of negative but not positive words. Cogn. Affect. Behav. Neurosci. 9, 389–397. doi: 10.3758/9.4.389
Hofmann, M. J., Kuchinke, L., Biemann, C., Tamm, S., and Jacobs, A. M. (2011). Remembering words in context as predicted by an Associative Read-Out Model. Front. Psychol. 2:252. doi: 10.3389/fpsyg.2011.00252
Hofmann, M. J., and Jacobs, A. M. (2014). Interactive activation and competition models and semantic context: from behavioral to brain data. Neurosci. Biobehav. Rev. 46, 85–104. doi: 10.1016/j.neubiorev.2014.06.011
Hsu, C.-T., Conrad, M., and Jacobs, A. M. (2014). Fiction feelings in Harry Potter: Haemodynamic response in the mid-cingulate cortex correlates with immersive reading experience. Neuroreport 25, 1356–1361. doi: 10.1097/WNR.0000000000000272
Hsu, C.-T., Jacobs, A. M., and Conrad, M. (2015a). Can Harry Potter still put a spell on us in a second language? An fMRI study on reading emotion-laden literature in late bilinguals. Cortex 63, 282–295. doi: 10.1016/j.cortex.2014.09.002
Hsu, C.-T., Jacobs, A. M., Citron, F., and Conrad, M. (2015b). The emotion potential of words and passages in reading Harry Potter: an fMRI study. Brain Lang. 142, 96–114. doi: 10.1016/j.bandl.2015.01.011
Hsu, C.-T., Jacobs, A. M., Altmann, U., and Conrad, M. (2015c). The magical activation of left amygdala when reading Harry Potter: an fMRI study on how descriptions of supra-natural events entertain and enchant. PLoS ONE 10:e0118179. doi: 10.1371/journal.pone.0118179
Jacobs, A. M. (2011). “Neurokognitive Poetik: elemente eines modells des literarischen lesens (Neurocognitive poetics: elements of a model of literary reading),” in Gehirn und Gedicht: Wie Wir Unsere Wirklichkeiten Konstruieren (Brain and Poetry: How We Construct Our Realities), eds R. Schrott and A. M. Jacobs (München: Carl Hanser Verlag), 492–520.
Jacobs, A. M., and Schrott, R. (2013). “Gehirn und Gedicht: Wie Wörter emotional wirklich werden. (Brain and Poem: How words become emotionally real),” in Keynote Lecture Given at the 55th Annual Conference of Experimental Psychologists (TeaP), (Vienna), 24–27.
Jacobs, A. M. (2014a). Metaphern beim lesen in gehirn und geist (Metaphors during reading in the mind/brain). Psychosozial 37, 27–38.
Jacobs, A. M. (2014b). Affektive und ästhetische Prozesse beim Lesen: Anfänge einer neurokognitiven Poetik (Affective and aesthetic processes in reading: towards a neurocognitive poetics.), in Sprachen der Emotion (Languages of Emotion), eds G. Gebauer and M. Edler (Frankfurt: Campus), 134–154.
Jacobs, A. M. (2015a). “Towards a neurocognitive poetics model of literary reading,” in Towards a Cognitive Neuroscience of Natural Language Use, ed R. Willems (Cambridge: Cambridge University Press), 135–159.
Jacobs, A. M. (2015b). Neurocognitive poetics: methods and models for investigating the neuronal and cognitive-affective bases of literature reception. Front. Hum. Neurosci. 9:186. doi: 10.3389/fnhum.2015.00186
Jacobs, A. M., and Grainger, J. (1994). Models of visual word recognition: sampling the state of the art. J. Exp. Psy. Human 20, 1311–1334. doi: 10.1037//0096-1523.20.6.1311
Jacobs, A. M., Rey, A., Ziegler, J. C., and Grainger, J. (1998). “MROM-p: an interactive activation, multiple readout model of orthographic and phonological processes in visual word recognition,” in Localist Connection- ist Approaches to Human Cognition, eds J. Grainger and A. M. Jacobs (Mahwah: Lawrence Erlbaum Associates Inc.), 147–188.
Jacobs, A. M., Lüdtke, J., and Meyer-Sickendiek, B. (2013). “Bausteine einer neurokognitiven poetik: foregrounding/backgrounding, lyrische stimmung und ästhetisches gefallen (Elements of a neurocognitive poetics: foregrounding/backgrounding, typical mood, and aesthetic pleasure),” in Stimmung und Methode (Mood and Method), eds B. Meyer-Sickendiek and F. Reents (Tübingen: Mohr Siebeck), 63–94.
Jacobs, A. M., and Kinder, A. (2015). “Worte als worte erfahren: wie erarbeitet das gehirn gedichte (Experience words as words: how the brain constrcuts poems),” in Kind und Gedicht (Child and Poem), ed A. Pompe (Berlin: Rombach), 57–76.
Jakobson, R. (1960). “Closing statement: linguistics and poetics,” in Style in Language, ed T. A. Sebeok (Cambridge, MA: MIT Press), 350–377.
Jansma, H., Roebroeck, A., and Münte, T. F. (2014). A network analysis of audiovisual affective speech perception. Neuroscience 256, 230–241. doi: 10.1016/j.neuroscience.2013.10.047
Janssen, D. P. (2012). Twice random, once mixed: applying mixed models to simultaneously analyze random effects of language and participants. Behav. Res. Methods 44, 232–247. doi: 10.3758/s13428-011-0145-1
Juhasz, B. J., Yap, M. J., Dicke, J., Taylor, S. C., and Gullick, M. M. (2011). Tangible words are recognized faster: the grounding of meaning in sensory and perceptual systems. Q. J. Exp. Psychol. 64, 1683–1691. doi: 10.1080/17470218.2011.605150
Kattner, F., and Ellermeier, W. (2014). Irrelevant speech does not interfere with serial recall in early blind listeners. Q. J. Exp. Psychol. 67, 2207–2217. doi: 10.1080/17470218.2014.910537
Kensinger, E. A., and Corkin, S. (2004). Two routes to emotional memory: distinct neural processes for valence and arousal. Proc. Natl. Acad. Sci. U.S.A. 101, 3310–3315. doi: 10.1073/pnas.0306408101
Kissler, J., Herbert, C., Peyk, P., and Junghofer, M. (2007). Buzzwords: early cortical responses to emotional words during reading. Psychol. Sci. 18, 475–480. doi: 10.1111/j.1467-9280.2007.01924.x
Kissler, J., and Herbert, C. (2012). EMOTION, ETMNNOOI, or EMITOON? – Emotional differentiation precedes word pseudoword differentiation during reading. Biol. Psychol. doi: 10.1016/j.biopsycho.2012.09
Kissler, J., Assadollahi, R., and Herbert, C. (2006). Emotional and semantic networks in visual word processing: insights from ERP studies. Progr. Brain Res. 156, 147–183. doi: 10.1016/S0079-6123(06)56008-X
Kliegl, R., Masson, M. E. J., and Richter, E. M. (2010). A linear mixed model analysis of masked repetition priming. Vis. Cogn. 18, 655–681. doi: 10.1080/13506280902986058
Klackl, J., Jonas, E., and Kronbichler, M. (2013). Existential neuroscience: neurophysiological correlates of proximal defenses against death-related thoughts. Soc. Cogn. Affect. Neurosci. 8, 333–340. doi: 10.1093/scan/nss003
Kneepkens, L. J., and Zwaan, R. A. (1994). Emotion and literary understanding. Poetics 23, 125–138. doi: 10.1016/0304-422X(94)00021-W
Kometer, M., Schmidt, A., Bachmann, R., Studerus, E., Seifritz, E., and Vollenweider, F. X. (2012). Psilocybin biases facial recognition, goal-directed behavior, and mood state toward positive relative to negative emotions through different serotonergic subreceptors. Biol. Psychiatry 72, 898–906. doi: 10.1016/j.biopsych.2012.04.005
Kopf, J., Dresler, T., Reicherts, P., Herrmann, M. J., and Reif, A. (2013). The effect of emotional content on brain activation and the late positive potential in a word n-back task. PLoS ONE 8:e75598. doi: 10.1371/journal.pone.0075598
Kousta, S.-T., Vigliocco, G., Vinson, D. P., Andrews, M., and Del Campo, E. (2011). The representation of abstract words: why emotion matters. J. Exp. Psychol. Gen. 140, 14–34. doi: 10.1037/a0021446
Kuchinke, L. (2007). Implicit and Explicit Recognition of Emotionally Valenced Words. Ph.D. thesis, Freie Universität Berlin.
Kuchinke, L., Jacobs, A. M., Grubich, C., Võ, M. L. H., Conrad, M., and Herrmann, M. (2005). Incidental effects of emotional valence in single word processing: an fMRI study. Neuroimage 28, 1022–1032. doi: 10.1016/j.neuroimage.2005.06.050
Kuchinke, L., Jacobs, A. M., Võ, M. L. H., Conrad, M., Grubich, C., and Herrmann, M. (2006). Modulation of prefrontal cortex activation by emotional words in recognition memory. Neuroreport 17, 1037–1041. doi: 10.1097/01.wnr.0000221838.27879.fe
Kuchinke, L., Võ, M. L. H., Hofmann, M., and Jacobs, A. M. (2007). Pupillary responses during lexical decisions vary with word frequency but not emotional valence. Int. J. Psychophysiol. 65, 132–140. doi: 10.1016/j.ijpsycho.2007.04.004
Kuchinke, L., and Lux, V. (2012). Caffeine improves left hemisphere processing of positive words. PLoS ONE 7:e48487. doi: 10.1371/journal.pone.0048487
Kuchinke, L., Fritzemeier, S., Hofmann, M. J., and Jacobs, A. M. (2013). Neural correlates of episodic memory: associative memory and confidence drive hippocampus activations. Behav. Brain Res. 254, 92–101. doi: 10.1016/j.bbr.2013.04.035
Kuchinke, L., Krause, B., Fritsch, N., and Briesemeister, B. B. (2014). A familiar font drives early emotional effects in word recognition. Brain Lang. 137, 142–147. doi: 10.1016/j.bandl.2014.08.007
Kuehnast, M., Wagner, V., Wassiliwizky, E., Jacobsen, T., and Mennighaus, W. (2014). Being moved: linguistic representation and conceptual structure. Front. Psychol. 5:1242. doi: 10.3389/fpsyg.2014.01242
Kurtz, T., and Zimprich, D. (2013). Individual differences in criterion-based dropout learning in old age: the role of processing speed and verbal knowledge. Eur. J. Ageing 11, 183–193. doi: 10.1007/s10433-013-0293-5
Lang, P. J. (1980). “Behavioral treatment and bio-behavioral assessment: computer applications,” in Technology in Mental Health and Delivery Systems, eds J. B. Sidowski, J. H. Johnson, and T. A. Williams (Norwood, NJ: Ablex), 119–137.
Lewis, P. A., Critchley, H. D., Rotshtein, P., and Dolan, R. J. (2007). Neural correlates of processing valence and arousal in affective words. Cereb. Cortex 17, 742–748. doi: 10.1093/cercor/bhk024
Limbach, J. (2004). Das Schönste Deutsche Wort (The Most Beautiful German Word). Freiburg: Verlag Herder.
Lüdtke, J., Meyer-Sickendiek, B., and Jacobs, A. M. (2014). Immersing in the stillness of an early morning: testing the mood empathy hypothesis in poems. Psychol. Aesthet. 8, 363–377. doi: 10.1037/a0036826
Maddock, R. J., Garrett, A. S., and Buonocore, M. H. (2003). Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task. Hum. Brain Mapp. 18, 30–41. doi: 10.1002/hbm.10075
McRae, K., Cree, G. S., Seidenberg, M. S., and McNorgan, C. (2005). Semantic feature production norms for a large set of living and nonliving things. Behav. Res. Methods 37, 547–559. doi: 10.3758/BF03192726
Miall, D. S., and Kuiken, D. (1994). Foregrounding, defamiliarization, and affect: response to literary stories. Poetics 22, 389–407. doi: 10.1016/0304-422X(94)00011-5
Norris, C. J., Gollan, J., Berntson, G. G., and Cacioppo, J. T. (2010). The current status of research on the structure of affective space. Biol. Psychol. 84, 422–436. doi: 10.1016/j.biopsycho.2010.03.011
Oatley, K. (1994). A taxonomy of the emotions of literary response and a theory of identification in fictional narrative. Poetics 23, 53–74. doi: 10.1016/0304-422X(94)P4296-S
Pak, A., and Paroubek, P. (2010). “Construction d'un lexique affectif pour le français à partir de Twitter,” Paper Presented at the 17ème Conférence sur le Traitement Automatique des Langues Naturelles (Montréal, QC), 19–22.
Palazova, M., Mantwill, K., Sommer, W., and Schacht, A. (2011). Are effects of emotion in single words non-lexical? Evidence from event-related brain potentials. Neuropsychologia 49, 2766–2775. doi: 10.1016/j.neuropsychologia.2011.06.005
Panksepp, J. (1998). Affective Neuroscience: The Foundations of Human and Animal Emotions. New York, NY: Oxford University Press
Peirce, J. W. (2007). PsychoPy—psychophysics software in Python. J. Neurosci. Methods 162, 8–13. doi: 10.1016/j.jneumeth.2006.11.017
Pexman, P. M., Hargreaves, I. S., Siakaluk, P. D., Bodner, G. E., and Pope, J. (2008). There are many ways to be rich: effects of three measures of semantic richness on visual word recognition. Psychon. Bull. Rev. 15, 161–167. doi: 10.3758/PBR.15.1.161
Phelphs, E. A., LaBar, K. S., Anderson, A. K., O'Connor, K. J., Fullbright, R. K., and Spencer, D. D. (1998). Specifying the contributions of the amygdala to human emotional memory: a case study. Neurocase 4, 527–540. doi: 10.1093/neucas/4.6.527
Ponz, A., Montant, M., Liegeois-Chauvel, C., Silva, C., Braun, M., Jacobs, A. M., et al. (2013). Emotion processing in words: a test of the neural re-use hypothesis using surface and intracranial EEG. Soc. Cogn. Affect. Neurosci. 9, 619–627. doi: 10.1093/scan/nst034
Recio, G., Conrad, M., Hansen, L. B., and Jacobs, A. M. (2014). On pleasure and thrill: the interplay between arousal and valence during visual word recognition. Brain Lang. 134, 34–43. doi: 10.1016/j.bandl.2014.03.009
Rellecke, J., Palazova, M., Sommer, W., and Schacht, A. (2011). On the automaticity of emotion processing in words and faces: event-related brain potentials evidence from a superficial task. Brain Cogn. 77, 23–32. doi: 10.1016/j.bandc.2011.07.001
Schacht, A., and Sommer, W. (2009). Time course and task dependence of emotion effects in visual word processing. Cogn. Affect. Behav. Neurosci. 9, 28–43. doi: 10.3758/CABN.9.1.28
Schacht, A., Adler, N., Chen, P., Guo, T., and Sommer, W. (2012). Association with positive outcome induces early effects in event-related brain potentials. Biol. Psychol. 89, 130–136. doi: 10.1016/j.biopsycho.2011.10.001
Schlochtermeier, L. H., Kuchinke, L., Pehrs, C., Urton, K., Kappelhoff, H., and Jacobs, A. M. (2013). Emotional picture and word processing: an FMRI study on effects of stimulus complexity. PLoS ONE 8:e55619. doi: 10.1371/journal.pone.0055619
Schmidtke, D. S., Schröder, T., Jacobs, A. M., and Conrad, M. (2014a). ANGST: affective norms for German sentiment terms, derived from the affective norms for English words. Behav. Res. Methods 46, 1108–1118. doi: 10.3758/s13428-013-0426-y
Schmidtke, D. S., Conrad, M., and Jacobs, A. M. (2014b). Phonological iconicity. Front. Psychol. 5:80. doi: 10.3389/fpsyg.2014.00080
Schnitzspahn, K. M., Horn, S. S., Bayen, U. J., and Kliegel, M. (2012). Age effects in emotional prospective memory: cue valence differentially affects the prospective and retrospective component. Psychol. Ageing 27, 498–509. doi: 10.1037/a0025021
Schrott, R., and Jacobs, A. M. (2011). Gehirn und Gedicht: Wie wir unsere Wirklichkeiten Konstruieren (Brain and Poetry: How We Construct Our Realities). München: Hanser.
Schwager, S., and Rothermund, K. (2013). Motivation and affective processing biases in risky decision making: a counter-regulation account. J. Ecol. Psychol. 38, 111–125. doi: 10.1016/j.joep.2012.08.005
Sennlaub, G. (2007). Wörterbuch Lollipop: für Kinder der Grundschule; [Mit Bild-Wort- Lexikon Englisch]; 1. Aufl. Berlin: Cornelsen.
Sennlaub, G. (2012). Von A bis Zett: Wörterbuch für Grundschulkinder; [mit Bild-Wort- Lexikon Englisch; mit CD-ROM interaktiver Nachschlagetrainer]. Hamburg: Cornelsen.
Shaoul, C., and Westbury, C. (2009). A USENET Corpus (2005–2009). Edmonton, AB: University of Alberta. Available online at: http://www.psych.ualberta.ca/~westburylab/downloads/usenetcorpus.download.html
Siakaluk, P. D., Pexman, P. M., Sears, C. R., Wilson, K., Locheed, K., and Owen, W. J. (2008). The benefits of sensorimotor knowledge: body-object interaction facilitates semantic processing. Cogn. Sci. 32, 591–605. doi: 10.1080/03640210802035399
Siegle, G. J., Steinhauer, S. R., Thase, M. E., Stenger, V. A., and Carter, C. S. (2002). Can't shake that feeling: event-related fMRI assessment of sustained amygdala activity in response to emotional information in depressed individuals. Biol. Psychiatry 51, 693–707. doi: 10.1016/S0006-3223(02)01314-8
Silveira, S., Graupmann, V., Agthe, M., Gutyrchik, E., Blautzik, J., Demirçapa, I., et al. (2013). Existential neuroscience: effects of mortality salience on the neurocognitive processing of attractive opposite-sex faces. Soc. Cogn. Affect. Neurosci. 9, 1601–1607. doi: 10.1093/scan/nst157
Sylvester, T. (2013). Die Berlin Affective Word List für Kinder – Theoretische Annahmen, Auseinandersetzungen mit der Entwicklung von Wortbedeutungen und deren Messung. Berlin: Freie Universität Berlin.
Tempel, K., Kuchinke, L., Urton, K., Schlochtermeier, L. H., Kappelhoff, H., and Jacobs, A. M. (2013). Effects of positive pictograms and words: an emotional word superiority effect? J. Neurolinguist. 26, 637–648. doi: 10.1016/j.jneuroling.2013.05.002
Võ, M. L. H., Jacobs, A. M., and Conrad, M. (2006). Cross-validating the Berlin affective word list. Behav. Res. Methods 38, 606–609. doi: 10.3758/B.F.03193892
Võ, M. L. H., Jacobs, A. M., Kuchinke, L., Hofmann, M., Conrad, M., Schacht, A., et al. (2008). The coupling of emotion and cognition in the eye: introducing the pupil old/new effect. Psychophysiology 45, 130–140. doi: 10.1111/j.1469-8986.2007.00606.x
Võ, M. L. H., Conrad, M., Kuchinke, L., Hartfeld, K., Hofmann, M. J., and Jacobs, A. M. (2009). The Berlin Affective Word List reloaded (BAWL-R). Behav. Res. Methods 41, 534–539. doi: 10.3758/BRM.41.2.534
Wabnitz, P., Martens, U., and Neuner, F. (2012). Cortical reactions to verbal abuse: event-related brain potentials reflecting the processing of socially threatening words. Neuroreport 23, 774–779. doi: 10.1097/WNR.0b013e328356f7a6
Wagenbreth, C., Rieger, J., Heinze, H. J., and Zaehle, T. (2014). Seeing emotions in the eyes – inverse priming effects induced by eyes expressing mental states. Front. Psychol. 5:1039. doi: 10.3389/fpsyg.2014.01039
Warriner, A. B., Kuperman, V., and Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav. Res. Methods 45, 1191–1207. doi: 10.3758/s13428-012-0314-x
Weigand, A., Grimm, S., Astalosch, A., Guo, J. S., Briesemeister, B. B., Lisanby, S. H., et al. (2013a). Lateralized effects of prefrontal repetitive transcranial magnetic stimulation on emotional working memory. Exp. Brain Res. 227, 43–52. doi: 10.1007/s00221-013-3483-7
Weigand, A., Richtermeier, A., Feeser, M., Guo, J. S., Briesemeister, B. B., Grimm, S., et al. (2013b). State-dependent effects of prefrontal repetitive transcranial magnetic stimulation on emotional working memory. Brain Stimul. 6, 905–912. doi: 10.1016/j.brs.2013.06.004
Westbury, C. F., Shaoul, C., Hollis, G., Smithson, L., Briesemeister, B. B., Hofmann, M. J., et al. (2013). Now you see it, now you don't: on emotion, context, and the algorithmic prediction of human imageability judgments. Front. Psychol. 4:991. doi: 10.3389/fpsyg.2013.00991
Westbury, C., Keith, J., Briesemeister, B. B., Hofmann, M. J., and Jacobs, A. M. (2014). Avoid violence, rioting and outrage; Approach celebration, delight, and strength: Using large text corpora to compute valence, arousal, and the basic emotions. Q. J. Exp. Psychol. 11. doi: 10.1080/17470218.2014.970204
Whitford, V., and Titone, D. (2014). The effects of reading comprehension and launch site on frequency-predictability interactions during paragraph reading. Q. J. Exp. Psychol. 67, 1151–1165. doi: 10.1080/17470218.2013.848216
Willems, R. M., and Casasanto, D. (2011). Flexibility in embodied language understanding. Front. Psychol. 2:116. doi: 10.3389/fpsyg.2011.00116
Keywords: Berlin Affective Word List (BAWL), valence decision task, lexical decision task, emotion, word recognition models, neurocognitive poetics, reading, aesthetics
Citation: Jacobs AM, Võ ML-H, Briesemeister BB, Conrad M, Hofmann MJ, Kuchinke L, Lüdtke J and Braun M (2015) 10 years of BAWLing into affective and aesthetic processes in reading: what are the echoes? Front. Psychol. 6:714. doi: 10.3389/fpsyg.2015.00714
Received: 20 November 2014; Paper pending published: 08 March 2015;
Accepted: 13 May 2015; Published: 03 June 2015.
Edited by:
Cornelia Herbert, University Clinic for Psychiatry and Psychotherapy, Tübingen, GermanyCopyright © 2015 Jacobs, Võ, Briesemeister, Conrad, Hofmann, Kuchinke, Lüdtke and Braun. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Arthur M. Jacobs, Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Habelschwerdter Allee 45, D-14195 Berlin, Germany, ajacobs@zedat.fu-berlin.de