AUTHOR=Ekström Axel G. , Nirme Jens , Gärdenfors Peter 

TITLE=Motion iconicity in prosody

JOURNAL=Frontiers in Communication

VOLUME=7

YEAR=2022

URL=https://www.frontiersin.org/journals/communication/articles/10.3389/fcomm.2022.994162

DOI=10.3389/fcomm.2022.994162

ISSN=2297-900X

ABSTRACT=<p>Evidence suggests that human non-verbal speech may be rich in iconicity. Here, we report results from two experiments aimed at testing whether perception of increasing and declining <italic>f</italic><sub>0</sub> can be iconically mapped onto motion events. We presented a sample of mixed-nationality participants (<italic>N</italic> = 118) with sets of two videos, where one pictured upward movement and the other downward movement. A disyllabic non-sense word prosodically resynthesized as increasing or declining in <italic>f</italic><sub>0</sub> was presented simultaneously with each video in a pair, and participants were tasked with guessing which of the two videos the word described. Results indicate that prosody is iconically associated with motion, such that motion-prosody congruent pairings were more readily selected than incongruent pairings (<italic>p</italic> &lt; 0.033). However, the effect observed in our sample was primarily driven by selections of words with declining <italic>f</italic><sub>0</sub>. A follow-up experiment with native Turkish speaking participants (<italic>N</italic> = 92) tested for the effect of language-specific metaphor for auditory pitch. Results showed no significant association between prosody and motion. Limitations of the experiment, and some implications for the motor theory of speech perception, and “gestural origins” theories of language evolution, are discussed.</p>