AUTHOR=Stöckl Hartmut , Pflaeging Jana 

TITLE=Multimodal Coherence Revisited: Notes on the Move From Theory to Data in Annotating Print Advertisements

JOURNAL=Frontiers in Communication

VOLUME=7

YEAR=2022

URL=https://www.frontiersin.org/journals/communication/articles/10.3389/fcomm.2022.900994

DOI=10.3389/fcomm.2022.900994

ISSN=2297-900X

ABSTRACT=<p>The present paper proposes a preliminary annotation framework for the study of multimodal coherence in print ads. The framework is firmly based on a review of current theorizing on multimodal cohesion and coherence. Following guidelines for good empirical practice, the annotation scheme is tested on 50 ad samples, seeking to illustrate genre-specific qualities of multimodal coherence and to identify difficulties in applying conceptual frameworks to data. The paper employs six dimensions of multimodal coherence: layout, cohesive ties, info-linking, relational propositions, mode-centricity and multimodal rhetorical operations. In conclusion, we outline some of the more general challenges that multimodal annotation raises when it makes close contact with data.</p>