AUTHOR=Castaldi Jacopo 

TITLE=Refining concepts for empirical multimodal research: defining semiotic modes and semiotic resources

JOURNAL=Frontiers in Communication

VOLUME=9

YEAR=2024

URL=https://www.frontiersin.org/journals/communication/articles/10.3389/fcomm.2024.1336325

DOI=10.3389/fcomm.2024.1336325

ISSN=2297-900X

ABSTRACT=<p>The issue of defining key concepts in multimodal research is at the same time ongoing and of pivotal importance. Building on John Bateman’s categorisation of modes, and paying special attention to the concept of <italic>materiality</italic> within the discussion, the paper provides a clear differentiation between <italic>semiotic modes</italic> and <italic>semiotic resources</italic> and discusses the relationship between the two. These will be defined by also looking at how they differ from another key concept in multimodal research, i.e., <italic>media</italic>, and examples will be provided to illustrate how the newly defined concepts can guide empirical investigations of multimodal texts and their reception. The paper aims to continue the discussions around these key concepts amongst multimodal scholars, so that agreement in the field can eventually be reached.</p>