Fei Victor Lim- English Language and Literature Academic Group, National Institute of Education, Nanyang Technological University, Singapore, Singapore
Editorial on the Research Topic
Transduction in evolving contexts of intermodal meaning making: Moving meaning across media, modes and multiple realities
Gunther Kress in his seminal book, Multimodality: Exploring Contemporary Methods of Communication, argued for the importance of naming the “processes of ‘moving meaning'… across modes” (Kress, 2010, p. 124). He introduced the term “transduction” (Kress, 1997) to describe the movement of meanings across modes, which we have extended in this present Research Topic to include media and multiple realities. Scholars have also used the term “intersemiosis” (O'Halloran, 2005; Baldry and Thibault, 2006; Unsworth, 2006; Bateman, 2008; Lim, 2021) “intermodal relations” (Caple, 2008; Martin, 2008; Norris and Maier, 2014; Siefkes, 2015) and “transposition” (Cope and Kalantzis, 2020; Kalantzis and Cope, 2020; Lim et al.) to account for the shifting of meanings from one mode to another. The concept of transduction has been used productively by many researchers seeking to understand the nature of multimodal meaning-making, particularly the interactions and interplay of meanings across semiotic systems (Bezemer and Kress, 2008; Hellwig et al.; Newfield, 2014; Rivers; Tytler and Prain; Sindoni, 2016).
In the contemporary digital and multimodal world presenting evolving and new contexts for intermodal meaning making, it is of value for scholars not only to theorize but also apply our understandings of transduction to inform transdisciplinary research, develop better educational approaches, and bring about positive social change. This Research Topic presents four articles which contribute toward the set of goals.
Tytler and Prain report on a successful study from their research project which involves the design and development of a pedagogy to guide students in understanding the transduction process involved in the multimodal meaning-making of primary school science. The authors show how students in a primary school science classroom can be guided by their teachers to explore similar and different meanings across modes. In this, they demonstrate the value of explicating the transduction process in the students' learning of concepts and processes in science.
Lim et al. introduce a pedagogic metalanguage of transpositional grammar to support primary and secondary school students' learning of multimodal literacy in the language classroom. The authors argue that providing the resources to support teachers and students' thinking and talking about multimodal meaning as well as rebalancing the cognitive bias in education with attention to the affective and embodied dimensions of learning can contribute to educational justice in the digital age.
Hellwig et al. present a compelling case for the learning of multimodal literacy, particularly the understanding of transduction, in the training of architecture and civil engineering students in universities. The authors report on a study where students in two courses of English for Architecture and Civil Engineering created digital multimodal artifacts to explain disciplinary concepts. The analysis of these artifacts reveals the range of semiotic resources used to communicate complex ideas and offers both theoretical contributions on developing a model for transduction as well as practical implications on a multimodal literacy curriculum for tertiary students.
Rivers takes us beyond the context of formal education to explore the transduction in the “multimodal gestalts” of the YouTube videos recording a bike initiative of British DH Dom Whiting. The author presents the analysis of the soundtrack of the drum and bass music in the videos from a social semiotic approach to multimodality and reflects on how the music communicates a post-pandemic utopianism in the United Kingdom. Through the discussion, Rivers argues for the importance of moving beyond the superficial differences which prior to the pandemic had divided and structured society, toward greater diversity and inclusiveness.
Through the notable contributions made by the 10 authors in this Research Topic, we hope to initiate a conversation and provoke a discussion on how our current understandings of multimodal meaning-making can bring about better learning for students, contribute to educational justice in the digital age, and advance positive social transformation in the post pandemic world.
Author contributions
FL prepared the text of the editorial.
Acknowledgments
The editors would like to thank the authors and reviewers for their contribution to the Research Topic.
Conflict of interest
The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Baldry, A., and Thibault, P. (2006). Multimodal Transcription and Text Analysis: A Multimedia Toolkit and Coursebook. London: Equinox.
Bateman, J. (2008). Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. New York, NY: Palgrave Macmillan UK.
Bezemer, J., and Kress, G. (2008). Writing in multimodal texts: a social semiotic account of designs for learning. Written Commun. 25, 166–195. doi: 10.1177/0741088307313177
Caple, H. (2008). “Intermodal relations in image nuclear news stories,” in Multimodal Semiotics. Functional Analysis in Contexts of Education, ed L. Unsworth (London: Continuum), 125–138.
Cope, B., and Kalantzis, M. (2020). Making Sense: Reference, Agency, and Structure of Multimodal Meaning. Cambridge: Cambridge University Press.
Kalantzis, M., and Cope, B. (2020). Adding Sense: Context and Interest in a Grammar of Multimodal Meaning. Cambridge: Cambridge University Press.
Kress, G. (1997): Before Writing: Rethinking the Paths to Literacy. London; New York, NY: Routledge.
Kress, G. (2010). Multimodality: A Social Semiotic Approach to Contemporary Communication. Abingdon; New York, NY: Routledge.
Lim, F. V. (2021). Investigating intersemiosis: a systemic functional multimodal discourse analysis of the relationship between language and gesture in classroom discourse. Visual Commun. 20, 34–58. doi: 10.1177/1470357218820695
Martin, J. R. (2008). “Intermodal reconciliation: Mates in arms,” in New Literacies and the English Curriculum: Multimodal Perspectives, ed L. Unsworth (London: Continuum), 112–148.
Newfield, D. (2014). “Transduction, transformation and the transmodal moment,” in The Routledge Handbook of Multimodal Analysis, ed C. Jewitt (London; New York, NY: Routledge), 100–114.
Norris, S., and Maier, C. D. (2014). Interactions, Images, and Text: A Reader in Multimodality. London; New York, NY: Routledge. doi: 10.1515/9781614511175
O'Halloran, K. L. (2005). Mathematical Discourse: Language, Symbolism and Visual Images. London: Continuum.
Siefkes, M. (2015). How semiotic modes work together in multimodal texts: Defining and representing intermodal relations. 10plus1 Liv. Linguist. 1, 113–131.
Sindoni, M. G. (2016). The semantics of migration. Translation as transduction: remaking meanings across modes. HERMES J. Lang. Commun. Bus. 55, 27–44. doi: 10.7146/hjlcb.v0i55.24287
Keywords: multimodality, transduction, intersemiosis, transposition, intermodal relations, semiotic modes, digital age, meaning-making
Citation: Lim FV (2023) Editorial: Transduction in evolving contexts of intermodal meaning making: Moving meaning across media, modes and multiple realities. Front. Commun. 8:1138753. doi: 10.3389/fcomm.2023.1138753
Received: 06 January 2023; Accepted: 09 January 2023;
Published: 18 January 2023.
Edited and reviewed by: John A. Bateman, University of Bremen, Germany
Copyright © 2023 Lim. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Fei Victor Lim, 
victor.lim@nie.edu.sg