Multimodality
2021, “Multimodality.” Chapter 40 in: Xu Wen & John R. Taylor, eds, The Routledge Handbook of Cognitive Linguistics (676-687). London/New York: Routledge
https://doi.org/10.4324/9781351034708-45Abstract
While it is crystal clear that communication can draw on many semiotic resources, research in the humanities has hitherto strongly focused on its verbal manifestations. "Multimodality" labels a variety of approaches and theories trying to remedy this bias by investigating how for instance visuals, music, and sound contribute to meaning-making. The contours of what is developing into a new discipline begin to be discernible. This chapter provides a brief survey of various perspectives on multimodality, addresses the thorny issue of what should count as a mode, and makes suggestions for further development of the fledgling discipline.
References (132)
- Adami, Elisabetta (2017). "Multimodality." In: Ofelia García, Nelson Flores, and Massimiliano Spotti (eds), The Oxford Handbook of Language and Society (451-472). Oxford: Oxford University Press. Doi: 10.1093/oxfordhb/9780190212896.013.23
- Archer, Arlene, and Esther Breuer, eds (2015). Multimodality in Writing: The State of the Art in Theory, Methodology and Pedagogy. Leiden: Brill. Doi: 10.1163/9789004297197
- Asenjo, Roberto (2018). "The influence of culture in the multimodal murals of Northern Ireland." Warsaw Multimodality Workshop and Masterclass, 7-9 June 2018, University of Warsaw, Poland.
- Baldry, Anthony, and Paul J. Thibault (2006). Multimodal Transcription and Text Analysis: A Multimedia Toolkit and Coursebook. London: Equinox.
- Barcelona, Antonio, ed., (2000). Metaphor and Metonymy at the Crossroads: A Cognitive Perspective. Berlin: Mouton de Gruyter.
- Bateman, John (2008). Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. Basingstoke: Palgrave Macmillan. Doi: 10.1057/9780230582323
- Bateman, John (2014). Text and Image: A Critical Introduction to the Visual/Verbal Divide. London: Routledge.
- Bateman, John, Judy Delin, and Renate Henschel (2004). "Multimodality and empiricism: Preparing for a corpus-based approach to the study of multimodal meaning-making." In: Eija Ventola, Cassily Charles, and Martin Kaltenbacher (eds), Perspectives on Multimodality (65-87). Amsterdam: Benjamins. Doi: 10.1075/ddcs.6.06bat
- Bateman, John, and Karl-Heinrich Schmidt (2014). Multimodal Film Analysis: How Films Mean. London: Routledge.
- Bateman, John, Janina Wildfeuer, and Tuomo Hiippala (2017). Multimodality: Foundations, Research and Analysis -A Problem-Oriented Introduction. Berlin: De Gruyter Mouton.
- Bounegru, Liliana, and Charles Forceville (2011). "Metaphors in editorial cartoons representing the global financial crisis." Visual Communication 10: 209-229. Doi: 10.1177/1470357211398446
- Burgers, Christiaan, Elly Konijn, and Gerard Steen (2016). "Figurative framing: Shaping public discourse through metaphor, hyperbole, and irony." Communication Theory 26: 410-430. Doi: 10.1111/comt.12096
- Caballero, Rosario (2006). Re-viewing Space: Figurative Language in Architects' Assessment of Built Space. Berlin: Mouton de Gruyter 2006. Doi: 10.1080/10926480701357687
- Caballero, Rosario (2009). "Cutting across the senses: imagery in winespeak and audiovisual promotion." In: Forceville and Urios-Aparisi (eds), Multimodal Metaphor (73-94). Doi: 10.1515/9783110215366.2.73
- Caple, Helen, Monika Bednarek, and Laurence Anthony (2018). "Using Kaleidographic to visualize multimodal relations within and across texts." Visual Communication 17(4): 461-474. Doi: 10.1177/1470357218789287
- Chandler, Daniel (2017). Semiotics: The Basics (3 rd edn.). London: Routledge.
- Chion, Michel (2009). Film, a Sound Art. Transl. by Claudia Gorbman. New York: Columbia University Press.
- Cienki, Alan (2017). Ten Lectures on Spoken Language and Gesture from the Perspective of Cognitive Linguistics: Issues of Dynamicity and Multimodality. Leiden: Brill. Doi: 10.1163/9789004336230
- Cila, Nazli (2013). Metaphors We Design By: The Use of Metaphors in Product Design. PhD thesis Technical University Delft, NL. ISBN: 978-94-6191-890-1.
- Clark, Billy (2013). Relevance Theory. Cambridge: Cambridge University Press. Doi: 10.1017/CBO9781139034104
- Coëgnarts, Maarten, and Peter Kravanja (2012). "From thought to modality: A theoretical framework for analysing structural-conceptual metaphor and image metaphor in film." Image [&] Narrative 13(1): 96-113.
- Coëgnarts, Maarten, and Peter Kravanja, eds (2015). Embodied Cognition and Cinema. Leuven: Leuven University Press.
- Forceville -Multimodality 13
- Cohn, Neil (2013). The Visual Language of Comics: Introduction to the Structure and Cognition of Sequential Images. London: Bloomsbury.
- Cohn, Neil, ed. (2016). The Visual Narrative Reader. London: Bloomsbury.
- Cook, Nicholas (1998). Analysing Musical Multimedia. Oxford: Clarendon.
- Cornevin, Vanessa, and Charles Forceville (2017). "From metaphor to allegory: The Japanese manga Afuganisu-tan." Metaphor and the Social World 7(2): 236-252. Doi: 10.1075/msw.7.2.04cor
- Djonov, Emilia, and Sumin Zhao, eds (2013), Critical Multimodal Studies of Popular Culture. New York: Routledge.
- Dirven, René, and Ralf Pörings, eds (2002). Metaphor and Metonymy in Comparison and Contrast. Berlin: Mouton de Gruyter.
- Domínguez, Martí (2015). "The metaphorical species: Evolution, adaptation and speciation of metaphors." Discourse Studies 17(4): 433-448.
- El Refaie, Elisabeth (2003). "Understanding visual metaphors: The example of newspaper cartoons." Visual Communication 2(1): 75-95. Doi: 10.1177/1470357203002001755
- El Refaie, Elisabeth (2019). Visual Metaphor and Embodiment in Graphic Illness Narratives. Oxford: Oxford University Press.
- Elleström, Lars (2010). "Introduction." In: Lars Elleström (ed.), Media Borders, Multimodality and Intermediality (1-48). Basingstoke: Palgrave MacMillan.
- Fahlenbrach, Kathrin, ed. (2016). Embodied Metaphors in Film, Television, and Video Games. London: Routledge.
- Fahlenbrach, Kathrin (2017). "Audiovisual metaphors and metonymies of emotions and depression in moving images." In: Ervas Francesca, Elisabetta Gola, and Maria Grazia Rossi (eds), Metaphor in Communication, Science and Education (95-117). Berlin: De Gruyter Mouton. Doi: 10.1515/9783110549928-006
- Fauconnier, Gilles, and Mark Turner (2002). The Way We Think: Conceptual Blending and the Mind's Hidden Complexities. New York: Basic Books.
- Forceville, Charles (1996). Pictorial Metaphor in Advertising. London: Routledge.
- Forceville, Charles (1999). "Educating the eye? Kress and Van Leeuwen's Reading Images: The Grammar of Visual Design (1996)." Language and Literature 8(2): 163-178. Doi: 10.1177/096394709900800204
- Forceville, Charles (2005a). "Visual representations of the Idealized Cognitive Model of anger in the Asterix album La Zizanie." Journal of Pragmatics 37: 69-88. Doi: 10.1016/j.pragma.2003.10.002
- Forceville, Charles (2005b). "Addressing an audience: Time, place, and genre in Peter van Straaten's calendar cartoons." Humor: International Journal of Humor Research 18(3): 247-278. Doi: 10.1515/humr.2005.18.3.247
- Forceville, Charles (2006). "Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research." In: Gitte Kristiansen, Michel Achard, René Dirven, and Francisco Ruiz de Mendoza (eds.), Cognitive Linguistics: Current Applications and Future Perspectives (379-402). Berlin: Mouton de Gruyter.
- Forceville, Charles (2013). "Creative visual duality in comics balloons." In: Tony Veale, Kurt Feyaerts, and Charles Forceville (eds), Creativity and the Agile Mind: A Multi-Disciplinary Exploration of a Multi-Faceted Phenomenon (253-273). Berlin: De Gruyter Mouton.
- Forceville Charles (2014). "Relevance Theory as model for analysing multimodal communication." In: David Machin (ed.), Visual Communication (51-70). Berlin: De Gruyter Mouton.
- Forceville, Charles (2018). "Multimodality, film, and cinematic metaphor: An evaluation of Müller and Kappelhoff (2018)." Punctum: International Journal of Semiotics (Greece) 4(2): 90-108. DOI: 10.18680/hss.2018.0021
- Forceville, Charles (2020). Visual and Multimodal Mass-Communication: Applying the Relevance Principle. Oxford University Press.
- Forceville, Charles, and Eduardo Urios-Aparisi, eds (2009). Multimodal Metaphor. Berlin: Mouton de Gruyter.
- Forceville, Charles, and Billy Clark (2014). "Can pictures have explicatures?" Linguagem em (Dis)curso 14(3): 451-472.
- Forceville, Charles, and Eduardo Urios-Aparisi, eds (2009). Multimodal Metaphor. Berlin: Mouton de Gruyter.
- Forceville, Charles, and Marloes Jeulink (2011). "The flesh and blood of embodied understanding: The source-path-goal schema in animation film." Pragmatics & Cognition 19(1): 37-59. Doi: 10.1075/pc.19.1.02for
- Forceville, Charles, and Sissy Paling (2018). "The metaphorical representation of DEPRESSION in short, wordless animation films." Visual Communication (ahead of print, via open access at http://journals.sagepub.com/doi/10.1177/1470357218797994).
- Forceville, Charles, and Nataša van de Laar (2019). "Metaphors portraying right-wing politician Geert Wilders in Dutch political cartoons." In: Encarnación Hidalgo Tenorio, Miguel Ángel Benitez Castro, and Francesca De Cesare (eds), Populist Discourse: Critical Approaches to Contemporary Politics (292-307). London: Routledge.
- Frow, John (2015). Genre (2 nd edn.). London: Routledge.
- Gibbons, Alison (2012). Multimodality, Cognition, and Experimental Literature. London: Routledge.
- Gibbs, Raymond W., Jr (1993). "Process and products in making sense of tropes." In: Andrew Ortony (ed.), Metaphor and Thought, 2 nd edn. (252-176). Cambridge: Cambridge University Press. Doi: 10.1017/CBO9781139173865.014
- Górska, Elżbieta (2010). "Life is music: A case study of a novel metaphor and its use in discourse." English Text Construction 3(2): 275-293. Doi: 10.1075/bct.40.08gor
- Greifenstein, Sarah, Dorothea Horst, Thomas Scherer, Christina Schmitt, Hermann Kappelhoff, and Cornelia Müller, eds (2018). Cinematic Metaphor in Perspective: Reflections on a Transdisciplinary Framework. Berlin: De Gruyter Mouton.
- Grice (1975). "Logic and conversation." In: Peter Cole and Jerry L. Morgan (eds), Syntax and Semantics 3: Speech Acts (41-58). New York: Academic Press.
- Hamann, Agnieszka (2018). "Multimodal meaning-making in Classic Maya inscriptions." LaMiCuS 2: 132-146. Doi: 10.32058/LAMICUS-2018-005
- Hidalgo-Downing, Laura, and Blanca Kraljevic-Mujic, eds (2013). "Metaphorical creativity across modes." Special issue of Metaphor and the Social World 3(2). Doi: 10.1075/msw.3.2.01int
- Hidalgo-Downing, Laura, and Blanca Kraljevic-Mujic, eds (2020). Performing Metaphoric Creativity across Modes and Contexts. Berlin: De Gruyter Mouton.
- Hiippala, Tuomo (2015). The Structure of Multimodal Documents: An Empirical Approach. London: Routledge.
- Holšánová, Jana (2008). Discourse, Vision, and Cognition. Amsterdam: Benjamins.
- Holšánová, Jana (2014). "In the eye of the beholder: Visual communication from a recipient perspective." In: David Machin (ed.), Visual Communication (331-355). Berlin: De Gruyter Mouton. Hommerberg, Charlotte (2011). Persuasiveness in the Discourse of Wine: The Rhetoric of Robert Parker. Linnaeus University Dissertations no 71/2011. ISBN: 978-91-86983-18-5
- Ibarretxe-Antuñano, Iraide (2013). "The relationship between conceptual metaphor and culture." Intercultural Pragmatics 10(2): 315-339.
- Indurkhya, Bipin, and Amitash Ojha (2013). "An empirical study on the role of perceptual similarity in visual metaphors and creativity." Metaphor and Symbol 28: 233-253. Doi: 10.1080/10926488.2013.826554
- Jewitt, Carey, ed. (2014a). The Routledge Handbook of Multimodal Analysis (2 nd edn.). London: Routledge.
- Jewitt, Carey (2014b). "Different approaches to multimodality." In: Carey Jewitt (ed.), The Routledge Handbook of Multimodal Analysis (31-43). London: Routledge.
- Jewitt, Carey (2014c). "An introduction to multimodality." In: Carey Jewitt (ed.), The Routledge Handbook of Multimodal Analysis (15-30). London: Routledge.
- Jewitt, Carey, Jeff Bezemer, and Kay O' Halloran (2016). Introducing Multimodality. London: Routledge.
- Johnson, Mark, and Steve Larson (2003). "'Something in the way she moves' -metaphors of musical motion." Metaphor and Symbol 18: 63-84. Doi: 10.1207/S15327868MS1802_1
- Kashanizadeh, Zahra, and Charles Forceville (2020). "Visual and multimodal interaction of metaphor and metonymy in print advertising." Cognitive Linguistics Studies 7(1): 78-110.
- Klug, Nina-Maria, and Hartmut Stöckl, eds (2016). Handbuch Sprache im multimodalen Kontext/The Language in Multimodal Contexts Handbook. Berlin: De Gruyter Mouton.
- Kövecses, Zoltán, and Günther Radden (1998). "Metonymy: Developing a cognitive linguistic view." Cognitive Linguistics 9(1): 37-78. Doi: 10.1515/cogl.1998.9.1.37
- Kozloff, Sarah (1988). Invisible Storytellers: Voice-Over Narration in American Fiction Film. Berkeley: University of California Press.
- Kozloff, Sarah (2000). Overhearing Film Dialogue. Berkeley: University of California Press.
- Kress, Gunther (2010). Multimodality: A Social Semiotic Approach to Contemporary Communication. London: Routledge.
- Kress, Gunther, and Theo van Leeuwen (2006). Reading Images: The Grammar of Visual Design (2 nd edn.). London: Routledge.
- Kress, Gunther, and Theo van Leeuwen (2001). Multimodal Discourse. London: Arnold.
- Lakoff, George, and Mark Johnson (1980). Metaphors We Live By. Chicago: University of Chicago Press.
- Lankjaer, Birger (2016). "Problems of metaphor, film, and visual perception." In: Kathrin Fahlenbrach (ed.), Embodied Metaphors in Film, Television, and Video Games (115-128). London: Routledge.
- Lin, Tiffany Ying-Yu, and Wen-Yu Chiang (2015). "Multimodal fusion in analyzing political cartoons: Debates on U.S. beef imports into Taiwan." Metaphor and Symbol 30: 137-161. Doi: 10.1080/10926488.2015.1016859
- Littlemore, J. (2015). Metonymy: Hidden Shortcuts in Language, Thought and Communication. Cambridge: Cambridge University Press.
- Machin, David, ed. (2014), Visual Communication. Berlin: De Gruyter Mouton.
- McCloud, Scott (1993). Understanding Comics. New York: Paradox Press.
- McNeill, David (1992). Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.
- Mildorf, Jarmila, and Till Kinzel, eds (2016). Audionarratology: Interfaces of Sound and Narrative. Berlin: De Gruyter Mouton.
- Mittelberg, Irene, and Linda R. Waugh (2009). "Metonymy first, metaphor second: A cognitive- semiotic approach to multimodal figures of thought in co-speech gesture." In: Forceville and Urios-Aparisi (eds.), Multimodal Metaphor (329-356).
- Müller, Cornelia (2008). Metaphors Dead and Alive, Sleeping and Waking: A Dynamic View. Chicago: University of Chicago Press.
- Müller, Cornelia, and Hermann Kappelhoff (2018). Cinematic Metaphor: Experience -Affectivity - Temporality. Berlin: De Gruyter Mouton.
- Negro Alousque, Isabel (2014). "Pictorial and verbo-pictorial metaphor in Spanish political cartooning." Círculo de Lingüística Aplicada a la Comunicación 57, 59-84. Doi: 10.5209/rev_CLAC.2014.v57.44515
- Norris, Sigrid, ed. (2012). Multimodality in Practice: Investigating Theory-in-Practice through Methodology. London: Routledge.
- Origgi, Gloria (2013). "Democracy and trust in the age of the Social Web." Teoria Politica. Nova Serie, Annali II: 23-38.
- Ortiz, María J. (2011). "Primary metaphors and monomodal visual metaphors." Journal of Pragmatics 43: 1568-1580. Doi: 10.1016/j.pragma.2010.12.003
- Ortiz, María J. (2015). "Films and embodied metaphors of emotion." In: Maarten Coëgnarts and Peter Kravanja (eds), Embodied Cognition and Cinema (203-220). Leuven: Leuven University Press.
- Parrill, Fey (2012). "Interactions between discourse status and viewpoint in co-speech gesture." In: Barbara Dancygier and Eve Sweetser (eds), Viewpoint in Language: A Multimodal Perspective (97- 112). Cambridge: Cambridge University Press. Doi: 10.1017/CBO9781139084727.008
- Pérez-Sobrino, Paula (2017). Multimodal Metaphor and Metonymy in Advertising. Amsterdam: Benjamins.
- Pinár-Sanz, Maria Jesús, ed. (2013). "Multimodality and cognitive linguistics," special issue of Review of Cognitive Linguistics 11(2). Doi: 10.1075/bct.78
- Plowright, Philip (2017). Qualititative Embodiment in Architectural Discourse: Conceptual Metaphors and the Value Judgement of Space. PhD thesis, Facultad de Letras Universidad de Castilla-La Mancha Ciudad Real, Spain.
- Plümacher, Martina, and Peter Holz, eds (2007). Speaking of Colors and Odors. Amsterdam: Benjamins.
- Poppi, Fabio Indio Massimo, and Peter Kravanja (2019). "Actiones secundum fidei: Antithesis and metaphoric conceptualization in Banksy's graffiti art." Metaphor and the Social World 9(1): 84- 107. Doi: 10.1075/msw.17021.pop
- Rewiś-Łętkowska, Anna (2015). "Multimodal representations of fear metaphors in television commercials." In: Dorota Brzozowska and Władysław Chłopicki (eds), Culture's Software: Communication Styles (381-404). Newcastle upon Tyne: Cambridge Scholars.
- Royce, Terry, and Wendy L. Bowcher, eds (2007). New Directions in the Analysis of Multimodal Discourse. Mahwah: Lawrence Erlbaum.
- Ruiz de Mendoza, Francisco (2000). "The role of mappings and domains in understanding metonymy." In: Antonio Barcelona (ed.), Metaphor and Metonymy at the Crossroads (109-132). Berlin: Mouton de Gruyter. Doi: 10.1515/9783110894677.109
- Schilperoord, Joost, and Alfons Maes (2009). "Visual metaphoric conceptualization in editorial cartoons." In: Forceville and Urios-Aparisi (eds), Multimodal Metaphor (213-240).
- Scollon, Ron, and Suzy Wong Scollon (2003). Discourses in Place: Language in the Material World. London: Routledge.
- Scollon, Ron, and Suzie Wong Scollon (2014). "Multimodality and language: A retrospective and prospective view." In: Carey Jewitt (ed.), The Routledge Handbook of Multimodal Analysis (205- 216). London: Routledge.
- Sperber, Dan and Deirdre Wilson (1995). Relevance: Communication and Cognition (2 nd edn.). Oxford: Blackwell.
- Stamenković, Dušan, Miloš Tasić, and Charles Forceville (2018). "Facial expressions in comics: An empirical consideration of McCloud's proposal." Visual Communication 17(4): 407-432. Doi: 10.1177/1470357218784075
- Steen, Francis, F., Anders Hougaard, Jungseock Joo, Inés Olza, Cristóbal Pagán Cánovas, Anna Pleshakova, Soumya Ray, Peter Uhrig, Javier Valenzuela, Jacek Woźny, and Mark Turner (2018). "Toward an infrastructure for data-driven multimodal communication research." LaMiCuS 2: 208- 222. Stöckl, Hartmut (2014a). "Typography." In: Sigrid Norris and Carmen Daniela Maier (eds), Interactions, Images and Texts. A Reader in Multimodality (281-294). Berlin: de Gruyter Mouton.
- Stöckl, Hartmut (2014b). "Semiotic paradigms and multimodality." In: Carey Jewitt (ed.), The Routledge Handbook of Multimodal Analysis (2 nd edn.) (274-286). London: Routledge.
- Stöckl, Hartmut (2019). "Linguistic multimodality -multimodal linguistics: a state-of-the-art sketch." In: Wildfeuer et al. (eds), Multimodality: Disciplinary Thoughts and the Challenge of Diversity (41- 68).
- Szawerna, Michał (2017). Metaphoricity of Conventionalized Diegetic Images in Comics: A Study in Multimodal Cognitive Linguistics. Frankfurt am Main: Peter Lang.
- Taylor, Christopher (2019). "Audio description: A multimodal practice in expansion." In: Wildfeuer et al. (eds), Multimodality: Disciplinary Thoughts and the Challenge of Diversity (195-218).
- Teng, Norman Y. (2009). "Image alignment in multimodal metaphor." In: Forceville and Eduardo Urios-Aparisi (eds), Multimodal Metaphor (197-211). .
- Teng, Norman Y., and Sewen Sun (2002). "Grouping, simile, and oxymoron in pictures: A design- based cognitive approach." Metaphor and Symbol 17: 295-316. Doi: 10.1207/S15327868MS1704_3
- Tseng, Chiao-i (2013). Cohesion in Film: Tracking Film Elements. Basingstoke: Palgrave Macmillan.
- Tseronis, Assimakis, and Charles Forceville (2017). "The argumentative relevance of visual and multimodal antithesis in Frederick Wiseman's documentaries." In: Assimakis Tseronis and Charles Forceville (eds), Multimodal Argumentation and Rhetoric in Media Genres (165-188). Amsterdam: Benjamins. DOI: 10.1075/aic.14.07tse
- Tuominen, Tiina, Catalina Jiménez Hurtado, and Anne Ketola (2018). "Why methods matter: Approaching multimodality in translation research." Linguistica Antverpiensia, New Series: Themes in Translation Studies 17: 1-21.
- Unsworth, Len, and Chris Clérigh (2009). "Multimodality and reading: The construction of meaning through image-text interaction." In: Carey Jewitt (ed.), The Routledge Handbook of Multimodal Analysis (2 nd edn.) (151-163). London: Routledge.
- Van Leeuwen, Theo (1999). Speech, Music, Sound. Basingstoke: Macmillan.
- Van Leeuwen, Theo (2006). "Towards a semiotics of typography." Information Design Journal 14(2): 139-155. Doi: 10.1075/idj.14.2.06lee
- Van Leeuwen, Theo, and Carey Jewitt, eds (2001). Handbook of Visual Analysis. London: Sage.
- Van Rompay, Thomas (2005). Expressions: Embodiment in the Experience of Design. PhD thesis, Technical University Delft, NL. ISBN: 90-9019316-2
- Ventola, Eija, and Arsenio Jesús Moya Guijarro, eds (2009). The World Told and the World Shown: Multisemiotic Issues. Basingstoke: Palgrave Macmillan.
- Wharton, Tim (2009). Pragmatics and Non-Verbal Communication. Cambridge: Cambridge University Press.
- Wharton, Tim, and Claudia Strey (2019). "Slave of the passions: Making emotions relevant." In: Kate Scott, Billy Clark, and Robyn Carston (eds), Relevance, Pragmatics and Interpretation (253-266). Cambridge: Cambridge University Press.
- Wildfeuer, Janina, Jana Pflaeging, John Bateman, Chiao-I Tseng, and Ognyan Seizov, eds (2019), Multimodality: Disciplinary Thoughts and the Challenge of Diversity. Berlin: De Gruyter Mouton.
- Wilson, Deirdre, and Dan Sperber, eds (2012). Meaning and Relevance. Cambridge: Cambridge University Press.
- Yus, Francisco (2011). Cyberpragmatics: Internet-mediated Communication in Context. Amsterdam: Benjamins.
- Yus, Francisco (2014). "Not all emoticons are created equal." Linguagem em (Dis)curso 14(3): 511- 529. Yus, Francisco (2016). Humour and Relevance. Benjamins, Amsterdam.
- Zbikowski, Lawrence (2009). "Music, language, and multimodal metaphor." In: Forceville and Urios- Aparisi (eds), Multimodal Metaphor (359-381).
- Bioline Charles Forceville works in Media Studies, University of Amsterdam. His key research question is how visuals convey meaning, alone or in combination with other modes. A cognitivist, he publishes on multimodal narration and rhetoric in documentary, animation, advertising, comics, and cartoons.