Multimodal Transduction in Deaf Pedagogy - Skyer (2022)
2022, Society for Text and Discourse, Conference
https://doi.org/10.13140/RG.2.2.15667.71201Abstract
a. Multimodal transduction (MT) is an interaction in deaf education that traverses changes in epistemology and ontology. Deaf faculty use MT to convert inaccessible modes to become accessible, often by enhancing visuality or multimodality. Deaf faculty enhance perceptibility by changing modalities, including the full range of language-based and communication-based discourse modes. Throughout MT, deaf pedagogues aim to preserve meaning, which is “carried across” one mode (or ensemble) into another, using an aesthetic mechanism similar to metaphors. 2. Theoretical Framework: a. My research began with an interest in visual pedagogy theory and methods (Rose, 2012) as a means to resolve problems in deaf education, including inexplicit teaching theories (Swanwick & Marschark 2010). As the study developed, I drew on theories of multimodality (Hodges & Kress, 1998; Kress, 2010), the aesthetics of educational change (Cherryholmes, 1999), and the ethics of deaf education (Christensen, 2010). My study used deaf axiology (Skyer, 2021) to synthesize a set of novel theories about visual and multimodal pedagogy in deaf education. Empirical demonstrations of theoretical ideas, which prior research (Kusters, et al., 2017) lacked, were interpreted through a conceptual framework about dissensus and conflict (Rancière, 2010) in pedagogic contexts (Kress, 2010). 3. Methodological Overview: a. I examined pedagogical praxis in a collective (qualitative) case-study involving six deaf educators who are themselves also deaf. I called the group “deaf faculty.” They represent the diversity of both the research site and the wider deaf student population. Evidence gathered from each of the six cases formed the basis for several grounded theories, built atop a large corpus (1.38 terabytes) of multimodal data. It was analyzed using abductive reasoning, analytic memos, and multimodal coding procedures (via MAXQDA software). Data included video and images from authentic observations of teaching, in-depth interviews, and stimulated recall (sessions where participants co-analyzed selections of their data as prompts). 4. Key Findings: a. I found that multimodal transduction (MT) occurred in nearly all teaching and learning interactions in deaf education. I present evidence showing that when deaf faculty apply MT in teaching, deaf students emulate the process and MT reappears in their learning products. The mechanism by which MT works is also its purpose—to change knowledge forms without substantially changing its content (Kress, 2010). The etymology of transduction shows movement across or through two stages, using the same underlying logic as scientific and poetic metaphors (Lakoff & Johnson, 1980; Sfard, 1998). b. MT is and requires a change from one mode or set (e.g., mode ensembles or assemblages of modes) into another. While this can use language at either the starting, intermediate, or ending stages, MT is not limited to language (c.f., Swanwick, 2017). When deaf faculty used MT in these case studies, it usually resulted in increased visuality; however, on the whole, MT is multimodal in character (Kusters, et al., 2017; Tapio, 2013). c. Deaf faculty often change knowledge to be more accessible for deaf learners, knowledge is thus, made more ethical by virtue of its increasing focus on visual and multimodal aesthetic properties. Deaf students and faculty used MT for particular purposes across a myriad of interactions, most of which centered on increasing access, enhancing interactivity, but also for the sheer aesthetic joy of change. d. MT is an “umbrella” encapsulating a broader range of related changes to other discourse forms (See: Illustration 1, below). Furthermore, in the course of the study, I found it useful to disambiguate MT with similar concepts such as: translanguaging, code switching and “chaining” (Humphries & McDougall, 2000). Throughout, I use qualitative data to ground, explain, and clarify claims a. MT is equally important in teaching as in learning. MT is widely and creatively used, owing to its flexibility and adaptivity. MT uses but extends beyond language. It is useful for all deaf students, regardless of cooccurring disabilities or language dysfluency. In sum, MT is an interactionary epistemic-ontological conjunction where the form of knowledge changes, and with it, new realities are manifested for deaf agents. In this, the aesthetic is a signpost to meaning-making.
References (11)
- Cherryholmes, C. (1999). Reading pragmatism. Teachers College Press: New York.
- Hodge, R., & Kress, G. (1988). Social semiotics. Ithaca, NY: Cornell University Press.
- Humphries, T., & McDougall, F. M. (1999). Chaining' and other links: Making connections between American Sign Language and English in two types of school settings. Visual Anthropology Review, 15(2), 84-94.
- Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. New York: Routledge.
- Kusters, A., Spotti, M., Swanwick, R., & Tapio, E. (2017). Beyond languages, beyond modalities: Transforming the study of semiotic repertoires. International Journal of Multilingualism, 14(3), 219-232. https://doi.org/10.1080/14790718.2017.1321651
- Lakoff, G., & Johnson, M. (1980). Metaphors We Live By. Chicago and London: The University of Chicago Press.
- Rancière, J. (2010). Dissensus: On politics and aesthetics. London, UK: Bloomsbury Academic.
- Sfard, A. (1998). On two metaphors for learning and the dangers of choosing just one. Educational Researcher, 27(2), 4-13. doi:10.3102/0013189X027002004
- Skyer, M.E. (2021). "Being and Deafness: The Ontology of Disablement and the Dialectics of Hearing Loss and Deaf Gain." Defining the Boundaries of Disability: Critical Perspectives, Drs. Licia Carlson and Matthew Murray (Eds)., pp. 57-74. Routledge. Link.
- Swanwick, R. (2017). Translanguaging, learning and teaching in deaf education. International Journal of Multilingualism, 14(3), 233-249. https://doi.org/10.1080/14790718.2017.1315808
- Tapio, E. (2013). A nexus analysis of English in the everyday life of FinSL signers: A multimodal view on interaction. Jyväskylä University