Academia.eduAcademia.edu

Multimodal Reading Comprehension

description7 papers
group0 followers
lightbulbAbout this topic
Multimodal reading comprehension refers to the ability to understand and integrate information from multiple modes of communication, such as text, images, audio, and video. It emphasizes the interaction between different modalities in the reading process, enhancing comprehension and interpretation of content across diverse formats.
lightbulbAbout this topic
Multimodal reading comprehension refers to the ability to understand and integrate information from multiple modes of communication, such as text, images, audio, and video. It emphasizes the interaction between different modalities in the reading process, enhancing comprehension and interpretation of content across diverse formats.

Key research themes

1. How does multimodal input affect the online processing and reading comprehension of second language learners?

This research theme focuses on understanding how learners process and integrate multiple modalities—written text, images, and auditory input—during second language (L2) reading. It examines attentional allocation, cognitive load, and the relationship between processing behaviors (e.g., gaze patterns) and comprehension outcomes. Insights inform the design of optimal multimodal instructional materials that enhance L2 reading comprehension.

Key finding: Using eye-tracking with young L2 English learners (11–12 years old), this study found that the addition of auditory input in reading-while-listening (RWL) conditions led learners to allocate more attention to images than in... Read more
Key finding: Replicating and extending eye-tracking analyses of young L2 readers, this work corroborated that auditory input facilitates increased visual attention to accompanying images. It additionally revealed that struggling to... Read more
Key finding: This comprehensive review identified that L2 readers inherently face greater cognitive demands in multimodal reading due to divided attention across text, images, and possibly audio. It highlighted that images typically... Read more

2. What is the relationship between decoding skills, comprehension monitoring, and reading comprehension outcomes?

This theme investigates cognitive and metacognitive factors underpinning reading comprehension. It includes the role of decoding fluency, comprehension monitoring (the reader’s ability to detect inconsistencies and resolve ambiguities), and their interaction in fostering effective comprehension. These studies often utilize behavioral and eye-tracking methods to elucidate when comprehension difficulties arise and how they impact text understanding.

Key finding: Using eye-tracking, this study examined how readers detect inconsistencies in sentences manipulating causal connective polarity (e.g., "because" vs. "although"). Findings showed that comprehension monitoring is influenced by... Read more
Key finding: This review synthesized evidence that decoding skill deficits alone do not account for many children's poor reading comprehension: about 10% have adequate decoding but poor comprehension abilities. Importantly, deficits at... Read more
Key finding: Focusing on metacognitive strategy use, this study showed that engaging EFL readers in think-aloud protocols significantly improves reading comprehension. By verbalizing their cognitive processes, learners increase awareness... Read more

3. How can the integration of multimodal texts (moving images, graphic novels) enhance reading comprehension development across contexts?

This theme explores pedagogical and cognitive benefits of multimodal text formats beyond traditional print, such as graphic novels and moving-image narratives, particularly for younger or struggling readers. It addresses how nontraditional multimodal narratives support engagement, inference making, and transfer of comprehension strategies independently of decoding skills, offering novel avenues to scaffold reading development and interdisciplinary learning.

Key finding: This small-scale intervention study demonstrated that explicit instruction using short animated narrative films significantly improved primary-aged children’s reading comprehension and accuracy on standardized tests—even... Read more
Key finding: By teaching sixth graders the design elements of graphic novels alongside historical content, students simultaneously increased their understanding of graphic novel reading strategies and content knowledge. The study provided... Read more

All papers in Multimodal Reading Comprehension

If as literacy educators we are to be successful brokers of our own destinies and those of our students in mat- ters of policy and practice, we have to communicate in clear and consistent language. Currently, the M word (multiliteracies)... more
This study aimed to determine the in-school and out-of-school reading and writing experiences of middle school students. This study used phenomenology from qualitative research methods. All 12 participants (8 female, 4 male) were middle... more
Evaluación de tipos y combinaciones de presentaciones multimodales en la retención y la transferencia de vocabulario concreto en el aprendizaje de EFL Abstract Although multimodality has been addressed in the educational psychology arena,... more
Download research papers for free!