GenAIReading: Augmenting Human Cognition with Interactive Digital Textbooks Using Large Language Models and Image Generation Models
By: Ryugo Morita , Ko Watanabe , Jinjia Zhou and more
Potential Business Impact:
AI makes learning easier with pictures and summaries.
Cognitive augmentation is a cornerstone in advancing education, particularly through personalized learning. However, personalizing extensive textual materials, such as narratives and academic textbooks, remains challenging due to their heavy use, which can hinder learner engagement and understanding. Building on cognitive theories like Dual Coding Theory -- which posits that combining textual and visual information enhances comprehension and memory -- this study explores the potential of Generative AI (GenAI) to enrich educational materials. We utilized large language models (LLMs) to generate concise text summaries and image generation models (IGMs) to create visually aligned content from textual inputs. After recruiting 24 participants, we verified that integrating AI-generated supplementary materials significantly improved learning outcomes, increasing post-reading test scores by 7.50%. These findings underscore GenAI's transformative potential in creating adaptive learning environments that enhance cognitive augmentation.
Similar Papers
Towards an AI-Augmented Textbook
Computers and Society
Makes textbooks teach you in your own way.
Towards an AI-Augmented Textbook
Computers and Society
Makes textbooks teach you in your own way.
Enhancing Higher Education with Generative AI: A Multimodal Approach for Personalised Learning
Human-Computer Interaction
Helps students learn and teachers grade faster.