SceneLoom: Communicating Data with Scene Context
By: Lin Gao , Leixian Shen , Yuheng Zhao and more
Potential Business Impact:
Connects charts with real pictures for better stories.
In data-driven storytelling contexts such as data journalism and data videos, data visualizations are often presented alongside real-world imagery to support narrative context. However, these visualizations and contextual images typically remain separated, limiting their combined narrative expressiveness and engagement. Achieving this is challenging due to the need for fine-grained alignment and creative ideation. To address this, we present SceneLoom, a Vision-Language Model (VLM)-powered system that facilitates the coordination of data visualization with real-world imagery based on narrative intents. Through a formative study, we investigated the design space of coordination relationships between data visualization and real-world scenes from the perspectives of visual alignment and semantic coherence. Guided by the derived design considerations, SceneLoom leverages VLMs to extract visual and semantic features from scene images and data visualization, and perform design mapping through a reasoning process that incorporates spatial organization, shape similarity, layout consistency, and semantic binding. The system generates a set of contextually expressive, image-driven design alternatives that achieve coherent alignments across visual, semantic, and data dimensions. Users can explore these alternatives, select preferred mappings, and further refine the design through interactive adjustments and animated transitions to support expressive data communication. A user study and an example gallery validate SceneLoom's effectiveness in inspiring creative design and facilitating design externalization.
Similar Papers
Story Ribbons: Reimagining Storyline Visualizations with Large Language Models
Human-Computer Interaction
Helps understand stories by showing character journeys.
LOOM: Personalized Learning Informed by Daily LLM Conversations Toward Long-Term Mastery via a Dynamic Learner Memory Graph
Human-Computer Interaction
Helps computers teach you better, right now.
DataSway: Vivifying Metaphoric Visualization with Animation Clip Generation and Coordination
Human-Computer Interaction
Makes charts move to tell stories better.