Narrative-to-Scene Generation: An LLM-Driven Pipeline for 2D Game Environments
By: Yi-Chun Chen, Arnav Jhala
Potential Business Impact:
Turns stories into playable game worlds.
Recent advances in large language models(LLMs) enable compelling story generation, but connecting narrative text to playable visual environments remains an open challenge in procedural content generation(PCG). We present a lightweight pipeline that transforms short narrative prompts into a sequence of 2D tile-based game scenes, reflecting the temporal structure of stories. Given an LLM-generated narrative, our system identifies three key time frames, extracts spatial predicates in the form of "Object-Relation-Object" triples, and retrieves visual assets using affordance-aware semantic embeddings from the GameTileNet dataset. A layered terrain is generated using Cellular Automata, and objects are placed using spatial rules grounded in the predicate structure. We evaluated our system in ten diverse stories, analyzing tile-object matching, affordance-layer alignment, and spatial constraint satisfaction across frames. This prototype offers a scalable approach to narrative-driven scene generation and lays the foundation for future work on multi-frame continuity, symbolic tracking, and multi-agent coordination in story-centered PCG.
Similar Papers
Object-Driven Narrative in AR: A Scenario-Metaphor Framework with VLM Integration
Human-Computer Interaction
Makes stories come alive from your surroundings.
Narrative Studio: Visual narrative exploration using LLMs and Monte Carlo Tree Search
Artificial Intelligence
Lets you explore many story endings easily.
A Database-Driven Framework for 3D Level Generation with LLMs
Artificial Intelligence
Builds game levels with smart building blocks.