Real-Time World Crafting: Generating Structured Game Behaviors from Natural Language with Large Language Models
By: Austin Drake, Hang Dong
Potential Business Impact:
Lets players "program" game actions with words.
We present a novel architecture for safely integrating Large Language Models (LLMs) into interactive game engines, allowing players to "program" new behaviors using natural language. Our framework mitigates risks by using an LLM to translate commands into a constrained Domain-Specific Language (DSL), which configures a custom Entity-Component-System (ECS) at runtime. We evaluated this system in a 2D spell-crafting game prototype by experimentally assessing models from the Gemini, GPT, and Claude families with various prompting strategies. A validated LLM judge qualitatively rated the outputs, showing that while larger models better captured creative intent, the optimal prompting strategy is task-dependent: Chain-of-Thought improved creative alignment, while few-shot examples were necessary to generate more complex DSL scripts. This work offers a validated LLM-ECS pattern for emergent gameplay and a quantitative performance comparison for developers.
Similar Papers
Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modelling
Human-Computer Interaction
Lets computers design things from your words.
Diamonds in the rough: Transforming SPARCs of imagination into a game concept by leveraging medium sized LLMs
Human-Computer Interaction
Helps game makers improve ideas with AI.
How LLMs are Shaping the Future of Virtual Reality
Human-Computer Interaction
Makes game characters smarter and stories more exciting.