Zero-shot 3D Map Generation with LLM Agents: A Dual-Agent Architecture for Procedural Content Generation
By: Lim Chien Her , Ming Yan , Yunshu Bai and more
Potential Business Impact:
Lets computers build game worlds from your words.
Procedural Content Generation (PCG) offers scalable methods for algorithmically creating complex, customizable worlds. However, controlling these pipelines requires the precise configuration of opaque technical parameters. We propose a training-free architecture that utilizes LLM agents for zero-shot PCG parameter configuration. While Large Language Models (LLMs) promise a natural language interface for PCG tools, off-the-shelf models often fail to bridge the semantic gap between abstract user instructions and strict parameter specifications. Our system pairs an Actor agent with a Critic agent, enabling an iterative workflow where the system autonomously reasons over tool parameters and refines configurations to progressively align with human design preferences. We validate this approach on the generation of various 3D maps, establishing a new benchmark for instruction-following in PCG. Experiments demonstrate that our approach outperforms single-agent baselines, producing diverse and structurally valid environments from natural language descriptions. These results demonstrate that off-the-shelf LLMs can be effectively repurposed as generalized agents for arbitrary PCG tools. By shifting the burden from model training to architectural reasoning, our method offers a scalable framework for mastering complex software without task-specific fine-tuning.
Similar Papers
Narrative-to-Scene Generation: An LLM-Driven Pipeline for 2D Game Environments
Graphics
Turns stories into playable game worlds.
A Database-Driven Framework for 3D Level Generation with LLMs
Artificial Intelligence
Builds game levels with smart building blocks.
Natural Language Actor-Critic: Scalable Off-Policy Learning in Language Space
Machine Learning (CS)
Teaches computers to learn better by explaining mistakes.