HiGS: Hierarchical Generative Scene Framework for Multi-Step Associative Semantic Spatial Composition
By: Jiacheng Hong , Kunzhen Wu , Mingrui Yu and more
Potential Business Impact:
Builds 3D worlds by adding objects step-by-step.
Three-dimensional scene generation holds significant potential in gaming, film, and virtual reality. However, most existing methods adopt a single-step generation process, making it difficult to balance scene complexity with minimal user input. Inspired by the human cognitive process in scene modeling, which progresses from global to local, focuses on key elements, and completes the scene through semantic association, we propose HiGS, a hierarchical generative framework for multi-step associative semantic spatial composition. HiGS enables users to iteratively expand scenes by selecting key semantic objects, offering fine-grained control over regions of interest while the model completes peripheral areas automatically. To support structured and coherent generation, we introduce the Progressive Hierarchical Spatial-Semantic Graph (PHiSSG), which dynamically organizes spatial relationships and semantic dependencies across the evolving scene structure. PHiSSG ensures spatial and geometric consistency throughout the generation process by maintaining a one-to-one mapping between graph nodes and generated objects and supporting recursive layout optimization. Experiments demonstrate that HiGS outperforms single-stage methods in layout plausibility, style consistency, and user preference, offering a controllable and extensible paradigm for efficient 3D scene construction.
Similar Papers
KeySG: Hierarchical Keyframe-Based 3D Scene Graphs
CV and Pattern Recognition
Helps robots understand and navigate complex places.
Asset-Driven Sematic Reconstruction of Dynamic Scene with Multi-Human-Object Interactions
CV and Pattern Recognition
Makes 3D models of moving people and things.
HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation
Graphics
Creates realistic 3D rooms from simple pictures.