SpatialDreamer: Incentivizing Spatial Reasoning via Active Mental Imagery
By: Meng Cao , Xingyu Li , Xue Liu and more
Potential Business Impact:
Lets computers imagine and solve puzzles like humans.
Despite advancements in Multi-modal Large Language Models (MLLMs) for scene understanding, their performance on complex spatial reasoning tasks requiring mental simulation remains significantly limited. Current methods often rely on passive observation of spatial data, failing to internalize an active mental imagery process. To bridge this gap, we propose SpatialDreamer, a reinforcement learning framework that enables spatial reasoning through a closedloop process of active exploration, visual imagination via a world model, and evidence-grounded reasoning. To address the lack of fine-grained reward supervision in longhorizontal reasoning tasks, we propose Geometric Policy Optimization (GeoPO), which introduces tree-structured sampling and step-level reward estimation with geometric consistency constraints. Extensive experiments demonstrate that SpatialDreamer delivers highly competitive results across multiple challenging benchmarks, signifying a critical advancement in human-like active spatial mental simulation for MLLMs.
Similar Papers
SpatialThinker: Reinforcing 3D Reasoning in Multimodal LLMs via Spatial Rewards
CV and Pattern Recognition
Helps computers understand 3D space like people.
SpatialGeo:Boosting Spatial Reasoning in Multimodal LLMs via Geometry-Semantics Fusion
CV and Pattern Recognition
Helps computers understand 3D shapes and where things are.
Seeing through Imagination: Learning Scene Geometry via Implicit Spatial World Modeling
CV and Pattern Recognition
Teaches computers to see and understand 3D space.