From Satellite to Street: A Hybrid Framework Integrating Stable Diffusion and PanoGAN for Consistent Cross-View Synthesis
By: Khawlah Bajbaa , Abbas Anwar , Muhammad Saqib and more
Potential Business Impact:
Makes street pictures from satellite maps.
Street view imagery has become an essential source for geospatial data collection and urban analytics, enabling the extraction of valuable insights that support informed decision-making. However, synthesizing street-view images from corresponding satellite imagery presents significant challenges due to substantial differences in appearance and viewing perspective between these two domains. This paper presents a hybrid framework that integrates diffusion-based models and conditional generative adversarial networks to generate geographically consistent street-view images from satellite imagery. Our approach uses a multi-stage training strategy that incorporates Stable Diffusion as the core component within a dual-branch architecture. To enhance the framework's capabilities, we integrate a conditional Generative Adversarial Network (GAN) that enables the generation of geographically consistent panoramic street views. Furthermore, we implement a fusion strategy that leverages the strengths of both models to create robust representations, thereby improving the geometric consistency and visual quality of the generated street-view images. The proposed framework is evaluated on the challenging Cross-View USA (CVUSA) dataset, a standard benchmark for cross-view image synthesis. Experimental results demonstrate that our hybrid approach outperforms diffusion-only methods across multiple evaluation metrics and achieves competitive performance compared to state-of-the-art GAN-based methods. The framework successfully generates realistic and geometrically consistent street-view images while preserving fine-grained local details, including street markings, secondary roads, and atmospheric elements such as clouds.
Similar Papers
Satellite to GroundScape -- Large-scale Consistent Ground View Generation from Satellite Views
CV and Pattern Recognition
Turns bird's-eye views into connected street scenes.
SatDreamer360: Geometry Consistent Street-View Video Generation from Satellite Imagery
CV and Pattern Recognition
Makes satellite pictures look like real street videos.
From Orbit to Ground: Generative City Photogrammetry from Extreme Off-Nadir Satellite Images
CV and Pattern Recognition
Creates 3D city views from satellite pictures.