PSI3D: Plug-and-Play 3D Stochastic Inference with Slice-wise Latent Diffusion Prior
By: Wenhan Guo , Jinglun Yu , Yaning Wang and more
Diffusion models are highly expressive image priors for Bayesian inverse problems. However, most diffusion models cannot operate on large-scale, high-dimensional data due to high training and inference costs. In this work, we introduce a Plug-and-play algorithm for 3D stochastic inference with latent diffusion prior (PSI3D) to address massive ($1024\times 1024\times 128$) volumes. Specifically, we formulate a Markov chain Monte Carlo approach to reconstruct each two-dimensional (2D) slice by sampling from a 2D latent diffusion model. To enhance inter-slice consistency, we also incorporate total variation (TV) regularization stochastically along the concatenation axis. We evaluate our performance on optical coherence tomography (OCT) super-resolution. Our method significantly improves reconstruction quality for large-scale scientific imaging compared to traditional and learning-based baselines, while providing robust and credible reconstructions.
Similar Papers
Physics-Guided Diffusion Priors for Multi-Slice Reconstruction in Scientific Imaging
Image and Video Processing
Makes medical scans faster and clearer.
Improving Temporal Consistency and Fidelity at Inference-time in Perceptual Video Restoration by Zero-shot Image-based Diffusion Models
Image and Video Processing
Makes old videos look clear and smooth.
ITS3D: Inference-Time Scaling for Text-Guided 3D Diffusion Models
CV and Pattern Recognition
Makes 3D pictures from words better.