MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models
By: Xudong Ma , Nantheera Anantrasirichai , Stefanos Bolomytis and more
Potential Business Impact:
Helps doctors find cancer better using different scans.
The diagnosis of prostate cancer increasingly depends on multimodal imaging, particularly magnetic resonance imaging (MRI) and transrectal ultrasound (TRUS). However, accurate registration between these modalities remains a fundamental challenge due to the differences in dimensionality and anatomical representations. In this work, we present a novel framework that addresses these challenges through a two-stage process: TRUS 3D reconstruction followed by cross-modal registration. Unlike existing TRUS 3D reconstruction methods that rely heavily on external probe tracking information, we propose a totally probe-location-independent approach that leverages the natural correlation between sagittal and transverse TRUS views. With the help of our clustering-based feature matching method, we enable the spatial localization of 2D frames without any additional probe tracking information. For the registration stage, we introduce an unsupervised diffusion-based framework guided by modality translation. Unlike existing methods that translate one modality into another, we map both MR and US into a pseudo intermediate modality. This design enables us to customize it to retain only registration-critical features, greatly easing registration. To further enhance anatomical alignment, we incorporate an anatomy-aware registration strategy that prioritizes internal structural coherence while adaptively reducing the influence of boundary inconsistencies. Extensive validation demonstrates that our approach outperforms state-of-the-art methods by achieving superior registration accuracy with physically realistic deformations in a completely unsupervised fashion.
Similar Papers
Modality Translation and Registration of MR and Ultrasound Images Using Diffusion Models
CV and Pattern Recognition
Helps doctors see cancer better with different scans.
Registration-Enhanced Segmentation Method for Prostate Cancer in Ultrasound Images
Image and Video Processing
Finds prostate cancer faster and more accurately.
Salient Region Matching for Fully Automated MR-TRUS Registration
Image and Video Processing
Helps doctors find prostate cancer better.