Enhancing Synthetic CT from CBCT via Multimodal Fusion: A Study on the Impact of CBCT Quality and Alignment
By: Maximilian Tschuchnig , Lukas Lamminger , Philipp Steininger and more
Potential Business Impact:
Makes medical scans clearer by combining two types.
Cone-Beam Computed Tomography (CBCT) is widely used for real-time intraoperative imaging due to its low radiation dose and high acquisition speed. However, despite its high resolution, CBCT suffers from significant artifacts and thereby lower visual quality, compared to conventional Computed Tomography (CT). A recent approach to mitigate these artifacts is synthetic CT (sCT) generation, translating CBCT volumes into the CT domain. In this work, we enhance sCT generation through multimodal learning, integrating intraoperative CBCT with preoperative CT. Beyond validation on two real-world datasets, we use a versatile synthetic dataset, to analyze how CBCT-CT alignment and CBCT quality affect sCT quality. The results demonstrate that multimodal sCT consistently outperform unimodal baselines, with the most significant gains observed in well-aligned, low-quality CBCT-CT cases. Finally, we demonstrate that these findings are highly reproducible in real-world clinical datasets.
Similar Papers
Enhancing Synthetic CT from CBCT via Multimodal Fusion and End-To-End Registration
Image and Video Processing
Makes blurry medical scans clearer for doctors.
Synthetic CT image generation from CBCT: A Systematic Review
Image and Video Processing
Makes cancer scans clearer for better treatment.
A Privacy-Preserving Federated Learning Framework for Generalizable CBCT to Synthetic CT Translation in Head and Neck
Medical Physics
Makes cancer scans clearer for better treatment.