Towards Unified and Lossless Latent Space for 3D Molecular Latent Diffusion Modeling
By: Yanchen Luo , Zhiyuan Liu , Yi Zhao and more
Potential Business Impact:
Designs new molecules for medicine and materials.
3D molecule generation is crucial for drug discovery and material science, requiring models to process complex multi-modalities, including atom types, chemical bonds, and 3D coordinates. A key challenge is integrating these modalities of different shapes while maintaining SE(3) equivariance for 3D coordinates. To achieve this, existing approaches typically maintain separate latent spaces for invariant and equivariant modalities, reducing efficiency in both training and sampling. In this work, we propose \textbf{U}nified Variational \textbf{A}uto-\textbf{E}ncoder for \textbf{3D} Molecular Latent Diffusion Modeling (\textbf{UAE-3D}), a multi-modal VAE that compresses 3D molecules into latent sequences from a unified latent space, while maintaining near-zero reconstruction error. This unified latent space eliminates the complexities of handling multi-modality and equivariance when performing latent diffusion modeling. We demonstrate this by employing the Diffusion Transformer--a general-purpose diffusion model without any molecular inductive bias--for latent generation. Extensive experiments on GEOM-Drugs and QM9 datasets demonstrate that our method significantly establishes new benchmarks in both \textit{de novo} and conditional 3D molecule generation, achieving leading efficiency and quality. On GEOM-Drugs, it reduces FCD by 72.6\% over the previous best result, while achieving over 70\% relative average improvements in geometric fidelity.
Similar Papers
Manipulating 3D Molecules in a Fixed-Dimensional SE(3)-Equivariant Latent Space
Machine Learning (CS)
Designs new medicines by changing molecule shapes.
Representing 3D Shapes With 64 Latent Vectors for 3D Diffusion Models
CV and Pattern Recognition
Makes 3D models smaller and faster to create.
UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation
CV and Pattern Recognition
Makes 3D objects from one picture fast.