Good Noise Makes Good Edits: A Training-Free Diffusion-Based Video Editing with Image and Text Prompts
By: Saemee Choi , Sohyun Jeong , Jaegul Choo and more
Potential Business Impact:
Changes videos using pictures and words.
We propose ImEdit, the first zero-shot, training-free video editing method conditioned on both images and text. The proposed method introduces $\rho$-start sampling and dilated dual masking to construct well-structured noise maps for coherent and accurate edits. We further present zero image guidance, a controllable negative prompt strategy, for visual fidelity. Both quantitative and qualitative evaluations show that our method outperforms state-of-the-art methods across all metrics.
Similar Papers
Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoising
CV and Pattern Recognition
Changes videos to match any spoken words.
V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
CV and Pattern Recognition
Changes videos and 3D worlds with text instructions.
DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editing
CV and Pattern Recognition
Changes pictures using words, more accurately.