V-Warper: Appearance-Consistent Video Diffusion Personalization via Value Warping
By: Hyunkoo Lee , Wooseok Jang , Jini Yang and more
Potential Business Impact:
Makes videos match people without extra training.
Video personalization aims to generate videos that faithfully reflect a user-provided subject while following a text prompt. However, existing approaches often rely on heavy video-based finetuning or large-scale video datasets, which impose substantial computational cost and are difficult to scale. Furthermore, they still struggle to maintain fine-grained appearance consistency across frames. To address these limitations, we introduce V-Warper, a training-free coarse-to-fine personalization framework for transformer-based video diffusion models. The framework enhances fine-grained identity fidelity without requiring any additional video training. (1) A lightweight coarse appearance adaptation stage leverages only a small set of reference images, which are already required for the task. This step encodes global subject identity through image-only LoRA and subject-embedding adaptation. (2) A inference-time fine appearance injection stage refines visual fidelity by computing semantic correspondences from RoPE-free mid-layer query--key features. These correspondences guide the warping of appearance-rich value representations into semantically aligned regions of the generation process, with masking ensuring spatial reliability. V-Warper significantly improves appearance fidelity while preserving prompt alignment and motion dynamics, and it achieves these gains efficiently without large-scale video finetuning.
Similar Papers
Personalized Image Descriptions from Attention Sequences
CV and Pattern Recognition
Helps computers describe pictures like you do.
DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework
CV and Pattern Recognition
Lets you try on clothes in videos realistically.
Per-Query Visual Concept Learning
CV and Pattern Recognition
Teaches computers to draw your specific ideas.