Panel-by-Panel Souls: A Performative Workflow for Expressive Faces in AI-Assisted Manga Creation
By: Qing Zhang , Jing Huang , Yifei Huang and more
Potential Business Impact:
Lets artists draw manga characters with real emotions.
Current text-to-image models struggle to render the nuanced facial expressions required for compelling manga narratives, largely due to the ambiguity of language itself. To bridge this gap, we introduce an interactive system built on a novel, dual-hybrid pipeline. The first stage combines landmark-based auto-detection with a manual framing tool for robust, artist-centric face preparation. The second stage maps expressions using the LivePortrait engine, blending intuitive performative input from video for fine-grained control. Our case study analysis suggests that this integrated workflow can streamline the creative process and effectively translate narrative intent into visual expression. This work presents a practical model for human-AI co-creation, offering artists a more direct and intuitive means of ``infusing souls'' into their characters. Our primary contribution is not a new generative model, but a novel, interactive workflow that bridges the gap between artistic intent and AI execution.
Similar Papers
Soul: Breathe Life into Digital Human for High-fidelity Long-term Multimodal Animation
CV and Pattern Recognition
Makes still pictures talk and move like real people.
PersonaLive! Expressive Portrait Image Animation for Live Streaming
CV and Pattern Recognition
Makes animated faces move in real-time.
Speaking images. A novel framework for the automated self-description of artworks
CV and Pattern Recognition
Makes old art explain itself in videos.