PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Rendering
By: Yifan Gao , Zihang Lin , Chuanbin Liu and more
Potential Business Impact:
Makes posters with perfect text and products.
Product posters, which integrate subject, scene, and text, are crucial promotional tools for attracting customers. Creating such posters using modern image generation methods is valuable, while the main challenge lies in accurately rendering text, especially for complex writing systems like Chinese, which contains over 10,000 individual characters. In this work, we identify the key to precise text rendering as constructing a character-discriminative visual feature as a control signal. Based on this insight, we propose a robust character-wise representation as control and we develop TextRenderNet, which achieves a high text rendering accuracy of over 90%. Another challenge in poster generation is maintaining the fidelity of user-specific products. We address this by introducing SceneGenNet, an inpainting-based model, and propose subject fidelity feedback learning to further enhance fidelity. Based on TextRenderNet and SceneGenNet, we present PosterMaker, an end-to-end generation framework. To optimize PosterMaker efficiently, we implement a two-stage training strategy that decouples text rendering and background generation learning. Experimental results show that PosterMaker outperforms existing baselines by a remarkable margin, which demonstrates its effectiveness.
Similar Papers
PosterCraft: Rethinking High-Quality Aesthetic Poster Generation in a Unified Framework
CV and Pattern Recognition
Makes cool posters with words and art.
DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Design
CV and Pattern Recognition
Creates amazing posters from your pictures and words.
Paper2Poster: Towards Multimodal Poster Automation from Scientific Papers
CV and Pattern Recognition
Turns long papers into easy-to-read posters.