Text-Conditioned Background Generation for Editable Multi-Layer Documents
By: Taewon Kang , Joseph K J , Chris Tensmeyer and more
We present a framework for document-centric background generation with multi-page editing and thematic continuity. To ensure text regions remain readable, we employ a \emph{latent masking} formulation that softly attenuates updates in the diffusion space, inspired by smooth barrier functions in physics and numerical optimization. In addition, we introduce \emph{Automated Readability Optimization (ARO)}, which automatically places semi-transparent, rounded backing shapes behind text regions. ARO determines the minimal opacity needed to satisfy perceptual contrast standards (WCAG 2.2) relative to the underlying background, ensuring readability while maintaining aesthetic harmony without human intervention. Multi-page consistency is maintained through a summarization-and-instruction process, where each page is distilled into a compact representation that recursively guides subsequent generations. This design reflects how humans build continuity by retaining prior context, ensuring that visual motifs evolve coherently across an entire document. Our method further treats a document as a structured composition in which text, figures, and backgrounds are preserved or regenerated as separate layers, allowing targeted background editing without compromising readability. Finally, user-provided prompts allow stylistic adjustments in color and texture, balancing automated consistency with flexible customization. Our training-free framework produces visually coherent, text-preserving, and thematically aligned documents, bridging generative modeling with natural design workflows.
Similar Papers
Layout-Conditioned Autoregressive Text-to-Image Generation via Structured Masking
CV and Pattern Recognition
Draws pictures from text and layout.
Cascaded Robust Rectification for Arbitrary Document Images
CV and Pattern Recognition
Fixes crooked and bent documents for clear reading.
EditAR: Unified Conditional Generation with Autoregressive Models
CV and Pattern Recognition
Makes one AI draw and change many kinds of pictures.