SciFig: Towards Automating Scientific Figure Generation
By: Siyuan Huang , Yutong Gao , Juyang Bai and more
Potential Business Impact:
AI draws science pictures from text automatically.
Creating high-quality figures and visualizations for scientific papers is a time-consuming task that requires both deep domain knowledge and professional design skills. Despite over 2.5 million scientific papers published annually, the figure generation process remains largely manual. We introduce $\textbf{SciFig}$, an end-to-end AI agent system that generates publication-ready pipeline figures directly from research paper texts. SciFig uses a hierarchical layout generation strategy, which parses research descriptions to identify component relationships, groups related elements into functional modules, and generates inter-module connections to establish visual organization. Furthermore, an iterative chain-of-thought (CoT) feedback mechanism progressively improves layouts through multiple rounds of visual analysis and reasoning. We introduce a rubric-based evaluation framework that analyzes 2,219 real scientific figures to extract evaluation rubrics and automatically generates comprehensive evaluation criteria. SciFig demonstrates remarkable performance: achieving 70.1$\%$ overall quality on dataset-level evaluation and 66.2$\%$ on paper-specific evaluation, and consistently high scores across metrics such as visual clarity, structural organization, and scientific accuracy. SciFig figure generation pipeline and our evaluation benchmark will be open-sourced.
Similar Papers
Paper2SysArch: Structure-Constrained System Architecture Generation from Scientific Papers
Artificial Intelligence
Automates drawing science diagrams from text.
SlideGen: Collaborative Multimodal Agents for Scientific Slide Generation
Artificial Intelligence
Creates presentation slides from research papers.
SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Model
CV and Pattern Recognition
AI draws accurate science pictures from text.