ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing
By: Liangyu Chen , Yichen Xu , Jianzhe Ma and more
Potential Business Impact:
Helps computers fix charts from pictures.
Chart editing reduces manual effort in visualization design. Typical benchmarks limited in data diversity and assume access to complete chart code, which is seldom in real-world scenarios. To address this gap, we present ChartEditVista, a comprehensive benchmark consisting of 7,964 samples spanning 31 chart categories. It encompasses diverse editing instructions and covers nearly all editable chart elements. The inputs in ChartEditVista include only the original chart image and natural language editing instructions, without the original chart codes. ChartEditVista is generated through a fully automated pipeline that produces, edits, and verifies charts, ensuring high-quality chart editing data. Besides, we introduce two novel fine-grained, rule-based evaluation metrics: the layout metric, which evaluates the position, size and color of graphical components; and the text metric, which jointly assesses textual content and font styling. Building on top of ChartEditVista, we present ChartEditor, a model trained using a reinforcement learning framework that incorporates a novel rendering reward to simultaneously enforce code executability and visual fidelity. Through extensive experiments and human evaluations, we demonstrate that ChartEditVista provides a robust evaluation, while ChartEditor consistently outperforms models with similar-scale and larger-scale on chart editing tasks.
Similar Papers
Charts Are Not Images: On the Challenges of Scientific Chart Editing
CV and Pattern Recognition
Helps computers fix and change science charts correctly.
ChartEdit: How Far Are MLLMs From Automating Chart Analysis? Evaluating MLLMs' Capability via Chart Editing
Computation and Language
Computers can now edit charts, but not perfectly.
BigCharts-R1: Enhanced Chart Reasoning with Visual Reinforcement Finetuning
Computation and Language
Helps computers understand charts better.