Reason Like a Radiologist: Chain-of-Thought and Reinforcement Learning for Verifiable Report Generation
By: Peiyuan Jing , Kinhei Lee , Zhenxuan Zhang and more
Potential Business Impact:
Helps doctors write better, trustworthy X-ray reports.
Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper introduces BoxMed-RL, a groundbreaking unified training framework for generating spatially verifiable and explainable radiology reports. Built on a large vision-language model, BoxMed-RL revolutionizes report generation through two integrated phases: (1) In the Pretraining Phase, we refine the model via medical concept learning, using Chain-of-Thought supervision to internalize the radiologist-like workflow, followed by spatially verifiable reinforcement, which applies reinforcement learning to align medical findings with bounding boxes. (2) In the Downstream Adapter Phase, we freeze the pretrained weights and train a downstream adapter to ensure fluent and clinically credible reports. This framework precisely mimics radiologists' workflow, compelling the model to connect high-level medical concepts with definitive anatomical evidence. Extensive experiments on public datasets demonstrate that BoxMed-RL achieves an average 7% improvement in both METEOR and ROUGE-L metrics compared to state-of-the-art methods. An average 5% improvement in large language model-based metrics further underscores BoxMed-RL's robustness in generating high-quality radiology reports.
Similar Papers
Enhancing Radiology Report Generation and Visual Grounding using Reinforcement Learning
Artificial Intelligence
Helps doctors read X-rays better and faster.
Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Models
CV and Pattern Recognition
Helps doctors understand X-rays better and faster.
Radiology Workflow-Guided Hierarchical Reinforcement Fine-Tuning for Medical Report Generation
Artificial Intelligence
Makes doctor reports more accurate and consistent.