PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoning
By: Jingyun Chen , Linghan Cai , Zhikang Wang and more
Potential Business Impact:
Helps doctors understand disease pictures better.
Analyzing whole-slide images (WSIs) requires an iterative, evidence-driven reasoning process that parallels how pathologists dynamically zoom, refocus, and self-correct while collecting the evidence. However, existing computational pipelines often lack this explicit reasoning trajectory, resulting in inherently opaque and unjustifiable predictions. To bridge this gap, we present PathAgent, a training-free, large language model (LLM)-based agent framework that emulates the reflective, stepwise analytical approach of human experts. PathAgent can autonomously explore WSI, iteratively and precisely locating significant micro-regions using the Navigator module, extracting morphology visual cues using the Perceptor, and integrating these findings into the continuously evolving natural language trajectories in the Executor. The entire sequence of observations and decisions forms an explicit chain-of-thought, yielding fully interpretable predictions. Evaluated across five challenging datasets, PathAgent exhibits strong zero-shot generalization, surpassing task-specific baselines in both open-ended and constrained visual question-answering tasks. Moreover, a collaborative evaluation with human pathologists confirms PathAgent's promise as a transparent and clinically grounded diagnostic assistant.
Similar Papers
PathReasoning: A multimodal reasoning agent for query-based ROI navigation on whole-slide images
CV and Pattern Recognition
Helps doctors find cancer faster in pictures.
Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behavior
CV and Pattern Recognition
Helps doctors find sickness in slides faster.
From Pixels to Histopathology: A Graph-Based Framework for Interpretable Whole Slide Image Analysis
Image and Video Processing
Helps doctors diagnose diseases faster from tissue pictures.