Leveraging the RETFound foundation model for optic disc segmentation in retinal images
By: Zhenyi Zhao, Muthu Rama Krishnan Mookiah, Emanuele Trucco
Potential Business Impact:
Helps doctors find eye problems from pictures.
RETFound is a well-known foundation model (FM) developed for fundus camera and optical coherence tomography images. It has shown promising performance across multiple datasets in diagnosing diseases, both eye-specific and systemic, from retinal images. However, to our best knowledge, it has not been used for other tasks. We present the first adaptation of RETFound for optic disc segmentation, a ubiquitous and foundational task in retinal image analysis. The resulting segmentation system outperforms state-of-the-art, segmentation-specific baseline networks after training a head with only a very modest number of task-specific examples. We report and discuss results with four public datasets, IDRID, Drishti-GS, RIM-ONE-r3, and REFUGE, and a private dataset, GoDARTS, achieving about 96% Dice consistently across all datasets. Overall, our method obtains excellent performance in internal verification, domain generalization and domain adaptation, and exceeds most of the state-of-the-art baseline results. We discuss the results in the framework of the debate about FMs as alternatives to task-specific architectures. The code is available at: [link to be added after the paper is accepted]
Similar Papers
FusionFM: Fusing Eye-specific Foundational Models for Optimized Ophthalmic Diagnosis
CV and Pattern Recognition
Helps doctors find eye and body diseases from eye pictures.
Generalist versus Specialist Vision Foundation Models for Ocular Disease and Oculomics
Image and Video Processing
Helps doctors find eye diseases better.
When Do Domain-Specific Foundation Models Justify Their Cost? A Systematic Evaluation Across Retinal Imaging Tasks
Image and Video Processing
Smaller computer models see eye diseases better.