Score: 0

Textual interpretation of transient image classifications from large language models

Published: October 8, 2025 | arXiv ID: 2510.06931v1

By: Fiorenzo Stoppa , Turan Bulmus , Steven Bloemen and more

Potential Business Impact:

Helps find real space explosions in telescope pictures.

Business Areas:
Natural Language Processing Artificial Intelligence, Data and Analytics, Software

Modern astronomical surveys deliver immense volumes of transient detections, yet distinguishing real astrophysical signals (for example, explosive events) from bogus imaging artefacts remains a challenge. Convolutional neural networks are effectively used for real versus bogus classification; however, their reliance on opaque latent representations hinders interpretability. Here we show that large language models (LLMs) can approach the performance level of a convolutional neural network on three optical transient survey datasets (Pan-STARRS, MeerLICHT and ATLAS) while simultaneously producing direct, human-readable descriptions for every candidate. Using only 15 examples and concise instructions, Google's LLM, Gemini, achieves a 93% average accuracy across datasets that span a range of resolution and pixel scales. We also show that a second LLM can assess the coherence of the output of the first model, enabling iterative refinement by identifying problematic cases. This framework allows users to define the desired classification behaviour through natural language and examples, bypassing traditional training pipelines. Furthermore, by generating textual descriptions of observed features, LLMs enable users to query classifications as if navigating an annotated catalogue, rather than deciphering abstract latent spaces. As next-generation telescopes and surveys further increase the amount of data available, LLM-based classification could help bridge the gap between automated detection and transparent, human-level understanding.

Country of Origin
🇬🇧 United Kingdom

Page Count
10 pages

Category
Astrophysics:
Instrumentation and Methods for Astrophysics