Score: 0

EvoSpeak: Large Language Models for Interpretable Genetic Programming-Evolved Heuristics

Published: October 3, 2025 | arXiv ID: 2510.02686v1

By: Meng Xu, Jiao Liu, Yew Soon Ong

Potential Business Impact:

Helps computers explain their smart decisions.

Business Areas:
Natural Language Processing Artificial Intelligence, Data and Analytics, Software

Genetic programming (GP) has demonstrated strong effectiveness in evolving tree-structured heuristics for complex optimization problems. Yet, in dynamic and large-scale scenarios, the most effective heuristics are often highly complex, hindering interpretability, slowing convergence, and limiting transferability across tasks. To address these challenges, we present EvoSpeak, a novel framework that integrates GP with large language models (LLMs) to enhance the efficiency, transparency, and adaptability of heuristic evolution. EvoSpeak learns from high-quality GP heuristics, extracts knowledge, and leverages this knowledge to (i) generate warm-start populations that accelerate convergence, (ii) translate opaque GP trees into concise natural-language explanations that foster interpretability and trust, and (iii) enable knowledge transfer and preference-aware heuristic generation across related tasks. We verify the effectiveness of EvoSpeak through extensive experiments on dynamic flexible job shop scheduling (DFJSS), under both single- and multi-objective formulations. The results demonstrate that EvoSpeak produces more effective heuristics, improves evolutionary efficiency, and delivers human-readable reports that enhance usability. By coupling the symbolic reasoning power of GP with the interpretative and generative strengths of LLMs, EvoSpeak advances the development of intelligent, transparent, and user-aligned heuristics for real-world optimization problems.

Country of Origin
πŸ‡ΈπŸ‡¬ Singapore

Page Count
14 pages

Category
Computer Science:
Machine Learning (CS)