LLM-Based Instance-Driven Heuristic Bias In the Context of a Biased Random Key Genetic Algorithm
By: Camilo Chacón Sartori , Martín Isla Pino , Pedro Pinacho-Davidson and more
Potential Business Impact:
Helps computers solve hard problems faster.
Integrating Large Language Models (LLMs) within metaheuristics opens a novel path for solving complex combinatorial optimization problems. While most existing approaches leverage LLMs for code generation to create or refine specific heuristics, they often overlook the structural properties of individual problem instances. In this work, we introduce a novel framework that integrates LLMs with a Biased Random-Key Genetic Algorithm (BRKGA) to solve the NP-hard Longest Run Subsequence problem. Our approach extends the instance-driven heuristic bias paradigm by introducing a human-LLM collaborative process to co-design and implement a set of computationally efficient metrics. The LLM analyzes these instance-specific metrics to generate a tailored heuristic bias, which steers the BRKGA toward promising areas of the search space. We conduct a comprehensive experimental evaluation, including rigorous statistical tests, convergence and behavioral analyses, and targeted ablation studies, comparing our method against a standard BRKGA baseline across 1,050 generated instances of varying complexity. Results show that our top-performing hybrid, BRKGA+Llama-4-Maverick, achieves statistically significant improvements over the baseline, particularly on the most complex instances. Our findings confirm that leveraging an LLM to produce an a priori, instance-driven heuristic bias is a valuable approach for enhancing metaheuristics in complex optimization domains.
Similar Papers
MultiGA: Leveraging Multi-Source Seeding in Genetic Algorithms
Neural and Evolutionary Computing
Combines many AI minds to solve hard problems.
Robust Heuristic Algorithm Design with LLMs
Artificial Intelligence
Makes computer programs work much better.
An In-depth Study of LLM Contributions to the Bin Packing Problem
Artificial Intelligence
Makes math problems easier to solve and understand.