The New Compiler Stack: A Survey on the Synergy of LLMs and Compilers
By: Shuoming Zhang , Jiacheng Zhao , Qiuchu Yu and more
Potential Business Impact:
Helps computers write better code automatically.
This survey has provided a systematic overview of the emerging field of LLM-enabled compilation by addressing several key research questions. We first answered how LLMs are being integrated by proposing a comprehensive, multi-dimensional taxonomy that categorizes works based on their Design Philosophy (Selector, Translator, Generator), LLM Methodology, their operational Level of Code Abstraction, and the specific Task Type they address. In answering what advancements these approaches offer, we identified three primary benefits: the democratization of compiler development, the discovery of novel optimization strategies, and the broadening of the compiler's traditional scope. Finally, in addressing the field's challenges and opportunities, we highlighted the critical hurdles of ensuring correctness and achieving scalability, while identifying the development of hybrid systems as the most promising path forward. By providing these answers, this survey serves as a foundational roadmap for researchers and practitioners, charting the course for a new generation of LLM-powered, intelligent, adaptive and synergistic compilation tools.
Similar Papers
A Survey on Code Generation with LLM-based Agents
Software Engineering
Computers write and fix computer programs themselves.
A Systematic Survey on Large Language Models for Evolutionary Optimization: From Modeling to Solving
Neural and Evolutionary Computing
Helps computers solve hard problems faster.
Exploring the Feasibility of End-to-End Large Language Model as a Compiler
Machine Learning (CS)
Makes computers write code for other computers.