How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inference
By: Nidhal Jegham , Marwan Abdelatti , Lassad Elmoubarki and more
Potential Business Impact:
Measures AI's energy use and pollution.
This paper introduces a novel infrastructure-aware benchmarking framework for quantifying the environmental footprint of LLM inference across 30 state-of-the-art models as deployed in commercial data centers. Our framework combines public API performance data with region-specific environmental multipliers and statistical inference of hardware configurations. We additionally utilize cross-efficiency Data Envelopment Analysis (DEA) to rank models by performance relative to environmental cost. Our results show that o3 and DeepSeek-R1 emerge as the most energy-intensive models, consuming over 33 Wh per long prompt, more than 70 times the consumption of GPT-4.1 nano, and that Claude-3.7 Sonnet ranks highest in eco-efficiency. While a single short GPT-4o query consumes 0.42 Wh, scaling this to 700 million queries/day results in substantial annual environmental impacts. These include electricity use comparable to 35,000 U.S. homes, freshwater evaporation matching the annual drinking needs of 1.2 million people, and carbon emissions requiring a Chicago-sized forest to offset. These findings illustrate a growing paradox: Although AI is becoming cheaper and faster, its global adoption drives disproportionate resource consumption. Our study provides a standardized, empirically grounded methodology for benchmarking the sustainability of LLM deployments, laying a foundation for future environmental accountability in AI development and sustainability standards.
Similar Papers
Holistically Evaluating the Environmental Impact of Creating Language Models
Computers and Society
Shows how much pollution AI makes.
Energy Use of AI Inference: Efficiency Pathways and Test-Time Compute
Machine Learning (CS)
Makes AI use less electricity for answers.
The Carbon Cost of Conversation, Sustainability in the Age of Language Models
Computers and Society
AI uses lots of energy, harming the planet.