NeurIPS 2024 ML4CFD Competition: Results and Retrospective Analysis
By: Mouadh Yagoubi , David Danan , Milad Leyli-Abadi and more
Potential Business Impact:
Makes computer models of air flow faster and better.
The integration of machine learning (ML) into the physical sciences is reshaping computational paradigms, offering the potential to accelerate demanding simulations such as computational fluid dynamics (CFD). Yet, persistent challenges in accuracy, generalization, and physical consistency hinder the practical deployment of ML models in scientific domains. To address these limitations and systematically benchmark progress, we organized the ML4CFD competition, centered on surrogate modeling for aerodynamic simulations over two-dimensional airfoils. The competition attracted over 240 teams, who were provided with a curated dataset generated via OpenFOAM and evaluated through a multi-criteria framework encompassing predictive accuracy, physical fidelity, computational efficiency, and out-of-distribution generalization. This retrospective analysis reviews the competition outcomes, highlighting several approaches that outperformed baselines under our global evaluation score. Notably, the top entry exceeded the performance of the original OpenFOAM solver on aggregate metrics, illustrating the promise of ML-based surrogates to outperform traditional solvers under tailored criteria. Drawing from these results, we analyze the key design principles of top submissions, assess the robustness of our evaluation framework, and offer guidance for future scientific ML challenges.
Similar Papers
Benchmarking machine learning models for predicting aerofoil performance
Fluid Dynamics
Makes wind turbine blades work better and faster.
Machine Learning for Physical Simulation Challenge Results and Retrospective Analysis: Power Grid Use Case
Machine Learning (CS)
Makes power grids safer with faster computer checks.
Crowdsourcing the Frontier: Advancing Hybrid Physics-ML Climate Simulation via $50,000 Kaggle Competition
Atmospheric and Oceanic Physics
AI helps climate models predict weather more accurately.