GraphBench: Next-generation graph learning benchmarking
By: Timo Stoll , Chendi Qian , Ben Finkelshtein and more
Potential Business Impact:
Makes computer learning on networks better and fairer.
Machine learning on graphs has recently achieved impressive progress in various domains, including molecular property prediction and chip design. However, benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent evaluation protocols, which hampers reproducibility and broader progress. To address this, we introduce GraphBench, a comprehensive benchmarking suite that spans diverse domains and prediction tasks, including node-level, edge-level, graph-level, and generative settings. GraphBench provides standardized evaluation protocols -- with consistent dataset splits and performance metrics that account for out-of-distribution generalization -- as well as a unified hyperparameter tuning framework. Additionally, we benchmark GraphBench using message-passing neural networks and graph transformer models, providing principled baselines and establishing a reference performance. See www.graphbench.io for further details.
Similar Papers
GraphBench: Next-generation graph learning benchmarking
Machine Learning (CS)
Makes computer learning on networks better.
GraphBench: Next-generation graph learning benchmarking
Machine Learning (CS)
Makes computer learning on networks faster and fairer.
DHG-Bench: A Comprehensive Benchmark on Deep Hypergraph Learning
Machine Learning (CS)
Tests computer programs that understand complex groups.