Super-Linear: A Lightweight Pretrained Mixture of Linear Experts for Time Series Forecasting
By: Liran Nochumsohn , Raz Marshanski , Hedi Zisling and more
Potential Business Impact:
Predicts future events faster and more accurately.
Time series forecasting (TSF) is critical in domains like energy, finance, healthcare, and logistics, requiring models that generalize across diverse datasets. Large pre-trained models such as Chronos and Time-MoE show strong zero-shot (ZS) performance but suffer from high computational costs. In this work, We introduce Super-Linear, a lightweight and scalable mixture-of-experts (MoE) model for general forecasting. It replaces deep architectures with simple frequency-specialized linear experts, trained on resampled data across multiple frequency regimes. A lightweight spectral gating mechanism dynamically selects relevant experts, enabling efficient, accurate forecasting. Despite its simplicity, Super-Linear matches state-of-the-art performance while offering superior efficiency, robustness to various sampling rates, and enhanced interpretability. The implementation of Super-Linear is available at \href{https://github.com/azencot-group/SuperLinear}{https://github.com/azencot-group/SuperLinear}
Similar Papers
Bridging Simplicity and Sophistication using GLinear: A Novel Architecture for Enhanced Time Series Prediction
Machine Learning (CS)
Predicts future events better with less data.
EMTSF:Extraordinary Mixture of SOTA Models for Time Series Forecasting
Computation and Language
Predicts future events more accurately than before.
Wavelet Mixture of Experts for Time Series Forecasting
Machine Learning (CS)
Predicts future events more accurately with less data.