Benchmarking Catastrophic Forgetting Mitigation Methods in Federated Time Series Forecasting
By: Khaled Hallak, Oudom Kem
Potential Business Impact:
Keeps smart devices learning new things without forgetting.
Catastrophic forgetting (CF) poses a persistent challenge in continual learning (CL), especially within federated learning (FL) environments characterized by non-i.i.d. time series data. While existing research has largely focused on classification tasks in vision domains, the regression-based forecasting setting prevalent in IoT and edge applications remains underexplored. In this paper, we present the first benchmarking framework tailored to investigate CF in federated continual time series forecasting. Using the Beijing Multi-site Air Quality dataset across 12 decentralized clients, we systematically evaluate several CF mitigation strategies, including Replay, Elastic Weight Consolidation, Learning without Forgetting, and Synaptic Intelligence. Key contributions include: (i) introducing a new benchmark for CF in time series FL, (ii) conducting a comprehensive comparative analysis of state-of-the-art methods, and (iii) releasing a reproducible open-source framework. This work provides essential tools and insights for advancing continual learning in federated time-series forecasting systems.
Similar Papers
A Conformal Predictive Measure for Assessing Catastrophic Forgetting
Machine Learning (CS)
Helps computers remember old lessons when learning new ones.
Data Heterogeneity and Forgotten Labels in Split Federated Learning
Machine Learning (CS)
Fixes AI forgetting what it learned before.
Mitigating Catastrophic Forgetting in Streaming Generative and Predictive Learning via Stateful Replay
Machine Learning (CS)
Keeps computer learning without forgetting old lessons.