Transformer-Based Model for Cold Start Mitigation in FaaS Architecture
By: Alexandre Savi Fayam Mbala Mouen, Jerry Lacmou Zeutouo, Vianney Kengne Tchendji
Potential Business Impact:
Fixes slow computer programs starting up.
Serverless architectures, particularly the Function as a Service (FaaS) model, have become a cornerstone of modern cloud computing due to their ability to simplify resource management and enhance application deployment agility. However, a significant challenge remains: the cold start problem. This phenomenon occurs when an idle FaaS function is invoked, requiring a full initialization process, which increases latency and degrades user experience. Existing solutions for cold start mitigation are limited in terms of invocation pattern generalization and implementation complexity. In this study, we propose an innovative approach leveraging Transformer models to mitigate the impact of cold starts in FaaS architectures. Our solution excels in accurately modeling function initialization delays and optimizing serverless system performance. Experimental evaluation using a public dataset provided by Azure demonstrates a significant reduction in cold start times, reaching up to 79\% compared to conventional methods.
Similar Papers
Efficient Function-as-a-Service for Large Language Models with TIDAL
Operating Systems
Makes AI start up much faster.
Efficient Serverless Cold Start: Reducing Library Loading Overhead by Profile-guided Optimization
Distributed, Parallel, and Cluster Computing
Makes computer programs start much faster.
Taming Cold Starts: Proactive Serverless Scheduling with Model Predictive Control
Distributed, Parallel, and Cluster Computing
Makes apps run faster by guessing what's needed.