Inferring Causal Relationships to Improve Caching for Clients with Correlated Requests: Applications to VR
By: Agrim Bari, Gustavo de Veciana, Yuqi Zhou
Efficient edge caching reduces latency and alleviates backhaul congestion in modern networks. Traditional caching policies, such as Least Recently Used (LRU) and Least Frequently Used (LFU), perform well under specific request patterns. LRU excels in workloads with strong temporal locality, while LFU is effective when content popularity remains static. However, real-world client requests often exhibit correlations due to shared contexts and coordinated activities. This is particularly evident in Virtual Reality (VR) environments, where groups of clients navigate shared virtual spaces, leading to correlated content requests. In this paper, we introduce the \textit{grouped client request model}, a generalization of the Independent Reference Model that explicitly captures different types of request correlations. Our theoretical analysis of LRU under this model reveals that the optimal causal caching policy depends on cache size: LFU is optimal for small to moderate caches, while LRU outperforms it for larger caches. To address the limitations of existing policies, we propose Least Following and Recently Used (LFRU), a novel online caching policy that dynamically infers and adapts to causal relationships in client requests to optimize evictions. LFRU prioritizes objects likely to be requested based on inferred dependencies, achieving near-optimal performance compared to the offline optimal Belady policy in structured correlation settings. We develop VR based datasets to evaluate caching policies under realistic correlated requests. Our results show that LFRU consistently performs at least as well as LRU and LFU, outperforming LRU by up to 2.9x and LFU by up to1.9x in certain settings.
Similar Papers
Toward Robust and Efficient ML-Based GPU Caching for Modern Inference
Machine Learning (CS)
Makes AI models run much faster and smoother.
Fundamentals of Caching Layered Data objects
Networking and Internet Architecture
Makes computer data storage smarter for games and maps.
Comparative Analysis of Distributed Caching Algorithms: Performance Metrics and Implementation Considerations
Distributed, Parallel, and Cluster Computing
Makes computer systems faster by storing data smartly.