Personalized Subgraph Federated Learning with Sheaf Collaboration
By: Wenfei Liang , Yanan Zhao , Rui She and more
Potential Business Impact:
Helps computers learn better from connected data.
Graph-structured data is prevalent in many applications. In subgraph federated learning (FL), this data is distributed across clients, each with a local subgraph. Personalized subgraph FL aims to develop a customized model for each client to handle diverse data distributions. However, performance variation across clients remains a key issue due to the heterogeneity of local subgraphs. To overcome the challenge, we propose FedSheafHN, a novel framework built on a sheaf collaboration mechanism to unify enhanced client descriptors with efficient personalized model generation. Specifically, FedSheafHN embeds each client's local subgraph into a server-constructed collaboration graph by leveraging graph-level embeddings and employing sheaf diffusion within the collaboration graph to enrich client representations. Subsequently, FedSheafHN generates customized client models via a server-optimized hypernetwork. Empirical evaluations demonstrate that FedSheafHN outperforms existing personalized subgraph FL methods on various graph datasets. Additionally, it exhibits fast model convergence and effectively generalizes to new clients.
Similar Papers
pFedDSH: Enabling Knowledge Transfer in Personalized Federated Learning through Data-free Sub-Hypernetwork
Machine Learning (CS)
Helps AI learn from new users without seeing their private info.
Curriculum Guided Personalized Subgraph Federated Learning
Machine Learning (CS)
Teaches computers to learn from private data better.
Subgraph Federated Learning via Spectral Methods
Machine Learning (CS)
Keeps learning private while sharing data.