FedSI: Federated Subnetwork Inference for Efficient Uncertainty Quantification
arxiv(2024)
摘要
While deep neural networks (DNNs) based personalized federated learning (PFL)
is demanding for addressing data heterogeneity and shows promising performance,
existing methods for federated learning (FL) suffer from efficient systematic
uncertainty quantification. The Bayesian DNNs-based PFL is usually questioned
of either over-simplified model structures or high computational and memory
costs. In this paper, we introduce FedSI, a novel Bayesian DNNs-based
subnetwork inference PFL framework. FedSI is simple and scalable by leveraging
Bayesian methods to incorporate systematic uncertainties effectively. It
implements a client-specific subnetwork inference mechanism, selects network
parameters with large variance to be inferred through posterior distributions,
and fixes the rest as deterministic ones. FedSI achieves fast and scalable
inference while preserving the systematic uncertainties to the fullest extent.
Extensive experiments on three different benchmark datasets demonstrate that
FedSI outperforms existing Bayesian and non-Bayesian FL baselines in
heterogeneous FL scenarios.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要