Amazing technological breakthrough possible @S-Logix pro@slogix.in

Office Address

  • 2nd Floor, #7a, High School Road, Secretariat Colony Ambattur, Chennai-600053 (Landmark: SRM School) Tamil Nadu, India
  • pro@slogix.in
  • +91- 81240 01111

Social List

Adaptive Personalized Federated Learning - 2020

Adaptive Personalized Federated Learning

Research Area:  Machine Learning

Abstract:

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an adaptive personalized federated learning (APFL) algorithm, where each client will train their local models while contributing to the global model. We derive the generalization bound of mixture of local and global models, and find the optimal mixing parameter. We also propose a communication-efficient optimization method to collaboratively learn the personalized models and analyze its convergence in both smooth strongly convex and nonconvex settings. The extensive experiments demonstrate the effectiveness of our personalization schema, as well as the correctness of established generalization theories.

Keywords:  

Author(s) Name:  Yuyang Deng, Mohammad Mahdi Kamani, Mehrdad Mahdavi

Journal name:  Computer Science

Conferrence name:  

Publisher name:  arXiv:2003.13461

DOI:  10.48550/arXiv.2003.13461

Volume Information: