PFLIC: A Novel Personalized Federated Learning-Based Iterative Clustering

Shiwen Zhang1, 2, Shuang Chen1, 2, Wei Liang1, 2, Kuanching Li1, 2, Arcangelo Castiglione3 and Junsong Yuan4

  1. School of Computer Science and Engineering, Hunan University of Science and Technology, Xiangtan 411201, China
  2. Sanya Research Institute, Hunan University of Science and Technology, Sanya 572024, China
    {shiwen,wliang,aliric}@hnust.edu.cn,shuangchen@mail.hnust.edu.cn
  3. Department of Computer Science, University of Salerno, Fisciano, SA, Italy
  4. University at Buffalo, State University of New York, Buffalo 14201, New York, USA
    jsyuan@buffalo.edu

Abstract

Federated learning (FL) is a machine learning framework that effectively helps multiple organizations perform data usage and machine learning models while meeting the requirements of user privacy protection, data security, and government regulations. However, in practical applications, existing federated learning mechanisms face many challenges, including system inefficiency due to data heterogeneity and how to achieve fairness to incentivize clients to participate in federated training. Due to this fact, we propose PFLIC, a novel personalized federated learning based on an iterative clustering algorithm, to estimate clusters to mitigate data heterogeneity and improve the efficiency of FL. It is combined with sparse sharing to facilitate knowledge sharing within the system for personalized federated learning. To ensure fairness, a client selection strategy is proposed to choose relatively “good” clients to achieve fairer federated learning without sacrificing system efficiency. Extensive experiments demonstrate the superior performance and effectiveness of the proposed PFLIC compared to the baseline.

Key words

Federated learning; Clustering algorithm; Client Selection; Sparse sharing

How to cite

Zhang, S., Chen, S., Liang, W., Li, K., Castiglione, A., Yuan, J.: PFLIC: A Novel Personalized Federated Learning-Based Iterative Clustering. Computer Science and Information Systems