A Hierarchical Federated Learning Model with Adaptive Model Parameter Aggregation

Zhuo Chen1, Chuan Zhou1 and Yang Zhou2

  1. College of Computer Science and Engineering, Chongqing University of Technology
    Chongqing, China
    chenzhuo@cqut.edu.cn, czhou@2020.cqut.edu.cn
  2. Department of Computer Science and Software Engineering, Auburn University
    Auburn, USA
    yangzhou@auburn.edu

Abstract

With the proposed Federated Learning (FL) paradigm based on the idea of "data available but invisible", participating nodes which create or hold data can perform local model training in a distributed manner, then a global model can be trained only by continuously aggregating model parameters or intermediate results from different nodes, thereby achieving a balance between data privacy protection and data sharing. However, there are some challenges when deploying a FL model. First, there may be hierarchical associations between participating nodes, so that the datasets held by each node are no longer independent of each other. Secondly, due to the possible abnormal delay of data transmission, it can seriously influence the aggregation of model parameters. In response to the above challenges, this paper proposes a newly designed FL framework for the participating nodes with hierarchical associations. In this framework, we design an adaptive model parameter aggregation algorithm, which can dynamically decide the aggregation strategy according to the state of network connection between nodes in different layers. Additionally, we conduct a theoretical analysis of the convergence of the proposed FL framework based on a non-convex objective function. Finally, the experimental results show that the proposed framework can be well applied to applications in different network connections, and can achieve faster model convergence efficiency while ensuring the accuracy of the model prediction.

Key words

Parameter Aggregation, Federated Learning, Internet of Things, Privacy Computing

Digital Object Identifier (DOI)

https://doi.org/10.2298/CSIS220930026C

Publication information

Volume 20, Issue 3 (June 2023)
Year of Publication: 2023
ISSN: 2406-1018 (Online)
Publisher: ComSIS Consortium

Full text

DownloadAvailable in PDF
Portable Document Format

How to cite

Chen, Z., Zhou, C., Zhou, Y.: A Hierarchical Federated Learning Model with Adaptive Model Parameter Aggregation. Computer Science and Information Systems, Vol. 20, No. 3, 1037–1060. (2023), https://doi.org/10.2298/CSIS220930026C