CRACAU: Byzantine Machine Learning meets Industrial Edge Computing in Industry 5.0

Industry 5.0 is emerging as a result of the advancement in networking and communications technologies, Artificial Intelligent (AI), distributed computing, and Beyond 5G (B5G). Among the important enabling technologies, federated Learning, industrial edge computing, and Byzantine-tolerant Machine Learning (ML) are key accelerators in Industry 5.0. We propose a framework to integrate these key components. Recent works have designed various Byzantine-tolerant ML algorithms for a datacenter or a cluster. However, these algorithms are difficult to be applied to industrial edge computing paradigms. In this paper, a novel Byzantine-tolerant federated learning algorithm, CRACAU, is designed for the popular three-level edge computing architecture. In this algorithm, edge devices jointly learn an ML model using the data collected at each device, and their private data is never shared with others. Under standard assumptions, we formally prove that CRACAU converges to the optimal point, i.e., CRACAU finds the optimal parameters of the ML model. We also implement CRACAU in the MXNet framework and evaluate it on the popular benchmark MNIST and CIFAR-10 image classification datasets. Experimental results show that CRACAU achieves satisfying accuracy.