Lightweight Industrial Image Classifier based on Federated Few-Shot Learning

Image classification using convolutional neural networks (CNNs) is critical for broader industrial applications like defect detection. To protect sensitive data during the industrial process, increasing institutions are highly interested in training CNN classifiers collaboratively with federated learning (FL). However, the existing FL solutions cannot address the sample deficiency and heterogeneous learning resource issues at different practical institutions. In this article, we present a federated lightweight relation network (FLRN), a lightweight industrial image classifier based on our federated few-shot learning (FFSL) architecture. Results of extensive experiments considering different real-world FFSL scenarios indicate that, unlike the state-of-the-art few-shot learning method relation network (RN), the FLRN performs well on not only FL participants with mutually isolated classes of samples but also external institutions with limited samples from unseen classes. Compared to the RN with the predominating FedAvg-based FL deployment, the FLRN manages to achieve as low as $\text{29.6}\times$ less client–cloud communication, $\text{5.2}\times$ less computation, and $\text{22.0}\times$ less storage costs of clients.