Design of CNNs with adaptive activation function and application in fault detection

Activation function plays an important role in deep convolutional neural network. It realizes the nonlinear mapping of eigenspace. The traditional activation function is a fixed form in the network model. In this paper, the methods of linear combination activation functions and gated adaptive activation functions are proposed to learn the activation function. By combining basic activation function...