Fractional Rectified Linear Unit Activation Function and Its Variants

Figure 9

Performance of neural network with FReLU in hidden layer 1 and FPRELU in hidden layer 2 during training and testing.