Fractional Rectified Linear Unit Activation Function and Its Variants

Figure 2

Response of fractional forms of nonlinear variants for various values of . (a) Fractional ELU, (b) fractional SiLU, and (c) fractional GELU.

(a)

(b)

(c)