Fractional Rectified Linear Unit Activation Function and Its Variants

Table 1

Summarization of proposed fractional-order activation functions.

Category	Function	Conventional	Fractional
Linear variant	ReLU
	LReLU
	PReLU
	ELU
Nonlinear variant	SiLU
	GELU