Recognition Method of Tunnel Lining Defects Based on Deep Learning

Table 2

Four commonly used activation functions and their mathematical expressions in CNN.

Function	Mathematical formula
Sigmoid
Tanh
ReLU
Leaky ReLU