Gradient-Sensitive Optimization for Convolutional Neural Networks

Figure 10

Convergence curves of the cost function in the CNN model training process using Adam with the adaptive learning rate factor proposed in this article with different bases of the sig function.