Gradient-Sensitive Optimization for Convolutional Neural Networks

Figure 3

(a) Comparison of the parameter iteration process with and without the adaptive factor while the learning rate is small. (b) Comparison of the parameter iteration process with and without the adaptive factor while the learning rate is large.

(a)

(b)