Prediction and Evaluation of Coal Mine Coal Bump Based on Improved Deep Neural Network
Algorithm 1
Steps of improved Adam algorithm.
Improved Adam algorithm
1. Initialization: initial learning efficiency,; Exponential decay rate of first-order moment and second-order moment estimation, ,,,; Small constants for numerical stability,
2. Initialization parameter
3. Initialization: first order moment vector , second order moment vector ; time step ; iterative direction of improved Adam algorithm
4. When the stop criterion is not reached
5. A small batch of m samples was collected from the training set
6. Calculate the gradient yi for the target
7.
8. Updated biased first-order moment estimation:
9. Updated biased second-order moment estimation:
10. Correct the deviation of the first moment:
11. Correct the deviation of the second moment:
12. The amount of update per iteration of the improved Adam algorithm:
