An Adaptive Deep Learning Optimization Method Based on Radius of Curvature

Algorithm 1

SGD-MS.

	Input: initialization parameter , learning rate , moving average decay rate , and objective function
(1)	initialization
(2)	for t = 1 to T do
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)	end for