SSGD: A Safe and Efficient Method of Gradient Descent

Table 2

The test accuracy of compared algorithms on fashion-MNIST.

	SGD ()	SGDm ()	Adam	SSGD (m)
16	0.8253 ()	0.7795 ()	0.7175	0.8035 (4)
32	0.8241 ()	0.8031 ()	0.7513	0.8046 (4)
64	0.8468 ()	0.8163 ()	0.7674	0.8344 (4)
128	0.8629 ()	0.8331 ()	0.7835	0.8437 (4)
256	0.8527 ()	0.8511 ()	0.8252	0.8602 (4)
512	0.8682 ()	0.8569 ()	0.8566	0.8590 (4)
1024	0.8569 ()	0.8612 ()	0.8547	0.8668 (16)
2048	0.8457 ()	0.8351 ()	0.8511	0.8652 (32)
4096	0.8629 ()	0.8518 ()	0.8321	0.8704 (32)
8192	0.8325 ()	0.8278 ()	0.8144	0.8648 (64)