SSGD: A Safe and Efficient Method of Gradient Descent

Table 5

Test accuracy with ε = 4 on MINST.

SGDm\Adam\SSGDm	n = 4	n = 8	n = 16	n = 32	n = 64
m = 4	0.8714\0.9321\0.9730	0.9299\0.9515\0.9816	0.9508\0.95920.9822	0.9559\0.9567\0.9774	0.9518\0.97150.9851
m = 8	0.9242\0.9570\0.9785	0.9337\0.9657\0.9829	0.9582\0.9737\0.9790	0.9569\0.95690.9832	0.9625\0.9797\0.9802
m = 16	0.9471\0.9607\0.9684	0.9390\0.9606\0.9839	0.9662\0.97230.9833	0.9674\0.9726\0.9844	0.9699\0.97960.9860
m = 32	0.9203\0.9580\0.9780	0.9333\0.9693\0.9805	0.9594\0.9658\0.9859	0.9647\0.97630.9838	0.9758\0.9806\0.9837
m = 64	0.9163\0.9545\0.9772	0.9514\0.9771\0.9861	0.9560\0.97150.987	0.9710\0.9702\0.9853	0.9678\0.98330.9885