VOVU: A Method for Predicting Generalization in Deep Neural Networks

Algorithm 1

Algorithm of calculating VOVU in neural networks.

	Input:
(1)	The activation matrix of neural network’s last hidden layer,
(2)	The fixed subset of the training set, T
	Output:
	Variance Of Variance of Units in the last hidden layer, .
(1)	Calculating the activation matrix vector .
(2)	Calculating the vector of unit’s importance , for each
(3)	Calculating the empirical variance of
(4)	Return