An Improvement of Stochastic Gradient Descent Approach for Mean-Variance Portfolio Optimization Problem

Algorithm 3

AdaMax algorithm.

	Data: given the initial value , the number of samples , the step size , and the tolerance . Set .
	Step 1: evaluate the augmented objective function from (16).
	Step 2: compute the stochastic gradient from (20).
	Step 3: set the random index .
	Step 4: compute the decaying averages of past and past squared gradients from (22) and (27).
	Step 5: calculate the bias-corrected first-moment estimate from (24).
	Step 6: update the vector from (28). If , then stop the iteration. Otherwise, set and repeat from Step 1.
	Remark:
	The default values for the decay rates are  = 0.9 and  = 0.999, the tolerance is , and the learning rate is  = 0.001.