An Extensible Gradient-Based Optimization Method for Parameter Identification in Power Distribution Network

Algorithm 1

Adaptive gradient-based optimization methods.

	Input: initial parameters
	objective function to be optimized
	, decay rates for moment estimates
	initialized first-order moment
	initialized second-order moment
	time step
	learning rate
	maximum length of the simple moving average
	While is not converged do
	gradient with respect to parameters at time step
	update first-order moment
	update second-order moment
	biased-corrected first-order moment
	the length of the moving average
	If the variance is tractable, i.e., then
	update the adaptive learning rate
	the variance rectification term
	update parameters
	Else
	End while
	Return