Stochastic approximation

The Robbins-Monro iteration: stochastic gradient descent on noisy gradients.

Robbins-Monro: stochastic gradient descent with decaying steps

Robbins-Monro: stochastic gradient descent with decaying steps