Nonlinear conjugate gradient

Fletcher-Reeves and Polak-Ribiere nonlinear CG. An animation races CG against gradient descent down Rosenbrock’s valley.

Nonlinear conjugate gradient vs. gradient descent

Nonlinear conjugate gradient vs. gradient descent

Animated: conjugate gradient against gradient descent in Rosenbrock’s valley

Animated: conjugate gradient against gradient descent in Rosenbrock's valley