.. _sphx_glr_api_gallery_optimization_gradient_descent:

Gradient descent
------------------

Fixed-step and backtracking-line-search gradient descent.


.. raw:: html

  <div id='sg-tag-list' class='sphx-glr-tag-list'></div>


.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Gradient descent zig-zags across a narrow, elongated quadratic bowl. Backtracking line search adapts its step length automatically and converges in far fewer iterations than any single fixed step size.">

.. only:: html

  .. image:: /api/gallery/optimization/gradient_descent/images/thumb/sphx_glr_plot_01_fixed_vs_line_search_thumb.png
    :alt:

  :doc:`/api/gallery/optimization/gradient_descent/plot_01_fixed_vs_line_search`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Fixed step vs. backtracking line search on an ill-conditioned bowl</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /api/gallery/optimization/gradient_descent/plot_01_fixed_vs_line_search