Gradient method: Difference between revisions

Revision as of 03:12, 14 May 2011

Latest revision as of 05:36, 17 April 2022

(7 intermediate revisions by 6 users not shown)

Line 1:

In [[optimization (mathematics)|optimization]], a '''gradient method''' is an [[algorithm]] to solve problems of the form

:<math>\min_{x\in\mathbb R^n}\; f(x)</math>

with the search directions defined by the [[gradient]] of the function at the current point. Examples of gradient methodmethods are the [[gradient descent]] and the [[conjugate gradient]].

==See also==

{{div col-begin|colwidth=22em}}

* [[Gradient descent]]

{{col-break}}

* [[Stochastic gradient descent]]

* [[GradientCoordinate descent method]]

* [[Frank–Wolfe algorithm]]

* [[Landweber iteration]]

* [[Random coordinate descent]]

* [[Conjugate gradient method]]

* [[Derivation of the conjugate gradient method]]

Line 15 ⟶ 18:

* [[Biconjugate gradient method]]

* [[Biconjugate gradient stabilized method]]

{{div col-break end}}

==References==

* {{cite book | year=1997 | title=Optimization : Algorithms and Consistent Approximations

| publisher=Springer-Verlag | isbn=0-387-94971-2 |author=Elijah Polak}}

{{Optimization algorithms}}

{{DEFAULTSORT:Gradient Method}}

[[Category:First order methods]]

[[Category:Optimization algorithms and methods]]

[[Category:Numerical linear algebra]]

[[Category:Gradient methods| ]]

{{linear-algebra-stub}}

[[fr:Algorithme du gradient]]

[[ja:勾配法]]