# Quasi-Newton method

### From Glossary

One designed to capture the essence of the modified Newton's method, such as the Broyden family. The general idea is to build up an approximation to the inverse hessian to get an order of convergence between 1 and 2. Letting denote the inverse hessian estimate (where the direction is chosen by the deflection of the gradient,
is generally obtained from as in the BFGS update. A
quasi-Newton method is *memoryless* when is obtained by the same formula as a quasi-Newton method, but with replaced by some fixed matrix, like the identity. A *partial* quasi-Newton method follows the udate rules for some (specified) number of iterations, then restarts with (usually = identity matrix).