Commonly used algorithms

gradient descent, Newton's method, trust region, proximal algorithm, admm, interior point method