Commonly used algorithm design techniques

alternating minimization, interior point, line search, trust region, optimality conditions inspired