Article,

Synthesis of Accelerated Gradient Algorithms for Optimization and Saddle Point Problems using Lyapunov functions

, , and .
Systems & Control Letters, (2022)
DOI: 10.1016/j.sysconle.2022.105271

Abstract

This paper considers the problem of designing accelerated gradient-based algorithms for optimization and saddle-point problems. The class of objective functions is defined by a generalized sector condition. This class of functions contains strongly convex functions with Lipschitz gradients but also non-convex functions, which allows not only to address optimization problems but also saddle-point problems. The proposed design procedure relies on a suitable class of Lyapunov functions and on convex semi-definite programming. The proposed synthesis allows the design of algorithms that reach the performance of state-of-the-art accelerated gradient methods and beyond.

Tags

Users

  • @testusersimtech
  • @simtech
  • @carsten.scherer
  • @exc2075
  • @mst
  • @mathematik

Comments and Reviews