p. 90 — the pseudo-gradient field of a convex–concave saddle point problem
ProvedShorNonsmooth.Ellipsoid.saddle_field_monotoneellipsoid-methodp2o-batch-b23ap2o-gran-per-chapterp2o-plan-bookp2o-v1saddle-point
Let be a function of and that is convex in for fixed and concave in for fixed , and let be a saddle point:
For every let be a partial subgradient of at , and let be such that is a subgradient of at . Put . Then
Hence the algorithm (3.57)–(3.60), run in on the field , localizes a saddle point.
Formalization Note The inner product of is written as the sum of the inner products of the two blocks. The partial supergradient condition is for all .
Preamble
import Mathlib
Formal statement
namespace ShorNonsmooth.Ellipsoid
/-- Shor (1985), p. 90, §3.8.3 (the saddle point problem). Let `f(x, y)` be convex in
`x ∈ E_n` for fixed `y` and concave in `y ∈ E_m` for fixed `x`, with a saddle point
`z* = (x*, y*)`: `f(x*, y) ≤ f(x*, y*) ≤ f(x, y*)`. Let `g_f^x(x, y)` be a partial subgradient of
`f(·, y)` at `x` and `g_f^y(x, y)` a partial supergradient of `f(x, ·)` at `y` (so `-g_f^y` is a
subgradient of `-f(x, ·)`), and `g(z) = {g_f^x(z), -g_f^y(z)}`. Then `(g(z), z - z*) ≥ 0` for all
`z = (x, y) ∈ E_n × E_m = E_{n+m}`; the inner product of `E_{n+m}` is written as the sum of the
inner products of the two blocks. -/
theorem saddle_field_monotone {n m : ℕ}
(f : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin m) → ℝ)
(hconv : ∀ y, ConvexOn ℝ Set.univ (fun x => f x y))
(hconc : ∀ x, ConcaveOn ℝ Set.univ (fun y => f x y))
(gx : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin m) → EuclideanSpace ℝ (Fin n))
(gy : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin m) → EuclideanSpace ℝ (Fin m))
(hgx : ∀ x y x', f x' y - f x y ≥ inner ℝ (gx x y) (x' - x))
(hgy : ∀ x y y', f x y' - f x y ≤ inner ℝ (gy x y) (y' - y))
(xstar : EuclideanSpace ℝ (Fin n)) (ystar : EuclideanSpace ℝ (Fin m))
(hsaddle : ∀ x y, f xstar y ≤ f xstar ystar ∧ f xstar ystar ≤ f x ystar) :
∀ x y, 0 ≤ inner ℝ (gx x y) (x - xstar) + inner ℝ (-gy x y) (y - ystar) := by sorry
end ShorNonsmooth.Ellipsoid
Source
Shor, Minimization Methods for Non-Differentiable Functions, Springer 1985, p. 90, §3.8.3 (The Saddle Point Problem), unnumbered display
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.