Eq. (3.62) — a vector field for minimizing a convex function on a ball
ProvedShorNonsmooth.Ellipsoid.ball_field_monotoneconvex-analysisellipsoid-methodp2o-batch-b23ap2o-gran-per-chapterp2o-plan-bookp2o-v1
Let be convex, let be a subgradient of at for every , and let be a minimum point of on the ball . Define the vector field
Then
The field makes the algorithm (3.57)–(3.60) applicable to constrained minimization on a ball: by Theorem 3.14, remains in ellipsoids whose volume decreases with ratio .
Formalization Note The subgradient property is for all . The book's intermediate estimate for prints where is meant; only the conclusion is stated.
Preamble
import Mathlib
Formal statement
namespace ShorNonsmooth.Ellipsoid
/-- Shor (1985), p. 88, (3.62). Let `f` be convex on `E_n`, `g_f` a subgradient selection of `f`,
and `x*` a minimum point of `f` on the ball `S(x₀, R) = {x : ‖x - x₀‖ ≤ R}`. The field
`g(x) = g_f(x)` for `x ∈ S(x₀, R)`, `g(x) = (x - x₀)/‖x - x₀‖` for `x ∉ S(x₀, R)`, satisfies
`(g(x), x - x*) ≥ 0` for all `x`. (The book's intermediate bound
`‖x - x₀‖(‖x - x₀‖ + ‖x* - x₀‖)` is a misprint for `‖x - x₀‖(‖x - x₀‖ - ‖x* - x₀‖)`; only the
conclusion is stated.) -/
theorem ball_field_monotone {n : ℕ} (f : EuclideanSpace ℝ (Fin n) → ℝ)
(hf : ConvexOn ℝ Set.univ f)
(gf : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin n))
(hgf : ∀ x y : EuclideanSpace ℝ (Fin n), f y - f x ≥ inner ℝ (gf x) (y - x))
(x₀ xstar : EuclideanSpace ℝ (Fin n)) (R : ℝ)
(hxstar : xstar ∈ Metric.closedBall x₀ R)
(hmin : ∀ x ∈ Metric.closedBall x₀ R, f xstar ≤ f x)
(g : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin n))
(hg_in : ∀ x ∈ Metric.closedBall x₀ R, g x = gf x)
(hg_out : ∀ x ∉ Metric.closedBall x₀ R, g x = ‖x - x₀‖⁻¹ • (x - x₀)) :
∀ x : EuclideanSpace ℝ (Fin n), 0 ≤ inner ℝ (g x) (x - xstar) := by sorry
end ShorNonsmooth.Ellipsoid
Source
Shor, Minimization Methods for Non-Differentiable Functions, Springer 1985, p. 88, §3.8.1, Eq. (3.62)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.