Eq. (27) — the energy inequality of the Explicit Golden Ratio Algorithm
ProvedGoldenRatioVI.Explicit.energy_inequalitygolden-ratio-algorithmlyapunov-functionp2o-batch-p200ap2o-gran-per-chapterp2o-plan-paperp2o-v1variational-inequality
Let be a finite-dimensional real inner product space, let satisfy (C2) (proper, convex, lower semicontinuous) and let be monotone on (C3). Consider a run of Algorithm 1 with parameter , stepsizes , ratios and iterates , and write . For every and every ,
Taking , where , this is the Lyapunov inequality that gives boundedness of the iterates and in the proof of Theorem 2.
Formalization Note The paper says "let be arbitrary"; the statement is restricted to , where is defined and is a real number. The range is where the proof applies: it uses that is itself a proximal step, which holds from on.
Preamble
import Mathlib import Definitions.Def_GoldenRatioVI_Explicit_viProblem import Definitions.Def_GoldenRatioVI_Explicit_egraalRun
Formal statement
namespace GoldenRatioVI.Explicit
/-- Eq. (27) of Malitsky (p. 7), the energy inequality of Algorithm 1: under (C2) and (C3),
for every `u ∈ dom g` and every `k ≥ 2`,
`(ϕ/(ϕ−1))‖z̄^{k+1} − u‖² + (θ_k/2)‖z^{k+1} − z^k‖² + 2λ_k Ψ(u, z^k)
≤ (ϕ/(ϕ−1))‖z̄^k − u‖² + (θ_{k−1}/2)‖z^k − z^{k−1}‖² − θ_k‖z^k − z̄^k‖²`. -/
theorem energy_inequality {E : Type*} [NormedAddCommGroup E] [InnerProductSpace ℝ E]
[FiniteDimensional ℝ E] (g : E → EReal) (F : E → E) (ϕ lamBar : ℝ)
(z zbar : ℕ → E) (lam theta : ℕ → ℝ)
(hg : IsProperConvexLSC g) (hF : IsMonotoneOnDom g F)
(hrun : IsEGRAALRun g F ϕ lamBar z zbar lam theta)
(u : E) (hu : u ∈ dom g) (k : ℕ) (hk : 2 ≤ k) :
ϕ / (ϕ - 1) * ‖zbar (k + 1) - u‖ ^ 2 + theta k / 2 * ‖z (k + 1) - z k‖ ^ 2
+ 2 * lam k * psi g F u (z k) ≤
ϕ / (ϕ - 1) * ‖zbar k - u‖ ^ 2 + theta (k - 1) / 2 * ‖z k - z (k - 1)‖ ^ 2
- theta k * ‖z k - zbar k‖ ^ 2 := by sorry
end GoldenRatioVI.Explicit
Source
Malitsky, Golden Ratio Algorithms for Variational Inequalities, preprint (Optimization Online 6598, 2018), p. 7, Eq. (27) (proof of Theorem 2)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.