Lemma 2.2 — with
ProvedSolodovSvaiterVI.Alg21.lemma2_2_proj_xbar_eqLet be a closed convex subset of and continuous. Assume that the solution set of is nonempty and that condition (1.2) holds, and let . Let with , and let be a nonnegative integer satisfying the linesearch condition (2.1) at . Put
Then
In the notation of Algorithm 2.1 (, , ), this is : the next iterate may be computed by first projecting onto the halfspace and then onto . This is the geometric fact behind the Fejér-type inequality (2.6).
Formalization Note One step of the algorithm is stated for a generic point and a generic satisfying (2.1); the paper's hypothesis "the linesearch procedure (2.1) is well defined" becomes this assumption on (minimality is not needed). Projections are projOnto; under the hypotheses and are nonempty closed convex sets, so these are true projections. Continuity of and are standing assumptions of the paper, not used by this step.
import Mathlib import Definitions.Def_SolodovSvaiterVI_Alg21_projOnto import Definitions.Def_SolodovSvaiterVI_Alg21_viSol import Definitions.Def_SolodovSvaiterVI_Alg21_SatisfiesCond12 import Definitions.Def_SolodovSvaiterVI_Alg21_residual import Definitions.Def_SolodovSvaiterVI_Alg21_halfspace import Definitions.Def_SolodovSvaiterVI_Alg21_ArmijoHolds
namespace SolodovSvaiterVI.Alg21
/-- Lemma 2.2 of Solodov–Svaiter (p. 768), one step of Algorithm 2.1: if `k` satisfies the
linesearch condition (2.1) at `x ∈ C` with `r(x) ≠ 0`, `z = x − γᵏ r(x)` and
`H = {y | ⟨F(z), y − z⟩ ≤ 0}`, then `P_{C∩H}[x̄] = P_{C∩H}[x]` where `x̄ = P_H[x]`. -/
theorem lemma2_2_proj_xbar_eq {n : ℕ}
(F : EuclideanSpace ℝ (Fin n) → EuclideanSpace ℝ (Fin n))
(C : Set (EuclideanSpace ℝ (Fin n))) (hCc : IsClosed C) (hCcv : Convex ℝ C)
(hF : Continuous F) (hS : (viSol F C).Nonempty) (h12 : SatisfiesCond12 F C)
(gamma sigma : ℝ) (hγ0 : 0 < gamma) (hγ1 : gamma < 1) (hσ0 : 0 < sigma) (hσ1 : sigma < 1)
(x : EuclideanSpace ℝ (Fin n)) (hx : x ∈ C) (hr : residual F C x ≠ 0)
(k : ℕ) (hk : ArmijoHolds F C gamma sigma x k) :
let z := x - gamma ^ k • residual F C x
let H := halfspace (F z) z
projOnto (C ∩ H) (projOnto H x) = projOnto (C ∩ H) x := by sorry
end SolodovSvaiterVI.Alg21
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.