Eq. (10) — convergence of along a convergent subsequence
ProvedNonconvexSplitting.ProxADMM.eq10_along_subseqadmmnonconvex-optimizationp2o-batch-p200bp2o-gran-per-chapterp2o-plan-paperp2o-v1
Assume the standing assumptions and Assumption 1, and let be generated by the proximal ADMM. If along a strictly increasing sequence , then is finite and
Together with (9) this is what allows passing to the limit in the inclusion .
Formalization Note The paper's (10) is a limit of real numbers equal to ; the finiteness of , which the limit presupposes, is stated as part of the conclusion. The convergence is in EReal.
Preamble
import Mathlib import Definitions.Def_NonconvexSplitting_Shared_StandingAssumptions import Definitions.Def_NonconvexSplitting_Shared_IsProxADMMSeq import Definitions.Def_NonconvexSplitting_Shared_Assumption1 open NonconvexSplitting.Shared open Filter Topology open scoped InnerProductSpace
Formal statement
namespace NonconvexSplitting.ProxADMM
/-- Eq. (10) of Li–Pong (pp. 9–10): along a convergent subsequence, `P(y^{t_i+1}) → P(y*)`,
and the limit `P(y*)` is finite. -/
theorem eq10_along_subseq {n m : ℕ} (h : EuclideanSpace ℝ (Fin n) → ℝ) (P : EuclideanSpace ℝ (Fin m) → EReal)
(phi : EuclideanSpace ℝ (Fin n) → ℝ) (M : EuclideanSpace ℝ (Fin n) →L[ℝ] EuclideanSpace ℝ (Fin m)) (β : ℝ)
(hstd : StandingAssumptions h P phi β)
(σ δ γ : ℝ) (Q1 Q2 T1 T2 Q3 : EuclideanSpace ℝ (Fin n) →L[ℝ] EuclideanSpace ℝ (Fin n))
(hA : Assumption1 h phi M β σ Q1 Q2 T1 T2 δ Q3 γ)
(x : ℕ → EuclideanSpace ℝ (Fin n)) (y z : ℕ → EuclideanSpace ℝ (Fin m))
(hseq : IsProxADMMSeq h P phi M β x y z)
(s : ℕ → ℕ) (hs : StrictMono s) (xs : EuclideanSpace ℝ (Fin n)) (ys zs : EuclideanSpace ℝ (Fin m))
(hconv : Tendsto (fun i => (x (s i), y (s i), z (s i))) atTop (𝓝 (xs, ys, zs))) :
Tendsto (fun i => P (y (s i + 1))) atTop (𝓝 (P ys)) ∧ P ys ≠ ⊤ := by sorry
end NonconvexSplitting.ProxADMM
Source
Li & Pong, Global Convergence of Splitting Methods for Nonconvex Composite Optimization, arXiv:1407.0753v6, pp. 9–10, proof that (10) holds along the subsequence (22)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.