(4.7) — fixed-point distance bound
ProvedRelaxedPRS.Linear.eq_4_7convex-optimizationlinear-convergencep2o-batch-pfp2ap2o-gran-per-chapterp2o-plan-paperp2o-v1relaxed-peaceman-rachford
In the relaxed PRS setting, suppose is real valued, convex, differentiable, and has a -Lipschitz gradient for . Let be a fixed point of , let , and let be the proximal points from iteration . For every ,
This bounds the fixed-point distance by the three quantities controlled in (4.6). The equality of the selected proximal subgradient and the smooth gradient is part of the mathematical content; it is not an added hypothesis.
Preamble
import Mathlib import Definitions.Def_RelaxedPRS_Linear_Setting
Formal statement
namespace RelaxedPRS.Linear
/-- (4.7), proof of Theorem 4.3, p. 16: the fixed-point distance bound. -/
theorem eq_4_7 {H : Type*} [NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]
(f g : H → EReal)
(hf : ThreeOpSplitting.ConvexRates.IsProperClosedConvex f)
(hg : ThreeOpSplitting.ConvexRates.IsProperClosedConvex g)
(γ : ℝ) (hγ : 0 < γ) (Pf Pg : H → H)
(hPf : ThreeOpSplitting.ConvexRates.IsProx γ f Pf)
(hPg : ThreeOpSplitting.ConvexRates.IsProx γ g Pg)
(lam : ℕ → ℝ) (hlam : ∀ k, 0 < lam k ∧ lam k ≤ 1)
(z : ℕ → H) (hz : RelaxedPRS.StrongCvx.IsPRSRun Pf Pg lam z)
(zs : H) (hzs : RelaxedPRS.StrongCvx.TPRS Pf Pg zs = zs)
(β : ℝ) (hβ : 0 < β)
(h : H → ℝ) (hgh : ∀ x, g x = (h x : EReal))
(hh : ThreeOpSplitting.ConvexRates.IsSmoothConvex β h) :
∀ k, ‖z k - zs‖ ^ 2 ≤ 3 *
(‖RelaxedPRS.StrongCvx.xf Pf Pg (z k) - RelaxedPRS.StrongCvx.xg Pg zs‖ ^ 2 +
‖γ • gradient h (RelaxedPRS.StrongCvx.xg Pg (z k)) - γ • gradient h (RelaxedPRS.StrongCvx.xg Pg zs)‖ ^ 2 +
‖RelaxedPRS.StrongCvx.xg Pg (z k) - RelaxedPRS.StrongCvx.xf Pf Pg (z k)‖ ^ 2) := by sorry
end RelaxedPRS.Linear
Source
Davis & Yin, Faster convergence rates of relaxed Peaceman-Rachford and ADMM under regularity assumptions, arXiv:1407.5210v3, p. 16, proof of Theorem 4.3, (4.7)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.