Theorem 3.1 — the inexact primal–dual forward–backward–forward iterates converge weakly to a primal and a dual solution
ProvedMonoSkew.Main.theorem_3_1Let and be real Hilbert spaces, let and be maximally monotone, let be a nonzero bounded linear operator, and let , be such that
Let , , be absolutely summable sequences in and , , absolutely summable sequences in . Let , , , let be a sequence in , and for every set
Then there are a solution of the primal inclusion and a solution of the dual inclusion with and , such that:
- and ;
- , , and ;
- if is uniformly monotone at , then and ;
- if is uniformly monotone at , then and .
This is the main result of the paper: a splitting method that uses and only through their resolvents (in parallel) and only through forward applications of and , and that solves the primal and the dual inclusion simultaneously, under the sole existence assumption that the primal problem has a solution.
Formalization Note The resolvents and are given maps, one per , with the resolvent property ; for maximally monotone , and they exist and are unique. "Absolutely summable" is . Convergence in (i), (iii), (iv) is in norm; is weak convergence ( for every ). The same pair serves all four clauses; uniform monotonicity is assumed at that point. The paper's "in Problem 1.1" (both operators maximally monotone, bounded linear) and the completeness of , are explicit hypotheses; is the operator norm, and is kept as printed.
import Mathlib import Definitions.Def_ThreeOpSplitting_Convergence_MonotoneOperators import Definitions.Def_ThreeOpSplitting_Convergence_WeakConvergence import Definitions.Def_DouglasRachfordPPA_GenDR_Operators import Definitions.Def_MonoSkew_Main_Basic open InnerProductSpace Filter Topology open ThreeOpSplitting.Convergence DouglasRachfordPPA.GenDR
namespace MonoSkew.Main
/-- Theorem 3.1 (pp. 10–11): in Problem 1.1 with `L ≠ 0` and
`z ∈ ran(A + L* ∘ B ∘ (L · − r))`, the iterates of the inexact primal–dual
forward–backward–forward method (3.1) with absolutely summable errors and step sizes in
`[ε, (1 − ε)/‖L‖]` satisfy, for some primal solution `x̄` and dual solution `v̄` with
`z − L*v̄ ∈ Ax̄` and `v̄ ∈ B(Lx̄ − r)`: (i) `x_n − p_{1,n} → 0`, `v_n − p_{2,n} → 0`;
(ii) `x_n, p_{1,n} ⇀ x̄` and `v_n, p_{2,n} ⇀ v̄`; (iii) if `A` is uniformly monotone at `x̄`
then `x_n, p_{1,n} → x̄`; (iv) if `B⁻¹` is uniformly monotone at `v̄` then `v_n, p_{2,n} → v̄`. -/
theorem theorem_3_1 {H G : Type*}
[NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]
[NormedAddCommGroup G] [InnerProductSpace ℝ G] [CompleteSpace G]
(A : H → Set H) (B : G → Set G) (hA : IsMaximalMonotone A) (hB : IsMaximalMonotone B)
(L : H →L[ℝ] G) (z : H) (r : G)
(hL : L ≠ 0) (hran : ∃ x, z ∈ primalOp A B L r x)
(a₁ b₁ c₁ : ℕ → H) (a₂ b₂ c₂ : ℕ → G)
(ha₁ : Summable (fun n => ‖a₁ n‖)) (hb₁ : Summable (fun n => ‖b₁ n‖))
(hc₁ : Summable (fun n => ‖c₁ n‖))
(ha₂ : Summable (fun n => ‖a₂ n‖)) (hb₂ : Summable (fun n => ‖b₂ n‖))
(hc₂ : Summable (fun n => ‖c₂ n‖))
(ε : ℝ) (hε0 : 0 < ε) (hε1 : ε < 1 / (‖L‖ + 1))
(γ : ℕ → ℝ) (hγ : ∀ n, ε ≤ γ n ∧ γ n ≤ (1 - ε) / ‖L‖)
(JA : ℕ → H → H) (hJA : ∀ n, IsResolvent (γ n) A (JA n))
(JBinv : ℕ → G → G) (hJB : ∀ n, IsResolvent (γ n) (opInv B) (JBinv n))
(x y₁ p₁ q₁ : ℕ → H) (v y₂ p₂ q₂ : ℕ → G)
(hrun : IsPDRun L z r γ JA JBinv a₁ b₁ c₁ a₂ b₂ c₂ x y₁ p₁ q₁ v y₂ p₂ q₂) :
∃ xbar : H, ∃ vbar : G,
xbar ∈ primalSet A B L z r ∧ vbar ∈ dualSet A B L z r ∧
z - ContinuousLinearMap.adjoint L vbar ∈ A xbar ∧ vbar ∈ B (L xbar - r) ∧
(Tendsto (fun n => x n - p₁ n) atTop (𝓝 0) ∧
Tendsto (fun n => v n - p₂ n) atTop (𝓝 0)) ∧
(WeakTendsto x xbar ∧ WeakTendsto p₁ xbar ∧ WeakTendsto v vbar ∧
WeakTendsto p₂ vbar) ∧
(IsUniformlyMonotoneAt A xbar →
Tendsto x atTop (𝓝 xbar) ∧ Tendsto p₁ atTop (𝓝 xbar)) ∧
(IsUniformlyMonotoneAt (opInv B) vbar →
Tendsto v atTop (𝓝 vbar) ∧ Tendsto p₂ atTop (𝓝 vbar)) := by sorry
end MonoSkew.Main
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.