Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Formalpedia

Theorem 6.1 — global convergence of Algorithm INB

Proved
GlobalInexactNewton.Backtracking.theorem_6_1

by mikedeng1 · Oct 6, 2026 · Mathlib 0df444a (Lean v4.33.1)

backtrackingglobal-convergenceinexact-newtonp2o-batch-pfp2bp2o-gran-per-chapterp2o-plan-paperp2o-v1

Let EEE be a finite-dimensional real normed space and F:E→EF:E\to EF:E→E continuously differentiable. Assume that Algorithm INB, with parameters ηmax⁡∈[0,1)\eta_{\max}\in[0,1)ηmax​∈[0,1), t∈(0,1)t\in(0,1)t∈(0,1) and 0<θmin⁡<θmax⁡<10<\theta_{\min}<\theta_{\max}<10<θmin​<θmax​<1, does not break down. Iteration kkk chooses ηˉk∈[0,ηmax⁡]\bar\eta_k\in[0,\eta_{\max}]ηˉ​k​∈[0,ηmax​] and an inexact Newton step sˉk\bar s_ksˉk​ with ∥F(xk)+F′(xk)sˉk∥≤ηˉk∥F(xk)∥\|F(x_k)+F'(x_k)\bar s_k\|\le\bar\eta_k\|F(x_k)\|∥F(xk​)+F′(xk​)sˉk​∥≤ηˉ​k​∥F(xk​)∥, and backtracks sk←θsks_k\leftarrow\theta s_ksk​←θsk​, ηk←1−θ(1−ηk)\eta_k\leftarrow1-\theta(1-\eta_k)ηk​←1−θ(1−ηk​) until

∥F(xk+sk)∥≤[1−t(1−ηk)] ∥F(xk)∥;\|F(x_k+s_k)\|\le[1-t(1-\eta_k)]\,\|F(x_k)\|;∥F(xk​+sk​)∥≤[1−t(1−ηk​)]∥F(xk​)∥;

then xk+1=xk+skx_{k+1}=x_k+s_kxk+1​=xk​+sk​.

If x∗x_*x∗​ is a limit point of (xk)(x_k)(xk​) such that F′(x∗)F'(x_*)F′(x∗​) is invertible, then

F(x∗)=0andxk→x∗.F(x_*)=0\qquad\text{and}\qquad x_k\to x_*.F(x∗​)=0andxk​→x∗​.

Furthermore, sk=sˉks_k=\bar s_ksk​=sˉk​ and ηk=ηˉk\eta_k=\bar\eta_kηk​=ηˉ​k​ for all sufficiently large kkk: eventually the initial inexact Newton step is accepted without backtracking.

The last clause means that, near a solution, the local convergence rate of the method is governed by the choice of initial levels ηˉk\bar\eta_kηˉ​k​, as in the local theory of inexact Newton methods.

Formalization Note "Does not break down" is the run predicate IsINBRun: the run is an infinite sequence, and every while-loop exits after finitely many passes mkm_kmk​. sks_ksk​ and ηk\eta_kηk​ are the values on exit from the loop. A limit point is MapClusterPt, and invertibility of F′(x∗)F'(x_*)F′(x∗​) is ContinuousLinearMap.IsInvertible.

Preamble
import Mathlib
import Definitions.Def_GlobalInexactNewton_Backtracking_Method
open Filter Topology
Formal statement
namespace GlobalInexactNewton.Backtracking

/-- Eisenstat–Walker (1994), p. 410, Theorem 6.1 (global convergence of Algorithm INB): assume
Algorithm INB does not break down. If `x_*` is a limit point of `{x_k}` such that `F'(x_*)` is
invertible, then `F(x_*) = 0` and `x_k → x_*`. Furthermore, `s_k = s̄_k` and `η_k = η̄_k` for all
sufficiently large `k`, where `s_k = trialStep (sbar k) (θ k) (m k)` and
`η_k = trialLevel (ηbar k) (θ k) (m k)` are the values on exit from the while-loop. -/
theorem theorem_6_1 {E : Type*} [NormedAddCommGroup E] [NormedSpace ℝ E] [FiniteDimensional ℝ E]
    (F : E → E) (hF : ContDiff ℝ 1 F) (ηmax t θmin θmax : ℝ) (x : ℕ → E) (ηbar : ℕ → ℝ)
    (sbar : ℕ → E) (θ : ℕ → ℕ → ℝ) (m : ℕ → ℕ)
    (hrun : IsINBRun F ηmax t θmin θmax x ηbar sbar θ m)
    (xstar : E) (hlim : MapClusterPt xstar atTop x) (hinv : (fderiv ℝ F xstar).IsInvertible) :
    F xstar = 0 ∧ Tendsto x atTop (𝓝 xstar) ∧
      ∀ᶠ k in atTop, trialStep (sbar k) (θ k) (m k) = sbar k ∧
        trialLevel (ηbar k) (θ k) (m k) = ηbar k := by sorry

end GlobalInexactNewton.Backtracking
Source
Eisenstat and Walker, Globally Convergent Inexact Newton Methods, SIAM J. Optim. 4(2) (1994), p. 410, Theorem 6.1
Human review
  • Endorsed by Shuze Chen · Oct 6, 2026

    Confirmed by the moderator at approval.

  • Endorsed by mikedeng1 · Oct 6, 2026

    Confirmed by the mission captain (proposal self-audit).

View graph

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me