(A.8) — with R = C⁻¹, c = y and (A.7) is the dfp update
ProvedVarStorageQN.LeastChange.dfp_updatedfpleast-changep2o-batch-pfp2bp2o-gran-per-chapterp2o-plan-paperp2o-v1quasi-newtonsecant-update
Let be a real Hilbert space, a self-adjoint bounded operator, and with . Let be a bijective bounded operator with (one exists by Proposition A.3) and take . Then the weight vector is , and the unique solution of
is , where
So the Davidon–Fletcher–Powell update is a weighted least-change self-adjoint secant update.
Formalization Note Both conjuncts of the paper's sentence are stated: , and the unique-solution property (feasibility, minimality, equality of every feasible minimizer) of for (A.6) with . is a continuous linear equivalence and is its inverse C.symm. The Hilbert–Schmidt norm uses an arbitrary Hilbert basis; summability is part of .
Preamble
import Mathlib import Definitions.Def_VarStorageQN_LeastChange_HilbertSchmidt import Definitions.Def_VarStorageQN_LeastChange_Bracket import Definitions.Def_VarStorageQN_LeastChange_SecantProblem
Formal statement
namespace VarStorageQN.LeastChange
open InnerProductSpace ContinuousLinearMap
open scoped InnerProductSpace
variable {H : Type*} [NormedAddCommGroup H] [InnerProductSpace ℝ H] [CompleteSpace H]
/-- (A.8), pp. 29–30: if `⟨y,s⟩ > 0` and `y = C*Cs` with `C` bijective, then for `R = C⁻¹`
the weight is `c = y`, and the unique solution of (A.6) is the dfp perturbation `B_dfp − B`. -/
theorem dfp_update {ι : Type*} (b : HilbertBasis ι ℝ H) (B : H →L[ℝ] H)
(hB : IsSelfAdjoint B) (y s : H) (hys : 0 < ⟪y, s⟫_ℝ) (C : H ≃L[ℝ] H)
(hC : y = adjoint (C : H →L[ℝ] H) (C s)) :
let R : H ≃L[ℝ] H := C.symm
let r := y - B s
let Pc : H →L[ℝ] H :=
(⟪y, s⟫_ℝ)⁻¹ • (bracket r y + bracket y r) - (⟪r, s⟫_ℝ / ⟪y, s⟫_ℝ ^ 2) • bracket y y
let obj : (H →L[ℝ] H) → ℝ :=
fun P => hsNorm b (adjoint (R : H →L[ℝ] H) ∘L P ∘L (R : H →L[ℝ] H))
weight R s = y ∧
Pc ∈ FeasSym b B y s ∧
(∀ P ∈ FeasSym b B y s, obj Pc ≤ obj P) ∧
(∀ P ∈ FeasSym b B y s, (∀ Q ∈ FeasSym b B y s, obj P ≤ obj Q) → P = Pc) := by sorry
end VarStorageQN.LeastChange
Source
Gilbert & Lemaréchal, Some numerical experiments with variable-storage quasi-Newton algorithms, IIASA Working Paper WP-88-121 (August 1988), pp. 29–30, Annex, sentence before (A.8) and (A.8)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.