On the Variational Principle I: Near Every ε-Minimizer of a Lower Semicontinuous Function Bounded Below on a Complete Metric Space Lies a Strict Minimizer of F + (ε/λ)d(v, ·)Research Paper
Motivation
A function that is bounded below need not attain its infimum: on has infimum and no minimizer. The classical "variational principle" says that at a minimizer of a differentiable functional, . Without compactness there may be no minimizer, and the principle has nothing to say. In 1974 Ivar Ekeland showed that a weaker statement survives in every complete metric space: next to any approximate minimizer lies a point that is the exact, strict minimizer of a slightly perturbed function (Ekeland 1974).
The result is now a standard tool in nonlinear analysis, optimization and the calculus of variations. It yields approximate first-order conditions () without existence of minimizers, approximate Lagrange multiplier rules, and approximate maximum principles in optimal control; Ekeland's survey (Ekeland 1979) collects many of these uses.
Timeline. Bishop and Phelps introduced the partial order on a Banach space times that underlies the proof, in their study of support functionals of convex sets (Bishop–Phelps, The support functional of a convex set, Proc. Symp. Pure Math. 7, AMS, 1963). Brøndsted and Rockafellar used it in 1965 to obtain subdifferentiability properties of convex functions on Banach spaces (Brøndsted–Rockafellar 1965), and Browder applied it to nonconvex subsets of Banach spaces (Bull. AMS 79, 1973). Ekeland's 1974 article, formalized here, isolates the device as a principle valid in every complete metric space for lower semicontinuous functions with values in , and applies it to Gâteaux-differentiable functions, constrained optimization, Plateau's problem, geodesics and optimal control.
Setting
Let be a complete metric space. Let be lower semicontinuous (for every the set is closed), not identically , and bounded from below:
For , a point is an -minimizer if
For , the Bishop–Phelps order on is
In Lean it is EkelandVP.General.bpLE α p q, read . The epigraph of is (1.15).
In §2, is a real Banach space with dual , and is Gâteaux-differentiable with derivative (EkelandVP.General.IsGateauxDiff F F'): at every with , for every (2.1).
Formalization targets
Goal: Theorem 1.1 (p. 324)
For every satisfying (1.2) and every there is with
The parameters and are free; the trade-off between closeness to and the size of the perturbation is the content of the theorem.
Milestones (§1)
- For , is reflexive, antisymmetric and transitive (p. 325).
- For every , the set is closed in (p. 325).
- Lemma 1.2 (p. 325): if is closed and on for some (1.7), then every lies below a -maximal element of .
Consequences (§2)
- Corollary 2.3 (p. 328): for Banach, l.s.c. and Gâteaux-differentiable with , and every , there is with and .
- Corollary 2.4 (p. 328): if moreover with , then is dense in .
- Corollary 2.5 (p. 329): if with continuous and , then is dense in .
Significance
The result. Theorem 1.1 replaces "a minimizer exists" by "a strict minimizer of a Lipschitz perturbation exists nearby", with explicit control of both the distance and the perturbation. With this gives a point that is -optimal, -close to , and -stationary in the metric sense. Corollary 2.3 is the form announced in the paper's abstract: a differentiable function with a finite lower bound has points where is almost minimal and is arbitrarily small. Later sections of the same paper use Theorem 1.1 for approximate Lagrange multiplier rules (§3) and an approximate Pontryagin maximum principle (§7), which are the subjects of missions II and III of this series.
Formalizing it. The theorem is proved; this mission formalizes the paper's own route (the order (1.6), Lemma 1.2, then Theorem 1.1) and its first applications in §2. The pinned Mathlib has no statement of Ekeland's principle, of the Caristi fixed point theorem, or of the Bishop–Phelps order, and the platform has none either. A machine-checked Theorem 1.1 for extended-real-valued functions would be directly reusable by every later mission that needs approximate optimality without compactness.
Difficulty
The obvious argument — take a minimizing sequence and pass to a limit — fails because nothing makes a minimizing sequence converge: is not compact, and a minimizing sequence of escapes to . Completeness only helps for Cauchy sequences, so one must construct a sequence that is Cauchy. The limit must moreover be maximal for the order (1.6), not merely a limit point, and that maximality is what produces the strict inequality (1.5). Lemma 1.2 is where this difficulty sits. In §2, the passage from the metric statement (1.5) to a bound on requires to be finite near along every line, which the Gâteaux hypothesis supplies.
Formalization scope
- is a
MetricSpacewithCompleteSpace; isdist u v. carries the product topology; only closedness of subsets of it is used. -
EReal. "Bounded from below" (1.1) is ; it also excludes the value , which the paper's codomain does not contain. "Not identically " is . Lower semicontinuity is Mathlib'sLowerSemicontinuous. - (1.2) is assumed in the form with real (the left half is automatic). is named
lam. - (1.5) is for all , strict, with the paper's argument order . Since is finite under the hypotheses, the
ERealsubtraction is ordinary. - A trivializing formalization is ruled out: is not real-valued (the value is what lets §3 apply the theorem to plus the indicator of a closed set), (1.5) is strict and quantified over all , and the conclusion is not weakened to or in (1.5).
- In §2, is a real
NormedSpacewithCompleteSpace, is a function , and Gâteaux differentiability requires to be finite near before taking a real derivative; without this,EReal.toRealwould let an infinite function have a junk derivative. Density of is stated for derivatives taken at points where . - Theorem 2.2 is not part of this mission: its conclusion (2.4) is printed as the strict , while its one-line proof from Theorem 1.1 gives only . Corollaries 2.3–2.5 do not depend on the strict form.
Contributions welcome: proofs of the milestones (the first two are short; Lemma 1.2 is the core), of Theorem 1.1, and of the §2 corollaries; a reusable Caristi fixed point theorem built on the same order would be a natural addition.
Selected references
- I. Ekeland, On the Variational Principle, J. Math. Anal. Appl. 47 (1974), 324–353. https://doi.org/10.1016/0022-247X(74)90025-0
- I. Ekeland, Nonconvex minimization problems, Bull. Amer. Math. Soc. (N.S.) 1 (1979), 443–474. https://doi.org/10.1090/S0273-0979-1979-14595-6
- E. Bishop, R. R. Phelps, The support functional of a convex set, in Convexity (V. Klee, ed.), Proc. Symp. Pure Math. 7, Amer. Math. Soc., 1963, 27–35. (Reference [4] of Ekeland 1974.)
- A. Brøndsted, R. T. Rockafellar, On the subdifferentiability of convex functions, Proc. Amer. Math. Soc. 16 (1965), 605–611. https://doi.org/10.1090/S0002-9939-1965-0178103-8
- F. E. Browder, Normal solvability for nonlinear mappings into Banach spaces, Bull. Amer. Math. Soc. 79 (1973), 328–350. https://doi.org/10.1090/S0002-9904-1973-13152-9