Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Analysis

323 missions · 177 completed

Missions

Open146Completed177All323
🏆Completed
CombinatoricsNumber Theory·Captain: Xiang Huang

Ramanujan's Notebooks (Berndt)Textbook

Motivation

The notebooks Ramanujan kept in India record identities, evaluations, transformations and general principles, usually presented without proofs. They preserve a working mathematician's collection rather than a textbook arranged around a sequence of prerequisite theorems. The Tata Institute of Fundamental Research published an unedited facsimile edition in 1957, making the manuscripts available for systematic study.

Bruce C. Berndt's Ramanujan's Notebooks, published by Springer in five parts in 1985, 1989, 1991, 1994 and 1998, supplies that study. The volumes examine the entries individually, proving them, correcting them where necessary, or explaining why they are false or lack a rigorous interpretation. Their subject matter ranges from magic squares and combinatorial identities to hypergeometric series, continued fractions, elliptic functions, modular equations, class invariants and asymptotic expansions.

This mission takes the results established in Berndt's treatment as formalization targets. The published arguments provide mathematical reference proofs. The remaining task is to express the results precisely and construct proofs checked by Lean.

Setting

An entry is a source claim identified by its chapter and local entry label in Berndt's series. The collection is organized around one Lean statement per entry that Berndt establishes. Where an entry contains separately identified parts, corollaries or examples, suffixes distinguish the corresponding statements while preserving their common source location. Intermediate steps of a printed proof do not automatically become additional targets.

The mission covers Chapters 1–39. Part I contains Chapters 1–9; Part II, Chapters 10–15; Part III, Chapters 16–21; Part IV, Chapters 22–31; and Part V, Chapters 32–39. The Part IV appendix on the first notebook and the Quarterly Reports treated in Part I also belong to the mission's scope, with their statements incorporated as they are added.

Declarations use the namespace RamanujanNotebooks and names of the form entry_<chapter>_<entry>, such as RamanujanNotebooks.entry_16_19. Shared definitions fix the meaning of recurring objects: q-shifted factorials, theta functions, hypergeometric series, continued-fraction convergents and the special functions used across chapters. Their domains, normalizations and indexing conventions are documented so that different entries refer to the same mathematical objects.

Formalization targets

The series has no single capstone theorem. Its goal item is therefore a representative entry: Chapter 16, Entry 19, Jacobi's triple product identity in Ramanujan's notation. This is in Part III, whose chapter develops q-series and theta functions.

For complex parameters a,ba,ba,b, Ramanujan's general theta function is

f(a,b)=∑n∈Zan(n+1)/2bn(n−1)/2.f(a,b)=\sum_{n\in\mathbb Z} a^{n(n+1)/2}b^{n(n-1)/2}.f(a,b)=n∈Z∑​an(n+1)/2bn(n−1)/2.

Both exponents are nonnegative integers. Under ∣ab∣<1|ab|<1∣ab∣<1, the series converges absolutely, and Entry 19 identifies it with an infinite product. Writing q=abq=abq=ab, the target is

f(a,b)=∏m=0∞(1+aqm)(1+bqm)(1−qm+1),∣ab∣<1.f(a,b)=\prod_{m=0}^{\infty} (1+a q^m)(1+b q^m)(1-q^{m+1}), \qquad |ab|<1.f(a,b)=m=0∏∞​(1+aqm)(1+bqm)(1−qm+1),∣ab∣<1.

Equivalently, with the infinite q-Pochhammer symbol

(z;q)∞=∏m=0∞(1−zqm),(z;q)_\infty=\prod_{m=0}^{\infty}(1-zq^m),(z;q)∞​=m=0∏∞​(1−zqm),

the identity reads

f(a,b)=(−a;ab)∞(−b;ab)∞(ab;ab)∞.f(a,b)=(-a;ab)_\infty(-b;ab)_\infty(ab;ab)_\infty.f(a,b)=(−a;ab)∞​(−b;ab)∞​(ab;ab)∞​.

The Lean statement uses ramanujanTheta and qPochInf, with the hypothesis ‖a * b‖ < 1. Proving this goal establishes the representative identity; completion of the collection is tracked through its member statements, one per entry.

Every entry is a separate statement of this mission, named RamanujanNotebooks.entry_<chapter>_<entry> (with suffixes for parts, corollaries and examples): 3,863 statements for Parts I–V, the Part IV appendix on the first notebook and the Quarterly Reports; the AMS Memoir 477 statements are being added. A chapter's statements are found by searching for its name prefix. The milestone list has one milestone per chapter, in source order, titled like “Part III · Ch. 16 — q-series and theta-functions”; each links one representative result and its description names the chapter's main results.

Statement conventions and source differences

The mathematical reference is what Berndt proves, with the hypotheses his argument requires. A notebook display alone is insufficient when its domain, convergence conditions or branch choices are unstated. Each target identifies its source and records the conditions under which the asserted equality, limit, transformation or asymptotic relation is established.

Corrected statements carry the explicit phrase “Differs from the printed source”. The accompanying note explains the difference and its origin: a correction supplied by Berndt, a restriction required by the proof, or a reading that resolves an ambiguity. A proposed repair supported only by numerical experiments requires further mathematical review before inclusion as a result established by the reference.

Entries that Berndt shows to be false are not stated as theorem targets. Neither are identities treated only formally, without a rigorous version. For example, Chapter 37's Entry 34 manipulates divergent series, while Entries 35–37 are shown false. Chapter 39 also contains formal claims and entries for which the book supplies no definite interpretation. Such omissions preserve the boundary between a proved result and a suggestive manuscript formula.

Numerical checks are recorded in theorem docstrings, including the tested parameters and the kind of comparison performed. They help detect indexing errors, sign errors and unsuitable domains. Agreement at sampled points is evidence about the transcription; it is not a proof of the universally quantified Lean statement.

Significance and status

The mission brings together source-linked statements of known results whose proofs otherwise remain dispersed across Berndt's commentary. Formal proofs can expose exactly which analytic hypotheses an identity needs and make the shared special-function definitions available for later developments. A proof of the triple product, for example, connects the series definition of the general theta function with its product representation, which recurs throughout the theta-function material.

The statements are proof targets. A declaration that type-checks has a meaningful Lean type; that check alone does not establish the proposition. The description makes no claim that the collection already has machine-checked proofs. Progress is measured by proofs of the individual targets with their stated hypotheses.

Difficulty

The entries vary considerably in their prerequisites. Finite algebraic and combinatorial identities can be approached with relatively little analytic infrastructure. Other chapters depend on convergence theory for continued fractions, transformations of theta and elliptic functions, modular forms, or class invariants.

Even a short equality can require substantial work before its expressions have the intended meaning. A divergent series cannot be interpreted as an ordinary sum, and a complex root or logarithm needs an appropriate branch convention. The central challenge is to preserve the object and domain of the reference result while supplying the formal infrastructure needed to prove it.

Formalization scope

Statements use real or complex variables according to the reference, with exceptional values, nonvanishing conditions and convergence ranges explicit. Infinite series are expressed with convergence assertions where necessary; continued fractions are represented through their convergents and limits. Integrals carry the hypotheses needed for their intended interpretation. Lean's total definitions of division, infinite sums and infinite products must not turn an undefined or divergent source expression into a trivial theorem.

Contributions should prove the registered statements using their shared definitions. Reusable lemmas about convergence, special functions and transformations are part of that work. Any suspected statement error should be reported with the declaration name, source location and a specific mathematical objection, so that the source relationship can be reviewed before a replacement is prepared.

Selected references

  • S. Ramanujan, Notebooks, facsimile edition, Tata Institute of Fundamental Research, Bombay, 1957.
  • B. C. Berndt, Ramanujan's Notebooks, Part I, Springer, 1985.
  • B. C. Berndt, Ramanujan's Notebooks, Part II, Springer, 1989.
  • B. C. Berndt, Ramanujan's Notebooks, Part III, Springer, 1991.
  • B. C. Berndt, Ramanujan's Notebooks, Part IV, Springer, 1994.
  • B. C. Berndt, Ramanujan's Notebooks, Part V, Springer, 1998.
45 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs 1: Every Cluster Point of the e-PSG Iterates Is a Lifted Stationary PointResearch Paper

Motivation

A fractional program minimizes a ratio f(x)/g(x)f(x)/g(x)f(x)/g(x) over a set SSS. Nonconvex, nonsmooth ratios arise in the scale-invariant sparse signal recovery model min⁡∥x∥1/∥x∥2\min\|x\|_1/\|x\|_2min∥x∥1​/∥x∥2​ over a polyhedron, in robust Sharpe-ratio optimization in finance, and in the Rayleigh quotient x⊤Ax/x⊤Bxx^\top Ax/x^\top Bxx⊤Ax/x⊤Bx over a sphere; with g≡1g\equiv1g≡1 and S=HS=HS=H the problem reduces to composite optimization min⁡fs+fn\min f^{\mathsf s}+f^{\mathsf n}minfs+fn. The classical method of Dinkelbach (1967) and its proximal-gradient descendants assume a convex numerator and a concave or smooth denominator, which these models do not satisfy.

Boţ, Dao and Li (arXiv:2003.04124, Math. Oper. Res. 2022) propose the extrapolated proximal subgradient algorithm (e-PSG) for problems in which the numerator is the sum of a smooth convex and a nonsmooth nonconvex term and the denominator is only weakly convex, and they prove that its cluster points satisfy a first-order condition. This mission formalizes that subsequential convergence theorem (Theorem 4.5).

Setting

Let H=RNH=\mathbb R^NH=RN with the Euclidean inner product, and let S⊆HS\subseteq HS⊆H be nonempty, closed and convex. The problem is

min⁡x∈S f(x)g(x).(P)\min_{x\in S}\ \frac{f(x)}{g(x)}.\qquad(\mathrm P)x∈Smin​ g(x)f(x)​.(P)

Assumption 1. f=fs+fnf=f^{\mathsf s}+f^{\mathsf n}f=fs+fn, where fs:H→Rf^{\mathsf s}:H\to\mathbb Rfs:H→R is continuously differentiable and convex with an ℓ\ellℓ-Lipschitz gradient, fn:H→(−∞,+∞]f^{\mathsf n}:H\to(-\infty,+\infty]fn:H→(−∞,+∞] is proper and lower semicontinuous, S∩dom⁡f≠∅S\cap\operatorname{dom}f\ne\emptysetS∩domf=∅, and f≥0f\ge0f≥0 on S∩dom⁡fS\cap\operatorname{dom}fS∩domf.

Assumption 2. ggg is finite and positive on SSS, continuous on an open set containing SSS, and either weakly convex with modulus β\betaβ on an open convex set containing SSS (that is, g+β2∥⋅∥2g+\frac\beta2\|\cdot\|^2g+2β​∥⋅∥2 is convex there), or regular (Fréchet and limiting subdifferentials coincide) and weakly convex with modulus β\betaβ on SSS.

The limiting subdifferential ∂Lh(x)\partial_L h(x)∂L​h(x) collects limits of Fréchet subgradients uk∈∂^h(xk)u_k\in\widehat\partial h(x_k)uk​∈∂h(xk​) along xk→xx_k\to xxk​→x with h(xk)→h(x)h(x_k)\to h(x)h(xk​)→h(x). A point xˉ∈S\bar x\in Sxˉ∈S is a lifted stationary point of (P) if

0∈g(xˉ) ∂L(f+ιS)(xˉ)−f(xˉ) ∂Lg(xˉ),0\in g(\bar x)\,\partial_L(f+\iota_S)(\bar x)-f(\bar x)\,\partial_L g(\bar x),0∈g(xˉ)∂L​(f+ιS​)(xˉ)−f(xˉ)∂L​g(xˉ),

where ιS\iota_SιS​ is 000 on SSS and +∞+\infty+∞ off SSS.

The boundedness condition (BC) asks for 0<m≤g≤M0<m\le g\le M0<m≤g≤M on S∩dom⁡fS\cap\operatorname{dom}fS∩domf. Algorithm 1 (e-PSG) starts from x−1=x0∈S∩dom⁡fx_{-1}=x_0\in S\cap\operatorname{dom}fx−1​=x0​∈S∩domf with parameters δ>0\delta>0δ>0, ζ>0\zeta>0ζ>0 (1−βζ>01-\sqrt\beta\zeta>01−β​ζ>0) and extrapolation bounds μˉ,κˉ\bar\mu,\bar\kappaμˉ​,κˉ (in explicit ranges depending on m,M,ℓm,M,\ellm,M,ℓ under (BC), and μˉ=κˉ=0\bar\mu=\bar\kappa=0μˉ​=κˉ=0 otherwise). At step nnn it sets θn=f(xn)/g(xn)\theta_n=f(x_n)/g(x_n)θn​=f(xn​)/g(xn​), picks gn∈∂Lg(xn)g_n\in\partial_L g(x_n)gn​∈∂L​g(xn​) and 0<τn≤1/max⁡{βθn/ζ,δ}0<\tau_n\le1/\max\{\sqrt\beta\theta_n/\zeta,\delta\}0<τn​≤1/max{β​θn​/ζ,δ}, forms un=xn+κn(xn−xn−1)u_n=x_n+\kappa_n(x_n-x_{n-1})un​=xn​+κn​(xn​−xn−1​), vn=xn+μn(xn−xn−1)v_n=x_n+\mu_n(x_n-x_{n-1})vn​=xn​+μn​(xn​−xn−1​) with κn∈[0,κˉ]\kappa_n\in[0,\bar\kappa]κn​∈[0,κˉ], μn∈[0,μˉτn]\mu_n\in[0,\bar\mu\tau_n]μn​∈[0,μˉ​τn​], and takes

xn+1∈argmin⁡x∈S(fn(x)+fs(un)+⟨∇fs(un),x−un⟩+12τn∥x−vn−τnθngn∥2+ℓ2∥x−un∥2).x_{n+1}\in\operatorname*{argmin}_{x\in S}\Big(f^{\mathsf n}(x)+f^{\mathsf s}(u_n)+\langle\nabla f^{\mathsf s}(u_n),x-u_n\rangle+\tfrac1{2\tau_n}\|x-v_n-\tau_n\theta_ng_n\|^2+\tfrac\ell2\|x-u_n\|^2\Big).xn+1​∈x∈Sargmin​(fn(x)+fs(un​)+⟨∇fs(un​),x−un​⟩+2τn​1​∥x−vn​−τn​θn​gn​∥2+2ℓ​∥x−un​∥2).

Finally S0={x∈S:f(x)/g(x)≤f(x0)/g(x0)}S_0=\{x\in S: f(x)/g(x)\le f(x_0)/g(x_0)\}S0​={x∈S:f(x)/g(x)≤f(x0​)/g(x0​)}.

Formalization targets

Goal: Theorem 4.5(iii)

If S0S_0S0​ is bounded and lim inf⁡nτn=τˉ>0\liminf_n\tau_n=\bar\tau>0liminfn​τn​=τˉ>0, then every cluster point xˉ\bar xxˉ of (xn)(x_n)(xn​) satisfies

xˉ∈S∩dom⁡f,lim⁡n→∞f(xn)g(xn)=f(xˉ)g(xˉ),xˉ is lifted stationary.\bar x\in S\cap\operatorname{dom}f,\qquad \lim_{n\to\infty}\frac{f(x_n)}{g(x_n)}=\frac{f(\bar x)}{g(\bar x)},\qquad \bar x\ \text{is lifted stationary.}xˉ∈S∩domf,n→∞lim​g(xn​)f(xn​)​=g(xˉ)f(xˉ)​,xˉ is lifted stationary.

In the formal statement ggg is in addition Lipschitz around every point of SSS; see Formalization scope.

Milestones, in proof order

  1. Lemma 4.3: for x,y∈Sx,y\in Sx,y∈S and u∈∂Lg(x)u\in\partial_L g(x)u∈∂L​g(x), ⟨u,y−x⟩≤g(y)−g(x)+β2∥y−x∥2\langle u,y-x\rangle\le g(y)-g(x)+\frac\beta2\|y-x\|^2⟨u,y−x⟩≤g(y)−g(x)+2β​∥y−x∥2.
  2. Lemma 4.4 (descent lemma), already on the platform.
  3. Inequality (16): the one-step inequality from the subproblem.
  4. Inequality (17): the ratio inequality, for every Young parameter ω>0\omega>0ω>0.
  5. Theorem 4.5(i): xn∈S∩dom⁡fx_n\in S\cap\operatorname{dom}fxn​∈S∩domf and
(f(xn+1)g(xn+1)+c∥xn+1−xn∥2)+α∥xn+1−xn∥2≤f(xn)g(xn)+c∥xn−xn−1∥2\Big(\tfrac{f(x_{n+1})}{g(x_{n+1})}+c\|x_{n+1}-x_n\|^2\Big)+\alpha\|x_{n+1}-x_n\|^2\le\tfrac{f(x_n)}{g(x_n)}+c\|x_n-x_{n-1}\|^2(g(xn+1​)f(xn+1​)​+c∥xn+1​−xn​∥2)+α∥xn+1​−xn​∥2≤g(xn​)f(xn​)​+c∥xn​−xn−1​∥2

with the explicit constants (14), and convergence of f(xn)/g(xn)f(x_n)/g(x_n)f(xn​)/g(xn​). 6. Theorem 4.5(ii): (xn)(x_n)(xn​) is bounded, ∥xn+1−xn∥→0\|x_{n+1}-x_n\|\to0∥xn+1​−xn​∥→0, and ∑n∥xn+1−xn∥2<∞\sum_n\|x_{n+1}-x_n\|^2<\infty∑n​∥xn+1​−xn​∥2<∞. 7. The limit inequality at a cluster point (proof of Theorem 4.5(iii), p. 13).

Significance

Theorem 4.5 is the subsequential convergence result on which the paper's later results rest: with a Kurdyka–Łojasiewicz property of a merit function it upgrades to convergence of the whole sequence and to linear rates (Theorem 5.5), and under strict differentiability of ggg lifted stationarity becomes ordinary stationarity (Corollary 4.6). The merit function Fn=f(xn)/g(xn)+c∥xn−xn−1∥2F_n=f(x_n)/g(x_n)+c\|x_n-x_{n-1}\|^2Fn​=f(xn​)/g(xn​)+c∥xn​−xn−1​∥2 with explicit constants is the template for analyzing extrapolated proximal methods on ratio objectives.

The result is proved on paper; no machine-checked version exists. Formalizing it produces a verified descent analysis of an extrapolated proximal method for a nonconvex ratio, a formal subgradient inequality for weakly convex functions with respect to the limiting subdifferential, and a checked passage to the limit through limiting subdifferentials. It also pins down the hypotheses: the formal statement records a missing assumption of the printed theorem (below).

Difficulty

The ratio is not a sum, so the standard sufficient-decrease argument for proximal gradient methods does not apply directly: the subproblem linearizes ggg through a limiting subgradient gng_ngn​ scaled by the current ratio θn\theta_nθn​, and the descent of f/gf/gf/g comes only after dividing by g(xn+1)g(x_{n+1})g(xn+1​), which ties the step size to θn\theta_nθn​ and to bounds on ggg. Extrapolation adds a cross term ⟨xn+1−xn,xn−xn−1⟩\langle x_{n+1}-x_n,x_n-x_{n-1}\rangle⟨xn+1​−xn​,xn​−xn−1​⟩ that the merit function must absorb, which is where the explicit ranges of μˉ,κˉ\bar\mu,\bar\kappaμˉ​,κˉ come from. At a cluster point, fff is only lower semicontinuous, so convergence of f(xkn)f(x_{k_n})f(xkn​​) to f(xˉ)f(\bar x)f(xˉ) must be extracted from the optimality of the subproblems, and the limits of gng_ngn​ must be shown to lie in ∂Lg(xˉ)\partial_L g(\bar x)∂L​g(xˉ). The naive approach of passing to the limit in the subproblem's optimality condition fails because ∂L(fn+ιS)\partial_L(f^{\mathsf n}+\iota_S)∂L​(fn+ιS​) has no sum rule in this generality.

Formalization scope

HHH is EuclideanSpace ℝ (Fin N). Functions into (−∞,+∞](-\infty,+\infty](−∞,+∞] are EReal-valued; properness is the published IsProperFn, and ∂^\widehat\partial∂, ∂L\partial_L∂L​ are the published IsRegularSubgrad and LimitingSubdiff. The denominator ggg is real-valued on all of HHH: only its values and subgradients near SSS enter, where the paper's ggg is finite. Weak convexity "with modulus β\betaβ" means that β≥0\beta\ge0β≥0 is a valid constant, not the smallest one. A run of Algorithm 1 is a predicate on the sequences (xn),(gn),(τn),(κn),(μn)(x_n),(g_n),(\tau_n),(\kappa_n),(\mu_n)(xn​),(gn​),(τn​),(κn​),(μn​); the argmin and gng_ngn​ are selections, never Classical.choose. x−1=x0x_{-1}=x_0x−1​=x0​. Ratios are real numbers (f x).toReal / g x, meaningful because the iterates stay in dom⁡f\operatorname{dom}fdomf. The κˉ\bar\kappaκˉ-range of Step 1 is written as ℓκˉ2<mδ(1−βζ)M−2mμˉmM\ell\bar\kappa^2<\frac{m\delta(1-\sqrt\beta\zeta)}M-\frac{2m\bar\mu}{\sqrt{mM}}ℓκˉ2<Mmδ(1−β​ζ)​−mM​2mμˉ​​, avoiding division by ℓ\ellℓ. lim inf⁡τn>0\liminf\tau_n>0liminfτn​>0 is an eventual positive lower bound, which is equivalent since τn≤1/δ\tau_n\le1/\deltaτn​≤1/δ. Cluster points are MapClusterPt.

Correction. Under the second alternative of Assumption 2 alone, Theorem 4.5(iii) fails: for S=[0,1]S=[0,1]S=[0,1], g(x)=2−xg(x)=2-\sqrt xg(x)=2−x​ on SSS and f(x)=1−x/4f(x)=1-\sqrt x/4f(x)=1−x​/4, the iterates converge to 000, where ∂Lg(0)=∅\partial_Lg(0)=\emptyset∂L​g(0)=∅, so 000 is not lifted stationary. The goal and the limit-inequality milestone therefore assume that ggg is Lipschitz around every point of SSS, which holds automatically under the first alternative.

The trivializing formalizations are ruled out: the parameter ranges are inhabited (checked in Lean, including ℓ=0\ell=0ℓ=0), the goal quantifies over every cluster point of every run, and lifted stationarity requires actual limiting subgradients rather than an infDist that would be 000 on an empty set.

Contributions welcome: the subgradient inequality for weakly convex functions, the descent lemma's use in (16), the limit arguments for limiting subdifferentials (the platform has the robustness property (3) as NonconvexSplitting.ProxGrad.limitingSubdiff_robust), and Fermat's rule for constrained minimizers of φ+ιS\varphi+\iota_Sφ+ιS​ — the last is reusable well beyond this mission.

Selected references

  • R. I. Boţ, M. N. Dao, G. Li, Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs, Math. Oper. Res. 47 (2022); arXiv:2003.04124v2. https://arxiv.org/abs/2003.04124
  • W. Dinkelbach, On nonlinear fractional programming, Management Science 13 (1967) 492–498. https://doi.org/10.1287/mnsc.13.7.492
  • B. S. Mordukhovich, Variational Analysis and Generalized Differentiation I, Springer, 2006. https://doi.org/10.1007/3-540-31247-1
  • Y. Nesterov, Introductory Lectures on Convex Optimization, Springer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
13 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

A Primal-Dual Interior-Point Algorithm for Nonsymmetric Exponential-Cone Optimization 3: The Exponential-Cone Barrier Does Not Have Negative CurvatureResearch Paper

Motivation

Interior-point methods for conic optimization are best understood on symmetric cones: the nonnegative orthant, the second-order cone and the cone of positive semidefinite matrices. On these cones the barrier functions are self-scaled, and Nesterov and Todd showed that every primal-dual pair (x,s)(x, s)(x,s) then has a unique scaling point www with s=F′′(w)xs = F''(w)xs=F′′(w)x and F′(x)=F′′(w)F∗′(s)F'(x) = F''(w)F_*'(s)F′(x)=F′′(w)F∗′​(s). The resulting primal-dual algorithms, implemented in solvers such as SeDuMi and MOSEK, combine long steps with good worst-case complexity.

Many models in statistics, geometric programming, entropy maximization and logistic regression need the exponential cone, which is not symmetric. Dahl and Andersen (Math. Program. 194, 2022) designed the primal-dual algorithm behind MOSEK's exponential-cone support. To explain why they cannot simply transplant the Nesterov–Todd construction, they use a property that sits between "self-scaled" and "arbitrary": negative curvature of the barrier. Barriers of symmetric cones have it; a barrier is self-scaled if and only if both it and its conjugate have it (Nesterov–Tunçel, 2016); and barriers with negative curvature still admit a unique scaling point satisfying one secant equation. Dahl and Andersen observe in §5 that the exponential-cone barrier lies outside this class, by an explicit witness. This mission formalizes that observation and the derivative formulas of their Appendix A it rests on.

Timeline:

  • 1997–1998: Nesterov and Todd introduce self-scaled barriers and their primal-dual scalings (Math. Oper. Res. 22; SIAM J. Optim. 8).
  • 2001: Tunçel generalizes primal-dual scalings to arbitrary convex cones (Found. Comput. Math. 1).
  • 2009: Chares studies the exponential cone and its 3-self-concordant barrier (thesis, Université catholique de Louvain).
  • 2016: Nesterov and Tunçel characterize self-scaled barriers through negative curvature of the barrier and its conjugate.
  • 2022: Dahl and Andersen give a primal-dual algorithm for the exponential cone with Tunçel-type scalings, and note that its barrier does not have negative curvature.

Setting

Points of R3\mathbb{R}^3R3 are written x=(x1,x2,x3)x = (x_1, x_2, x_3)x=(x1​,x2​,x3​). The exponential cone is the closure

Kexp⁡=cl⁡{x∈R3∣x1≥x2exp⁡(x3/x2), x2>0},K_{\exp} = \operatorname{cl}\{x \in \mathbb{R}^3 \mid x_1 \ge x_2 \exp(x_3/x_2),\ x_2 > 0\},Kexp​=cl{x∈R3∣x1​≥x2​exp(x3​/x2​), x2​>0},

whose interior is {x∣x2>0, x1>x2exp⁡(x3/x2)}\{x \mid x_2 > 0,\ x_1 > x_2\exp(x_3/x_2)\}{x∣x2​>0, x1​>x2​exp(x3​/x2​)}. Its standard barrier is

F(x)=−log⁡(x2log⁡(x1/x2)−x3)−log⁡x1−log⁡x2,(2)F(x) = -\log\bigl(x_2\log(x_1/x_2) - x_3\bigr) - \log x_1 - \log x_2, \qquad (2)F(x)=−log(x2​log(x1​/x2​)−x3​)−logx1​−logx2​,(2)

defined and smooth on int⁡(Kexp⁡)\operatorname{int}(K_{\exp})int(Kexp​). Appendix A of the paper writes F=g+hF = g + hF=g+h with

ψ(x)=x2log⁡(x1/x2)−x3,g(x)=−log⁡ψ(x),h(x)=−log⁡x1−log⁡x2.\psi(x) = x_2\log(x_1/x_2) - x_3,\qquad g(x) = -\log\psi(x),\qquad h(x) = -\log x_1 - \log x_2 .ψ(x)=x2​log(x1​/x2​)−x3​,g(x)=−logψ(x),h(x)=−logx1​−logx2​.

For a smooth FFF on an open set, F′′(x)F''(x)F′′(x) is its Hessian, a symmetric linear map of Rn\mathbb{R}^nRn, and the third directional derivative is the symmetric linear map

F′′′(x)[u]=ddtF′′(x+tu)∣t=0,F′′′(x)[u,v,v]=⟨F′′′(x)[u] v,v⟩.F'''(x)[u] = \frac{d}{dt}F''(x + tu)\Big|_{t=0}, \qquad F'''(x)[u, v, v] = \langle F'''(x)[u]\,v, v\rangle .F′′′(x)[u]=dtd​F′′(x+tu)​t=0​,F′′′(x)[u,v,v]=⟨F′′′(x)[u]v,v⟩.

A barrier FFF of a cone KKK has negative curvature if for all x∈int⁡(K)x \in \operatorname{int}(K)x∈int(K) and for u∈Ku \in Ku∈K

F′′′(x)[u]⪯0,F'''(x)[u] \preceq 0,F′′′(x)[u]⪯0,

where ⪯\preceq⪯ is the Loewner order: ⟨F′′′(x)[u] v,v⟩≤0\langle F'''(x)[u]\,v, v\rangle \le 0⟨F′′′(x)[u]v,v⟩≤0 for every vvv. The direction uuu ranges over the closed cone KKK, including its boundary.

Formalization targets

Goal: the exponential-cone barrier does not have negative curvature

¬(∀x∈int⁡(Kexp⁡), ∀u∈Kexp⁡, ∀v∈R3: ⟨F′′′(x)[u] v,v⟩≤0).\neg\Bigl(\forall x \in \operatorname{int}(K_{\exp}),\ \forall u \in K_{\exp},\ \forall v \in \mathbb{R}^3:\ \langle F'''(x)[u]\,v, v\rangle \le 0\Bigr).¬(∀x∈int(Kexp​), ∀u∈Kexp​, ∀v∈R3: ⟨F′′′(x)[u]v,v⟩≤0).

The goal asserts only the qualitative failure, so it does not depend on the particular witness.

Milestones

  1. The witness: x^:=(1,e−2,0)∈int⁡(Kexp⁡)\hat x := (1, e^{-2}, 0) \in \operatorname{int}(K_{\exp})x^:=(1,e−2,0)∈int(Kexp​) and u^:=(1,0,0)∈Kexp⁡∖int⁡(Kexp⁡)\hat u := (1, 0, 0) \in K_{\exp}\setminus\operatorname{int}(K_{\exp})u^:=(1,0,0)∈Kexp​∖int(Kexp​) (§5, p. 356).
  2. First-order derivatives (A.1, p. 367): ψ′(x)=(x2/x1, log⁡(x1/x2)−1, −1)\psi'(x) = (x_2/x_1,\ \log(x_1/x_2) - 1,\ -1)ψ′(x)=(x2​/x1​, log(x1​/x2​)−1, −1), h′(x)=−(1/x1,1/x2,0)h'(x) = -(1/x_1, 1/x_2, 0)h′(x)=−(1/x1​,1/x2​,0), g′(x)=−ψ′(x)/ψ(x)g'(x) = -\psi'(x)/\psi(x)g′(x)=−ψ′(x)/ψ(x), F′=g′+h′F' = g' + h'F′=g′+h′ on int⁡(Kexp⁡)\operatorname{int}(K_{\exp})int(Kexp​).
  3. Second-order derivatives (A.2, p. 367):
F′′(x)=−1ψ(x)(ψ′′(x)−ψ′(x)ψ′(x)Tψ(x))+h′′(x).F''(x) = -\frac{1}{\psi(x)}\Bigl(\psi''(x) - \frac{\psi'(x)\psi'(x)^T}{\psi(x)}\Bigr) + h''(x).F′′(x)=−ψ(x)1​(ψ′′(x)−ψ(x)ψ′(x)ψ′(x)T​)+h′′(x).
  1. Third-order directional derivatives (A.3 and (33), p. 368): the closed form of F′′′(x)[u]F'''(x)[u]F′′′(x)[u] in terms of ψ\psiψ, its derivatives and h′′′(x)[u]h'''(x)[u]h′′′(x)[u].
  2. The matrix at the witness (§5, p. 356):
F′′′(x^)[u^]=[−4e2/2e2/2e2/200e2/20−e4/4].F'''(\hat x)[\hat u] = \begin{bmatrix} -4 & e^2/2 & e^2/2 \\ e^2/2 & 0 & 0 \\ e^2/2 & 0 & -e^4/4 \end{bmatrix}.F′′′(x^)[u^]=​−4e2/2e2/2​e2/200​e2/20−e4/4​​.
  1. The positive value (§5, p. 356): F′′′(x^)[u^,v^,v^]=4F'''(\hat x)[\hat u, \hat v, \hat v] = 4F′′′(x^)[u^,v^,v^]=4 for v^:=(1,8e−2,4e−2)\hat v := (1, 8e^{-2}, 4e^{-2})v^:=(1,8e−2,4e−2).

Significance

The result. Negative curvature is the property that gives symmetric-cone barriers their long-step Hessian estimates and a unique scaling point with one secant equation. Its failure for the exponential-cone barrier means that none of these consequences can be invoked for the exponential cone. An algorithm for this cone has to obtain its scalings by other means; Dahl and Andersen take them from Tunçel's framework, via the quasi-Newton secant updates of §5. The witness also shows that the failure occurs already for a direction on the boundary of the cone, at an interior point with simple coordinates.

Formalizing it. The claim is proved in the paper by a computation "using the expressions in the appendix", with the details left to the reader. The appendix formulas for the gradient, Hessian and third directional derivative of the exponential-cone barrier are the ones an implementation evaluates, including the higher-order corrector term −12F′′′(x)[u,v]-\tfrac12F'''(x)[u, v]−21​F′′′(x)[u,v]. A machine-checked version certifies these closed forms, including the zero padding of the 2×22\times22×2 "leading parts" in (33), and gives a reusable definition of negative curvature that applies to any cone and barrier. As far as is known, none of these statements has a machine-checked proof.

Difficulty

The obstacle is computational, not conceptual. The barrier is a composition of logarithms with a function ψ\psiψ that is itself a perspective of the logarithm, so its third derivative is a sum of terms with denominators ψ(x)k\psi(x)^kψ(x)k, x1kx_1^kx1k​ and x2kx_2^kx2k​. Stating it as a derivative of the Hessian map requires showing that the Hessian is differentiable on the open interior, which in turn requires a description of that interior, a set defined as the interior of a closure. The membership claims about u^\hat uu^ are not definitional either: u^\hat uu^ lies on the boundary, reached only as a limit of points of the generating set, and its non-interiority needs a neighbourhood argument. Finally, the cone condition on uuu matters: replacing u∈Kexp⁡u \in K_{\exp}u∈Kexp​ by u∈R3u \in \mathbb{R}^3u∈R3 makes the claim nearly trivial, because F′′′(x)[−u]=−F′′′(x)[u]F'''(x)[-u] = -F'''(x)[u]F′′′(x)[−u]=−F′′′(x)[u].

Formalization scope

  • Points of R3\mathbb{R}^3R3 are EuclideanSpace ℝ (Fin 3); the paper's (x1,x2,x3)(x_1, x_2, x_3)(x1​,x2​,x3​) are (x 0, x 1, x 2), and vectors are written !₂[·, ·, ·].
  • Kexp⁡K_{\exp}Kexp​ is the closure of the printed set, not its interior or an equivalent description. FFF, ψ\psiψ, ggg, hhh are defined on all of R3\mathbb{R}^3R3 by their formulas with Real.log; every statement evaluates them, and their derivatives, only at points of int⁡(Kexp⁡)\operatorname{int}(K_{\exp})int(Kexp​), where all logarithms are the genuine ones. The appendix formulas carry the hypothesis x∈int⁡(Kexp⁡)x \in \operatorname{int}(K_{\exp})x∈int(Kexp​).
  • F′′F''F′′ is the published SelfScaledIPM.ShortStep.hess (derivative of the gradient), and F′′′(x)[u]F'''(x)[u]F′′′(x)[u] is fderiv ℝ (hess F) x u. The Loewner order is stated through the quadratic form for every vvv. Matrices act through the standard basis (Matrix.toEuclideanCLM).
  • Disclosed deviations from the page: milestone 1 asserts x^∈int⁡(Kexp⁡)\hat x \in \operatorname{int}(K_{\exp})x^∈int(Kexp​), stronger than the printed x^∈Kexp⁡\hat x \in K_{\exp}x^∈Kexp​ and the form the definition needs. In A.3 the 2×22\times22×2 leading parts h^′′′\hat h'''h^′′′, ψ^′′′\hat\psi'''ψ^​′′′ of (33) are padded with a zero third row and column, and g′′(x)g''(x)g′′(x) is written out by the A.2 formula. Only the first display of A.2 is stated, not the factorization F′′(x)=R(x)R(x)TF''(x) = R(x)R(x)^TF′′(x)=R(x)R(x)T.
  • A trivializing formalization would let uuu range over all of R3\mathbb{R}^3R3, or read ⪯0\preceq 0⪯0 entrywise; both are excluded, and uuu ranges over the closed cone exactly as in the paper.
  • The claim that FFF is a 3-self-concordant barrier (quoted from Chares) is not part of the mission. The definition of negative curvature applies to any cone in any dimension and can be reused for other barriers. Contributions of calculus lemmas for logarithmic barriers on open sets (differentiability of the Hessian map, interiors of closures of epigraph-type sets) are welcome.

Selected references

  • J. Dahl, E. D. Andersen, A primal-dual interior-point algorithm for nonsymmetric exponential-cone optimization, Mathematical Programming 194 (2022), 341–370. https://doi.org/10.1007/s10107-021-01631-4
  • Yu. Nesterov, M. J. Todd, Self-scaled barriers and interior-point methods for convex programming, Mathematics of Operations Research 22 (1997), 1–42. https://doi.org/10.1287/moor.22.1.1
  • Yu. Nesterov, M. J. Todd, Primal-dual interior-point methods for self-scaled cones, SIAM Journal on Optimization 8 (1998), 324–364. https://doi.org/10.1137/S1052623495290209
  • L. Tunçel, Generalization of primal-dual interior-point methods to convex optimization problems in conic form, Foundations of Computational Mathematics 1 (2001), 229–254. https://doi.org/10.1007/s102080010008
  • Yu. Nesterov, L. Tunçel, Local superlinear convergence of polynomial-time interior-point methods for hyperbolicity cone optimization problems, SIAM Journal on Optimization 26 (2016), 139–170. https://doi.org/10.1137/140978296
  • P. R. Chares, Cones and interior-point algorithms for structured convex optimization involving powers and exponentials, PhD thesis, Université catholique de Louvain, 2009.
10 thms3 active usersReviewed
Linear algebraProbabilityRandom Matrix Theory·Captain: mikedeng1

User-Friendly Tail Bounds for Sums of Random Matrices V: The Matrix Azuma Inequality for Adapted Sequences with Semidefinite Bounds on the Squared DifferencesResearch Paper

Motivation

Sums of random matrices appear throughout numerical linear algebra, statistics, combinatorics and quantum information: randomized sketching and sparsification, covariance estimation, graph sparsifiers, and the analysis of random features all reduce to controlling the largest eigenvalue of a sum of random self-adjoint matrices. Scalar concentration inequalities (Chernoff, Hoeffding, Bernstein, Azuma) have matrix analogues, and J. A. Tropp's User-Friendly Tail Bounds for Sums of Random Matrices (arXiv:1004.4389v7, Found. Comput. Math. 12 (2012) 389–434, doi:10.1007/s10208-011-9099-z) gives a unified derivation of them with explicit constants.

Many applications do not have independent summands: adaptive algorithms, online learning and sequential estimation produce sums whose terms depend on the past. The scalar tool for such sums is Azuma's inequality for martingales with bounded differences, and its corollary, McDiarmid's bounded differences inequality (McDiarmid 1998). This mission is the fifth of a series formalizing Tropp's paper; it targets §7, the matrix Azuma inequality.

Timeline. Ahlswede and Winter (2002) introduced a matrix analogue of the Laplace transform bound for independent sums; Oliveira (2010) gave the variant used in this paper. Tropp (this paper, 2010–2012) proved the matrix Azuma and McDiarmid inequalities below. More refined matrix martingale inequalities appear in Oliveira (2010) and in Tropp's Freedman's inequality for matrix martingales (2011), which the paper cites (p. 27) as requiring additional machinery.

Setting

All matrices are d×dd\times dd×d with complex entries, d≥1d\ge 1d≥1. A matrix is self-adjoint (s.a.) when it is Hermitian. For s.a. AAA, λmax⁡(A)\lambda_{\max}(A)λmax​(A) is its largest eigenvalue and ∥A∥\|A\|∥A∥ its spectral norm. Functions of s.a. matrices are defined spectrally: if A=QΛQ∗A=Q\Lambda Q^*A=QΛQ∗ then eA=QeΛQ∗e^{A}=Qe^{\Lambda}Q^*eA=QeΛQ∗, and log⁡\loglog is defined the same way on positive-definite matrices. A⪯BA\preceq BA⪯B is the semidefinite order: B−AB-AB−A is positive semidefinite.

Let (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) be a probability space with a filtration F0⊂F1⊂⋯⊂F\mathcal F_0\subset\mathcal F_1\subset\cdots\subset\mathcal FF0​⊂F1​⊂⋯⊂F, and write Ek[ ⋅ ]=E[ ⋅∣Fk]\mathbb E_k[\,\cdot\,]=\mathbb E[\,\cdot\mid\mathcal F_k]Ek​[⋅]=E[⋅∣Fk​]. The expectation and the conditional expectation of a random matrix are taken entrywise. A sequence X1,…,XnX_1,\dots,X_nX1​,…,Xn​ of random matrices is adapted when each XkX_kXk​ is Fk\mathcal F_kFk​-measurable. A matrix martingale is an adapted sequence of s.a. matrices YkY_kYk​ with E∥Yk∥<∞\mathbb E\|Y_k\|<\inftyE∥Yk​∥<∞ and Ek−1Yk=Yk−1\mathbb E_{k-1}Y_k=Y_{k-1}Ek−1​Yk​=Yk−1​; its difference sequence Xk=Yk−Yk−1X_k=Y_k-Y_{k-1}Xk​=Yk​−Yk−1​ satisfies Ek−1Xk=0\mathbb E_{k-1}X_k=0Ek−1​Xk​=0.

The hypotheses of the main theorem are: X1,…,XnX_1,\dots,X_nX1​,…,Xn​ is an adapted sequence of random s.a. matrices, and A1,…,AnA_1,\dots,A_nA1​,…,An​ is a fixed (non-random) sequence of s.a. matrices, with

Ek−1Xk=0andXk2⪯Ak2  almost surely.\mathbb E_{k-1}X_k = 0 \qquad\text{and}\qquad X_k^2\preceq A_k^2\ \text{ almost surely.}Ek−1​Xk​=0andXk2​⪯Ak2​  almost surely.

The variance parameter is σ2:=∥∑kAk2∥\sigma^2 := \big\|\sum_k A_k^2\big\|σ2:=​∑k​Ak2​​.

Formalization targets

Goal: Theorem 7.1 (Matrix Azuma), p. 27

For all t≥0t\ge 0t≥0,

P{λmax⁡(∑kXk)≥t}≤d⋅e−t2/8σ2.\mathbb P\Big\{\lambda_{\max}\Big(\sum_{k}X_k\Big)\ge t\Big\}\le d\cdot e^{-t^2/8\sigma^2}.P{λmax​(k∑​Xk​)≥t}≤d⋅e−t2/8σ2.

Milestones

In the order they are used:

  1. Display (2.6), Golden–Thompson: tr⁡eA+H≤tr⁡(eAeH)\operatorname{tr}e^{A+H}\le\operatorname{tr}(e^Ae^H)treA+H≤tr(eAeH) for s.a. A,HA,HA,H.
  2. Proposition 3.1, the Laplace transform method: P{λmax⁡(Y)≥t}≤inf⁡θ>0e−θt Etr⁡eθY\mathbb P\{\lambda_{\max}(Y)\ge t\}\le\inf_{\theta>0}e^{-\theta t}\,\mathbb E\operatorname{tr}e^{\theta Y}P{λmax​(Y)≥t}≤infθ>0​e−θtEtreθY.
  3. Corollary 3.3: Etr⁡exp⁡(H+X)≤tr⁡exp⁡(H+log⁡EeX)\mathbb E\operatorname{tr}\exp(H+X)\le\operatorname{tr}\exp(H+\log\mathbb E e^{X})Etrexp(H+X)≤trexp(H+logEeX).
  4. Lemma 4.3, Rademacher half: EeεθA⪯eθ2A2/2\mathbb E e^{\varepsilon\theta A}\preceq e^{\theta^2A^2/2}EeεθA⪯eθ2A2/2.
  5. Lemma 7.6 (Symmetrization): Etr⁡eH+X≤Etr⁡eH+2εX\mathbb E\operatorname{tr}e^{H+X}\le\mathbb E\operatorname{tr}e^{H+2\varepsilon X}EtreH+X≤EtreH+2εX when EX=0\mathbb EX=0EX=0 and ε\varepsilonε is an independent Rademacher variable.
  6. Lemma 7.7 (Azuma cgf): log⁡E[e2εθX∣X]⪯2θ2A2\log\mathbb E[e^{2\varepsilon\theta X}\mid X]\preceq2\theta^2A^2logE[e2εθX∣X]⪯2θ2A2 when X2⪯A2X^2\preceq A^2X2⪯A2.
  7. Display (7.5): Etr⁡exp⁡(∑kθXk)≤tr⁡exp⁡(2θ2∑kAk2)\mathbb E\operatorname{tr}\exp(\sum_k\theta X_k)\le\operatorname{tr}\exp(2\theta^2\sum_kA_k^2)Etrexp(∑k​θXk​)≤trexp(2θ2∑k​Ak2​) under the hypotheses of the goal.

Further statements

Corollary 7.2 is the martingale form, P{λmax⁡(Yn−EYn)≥t}≤d e−t2/8σ2\mathbb P\{\lambda_{\max}(Y_n-\mathbb EY_n)\ge t\}\le d\,e^{-t^2/8\sigma^2}P{λmax​(Yn​−EYn​)≥t}≤de−t2/8σ2. Corollary 7.5 (Matrix Bounded Differences) is the matrix McDiarmid inequality, P{λmax⁡(H(z)−EH(z))≥t}≤d e−t2/8σ2\mathbb P\{\lambda_{\max}(H(z)-\mathbb EH(z))\ge t\}\le d\,e^{-t^2/8\sigma^2}P{λmax​(H(z)−EH(z))≥t}≤de−t2/8σ2 for a matrix-valued function HHH of independent variables whose changes in one coordinate kkk have squares bounded by Ak2A_k^2Ak2​.

Significance

The result. The bound has the scalar subgaussian shape with two matrix features: a dimensional factor ddd, and a variance parameter equal to the norm of the sum ∑kAk2\sum_kA_k^2∑k​Ak2​ rather than the sum of the norms ∑k∥Ak∥2\sum_k\|A_k\|^2∑k​∥Ak​∥2. In the commuting case the two coincide; in general the first can be smaller by a factor of up to nnn. The theorem needs no independence, so it covers adapted constructions such as Doob martingales. Corollary 7.5, obtained from it, is the standard matrix tool for concentration of matrix-valued functions of independent data. With independent summands the theorem gives a matrix Hoeffding inequality (Theorem 1.3 of the paper).

Formalizing it. The result is proved in the paper; none of it is formalized. Mathlib has the continuous functional calculus, conditional expectation and filtrations, but no Golden–Thompson inequality, no Lieb concavity theorem, and no matrix tail inequality. A formalization produces a machine-checked matrix Azuma inequality, the Golden–Thompson inequality, and a symmetrization lemma for the trace exponential, all of which have uses beyond this paper.

Difficulty

The scalar proof of Azuma's inequality multiplies conditional moment generating functions, Eeθ∑Xk=E[eθ∑k<nXk En−1eθXn]\mathbb E e^{\theta\sum X_k}=\mathbb E\big[e^{\theta\sum_{k<n}X_k}\,\mathbb E_{n-1}e^{\theta X_n}\big]Eeθ∑Xk​=E[eθ∑k<n​Xk​En−1​eθXn​], and bounds each factor. For matrices this fails: eA+B≠eAeBe^{A+B}\neq e^Ae^BeA+B=eAeB unless AAA and BBB commute, and tr⁡eA+B+C≤tr⁡(eAeBeC)\operatorname{tr}e^{A+B+C}\le\operatorname{tr}(e^Ae^Be^C)treA+B+C≤tr(eAeBeC) is false, so the Golden–Thompson inequality cannot be iterated over nnn terms. The paper itself notes (p. 28) that the classical approach does not seem to extend. A second obstacle is that the hypothesis Xk2⪯Ak2X_k^2\preceq A_k^2Xk2​⪯Ak2​ bounds squares, not the matrices themselves; it does not give Xk⪯AkX_k\preceq A_kXk​⪯Ak​, so the scalar Hoeffding lemma for bounded centred variables has no direct matrix analogue. The infrastructure is also heavy: Lieb's concavity theorem underlies Corollary 3.3, and operator monotonicity of the logarithm is needed.

Formalization scope

Matrices are Matrix (Fin d) (Fin d) ℂ, self-adjointness is IsHermitian, and ⪯\preceq⪯ is Mathlib's order under MatrixOrder. Matrix exponential and logarithm are cfc Real.exp and cfc Real.log. λmax⁡\lambda_{\max}λmax​ is the supremum of the real spectrum, which is why d≥1d\ge1d≥1 is assumed (NeZero d). Expectation and conditional expectation of matrices are entrywise Bochner integrals; adaptedness is entrywise strong measurability with respect to a Mathlib Filtration ℕ. The summands are indexed by k=1,…,nk=1,\dots,nk=1,…,n, so Fk−1\mathcal F_{k-1}Fk−1​ is never truncated. The bound Xk2⪯Ak2X_k^2\preceq A_k^2Xk2​⪯Ak2​ is required almost surely. The bounds AkA_kAk​ are deterministic matrices. The infimum over θ>0\theta>0θ>0 in Proposition 3.1 is posed as the bound for each θ>0\theta>0θ>0 at which the expectation is finite.

The hypotheses must not be made vacuous. Integrability of each XkX_kXk​ is assumed explicitly, because for a non-integrable variable Lean's conditional expectation is 000 and the centring hypothesis would say nothing. The XkX_kXk​ are not assumed independent: an independence hypothesis would turn the goal into the weaker matrix Hoeffding inequality.

Two readings are recorded in the statements. In Lemma 7.7 the conditional expectation given XXX is replaced by the expectation over ε\varepsilonε at each fixed value xxx with x2⪯A2x^2\preceq A^2x2⪯A2; by independence these agree. Corollary 7.2 adds the hypothesis that Y0Y_0Y0​ is almost surely constant, without which Yn−EYn≠∑kXkY_n-\mathbb EY_n\neq\sum_kX_kYn​−EYn​=∑k​Xk​.

A complete development needs: Golden–Thompson; Lieb's concavity theorem (or Corollary 3.3 directly); operator monotonicity of the matrix logarithm; monotonicity of the trace exponential; conditional expectation of matrix-valued variables and its interaction with the semidefinite order. All of these are reusable well beyond this mission, and contributions of any of them are welcome. Proposition 3.1, Corollary 3.3 and Lemma 4.3 are also milestones of other missions in this series.

Selected references

  • J. A. Tropp, User-Friendly Tail Bounds for Sums of Random Matrices, Found. Comput. Math. 12 (2012) 389–434; cited version arXiv:1004.4389v7 (2011). https://arxiv.org/abs/1004.4389v7
  • R. Ahlswede and A. Winter, Strong converse for identification via quantum channels, IEEE Trans. Inform. Theory 48 (2002) 569–579. https://doi.org/10.1109/18.985947
  • R. I. Oliveira, Sums of random Hermitian matrices and an inequality by Rudelson, Electron. Commun. Probab. 15 (2010) 203–212. https://arxiv.org/abs/1004.3821
  • J. A. Tropp, Freedman's inequality for matrix martingales, Electron. Commun. Probab. 16 (2011) 262–270. https://arxiv.org/abs/1101.3039
  • R. I. Oliveira, Concentration of the adjacency matrix and of the Laplacian in random graphs with independent edges, arXiv:0911.0600 (2010). https://arxiv.org/abs/0911.0600
  • C. McDiarmid, Concentration, in Probabilistic Methods for Algorithmic Discrete Mathematics, Springer (1998) 195–248. https://doi.org/10.1007/978-3-662-12788-9_6
  • R. Bhatia, Matrix Analysis, Springer GTM 169 (1997), Sec. IX.3. https://doi.org/10.1007/978-1-4612-0653-8
  • E. H. Lieb, Convex trace functions and the Wigner–Yanase–Dyson conjecture, Adv. Math. 11 (1973) 267–288. https://doi.org/10.1016/0001-8708(73)90011-X
10 thms3 active usersReviewed
🏆Completed
Optimal Transport·Captain: marwahaha

A counterexample to the Monge ansatz for the three-marginal Coulomb costOpen Problem

Motivation

An optimal coupling can exist even when no deterministic transport maps attain its cost. The target separates attainment from equality of infima for a three-marginal repulsive cost. The pinned manuscript supplies the research context.

Setting

All three marginals are the same smooth compactly supported probability density in real three-space, with smooth compactly supported square root. Coincident points have infinite Coulomb cost.

Formalization target

The selected goal is OAI.Problem356.coulomb_counterexample_and_equal_infima. Its central assertion is

inf⁡T2,T3∫c(x,T2x,T3x) dμ=min⁡π∈Π(μ,μ,μ)∫c dπ.\inf_{T_2,T_3}\int c(x,T_2x,T_3x)\,d\mu=\min_{\pi\in\Pi(\mu,\mu,\mu)}\int c\,d\pi.T2​,T3​inf​∫c(x,T2​x,T3​x)dμ=π∈Π(μ,μ,μ)min​∫cdπ.

The theorem states, without a proof being verified here, that there exists a function ρ on three-dimensional Euclidean space ℝ³ satisfying a full Coulomb conclusion. This means ρ is a nonnegative C^∞ function with compact support, whose square root is also C^∞ with compact support, and with integral 1 over ℝ³; its density measure μ (Lebesgue measure weighted by ρ) is a probability measure. Consider three-marginal couplings of μ, namely probability measures on triples (x,y,z) of points of ℝ³ all of whose three coordinate marginals equal μ, with cost 1/|x−y| + 1/|x−z| + 1/|y−z| valued in [0,∞] (the inverse of distance zero is ∞). The Kantorovich value of μ is the infimum of the expected cost over all such couplings, and the theorem asserts it is finite and attained by some coupling. Further, no pair of measurable maps T₂,T₃ each preserving μ (pushing μ forward to itself) is a Monge optimizer: for every such pair, the expected cost of the triple (x,T₂x,T₃x) under μ is strictly larger than the Kantorovich value. Nevertheless, the Monge value, the infimum of this graph cost over all such pairs of μ-preserving maps, equals the Kantorovich value, and for every ε>0 there are μ-preserving maps T₂,T₃ with finite graph cost at most the Kantorovich value plus ε.

Significance and status

The goal includes a finite attained Kantorovich value, no Monge minimizer, equal infima and arbitrarily accurate finite-cost maps. Other dimensions and Riesz exponents are not part of this selected target. The target is currently Open on Prove2Me. The manuscript's mathematical argument and a machine-checked proof of the selected statement are separate deliverables.

Difficulty

Every measure-preserving pair of maps must be strictly suboptimal, while a sequence of such pairs still approaches the coupling minimum.

Formalization scope

The exact published goal, its hypotheses and its referenced definition blocks specify the requested formalization. The explanatory formula above is a summary; all quantifiers and additional clauses in the linked statement remain required.

The available published material supplies this goal and its necessary definitions. Additional manuscript lemmas are not represented as attached milestones.

Selected references

  • OpenAI, A counterexample to the Monge ansatz for the three-marginal Coulomb cost, preprint, 2026. Manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Selected goal source.
36 thms3 active usersReviewed
🏆Completed
Theoretical Computer Science·Captain: marwahaha

Tree Constructions for the l1 Distortion of Binary Edit DistanceOpen Problem

Motivation

Embedding edit distance into ℓ₁ would permit algorithms and geometric tools for that normed space. Distortion lower bounds quantify the loss any such representation must incur. The source manuscript presents the surrounding research claim.

Setting

Edit distance is the least number of unit insertions, deletions and substitutions, with unrestricted intermediate word lengths. For a finite equal-length binary set W, c₁(W) is the infimum over all injective maps into the full real sequence space ℓ₁ of the product of the two worst distance ratios.

Formalization target

Find an absolute c>0 and d₀ such that for every d≥d₀ there are 1≤n≤d and at least two binary words of length n with

c1(W)≥exp⁡ ⁣(clog⁡d log⁡log⁡d).c_1(W)\ge\exp\!\left(c\sqrt{\log d\,\log\log d}\right).c1​(W)≥exp(clogdloglogd​).

The selected formal target is OAI.TreeEdit.binary_lower_bound.

Significance and status

The witness exists for every sufficiently large length cap. The target bounds distortion against every injective ℓ₁ embedding, not only a particular algorithm. The published target is currently Open; the manuscript's argument and a checked Lean proof are separate deliverables.

Difficulty

A bad map is not a lower bound for the infimum over all maps. The finite family must force distortion uniformly while preserving its common binary word length.

Formalization scope

The chosen target uses Word Bool n and Finset witnesses. A companion binary_torus formulation is retained as a reference to the same lower-bound endpoint. Its independent source group repeats edit-distance declarations and is not combined into one import. No companion upper embedding theorem is attached.

Selected references

  • OpenAI, Tree Constructions for the l1 Distortion of Binary Edit Distance, preprint, 2026. Pinned manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Goal source.
70 thms3 active usersReviewed
🏆Completed
Functional Analysis·Captain: wurtle

Fixed Points of Nonexpansive Maps in Reflexive Banach SpacesResearch Paper

Motivation: the fixed point property in reflexive spaces

A map FFF is nonexpansive if ∥F(a)−F(b)∥≤∥a−b∥\|F(a)-F(b)\|\le\|a-b\|∥F(a)−F(b)∥≤∥a−b∥. Unlike strict contractions, nonexpansive maps need not have fixed points: on a bounded set, existence depends on the geometry of the norm. A Banach space has the fixed point property (FPP) if every nonexpansive self-map of every nonempty closed bounded convex subset has a fixed point. Since the mid-1960s, whether every reflexive Banach space has the FPP in its given norm has been one of the central open questions of metric fixed point theory. Many sufficient geometric conditions are known, but none of them covers all reflexive spaces. In fixed point theory, the question has been listed as unresolved as recently as 2026 (Nourouzi 2026).

Timeline

  • 1965 — Browder and Göhde prove the FPP for uniformly convex spaces (Browder 1965; Göhde 1965). Kirk proves it for weakly compact convex sets with normal structure, in particular for closed bounded convex sets with normal structure in reflexive spaces (Kirk 1965).
  • 1974–1975 — Bruck's common fixed point theorems for commuting families and compact convex semigroups (Bruck 1974; Bruck 1975).
  • 1975–1976 — The Goebel–Karlovitz lemma on approximate fixed point sequences in minimal invariant sets (Goebel 1975; Karlovitz 1976). Karlovitz also shows that a norm on ℓ2\ell_2ℓ2​ without normal structure still has the FPP, so normal structure is not necessary.
  • 1981 — Alspach constructs a weakly compact convex subset of L1[0,1]L_1[0,1]L1​[0,1] with a fixed-point-free nonexpansive self-map, so weak compactness alone is insufficient in general Banach spaces (Alspach 1981). Maurey proves the FPP for reflexive subspaces of L1L^1L1 (Maurey 1981).
  • 1985 — Lin proves the weak FPP for spaces with a 111-unconditional basis (Lin 1985).
  • 2006 — García-Falset, Llorens-Fuster and Mazcuñán-Navarro prove the FPP for uniformly nonsquare spaces (JFA 2006); another proof is due to Dowling, Randrianantoanina and Turett (JFA 2008).
  • 2009 — Domínguez Benavides shows that every reflexive space admits an equivalent norm with the FPP (JMAA 2009). Changing the norm changes which maps are nonexpansive, so this does not settle the question for the original norm.
  • 2019, 2021 — Hanebaly proposes proofs of the original-norm assertion (JP J. Fixed Point Theory Appl. 2019; preprint 2021). Later literature, such as Nourouzi (2026), still treats the question as unresolved.
  • 2026 — An OpenAI preprint, Fixed Points of Nonexpansive Maps in Reflexive Banach Spaces (OpenAI Math Release, September 24, 2026), claims a proof for every real reflexive Banach space. It has not been peer reviewed, and the claim has not been formally verified.

Setting

Let XXX be a real Banach space and X∗∗X^{**}X∗∗ its continuous bidual. The canonical map J:X→X∗∗J:X\to X^{**}J:X→X∗∗, J(x)(φ)=φ(x)J(x)(\varphi)=\varphi(x)J(x)(φ)=φ(x), is always a linear isometry, and XXX is reflexive if JJJ is surjective. A subset C⊆XC\subseteq XC⊆X is taken nonempty, closed in the norm topology, bounded and convex. A map F:C→CF:C\to CF:C→C is nonexpansive in the given norm of XXX, and a fixed point is a point a∈Ca\in Ca∈C with F(a)=aF(a)=aF(a)=a.

In Lean, reflexivity is the definition CanonicallyReflexive X, which says that NormedSpace.inclusionInDoubleDual ℝ X is surjective.

Formalization targets

Goal: reflexive spaces have the fixed point property (Theorem 1.1)

X real reflexive Banach, C⊆X nonempty, closed, bounded, convex, ∥F(a)−F(b)∥≤∥a−b∥  ∀a,b∈C ⟹ ∃ a∈C: F(a)=a.X \text{ real reflexive Banach},\ C\subseteq X \text{ nonempty, closed, bounded, convex},\ \|F(a)-F(b)\|\le\|a-b\|\ \ \forall a,b\in C \ \Longrightarrow\ \exists\, a\in C:\ F(a)=a.X real reflexive Banach, C⊆X nonempty, closed, bounded, convex, ∥F(a)−F(b)∥≤∥a−b∥  ∀a,b∈C ⟹ ∃a∈C: F(a)=a.

This is exactly Theorem 1.1 of the source. The goal is published on the platform with status Open: no machine-checked proof exists yet.

Significance

The result itself. The theorem answers the reflexive-space fixed point problem for the given norm, with no extra geometric assumption (uniform convexity, normal structure, unconditional bases, uniform nonsquareness). With Bruck's 1974 theorem it gives the source's Corollary 1.2: for every commuting family of nonexpansive self-maps of CCC, the common fixed point set is nonempty and is a nonexpansive retract of CCC. Alspach's example shows that reflexivity cannot be weakened to weak compactness of CCC in an arbitrary Banach space.

Formalizing it. Earlier proposed proofs of the same assertion exist, and the literature has not reached a consensus, so a machine-checked proof would give unusual certainty on a disputed question. The proof relies on the minimal invariant set reduction (Zorn's lemma and weak compactness), the Goebel–Karlovitz lemma, compact semigroups of nonexpansive maps (an Ellis-type idempotent), and a tree construction with weighted telescoping estimates. Mathlib has the bidual, the weak topology, and Banach–Alaoglu, but most of the fixed-point-theoretic layer has to be built.

Difficulty

The classical route reduces a hypothetical counterexample to a minimal invariant weakly compact convex set KKK of diameter one. By the Goebel–Karlovitz lemma, every approximate fixed point sequence in KKK is asymptotically diametral. Normal-structure arguments then find a point whose radius is strictly below the diameter. In a general reflexive space there is no such geometric gain, and Karlovitz's example shows that normal structure is not necessary for the conclusion. Alspach's L1L_1L1​ example shows that compactness of CCC and nonexpansiveness alone cannot produce the contradiction: the proof has to use reflexivity of the whole space (weak compactness of the unit ball of span⁡‾(K−K)\overline{\operatorname{span}}(K-K)span​(K−K)), not just of the domain. A further obstacle is that FFF is nonlinear, so convex combinations of approximate fixed points are not mapped to convex combinations of their images.

Formalization scope

  • XXX is any real normed space with CompleteSpace X, and reflexivity is surjectivity of NormedSpace.inclusionInDoubleDual ℝ X (the continuous bidual). Completeness also follows from reflexivity, so including it is harmless. The scalar field is R\mathbb RR; complex spaces enter as real spaces.
  • CCC is a Set X with Nonempty, IsClosed (norm topology), Bornology.IsBounded and Convex ℝ. FFF is a function on the subtype C → C, and nonexpansiveness is stated in the original norm of XXX, not in an equivalent norm.
  • The conclusion is the existence of a fixed point ∃ a : C, F a = a. Every hypothesis is satisfiable, so the statement is not vacuous: a trivial CCC is excluded only by nonemptiness, as in the source.
  • Infrastructure needed: the minimal invariant set reduction, the Goebel–Karlovitz lemma, compact right-topological semigroups of maps and idempotents (Ellis), and weak compactness in reflexive spaces. These would serve other fixed-point formalizations, for example Kirk's and Browder–Göhde's theorems, which are not formalized in Mathlib.

Selected references

  • F. E. Browder, Nonexpansive nonlinear operators in a Banach space, Proc. Natl. Acad. Sci. USA 54 (1965), 1041–1044. https://doi.org/10.1073/pnas.54.4.1041
  • D. Göhde, Zum Prinzip der kontraktiven Abbildung, Math. Nachr. 30 (1965), 251–258. https://doi.org/10.1002/mana.19650300312
  • W. A. Kirk, A fixed point theorem for mappings which do not increase distances, Amer. Math. Monthly 72 (1965), 1004–1006. https://doi.org/10.2307/2313345
  • R. E. Bruck, Jr., A common fixed point theorem for a commuting family of nonexpansive mappings, Pacific J. Math. 53 (1974), 59–71. https://msp.org/pjm/1974/53-1/pjm-v53-n1-p05-p.pdf
  • K. Goebel, On the structure of minimal invariant sets for nonexpansive mappings, Ann. Univ. Mariae Curie-Skłodowska Sect. A 29 (1975), 73–77. https://www.bc.umcs.pl/Content/31033/PDF/czas4050_29_1975_9.pdf
  • L. A. Karlovitz, Existence of fixed points of nonexpansive mappings in a space without normal structure, Pacific J. Math. 66 (1976), 153–159. https://doi.org/10.2140/pjm.1976.66.153
  • D. E. Alspach, A fixed point free nonexpansive map, Proc. Amer. Math. Soc. 82 (1981), 423–424. https://doi.org/10.2307/2043954
  • B. Maurey, Points fixes des contractions de certains faiblement compacts de L1L^1L1, Séminaire d'analyse fonctionnelle (1980–1981), Exposé VIII. https://www.numdam.org/item/SAF_1980-1981____A8_0/
  • P.-K. Lin, Unconditional bases and fixed points of nonexpansive mappings, Pacific J. Math. 116 (1985), 69–76. https://doi.org/10.2140/pjm.1985.116.69
  • J. García-Falset, E. Llorens-Fuster and E. M. Mazcuñán-Navarro, Uniformly nonsquare Banach spaces have the fixed point property for nonexpansive mappings, J. Funct. Anal. 233 (2006), 494–514. https://doi.org/10.1016/j.jfa.2005.09.002
  • T. Domínguez Benavides, A renorming of some nonseparable Banach spaces with the Fixed Point Property, J. Math. Anal. Appl. 350 (2009), 525–530. https://doi.org/10.1016/j.jmaa.2008.02.049
  • K. Nourouzi, Reflexivity of Hilbert K(H)K(H)K(H)-modules and fixed-point property for nonexpansive mappings, J. Math. 2026, Article ID 6311273. https://doi.org/10.1155/jom/6311273
  • OpenAI, Fixed Points of Nonexpansive Maps in Reflexive Banach Spaces, OpenAI Math Release preprint, September 24, 2026 (Theorem 1.1, p. 1). https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/Fixed-Points-of-Nonexpansive-Maps-in-Reflexive-Banach-Spaces-September-24-2026/paper.pdf
78 thms3 active usersReviewed
🏆Completed
Functional AnalysisLinear algebra·Captain: wurtle

The complete Crouzeix theorem: optimal similarity and a common positive boundary representationResearch Paper

Motivation

For a square matrix AAA, the spectrum alone does not control the size of p(A)p(A)p(A): a nonzero nilpotent matrix has spectrum {0}\{0\}{0} yet ∥A∥>0\|A\|>0∥A∥>0. The numerical range W(A)={u∗Au: ∥u∥=1}W(A)=\{u^*Au:\ \|u\|=1\}W(A)={u∗Au: ∥u∥=1} is a compact convex set containing the spectrum (Toeplitz–Hausdorff), and it does retain enough information. Crouzeix's conjecture (2004) asserts that for every polynomial ppp,

∥p(A)∥≤2max⁡z∈W(A)∣p(z)∣,\|p(A)\|\le 2\max_{z\in W(A)}|p(z)|,∥p(A)∥≤2z∈W(A)max​∣p(z)∣,

i.e. that W(A)W(A)W(A) is a 222-spectral set; the constant 222 would be optimal. Such bounds are used to estimate matrix functions in numerical linear algebra (for example GMRES convergence through Faber polynomials) and in operator theory. The complete version asks for the same constant when the polynomial has m×mm\times mm×m matrix coefficients, uniformly in mmm; by Paulsen's theorem this is equivalent to similarity of the conformal disk image of AAA to a contraction with condition number at most 222.

Background

  • 1918–1919 — Toeplitz and Hausdorff prove convexity of the numerical range (Math. Z. 1918, Math. Z. 1919).
  • 1972, 1984 — Arveson's dilation theory (Acta Math. 128, 1972) and Paulsen's similarity theorem (Proc. AMS 92, 1984) relate complete contractivity, dilations and similarity.
  • 1999 — Delyon and Delyon's positive integral representations (Bull. SMF 1999).
  • 2004 — Crouzeix formulates the constant-two question (IEOT 2004); 2007 — he proves a universal complete bound 11.0811.0811.08 (JFA 2007).
  • 2006 — Badea, Crouzeix and Delyon obtain the complete constant 222 for 2×22\times22×2 matrices (Math. Z. 2006).
  • 2017–2018 — Crouzeix and Palencia prove the complete bound 1+21+\sqrt21+2​ (SIMAX 2017); Ransford and Schwenninger simplify the argument (SIMAX 2018).
  • 2026 — Scalar (m=1m=1m=1) constant-two proofs appear in preprints of Jin, Lorist–Schwenninger (arXiv:2608.03841) and Luo; Åhag, Czyż and Virtanen prove the complete inequality for base matrices of order at most three (arXiv:2608.27346).
  • September 2026 — Two OpenAI preprints claim the complete inequality in all dimensions: a structural proof via an optimal similarity and a common positive boundary density, extended to all bounded Hilbert-space operators (source), and a direct coefficient proof for matrices (source).

This mission asks for a formal proof of the complete Crouzeix inequality for all bounded operators on complex Hilbert spaces, with its sharpness, as stated in Corollary 6.3 of an OpenAI preprint dated September 23, 2026 (source), together with the preprint's structural theorems as milestones. The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) (n≥1n\ge1n≥1) let W(A)={u∗Au:u∈Cn, u∗u=1}W(A)=\{u^*Au: u\in\mathbb C^n,\ u^*u=1\}W(A)={u∗Au:u∈Cn, u∗u=1}. A matrix polynomial of degree ddd with coefficient size m≥1m\ge1m≥1 is P(z)=∑k=0dBkzkP(z)=\sum_{k=0}^dB_kz^kP(z)=∑k=0d​Bk​zk with Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C). Its evaluation at AAA is

P[A]=∑k=0dAk⊗Bk ∈Mn(C)⊗Mm(C),P[A]=\sum_{k=0}^d A^k\otimes B_k\ \in M_n(\mathbb C)\otimes M_m(\mathbb C),P[A]=k=0∑d​Ak⊗Bk​ ∈Mn​(C)⊗Mm​(C),

with the base space first. All norms are Euclidean operator norms. For m=1m=1m=1 this is the usual p(A)p(A)p(A).

For a bounded operator AAA on a complex Hilbert space H≠{0}\mathcal H\neq\{0\}H={0}, W(A)={⟨x,Ax⟩:∥x∥=1}W(A)=\{\langle x,Ax\rangle:\|x\|=1\}W(A)={⟨x,Ax⟩:∥x∥=1} and K=W(A)‾K=\overline{W(A)}K=W(A)​; P[A]=∑kAk⊗BkP[A]=\sum_kA^k\otimes B_kP[A]=∑k​Ak⊗Bk​ acts on H⊗Cm\mathcal H\otimes\mathbb C^mH⊗Cm. A bounded open convex Ω⊂C\Omega\subset\mathbb CΩ⊂C is admissible if its boundary is a regular real-analytic Jordan curve. For such Ω⊃W(A)\Omega\supset W(A)Ω⊃W(A) (AAA a matrix) with interior conformal map f:Ω→Df:\Omega\to\mathbb Df:Ω→D, put T=f(A)T=f(A)T=f(A) and

κ2=min⁡{τ: I⪯H⪯τI, T∗HT⪯H for some H=H∗}.\kappa^2=\min\{\tau:\ I\preceq H\preceq\tau I,\ T^*HT\preceq H\ \text{for some } H=H^*\}.κ2=min{τ: I⪯H⪯τI, T∗HT⪯H for some H=H∗}.

Formalization targets

Milestone: geometry of the numerical range (Corollary 6.3, p. 16, first assertion)

For H≠{0}\mathcal H\neq\{0\}H={0}, K=W(A)‾K=\overline{W(A)}K=W(A)​ is compact and convex and contains spec⁡(A)\operatorname{spec}(A)spec(A).

Milestone: the zero space (Corollary 6.3, p. 16, case H={0}\mathcal H=\{0\}H={0})

If H={0}\mathcal H=\{0\}H={0}, the numerical range is empty, every polynomial, holomorphic and rational evaluation is 000, and the corresponding inequalities read 0≤00\le00≤0 (with the supremum over the empty set taken to be 000).

Milestone: optimal metric and common positive representation (Lemma 1.1, Theorems 1.2–1.3, p. 2)

For admissible Ω\OmegaΩ conformal coordinates exist; for every n≥1n\ge1n≥1 and A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) with W(A)⊂ΩW(A)\subset\OmegaW(A)⊂Ω, the problem defining κ2\kappa^2κ2 is strictly feasible with attained minimum 1≤κ2≤41\le\kappa^2\le41≤κ2≤4; for a minimizer HHH, S=H1/2S=H^{1/2}S=H1/2 satisfies ∥S∥∥S−1∥=κ≤2\|S\|\|S^{-1}\|=\kappa\le2∥S∥∥S−1∥=κ≤2 and D=Sf(A)S−1D=Sf(A)S^{-1}D=Sf(A)S−1 is a contraction with ρ(D)<1\rho(D)<1ρ(D)<1; and one continuous Λ:T→Mn(C)\Lambda:\mathbb T\to M_n(\mathbb C)Λ:T→Mn​(C) with Λ⪰0\Lambda\succeq0Λ⪰0, ∫Λ dσ=I\int\Lambda\,d\sigma=I∫Λdσ=I represents v[SAS−1]=∫Λ(t)⊗v(G(t)) dσ(t)v[SAS^{-1}]=\int\Lambda(t)\otimes v(G(t))\,d\sigma(t)v[SAS−1]=∫Λ(t)⊗v(G(t))dσ(t) for every mmm and every MmM_mMm​-valued vvv holomorphic near Ω‾\overline\OmegaΩ, giving ∥v[A]∥≤κmax⁡Ω‾∥v∥\|v[A]\|\le\kappa\max_{\overline\Omega}\|v\|∥v[A]∥≤κmaxΩ​∥v∥.

Milestone: the matrix inequality (Corollary 6.1, p. 15)

For all n,m≥1n,m\ge1n,m≥1, d≥0d\ge0d≥0, A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C), Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C): ∥P[A]∥≤2max⁡W(A)∥P∥\|P[A]\|\le2\max_{W(A)}\|P\|∥P[A]∥≤2maxW(A)​∥P∥, and no smaller universal constant works.

Goal: Corollary 6.3 (p. 16)

For every complex Hilbert space H\mathcal HH (no separability assumption) and A∈B(H)A\in B(\mathcal H)A∈B(H): if H≠{0}\mathcal H\neq\{0\}H={0} then KKK is compact, convex, contains the spectrum, and for every m≥1m\ge1m≥1

∥P[A]∥≤2sup⁡W(A)∥P∥=2max⁡K∥P∥,∥F[A]∥≤2max⁡K∥F∥,∥R[A]∥≤2max⁡K∥R∥\|P[A]\|\le 2\sup_{W(A)}\|P\|=2\max_K\|P\|,\qquad \|F[A]\|\le2\max_K\|F\|,\qquad \|R[A]\|\le 2\max_K\|R\|∥P[A]∥≤2W(A)sup​∥P∥=2Kmax​∥P∥,∥F[A]∥≤2Kmax​∥F∥,∥R[A]∥≤2Kmax​∥R∥

for matrix polynomials PPP, matrix functions FFF holomorphic on an open U⊇KU\supseteq KU⊇K (holomorphic functional calculus), and matrix rational functions RRR with poles off KKK; if H={0}\mathcal H=\{0\}H={0} the degenerate statements above hold; and the constant 222 is optimal.

Significance

The result itself. It resolves the complete Crouzeix conjecture in its operator formulation, independent of the Hilbert space, the coefficient size and the degree: W(A)‾\overline{W(A)}W(A)​ is a complete 222-spectral set for every bounded operator. The structural theorems give more than the inequality: an optimal similarity, attained, with condition number at most 222, and one positive boundary density that represents every matrix-valued analytic evaluation simultaneously. These are the objects predicted abstractly by Paulsen's and Arveson's theorems, constructed here explicitly. A companion OpenAI preprint gives an independent direct proof of the matrix inequality.

Formalizing it. Mathlib has bounded operators, the holomorphic functional calculus is only partially available, and conformal mapping of analytic Jordan domains is absent. A complete development needs the Riemann mapping theorem with boundary extension, semidefinite optimization over Hermitian matrices, Haar integration on the circle, and a finite-compression argument for nonseparable spaces.

Difficulty

Two obstacles stand out. First, the passage from the scalar to the complete inequality: scalar proofs exploit commutativity that fails for matrix coefficients, so a structure valid for every coefficient size at once is needed; here it is the optimal metric chosen before any test function. Proving κ≤2\kappa\le2κ≤2 for that metric requires an endpoint extremal pair (Proposition 2.2, p. 6) and an ordered density comparison (Lemma 5.1, p. 14). Second, the passage from matrices to arbitrary operators: the numerical range of a compression lies in W(A)W(A)W(A), but one must show every vector of H⊗Cm\mathcal H\otimes\mathbb C^mH⊗Cm and its image under P[A]P[A]P[A] live in a finite-dimensional compression, and treat holomorphic and rational calculi through contour integrals around the closed numerical range.

Formalization scope

  • H is any type with InnerProductSpace ℂ H and CompleteSpace H; operators are H →L[ℂ] H. The amplification H⊗Cm\mathcal H\otimes\mathbb C^mH⊗Cm is the completion of the algebraic tensor product, and Ak⊗BkA^k\otimes B_kAk⊗Bk​ is the completed TensorProduct.mapL.
  • supNorm S F = sSup (insert 0 (‖F ·‖ '' S)), so the supremum over an empty set is 000, matching the convention of Corollary 6.3.
  • Holomorphic evaluation is defined by a contour integral over a CalculusContour around KKK inside UUU; the goal asserts such contours exist and that the evaluation is contour-independent. Rational evaluation inverts aeval A denom; the goal asserts these denominators are units and that the rational evaluation agrees with the holomorphic one.
  • SharpConstant is witnessed by a 2×22\times22×2 matrix with sup⁡W∣P∣=1\sup_{W}|P|=1supW​∣P∣=1 and ∥P[A]∥=2\|P[A]\|=2∥P[A]∥=2.
  • The structural milestone also includes, as an extra conjunct, that the open unit disk is admissible.

Two further published supporting statements are included as items but not milestones: existence of a finite-dimensional compression representing a given vector (a step in the proof of Corollary 6.3) and invertibility of rational denominators (the well-definedness part of the rational calculus).

Selected references

  • OpenAI, The complete Crouzeix theorem: optimal similarity and a common positive boundary representation, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-complete-Crouzeix-theorem-September-23-2026/paper.pdf
  • OpenAI, A direct proof of the complete Crouzeix inequality, OpenAI Math Release preprint, September 26, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-direct-proof-of-the-complete-Crouzeix-inequality-September-26-2026/paper.pdf
  • V. I. Paulsen, Completely bounded homomorphisms of operator algebras, Proc. Amer. Math. Soc. 92 (1984), 225–228.
  • W. Arveson, Subalgebras of C-algebras II*, Acta Math. 128 (1972), 271–308.
  • M. Crouzeix, Bounds for analytical functions of matrices, Integral Equations Operator Theory 48 (2004), 461–477. https://doi.org/10.1007/s00020-002-1188-6
  • M. Crouzeix, Numerical range and functional calculus in Hilbert space, J. Funct. Anal. 244 (2007), 668–690. https://doi.org/10.1016/j.jfa.2006.10.013
  • M. Crouzeix, C. Palencia, The numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 38 (2017), 649–655. https://doi.org/10.1137/17M1116672
  • T. Ransford, F. L. Schwenninger, Remarks on the Crouzeix–Palencia proof that the numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 39 (2018), 342–345. https://doi.org/10.1137/17M1143757
  • C. Badea, M. Crouzeix, B. Delyon, Convex domains and K-spectral sets, Math. Z. 252 (2006), 345–365. https://doi.org/10.1007/s00209-005-0857-y
  • B. Delyon, F. Delyon, Generalization of von Neumann's spectral sets and integral representation of operators, Bull. Soc. Math. France 127 (1999), 25–41. https://doi.org/10.24033/bsmf.2340
  • E. Lorist, F. L. Schwenninger, A solution to Crouzeix's conjecture, arXiv:2608.03841 (2026). https://arxiv.org/abs/2608.03841v2
  • P. Åhag, R. Czyż, J. Virtanen, The complete Crouzeix conjecture in dimension three and the Clouâtre–Ostermann–Ransford conjecture, arXiv:2608.27346 (2026). https://arxiv.org/abs/2608.27346v4
  • O. Toeplitz, Das algebraische Analogon zu einem Satze von Fejér, Math. Z. 2 (1918), 187–197. https://doi.org/10.1007/BF01212904
  • F. Hausdorff, Der Wertvorrat einer Bilinearform, Math. Z. 3 (1919), 314–316. https://doi.org/10.1007/BF01292610
10 thms3 active usersReviewed
🏆Completed
Functional AnalysisLinear algebra·Captain: wurtle

A direct proof of the complete Crouzeix inequalityResearch Paper

Motivation

For a square matrix AAA, the spectrum alone does not control the size of p(A)p(A)p(A): a nonzero nilpotent matrix has spectrum {0}\{0\}{0} yet ∥A∥>0\|A\|>0∥A∥>0. The numerical range W(A)={u∗Au: ∥u∥=1}W(A)=\{u^*Au:\ \|u\|=1\}W(A)={u∗Au: ∥u∥=1} is a compact convex set containing the spectrum (Toeplitz–Hausdorff), and it does retain enough information. Crouzeix's conjecture (2004) asserts that for every polynomial ppp,

∥p(A)∥≤2max⁡z∈W(A)∣p(z)∣,\|p(A)\|\le 2\max_{z\in W(A)}|p(z)|,∥p(A)∥≤2z∈W(A)max​∣p(z)∣,

i.e. that W(A)W(A)W(A) is a 222-spectral set; the constant 222 would be optimal. Such bounds are used to estimate matrix functions in numerical linear algebra (for example GMRES convergence through Faber polynomials) and in operator theory. The complete version asks for the same constant when the polynomial has m×mm\times mm×m matrix coefficients, uniformly in mmm; by Paulsen's theorem this is equivalent to similarity of the conformal disk image of AAA to a contraction with condition number at most 222.

Background

  • 1918–1919 — Toeplitz and Hausdorff prove convexity of the numerical range (Math. Z. 1918, Math. Z. 1919).
  • 1972, 1984 — Arveson's dilation theory (Acta Math. 128, 1972) and Paulsen's similarity theorem (Proc. AMS 92, 1984) relate complete contractivity, dilations and similarity.
  • 1999 — Delyon and Delyon's positive integral representations (Bull. SMF 1999).
  • 2004 — Crouzeix formulates the constant-two question (IEOT 2004); 2007 — he proves a universal complete bound 11.0811.0811.08 (JFA 2007).
  • 2006 — Badea, Crouzeix and Delyon obtain the complete constant 222 for 2×22\times22×2 matrices (Math. Z. 2006).
  • 2017–2018 — Crouzeix and Palencia prove the complete bound 1+21+\sqrt21+2​ (SIMAX 2017); Ransford and Schwenninger simplify the argument (SIMAX 2018).
  • 2026 — Scalar (m=1m=1m=1) constant-two proofs appear in preprints of Jin, Lorist–Schwenninger (arXiv:2608.03841) and Luo; Åhag, Czyż and Virtanen prove the complete inequality for base matrices of order at most three (arXiv:2608.27346).
  • September 2026 — Two OpenAI preprints claim the complete inequality in all dimensions: a structural proof via an optimal similarity and a common positive boundary density, extended to all bounded Hilbert-space operators (source), and a direct coefficient proof for matrices (source).

This mission asks for a formal proof of the complete Crouzeix inequality for matrices, with its sharpness, as stated in Theorem 1.1 of an OpenAI preprint dated September 26, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) (n≥1n\ge1n≥1) let W(A)={u∗Au:u∈Cn, u∗u=1}W(A)=\{u^*Au: u\in\mathbb C^n,\ u^*u=1\}W(A)={u∗Au:u∈Cn, u∗u=1}. A matrix polynomial of degree ddd with coefficient size m≥1m\ge1m≥1 is P(z)=∑k=0dBkzkP(z)=\sum_{k=0}^dB_kz^kP(z)=∑k=0d​Bk​zk with Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C). Its evaluation at AAA is

P[A]=∑k=0dAk⊗Bk ∈Mn(C)⊗Mm(C),P[A]=\sum_{k=0}^d A^k\otimes B_k\ \in M_n(\mathbb C)\otimes M_m(\mathbb C),P[A]=k=0∑d​Ak⊗Bk​ ∈Mn​(C)⊗Mm​(C),

with the base space first. All norms are Euclidean operator norms. For m=1m=1m=1 this is the usual p(A)p(A)p(A).

Formalization targets

Milestone: the inequality (Theorem 1.1, p. 1, first assertion)

For all n,m≥1n,m\ge1n,m≥1, d≥0d\ge0d≥0, A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) and B0,…,Bd∈Mm(C)B_0,\dots,B_d\in M_m(\mathbb C)B0​,…,Bd​∈Mm​(C),

∥∑k=0dAk⊗Bk∥ ≤ 2max⁡z∈W(A)∥∑k=0dBkzk∥.\Bigl\|\sum_{k=0}^dA^k\otimes B_k\Bigr\|\ \le\ 2\max_{z\in W(A)}\Bigl\|\sum_{k=0}^dB_kz^k\Bigr\| .​k=0∑d​Ak⊗Bk​​ ≤ 2z∈W(A)max​​k=0∑d​Bk​zk​.

Milestone: sharpness (Theorem 1.1, p. 1, second assertion)

If the inequality holds with a constant ccc in place of 222 for all n,m,d,A,Bn,m,d,A,Bn,m,d,A,B, then c≥2c\ge2c≥2.

Goal: Theorem 1.1 (p. 1)

Both assertions together: the constant 222 is valid and no smaller universal constant is.

Significance

The result itself. It settles the complete Crouzeix conjecture in its matrix formulation, uniformly in the base dimension nnn, the coefficient size mmm and the degree, including matrices whose numerical range is a point or a segment. The scalar case m=1m=1m=1 had recently been proved by other authors and the complete case was known only for n≤3n\le3n≤3; a scalar argument need not survive matrix amplification because coefficient matrices do not commute. Equivalently, the numerical range is a complete 222-spectral set for every matrix, which via Paulsen's theorem gives a similarity of condition number at most 222 making the conformal disk image of AAA a contraction. A companion OpenAI preprint gives a separate structural proof and extends the bound to all bounded operators on Hilbert spaces.

Formalizing it. The proof uses exterior conformal maps of analytic convex domains, Faber-type coefficients, a positive double-layer kernel, and a 2×22\times22×2 block positivity argument; Section 4 then approximates an arbitrary numerical range by analytic convex domains. A formal proof would provide numerical ranges, Faber polynomials and conformal collars in Lean, all reusable in matrix analysis. No machine-checked proof of any constant-222 Crouzeix bound is known.

Difficulty

The naive approach through the spectrum fails for non-normal matrices, and the classical Crouzeix–Palencia method (a positive double-layer potential plus a Cauchy transform of conjugate data) loses a factor and yields 1+21+\sqrt21+2​. To reach 222 in the complete setting, the argument must keep both multiplication orders FGFGFG and GFGFGF of matrix-valued test functions, since the coefficients do not commute. The preprint chooses a top singular pair (x,y)(x,y)(x,y) of F[A]F[A]F[A], represents three functionals through the resolvent, and must show that the resulting coefficient weights (one on the constant term, one half on the others) match exactly the Fourier weights of the diagonal compressions (Section 2, Proposition 2.2, p. 5; Theorem 3.2, p. 6). Degenerate numerical ranges with empty interior require a separate approximation step (Lemma 4.1, p. 9).

Formalization scope

  • Matrices are Matrix (Fin n) (Fin n) ℂ with the L2 operator norm (Matrix.Norms.L2Operator). The numerical range is the set of ⟨x,Ax⟩\langle x, Ax\rangle⟨x,Ax⟩ over unit vectors of EuclideanSpace ℂ (Fin n).
  • Coefficients are B : Fin (d+1) → Matrix (Fin m) (Fin m) ℂ; the evaluation is ∑kAk⊗KronBk\sum_k A^k\otimes_{\mathrm{Kron}}B_k∑k​Ak⊗Kron​Bk​ indexed by Fin n × Fin m, base factor first.
  • rangeMaximum A B is the sSup of ∥P(z)∥\|P(z)\|∥P(z)∥ over W(A)W(A)W(A). Since n≥1n\ge1n≥1, W(A)W(A)W(A) is nonempty and compact, so this is the true maximum; UniversalBound C quantifies over all n,m≥1n,m\ge1n,m≥1, all ddd, all AAA and BBB.
  • The goal OAI.CompleteCrouzeix.main is UniversalBound 2 ∧ ∀ C, UniversalBound C → 2 ≤ C. The two milestones state the same two clauses in the DirectCrouzeix namespace, whose definitions are identical in content.
  • No normality, invertibility or nonempty-interior hypothesis is imposed on AAA.

Selected references

  • OpenAI, A direct proof of the complete Crouzeix inequality, OpenAI Math Release preprint, September 26, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-direct-proof-of-the-complete-Crouzeix-inequality-September-26-2026/paper.pdf
  • OpenAI, The complete Crouzeix theorem: optimal similarity and a common positive boundary representation, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-complete-Crouzeix-theorem-September-23-2026/paper.pdf
  • M. Crouzeix, Bounds for analytical functions of matrices, Integral Equations Operator Theory 48 (2004), 461–477. https://doi.org/10.1007/s00020-002-1188-6
  • M. Crouzeix, Numerical range and functional calculus in Hilbert space, J. Funct. Anal. 244 (2007), 668–690. https://doi.org/10.1016/j.jfa.2006.10.013
  • M. Crouzeix, C. Palencia, The numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 38 (2017), 649–655. https://doi.org/10.1137/17M1116672
  • T. Ransford, F. L. Schwenninger, Remarks on the Crouzeix–Palencia proof that the numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 39 (2018), 342–345. https://doi.org/10.1137/17M1143757
  • C. Badea, M. Crouzeix, B. Delyon, Convex domains and K-spectral sets, Math. Z. 252 (2006), 345–365. https://doi.org/10.1007/s00209-005-0857-y
  • B. Delyon, F. Delyon, Generalization of von Neumann's spectral sets and integral representation of operators, Bull. Soc. Math. France 127 (1999), 25–41. https://doi.org/10.24033/bsmf.2340
  • E. Lorist, F. L. Schwenninger, A solution to Crouzeix's conjecture, arXiv:2608.03841 (2026). https://arxiv.org/abs/2608.03841v2
  • P. Åhag, R. Czyż, J. Virtanen, The complete Crouzeix conjecture in dimension three and the Clouâtre–Ostermann–Ransford conjecture, arXiv:2608.27346 (2026). https://arxiv.org/abs/2608.27346v4
  • O. Toeplitz, Das algebraische Analogon zu einem Satze von Fejér, Math. Z. 2 (1918), 187–197. https://doi.org/10.1007/BF01212904
  • F. Hausdorff, Der Wertvorrat einer Bilinearform, Math. Z. 3 (1919), 314–316. https://doi.org/10.1007/BF01292610
47 thms3 active usersReviewed
🏆Completed
Operations ResearchStochastic Systems·Captain: mikedeng1

The Power of Two Choices in Randomized Load Balancing II: T_d(λ)/log T_1(λ) → 1/log d as λ → 1⁻, an Exponential Improvement over One ChoiceResearch Paper

Motivation

A dispatcher assigns each arriving job to one of nnn servers. Sending it to a uniformly random server is simple but produces long queues near capacity; sending it to the globally shortest queue requires full state information. The power of ddd choices sits between the two: each job samples ddd servers at random and joins the shortest of them. Mitzenmacher's analysis of this supermarket model (IEEE TPDS 12(10), 2001) together with the balls-into-bins result of Azar, Broder, Karlin and Upfal (SIAM J. Comput. 29(1), 1999), established that a second random choice changes the behaviour of the system qualitatively. The idea underlies load balancers, hashing schemes and distributed schedulers.

This mission formalizes the paper's quantitative statement of that improvement in heavy traffic, the regime where the arrival rate per server λ\lambdaλ approaches the service rate 111.

Setting

Customers arrive as a Poisson stream of rate λn\lambda nλn with 0≤λ<10\le\lambda<10≤λ<1, service times are exponential with mean 111, and each customer joins the shortest of ddd queues sampled uniformly with replacement. As n→∞n\to\inftyn→∞ the fraction of queues with at least iii customers follows a deterministic limiting system with fixed point πi=λ(di−1)/(d−1)\pi_i=\lambda^{(d^i-1)/(d-1)}πi​=λ(di−1)/(d−1). Corollary 2 of the paper shows that, for d≥2d\ge2d≥2, the expected time a customer spends in that limiting system converges to

Td(λ)=∑i=1∞λdi−dd−1.T_d(\lambda)=\sum_{i=1}^{\infty}\lambda^{\frac{d^i-d}{d-1}} .Td​(λ)=i=1∑∞​λd−1di−d​.

With a single choice the system is nnn independent M/M/1 queues, and the expected time is

T1(λ)=11−λ.T_1(\lambda)=\frac{1}{1-\lambda}.T1​(λ)=1−λ1​.

This mission takes these two formulas as its definitions; the limiting system itself and the convergence to Td(λ)T_d(\lambda)Td​(λ) are the subject of the companion mission (part I). The auxiliary function of Lemma 3 is

Fd(λ)=∑i=0∞λdilog⁡11−λ.F_d(\lambda)=\frac{\sum_{i=0}^{\infty}\lambda^{d^i}}{\log\frac{1}{1-\lambda}} .Fd​(λ)=log1−λ1​∑i=0∞​λdi​.

Throughout, d≥2d\ge2d≥2 is an integer and logarithms are natural.

Formalization targets

Goal: Theorem 4, limit clause (p. 1099)

lim⁡λ→1−Td(λ)log⁡T1(λ)=1log⁡d(d≥2).\lim_{\lambda\to1^-}\frac{T_d(\lambda)}{\log T_1(\lambda)}=\frac{1}{\log d}\qquad(d\ge2).λ→1−lim​logT1​(λ)Td​(λ)​=logd1​(d≥2).

Milestones, in the order the paper's argument uses them

  1. The rewriting of TdT_dTd​ (proof of Theorem 4): with λ′=λ1/(d−1)\lambda'=\lambda^{1/(d-1)}λ′=λ1/(d−1) and 0<λ<10<\lambda<10<λ<1,
Td(λ)=∑i=1∞(λ′)diλd/(d−1).T_d(\lambda)=\frac{\sum_{i=1}^{\infty}(\lambda')^{d^i}}{\lambda^{d/(d-1)}} .Td​(λ)=λd/(d−1)∑i=1∞​(λ′)di​.
  1. The product identity (proof of Lemma 3): for 0≤λ<10\le\lambda<10≤λ<1,
∏i=0∞(1+λdi+λ2di+⋯+λ(d−1)di)=11−λ.\prod_{i=0}^{\infty}\bigl(1+\lambda^{d^i}+\lambda^{2d^i}+\dots+\lambda^{(d-1)d^i}\bigr)=\frac{1}{1-\lambda}.i=0∏∞​(1+λdi+λ2di+⋯+λ(d−1)di)=1−λ1​.
  1. Lemma 3:
lim⁡λ→1−Fd(λ)=1log⁡d.\lim_{\lambda\to1^-}F_d(\lambda)=\frac{1}{\log d}.λ→1−lim​Fd​(λ)=logd1​.

The goal is a statement about the shape of the growth, not a constant: it pins the leading behaviour Td(λ)∼log⁡d11−λT_d(\lambda)\sim\log_d\frac{1}{1-\lambda}Td​(λ)∼logd​1−λ1​.

Significance

Theorem 4 makes "exponential improvement" precise. With one choice the expected time grows like 11−λ\frac1{1-\lambda}1−λ1​ as the load approaches capacity; with d≥2d\ge2d≥2 choices it grows like log⁡11−λlog⁡d\frac{\log\frac1{1-\lambda}}{\log d}logdlog1−λ1​​. It also quantifies the diminishing return of extra choices: going from d=2d=2d=2 to ddd only divides the leading term by log⁡2d\log_2 dlog2​d, while going from one choice to two changes its order. These constants are the benchmark against which later heavy-traffic analyses of join-the-shortest-of-ddd policies are compared.

The result is proved in the paper (the limit clause; see Difficulty for the other clause). No machine-checked version is known to exist. The formalization yields a self-contained Lean development of the lacunary series ∑ixdi\sum_i x^{d^i}∑i​xdi near x=1x=1x=1 and of the base-ddd product identity, both of which are classical analytic facts with uses outside queueing (lacunary power series, digit expansions).

Difficulty

The obvious approach compares ∑iλdi\sum_i\lambda^{d^i}∑i​λdi with an integral, but the terms are not monotone images of a smooth function of a continuous index in a way that controls the error uniformly as λ→1−\lambda\to1^-λ→1−: the number of terms close to 111 grows like log⁡d11−λ\log_d\frac{1}{1-\lambda}logd​1−λ1​ and each of them contributes nearly 111, so the error terms are of the same order as the quantity being measured. The difficulty is to obtain matching upper and lower bounds with constants tending to 1/log⁡d1/\log d1/logd, uniformly as λ→1−\lambda\to1^-λ→1−. Passing from Lemma 3 to Theorem 4 additionally requires controlling the change of variable λ↦λ1/(d−1)\lambda\mapsto\lambda^{1/(d-1)}λ↦λ1/(d−1) inside the logarithm.

Theorem 4 as printed also contains a first clause, Td(λ)≤cdlog⁡T1(λ)T_d(\lambda)\le c_d\log T_1(\lambda)Td​(λ)≤cd​logT1​(λ) for all λ∈[0,1]\lambda\in[0,1]λ∈[0,1]. It is false as printed near λ=0\lambda=0λ=0: Td(λ)≥1T_d(\lambda)\ge1Td​(λ)≥1 while log⁡T1(λ)→0\log T_1(\lambda)\to0logT1​(λ)→0. The paper does not prove it, and this mission does not pose it.

Formalization scope

  • Representation. λ\lambdaλ is a real number (lam), ddd a natural number with the hypothesis 2≤d2\le d2≤d on every statement. TdT_dTd​, T1T_1T1​ and FdF_dFd​ are real-valued definitions in one definition file.
  • Exponents. TdT_dTd​'s iii-th term uses the natural-number exponent ∑1≤k<idk=di−dd−1\sum_{1\le k<i}d^k=\frac{d^i-d}{d-1}∑1≤k<i​dk=d−1di−d​, so its i=1i=1i=1 term is λ0=1\lambda^0=1λ0=1. The series runs over i∈Ni\in\mathbb Ni∈N with the i=0i=0i=0 term equal to 000. λ′=λ1/(d−1)\lambda'=\lambda^{1/(d-1)}λ′=λ1/(d−1) and λd/(d−1)\lambda^{d/(d-1)}λd/(d−1) are real powers.
  • Series and junk values. All series are real tsums; they converge for 0≤λ<10\le\lambda<10≤λ<1. Outside that range Lean's conventions (a divergent series sums to 000, x/0=0x/0=0x/0=0, log⁡x=0\log x=0logx=0 for x≤0x\le0x≤0) produce meaningless values, so every statement either restricts λ\lambdaλ to [0,1)[0,1)[0,1) or (0,1)(0,1)(0,1) or is a limit along λ<1\lambda<1λ<1.
  • Limits. "λ→1−\lambda\to1^-λ→1−" is the one-sided filter 𝓝[<] 1; the limit 1/log⁡d1/\log d1/logd uses Real.log.
  • Infinite product. The product identity is stated with HasProd (unconditional convergence of finite subproducts), which for factors ≥1\ge1≥1 is the same as convergence of the partial products.
  • Not trivializable. Because every limit is one-sided at 111 and the denominators log⁡T1(λ)\log T_1(\lambda)logT1​(λ) and log⁡11−λ\log\frac1{1-\lambda}log1−λ1​ are positive there, no statement can be satisfied by Lean's junk values at λ≥1\lambda\ge1λ≥1 or at λ=0\lambda=0λ=0; the summability of the rewritten series is asserted explicitly.
  • Infrastructure. Useful general lemmas: asymptotics of ∑ixdi\sum_i x^{d^i}∑i​xdi as x→1−x\to1^-x→1−, products of finite geometric sums, change of variables in one-sided limits. These are reusable beyond this mission. Contributions of any of the milestones, or of alternative proofs of Lemma 3, are welcome.

Selected references

  • M. Mitzenmacher, The Power of Two Choices in Randomized Load Balancing, IEEE Transactions on Parallel and Distributed Systems 12(10), 2001, pp. 1094–1104. https://doi.org/10.1109/71.963420
  • Y. Azar, A. Z. Broder, A. R. Karlin, E. Upfal, Balanced Allocations, SIAM Journal on Computing 29(1), 1999, pp. 180–200. https://doi.org/10.1137/S0097539795288490
5 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 3: The Periodic Gaussians Ψ_α and Ψ_β Are Within Statistical Distance 9(β/α − 1) When 0 < α < β ≤ 2αResearch Paper

Motivation

The Learning with Errors (LWE) problem, introduced by Regev in On Lattices, Learning with Errors, Random Linear Codes, and Cryptography (J. ACM 56(6), 2009, Article 34; doi:10.1145/1568318.1568324), asks to recover a secret vector s∈Zpns \in \mathbb{Z}_p^ns∈Zpn​ from noisy inner products ⟨a,s⟩/p+e mod 1\langle a, s\rangle/p + e \bmod 1⟨a,s⟩/p+emod1. The noise eee is drawn from a periodic normal distribution Ψβ\Psi_\betaΨβ​ on the circle T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z: a centred normal variable reduced modulo 111. LWE has since become the main hardness assumption of lattice-based cryptography, including the post-quantum standards built on it.

Regev's reductions repeatedly need to compare Ψα\Psi_\alphaΨα​ and Ψβ\Psi_\betaΨβ​ for nearby parameters, for instance when the noise parameter is known only up to a small relative error. Claim 2.2 of the paper (p. 34:16) quantifies this: the two periodic normal distributions are close in statistical distance, linearly in the relative change β/α−1\beta/\alpha - 1β/α−1. This mission formalizes Claim 2.2 and the steps of its proof. The source is the published J. ACM article; the paper's main theorem, a quantum reduction from worst-case lattice problems to LWE, is outside this series.

Setting

Identify T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z with the segment [0,1)[0,1)[0,1) with addition modulo 111. For β>0\beta > 0β>0 the normal density with mean 000 and standard deviation β/2π\beta/\sqrt{2\pi}β/2π​ is

νβ(x)=1βexp⁡(−π(xβ)2),x∈R,\nu_\beta(x) = \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{x}{\beta}\Bigr)^2\Bigr), \qquad x \in \mathbb{R},νβ​(x)=β1​exp(−π(βx​)2),x∈R,

(Eq. (5) in dimension one), and the periodic normal density (Eq. (7)) is its periodization

Ψβ(r)=∑k=−∞∞1βexp⁡(−π(r−kβ)2),r∈[0,1),\Psi_\beta(r) = \sum_{k=-\infty}^{\infty} \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{r-k}{\beta}\Bigr)^2\Bigr), \qquad r \in [0,1),Ψβ​(r)=k=−∞∑∞​β1​exp(−π(βr−k​)2),r∈[0,1),

the density of a νβ\nu_\betaνβ​-distributed variable reduced modulo 111.

The statistical distance of two densities φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ (p. 34:14) is

Δ(φ1,φ2)=∫∣φ1−φ2∣,\Delta(\varphi_1, \varphi_2) = \int |\varphi_1 - \varphi_2|,Δ(φ1​,φ2​)=∫∣φ1​−φ2​∣,

the integral taken over R\mathbb{R}R for densities on the line and over [0,1)[0,1)[0,1) for densities on T\mathbb{T}T. The paper uses this normalization without a factor 12\tfrac1221​, so that Δ\DeltaΔ ranges in [0,2][0,2][0,2] on probability densities. In Lean these objects are RegevLWE.PeriodicGauss.nu, Psi, statDist and statDistT.

Formalization targets

Goal: Claim 2.2

For any 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,

Δ(Ψα,Ψβ)≤9(βα−1).\Delta(\Psi_\alpha, \Psi_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(Ψα​,Ψβ​)≤9(αβ​−1).

The hypotheses and the constant 999 are exactly as printed.

Milestones

  1. The bound on the line (proof of Claim 2.2, first sentence). For 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,
Δ(να,νβ)≤9(βα−1).\Delta(\nu_\alpha, \nu_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(να​,νβ​)≤9(αβ​−1).
  1. Reduction modulo 1 does not increase Δ\DeltaΔ (p. 34:15, used on p. 34:16): for integrable φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ on R\mathbb{R}R, the periodizations φ~i(r)=∑kφi(r−k)\tilde\varphi_i(r) = \sum_k \varphi_i(r-k)φ~​i​(r)=∑k​φi​(r−k) satisfy Δ(φ~1,φ~2)≤Δ(φ1,φ2)\Delta(\tilde\varphi_1, \tilde\varphi_2) \le \Delta(\varphi_1, \varphi_2)Δ(φ~​1​,φ~​2​)≤Δ(φ1​,φ2​).
  2. The three displayed steps of the proof after normalizing to α=1\alpha = 1α=1, β=1+ϵ\beta = 1 + \epsilonβ=1+ϵ, 0<ϵ≤10 < \epsilon \le 10<ϵ≤1: the first display (a triangle-inequality split and an exact evaluation), the pointwise bound
∣e−π(1−1/(1+ϵ)2)x2−1∣≤π(1−1/(1+ϵ)2)x2≤2πϵx2,\bigl|e^{-\pi(1-1/(1+\epsilon)^2)x^2} - 1\bigr| \le \pi\bigl(1 - 1/(1+\epsilon)^2\bigr)x^2 \le 2\pi\epsilon x^2,​e−π(1−1/(1+ϵ)2)x2−1​≤π(1−1/(1+ϵ)2)x2≤2πϵx2,

and the final evaluation

ϵ+2πϵ∫Rx2e−πx2/(1+ϵ)2 dx=ϵ+ϵ(1+ϵ)3≤9ϵ.\epsilon + 2\pi\epsilon\int_{\mathbb{R}} x^2 e^{-\pi x^2/(1+\epsilon)^2}\,dx = \epsilon + \epsilon(1+\epsilon)^3 \le 9\epsilon.ϵ+2πϵ∫R​x2e−πx2/(1+ϵ)2dx=ϵ+ϵ(1+ϵ)3≤9ϵ.

Significance

Claim 2.2 is a stability statement for the LWE error distribution. It lets an algorithm that works for one noise parameter be applied to a nearby one at a controlled cost in statistical distance, which is how Regev's reductions tolerate an approximately known parameter. It also states a quantitative fact about wrapped normal distributions, which appear outside cryptography, for example in directional statistics.

The result is proved in the paper; no machine-checked proof is known to this mission. Formalizing it produces a reusable one-dimensional toolkit: the L1L^1L1 distance between two centred normal densities, the second moment of a Gaussian in Regev's normalization, and the contraction of L1L^1L1 distance under periodization. Each of these is a building block for formalizing the rest of the paper's analysis of Gaussian noise.

Difficulty

The arithmetic is elementary; the work is in the analysis. The statement on T\mathbb{T}T involves infinite series inside an integral, and the passage from the line to the circle requires exchanging a sum over Z\mathbb{Z}Z with an integral and controlling the series almost everywhere. A direct attack on Ψα−Ψβ\Psi_\alpha - \Psi_\betaΨα​−Ψβ​ termwise on [0,1)[0,1)[0,1) does not by itself produce a bound in terms of β/α−1\beta/\alpha - 1β/α−1; the comparison has to be made on the line first. On the line, the scaling to α=1\alpha = 1α=1 is a change of variables in a Lebesgue integral, and the evaluation of ∫x2e−πx2/σ2dx=σ3/(2π)\int x^2 e^{-\pi x^2/\sigma^2}dx = \sigma^3/(2\pi)∫x2e−πx2/σ2dx=σ3/(2π) requires Gaussian moment identities in the paper's normalization rather than Mathlib's.

Formalization scope

  • Reals and densities. Everything is one-dimensional over R\mathbb{R}R; distributions are represented by their densities, not by measures. T\mathbb{T}T is the interval Set.Ico 0 1 with Lebesgue measure; Ψβ\Psi_\betaΨβ​ is a real tsum over k∈Zk \in \mathbb{Z}k∈Z, which converges absolutely for β≠0\beta \ne 0β=0.
  • Statistical distance. Δ\DeltaΔ is a lower Lebesgue integral ∫⁻ ENNReal.ofReal |φ₁ - φ₂| valued in [0,∞][0,\infty][0,∞], with no factor 12\tfrac1221​, as on p. 34:14. Bounds are compared through ENNReal.ofReal. A Bochner integral would be 000 on a non-integrable difference and would make any upper bound trivially true; the extended-valued integral rules this out.
  • Added hypotheses. None on the goal or on the line bound. The modulo-1 milestone assumes φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ integrable (the paper states the data-processing fact for random variables, whose densities are integrable); only the "modulo 1" instance used in the proof is stated, not the general inequality for arbitrary randomized functions. The pointwise bound is stated for every ϵ≥0\epsilon \ge 0ϵ≥0, a harmless generalization of the proof's range 0<ϵ≤10 < \epsilon \le 10<ϵ≤1. The first display is stated as its three component facts (inequality, evaluation =ϵ= \epsilon=ϵ, and the rewriting of the integrand), which together give the printed chain.
  • No trivialization. The goal is Claim 2.2 on T\mathbb{T}T, not the bound on the line, and neither side can collapse to a junk value: the left side is an extended nonnegative integral and the right side is positive under the hypotheses.
  • Welcome contributions. Gaussian moment lemmas in the normalization e−πx2/s2e^{-\pi x^2/s^2}e−πx2/s2, the periodization contraction for general integrable functions, and a measure-level statement identifying Ψβ\Psi_\betaΨβ​ with the pushforward of νβ\nu_\betaνβ​ under reduction modulo 111.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • D. Micciancio and S. Goldwasser, Complexity of Lattice Problems: A Cryptographic Perspective, Kluwer, 2002 (cited on p. 34:15 for the data-processing property of statistical distance). https://doi.org/10.1007/978-1-4615-0897-7
7 thms3 active usersReviewed
🏆Completed
Harmonic AnalysisProbability·Captain: mikedeng1

Distribution Function Inequalities for Martingales 2: Gundy's Decomposition of an L¹-Bounded Martingale, with One Stopping TimeResearch Paper

Motivation

Many operators of harmonic analysis are bounded on L2L^2L2 by an orthogonality argument but fail to be bounded on L1L^1L1; what survives at p=1p=1p=1 is a weak-type estimate λ P(∣Tf∣>λ)≤c ∥f∥1\lambda\,P(|Tf|>\lambda)\le c\,\|f\|_1λP(∣Tf∣>λ)≤c∥f∥1​. For singular integrals the standard route to such an estimate is the Calderón–Zygmund decomposition, which splits a function at height λ\lambdaλ into a bounded part and a part supported on a small set. Martingale theory has the same need: square functions, martingale transforms and maximal operators of martingales are bounded on L2L^2L2 for orthogonality reasons, and their behaviour on L1L^1L1-bounded martingales is the delicate endpoint.

R. F. Gundy (1968) supplied the martingale analogue: an L1L^1L1-bounded martingale can be written as the sum of three martingales, one bounded in L2L^2L2, one whose differences are absolutely summable in L1L^1L1, and one that is non-zero only on an event of small probability (Gundy 1968). Gundy's construction used several stopping times. In his 1971 Wald Memorial Lectures, published as Distribution Function Inequalities for Martingales (Burkholder 1973), D. L. Burkholder gave a simplified version of the decomposition in which only one stopping time is used, with explicit constants 222, 444 and 111. This mission formalizes that version, Theorem 4.1 of the lectures, together with the facts its proof rests on.

Timeline:

  • 1953. J. L. Doob's Stochastic Processes establishes almost-everywhere convergence of L1L^1L1-bounded martingales and the maximal inequality.
  • 1966. D. G. Austin proves that the integral of S2(f)S^2(f)S2(f) over {f∗≤λ}\{f^*\le\lambda\}{f∗≤λ} is finite for an L1L^1L1-bounded martingale (Austin 1966).
  • 1968. Gundy proves the decomposition theorem for L1L^1L1-bounded martingales, with applications to weak-type estimates.
  • 1973. Burkholder's Lemma 2.1, a refinement of Austin's theorem, yields a one-stopping-time proof of Gundy's decomposition with explicit constants.

Setting

Let (Ω,A,P)(\Omega,\mathcal A,P)(Ω,A,P) be a probability space and A0⊆A1⊆⋯\mathcal A_0\subseteq\mathcal A_1\subseteq\cdotsA0​⊆A1​⊆⋯ a nondecreasing sequence of sub-σ\sigmaσ-fields of A\mathcal AA. A martingale relative to A1,A2,…\mathcal A_1,\mathcal A_2,\dotsA1​,A2​,… is a sequence f=(f1,f2,… )f=(f_1,f_2,\dots)f=(f1​,f2​,…) of integrable random variables with fnf_nfn​ An\mathcal A_nAn​-measurable and E(fn+1∣An)=fnE(f_{n+1}\mid\mathcal A_n)=f_nE(fn+1​∣An​)=fn​. Its difference sequence is d=(d1,d2,… )d=(d_1,d_2,\dots)d=(d1​,d2​,…) with fn=∑k=1ndkf_n=\sum_{k=1}^n d_kfn​=∑k=1n​dk​, i.e. d1=f1d_1=f_1d1​=f1​, dk=fk−fk−1d_k=f_k-f_{k-1}dk​=fk​−fk−1​ (the convention is f0=0f_0=0f0​=0).

The maximal function is f∗=sup⁡n≥1∣fn∣f^*=\sup_{n\ge1}|f_n|f∗=supn≥1​∣fn​∣, the square function is S(f)=[∑k≥1dk2]1/2S(f)=\big[\sum_{k\ge1}d_k^2\big]^{1/2}S(f)=[∑k≥1​dk2​]1/2, and Sn(f)S_n(f)Sn​(f) is its nnn-th partial version. For 0<p<∞0<p<\infty0<p<∞,

∥f∥p=sup⁡n≥1∥fn∥p,∥fn∥p=(E∣fn∣p)1/p,\|f\|_p=\sup_{n\ge1}\|f_n\|_p,\qquad \|f_n\|_p=(E|f_n|^p)^{1/p},∥f∥p​=n≥1sup​∥fn​∥p​,∥fn​∥p​=(E∣fn​∣p)1/p,

and fff is LpL^pLp-bounded when ∥f∥p<∞\|f\|_p<\infty∥f∥p​<∞. For λ>0\lambda>0λ>0, the exit time μ=inf⁡{n≥1:∣fn∣>λ}\mu=\inf\{n\ge1:|f_n|>\lambda\}μ=inf{n≥1:∣fn​∣>λ} (with inf⁡∅=∞\inf\emptyset=\inftyinf∅=∞) is the first index at which ∣fn∣|f_n|∣fn​∣ exceeds λ\lambdaλ; fμf_\mufμ​, fμ−1f_{\mu-1}fμ−1​, Sμ−1(f)S_{\mu-1}(f)Sμ−1​(f) denote evaluation at the random index, with f∞=lim⁡nfnf_\infty=\lim_n f_nf∞​=limn​fn​.

The Lean development names these objects dseq (ddd), sqFnN/sqFn (Sn(f)S_n(f)Sn​(f), S(f)S(f)S(f)), maxFnN/maxFn (fn∗f_n^*fn∗​, f∗f^*f∗), pNorm (∥f∥p\|f\|_p∥f∥p​), exitTime (μ\muμ) and valAt/sqFnAt (evaluation at an index in {0,1,…,∞}\{0,1,\dots,\infty\}{0,1,…,∞}), all in the namespace BurkholderDFI.Gundy.

Formalization targets

Goal: Theorem 4.1 (p. 23)

For every L1L^1L1-bounded martingale fff and every λ>0\lambda>0λ>0 there are martingales X,Y,ZX,Y,ZX,Y,Z relative to the same σ\sigmaσ-fields, with difference sequences x,y,zx,y,zx,y,z, such that

f=X+Y+Z,∥X∥22≤2λ∥f∥1,∥∑k=1∞∣yk∣∥1≤4∥f∥1,P(Z∗>0)≤∥f∥1/λ.f=X+Y+Z,\qquad \|X\|_2^2\le2\lambda\|f\|_1,\qquad \Big\|\sum_{k=1}^\infty|y_k|\Big\|_1\le4\|f\|_1,\qquad P(Z^*>0)\le\|f\|_1/\lambda.f=X+Y+Z,∥X∥22​≤2λ∥f∥1​,​k=1∑∞​∣yk​∣​1​≤4∥f∥1​,P(Z∗>0)≤∥f∥1​/λ.

The three bounds hold together; each alone is trivial (f=0+0+ff=0+0+ff=0+0+f satisfies the first two, f=0+f+0f=0+f+0f=0+f+0 the first and last).

Milestones

  1. Doob's facts (cited, §1, p. 20). An L1L^1L1-bounded martingale or nonnegative submartingale converges almost everywhere, and ∥fμ∥1≤∥f∥1\|f_\mu\|_1\le\|f\|_1∥fμ​∥1​≤∥f∥1​ for every stopping time μ\muμ.
  2. (1.5) (p. 20). λpP(f∗>λ)≤∥f∥pp\lambda^pP(f^*>\lambda)\le\|f\|_p^pλpP(f∗>λ)≤∥f∥pp​ for 1≤p<∞1\le p<\infty1≤p<∞.
  3. Lemma 2.1 (p. 21). For the exit time μ\muμ above λ\lambdaλ,
∥Sμ−1(f)∥22+∥fμ−1∥22≤2Efμfμ−1≤2λ∥f∥1,\|S_{\mu-1}(f)\|_2^2+\|f_{\mu-1}\|_2^2\le2Ef_\mu f_{\mu-1}\le2\lambda\|f\|_1,∥Sμ−1​(f)∥22​+∥fμ−1​∥22​≤2Efμ​fμ−1​≤2λ∥f∥1​,

with equality on the left for martingales.

Significance

The result. The decomposition is the standard device for passing from L2L^2L2 to weak-type (1,1)(1,1)(1,1) estimates for martingale operators: an operator that is bounded on L2L^2L2, controlled by total variation on the second piece, and local in the sense that it vanishes where the third piece vanishes, is of weak type (1,1)(1,1)(1,1). Applications of the decomposition are given in Gundy's papers of 1968 and 1969 (On the class Llog⁡LL\log LLlogL, martingales, and singular integrals, Studia Math. 33), which the lectures cite for this purpose. The explicit constants 222, 444, 111 make every such weak-type constant explicit.

Formalizing it. The theorem is classical and proved; the remaining work is its formalization. As far as is known, no machine-checked proof of Gundy's decomposition, of Lemma 2.1, or of the weak-type maximal inequality in the form (1.5) for real martingales exists in Mathlib or on this platform. Mathlib provides almost-everywhere convergence of L1L^1L1-bounded submartingales and Doob's maximal inequality for nonnegative submartingales; the stopped-value bound for unbounded stopping times, the square-function identity of Lemma 2.1 and the decomposition itself are new. The milestones are shared with other missions of this series (Lemma 2.1 is also used for Burkholder's weak-type square function inequality and his exponential estimates), so each proof is reused.

Difficulty

The obvious attempt imitates the Calderón–Zygmund cut directly: truncate fff at height λ\lambdaλ, or stop it when it first exceeds λ\lambdaλ. Neither produces the required pieces. Truncation destroys the martingale property, and whatever restores it adds terms that must themselves be controlled in the right norm. Stopping at the exit time produces a martingale bounded by λ\lambdaλ only up to the overshoot at the exit, which is not bounded and lives on an event that is small only in probability. The L2L^2L2 estimate (4.2) is therefore not a consequence of boundedness; it needs a quantitative square-function bound for the martingale up to the exit, which is the content of Lemma 2.1, and that lemma in turn needs the limit f∞f_\inftyf∞​ and the stopped values fμf_\mufμ​ on {μ=∞}\{\mu=\infty\}{μ=∞} — so Doob's convergence theorem cannot be avoided.

Formalization scope

Processes are functions f : ℕ → Ω → ℝ with a Mathlib Filtration ℕ and Mathlib's Martingale/Submartingale. The paper indexes from 111; Lean's index 000 is never read by any quantity in the statements, which use the paper's convention f0=0f_0=0f0​=0. Mathlib's martingale definition additionally constrains f0=E(f1∣A0)f_0=E(f_1\mid\mathcal A_0)f0​=E(f1​∣A0​); this is no restriction, since every martingale indexed from 111 extends this way. The goal asserts that X,Y,ZX,Y,ZX,Y,Z are Mathlib martingales for the same filtration as fff, and the identity fn=Xn+Yn+Znf_n=X_n+Y_n+Z_nfn​=Xn​+Yn​+Zn​ is required for n≥1n\ge1n≥1.

Further committed conventions:

  • S(f)S(f)S(f), f∗f^*f∗, Z∗Z^*Z∗, ∥⋅∥p\|\cdot\|_p∥⋅∥p​ and all expectations of nonnegative quantities take values in [0,∞][0,\infty][0,∞] (lower Lebesgue integral), so no infinite value is silently replaced by 000.
  • ∥X∥2=sup⁡n≥1∥Xn∥2\|X\|_2=\sup_{n\ge1}\|X_n\|_2∥X∥2​=supn≥1​∥Xn​∥2​, not the norm of a limit; Z∗=sup⁡n≥1∣Zn∣Z^*=\sup_{n\ge1}|Z_n|Z∗=supn≥1​∣Zn​∣; ∥∑k∣yk∣∥1\|\sum_k|y_k|\|_1∥∑k​∣yk​∣∥1​ is the integral of the series with y1=Y1y_1=Y_1y1​=Y1​.
  • The exit time takes values in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} and μ−1\mu-1μ−1 is truncated, with ∞−1=∞\infty-1=\infty∞−1=∞; the a.e. limit f∞f_\inftyf∞​ is a function supplied with its convergence hypothesis (Lemma 2.1) or asserted to exist (Doob's facts).
  • "Nonnegative submartingale" means fn≥0f_n\ge0fn​≥0 almost surely for n≥1n\ge1n≥1.
  • Ω\OmegaΩ is an arbitrary measurable space with a probability measure.

A formalization in which the existential could choose its own filtration, or in which the norms were Bochner integrals (which vanish on non-integrable functions), would trivialize the goal; both are excluded by the statement above.

Infrastructure needed: stopped values at unbounded stopping times and their L1L^1L1 bound; square-function identities for stopped martingales (orthogonality of martingale differences up to a stopping time); conditional-expectation compensators of predictable truncations. The definitions file is shared with the other eight missions of this series and is reusable for any work on discrete-time square and maximal functions. Proofs of the milestones, alternative arguments, and sharper constants are all welcome.

Selected references

  • D. L. Burkholder, Distribution function inequalities for martingales, The Annals of Probability 1(1), 19–42, 1973. https://doi.org/10.1214/aop/1176997023
  • R. F. Gundy, A decomposition for L¹-bounded martingales, The Annals of Mathematical Statistics 39(1), 134–138, 1968. https://doi.org/10.1214/aoms/1177698510
  • D. G. Austin, A sample function property of martingales, The Annals of Mathematical Statistics 37(5), 1396–1397, 1966. https://doi.org/10.1214/aoms/1177699283
  • J. L. Doob, Stochastic Processes, Wiley, New York, 1953.
5 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Inventory Control and Price Theory 1: With Linear Demand and Economic Lot Sizes, the Profit-Maximizing Price Satisfies the Cubic (7)Research Paper

Motivation

Inventory calculations often take the selling price as fixed, while price calculations often treat the cost of supplying demand as independent of the order policy. Whitin's 1955 model connects the two decisions in one annual-profit calculation. A merchant chooses both the price charged to customers and the size of each replenishment order. Changing the price changes annual demand; changing demand changes the number of orders, inventory carrying cost, and therefore the economic lot size. This makes the selling price and the inventory decision parts of the same optimization problem. Whitin's paper gives a compact example in which the connection can be written down explicitly.

The mission concentrates on Section 2, the stationary-demand model for a stable item. Section 3 of the paper studies style goods under uncertain sales and belongs to a separate mission. The result here concerns a deterministic annual demand curve and continuous order quantities, so a solver can focus on the interaction between a classical economic order quantity calculation and a price first-order condition.

Setting

The price is a real number ppp. Annual demand is the linear function D(p)=ap+bD(p)=ap+bD(p)=ap+b, where aaa and bbb are given real constants. A feasible price has D(p)>0D(p)>0D(p)>0. The paper does not require a<0a<0a<0 in its displayed model, so the formal statements leave the slope unrestricted. Negative aaa is the economically usual decreasing-demand case; in other regimes a joint maximum may simply fail to exist.

The merchant pays a fixed setup cost SSS whenever an order is placed. The purchase cost per unit is CCC, and the annual carrying charge for one unit kept in stock is ICICIC, where III is a carrying-rate factor. If Q>0Q>0Q>0 units are ordered each time, average stock is Q/2Q/2Q/2 and the annual number of orders is D/QD/QD/Q. A per-unit operating cost kkk is incurred on annual demand, and fff is an annual fixed cost. The resulting total variable cost and two-variable annual profit are

TVC⁡(D,Q)=Q2IC+DQS+kD,Π(p,Q)=D(p)p−TVC⁡(D(p),Q)−f.\operatorname{TVC}(D,Q)=\frac Q2 IC+\frac DQ S+kD, \qquad \Pi(p,Q)=D(p)p-\operatorname{TVC}(D(p),Q)-f.TVC(D,Q)=2Q​IC+QD​S+kD,Π(p,Q)=D(p)p−TVC(D(p),Q)−f.

Only pairs with D(p)>0D(p)>0D(p)>0 and Q>0Q>0Q>0 are feasible. For a fixed demand level, the economic lot size is Q∗(D)=2DS/(IC)Q^*(D)=\sqrt{2DS/(IC)}Q∗(D)=2DS/(IC)​. Substituting it into profit gives Whitin's reduced profit

P(p)=ap2+bp−2SIC(ap+b)−k(ap+b)−f.P(p)=ap^2+bp-\sqrt{2SIC(ap+b)}-k(ap+b)-f.P(p)=ap2+bp−2SIC(ap+b)​−k(ap+b)−f.

The paper uses PPP for annual profit in this section. The Lean development calls the two-variable function profit and the function after optimizing QQQ reducedProfit.

Formalization targets

The first target is the unique lot-size minimum in Eq. (3), followed by its value in Eq. (4):

TVC⁡(D,Q∗(D))≤TVC⁡(D,Q)(Q>0),TVC⁡(D,Q∗(D))=2DSIC+kD.\operatorname{TVC}(D,Q^*(D))\leq\operatorname{TVC}(D,Q) \quad(Q>0),\qquad \operatorname{TVC}(D,Q^*(D))=\sqrt{2DSIC}+kD.TVC(D,Q∗(D))≤TVC(D,Q)(Q>0),TVC(D,Q∗(D))=2DSIC​+kD.

Equality in the inequality holds only at Q=Q∗(D)Q=Q^*(D)Q=Q∗(D). The next target is the necessary stationarity condition in Eqs. (6)–(7): when D(p)>0D(p)>0D(p)>0 and the derivative of PPP at ppp is zero,

8a3p3+(16a2b−8ka3)p2+(10ab2−12ka2b+2k2a3)p+2b3−4kab2+2k2a2b−SICa2=0.8a^3p^3+(16a^2b-8ka^3)p^2 +(10ab^2-12ka^2b+2k^2a^3)p +2b^3-4kab^2+2k^2a^2b-SICa^2=0.8a3p3+(16a2b−8ka3)p2+(10ab2−12ka2b+2k2a3)p+2b3−4kab2+2k2a2b−SICa2=0.

The goal joins these steps at a global joint maximum. If a feasible pair (p,Q)(p,Q)(p,Q) maximizes Π\PiΠ over all feasible price and lot-size pairs, then Q=Q∗(D(p))Q=Q^*(D(p))Q=Q∗(D(p)) and ppp satisfies the cubic. The goal is an implication about any joint maximizer; it does not assert that one exists for every demand curve. The cubic is a necessary condition only. Its algebraic roots may include prices that fail the original first-order equation or fail to maximize profit.

Significance

The result gives a concrete relation between a price chosen to maximize annual profit and the ordering cost and carrying charge of the inventory system. The lot-size formula alone optimizes cost at a fixed demand rate. The cubic makes the demand response to price and the resulting inventory cost visible in the price condition. It also specifies what can be inferred from the calculation: an optimal price must satisfy the equation, while selecting an optimum from candidate roots remains a separate question.

The paper already supplies the mathematical result. The formalization task is to represent the joint optimization and verify its necessary conditions in Lean, together with the cost identity on which the reduced-profit expression rests. The published Prove2Me definition InventoryControl_eoq already provides the classical EOQ cost and square-root quantity; this mission uses its cost function and adds Whitin's demand curve and profit. Related inventory results for backorders and multilevel systems describe different models and do not replace the targets here.

Difficulty

At a fixed price, choosing the lot size involves both a term proportional to QQQ and one proportional to 1/Q1/Q1/Q. The optimality statement needs a global inequality and a unique equality case, not merely the observation that a derivative vanishes. After substituting that quantity, the reduced profit contains a square root of the demand curve. Its derivative is meaningful on positive demand, and turning its stationarity equation into the displayed cubic loses information when an equation is squared. A proof therefore has to preserve the implication from optimality to the cubic without promoting all cubic roots to optima.

Formalization scope

The model uses real prices, real demands, and real lot sizes; it does not round order quantities to integers. The hypotheses S,I,C>0S,I,C>0S,I,C>0 make explicit the positive cost and carrying-charge conventions of Section 2. Neither kkk nor fff is assigned a sign, and no sign is imposed on aaa or bbb. The conditions Q>0Q>0Q>0 and D(p)>0D(p)>0D(p)>0 apply to every cost or profit comparison. They exclude Lean's total value for division by zero and the zero value assigned by Real.sqrt to a negative argument. The goal quantifies over every feasible pair in a joint maximum of the original profit, so optimizing QQQ is part of its content. Defining profit only by the reduced formula would erase that claim.

The definitions comprise linear demand, total variable cost, two-variable profit, and reduced profit. The classical EOQ cost comes from the existing InventoryControl_eoq definition; the model-specific layer is small and can be reused in further work on pricing with inventory costs. The theorem targets welcome proofs of the global lot-size inequality, the minimized-cost identity, the stationary cubic, and their combination at a joint maximizer. The paper's quantity-discount footnote is outside this scope because it leaves the revised purchase and carrying-cost model unspecified.

Selected references

  • T. M. Whitin, Inventory Control and Price Theory, Management Science 2(1), 1955, pp. 61–68. DOI: 10.1287/mnsc.2.1.61.
6 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations ResearchProbability·Captain: mikedeng1

Values of Large Games II: Oceanic Games 1: Closed-Form Values of Interior Oceanic GamesResearch Paper

Motivation

Weighted voting bodies often combine a few large blocs with a mass of small, unorganized voters: shareholders' meetings with a handful of large holders and a dispersed float, legislatures with party blocs and independents. The Shapley value measures each participant's voting power as the probability of being pivotal — the one whose arrival first turns a losing coalition into a winning one — when participants arrive in a uniformly random order. For many small voters this computation becomes a combinatorial problem whose size grows with the number of voters.

Milnor and Shapley (RAND RM-2649, 1961; revised as Mathematics of Operations Research 3(4), 1978) replaced the small voters by a continuum, the ocean, and obtained explicit formulas for the power of the large voters. The memorandum is the second of a RAND series on values of large games; the first (L. S. Shapley and N. Z. Shapiro, Values of Large Games, I: A Limit Theorem, RM-2648, 1960) proves the limit theorem for finite games with many small players on which the oceanic model rests. This mission formalizes the part of the memorandum that leads to explicit closed forms for the values of interior oceanic games (§2, §4, §5).

Setting

There are mmm major players M={1,…,m}M = \{1, \dots, m\}M={1,…,m} with weights w1,…,wm≥0w_1, \dots, w_m \ge 0w1​,…,wm​≥0, and w(S)=∑j∈Swjw(S) = \sum_{j \in S} w_jw(S)=∑j∈S​wj​. The ocean is the interval I=[0,1]I = [0,1]I=[0,1] with Lebesgue measure, carrying total weight α>0\alpha > 0α>0. In the oceanic game [c;w1,…,wm;α][c; w_1, \dots, w_m; \alpha][c;w1​,…,wm​;α] with quota ccc, a coalition wins when the weight of its major players plus α\alphaα times its share of the ocean is at least ccc.

The random order is modelled by a uniform random point x=(x1,…,xm)x = (x_1, \dots, x_m)x=(x1​,…,xm​) of the cube ImI^mIm: major player jjj is inserted into the ocean at position xjx_jxj​, and P(t)={j:xj<t}P(t) = \{ j : x_j < t \}P(t)={j:xj​<t} is the set of major players placed before position ttt. Player iii is pivotal when

w(P(xi))+αxi≤c≤w(P(xi))+wi+αxi,(2.4)w(P(x_i)) + \alpha x_i \le c \le w(P(x_i)) + w_i + \alpha x_i, \qquad (2.4)w(P(xi​))+αxi​≤c≤w(P(xi​))+wi​+αxi​,(2.4)

and the value φi\varphi_iφi​ of player iii is the probability of (2.4), i.e. the volume of the set Ai⊆ImA_i \subseteq I^mAi​⊆Im where it holds. The combined value of the ocean is Φ=1−∑iφi\Phi = 1 - \sum_{i} \varphi_iΦ=1−∑i​φi​ (2.5).

With the quota yyy as a variable, Γ(y)=[y;w1,…,wm;α]\Gamma(y) = [y; w_1, \dots, w_m; \alpha]Γ(y)=[y;w1​,…,wm​;α] has values φi(y)\varphi_i(y)φi​(y), Φ(y)\Phi(y)Φ(y), and the pivot location F(y)=inf⁡{t≥0:w(P(t))+αt≥y}F(y) = \inf\{t \ge 0 : w(P(t)) + \alpha t \ge y\}F(y)=inf{t≥0:w(P(t))+αt≥y} is a random, nondecreasing, piecewise linear function of yyy with expectation E{F(y)}E\{F(y)\}E{F(y)}. Adding a major player m+1m+1m+1 of weight wm+1w_{m+1}wm+1​ gives the game Γ+\Gamma^+Γ+.

The game is interior when

w(M)≤c≤α,w(M) \le c \le \alpha,w(M)≤c≤α,

that is, the ocean alone wins and the major players together lose. With wˉj=α−wj\bar w_j = \alpha - w_jwˉj​=α−wj​, define π(S)=∏j∈Swjα∏j∈M−Swˉjα\pi(S) = \prod_{j \in S} \tfrac{w_j}{\alpha} \prod_{j \in M - S} \tfrac{\bar w_j}{\alpha}π(S)=∏j∈S​αwj​​∏j∈M−S​αwˉj​​ for S⊆MS \subseteq MS⊆M, the analogous product πi(S)\pi_i(S)πi​(S) over M−{i}M - \{i\}M−{i} for S⊆M−{i}S \subseteq M - \{i\}S⊆M−{i}, and the integers a0=1a_0 = 1a0​=1, an=1−nan−1a_n = 1 - n a_{n-1}an​=1−nan−1​, i.e. 1,0,1,−2,9,−44,…1, 0, 1, -2, 9, -44, \dots1,0,1,−2,9,−44,…

Formalization targets

Goal: Theorem 6 (p. 20)

In an interior game, with s=∣S∣s = |S|s=∣S∣,

φi=wiα∑S⊆M−{i}as πi(S),Φ=∑S⊆Mas π(S).\varphi_i = \frac{w_i}{\alpha} \sum_{S \subseteq M - \{i\}} a_s \, \pi_i(S), \qquad \Phi = \sum_{S \subseteq M} a_s \, \pi(S).φi​=αwi​​S⊆M−{i}∑​as​πi​(S),Φ=S⊆M∑​as​π(S).

Both identities are part of the goal. The values do not depend on ccc within the interior range.

Milestones

  1. §2, p. 5: the pivot sets A1,…,AmA_1, \dots, A_mA1​,…,Am​ overlap only in measure zero.
  2. (4.3): φi(y)=Prob⁡{F(y)=xi}\varphi_i(y) = \operatorname{Prob}\{F(y) = x_i\}φi​(y)=Prob{F(y)=xi​} for 0≤y≤w(M)+α0 \le y \le w(M) + \alpha0≤y≤w(M)+α.
  3. (4.4)–(4.5): for 0<y<w(M)+α0 < y < w(M) + \alpha0<y<w(M)+α, FFF is differentiable at yyy almost surely, ∑iφi(y)=Prob⁡{F′(y)=0}\sum_i \varphi_i(y) = \operatorname{Prob}\{F'(y) = 0\}∑i​φi​(y)=Prob{F′(y)=0} and Φ(y)=Prob⁡{F′(y)=1/α}\Phi(y) = \operatorname{Prob}\{F'(y) = 1/\alpha\}Φ(y)=Prob{F′(y)=1/α}.
  4. Theorem 2, (4.7): Φ(y)=α ddyE{F(y)}\Phi(y) = \alpha \, \frac{d}{dy} E\{F(y)\}Φ(y)=αdyd​E{F(y)}.
  5. Lemma, (4.12)–(4.13): φm+1+(z)=1α∫t1t2Φ(y) dy\varphi^+_{m+1}(z) = \frac{1}{\alpha} \int_{t_1}^{t_2} \Phi(y)\, dyφm+1+​(z)=α1​∫t1​t2​​Φ(y)dy with t1=max⁡(z−wm+1,0)t_1 = \max(z - w_{m+1}, 0)t1​=max(z−wm+1​,0), t2=min⁡(z,w(M)+α)t_2 = \min(z, w(M) + \alpha)t2​=min(z,w(M)+α).
  6. Theorem 5, (5.4): if [c;w1,…,wm;α][c; w_1, \dots, w_m; \alpha][c;w1​,…,wm​;α] and [d;w1,…,wm+1;α][d; w_1, \dots, w_{m+1}; \alpha][d;w1​,…,wm+1​;α] are both interior, φm+1+=1αΦwm+1\varphi^+_{m+1} = \frac{1}{\alpha} \Phi w_{m+1}φm+1+​=α1​Φwm+1​.
  7. Proof of Theorem 6, p. 21: the right-hand sides above add up to 1, an identity valid for all real wjw_jwj​ and α≠0\alpha \ne 0α=0.

Further items, not milestones: the Corollary (5.5), Theorem 3 (averaged over all quotas, each value equals the player's share of the total weight), Theorem 4 (small players behave like ocean), and (5.8) with its footnote (∣an∣|a_n|∣an​∣ is the nearest integer to n!/en!/en!/e and counts derangements).

Significance

Theorem 6 turns the voting power of the large blocs, a priori a probability over a continuum of orderings, into a finite multilinear polynomial in the ratios wj/αw_j/\alphawj​/α. Table 1 of the memorandum lists the cases m≤3m \le 3m≤3, and the theorem gives every mmm. Its coefficients are signed derangement numbers. The Corollary (5.5) states that a major player's value per vote equals the ocean's value per vote in the game without that player.

The memorandum's arguments are short and partly heuristic: "E commutes with the derivative", the disjointness of the pivot sets is "obvious", and the induction for Theorem 6 relies on the symmetry of the value in the major players, which is never stated. A formalization makes each of these steps precise, including the measure-zero exceptions and the quota ranges. To our knowledge none of these results has a machine-checked proof; Mathlib has the Lebesgue measure on cubes, interval integrals and derangement numbers, but no game-theoretic value with a continuum of players.

Difficulty

The values are volumes of regions of ImI^mIm cut out by inequalities whose shape depends on the order of the coordinates, so a direct computation splits into m!m!m! order cells, with the quota ccc entering each. The paper's route avoids this by passing through the random function FFF, Theorem 2 and the Lemma; that route needs differentiation under the integral sign for a function that is only piecewise linear in yyy, with kinks at random locations, and an exact bookkeeping of the interval of integration when the quota approaches the ends of [0,w(M)+α][0, w(M) + \alpha][0,w(M)+α]. Theorem 6 is then an induction on mmm that uses Theorem 5 for every player in turn, so it also needs the invariance of φi\varphi_iφi​ under a relabelling of the major players.

Formalization scope

  • Major players are Fin m (m=0m = 0m=0 is allowed; then Φ=1\Phi = 1Φ=1). The probability of an event is the Lebesgue volume of its intersection with [0,1]m[0,1]^m[0,1]m; no probability space is built.
  • P(t)P(t)P(t) uses the strict inequality xj<tx_j < txj​<t, as printed.
  • φi\varphi_iφi​ is defined as the volume of the pivot set (2.4), for every real quota. Φ\PhiΦ is defined by (2.5), as the paper allows ("We might equally well take (2.5) as the definition of Φ\PhiΦ"). Neither is defined through the formulas of Theorem 6 or through FFF; defining them that way would make the goal an unfolding, and is ruled out.
  • The paper writes (4.2) as a minimum F(y)=min⁡{x∣w(P(x))+αx≥y}F(y) = \min\{x \mid w(P(x)) + \alpha x \ge y\}F(y)=min{x∣w(P(x))+αx≥y}, which need not be attained; FFF is the infimum over t≥0t \ge 0t≥0, the value shown in its Fig. 3.
  • The standing assumptions wj≥0w_j \ge 0wj​≥0 and α>0\alpha > 0α>0 (§2) are explicit hypotheses. The p. 5 footnote's 0≤c≤w(M)+α0 \le c \le w(M)+\alpha0≤c≤w(M)+α applies to the pivot-set milestone. Other quota ranges are explicit: 0≤y≤w(M)+α0 \le y \le w(M) + \alpha0≤y≤w(M)+α for (4.3) and Theorem 2 (one-sided derivatives at the ends), the open interval for (4.4)–(4.5) (two-sided derivatives, stated with HasDerivAt), and 0≤z≤w(M)+wm+1+α0 \le z \le w(M) + w_{m+1} + \alpha0≤z≤w(M)+wm+1​+α for the Lemma, as on p. 14.
  • The added player is appended with Fin.snoc as index Fin.last m.
  • Corollary (5.5) assumes wi>0w_i > 0wi​>0, since it divides by wiw_iwi​. Theorem 4, stated in the paper "in the general oceanic game", is false at quota 000 and when the limit game has no winning coalition; it is stated for 0<c≤w(M−{i})+α0 < c \le w(M - \{i\}) + \alpha0<c≤w(M−{i})+α.
  • The identity of milestone 7 is pure algebra and is stated for all real weights and α≠0\alpha \ne 0α=0.

A complete development needs: measurability of the pivot sets and of FFF in xxx, the structure of FFF as a piecewise linear function of yyy, differentiation of E{F}E\{F\}E{F}, and invariance of the values under permutations of the major players. The pivot-set and FFF infrastructure is reusable for the companion mission on limits of finite weighted majority games. Contributions of any of the milestones, of the symmetry lemma, and of the non-milestone items are welcome.

Selected references

  • J. W. Milnor and L. S. Shapley, Values of Large Games, II: Oceanic Games, The RAND Corporation, Research Memorandum RM-2649, February 1961. https://www.rand.org/pubs/research_memoranda/RM2649.html
  • J. W. Milnor and L. S. Shapley, Values of Large Games II: Oceanic Games, Mathematics of Operations Research 3(4):290–307, 1978. https://doi.org/10.1287/moor.3.4.290
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, 307–317. https://doi.org/10.1515/9781400881970-018
  • L. S. Shapley and N. Z. Shapiro, Values of Large Games, I: A Limit Theorem, The RAND Corporation, Research Memorandum RM-2648, November 1960.
  • R. J. Aumann and L. S. Shapley, Values of Non-Atomic Games, Princeton University Press, 1974. https://doi.org/10.1515/9781400867080
9 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem II: Under Linear Arc Delay αx(t) + β the Arc Exit Time Is Strictly Increasing (FIFO Holds)Research Paper

Motivation

Dynamic traffic assignment models how commuters choose routes and departure times when travel times change over the day. In the model of Friesz, Bernstein, Smith, Tobin and Wie (Oper. Res. 41 (1993)), the time to traverse a path is built recursively from arc exit-time functions: a vehicle that enters an arc at time ttt leaves it at time τ(t)\tau(t)τ(t). The equilibrium conditions of that model refer to the inverses of these functions, so the model is only well defined when every arc exit-time function is invertible.

Invertibility has a direct traffic meaning. A strictly increasing exit time is the first-in-first-out (FIFO) property: a vehicle that enters later cannot leave earlier, so no overtaking occurs on the arc. Whether a given delay model respects FIFO was an active question in the early 1990s, because several delay functions used in practice violate it for some inflow patterns.

Timeline:

  • 1969. Vickrey's bottleneck model introduces deterministic queueing at a single bottleneck (Vickrey 1969).
  • 1986. Ben-Akiva and De Palma show (Trans. Sci. 20 (1986)), for uniform entry rates and deterministic queueing delays, that it is not possible to "arrive earlier by departing later".
  • 1993. Friesz et al. prove (Theorem 1, p. 185) that for every linear arc delay D=αx+βD = \alpha x + \betaD=αx+β the exit time is strictly increasing, extending the 1986 result to all continuous entry-rate patterns (remark, p. 186).

Setting

Consider one arc. Vehicles enter it at the entry rate u(t)≥0u(t) \ge 0u(t)≥0, a continuous function of time t≥0t \ge 0t≥0; the first vehicle enters at time 000. For an exit-time function τ\tauτ, the arc volume at time t≥0t \ge 0t≥0 is the inflow mass of the vehicles that entered during [0,t][0,t][0,t] and have not left by time ttt:

x(t)=∫{s∈[0,t] : τ(s)>t}u(s) ds.x(t) = \int_{\{s \in [0,t]\,:\,\tau(s) > t\}} u(s)\,ds .x(t)=∫{s∈[0,t]:τ(s)>t}​u(s)ds.

The linear delay function (18) of the paper is

D(t)=α x(t)+β,α,β>0,D(t) = \alpha\, x(t) + \beta, \qquad \alpha, \beta > 0,D(t)=αx(t)+β,α,β>0,

a fixed free-flow travel time β\betaβ plus a queueing time determined by the service rate 1/α1/\alpha1/α. The exit time is entry time plus delay, so τ\tauτ is pinned by the exit-time equation

τ(t)=t+α x(t)+β(t≥0).\tau(t) = t + \alpha\, x(t) + \beta \qquad (t \ge 0).τ(t)=t+αx(t)+β(t≥0).

The equation is implicit: τ\tauτ appears on the right through the volume. The proof partitions time at t0=0t_0 = 0t0​=0, tn+1=τ(tn)t_{n+1} = \tau(t_n)tn+1​=τ(tn​); in particular t1=τ(0)=βt_1 = \tau(0) = \betat1​=τ(0)=β is the exit time of the first vehicle. In Lean these objects are linearDelay, arcVolume, IsLinearExitTime and tSeq in FrieszDUE.FIFO.

Formalization targets

Goal: Theorem 1 (p. 185)

For α,β>0\alpha, \beta > 0α,β>0 and a nonnegative continuous entry rate uuu, every τ\tauτ satisfying the exit-time equation is strictly increasing on [0,∞)[0, \infty)[0,∞):

0≤s<t  ⟹  τ(s)<τ(t),0 \le s < t \implies \tau(s) < \tau(t),0≤s<t⟹τ(s)<τ(t),

and hence injective there, so τ−1\tau^{-1}τ−1 exists.

Milestones

  1. Lemma 1 (19): for a differentiable invertible fff, [f−1]′(z)=1/f′[f−1(z)][f^{-1}]'(z) = 1/f'[f^{-1}(z)][f−1]′(z)=1/f′[f−1(z)].
  2. First interval (21)–(24): t1=βt_1 = \betat1​=β; on [0,t1][0, t_1][0,t1​], x(t)=∫0tux(t) = \int_0^t ux(t)=∫0t​u, τ(t)=t+α∫0tu+β\tau(t) = t + \alpha\int_0^t u + \betaτ(t)=t+α∫0t​u+β, and τ′=1+αu>0\tau' = 1 + \alpha u > 0τ′=1+αu>0.
  3. Second interval (25)–(28): on [t1,t2][t_1, t_2][t1​,t2​], τ(t)=t+α∫τ−1(t)tu+β\tau(t) = t + \alpha\int_{\tau^{-1}(t)}^t u + \betaτ(t)=t+α∫τ−1(t)t​u+β and τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t)\tau'(t) = \alpha u(t) + 1/(1 + \alpha u[\tau^{-1}(t)]) > \alpha u(t)τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t).
  4. Induction (29)–(34): the same representation and τ′(t)>αu(t)\tau'(t) > \alpha u(t)τ′(t)>αu(t) on every [tn+1,tn+2][t_{n+1}, t_{n+2}][tn+1​,tn+2​], with τ\tauτ strictly increasing there.
  5. Covering: tn+1−tn≥βt_{n+1} - t_n \ge \betatn+1​−tn​≥β and R+=⋃n≥0[tn,tn+1]\mathbb R_+ = \bigcup_{n \ge 0}[t_n, t_{n+1}]R+​=⋃n≥0​[tn​,tn+1​].

A supporting, non-milestone item states that the exit-time equation has a solution for every admissible uuu.

Significance

The result makes the path exit-time functions of the dynamic network model invertible whenever the arc delays are linear in volume. That invertibility is what allows the path costs, and through them the variational inequality of Theorem 2 of the same paper, to be written down. In traffic terms it certifies that linear volume-based delays never let a later entrant overtake an earlier one, whatever the continuous inflow profile.

The theorem is proved in the paper. As far as is known it has no machine-checked proof. The mission produces one, together with a formal model of a single arc whose exit time is defined implicitly through the volume, which is reusable for other delay functions and for FIFO questions in dynamic traffic assignment.

Difficulty

The obvious argument differentiates τ(t)=t+αx(t)+β\tau(t) = t + \alpha x(t) + \betaτ(t)=t+αx(t)+β and bounds the outflow rate. But the volume can only be written as ∫τ−1(t)tu\int_{\tau^{-1}(t)}^t u∫τ−1(t)t​u once τ\tauτ is known to be invertible, which is the conclusion. The paper breaks the circularity by working forward in time: on [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​] the volume depends only on τ\tauτ restricted to the earlier interval, whose invertibility is already established. A formal proof must make this forward dependence rigorous for an exit time given only by the implicit equation, handle one-sided derivatives at the junctions tnt_ntn​, where τ\tauτ is generally not differentiable, and show that the junctions do not accumulate.

Formalization scope

Time is real; the entry rate is a function u:R→Ru : \mathbb R \to \mathbb Ru:R→R with u(t)≥0u(t) \ge 0u(t)≥0 and uuu continuous on [0,∞)[0, \infty)[0,∞). Both are added hypotheses: Theorem 1 names none, nonnegativity is implicit in "entry rate", and the remark after the proof covers "all continuous entry rate patterns". Integrals are Lebesgue integrals. Monotonicity is claimed on [0,∞)[0,\infty)[0,∞) only, the entry times that the equation constrains. Derivative claims in the milestones are taken within the closed interval [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​]. The paper's separate pieces τk\tau_kτk​ are one global function here, so the junction identities (27), (30), (33) are automatic. Lemma 1 adds the hypothesis f′[f−1(z)]≠0f'[f^{-1}(z)] \ne 0f′[f−1(z)]=0, without which it is false.

The exit time τ is pinned by the implicit equation τ(t) = t + αx(t) + β, where x(t) is the inflow mass of vehicles that entered by time t and have not exited by time t; no monotonicity or invertibility of τ is assumed. A formalization that defined the volume through τ−1\tau^{-1}τ−1 or assumed τ\tauτ monotone would assume the conclusion and is ruled out.

The development needs one-sided derivatives of parametric integrals, the inverse-function derivative on an interval, and a forward induction over the partition. Contributions of proofs for any milestone, of the existence item, and of a uniqueness result for the exit-time equation are welcome.

Selected references

  • T. L. Friesz, D. Bernstein, T. E. Smith, R. L. Tobin and B. W. Wie, A variational inequality formulation of the dynamic network user equilibrium problem, Operations Research 41(1):179–191, 1993. https://doi.org/10.1287/opre.41.1.179
  • M. Ben-Akiva and A. de Palma, Some circumstances in which vehicles will reach their destinations earlier by starting later: revisited, Transportation Science 20(1):52–55, 1986. https://doi.org/10.1287/trsc.20.1.52
  • M. Ben-Akiva, A. de Palma and P. Kanaroglou, Dynamic model of peak period traffic congestion with elastic arrival rates, Transportation Science 20(3):164–181, 1986. https://doi.org/10.1287/trsc.20.3.164
  • W. S. Vickrey, Congestion theory and transport investment, American Economic Review 59(2):251–261, 1969. https://www.jstor.org/stable/1823678
7 thms3 active usersReviewed
🏆Completed
Control TheoryDynamical SystemsPartial Differential Equations·Captain: mikedeng1

An Example on the Effect of Time Delays in Boundary Feedback Stabilization of Wave Equations: The Spectral Stability Trichotomy at the Feedback Gain k = (1 − K)/(1 + K), K = e^{−2a}Research Paper

Why delays in boundary feedback matter

Boundary feedback is the standard way to stabilize vibrating structures governed by wave equations: a sensor measures the velocity at the boundary and an actuator applies a force proportional to it. For the one-dimensional damped wave equation with such feedback, the closed loop is uniformly exponentially stable (Chen, 1979). In practice the measured velocity reaches the actuator only after a computation time, so the feedback acts with a time delay ε>0\varepsilon > 0ε>0. The question addressed by Datko, Lagnese and Polis (1986) is whether arbitrarily small delays can destroy the stability of a system that is stable without them.

Their note answers it with an explicit example and a sharp threshold on the feedback gain. It is the founding example of delay-induced instability in boundary stabilization, cited by most later work on robustness of boundary control to delays.

Timeline.

  • Chen (1979, 1981): energy decay E(u,t)≤Ce−αtE(u,0)E(u,t) \le Ce^{-\alpha t}E(u,0)E(u,t)≤Ce−αtE(u,0) for boundary-damped wave equations without delay.
  • Datko (1978): delays in the velocity term of the equation itself can destabilize; a lemma on zeros of exponential polynomials in vertical strips (the source of Lemma 1 here).
  • Datko, Lagnese, Polis (1986, DOI 10.1137/0324007): the delayed boundary feedback ux(1,t)=−kut(1,t−ε)u_x(1,t) = -ku_t(1,t-\varepsilon)ux​(1,t)=−kut​(1,t−ε) for the damped string, with a trichotomy in the gain kkk.
  • Nicaise and Pignotti (2006, DOI 10.1137/060648891): the multidimensional undamped problem with feedback −μ1ut(t)−μ2ut(t−τ)-\mu_1u_t(t) - \mu_2u_t(t-\tau)−μ1​ut​(t)−μ2​ut​(t−τ); stability iff μ2<μ1\mu_2 < \mu_1μ2​<μ1​, instability for a sequence of delays otherwise.

Setting

Fix real numbers a≥0a \ge 0a≥0 (damping), k≥0k \ge 0k≥0 (feedback gain) and ε>0\varepsilon > 0ε>0 (delay), and put K=e−2a∈(0,1]K = e^{-2a} \in (0,1]K=e−2a∈(0,1]. The delayed system is

(1)utt−uxx+2aut+a2u=0,0<x<1, t>0,(2)u(0,t)=0,t>0,(8)ux(1,t)=−k ut(1,t−ε),t>ε.\begin{aligned} &(1)\quad u_{tt} - u_{xx} + 2au_t + a^2u = 0, && 0<x<1,\ t>0,\\ &(2)\quad u(0,t) = 0, && t>0,\\ &(8)\quad u_x(1,t) = -k\,u_t(1,t-\varepsilon), && t>\varepsilon . \end{aligned}​(1)utt​−uxx​+2aut​+a2u=0,(2)u(0,t)=0,(8)ux​(1,t)=−kut​(1,t−ε),​​0<x<1, t>0,t>0,t>ε.​

A classical solution is a C2C^2C2 function u(x,t)u(x,t)u(x,t) with complex values satisfying (1), (2), (8).

Separated solutions u=eωtφ(x)u = e^{\omega t}\varphi(x)u=eωtφ(x) lead to the eigenvalue problem

φ′′(x)=(a+ω)2φ(x) (0<x<1),φ(0)=0,φ′(1)+kωe−εωφ(1)=0.\varphi''(x) = (a+\omega)^2\varphi(x)\ (0<x<1),\qquad \varphi(0) = 0,\qquad \varphi'(1) + k\omega e^{-\varepsilon\omega}\varphi(1) = 0 .φ′′(x)=(a+ω)2φ(x) (0<x<1),φ(0)=0,φ′(1)+kωe−εωφ(1)=0.

The spectrum σ(a,k,ε)\sigma(a,k,\varepsilon)σ(a,k,ε) is the set of ω∈C\omega \in \mathbb Cω∈C for which this problem has a solution φ\varphiφ not identically zero on [0,1][0,1][0,1]. The paper encodes it through the entire functions

f(ε,ω)=1+Ke−2ω+ke−εω(1−Ke−2ω),h(ε,ω)=ωf(ε,ω)+a(1+Ke−2ω),f(\varepsilon,\omega) = 1 + Ke^{-2\omega} + ke^{-\varepsilon\omega}(1 - Ke^{-2\omega}),\qquad h(\varepsilon,\omega) = \omega f(\varepsilon,\omega) + a(1 + Ke^{-2\omega}),f(ε,ω)=1+Ke−2ω+ke−εω(1−Ke−2ω),h(ε,ω)=ωf(ε,ω)+a(1+Ke−2ω),

and the critical gain (1−K)/(1+K)(1-K)/(1+K)(1−K)/(1+K). In Lean these are K a, f a k ε ω, h a k ε ω, delaySpectrum a k ε, IsClassicalSolution a k ε u and IsExpUnstableSolution a k ε u in the namespace DatkoDelayWave.BoundaryDelay.

Formalization targets

Goal: the stability trichotomy (THEOREM, p. 153)

  1. If 0<k<1−K1+K0 < k < \frac{1-K}{1+K}0<k<1+K1−K​: for each ε>0\varepsilon > 0ε>0 there is β(ε)>0\beta(\varepsilon) > 0β(ε)>0 with
σ(a,k,ε)⊆{Re⁡ω≤−β}.\sigma(a,k,\varepsilon) \subseteq \{\operatorname{Re}\omega \le -\beta\}.σ(a,k,ε)⊆{Reω≤−β}.
  1. If k=1−K1+K>0k = \frac{1-K}{1+K} > 0k=1+K1−K​>0: for each ε>0\varepsilon > 0ε>0, σ(a,k,ε)⊆{Re⁡ω<0}\sigma(a,k,\varepsilon) \subseteq \{\operatorname{Re}\omega < 0\}σ(a,k,ε)⊆{Reω<0}, but there is a countable set R⊆(0,∞)R \subseteq (0,\infty)R⊆(0,∞), dense in (0,∞)(0,\infty)(0,∞), such that for each ε∈R\varepsilon \in Rε∈R some sequence ωn∈σ(a,k,ε)\omega_n \in \sigma(a,k,\varepsilon)ωn​∈σ(a,k,ε) has Re⁡ωn→0\operatorname{Re}\omega_n \to 0Reωn​→0.
  2. If k>1−K1+Kk > \frac{1-K}{1+K}k>1+K1−K​: there is an open set D⊆(0,∞)D \subseteq (0,\infty)D⊆(0,∞), dense in (0,∞)(0,\infty)(0,∞), such that for each ε∈D\varepsilon \in Dε∈D the system has a classical solution with ∣u(x0,t)∣≥ceγt|u(x_0,t)| \ge ce^{\gamma t}∣u(x0​,t)∣≥ceγt for some γ,c>0\gamma, c > 0γ,c>0, x0∈(0,1)x_0 \in (0,1)x0​∈(0,1) and all t≥0t \ge 0t≥0.

Milestones

In attack order: the characteristic equation (16) (ω∈σ  ⟺  h(ε,ω)=0\omega \in \sigma \iff h(\varepsilon,\omega) = 0ω∈σ⟺h(ε,ω)=0 for ω≠−a\omega \ne -aω=−a); separated solutions; Lemma 1 (one zero of fff forces infinitely many zeros of fff and hhh in every vertical strip around it); (17)–(18) (no zeros of hhh in the right half-plane below or at the critical gain); the half-plane bound below the critical gain; (19) (no purely imaginary zeros at the critical gain); the explicit zero f(2(2m+1)2n+1,(2n+1)πi2)=0f\bigl(\tfrac{2(2m+1)}{2n+1}, \tfrac{(2n+1)\pi i}{2}\bigr) = 0f(2n+12(2m+1)​,2(2n+1)πi​)=0; density of the delays 2(2m+1)2n+1\tfrac{2(2m+1)}{2n+1}2n+12(2m+1)​; the root family (12)–(15) above the critical gain; Lemma 2 (an open dense set of delays with zeros of fff in Re⁡ω>0\operatorname{Re}\omega > 0Reω>0); the three parts of the THEOREM separately; and, off the goal's path, the undelayed formula Re⁡ω=12log⁡∣k−1k+1∣\operatorname{Re}\omega = \tfrac12\log\bigl|\tfrac{k-1}{k+1}\bigr|Reω=21​log​k+1k−1​​ for a=0a = 0a=0.

Significance

The result shows that exponential stability obtained by boundary velocity feedback is not robust to delays when the gain is above (1−K)/(1+K)(1-K)/(1+K)(1−K)/(1+K): delays from a dense set of lengths, including arbitrarily small ones, produce exponentially growing modes. When a=0a = 0a=0 the critical gain is 000, so every positive gain is fragile. Below the critical gain the spectral gap survives every delay. This identifies a quantitative robustness margin and motivated the later analysis of delayed boundary control, including the Nicaise–Pignotti theorems already posed on the platform for a different, multidimensional model (NicaiseDelayWave.*).

The result is proved in the paper, partly by citation: Lemma 1 is quoted from Datko (1978) without proof, and the open-mapping step of Lemma 2 is sketched. No machine-checked version exists. A formalization would check the threshold computations, supply the strip-zero lemma for this exponential polynomial, and give a rigorous version of the open-mapping step.

Difficulty

The algebraic parts, (16)–(19) and the explicit zeros, are calculations with complex exponentials. The difficulty is in Lemma 1 and Lemma 2. Lemma 1 needs the almost-periodic structure of exponential polynomials in vertical strips together with a Hurwitz or Rouché type argument, and neither is in Mathlib. Lemma 2 needs zeros of f(ε,⋅)f(\varepsilon,\cdot)f(ε,⋅) to persist under small changes of the real parameter ε\varepsilonε. The paper's route through the logarithmic map (11) does not work as printed, because it is stated with the principal branch exactly on the branch cut. In part (i), the delicate step is excluding accumulation of zeros at the imaginary axis as ∣Im⁡ω∣→∞|\operatorname{Im}\omega| \to \infty∣Imω∣→∞, which the half-plane estimate alone does not give.

Formalization scope

Parameters a,k,εa, k, \varepsilona,k,ε are real, ω∈C\omega \in \mathbb Cω∈C, eigenfunctions are maps R→C\mathbb R \to \mathbb CR→C and solutions are maps u:R→R→Cu : \mathbb R \to \mathbb R \to \mathbb Cu:R→R→C (space first). Partial derivatives are deriv of the sections. Solutions and eigenfunctions are required to be C2C^2C2 on all of R2\mathbb R^2R2, resp. R\mathbb RR; this loses no eigenvalue, since solutions of (5) are combinations of e±(a+ω)xe^{\pm(a+\omega)x}e±(a+ω)x. Committed readings of the paper's loose phrases:

  • the spectrum is the eigenvalue set of the problem above, not the zero set of hhh; h(ε,−a)=0h(\varepsilon,-a) = 0h(ε,−a)=0 always, so (16) is stated for ω≠−a\omega \neq -aω=−a;
  • "countably dense set RRR in (0,∞)(0,\infty)(0,∞)": R⊆(0,∞)R \subseteq (0,\infty)R⊆(0,∞), RRR countable, (0,∞)⊆R‾(0,\infty) \subseteq \overline R(0,∞)⊆R;
  • "dense open set DDD in (0,∞)(0,\infty)(0,∞)": D⊆(0,∞)D \subseteq (0,\infty)D⊆(0,∞) open, (0,∞)⊆D‾(0,\infty) \subseteq \overline D(0,∞)⊆D;
  • "exponentially unstable solution": a classical solution with ∣u(x0,t)∣≥ceγt|u(x_0,t)| \ge ce^{\gamma t}∣u(x0​,t)∣≥ceγt for all t≥0t \ge 0t≥0;
  • "an infinite number of zeros" (Lemma 1): the zero set in the open strip is infinite, for fff and for hhh separately;
  • "there exists β(ε)>0\beta(\varepsilon) > 0β(ε)>0": ∀ε>0 ∃β>0\forall \varepsilon > 0\ \exists \beta > 0∀ε>0 ∃β>0, so β\betaβ may depend on ε\varepsilonε;
  • part (ii) carries k>0k > 0k>0, the paper's standing assumption (p. 152); without it the part is false at a=0a = 0a=0;
  • m,nm, nm,n in 2(2m+1)/(2n+1)2(2m+1)/(2n+1)2(2m+1)/(2n+1) are positive integers in (12)–(15) and in the density of (15), as in the proof of Lemma 2; in the explicit threshold zero, where the page says "m,nm, nm,n are arbitrary", they range over all natural numbers.

Trivializing encodings are ruled out: defining the spectrum as the zero set of hhh would make −a-a−a a spurious spectral point, and reading "exponentially unstable" as "the spectrum meets Re⁡ω>0\operatorname{Re}\omega > 0Reω>0" would delete the solution-level content of part (iii).

A complete development needs zero-counting tools for exponential polynomials in strips (almost periodicity, Hurwitz's theorem), which would be reusable for other delay equations. Contributions to any milestone, and to that general infrastructure, are welcome.

Selected references

  • R. Datko, J. Lagnese, M. P. Polis, An example on the effect of time delays in boundary feedback stabilization of wave equations, SIAM J. Control Optim. 24(1), 152–156, 1986. https://doi.org/10.1137/0324007
  • R. Datko, A procedure for determination of the exponential stability of certain differential-difference equations, Quart. Appl. Math. 36, 279–292, 1978.
  • G. Chen, Energy decay estimates and exact boundary value controllability for the wave equation in a bounded domain, J. Math. Pures Appl. 58, 249–274, 1979.
  • S. Nicaise, C. Pignotti, Stability and instability results of the wave equation with a delay term in the boundary or internal feedbacks, SIAM J. Control Optim. 45(5), 1561–1585, 2006. https://doi.org/10.1137/060648891
16 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Regret in Decision Making under Uncertainty 2: With u(x, y) = x + f(x − y) and f Decreasingly Concave, the Same Decision Maker Takes a Fair Long-Odds Bet and Buys Fair InsuranceResearch Paper

Motivation

Expected utility theory explains a single attitude toward risk by the curvature of a utility function of final wealth: a concave utility makes a decision maker risk averse, a convex one risk seeking. Several well documented patterns of behaviour do not fit this picture. The same people buy insurance against small-probability losses and buy lottery tickets with small-probability gains (Friedman and Savage, 1948, doi:10.1086/256692); subjects who are risk averse for gains are risk seeking for the mirrored losses, the reflection effect; and subjects who are indifferent between full insurance and bearing a risk reject half-price insurance that pays only half the time, probabilistic insurance (Kahneman and Tversky, 1979, doi:10.2307/1914185).

David E. Bell's 1982 paper Regret in Decision Making under Uncertainty (doi:10.1287/opre.30.5.961) proposes that a decision maker cares not only about what she obtains but also about what she would have obtained had she chosen differently. Its first part (the companion mission of this series) derives the representation u(x,y)=αv(x)+f(v(x)−v(y))u(x,y)=\alpha v(x)+f(v(x)-v(y))u(x,y)=αv(x)+f(v(x)−v(y)); its Section 2 shows that the single additive form with linear vvv explains all of the patterns above at once, provided the regret function fff is decreasingly concave. Regret theory, developed at the same time by Loomes and Sugden (1982, doi:10.2307/2232669), remains one of the standard alternatives to expected utility in decision analysis and behavioural economics.

Setting

A decision maker chooses between two alternatives aaa and bbb. Uncertainty is described by finitely many states iii with probabilities πi\pi_iπi​; in state iii alternative aaa gives final assets aia_iai​ and bbb gives bib_ibi​. Choosing aaa means forgoing bbb, and an outcome is valued by the regret utility

u(x,y)=x+f(x−y),u(x,y)=x+f(x-y),u(x,y)=x+f(x−y),

where xxx is the final assets received, yyy the assets the foregone alternative would have given in the same state, and f:R→Rf:\mathbb R\to\mathbb Rf:R→R the regret function. The expected utility of selecting aaa when bbb is foregone is

EUπ(a ∣ b)=∑iπi u(ai,bi),\mathrm{EU}_\pi(a\,|\,b)=\sum_i \pi_i\,u(a_i,b_i),EUπ​(a∣b)=i∑​πi​u(ai​,bi​),

and aaa is strictly preferred to bbb when EUπ(b ∣ a)<EUπ(a ∣ b)\mathrm{EU}_\pi(b\,|\,a)<\mathrm{EU}_\pi(a\,|\,b)EUπ​(b∣a)<EUπ​(a∣b) (the paper's inequality (1)); aaa and bbb are indifferent when the two expected utilities are equal.

The comparisons are given by three payoff tables. Table II: a horse wins with probability ppp; betting \pgivesgivesgives1-pifitwinsandif it wins andifitwinsand-pifitloses,notbettinggivesif it loses, not betting givesifitloses,notbettinggives0.TableIII:acarisdamagedwithprobability. Table III: a car is damaged with probability .TableIII:acarisdamagedwithprobabilitypatacostofat a cost ofatacostof1;insuringgives; insuring gives ;insuringgives-pinbothstates,notinsuringgivesin both states, not insuring givesinbothstates,notinsuringgives-1ororor0.TableIV:anaccidenthasprobability. Table IV: an accident has probability .TableIV:anaccidenthasprobabilityq;selfinsurancegives; self insurance gives ;selfinsurancegives-1ororor0,fullinsurance, full insurance ,fullinsurance-palways,andprobabilisticinsurance,whichchargeshalfthepremiumandpayswithprobabilityonehalfgivenanaccident,givesalways, and probabilistic insurance, which charges half the premium and pays with probability one half given an accident, givesalways,andprobabilisticinsurance,whichchargeshalfthepremiumandpayswithprobabilityonehalfgivenanaccident,gives-p,, ,-1ororor-p/2$.

The regret function fff is decreasingly concave if it is twice differentiable with strictly increasing second derivative f′′f''f′′. Section 3 also uses g(r)=r+f(r)−f(−r)g(r)=r+f(r)-f(-r)g(r)=r+f(r)−f(−r) and the negative exponential f(r)=1−e−γrf(r)=1-e^{-\gamma r}f(r)=1−e−γr, γ>0\gamma>0γ>0.

Formalization targets

Goal: coexistence of insurance and gambling

If fff is decreasingly concave and 0<p<120<p<\tfrac120<p<21​, then the bet of Table II is strictly preferred to not betting and insuring in Table III is strictly preferred to not insuring:

p [f(1−p)−f(p−1)]>(1−p) [f(p)−f(−p)].p\,[f(1-p)-f(p-1)]>(1-p)\,[f(p)-f(-p)].p[f(1−p)−f(p−1)]>(1−p)[f(p)−f(−p)].

Both comparisons have equal expected values, so the statement is a pure regret effect. The goal fixes no constants and assumes nothing about fff beyond decreasing concavity; it is the weakest hypothesis the page offers.

Milestones

  1. Display (5): the bet is preferred iff the inequality above; display (6): insurance is preferred iff the same inequality, so the two preferences coincide.
  2. The inequality holds for 0<p<120<p<\tfrac120<p<21​ whenever (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x is strictly increasing on x>0x>0x>0; and that ratio is strictly increasing whenever f′′(x)>f′′(−x)f''(x)>f''(-x)f′′(x)>f′′(−x) for x>0x>0x>0.
  3. The reflection effect (Sec. 2(ii)): x2x_2x2​ for sure is indifferent to the lottery (p:x1; 1−p:x3)(p:x_1;\,1-p:x_3)(p:x1​;1−p:x3​) iff −x2-x_2−x2​ for sure is indifferent to (p:−x1; 1−p:−x3)(p:-x_1;\,1-p:-x_3)(p:−x1​;1−p:−x3​).
  4. Probabilistic insurance (Sec. 2(iii)): display (9) characterises indifference between full and self insurance; under (9) and 0≤q<10\le q<10≤q<1,
f(p/2)−f(−p/2)<12 [f(p)−f(−p)](11)f(p/2)-f(-p/2)<\tfrac12\,[f(p)-f(-p)]\qquad(11)f(p/2)−f(−p/2)<21​[f(p)−f(−p)](11)

holds iff full insurance is strictly preferred to probabilistic insurance, iff probabilistic insurance is strictly preferred to self insurance; and (11) follows from the same ratio condition. 5. The negative exponential (Sec. 3): fff concave, ggg convex on r≥0r\ge0r≥0, g(r)/rg(r)/rg(r)/r strictly increasing on r>0r>0r>0, and fff decreasingly concave.

Significance

The goal is the paper's central behavioural claim: one regret function explains why the same decision maker gambles on long odds and buys insurance at fair prices, behaviour that a single concave or convex utility of wealth cannot produce. The milestones show that the reflection effect and the rejection of probabilistic insurance follow from the same model, and two of them reduce to the same inequality on the odd part f(x)−f(−x)f(x)-f(-x)f(x)−f(−x) of the regret function. The negative exponential example shows the hypotheses are met by a concrete, commonly used function, so the explanation is not vacuous.

The results are proved in the paper by short calculations, and none of them has been machine-checked before. The mission produces a formal statement of the regret model of Section 2 with its payoff tables, which pins down several points the printed text leaves loose: the meaning of "decreasingly concave", the domain on which "increasing" and "convex" are meant, and three misprinted intermediate displays.

Difficulty

The comparisons (5), (6), (9) and the reflection identity are algebraic once the payoff tables are expanded; the work is in expanding them correctly, since the foregone argument of uuu changes with the alternative selected and three printed expansions are wrong. The substance lies in the analytic step: passing from a pointwise condition on f′′f''f′′ to strict monotonicity of (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x on (0,∞)(0,\infty)(0,∞), with strict inequalities throughout and through a quotient that is undefined at 000. The naive reading of the page's condition, "f′′(x)>f′′(−x)f''(x)>f''(-x)f′′(x)>f′′(−x) for all xxx", is unsatisfiable and cannot be used as a hypothesis.

Formalization scope

All quantities are real numbers. The utility is regretU f x y = x + f (x - y), i.e. form (4) with v(x)=xv(x)=xv(x)=x exactly; the page assumes vvv only "approximately linear" but computes every display with v(x)=xv(x)=xv(x)=x. A comparison is a finite state space Fin n with a real weight vector; the theorems instantiate it with (p,1−p)(p,1-p)(p,1−p) for Tables II–III and with (q/2,q/2,1−q)(q/2,q/2,1-q)(q/2,q/2,1−q) for Table IV, the accident state split by whether the insurer pays. Strict preference is strict inequality of expected regret utilities; indifference is equality.

Conventions and corrections, each disclosed in the item concerned:

  • "Decreasingly concave" is not defined in the paper; it is read as Differentiable ℝ f, Differentiable ℝ (deriv f) and StrictMono (deriv (deriv f)). The page's presumption that fff is increasing and concave is not assumed.
  • "Increasing" is read strictly, because the conclusions (5), (6), (11) are strict, and on x>0x>0x>0, because (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x is undefined at 000 and even.
  • "f′′(x)>f′′(−x)f''(x)>f''(-x)f′′(x)>f′′(−x) for all xxx" is read for x>0x>0x>0.
  • The convexity of ggg in the exponential example is stated on r≥0r\ge0r≥0: g(r)=r+2sinh⁡(γr)g(r)=r+2\sinh(\gamma r)g(r)=r+2sinh(γr) is concave for r<0r<0r<0, as the paper itself notes on p. 977.
  • Misprints corrected: the last bracket of the second reflection equality on p. 973; f(p/2)f(p/2)f(p/2) for f(−p/2)f(-p/2)f(−p/2) in the expansion before (10) and in the probabilistic-versus-self display on p. 975, which also lacks a factor qqq. The normalisation f(0)=0f(0)=0f(0)=0 is not needed.
  • The equivalences (5), (6), (9) and the reflection identity hold for every real probability and are stated without a range; the goal keeps 0<p<120<p<\tfrac120<p<21​ and the probabilistic-insurance statement keeps 0≤q<10\le q<10≤q<1.

The goal cannot be satisfied vacuously: the negative exponential milestone exhibits a decreasingly concave fff, and the conclusion is a strict preference between two alternatives of equal expected value. Section 2(iv) (preference reversals) is not formalized: its printed rewriting of (12) in terms of hhh drops a linear term and its conclusion is unquantified ("for sufficiently small units of money").

Contributions welcome: proofs of the algebraic reductions, the slope argument for (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x, and the convexity facts for sinh⁡\sinhsinh; the latter two are reusable beyond this mission.

Selected references

  • D. E. Bell, Regret in Decision Making under Uncertainty, Operations Research 30(5), 961–981, 1982. doi:10.1287/opre.30.5.961
  • D. Kahneman and A. Tversky, Prospect Theory: An Analysis of Decision under Risk, Econometrica 47(2), 263–291, 1979. doi:10.2307/1914185
  • G. Loomes and R. Sugden, Regret Theory: An Alternative Theory of Rational Choice under Uncertainty, The Economic Journal 92(368), 805–824, 1982. doi:10.2307/2232669
  • M. Friedman and L. J. Savage, The Utility Analysis of Choices Involving Risk, Journal of Political Economy 56(4), 279–304, 1948. doi:10.1086/256692
12 thms3 active usersReviewed
🏆Completed
Differential GeometryOptimization·Captain: mikedeng1

Projection-like Retractions on Matrix Manifolds II: The Metric Projection onto a C^k Submanifold Is Locally Unique and C^(k−1), so Projecting a Tangent Step Is a RetractionResearch Paper

Motivation

Many optimization problems in statistics, signal processing and control are posed over sets of matrices with a constraint that makes them curved: matrices of fixed rank, matrices with orthonormal columns, symmetric matrices with a prescribed spectrum. Algorithms on such sets ("optimization on manifolds") compute a step in the tangent space at the current point, as in a vector space, and then need a rule that brings the point x+ux+ux+u back to the set. A retraction is such a rule; the notion was introduced by Adler, Dedieu, Margulies, Martens and Shub for Newton's method on Riemannian manifolds (IMA J. Numer. Anal. 2002) and is the basic building block of the algorithms in Absil, Mahony and Sepulchre's monograph (Princeton, 2008). Any retraction preserves the local convergence of Newton's method, so the choice among retractions is about cost and convenience.

The most natural candidate is to project x+ux+ux+u back onto the manifold: take the nearest point. Absil and Malick (SIAM J. Optim. 2012; preprint HAL hal-00651608) show in §3.1 that this projective retraction is always a valid retraction of maximal smoothness, and then compute it for fixed-rank, spectral and Stiefel manifolds. The underlying fact, that the nearest-point map onto a CkC^kCk submanifold is locally single-valued and Ck−1C^{k-1}Ck−1, is classical (the paper cites Lewis and Malick, Math. Oper. Res. 2008); the paper gives a short proof through the inverse function theorem on the normal bundle. This mission formalizes §3.1: that lemma and the resulting retraction.

Setting

Let E\mathcal EE be a Euclidean space, a finite-dimensional real inner product space, of dimension nnn (in the paper's examples, Rn×m\mathbb R^{n\times m}Rn×m with the Frobenius inner product). A set M⊆E\mathcal M\subseteq\mathcal EM⊆E is a submanifold of class CkC^kCk and dimension ddd around xˉ\bar xxˉ if xˉ∈M\bar x\in\mathcal Mxˉ∈M and there are an open neighbourhood UEU_{\mathcal E}UE​ of xˉ\bar xxˉ and a CkC^kCk diffeomorphism φ\varphiφ from UEU_{\mathcal E}UE​ onto an open subset of Rn\mathbb R^nRn with

M∩UE={x∈UE: φd+1(x)=⋯=φn(x)=0}.\mathcal M\cap U_{\mathcal E}=\{x\in U_{\mathcal E}:\ \varphi_{d+1}(x)=\cdots=\varphi_n(x)=0\}.M∩UE​={x∈UE​: φd+1​(x)=⋯=φn​(x)=0}.

The tangent space TM(x)T_{\mathcal M}(x)TM​(x) is the linear subspace of E\mathcal EE spanned by the tangent cone of M\mathcal MM at xxx, and the normal space is NM(x)=TM(x)⊥N_{\mathcal M}(x)=T_{\mathcal M}(x)^\perpNM​(x)=TM​(x)⊥. The tangent bundle and normal bundle are TM={(x,u):x∈M, u∈TM(x)}T\mathcal M=\{(x,u):x\in\mathcal M,\ u\in T_{\mathcal M}(x)\}TM={(x,u):x∈M, u∈TM​(x)} and NM={(x,v):x∈M, v∈NM(x)}N\mathcal M=\{(x,v):x\in\mathcal M,\ v\in N_{\mathcal M}(x)\}NM={(x,v):x∈M, v∈NM​(x)}, subsets of E×E\mathcal E\times\mathcal EE×E. PTM(x)P_{T_{\mathcal M}(x)}PTM​(x)​ denotes the orthogonal projector onto TM(x)T_{\mathcal M}(x)TM​(x).

The projection of x∈Ex\in\mathcal Ex∈E onto M\mathcal MM is the set of nearest points,

PM(x)=argmin⁡{∥x−y∥: y∈M},P_{\mathcal M}(x)=\operatorname{argmin}\{\|x-y\|:\ y\in\mathcal M\},PM​(x)=argmin{∥x−y∥: y∈M},

which may be empty (if M\mathcal MM is not closed) or contain several points (if M\mathcal MM is not convex).

A map RRR from TMT\mathcal MTM to M\mathcal MM is a retraction around xˉ\bar xxˉ (Definition 2.1) if on some neighbourhood U\mathcal UU of (xˉ,0)(\bar x,0)(xˉ,0) in TMT\mathcal MTM it is of class Ck−1C^{k-1}Ck−1, satisfies R(x,0)=xR(x,0)=xR(x,0)=x, and DR(x,⋅)(0)=idTM(x)\mathrm DR(x,\cdot)(0)=\mathrm{id}_{T_{\mathcal M}(x)}DR(x,⋅)(0)=idTM​(x)​ for (x,0)∈U(x,0)\in\mathcal U(x,0)∈U.

The formal retraction predicate includes k≥2k\ge2k≥2 and a local submanifold chart at xˉ\bar xxˉ; this ensures that its base point lies on M\mathcal MM.

Formalization targets

Goal: Proposition 3.2 (projective retraction)

For M\mathcal MM a CkC^kCk submanifold (k≥2k\ge2k≥2) around xˉ\bar xxˉ, the map

R(x,u)=PM(x+u),(x,u)∈TM,R(x,u)=P_{\mathcal M}(x+u),\qquad (x,u)\in T\mathcal M,R(x,u)=PM​(x+u),(x,u)∈TM,

is single-valued near (xˉ,0)(\bar x,0)(xˉ,0) in TMT\mathcal MTM, and this single value is a retraction around xˉ\bar xxˉ.

Milestones

  1. (3.2) If p∈PM(x)p\in P_{\mathcal M}(x)p∈PM​(x) and M\mathcal MM is a CkC^kCk submanifold around ppp, then p∈Mp\in\mathcal Mp∈M and x−p∈NM(p)x-p\in N_{\mathcal M}(p)x−p∈NM​(p).
  2. (3.3) TNM(xˉ,0)=TM(xˉ)×NM(xˉ)T_{N\mathcal M}(\bar x,0)=T_{\mathcal M}(\bar x)\times N_{\mathcal M}(\bar x)TNM​(xˉ,0)=TM​(xˉ)×NM​(xˉ).
  3. Lemma 3.1 There is δ>0\delta>0δ>0 such that on B(xˉ,δ)B(\bar x,\delta)B(xˉ,δ) the projection PMP_{\mathcal M}PM​ is a single point P(x)P(x)P(x), the map PPP is Ck−1C^{k-1}Ck−1, and
DPM(xˉ)=PTM(xˉ).\mathrm DP_{\mathcal M}(\bar x)=P_{T_{\mathcal M}(\bar x)}.DPM​(xˉ)=PTM​(xˉ)​.

Significance

The projective retraction is the reference retraction on an embedded submanifold: it exists for every CkC^kCk submanifold, it has the maximal smoothness Ck−1C^{k-1}Ck−1 allowed by the tangent bundle, and it is the one practitioners compute first (truncated SVD for fixed-rank matrices, polar factor for the Stiefel manifold). Section 4 of the paper shows that it is moreover second order and generalizes it to projections along arbitrary smooth fields of transverse subspaces; Lemma 3.1 is the model of that argument. Lemma 3.1 on its own is a basic tool well beyond retractions: local single-valuedness and smoothness of the nearest-point map underlies the local convergence analysis of alternating projections on manifolds and the theory of prox-regular sets.

All statements here are proved results. No machine-checked proof of them is known to exist: Mathlib has the inverse function theorem, tangent cones and orthogonal projections onto subspaces, but no embedded submanifolds of a Euclidean space with their normal bundle and no nearest-point map onto non-convex sets. The mission produces these statements in Lean and invites proofs of them.

Difficulty

The obvious argument writes the nearest point as a critical point of y↦∥x−y∥2y\mapsto\|x-y\|^2y↦∥x−y∥2 on M\mathcal MM and applies the implicit function theorem. Two things break. First, existence: M\mathcal MM is not assumed closed, so a nearest point exists only because M\mathcal MM is locally closed near xˉ\bar xxˉ and points of M\mathcal MM far from xˉ\bar xxˉ are farther from xxx than xˉ\bar xxˉ is. Second, uniqueness: critical points are not unique in general, and the implicit function theorem only describes critical points near a given one. Uniqueness needs a quantitative argument that every nearest point of xxx lies in the region where (p,v)↦p+v(p,v)\mapsto p+v(p,v)↦p+v on the normal bundle is injective. Finally, the normal bundle is itself only a Ck−1C^{k-1}Ck−1 manifold, whose tangent space at (xˉ,0)(\bar x,0)(xˉ,0) must be identified before the inverse function theorem applies; this is milestone (3.3).

Formalization scope

The ambient space is any type E with [NormedAddCommGroup E] [InnerProductSpace ℝ E] [FiniteDimensional ℝ E]; nnn is Module.finrank ℝ E, and k,dk,dk,d are natural numbers with k≥2k\ge2k≥2 stated as a hypothesis (so that k−1k-1k−1 in ℕ is honest). The paper's standing assumption "M\mathcal MM is a submanifold of class CkC^kCk (k≥2k\ge2k≥2) and dimension ddd" enters only as the local hypothesis IsSubmanifoldAt k d M xbar, exactly as Lemma 3.1 and Proposition 3.2 state it ("around xˉ\bar xxˉ"). The chart is an OpenPartialHomeomorph onto EuclideanSpace ℝ (Fin n), CkC^kCk in both directions, with 0-based coordinates. No closedness of M\mathcal MM is assumed, because the paper does not assume it.

The projection is the platform predicate IsMetricProjection M x z (z∈Mz\in\mathcal Mz∈M and ∥x−z∥≤∥x−w∥\|x-z\|\le\|x-w\|∥x−z∥≤∥x−w∥ for all w∈Mw\in\mathcal Mw∈M); single-valuedness is stated as equality of the set of such zzz with a singleton, which asserts existence and uniqueness. A formalization that only states "some selection is Ck−1C^{k-1}Ck−1", or uses ⊆\subseteq⊆ (satisfied by the empty set), would drop the main claim and is ruled out. The tangent space is the span of Mathlib's tangentConeAt; "class Ck−1C^{k-1}Ck−1 on a neighbourhood in TMT\mathcal MTM" is ContDiffOn on O∩TMO\cap T\mathcal MO∩TM with OOO open; DR(x,⋅)(0)=id\mathrm DR(x,\cdot)(0)=\mathrm{id}DR(x,⋅)(0)=id is a HasFDerivAt statement on the normed space TM(x)T_{\mathcal M}(x)TM​(x); PTM(xˉ)P_{T_{\mathcal M}(\bar x)}PTM​(xˉ)​ is Submodule.starProjection.

A complete development needs: the tangent space of a slice submanifold equals the image of the chart's derivative, the normal bundle as a Ck−1C^{k-1}Ck−1 manifold, an inverse function theorem on it, and compactness of M∩Bˉ(xˉ,r)\mathcal M\cap\bar B(\bar x,r)M∩Bˉ(xˉ,r) for small rrr. These are reusable for the other missions of this series (fixed-rank, spectral and Stiefel manifolds, and the retractor construction of Section 4), and contributions of such general lemmas as intermediate theorems are welcome.

Selected references

  • P.-A. Absil and J. Malick, Projection-like retractions on matrix manifolds, SIAM J. Optim. 22(1):135–158, 2012. https://doi.org/10.1137/100802529 (preprint: https://hal.science/hal-00651608, version 2, the basis of the statement indices here)
  • R. L. Adler, J.-P. Dedieu, J. Y. Margulies, M. Martens and M. Shub, Newton's method on Riemannian manifolds and a geometric model for the human spine, IMA J. Numer. Anal. 22:359–390, 2002. https://doi.org/10.1093/imanum/22.3.359
  • P.-A. Absil, R. Mahony and R. Sepulchre, Optimization Algorithms on Matrix Manifolds, Princeton University Press, 2008. https://doi.org/10.1515/9781400830244
  • A. S. Lewis and J. Malick, Alternating projections on manifolds, Math. Oper. Res. 33(1):216–234, 2008. https://doi.org/10.1287/moor.1070.0291
8 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization+2·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case VI: Lower Semianalytic Functions — Analytically Measurable ε-Optimal Selectors (Jankov–von Neumann)Textbook

Motivation

Dynamic programming over uncountable state and control spaces needs two things at every stage: the optimal cost-to-go, obtained by minimizing over the control, must be a function that can be integrated against the next stage's transition probabilities, and a policy that nearly attains the minimum must be measurable, so that it defines a stochastic process. With Borel-measurable costs and Borel-measurable policies both requirements fail. Minimizing a Borel function of (x,y)(x,y)(x,y) over yyy produces a function whose level sets are projections of Borel sets, and such projections need not be Borel (Suslin, 1917). The repair, developed by Blackwell, Freedman and Orkin (1974), Shreve and Bertsekas, and set out in Chapter 7 of Bertsekas and Shreve's Stochastic Optimal Control: The Discrete-Time Case (1978), is to enlarge the class of costs to the lower semianalytic functions and the class of policies to the analytically or universally measurable ones. Sections 7.6–7.7 of the book establish that this class is closed under partial minimization and admits measurable ε-optimal selectors. Chapters 8–10 of the book, and much of the later literature on Borel-space Markov decision processes (Hernández-Lerma and Lasserre; Feinberg and coauthors), build on these results.

Timeline:

  • 1917: Suslin shows that projections of Borel sets need not be Borel and introduces analytic sets; Lusin proves that analytic sets are universally measurable.
  • 1941–1949: Jankov and von Neumann independently prove that an analytic subset of a product admits a selector measurable with respect to the σ-algebra generated by analytic sets.
  • 1974: Blackwell, Freedman and Orkin use analytic sets to construct ε-optimal policies in Borel dynamic programming.
  • 1978: Bertsekas and Shreve give the treatment used here (§7.6–7.7), including the selection theorem for lower semianalytic functions, Proposition 7.50.

Setting

A Borel space is a topological space homeomorphic to a Borel subset of a complete separable metric space (Definition 7.7); its Borel σ-algebra is BX\mathscr B_XBX​. The Baire space is N=NN\mathscr N=\mathbb N^{\mathbb N}N=NN with the product topology. A set A⊆XA\subseteq XA⊆X is analytic if it is empty or the image of N\mathscr NN under a continuous map; by Proposition 7.41 this is the book's Definition 7.16 (the Suslin operation applied to closed sets). Every Borel set is analytic, and the converse fails when XXX is uncountable.

Three σ-algebras on XXX are in play. The analytic σ-algebra AX\mathscr A_XAX​ is generated by the analytic sets (Definition 7.19). The universal σ-algebra is UX=⋂pBX(p)\mathscr U_X=\bigcap_{p}\mathscr B_X(p)UX​=⋂p​BX​(p), the intersection over all probability measures ppp on (X,BX)(X,\mathscr B_X)(X,BX​) of the ppp-completions of BX\mathscr B_XBX​ (Definition 7.18). For a function fff from D⊆XD\subseteq XD⊆X into a Borel space YYY, fff is analytically measurable if D∈AXD\in\mathscr A_XD∈AX​ and f−1(B)∈AXf^{-1}(B)\in\mathscr A_Xf−1(B)∈AX​ for every B∈BYB\in\mathscr B_YB∈BY​, and universally measurable if the same holds with UX\mathscr U_XUX​ (Definition 7.20).

Let R∗=[−∞,∞]R^*=[-\infty,\infty]R∗=[−∞,∞]. A function f:D→R∗f:D\to R^*f:D→R∗ is lower semianalytic if DDD is analytic and {x∈D∣f(x)<c}\{x\in D\mid f(x)<c\}{x∈D∣f(x)<c} is analytic for every real ccc (Definition 7.21). For D⊆X×YD\subseteq X\times YD⊆X×Y write Dx={y∣(x,y)∈D}D_x=\{y\mid (x,y)\in D\}Dx​={y∣(x,y)∈D}, projX(D)={x∣Dx≠∅}\mathrm{proj}_X(D)=\{x\mid D_x\neq\emptyset\}projX​(D)={x∣Dx​=∅}, and define the partial infimum

f∗(x)=inf⁡y∈Dxf(x,y),x∈projX(D).f^*(x)=\inf_{y\in D_x}f(x,y),\qquad x\in\mathrm{proj}_X(D).f∗(x)=y∈Dx​inf​f(x,y),x∈projX​(D).

A selector is a function φ:projX(D)→Y\varphi:\mathrm{proj}_X(D)\to Yφ:projX​(D)→Y whose graph Gr(φ)\mathrm{Gr}(\varphi)Gr(φ) lies in DDD.

Formalization targets

Goal: Proposition 7.50

Let X,YX,YX,Y be Borel spaces, D⊆X×YD\subseteq X\times YD⊆X×Y analytic, and f:D→R∗f:D\to R^*f:D→R∗ lower semianalytic.

(a) For every ε>0\varepsilon>0ε>0 there is an analytically measurable selector φ\varphiφ with

f[x,φ(x)]≤{f∗(x)+εif f∗(x)>−∞,−1/εif f∗(x)=−∞.f[x,\varphi(x)]\le\begin{cases}f^*(x)+\varepsilon&\text{if }f^*(x)>-\infty,\\-1/\varepsilon&\text{if }f^*(x)=-\infty.\end{cases}f[x,φ(x)]≤{f∗(x)+ε−1/ε​if f∗(x)>−∞,if f∗(x)=−∞.​

(b) The set III of points where the infimum is attained is universally measurable, and for every ε>0\varepsilon>0ε>0 there is a universally measurable selector φ\varphiφ with f[x,φ(x)]=f∗(x)f[x,\varphi(x)]=f^*(x)f[x,φ(x)]=f∗(x) on III and the bounds of (a) off III.

The goal fixes no constant beyond the book's ε\varepsilonε and −1/ε-1/\varepsilon−1/ε.

Milestones

In attack order: Proposition 7.40 (Borel images and preimages of analytic sets are analytic), Corollary 7.42.1 (AX⊆UX\mathscr A_X\subseteq\mathscr U_XAX​⊆UX​), Corollary 7.44.2 (composites of analytically measurable maps are universally measurable), and Proposition 7.49, the Jankov–von Neumann theorem:

A⊆X×Y analytic ⟹ ∃ φ:projX(A)→Y analytically measurable, Gr(φ)⊆A.A\subseteq X\times Y\text{ analytic}\ \Longrightarrow\ \exists\,\varphi:\mathrm{proj}_X(A)\to Y\ \text{analytically measurable},\ \mathrm{Gr}(\varphi)\subseteq A.A⊆X×Y analytic ⟹ ∃φ:projX​(A)→Y analytically measurable, Gr(φ)⊆A.

Further items of the mission, on the same definitions: Proposition 7.39 (projections of analytic sets are analytic, and every analytic set is a projection of a Borel set), Lemma 7.30(1) (strict and non-strict, real and extended level sets give the same class) and Proposition 7.47 (lower semianalytic functions are exactly partial infima of Borel functions).

Significance

Proposition 7.50 is the selection theorem behind the existence of ε-optimal policies in Borel-space dynamic programming. In the finite-horizon model of Chapter 8 the optimal cost-to-go at each stage is lower semianalytic, by Propositions 7.47 and 7.48. Proposition 7.50 then turns the one-stage minimization into a measurable policy, analytically measurable when only ε-optimality is required and universally measurable when the minimum is attained. Chapters 8–9 of the book (the finite-horizon recursion JK∗=TK(J0)J^*_K=T^K(J_0)JK∗​=TK(J0​) and the optimality equation under (P), (N), (D)) use it at every step. Downstream catalog papers on average-cost and stochastic shortest-path problems over Borel spaces cite these results.

All results here are proved in the book and in the descriptive set theory literature (Kechris, Classical Descriptive Set Theory, §18 and §29). None is formalized on Prove2Me. Mathlib has analytic sets in Polish-type settings, the Lusin separation theorem and Suslin's theorem, but it has no universal σ-algebra, no analytic σ-algebra, no lower semianalytic functions and no Jankov–von Neumann uniformization. The definitions in this mission are reusable by the later missions of the series (Chapters 8–10), which restate them locally until these are published.

Difficulty

The obvious route to a selector is to choose, for each xxx, a minimizing or near-minimizing yyy. The axiom of choice provides such a function, but nothing makes it measurable, and the conclusion of the theorem is exactly that measurability. The Borel route fails too: the set {x∣f∗(x)<c}\{x\mid f^*(x)<c\}{x∣f∗(x)<c} is a projection of a Borel set, which is analytic but in general not Borel, so no Borel-measurable selector exists in general. The Jankov–von Neumann theorem needs a lexicographically least branch of a continuous parametrization of AAA by N\mathscr NN, and an argument that the resulting map is measurable with respect to AX\mathscr A_XAX​, which is generated by sets that are not closed under complementation. Part (b) adds a further obstacle: the composite of two analytically measurable maps need not be analytically measurable, so the exact selector is only universally measurable. Proving that requires Lusin's theorem that analytic sets are measurable for every completed probability measure.

Formalization scope

  • A Borel space is a type with a topology satisfying the class IsBorelSpace (Definition 7.7, the ambient complete separable metric space taken in the same universe), together with Mathlib's [MeasurableSpace X] [BorelSpace X], so measurable sets are exactly the Borel sets. On X×YX\times YX×Y the product σ-algebra is used; it coincides with BX×Y\mathscr B_{X\times Y}BX×Y​ for separable metrizable spaces (Proposition 7.13).
  • Analytic sets are Mathlib's MeasureTheory.AnalyticSet (empty or a continuous image of ℕ → ℕ).
  • R∗R^*R∗ is EReal. The book uses ∞−∞=∞\infty-\infty=\infty∞−∞=∞, and Mathlib's EReal uses ⊥+⊤=⊥\bot+\top=\bot⊥+⊤=⊥. No statement of this mission adds infinities of opposite sign; f∗(x)+εf^*(x)+\varepsilonf∗(x)+ε adds a real number.
  • Functions on DDD and on projX(D)\mathrm{proj}_X(D)projX​(D) are functions on subtypes. The graph condition Gr(φ)⊆D\mathrm{Gr}(\varphi)\subseteq DGr(φ)⊆D is part of every selector statement.
  • Universally measurable means NullMeasurableSet E p for every probability measure p.
  • "Analytically measurable" refers to the σ-algebra generated by analytic sets. Replacing it by the power set, dropping the graph condition, or dropping the −1/ε-1/\varepsilon−1/ε case would make the selection theorems a consequence of the axiom of choice. The statements rule all three out.

Not included: Lusin's theorem in Suslin-scheme form (Proposition 7.42, which needs the Suslin operation as a definition), Proposition 7.43 on P(X)P(X)P(X), the integration results of Propositions 7.46 and 7.48, and Lemma 7.30(2)–(4). None is used in the proof of the goal. Contributions welcome: the bridge between IsBorelSpace and Mathlib's StandardBorelSpace, the universal σ-algebra API, and the Jankov–von Neumann theorem itself.

Selected references

  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press 1978; Athena Scientific 1996, §7.6–7.7. https://web.mit.edu/dimitrib/www/soc.html
  • D. Blackwell, D. Freedman and M. Orkin, The optimal reward operator in dynamic programming, Annals of Probability 2 (1974) 926–941. https://doi.org/10.1214/aop/1176996558
  • A. S. Kechris, Classical Descriptive Set Theory, Graduate Texts in Mathematics 156, Springer 1995, §18 (Jankov–von Neumann uniformization), §29 (measurability of analytic sets). https://doi.org/10.1007/978-1-4612-4190-4
  • S. E. Shreve and D. P. Bertsekas, Universally measurable policies in dynamic programming, Mathematics of Operations Research 4 (1979) 15–30. https://doi.org/10.1287/moor.4.1.15
8 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization+2·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case V: Semicontinuous Functions — a Borel-Measurable Minimizing Selector for Lower Semicontinuous CostsTextbook

Motivation

Every step of the dynamic programming algorithm on a general state space does three things: it takes a conditional expectation of the cost-to-go under a transition kernel, it minimizes the resulting function of state and control over the control, and, if a policy is to be produced, it picks a control for each state that attains or nearly attains that minimum. On a finite or countable state space all three are harmless. On an uncountable state space each can destroy the measurability needed to take the next expectation: the infimum over an uncountable family of measurable functions need not be measurable, and a minimizer chosen state by state need not be a measurable function of the state, so it does not define a policy at all.

Section 7.5 of Bertsekas and Shreve, Stochastic Optimal Control: The Discrete-Time Case (1978; Athena Scientific reprint 1996), settles the three operations for semicontinuous costs and continuous kernels. The results are the topological half of the book's measurability theory; the descriptive set theory half (lower semianalytic functions and analytically measurable selectors, §7.6–7.7) is a separate mission in this series. The semicontinuous results are what Propositions 8.6–8.7 and Corollaries 9.17.2–9.17.3 of the book use to obtain Borel-measurable optimal policies for finite-horizon and infinite-horizon models with lower semicontinuous costs and compact control sets.

Timeline. The exact selection theorem for lower semicontinuous functions (Proposition 7.33 below) is credited by the book's notes to Dubins and Savage, How to Gamble If You Must (1965). The Hausdorff metric on closed sets goes back to Hausdorff's Set Theory. Measurable selection in the closed-valued setting was later systematized by Kuratowski and Ryll-Nardzewski (1965), whose theorem gives a different route to results of this kind.

Setting

Throughout, R∗=[−∞,+∞]R^*=[-\infty,+\infty]R∗=[−∞,+∞] is the extended real line. A function f:X→R∗f:X\to R^*f:X→R∗ on a metrizable space XXX is lower semicontinuous if every sublevel set {x∣f(x)≤c}\{x\mid f(x)\le c\}{x∣f(x)≤c}, c∈Rc\in\mathbb Rc∈R, is closed, and upper semicontinuous if every superlevel set {x∣f(x)≥c}\{x\mid f(x)\ge c\}{x∣f(x)≥c} is closed (Definition 7.13). C(X)C(X)C(X) is the space of bounded continuous real-valued functions on XXX.

For a separable metrizable space YYY, P(Y)P(Y)P(Y) is the set of Borel probability measures on YYY with the weak topology (convergence of integrals of functions in C(Y)C(Y)C(Y)). A stochastic kernel q(dy∣x)q(dy\mid x)q(dy∣x) on YYY given XXX is a map x↦q(dy∣x)x\mapsto q(dy\mid x)x↦q(dy∣x) from XXX to P(Y)P(Y)P(Y), and it is continuous if this map is continuous (Definition 7.12). The integral of a Borel-measurable f:Y→R∗f:Y\to R^*f:Y→R∗ is ∫f dp=∫f+dp−∫f−dp\int f\,dp=\int f^+dp-\int f^-dp∫fdp=∫f+dp−∫f−dp with the convention −∞+∞=+∞−∞=+∞-\infty+\infty=+\infty-\infty=+\infty−∞+∞=+∞−∞=+∞ (Eq. (43) of Chapter 7).

For a compact metric space YYY, 2Y2^Y2Y is the collection of closed subsets of YYY with the topology of the Hausdorff metric (Appendix C). For D⊆X×YD\subseteq X\times YD⊆X×Y, the section at xxx is Dx={y∣(x,y)∈D}D_x=\{y\mid (x,y)\in D\}Dx​={y∣(x,y)∈D}, the projection is projX(D)={x∣Dx≠∅}\mathrm{proj}_X(D)=\{x\mid D_x\neq\emptyset\}projX​(D)={x∣Dx​=∅}, and a function φ:projX(D)→Y\varphi:\mathrm{proj}_X(D)\to Yφ:projX​(D)→Y has its graph in DDD if (x,φ(x))∈D(x,\varphi(x))\in D(x,φ(x))∈D for every x∈projX(D)x\in\mathrm{proj}_X(D)x∈projX​(D). "Borel-measurable" refers to the Borel σ-algebras of the topologies in question; on projX(D)\mathrm{proj}_X(D)projX​(D) this is the Borel σ-algebra of the subspace topology.

Formalization targets

Goal: Proposition 7.33

Let XXX be metrizable, YYY compact metrizable, D⊆X×YD\subseteq X\times YD⊆X×Y closed, and f:D→R∗f:D\to R^*f:D→R∗ lower semicontinuous. Put

f∗(x)=min⁡y∈Dxf(x,y),x∈projX(D).f^*(x)=\min_{y\in D_x}f(x,y),\qquad x\in\mathrm{proj}_X(D).f∗(x)=y∈Dx​min​f(x,y),x∈projX​(D).

Then projX(D)\mathrm{proj}_X(D)projX​(D) is closed, f∗f^*f∗ is lower semicontinuous, and there is a Borel-measurable φ:projX(D)→Y\varphi:\mathrm{proj}_X(D)\to Yφ:projX​(D)→Y with graph in DDD and

f(x,φ(x))=f∗(x)∀x∈projX(D).f\bigl(x,\varphi(x)\bigr)=f^*(x)\qquad\forall x\in\mathrm{proj}_X(D).f(x,φ(x))=f∗(x)∀x∈projX​(D).

Milestones

  • Proposition 7.32: for f∗(x)=inf⁡y∈Yf(x,y)f^*(x)=\inf_{y\in Y}f(x,y)f∗(x)=infy∈Y​f(x,y), lower semicontinuity of fff and compactness of YYY give lower semicontinuity of f∗f^*f∗ and attainment; upper semicontinuity of fff gives upper semicontinuity of f∗f^*f∗.
  • Lemma 7.18: there is a Borel-measurable σ:2Y−{∅}→Y\sigma:2^Y-\{\emptyset\}\to Yσ:2Y−{∅}→Y with σ(A)∈A\sigma(A)\in Aσ(A)∈A.
  • Lemma 7.20: for lower semicontinuous fff on a nonempty compact YYY, the argmin map x↦{y∣f(x,y)≤f∗(x)}x\mapsto\{y\mid f(x,y)\le f^*(x)\}x↦{y∣f(x,y)≤f∗(x)} is Borel-measurable into 2Y2^Y2Y.
  • Lemma 7.14: fff is lower semicontinuous and bounded below iff fn↑ff_n\uparrow ffn​↑f for some fn∈C(X)f_n\in C(X)fn​∈C(X) (and dually).
  • Proposition 7.30: x↦∫f(x,y) q(dy∣x)x\mapsto\int f(x,y)\,q(dy\mid x)x↦∫f(x,y)q(dy∣x) is continuous for f∈C(X×Y)f\in C(X\times Y)f∈C(X×Y) and continuous qqq.
  • Proposition 7.31: the same map is lower (upper) semicontinuous and bounded below (above) when fff is.
  • Lemma 7.21: an open G⊆X×YG\subseteq X\times YG⊆X×Y, YYY separable, has open projection and a Borel-measurable selector with graph in GGG.
  • Proposition 7.34: for open DDD and upper semicontinuous fff, projX(D)\mathrm{proj}_X(D)projX​(D) is open, f∗=inf⁡Dxff^*=\inf_{D_x}ff∗=infDx​​f is upper semicontinuous, and for each ε>0\varepsilon>0ε>0 there is a Borel-measurable φε\varphi_\varepsilonφε​ with graph in DDD and
f(x,φε(x))≤{f∗(x)+εif f∗(x)>−∞,−1/εif f∗(x)=−∞.f\bigl(x,\varphi_\varepsilon(x)\bigr)\le\begin{cases}f^*(x)+\varepsilon&\text{if }f^*(x)>-\infty,\\-1/\varepsilon&\text{if }f^*(x)=-\infty.\end{cases}f(x,φε​(x))≤{f∗(x)+ε−1/ε​if f∗(x)>−∞,if f∗(x)=−∞.​

Significance

The results. Propositions 7.31–7.33 are the closure properties that make the dynamic programming recursion stay inside the class of lower semicontinuous functions bounded below: the expectation step preserves the class (7.31), the minimization step preserves it (7.32, 7.33), and the minimization admits a Borel-measurable exact minimizer (7.33). This is why, in semicontinuous models, the optimal cost functions are lower semicontinuous and optimal policies can be taken Borel-measurable and nonrandomized. Proposition 7.34 gives the weaker, ε\varepsilonε-optimal counterpart for upper semicontinuous costs, where the infimum need not be attained.

Formalizing them. All of these results are proved in the book; none is open. As far as is known, none has a machine-checked proof: Mathlib has semicontinuity, the Hausdorff extended metric on closed and on nonempty compact sets, and the weak topology on probability measures, but no theorem combining them into a measurable selection result of this kind. A formal development would supply measurable selectors for semicontinuous minimization in Lean and the Borel-measurability of set-valued maps into the hyperspace of closed sets, both reusable well beyond dynamic programming.

Difficulty

The obvious attempt at the goal is to pick, for each xxx, some minimizer yyy of f(x,⋅)f(x,\cdot)f(x,⋅) over the compact section DxD_xDx​. The minimizer exists by compactness and lower semicontinuity, but the choice is made pointwise and gives no control on measurability: a minimizer chosen by the axiom of choice need not be Borel-measurable. The argmin sets F∗(x)F^*(x)F∗(x) vary with xxx only semicontinuously: they can jump from a single point to a large set, so a continuous selection generally does not exist, and continuity arguments cannot replace measurability. Lemma 7.18 isolates the hardest part: a choice of a point of each nonempty closed set that is measurable as a function of the set itself.

A second difficulty is bookkeeping at infinity. Values ±∞\pm\infty±∞ are allowed throughout, so sublevel sets, minima, integrals and ε\varepsilonε-bounds must all be handled in R∗R^*R∗; the integral in Proposition 7.31 uses the convention ∞−∞=+∞\infty-\infty=+\infty∞−∞=+∞, which is not Mathlib's.

Formalization scope

  • Extended reals. Values are in EReal. The only place where values of opposite infinite sign are combined is the integral, which is the published definition DupacovaWets.Consistency.expect (reused, not restated): ∫f+−∫f−\int f^+-\int f^-∫f+−∫f− with an explicit case returning +∞+\infty+∞ when ∫f+=∞\int f^+=\infty∫f+=∞, exactly the book's convention (42). The ε\varepsilonε-bound of Proposition 7.34 adds a real ε\varepsilonε to a value different from −∞-\infty−∞, which is safe in EReal.
  • Semicontinuity is Mathlib's LowerSemicontinuous/UpperSemicontinuous, equivalent to Definition 7.13 for EReal-valued functions. Lemma 7.13 of the book (the sequential characterization) is Mathlib's lowerSemicontinuous_iff_le_liminf together with first countability of metrizable spaces, and is not restated here.
  • Functions on DDD. Functions "on DDD" are functions on X×YX\times YX×Y with LowerSemicontinuousOn f D (resp. UpperSemicontinuousOn); values off DDD play no role. projX(D)\mathrm{proj}_X(D)projX​(D) is Prod.fst '' D, selectors are functions on that subtype, and its σ-algebra is the Borel σ-algebra of the subspace topology.
  • Hyperspace. 2Y2^Y2Y is Closeds Y, and 2Y−{∅}2^Y-\{\emptyset\}2Y−{∅} for compact YYY is NonemptyCompacts Y, each with the Hausdorff extended metric and the Borel σ-algebra of its topology. This topology agrees with the book's (the exponential topology of Appendix C, independent of the metric).
  • Boundedness. "Bounded below/above" is by a real constant. BddBelow in EReal would be vacuous and is not used.
  • Edge cases. Proposition 7.32(a)'s attainment clause is stated for nonempty YYY, since for Y=∅Y=\emptysetY=∅ the infimum is +∞+\infty+∞ and nothing attains it.
  • Argmin minimum. Lemma 7.20 assumes nonempty YYY because its defining formula uses a minimum; for empty YYY there is no minimizer.
  • Ruling out trivial readings. The graph condition (x,φ(x))∈D(x,\varphi(x))\in D(x,φ(x))∈D is part of every selection statement; without it the goal would follow from the unconstrained case. The selector must be Borel-measurable on projX(D)\mathrm{proj}_X(D)projX​(D) and must attain the minimum exactly, not up to ε\varepsilonε.

A complete development needs the Borel structure of the hyperspace (measurability of maps into Closeds Y from upper semicontinuity in the sense of Kuratowski, Proposition C.4 of the book), the construction of a measurable choice function on NonemptyCompacts Y, and approximation of semicontinuous functions by monotone sequences in C(X)C(X)C(X). Each of these is reusable on its own; proofs of individual milestones by any route are welcome.

Selected references

  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978; Athena Scientific reprint, 1996, Section 7.5 and Appendix C. https://web.mit.edu/dimitrib/www/soc.html
  • L. E. Dubins and L. J. Savage, How to Gamble If You Must: Inequalities for Stochastic Processes, McGraw-Hill, 1965.
  • K. Kuratowski and C. Ryll-Nardzewski, "A general theorem on selectors," Bull. Acad. Polon. Sci. 13 (1965), 397–403.
  • F. Hausdorff, Set Theory, Chelsea, New York, 1957.
10 thms3 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

Theory of Reproducing Kernels II: One Reproducing Kernel Class Contains Another iff a Multiple of Its Kernel Dominates the Other KernelResearch Paper

Motivation

A reproducing kernel Hilbert space (RKHS) is a Hilbert space of functions in which evaluation at each point is a continuous functional. Each such space is determined by its kernel, and in practice spaces are usually given by their kernels: Gaussian or Sobolev kernels in kernel methods and Gaussian-process regression, the Bergman and Szegő kernels in complex analysis. A recurring question is therefore how a relation between two function spaces reads on their kernels. When is one space contained in another? When do two kernels define the same space?

N. Aronszajn's Theory of Reproducing Kernels (Trans. Amer. Math. Soc. 68 (1950), 337–404) answers both questions. §7 (pp. 354–356) compares a class with a contractively included subclass. §13 (C) (pp. 382–383) uses Banach's closed graph theorem to remove the contractivity assumption. The answer is an order relation between kernels, checkable on finite point sets. It is the standard tool for comparing RKHSs: Part II of the paper (§2, p. 387) applies §7, Theorem II to compare Bergman kernels of nested plane domains.

Setting

Let XXX be an arbitrary set (no topology, no measure). A function K:X×X→CK : X\times X\to\mathbb CK:X×X→C is a positive matrix if

∑i,j=1nK(yi,yj) ξˉi ξj ≥0\sum_{i,j=1}^n K(y_i,y_j)\,\bar\xi_i\,\xi_j\ \ge 0i,j=1∑n​K(yi​,yj​)ξˉ​i​ξj​ ≥0

for every finite family y1,…,yn∈Xy_1,\dots,y_n\in Xy1​,…,yn​∈X and every ξ1,…,ξn∈C\xi_1,\dots,\xi_n\in\mathbb Cξ1​,…,ξn​∈C. For two kernels, K1≪KK_1\ll KK1​≪K means that K−K1K-K_1K−K1​ is a positive matrix.

A class with a reproducing kernel is a complex Hilbert space FFF of functions X→CX\to\mathbb CX→C for which there is a function KKK with K(⋅,y)∈FK(\cdot,y)\in FK(⋅,y)∈F and f(y)=(f,K(⋅,y))f(y) = (f,K(\cdot,y))f(y)=(f,K(⋅,y)) for all f∈Ff\in Ff∈F and y∈Xy\in Xy∈X. The scalar product (f,g)(f,g)(f,g) is linear in fff. Every such KKK is a positive matrix, and by Moore's theorem (§2 (4)) every positive matrix is the kernel of exactly one such class. A linear class of functions is an (R.K.)-class if some norm makes it a Hilbert space with a reproducing kernel. Such a class carries many admissible norms, and correspondingly many kernels.

In the Lean development, FFF is a Mathlib RKHS ℂ H X ℂ instance on a complete complex inner product space H. The class of functions is Set.range (⇑ : H → X → ℂ). The scalar kernel is kernelFn H x y = RKHS.kernel H x y 1, and K1≪KK_1\ll KK1​≪K is AronszajnRK.Limits.KernelLE K₁ K (the series' shared definition).

Formalization targets

Goal: Corollary IV₂ of §13

For classes F,F1F, F_1F,F1​ with reproducing kernels K,K1K, K_1K,K1​:

F1⊂F  ⟺  ∃ M>0: K1≪MK.F_1\subset F \iff \exists\, M>0:\ K_1\ll MK .F1​⊂F⟺∃M>0: K1​≪MK.

The constant MMM is left unspecified: it measures the norm of the inclusion operator and has no canonical value.

Milestones, in attack order

  1. ≪ is a partial ordering of the positive matrices (§7, p. 354).
  2. §7, Theorem I: if K1≪KK_1\ll KK1​≪K, then F1⊂FF_1\subset FF1​⊂F and ∥f1∥1≥∥f1∥\|f_1\|_1\ge\|f_1\|∥f1​∥1​≥∥f1​∥.
  3. §7, Theorem II: if a linear class F1⊂FF_1\subset FF1​⊂F is a Hilbert space with ∥f1∥1≥∥f1∥\|f_1\|_1\ge\|f_1\|∥f1​∥1​≥∥f1​∥, then F1F_1F1​ has a reproducing kernel K1≪KK_1\ll KK1​≪K.
  4. §13 (C), p. 382: the norm c∥⋅∥c\|\cdot\|c∥⋅∥ corresponds to the same class, with kernel c−2Kc^{-2}Kc−2K.
  5. §13 (C), Lemma: the identity correspondence from F1⋅F2⊂F1F_1\cdot F_2\subset F_1F1​⋅F2​⊂F1​ to F2F_2F2​ is a closed linear transformation.
  6. §13 (C), Theorem IV: if F1⊂FF_1\subset FF1​⊂F are (R.K.)-classes, then ∥f∥≤M∥f∥1\|f\|\le M\|f\|_1∥f∥≤M∥f∥1​ on F1F_1F1​ for some M>0M>0M>0, whatever admissible norms are chosen.
  7. §13 (C), Corollary IV₁: any two admissible norms on one (R.K.)-class are equivalent.
  8. §13 (C), Corollary IV₃: F1=FF_1 = FF1​=F iff mK≪K1≪MKmK\ll K_1\ll MKmK≪K1​≪MK for some m,M>0m,M>0m,M>0.
  9. §13 (D), Theorem VI: intersections and sums of (R.K.)-classes are (R.K.)-classes.

Significance

The result. Corollary IV₂ reduces inclusion of infinite-dimensional function spaces to positivity of finite matrices. Corollary IV₃ says when two kernels give the same space, as sets of functions with equivalent norms. Kernel-method theory uses these facts to compare hypothesis spaces of different kernels. In complex analysis they compare Bergman spaces of nested domains, since the restricted kernel of a larger domain is dominated by the kernel of a smaller one (Part II, §2, p. 387, of the paper). Theorem VI makes (R.K.)-classes a lattice under intersection and sum.

Formalizing it. All statements are classical and have been proved since 1950. To our knowledge none is machine-checked. Mathlib has RKHSs, their kernels, positive semidefiniteness of kernels and the construction of a space from a kernel. It has no comparison theorem between two RKHSs, and no characterization of an RKHS by its kernel up to inclusion or equality of function sets. This mission adds these. As a by-product it produces the closed-graph argument for RKHS inclusions in a form that other missions can reuse.

Difficulty

The sufficiency direction (K1≪MK⇒F1⊂FK_1\ll MK \Rightarrow F_1\subset FK1​≪MK⇒F1​⊂F) does not follow from the definitions alone. Domination is a statement about finite quadratic forms; membership of a function of F1F_1F1​ in FFF is a statement about an infinite-dimensional space, and nothing pointwise connects the two. The paper's argument rests on the sum theorem of §6, the goal of a separate mission in this series.

The necessity direction cannot start from an assumed norm inequality, because the two norms are a priori unrelated. Producing the constant MMM needs the closed graph theorem together with the fact that norm convergence in an RKHS implies pointwise convergence. A direct estimate of ∑K1(yi,yj)ξˉiξj\sum K_1(y_i,y_j)\bar\xi_i\xi_j∑K1​(yi​,yj​)ξˉ​i​ξj​ against ∑K(yi,yj)ξˉiξj\sum K(y_i,y_j)\bar\xi_i\xi_j∑K(yi​,yj​)ξˉ​i​ξj​ from the inclusion alone has no route to a uniform constant.

Formalization scope

  • Scalars and spaces. All scalars are complex and XXX is an arbitrary type. A class with a reproducing kernel is an RKHS ℂ H X ℂ instance on a complete complex inner product space H. The function of f : H is ⇑f.
  • Scalar product. Mathlib's ⟪f, g⟫_ℂ is conjugate-linear in f, so Aronszajn's (f,g)(f,g)(f,g) is ⟪g, f⟫_ℂ, and the reproducing property is ⟪k y, f⟫_ℂ = f y.
  • Inclusion and norm comparison. "F1⊂FF_1\subset FF1​⊂F" is inclusion of the sets of functions. A norm comparison ∥f∥≤M∥f∥1\|f\|\le M\|f\|_1∥f∥≤M∥f∥1​ is stated between the elements of the two spaces that are the same function.
  • Positivity. Positive matrices are Matrix.PosSemidef over the index type X. Its quadratic form over finitely supported vectors is exactly the paper's. Over C\mathbb CC it includes Hermitian symmetry, which nonnegativity implies. MKMKMK is fun x y => (M : ℂ) * K x y with real M>0M>0M>0.
  • The goal and Corollary IV₃. "FFF, F1F_1F1​ the corresponding classes" of positive matrices KKK, K1K_1K1​ is read as: arbitrary RKHSs whose kernels are KKK, K1K_1K1​. By Moore's uniqueness theorem this is the same statement.
  • Theorem II. F1F_1F1​ is not assumed to carry an RKHS instance, since having a kernel is the conclusion. It is a complex Hilbert space with an injective linear map into the functions of FFF.
  • Theorem IV and Corollary IV₁ quantify over all admissible norms, i.e. all RKHSs with the given function sets.
  • Closedness of a transformation is the paper's sequential definition (§13 (C), p. 382), stated on a submodule that need not be closed.
  • (R.K.)-class means: equals the set of functions of some RKHS in the universe of XXX.
  • Rescaling milestone. It asserts that a rescaled RKHS exists, and that every RKHS with the same functions and the rescaled norm has the rescaled kernel.

Trivializations ruled out. No statement defines a class as RKHS.OfKernel K and then asserts that its kernel is K. Classes are always compared through their sets of functions and norms. "F1⊂FF_1\subset FF1​⊂F" is never weakened to the existence of some injection H1→HH_1\to HH1​→H.

Substrate. Mathlib's RKHS, RKHS.kernel, RKHS.kerFun, RKHS.kerFun_inner, RKHS.posSemidef_kernel, RKHS.OfKernel, Matrix.PosSemidef (with .add, .smul), Banach's LinearMap.continuous_of_isClosed_graph, and the continuous functional calculus (CFC.sqrt, for the square root (I−L)1/2(I-L)^{1/2}(I−L)1/2 in the proof of Theorem II). The sum theorem of §6, used in the proof of Theorem I, is the goal of mission I of this series. Contributions of that theorem and of reusable lemmas on RKHS inclusions are welcome.

Selected references

  • N. Aronszajn, Theory of Reproducing Kernels, Trans. Amer. Math. Soc. 68 (1950), 337–404. https://doi.org/10.1090/S0002-9947-1950-0051437-7
  • S. Banach, Théorie des opérations linéaires, Monografje Matematyczne 1, Warsaw, 1932 (closed graph theorem, as cited on p. 382).
  • V. I. Paulsen and M. Raghupathi, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, Cambridge Stud. Adv. Math. 152, Cambridge University Press, 2016 (modern treatment of the inclusion criterion). https://doi.org/10.1017/CBO9781316219232
14 thms3 active usersReviewed
🏆Completed
Calculus of VariationsFunctional AnalysisOptimization·Captain: mikedeng1

On the Variational Principle I: Near Every ε-Minimizer of a Lower Semicontinuous Function Bounded Below on a Complete Metric Space Lies a Strict Minimizer of F + (ε/λ)d(v, ·)Research Paper

Motivation

A function that is bounded below need not attain its infimum: exe^xex on R\mathbb{R}R has infimum 000 and no minimizer. The classical "variational principle" says that at a minimizer uˉ\bar uuˉ of a differentiable functional, F′(uˉ)=0F'(\bar u)=0F′(uˉ)=0. Without compactness there may be no minimizer, and the principle has nothing to say. In 1974 Ivar Ekeland showed that a weaker statement survives in every complete metric space: next to any approximate minimizer lies a point that is the exact, strict minimizer of a slightly perturbed function (Ekeland 1974).

The result is now a standard tool in nonlinear analysis, optimization and the calculus of variations. It yields approximate first-order conditions (∥F′(v)∥∗≤ε\|F'(v)\|_*\le\varepsilon∥F′(v)∥∗​≤ε) without existence of minimizers, approximate Lagrange multiplier rules, and approximate maximum principles in optimal control; Ekeland's survey (Ekeland 1979) collects many of these uses.

Timeline. Bishop and Phelps introduced the partial order on a Banach space times R\mathbb{R}R that underlies the proof, in their study of support functionals of convex sets (Bishop–Phelps, The support functional of a convex set, Proc. Symp. Pure Math. 7, AMS, 1963). Brøndsted and Rockafellar used it in 1965 to obtain subdifferentiability properties of convex functions on Banach spaces (Brøndsted–Rockafellar 1965), and Browder applied it to nonconvex subsets of Banach spaces (Bull. AMS 79, 1973). Ekeland's 1974 article, formalized here, isolates the device as a principle valid in every complete metric space for lower semicontinuous functions with values in R∪{+∞}\mathbb{R}\cup\{+\infty\}R∪{+∞}, and applies it to Gâteaux-differentiable functions, constrained optimization, Plateau's problem, geodesics and optimal control.

Setting

Let (V,d)(V,d)(V,d) be a complete metric space. Let F:V→R∪{+∞}F:V\to\mathbb{R}\cup\{+\infty\}F:V→R∪{+∞} be lower semicontinuous (for every ccc the set {F≤c}\{F\le c\}{F≤c} is closed), not identically +∞+\infty+∞, and bounded from below:

inf⁡F>−∞.(1.1)\inf F > -\infty. \tag{1.1}infF>−∞.(1.1)

For ε>0\varepsilon>0ε>0, a point u∈Vu\in Vu∈V is an ε\varepsilonε-minimizer if

inf⁡F≤F(u)≤inf⁡F+ε.(1.2)\inf F \le F(u) \le \inf F + \varepsilon. \tag{1.2}infF≤F(u)≤infF+ε.(1.2)

For α>0\alpha>0α>0, the Bishop–Phelps order on V×RV\times\mathbb{R}V×R is

(v1,a1)≺(v2,a2)  ⟺  (a2−a1)+α d(v1,v2)≤0.(1.6)(v_1,a_1)\prec(v_2,a_2)\iff (a_2-a_1)+\alpha\,d(v_1,v_2)\le 0. \tag{1.6}(v1​,a1​)≺(v2​,a2​)⟺(a2​−a1​)+αd(v1​,v2​)≤0.(1.6)

In Lean it is EkelandVP.General.bpLE α p q, read p≺qp\prec qp≺q. The epigraph of FFF is S={(v,a)∣a≥F(v)}⊆V×RS=\{(v,a)\mid a\ge F(v)\}\subseteq V\times\mathbb{R}S={(v,a)∣a≥F(v)}⊆V×R (1.15).

In §2, VVV is a real Banach space with dual V∗V^*V∗, and FFF is Gâteaux-differentiable with derivative F′:V→V∗F':V\to V^*F′:V→V∗ (EkelandVP.General.IsGateauxDiff F F'): at every u0u_0u0​ with F(u0)<+∞F(u_0)<+\inftyF(u0​)<+∞, ddtF(u0+tv)∣t=0=⟨F′(u0),v⟩\frac{d}{dt}F(u_0+tv)|_{t=0}=\langle F'(u_0),v\rangledtd​F(u0​+tv)∣t=0​=⟨F′(u0​),v⟩ for every vvv (2.1).

Formalization targets

Goal: Theorem 1.1 (p. 324)

For every uuu satisfying (1.2) and every λ>0\lambda>0λ>0 there is v∈Vv\in Vv∈V with

F(v)≤F(u),d(u,v)≤λ,∀w≠v: F(w)>F(v)−ελ d(v,w).(1.3–1.5)F(v)\le F(u),\qquad d(u,v)\le\lambda,\qquad \forall w\ne v:\ F(w)>F(v)-\frac{\varepsilon}{\lambda}\,d(v,w). \tag{1.3–1.5}F(v)≤F(u),d(u,v)≤λ,∀w=v: F(w)>F(v)−λε​d(v,w).(1.3–1.5)

The parameters ε\varepsilonε and λ\lambdaλ are free; the trade-off between closeness to uuu and the size of the perturbation is the content of the theorem.

Milestones (§1)

  1. For α>0\alpha>0α>0, ≺\prec≺ is reflexive, antisymmetric and transitive (p. 325).
  2. For every (v1,a1)(v_1,a_1)(v1​,a1​), the set {(v,a)∣(v1,a1)≺(v,a)}\{(v,a)\mid (v_1,a_1)\prec(v,a)\}{(v,a)∣(v1​,a1​)≺(v,a)} is closed in V×RV\times\mathbb{R}V×R (p. 325).
  3. Lemma 1.2 (p. 325): if S⊆V×RS\subseteq V\times\mathbb{R}S⊆V×R is closed and a≥ma\ge ma≥m on SSS for some mmm (1.7), then every (v1,a1)∈S(v_1,a_1)\in S(v1​,a1​)∈S lies below a ≺\prec≺-maximal element of SSS.

Consequences (§2)

  • Corollary 2.3 (p. 328): for VVV Banach, FFF l.s.c. and Gâteaux-differentiable with −∞<inf⁡F<+∞-\infty<\inf F<+\infty−∞<infF<+∞, and every ε>0\varepsilon>0ε>0, there is vεv_\varepsilonvε​ with F(vε)−inf⁡F≤ε2F(v_\varepsilon)-\inf F\le\varepsilon^2F(vε​)−infF≤ε2 and ∥F′(vε)∥∗≤ε\|F'(v_\varepsilon)\|_*\le\varepsilon∥F′(vε​)∥∗​≤ε.
  • Corollary 2.4 (p. 328): if moreover F(v)≥k∥v∥+cF(v)\ge k\|v\|+cF(v)≥k∥v∥+c with k>0k>0k>0, then F′(V)F'(V)F′(V) is dense in kB∗kB^*kB∗.
  • Corollary 2.5 (p. 329): if F(v)≥Φ(∥v∥)F(v)\ge\Phi(\|v\|)F(v)≥Φ(∥v∥) with Φ\PhiΦ continuous and Φ(t)/t→∞\Phi(t)/t\to\inftyΦ(t)/t→∞, then F′(V)F'(V)F′(V) is dense in V∗V^*V∗.

Significance

The result. Theorem 1.1 replaces "a minimizer exists" by "a strict minimizer of a Lipschitz perturbation exists nearby", with explicit control of both the distance and the perturbation. With λ=ε\lambda=\sqrt{\varepsilon}λ=ε​ this gives a point that is ε\varepsilonε-optimal, ε\sqrt{\varepsilon}ε​-close to uuu, and ε\sqrt{\varepsilon}ε​-stationary in the metric sense. Corollary 2.3 is the form announced in the paper's abstract: a differentiable function with a finite lower bound has points where FFF is almost minimal and ∥F′∥∗\|F'\|_*∥F′∥∗​ is arbitrarily small. Later sections of the same paper use Theorem 1.1 for approximate Lagrange multiplier rules (§3) and an approximate Pontryagin maximum principle (§7), which are the subjects of missions II and III of this series.

Formalizing it. The theorem is proved; this mission formalizes the paper's own route (the order (1.6), Lemma 1.2, then Theorem 1.1) and its first applications in §2. The pinned Mathlib has no statement of Ekeland's principle, of the Caristi fixed point theorem, or of the Bishop–Phelps order, and the platform has none either. A machine-checked Theorem 1.1 for extended-real-valued functions would be directly reusable by every later mission that needs approximate optimality without compactness.

Difficulty

The obvious argument — take a minimizing sequence and pass to a limit — fails because nothing makes a minimizing sequence converge: VVV is not compact, and a minimizing sequence of exe^xex escapes to −∞-\infty−∞. Completeness only helps for Cauchy sequences, so one must construct a sequence that is Cauchy. The limit must moreover be maximal for the order (1.6), not merely a limit point, and that maximality is what produces the strict inequality (1.5). Lemma 1.2 is where this difficulty sits. In §2, the passage from the metric statement (1.5) to a bound on ∥F′(v)∥∗\|F'(v)\|_*∥F′(v)∥∗​ requires FFF to be finite near vvv along every line, which the Gâteaux hypothesis supplies.

Formalization scope

  • VVV is a MetricSpace with CompleteSpace; d(u,v)d(u,v)d(u,v) is dist u v. V×RV\times\mathbb{R}V×R carries the product topology; only closedness of subsets of it is used.
  • F:V→F:V\toF:V→ EReal. "Bounded from below" (1.1) is ⊥<inf⁡vF(v)\bot<\inf_v F(v)⊥<infv​F(v); it also excludes the value −∞-\infty−∞, which the paper's codomain does not contain. "Not identically +∞+\infty+∞" is ∃v0, F(v0)≠⊤\exists v_0,\ F(v_0)\ne\top∃v0​, F(v0​)=⊤. Lower semicontinuity is Mathlib's LowerSemicontinuous.
  • (1.2) is assumed in the form F(u)≤inf⁡F+εF(u)\le\inf F+\varepsilonF(u)≤infF+ε with ε>0\varepsilon>0ε>0 real (the left half is automatic). λ\lambdaλ is named lam.
  • (1.5) is F(v)−ελd(v,w)<F(w)F(v)-\frac{\varepsilon}{\lambda}d(v,w)<F(w)F(v)−λε​d(v,w)<F(w) for all w≠vw\ne vw=v, strict, with the paper's argument order d(v,w)d(v,w)d(v,w). Since F(v)F(v)F(v) is finite under the hypotheses, the EReal subtraction is ordinary.
  • A trivializing formalization is ruled out: FFF is not real-valued (the value +∞+\infty+∞ is what lets §3 apply the theorem to FFF plus the indicator of a closed set), (1.5) is strict and quantified over all w≠vw\ne vw=v, and the conclusion is not weakened to d(u,v)<∞d(u,v)<\inftyd(u,v)<∞ or ≤\le≤ in (1.5).
  • In §2, VVV is a real NormedSpace with CompleteSpace, F′F'F′ is a function V→(V→LR)V\to(V\to_L\mathbb{R})V→(V→L​R), and Gâteaux differentiability requires t↦F(u0+tv)t\mapsto F(u_0+tv)t↦F(u0​+tv) to be finite near t=0t=0t=0 before taking a real derivative; without this, EReal.toReal (±∞)=0(\pm\infty)=0(±∞)=0 would let an infinite function have a junk derivative. Density of F′(V)F'(V)F′(V) is stated for derivatives taken at points where F<+∞F<+\inftyF<+∞.
  • Theorem 2.2 is not part of this mission: its conclusion (2.4) is printed as the strict ∥v−u∥<λ\|v-u\|<\lambda∥v−u∥<λ, while its one-line proof from Theorem 1.1 gives only ≤λ\le\lambda≤λ. Corollaries 2.3–2.5 do not depend on the strict form.

Contributions welcome: proofs of the milestones (the first two are short; Lemma 1.2 is the core), of Theorem 1.1, and of the §2 corollaries; a reusable Caristi fixed point theorem built on the same order would be a natural addition.

Selected references

  • I. Ekeland, On the Variational Principle, J. Math. Anal. Appl. 47 (1974), 324–353. https://doi.org/10.1016/0022-247X(74)90025-0
  • I. Ekeland, Nonconvex minimization problems, Bull. Amer. Math. Soc. (N.S.) 1 (1979), 443–474. https://doi.org/10.1090/S0273-0979-1979-14595-6
  • E. Bishop, R. R. Phelps, The support functional of a convex set, in Convexity (V. Klee, ed.), Proc. Symp. Pure Math. 7, Amer. Math. Soc., 1963, 27–35. (Reference [4] of Ekeland 1974.)
  • A. Brøndsted, R. T. Rockafellar, On the subdifferentiability of convex functions, Proc. Amer. Math. Soc. 16 (1965), 605–611. https://doi.org/10.1090/S0002-9939-1965-0178103-8
  • F. E. Browder, Normal solvability for nonlinear mappings into Banach spaces, Bull. Amer. Math. Soc. 79 (1973), 328–350. https://doi.org/10.1090/S0002-9904-1973-13152-9
6 thms3 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

Theory of Reproducing Kernels III: The Product of Two Reproducing Kernels Is the Kernel of the Diagonal Restrictions of the Direct ProductResearch Paper

Motivation

A reproducing kernel is the function K(x,y)K(x,y)K(x,y) that represents point evaluation in a Hilbert space of functions: f(y)=(f,K(⋅,y))f(y) = (f, K(\cdot, y))f(y)=(f,K(⋅,y)). Kernels are combined all the time. In machine learning, a kernel on pairs of objects is routinely built as the pointwise product of two simpler kernels, and in complex analysis the product ∣K(x,y)∣2=K(x,y)K(y,x)|K(x,y)|^2 = K(x,y)K(y,x)∣K(x,y)∣2=K(x,y)K(y,x) of a kernel with its conjugate appears naturally. That the pointwise product of two positive matrices is again a positive matrix goes back to I. Schur (1911). What Schur's theorem does not say is which space of functions the product kernel belongs to and what its norm is.

N. Aronszajn answered this in §8 of Theory of Reproducing Kernels (Trans. Amer. Math. Soc. 68 (1950), 337–404, doi:10.1090/S0002-9947-1950-0051437-7), the paper that fixed the general theory of reproducing kernel Hilbert spaces. He notes (p. 358, footnote 7) that the idea of the proof was found independently by R. Godement, who applied it only to positive definite functions. The answer has three ingredients developed in the same paper: the functional completion of an incomplete class of functions (§4), the restriction of a kernel to a subset (§5), and the direct product F1⊗F2F_1 \otimes F_2F1​⊗F2​ of two classes of functions (§8).

Setting

Let EEE be an arbitrary set. A class with a reproducing kernel is a complex Hilbert space FFF of functions f:E→Cf : E \to \mathbb{C}f:E→C such that every point evaluation f↦f(y)f \mapsto f(y)f↦f(y) is continuous. Its reproducing kernel K:E×E→CK : E \times E \to \mathbb{C}K:E×E→C is characterized by: K(⋅,y)∈FK(\cdot, y) \in FK(⋅,y)∈F for each yyy, and f(y)=(f,K(⋅,y))f(y) = (f, K(\cdot, y))f(y)=(f,K(⋅,y)) for all f∈Ff \in Ff∈F, where the scalar product (f,g)(f, g)(f,g) is linear in fff and conjugate-linear in ggg.

Functional completion. Suppose FFF is a linear class of functions on EEE with a scalar product satisfying every Hilbert-space axiom except completeness. A functional completion of FFF is a Hilbert space of functions on EEE, with continuous point evaluations, that contains FFF isometrically as a dense subset.

Restriction. For E1⊆EE_1 \subseteq EE1​⊆E, the restriction of fff is f∣E1f|_{E_1}f∣E1​​, and F∣E1F|_{E_1}F∣E1​​ is the class of all restrictions.

Direct product. Given classes F1F_1F1​, F2F_2F2​ on EEE with kernels K1K_1K1​, K2K_2K2​ and norms ∥⋅∥1\|\cdot\|_1∥⋅∥1​, ∥⋅∥2\|\cdot\|_2∥⋅∥2​, consider on E′=E×EE' = E \times EE′=E×E the functions

f′(x1,x2)=∑k=1nf1(k)(x1)f2(k)(x2),f1(k)∈F1, f2(k)∈F2,f'(x_1,x_2) = \sum_{k=1}^n f_1^{(k)}(x_1) f_2^{(k)}(x_2), \qquad f_1^{(k)} \in F_1,\ f_2^{(k)} \in F_2,f′(x1​,x2​)=k=1∑n​f1(k)​(x1​)f2(k)​(x2​),f1(k)​∈F1​, f2(k)​∈F2​,

with scalar product (f′,g′)′=∑k,l(f1(k),g1(l))1(f2(k),g2(l))2(f', g')' = \sum_{k,l} (f_1^{(k)}, g_1^{(l)})_1 (f_2^{(k)}, g_2^{(l)})_2(f′,g′)′=∑k,l​(f1(k)​,g1(l)​)1​(f2(k)​,g2(l)​)2​. Their functional completion is the direct product F′=F1⊗F2F' = F_1 \otimes F_2F′=F1​⊗F2​, with norm ∥⋅∥′\|\cdot\|'∥⋅∥′.

In Lean, kernelFn H x y is the scalar kernel K(x,y)K(x,y)K(x,y) of a space H, IsFunctionalCompletion ι H says H is a functional completion of the class presented by ι, and IsDirectProduct H₁ H₂ H' says H' is F1⊗F2F_1 \otimes F_2F1​⊗F2​.

Formalization targets

Goal: §8, Theorem II

The kernel K(x,y)=K1(x,y)K2(x,y)K(x,y) = K_1(x,y) K_2(x,y)K(x,y)=K1​(x,y)K2​(x,y) is the reproducing kernel of the class FFF of restrictions of the functions of F1⊗F2F_1 \otimes F_2F1​⊗F2​ to the diagonal {(x,x)}\{(x,x)\}{(x,x)}, and

∥f∥=min⁡{∥g′∥′:g′∈F1⊗F2, g′(x,x)=f(x) ∀x∈E}.\|f\| = \min\{\|g'\|' : g' \in F_1 \otimes F_2,\ g'(x,x) = f(x)\ \forall x \in E\}.∥f∥=min{∥g′∥′:g′∈F1​⊗F2​, g′(x,x)=f(x) ∀x∈E}.

Milestones

  1. §4, Theorem. A functional completion of FFF exists if and only if every evaluation f↦f(y)f \mapsto f(y)f↦f(y) is bounded on FFF and every Cauchy sequence (fm)⊂F(f_m) \subset F(fm​)⊂F with fm(y)→0f_m(y) \to 0fm​(y)→0 for every yyy satisfies ∥fm∥→0\|f_m\| \to 0∥fm​∥→0; the functional completion, when it exists, is unique.
  2. §8, Theorem I. F1⊗F2F_1 \otimes F_2F1​⊗F2​ has reproducing kernel
K′(x1,x2,y1,y2)=K1(x1,y1) K2(x2,y2).K'(x_1,x_2,y_1,y_2) = K_1(x_1,y_1)\,K_2(x_2,y_2).K′(x1​,x2​,y1​,y2​)=K1​(x1​,y1​)K2​(x2​,y2​).
  1. §5, Theorem. K∣E1×E1K|_{E_1 \times E_1}K∣E1​×E1​​ is the reproducing kernel of F∣E1F|_{E_1}F∣E1​​, with ∥f1∥1=min⁡{∥f∥:f∣E1=f1}\|f_1\|_1 = \min\{\|f\| : f|_{E_1} = f_1\}∥f1​∥1​=min{∥f∥:f∣E1​​=f1​}.
  2. §8, Remark. For a complete orthonormal system {g1(k)}\{g_1^{(k)}\}{g1(k)​} of F1F_1F1​, every fff in the class of K1K2K_1K_2K1​K2​ is f=∑kf2(k)g1(k)f = \sum_k f_2^{(k)} g_1^{(k)}f=∑k​f2(k)​g1(k)​ with f2(k)∈F2f_2^{(k)} \in F_2f2(k)​∈F2​, ∑k∥f2(k)∥22<∞\sum_k \|f_2^{(k)}\|_2^2 < \infty∑k​∥f2(k)​∥22​<∞; exactly one such representation minimizes ∑k∥f2(k)∥22\sum_k \|f_2^{(k)}\|_2^2∑k​∥f2(k)​∥22​, and the minimum is ∥f∥2\|f\|^2∥f∥2.

Significance

The result. Theorem II turns the Schur product theorem from a statement about matrices into a statement about function spaces: it says which functions the product kernel can represent and how their norms are computed, through a minimal decomposition. It is the standard description of the reproducing kernel Hilbert space of a product kernel, used to reason about which functions product kernels can express and with what norm, and the Remark gives a concrete series description of the same space. §5 (restriction) and §4 (functional completion) are general tools in their own right: restriction underlies every comparison of kernels on nested domains, and §4 is the criterion for when an incomplete space of functions can be completed without leaving the world of functions.

Formalizing it. All four results are classical and proved on paper. Mathlib has reproducing kernel Hilbert spaces (RKHS, RKHS.kernel, the construction RKHS.OfKernel from a positive semidefinite kernel) and Schur's product theorem (Matrix.PosSemidef.hadamard, for an arbitrary index type), but no restriction theorem, no functional completion and no tensor product of reproducing kernel Hilbert spaces. None of these statements has a machine-checked proof that the mission is aware of.

Difficulty

The kernel identity is the easy part: by Schur's theorem K1K2K_1K_2K1​K2​ is positive, so some space with kernel K1K2K_1K_2K1​K2​ exists. The content is the identification of that space and its norm. The direct product has to be constructed before anything can be said about it: the class of finite sums of products is not complete, the scalar product (2) must be shown independent of the representation and positive definite, and the completion must stay a class of functions, which is exactly the question §4 answers and which can fail (p. 349 gives a class satisfying the first condition but not the second). The norm formula is an attained minimum over an infinite-dimensional affine set of preimages, not merely an infimum.

Formalization scope

Scalars are complex throughout ("From now on … we shall consider only complex Hilbert spaces", p. 343). The underlying set EEE is an arbitrary type X, with no topology, measure or nonemptiness assumption. A class with a reproducing kernel is a complex Hilbert space H with Mathlib's RKHS ℂ H X ℂ structure; its functions are the coercions ⇑f. The scalar kernel is kernelFn H x y = RKHS.kernel H x y 1. Mathlib's inner product ⟨u,v⟩\langle u, v\rangle⟨u,v⟩ is conjugate-linear in uuu, so Aronszajn's (f,g)(f,g)(f,g) is ⟨g,f⟩\langle g, f\rangle⟨g,f⟩.

Conventions and reading decisions:

  • Statements of the form "KKK is the reproducing kernel of the class C\mathcal{C}C with norm NNN" assert that a space with kernel KKK exists and that every space with kernel KKK has exactly the functions C\mathcal{C}C and the norm NNN. They never define the space as RKHS.OfKernel K, which would make the kernel identity true by construction.
  • The direct product is characterized by its elementary products f1(x1)f2(x2)f_1(x_1)f_2(x_2)f1​(x1​)f2​(x2​), the scalar product (2) on them, and density of their span (IsDirectProduct); it is never defined through its kernel. With that, Theorem I is not a definitional identity and Theorem II is not a restatement of §5.
  • "min" is an attained minimum (IsLeast). In Theorem II and §5 it is the minimum of the norm, not its square; in the Remark it is the minimum of the sum of squared norms, as printed.
  • The diagonal of E×EE\times EE×E is identified with EEE through x↦(x,x)x \mapsto (x,x)x↦(x,x), and the restriction of g′g'g′ is x↦g′(x,x)x \mapsto g'(x,x)x↦g′(x,x).
  • §4's "incomplete" Hilbert space is a complex inner product space, not assumed complete; completeness is not excluded either.
  • The complete orthonormal system of the Remark is a Mathlib HilbertBasis over an arbitrary index set, and the series converges unconditionally at each point.

Results already in Mathlib are not restated: Schur's product theorem (Matrix.PosSemidef.hadamard, the first sentence of §8 and the sentence after Theorem I), positivity of a kernel (RKHS.posSemidef_kernel) and existence of a space for a positive kernel (RKHS.OfKernel, RKHS.kernel_ofKernel).

A complete development needs a Hilbert tensor product of reproducing kernel Hilbert spaces realized as functions on E×EE\times EE×E, the restriction construction (quotient by the subspace of functions vanishing on E1E_1E1​), and uniqueness of a reproducing kernel Hilbert space with given kernel. The restriction theorem and the functional completion theorem are reusable well beyond this mission; contributions of either, or of a Hilbert tensor product for RKHS, are welcome.

Selected references

  • N. Aronszajn, Theory of Reproducing Kernels, Trans. Amer. Math. Soc. 68 (1950), 337–404. https://doi.org/10.1090/S0002-9947-1950-0051437-7
  • I. Schur, Bemerkungen zur Theorie der beschränkten Bilinearformen mit unendlich vielen Veränderlichen, J. Reine Angew. Math. 140 (1911), 1–28. https://doi.org/10.1515/crll.1911.140.1
  • J. von Neumann and F. J. Murray, On rings of operators, Ann. of Math. 37 (1936), 116–229 (direct products of Hilbert spaces). https://doi.org/10.2307/1968693
  • V. I. Paulsen and M. Raghupathi, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, Cambridge Univ. Press, 2016. https://doi.org/10.1017/CBO9781316219232
8 thms3 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

Theory of Reproducing Kernels I: The Sum of Two Reproducing Kernels Is the Kernel of the Sum Class with the Minimal-Decomposition NormResearch Paper

Motivation

Reproducing kernel Hilbert spaces are Hilbert spaces of functions in which evaluation at a point is a continuous linear functional. They appear wherever a space of functions carries a natural quadratic norm: Bergman and Hardy spaces of analytic functions, spaces of harmonic functions and solutions of elliptic equations, Sobolev spaces in one dimension, and, since the 1990s, the hypothesis classes of kernel methods in machine learning (support vector machines, Gaussian process regression, kernel ridge regression). In all of these settings, kernels are routinely combined: a sum of kernels is used to model a function as a sum of components, and the question is which space of functions, and which norm, the combined kernel describes.

N. Aronszajn's Theory of Reproducing Kernels (Trans. Amer. Math. Soc. 68 (1950), 337–404) organised the subject as a calculus of operations on kernels. Its §6 answers the question for sums.

Timeline. E. H. Moore (Bull. Amer. Math. Soc. 1916; General Analysis, 1935) introduced positive Hermitian matrices on arbitrary sets and their associated function classes. S. Bergman (1920s–1930s) studied the kernel of square-integrable analytic functions of a domain. R. Godement (C. R. Acad. Sci. Paris notes, 1945–1946) found the sum theorem for positive definite functions on a group (footnote 6 of the paper). Aronszajn (1950) proved it for arbitrary kernels on arbitrary sets, with the description of the norm as a minimum over decompositions.

Setting

Let EEE be an arbitrary set. A class of functions FFF on EEE is a complex vector space of functions f:E→Cf:E\to\mathbb Cf:E→C carrying a norm ∥⋅∥\|\cdot\|∥⋅∥ that makes it a complex Hilbert space. A function K:E×E→CK:E\times E\to\mathbb CK:E×E→C is the reproducing kernel (r.k.) of FFF if, for every y∈Ey\in Ey∈E, the function K(⋅,y)K(\cdot,y)K(⋅,y) belongs to FFF and

f(y)=(f,K(⋅,y))for every f∈F,f(y)=(f,K(\cdot,y))\qquad\text{for every } f\in F,f(y)=(f,K(⋅,y))for every f∈F,

where (f,g)(f,g)(f,g) is the scalar product, linear in fff. A kernel exists exactly when every evaluation f↦f(y)f\mapsto f(y)f↦f(y) is continuous.

A function K:E×E→CK:E\times E\to\mathbb CK:E×E→C is a positive matrix if ∑i,j=1nK(yi,yj)ξˉiξj≥0\sum_{i,j=1}^n K(y_i,y_j)\bar\xi_i\xi_j\ge 0∑i,j=1n​K(yi​,yj​)ξˉ​i​ξj​≥0 for all finite families of points yi∈Ey_i\in Eyi​∈E and complex numbers ξi\xi_iξi​. Every reproducing kernel is a positive matrix.

A class F1F_1F1​ is a subclass of F2F_2F2​ if every function of F1F_1F1​ belongs to F2F_2F2​, and a subspace if moreover the two norms agree on F1F_1F1​. Two classes F1F_1F1​, F2F_2F2​ with kernels K1K_1K1​, K2K_2K2​ have a sum class F1+F2={f1+f2:fi∈Fi}F_1+F_2=\{f_1+f_2: f_i\in F_i\}F1​+F2​={f1​+f2​:fi​∈Fi​}, a set of functions; a function of it may have many decompositions f=f1+f2f=f_1+f_2f=f1​+f2​, since F1F_1F1​ and F2F_2F2​ may share functions.

Formalization targets

Goal: the sum theorem (§6, Theorem, p. 353)

For complex Hilbert spaces F1F_1F1​, F2F_2F2​ of functions on EEE with kernels K1K_1K1​, K2K_2K2​: the kernel K=K1+K2K=K_1+K_2K=K1​+K2​ is the reproducing kernel of the class of all f=f1+f2f=f_1+f_2f=f1​+f2​, with

∥f∥2=min⁡[∥f1∥12+∥f2∥22],\|f\|^2=\min\big[\|f_1\|_1^2+\|f_2\|_2^2\big],∥f∥2=min[∥f1​∥12​+∥f2​∥22​],

the minimum taken over all decompositions f=f1+f2f=f_1+f_2f=f1​+f2​, fi∈Fif_i\in F_ifi​∈Fi​. The goal asserts that a space with kernel K1+K2K_1+K_2K1​+K2​ exists, and that every such space consists exactly of the sums and has exactly this norm, the minimum being attained.

Milestones

  1. §2 (4), Moore's theorem (p. 344): a positive matrix is the kernel of one and only one class of functions with a uniquely determined norm. This makes "the class with kernel K1+K2K_1+K_2K1​+K2​" well defined.
  2. §2 (7) (p. 345): every closed subspace F′F'F′ of FFF has a kernel K′K'K′, and for the orthogonal complement F′′F''F′′, K′+K′′=KK'+K''=KK′+K′′=K.
  3. §3, Theorem (p. 347): KKK is the kernel of a finite-dimensional class if and only if K(x,y)=∑i,jβijwi(x)wj(y)‾K(x,y)=\sum_{i,j}\beta_{ij}w_i(x)\overline{w_j(y)}K(x,y)=∑i,j​βij​wi​(x)wj​(y)​ with {βij}\{\beta_{ij}\}{βij​} positive definite and the wkw_kwk​ linearly independent; the class is then spanned by the wkw_kwk​, with norm given by the inverse of {βˉij}\{\bar\beta_{ij}\}{βˉ​ij​}.
  4. §6, p. 354, the disjoint case: when F1∩F2={0}F_1\cap F_2=\{0\}F1​∩F2​={0}, ∥f∥2=∥f1∥12+∥f2∥22\|f\|^2=\|f_1\|_1^2+\|f_2\|_2^2∥f∥2=∥f1​∥12​+∥f2​∥22​, and this happens if and only if F1F_1F1​ and F2F_2F2​ are complementary closed subspaces of FFF.
  5. §6, p. 354, Eq. (1): the class of conjugates Fˉ\bar FFˉ has kernel K(y,x)K(y,x)K(y,x), and Re⁡K=2−1(K(x,y)+K(y,x))\operatorname{Re}K=2^{-1}(K(x,y)+K(y,x))ReK=2−1(K(x,y)+K(y,x)) is the kernel of the class of all f+gˉf+\bar gf+gˉ​, with ∥φ∥02=2min⁡[∥f∥2+∥g∥2]\|\varphi\|_0^2=2\min[\|f\|^2+\|g\|^2]∥φ∥02​=2min[∥f∥2+∥g∥2].

Significance

The result itself. The sum theorem is the first operation of Aronszajn's calculus and the base of the next ones: the order K1≪KK_1\ll KK1​≪K between kernels and the inclusion theorem of §7 are derived from it, as are the kernel Re⁡K\operatorname{Re}KReK of the class of all f+gˉf+\bar gf+gˉ​ and the characterisation of kernels of real spaces (§6, p. 354). In machine learning, it is the statement behind additive kernels and multiple-kernel learning: the hypothesis class of K1+K2K_1+K_2K1​+K2​ is the set of sums, and the regulariser is the infimal convolution of the two squared norms. In complex analysis, it describes the space attached to a sum of Bergman-type kernels.

Formalizing it. The results are classical and proved in the paper; none of them is formalized in Mathlib beyond the existence half of Moore's theorem. Mathlib (2026) has reproducing kernel Hilbert spaces with operator-valued kernels (RKHS, RKHS.kernel, RKHS.kerFun, RKHS.posSemidef_kernel) and the construction of a space from a positive semidefinite matrix (RKHS.OfKernel, RKHS.kernel_ofKernel). This mission adds uniqueness, the sum theorem, kernels of closed subspaces, the finite-dimensional case and the conjugate class.

Difficulty

The kernel K1+K2K_1+K_2K1​+K2​ is the kernel of some space by Moore's existence theorem, so the content is the identification of that space. The obvious candidate, the external direct sum F1⊕F2F_1\oplus F_2F1​⊕F2​ mapped to functions by (f1,f2)↦f1+f2(f_1,f_2)\mapsto f_1+f_2(f1​,f2​)↦f1​+f2​, is not injective as soon as F1F_1F1​ and F2F_2F2​ share a nonzero function; the class of sums is the image of a quotient, and its norm is the norm of a minimal representative, which has to be shown to exist and to make the class complete. Proving that the resulting space has kernel K1+K2K_1+K_2K1​+K2​ and that every other space with this kernel coincides with it requires the uniqueness half of Moore's theorem, which is not in Mathlib. The disjoint case needs, in addition, that an isometric image of a complete space is closed, and the converse direction of its "only in this case".

Formalization scope

  • Scalars and sets. Complex scalars throughout (the paper's convention from §1 on). EEE is an arbitrary type X with no topology, measure, or nonemptiness assumption.
  • Spaces. A class with a kernel is a Mathlib RKHS ℂ H X ℂ on a complex Hilbert space H; its functions are Set.range (⇑ : H → X → ℂ).
  • Kernel. The scalar kernel kernelFn H x y is RKHS.kernel H x y 1.
  • Scalar products. The paper's (f,g)(f,g)(f,g), linear in fff, is Mathlib's ⟪g, f⟫_ℂ.
  • Positivity. A positive matrix is (Matrix.of K).PosSemidef, and "positive definite" is Matrix.PosDef.
  • Decompositions are of functions: f=f1+f2f=f_1+f_2f=f1​+f2​ pointwise with fif_ifi​ in FiF_iFi​.
  • Minima. "min" is an attained minimum (IsLeast), never an infimum.
  • Quantification. Statements about "the" class with a given kernel quantify over every RKHS with that kernel, in any universe, and assert separately that one exists.

Reading decisions, recorded in the item notes:

  • In §2 (7), "complementary subspaces" means a closed subspace and its orthogonal complement, and the kernels of the two subspaces are any kernels with the reproducing property there, not projections of KKK.
  • In §3, {βˉij}\{\bar\beta_{ij}\}{βˉ​ij​} is the entrywise conjugate of {βij}\{\beta_{ij}\}{βij​} (consistent with §3 (5), ∑jαijβˉjk=δik\sum_j\alpha_{ij}\bar\beta_{jk}=\delta_{ik}∑j​αij​βˉ​jk​=δik​), not its conjugate transpose.
  • In §6, p. 354, "subspace" is the paper's §1 notion (norms agree), and the scalar-product remark on Fˉ\bar FFˉ follows from the norm statement by polarization.

Trivialization ruled out. The goal does not define the sum class as RKHS.OfKernel (K₁ + K₂) and assert that its kernel is K1+K2K_1+K_2K1​+K2​, which is Mathlib's kernel_ofKernel. Its content is the description of the functions (exactly the sums) and of the norm (the attained minimum) for every space with that kernel.

Infrastructure. A complete development needs:

  • uniqueness of an RKHS given its kernel (milestone 1);
  • orthogonal projections onto closed subspaces (Mathlib Submodule.starProjection);
  • quotients of Hilbert spaces by closed subspaces, or the orthogonal complement of the kernel of the sum map;
  • for §3, Gram matrices and their inverses.

Milestone 1 and the RKHS structure on a closed subspace are reusable beyond this mission and are natural Mathlib contributions. Independent proofs of any milestone are welcome.

Selected references

  • N. Aronszajn, Theory of Reproducing Kernels, Trans. Amer. Math. Soc. 68 (1950), no. 3, 337–404. https://doi.org/10.1090/S0002-9947-1950-0051437-7
  • E. H. Moore, General Analysis, Part I, Memoirs of the American Philosophical Society 1, 1935.
  • R. Godement, Sur les fonctions de type positif, C. R. Acad. Sci. Paris 221 (1945), 69; and further notes in vols. 221–222 (1945–1946), as cited by Aronszajn [Godement 1].
  • E. H. Moore, On properly positive Hermitian matrices, Bull. Amer. Math. Soc. 23 (1916), 59.
  • V. I. Paulsen and M. Raghupathi, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, Cambridge Univ. Press, 2016. https://doi.org/10.1017/CBO9781316219232
8 thms3 active usersReviewed
🏆Completed
Markov ChainOperations ResearchProbability+1·Captain: mikedeng1

Fundamentals of Queueing Theory III: The Transient M/M/1 Queue via Modified Bessel FunctionsTextbook

Motivation

Steady-state formulas describe a queue that has been running forever. Many practical questions are about a queue that has not: a call centre just after opening, a server just after a reset, a system under a burst of load. For these, the relevant quantity is the transient distribution pn(t)=Pr⁡{N(t)=n}p_n(t) = \Pr\{N(t) = n\}pn​(t)=Pr{N(t)=n} of the number N(t)N(t)N(t) in the system at a finite time ttt. It is also what determines how fast the steady state is approached, and it is needed for the busy period: the length of time a server stays busy once a customer arrives at an idle server.

For the single-server Markovian queue M/M/1 the transient distribution has an explicit closed form in modified Bessel functions. Its history is short and well documented. Ledermann and Reuter (1954) obtained it by spectral analysis of the birth–death process. Bailey (1954) found it by generating functions and Laplace transforms, and Champernowne (1956) by combinatorial methods. Bailey's route is the standard textbook derivation, and it is the one Gross, Shortle, Thompson and Harris outline in §2.11 of Fundamentals of Queueing Theory (4th ed., 2008). Abate and Whitt (1989) showed that computing with the resulting series is numerically delicate, which is one reason for having the formula pinned down exactly.

This mission formalizes §§2.11–2.12 of that book: the transient laws of M/M/1/1, M/M/1 and M/M/∞, and the M/M/1 busy period.

Setting

Customers arrive in a Poisson stream of rate λ>0\lambda > 0λ>0. Each service takes an exponential time of rate μ>0\mu > 0μ>0, and ρ=λ/μ\rho = \lambda/\muρ=λ/μ. The number in the system is a continuous-time Markov chain on {0,1,2,… }\{0, 1, 2, \dots\}{0,1,2,…}, and its state probabilities pn(t)p_n(t)pn​(t) satisfy the forward (differential–difference) equations. For M/M/1 started with N(0)=iN(0) = iN(0)=i they are, for t≥0t \ge 0t≥0,

pn′(t)=−(λ+μ)pn(t)+λpn−1(t)+μpn+1(t) (n>0),p0′(t)=−λp0(t)+μp1(t),(2.72)p_n'(t) = -(\lambda+\mu)p_n(t) + \lambda p_{n-1}(t) + \mu p_{n+1}(t)\ (n > 0), \qquad p_0'(t) = -\lambda p_0(t) + \mu p_1(t), \tag{2.72}pn′​(t)=−(λ+μ)pn​(t)+λpn−1​(t)+μpn+1​(t) (n>0),p0′​(t)=−λp0​(t)+μp1​(t),(2.72)

with pn(0)=1p_n(0) = 1pn​(0)=1 if n=in = in=i and 000 otherwise. The other systems are variants:

  • M/M/1/1, no waiting room: two states and equations (2.70).
  • M/M/∞, ample service: the death rate in state nnn is nμn\munμ, giving (2.76).
  • The busy-period system: (2.72) with 000 made absorbing (λ0=0\lambda_0 = 0λ0​=0) and N(0)=1N(0) = 1N(0)=1. Its p0(t)p_0(t)p0​(t) is the distribution function of the busy period TbpT_{bp}Tbp​.

A family (pn)(p_n)(pn​) solves a system on [0,∞)[0,\infty)[0,∞) when each pnp_npn​ has, at every t≥0t \ge 0t≥0, the prescribed derivative (a right derivative at t=0t = 0t=0). It is a probability solution when pn(t)≥0p_n(t) \ge 0pn​(t)≥0 and ∑npn(t)=1\sum_n p_n(t) = 1∑n​pn​(t)=1 for every t≥0t \ge 0t≥0. The modified Bessel function of the first kind is

In(y)=∑k=0∞(y/2)n+2kk! (n+k)!,I−n=In,I_n(y) = \sum_{k=0}^{\infty} \frac{(y/2)^{n+2k}}{k!\,(n+k)!}, \qquad I_{-n} = I_n,In​(y)=k=0∑∞​k!(n+k)!(y/2)n+2k​,I−n​=In​,

and the Laplace transform of fff is fˉ(s)=∫0∞e−stf(t) dt\bar f(s) = \int_0^\infty e^{-st} f(t)\,dtfˉ​(s)=∫0∞​e−stf(t)dt for Re⁡s>0\operatorname{Re} s > 0Res>0.

Formalization targets

Goal: the transient M/M/1 law, (2.75)

With y=2tλμy = 2t\sqrt{\lambda\mu}y=2tλμ​,

pn(t)=e−(λ+μ)t[ρ(n−i)/2In−i(y)+ρ(n−i−1)/2In+i+1(y)+(1−ρ)ρn∑j=n+i+2∞ρ−j/2Ij(y)].p_n(t) = e^{-(\lambda+\mu)t}\Big[\rho^{(n-i)/2} I_{n-i}(y) + \rho^{(n-i-1)/2} I_{n+i+1}(y) + (1-\rho)\rho^n \sum_{j=n+i+2}^{\infty} \rho^{-j/2} I_j(y)\Big].pn​(t)=e−(λ+μ)t[ρ(n−i)/2In−i​(y)+ρ(n−i−1)/2In+i+1​(y)+(1−ρ)ρnj=n+i+2∑∞​ρ−j/2Ij​(y)].

The goal asserts five things for every λ,μ>0\lambda, \mu > 0λ,μ>0 and every iii, with no restriction on ρ\rhoρ:

  1. the series converges;
  2. these functions solve (2.72);
  3. they meet the initial condition;
  4. they form a probability distribution at every ttt;
  5. they are the only probability solution.

Milestones

  1. (2.71): the M/M/1/1 solution p1(t)=λλ+μ(1−e−(λ+μ)t)+p1(0)e−(λ+μ)tp_1(t) = \frac{\lambda}{\lambda+\mu}(1-e^{-(\lambda+\mu)t}) + p_1(0)e^{-(\lambda+\mu)t}p1​(t)=λ+μλ​(1−e−(λ+μ)t)+p1​(0)e−(λ+μ)t, and the matching formula for p0p_0p0​.
  2. (2.74) and Rouché's theorem: for Re⁡s>0\operatorname{Re} s > 0Res>0, the quadratic (λ+μ+s)z−μ−λz2(\lambda+\mu+s)z - \mu - \lambda z^2(λ+μ+s)z−μ−λz2 has exactly one zero in ∣z∣<1|z| < 1∣z∣<1, namely z1=(λ+μ+s−(λ+μ+s)2−4λμ)/(2λ)z_1 = (\lambda+\mu+s-\sqrt{(\lambda+\mu+s)^2-4\lambda\mu})/(2\lambda)z1​=(λ+μ+s−(λ+μ+s)2−4λμ​)/(2λ).
  3. The transform of p0p_0p0​: pˉ0(s)=z1i+1/(μ(1−z1))\bar p_0(s) = z_1^{i+1}/(\mu(1-z_1))pˉ​0​(s)=z1i+1​/(μ(1−z1​)).
  4. The limit of (2.75): pn(t)→(1−ρ)ρnp_n(t) \to (1-\rho)\rho^npn​(t)→(1−ρ)ρn if ρ<1\rho < 1ρ<1, and pn(t)→0p_n(t) \to 0pn​(t)→0 if ρ≥1\rho \ge 1ρ≥1.
  5. (2.77), M/M/∞: started empty, pn(t)=a(t)ne−a(t)/n!p_n(t) = a(t)^n e^{-a(t)}/n!pn​(t)=a(t)ne−a(t)/n! with a(t)=(1−e−μt)λ/μa(t) = (1-e^{-\mu t})\lambda/\mua(t)=(1−e−μt)λ/μ. The statement says that this family solves (2.76), is the unique probability solution, and has generating function exp⁡((z−1)a(t))\exp((z-1)a(t))exp((z−1)a(t)).
  6. The busy-period transform: pˉ0(s)=2μ/(s[λ+μ+s+(λ+μ+s)2−4λμ])\bar p_0(s) = 2\mu/(s[\lambda+\mu+s+\sqrt{(\lambda+\mu+s)^2-4\lambda\mu}])pˉ​0​(s)=2μ/(s[λ+μ+s+(λ+μ+s)2−4λμ​]).
  7. The busy-period density: p0′(t)=μ/λ e−(λ+μ)tI1(2λμ t)/tp_0'(t) = \sqrt{\mu/\lambda}\,e^{-(\lambda+\mu)t} I_1(2\sqrt{\lambda\mu}\,t)/tp0′​(t)=μ/λ​e−(λ+μ)tI1​(2λμ​t)/t.
  8. (2.79): for λ<μ\lambda < \muλ<μ, E[Tbp]=1/(μ−λ)E[T_{bp}] = 1/(\mu-\lambda)E[Tbp​]=1/(μ−λ) and E[Tbc]=1/λ+1/(μ−λ)E[T_{bc}] = 1/\lambda + 1/(\mu-\lambda)E[Tbc​]=1/λ+1/(μ−λ).

Significance

The formula (2.75) is the exact finite-time law of the most basic queue. It gives the rate at which M/M/1 approaches equilibrium, and it gives the distribution of the queue under overload (ρ≥1\rho \ge 1ρ≥1), where no steady state exists. It is the reference against which numerical transient methods, such as the uniformization of Chapter 8 of the same book, are checked. The busy-period density and its mean (2.79) enter server-utilisation and vacation models, and the Laplace-transform method used here recurs in the M/G/1 analysis of Chapter 5.

All of these results are classical and proved in the literature. None of them is machine-checked, as far as the platform's catalogue and Mathlib show. The chain from a countable system of linear ODEs, through generating functions and a root-location argument, to a Bessel series is a standard pattern in applied probability, and a formal version of it is what this mission adds. The formal statements also make explicit what the book leaves implicit: the sense in which the equations hold at t=0t = 0t=0, and the class in which the solution is unique.

Difficulty

The forward equations (2.72) form an infinite linear system. The obvious approach is to treat it like a finite system of ODEs, whose solution is a matrix exponential, and read off (2.75). That fails for two reasons. The generator is an infinite matrix, so its exponential needs a functional-analytic setting. And uniqueness is not automatic for infinite systems: it needs a class, such as probability solutions, and an argument that works in that class.

The Bessel form is a second, independent difficulty. The transform pˉ0(s)\bar p_0(s)pˉ​0​(s) is fixed by a root-location argument in the complex plane. Inverting the transform, or verifying (2.75) directly, requires manipulating the three-term Bessel recurrence and exchanging infinite sums. The tail sum ∑jρ−j/2Ij\sum_{j} \rho^{-j/2} I_j∑j​ρ−j/2Ij​ has to be controlled uniformly enough to be differentiated term by term. For ρ≥1\rho \ge 1ρ≥1 the factor (1−ρ)(1-\rho)(1−ρ) is non-positive, so the nonnegativity of pn(t)p_n(t)pn​(t) is not visible from the formula.

Formalization scope

Conventions committed to:

  • Parameters. Rates are real with λ,μ>0\lambda, \mu > 0λ,μ>0, and ρ=λ/μ\rho = \lambda/\muρ=λ/μ. States are ℕ (Fin 2 for M/M/1/1).
  • Solutions. "Solves on [0,∞)[0,\infty)[0,∞)" is HasDerivWithinAt on Set.Ici 0 at every t≥0t \ge 0t≥0. Uniqueness is asserted among solutions that are probability distributions at every time.
  • Special functions. Half-integer powers of ρ\rhoρ are real powers, and I−m=ImI_{-m} = I_mI−m​=Im​ is part of the definition. Laplace transforms are complex Bochner integrals over (0,∞)(0,\infty)(0,∞), and each statement also asserts the integrability it needs. Square roots with positive real part are hypotheses r2=(λ+μ+s)2−4λμr^2 = (\lambda+\mu+s)^2 - 4\lambda\mur2=(λ+μ+s)2−4λμ, Re⁡r>0\operatorname{Re} r > 0Rer>0.

The closed forms stated exactly as in the book are:

  • (2.71);
  • z1z_1z1​ and z2z_2z2​ of (2.74);
  • pˉ0(s)=z1i+1/(μ(1−z1))\bar p_0(s) = z_1^{i+1}/(\mu(1-z_1))pˉ​0​(s)=z1i+1​/(μ(1−z1​));
  • (2.75), with the Bessel series of p.101;
  • the M/M/∞ law and (2.77);
  • the busy-period transform and density of p.102;
  • (2.79).

The book derives (2.79) by a steady-state ratio argument valid for M/G/1. Here it is stated for M/M/1, as the mean of the explicit density.

A statement of (2.75) that only asserts the right-hand side is well defined, or checks only n=0n = 0n=0, is ruled out: the goal requires the ODE system, the initial condition, the probability property and uniqueness. For the same reason, the M/M/∞ law is tied to the system (2.76) and does not reduce to a Taylor expansion.

Needed infrastructure that Mathlib lacks:

  • modified Bessel functions of integer order;
  • Laplace transforms;
  • a Rouché-type zero count or a direct root-location lemma;
  • uniqueness for countable linear ODE systems with bounded or linearly growing rates.

The Bessel and Laplace definitions, and the uniqueness lemma for birth–death forward equations, are reusable beyond this mission. Contributions of those as separate lemmas are welcome.

Selected references

  • D. Gross, J. F. Shortle, J. M. Thompson, C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008, §§2.11–2.12, pp.97–103. https://doi.org/10.1002/9781118625651
  • N. T. J. Bailey, "A continuous time treatment of a simple queue using generating functions", J. Royal Statistical Society B 16 (1954) 288–291. https://doi.org/10.1111/j.2517-6161.1954.tb00172.x
  • W. Ledermann, G. E. H. Reuter, "Spectral theory for the differential equations of simple birth and death processes", Phil. Trans. Royal Society A 246 (1954) 321–369. https://doi.org/10.1098/rsta.1954.0001
  • D. G. Champernowne, "An elementary method of solution of the queueing problem with a single server and constant parameters", J. Royal Statistical Society B 18 (1956) 125–128. https://doi.org/10.1111/j.2517-6161.1956.tb00217.x
  • J. Abate, W. Whitt, "Calculating time-dependent performance measures for the M/M/1 queue", IEEE Trans. Communications 37 (1989) 1102–1104. https://doi.org/10.1109/26.41165
15 thms3 active usersReviewed
PreviousPage 3 of 13Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me