Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Analysis

323 missions · 177 completed

Missions

Open146Completed177All323
🏆Completed
Functional AnalysisLinear algebra·Captain: wurtle

A direct proof of the complete Crouzeix inequalityResearch Paper

Motivation

For a square matrix AAA, the spectrum alone does not control the size of p(A)p(A)p(A): a nonzero nilpotent matrix has spectrum {0}\{0\}{0} yet ∥A∥>0\|A\|>0∥A∥>0. The numerical range W(A)={u∗Au: ∥u∥=1}W(A)=\{u^*Au:\ \|u\|=1\}W(A)={u∗Au: ∥u∥=1} is a compact convex set containing the spectrum (Toeplitz–Hausdorff), and it does retain enough information. Crouzeix's conjecture (2004) asserts that for every polynomial ppp,

∥p(A)∥≤2max⁡z∈W(A)∣p(z)∣,\|p(A)\|\le 2\max_{z\in W(A)}|p(z)|,∥p(A)∥≤2z∈W(A)max​∣p(z)∣,

i.e. that W(A)W(A)W(A) is a 222-spectral set; the constant 222 would be optimal. Such bounds are used to estimate matrix functions in numerical linear algebra (for example GMRES convergence through Faber polynomials) and in operator theory. The complete version asks for the same constant when the polynomial has m×mm\times mm×m matrix coefficients, uniformly in mmm; by Paulsen's theorem this is equivalent to similarity of the conformal disk image of AAA to a contraction with condition number at most 222.

Background

  • 1918–1919 — Toeplitz and Hausdorff prove convexity of the numerical range (Math. Z. 1918, Math. Z. 1919).
  • 1972, 1984 — Arveson's dilation theory (Acta Math. 128, 1972) and Paulsen's similarity theorem (Proc. AMS 92, 1984) relate complete contractivity, dilations and similarity.
  • 1999 — Delyon and Delyon's positive integral representations (Bull. SMF 1999).
  • 2004 — Crouzeix formulates the constant-two question (IEOT 2004); 2007 — he proves a universal complete bound 11.0811.0811.08 (JFA 2007).
  • 2006 — Badea, Crouzeix and Delyon obtain the complete constant 222 for 2×22\times22×2 matrices (Math. Z. 2006).
  • 2017–2018 — Crouzeix and Palencia prove the complete bound 1+21+\sqrt21+2​ (SIMAX 2017); Ransford and Schwenninger simplify the argument (SIMAX 2018).
  • 2026 — Scalar (m=1m=1m=1) constant-two proofs appear in preprints of Jin, Lorist–Schwenninger (arXiv:2608.03841) and Luo; Åhag, Czyż and Virtanen prove the complete inequality for base matrices of order at most three (arXiv:2608.27346).
  • September 2026 — Two OpenAI preprints claim the complete inequality in all dimensions: a structural proof via an optimal similarity and a common positive boundary density, extended to all bounded Hilbert-space operators (source), and a direct coefficient proof for matrices (source).

This mission asks for a formal proof of the complete Crouzeix inequality for matrices, with its sharpness, as stated in Theorem 1.1 of an OpenAI preprint dated September 26, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) (n≥1n\ge1n≥1) let W(A)={u∗Au:u∈Cn, u∗u=1}W(A)=\{u^*Au: u\in\mathbb C^n,\ u^*u=1\}W(A)={u∗Au:u∈Cn, u∗u=1}. A matrix polynomial of degree ddd with coefficient size m≥1m\ge1m≥1 is P(z)=∑k=0dBkzkP(z)=\sum_{k=0}^dB_kz^kP(z)=∑k=0d​Bk​zk with Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C). Its evaluation at AAA is

P[A]=∑k=0dAk⊗Bk ∈Mn(C)⊗Mm(C),P[A]=\sum_{k=0}^d A^k\otimes B_k\ \in M_n(\mathbb C)\otimes M_m(\mathbb C),P[A]=k=0∑d​Ak⊗Bk​ ∈Mn​(C)⊗Mm​(C),

with the base space first. All norms are Euclidean operator norms. For m=1m=1m=1 this is the usual p(A)p(A)p(A).

Formalization targets

Milestone: the inequality (Theorem 1.1, p. 1, first assertion)

For all n,m≥1n,m\ge1n,m≥1, d≥0d\ge0d≥0, A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) and B0,…,Bd∈Mm(C)B_0,\dots,B_d\in M_m(\mathbb C)B0​,…,Bd​∈Mm​(C),

∥∑k=0dAk⊗Bk∥ ≤ 2max⁡z∈W(A)∥∑k=0dBkzk∥.\Bigl\|\sum_{k=0}^dA^k\otimes B_k\Bigr\|\ \le\ 2\max_{z\in W(A)}\Bigl\|\sum_{k=0}^dB_kz^k\Bigr\| .​k=0∑d​Ak⊗Bk​​ ≤ 2z∈W(A)max​​k=0∑d​Bk​zk​.

Milestone: sharpness (Theorem 1.1, p. 1, second assertion)

If the inequality holds with a constant ccc in place of 222 for all n,m,d,A,Bn,m,d,A,Bn,m,d,A,B, then c≥2c\ge2c≥2.

Goal: Theorem 1.1 (p. 1)

Both assertions together: the constant 222 is valid and no smaller universal constant is.

Significance

The result itself. It settles the complete Crouzeix conjecture in its matrix formulation, uniformly in the base dimension nnn, the coefficient size mmm and the degree, including matrices whose numerical range is a point or a segment. The scalar case m=1m=1m=1 had recently been proved by other authors and the complete case was known only for n≤3n\le3n≤3; a scalar argument need not survive matrix amplification because coefficient matrices do not commute. Equivalently, the numerical range is a complete 222-spectral set for every matrix, which via Paulsen's theorem gives a similarity of condition number at most 222 making the conformal disk image of AAA a contraction. A companion OpenAI preprint gives a separate structural proof and extends the bound to all bounded operators on Hilbert spaces.

Formalizing it. The proof uses exterior conformal maps of analytic convex domains, Faber-type coefficients, a positive double-layer kernel, and a 2×22\times22×2 block positivity argument; Section 4 then approximates an arbitrary numerical range by analytic convex domains. A formal proof would provide numerical ranges, Faber polynomials and conformal collars in Lean, all reusable in matrix analysis. No machine-checked proof of any constant-222 Crouzeix bound is known.

Difficulty

The naive approach through the spectrum fails for non-normal matrices, and the classical Crouzeix–Palencia method (a positive double-layer potential plus a Cauchy transform of conjugate data) loses a factor and yields 1+21+\sqrt21+2​. To reach 222 in the complete setting, the argument must keep both multiplication orders FGFGFG and GFGFGF of matrix-valued test functions, since the coefficients do not commute. The preprint chooses a top singular pair (x,y)(x,y)(x,y) of F[A]F[A]F[A], represents three functionals through the resolvent, and must show that the resulting coefficient weights (one on the constant term, one half on the others) match exactly the Fourier weights of the diagonal compressions (Section 2, Proposition 2.2, p. 5; Theorem 3.2, p. 6). Degenerate numerical ranges with empty interior require a separate approximation step (Lemma 4.1, p. 9).

Formalization scope

  • Matrices are Matrix (Fin n) (Fin n) ℂ with the L2 operator norm (Matrix.Norms.L2Operator). The numerical range is the set of ⟨x,Ax⟩\langle x, Ax\rangle⟨x,Ax⟩ over unit vectors of EuclideanSpace ℂ (Fin n).
  • Coefficients are B : Fin (d+1) → Matrix (Fin m) (Fin m) ℂ; the evaluation is ∑kAk⊗KronBk\sum_k A^k\otimes_{\mathrm{Kron}}B_k∑k​Ak⊗Kron​Bk​ indexed by Fin n × Fin m, base factor first.
  • rangeMaximum A B is the sSup of ∥P(z)∥\|P(z)\|∥P(z)∥ over W(A)W(A)W(A). Since n≥1n\ge1n≥1, W(A)W(A)W(A) is nonempty and compact, so this is the true maximum; UniversalBound C quantifies over all n,m≥1n,m\ge1n,m≥1, all ddd, all AAA and BBB.
  • The goal OAI.CompleteCrouzeix.main is UniversalBound 2 ∧ ∀ C, UniversalBound C → 2 ≤ C. The two milestones state the same two clauses in the DirectCrouzeix namespace, whose definitions are identical in content.
  • No normality, invertibility or nonempty-interior hypothesis is imposed on AAA.

Selected references

  • OpenAI, A direct proof of the complete Crouzeix inequality, OpenAI Math Release preprint, September 26, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-direct-proof-of-the-complete-Crouzeix-inequality-September-26-2026/paper.pdf
  • OpenAI, The complete Crouzeix theorem: optimal similarity and a common positive boundary representation, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-complete-Crouzeix-theorem-September-23-2026/paper.pdf
  • M. Crouzeix, Bounds for analytical functions of matrices, Integral Equations Operator Theory 48 (2004), 461–477. https://doi.org/10.1007/s00020-002-1188-6
  • M. Crouzeix, Numerical range and functional calculus in Hilbert space, J. Funct. Anal. 244 (2007), 668–690. https://doi.org/10.1016/j.jfa.2006.10.013
  • M. Crouzeix, C. Palencia, The numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 38 (2017), 649–655. https://doi.org/10.1137/17M1116672
  • T. Ransford, F. L. Schwenninger, Remarks on the Crouzeix–Palencia proof that the numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 39 (2018), 342–345. https://doi.org/10.1137/17M1143757
  • C. Badea, M. Crouzeix, B. Delyon, Convex domains and K-spectral sets, Math. Z. 252 (2006), 345–365. https://doi.org/10.1007/s00209-005-0857-y
  • B. Delyon, F. Delyon, Generalization of von Neumann's spectral sets and integral representation of operators, Bull. Soc. Math. France 127 (1999), 25–41. https://doi.org/10.24033/bsmf.2340
  • E. Lorist, F. L. Schwenninger, A solution to Crouzeix's conjecture, arXiv:2608.03841 (2026). https://arxiv.org/abs/2608.03841v2
  • P. Åhag, R. Czyż, J. Virtanen, The complete Crouzeix conjecture in dimension three and the Clouâtre–Ostermann–Ransford conjecture, arXiv:2608.27346 (2026). https://arxiv.org/abs/2608.27346v4
  • O. Toeplitz, Das algebraische Analogon zu einem Satze von Fejér, Math. Z. 2 (1918), 187–197. https://doi.org/10.1007/BF01212904
  • F. Hausdorff, Der Wertvorrat einer Bilinearform, Math. Z. 3 (1919), 314–316. https://doi.org/10.1007/BF01292610
47 thms3 active usersReviewed
🏆Completed
Operations ResearchStochastic Systems·Captain: mikedeng1

The Power of Two Choices in Randomized Load Balancing II: T_d(λ)/log T_1(λ) → 1/log d as λ → 1⁻, an Exponential Improvement over One ChoiceResearch Paper

Motivation

A dispatcher assigns each arriving job to one of nnn servers. Sending it to a uniformly random server is simple but produces long queues near capacity; sending it to the globally shortest queue requires full state information. The power of ddd choices sits between the two: each job samples ddd servers at random and joins the shortest of them. Mitzenmacher's analysis of this supermarket model (IEEE TPDS 12(10), 2001) together with the balls-into-bins result of Azar, Broder, Karlin and Upfal (SIAM J. Comput. 29(1), 1999), established that a second random choice changes the behaviour of the system qualitatively. The idea underlies load balancers, hashing schemes and distributed schedulers.

This mission formalizes the paper's quantitative statement of that improvement in heavy traffic, the regime where the arrival rate per server λ\lambdaλ approaches the service rate 111.

Setting

Customers arrive as a Poisson stream of rate λn\lambda nλn with 0≤λ<10\le\lambda<10≤λ<1, service times are exponential with mean 111, and each customer joins the shortest of ddd queues sampled uniformly with replacement. As n→∞n\to\inftyn→∞ the fraction of queues with at least iii customers follows a deterministic limiting system with fixed point πi=λ(di−1)/(d−1)\pi_i=\lambda^{(d^i-1)/(d-1)}πi​=λ(di−1)/(d−1). Corollary 2 of the paper shows that, for d≥2d\ge2d≥2, the expected time a customer spends in that limiting system converges to

Td(λ)=∑i=1∞λdi−dd−1.T_d(\lambda)=\sum_{i=1}^{\infty}\lambda^{\frac{d^i-d}{d-1}} .Td​(λ)=i=1∑∞​λd−1di−d​.

With a single choice the system is nnn independent M/M/1 queues, and the expected time is

T1(λ)=11−λ.T_1(\lambda)=\frac{1}{1-\lambda}.T1​(λ)=1−λ1​.

This mission takes these two formulas as its definitions; the limiting system itself and the convergence to Td(λ)T_d(\lambda)Td​(λ) are the subject of the companion mission (part I). The auxiliary function of Lemma 3 is

Fd(λ)=∑i=0∞λdilog⁡11−λ.F_d(\lambda)=\frac{\sum_{i=0}^{\infty}\lambda^{d^i}}{\log\frac{1}{1-\lambda}} .Fd​(λ)=log1−λ1​∑i=0∞​λdi​.

Throughout, d≥2d\ge2d≥2 is an integer and logarithms are natural.

Formalization targets

Goal: Theorem 4, limit clause (p. 1099)

lim⁡λ→1−Td(λ)log⁡T1(λ)=1log⁡d(d≥2).\lim_{\lambda\to1^-}\frac{T_d(\lambda)}{\log T_1(\lambda)}=\frac{1}{\log d}\qquad(d\ge2).λ→1−lim​logT1​(λ)Td​(λ)​=logd1​(d≥2).

Milestones, in the order the paper's argument uses them

  1. The rewriting of TdT_dTd​ (proof of Theorem 4): with λ′=λ1/(d−1)\lambda'=\lambda^{1/(d-1)}λ′=λ1/(d−1) and 0<λ<10<\lambda<10<λ<1,
Td(λ)=∑i=1∞(λ′)diλd/(d−1).T_d(\lambda)=\frac{\sum_{i=1}^{\infty}(\lambda')^{d^i}}{\lambda^{d/(d-1)}} .Td​(λ)=λd/(d−1)∑i=1∞​(λ′)di​.
  1. The product identity (proof of Lemma 3): for 0≤λ<10\le\lambda<10≤λ<1,
∏i=0∞(1+λdi+λ2di+⋯+λ(d−1)di)=11−λ.\prod_{i=0}^{\infty}\bigl(1+\lambda^{d^i}+\lambda^{2d^i}+\dots+\lambda^{(d-1)d^i}\bigr)=\frac{1}{1-\lambda}.i=0∏∞​(1+λdi+λ2di+⋯+λ(d−1)di)=1−λ1​.
  1. Lemma 3:
lim⁡λ→1−Fd(λ)=1log⁡d.\lim_{\lambda\to1^-}F_d(\lambda)=\frac{1}{\log d}.λ→1−lim​Fd​(λ)=logd1​.

The goal is a statement about the shape of the growth, not a constant: it pins the leading behaviour Td(λ)∼log⁡d11−λT_d(\lambda)\sim\log_d\frac{1}{1-\lambda}Td​(λ)∼logd​1−λ1​.

Significance

Theorem 4 makes "exponential improvement" precise. With one choice the expected time grows like 11−λ\frac1{1-\lambda}1−λ1​ as the load approaches capacity; with d≥2d\ge2d≥2 choices it grows like log⁡11−λlog⁡d\frac{\log\frac1{1-\lambda}}{\log d}logdlog1−λ1​​. It also quantifies the diminishing return of extra choices: going from d=2d=2d=2 to ddd only divides the leading term by log⁡2d\log_2 dlog2​d, while going from one choice to two changes its order. These constants are the benchmark against which later heavy-traffic analyses of join-the-shortest-of-ddd policies are compared.

The result is proved in the paper (the limit clause; see Difficulty for the other clause). No machine-checked version is known to exist. The formalization yields a self-contained Lean development of the lacunary series ∑ixdi\sum_i x^{d^i}∑i​xdi near x=1x=1x=1 and of the base-ddd product identity, both of which are classical analytic facts with uses outside queueing (lacunary power series, digit expansions).

Difficulty

The obvious approach compares ∑iλdi\sum_i\lambda^{d^i}∑i​λdi with an integral, but the terms are not monotone images of a smooth function of a continuous index in a way that controls the error uniformly as λ→1−\lambda\to1^-λ→1−: the number of terms close to 111 grows like log⁡d11−λ\log_d\frac{1}{1-\lambda}logd​1−λ1​ and each of them contributes nearly 111, so the error terms are of the same order as the quantity being measured. The difficulty is to obtain matching upper and lower bounds with constants tending to 1/log⁡d1/\log d1/logd, uniformly as λ→1−\lambda\to1^-λ→1−. Passing from Lemma 3 to Theorem 4 additionally requires controlling the change of variable λ↦λ1/(d−1)\lambda\mapsto\lambda^{1/(d-1)}λ↦λ1/(d−1) inside the logarithm.

Theorem 4 as printed also contains a first clause, Td(λ)≤cdlog⁡T1(λ)T_d(\lambda)\le c_d\log T_1(\lambda)Td​(λ)≤cd​logT1​(λ) for all λ∈[0,1]\lambda\in[0,1]λ∈[0,1]. It is false as printed near λ=0\lambda=0λ=0: Td(λ)≥1T_d(\lambda)\ge1Td​(λ)≥1 while log⁡T1(λ)→0\log T_1(\lambda)\to0logT1​(λ)→0. The paper does not prove it, and this mission does not pose it.

Formalization scope

  • Representation. λ\lambdaλ is a real number (lam), ddd a natural number with the hypothesis 2≤d2\le d2≤d on every statement. TdT_dTd​, T1T_1T1​ and FdF_dFd​ are real-valued definitions in one definition file.
  • Exponents. TdT_dTd​'s iii-th term uses the natural-number exponent ∑1≤k<idk=di−dd−1\sum_{1\le k<i}d^k=\frac{d^i-d}{d-1}∑1≤k<i​dk=d−1di−d​, so its i=1i=1i=1 term is λ0=1\lambda^0=1λ0=1. The series runs over i∈Ni\in\mathbb Ni∈N with the i=0i=0i=0 term equal to 000. λ′=λ1/(d−1)\lambda'=\lambda^{1/(d-1)}λ′=λ1/(d−1) and λd/(d−1)\lambda^{d/(d-1)}λd/(d−1) are real powers.
  • Series and junk values. All series are real tsums; they converge for 0≤λ<10\le\lambda<10≤λ<1. Outside that range Lean's conventions (a divergent series sums to 000, x/0=0x/0=0x/0=0, log⁡x=0\log x=0logx=0 for x≤0x\le0x≤0) produce meaningless values, so every statement either restricts λ\lambdaλ to [0,1)[0,1)[0,1) or (0,1)(0,1)(0,1) or is a limit along λ<1\lambda<1λ<1.
  • Limits. "λ→1−\lambda\to1^-λ→1−" is the one-sided filter 𝓝[<] 1; the limit 1/log⁡d1/\log d1/logd uses Real.log.
  • Infinite product. The product identity is stated with HasProd (unconditional convergence of finite subproducts), which for factors ≥1\ge1≥1 is the same as convergence of the partial products.
  • Not trivializable. Because every limit is one-sided at 111 and the denominators log⁡T1(λ)\log T_1(\lambda)logT1​(λ) and log⁡11−λ\log\frac1{1-\lambda}log1−λ1​ are positive there, no statement can be satisfied by Lean's junk values at λ≥1\lambda\ge1λ≥1 or at λ=0\lambda=0λ=0; the summability of the rewritten series is asserted explicitly.
  • Infrastructure. Useful general lemmas: asymptotics of ∑ixdi\sum_i x^{d^i}∑i​xdi as x→1−x\to1^-x→1−, products of finite geometric sums, change of variables in one-sided limits. These are reusable beyond this mission. Contributions of any of the milestones, or of alternative proofs of Lemma 3, are welcome.

Selected references

  • M. Mitzenmacher, The Power of Two Choices in Randomized Load Balancing, IEEE Transactions on Parallel and Distributed Systems 12(10), 2001, pp. 1094–1104. https://doi.org/10.1109/71.963420
  • Y. Azar, A. Z. Broder, A. R. Karlin, E. Upfal, Balanced Allocations, SIAM Journal on Computing 29(1), 1999, pp. 180–200. https://doi.org/10.1137/S0097539795288490
5 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 3: The Periodic Gaussians Ψ_α and Ψ_β Are Within Statistical Distance 9(β/α − 1) When 0 < α < β ≤ 2αResearch Paper

Motivation

The Learning with Errors (LWE) problem, introduced by Regev in On Lattices, Learning with Errors, Random Linear Codes, and Cryptography (J. ACM 56(6), 2009, Article 34; doi:10.1145/1568318.1568324), asks to recover a secret vector s∈Zpns \in \mathbb{Z}_p^ns∈Zpn​ from noisy inner products ⟨a,s⟩/p+e mod 1\langle a, s\rangle/p + e \bmod 1⟨a,s⟩/p+emod1. The noise eee is drawn from a periodic normal distribution Ψβ\Psi_\betaΨβ​ on the circle T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z: a centred normal variable reduced modulo 111. LWE has since become the main hardness assumption of lattice-based cryptography, including the post-quantum standards built on it.

Regev's reductions repeatedly need to compare Ψα\Psi_\alphaΨα​ and Ψβ\Psi_\betaΨβ​ for nearby parameters, for instance when the noise parameter is known only up to a small relative error. Claim 2.2 of the paper (p. 34:16) quantifies this: the two periodic normal distributions are close in statistical distance, linearly in the relative change β/α−1\beta/\alpha - 1β/α−1. This mission formalizes Claim 2.2 and the steps of its proof. The source is the published J. ACM article; the paper's main theorem, a quantum reduction from worst-case lattice problems to LWE, is outside this series.

Setting

Identify T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z with the segment [0,1)[0,1)[0,1) with addition modulo 111. For β>0\beta > 0β>0 the normal density with mean 000 and standard deviation β/2π\beta/\sqrt{2\pi}β/2π​ is

νβ(x)=1βexp⁡(−π(xβ)2),x∈R,\nu_\beta(x) = \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{x}{\beta}\Bigr)^2\Bigr), \qquad x \in \mathbb{R},νβ​(x)=β1​exp(−π(βx​)2),x∈R,

(Eq. (5) in dimension one), and the periodic normal density (Eq. (7)) is its periodization

Ψβ(r)=∑k=−∞∞1βexp⁡(−π(r−kβ)2),r∈[0,1),\Psi_\beta(r) = \sum_{k=-\infty}^{\infty} \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{r-k}{\beta}\Bigr)^2\Bigr), \qquad r \in [0,1),Ψβ​(r)=k=−∞∑∞​β1​exp(−π(βr−k​)2),r∈[0,1),

the density of a νβ\nu_\betaνβ​-distributed variable reduced modulo 111.

The statistical distance of two densities φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ (p. 34:14) is

Δ(φ1,φ2)=∫∣φ1−φ2∣,\Delta(\varphi_1, \varphi_2) = \int |\varphi_1 - \varphi_2|,Δ(φ1​,φ2​)=∫∣φ1​−φ2​∣,

the integral taken over R\mathbb{R}R for densities on the line and over [0,1)[0,1)[0,1) for densities on T\mathbb{T}T. The paper uses this normalization without a factor 12\tfrac1221​, so that Δ\DeltaΔ ranges in [0,2][0,2][0,2] on probability densities. In Lean these objects are RegevLWE.PeriodicGauss.nu, Psi, statDist and statDistT.

Formalization targets

Goal: Claim 2.2

For any 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,

Δ(Ψα,Ψβ)≤9(βα−1).\Delta(\Psi_\alpha, \Psi_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(Ψα​,Ψβ​)≤9(αβ​−1).

The hypotheses and the constant 999 are exactly as printed.

Milestones

  1. The bound on the line (proof of Claim 2.2, first sentence). For 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,
Δ(να,νβ)≤9(βα−1).\Delta(\nu_\alpha, \nu_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(να​,νβ​)≤9(αβ​−1).
  1. Reduction modulo 1 does not increase Δ\DeltaΔ (p. 34:15, used on p. 34:16): for integrable φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ on R\mathbb{R}R, the periodizations φ~i(r)=∑kφi(r−k)\tilde\varphi_i(r) = \sum_k \varphi_i(r-k)φ~​i​(r)=∑k​φi​(r−k) satisfy Δ(φ~1,φ~2)≤Δ(φ1,φ2)\Delta(\tilde\varphi_1, \tilde\varphi_2) \le \Delta(\varphi_1, \varphi_2)Δ(φ~​1​,φ~​2​)≤Δ(φ1​,φ2​).
  2. The three displayed steps of the proof after normalizing to α=1\alpha = 1α=1, β=1+ϵ\beta = 1 + \epsilonβ=1+ϵ, 0<ϵ≤10 < \epsilon \le 10<ϵ≤1: the first display (a triangle-inequality split and an exact evaluation), the pointwise bound
∣e−π(1−1/(1+ϵ)2)x2−1∣≤π(1−1/(1+ϵ)2)x2≤2πϵx2,\bigl|e^{-\pi(1-1/(1+\epsilon)^2)x^2} - 1\bigr| \le \pi\bigl(1 - 1/(1+\epsilon)^2\bigr)x^2 \le 2\pi\epsilon x^2,​e−π(1−1/(1+ϵ)2)x2−1​≤π(1−1/(1+ϵ)2)x2≤2πϵx2,

and the final evaluation

ϵ+2πϵ∫Rx2e−πx2/(1+ϵ)2 dx=ϵ+ϵ(1+ϵ)3≤9ϵ.\epsilon + 2\pi\epsilon\int_{\mathbb{R}} x^2 e^{-\pi x^2/(1+\epsilon)^2}\,dx = \epsilon + \epsilon(1+\epsilon)^3 \le 9\epsilon.ϵ+2πϵ∫R​x2e−πx2/(1+ϵ)2dx=ϵ+ϵ(1+ϵ)3≤9ϵ.

Significance

Claim 2.2 is a stability statement for the LWE error distribution. It lets an algorithm that works for one noise parameter be applied to a nearby one at a controlled cost in statistical distance, which is how Regev's reductions tolerate an approximately known parameter. It also states a quantitative fact about wrapped normal distributions, which appear outside cryptography, for example in directional statistics.

The result is proved in the paper; no machine-checked proof is known to this mission. Formalizing it produces a reusable one-dimensional toolkit: the L1L^1L1 distance between two centred normal densities, the second moment of a Gaussian in Regev's normalization, and the contraction of L1L^1L1 distance under periodization. Each of these is a building block for formalizing the rest of the paper's analysis of Gaussian noise.

Difficulty

The arithmetic is elementary; the work is in the analysis. The statement on T\mathbb{T}T involves infinite series inside an integral, and the passage from the line to the circle requires exchanging a sum over Z\mathbb{Z}Z with an integral and controlling the series almost everywhere. A direct attack on Ψα−Ψβ\Psi_\alpha - \Psi_\betaΨα​−Ψβ​ termwise on [0,1)[0,1)[0,1) does not by itself produce a bound in terms of β/α−1\beta/\alpha - 1β/α−1; the comparison has to be made on the line first. On the line, the scaling to α=1\alpha = 1α=1 is a change of variables in a Lebesgue integral, and the evaluation of ∫x2e−πx2/σ2dx=σ3/(2π)\int x^2 e^{-\pi x^2/\sigma^2}dx = \sigma^3/(2\pi)∫x2e−πx2/σ2dx=σ3/(2π) requires Gaussian moment identities in the paper's normalization rather than Mathlib's.

Formalization scope

  • Reals and densities. Everything is one-dimensional over R\mathbb{R}R; distributions are represented by their densities, not by measures. T\mathbb{T}T is the interval Set.Ico 0 1 with Lebesgue measure; Ψβ\Psi_\betaΨβ​ is a real tsum over k∈Zk \in \mathbb{Z}k∈Z, which converges absolutely for β≠0\beta \ne 0β=0.
  • Statistical distance. Δ\DeltaΔ is a lower Lebesgue integral ∫⁻ ENNReal.ofReal |φ₁ - φ₂| valued in [0,∞][0,\infty][0,∞], with no factor 12\tfrac1221​, as on p. 34:14. Bounds are compared through ENNReal.ofReal. A Bochner integral would be 000 on a non-integrable difference and would make any upper bound trivially true; the extended-valued integral rules this out.
  • Added hypotheses. None on the goal or on the line bound. The modulo-1 milestone assumes φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ integrable (the paper states the data-processing fact for random variables, whose densities are integrable); only the "modulo 1" instance used in the proof is stated, not the general inequality for arbitrary randomized functions. The pointwise bound is stated for every ϵ≥0\epsilon \ge 0ϵ≥0, a harmless generalization of the proof's range 0<ϵ≤10 < \epsilon \le 10<ϵ≤1. The first display is stated as its three component facts (inequality, evaluation =ϵ= \epsilon=ϵ, and the rewriting of the integrand), which together give the printed chain.
  • No trivialization. The goal is Claim 2.2 on T\mathbb{T}T, not the bound on the line, and neither side can collapse to a junk value: the left side is an extended nonnegative integral and the right side is positive under the hypotheses.
  • Welcome contributions. Gaussian moment lemmas in the normalization e−πx2/s2e^{-\pi x^2/s^2}e−πx2/s2, the periodization contraction for general integrable functions, and a measure-level statement identifying Ψβ\Psi_\betaΨβ​ with the pushforward of νβ\nu_\betaνβ​ under reduction modulo 111.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • D. Micciancio and S. Goldwasser, Complexity of Lattice Problems: A Cryptographic Perspective, Kluwer, 2002 (cited on p. 34:15 for the data-processing property of statistical distance). https://doi.org/10.1007/978-1-4615-0897-7
7 thms3 active usersReviewed
🏆Completed
Harmonic AnalysisProbability·Captain: mikedeng1

Distribution Function Inequalities for Martingales 2: Gundy's Decomposition of an L¹-Bounded Martingale, with One Stopping TimeResearch Paper

Motivation

Many operators of harmonic analysis are bounded on L2L^2L2 by an orthogonality argument but fail to be bounded on L1L^1L1; what survives at p=1p=1p=1 is a weak-type estimate λ P(∣Tf∣>λ)≤c ∥f∥1\lambda\,P(|Tf|>\lambda)\le c\,\|f\|_1λP(∣Tf∣>λ)≤c∥f∥1​. For singular integrals the standard route to such an estimate is the Calderón–Zygmund decomposition, which splits a function at height λ\lambdaλ into a bounded part and a part supported on a small set. Martingale theory has the same need: square functions, martingale transforms and maximal operators of martingales are bounded on L2L^2L2 for orthogonality reasons, and their behaviour on L1L^1L1-bounded martingales is the delicate endpoint.

R. F. Gundy (1968) supplied the martingale analogue: an L1L^1L1-bounded martingale can be written as the sum of three martingales, one bounded in L2L^2L2, one whose differences are absolutely summable in L1L^1L1, and one that is non-zero only on an event of small probability (Gundy 1968). Gundy's construction used several stopping times. In his 1971 Wald Memorial Lectures, published as Distribution Function Inequalities for Martingales (Burkholder 1973), D. L. Burkholder gave a simplified version of the decomposition in which only one stopping time is used, with explicit constants 222, 444 and 111. This mission formalizes that version, Theorem 4.1 of the lectures, together with the facts its proof rests on.

Timeline:

  • 1953. J. L. Doob's Stochastic Processes establishes almost-everywhere convergence of L1L^1L1-bounded martingales and the maximal inequality.
  • 1966. D. G. Austin proves that the integral of S2(f)S^2(f)S2(f) over {f∗≤λ}\{f^*\le\lambda\}{f∗≤λ} is finite for an L1L^1L1-bounded martingale (Austin 1966).
  • 1968. Gundy proves the decomposition theorem for L1L^1L1-bounded martingales, with applications to weak-type estimates.
  • 1973. Burkholder's Lemma 2.1, a refinement of Austin's theorem, yields a one-stopping-time proof of Gundy's decomposition with explicit constants.

Setting

Let (Ω,A,P)(\Omega,\mathcal A,P)(Ω,A,P) be a probability space and A0⊆A1⊆⋯\mathcal A_0\subseteq\mathcal A_1\subseteq\cdotsA0​⊆A1​⊆⋯ a nondecreasing sequence of sub-σ\sigmaσ-fields of A\mathcal AA. A martingale relative to A1,A2,…\mathcal A_1,\mathcal A_2,\dotsA1​,A2​,… is a sequence f=(f1,f2,… )f=(f_1,f_2,\dots)f=(f1​,f2​,…) of integrable random variables with fnf_nfn​ An\mathcal A_nAn​-measurable and E(fn+1∣An)=fnE(f_{n+1}\mid\mathcal A_n)=f_nE(fn+1​∣An​)=fn​. Its difference sequence is d=(d1,d2,… )d=(d_1,d_2,\dots)d=(d1​,d2​,…) with fn=∑k=1ndkf_n=\sum_{k=1}^n d_kfn​=∑k=1n​dk​, i.e. d1=f1d_1=f_1d1​=f1​, dk=fk−fk−1d_k=f_k-f_{k-1}dk​=fk​−fk−1​ (the convention is f0=0f_0=0f0​=0).

The maximal function is f∗=sup⁡n≥1∣fn∣f^*=\sup_{n\ge1}|f_n|f∗=supn≥1​∣fn​∣, the square function is S(f)=[∑k≥1dk2]1/2S(f)=\big[\sum_{k\ge1}d_k^2\big]^{1/2}S(f)=[∑k≥1​dk2​]1/2, and Sn(f)S_n(f)Sn​(f) is its nnn-th partial version. For 0<p<∞0<p<\infty0<p<∞,

∥f∥p=sup⁡n≥1∥fn∥p,∥fn∥p=(E∣fn∣p)1/p,\|f\|_p=\sup_{n\ge1}\|f_n\|_p,\qquad \|f_n\|_p=(E|f_n|^p)^{1/p},∥f∥p​=n≥1sup​∥fn​∥p​,∥fn​∥p​=(E∣fn​∣p)1/p,

and fff is LpL^pLp-bounded when ∥f∥p<∞\|f\|_p<\infty∥f∥p​<∞. For λ>0\lambda>0λ>0, the exit time μ=inf⁡{n≥1:∣fn∣>λ}\mu=\inf\{n\ge1:|f_n|>\lambda\}μ=inf{n≥1:∣fn​∣>λ} (with inf⁡∅=∞\inf\emptyset=\inftyinf∅=∞) is the first index at which ∣fn∣|f_n|∣fn​∣ exceeds λ\lambdaλ; fμf_\mufμ​, fμ−1f_{\mu-1}fμ−1​, Sμ−1(f)S_{\mu-1}(f)Sμ−1​(f) denote evaluation at the random index, with f∞=lim⁡nfnf_\infty=\lim_n f_nf∞​=limn​fn​.

The Lean development names these objects dseq (ddd), sqFnN/sqFn (Sn(f)S_n(f)Sn​(f), S(f)S(f)S(f)), maxFnN/maxFn (fn∗f_n^*fn∗​, f∗f^*f∗), pNorm (∥f∥p\|f\|_p∥f∥p​), exitTime (μ\muμ) and valAt/sqFnAt (evaluation at an index in {0,1,…,∞}\{0,1,\dots,\infty\}{0,1,…,∞}), all in the namespace BurkholderDFI.Gundy.

Formalization targets

Goal: Theorem 4.1 (p. 23)

For every L1L^1L1-bounded martingale fff and every λ>0\lambda>0λ>0 there are martingales X,Y,ZX,Y,ZX,Y,Z relative to the same σ\sigmaσ-fields, with difference sequences x,y,zx,y,zx,y,z, such that

f=X+Y+Z,∥X∥22≤2λ∥f∥1,∥∑k=1∞∣yk∣∥1≤4∥f∥1,P(Z∗>0)≤∥f∥1/λ.f=X+Y+Z,\qquad \|X\|_2^2\le2\lambda\|f\|_1,\qquad \Big\|\sum_{k=1}^\infty|y_k|\Big\|_1\le4\|f\|_1,\qquad P(Z^*>0)\le\|f\|_1/\lambda.f=X+Y+Z,∥X∥22​≤2λ∥f∥1​,​k=1∑∞​∣yk​∣​1​≤4∥f∥1​,P(Z∗>0)≤∥f∥1​/λ.

The three bounds hold together; each alone is trivial (f=0+0+ff=0+0+ff=0+0+f satisfies the first two, f=0+f+0f=0+f+0f=0+f+0 the first and last).

Milestones

  1. Doob's facts (cited, §1, p. 20). An L1L^1L1-bounded martingale or nonnegative submartingale converges almost everywhere, and ∥fμ∥1≤∥f∥1\|f_\mu\|_1\le\|f\|_1∥fμ​∥1​≤∥f∥1​ for every stopping time μ\muμ.
  2. (1.5) (p. 20). λpP(f∗>λ)≤∥f∥pp\lambda^pP(f^*>\lambda)\le\|f\|_p^pλpP(f∗>λ)≤∥f∥pp​ for 1≤p<∞1\le p<\infty1≤p<∞.
  3. Lemma 2.1 (p. 21). For the exit time μ\muμ above λ\lambdaλ,
∥Sμ−1(f)∥22+∥fμ−1∥22≤2Efμfμ−1≤2λ∥f∥1,\|S_{\mu-1}(f)\|_2^2+\|f_{\mu-1}\|_2^2\le2Ef_\mu f_{\mu-1}\le2\lambda\|f\|_1,∥Sμ−1​(f)∥22​+∥fμ−1​∥22​≤2Efμ​fμ−1​≤2λ∥f∥1​,

with equality on the left for martingales.

Significance

The result. The decomposition is the standard device for passing from L2L^2L2 to weak-type (1,1)(1,1)(1,1) estimates for martingale operators: an operator that is bounded on L2L^2L2, controlled by total variation on the second piece, and local in the sense that it vanishes where the third piece vanishes, is of weak type (1,1)(1,1)(1,1). Applications of the decomposition are given in Gundy's papers of 1968 and 1969 (On the class Llog⁡LL\log LLlogL, martingales, and singular integrals, Studia Math. 33), which the lectures cite for this purpose. The explicit constants 222, 444, 111 make every such weak-type constant explicit.

Formalizing it. The theorem is classical and proved; the remaining work is its formalization. As far as is known, no machine-checked proof of Gundy's decomposition, of Lemma 2.1, or of the weak-type maximal inequality in the form (1.5) for real martingales exists in Mathlib or on this platform. Mathlib provides almost-everywhere convergence of L1L^1L1-bounded submartingales and Doob's maximal inequality for nonnegative submartingales; the stopped-value bound for unbounded stopping times, the square-function identity of Lemma 2.1 and the decomposition itself are new. The milestones are shared with other missions of this series (Lemma 2.1 is also used for Burkholder's weak-type square function inequality and his exponential estimates), so each proof is reused.

Difficulty

The obvious attempt imitates the Calderón–Zygmund cut directly: truncate fff at height λ\lambdaλ, or stop it when it first exceeds λ\lambdaλ. Neither produces the required pieces. Truncation destroys the martingale property, and whatever restores it adds terms that must themselves be controlled in the right norm. Stopping at the exit time produces a martingale bounded by λ\lambdaλ only up to the overshoot at the exit, which is not bounded and lives on an event that is small only in probability. The L2L^2L2 estimate (4.2) is therefore not a consequence of boundedness; it needs a quantitative square-function bound for the martingale up to the exit, which is the content of Lemma 2.1, and that lemma in turn needs the limit f∞f_\inftyf∞​ and the stopped values fμf_\mufμ​ on {μ=∞}\{\mu=\infty\}{μ=∞} — so Doob's convergence theorem cannot be avoided.

Formalization scope

Processes are functions f : ℕ → Ω → ℝ with a Mathlib Filtration ℕ and Mathlib's Martingale/Submartingale. The paper indexes from 111; Lean's index 000 is never read by any quantity in the statements, which use the paper's convention f0=0f_0=0f0​=0. Mathlib's martingale definition additionally constrains f0=E(f1∣A0)f_0=E(f_1\mid\mathcal A_0)f0​=E(f1​∣A0​); this is no restriction, since every martingale indexed from 111 extends this way. The goal asserts that X,Y,ZX,Y,ZX,Y,Z are Mathlib martingales for the same filtration as fff, and the identity fn=Xn+Yn+Znf_n=X_n+Y_n+Z_nfn​=Xn​+Yn​+Zn​ is required for n≥1n\ge1n≥1.

Further committed conventions:

  • S(f)S(f)S(f), f∗f^*f∗, Z∗Z^*Z∗, ∥⋅∥p\|\cdot\|_p∥⋅∥p​ and all expectations of nonnegative quantities take values in [0,∞][0,\infty][0,∞] (lower Lebesgue integral), so no infinite value is silently replaced by 000.
  • ∥X∥2=sup⁡n≥1∥Xn∥2\|X\|_2=\sup_{n\ge1}\|X_n\|_2∥X∥2​=supn≥1​∥Xn​∥2​, not the norm of a limit; Z∗=sup⁡n≥1∣Zn∣Z^*=\sup_{n\ge1}|Z_n|Z∗=supn≥1​∣Zn​∣; ∥∑k∣yk∣∥1\|\sum_k|y_k|\|_1∥∑k​∣yk​∣∥1​ is the integral of the series with y1=Y1y_1=Y_1y1​=Y1​.
  • The exit time takes values in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} and μ−1\mu-1μ−1 is truncated, with ∞−1=∞\infty-1=\infty∞−1=∞; the a.e. limit f∞f_\inftyf∞​ is a function supplied with its convergence hypothesis (Lemma 2.1) or asserted to exist (Doob's facts).
  • "Nonnegative submartingale" means fn≥0f_n\ge0fn​≥0 almost surely for n≥1n\ge1n≥1.
  • Ω\OmegaΩ is an arbitrary measurable space with a probability measure.

A formalization in which the existential could choose its own filtration, or in which the norms were Bochner integrals (which vanish on non-integrable functions), would trivialize the goal; both are excluded by the statement above.

Infrastructure needed: stopped values at unbounded stopping times and their L1L^1L1 bound; square-function identities for stopped martingales (orthogonality of martingale differences up to a stopping time); conditional-expectation compensators of predictable truncations. The definitions file is shared with the other eight missions of this series and is reusable for any work on discrete-time square and maximal functions. Proofs of the milestones, alternative arguments, and sharper constants are all welcome.

Selected references

  • D. L. Burkholder, Distribution function inequalities for martingales, The Annals of Probability 1(1), 19–42, 1973. https://doi.org/10.1214/aop/1176997023
  • R. F. Gundy, A decomposition for L¹-bounded martingales, The Annals of Mathematical Statistics 39(1), 134–138, 1968. https://doi.org/10.1214/aoms/1177698510
  • D. G. Austin, A sample function property of martingales, The Annals of Mathematical Statistics 37(5), 1396–1397, 1966. https://doi.org/10.1214/aoms/1177699283
  • J. L. Doob, Stochastic Processes, Wiley, New York, 1953.
5 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Inventory Control and Price Theory 1: With Linear Demand and Economic Lot Sizes, the Profit-Maximizing Price Satisfies the Cubic (7)Research Paper

Motivation

Inventory calculations often take the selling price as fixed, while price calculations often treat the cost of supplying demand as independent of the order policy. Whitin's 1955 model connects the two decisions in one annual-profit calculation. A merchant chooses both the price charged to customers and the size of each replenishment order. Changing the price changes annual demand; changing demand changes the number of orders, inventory carrying cost, and therefore the economic lot size. This makes the selling price and the inventory decision parts of the same optimization problem. Whitin's paper gives a compact example in which the connection can be written down explicitly.

The mission concentrates on Section 2, the stationary-demand model for a stable item. Section 3 of the paper studies style goods under uncertain sales and belongs to a separate mission. The result here concerns a deterministic annual demand curve and continuous order quantities, so a solver can focus on the interaction between a classical economic order quantity calculation and a price first-order condition.

Setting

The price is a real number ppp. Annual demand is the linear function D(p)=ap+bD(p)=ap+bD(p)=ap+b, where aaa and bbb are given real constants. A feasible price has D(p)>0D(p)>0D(p)>0. The paper does not require a<0a<0a<0 in its displayed model, so the formal statements leave the slope unrestricted. Negative aaa is the economically usual decreasing-demand case; in other regimes a joint maximum may simply fail to exist.

The merchant pays a fixed setup cost SSS whenever an order is placed. The purchase cost per unit is CCC, and the annual carrying charge for one unit kept in stock is ICICIC, where III is a carrying-rate factor. If Q>0Q>0Q>0 units are ordered each time, average stock is Q/2Q/2Q/2 and the annual number of orders is D/QD/QD/Q. A per-unit operating cost kkk is incurred on annual demand, and fff is an annual fixed cost. The resulting total variable cost and two-variable annual profit are

TVC⁡(D,Q)=Q2IC+DQS+kD,Π(p,Q)=D(p)p−TVC⁡(D(p),Q)−f.\operatorname{TVC}(D,Q)=\frac Q2 IC+\frac DQ S+kD, \qquad \Pi(p,Q)=D(p)p-\operatorname{TVC}(D(p),Q)-f.TVC(D,Q)=2Q​IC+QD​S+kD,Π(p,Q)=D(p)p−TVC(D(p),Q)−f.

Only pairs with D(p)>0D(p)>0D(p)>0 and Q>0Q>0Q>0 are feasible. For a fixed demand level, the economic lot size is Q∗(D)=2DS/(IC)Q^*(D)=\sqrt{2DS/(IC)}Q∗(D)=2DS/(IC)​. Substituting it into profit gives Whitin's reduced profit

P(p)=ap2+bp−2SIC(ap+b)−k(ap+b)−f.P(p)=ap^2+bp-\sqrt{2SIC(ap+b)}-k(ap+b)-f.P(p)=ap2+bp−2SIC(ap+b)​−k(ap+b)−f.

The paper uses PPP for annual profit in this section. The Lean development calls the two-variable function profit and the function after optimizing QQQ reducedProfit.

Formalization targets

The first target is the unique lot-size minimum in Eq. (3), followed by its value in Eq. (4):

TVC⁡(D,Q∗(D))≤TVC⁡(D,Q)(Q>0),TVC⁡(D,Q∗(D))=2DSIC+kD.\operatorname{TVC}(D,Q^*(D))\leq\operatorname{TVC}(D,Q) \quad(Q>0),\qquad \operatorname{TVC}(D,Q^*(D))=\sqrt{2DSIC}+kD.TVC(D,Q∗(D))≤TVC(D,Q)(Q>0),TVC(D,Q∗(D))=2DSIC​+kD.

Equality in the inequality holds only at Q=Q∗(D)Q=Q^*(D)Q=Q∗(D). The next target is the necessary stationarity condition in Eqs. (6)–(7): when D(p)>0D(p)>0D(p)>0 and the derivative of PPP at ppp is zero,

8a3p3+(16a2b−8ka3)p2+(10ab2−12ka2b+2k2a3)p+2b3−4kab2+2k2a2b−SICa2=0.8a^3p^3+(16a^2b-8ka^3)p^2 +(10ab^2-12ka^2b+2k^2a^3)p +2b^3-4kab^2+2k^2a^2b-SICa^2=0.8a3p3+(16a2b−8ka3)p2+(10ab2−12ka2b+2k2a3)p+2b3−4kab2+2k2a2b−SICa2=0.

The goal joins these steps at a global joint maximum. If a feasible pair (p,Q)(p,Q)(p,Q) maximizes Π\PiΠ over all feasible price and lot-size pairs, then Q=Q∗(D(p))Q=Q^*(D(p))Q=Q∗(D(p)) and ppp satisfies the cubic. The goal is an implication about any joint maximizer; it does not assert that one exists for every demand curve. The cubic is a necessary condition only. Its algebraic roots may include prices that fail the original first-order equation or fail to maximize profit.

Significance

The result gives a concrete relation between a price chosen to maximize annual profit and the ordering cost and carrying charge of the inventory system. The lot-size formula alone optimizes cost at a fixed demand rate. The cubic makes the demand response to price and the resulting inventory cost visible in the price condition. It also specifies what can be inferred from the calculation: an optimal price must satisfy the equation, while selecting an optimum from candidate roots remains a separate question.

The paper already supplies the mathematical result. The formalization task is to represent the joint optimization and verify its necessary conditions in Lean, together with the cost identity on which the reduced-profit expression rests. The published Prove2Me definition InventoryControl_eoq already provides the classical EOQ cost and square-root quantity; this mission uses its cost function and adds Whitin's demand curve and profit. Related inventory results for backorders and multilevel systems describe different models and do not replace the targets here.

Difficulty

At a fixed price, choosing the lot size involves both a term proportional to QQQ and one proportional to 1/Q1/Q1/Q. The optimality statement needs a global inequality and a unique equality case, not merely the observation that a derivative vanishes. After substituting that quantity, the reduced profit contains a square root of the demand curve. Its derivative is meaningful on positive demand, and turning its stationarity equation into the displayed cubic loses information when an equation is squared. A proof therefore has to preserve the implication from optimality to the cubic without promoting all cubic roots to optima.

Formalization scope

The model uses real prices, real demands, and real lot sizes; it does not round order quantities to integers. The hypotheses S,I,C>0S,I,C>0S,I,C>0 make explicit the positive cost and carrying-charge conventions of Section 2. Neither kkk nor fff is assigned a sign, and no sign is imposed on aaa or bbb. The conditions Q>0Q>0Q>0 and D(p)>0D(p)>0D(p)>0 apply to every cost or profit comparison. They exclude Lean's total value for division by zero and the zero value assigned by Real.sqrt to a negative argument. The goal quantifies over every feasible pair in a joint maximum of the original profit, so optimizing QQQ is part of its content. Defining profit only by the reduced formula would erase that claim.

The definitions comprise linear demand, total variable cost, two-variable profit, and reduced profit. The classical EOQ cost comes from the existing InventoryControl_eoq definition; the model-specific layer is small and can be reused in further work on pricing with inventory costs. The theorem targets welcome proofs of the global lot-size inequality, the minimized-cost identity, the stationary cubic, and their combination at a joint maximizer. The paper's quantity-discount footnote is outside this scope because it leaves the revised purchase and carrying-cost model unspecified.

Selected references

  • T. M. Whitin, Inventory Control and Price Theory, Management Science 2(1), 1955, pp. 61–68. DOI: 10.1287/mnsc.2.1.61.
6 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations ResearchProbability·Captain: mikedeng1

Values of Large Games II: Oceanic Games 1: Closed-Form Values of Interior Oceanic GamesResearch Paper

Motivation

Weighted voting bodies often combine a few large blocs with a mass of small, unorganized voters: shareholders' meetings with a handful of large holders and a dispersed float, legislatures with party blocs and independents. The Shapley value measures each participant's voting power as the probability of being pivotal — the one whose arrival first turns a losing coalition into a winning one — when participants arrive in a uniformly random order. For many small voters this computation becomes a combinatorial problem whose size grows with the number of voters.

Milnor and Shapley (RAND RM-2649, 1961; revised as Mathematics of Operations Research 3(4), 1978) replaced the small voters by a continuum, the ocean, and obtained explicit formulas for the power of the large voters. The memorandum is the second of a RAND series on values of large games; the first (L. S. Shapley and N. Z. Shapiro, Values of Large Games, I: A Limit Theorem, RM-2648, 1960) proves the limit theorem for finite games with many small players on which the oceanic model rests. This mission formalizes the part of the memorandum that leads to explicit closed forms for the values of interior oceanic games (§2, §4, §5).

Setting

There are mmm major players M={1,…,m}M = \{1, \dots, m\}M={1,…,m} with weights w1,…,wm≥0w_1, \dots, w_m \ge 0w1​,…,wm​≥0, and w(S)=∑j∈Swjw(S) = \sum_{j \in S} w_jw(S)=∑j∈S​wj​. The ocean is the interval I=[0,1]I = [0,1]I=[0,1] with Lebesgue measure, carrying total weight α>0\alpha > 0α>0. In the oceanic game [c;w1,…,wm;α][c; w_1, \dots, w_m; \alpha][c;w1​,…,wm​;α] with quota ccc, a coalition wins when the weight of its major players plus α\alphaα times its share of the ocean is at least ccc.

The random order is modelled by a uniform random point x=(x1,…,xm)x = (x_1, \dots, x_m)x=(x1​,…,xm​) of the cube ImI^mIm: major player jjj is inserted into the ocean at position xjx_jxj​, and P(t)={j:xj<t}P(t) = \{ j : x_j < t \}P(t)={j:xj​<t} is the set of major players placed before position ttt. Player iii is pivotal when

w(P(xi))+αxi≤c≤w(P(xi))+wi+αxi,(2.4)w(P(x_i)) + \alpha x_i \le c \le w(P(x_i)) + w_i + \alpha x_i, \qquad (2.4)w(P(xi​))+αxi​≤c≤w(P(xi​))+wi​+αxi​,(2.4)

and the value φi\varphi_iφi​ of player iii is the probability of (2.4), i.e. the volume of the set Ai⊆ImA_i \subseteq I^mAi​⊆Im where it holds. The combined value of the ocean is Φ=1−∑iφi\Phi = 1 - \sum_{i} \varphi_iΦ=1−∑i​φi​ (2.5).

With the quota yyy as a variable, Γ(y)=[y;w1,…,wm;α]\Gamma(y) = [y; w_1, \dots, w_m; \alpha]Γ(y)=[y;w1​,…,wm​;α] has values φi(y)\varphi_i(y)φi​(y), Φ(y)\Phi(y)Φ(y), and the pivot location F(y)=inf⁡{t≥0:w(P(t))+αt≥y}F(y) = \inf\{t \ge 0 : w(P(t)) + \alpha t \ge y\}F(y)=inf{t≥0:w(P(t))+αt≥y} is a random, nondecreasing, piecewise linear function of yyy with expectation E{F(y)}E\{F(y)\}E{F(y)}. Adding a major player m+1m+1m+1 of weight wm+1w_{m+1}wm+1​ gives the game Γ+\Gamma^+Γ+.

The game is interior when

w(M)≤c≤α,w(M) \le c \le \alpha,w(M)≤c≤α,

that is, the ocean alone wins and the major players together lose. With wˉj=α−wj\bar w_j = \alpha - w_jwˉj​=α−wj​, define π(S)=∏j∈Swjα∏j∈M−Swˉjα\pi(S) = \prod_{j \in S} \tfrac{w_j}{\alpha} \prod_{j \in M - S} \tfrac{\bar w_j}{\alpha}π(S)=∏j∈S​αwj​​∏j∈M−S​αwˉj​​ for S⊆MS \subseteq MS⊆M, the analogous product πi(S)\pi_i(S)πi​(S) over M−{i}M - \{i\}M−{i} for S⊆M−{i}S \subseteq M - \{i\}S⊆M−{i}, and the integers a0=1a_0 = 1a0​=1, an=1−nan−1a_n = 1 - n a_{n-1}an​=1−nan−1​, i.e. 1,0,1,−2,9,−44,…1, 0, 1, -2, 9, -44, \dots1,0,1,−2,9,−44,…

Formalization targets

Goal: Theorem 6 (p. 20)

In an interior game, with s=∣S∣s = |S|s=∣S∣,

φi=wiα∑S⊆M−{i}as πi(S),Φ=∑S⊆Mas π(S).\varphi_i = \frac{w_i}{\alpha} \sum_{S \subseteq M - \{i\}} a_s \, \pi_i(S), \qquad \Phi = \sum_{S \subseteq M} a_s \, \pi(S).φi​=αwi​​S⊆M−{i}∑​as​πi​(S),Φ=S⊆M∑​as​π(S).

Both identities are part of the goal. The values do not depend on ccc within the interior range.

Milestones

  1. §2, p. 5: the pivot sets A1,…,AmA_1, \dots, A_mA1​,…,Am​ overlap only in measure zero.
  2. (4.3): φi(y)=Prob⁡{F(y)=xi}\varphi_i(y) = \operatorname{Prob}\{F(y) = x_i\}φi​(y)=Prob{F(y)=xi​} for 0≤y≤w(M)+α0 \le y \le w(M) + \alpha0≤y≤w(M)+α.
  3. (4.4)–(4.5): for 0<y<w(M)+α0 < y < w(M) + \alpha0<y<w(M)+α, FFF is differentiable at yyy almost surely, ∑iφi(y)=Prob⁡{F′(y)=0}\sum_i \varphi_i(y) = \operatorname{Prob}\{F'(y) = 0\}∑i​φi​(y)=Prob{F′(y)=0} and Φ(y)=Prob⁡{F′(y)=1/α}\Phi(y) = \operatorname{Prob}\{F'(y) = 1/\alpha\}Φ(y)=Prob{F′(y)=1/α}.
  4. Theorem 2, (4.7): Φ(y)=α ddyE{F(y)}\Phi(y) = \alpha \, \frac{d}{dy} E\{F(y)\}Φ(y)=αdyd​E{F(y)}.
  5. Lemma, (4.12)–(4.13): φm+1+(z)=1α∫t1t2Φ(y) dy\varphi^+_{m+1}(z) = \frac{1}{\alpha} \int_{t_1}^{t_2} \Phi(y)\, dyφm+1+​(z)=α1​∫t1​t2​​Φ(y)dy with t1=max⁡(z−wm+1,0)t_1 = \max(z - w_{m+1}, 0)t1​=max(z−wm+1​,0), t2=min⁡(z,w(M)+α)t_2 = \min(z, w(M) + \alpha)t2​=min(z,w(M)+α).
  6. Theorem 5, (5.4): if [c;w1,…,wm;α][c; w_1, \dots, w_m; \alpha][c;w1​,…,wm​;α] and [d;w1,…,wm+1;α][d; w_1, \dots, w_{m+1}; \alpha][d;w1​,…,wm+1​;α] are both interior, φm+1+=1αΦwm+1\varphi^+_{m+1} = \frac{1}{\alpha} \Phi w_{m+1}φm+1+​=α1​Φwm+1​.
  7. Proof of Theorem 6, p. 21: the right-hand sides above add up to 1, an identity valid for all real wjw_jwj​ and α≠0\alpha \ne 0α=0.

Further items, not milestones: the Corollary (5.5), Theorem 3 (averaged over all quotas, each value equals the player's share of the total weight), Theorem 4 (small players behave like ocean), and (5.8) with its footnote (∣an∣|a_n|∣an​∣ is the nearest integer to n!/en!/en!/e and counts derangements).

Significance

Theorem 6 turns the voting power of the large blocs, a priori a probability over a continuum of orderings, into a finite multilinear polynomial in the ratios wj/αw_j/\alphawj​/α. Table 1 of the memorandum lists the cases m≤3m \le 3m≤3, and the theorem gives every mmm. Its coefficients are signed derangement numbers. The Corollary (5.5) states that a major player's value per vote equals the ocean's value per vote in the game without that player.

The memorandum's arguments are short and partly heuristic: "E commutes with the derivative", the disjointness of the pivot sets is "obvious", and the induction for Theorem 6 relies on the symmetry of the value in the major players, which is never stated. A formalization makes each of these steps precise, including the measure-zero exceptions and the quota ranges. To our knowledge none of these results has a machine-checked proof; Mathlib has the Lebesgue measure on cubes, interval integrals and derangement numbers, but no game-theoretic value with a continuum of players.

Difficulty

The values are volumes of regions of ImI^mIm cut out by inequalities whose shape depends on the order of the coordinates, so a direct computation splits into m!m!m! order cells, with the quota ccc entering each. The paper's route avoids this by passing through the random function FFF, Theorem 2 and the Lemma; that route needs differentiation under the integral sign for a function that is only piecewise linear in yyy, with kinks at random locations, and an exact bookkeeping of the interval of integration when the quota approaches the ends of [0,w(M)+α][0, w(M) + \alpha][0,w(M)+α]. Theorem 6 is then an induction on mmm that uses Theorem 5 for every player in turn, so it also needs the invariance of φi\varphi_iφi​ under a relabelling of the major players.

Formalization scope

  • Major players are Fin m (m=0m = 0m=0 is allowed; then Φ=1\Phi = 1Φ=1). The probability of an event is the Lebesgue volume of its intersection with [0,1]m[0,1]^m[0,1]m; no probability space is built.
  • P(t)P(t)P(t) uses the strict inequality xj<tx_j < txj​<t, as printed.
  • φi\varphi_iφi​ is defined as the volume of the pivot set (2.4), for every real quota. Φ\PhiΦ is defined by (2.5), as the paper allows ("We might equally well take (2.5) as the definition of Φ\PhiΦ"). Neither is defined through the formulas of Theorem 6 or through FFF; defining them that way would make the goal an unfolding, and is ruled out.
  • The paper writes (4.2) as a minimum F(y)=min⁡{x∣w(P(x))+αx≥y}F(y) = \min\{x \mid w(P(x)) + \alpha x \ge y\}F(y)=min{x∣w(P(x))+αx≥y}, which need not be attained; FFF is the infimum over t≥0t \ge 0t≥0, the value shown in its Fig. 3.
  • The standing assumptions wj≥0w_j \ge 0wj​≥0 and α>0\alpha > 0α>0 (§2) are explicit hypotheses. The p. 5 footnote's 0≤c≤w(M)+α0 \le c \le w(M)+\alpha0≤c≤w(M)+α applies to the pivot-set milestone. Other quota ranges are explicit: 0≤y≤w(M)+α0 \le y \le w(M) + \alpha0≤y≤w(M)+α for (4.3) and Theorem 2 (one-sided derivatives at the ends), the open interval for (4.4)–(4.5) (two-sided derivatives, stated with HasDerivAt), and 0≤z≤w(M)+wm+1+α0 \le z \le w(M) + w_{m+1} + \alpha0≤z≤w(M)+wm+1​+α for the Lemma, as on p. 14.
  • The added player is appended with Fin.snoc as index Fin.last m.
  • Corollary (5.5) assumes wi>0w_i > 0wi​>0, since it divides by wiw_iwi​. Theorem 4, stated in the paper "in the general oceanic game", is false at quota 000 and when the limit game has no winning coalition; it is stated for 0<c≤w(M−{i})+α0 < c \le w(M - \{i\}) + \alpha0<c≤w(M−{i})+α.
  • The identity of milestone 7 is pure algebra and is stated for all real weights and α≠0\alpha \ne 0α=0.

A complete development needs: measurability of the pivot sets and of FFF in xxx, the structure of FFF as a piecewise linear function of yyy, differentiation of E{F}E\{F\}E{F}, and invariance of the values under permutations of the major players. The pivot-set and FFF infrastructure is reusable for the companion mission on limits of finite weighted majority games. Contributions of any of the milestones, of the symmetry lemma, and of the non-milestone items are welcome.

Selected references

  • J. W. Milnor and L. S. Shapley, Values of Large Games, II: Oceanic Games, The RAND Corporation, Research Memorandum RM-2649, February 1961. https://www.rand.org/pubs/research_memoranda/RM2649.html
  • J. W. Milnor and L. S. Shapley, Values of Large Games II: Oceanic Games, Mathematics of Operations Research 3(4):290–307, 1978. https://doi.org/10.1287/moor.3.4.290
  • L. S. Shapley, A Value for n-Person Games, in Contributions to the Theory of Games II, Annals of Mathematics Studies 28, Princeton University Press, 1953, 307–317. https://doi.org/10.1515/9781400881970-018
  • L. S. Shapley and N. Z. Shapiro, Values of Large Games, I: A Limit Theorem, The RAND Corporation, Research Memorandum RM-2648, November 1960.
  • R. J. Aumann and L. S. Shapley, Values of Non-Atomic Games, Princeton University Press, 1974. https://doi.org/10.1515/9781400867080
9 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

A Variational Inequality Formulation of the Dynamic Network User Equilibrium Problem II: Under Linear Arc Delay αx(t) + β the Arc Exit Time Is Strictly Increasing (FIFO Holds)Research Paper

Motivation

Dynamic traffic assignment models how commuters choose routes and departure times when travel times change over the day. In the model of Friesz, Bernstein, Smith, Tobin and Wie (Oper. Res. 41 (1993)), the time to traverse a path is built recursively from arc exit-time functions: a vehicle that enters an arc at time ttt leaves it at time τ(t)\tau(t)τ(t). The equilibrium conditions of that model refer to the inverses of these functions, so the model is only well defined when every arc exit-time function is invertible.

Invertibility has a direct traffic meaning. A strictly increasing exit time is the first-in-first-out (FIFO) property: a vehicle that enters later cannot leave earlier, so no overtaking occurs on the arc. Whether a given delay model respects FIFO was an active question in the early 1990s, because several delay functions used in practice violate it for some inflow patterns.

Timeline:

  • 1969. Vickrey's bottleneck model introduces deterministic queueing at a single bottleneck (Vickrey 1969).
  • 1986. Ben-Akiva and De Palma show (Trans. Sci. 20 (1986)), for uniform entry rates and deterministic queueing delays, that it is not possible to "arrive earlier by departing later".
  • 1993. Friesz et al. prove (Theorem 1, p. 185) that for every linear arc delay D=αx+βD = \alpha x + \betaD=αx+β the exit time is strictly increasing, extending the 1986 result to all continuous entry-rate patterns (remark, p. 186).

Setting

Consider one arc. Vehicles enter it at the entry rate u(t)≥0u(t) \ge 0u(t)≥0, a continuous function of time t≥0t \ge 0t≥0; the first vehicle enters at time 000. For an exit-time function τ\tauτ, the arc volume at time t≥0t \ge 0t≥0 is the inflow mass of the vehicles that entered during [0,t][0,t][0,t] and have not left by time ttt:

x(t)=∫{s∈[0,t] : τ(s)>t}u(s) ds.x(t) = \int_{\{s \in [0,t]\,:\,\tau(s) > t\}} u(s)\,ds .x(t)=∫{s∈[0,t]:τ(s)>t}​u(s)ds.

The linear delay function (18) of the paper is

D(t)=α x(t)+β,α,β>0,D(t) = \alpha\, x(t) + \beta, \qquad \alpha, \beta > 0,D(t)=αx(t)+β,α,β>0,

a fixed free-flow travel time β\betaβ plus a queueing time determined by the service rate 1/α1/\alpha1/α. The exit time is entry time plus delay, so τ\tauτ is pinned by the exit-time equation

τ(t)=t+α x(t)+β(t≥0).\tau(t) = t + \alpha\, x(t) + \beta \qquad (t \ge 0).τ(t)=t+αx(t)+β(t≥0).

The equation is implicit: τ\tauτ appears on the right through the volume. The proof partitions time at t0=0t_0 = 0t0​=0, tn+1=τ(tn)t_{n+1} = \tau(t_n)tn+1​=τ(tn​); in particular t1=τ(0)=βt_1 = \tau(0) = \betat1​=τ(0)=β is the exit time of the first vehicle. In Lean these objects are linearDelay, arcVolume, IsLinearExitTime and tSeq in FrieszDUE.FIFO.

Formalization targets

Goal: Theorem 1 (p. 185)

For α,β>0\alpha, \beta > 0α,β>0 and a nonnegative continuous entry rate uuu, every τ\tauτ satisfying the exit-time equation is strictly increasing on [0,∞)[0, \infty)[0,∞):

0≤s<t  ⟹  τ(s)<τ(t),0 \le s < t \implies \tau(s) < \tau(t),0≤s<t⟹τ(s)<τ(t),

and hence injective there, so τ−1\tau^{-1}τ−1 exists.

Milestones

  1. Lemma 1 (19): for a differentiable invertible fff, [f−1]′(z)=1/f′[f−1(z)][f^{-1}]'(z) = 1/f'[f^{-1}(z)][f−1]′(z)=1/f′[f−1(z)].
  2. First interval (21)–(24): t1=βt_1 = \betat1​=β; on [0,t1][0, t_1][0,t1​], x(t)=∫0tux(t) = \int_0^t ux(t)=∫0t​u, τ(t)=t+α∫0tu+β\tau(t) = t + \alpha\int_0^t u + \betaτ(t)=t+α∫0t​u+β, and τ′=1+αu>0\tau' = 1 + \alpha u > 0τ′=1+αu>0.
  3. Second interval (25)–(28): on [t1,t2][t_1, t_2][t1​,t2​], τ(t)=t+α∫τ−1(t)tu+β\tau(t) = t + \alpha\int_{\tau^{-1}(t)}^t u + \betaτ(t)=t+α∫τ−1(t)t​u+β and τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t)\tau'(t) = \alpha u(t) + 1/(1 + \alpha u[\tau^{-1}(t)]) > \alpha u(t)τ′(t)=αu(t)+1/(1+αu[τ−1(t)])>αu(t).
  4. Induction (29)–(34): the same representation and τ′(t)>αu(t)\tau'(t) > \alpha u(t)τ′(t)>αu(t) on every [tn+1,tn+2][t_{n+1}, t_{n+2}][tn+1​,tn+2​], with τ\tauτ strictly increasing there.
  5. Covering: tn+1−tn≥βt_{n+1} - t_n \ge \betatn+1​−tn​≥β and R+=⋃n≥0[tn,tn+1]\mathbb R_+ = \bigcup_{n \ge 0}[t_n, t_{n+1}]R+​=⋃n≥0​[tn​,tn+1​].

A supporting, non-milestone item states that the exit-time equation has a solution for every admissible uuu.

Significance

The result makes the path exit-time functions of the dynamic network model invertible whenever the arc delays are linear in volume. That invertibility is what allows the path costs, and through them the variational inequality of Theorem 2 of the same paper, to be written down. In traffic terms it certifies that linear volume-based delays never let a later entrant overtake an earlier one, whatever the continuous inflow profile.

The theorem is proved in the paper. As far as is known it has no machine-checked proof. The mission produces one, together with a formal model of a single arc whose exit time is defined implicitly through the volume, which is reusable for other delay functions and for FIFO questions in dynamic traffic assignment.

Difficulty

The obvious argument differentiates τ(t)=t+αx(t)+β\tau(t) = t + \alpha x(t) + \betaτ(t)=t+αx(t)+β and bounds the outflow rate. But the volume can only be written as ∫τ−1(t)tu\int_{\tau^{-1}(t)}^t u∫τ−1(t)t​u once τ\tauτ is known to be invertible, which is the conclusion. The paper breaks the circularity by working forward in time: on [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​] the volume depends only on τ\tauτ restricted to the earlier interval, whose invertibility is already established. A formal proof must make this forward dependence rigorous for an exit time given only by the implicit equation, handle one-sided derivatives at the junctions tnt_ntn​, where τ\tauτ is generally not differentiable, and show that the junctions do not accumulate.

Formalization scope

Time is real; the entry rate is a function u:R→Ru : \mathbb R \to \mathbb Ru:R→R with u(t)≥0u(t) \ge 0u(t)≥0 and uuu continuous on [0,∞)[0, \infty)[0,∞). Both are added hypotheses: Theorem 1 names none, nonnegativity is implicit in "entry rate", and the remark after the proof covers "all continuous entry rate patterns". Integrals are Lebesgue integrals. Monotonicity is claimed on [0,∞)[0,\infty)[0,∞) only, the entry times that the equation constrains. Derivative claims in the milestones are taken within the closed interval [tn,tn+1][t_n, t_{n+1}][tn​,tn+1​]. The paper's separate pieces τk\tau_kτk​ are one global function here, so the junction identities (27), (30), (33) are automatic. Lemma 1 adds the hypothesis f′[f−1(z)]≠0f'[f^{-1}(z)] \ne 0f′[f−1(z)]=0, without which it is false.

The exit time τ is pinned by the implicit equation τ(t) = t + αx(t) + β, where x(t) is the inflow mass of vehicles that entered by time t and have not exited by time t; no monotonicity or invertibility of τ is assumed. A formalization that defined the volume through τ−1\tau^{-1}τ−1 or assumed τ\tauτ monotone would assume the conclusion and is ruled out.

The development needs one-sided derivatives of parametric integrals, the inverse-function derivative on an interval, and a forward induction over the partition. Contributions of proofs for any milestone, of the existence item, and of a uniqueness result for the exit-time equation are welcome.

Selected references

  • T. L. Friesz, D. Bernstein, T. E. Smith, R. L. Tobin and B. W. Wie, A variational inequality formulation of the dynamic network user equilibrium problem, Operations Research 41(1):179–191, 1993. https://doi.org/10.1287/opre.41.1.179
  • M. Ben-Akiva and A. de Palma, Some circumstances in which vehicles will reach their destinations earlier by starting later: revisited, Transportation Science 20(1):52–55, 1986. https://doi.org/10.1287/trsc.20.1.52
  • M. Ben-Akiva, A. de Palma and P. Kanaroglou, Dynamic model of peak period traffic congestion with elastic arrival rates, Transportation Science 20(3):164–181, 1986. https://doi.org/10.1287/trsc.20.3.164
  • W. S. Vickrey, Congestion theory and transport investment, American Economic Review 59(2):251–261, 1969. https://www.jstor.org/stable/1823678
7 thms3 active usersReviewed
🏆Completed
Control TheoryDynamical SystemsPartial Differential Equations·Captain: mikedeng1

An Example on the Effect of Time Delays in Boundary Feedback Stabilization of Wave Equations: The Spectral Stability Trichotomy at the Feedback Gain k = (1 − K)/(1 + K), K = e^{−2a}Research Paper

Why delays in boundary feedback matter

Boundary feedback is the standard way to stabilize vibrating structures governed by wave equations: a sensor measures the velocity at the boundary and an actuator applies a force proportional to it. For the one-dimensional damped wave equation with such feedback, the closed loop is uniformly exponentially stable (Chen, 1979). In practice the measured velocity reaches the actuator only after a computation time, so the feedback acts with a time delay ε>0\varepsilon > 0ε>0. The question addressed by Datko, Lagnese and Polis (1986) is whether arbitrarily small delays can destroy the stability of a system that is stable without them.

Their note answers it with an explicit example and a sharp threshold on the feedback gain. It is the founding example of delay-induced instability in boundary stabilization, cited by most later work on robustness of boundary control to delays.

Timeline.

  • Chen (1979, 1981): energy decay E(u,t)≤Ce−αtE(u,0)E(u,t) \le Ce^{-\alpha t}E(u,0)E(u,t)≤Ce−αtE(u,0) for boundary-damped wave equations without delay.
  • Datko (1978): delays in the velocity term of the equation itself can destabilize; a lemma on zeros of exponential polynomials in vertical strips (the source of Lemma 1 here).
  • Datko, Lagnese, Polis (1986, DOI 10.1137/0324007): the delayed boundary feedback ux(1,t)=−kut(1,t−ε)u_x(1,t) = -ku_t(1,t-\varepsilon)ux​(1,t)=−kut​(1,t−ε) for the damped string, with a trichotomy in the gain kkk.
  • Nicaise and Pignotti (2006, DOI 10.1137/060648891): the multidimensional undamped problem with feedback −μ1ut(t)−μ2ut(t−τ)-\mu_1u_t(t) - \mu_2u_t(t-\tau)−μ1​ut​(t)−μ2​ut​(t−τ); stability iff μ2<μ1\mu_2 < \mu_1μ2​<μ1​, instability for a sequence of delays otherwise.

Setting

Fix real numbers a≥0a \ge 0a≥0 (damping), k≥0k \ge 0k≥0 (feedback gain) and ε>0\varepsilon > 0ε>0 (delay), and put K=e−2a∈(0,1]K = e^{-2a} \in (0,1]K=e−2a∈(0,1]. The delayed system is

(1)utt−uxx+2aut+a2u=0,0<x<1, t>0,(2)u(0,t)=0,t>0,(8)ux(1,t)=−k ut(1,t−ε),t>ε.\begin{aligned} &(1)\quad u_{tt} - u_{xx} + 2au_t + a^2u = 0, && 0<x<1,\ t>0,\\ &(2)\quad u(0,t) = 0, && t>0,\\ &(8)\quad u_x(1,t) = -k\,u_t(1,t-\varepsilon), && t>\varepsilon . \end{aligned}​(1)utt​−uxx​+2aut​+a2u=0,(2)u(0,t)=0,(8)ux​(1,t)=−kut​(1,t−ε),​​0<x<1, t>0,t>0,t>ε.​

A classical solution is a C2C^2C2 function u(x,t)u(x,t)u(x,t) with complex values satisfying (1), (2), (8).

Separated solutions u=eωtφ(x)u = e^{\omega t}\varphi(x)u=eωtφ(x) lead to the eigenvalue problem

φ′′(x)=(a+ω)2φ(x) (0<x<1),φ(0)=0,φ′(1)+kωe−εωφ(1)=0.\varphi''(x) = (a+\omega)^2\varphi(x)\ (0<x<1),\qquad \varphi(0) = 0,\qquad \varphi'(1) + k\omega e^{-\varepsilon\omega}\varphi(1) = 0 .φ′′(x)=(a+ω)2φ(x) (0<x<1),φ(0)=0,φ′(1)+kωe−εωφ(1)=0.

The spectrum σ(a,k,ε)\sigma(a,k,\varepsilon)σ(a,k,ε) is the set of ω∈C\omega \in \mathbb Cω∈C for which this problem has a solution φ\varphiφ not identically zero on [0,1][0,1][0,1]. The paper encodes it through the entire functions

f(ε,ω)=1+Ke−2ω+ke−εω(1−Ke−2ω),h(ε,ω)=ωf(ε,ω)+a(1+Ke−2ω),f(\varepsilon,\omega) = 1 + Ke^{-2\omega} + ke^{-\varepsilon\omega}(1 - Ke^{-2\omega}),\qquad h(\varepsilon,\omega) = \omega f(\varepsilon,\omega) + a(1 + Ke^{-2\omega}),f(ε,ω)=1+Ke−2ω+ke−εω(1−Ke−2ω),h(ε,ω)=ωf(ε,ω)+a(1+Ke−2ω),

and the critical gain (1−K)/(1+K)(1-K)/(1+K)(1−K)/(1+K). In Lean these are K a, f a k ε ω, h a k ε ω, delaySpectrum a k ε, IsClassicalSolution a k ε u and IsExpUnstableSolution a k ε u in the namespace DatkoDelayWave.BoundaryDelay.

Formalization targets

Goal: the stability trichotomy (THEOREM, p. 153)

  1. If 0<k<1−K1+K0 < k < \frac{1-K}{1+K}0<k<1+K1−K​: for each ε>0\varepsilon > 0ε>0 there is β(ε)>0\beta(\varepsilon) > 0β(ε)>0 with
σ(a,k,ε)⊆{Re⁡ω≤−β}.\sigma(a,k,\varepsilon) \subseteq \{\operatorname{Re}\omega \le -\beta\}.σ(a,k,ε)⊆{Reω≤−β}.
  1. If k=1−K1+K>0k = \frac{1-K}{1+K} > 0k=1+K1−K​>0: for each ε>0\varepsilon > 0ε>0, σ(a,k,ε)⊆{Re⁡ω<0}\sigma(a,k,\varepsilon) \subseteq \{\operatorname{Re}\omega < 0\}σ(a,k,ε)⊆{Reω<0}, but there is a countable set R⊆(0,∞)R \subseteq (0,\infty)R⊆(0,∞), dense in (0,∞)(0,\infty)(0,∞), such that for each ε∈R\varepsilon \in Rε∈R some sequence ωn∈σ(a,k,ε)\omega_n \in \sigma(a,k,\varepsilon)ωn​∈σ(a,k,ε) has Re⁡ωn→0\operatorname{Re}\omega_n \to 0Reωn​→0.
  2. If k>1−K1+Kk > \frac{1-K}{1+K}k>1+K1−K​: there is an open set D⊆(0,∞)D \subseteq (0,\infty)D⊆(0,∞), dense in (0,∞)(0,\infty)(0,∞), such that for each ε∈D\varepsilon \in Dε∈D the system has a classical solution with ∣u(x0,t)∣≥ceγt|u(x_0,t)| \ge ce^{\gamma t}∣u(x0​,t)∣≥ceγt for some γ,c>0\gamma, c > 0γ,c>0, x0∈(0,1)x_0 \in (0,1)x0​∈(0,1) and all t≥0t \ge 0t≥0.

Milestones

In attack order: the characteristic equation (16) (ω∈σ  ⟺  h(ε,ω)=0\omega \in \sigma \iff h(\varepsilon,\omega) = 0ω∈σ⟺h(ε,ω)=0 for ω≠−a\omega \ne -aω=−a); separated solutions; Lemma 1 (one zero of fff forces infinitely many zeros of fff and hhh in every vertical strip around it); (17)–(18) (no zeros of hhh in the right half-plane below or at the critical gain); the half-plane bound below the critical gain; (19) (no purely imaginary zeros at the critical gain); the explicit zero f(2(2m+1)2n+1,(2n+1)πi2)=0f\bigl(\tfrac{2(2m+1)}{2n+1}, \tfrac{(2n+1)\pi i}{2}\bigr) = 0f(2n+12(2m+1)​,2(2n+1)πi​)=0; density of the delays 2(2m+1)2n+1\tfrac{2(2m+1)}{2n+1}2n+12(2m+1)​; the root family (12)–(15) above the critical gain; Lemma 2 (an open dense set of delays with zeros of fff in Re⁡ω>0\operatorname{Re}\omega > 0Reω>0); the three parts of the THEOREM separately; and, off the goal's path, the undelayed formula Re⁡ω=12log⁡∣k−1k+1∣\operatorname{Re}\omega = \tfrac12\log\bigl|\tfrac{k-1}{k+1}\bigr|Reω=21​log​k+1k−1​​ for a=0a = 0a=0.

Significance

The result shows that exponential stability obtained by boundary velocity feedback is not robust to delays when the gain is above (1−K)/(1+K)(1-K)/(1+K)(1−K)/(1+K): delays from a dense set of lengths, including arbitrarily small ones, produce exponentially growing modes. When a=0a = 0a=0 the critical gain is 000, so every positive gain is fragile. Below the critical gain the spectral gap survives every delay. This identifies a quantitative robustness margin and motivated the later analysis of delayed boundary control, including the Nicaise–Pignotti theorems already posed on the platform for a different, multidimensional model (NicaiseDelayWave.*).

The result is proved in the paper, partly by citation: Lemma 1 is quoted from Datko (1978) without proof, and the open-mapping step of Lemma 2 is sketched. No machine-checked version exists. A formalization would check the threshold computations, supply the strip-zero lemma for this exponential polynomial, and give a rigorous version of the open-mapping step.

Difficulty

The algebraic parts, (16)–(19) and the explicit zeros, are calculations with complex exponentials. The difficulty is in Lemma 1 and Lemma 2. Lemma 1 needs the almost-periodic structure of exponential polynomials in vertical strips together with a Hurwitz or Rouché type argument, and neither is in Mathlib. Lemma 2 needs zeros of f(ε,⋅)f(\varepsilon,\cdot)f(ε,⋅) to persist under small changes of the real parameter ε\varepsilonε. The paper's route through the logarithmic map (11) does not work as printed, because it is stated with the principal branch exactly on the branch cut. In part (i), the delicate step is excluding accumulation of zeros at the imaginary axis as ∣Im⁡ω∣→∞|\operatorname{Im}\omega| \to \infty∣Imω∣→∞, which the half-plane estimate alone does not give.

Formalization scope

Parameters a,k,εa, k, \varepsilona,k,ε are real, ω∈C\omega \in \mathbb Cω∈C, eigenfunctions are maps R→C\mathbb R \to \mathbb CR→C and solutions are maps u:R→R→Cu : \mathbb R \to \mathbb R \to \mathbb Cu:R→R→C (space first). Partial derivatives are deriv of the sections. Solutions and eigenfunctions are required to be C2C^2C2 on all of R2\mathbb R^2R2, resp. R\mathbb RR; this loses no eigenvalue, since solutions of (5) are combinations of e±(a+ω)xe^{\pm(a+\omega)x}e±(a+ω)x. Committed readings of the paper's loose phrases:

  • the spectrum is the eigenvalue set of the problem above, not the zero set of hhh; h(ε,−a)=0h(\varepsilon,-a) = 0h(ε,−a)=0 always, so (16) is stated for ω≠−a\omega \neq -aω=−a;
  • "countably dense set RRR in (0,∞)(0,\infty)(0,∞)": R⊆(0,∞)R \subseteq (0,\infty)R⊆(0,∞), RRR countable, (0,∞)⊆R‾(0,\infty) \subseteq \overline R(0,∞)⊆R;
  • "dense open set DDD in (0,∞)(0,\infty)(0,∞)": D⊆(0,∞)D \subseteq (0,\infty)D⊆(0,∞) open, (0,∞)⊆D‾(0,\infty) \subseteq \overline D(0,∞)⊆D;
  • "exponentially unstable solution": a classical solution with ∣u(x0,t)∣≥ceγt|u(x_0,t)| \ge ce^{\gamma t}∣u(x0​,t)∣≥ceγt for all t≥0t \ge 0t≥0;
  • "an infinite number of zeros" (Lemma 1): the zero set in the open strip is infinite, for fff and for hhh separately;
  • "there exists β(ε)>0\beta(\varepsilon) > 0β(ε)>0": ∀ε>0 ∃β>0\forall \varepsilon > 0\ \exists \beta > 0∀ε>0 ∃β>0, so β\betaβ may depend on ε\varepsilonε;
  • part (ii) carries k>0k > 0k>0, the paper's standing assumption (p. 152); without it the part is false at a=0a = 0a=0;
  • m,nm, nm,n in 2(2m+1)/(2n+1)2(2m+1)/(2n+1)2(2m+1)/(2n+1) are positive integers in (12)–(15) and in the density of (15), as in the proof of Lemma 2; in the explicit threshold zero, where the page says "m,nm, nm,n are arbitrary", they range over all natural numbers.

Trivializing encodings are ruled out: defining the spectrum as the zero set of hhh would make −a-a−a a spurious spectral point, and reading "exponentially unstable" as "the spectrum meets Re⁡ω>0\operatorname{Re}\omega > 0Reω>0" would delete the solution-level content of part (iii).

A complete development needs zero-counting tools for exponential polynomials in strips (almost periodicity, Hurwitz's theorem), which would be reusable for other delay equations. Contributions to any milestone, and to that general infrastructure, are welcome.

Selected references

  • R. Datko, J. Lagnese, M. P. Polis, An example on the effect of time delays in boundary feedback stabilization of wave equations, SIAM J. Control Optim. 24(1), 152–156, 1986. https://doi.org/10.1137/0324007
  • R. Datko, A procedure for determination of the exponential stability of certain differential-difference equations, Quart. Appl. Math. 36, 279–292, 1978.
  • G. Chen, Energy decay estimates and exact boundary value controllability for the wave equation in a bounded domain, J. Math. Pures Appl. 58, 249–274, 1979.
  • S. Nicaise, C. Pignotti, Stability and instability results of the wave equation with a delay term in the boundary or internal feedbacks, SIAM J. Control Optim. 45(5), 1561–1585, 2006. https://doi.org/10.1137/060648891
16 thms3 active usersReviewed
🏆Completed
Operations Research·Captain: mikedeng1

Regret in Decision Making under Uncertainty 2: With u(x, y) = x + f(x − y) and f Decreasingly Concave, the Same Decision Maker Takes a Fair Long-Odds Bet and Buys Fair InsuranceResearch Paper

Motivation

Expected utility theory explains a single attitude toward risk by the curvature of a utility function of final wealth: a concave utility makes a decision maker risk averse, a convex one risk seeking. Several well documented patterns of behaviour do not fit this picture. The same people buy insurance against small-probability losses and buy lottery tickets with small-probability gains (Friedman and Savage, 1948, doi:10.1086/256692); subjects who are risk averse for gains are risk seeking for the mirrored losses, the reflection effect; and subjects who are indifferent between full insurance and bearing a risk reject half-price insurance that pays only half the time, probabilistic insurance (Kahneman and Tversky, 1979, doi:10.2307/1914185).

David E. Bell's 1982 paper Regret in Decision Making under Uncertainty (doi:10.1287/opre.30.5.961) proposes that a decision maker cares not only about what she obtains but also about what she would have obtained had she chosen differently. Its first part (the companion mission of this series) derives the representation u(x,y)=αv(x)+f(v(x)−v(y))u(x,y)=\alpha v(x)+f(v(x)-v(y))u(x,y)=αv(x)+f(v(x)−v(y)); its Section 2 shows that the single additive form with linear vvv explains all of the patterns above at once, provided the regret function fff is decreasingly concave. Regret theory, developed at the same time by Loomes and Sugden (1982, doi:10.2307/2232669), remains one of the standard alternatives to expected utility in decision analysis and behavioural economics.

Setting

A decision maker chooses between two alternatives aaa and bbb. Uncertainty is described by finitely many states iii with probabilities πi\pi_iπi​; in state iii alternative aaa gives final assets aia_iai​ and bbb gives bib_ibi​. Choosing aaa means forgoing bbb, and an outcome is valued by the regret utility

u(x,y)=x+f(x−y),u(x,y)=x+f(x-y),u(x,y)=x+f(x−y),

where xxx is the final assets received, yyy the assets the foregone alternative would have given in the same state, and f:R→Rf:\mathbb R\to\mathbb Rf:R→R the regret function. The expected utility of selecting aaa when bbb is foregone is

EUπ(a ∣ b)=∑iπi u(ai,bi),\mathrm{EU}_\pi(a\,|\,b)=\sum_i \pi_i\,u(a_i,b_i),EUπ​(a∣b)=i∑​πi​u(ai​,bi​),

and aaa is strictly preferred to bbb when EUπ(b ∣ a)<EUπ(a ∣ b)\mathrm{EU}_\pi(b\,|\,a)<\mathrm{EU}_\pi(a\,|\,b)EUπ​(b∣a)<EUπ​(a∣b) (the paper's inequality (1)); aaa and bbb are indifferent when the two expected utilities are equal.

The comparisons are given by three payoff tables. Table II: a horse wins with probability ppp; betting \pgivesgivesgives1-pifitwinsandif it wins andifitwinsand-pifitloses,notbettinggivesif it loses, not betting givesifitloses,notbettinggives0.TableIII:acarisdamagedwithprobability. Table III: a car is damaged with probability .TableIII:acarisdamagedwithprobabilitypatacostofat a cost ofatacostof1;insuringgives; insuring gives ;insuringgives-pinbothstates,notinsuringgivesin both states, not insuring givesinbothstates,notinsuringgives-1ororor0.TableIV:anaccidenthasprobability. Table IV: an accident has probability .TableIV:anaccidenthasprobabilityq;selfinsurancegives; self insurance gives ;selfinsurancegives-1ororor0,fullinsurance, full insurance ,fullinsurance-palways,andprobabilisticinsurance,whichchargeshalfthepremiumandpayswithprobabilityonehalfgivenanaccident,givesalways, and probabilistic insurance, which charges half the premium and pays with probability one half given an accident, givesalways,andprobabilisticinsurance,whichchargeshalfthepremiumandpayswithprobabilityonehalfgivenanaccident,gives-p,, ,-1ororor-p/2$.

The regret function fff is decreasingly concave if it is twice differentiable with strictly increasing second derivative f′′f''f′′. Section 3 also uses g(r)=r+f(r)−f(−r)g(r)=r+f(r)-f(-r)g(r)=r+f(r)−f(−r) and the negative exponential f(r)=1−e−γrf(r)=1-e^{-\gamma r}f(r)=1−e−γr, γ>0\gamma>0γ>0.

Formalization targets

Goal: coexistence of insurance and gambling

If fff is decreasingly concave and 0<p<120<p<\tfrac120<p<21​, then the bet of Table II is strictly preferred to not betting and insuring in Table III is strictly preferred to not insuring:

p [f(1−p)−f(p−1)]>(1−p) [f(p)−f(−p)].p\,[f(1-p)-f(p-1)]>(1-p)\,[f(p)-f(-p)].p[f(1−p)−f(p−1)]>(1−p)[f(p)−f(−p)].

Both comparisons have equal expected values, so the statement is a pure regret effect. The goal fixes no constants and assumes nothing about fff beyond decreasing concavity; it is the weakest hypothesis the page offers.

Milestones

  1. Display (5): the bet is preferred iff the inequality above; display (6): insurance is preferred iff the same inequality, so the two preferences coincide.
  2. The inequality holds for 0<p<120<p<\tfrac120<p<21​ whenever (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x is strictly increasing on x>0x>0x>0; and that ratio is strictly increasing whenever f′′(x)>f′′(−x)f''(x)>f''(-x)f′′(x)>f′′(−x) for x>0x>0x>0.
  3. The reflection effect (Sec. 2(ii)): x2x_2x2​ for sure is indifferent to the lottery (p:x1; 1−p:x3)(p:x_1;\,1-p:x_3)(p:x1​;1−p:x3​) iff −x2-x_2−x2​ for sure is indifferent to (p:−x1; 1−p:−x3)(p:-x_1;\,1-p:-x_3)(p:−x1​;1−p:−x3​).
  4. Probabilistic insurance (Sec. 2(iii)): display (9) characterises indifference between full and self insurance; under (9) and 0≤q<10\le q<10≤q<1,
f(p/2)−f(−p/2)<12 [f(p)−f(−p)](11)f(p/2)-f(-p/2)<\tfrac12\,[f(p)-f(-p)]\qquad(11)f(p/2)−f(−p/2)<21​[f(p)−f(−p)](11)

holds iff full insurance is strictly preferred to probabilistic insurance, iff probabilistic insurance is strictly preferred to self insurance; and (11) follows from the same ratio condition. 5. The negative exponential (Sec. 3): fff concave, ggg convex on r≥0r\ge0r≥0, g(r)/rg(r)/rg(r)/r strictly increasing on r>0r>0r>0, and fff decreasingly concave.

Significance

The goal is the paper's central behavioural claim: one regret function explains why the same decision maker gambles on long odds and buys insurance at fair prices, behaviour that a single concave or convex utility of wealth cannot produce. The milestones show that the reflection effect and the rejection of probabilistic insurance follow from the same model, and two of them reduce to the same inequality on the odd part f(x)−f(−x)f(x)-f(-x)f(x)−f(−x) of the regret function. The negative exponential example shows the hypotheses are met by a concrete, commonly used function, so the explanation is not vacuous.

The results are proved in the paper by short calculations, and none of them has been machine-checked before. The mission produces a formal statement of the regret model of Section 2 with its payoff tables, which pins down several points the printed text leaves loose: the meaning of "decreasingly concave", the domain on which "increasing" and "convex" are meant, and three misprinted intermediate displays.

Difficulty

The comparisons (5), (6), (9) and the reflection identity are algebraic once the payoff tables are expanded; the work is in expanding them correctly, since the foregone argument of uuu changes with the alternative selected and three printed expansions are wrong. The substance lies in the analytic step: passing from a pointwise condition on f′′f''f′′ to strict monotonicity of (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x on (0,∞)(0,\infty)(0,∞), with strict inequalities throughout and through a quotient that is undefined at 000. The naive reading of the page's condition, "f′′(x)>f′′(−x)f''(x)>f''(-x)f′′(x)>f′′(−x) for all xxx", is unsatisfiable and cannot be used as a hypothesis.

Formalization scope

All quantities are real numbers. The utility is regretU f x y = x + f (x - y), i.e. form (4) with v(x)=xv(x)=xv(x)=x exactly; the page assumes vvv only "approximately linear" but computes every display with v(x)=xv(x)=xv(x)=x. A comparison is a finite state space Fin n with a real weight vector; the theorems instantiate it with (p,1−p)(p,1-p)(p,1−p) for Tables II–III and with (q/2,q/2,1−q)(q/2,q/2,1-q)(q/2,q/2,1−q) for Table IV, the accident state split by whether the insurer pays. Strict preference is strict inequality of expected regret utilities; indifference is equality.

Conventions and corrections, each disclosed in the item concerned:

  • "Decreasingly concave" is not defined in the paper; it is read as Differentiable ℝ f, Differentiable ℝ (deriv f) and StrictMono (deriv (deriv f)). The page's presumption that fff is increasing and concave is not assumed.
  • "Increasing" is read strictly, because the conclusions (5), (6), (11) are strict, and on x>0x>0x>0, because (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x is undefined at 000 and even.
  • "f′′(x)>f′′(−x)f''(x)>f''(-x)f′′(x)>f′′(−x) for all xxx" is read for x>0x>0x>0.
  • The convexity of ggg in the exponential example is stated on r≥0r\ge0r≥0: g(r)=r+2sinh⁡(γr)g(r)=r+2\sinh(\gamma r)g(r)=r+2sinh(γr) is concave for r<0r<0r<0, as the paper itself notes on p. 977.
  • Misprints corrected: the last bracket of the second reflection equality on p. 973; f(p/2)f(p/2)f(p/2) for f(−p/2)f(-p/2)f(−p/2) in the expansion before (10) and in the probabilistic-versus-self display on p. 975, which also lacks a factor qqq. The normalisation f(0)=0f(0)=0f(0)=0 is not needed.
  • The equivalences (5), (6), (9) and the reflection identity hold for every real probability and are stated without a range; the goal keeps 0<p<120<p<\tfrac120<p<21​ and the probabilistic-insurance statement keeps 0≤q<10\le q<10≤q<1.

The goal cannot be satisfied vacuously: the negative exponential milestone exhibits a decreasingly concave fff, and the conclusion is a strict preference between two alternatives of equal expected value. Section 2(iv) (preference reversals) is not formalized: its printed rewriting of (12) in terms of hhh drops a linear term and its conclusion is unquantified ("for sufficiently small units of money").

Contributions welcome: proofs of the algebraic reductions, the slope argument for (f(x)−f(−x))/x(f(x)-f(-x))/x(f(x)−f(−x))/x, and the convexity facts for sinh⁡\sinhsinh; the latter two are reusable beyond this mission.

Selected references

  • D. E. Bell, Regret in Decision Making under Uncertainty, Operations Research 30(5), 961–981, 1982. doi:10.1287/opre.30.5.961
  • D. Kahneman and A. Tversky, Prospect Theory: An Analysis of Decision under Risk, Econometrica 47(2), 263–291, 1979. doi:10.2307/1914185
  • G. Loomes and R. Sugden, Regret Theory: An Alternative Theory of Rational Choice under Uncertainty, The Economic Journal 92(368), 805–824, 1982. doi:10.2307/2232669
  • M. Friedman and L. J. Savage, The Utility Analysis of Choices Involving Risk, Journal of Political Economy 56(4), 279–304, 1948. doi:10.1086/256692
12 thms3 active usersReviewed
🏆Completed
Differential GeometryOptimization·Captain: mikedeng1

Projection-like Retractions on Matrix Manifolds II: The Metric Projection onto a C^k Submanifold Is Locally Unique and C^(k−1), so Projecting a Tangent Step Is a RetractionResearch Paper

Motivation

Many optimization problems in statistics, signal processing and control are posed over sets of matrices with a constraint that makes them curved: matrices of fixed rank, matrices with orthonormal columns, symmetric matrices with a prescribed spectrum. Algorithms on such sets ("optimization on manifolds") compute a step in the tangent space at the current point, as in a vector space, and then need a rule that brings the point x+ux+ux+u back to the set. A retraction is such a rule; the notion was introduced by Adler, Dedieu, Margulies, Martens and Shub for Newton's method on Riemannian manifolds (IMA J. Numer. Anal. 2002) and is the basic building block of the algorithms in Absil, Mahony and Sepulchre's monograph (Princeton, 2008). Any retraction preserves the local convergence of Newton's method, so the choice among retractions is about cost and convenience.

The most natural candidate is to project x+ux+ux+u back onto the manifold: take the nearest point. Absil and Malick (SIAM J. Optim. 2012; preprint HAL hal-00651608) show in §3.1 that this projective retraction is always a valid retraction of maximal smoothness, and then compute it for fixed-rank, spectral and Stiefel manifolds. The underlying fact, that the nearest-point map onto a CkC^kCk submanifold is locally single-valued and Ck−1C^{k-1}Ck−1, is classical (the paper cites Lewis and Malick, Math. Oper. Res. 2008); the paper gives a short proof through the inverse function theorem on the normal bundle. This mission formalizes §3.1: that lemma and the resulting retraction.

Setting

Let E\mathcal EE be a Euclidean space, a finite-dimensional real inner product space, of dimension nnn (in the paper's examples, Rn×m\mathbb R^{n\times m}Rn×m with the Frobenius inner product). A set M⊆E\mathcal M\subseteq\mathcal EM⊆E is a submanifold of class CkC^kCk and dimension ddd around xˉ\bar xxˉ if xˉ∈M\bar x\in\mathcal Mxˉ∈M and there are an open neighbourhood UEU_{\mathcal E}UE​ of xˉ\bar xxˉ and a CkC^kCk diffeomorphism φ\varphiφ from UEU_{\mathcal E}UE​ onto an open subset of Rn\mathbb R^nRn with

M∩UE={x∈UE: φd+1(x)=⋯=φn(x)=0}.\mathcal M\cap U_{\mathcal E}=\{x\in U_{\mathcal E}:\ \varphi_{d+1}(x)=\cdots=\varphi_n(x)=0\}.M∩UE​={x∈UE​: φd+1​(x)=⋯=φn​(x)=0}.

The tangent space TM(x)T_{\mathcal M}(x)TM​(x) is the linear subspace of E\mathcal EE spanned by the tangent cone of M\mathcal MM at xxx, and the normal space is NM(x)=TM(x)⊥N_{\mathcal M}(x)=T_{\mathcal M}(x)^\perpNM​(x)=TM​(x)⊥. The tangent bundle and normal bundle are TM={(x,u):x∈M, u∈TM(x)}T\mathcal M=\{(x,u):x\in\mathcal M,\ u\in T_{\mathcal M}(x)\}TM={(x,u):x∈M, u∈TM​(x)} and NM={(x,v):x∈M, v∈NM(x)}N\mathcal M=\{(x,v):x\in\mathcal M,\ v\in N_{\mathcal M}(x)\}NM={(x,v):x∈M, v∈NM​(x)}, subsets of E×E\mathcal E\times\mathcal EE×E. PTM(x)P_{T_{\mathcal M}(x)}PTM​(x)​ denotes the orthogonal projector onto TM(x)T_{\mathcal M}(x)TM​(x).

The projection of x∈Ex\in\mathcal Ex∈E onto M\mathcal MM is the set of nearest points,

PM(x)=argmin⁡{∥x−y∥: y∈M},P_{\mathcal M}(x)=\operatorname{argmin}\{\|x-y\|:\ y\in\mathcal M\},PM​(x)=argmin{∥x−y∥: y∈M},

which may be empty (if M\mathcal MM is not closed) or contain several points (if M\mathcal MM is not convex).

A map RRR from TMT\mathcal MTM to M\mathcal MM is a retraction around xˉ\bar xxˉ (Definition 2.1) if on some neighbourhood U\mathcal UU of (xˉ,0)(\bar x,0)(xˉ,0) in TMT\mathcal MTM it is of class Ck−1C^{k-1}Ck−1, satisfies R(x,0)=xR(x,0)=xR(x,0)=x, and DR(x,⋅)(0)=idTM(x)\mathrm DR(x,\cdot)(0)=\mathrm{id}_{T_{\mathcal M}(x)}DR(x,⋅)(0)=idTM​(x)​ for (x,0)∈U(x,0)\in\mathcal U(x,0)∈U.

The formal retraction predicate includes k≥2k\ge2k≥2 and a local submanifold chart at xˉ\bar xxˉ; this ensures that its base point lies on M\mathcal MM.

Formalization targets

Goal: Proposition 3.2 (projective retraction)

For M\mathcal MM a CkC^kCk submanifold (k≥2k\ge2k≥2) around xˉ\bar xxˉ, the map

R(x,u)=PM(x+u),(x,u)∈TM,R(x,u)=P_{\mathcal M}(x+u),\qquad (x,u)\in T\mathcal M,R(x,u)=PM​(x+u),(x,u)∈TM,

is single-valued near (xˉ,0)(\bar x,0)(xˉ,0) in TMT\mathcal MTM, and this single value is a retraction around xˉ\bar xxˉ.

Milestones

  1. (3.2) If p∈PM(x)p\in P_{\mathcal M}(x)p∈PM​(x) and M\mathcal MM is a CkC^kCk submanifold around ppp, then p∈Mp\in\mathcal Mp∈M and x−p∈NM(p)x-p\in N_{\mathcal M}(p)x−p∈NM​(p).
  2. (3.3) TNM(xˉ,0)=TM(xˉ)×NM(xˉ)T_{N\mathcal M}(\bar x,0)=T_{\mathcal M}(\bar x)\times N_{\mathcal M}(\bar x)TNM​(xˉ,0)=TM​(xˉ)×NM​(xˉ).
  3. Lemma 3.1 There is δ>0\delta>0δ>0 such that on B(xˉ,δ)B(\bar x,\delta)B(xˉ,δ) the projection PMP_{\mathcal M}PM​ is a single point P(x)P(x)P(x), the map PPP is Ck−1C^{k-1}Ck−1, and
DPM(xˉ)=PTM(xˉ).\mathrm DP_{\mathcal M}(\bar x)=P_{T_{\mathcal M}(\bar x)}.DPM​(xˉ)=PTM​(xˉ)​.

Significance

The projective retraction is the reference retraction on an embedded submanifold: it exists for every CkC^kCk submanifold, it has the maximal smoothness Ck−1C^{k-1}Ck−1 allowed by the tangent bundle, and it is the one practitioners compute first (truncated SVD for fixed-rank matrices, polar factor for the Stiefel manifold). Section 4 of the paper shows that it is moreover second order and generalizes it to projections along arbitrary smooth fields of transverse subspaces; Lemma 3.1 is the model of that argument. Lemma 3.1 on its own is a basic tool well beyond retractions: local single-valuedness and smoothness of the nearest-point map underlies the local convergence analysis of alternating projections on manifolds and the theory of prox-regular sets.

All statements here are proved results. No machine-checked proof of them is known to exist: Mathlib has the inverse function theorem, tangent cones and orthogonal projections onto subspaces, but no embedded submanifolds of a Euclidean space with their normal bundle and no nearest-point map onto non-convex sets. The mission produces these statements in Lean and invites proofs of them.

Difficulty

The obvious argument writes the nearest point as a critical point of y↦∥x−y∥2y\mapsto\|x-y\|^2y↦∥x−y∥2 on M\mathcal MM and applies the implicit function theorem. Two things break. First, existence: M\mathcal MM is not assumed closed, so a nearest point exists only because M\mathcal MM is locally closed near xˉ\bar xxˉ and points of M\mathcal MM far from xˉ\bar xxˉ are farther from xxx than xˉ\bar xxˉ is. Second, uniqueness: critical points are not unique in general, and the implicit function theorem only describes critical points near a given one. Uniqueness needs a quantitative argument that every nearest point of xxx lies in the region where (p,v)↦p+v(p,v)\mapsto p+v(p,v)↦p+v on the normal bundle is injective. Finally, the normal bundle is itself only a Ck−1C^{k-1}Ck−1 manifold, whose tangent space at (xˉ,0)(\bar x,0)(xˉ,0) must be identified before the inverse function theorem applies; this is milestone (3.3).

Formalization scope

The ambient space is any type E with [NormedAddCommGroup E] [InnerProductSpace ℝ E] [FiniteDimensional ℝ E]; nnn is Module.finrank ℝ E, and k,dk,dk,d are natural numbers with k≥2k\ge2k≥2 stated as a hypothesis (so that k−1k-1k−1 in ℕ is honest). The paper's standing assumption "M\mathcal MM is a submanifold of class CkC^kCk (k≥2k\ge2k≥2) and dimension ddd" enters only as the local hypothesis IsSubmanifoldAt k d M xbar, exactly as Lemma 3.1 and Proposition 3.2 state it ("around xˉ\bar xxˉ"). The chart is an OpenPartialHomeomorph onto EuclideanSpace ℝ (Fin n), CkC^kCk in both directions, with 0-based coordinates. No closedness of M\mathcal MM is assumed, because the paper does not assume it.

The projection is the platform predicate IsMetricProjection M x z (z∈Mz\in\mathcal Mz∈M and ∥x−z∥≤∥x−w∥\|x-z\|\le\|x-w\|∥x−z∥≤∥x−w∥ for all w∈Mw\in\mathcal Mw∈M); single-valuedness is stated as equality of the set of such zzz with a singleton, which asserts existence and uniqueness. A formalization that only states "some selection is Ck−1C^{k-1}Ck−1", or uses ⊆\subseteq⊆ (satisfied by the empty set), would drop the main claim and is ruled out. The tangent space is the span of Mathlib's tangentConeAt; "class Ck−1C^{k-1}Ck−1 on a neighbourhood in TMT\mathcal MTM" is ContDiffOn on O∩TMO\cap T\mathcal MO∩TM with OOO open; DR(x,⋅)(0)=id\mathrm DR(x,\cdot)(0)=\mathrm{id}DR(x,⋅)(0)=id is a HasFDerivAt statement on the normed space TM(x)T_{\mathcal M}(x)TM​(x); PTM(xˉ)P_{T_{\mathcal M}(\bar x)}PTM​(xˉ)​ is Submodule.starProjection.

A complete development needs: the tangent space of a slice submanifold equals the image of the chart's derivative, the normal bundle as a Ck−1C^{k-1}Ck−1 manifold, an inverse function theorem on it, and compactness of M∩Bˉ(xˉ,r)\mathcal M\cap\bar B(\bar x,r)M∩Bˉ(xˉ,r) for small rrr. These are reusable for the other missions of this series (fixed-rank, spectral and Stiefel manifolds, and the retractor construction of Section 4), and contributions of such general lemmas as intermediate theorems are welcome.

Selected references

  • P.-A. Absil and J. Malick, Projection-like retractions on matrix manifolds, SIAM J. Optim. 22(1):135–158, 2012. https://doi.org/10.1137/100802529 (preprint: https://hal.science/hal-00651608, version 2, the basis of the statement indices here)
  • R. L. Adler, J.-P. Dedieu, J. Y. Margulies, M. Martens and M. Shub, Newton's method on Riemannian manifolds and a geometric model for the human spine, IMA J. Numer. Anal. 22:359–390, 2002. https://doi.org/10.1093/imanum/22.3.359
  • P.-A. Absil, R. Mahony and R. Sepulchre, Optimization Algorithms on Matrix Manifolds, Princeton University Press, 2008. https://doi.org/10.1515/9781400830244
  • A. S. Lewis and J. Malick, Alternating projections on manifolds, Math. Oper. Res. 33(1):216–234, 2008. https://doi.org/10.1287/moor.1070.0291
8 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization+2·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case VI: Lower Semianalytic Functions — Analytically Measurable ε-Optimal Selectors (Jankov–von Neumann)Textbook

Motivation

Dynamic programming over uncountable state and control spaces needs two things at every stage: the optimal cost-to-go, obtained by minimizing over the control, must be a function that can be integrated against the next stage's transition probabilities, and a policy that nearly attains the minimum must be measurable, so that it defines a stochastic process. With Borel-measurable costs and Borel-measurable policies both requirements fail. Minimizing a Borel function of (x,y)(x,y)(x,y) over yyy produces a function whose level sets are projections of Borel sets, and such projections need not be Borel (Suslin, 1917). The repair, developed by Blackwell, Freedman and Orkin (1974), Shreve and Bertsekas, and set out in Chapter 7 of Bertsekas and Shreve's Stochastic Optimal Control: The Discrete-Time Case (1978), is to enlarge the class of costs to the lower semianalytic functions and the class of policies to the analytically or universally measurable ones. Sections 7.6–7.7 of the book establish that this class is closed under partial minimization and admits measurable ε-optimal selectors. Chapters 8–10 of the book, and much of the later literature on Borel-space Markov decision processes (Hernández-Lerma and Lasserre; Feinberg and coauthors), build on these results.

Timeline:

  • 1917: Suslin shows that projections of Borel sets need not be Borel and introduces analytic sets; Lusin proves that analytic sets are universally measurable.
  • 1941–1949: Jankov and von Neumann independently prove that an analytic subset of a product admits a selector measurable with respect to the σ-algebra generated by analytic sets.
  • 1974: Blackwell, Freedman and Orkin use analytic sets to construct ε-optimal policies in Borel dynamic programming.
  • 1978: Bertsekas and Shreve give the treatment used here (§7.6–7.7), including the selection theorem for lower semianalytic functions, Proposition 7.50.

Setting

A Borel space is a topological space homeomorphic to a Borel subset of a complete separable metric space (Definition 7.7); its Borel σ-algebra is BX\mathscr B_XBX​. The Baire space is N=NN\mathscr N=\mathbb N^{\mathbb N}N=NN with the product topology. A set A⊆XA\subseteq XA⊆X is analytic if it is empty or the image of N\mathscr NN under a continuous map; by Proposition 7.41 this is the book's Definition 7.16 (the Suslin operation applied to closed sets). Every Borel set is analytic, and the converse fails when XXX is uncountable.

Three σ-algebras on XXX are in play. The analytic σ-algebra AX\mathscr A_XAX​ is generated by the analytic sets (Definition 7.19). The universal σ-algebra is UX=⋂pBX(p)\mathscr U_X=\bigcap_{p}\mathscr B_X(p)UX​=⋂p​BX​(p), the intersection over all probability measures ppp on (X,BX)(X,\mathscr B_X)(X,BX​) of the ppp-completions of BX\mathscr B_XBX​ (Definition 7.18). For a function fff from D⊆XD\subseteq XD⊆X into a Borel space YYY, fff is analytically measurable if D∈AXD\in\mathscr A_XD∈AX​ and f−1(B)∈AXf^{-1}(B)\in\mathscr A_Xf−1(B)∈AX​ for every B∈BYB\in\mathscr B_YB∈BY​, and universally measurable if the same holds with UX\mathscr U_XUX​ (Definition 7.20).

Let R∗=[−∞,∞]R^*=[-\infty,\infty]R∗=[−∞,∞]. A function f:D→R∗f:D\to R^*f:D→R∗ is lower semianalytic if DDD is analytic and {x∈D∣f(x)<c}\{x\in D\mid f(x)<c\}{x∈D∣f(x)<c} is analytic for every real ccc (Definition 7.21). For D⊆X×YD\subseteq X\times YD⊆X×Y write Dx={y∣(x,y)∈D}D_x=\{y\mid (x,y)\in D\}Dx​={y∣(x,y)∈D}, projX(D)={x∣Dx≠∅}\mathrm{proj}_X(D)=\{x\mid D_x\neq\emptyset\}projX​(D)={x∣Dx​=∅}, and define the partial infimum

f∗(x)=inf⁡y∈Dxf(x,y),x∈projX(D).f^*(x)=\inf_{y\in D_x}f(x,y),\qquad x\in\mathrm{proj}_X(D).f∗(x)=y∈Dx​inf​f(x,y),x∈projX​(D).

A selector is a function φ:projX(D)→Y\varphi:\mathrm{proj}_X(D)\to Yφ:projX​(D)→Y whose graph Gr(φ)\mathrm{Gr}(\varphi)Gr(φ) lies in DDD.

Formalization targets

Goal: Proposition 7.50

Let X,YX,YX,Y be Borel spaces, D⊆X×YD\subseteq X\times YD⊆X×Y analytic, and f:D→R∗f:D\to R^*f:D→R∗ lower semianalytic.

(a) For every ε>0\varepsilon>0ε>0 there is an analytically measurable selector φ\varphiφ with

f[x,φ(x)]≤{f∗(x)+εif f∗(x)>−∞,−1/εif f∗(x)=−∞.f[x,\varphi(x)]\le\begin{cases}f^*(x)+\varepsilon&\text{if }f^*(x)>-\infty,\\-1/\varepsilon&\text{if }f^*(x)=-\infty.\end{cases}f[x,φ(x)]≤{f∗(x)+ε−1/ε​if f∗(x)>−∞,if f∗(x)=−∞.​

(b) The set III of points where the infimum is attained is universally measurable, and for every ε>0\varepsilon>0ε>0 there is a universally measurable selector φ\varphiφ with f[x,φ(x)]=f∗(x)f[x,\varphi(x)]=f^*(x)f[x,φ(x)]=f∗(x) on III and the bounds of (a) off III.

The goal fixes no constant beyond the book's ε\varepsilonε and −1/ε-1/\varepsilon−1/ε.

Milestones

In attack order: Proposition 7.40 (Borel images and preimages of analytic sets are analytic), Corollary 7.42.1 (AX⊆UX\mathscr A_X\subseteq\mathscr U_XAX​⊆UX​), Corollary 7.44.2 (composites of analytically measurable maps are universally measurable), and Proposition 7.49, the Jankov–von Neumann theorem:

A⊆X×Y analytic ⟹ ∃ φ:projX(A)→Y analytically measurable, Gr(φ)⊆A.A\subseteq X\times Y\text{ analytic}\ \Longrightarrow\ \exists\,\varphi:\mathrm{proj}_X(A)\to Y\ \text{analytically measurable},\ \mathrm{Gr}(\varphi)\subseteq A.A⊆X×Y analytic ⟹ ∃φ:projX​(A)→Y analytically measurable, Gr(φ)⊆A.

Further items of the mission, on the same definitions: Proposition 7.39 (projections of analytic sets are analytic, and every analytic set is a projection of a Borel set), Lemma 7.30(1) (strict and non-strict, real and extended level sets give the same class) and Proposition 7.47 (lower semianalytic functions are exactly partial infima of Borel functions).

Significance

Proposition 7.50 is the selection theorem behind the existence of ε-optimal policies in Borel-space dynamic programming. In the finite-horizon model of Chapter 8 the optimal cost-to-go at each stage is lower semianalytic, by Propositions 7.47 and 7.48. Proposition 7.50 then turns the one-stage minimization into a measurable policy, analytically measurable when only ε-optimality is required and universally measurable when the minimum is attained. Chapters 8–9 of the book (the finite-horizon recursion JK∗=TK(J0)J^*_K=T^K(J_0)JK∗​=TK(J0​) and the optimality equation under (P), (N), (D)) use it at every step. Downstream catalog papers on average-cost and stochastic shortest-path problems over Borel spaces cite these results.

All results here are proved in the book and in the descriptive set theory literature (Kechris, Classical Descriptive Set Theory, §18 and §29). None is formalized on Prove2Me. Mathlib has analytic sets in Polish-type settings, the Lusin separation theorem and Suslin's theorem, but it has no universal σ-algebra, no analytic σ-algebra, no lower semianalytic functions and no Jankov–von Neumann uniformization. The definitions in this mission are reusable by the later missions of the series (Chapters 8–10), which restate them locally until these are published.

Difficulty

The obvious route to a selector is to choose, for each xxx, a minimizing or near-minimizing yyy. The axiom of choice provides such a function, but nothing makes it measurable, and the conclusion of the theorem is exactly that measurability. The Borel route fails too: the set {x∣f∗(x)<c}\{x\mid f^*(x)<c\}{x∣f∗(x)<c} is a projection of a Borel set, which is analytic but in general not Borel, so no Borel-measurable selector exists in general. The Jankov–von Neumann theorem needs a lexicographically least branch of a continuous parametrization of AAA by N\mathscr NN, and an argument that the resulting map is measurable with respect to AX\mathscr A_XAX​, which is generated by sets that are not closed under complementation. Part (b) adds a further obstacle: the composite of two analytically measurable maps need not be analytically measurable, so the exact selector is only universally measurable. Proving that requires Lusin's theorem that analytic sets are measurable for every completed probability measure.

Formalization scope

  • A Borel space is a type with a topology satisfying the class IsBorelSpace (Definition 7.7, the ambient complete separable metric space taken in the same universe), together with Mathlib's [MeasurableSpace X] [BorelSpace X], so measurable sets are exactly the Borel sets. On X×YX\times YX×Y the product σ-algebra is used; it coincides with BX×Y\mathscr B_{X\times Y}BX×Y​ for separable metrizable spaces (Proposition 7.13).
  • Analytic sets are Mathlib's MeasureTheory.AnalyticSet (empty or a continuous image of ℕ → ℕ).
  • R∗R^*R∗ is EReal. The book uses ∞−∞=∞\infty-\infty=\infty∞−∞=∞, and Mathlib's EReal uses ⊥+⊤=⊥\bot+\top=\bot⊥+⊤=⊥. No statement of this mission adds infinities of opposite sign; f∗(x)+εf^*(x)+\varepsilonf∗(x)+ε adds a real number.
  • Functions on DDD and on projX(D)\mathrm{proj}_X(D)projX​(D) are functions on subtypes. The graph condition Gr(φ)⊆D\mathrm{Gr}(\varphi)\subseteq DGr(φ)⊆D is part of every selector statement.
  • Universally measurable means NullMeasurableSet E p for every probability measure p.
  • "Analytically measurable" refers to the σ-algebra generated by analytic sets. Replacing it by the power set, dropping the graph condition, or dropping the −1/ε-1/\varepsilon−1/ε case would make the selection theorems a consequence of the axiom of choice. The statements rule all three out.

Not included: Lusin's theorem in Suslin-scheme form (Proposition 7.42, which needs the Suslin operation as a definition), Proposition 7.43 on P(X)P(X)P(X), the integration results of Propositions 7.46 and 7.48, and Lemma 7.30(2)–(4). None is used in the proof of the goal. Contributions welcome: the bridge between IsBorelSpace and Mathlib's StandardBorelSpace, the universal σ-algebra API, and the Jankov–von Neumann theorem itself.

Selected references

  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press 1978; Athena Scientific 1996, §7.6–7.7. https://web.mit.edu/dimitrib/www/soc.html
  • D. Blackwell, D. Freedman and M. Orkin, The optimal reward operator in dynamic programming, Annals of Probability 2 (1974) 926–941. https://doi.org/10.1214/aop/1176996558
  • A. S. Kechris, Classical Descriptive Set Theory, Graduate Texts in Mathematics 156, Springer 1995, §18 (Jankov–von Neumann uniformization), §29 (measurability of analytic sets). https://doi.org/10.1007/978-1-4612-4190-4
  • S. E. Shreve and D. P. Bertsekas, Universally measurable policies in dynamic programming, Mathematics of Operations Research 4 (1979) 15–30. https://doi.org/10.1287/moor.4.1.15
8 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization+2·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case V: Semicontinuous Functions — a Borel-Measurable Minimizing Selector for Lower Semicontinuous CostsTextbook

Motivation

Every step of the dynamic programming algorithm on a general state space does three things: it takes a conditional expectation of the cost-to-go under a transition kernel, it minimizes the resulting function of state and control over the control, and, if a policy is to be produced, it picks a control for each state that attains or nearly attains that minimum. On a finite or countable state space all three are harmless. On an uncountable state space each can destroy the measurability needed to take the next expectation: the infimum over an uncountable family of measurable functions need not be measurable, and a minimizer chosen state by state need not be a measurable function of the state, so it does not define a policy at all.

Section 7.5 of Bertsekas and Shreve, Stochastic Optimal Control: The Discrete-Time Case (1978; Athena Scientific reprint 1996), settles the three operations for semicontinuous costs and continuous kernels. The results are the topological half of the book's measurability theory; the descriptive set theory half (lower semianalytic functions and analytically measurable selectors, §7.6–7.7) is a separate mission in this series. The semicontinuous results are what Propositions 8.6–8.7 and Corollaries 9.17.2–9.17.3 of the book use to obtain Borel-measurable optimal policies for finite-horizon and infinite-horizon models with lower semicontinuous costs and compact control sets.

Timeline. The exact selection theorem for lower semicontinuous functions (Proposition 7.33 below) is credited by the book's notes to Dubins and Savage, How to Gamble If You Must (1965). The Hausdorff metric on closed sets goes back to Hausdorff's Set Theory. Measurable selection in the closed-valued setting was later systematized by Kuratowski and Ryll-Nardzewski (1965), whose theorem gives a different route to results of this kind.

Setting

Throughout, R∗=[−∞,+∞]R^*=[-\infty,+\infty]R∗=[−∞,+∞] is the extended real line. A function f:X→R∗f:X\to R^*f:X→R∗ on a metrizable space XXX is lower semicontinuous if every sublevel set {x∣f(x)≤c}\{x\mid f(x)\le c\}{x∣f(x)≤c}, c∈Rc\in\mathbb Rc∈R, is closed, and upper semicontinuous if every superlevel set {x∣f(x)≥c}\{x\mid f(x)\ge c\}{x∣f(x)≥c} is closed (Definition 7.13). C(X)C(X)C(X) is the space of bounded continuous real-valued functions on XXX.

For a separable metrizable space YYY, P(Y)P(Y)P(Y) is the set of Borel probability measures on YYY with the weak topology (convergence of integrals of functions in C(Y)C(Y)C(Y)). A stochastic kernel q(dy∣x)q(dy\mid x)q(dy∣x) on YYY given XXX is a map x↦q(dy∣x)x\mapsto q(dy\mid x)x↦q(dy∣x) from XXX to P(Y)P(Y)P(Y), and it is continuous if this map is continuous (Definition 7.12). The integral of a Borel-measurable f:Y→R∗f:Y\to R^*f:Y→R∗ is ∫f dp=∫f+dp−∫f−dp\int f\,dp=\int f^+dp-\int f^-dp∫fdp=∫f+dp−∫f−dp with the convention −∞+∞=+∞−∞=+∞-\infty+\infty=+\infty-\infty=+\infty−∞+∞=+∞−∞=+∞ (Eq. (43) of Chapter 7).

For a compact metric space YYY, 2Y2^Y2Y is the collection of closed subsets of YYY with the topology of the Hausdorff metric (Appendix C). For D⊆X×YD\subseteq X\times YD⊆X×Y, the section at xxx is Dx={y∣(x,y)∈D}D_x=\{y\mid (x,y)\in D\}Dx​={y∣(x,y)∈D}, the projection is projX(D)={x∣Dx≠∅}\mathrm{proj}_X(D)=\{x\mid D_x\neq\emptyset\}projX​(D)={x∣Dx​=∅}, and a function φ:projX(D)→Y\varphi:\mathrm{proj}_X(D)\to Yφ:projX​(D)→Y has its graph in DDD if (x,φ(x))∈D(x,\varphi(x))\in D(x,φ(x))∈D for every x∈projX(D)x\in\mathrm{proj}_X(D)x∈projX​(D). "Borel-measurable" refers to the Borel σ-algebras of the topologies in question; on projX(D)\mathrm{proj}_X(D)projX​(D) this is the Borel σ-algebra of the subspace topology.

Formalization targets

Goal: Proposition 7.33

Let XXX be metrizable, YYY compact metrizable, D⊆X×YD\subseteq X\times YD⊆X×Y closed, and f:D→R∗f:D\to R^*f:D→R∗ lower semicontinuous. Put

f∗(x)=min⁡y∈Dxf(x,y),x∈projX(D).f^*(x)=\min_{y\in D_x}f(x,y),\qquad x\in\mathrm{proj}_X(D).f∗(x)=y∈Dx​min​f(x,y),x∈projX​(D).

Then projX(D)\mathrm{proj}_X(D)projX​(D) is closed, f∗f^*f∗ is lower semicontinuous, and there is a Borel-measurable φ:projX(D)→Y\varphi:\mathrm{proj}_X(D)\to Yφ:projX​(D)→Y with graph in DDD and

f(x,φ(x))=f∗(x)∀x∈projX(D).f\bigl(x,\varphi(x)\bigr)=f^*(x)\qquad\forall x\in\mathrm{proj}_X(D).f(x,φ(x))=f∗(x)∀x∈projX​(D).

Milestones

  • Proposition 7.32: for f∗(x)=inf⁡y∈Yf(x,y)f^*(x)=\inf_{y\in Y}f(x,y)f∗(x)=infy∈Y​f(x,y), lower semicontinuity of fff and compactness of YYY give lower semicontinuity of f∗f^*f∗ and attainment; upper semicontinuity of fff gives upper semicontinuity of f∗f^*f∗.
  • Lemma 7.18: there is a Borel-measurable σ:2Y−{∅}→Y\sigma:2^Y-\{\emptyset\}\to Yσ:2Y−{∅}→Y with σ(A)∈A\sigma(A)\in Aσ(A)∈A.
  • Lemma 7.20: for lower semicontinuous fff on a nonempty compact YYY, the argmin map x↦{y∣f(x,y)≤f∗(x)}x\mapsto\{y\mid f(x,y)\le f^*(x)\}x↦{y∣f(x,y)≤f∗(x)} is Borel-measurable into 2Y2^Y2Y.
  • Lemma 7.14: fff is lower semicontinuous and bounded below iff fn↑ff_n\uparrow ffn​↑f for some fn∈C(X)f_n\in C(X)fn​∈C(X) (and dually).
  • Proposition 7.30: x↦∫f(x,y) q(dy∣x)x\mapsto\int f(x,y)\,q(dy\mid x)x↦∫f(x,y)q(dy∣x) is continuous for f∈C(X×Y)f\in C(X\times Y)f∈C(X×Y) and continuous qqq.
  • Proposition 7.31: the same map is lower (upper) semicontinuous and bounded below (above) when fff is.
  • Lemma 7.21: an open G⊆X×YG\subseteq X\times YG⊆X×Y, YYY separable, has open projection and a Borel-measurable selector with graph in GGG.
  • Proposition 7.34: for open DDD and upper semicontinuous fff, projX(D)\mathrm{proj}_X(D)projX​(D) is open, f∗=inf⁡Dxff^*=\inf_{D_x}ff∗=infDx​​f is upper semicontinuous, and for each ε>0\varepsilon>0ε>0 there is a Borel-measurable φε\varphi_\varepsilonφε​ with graph in DDD and
f(x,φε(x))≤{f∗(x)+εif f∗(x)>−∞,−1/εif f∗(x)=−∞.f\bigl(x,\varphi_\varepsilon(x)\bigr)\le\begin{cases}f^*(x)+\varepsilon&\text{if }f^*(x)>-\infty,\\-1/\varepsilon&\text{if }f^*(x)=-\infty.\end{cases}f(x,φε​(x))≤{f∗(x)+ε−1/ε​if f∗(x)>−∞,if f∗(x)=−∞.​

Significance

The results. Propositions 7.31–7.33 are the closure properties that make the dynamic programming recursion stay inside the class of lower semicontinuous functions bounded below: the expectation step preserves the class (7.31), the minimization step preserves it (7.32, 7.33), and the minimization admits a Borel-measurable exact minimizer (7.33). This is why, in semicontinuous models, the optimal cost functions are lower semicontinuous and optimal policies can be taken Borel-measurable and nonrandomized. Proposition 7.34 gives the weaker, ε\varepsilonε-optimal counterpart for upper semicontinuous costs, where the infimum need not be attained.

Formalizing them. All of these results are proved in the book; none is open. As far as is known, none has a machine-checked proof: Mathlib has semicontinuity, the Hausdorff extended metric on closed and on nonempty compact sets, and the weak topology on probability measures, but no theorem combining them into a measurable selection result of this kind. A formal development would supply measurable selectors for semicontinuous minimization in Lean and the Borel-measurability of set-valued maps into the hyperspace of closed sets, both reusable well beyond dynamic programming.

Difficulty

The obvious attempt at the goal is to pick, for each xxx, some minimizer yyy of f(x,⋅)f(x,\cdot)f(x,⋅) over the compact section DxD_xDx​. The minimizer exists by compactness and lower semicontinuity, but the choice is made pointwise and gives no control on measurability: a minimizer chosen by the axiom of choice need not be Borel-measurable. The argmin sets F∗(x)F^*(x)F∗(x) vary with xxx only semicontinuously: they can jump from a single point to a large set, so a continuous selection generally does not exist, and continuity arguments cannot replace measurability. Lemma 7.18 isolates the hardest part: a choice of a point of each nonempty closed set that is measurable as a function of the set itself.

A second difficulty is bookkeeping at infinity. Values ±∞\pm\infty±∞ are allowed throughout, so sublevel sets, minima, integrals and ε\varepsilonε-bounds must all be handled in R∗R^*R∗; the integral in Proposition 7.31 uses the convention ∞−∞=+∞\infty-\infty=+\infty∞−∞=+∞, which is not Mathlib's.

Formalization scope

  • Extended reals. Values are in EReal. The only place where values of opposite infinite sign are combined is the integral, which is the published definition DupacovaWets.Consistency.expect (reused, not restated): ∫f+−∫f−\int f^+-\int f^-∫f+−∫f− with an explicit case returning +∞+\infty+∞ when ∫f+=∞\int f^+=\infty∫f+=∞, exactly the book's convention (42). The ε\varepsilonε-bound of Proposition 7.34 adds a real ε\varepsilonε to a value different from −∞-\infty−∞, which is safe in EReal.
  • Semicontinuity is Mathlib's LowerSemicontinuous/UpperSemicontinuous, equivalent to Definition 7.13 for EReal-valued functions. Lemma 7.13 of the book (the sequential characterization) is Mathlib's lowerSemicontinuous_iff_le_liminf together with first countability of metrizable spaces, and is not restated here.
  • Functions on DDD. Functions "on DDD" are functions on X×YX\times YX×Y with LowerSemicontinuousOn f D (resp. UpperSemicontinuousOn); values off DDD play no role. projX(D)\mathrm{proj}_X(D)projX​(D) is Prod.fst '' D, selectors are functions on that subtype, and its σ-algebra is the Borel σ-algebra of the subspace topology.
  • Hyperspace. 2Y2^Y2Y is Closeds Y, and 2Y−{∅}2^Y-\{\emptyset\}2Y−{∅} for compact YYY is NonemptyCompacts Y, each with the Hausdorff extended metric and the Borel σ-algebra of its topology. This topology agrees with the book's (the exponential topology of Appendix C, independent of the metric).
  • Boundedness. "Bounded below/above" is by a real constant. BddBelow in EReal would be vacuous and is not used.
  • Edge cases. Proposition 7.32(a)'s attainment clause is stated for nonempty YYY, since for Y=∅Y=\emptysetY=∅ the infimum is +∞+\infty+∞ and nothing attains it.
  • Argmin minimum. Lemma 7.20 assumes nonempty YYY because its defining formula uses a minimum; for empty YYY there is no minimizer.
  • Ruling out trivial readings. The graph condition (x,φ(x))∈D(x,\varphi(x))\in D(x,φ(x))∈D is part of every selection statement; without it the goal would follow from the unconstrained case. The selector must be Borel-measurable on projX(D)\mathrm{proj}_X(D)projX​(D) and must attain the minimum exactly, not up to ε\varepsilonε.

A complete development needs the Borel structure of the hyperspace (measurability of maps into Closeds Y from upper semicontinuity in the sense of Kuratowski, Proposition C.4 of the book), the construction of a measurable choice function on NonemptyCompacts Y, and approximation of semicontinuous functions by monotone sequences in C(X)C(X)C(X). Each of these is reusable on its own; proofs of individual milestones by any route are welcome.

Selected references

  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978; Athena Scientific reprint, 1996, Section 7.5 and Appendix C. https://web.mit.edu/dimitrib/www/soc.html
  • L. E. Dubins and L. J. Savage, How to Gamble If You Must: Inequalities for Stochastic Processes, McGraw-Hill, 1965.
  • K. Kuratowski and C. Ryll-Nardzewski, "A general theorem on selectors," Bull. Acad. Polon. Sci. 13 (1965), 397–403.
  • F. Hausdorff, Set Theory, Chelsea, New York, 1957.
10 thms3 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

Theory of Reproducing Kernels II: One Reproducing Kernel Class Contains Another iff a Multiple of Its Kernel Dominates the Other KernelResearch Paper

Motivation

A reproducing kernel Hilbert space (RKHS) is a Hilbert space of functions in which evaluation at each point is a continuous functional. Each such space is determined by its kernel, and in practice spaces are usually given by their kernels: Gaussian or Sobolev kernels in kernel methods and Gaussian-process regression, the Bergman and Szegő kernels in complex analysis. A recurring question is therefore how a relation between two function spaces reads on their kernels. When is one space contained in another? When do two kernels define the same space?

N. Aronszajn's Theory of Reproducing Kernels (Trans. Amer. Math. Soc. 68 (1950), 337–404) answers both questions. §7 (pp. 354–356) compares a class with a contractively included subclass. §13 (C) (pp. 382–383) uses Banach's closed graph theorem to remove the contractivity assumption. The answer is an order relation between kernels, checkable on finite point sets. It is the standard tool for comparing RKHSs: Part II of the paper (§2, p. 387) applies §7, Theorem II to compare Bergman kernels of nested plane domains.

Setting

Let XXX be an arbitrary set (no topology, no measure). A function K:X×X→CK : X\times X\to\mathbb CK:X×X→C is a positive matrix if

∑i,j=1nK(yi,yj) ξˉi ξj ≥0\sum_{i,j=1}^n K(y_i,y_j)\,\bar\xi_i\,\xi_j\ \ge 0i,j=1∑n​K(yi​,yj​)ξˉ​i​ξj​ ≥0

for every finite family y1,…,yn∈Xy_1,\dots,y_n\in Xy1​,…,yn​∈X and every ξ1,…,ξn∈C\xi_1,\dots,\xi_n\in\mathbb Cξ1​,…,ξn​∈C. For two kernels, K1≪KK_1\ll KK1​≪K means that K−K1K-K_1K−K1​ is a positive matrix.

A class with a reproducing kernel is a complex Hilbert space FFF of functions X→CX\to\mathbb CX→C for which there is a function KKK with K(⋅,y)∈FK(\cdot,y)\in FK(⋅,y)∈F and f(y)=(f,K(⋅,y))f(y) = (f,K(\cdot,y))f(y)=(f,K(⋅,y)) for all f∈Ff\in Ff∈F and y∈Xy\in Xy∈X. The scalar product (f,g)(f,g)(f,g) is linear in fff. Every such KKK is a positive matrix, and by Moore's theorem (§2 (4)) every positive matrix is the kernel of exactly one such class. A linear class of functions is an (R.K.)-class if some norm makes it a Hilbert space with a reproducing kernel. Such a class carries many admissible norms, and correspondingly many kernels.

In the Lean development, FFF is a Mathlib RKHS ℂ H X ℂ instance on a complete complex inner product space H. The class of functions is Set.range (⇑ : H → X → ℂ). The scalar kernel is kernelFn H x y = RKHS.kernel H x y 1, and K1≪KK_1\ll KK1​≪K is AronszajnRK.Limits.KernelLE K₁ K (the series' shared definition).

Formalization targets

Goal: Corollary IV₂ of §13

For classes F,F1F, F_1F,F1​ with reproducing kernels K,K1K, K_1K,K1​:

F1⊂F  ⟺  ∃ M>0: K1≪MK.F_1\subset F \iff \exists\, M>0:\ K_1\ll MK .F1​⊂F⟺∃M>0: K1​≪MK.

The constant MMM is left unspecified: it measures the norm of the inclusion operator and has no canonical value.

Milestones, in attack order

  1. ≪ is a partial ordering of the positive matrices (§7, p. 354).
  2. §7, Theorem I: if K1≪KK_1\ll KK1​≪K, then F1⊂FF_1\subset FF1​⊂F and ∥f1∥1≥∥f1∥\|f_1\|_1\ge\|f_1\|∥f1​∥1​≥∥f1​∥.
  3. §7, Theorem II: if a linear class F1⊂FF_1\subset FF1​⊂F is a Hilbert space with ∥f1∥1≥∥f1∥\|f_1\|_1\ge\|f_1\|∥f1​∥1​≥∥f1​∥, then F1F_1F1​ has a reproducing kernel K1≪KK_1\ll KK1​≪K.
  4. §13 (C), p. 382: the norm c∥⋅∥c\|\cdot\|c∥⋅∥ corresponds to the same class, with kernel c−2Kc^{-2}Kc−2K.
  5. §13 (C), Lemma: the identity correspondence from F1⋅F2⊂F1F_1\cdot F_2\subset F_1F1​⋅F2​⊂F1​ to F2F_2F2​ is a closed linear transformation.
  6. §13 (C), Theorem IV: if F1⊂FF_1\subset FF1​⊂F are (R.K.)-classes, then ∥f∥≤M∥f∥1\|f\|\le M\|f\|_1∥f∥≤M∥f∥1​ on F1F_1F1​ for some M>0M>0M>0, whatever admissible norms are chosen.
  7. §13 (C), Corollary IV₁: any two admissible norms on one (R.K.)-class are equivalent.
  8. §13 (C), Corollary IV₃: F1=FF_1 = FF1​=F iff mK≪K1≪MKmK\ll K_1\ll MKmK≪K1​≪MK for some m,M>0m,M>0m,M>0.
  9. §13 (D), Theorem VI: intersections and sums of (R.K.)-classes are (R.K.)-classes.

Significance

The result. Corollary IV₂ reduces inclusion of infinite-dimensional function spaces to positivity of finite matrices. Corollary IV₃ says when two kernels give the same space, as sets of functions with equivalent norms. Kernel-method theory uses these facts to compare hypothesis spaces of different kernels. In complex analysis they compare Bergman spaces of nested domains, since the restricted kernel of a larger domain is dominated by the kernel of a smaller one (Part II, §2, p. 387, of the paper). Theorem VI makes (R.K.)-classes a lattice under intersection and sum.

Formalizing it. All statements are classical and have been proved since 1950. To our knowledge none is machine-checked. Mathlib has RKHSs, their kernels, positive semidefiniteness of kernels and the construction of a space from a kernel. It has no comparison theorem between two RKHSs, and no characterization of an RKHS by its kernel up to inclusion or equality of function sets. This mission adds these. As a by-product it produces the closed-graph argument for RKHS inclusions in a form that other missions can reuse.

Difficulty

The sufficiency direction (K1≪MK⇒F1⊂FK_1\ll MK \Rightarrow F_1\subset FK1​≪MK⇒F1​⊂F) does not follow from the definitions alone. Domination is a statement about finite quadratic forms; membership of a function of F1F_1F1​ in FFF is a statement about an infinite-dimensional space, and nothing pointwise connects the two. The paper's argument rests on the sum theorem of §6, the goal of a separate mission in this series.

The necessity direction cannot start from an assumed norm inequality, because the two norms are a priori unrelated. Producing the constant MMM needs the closed graph theorem together with the fact that norm convergence in an RKHS implies pointwise convergence. A direct estimate of ∑K1(yi,yj)ξˉiξj\sum K_1(y_i,y_j)\bar\xi_i\xi_j∑K1​(yi​,yj​)ξˉ​i​ξj​ against ∑K(yi,yj)ξˉiξj\sum K(y_i,y_j)\bar\xi_i\xi_j∑K(yi​,yj​)ξˉ​i​ξj​ from the inclusion alone has no route to a uniform constant.

Formalization scope

  • Scalars and spaces. All scalars are complex and XXX is an arbitrary type. A class with a reproducing kernel is an RKHS ℂ H X ℂ instance on a complete complex inner product space H. The function of f : H is ⇑f.
  • Scalar product. Mathlib's ⟪f, g⟫_ℂ is conjugate-linear in f, so Aronszajn's (f,g)(f,g)(f,g) is ⟪g, f⟫_ℂ, and the reproducing property is ⟪k y, f⟫_ℂ = f y.
  • Inclusion and norm comparison. "F1⊂FF_1\subset FF1​⊂F" is inclusion of the sets of functions. A norm comparison ∥f∥≤M∥f∥1\|f\|\le M\|f\|_1∥f∥≤M∥f∥1​ is stated between the elements of the two spaces that are the same function.
  • Positivity. Positive matrices are Matrix.PosSemidef over the index type X. Its quadratic form over finitely supported vectors is exactly the paper's. Over C\mathbb CC it includes Hermitian symmetry, which nonnegativity implies. MKMKMK is fun x y => (M : ℂ) * K x y with real M>0M>0M>0.
  • The goal and Corollary IV₃. "FFF, F1F_1F1​ the corresponding classes" of positive matrices KKK, K1K_1K1​ is read as: arbitrary RKHSs whose kernels are KKK, K1K_1K1​. By Moore's uniqueness theorem this is the same statement.
  • Theorem II. F1F_1F1​ is not assumed to carry an RKHS instance, since having a kernel is the conclusion. It is a complex Hilbert space with an injective linear map into the functions of FFF.
  • Theorem IV and Corollary IV₁ quantify over all admissible norms, i.e. all RKHSs with the given function sets.
  • Closedness of a transformation is the paper's sequential definition (§13 (C), p. 382), stated on a submodule that need not be closed.
  • (R.K.)-class means: equals the set of functions of some RKHS in the universe of XXX.
  • Rescaling milestone. It asserts that a rescaled RKHS exists, and that every RKHS with the same functions and the rescaled norm has the rescaled kernel.

Trivializations ruled out. No statement defines a class as RKHS.OfKernel K and then asserts that its kernel is K. Classes are always compared through their sets of functions and norms. "F1⊂FF_1\subset FF1​⊂F" is never weakened to the existence of some injection H1→HH_1\to HH1​→H.

Substrate. Mathlib's RKHS, RKHS.kernel, RKHS.kerFun, RKHS.kerFun_inner, RKHS.posSemidef_kernel, RKHS.OfKernel, Matrix.PosSemidef (with .add, .smul), Banach's LinearMap.continuous_of_isClosed_graph, and the continuous functional calculus (CFC.sqrt, for the square root (I−L)1/2(I-L)^{1/2}(I−L)1/2 in the proof of Theorem II). The sum theorem of §6, used in the proof of Theorem I, is the goal of mission I of this series. Contributions of that theorem and of reusable lemmas on RKHS inclusions are welcome.

Selected references

  • N. Aronszajn, Theory of Reproducing Kernels, Trans. Amer. Math. Soc. 68 (1950), 337–404. https://doi.org/10.1090/S0002-9947-1950-0051437-7
  • S. Banach, Théorie des opérations linéaires, Monografje Matematyczne 1, Warsaw, 1932 (closed graph theorem, as cited on p. 382).
  • V. I. Paulsen and M. Raghupathi, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, Cambridge Stud. Adv. Math. 152, Cambridge University Press, 2016 (modern treatment of the inclusion criterion). https://doi.org/10.1017/CBO9781316219232
14 thms3 active usersReviewed
🏆Completed
Calculus of VariationsFunctional AnalysisOptimization·Captain: mikedeng1

On the Variational Principle I: Near Every ε-Minimizer of a Lower Semicontinuous Function Bounded Below on a Complete Metric Space Lies a Strict Minimizer of F + (ε/λ)d(v, ·)Research Paper

Motivation

A function that is bounded below need not attain its infimum: exe^xex on R\mathbb{R}R has infimum 000 and no minimizer. The classical "variational principle" says that at a minimizer uˉ\bar uuˉ of a differentiable functional, F′(uˉ)=0F'(\bar u)=0F′(uˉ)=0. Without compactness there may be no minimizer, and the principle has nothing to say. In 1974 Ivar Ekeland showed that a weaker statement survives in every complete metric space: next to any approximate minimizer lies a point that is the exact, strict minimizer of a slightly perturbed function (Ekeland 1974).

The result is now a standard tool in nonlinear analysis, optimization and the calculus of variations. It yields approximate first-order conditions (∥F′(v)∥∗≤ε\|F'(v)\|_*\le\varepsilon∥F′(v)∥∗​≤ε) without existence of minimizers, approximate Lagrange multiplier rules, and approximate maximum principles in optimal control; Ekeland's survey (Ekeland 1979) collects many of these uses.

Timeline. Bishop and Phelps introduced the partial order on a Banach space times R\mathbb{R}R that underlies the proof, in their study of support functionals of convex sets (Bishop–Phelps, The support functional of a convex set, Proc. Symp. Pure Math. 7, AMS, 1963). Brøndsted and Rockafellar used it in 1965 to obtain subdifferentiability properties of convex functions on Banach spaces (Brøndsted–Rockafellar 1965), and Browder applied it to nonconvex subsets of Banach spaces (Bull. AMS 79, 1973). Ekeland's 1974 article, formalized here, isolates the device as a principle valid in every complete metric space for lower semicontinuous functions with values in R∪{+∞}\mathbb{R}\cup\{+\infty\}R∪{+∞}, and applies it to Gâteaux-differentiable functions, constrained optimization, Plateau's problem, geodesics and optimal control.

Setting

Let (V,d)(V,d)(V,d) be a complete metric space. Let F:V→R∪{+∞}F:V\to\mathbb{R}\cup\{+\infty\}F:V→R∪{+∞} be lower semicontinuous (for every ccc the set {F≤c}\{F\le c\}{F≤c} is closed), not identically +∞+\infty+∞, and bounded from below:

inf⁡F>−∞.(1.1)\inf F > -\infty. \tag{1.1}infF>−∞.(1.1)

For ε>0\varepsilon>0ε>0, a point u∈Vu\in Vu∈V is an ε\varepsilonε-minimizer if

inf⁡F≤F(u)≤inf⁡F+ε.(1.2)\inf F \le F(u) \le \inf F + \varepsilon. \tag{1.2}infF≤F(u)≤infF+ε.(1.2)

For α>0\alpha>0α>0, the Bishop–Phelps order on V×RV\times\mathbb{R}V×R is

(v1,a1)≺(v2,a2)  ⟺  (a2−a1)+α d(v1,v2)≤0.(1.6)(v_1,a_1)\prec(v_2,a_2)\iff (a_2-a_1)+\alpha\,d(v_1,v_2)\le 0. \tag{1.6}(v1​,a1​)≺(v2​,a2​)⟺(a2​−a1​)+αd(v1​,v2​)≤0.(1.6)

In Lean it is EkelandVP.General.bpLE α p q, read p≺qp\prec qp≺q. The epigraph of FFF is S={(v,a)∣a≥F(v)}⊆V×RS=\{(v,a)\mid a\ge F(v)\}\subseteq V\times\mathbb{R}S={(v,a)∣a≥F(v)}⊆V×R (1.15).

In §2, VVV is a real Banach space with dual V∗V^*V∗, and FFF is Gâteaux-differentiable with derivative F′:V→V∗F':V\to V^*F′:V→V∗ (EkelandVP.General.IsGateauxDiff F F'): at every u0u_0u0​ with F(u0)<+∞F(u_0)<+\inftyF(u0​)<+∞, ddtF(u0+tv)∣t=0=⟨F′(u0),v⟩\frac{d}{dt}F(u_0+tv)|_{t=0}=\langle F'(u_0),v\rangledtd​F(u0​+tv)∣t=0​=⟨F′(u0​),v⟩ for every vvv (2.1).

Formalization targets

Goal: Theorem 1.1 (p. 324)

For every uuu satisfying (1.2) and every λ>0\lambda>0λ>0 there is v∈Vv\in Vv∈V with

F(v)≤F(u),d(u,v)≤λ,∀w≠v: F(w)>F(v)−ελ d(v,w).(1.3–1.5)F(v)\le F(u),\qquad d(u,v)\le\lambda,\qquad \forall w\ne v:\ F(w)>F(v)-\frac{\varepsilon}{\lambda}\,d(v,w). \tag{1.3–1.5}F(v)≤F(u),d(u,v)≤λ,∀w=v: F(w)>F(v)−λε​d(v,w).(1.3–1.5)

The parameters ε\varepsilonε and λ\lambdaλ are free; the trade-off between closeness to uuu and the size of the perturbation is the content of the theorem.

Milestones (§1)

  1. For α>0\alpha>0α>0, ≺\prec≺ is reflexive, antisymmetric and transitive (p. 325).
  2. For every (v1,a1)(v_1,a_1)(v1​,a1​), the set {(v,a)∣(v1,a1)≺(v,a)}\{(v,a)\mid (v_1,a_1)\prec(v,a)\}{(v,a)∣(v1​,a1​)≺(v,a)} is closed in V×RV\times\mathbb{R}V×R (p. 325).
  3. Lemma 1.2 (p. 325): if S⊆V×RS\subseteq V\times\mathbb{R}S⊆V×R is closed and a≥ma\ge ma≥m on SSS for some mmm (1.7), then every (v1,a1)∈S(v_1,a_1)\in S(v1​,a1​)∈S lies below a ≺\prec≺-maximal element of SSS.

Consequences (§2)

  • Corollary 2.3 (p. 328): for VVV Banach, FFF l.s.c. and Gâteaux-differentiable with −∞<inf⁡F<+∞-\infty<\inf F<+\infty−∞<infF<+∞, and every ε>0\varepsilon>0ε>0, there is vεv_\varepsilonvε​ with F(vε)−inf⁡F≤ε2F(v_\varepsilon)-\inf F\le\varepsilon^2F(vε​)−infF≤ε2 and ∥F′(vε)∥∗≤ε\|F'(v_\varepsilon)\|_*\le\varepsilon∥F′(vε​)∥∗​≤ε.
  • Corollary 2.4 (p. 328): if moreover F(v)≥k∥v∥+cF(v)\ge k\|v\|+cF(v)≥k∥v∥+c with k>0k>0k>0, then F′(V)F'(V)F′(V) is dense in kB∗kB^*kB∗.
  • Corollary 2.5 (p. 329): if F(v)≥Φ(∥v∥)F(v)\ge\Phi(\|v\|)F(v)≥Φ(∥v∥) with Φ\PhiΦ continuous and Φ(t)/t→∞\Phi(t)/t\to\inftyΦ(t)/t→∞, then F′(V)F'(V)F′(V) is dense in V∗V^*V∗.

Significance

The result. Theorem 1.1 replaces "a minimizer exists" by "a strict minimizer of a Lipschitz perturbation exists nearby", with explicit control of both the distance and the perturbation. With λ=ε\lambda=\sqrt{\varepsilon}λ=ε​ this gives a point that is ε\varepsilonε-optimal, ε\sqrt{\varepsilon}ε​-close to uuu, and ε\sqrt{\varepsilon}ε​-stationary in the metric sense. Corollary 2.3 is the form announced in the paper's abstract: a differentiable function with a finite lower bound has points where FFF is almost minimal and ∥F′∥∗\|F'\|_*∥F′∥∗​ is arbitrarily small. Later sections of the same paper use Theorem 1.1 for approximate Lagrange multiplier rules (§3) and an approximate Pontryagin maximum principle (§7), which are the subjects of missions II and III of this series.

Formalizing it. The theorem is proved; this mission formalizes the paper's own route (the order (1.6), Lemma 1.2, then Theorem 1.1) and its first applications in §2. The pinned Mathlib has no statement of Ekeland's principle, of the Caristi fixed point theorem, or of the Bishop–Phelps order, and the platform has none either. A machine-checked Theorem 1.1 for extended-real-valued functions would be directly reusable by every later mission that needs approximate optimality without compactness.

Difficulty

The obvious argument — take a minimizing sequence and pass to a limit — fails because nothing makes a minimizing sequence converge: VVV is not compact, and a minimizing sequence of exe^xex escapes to −∞-\infty−∞. Completeness only helps for Cauchy sequences, so one must construct a sequence that is Cauchy. The limit must moreover be maximal for the order (1.6), not merely a limit point, and that maximality is what produces the strict inequality (1.5). Lemma 1.2 is where this difficulty sits. In §2, the passage from the metric statement (1.5) to a bound on ∥F′(v)∥∗\|F'(v)\|_*∥F′(v)∥∗​ requires FFF to be finite near vvv along every line, which the Gâteaux hypothesis supplies.

Formalization scope

  • VVV is a MetricSpace with CompleteSpace; d(u,v)d(u,v)d(u,v) is dist u v. V×RV\times\mathbb{R}V×R carries the product topology; only closedness of subsets of it is used.
  • F:V→F:V\toF:V→ EReal. "Bounded from below" (1.1) is ⊥<inf⁡vF(v)\bot<\inf_v F(v)⊥<infv​F(v); it also excludes the value −∞-\infty−∞, which the paper's codomain does not contain. "Not identically +∞+\infty+∞" is ∃v0, F(v0)≠⊤\exists v_0,\ F(v_0)\ne\top∃v0​, F(v0​)=⊤. Lower semicontinuity is Mathlib's LowerSemicontinuous.
  • (1.2) is assumed in the form F(u)≤inf⁡F+εF(u)\le\inf F+\varepsilonF(u)≤infF+ε with ε>0\varepsilon>0ε>0 real (the left half is automatic). λ\lambdaλ is named lam.
  • (1.5) is F(v)−ελd(v,w)<F(w)F(v)-\frac{\varepsilon}{\lambda}d(v,w)<F(w)F(v)−λε​d(v,w)<F(w) for all w≠vw\ne vw=v, strict, with the paper's argument order d(v,w)d(v,w)d(v,w). Since F(v)F(v)F(v) is finite under the hypotheses, the EReal subtraction is ordinary.
  • A trivializing formalization is ruled out: FFF is not real-valued (the value +∞+\infty+∞ is what lets §3 apply the theorem to FFF plus the indicator of a closed set), (1.5) is strict and quantified over all w≠vw\ne vw=v, and the conclusion is not weakened to d(u,v)<∞d(u,v)<\inftyd(u,v)<∞ or ≤\le≤ in (1.5).
  • In §2, VVV is a real NormedSpace with CompleteSpace, F′F'F′ is a function V→(V→LR)V\to(V\to_L\mathbb{R})V→(V→L​R), and Gâteaux differentiability requires t↦F(u0+tv)t\mapsto F(u_0+tv)t↦F(u0​+tv) to be finite near t=0t=0t=0 before taking a real derivative; without this, EReal.toReal (±∞)=0(\pm\infty)=0(±∞)=0 would let an infinite function have a junk derivative. Density of F′(V)F'(V)F′(V) is stated for derivatives taken at points where F<+∞F<+\inftyF<+∞.
  • Theorem 2.2 is not part of this mission: its conclusion (2.4) is printed as the strict ∥v−u∥<λ\|v-u\|<\lambda∥v−u∥<λ, while its one-line proof from Theorem 1.1 gives only ≤λ\le\lambda≤λ. Corollaries 2.3–2.5 do not depend on the strict form.

Contributions welcome: proofs of the milestones (the first two are short; Lemma 1.2 is the core), of Theorem 1.1, and of the §2 corollaries; a reusable Caristi fixed point theorem built on the same order would be a natural addition.

Selected references

  • I. Ekeland, On the Variational Principle, J. Math. Anal. Appl. 47 (1974), 324–353. https://doi.org/10.1016/0022-247X(74)90025-0
  • I. Ekeland, Nonconvex minimization problems, Bull. Amer. Math. Soc. (N.S.) 1 (1979), 443–474. https://doi.org/10.1090/S0273-0979-1979-14595-6
  • E. Bishop, R. R. Phelps, The support functional of a convex set, in Convexity (V. Klee, ed.), Proc. Symp. Pure Math. 7, Amer. Math. Soc., 1963, 27–35. (Reference [4] of Ekeland 1974.)
  • A. Brøndsted, R. T. Rockafellar, On the subdifferentiability of convex functions, Proc. Amer. Math. Soc. 16 (1965), 605–611. https://doi.org/10.1090/S0002-9939-1965-0178103-8
  • F. E. Browder, Normal solvability for nonlinear mappings into Banach spaces, Bull. Amer. Math. Soc. 79 (1973), 328–350. https://doi.org/10.1090/S0002-9904-1973-13152-9
6 thms3 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

Theory of Reproducing Kernels III: The Product of Two Reproducing Kernels Is the Kernel of the Diagonal Restrictions of the Direct ProductResearch Paper

Motivation

A reproducing kernel is the function K(x,y)K(x,y)K(x,y) that represents point evaluation in a Hilbert space of functions: f(y)=(f,K(⋅,y))f(y) = (f, K(\cdot, y))f(y)=(f,K(⋅,y)). Kernels are combined all the time. In machine learning, a kernel on pairs of objects is routinely built as the pointwise product of two simpler kernels, and in complex analysis the product ∣K(x,y)∣2=K(x,y)K(y,x)|K(x,y)|^2 = K(x,y)K(y,x)∣K(x,y)∣2=K(x,y)K(y,x) of a kernel with its conjugate appears naturally. That the pointwise product of two positive matrices is again a positive matrix goes back to I. Schur (1911). What Schur's theorem does not say is which space of functions the product kernel belongs to and what its norm is.

N. Aronszajn answered this in §8 of Theory of Reproducing Kernels (Trans. Amer. Math. Soc. 68 (1950), 337–404, doi:10.1090/S0002-9947-1950-0051437-7), the paper that fixed the general theory of reproducing kernel Hilbert spaces. He notes (p. 358, footnote 7) that the idea of the proof was found independently by R. Godement, who applied it only to positive definite functions. The answer has three ingredients developed in the same paper: the functional completion of an incomplete class of functions (§4), the restriction of a kernel to a subset (§5), and the direct product F1⊗F2F_1 \otimes F_2F1​⊗F2​ of two classes of functions (§8).

Setting

Let EEE be an arbitrary set. A class with a reproducing kernel is a complex Hilbert space FFF of functions f:E→Cf : E \to \mathbb{C}f:E→C such that every point evaluation f↦f(y)f \mapsto f(y)f↦f(y) is continuous. Its reproducing kernel K:E×E→CK : E \times E \to \mathbb{C}K:E×E→C is characterized by: K(⋅,y)∈FK(\cdot, y) \in FK(⋅,y)∈F for each yyy, and f(y)=(f,K(⋅,y))f(y) = (f, K(\cdot, y))f(y)=(f,K(⋅,y)) for all f∈Ff \in Ff∈F, where the scalar product (f,g)(f, g)(f,g) is linear in fff and conjugate-linear in ggg.

Functional completion. Suppose FFF is a linear class of functions on EEE with a scalar product satisfying every Hilbert-space axiom except completeness. A functional completion of FFF is a Hilbert space of functions on EEE, with continuous point evaluations, that contains FFF isometrically as a dense subset.

Restriction. For E1⊆EE_1 \subseteq EE1​⊆E, the restriction of fff is f∣E1f|_{E_1}f∣E1​​, and F∣E1F|_{E_1}F∣E1​​ is the class of all restrictions.

Direct product. Given classes F1F_1F1​, F2F_2F2​ on EEE with kernels K1K_1K1​, K2K_2K2​ and norms ∥⋅∥1\|\cdot\|_1∥⋅∥1​, ∥⋅∥2\|\cdot\|_2∥⋅∥2​, consider on E′=E×EE' = E \times EE′=E×E the functions

f′(x1,x2)=∑k=1nf1(k)(x1)f2(k)(x2),f1(k)∈F1, f2(k)∈F2,f'(x_1,x_2) = \sum_{k=1}^n f_1^{(k)}(x_1) f_2^{(k)}(x_2), \qquad f_1^{(k)} \in F_1,\ f_2^{(k)} \in F_2,f′(x1​,x2​)=k=1∑n​f1(k)​(x1​)f2(k)​(x2​),f1(k)​∈F1​, f2(k)​∈F2​,

with scalar product (f′,g′)′=∑k,l(f1(k),g1(l))1(f2(k),g2(l))2(f', g')' = \sum_{k,l} (f_1^{(k)}, g_1^{(l)})_1 (f_2^{(k)}, g_2^{(l)})_2(f′,g′)′=∑k,l​(f1(k)​,g1(l)​)1​(f2(k)​,g2(l)​)2​. Their functional completion is the direct product F′=F1⊗F2F' = F_1 \otimes F_2F′=F1​⊗F2​, with norm ∥⋅∥′\|\cdot\|'∥⋅∥′.

In Lean, kernelFn H x y is the scalar kernel K(x,y)K(x,y)K(x,y) of a space H, IsFunctionalCompletion ι H says H is a functional completion of the class presented by ι, and IsDirectProduct H₁ H₂ H' says H' is F1⊗F2F_1 \otimes F_2F1​⊗F2​.

Formalization targets

Goal: §8, Theorem II

The kernel K(x,y)=K1(x,y)K2(x,y)K(x,y) = K_1(x,y) K_2(x,y)K(x,y)=K1​(x,y)K2​(x,y) is the reproducing kernel of the class FFF of restrictions of the functions of F1⊗F2F_1 \otimes F_2F1​⊗F2​ to the diagonal {(x,x)}\{(x,x)\}{(x,x)}, and

∥f∥=min⁡{∥g′∥′:g′∈F1⊗F2, g′(x,x)=f(x) ∀x∈E}.\|f\| = \min\{\|g'\|' : g' \in F_1 \otimes F_2,\ g'(x,x) = f(x)\ \forall x \in E\}.∥f∥=min{∥g′∥′:g′∈F1​⊗F2​, g′(x,x)=f(x) ∀x∈E}.

Milestones

  1. §4, Theorem. A functional completion of FFF exists if and only if every evaluation f↦f(y)f \mapsto f(y)f↦f(y) is bounded on FFF and every Cauchy sequence (fm)⊂F(f_m) \subset F(fm​)⊂F with fm(y)→0f_m(y) \to 0fm​(y)→0 for every yyy satisfies ∥fm∥→0\|f_m\| \to 0∥fm​∥→0; the functional completion, when it exists, is unique.
  2. §8, Theorem I. F1⊗F2F_1 \otimes F_2F1​⊗F2​ has reproducing kernel
K′(x1,x2,y1,y2)=K1(x1,y1) K2(x2,y2).K'(x_1,x_2,y_1,y_2) = K_1(x_1,y_1)\,K_2(x_2,y_2).K′(x1​,x2​,y1​,y2​)=K1​(x1​,y1​)K2​(x2​,y2​).
  1. §5, Theorem. K∣E1×E1K|_{E_1 \times E_1}K∣E1​×E1​​ is the reproducing kernel of F∣E1F|_{E_1}F∣E1​​, with ∥f1∥1=min⁡{∥f∥:f∣E1=f1}\|f_1\|_1 = \min\{\|f\| : f|_{E_1} = f_1\}∥f1​∥1​=min{∥f∥:f∣E1​​=f1​}.
  2. §8, Remark. For a complete orthonormal system {g1(k)}\{g_1^{(k)}\}{g1(k)​} of F1F_1F1​, every fff in the class of K1K2K_1K_2K1​K2​ is f=∑kf2(k)g1(k)f = \sum_k f_2^{(k)} g_1^{(k)}f=∑k​f2(k)​g1(k)​ with f2(k)∈F2f_2^{(k)} \in F_2f2(k)​∈F2​, ∑k∥f2(k)∥22<∞\sum_k \|f_2^{(k)}\|_2^2 < \infty∑k​∥f2(k)​∥22​<∞; exactly one such representation minimizes ∑k∥f2(k)∥22\sum_k \|f_2^{(k)}\|_2^2∑k​∥f2(k)​∥22​, and the minimum is ∥f∥2\|f\|^2∥f∥2.

Significance

The result. Theorem II turns the Schur product theorem from a statement about matrices into a statement about function spaces: it says which functions the product kernel can represent and how their norms are computed, through a minimal decomposition. It is the standard description of the reproducing kernel Hilbert space of a product kernel, used to reason about which functions product kernels can express and with what norm, and the Remark gives a concrete series description of the same space. §5 (restriction) and §4 (functional completion) are general tools in their own right: restriction underlies every comparison of kernels on nested domains, and §4 is the criterion for when an incomplete space of functions can be completed without leaving the world of functions.

Formalizing it. All four results are classical and proved on paper. Mathlib has reproducing kernel Hilbert spaces (RKHS, RKHS.kernel, the construction RKHS.OfKernel from a positive semidefinite kernel) and Schur's product theorem (Matrix.PosSemidef.hadamard, for an arbitrary index type), but no restriction theorem, no functional completion and no tensor product of reproducing kernel Hilbert spaces. None of these statements has a machine-checked proof that the mission is aware of.

Difficulty

The kernel identity is the easy part: by Schur's theorem K1K2K_1K_2K1​K2​ is positive, so some space with kernel K1K2K_1K_2K1​K2​ exists. The content is the identification of that space and its norm. The direct product has to be constructed before anything can be said about it: the class of finite sums of products is not complete, the scalar product (2) must be shown independent of the representation and positive definite, and the completion must stay a class of functions, which is exactly the question §4 answers and which can fail (p. 349 gives a class satisfying the first condition but not the second). The norm formula is an attained minimum over an infinite-dimensional affine set of preimages, not merely an infimum.

Formalization scope

Scalars are complex throughout ("From now on … we shall consider only complex Hilbert spaces", p. 343). The underlying set EEE is an arbitrary type X, with no topology, measure or nonemptiness assumption. A class with a reproducing kernel is a complex Hilbert space H with Mathlib's RKHS ℂ H X ℂ structure; its functions are the coercions ⇑f. The scalar kernel is kernelFn H x y = RKHS.kernel H x y 1. Mathlib's inner product ⟨u,v⟩\langle u, v\rangle⟨u,v⟩ is conjugate-linear in uuu, so Aronszajn's (f,g)(f,g)(f,g) is ⟨g,f⟩\langle g, f\rangle⟨g,f⟩.

Conventions and reading decisions:

  • Statements of the form "KKK is the reproducing kernel of the class C\mathcal{C}C with norm NNN" assert that a space with kernel KKK exists and that every space with kernel KKK has exactly the functions C\mathcal{C}C and the norm NNN. They never define the space as RKHS.OfKernel K, which would make the kernel identity true by construction.
  • The direct product is characterized by its elementary products f1(x1)f2(x2)f_1(x_1)f_2(x_2)f1​(x1​)f2​(x2​), the scalar product (2) on them, and density of their span (IsDirectProduct); it is never defined through its kernel. With that, Theorem I is not a definitional identity and Theorem II is not a restatement of §5.
  • "min" is an attained minimum (IsLeast). In Theorem II and §5 it is the minimum of the norm, not its square; in the Remark it is the minimum of the sum of squared norms, as printed.
  • The diagonal of E×EE\times EE×E is identified with EEE through x↦(x,x)x \mapsto (x,x)x↦(x,x), and the restriction of g′g'g′ is x↦g′(x,x)x \mapsto g'(x,x)x↦g′(x,x).
  • §4's "incomplete" Hilbert space is a complex inner product space, not assumed complete; completeness is not excluded either.
  • The complete orthonormal system of the Remark is a Mathlib HilbertBasis over an arbitrary index set, and the series converges unconditionally at each point.

Results already in Mathlib are not restated: Schur's product theorem (Matrix.PosSemidef.hadamard, the first sentence of §8 and the sentence after Theorem I), positivity of a kernel (RKHS.posSemidef_kernel) and existence of a space for a positive kernel (RKHS.OfKernel, RKHS.kernel_ofKernel).

A complete development needs a Hilbert tensor product of reproducing kernel Hilbert spaces realized as functions on E×EE\times EE×E, the restriction construction (quotient by the subspace of functions vanishing on E1E_1E1​), and uniqueness of a reproducing kernel Hilbert space with given kernel. The restriction theorem and the functional completion theorem are reusable well beyond this mission; contributions of either, or of a Hilbert tensor product for RKHS, are welcome.

Selected references

  • N. Aronszajn, Theory of Reproducing Kernels, Trans. Amer. Math. Soc. 68 (1950), 337–404. https://doi.org/10.1090/S0002-9947-1950-0051437-7
  • I. Schur, Bemerkungen zur Theorie der beschränkten Bilinearformen mit unendlich vielen Veränderlichen, J. Reine Angew. Math. 140 (1911), 1–28. https://doi.org/10.1515/crll.1911.140.1
  • J. von Neumann and F. J. Murray, On rings of operators, Ann. of Math. 37 (1936), 116–229 (direct products of Hilbert spaces). https://doi.org/10.2307/1968693
  • V. I. Paulsen and M. Raghupathi, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, Cambridge Univ. Press, 2016. https://doi.org/10.1017/CBO9781316219232
8 thms3 active usersReviewed
🏆Completed
Functional AnalysisMachine Learning·Captain: mikedeng1

Theory of Reproducing Kernels I: The Sum of Two Reproducing Kernels Is the Kernel of the Sum Class with the Minimal-Decomposition NormResearch Paper

Motivation

Reproducing kernel Hilbert spaces are Hilbert spaces of functions in which evaluation at a point is a continuous linear functional. They appear wherever a space of functions carries a natural quadratic norm: Bergman and Hardy spaces of analytic functions, spaces of harmonic functions and solutions of elliptic equations, Sobolev spaces in one dimension, and, since the 1990s, the hypothesis classes of kernel methods in machine learning (support vector machines, Gaussian process regression, kernel ridge regression). In all of these settings, kernels are routinely combined: a sum of kernels is used to model a function as a sum of components, and the question is which space of functions, and which norm, the combined kernel describes.

N. Aronszajn's Theory of Reproducing Kernels (Trans. Amer. Math. Soc. 68 (1950), 337–404) organised the subject as a calculus of operations on kernels. Its §6 answers the question for sums.

Timeline. E. H. Moore (Bull. Amer. Math. Soc. 1916; General Analysis, 1935) introduced positive Hermitian matrices on arbitrary sets and their associated function classes. S. Bergman (1920s–1930s) studied the kernel of square-integrable analytic functions of a domain. R. Godement (C. R. Acad. Sci. Paris notes, 1945–1946) found the sum theorem for positive definite functions on a group (footnote 6 of the paper). Aronszajn (1950) proved it for arbitrary kernels on arbitrary sets, with the description of the norm as a minimum over decompositions.

Setting

Let EEE be an arbitrary set. A class of functions FFF on EEE is a complex vector space of functions f:E→Cf:E\to\mathbb Cf:E→C carrying a norm ∥⋅∥\|\cdot\|∥⋅∥ that makes it a complex Hilbert space. A function K:E×E→CK:E\times E\to\mathbb CK:E×E→C is the reproducing kernel (r.k.) of FFF if, for every y∈Ey\in Ey∈E, the function K(⋅,y)K(\cdot,y)K(⋅,y) belongs to FFF and

f(y)=(f,K(⋅,y))for every f∈F,f(y)=(f,K(\cdot,y))\qquad\text{for every } f\in F,f(y)=(f,K(⋅,y))for every f∈F,

where (f,g)(f,g)(f,g) is the scalar product, linear in fff. A kernel exists exactly when every evaluation f↦f(y)f\mapsto f(y)f↦f(y) is continuous.

A function K:E×E→CK:E\times E\to\mathbb CK:E×E→C is a positive matrix if ∑i,j=1nK(yi,yj)ξˉiξj≥0\sum_{i,j=1}^n K(y_i,y_j)\bar\xi_i\xi_j\ge 0∑i,j=1n​K(yi​,yj​)ξˉ​i​ξj​≥0 for all finite families of points yi∈Ey_i\in Eyi​∈E and complex numbers ξi\xi_iξi​. Every reproducing kernel is a positive matrix.

A class F1F_1F1​ is a subclass of F2F_2F2​ if every function of F1F_1F1​ belongs to F2F_2F2​, and a subspace if moreover the two norms agree on F1F_1F1​. Two classes F1F_1F1​, F2F_2F2​ with kernels K1K_1K1​, K2K_2K2​ have a sum class F1+F2={f1+f2:fi∈Fi}F_1+F_2=\{f_1+f_2: f_i\in F_i\}F1​+F2​={f1​+f2​:fi​∈Fi​}, a set of functions; a function of it may have many decompositions f=f1+f2f=f_1+f_2f=f1​+f2​, since F1F_1F1​ and F2F_2F2​ may share functions.

Formalization targets

Goal: the sum theorem (§6, Theorem, p. 353)

For complex Hilbert spaces F1F_1F1​, F2F_2F2​ of functions on EEE with kernels K1K_1K1​, K2K_2K2​: the kernel K=K1+K2K=K_1+K_2K=K1​+K2​ is the reproducing kernel of the class of all f=f1+f2f=f_1+f_2f=f1​+f2​, with

∥f∥2=min⁡[∥f1∥12+∥f2∥22],\|f\|^2=\min\big[\|f_1\|_1^2+\|f_2\|_2^2\big],∥f∥2=min[∥f1​∥12​+∥f2​∥22​],

the minimum taken over all decompositions f=f1+f2f=f_1+f_2f=f1​+f2​, fi∈Fif_i\in F_ifi​∈Fi​. The goal asserts that a space with kernel K1+K2K_1+K_2K1​+K2​ exists, and that every such space consists exactly of the sums and has exactly this norm, the minimum being attained.

Milestones

  1. §2 (4), Moore's theorem (p. 344): a positive matrix is the kernel of one and only one class of functions with a uniquely determined norm. This makes "the class with kernel K1+K2K_1+K_2K1​+K2​" well defined.
  2. §2 (7) (p. 345): every closed subspace F′F'F′ of FFF has a kernel K′K'K′, and for the orthogonal complement F′′F''F′′, K′+K′′=KK'+K''=KK′+K′′=K.
  3. §3, Theorem (p. 347): KKK is the kernel of a finite-dimensional class if and only if K(x,y)=∑i,jβijwi(x)wj(y)‾K(x,y)=\sum_{i,j}\beta_{ij}w_i(x)\overline{w_j(y)}K(x,y)=∑i,j​βij​wi​(x)wj​(y)​ with {βij}\{\beta_{ij}\}{βij​} positive definite and the wkw_kwk​ linearly independent; the class is then spanned by the wkw_kwk​, with norm given by the inverse of {βˉij}\{\bar\beta_{ij}\}{βˉ​ij​}.
  4. §6, p. 354, the disjoint case: when F1∩F2={0}F_1\cap F_2=\{0\}F1​∩F2​={0}, ∥f∥2=∥f1∥12+∥f2∥22\|f\|^2=\|f_1\|_1^2+\|f_2\|_2^2∥f∥2=∥f1​∥12​+∥f2​∥22​, and this happens if and only if F1F_1F1​ and F2F_2F2​ are complementary closed subspaces of FFF.
  5. §6, p. 354, Eq. (1): the class of conjugates Fˉ\bar FFˉ has kernel K(y,x)K(y,x)K(y,x), and Re⁡K=2−1(K(x,y)+K(y,x))\operatorname{Re}K=2^{-1}(K(x,y)+K(y,x))ReK=2−1(K(x,y)+K(y,x)) is the kernel of the class of all f+gˉf+\bar gf+gˉ​, with ∥φ∥02=2min⁡[∥f∥2+∥g∥2]\|\varphi\|_0^2=2\min[\|f\|^2+\|g\|^2]∥φ∥02​=2min[∥f∥2+∥g∥2].

Significance

The result itself. The sum theorem is the first operation of Aronszajn's calculus and the base of the next ones: the order K1≪KK_1\ll KK1​≪K between kernels and the inclusion theorem of §7 are derived from it, as are the kernel Re⁡K\operatorname{Re}KReK of the class of all f+gˉf+\bar gf+gˉ​ and the characterisation of kernels of real spaces (§6, p. 354). In machine learning, it is the statement behind additive kernels and multiple-kernel learning: the hypothesis class of K1+K2K_1+K_2K1​+K2​ is the set of sums, and the regulariser is the infimal convolution of the two squared norms. In complex analysis, it describes the space attached to a sum of Bergman-type kernels.

Formalizing it. The results are classical and proved in the paper; none of them is formalized in Mathlib beyond the existence half of Moore's theorem. Mathlib (2026) has reproducing kernel Hilbert spaces with operator-valued kernels (RKHS, RKHS.kernel, RKHS.kerFun, RKHS.posSemidef_kernel) and the construction of a space from a positive semidefinite matrix (RKHS.OfKernel, RKHS.kernel_ofKernel). This mission adds uniqueness, the sum theorem, kernels of closed subspaces, the finite-dimensional case and the conjugate class.

Difficulty

The kernel K1+K2K_1+K_2K1​+K2​ is the kernel of some space by Moore's existence theorem, so the content is the identification of that space. The obvious candidate, the external direct sum F1⊕F2F_1\oplus F_2F1​⊕F2​ mapped to functions by (f1,f2)↦f1+f2(f_1,f_2)\mapsto f_1+f_2(f1​,f2​)↦f1​+f2​, is not injective as soon as F1F_1F1​ and F2F_2F2​ share a nonzero function; the class of sums is the image of a quotient, and its norm is the norm of a minimal representative, which has to be shown to exist and to make the class complete. Proving that the resulting space has kernel K1+K2K_1+K_2K1​+K2​ and that every other space with this kernel coincides with it requires the uniqueness half of Moore's theorem, which is not in Mathlib. The disjoint case needs, in addition, that an isometric image of a complete space is closed, and the converse direction of its "only in this case".

Formalization scope

  • Scalars and sets. Complex scalars throughout (the paper's convention from §1 on). EEE is an arbitrary type X with no topology, measure, or nonemptiness assumption.
  • Spaces. A class with a kernel is a Mathlib RKHS ℂ H X ℂ on a complex Hilbert space H; its functions are Set.range (⇑ : H → X → ℂ).
  • Kernel. The scalar kernel kernelFn H x y is RKHS.kernel H x y 1.
  • Scalar products. The paper's (f,g)(f,g)(f,g), linear in fff, is Mathlib's ⟪g, f⟫_ℂ.
  • Positivity. A positive matrix is (Matrix.of K).PosSemidef, and "positive definite" is Matrix.PosDef.
  • Decompositions are of functions: f=f1+f2f=f_1+f_2f=f1​+f2​ pointwise with fif_ifi​ in FiF_iFi​.
  • Minima. "min" is an attained minimum (IsLeast), never an infimum.
  • Quantification. Statements about "the" class with a given kernel quantify over every RKHS with that kernel, in any universe, and assert separately that one exists.

Reading decisions, recorded in the item notes:

  • In §2 (7), "complementary subspaces" means a closed subspace and its orthogonal complement, and the kernels of the two subspaces are any kernels with the reproducing property there, not projections of KKK.
  • In §3, {βˉij}\{\bar\beta_{ij}\}{βˉ​ij​} is the entrywise conjugate of {βij}\{\beta_{ij}\}{βij​} (consistent with §3 (5), ∑jαijβˉjk=δik\sum_j\alpha_{ij}\bar\beta_{jk}=\delta_{ik}∑j​αij​βˉ​jk​=δik​), not its conjugate transpose.
  • In §6, p. 354, "subspace" is the paper's §1 notion (norms agree), and the scalar-product remark on Fˉ\bar FFˉ follows from the norm statement by polarization.

Trivialization ruled out. The goal does not define the sum class as RKHS.OfKernel (K₁ + K₂) and assert that its kernel is K1+K2K_1+K_2K1​+K2​, which is Mathlib's kernel_ofKernel. Its content is the description of the functions (exactly the sums) and of the norm (the attained minimum) for every space with that kernel.

Infrastructure. A complete development needs:

  • uniqueness of an RKHS given its kernel (milestone 1);
  • orthogonal projections onto closed subspaces (Mathlib Submodule.starProjection);
  • quotients of Hilbert spaces by closed subspaces, or the orthogonal complement of the kernel of the sum map;
  • for §3, Gram matrices and their inverses.

Milestone 1 and the RKHS structure on a closed subspace are reusable beyond this mission and are natural Mathlib contributions. Independent proofs of any milestone are welcome.

Selected references

  • N. Aronszajn, Theory of Reproducing Kernels, Trans. Amer. Math. Soc. 68 (1950), no. 3, 337–404. https://doi.org/10.1090/S0002-9947-1950-0051437-7
  • E. H. Moore, General Analysis, Part I, Memoirs of the American Philosophical Society 1, 1935.
  • R. Godement, Sur les fonctions de type positif, C. R. Acad. Sci. Paris 221 (1945), 69; and further notes in vols. 221–222 (1945–1946), as cited by Aronszajn [Godement 1].
  • E. H. Moore, On properly positive Hermitian matrices, Bull. Amer. Math. Soc. 23 (1916), 59.
  • V. I. Paulsen and M. Raghupathi, An Introduction to the Theory of Reproducing Kernel Hilbert Spaces, Cambridge Univ. Press, 2016. https://doi.org/10.1017/CBO9781316219232
8 thms3 active usersReviewed
🏆Completed
Markov ChainOperations ResearchProbability+1·Captain: mikedeng1

Fundamentals of Queueing Theory III: The Transient M/M/1 Queue via Modified Bessel FunctionsTextbook

Motivation

Steady-state formulas describe a queue that has been running forever. Many practical questions are about a queue that has not: a call centre just after opening, a server just after a reset, a system under a burst of load. For these, the relevant quantity is the transient distribution pn(t)=Pr⁡{N(t)=n}p_n(t) = \Pr\{N(t) = n\}pn​(t)=Pr{N(t)=n} of the number N(t)N(t)N(t) in the system at a finite time ttt. It is also what determines how fast the steady state is approached, and it is needed for the busy period: the length of time a server stays busy once a customer arrives at an idle server.

For the single-server Markovian queue M/M/1 the transient distribution has an explicit closed form in modified Bessel functions. Its history is short and well documented. Ledermann and Reuter (1954) obtained it by spectral analysis of the birth–death process. Bailey (1954) found it by generating functions and Laplace transforms, and Champernowne (1956) by combinatorial methods. Bailey's route is the standard textbook derivation, and it is the one Gross, Shortle, Thompson and Harris outline in §2.11 of Fundamentals of Queueing Theory (4th ed., 2008). Abate and Whitt (1989) showed that computing with the resulting series is numerically delicate, which is one reason for having the formula pinned down exactly.

This mission formalizes §§2.11–2.12 of that book: the transient laws of M/M/1/1, M/M/1 and M/M/∞, and the M/M/1 busy period.

Setting

Customers arrive in a Poisson stream of rate λ>0\lambda > 0λ>0. Each service takes an exponential time of rate μ>0\mu > 0μ>0, and ρ=λ/μ\rho = \lambda/\muρ=λ/μ. The number in the system is a continuous-time Markov chain on {0,1,2,… }\{0, 1, 2, \dots\}{0,1,2,…}, and its state probabilities pn(t)p_n(t)pn​(t) satisfy the forward (differential–difference) equations. For M/M/1 started with N(0)=iN(0) = iN(0)=i they are, for t≥0t \ge 0t≥0,

pn′(t)=−(λ+μ)pn(t)+λpn−1(t)+μpn+1(t) (n>0),p0′(t)=−λp0(t)+μp1(t),(2.72)p_n'(t) = -(\lambda+\mu)p_n(t) + \lambda p_{n-1}(t) + \mu p_{n+1}(t)\ (n > 0), \qquad p_0'(t) = -\lambda p_0(t) + \mu p_1(t), \tag{2.72}pn′​(t)=−(λ+μ)pn​(t)+λpn−1​(t)+μpn+1​(t) (n>0),p0′​(t)=−λp0​(t)+μp1​(t),(2.72)

with pn(0)=1p_n(0) = 1pn​(0)=1 if n=in = in=i and 000 otherwise. The other systems are variants:

  • M/M/1/1, no waiting room: two states and equations (2.70).
  • M/M/∞, ample service: the death rate in state nnn is nμn\munμ, giving (2.76).
  • The busy-period system: (2.72) with 000 made absorbing (λ0=0\lambda_0 = 0λ0​=0) and N(0)=1N(0) = 1N(0)=1. Its p0(t)p_0(t)p0​(t) is the distribution function of the busy period TbpT_{bp}Tbp​.

A family (pn)(p_n)(pn​) solves a system on [0,∞)[0,\infty)[0,∞) when each pnp_npn​ has, at every t≥0t \ge 0t≥0, the prescribed derivative (a right derivative at t=0t = 0t=0). It is a probability solution when pn(t)≥0p_n(t) \ge 0pn​(t)≥0 and ∑npn(t)=1\sum_n p_n(t) = 1∑n​pn​(t)=1 for every t≥0t \ge 0t≥0. The modified Bessel function of the first kind is

In(y)=∑k=0∞(y/2)n+2kk! (n+k)!,I−n=In,I_n(y) = \sum_{k=0}^{\infty} \frac{(y/2)^{n+2k}}{k!\,(n+k)!}, \qquad I_{-n} = I_n,In​(y)=k=0∑∞​k!(n+k)!(y/2)n+2k​,I−n​=In​,

and the Laplace transform of fff is fˉ(s)=∫0∞e−stf(t) dt\bar f(s) = \int_0^\infty e^{-st} f(t)\,dtfˉ​(s)=∫0∞​e−stf(t)dt for Re⁡s>0\operatorname{Re} s > 0Res>0.

Formalization targets

Goal: the transient M/M/1 law, (2.75)

With y=2tλμy = 2t\sqrt{\lambda\mu}y=2tλμ​,

pn(t)=e−(λ+μ)t[ρ(n−i)/2In−i(y)+ρ(n−i−1)/2In+i+1(y)+(1−ρ)ρn∑j=n+i+2∞ρ−j/2Ij(y)].p_n(t) = e^{-(\lambda+\mu)t}\Big[\rho^{(n-i)/2} I_{n-i}(y) + \rho^{(n-i-1)/2} I_{n+i+1}(y) + (1-\rho)\rho^n \sum_{j=n+i+2}^{\infty} \rho^{-j/2} I_j(y)\Big].pn​(t)=e−(λ+μ)t[ρ(n−i)/2In−i​(y)+ρ(n−i−1)/2In+i+1​(y)+(1−ρ)ρnj=n+i+2∑∞​ρ−j/2Ij​(y)].

The goal asserts five things for every λ,μ>0\lambda, \mu > 0λ,μ>0 and every iii, with no restriction on ρ\rhoρ:

  1. the series converges;
  2. these functions solve (2.72);
  3. they meet the initial condition;
  4. they form a probability distribution at every ttt;
  5. they are the only probability solution.

Milestones

  1. (2.71): the M/M/1/1 solution p1(t)=λλ+μ(1−e−(λ+μ)t)+p1(0)e−(λ+μ)tp_1(t) = \frac{\lambda}{\lambda+\mu}(1-e^{-(\lambda+\mu)t}) + p_1(0)e^{-(\lambda+\mu)t}p1​(t)=λ+μλ​(1−e−(λ+μ)t)+p1​(0)e−(λ+μ)t, and the matching formula for p0p_0p0​.
  2. (2.74) and Rouché's theorem: for Re⁡s>0\operatorname{Re} s > 0Res>0, the quadratic (λ+μ+s)z−μ−λz2(\lambda+\mu+s)z - \mu - \lambda z^2(λ+μ+s)z−μ−λz2 has exactly one zero in ∣z∣<1|z| < 1∣z∣<1, namely z1=(λ+μ+s−(λ+μ+s)2−4λμ)/(2λ)z_1 = (\lambda+\mu+s-\sqrt{(\lambda+\mu+s)^2-4\lambda\mu})/(2\lambda)z1​=(λ+μ+s−(λ+μ+s)2−4λμ​)/(2λ).
  3. The transform of p0p_0p0​: pˉ0(s)=z1i+1/(μ(1−z1))\bar p_0(s) = z_1^{i+1}/(\mu(1-z_1))pˉ​0​(s)=z1i+1​/(μ(1−z1​)).
  4. The limit of (2.75): pn(t)→(1−ρ)ρnp_n(t) \to (1-\rho)\rho^npn​(t)→(1−ρ)ρn if ρ<1\rho < 1ρ<1, and pn(t)→0p_n(t) \to 0pn​(t)→0 if ρ≥1\rho \ge 1ρ≥1.
  5. (2.77), M/M/∞: started empty, pn(t)=a(t)ne−a(t)/n!p_n(t) = a(t)^n e^{-a(t)}/n!pn​(t)=a(t)ne−a(t)/n! with a(t)=(1−e−μt)λ/μa(t) = (1-e^{-\mu t})\lambda/\mua(t)=(1−e−μt)λ/μ. The statement says that this family solves (2.76), is the unique probability solution, and has generating function exp⁡((z−1)a(t))\exp((z-1)a(t))exp((z−1)a(t)).
  6. The busy-period transform: pˉ0(s)=2μ/(s[λ+μ+s+(λ+μ+s)2−4λμ])\bar p_0(s) = 2\mu/(s[\lambda+\mu+s+\sqrt{(\lambda+\mu+s)^2-4\lambda\mu}])pˉ​0​(s)=2μ/(s[λ+μ+s+(λ+μ+s)2−4λμ​]).
  7. The busy-period density: p0′(t)=μ/λ e−(λ+μ)tI1(2λμ t)/tp_0'(t) = \sqrt{\mu/\lambda}\,e^{-(\lambda+\mu)t} I_1(2\sqrt{\lambda\mu}\,t)/tp0′​(t)=μ/λ​e−(λ+μ)tI1​(2λμ​t)/t.
  8. (2.79): for λ<μ\lambda < \muλ<μ, E[Tbp]=1/(μ−λ)E[T_{bp}] = 1/(\mu-\lambda)E[Tbp​]=1/(μ−λ) and E[Tbc]=1/λ+1/(μ−λ)E[T_{bc}] = 1/\lambda + 1/(\mu-\lambda)E[Tbc​]=1/λ+1/(μ−λ).

Significance

The formula (2.75) is the exact finite-time law of the most basic queue. It gives the rate at which M/M/1 approaches equilibrium, and it gives the distribution of the queue under overload (ρ≥1\rho \ge 1ρ≥1), where no steady state exists. It is the reference against which numerical transient methods, such as the uniformization of Chapter 8 of the same book, are checked. The busy-period density and its mean (2.79) enter server-utilisation and vacation models, and the Laplace-transform method used here recurs in the M/G/1 analysis of Chapter 5.

All of these results are classical and proved in the literature. None of them is machine-checked, as far as the platform's catalogue and Mathlib show. The chain from a countable system of linear ODEs, through generating functions and a root-location argument, to a Bessel series is a standard pattern in applied probability, and a formal version of it is what this mission adds. The formal statements also make explicit what the book leaves implicit: the sense in which the equations hold at t=0t = 0t=0, and the class in which the solution is unique.

Difficulty

The forward equations (2.72) form an infinite linear system. The obvious approach is to treat it like a finite system of ODEs, whose solution is a matrix exponential, and read off (2.75). That fails for two reasons. The generator is an infinite matrix, so its exponential needs a functional-analytic setting. And uniqueness is not automatic for infinite systems: it needs a class, such as probability solutions, and an argument that works in that class.

The Bessel form is a second, independent difficulty. The transform pˉ0(s)\bar p_0(s)pˉ​0​(s) is fixed by a root-location argument in the complex plane. Inverting the transform, or verifying (2.75) directly, requires manipulating the three-term Bessel recurrence and exchanging infinite sums. The tail sum ∑jρ−j/2Ij\sum_{j} \rho^{-j/2} I_j∑j​ρ−j/2Ij​ has to be controlled uniformly enough to be differentiated term by term. For ρ≥1\rho \ge 1ρ≥1 the factor (1−ρ)(1-\rho)(1−ρ) is non-positive, so the nonnegativity of pn(t)p_n(t)pn​(t) is not visible from the formula.

Formalization scope

Conventions committed to:

  • Parameters. Rates are real with λ,μ>0\lambda, \mu > 0λ,μ>0, and ρ=λ/μ\rho = \lambda/\muρ=λ/μ. States are ℕ (Fin 2 for M/M/1/1).
  • Solutions. "Solves on [0,∞)[0,\infty)[0,∞)" is HasDerivWithinAt on Set.Ici 0 at every t≥0t \ge 0t≥0. Uniqueness is asserted among solutions that are probability distributions at every time.
  • Special functions. Half-integer powers of ρ\rhoρ are real powers, and I−m=ImI_{-m} = I_mI−m​=Im​ is part of the definition. Laplace transforms are complex Bochner integrals over (0,∞)(0,\infty)(0,∞), and each statement also asserts the integrability it needs. Square roots with positive real part are hypotheses r2=(λ+μ+s)2−4λμr^2 = (\lambda+\mu+s)^2 - 4\lambda\mur2=(λ+μ+s)2−4λμ, Re⁡r>0\operatorname{Re} r > 0Rer>0.

The closed forms stated exactly as in the book are:

  • (2.71);
  • z1z_1z1​ and z2z_2z2​ of (2.74);
  • pˉ0(s)=z1i+1/(μ(1−z1))\bar p_0(s) = z_1^{i+1}/(\mu(1-z_1))pˉ​0​(s)=z1i+1​/(μ(1−z1​));
  • (2.75), with the Bessel series of p.101;
  • the M/M/∞ law and (2.77);
  • the busy-period transform and density of p.102;
  • (2.79).

The book derives (2.79) by a steady-state ratio argument valid for M/G/1. Here it is stated for M/M/1, as the mean of the explicit density.

A statement of (2.75) that only asserts the right-hand side is well defined, or checks only n=0n = 0n=0, is ruled out: the goal requires the ODE system, the initial condition, the probability property and uniqueness. For the same reason, the M/M/∞ law is tied to the system (2.76) and does not reduce to a Taylor expansion.

Needed infrastructure that Mathlib lacks:

  • modified Bessel functions of integer order;
  • Laplace transforms;
  • a Rouché-type zero count or a direct root-location lemma;
  • uniqueness for countable linear ODE systems with bounded or linearly growing rates.

The Bessel and Laplace definitions, and the uniqueness lemma for birth–death forward equations, are reusable beyond this mission. Contributions of those as separate lemmas are welcome.

Selected references

  • D. Gross, J. F. Shortle, J. M. Thompson, C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008, §§2.11–2.12, pp.97–103. https://doi.org/10.1002/9781118625651
  • N. T. J. Bailey, "A continuous time treatment of a simple queue using generating functions", J. Royal Statistical Society B 16 (1954) 288–291. https://doi.org/10.1111/j.2517-6161.1954.tb00172.x
  • W. Ledermann, G. E. H. Reuter, "Spectral theory for the differential equations of simple birth and death processes", Phil. Trans. Royal Society A 246 (1954) 321–369. https://doi.org/10.1098/rsta.1954.0001
  • D. G. Champernowne, "An elementary method of solution of the queueing problem with a single server and constant parameters", J. Royal Statistical Society B 18 (1956) 125–128. https://doi.org/10.1111/j.2517-6161.1956.tb00217.x
  • J. Abate, W. Whitt, "Calculating time-dependent performance measures for the M/M/1 queue", IEEE Trans. Communications 37 (1989) 1102–1104. https://doi.org/10.1109/26.41165
15 thms3 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Minimization Methods for Non-Differentiable Functions II: Convex Functions Are Almost Differentiable and Their Almost-Gradients Are SubgradientsTextbook

Motivation

Gradient methods assume a continuous gradient; subgradient methods assume convexity. Many objective functions met in practice satisfy neither. Shor's example is economic planning, where components of the objective are piecewise-smooth, not necessarily convex functions of a parameter describing the productivity of a unit, and where minimax formulations produce kinks as a rule (Shor, Minimization Methods for Non-Differentiable Functions, Springer 1985, §1.4, p. 17, DOI 10.1007/978-3-642-82118-9). Such problems need a class of functions wide enough to contain piecewise-smooth and minimax functions and narrow enough to carry a usable replacement for the gradient.

Shor's answer is the class of almost differentiable functions, introduced in his 1972 work and presented in §1.4 of the book, together with the almost-gradient, a limit of gradients taken at nearby points of differentiability. The capstone of the section, Theorem 1.15, connects this class with convex analysis: every convex function on EnE_nEn​ is almost differentiable, and its almost-gradients are subgradients. This is what lets the later chapters treat convex minimization and almost-differentiable minimization with one set of tools. Clarke's generalized gradient of locally Lipschitz functions (Clarke 1975) is the closest relative; Shor's definition differs in requiring the gradient to be continuous on its domain (p. 19).

Setting

Let EnE_nEn​ denote nnn-dimensional Euclidean space with inner product (x,y)(x, y)(x,y) and norm ∥x∥\|x\|∥x∥. For f:En→Rf : E_n \to \mathbb{R}f:En​→R, write M={x∈En:f is differentiable at x}M = \{x \in E_n : f \text{ is differentiable at } x\}M={x∈En​:f is differentiable at x} and ∇f(x)\nabla f(x)∇f(x) for the gradient at x∈Mx \in Mx∈M.

A function fff is almost differentiable if

  1. on every bounded set SSS it is Lipschitz: ∣f(x)−f(y)∣≤LS∥x−y∥|f(x) - f(y)| \le L_S \|x - y\|∣f(x)−f(y)∣≤LS​∥x−y∥ for x,y∈Sx, y \in Sx,y∈S, with a constant LSL_SLS​ depending on SSS;
  2. it is differentiable at Lebesgue-almost every point of EnE_nEn​;
  3. the map x↦∇f(x)x \mapsto \nabla f(x)x↦∇f(x), restricted to MMM, is continuous.

An almost-gradient of fff at x0x_0x0​ is a vector ggg that is an accumulation point of a sequence ∇f(x1),∇f(x2),…\nabla f(x_1), \nabla f(x_2), \dots∇f(x1​),∇f(x2​),… with xk∈Mx_k \in Mxk​∈M and xk→x0x_k \to x_0xk​→x0​. The set of almost-gradients is G(x0)G(x_0)G(x0​). A generalized almost-gradient is a point of the closure of the convex hull of G(x0)G(x_0)G(x0​).

A vector ggg is a subgradient of fff at x0x_0x0​ if f(x)−f(x0)≥(g,x−x0)f(x) - f(x_0) \ge (g, x - x_0)f(x)−f(x0​)≥(g,x−x0​) for all x∈Enx \in E_nx∈En​; for convex fff the set of subgradients is the subdifferential Gf(x0)G_f(x_0)Gf​(x0​).

In Lean these objects are AlmostDifferentiable f, almostGradients f x₀ and IsSubgradient f x₀ g in the namespace ShorNonsmooth.AlmostDiff, with EnE_nEn​ = EuclideanSpace ℝ (Fin n).

Formalization targets

Goal: Theorem 1.15 (p. 18)

For convex f:En→Rf : E_n \to \mathbb{R}f:En​→R,

f is almost differentiableandG(x0)⊆Gf(x0)  for every x0∈En.f \text{ is almost differentiable} \quad\text{and}\quad G(x_0) \subseteq G_f(x_0) \ \text{ for every } x_0 \in E_n .f is almost differentiableandG(x0​)⊆Gf​(x0​)  for every x0​∈En​.

The printed statement says the almost-gradients "coincide with" the subgradients. As a set equality this is false (for f(x)=∣x∣f(x) = |x|f(x)=∣x∣ on E1E_1E1​, G(0)={−1,1}G(0) = \{-1, 1\}G(0)={−1,1} while Gf(0)=[−1,1]G_f(0) = [-1, 1]Gf​(0)=[−1,1]), and the book's proof establishes the inclusion. The goal is the inclusion.

Milestones

  1. Proof of Theorem 1.15, display (p. 18). For convex fff differentiable at xkx_kxk​: f(x)−f(xk)≥(∇f(xk),x−xk)f(x) - f(x_k) \ge (\nabla f(x_k), x - x_k)f(x)−f(xk​)≥(∇f(xk​),x−xk​) for all xxx.
  2. Proof of Theorem 1.15 (p. 18). For convex fff and bounded SSS there is CCC with ∣fv′(x)∣≤C∥v∥|f'_v(x)| \le C\|v\|∣fv′​(x)∣≤C∥v∥ for all x∈Sx \in Sx∈S and all vvv, the one-sided directional derivatives existing.
  3. Proof of Theorem 1.15 (p. 18). A convex fff is differentiable almost everywhere and ∇f\nabla f∇f is continuous on MMM.
  4. Theorem 1.14 (p. 18). For almost differentiable fff, G(x)G(x)G(x) is nonempty, bounded and closed at every xxx.
  5. p. 19. For almost differentiable fff, conv⁡‾ G(x)\overline{\operatorname{conv}}\, G(x)convG(x) is convex, bounded and closed.

Significance

The result. Theorem 1.15 embeds convex functions into the almost differentiable class and identifies each almost-gradient of a convex function as a subgradient. Consequently any method that only needs almost-gradients (limits of gradients at nearby differentiable points, which is what a numerical procedure can actually compute) produces valid subgradients when applied to a convex function. Theorem 1.14 supplies the compactness that makes G(x)G(x)G(x) usable as a set-valued substitute for the gradient.

Formalizing it. All results here are classical and proved on paper. Mathlib contains Rademacher's theorem for Lipschitz functions (LipschitzWith.ae_differentiableAt) and local Lipschitz continuity of convex functions on open sets; it does not contain the continuity of the gradient of a convex function on its domain of differentiability, nor any notion of almost-gradient. The mission produces those, together with a formal record that the printed "coincide" is an inclusion. A formal proof of the true equality Gf(x0)=conv⁡‾ G(x0)G_f(x_0) = \overline{\operatorname{conv}}\, G(x_0)Gf​(x0​)=convG(x0​) would be a welcome further contribution.

Difficulty

Two parts of the goal carry real content. The first is condition (c): the gradient of a convex function, restricted to the set where it exists, is continuous. The book cites this from the literature; it is not a consequence of Rademacher's theorem, which gives differentiability almost everywhere and says nothing about how gradients at nearby points relate. The second is condition (b) in a form Lean accepts: Rademacher's theorem in Mathlib is stated for globally Lipschitz functions, while a convex function on EnE_nEn​ is only Lipschitz on bounded sets, so the almost-everywhere statement has to be assembled from local pieces. The passage from gradients to subgradients in the second conjunct is comparatively routine.

The analogous closure properties claimed on the same pages for sums, products and maxima of almost differentiable functions (Theorems 1.16 and 1.17) are false as printed and are not targets; see the formalization scope.

Formalization scope

  • EnE_nEn​ is EuclideanSpace ℝ (Fin n); n=0n = 0n=0 is allowed and harmless. Functions are total and real-valued; convexity is ConvexOn ℝ Set.univ f.
  • The gradient is Mathlib's gradient f x; condition (c) is ContinuousOn (gradient f) {x | DifferentiableAt ℝ f x}, continuity of the restriction in the subspace topology.
  • Condition (a) is quantified over every bounded set with a set-dependent constant: ∀ S, Bornology.IsBounded S → ∃ L, LipschitzOnWith L f S. Condition (b) is ∀ᵐ x ∂volume, DifferentiableAt ℝ f x.
  • An almost-gradient is a cluster point (MapClusterPt) of the gradient sequence, not its limit; the points xkx_kxk​ may equal x0x_0x0​.
  • Subgradients are taken relative to the whole space, the domain of every function in this mission.
  • The goal states the inclusion G(x0)⊆Gf(x0)G(x_0) \subseteq G_f(x_0)G(x0​)⊆Gf​(x0​) proved in the book. Stating the printed set equality would make the goal false; weakening the first conjunct to "locally Lipschitz and differentiable almost everywhere" would drop condition (c) and with it the substance of the theorem. Neither is acceptable.
  • Theorem 1.16 (sums, differences, products) and Theorem 1.17 (maxima) are omitted: both are false for the class as defined. With h(x)=x2sin⁡(1/x)h(x) = x^2 \sin(1/x)h(x)=x2sin(1/x), the functions h+∣x∣h + |x|h+∣x∣ and −∣x∣-|x|−∣x∣ are almost differentiable but their sum hhh is differentiable everywhere with a derivative discontinuous at 000; and max⁡(h−∣x∣, h−∣x∣+2x)=h+x\max(h - |x|,\, h - |x| + 2x) = h + xmax(h−∣x∣,h−∣x∣+2x)=h+x. Theorem 1.18 (Mifflin's superposition theorem for semismooth functions) is cited from the literature without proof and rests on Clarke's generalized gradient; it is outside this mission.

Infrastructure that is reusable beyond this mission: continuity of the gradient of a convex function on its domain; Rademacher's theorem for locally Lipschitz functions on EnE_nEn​; the almost-gradient set and its compactness. Contributions that prove these as standalone lemmas are welcome.

Selected references

  • N. Z. Shor, Minimization Methods for Non-Differentiable Functions, Springer Series in Computational Mathematics 3, Springer, 1985. https://doi.org/10.1007/978-3-642-82118-9
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970, Theorem 25.5 (continuity of the gradient of a convex function). https://doi.org/10.1515/9781400873173
  • F. H. Clarke, Generalized gradients and applications, Transactions of the American Mathematical Society 205 (1975), 247–262. https://doi.org/10.1090/S0002-9947-1975-0367131-6
  • H. Rademacher, Über partielle und totale Differenzierbarkeit von Funktionen mehrerer Variabeln und über die Transformation der Doppelintegrale, Mathematische Annalen 79 (1919), 340–359. https://doi.org/10.1007/BF01498415
9 thms3 active usersReviewed
🏆Completed
Probability·Captain: mikedeng1

Stochastic Dynamic Programming and the Control of Queueing Systems XII: A Tauberian Theorem Linking Abel and Cesàro Means of Nonnegative SeriesTextbook

Motivation

In the theory of Markov decision chains two cost criteria dominate: the discounted cost, in which a cost incurred at time nnn is weighted by αn\alpha^nαn for a discount factor α∈(0,1)\alpha \in (0,1)α∈(0,1), and the average cost, the long-run cost per unit time. A standard route to average cost optimal policies is to solve the discounted problem and let α→1−\alpha \to 1^-α→1−. That route needs a precise link between the two criteria for a single sequence of expected costs u0,u1,u2,⋯≥0u_0, u_1, u_2, \dots \ge 0u0​,u1​,u2​,⋯≥0: the discounted cost multiplied by 1−α1-\alpha1−α on one side, the running average on the other. Appendix A.4 of Sennott, Stochastic Dynamic Programming and the Control of Queueing Systems (Wiley, 1999) supplies this link as Theorem A.4.2, and the book invokes it whenever it passes from discounted to average cost (for instance in Chapter 6, where it is applied to un=Eθ[C(Xn,An)]u_n = E_\theta[C(X_n, A_n)]un​=Eθ​[C(Xn​,An​)]).

The result belongs to classical summability theory.

  • Abelian direction. Convergence of averages implies convergence of the power-series (Abel) means: a consequence of Abel's and Frobenius's theorems on power series (19th century).
  • Tauber (1897). The first converse, under a growth condition on the terms.
  • Hardy and Littlewood (1914). The converse for Cesàro means of nonnegative terms, the "Hardy–Littlewood Tauberian theorem".
  • Karamata (1930). A short proof of that converse by polynomial approximation, reproduced in Titchmarsh, The Theory of Functions (1939, pp. 227–229). The book follows this proof.
  • Widder (1941). The continuous-time (Laplace transform) version.
  • Sennott (1986b). A proof of the discrete statement, cited by the book as its source for Theorem A.4.2.

Setting

Let u0,u1,u2,…u_0, u_1, u_2, \dotsu0​,u1​,u2​,… be nonnegative terms un∈[0,∞]u_n \in [0, \infty]un​∈[0,∞] with u0<∞u_0 < \inftyu0​<∞. For α∈[0,∞)\alpha \in [0, \infty)α∈[0,∞) the power series

U(α)=∑n=0∞αnun∈[0,∞]U(\alpha) = \sum_{n=0}^{\infty} \alpha^n u_n \in [0, \infty]U(α)=n=0∑∞​αnun​∈[0,∞]

always has a sum, possibly +∞+\infty+∞, because its partial sums increase. Its radius of convergence is R=(lim sup⁡nun1/n)−1∈[0,∞]R = (\limsup_{n} u_n^{1/n})^{-1} \in [0,\infty]R=(limsupn​un1/n​)−1∈[0,∞]. The partial sums are wn=∑k=0n−1ukw_n = \sum_{k=0}^{n-1} u_kwn​=∑k=0n−1​uk​ for n≥1n \ge 1n≥1. Two ways of averaging the sequence are compared:

  • the Cesàro means wn/nw_n / nwn​/n, as n→∞n \to \inftyn→∞;
  • the Abel means (1−α)U(α)(1-\alpha) U(\alpha)(1−α)U(α), as α→1−\alpha \to 1^-α→1− (from below).

For the constant sequence un≡Bu_n \equiv Bun​≡B both equal BBB. In the Lean development these are U, radius, w, cesaroMean and abelMean in the namespace SennottDP.Tauberian, all valued in ℝ≥0∞. The proof also uses the function rrr of Fig. A.1, equal to 000 on (0,e−1)(0, e^{-1})(0,e−1) and to 1/x1/x1/x on [e−1,1)[e^{-1}, 1)[e−1,1).

Formalization targets

Goal: Theorem A.4.2

lim inf⁡n→∞wnn≤lim inf⁡α→1−(1−α)U(α)≤lim sup⁡α→1−(1−α)U(α)≤lim sup⁡n→∞wnn,(A.28)\liminf_{n\to\infty} \frac{w_n}{n} \le \liminf_{\alpha\to 1^-} (1-\alpha)U(\alpha) \le \limsup_{\alpha\to 1^-} (1-\alpha)U(\alpha) \le \limsup_{n\to\infty} \frac{w_n}{n}, \tag{A.28}n→∞liminf​nwn​​≤α→1−liminf​(1−α)U(α)≤α→1−limsup​(1−α)U(α)≤n→∞limsup​nwn​​,(A.28)

and the following are equivalent: (i) all terms in (A.28) are equal and finite; (ii) lim⁡nwn/n\lim_n w_n/nlimn​wn​/n exists and is finite; (iii) lim⁡α→1−(1−α)U(α)\lim_{\alpha \to 1^-} (1-\alpha)U(\alpha)limα→1−​(1−α)U(α) exists and is finite.

No growth or boundedness condition on unu_nun​ is assumed: nonnegativity is the only Tauberian condition.

Milestones

  1. Remark A.3.3: the geometric series. R=1R = 1R=1, U(α)=B/(1−α)U(\alpha) = B/(1-\alpha)U(α)=B/(1−α) and B∑nnαn=Bα/(1−α)2B\sum_n n\alpha^n = B\alpha/(1-\alpha)^2B∑n​nαn=Bα/(1−α)2.
  2. Remark A.3.1: inside the radius of convergence, UUU is differentiable term by term, and the derived series has the same radius.
  3. Eq. (A.31): (∑αn)U(α)=∑nαnwn+1=U(α)/(1−α)\big(\sum \alpha^n\big) U(\alpha) = \sum_n \alpha^n w_{n+1} = U(\alpha)/(1-\alpha)(∑αn)U(α)=∑n​αnwn+1​=U(α)/(1−α).
  4. Eq. (A.28): the Abelian inequalities on their own.
  5. Eq. (A.26): ∫01r=1\int_0^1 r = 1∫01​r=1.
  6. Lemma A.4.1: continuous s∗≤r≤ss^* \le r \le ss∗≤r≤s with integrals within ε\varepsilonε of 111.
  7. Eqs. (A.35)–(A.36): if the Abel means tend to L<∞L < \inftyL<∞, then (1−α)∑nαnunf(αn)→L∫01f(1-\alpha)\sum_n \alpha^n u_n f(\alpha^n) \to L\int_0^1 f(1−α)∑n​αnun​f(αn)→L∫01​f for f(x)=xkf(x) = x^kf(x)=xk.
  8. The same statement for every fff continuous on [0,1][0,1][0,1].
  9. The same statement for f=rf = rf=r.
  10. Example A.5.1: a 0/10/10/1 block sequence with lim inf⁡wn/n=1/2\liminf w_n/n = 1/2liminfwn​/n=1/2 and lim sup⁡wn/n=2/3\limsup w_n/n = 2/3limsupwn​/n=2/3 (Choice One) or 111 (Choice Two), for which the middle inequality of (A.28) is strict.

Significance

The result itself. Theorem A.4.2 lets every statement about lim⁡α→1−(1−α)Vα\lim_{\alpha\to1^-}(1-\alpha)V_\alphalimα→1−​(1−α)Vα​ for a discounted value be read as a statement about long-run average cost, and conversely. The strict cases of Example A.5.1 show why the book must work with lim inf⁡\liminfliminf and lim sup⁡\limsuplimsup rather than limits: average costs of policies need not exist as limits, even for bounded costs.

Formalizing it. Mathlib contains Abel's theorem for convergent series (Mathlib/Analysis/Complex/AbelLimit.lean) and Cesàro convergence of convergent sequences, but no Tauberian theorem. The pinned checkout has no file mentioning "Tauberian", and neither does the platform. The mathematics has been proved since 1914. Formalizing it here adds:

  • a machine-checked Hardy–Littlewood–Karamata theorem for nonnegative [0,∞][0,\infty][0,∞]-valued sequences;
  • the lim inf⁡\liminfliminf/lim sup⁡\limsuplimsup comparison (A.28) with infinite values allowed;
  • a reusable component for the average cost chapters of this series.

Difficulty

The Abelian inequalities (A.28) follow from rearranging the series. The converse (iii) ⇒ (ii) does not: the first idea, recovering wn/nw_n/nwn​/n from (1−α)U(α)(1-\alpha)U(\alpha)(1−α)U(α) at α=1−1/n\alpha = 1 - 1/nα=1−1/n, fails, because knowing UUU near 111 controls only weighted averages of all the uku_kuk​, not a sharp truncation. Some positivity argument is unavoidable, since the converse fails for signed sequences (for example un=(−1)nnu_n = (-1)^n nun​=(−1)nn). The sharp truncation at n≈(−ln⁡α)−1n \approx (-\ln\alpha)^{-1}n≈(−lnα)−1 corresponds to the discontinuous weight rrr. Passing from polynomial weights to the jump function rrr requires uniform approximation together with the nonnegativity of the unu_nun​ at every step.

The infinite values add bookkeeping. A single un0=∞u_{n_0} = \inftyun0​​=∞ makes every term of (A.28) infinite, and R<1R < 1R<1 forces U(α)=∞U(\alpha) = \inftyU(α)=∞ on (R,1)(R,1)(R,1).

Formalization scope

Conventions the statements commit to:

  • Values. Terms u:N→[0,∞]u : \mathbb{N} \to [0,\infty]u:N→[0,∞] (ℝ≥0∞) with u0≠∞u_0 \ne \inftyu0​=∞. UUU, the Abel means, wnw_nwn​ and the Cesàro means are ℝ≥0∞-valued, with ℝ≥0∞ sums (no summability side conditions).
  • Limits. lim inf⁡\liminfliminf and lim sup⁡\limsuplimsup are those of the complete lattice [0,∞][0,\infty][0,∞], never real liminf. "Exists and is finite" means convergence in [0,∞][0,\infty][0,∞] to some L≠∞L \ne \inftyL=∞.
  • Discount factor. α∈R≥0\alpha \in \mathbb{R}_{\ge 0}α∈R≥0​, and α→1−\alpha \to 1^-α→1− is the filter 𝓝[<] 1.
  • Index n=0n = 0n=0. n→∞n \to \inftyn→∞ is atTop on N\mathbb{N}N; the value w0/0=0w_0/0 = 0w0​/0=0 is irrelevant.
  • The equivalence is List.TFAE.
  • The function rrr. Its value at the jump is r(e−1)=er(e^{-1}) = er(e−1)=e (Fig. A.1).
  • Continuity. In Lemma A.4.1 and in the continuous-weight step, continuity is required on the closed interval [0,1][0,1][0,1], which is what the Weierstrass approximation step uses. The book writes "(0,1)(0,1)(0,1)".
  • Finite terms. Remark A.3.1 is stated for finite terms, which the book's discussion of the radius presumes.

A trivializing formalization is ruled out. Real-valued lim inf⁡\liminfliminf/lim sup⁡\limsuplimsup would make (A.28) hold by junk values on unbounded sequences; hypotheses such as boundedness of unu_nun​ would replace the theorem by an easier special case; and a definition of "exists and is finite" allowing L=∞L = \inftyL=∞ would make (ii) hold for un=nu_n = nun​=n. None of these is used. As sanity checks: for un≡1u_n \equiv 1un​≡1 all four terms of (A.28) equal 111, and for un=nu_n = nun​=n all equal ∞\infty∞ and (i)–(iii) all fail.

A complete development needs:

  • Cauchy products of [0,∞][0,\infty][0,∞]-valued power series;
  • the Weierstrass approximation theorem, which Mathlib has (polynomialFunctions.topologicalClosure);
  • interval integrals of step-like functions;
  • lim inf⁡\liminfliminf/lim sup⁡\limsuplimsup manipulation along 𝓝[<] 1.

Reusable beyond this mission: the ℝ≥0∞ power-series toolkit and the Karamata argument for general continuous weights (milestone 8). Contributions welcome: proofs of any milestone, and alternative proofs of (iii) ⇒ (ii).

Selected references

  • L. I. Sennott, Stochastic Dynamic Programming and the Control of Queueing Systems, Wiley, 1999, Appendix A.3–A.5, pp. 279–287. https://doi.org/10.1002/9780470317037
  • E. C. Titchmarsh, The Theory of Functions, 2nd ed., Oxford University Press, 1939, pp. 227–229 (Karamata's proof).
  • J. Karamata, "Über die Hardy–Littlewoodschen Umkehrungen des Abelschen Stetigkeitssatzes", Mathematische Zeitschrift 32 (1930), 319–320.
  • G. H. Hardy and J. E. Littlewood, "Tauberian theorems concerning power series and Dirichlet's series whose coefficients are positive", Proc. London Math. Soc. (2) 13 (1914), 174–191.
  • D. V. Widder, The Laplace Transform, Princeton University Press, 1941.
  • L. I. Sennott, "A new condition for the existence of optimum stationary policies in average cost Markov decision processes — unbounded cost case", Proc. 25th IEEE Conference on Decision and Control, Athens, 1986, pp. 1719–1721 (cited by the book as Sennott 1986b).
  • T. M. Liggett and S. A. Lippman, "Short notes: Stochastic games with perfect information and time average payoff", SIAM Review 11 (1969), 604–607. https://doi.org/10.1137/1011093
14 thms3 active usersReviewed
🏆Completed
Probability·Captain: mikedeng1

Stochastic Dynamic Programming and the Control of Queueing Systems XI: The Generalized Dominated Convergence Theorem for Approximating DistributionsTextbook

Motivation

Linn Sennott's Stochastic Dynamic Programming and the Control of Queueing Systems (Wiley, 1999) studies Markov decision chains with countably many states, finite action sets and unbounded nonnegative costs. Its main computational device, the approximating sequence method (Definition 2.5.1, p. 28), replaces the countable state space SSS by an increasing sequence of state spaces SNS_NSN​ and the transition law out of each state by distributions Pj(N)P_j(N)Pj​(N) on SNS_NSN​ that converge pointwise to the original law. Every convergence argument of that method has the same shape: a sum ∑j∈SNPj(N) u(j,N)\sum_{j\in S_N} P_j(N)\,u(j,N)∑j∈SN​​Pj​(N)u(j,N), an expected cost or value under the NNN-th approximating model, must be shown to converge to ∑j∈SPj u(j)\sum_{j\in S} P_j\,u(j)∑j∈S​Pj​u(j), or at least to satisfy a one-sided bound in the limit.

Appendix A, Sections A.1–A.2 (pp. 270–278), collects the analysis results used for this. The author proves them for sums over countable sets rather than general integrals, so they need no measure theory, and the proofs of the discounted-cost and average-cost approximation theorems (Chapters 4 and 8) cite them. This mission formalizes that appendix section as a self-contained unit.

Setting

Let SSS be a countable set and (Pj)j∈S(P_j)_{j\in S}(Pj​)j∈S​ a probability distribution on SSS: Pj≥0P_j\ge 0Pj​≥0 and ∑jPj=1\sum_j P_j=1∑j​Pj​=1. Values of functions are extended reals in [−∞,∞][-\infty,\infty][−∞,∞], with the convention 0⋅∞=00\cdot\infty=00⋅∞=0. For u:S→[−∞,∞]u:S\to[-\infty,\infty]u:S→[−∞,∞], the weighted sum is

∑j∈SPj u(j)=∑j∈SPj u+(j)−∑j∈SPj u−(j),\sum_{j\in S}P_j\,u(j)=\sum_{j\in S}P_j\,u^+(j)-\sum_{j\in S}P_j\,u^-(j),j∈S∑​Pj​u(j)=j∈S∑​Pj​u+(j)−j∈S∑​Pj​u−(j),

which is well defined, in (−∞,∞](-\infty,\infty](−∞,∞], whenever the negative parts have finite weighted sum. In Lean this is wsum P u.

A family of approximating distributions for (Pj)(P_j)(Pj​) consists of

  1. an increasing sequence of subsets S0⊆S1⊆⋯S_0\subseteq S_1\subseteq\cdotsS0​⊆S1​⊆⋯ of SSS with ⋃NSN=S\bigcup_N S_N=S⋃N​SN​=S;
  2. for each NNN, a probability distribution (Pj(N))j∈SN(P_j(N))_{j\in S_N}(Pj​(N))j∈SN​​ on SNS_NSN​;
  3. pointwise convergence lim⁡N→∞Pj(N)=Pj\lim_{N\to\infty}P_j(N)=P_jlimN→∞​Pj​(N)=Pj​ for every j∈Sj\in Sj∈S.

Since the sets increase to SSS, a fixed state jjj lies in SNS_NSN​ for every large NNN, so lim inf⁡Nu(j,N)\liminf_N u(j,N)liminfN​u(j,N) and lim⁡Nu(j,N)\lim_N u(j,N)limN​u(j,N) make sense for a function u(j,N)u(j,N)u(j,N) defined only for j∈SNj\in S_Nj∈SN​. In Lean these three conditions are the structure ApproxDist P SN Q, with Q N j =Pj(N)=P_j(N)=Pj​(N).

Formalization targets

Goal: Theorem A.2.6 (Generalized Dominated Convergence Theorem), p. 278

Under the approximating-distribution hypotheses, let u(j,N)u(j,N)u(j,N) and w(j,N)w(j,N)w(j,N) be finite with ∣u(j,N)∣≤w(j,N)|u(j,N)|\le w(j,N)∣u(j,N)∣≤w(j,N) for j∈SNj\in S_Nj∈SN​, let u(j,N)→u(j)u(j,N)\to u(j)u(j,N)→u(j) and w(j,N)→w(j)w(j,N)\to w(j)w(j,N)→w(j) for every jjj, and assume

lim⁡N→∞∑j∈SNPj(N) w(j,N)=∑j∈SPj w(j)<∞.\lim_{N\to\infty}\sum_{j\in S_N}P_j(N)\,w(j,N)=\sum_{j\in S}P_j\,w(j)<\infty.N→∞lim​j∈SN​∑​Pj​(N)w(j,N)=j∈S∑​Pj​w(j)<∞.

Then

lim⁡N→∞∑j∈SNPj(N) u(j,N)=∑j∈SPj u(j).\lim_{N\to\infty}\sum_{j\in S_N}P_j(N)\,u(j,N)=\sum_{j\in S}P_j\,u(j).N→∞lim​j∈SN​∑​Pj​(N)u(j,N)=j∈S∑​Pj​u(j).

Milestones, in the book's order

  • Proposition A.1.3: lim inf⁡\liminfliminf commutes with a minimum over a finite nonempty set; lim⁡\limlim does too when all limits exist.
  • Proposition A.1.5: lim inf⁡N∑j∈Gu(j,N)≥∑j∈Glim inf⁡Nu(j,N)\liminf_N\sum_{j\in G}u(j,N)\ge\sum_{j\in G}\liminf_N u(j,N)liminfN​∑j∈G​u(j,N)≥∑j∈G​liminfN​u(j,N) for finite GGG and u>−∞u>-\inftyu>−∞, when the right side has no indeterminate form.
  • Proposition A.1.7: the same inequality for countable sums of [0,∞][0,\infty][0,∞]-valued terms.
  • Proposition A.1.8: the same, with the left sum over SNS_NSN​ increasing to SSS.
  • Proposition A.1.10: lim inf⁡un≤lim inf⁡wn/n≤lim sup⁡wn/n≤lim sup⁡un\liminf u_n\le\liminf w_n/n\le\limsup w_n/n\le\limsup u_nliminfun​≤liminfwn​/n≤limsupwn​/n≤limsupun​ for wn=∑k<nukw_n=\sum_{k<n}u_kwn​=∑k<n​uk​.
  • Proposition A.2.1 (Fatou's lemma): lim inf⁡N∑jPju(j,N)≥∑jPjlim inf⁡Nu(j,N)\liminf_N\sum_jP_j u(j,N)\ge\sum_jP_j\liminf_N u(j,N)liminfN​∑j​Pj​u(j,N)≥∑j​Pj​liminfN​u(j,N) for u≥−Lu\ge -Lu≥−L.
  • Theorem A.2.3 (dominated convergence, with a convergent dominating sequence w(j,N)w(j,N)w(j,N)) and Corollary A.2.4 (fixed dominating function).
  • Proposition A.2.5 (generalized Fatou's lemma):
lim inf⁡N→∞∑j∈SNPj(N) u(j,N) ≥ ∑j∈SPj lim inf⁡N→∞u(j,N)(u≥−L on SN).\liminf_{N\to\infty}\sum_{j\in S_N}P_j(N)\,u(j,N)\ \ge\ \sum_{j\in S}P_j\,\liminf_{N\to\infty}u(j,N)\qquad(u\ge -L\text{ on }S_N).N→∞liminf​j∈SN​∑​Pj​(N)u(j,N) ≥ j∈S∑​Pj​N→∞liminf​u(j,N)(u≥−L on SN​).
  • Corollary A.2.7: bounded convergence under approximating distributions.

Significance

The results. Proposition A.2.5 and Theorem A.2.6 are the two limit interchanges the approximating sequence method needs. The generalized Fatou inequality gives the lower bound on limits of value functions of the approximating models, and the generalized dominated convergence theorem identifies the limit of expected costs when a dominating function is available. Corollary A.2.7 gives the bounded case, and Proposition A.1.3 moves limits inside the minimization of an optimality equation. Proposition A.1.10 compares Cesàro averages with the sequence itself, which the average-cost chapters use.

Formalizing them. All statements are classical and proved in the book. A.1.7, A.2.1, A.2.3 and A.2.4 are, after translation, instances of Mathlib's Fatou lemma (MeasureTheory.lintegral_liminf_le) and dominated convergence theorem for a discrete measure. The mission states them in the book's discrete, extended-real form so later chapters can cite them by number. The versions in which the distribution and its support change with NNN (A.2.5–A.2.7) are not in Mathlib in this form; the generalized dominated convergence theorem appears in the measure-theoretic literature (Royden, Real Analysis, Ch. 4) but has no Lean formalization. None of these statements has been formalized for this book.

Difficulty

For the generalized results, Mathlib's Fatou lemma and dominated convergence theorem do not apply directly: they fix one measure, while here both the weights Pj(N)P_j(N)Pj​(N) and the support SNS_NSN​ change with NNN. The dominating function w(j,N)w(j,N)w(j,N) also changes with NNN and is not integrable uniformly in NNN; only the convergence of its expectations is assumed. For small NNN, ∑j∈SNPj(N)w(j,N)\sum_{j\in S_N}P_j(N)w(j,N)∑j∈SN​​Pj​(N)w(j,N) may even be infinite, and then ∑j∈SNPj(N)u(j,N)\sum_{j\in S_N} P_j(N)u(j,N)∑j∈SN​​Pj​(N)u(j,N) has no value.

A second difficulty is bookkeeping in the extended reals. Lower limits may be ±∞\pm\infty±∞, products use 0⋅∞=00\cdot\infty=00⋅∞=0, and a sum with a +∞+\infty+∞ term and a −∞-\infty−∞ term is undefined. The inequality of Proposition A.1.5 holds only when that indeterminate form is excluded. The bound u≥−Lu\ge -Lu≥−L in A.2.1 and A.2.5 cannot be dropped: Examples A.1.9 and A.2.2 of the book show the inequalities fail without it.

Formalization scope

  • Types. SSS is any type with [Countable S]. Probabilities are ℝ≥0∞-valued with ∑' j, P j = 1, and Pj(N)P_j(N)Pj​(N) is Q N j. Extended-real values are EReal, and nonnegative extended values (A.1.7, A.1.8) are ℝ≥0∞. Limits and lower and upper limits are along atTop in ℕ. The book's N≥N0N\ge N_0N≥N0​ convention (Remark A.1.2) needs nothing extra, since only large NNN matter.
  • Sums over SNS_NSN​ are sums over SSS of (SN N).indicator (Q N) times the function. Values of u(j,N)u(j,N)u(j,N) and Pj(N)P_j(N)Pj​(N) for j∉SNj\notin S_Nj∈/SN​ never enter any statement, and the hypotheses on uuu (u≥−Lu\ge -Lu≥−L, ∣u∣≤w|u|\le w∣u∣≤w) are imposed only on SNS_NSN​, as in the book.
  • Weighted sums are wsum, the difference of the weighted positive and negative parts, each in [0,∞]. When both are infinite the book's sum is undefined and wsum returns −∞-\infty−∞. Every sum used in a hypothesis or conclusion is defined, except possibly for finitely many NNN in limit statements, where it does not matter.
  • Limits of u(j,N)u(j,N)u(j,N) and w(j,N)w(j,N)w(j,N) are taken in EReal, since the book allows extended-real limits (p. 271). The hypotheses force them to be finite wherever Pj>0P_j>0Pj​>0.
  • Ruled out. Statements in which wsum returns its junk value −∞-\infty−∞ could make an inequality trivial. Every left-hand side here is a lower limit of sums whose negative parts are bounded, or a limit of eventually defined sums, so no statement holds only because of that junk value. Real-valued tsum with its junk value 000 is not used anywhere.
  • Welcome contributions. A proof of A.1.7 from lintegral_liminf_le for the counting measure, and lemmas relating wsum to Mathlib's tsum and to integrals against Measure.sum (fun j => P j • dirac j), can be reused by the other missions of this series.

Selected references

  • L. I. Sennott, Stochastic Dynamic Programming and the Control of Queueing Systems, Wiley Series in Probability and Statistics, John Wiley & Sons, 1999, Appendix A, pp. 270–278. https://doi.org/10.1002/9780470317037
  • H. L. Royden, Real Analysis, 3rd ed., Macmillan, 1988, Chapter 4 (Fatou's lemma, generalized Lebesgue convergence theorem).
  • The Mathlib Community, The Lean Mathematical Library, CPP 2020, https://doi.org/10.1145/3372885.3373824 (MeasureTheory.lintegral_liminf_le, MeasureTheory.tendsto_integral_of_dominated_convergence).
12 thms3 active usersReviewed
🏆Completed
Functional AnalysisMathematical Physics·Captain: mikedeng1

Mathematical Methods in Quantum Mechanics V: Stone's Theorem and the RAGE TheoremTextbook

Motivation

In quantum mechanics the state of a system at time ttt is ψ(t)=e−itAψ\psi(t) = \mathrm e^{-\mathrm itA}\psiψ(t)=e−itAψ, where the Hamiltonian AAA is a self-adjoint operator. The spectral theorem splits the Hilbert space into subspaces according to the type of the spectral measure of a vector (absolutely continuous, singularly continuous, pure point). That splitting is defined through measure theory, and it is not evident what it has to do with the motion of the system. The RAGE theorem, named after Ruelle (1969), Amrein and Georgescu (1973) and Enß (1978), answers this. Vectors in the continuous subspace are exactly the states that, on time average, leave every bounded region: the scattering states. Vectors in the pure point subspace are exactly the states that stay in a bounded region uniformly in time: the bound states. This dynamical characterization is the starting point of the geometric approach to scattering theory and of the modern theory of quantum dynamics and transport.

This mission formalizes Chapter 5 of Teschl's Mathematical Methods in Quantum Mechanics (AMS GSM 99, 2009). The chapter covers the time evolution e−itA\mathrm e^{-\mathrm itA}e−itA as a unitary group, Wiener's theorem on Fourier transforms of measures, and the abstract RAGE theorem with its Heisenberg-picture corollaries.

Setting

Let H\mathfrak HH be a complex Hilbert space with inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩, conjugate linear in the first argument. An operator AAA is a linear map defined on a subspace D(A)\mathfrak D(A)D(A), its domain. AAA is self-adjoint if D(A)\mathfrak D(A)D(A) is dense and A=A∗A = A^*A=A∗. L(H)\mathfrak L(\mathfrak H)L(H) denotes the bounded, everywhere defined operators.

A projection-valued measure PPP assigns to each Borel set Ω⊆R\Omega \subseteq \mathbb RΩ⊆R an orthogonal projection P(Ω)P(\Omega)P(Ω), with P(R)=IP(\mathbb R) = \mathbb IP(R)=I and P(⋃nΩn)ψ=∑nP(Ωn)ψP(\bigcup_n \Omega_n)\psi = \sum_n P(\Omega_n)\psiP(⋃n​Ωn​)ψ=∑n​P(Ωn​)ψ for disjoint Ωn\Omega_nΩn​. The spectral measure of ψ\psiψ is the finite Borel measure μψ(Ω)=⟨ψ,P(Ω)ψ⟩\mu_\psi(\Omega) = \langle\psi, P(\Omega)\psi\rangleμψ​(Ω)=⟨ψ,P(Ω)ψ⟩. The spectral theorem says that every self-adjoint AAA is A=∫λ dP(λ)A = \int \lambda\, dP(\lambda)A=∫λdP(λ) for a unique P=PAP = P_AP=PA​. Then D(A)={ψ∣∫λ2 dμψ<∞}\mathfrak D(A) = \{\psi \mid \int\lambda^2\, d\mu_\psi < \infty\}D(A)={ψ∣∫λ2dμψ​<∞} and ⟨ψ,Aψ⟩=∫λ dμψ(λ)\langle\psi, A\psi\rangle = \int\lambda\, d\mu_\psi(\lambda)⟨ψ,Aψ⟩=∫λdμψ​(λ). For a bounded Borel function fff, f(A)f(A)f(A) is the bounded operator with ⟨ψ,f(A)ψ⟩=∫f dμψ\langle\psi, f(A)\psi\rangle = \int f\, d\mu_\psi⟨ψ,f(A)ψ⟩=∫fdμψ​. The time evolution is U(t)=e−itAU(t) = \mathrm e^{-\mathrm itA}U(t)=e−itA, the case f(λ)=e−itλf(\lambda) = \mathrm e^{-\mathrm it\lambda}f(λ)=e−itλ.

The spectral subspaces are

Hac={ψ∣μψ≪Lebesgue},Hsc={ψ∣μψ singular, without atoms},Hpp={ψ∣μψ supported on a countable set},\mathfrak H_{ac} = \{\psi \mid \mu_\psi \ll \text{Lebesgue}\},\quad \mathfrak H_{sc} = \{\psi \mid \mu_\psi \text{ singular, without atoms}\},\quad \mathfrak H_{pp} = \{\psi \mid \mu_\psi \text{ supported on a countable set}\},Hac​={ψ∣μψ​≪Lebesgue},Hsc​={ψ∣μψ​ singular, without atoms},Hpp​={ψ∣μψ​ supported on a countable set},

and the continuous subspace is Hc=Hac⊕Hsc\mathfrak H_c = \mathfrak H_{ac} \oplus \mathfrak H_{sc}Hc​=Hac​⊕Hsc​. The projectors Pac,Pc,PppP^{ac}, P^c, P^{pp}Pac,Pc,Ppp are the orthogonal projections onto these subspaces. σp(A)\sigma_p(A)σp​(A) is the set of eigenvalues of AAA.

A finite rank operator is a K∈L(H)K \in \mathfrak L(\mathfrak H)K∈L(H) with finite dimensional range. The compact operators C(H)\mathfrak C(\mathfrak H)C(H) are the norm closure of the finite rank operators. For zzz in the resolvent set ρ(A)\rho(A)ρ(A), RA(z)=(A−z)−1∈L(H)R_A(z) = (A - z)^{-1} \in \mathfrak L(\mathfrak H)RA​(z)=(A−z)−1∈L(H). An operator KKK is relatively compact with respect to AAA if KRA(z)∈C(H)K R_A(z) \in \mathfrak C(\mathfrak H)KRA​(z)∈C(H) for one z∈ρ(A)z \in \rho(A)z∈ρ(A); in particular D(A)⊆D(K)\mathfrak D(A) \subseteq \mathfrak D(K)D(A)⊆D(K). The Fourier transform of a finite complex Borel measure μ\muμ on R\mathbb RR is μ^(t)=∫Re−itλ dμ(λ)\hat\mu(t) = \int_{\mathbb R} \mathrm e^{-\mathrm it\lambda}\, d\mu(\lambda)μ^​(t)=∫R​e−itλdμ(λ).

Formalization targets

Goal: the RAGE theorem (Theorem 5.7)

Let AAA be self-adjoint and let Kn∈L(H)K_n \in \mathfrak L(\mathfrak H)Kn​∈L(H) be relatively compact operators converging strongly to I\mathbb II. Then

Hc={ψ  ∣  lim⁡n→∞lim⁡T→∞1T∫0T∥Kne−itAψ∥ dt=0},Hpp={ψ  ∣  lim⁡n→∞sup⁡t≥0∥(I−Kn)e−itAψ∥=0}.\mathfrak H_c = \Big\{\psi \;\Big|\; \lim_{n\to\infty}\lim_{T\to\infty} \frac1T\int_0^T \|K_n\mathrm e^{-\mathrm itA}\psi\|\, dt = 0\Big\},\qquad \mathfrak H_{pp} = \Big\{\psi \;\Big|\; \lim_{n\to\infty}\sup_{t\ge0} \|(\mathbb I - K_n)\mathrm e^{-\mathrm itA}\psi\| = 0\Big\}.Hc​={ψ​n→∞lim​T→∞lim​T1​∫0T​∥Kn​e−itAψ∥dt=0},Hpp​={ψ​n→∞lim​t≥0sup​∥(I−Kn​)e−itAψ∥=0}.

Milestones

  • Theorem 5.1. U(t)=e−itAU(t) = \mathrm e^{-\mathrm itA}U(t)=e−itA is a strongly continuous one-parameter unitary group. lim⁡t→01t(U(t)ψ−ψ)\lim_{t\to0}\frac1t(U(t)\psi - \psi)limt→0​t1​(U(t)ψ−ψ) exists iff ψ∈D(A)\psi \in \mathfrak D(A)ψ∈D(A), and then it equals −iAψ-\mathrm iA\psi−iAψ. U(t)D(A)=D(A)U(t)\mathfrak D(A) = \mathfrak D(A)U(t)D(A)=D(A) and AU(t)=U(t)AAU(t) = U(t)AAU(t)=U(t)A.
  • Theorem 5.4 (Wiener). lim⁡T→∞1T∫0T∣μ^(t)∣2 dt=∑λ∈R∣μ({λ})∣2\displaystyle\lim_{T\to\infty}\frac1T\int_0^T|\hat\mu(t)|^2\,dt = \sum_{\lambda\in\mathbb R}|\mu(\{\lambda\})|^2T→∞lim​T1​∫0T​∣μ^​(t)∣2dt=λ∈R∑​∣μ({λ})∣2, and the sum is finite.
  • Lemma 5.5. C(H)\mathfrak C(\mathfrak H)C(H) is a closed ∗*∗-ideal in L(H)\mathfrak L(\mathfrak H)L(H).
  • Theorem 5.6. For relatively compact KKK and ψ∈D(A)\psi \in \mathfrak D(A)ψ∈D(A): 1T∫0T∥Ke−itAPcψ∥2dt→0\frac1T\int_0^T\|K\mathrm e^{-\mathrm itA}P^c\psi\|^2dt \to 0T1​∫0T​∥Ke−itAPcψ∥2dt→0 and ∥Ke−itAPacψ∥→0\|K\mathrm e^{-\mathrm itA}P^{ac}\psi\| \to 0∥Ke−itAPacψ∥→0. For bounded KKK this holds for all ψ\psiψ.
  • Theorem 5.8. lim⁡T→∞1T∫0TeitAKe−itAψ dt=∑λ∈σp(A)PA({λ})KPA({λ})ψ\displaystyle\lim_{T\to\infty}\frac1T\int_0^T \mathrm e^{\mathrm itA}K\mathrm e^{-\mathrm itA}\psi\,dt = \sum_{\lambda\in\sigma_p(A)}P_A(\{\lambda\})KP_A(\{\lambda\})\psiT→∞lim​T1​∫0T​eitAKe−itAψdt=λ∈σp​(A)∑​PA​({λ})KPA​({λ})ψ for ψ∈D(A)\psi \in \mathfrak D(A)ψ∈D(A), and for all ψ\psiψ if KKK is bounded.
  • Corollary 5.9. Under the RAGE assumptions, the iterated time averages of eitAKne−itAψ\mathrm e^{\mathrm itA}K_n\mathrm e^{-\mathrm itA}\psieitAKn​e−itAψ and of eitA(I−Kn)e−itAψ\mathrm e^{\mathrm itA}(\mathbb I - K_n)\mathrm e^{-\mathrm itA}\psieitA(I−Kn​)e−itAψ converge to PppψP^{pp}\psiPppψ and to PcψP^c\psiPcψ.

Significance

The RAGE theorem connects the spectral types of the Hamiltonian with observable long-time behaviour. For Schrödinger operators −Δ+V-\Delta + V−Δ+V on L2(Rn)L^2(\mathbb R^n)L2(Rn), taking KnK_nKn​ to be multiplication by the indicator of the ball of radius nnn gives a sequence of relatively compact operators. The theorem then says that states in Hc\mathfrak H_cHc​ spend, on time average, a vanishing fraction of time in every ball, while states in Hpp\mathfrak H_{pp}Hpp​ stay uniformly localized. Enß's proof of asymptotic completeness for short-range potentials rests on this characterization. The same argument, through Wiener's theorem, is used to relate the fractal dimensions of spectral measures to rates of quantum transport. Theorem 5.8 and Corollary 5.9 describe the asymptotic observables of the Heisenberg picture.

These results are classical and proved in the literature. They are not formalized. Mathlib has neither a spectral theorem nor a functional calculus for unbounded self-adjoint operators, and no decomposition of a Hilbert space by spectral type. What the platform has are Stone's theorem in the separate BookProof development (for weakly measurable groups, with its own structure of unbounded self-adjoint operators) and the discrete-time von Neumann mean ergodic theorem for contractions. The mean ergodic theorem is related to Theorem 5.8 with K=IK = \mathbb IK=I but is a different statement. This mission formalizes the continuous-time, spectral-type-resolved statements.

Difficulty

The two sides of the RAGE characterization are defined in unrelated terms. Hc\mathfrak H_cHc​ and Hpp\mathfrak H_{pp}Hpp​ are defined by properties of the scalar measures μψ\mu_\psiμψ​, while the conditions in (5.14) concern norms of vectors moving under a unitary group and seen through operators that are only relatively compact. Wiener's theorem controls scalar quantities ⟨φ,e−itAψ⟩\langle\varphi, \mathrm e^{-\mathrm itA}\psi\rangle⟨φ,e−itAψ⟩. Passing to norms ∥Ke−itAψ∥\|K\mathrm e^{-\mathrm itA}\psi\|∥Ke−itAψ∥ needs compactness, and relative compactness only gives compactness after composing with a resolvent, which is where the restriction to D(A)\mathfrak D(A)D(A) in Theorems 5.6 and 5.8 comes from. The pure point characterization needs control that is uniform in t≥0t \ge 0t≥0, so a limit over nnn has to be exchanged with a supremum over all times. The limits in (5.14) and (5.19)–(5.20) are iterated, not joint, and a naive exchange of the two limits is not justified. Summing over σp(A)\sigma_p(A)σp​(A) in (5.18) needs an unconditionally convergent sum over a possibly uncountable index set. Wiener's theorem itself needs a Fubini argument for a complex measure against its conjugate.

Formalization scope

The formalization uses Lean 4 with Mathlib. Operators are partially defined linear maps (LinearPMap, H →ₗ.[ℂ] H) on a complex Hilbert space. Self-adjointness is Mathlib's IsSelfAdjoint, which includes density of the domain. The Hilbert space is not assumed separable.

The spectral theorem is not part of this mission. Every statement about AAA takes a projection-valued measure PPP on the Borel sets of R\mathbb RR as data, together with the hypothesis that A=∫λ dP(λ)A = \int\lambda\, dP(\lambda)A=∫λdP(λ): D(A)={ψ∣∫λ2dμψ<∞}\mathfrak D(A) = \{\psi \mid \int\lambda^2 d\mu_\psi < \infty\}D(A)={ψ∣∫λ2dμψ​<∞} and ⟨ψ,Aψ⟩=∫λ dμψ\langle\psi, A\psi\rangle = \int\lambda\,d\mu_\psi⟨ψ,Aψ⟩=∫λdμψ​ there. This is the form the spectral theorem guarantees, and it makes PA=PP_A = PPA​=P. The time evolution e−itA\mathrm e^{-\mathrm itA}e−itA is the bounded operator P(λ↦e−itλ)P(\lambda \mapsto \mathrm e^{-\mathrm it\lambda})P(λ↦e−itλ), determined by its quadratic form, and eitA\mathrm e^{\mathrm itA}eitA is its value at −t-t−t. Nothing else the book derives is assumed.

The spectral subspaces are sets of vectors defined only from the spectral measures, as above, and Hc\mathfrak H_cHc​ is the set of sums of a vector of Hac\mathfrak H_{ac}Hac​ and a vector of Hsc\mathfrak H_{sc}Hsc​. A formalization that defined Hc\mathfrak H_cHc​ or Hpp\mathfrak H_{pp}Hpp​ by the dynamical conditions of (5.14) would make the goal a tautology; that is ruled out here. PcP^cPc, PacP^{ac}Pac, PppP^{pp}Ppp are the orthogonal projections onto the closed linear spans of these sets. Compact operators are the norm closure of the finite rank operators (the book's definition), not Mathlib's IsCompactOperator. Relative compactness asks for one z∈ρ(A)z \in \rho(A)z∈ρ(A), its resolvent RRR, and a compact CCC with Ran⁡R⊆D(K)\operatorname{Ran} R \subseteq \mathfrak D(K)RanR⊆D(K) and KR=CKR = CKR=C. "KKK bounded" means an everywhere defined K∈L(H)K \in \mathfrak L(\mathfrak H)K∈L(H).

Iterated limits lim⁡nlim⁡T\lim_n\lim_Tlimn​limT​ are stated as: for every nnn the inner limit exists, and the sequence of inner limits converges. The supremum over t≥0t \ge 0t≥0 is taken in [0,∞][0,\infty][0,∞]. Time averages use interval integrals, with Bochner integrals for vector-valued integrands; all integrands are continuous in ttt. Wiener's theorem uses Mathlib's ComplexMeasure ℝ and its vector-measure integral. The sum over λ∈R\lambda \in \mathbb Rλ∈R is an unconditional sum whose summability is part of the conclusion, and the sum over σp(A)\sigma_p(A)σp​(A) is an unconditional sum in H\mathfrak HH. The Fourier transform has the book's normalization.

A complete development needs a functional calculus for projection-valued measures (multiplicativity, strong continuity in the function argument), the reduction of AAA by the spectral subspaces (Lemma 3.19), the Riemann–Lebesgue lemma for absolutely continuous measures, and the approximation of compact operators by finite rank ones. These pieces are reusable across the rest of the book, notably for scattering theory. Proofs of any milestone, and of such supporting lemmas, are welcome.

Selected references

  • G. Teschl, Mathematical Methods in Quantum Mechanics, With Applications to Schrödinger Operators, Graduate Studies in Mathematics 99, American Mathematical Society, 2009. doi:10.1090/gsm/099. Chapter 5, pp. 123–132.
  • D. Ruelle, A remark on bound states in potential-scattering theory, Il Nuovo Cimento A 61 (1969), 655–662. doi:10.1007/BF02819607.
  • W. O. Amrein and V. Georgescu, On the characterization of bound states and scattering states in quantum mechanics, Helvetica Physica Acta 46 (1973), 635–658 (archive: e-periodica.ch).
  • V. Enss, Asymptotic completeness for quantum mechanical potential scattering. I. Short range potentials, Communications in Mathematical Physics 61 (1978), 285–291. doi:10.1007/BF01940771.
  • M. H. Stone, On one-parameter unitary groups in Hilbert space, Annals of Mathematics 33 (1932), 643–648. doi:10.2307/1968538.
16 thms3 active usersReviewed
🏆Completed
Dynamical Systems·Captain: mikedeng1

Ordinary Differential Equations and Dynamical Systems X: Periodic Orbits and the Poincaré MapTextbook

Motivation

Periodic solutions are the simplest non-stationary long-time behaviour of an autonomous system x˙=f(x)\dot x = f(x)x˙=f(x): limit cycles in oscillators and population models, closed orbits of conservative systems. The first question about a periodic orbit is whether it is stable. Poincaré introduced the first-return map on a transversal section, which turns this question into a question about a fixed point of a map in one dimension less. Floquet theory attacks the same question through the linear periodic system obtained by linearizing along the orbit. This mission formalizes Chapter 12, §§12.1–12.2 of G. Teschl, Ordinary Differential Equations and Dynamical Systems (AMS Graduate Studies in Mathematics 140, 2012; author's preliminary version, DOI of the published book). That chapter proves the two approaches agree and derives the standard stability and persistence criteria from this.

Setting

Let M⊆RnM \subseteq \mathbb{R}^nM⊆Rn be open, f∈Ck(M,Rn)f \in C^k(M, \mathbb{R}^n)f∈Ck(M,Rn) with k≥1k \ge 1k≥1, and let Φ(t,x)\Phi(t, x)Φ(t,x) be the flow of x˙=f(x)\dot x = f(x)x˙=f(x) with maximal intervals IxI_xIx​: t↦Φ(t,x)t \mapsto \Phi(t,x)t↦Φ(t,x) is the unique maximal solution with Φ(0,x)=x\Phi(0,x) = xΦ(0,x)=x. A point x0∈Mx_0 \in Mx0​∈M is periodic with period T>0T > 0T>0 if Φ(T,x0)=x0\Phi(T, x_0) = x_0Φ(T,x0​)=x0​ and Φ(t,x0)≠x0\Phi(t, x_0) \neq x_0Φ(t,x0​)=x0​ for 0<t<T0 < t < T0<t<T. Its orbit γ(x0)={Φ(t,x0)}\gamma(x_0) = \{\Phi(t, x_0)\}γ(x0​)={Φ(t,x0​)} is then a closed curve.

Linearization along the orbit. Put A(t)=dfΦ(t,x0)A(t) = df_{\Phi(t, x_0)}A(t)=dfΦ(t,x0​)​, a TTT-periodic matrix. The first variational equation is y˙=A(t)y\dot y = A(t) yy˙​=A(t)y, and Πx0(t,t0)\Pi_{x_0}(t, t_0)Πx0​​(t,t0​) denotes its principal matrix solution: ∂tΠ=A(t)Π\partial_t \Pi = A(t)\Pi∂t​Π=A(t)Π, Π(t0,t0)=I\Pi(t_0, t_0) = \mathbb{I}Π(t0​,t0​)=I. The monodromy matrix based at Φ(t0,x0)\Phi(t_0,x_0)Φ(t0​,x0​) is

Mx0(t0)=∂ΦT∂x(Φ(t0,x0)).M_{x_0}(t_0) = \frac{\partial \Phi_T}{\partial x}\big(\Phi(t_0, x_0)\big).Mx0​​(t0​)=∂x∂ΦT​​(Φ(t0​,x0​)).

The Poincaré map. A transversal section is Σ={x∈U∣S(x)=0}\Sigma = \{x \in U \mid S(x) = 0\}Σ={x∈U∣S(x)=0} with UUU open, S∈Ck(U)S \in C^k(U)S∈Ck(U), ∂S/∂x≠0\partial S/\partial x \ne 0∂S/∂x=0 and (∂S/∂x) f≠0(\partial S/\partial x)\, f \neq 0(∂S/∂x)f=0 on Σ\SigmaΣ. If x0∈Σx_0 \in \Sigmax0​∈Σ there is a CkC^kCk return time τ\tauτ near x0x_0x0​ with τ(x0)=T\tau(x_0) = Tτ(x0​)=T and Φ(τ(y),y)∈Σ\Phi(\tau(y), y) \in \SigmaΦ(τ(y),y)∈Σ. The Poincaré map is

PΣ(y)=Φ(τ(y),y).P_\Sigma(y) = \Phi(\tau(y), y).PΣ​(y)=Φ(τ(y),y).

Its derivative dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) is a linear map of the (n−1)(n-1)(n−1)-dimensional tangent space Tx0Σ=ker⁡∂S∂x(x0)T_{x_0}\Sigma = \ker \frac{\partial S}{\partial x}(x_0)Tx0​​Σ=ker∂x∂S​(x0​) into itself.

Stability. The orbit γ\gammaγ is stable if every neighborhood UUU of γ\gammaγ contains a neighborhood VVV of γ\gammaγ from which solutions stay in UUU for all t≥0t \ge 0t≥0. It is asymptotically stable if moreover d(Φ(t,x),γ)→0d(\Phi(t,x), \gamma) \to 0d(Φ(t,x),γ)→0 for all xxx in some neighborhood of γ\gammaγ. A periodic orbit is hyperbolic if dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) has no eigenvalue on the unit circle.

Formalization targets

Goal: Theorem 12.4

For every t0∈Rt_0 \in \mathbb{R}t0​∈R,

χMx0(t0)(X)=(X−1) χdPΣ(x0)(X),\chi_{M_{x_0}(t_0)}(X) = (X - 1)\,\chi_{dP_\Sigma(x_0)}(X),χMx0​​(t0​)​(X)=(X−1)χdPΣ​(x0​)​(X),

where χ\chiχ is the characteristic polynomial. So the eigenvalues of dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) together with the single value 111 are exactly the eigenvalues of the monodromy matrix, with multiplicities. In particular they depend neither on the section Σ\SigmaΣ nor on the base point on the orbit.

Milestones

  • Lemma 12.1. Πx0(t,t0)=∂Φt−t0∂x(Φ(t0,x0))\Pi_{x_0}(t,t_0) = \frac{\partial\Phi_{t-t_0}}{\partial x}(\Phi(t_0,x_0))Πx0​​(t,t0​)=∂x∂Φt−t0​​​(Φ(t0​,x0​)), and f(Φ(t,x0))=Πx0(t,t0)f(Φ(t0,x0))f(\Phi(t,x_0)) = \Pi_{x_0}(t,t_0) f(\Phi(t_0,x_0))f(Φ(t,x0​))=Πx0​​(t,t0​)f(Φ(t0​,x0​)).
  • Corollary 12.3. If every eigenvalue of dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) has modulus <1< 1<1, then γ(x0)\gamma(x_0)γ(x0​) is asymptotically stable.
  • Corollary 12.5. det⁡dPΣ(x0)=det⁡Mx0(t0)≠0\det dP_\Sigma(x_0) = \det M_{x_0}(t_0) \neq 0detdPΣ​(x0​)=detMx0​​(t0​)=0, and PΣP_\SigmaPΣ​ is a local CkC^kCk diffeomorphism of Σ\SigmaΣ at x0x_0x0​.
  • Lemma 12.6. For n=2n = 2n=2, γ(x0)\gamma(x_0)γ(x0​) is asymptotically stable if ∫0Tdiv⁡f(Φ(t,x0)) dt<0\int_0^T \operatorname{div} f(\Phi(t,x_0))\,dt < 0∫0T​divf(Φ(t,x0​))dt<0 and unstable if the integral is positive.
  • Lemma 12.7. If f(x,0)f(x,0)f(x,0) has a hyperbolic periodic orbit through x0x_0x0​ and f(x,μ)f(x,\mu)f(x,μ) is CkC^kCk, then on a neighborhood of μ=0\mu = 0μ=0 there is a CkC^kCk family x0(μ)x_0(\mu)x0​(μ) with x0(0)=x0x_0(0) = x_0x0​(0)=x0​ and each x0(μ)x_0(\mu)x0​(μ) periodic for f(⋅,μ)f(\cdot,\mu)f(⋅,μ).

Significance

The result. Theorem 12.4 is the bridge between the two standard tools for periodic orbits. The Floquet multipliers of y˙=A(t)y\dot y = A(t)yy˙​=A(t)y can often be computed or estimated, for instance through Liouville's formula det⁡Mx0(t0)=exp⁡∫0Tdiv⁡f(Φ(t,x0)) dt\det M_{x_0}(t_0) = \exp\int_0^T \operatorname{div} f(\Phi(t,x_0))\,dtdetMx0​​(t0​)=exp∫0T​divf(Φ(t,x0​))dt. The Poincaré map is where the dynamics is decided, for instance through the fixed-point stability theory of maps. Corollaries 12.3 and 12.5 and Lemma 12.6 are the resulting stability tests. Lemma 12.7 is the structural-stability statement for hyperbolic orbits that bifurcation theory starts from. Theorems 12.8–12.10 (stable manifolds of periodic orbits) build on the same objects.

Formalizing it. All results are classical and proved in the book. None has a machine-checked proof on the platform or, as far as is known, in Mathlib, which has neither Poincaré maps nor the linearization of flows along orbits. The work is a formalization of the known proofs. It needs differentiability of the flow with respect to initial conditions, and that part is reusable across the whole of qualitative ODE theory.

Difficulty

The algebra of Theorem 12.4 is short. The two linear maps act on different spaces: Mx0(0)M_{x_0}(0)Mx0​​(0) on Rn\mathbb{R}^nRn, and dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) on the hyperplane Tx0ΣT_{x_0}\SigmaTx0​​Σ. That hyperplane is in general not orthogonal to f(x0)f(x_0)f(x0​), not a coordinate hyperplane, and not invariant under Mx0(0)M_{x_0}(0)Mx0​​(0). Any comparison has to go through the derivative of y↦Φ(τ(y),y)y \mapsto \Phi(\tau(y), y)y↦Φ(τ(y),y), which involves the derivative of the implicitly defined return time. Behind all this sits the differentiability of Φ\PhiΦ in xxx and the variational equation it satisfies, which Mathlib does not provide for local flows. For the stability milestones, the delicate step is passing from the discrete iterates of PΣP_\SigmaPΣ​ on Σ\SigmaΣ back to the continuous flow near the whole orbit. That requires uniform control over one period.

Formalization scope

The state space is Fin n → ℝ. Norm-dependent notions (distance to the orbit, neighborhoods) do not depend on the choice of norm. The flow is local: IsMaximalFlow f M I Φ characterizes Φ\PhiΦ and IxI_xIx​ by maximality and uniqueness, and Φ\PhiΦ's values outside its domain are never used. Derivatives are Mathlib's fderiv. The section Σ\SigmaΣ is the book's general {S=0}\{S = 0\}{S=0} with (∂S/∂x)f≠0(\partial S/\partial x)f \neq 0(∂S/∂x)f=0, not a hyperplane chosen orthogonal to f(x0)f(x_0)f(x0​). The return time τ\tauτ is any CkC^kCk function on a neighborhood of x0x_0x0​ with τ(x0)=T\tau(x_0) = Tτ(x0​)=T and Φ(τ(y),y)∈Σ\Phi(\tau(y),y) \in \SigmaΦ(τ(y),y)∈Σ; such a function agrees with the book's τ\tauτ near x0x_0x0​. dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) is an endomorphism L of LinearMap.ker (fderiv ℝ S x₀) that agrees with the derivative of y↦Φ(τ(y),y)y \mapsto \Phi(\tau(y), y)y↦Φ(τ(y),y) there (IsPoincareDerivative). Theorems 12.4 and 12.5 assert that it exists. Eigenvalues are complex roots of characteristic polynomials.

Conventions and readings:

  • The goal compares characteristic polynomials, so multiplicities count. Equality of eigenvalue sets, a statement at a single convenient t0t_0t0​, or a hyperplane section would each be weaker than the book's theorem and do not count as solving the goal.
  • The monodromy matrix is ∂ΦT∂x(Φ(t0,x0))\frac{\partial\Phi_T}{\partial x}(\Phi(t_0,x_0))∂x∂ΦT​​(Φ(t0​,x0​)). The book prints ΦT−t0\Phi_{T-t_0}ΦT−t0​​ on p. 316, a typo inconsistent with (12.5) and (12.8).
  • "Periodic orbit" means positive least period. Fixed points are excluded, since there is no transversal section through them. In dimension n≤1n \le 1n≤1 no such orbit exists, and the statements are vacuous there as in the book.
  • "Hyperbolic periodic orbit" is not defined in the preliminary version. The definition used is the one the proof of Lemma 12.7 uses: no eigenvalue of dPΣ(x0)dP_\Sigma(x_0)dPΣ​(x0​) on the unit circle, for some transversal section.
  • Lemma 12.7: "in a sufficiently small neighborhood of 000" is read as: there exists an open W∋0W \ni 0W∋0 inside the parameter set on which x0(⋅)x_0(\cdot)x0​(⋅) is CkC^kCk. The parameter lies in Rp\mathbb{R}^pRp.
  • Corollary 12.5: "local diffeomorphism at x0x_0x0​" is read as: PΣP_\SigmaPΣ​ maps W∩ΣW \cap \SigmaW∩Σ bijectively onto W′∩ΣW' \cap \SigmaW′∩Σ for open W,W′∋x0W, W' \ni x_0W,W′∋x0​, with an inverse that is the restriction of a CkC^kCk map on W′W'W′.
  • (12.1) is stated for all xxx in a neighborhood of the orbit. The book writes U(x0)U(x_0)U(x0​) right after introducing U(γ(x0))U(\gamma(x_0))U(γ(x0​)).

Needed infrastructure: existence, uniqueness and CkC^kCk dependence on initial conditions for local flows; the implicit function theorem (Mathlib); characteristic polynomials and determinants of endomorphisms of finite-dimensional subspaces (Mathlib); Liouville's formula; stability of fixed points of C1C^1C1 maps with contracting linearization. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • G. Teschl, Ordinary Differential Equations and Dynamical Systems, Graduate Studies in Mathematics 140, AMS, 2012. https://doi.org/10.1090/gsm/140 (preliminary version: https://www.mat.univie.ac.at/~gerald/ftp/book-ode/ode.pdf)
  • H. Poincaré, Mémoire sur les courbes définies par une équation différentielle, J. Math. Pures Appl. (3) 7 (1881) 375–422. http://www.numdam.org/item/JMPA_1881_3_7__375_0/
  • G. Floquet, Sur les équations différentielles linéaires à coefficients périodiques, Ann. Sci. ÉNS (2) 12 (1883) 47–88. https://doi.org/10.24033/asens.220
  • P. Hartman, Ordinary Differential Equations, 2nd ed., SIAM Classics in Applied Mathematics 38, 2002. https://doi.org/10.1137/1.9780898719222
22 thms3 active usersReviewed
🏆Completed
Functional AnalysisMathematical Physics·Captain: mikedeng1

Mathematical Methods in Quantum Mechanics X: The Uncertainty Principle and the Harmonic OscillatorTextbook

Motivation

The quantum harmonic oscillator is the Schrödinger operator of a particle in a quadratic potential. It describes small vibrations around an equilibrium, the modes of the electromagnetic field, and phonons in a crystal. It is also one of the very few Schrödinger operators whose spectrum and eigenfunctions are known in closed form. The eigenvalues are equally spaced, and the eigenfunctions are Hermite functions. Its algebraic treatment by creation and annihilation operators goes back to Dirac (The Principles of Quantum Mechanics, 1930). That treatment became the template for second quantization and Fock space.

The same chapter of G. Teschl's Mathematical Methods in Quantum Mechanics (AMS Graduate Studies in Mathematics 99, 2009, Chapter 8, AMS page) contains two further results that use commutation relations. The first is the Heisenberg uncertainty principle (Heisenberg 1927; the general form for two observables is due to Robertson, Phys. Rev. 34 (1929)). The second is an abstract statement that A∗AA^*AA∗A and AA∗AA^*AA∗ have the same spectrum away from 000. Physicists call this supersymmetric quantum mechanics, and Teschl uses it later for the hydrogen atom. This mission follows Teschl's Sections 8.1–8.4.

Setting

Let H\mathfrak HH be a complex Hilbert space. A linear operator AAA is a linear map defined on a subspace D(A)⊆H\mathfrak D(A) \subseteq \mathfrak HD(A)⊆H, its domain. AAA is symmetric if D(A)\mathfrak D(A)D(A) is dense and ⟨φ,Aψ⟩=⟨Aφ,ψ⟩\langle \varphi, A\psi\rangle = \langle A\varphi, \psi\rangle⟨φ,Aψ⟩=⟨Aφ,ψ⟩ for all φ,ψ∈D(A)\varphi, \psi \in \mathfrak D(A)φ,ψ∈D(A). For a closed operator AAA and z∈Cz \in \mathbb Cz∈C, the resolvent RA(z)=(A−z)−1R_A(z) = (A - z)^{-1}RA​(z)=(A−z)−1 exists when A−zA - zA−z maps D(A)\mathfrak D(A)D(A) bijectively onto H\mathfrak HH with a bounded inverse. The resolvent set ρ(A)\rho(A)ρ(A) is the set of such zzz, and the spectrum is σ(A)=C∖ρ(A)\sigma(A) = \mathbb C \setminus \rho(A)σ(A)=C∖ρ(A). An operator is essentially self-adjoint on its domain if its closure A‾\overline AA is self-adjoint.

For ψ∈D(A)\psi \in \mathfrak D(A)ψ∈D(A) with ∥ψ∥=1\|\psi\| = 1∥ψ∥=1 (a state), the expectation is Eψ(A)=⟨ψ,Aψ⟩\mathbb E_\psi(A) = \langle\psi, A\psi\rangleEψ​(A)=⟨ψ,Aψ⟩ and the mean-square deviation is Δψ(A)=∥(A−Eψ(A))ψ∥\Delta_\psi(A) = \|(A - \mathbb E_\psi(A))\psi\|Δψ​(A)=∥(A−Eψ​(A))ψ∥. The commutator is [A,B]ψ=ABψ−BAψ[A,B]\psi = AB\psi - BA\psi[A,B]ψ=ABψ−BAψ for ψ∈D(AB)∩D(BA)\psi \in \mathfrak D(AB) \cap \mathfrak D(BA)ψ∈D(AB)∩D(BA), where D(AB)={ψ∈D(B)∣Bψ∈D(A)}\mathfrak D(AB) = \{\psi \in \mathfrak D(B) \mid B\psi \in \mathfrak D(A)\}D(AB)={ψ∈D(B)∣Bψ∈D(A)}.

Fix a frequency ω>0\omega > 0ω>0. On R3\mathbb R^3R3 with Lebesgue measure, let

Dω=span⁡{xαe−ω∣x∣2/2∣α∈N03}⊆L2(R3),\mathfrak D_\omega = \operatorname{span}\{x^\alpha e^{-\omega|x|^2/2} \mid \alpha \in \mathbb N_0^3\} \subseteq L^2(\mathbb R^3),Dω​=span{xαe−ω∣x∣2/2∣α∈N03​}⊆L2(R3),

where xα=x1α1x2α2x3α3x^\alpha = x_1^{\alpha_1}x_2^{\alpha_2}x_3^{\alpha_3}xα=x1α1​​x2α2​​x3α3​​ and ∣x∣|x|∣x∣ is the Euclidean norm. With Δ=∑j∂2/∂xj2\Delta = \sum_j \partial^2/\partial x_j^2Δ=∑j​∂2/∂xj2​ and Teschl's units (ℏ=1\hbar = 1ℏ=1, mass 1/21/21/2, so the free Hamiltonian is H0=−ΔH_0 = -\DeltaH0​=−Δ), the harmonic oscillator is the operator

H=H0+ω2x2,(Hf)(x)=−Δf(x)+ω2∣x∣2f(x),D(H)=Dω.H = H_0 + \omega^2 x^2, \qquad (Hf)(x) = -\Delta f(x) + \omega^2|x|^2 f(x), \qquad \mathfrak D(H) = \mathfrak D_\omega.H=H0​+ω2x2,(Hf)(x)=−Δf(x)+ω2∣x∣2f(x),D(H)=Dω​.

In one dimension the ladder operators on span⁡{xke−ωx2/2}\operatorname{span}\{x^k e^{-\omega x^2/2}\}span{xke−ωx2/2} are

A±=12(ω x∓1ωddx).A_\pm = \frac{1}{\sqrt2}\Big(\sqrt\omega\,x \mp \frac{1}{\sqrt\omega}\frac{d}{dx}\Big).A±​=2​1​(ω​x∓ω​1​dxd​).

The Hermite polynomials are Hn(x)=(−1)nex2dndxne−x2H_n(x) = (-1)^n e^{x^2}\frac{d^n}{dx^n}e^{-x^2}Hn​(x)=(−1)nex2dxndn​e−x2. The Hermite functions are

ψn(x)=12nn!(ωπ)1/4Hn(ω x) e−ωx2/2,\psi_n(x) = \frac{1}{\sqrt{2^n n!}}\Big(\frac\omega\pi\Big)^{1/4} H_n(\sqrt\omega\,x)\,e^{-\omega x^2/2},ψn​(x)=2nn!​1​(πω​)1/4Hn​(ω​x)e−ωx2/2,

and on R3\mathbb R^3R3, ψn1,n2,n3(x)=ψn1(x1)ψn2(x2)ψn3(x3)\psi_{n_1,n_2,n_3}(x) = \psi_{n_1}(x_1)\psi_{n_2}(x_2)\psi_{n_3}(x_3)ψn1​,n2​,n3​​(x)=ψn1​​(x1​)ψn2​​(x2​)ψn3​​(x3​).

Formalization targets

Goal: the harmonic oscillator (Theorem 8.5)

For every ω>0\omega > 0ω>0 the operator HHH above exists. It is essentially self-adjoint on Dω\mathfrak D_\omegaDω​, the functions ψn1,n2,n3\psi_{n_1,n_2,n_3}ψn1​,n2​,n3​​, (n1,n2,n3)∈N03(n_1,n_2,n_3) \in \mathbb N_0^3(n1​,n2​,n3​)∈N03​, form an orthonormal basis of L2(R3)L^2(\mathbb R^3)L2(R3) consisting of eigenvectors of HHH, and

σ(H‾)={(2n+3)ω∣n∈N0}.\sigma(\overline H) = \{(2n + 3)\omega \mid n \in \mathbb N_0\}.σ(H)={(2n+3)ω∣n∈N0​}.

Milestones

  • Density (Lemma 8.3). span⁡{xαe−∣x∣2/2∣α∈N0n}\operatorname{span}\{x^\alpha e^{-|x|^2/2} \mid \alpha \in \mathbb N_0^n\}span{xαe−∣x∣2/2∣α∈N0n​} is dense in L2(Rn)L^2(\mathbb R^n)L2(Rn) for every nnn.
  • Canonical commutation relation (Eq. (8.36)). [A−,A+]=1[A_-, A_+] = 1[A−​,A+​]=1 on span⁡{xke−ωx2/2}\operatorname{span}\{x^k e^{-\omega x^2/2}\}span{xke−ωx2/2}.
  • Factorization (Eq. (8.37)). On the same space, −d2dx2+ω2x2=ω(2N+1)-\frac{d^2}{dx^2} + \omega^2x^2 = \omega(2N + 1)−dx2d2​+ω2x2=ω(2N+1) with N=A+A−N = A_+A_-N=A+​A−​, and the space is invariant under A±A_\pmA±​.
  • Hermite functions (Eqs. (8.40)–(8.42)). ψn=A+nψ0/n!\psi_n = A_+^n\psi_0/\sqrt{n!}ψn​=A+n​ψ0​/n!​ with ψ0(x)=(ω/π)1/4e−ωx2/2\psi_0(x) = (\omega/\pi)^{1/4}e^{-\omega x^2/2}ψ0​(x)=(ω/π)1/4e−ωx2/2. Each ψn\psi_nψn​ is a normalized eigenfunction of NNN for the eigenvalue nnn, and span⁡{ψn}=span⁡{xke−ωx2/2}\operatorname{span}\{\psi_n\} = \operatorname{span}\{x^k e^{-\omega x^2/2}\}span{ψn​}=span{xke−ωx2/2}.
  • Heisenberg uncertainty principle (Theorem 8.2). For symmetric AAA, BBB and a state ψ∈D(AB)∩D(BA)\psi \in \mathfrak D(AB) \cap \mathfrak D(BA)ψ∈D(AB)∩D(BA),
Δψ(A) Δψ(B)≥12 ∣Eψ([A,B])∣,\Delta_\psi(A)\,\Delta_\psi(B) \ge \tfrac12\,|\mathbb E_\psi([A,B])|,Δψ​(A)Δψ​(B)≥21​∣Eψ​([A,B])∣,

with equality if (B−Eψ(B))ψ=iλ(A−Eψ(A))ψ(B - \mathbb E_\psi(B))\psi = i\lambda(A - \mathbb E_\psi(A))\psi(B−Eψ​(B))ψ=iλ(A−Eψ​(A))ψ for a real λ≠0\lambda \ne 0λ=0, or if ψ\psiψ is an eigenvector of AAA or BBB.

  • Abstract commutation (Theorem 8.6). For AAA closed and densely defined, A∗A∣Ker⁡(A)⊥A^*A|_{\operatorname{Ker}(A)^\perp}A∗A∣Ker(A)⊥​ and AA∗∣Ker⁡(A∗)⊥AA^*|_{\operatorname{Ker}(A^*)^\perp}AA∗∣Ker(A∗)⊥​ are unitarily equivalent. AAA maps eigenvectors of A∗AA^*AA∗A (eigenvalue EEE) to eigenvectors of AA∗AA^*AA∗ with ∥Aψ0∥=E ∥ψ0∥\|A\psi_0\| = \sqrt E\,\|\psi_0\|∥Aψ0​∥=E​∥ψ0​∥. For z≠0z \ne 0z=0,
RAA∗(z)⊇1z(ARA∗A(z)A∗−1),RA∗A(z)⊇1z(A∗RAA∗(z)A−1).R_{AA^*}(z) \supseteq \tfrac1z\big(A R_{A^*A}(z) A^* - 1\big), \qquad R_{A^*A}(z) \supseteq \tfrac1z\big(A^* R_{AA^*}(z) A - 1\big).RAA∗​(z)⊇z1​(ARA∗A​(z)A∗−1),RA∗A​(z)⊇z1​(A∗RAA∗​(z)A−1).

The last two milestones do not enter the goal. They are the chapter's other two theorems and use the same operator-theoretic layer.

Significance

Theorem 8.5 is the rigorous form of the most used exactly solvable model of quantum mechanics. Once it is available, the Hermite functions become an orthonormal basis of L2(R3)L^2(\mathbb R^3)L2(R3) that diagonalizes a concrete differential operator. That basis underlies Mehler's formula and the Fourier transform's action Fψn=(−i)nψn\mathcal F\psi_n = (-i)^n\psi_nFψn​=(−i)nψn​ (Eq. (8.46)). Perturbation arguments around the oscillator also start from it, and so does the construction of Fock space. The uncertainty principle is the basic quantitative constraint on simultaneous measurement. Theorem 8.6 gives an eigenvalue transfer mechanism that Teschl reuses to compute the hydrogen spectrum (Section 10.4).

Formally, the mission asks for a machine-checked proof about an unbounded differential operator on L2(R3)L^2(\mathbb R^3)L2(R3), stated on a concrete core. Mathlib has unbounded operators (LinearPMap, closure, adjoint), LpL^pLp spaces, Gaussian integrals and the probabilists' Hermite polynomials. It has no statement identifying the spectrum of a concrete Schrödinger operator. These results are proved in every textbook, but none of them has been formalized in this form.

Difficulty

The algebra of Eqs. (8.36)–(8.41) is a finite computation with polynomials times a Gaussian. The work in the goal is analytic. Essential self-adjointness is a statement about the closure of an operator on a non-closed domain. Symmetry of HHH together with a family of eigenvectors in Dω\mathfrak D_\omegaDω​ does not give it by definition, and the relevant criterion for unbounded operators is not in Mathlib. Completeness of the eigenfunctions in L2(R3)L^2(\mathbb R^3)L2(R3) is a density statement about a concrete function space (Lemma 8.3), and it has to be transferred from one dimension to three. The spectrum is asked for the closure H‾\overline HH, not for HHH on Dω\mathfrak D_\omegaDω​: the eigenvalues (2n+3)ω(2n+3)\omega(2n+3)ω are easy to exhibit, but showing that no other point of C\mathbb CC lies in σ(H‾)\sigma(\overline H)σ(H) requires control of (H‾−z)−1(\overline H - z)^{-1}(H−z)−1 on all of L2L^2L2. Finally, the Rodrigues formula (8.42) and the ladder construction (8.40) define the same functions only after an identity for all derivatives of e−x2e^{-x^2}e−x2.

Formalization scope

H\mathfrak HH is a complex inner product space with CompleteSpace; separability is not assumed, and no statement needs it. Operators are Mathlib LinearPMaps H →ₗ.[ℂ] H. A∗A^*A∗ is LinearPMap.adjoint, and every statement using it assumes a dense domain. Self-adjointness is Mathlib's IsSelfAdjoint, and essential self-adjointness is IsSelfAdjoint H.closure. ρ\rhoρ and σ\sigmaσ are defined in the mission for LinearPMaps (bounded two-sided inverse of A−zA - zA−z); Mathlib's Banach-algebra spectrum is not used. L2(Rn)L^2(\mathbb R^n)L2(Rn) is Lp ℂ 2 volume on EuclideanSpace ℝ (Fin n). The Laplacian is the sum of second Fréchet derivatives along the unit vectors. Hermite polynomials are defined by the Rodrigues formula, not as Mathlib's probabilists' Polynomial.hermite. No projection-valued measure, functional calculus or Fourier transform is taken as data.

The oscillator is not defined as a construction. IsHarmonicOscillator ω H states that D(H)=Dω\mathfrak D(H) = \mathfrak D_\omegaD(H)=Dω​ and that HHH acts on a representative fff as −Δf+ω2∣x∣2f-\Delta f + \omega^2|x|^2 f−Δf+ω2∣x∣2f. This determines HHH uniquely, and the goal also asserts that such an HHH exists. Trivializing formalization ruled out: defining HHH as the diagonal operator ∑n(2∣n∣+3)ω⟨ψn,⋅⟩ψn\sum_n (2|n| + 3)\omega\langle\psi_n,\cdot\rangle\psi_n∑n​(2∣n∣+3)ω⟨ψn​,⋅⟩ψn​ would make the spectrum immediate. Here HHH is the differential operator on Dω\mathfrak D_\omegaDω​, and its eigenvalues must be derived.

Two choices differ from the printed text. First, Teschl's (8.34) writes the domain with e−x2/2e^{-x^2/2}e−x2/2, but his (8.39)–(8.41) and the conclusion span⁡{ψn}=D\operatorname{span}\{\psi_n\} = \mathfrak Dspan{ψn​}=D use e−ωx2/2e^{-\omega x^2/2}e−ωx2/2. The mission uses Dω\mathfrak D_\omegaDω​, which equals (8.34) for ω=1\omega = 1ω=1. Lemma 8.3 is stated for (8.20)'s D\mathfrak DD itself. Second, Theorem 8.6 prints "H1ψ1=ψ1H_1\psi_1 = \psi_1H1​ψ1​=ψ1​", and the mission states the intended H1ψ1=Eψ1H_1\psi_1 = E\psi_1H1​ψ1​=Eψ1​. The uncertainty principle adds ∥ψ∥=1\|\psi\| = 1∥ψ∥=1 explicitly; the book assumes it through its definition of a state.

Reusable pieces are the product of LinearPMaps, spectrum and resolvent for unbounded operators, the Gauss–polynomial core and its density, and the Hermite-function API. Contributions of general lemmas are welcome, for example "an operator with an orthonormal eigenbasis in its domain is essentially self-adjoint" and the spectrum of such an operator.

Selected references

  • G. Teschl, Mathematical Methods in Quantum Mechanics, With Applications to Schrödinger Operators, Graduate Studies in Mathematics 99, AMS, 2009. bookstore.ams.org/gsm-99
  • H. P. Robertson, "The Uncertainty Principle", Physical Review 34 (1929), 163–164. doi:10.1103/PhysRev.34.163
  • W. Heisenberg, "Über den anschaulichen Inhalt der quantentheoretischen Kinematik und Mechanik", Zeitschrift für Physik 43 (1927), 172–198. doi:10.1007/BF01397280
15 thms3 active usersReviewed
🏆Completed
Dynamical Systems·Captain: mikedeng1

Ordinary Differential Equations and Dynamical Systems IX: Interval Maps, Symbolic Dynamics and the Tent-Map RepellorTextbook

Motivation

One-dimensional maps are the smallest systems in which deterministic dynamics becomes unpredictable. Chapter 11 of Gerald Teschl's graduate text Ordinary Differential Equations and Dynamical Systems (author's version; AMS Graduate Studies in Mathematics 140, 2012, doi:10.1090/gsm/140) uses them to make the word "chaos" precise. The chapter proves that a period-three orbit of a continuous interval map forces orbits of every period (Li and Yorke, 1975, the first case of Sarkovskii's theorem), adopts Devaney's topological definition of chaos, codes the tent map by sequences of two symbols, and ends by computing the Hausdorff dimension of the tent map's invariant Cantor set. The same pattern (a Cantor set, a conjugacy to a shift, a fractal dimension) returns in the Smale horseshoe of Chapter 13 and in hyperbolic dynamics generally, so the chapter is the standard entry point to symbolic dynamics.

Setting

For a real parameter μ\muμ the tent map is Tμ(x)=μ2(1−∣2x−1∣)T_\mu(x) = \frac{\mu}{2}(1 - |2x-1|)Tμ​(x)=2μ​(1−∣2x−1∣), a map of the real line. For μ>2\mu > 2μ>2 the peak μ/2\mu/2μ/2 exceeds 111, points leave [0,1][0,1][0,1] and then escape to −∞-\infty−∞. The repellor of the tent map is the set of points that never leave,

Λ={ x∈R:Tμn(x)∈[0,1] for all n≥0 },\Lambda = \{\, x \in \mathbb{R} : T_\mu^n(x) \in [0,1] \text{ for all } n \ge 0 \,\},Λ={x∈R:Tμn​(x)∈[0,1] for all n≥0},

which the book builds as a nested intersection of 2n2^n2n intervals of length μ−n\mu^{-n}μ−n; for μ=2\mu = 2μ=2 it is all of [0,1][0,1][0,1]. With I0=[0,μ−1]I_0 = [0, \mu^{-1}]I0​=[0,μ−1] and I1=[1−μ−1,1]I_1 = [1-\mu^{-1}, 1]I1​=[1−μ−1,1], the itinerary map φ\varphiφ sends x∈Λx \in \Lambdax∈Λ to the sequence (xn)n≥0(x_n)_{n \ge 0}(xn​)n≥0​ with xn=jx_n = jxn​=j when Tμn(x)∈IjT_\mu^n(x) \in I_jTμn​(x)∈Ij​.

The sequence space ΣN={0,…,N−1}N0\Sigma_N = \{0, \dots, N-1\}^{\mathbb{N}_0}ΣN​={0,…,N−1}N0​, N≥2N \ge 2N≥2, carries the metric d(x,y)=∑n≥0∣xn−yn∣/Nnd(x,y) = \sum_{n \ge 0} |x_n - y_n| / N^nd(x,y)=∑n≥0​∣xn​−yn​∣/Nn and the shift σ(x0,x1,… )=(x1,x2,… )\sigma(x_0, x_1, \dots) = (x_1, x_2, \dots)σ(x0​,x1​,…)=(x1​,x2​,…).

A continuous map f:M→Mf : M \to Mf:M→M of a metric space is topologically transitive if for all nonempty open U,VU, VU,V some iterate fn(U)f^n(U)fn(U), n≥1n \ge 1n≥1, meets VVV. It is chaotic if in addition MMM is infinite and the periodic points of fff are dense. This is the definition used in the book, and it has no sensitivity clause. It has sensitive dependence on initial conditions if some δ>0\delta > 0δ>0 has the property that every xxx has points yyy arbitrarily close to it with d(fn(x),fn(y))>δd(f^n(x), f^n(y)) > \deltad(fn(x),fn(y))>δ for some n≥1n \ge 1n≥1. A compact set Λ\LambdaΛ with f(Λ)=Λf(\Lambda) = \Lambdaf(Λ)=Λ is repelling if some neighborhood UUU of Λ\LambdaΛ is eventually left by every orbit starting in U∖ΛU \setminus \LambdaU∖Λ. A repelling set is a repellor if (Λ,f∣Λ)(\Lambda, f|_\Lambda)(Λ,f∣Λ​) is transitive. It is a strange repellor if moreover (Λ,f∣Λ)(\Lambda, f|_\Lambda)(Λ,f∣Λ​) is chaotic and Λ\LambdaΛ is fractal, meaning its Hausdorff dimension dim⁡H\dim_HdimH​ is not an integer. A Cantor set is a compact, totally disconnected, perfect set.

Formalization targets

Goal: Theorem 11.20

dim⁡H(Λ)=log⁡2log⁡μ(μ≥2),and for μ>2, Λ is a strange repellor of Tμ.\dim_H(\Lambda) = \frac{\log 2}{\log \mu} \quad (\mu \ge 2), \qquad \text{and for } \mu > 2,\ \Lambda \text{ is a strange repellor of } T_\mu .dimH​(Λ)=logμlog2​(μ≥2),and for μ>2, Λ is a strange repellor of Tμ​.

The book states the strange-repellor clause for μ≥2\mu \ge 2μ≥2. At μ=2\mu = 2μ=2, however, Λ=[0,1]\Lambda = [0,1]Λ=[0,1] has dimension 111, which is an integer, so the goal restricts that clause to μ>2\mu > 2μ>2.

Milestones

  • Lemma 11.1. A continuous f:[a,b]→[a,b]f : [a,b] \to [a,b]f:[a,b]→[a,b] with a point of prime period 333 has points of every prime period n≥1n \ge 1n≥1.
  • Lemma 11.3. A chaotic map has sensitive dependence on initial conditions.
  • Lemma 11.6. On ΣN\Sigma_NΣN​: d(x,y)≤N−nd(x,y) \le N^{-n}d(x,y)≤N−n if xj=yjx_j = y_jxj​=yj​ for all j≤nj \le nj≤n, and d(x,y)≥N−nd(x,y) \ge N^{-n}d(x,y)≥N−n if xj≠yjx_j \ne y_jxj​=yj​ for some j≤nj \le nj≤n.
  • Lemma 11.8. The periodic points of σ\sigmaσ on ΣN\Sigma_NΣN​ are countable and dense.
  • Lemma 11.9. The shift on ΣN\Sigma_NΣN​ has a dense forward orbit.
  • Lemma 11.4. For μ>2\mu > 2μ>2, Λ\LambdaΛ is a Cantor set.
  • Theorem 11.5. For μ>2\mu > 2μ>2, φ\varphiφ is a homeomorphism of Λ\LambdaΛ onto Σ2\Sigma_2Σ2​ with σ∘φ=φ∘Tμ\sigma \circ \varphi = \varphi \circ T_\muσ∘φ=φ∘Tμ​ on Λ\LambdaΛ.

Significance

The dimension formula is the simplest non-trivial instance of the principle that the Hausdorff dimension of an expanding repellor is determined by the number of branches and the expansion rate. For conformal repellors this principle becomes Bowen's formula. Theorem 11.23 of the same chapter extends the bound to general two-branch expanding interval maps, with log⁡2/log⁡β≤dim⁡HΛ≤log⁡2/log⁡α\log 2/\log\beta \le \dim_H \Lambda \le \log 2/\log\alphalog2/logβ≤dimH​Λ≤log2/logα. The conjugacy with the full shift is the device that reduces the dynamics on Λ\LambdaΛ to combinatorics of sequences. It is reused verbatim for the horseshoe.

On formalization: Mathlib has Hausdorff measure and dimension (MeasureTheory.Measure.hausdorffMeasure, dimH) together with Hölder and Lipschitz image bounds. It has no dimension computation for a self-similar Cantor set and no symbolic-dynamics layer. On Prove2Me, the Devaney series proves period three implies all periods and Sarkovskii's theorem for continuous maps R→R\mathbb{R} \to \mathbb{R}R→R, the density of periodic points and a dense orbit for the two-symbol shift, and a Cantor-set statement for the quadratic family. None of these states the results for self-maps of a compact interval, for NNN symbols, or for the tent map, and none computes a Hausdorff dimension. All results here are proved in the book, except that the proof of Theorem 11.20 is terse. None is formalized in the form stated here.

Difficulty

The upper bound dim⁡HΛ≤log⁡2/log⁡μ\dim_H \Lambda \le \log 2/\log\mudimH​Λ≤log2/logμ comes from the natural covers. The lower bound is the hard direction: it has to hold for every cover, including covers by sets of very different sizes that do not line up with the 2n2^n2n construction intervals. So the natural covers alone do not decide it. Counting the construction intervals that an arbitrary set of a given diameter can meet needs the gaps between them to be controlled uniformly. The heuristic self-similarity identity hα(Λ)=2μ−αhα(Λ)h^\alpha(\Lambda) = 2\mu^{-\alpha} h^\alpha(\Lambda)hα(Λ)=2μ−αhα(Λ) fixes α\alphaα only once 0<hα(Λ)<∞0 < h^\alpha(\Lambda) < \infty0<hα(Λ)<∞ is known, and that is exactly what has to be proved. For the strange-repellor clause, every part of the definition (repelling, transitive, infinite, dense periodic points, fractal) has to be checked for (Λ,Tμ∣Λ)(\Lambda, T_\mu|_\Lambda)(Λ,Tμ​∣Λ​) with the subspace topology. Transferring transitivity and density of periodic points from Σ2\Sigma_2Σ2​ requires the homeomorphism of Theorem 11.5 in both directions, not just a continuous surjection. In Lemma 11.1 the difficulty is showing that the periodic point found has prime period nnn, not a divisor of nnn.

Formalization scope

Everything is stated in namespace TeschlODE.IntervalMaps against Mathlib.

  • The tent map is a total function R→R\mathbb{R} \to \mathbb{R}R→R, and Λ\LambdaΛ is defined as the set of points whose orbit stays in [0,1][0,1][0,1], uniformly in μ\muμ. For μ>2\mu > 2μ>2 this is the book's ⋂nΛn\bigcap_n \Lambda_n⋂n​Λn​ (11.18).
  • ΣN\Sigma_NΣN​ is ℕ → Fin N, and the metric (11.28) is a function symDist N (a tsum, summable for N≥2N \ge 2N≥2). Density and continuity on ΣN\Sigma_NΣN​ are stated in explicit ε\varepsilonε–δ\deltaδ form with this function. Each theorem assumes N≥2N \ge 2N≥2, the book's N∈N∖{1}N \in \mathbb{N}\setminus\{1\}N∈N∖{1}.
  • The itinerary map is ℝ → (ℕ → Fin 2). Its values off Λ\LambdaΛ are meaningless and never used. "Homeomorphism" in Theorem 11.5 means: φ\varphiφ is a bijection of Λ\LambdaΛ onto Σ2\Sigma_2Σ2​, it is continuous on Λ\LambdaΛ, and its inverse is continuous, all in metric form.
  • Chaos, transitivity, repelling sets, repellors and strange repellors are predicates on a map of a metric space. The restricted system (Λ,f∣Λ)(\Lambda, f|_\Lambda)(Λ,f∣Λ​) uses the subspace topology. Transitivity quantifies over nonempty open sets and iterates n≥1n \ge 1n≥1. Periodic points are Function.periodicPts, and the prime period in Lemma 11.1 is Function.minimalPeriod on the subtype [a,b][a,b][a,b].
  • dim⁡H\dim_HdimH​ is Mathlib's dimH, valued in [0,∞][0,\infty][0,∞]. "Not an integer" means finite and different from every natural number. The goal's right-hand side is ENNReal.ofReal (log 2 / log μ).

There are no "sufficiently small" or O(⋅)O(\cdot)O(⋅) readings in this chapter. The only quantifier choices are the explicit ε\varepsilonε–δ\deltaδ forms above and the nonempty open sets in transitivity.

The goal is not a dimension-only statement. For μ>2\mu > 2μ>2, a statement that proved only (11.49), or that restricted to a single value such as μ=3\mu = 3μ=3, would be a different and weaker theorem. The full strange-repellor conclusion, with every clause of the definition, is required. Solvers can reuse the symbolic-dynamics lemmas (11.6, 11.8, 11.9) and the conjugacy (11.5). General Mathlib contributions on ΣN\Sigma_NΣN​ as a metric space are welcome.

Selected references

  • G. Teschl, Ordinary Differential Equations and Dynamical Systems, AMS Graduate Studies in Mathematics 140, 2012. Author's version: https://www.mat.univie.ac.at/~gerald/ftp/book-ode/ode.pdf ; https://doi.org/10.1090/gsm/140
  • R. L. Devaney, An Introduction to Chaotic Dynamical Systems, 2nd ed., Addison-Wesley, 1989 (book; no DOI).
  • T.-Y. Li and J. A. Yorke, "Period three implies chaos", American Mathematical Monthly 82 (1975), 985–992. https://doi.org/10.2307/2318254
  • K. Falconer, Fractal Geometry: Mathematical Foundations and Applications, Wiley, 1990 (book; no DOI for the first edition).
  • C. Robinson, Dynamical Systems: Stability, Symbolic Dynamics, and Chaos, 2nd ed., CRC Press, 1999 (book).
21 thms3 active usersReviewed
🏆Completed
Dynamical Systems·Captain: mikedeng1

Ordinary Differential Equations and Dynamical Systems VI: The Poincaré–Bendixson TheoremTextbook

Motivation

Long-time behaviour is the central question about an autonomous differential equation x˙=f(x)\dot x = f(x)x˙=f(x): where does a trajectory go as t→±∞t \to \pm\inftyt→±∞? In the plane this question has an almost complete answer. The theory begun by Poincaré (Mémoire sur les courbes définies par une équation différentielle, 1881–1886) and completed by Bendixson (Sur les courbes définies par des équations différentielles, Acta Math. 24, 1901, doi:10.1007/BF02403068) shows that a bounded planar trajectory can only accumulate on equilibria, on a periodic orbit, or on a chain of equilibria joined by connecting orbits. Chaotic behaviour, which already occurs for three-dimensional flows such as the Lorenz system, is excluded. It is the standard tool for proving that a planar system has a limit cycle, and it underlies Hilbert's 16th problem.

This mission formalizes Section 7.3 of G. Teschl, Ordinary Differential Equations and Dynamical Systems (author's preliminary version of AMS Graduate Studies in Mathematics 140, 2012), pp. 220–224, which proves the classical theorem and the generalized version with finitely many fixed points.

Setting

Let M⊆R2M \subseteq \mathbb{R}^2M⊆R2 be open and f∈C1(M,R2)f \in C^1(M, \mathbb{R}^2)f∈C1(M,R2). An integral curve at xxx is a function φ\varphiφ on an open interval J∋0J \ni 0J∋0 with φ(0)=x\varphi(0) = xφ(0)=x, φ(J)⊆M\varphi(J) \subseteq Mφ(J)⊆M and φ˙(s)=f(φ(s))\dot\varphi(s) = f(\varphi(s))φ˙​(s)=f(φ(s)) on JJJ. The union of all such JJJ is the maximal interval Ix=(T−(x),T+(x))I_x = (T_-(x), T_+(x))Ix​=(T−​(x),T+​(x)). The flow Φ(t,x)\Phi(t, x)Φ(t,x), t∈Ixt \in I_xt∈Ix​, is the value at time ttt of the maximal integral curve at xxx. With σ∈{+,−}\sigma \in \{+,-\}σ∈{+,−}:

  • the orbit is γ(x)={Φ(t,x):t∈Ix}\gamma(x) = \{\Phi(t,x) : t \in I_x\}γ(x)={Φ(t,x):t∈Ix​}, and the half-orbit γσ(x)\gamma_\sigma(x)γσ​(x) keeps only t∈Ixt \in I_xt∈Ix​ with σt>0\sigma t > 0σt>0;
  • a fixed point is a point with f(x)=0f(x) = 0f(x)=0; a periodic point is a point with Φ(T,x)=x\Phi(T, x) = xΦ(T,x)=x for some T>0T > 0T>0 in IxI_xIx​ (fixed points included). A regular periodic orbit is the orbit of a periodic point that is not fixed, and a non-closed orbit is the orbit of a point that is not periodic;
  • the ωσ\omega_\sigmaωσ​-limit set ωσ(x)\omega_\sigma(x)ωσ​(x) is the set of y∈My \in My∈M with Φ(tk,x)→y\Phi(t_k, x) \to yΦ(tk​,x)→y for some times tk∈Ixt_k \in I_xtk​∈Ix​, tk→σ∞t_k \to \sigma\inftytk​→σ∞;
  • a set U⊆MU \subseteq MU⊆M is σ\sigmaσ invariant if γσ(x)⊆U\gamma_\sigma(x) \subseteq Uγσ​(x)⊆U for every x∈Ux \in Ux∈U;
  • a transversal arc Σ=s(J)\Sigma = s(J)Σ=s(J) is the image of a C1C^1C1 embedding sss of an open interval JJJ into MMM with s˙≠0\dot s \ne 0s˙=0 and s˙1f2(s)−s˙2f1(s)≠0\dot s_1 f_2(s) - \dot s_2 f_1(s) \neq 0s˙1​f2​(s)−s˙2​f1​(s)=0 on JJJ. The parameter orders the points of Σ\SigmaΣ.

In Lean, points are Fin 2 → ℝ (general Fin n → ℝ for the Chapter 6 notions), and σ\sigmaσ is a Bool with true for +++. The definitions are lifetime, flow, orbit, halfOrbit, omegaLimitSet, IsPeriodicPoint and IsTransversalArc, all in the namespace TeschlODE.Planar.

Formalization targets

Goal: the generalized Poincaré–Bendixson theorem (Theorem 7.16)

Fix x∈Mx \in Mx∈M and σ\sigmaσ, and suppose ωσ(x)≠∅\omega_\sigma(x) \neq \emptysetωσ​(x)=∅ is compact, connected and contains only finitely many fixed points. Then one of three cases holds:

(i) ωσ(x)={x0}, f(x0)=0;(ii) ωσ(x)=γ(y), y periodic, f(y)≠0;\text{(i) } \omega_\sigma(x) = \{x_0\},\ f(x_0) = 0; \qquad \text{(ii) } \omega_\sigma(x) = \gamma(y),\ y \text{ periodic},\ f(y) \neq 0;(i) ωσ​(x)={x0​}, f(x0​)=0;(ii) ωσ​(x)=γ(y), y periodic, f(y)=0; (iii) every y∈ωσ(x) with f(y)≠0 lies on a non-closed orbit γ(y)⊆ωσ(x) with ω+(y)={a}, ω−(y)={b},\text{(iii) every } y \in \omega_\sigma(x) \text{ with } f(y) \ne 0 \text{ lies on a non-closed orbit } \gamma(y) \subseteq \omega_\sigma(x) \text{ with } \omega_+(y) = \{a\},\ \omega_-(y) = \{b\},(iii) every y∈ωσ​(x) with f(y)=0 lies on a non-closed orbit γ(y)⊆ωσ​(x) with ω+​(y)={a}, ω−​(y)={b},

where a,ba, ba,b are fixed points in ωσ(x)\omega_\sigma(x)ωσ​(x).

Milestones

  1. Lemma 7.9. The successive intersections of γσ(x0)\gamma_\sigma(x_0)γσ​(x0​) with a transversal arc through a regular point x0x_0x0​ are monotone along the arc.
  2. Corollary 7.10. ωσ(x)\omega_\sigma(x)ωσ​(x) meets a transversal arc in at most one point.
  3. Corollary 7.11. If ωσ(x)∩γσ(x)≠∅\omega_\sigma(x) \cap \gamma_\sigma(x) \neq \emptysetωσ​(x)∩γσ​(x)=∅, then xxx is periodic and ω+(x)=ω−(x)=γ(x)\omega_+(x) = \omega_-(x) = \gamma(x)ω+​(x)=ω−​(x)=γ(x).
  4. Corollary 7.12. A minimal compact σ\sigmaσ invariant set is a periodic orbit.
  5. Lemma 7.13 (Poincaré–Bendixson). A nonempty compact ωσ(x)\omega_\sigma(x)ωσ​(x) without fixed points is a regular periodic orbit.
  6. Lemma 7.14. A connected ωσ(x)\omega_\sigma(x)ωσ​(x) that contains a regular periodic orbit γ(y)\gamma(y)γ(y) equals γ(y)\gamma(y)γ(y).
  7. Lemma 7.15. If ωσ(x)\omega_\sigma(x)ωσ​(x) is compact, at most one orbit in ωσ(x)\omega_\sigma(x)ωσ​(x) runs from a fixed point x−x_-x−​ to a distinct fixed point x+x_+x+​.

Significance

The theorem turns the existence of periodic solutions into a topological statement. It is enough to find a compact positively invariant region with no equilibria, often an annulus bounded by two curves on which the vector field points inward. This is how periodic orbits are established for the van der Pol and Liénard equations (Theorem 7.8 of the same chapter) and for many models in biology and chemistry. The generalized version also describes limit sets that contain equilibria, such as homoclinic and heteroclinic cycles. Corollary 7.12 records the dimensional boundary: in the plane every minimal set is a periodic orbit, while from dimension three on minimal sets can be invariant tori with dense orbits.

The results have been proved for over a century. None of them is formalized in Mathlib or on the platform. Mathlib has omegaLimit for global flows on topological spaces and existence and uniqueness of integral curves, but no local flow of a vector field on an open set, no transversal sections and no Jordan curve theorem. This mission produces a machine-checked planar limit-set theory. The local flow and limit-set layer it needs is reusable for every later chapter on dynamical systems.

Difficulty

The statements are topological, and the proofs rest on the Jordan curve theorem for piecewise C1C^1C1 curves: a closed curve made of an orbit segment and a piece of transversal arc separates the plane, and trajectories cannot cross it in the forbidden direction. That theorem is not in Mathlib, and the platform's Jordan-curve and Schoenflies statements are open. Everything that looks one-dimensional in a sketch, "the orbit enters the inside and is trapped", depends on it. The ingredients a sketch treats as obvious also need care: the flow-box straightening (Lemma 6.2), the local return map to a transversal arc (Lemma 6.9), and the invariance, closedness and connectedness of limit sets (Lemmas 6.5–6.6). Generic arguments about compact invariant sets do not suffice: the conclusions are false in R3\mathbb{R}^3R3, so any proof must use planarity.

Formalization scope

  • Points are Fin 2 → ℝ. Its sup norm induces the Euclidean topology, and no statement depends on the norm. fff is a total function with ContDiffOn ℝ 1 f M on the open set MMM.
  • The flow is defined, not assumed. lifetime f M x is the union of domains of integral curves at xxx, and flow f M t x is the value at ttt of such a curve, selected by choice (unique for C1C^1C1 fields). Outside IxI_xIx​ the flow has the junk value xxx, and no statement evaluates it there. Limit points must lie in MMM, as in the book.
  • σ∈{±}\sigma \in \{\pm\}σ∈{±} is a Bool; true means +++ (atTop), false means −-− (atBot).
  • "Periodic" includes fixed points (period zero), as in the book. "Regular periodic" is periodic with f(y)≠0f(y) \neq 0f(y)=0, and "non-closed" is not periodic.
  • A transversal arc is a C1C^1C1 topological embedding of an open interval into MMM. The book says "smooth", so these statements cover a wider class of arcs and are at least as strong as the book's. Lemma 7.9's "monotone sequence of intersections" is stated as: any parametrization uuu of the intersection points (s(u(t))=Φ(t,x0)s(u(t)) = \Phi(t, x_0)s(u(t))=Φ(t,x0​)) is monotone or antitone on the set of intersection times.
  • "Connected" is IsPreconnected; nonemptiness is a separate hypothesis. "Finitely many fixed points" is Set.Finite {y ∈ ω_σ(x) | f y = 0}. The book's "ω±(y)∈{xj}\omega_\pm(y) \in \{x_j\}ω±​(y)∈{xj​}" is ω±(y)={a}\omega_\pm(y) = \{a\}ω±​(y)={a} for a fixed point a∈ωσ(x)a \in \omega_\sigma(x)a∈ωσ​(x). No statement uses O(·), "sufficiently small" or an unspecified constant.
  • The four hypotheses on ωσ(x)\omega_\sigma(x)ωσ​(x) (nonempty, compact, connected, finitely many fixed points) are the book's and are all kept. A formalization that drops one of them, or reads "regular periodic orbit" to include a fixed point, is not the theorem.
  • Needed infrastructure: local existence, uniqueness and continuity of the flow (Chapter 2, 6.1), the flow box, the Jordan curve theorem for piecewise C1C^1C1 curves, and the basic limit-set lemmas of Chapter 6. Contributions of any of these as separate lemmas are welcome, and the Jordan curve theorem in particular is reusable far beyond this mission.

Selected references

  • G. Teschl, Ordinary Differential Equations and Dynamical Systems, Graduate Studies in Mathematics 140, AMS, 2012 (author's preliminary version, §7.3). doi:10.1090/gsm/140, author's copy
  • I. Bendixson, Sur les courbes définies par des équations différentielles, Acta Mathematica 24 (1901), 1–88. doi:10.1007/BF02403068
  • M. W. Hirsch, S. Smale, R. L. Devaney, Differential Equations, Dynamical Systems, and an Introduction to Chaos, 3rd ed., Academic Press, 2013, Ch. 10. doi:10.1016/C2009-0-61160-0
  • L. Perko, Differential Equations and Dynamical Systems, 3rd ed., Springer, 2001, §3.7. doi:10.1007/978-1-4613-0003-8
16 thms3 active usersReviewed
PreviousPage 3 of 8Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me