Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Linear algebra

222 missions · 132 completed

Missions

Open90Completed132All222
🏆Completed
Markov ChainQuantum Information·Captain: mikedeng1

Search via Quantum Walk 2: Phase Estimation Repeated k Times on the Szegedy Walk W(P) Fixes |π⟩ and Reflects A + B ⊖ |π⟩ up to Error 2^{1−k}Research Paper

Motivation

Many classical search algorithms are random walks: a Markov chain PPP on a finite state space XXX is run until it hits a marked state. Szegedy (2004) attached to every such chain a unitary quantum walk W(P)W(P)W(P), and Magniez, Nayak, Roland and Santha (SIAM J. Comput. 2011, arXiv:quant-ph/0608026) used it to search quadratically faster than the classical walk for every reversible ergodic chain. The search runs Grover-style rotations, and each rotation needs the reflection ref(π)\mathrm{ref}(\pi)ref(π) about the stationary state ∣π⟩|\pi\rangle∣π⟩. Preparing ∣π⟩|\pi\rangle∣π⟩ exactly can cost far more than one step of the walk, so the paper builds an approximate reflection R(P)R(P)R(P) from the walk alone, by phase estimation. Theorem 6 of the paper is the guarantee for that circuit, and this mission formalizes it.

Timeline:

  • Jordan, 1875. Two subspaces of a Euclidean space decompose it into one- and two-dimensional invariant pieces ("principal angles").
  • Cleve, Ekert, Macchiavello and Mosca, 1998 (Proc. R. Soc. A). The phase-estimation circuit C(U)C(U)C(U) and its output distribution (Theorem 5 of the paper).
  • Szegedy, 2004. The walk W(P)W(P)W(P), and its spectrum in terms of the singular values of the discriminant matrix (Theorem 4 of the paper).
  • Magniez, Nayak, Roland and Santha, 2007/2011. The circuit R(P)R(P)R(P) and Theorem 6, the search algorithm (Theorem 7), and the bound Δ(P)≥2δ(P)\Delta(P)\ge2\sqrt{\delta(P)}Δ(P)≥2δ(P)​ relating the phase gap to the eigenvalue gap.

Setting

XXX is a finite set of size nnn. A Markov chain is a row-stochastic matrix P=(pxy)x,y∈XP=(p_{xy})_{x,y\in X}P=(pxy​)x,y∈X​. It is ergodic if some power of PPP has all entries positive. A stationary distribution π\piπ satisfies πx>0\pi_x>0πx​>0, ∑xπx=1\sum_x\pi_x=1∑x​πx​=1 and ∑xπxpxy=πy\sum_x\pi_xp_{xy}=\pi_y∑x​πx​pxy​=πy​. The time-reversed chain P∗P^*P∗ is defined by πxpxy=πypyx∗\pi_xp_{xy}=\pi_yp^*_{yx}πx​pxy​=πy​pyx∗​, and PPP is reversible if P∗=PP^*=PP∗=P.

The space is H=CX×X\mathcal H=\mathbb C^{X\times X}H=CX×X with basis ∣x⟩∣y⟩|x\rangle|y\rangle∣x⟩∣y⟩. Put ∣px⟩=∑ypxy ∣y⟩|p_x\rangle=\sum_y\sqrt{p_{xy}}\,|y\rangle∣px​⟩=∑y​pxy​​∣y⟩ and ∣py∗⟩=∑xpyx∗ ∣x⟩|p^*_y\rangle=\sum_x\sqrt{p^*_{yx}}\,|x\rangle∣py∗​⟩=∑x​pyx∗​​∣x⟩, and

A=Span(∣x⟩∣px⟩:x∈X),B=Span(∣py∗⟩∣y⟩:y∈X).\mathcal A=\mathrm{Span}(|x\rangle|p_x\rangle:x\in X),\qquad \mathcal B=\mathrm{Span}(|p^*_y\rangle|y\rangle:y\in X).A=Span(∣x⟩∣px​⟩:x∈X),B=Span(∣py∗​⟩∣y⟩:y∈X).

For a subspace K\mathcal KK, ref(K)=2ΠK−Id\mathrm{ref}(\mathcal K)=2\Pi_{\mathcal K}-\mathrm{Id}ref(K)=2ΠK​−Id, where ΠK\Pi_{\mathcal K}ΠK​ is the orthogonal projector onto K\mathcal KK. The quantum walk is W(P)=ref(B)⋅ref(A)W(P)=\mathrm{ref}(\mathcal B)\cdot\mathrm{ref}(\mathcal A)W(P)=ref(B)⋅ref(A), and the stationary state is ∣π⟩=∑xπx ∣x⟩∣px⟩|\pi\rangle=\sum_x\sqrt{\pi_x}\,|x\rangle|p_x\rangle∣π⟩=∑x​πx​​∣x⟩∣px​⟩.

The discriminant matrix is D(P)=(pxypyx∗)x,yD(P)=(\sqrt{p_{xy}p^*_{yx}})_{x,y}D(P)=(pxy​pyx∗​​)x,y​. Its singular values lie in [0,1][0,1][0,1]. The phase gap Δ(P)\Delta(P)Δ(P) is 2θ2\theta2θ, where θ\thetaθ is the smallest angle in (0,π/2)(0,\pi/2)(0,π/2) such that cos⁡θ\cos\thetacosθ is a singular value of D(P)D(P)D(P).

The phase-estimation circuit C(U)C(U)C(U) acts on Cι⊗C2s\mathbb C^\iota\otimes\mathbb C^{2^s}Cι⊗C2s. It is

C(U)=(Id⊗F†)(∑j<2sUj⊗∣j⟩⟨j∣)(Id⊗H⊗s),C(U)=(\mathrm{Id}\otimes F^\dagger)\Big(\sum_{j<2^s}U^j\otimes|j\rangle\langle j|\Big)(\mathrm{Id}\otimes H^{\otimes s}),C(U)=(Id⊗F†)(j<2s∑​Uj⊗∣j⟩⟨j∣)(Id⊗H⊗s),

where H⊗sH^{\otimes s}H⊗s is the Walsh–Hadamard matrix and FFF is the 2s2^s2s-point Fourier transform.

The circuit R(P)R(P)R(P) uses s=⌈log⁡2(2π/Δ(P))⌉s=\lceil\log_2(2\pi/\Delta(P))\rceils=⌈log2​(2π/Δ(P))⌉ and acts on H⊗(C2s)⊗k\mathcal H\otimes(\mathbb C^{2^s})^{\otimes k}H⊗(C2s)⊗k. It is built in three steps:

  1. VVV applies C(W(P))C(W(P))C(W(P)) kkk times, each time to the system register and a fresh ancilla register.
  2. F≠0F_{\neq0}F=0​ multiplies by −1-1−1 every basis state with a non-zero estimate in some register.
  3. Then R(P)=V†F≠0VR(P)=V^\dagger F_{\neq0}VR(P)=V†F=0​V.

Formalization targets

Goal: Theorem 6, properties 2 and 3

For PPP ergodic and reversible on n≥2n\ge2n≥2 states, and every integer k≥0k\ge0k≥0:

R(P) ∣π⟩∣0ks⟩=∣π⟩∣0ks⟩,∥(R(P)+Id) ∣ψ⟩∣0ks⟩∥≤21−k∥ψ∥(ψ∈A+B, ψ⊥∣π⟩).R(P)\,|\pi\rangle|0^{ks}\rangle=|\pi\rangle|0^{ks}\rangle,\qquad \big\|(R(P)+\mathrm{Id})\,|\psi\rangle|0^{ks}\rangle\big\|\le2^{1-k}\|\psi\|\quad(\psi\in\mathcal A+\mathcal B,\ \psi\perp|\pi\rangle).R(P)∣π⟩∣0ks⟩=∣π⟩∣0ks⟩,​(R(P)+Id)∣ψ⟩∣0ks⟩​≤21−k∥ψ∥(ψ∈A+B, ψ⊥∣π⟩).

Milestones

The milestones follow the order in which the paper's proof uses them:

  1. Theorem 4 (Szegedy). The spectrum of W(P)W(P)W(P) on A+B\mathcal A+\mathcal BA+B. On that space W(P)W(P)W(P) has the eigenvalues 111 (on A∩B\mathcal A\cap\mathcal BA∩B), −1-1−1, and e±2iθe^{\pm2i\theta}e±2iθ for cos⁡θ\cos\thetacosθ a singular value of D(P)D(P)D(P) in (0,1)(0,1)(0,1), with matching multiplicities. The mission has two items for it: the full statement, and the direction the proof uses.
  2. §3.2. For ergodic reversible PPP, ∣π⟩|\pi\rangle∣π⟩ is the only 111-eigenvector of W(P)W(P)W(P) in A+B\mathcal A+\mathcal BA+B, up to scalars, and every other eigenvalue μ\muμ there satisfies ∣1−μ∣≥∣1−eiΔ(P)∣|1-\mu|\ge|1-e^{i\Delta(P)}|∣1−μ∣≥∣1−eiΔ(P)∣.
  3. Theorem 5, properties 2 and 3. C(U)C(U)C(U) fixes ∣ψ⟩∣0s⟩|\psi\rangle|0^s\rangle∣ψ⟩∣0s⟩ when Uψ=ψU\psi=\psiUψ=ψ. If Uψ=e2iθψU\psi=e^{2i\theta}\psiUψ=e2iθψ with θ∈(0,π)\theta\in(0,\pi)θ∈(0,π), it outputs ∣ψ⟩∣ω⟩|\psi\rangle|\omega\rangle∣ψ⟩∣ω⟩ with ∣⟨0s∣ω⟩∣=∣sin⁡(2sθ)∣/(2ssin⁡θ)|\langle0^s|\omega\rangle|=|\sin(2^s\theta)|/(2^s\sin\theta)∣⟨0s∣ω⟩∣=∣sin(2sθ)∣/(2ssinθ).
  4. Single-copy bound. For Δ/2≤θ≤π−Δ/2\Delta/2\le\theta\le\pi-\Delta/2Δ/2≤θ≤π−Δ/2 and the sss above, ∣sin⁡(2sθ)∣/(2ssin⁡θ)≤1/2|\sin(2^s\theta)|/(2^s\sin\theta)\le1/2∣sin(2sθ)∣/(2ssinθ)≤1/2.
  5. kkk-copy bound. For ψ∈A+B\psi\in\mathcal A+\mathcal Bψ∈A+B with ψ⊥∣π⟩\psi\perp|\pi\rangleψ⊥∣π⟩, the all-zero-estimate component ψ0\psi_0ψ0​ of V∣ψ⟩∣0ks⟩V|\psi\rangle|0^{ks}\rangleV∣ψ⟩∣0ks⟩ has ∥ψ0∥≤2−k∥ψ∥\|\psi_0\|\le2^{-k}\|\psi\|∥ψ0​∥≤2−k∥ψ∥. For every ψ\psiψ, ∥(R(P)+Id)∣ψ⟩∣0ks⟩∥=2∥ψ0∥\|(R(P)+\mathrm{Id})|\psi\rangle|0^{ks}\rangle\|=2\|\psi_0\|∥(R(P)+Id)∣ψ⟩∣0ks⟩∥=2∥ψ0​∥.

Significance

Theorem 6 replaces the reflection about ∣π⟩|\pi\rangle∣π⟩ with a circuit that only calls the walk. Its cost scales as 1/Δ(P)1/\Delta(P)1/Δ(P) rather than as the cost of preparing ∣π⟩|\pi\rangle∣π⟩. Combined with Δ(P)≥2δ(P)\Delta(P)\ge2\sqrt{\delta(P)}Δ(P)≥2δ(P)​, where δ(P)\delta(P)δ(P) is the eigenvalue gap, this gives the search cost S+1ε(1δU+C)S+\frac1{\sqrt\varepsilon}\big(\frac1{\sqrt\delta}U+C\big)S+ε​1​(δ​1​U+C) of Theorem 7, up to logarithmic factors. The same approximate-reflection device recurs in later quantum-walk and amplitude-amplification algorithms.

The results are proved in the paper, which takes Theorem 4 from Szegedy and Theorem 5 from Cleve et al. As far as the platform index shows, none of Theorems 4, 5 or 6 has a machine-checked proof. The mission produces three reusable components: a Lean definition of the Szegedy walk and of the phase-estimation circuit, a formal Jordan-type spectral theorem for products of two reflections, and the analysis of phase estimation on an eigenvector.

Difficulty

Most of the work is linear algebra. The proof of Theorem 6 has a short outline: expand ψ\psiψ in eigenvectors of W(P)W(P)W(P), apply Theorem 5 to each, and bound each amplitude by 1/21/21/2. Three steps carry the weight:

  • Theorem 4. The eigen-decomposition of W(P)W(P)W(P) on A+B\mathcal A+\mathcal BA+B is Jordan's two-subspace decomposition, with the multiplicities read off the singular value decomposition of D(P)D(P)D(P). The decomposition has to be built, and the cases at singular values 000 and 111 have to be handled separately.
  • Uniqueness of ∣π⟩|\pi\rangle∣π⟩. This step needs ergodicity, through Perron–Frobenius, and reversibility, because D(P)D(P)D(P) is then symmetric and its singular values are the moduli of the eigenvalues of PPP. Without reversibility D(P)D(P)D(P) can have the singular value 111 twice, and property 3 then fails.
  • Repetition. The kkk phase estimations share one system register. Their product acts on an eigenvector as a tensor power on the ancillas. This needs the eigenvectors of the unitary W(P)W(P)W(P) restricted to the invariant subspace A+B\mathcal A+\mathcal BA+B to be orthogonal.

Formalization scope

  • H\mathcal HH is EuclideanSpace ℂ (X × X), with the first coordinate the first register.
  • The ancilla register is indexed by Fin (2^s), and kkk registers by Fin k → Fin (2^s); the all-zeros state is the zero index.
  • ref(K)\mathrm{ref}(\mathcal K)ref(K) is Mathlib's Submodule.reflection.
  • The stationary distribution π\piπ is passed as data with its defining hypotheses. "Ergodic" is Matrix.IsPrimitive.
  • Singular values of the real matrix D(P)D(P)D(P) are LinearMap.singularValues.
  • When D(P)D(P)D(P) has no singular value in (0,1)(0,1)(0,1), the paper leaves Δ(P)\Delta(P)Δ(P) undefined, and the formalization sets Δ(P)=π\Delta(P)=\piΔ(P)=π.
  • log⁡2\log_2log2​ is Real.logb 2 and the ceiling is Nat.ceil.

Deviations from the page.

  • Reversibility, the standing assumption of §3.2, is a hypothesis of the goal.
  • Property 3 is stated for vectors and is homogeneous in ∥ψ∥\|\psi\|∥ψ∥.
  • Theorem 5 is stated for any finite-dimensional unitary, not only 2m×2m2^m\times2^m2m×2m, and with ∣sin⁡(2sθ)∣|\sin(2^s\theta)|∣sin(2sθ)∣, because the printed right-hand side can be negative.
  • The single-copy bound also covers the eigenvalue −1-1−1.

Only exact statements are formalized. The cost halves (gate counts, calls to ccc-W(P)W(P)W(P), "s∈log⁡2(1/Δ)+O(1)s\in\log_2(1/\Delta)+O(1)s∈log2​(1/Δ)+O(1)", the qubit count, uniformity) are out of scope.

The circuit R(P)R(P)R(P) is the explicit composition above, built from C(W(P))C(W(P))C(W(P)). It is neither "some circuit with properties 2–3" nor anything defined through the projector onto ∣π⟩|\pi\rangle∣π⟩, either of which would make the goal a tautology.

Contributions welcome: proofs of the milestones, Jordan's lemma for two subspaces as a standalone result, and the bound Δ(P)≥2δ(P)\Delta(P)\ge2\sqrt{\delta(P)}Δ(P)≥2δ(P)​ of §3.3.

Selected references

  • F. Magniez, A. Nayak, J. Roland, M. Santha, Search via Quantum Walk, SIAM J. Comput. 40(1), 2011. https://arxiv.org/abs/quant-ph/0608026 (v4), https://doi.org/10.1137/090745854
  • M. Szegedy, Quantum speed-up of Markov chain based algorithms, FOCS 2004. https://doi.org/10.1109/FOCS.2004.53
  • R. Cleve, A. Ekert, C. Macchiavello, M. Mosca, Quantum algorithms revisited, Proc. R. Soc. Lond. A 454, 1998. https://doi.org/10.1098/rspa.1998.0164
  • C. Jordan, Essai sur la géométrie à n dimensions, Bull. Soc. Math. France 3, 1875. https://doi.org/10.24033/bsmf.90
11 thms3 active usersReviewed
Convex OptimizationMachine LearningStatistics·Captain: mikedeng1

Nuclear-Norm Penalization and Optimal Rates for Noisy Low-Rank Matrix Completion 2: If λ ≥ 3‖M‖∞ on a Linear Subspace, a Sharp Oracle Inequality with the Restricted Constant μ₅(A)Research Paper

Motivation

Estimating a large matrix that is approximately low rank from a few noisy linear measurements is a basic problem of high-dimensional statistics. It covers matrix completion (recovering a ratings table from a small sample of entries), multi-task regression and quantum state tomography. The standard estimator penalizes the nuclear norm, the sum of the singular values, which is the convex surrogate of the rank. Koltchinskii, Lounici and Tsybakov (arXiv:1011.6256v4; Ann. Statist. 39(5), 2011) study a variant of this estimator that uses the known distribution of the design. Their Theorem 1 proves sharp oracle inequalities, with leading constant 1, under a global isometry condition on the design (Assumption 1).

Global isometry is a strong requirement. For sparse vectors, the analogous requirement was relaxed to the restricted eigenvalue condition of Bickel, Ritov and Tsybakov (Ann. Statist. 37, 2009), which only asks for curvature on a cone of approximately sparse directions. The random-design version is due to Koltchinskii (Bernoulli 15, 2009), and a matrix version of the cone appears in Negahban, Ravikumar, Wainwright and Yu (arXiv:1010.2731). Theorem 2 of the paper is the matrix counterpart of the restricted eigenvalue analysis for this estimator. It keeps the leading constant 1, and the price is a stronger tuning condition, λ ≥ 3‖M‖∞ instead of 2‖M‖∞. Section 5.4 of the same paper derives from it a sharp sparsity oracle inequality for the ordinary vector Lasso.

Setting

Observe n pairs (Xᵢ, Yᵢ), i = 1, …, n, where Xᵢ is a random m₁ × m₂ real matrix and Yᵢ a real random variable, satisfying the trace regression model

E(Yi∣Xi)=tr⁡(Xi⊤A0),\mathbb E(Y_i \mid X_i) = \operatorname{tr}(X_i^\top A_0),E(Yi​∣Xi​)=tr(Xi⊤​A0​),

for an unknown matrix A₀. Write ⟨A, B⟩ = tr(AᵀB), and let ‖A‖₁, ‖A‖₂ and ‖A‖∞ be the nuclear, Frobenius and operator norms, the last being the largest singular value. The design enters through the bilinear form

⟨A,B⟩L2(Π)=1n∑i=1nE(⟨A,Xi⟩⟨B,Xi⟩),\langle A, B\rangle_{L_2(\Pi)} = \frac1n\sum_{i=1}^n \mathbb E\big(\langle A, X_i\rangle\langle B, X_i\rangle\big),⟨A,B⟩L2​(Π)​=n1​i=1∑n​E(⟨A,Xi​⟩⟨B,Xi​⟩),

with semi-norm ‖A‖_{L₂(Π)}. Two random objects are built from the sample: the noise matrix M = (1/n) Σᵢ (YᵢXᵢ − 𝔼(YᵢXᵢ)), and, for λ > 0 and a set 𝔸 of matrices, the estimator Â^λ, any minimizer over 𝔸 of

Ln(A)=∥A∥L2(Π)2−⟨2n∑i=1nYiXi,A⟩+λ∥A∥1.L_n(A) = \|A\|_{L_2(\Pi)}^2 - \Big\langle \frac2n\sum_{i=1}^n Y_iX_i, A\Big\rangle + \lambda\|A\|_1 .Ln​(A)=∥A∥L2​(Π)2​−⟨n2​i=1∑n​Yi​Xi​,A⟩+λ∥A∥1​.

Let A = Σ_{j≤r} σⱼ uⱼvⱼᵀ be a singular value decomposition, with support (S₁, S₂), the spans of the uⱼ and of the vⱼ. Write 𝒫_A⊥(B) = P_{S₁⊥} B P_{S₂⊥} for the part of B orthogonal to both singular spaces, and 𝒫_A(B) = B − 𝒫_A⊥(B). When 𝔸 is a linear subspace and c₀ ≥ 0, the cone ℂ_{A,c₀} consists of the B ∈ 𝔸 with ‖𝒫_A⊥(B)‖₁ ≤ c₀‖𝒫_A(B)‖₁. The restricted constant μ_{c₀}(A) is the infimum of the μ′ > 0 such that ‖𝒫_A(B)‖₂ ≤ μ′‖B‖{L₂(Π)} for every B ∈ ℂ{A,c₀}. The paper uses μ(A) := μ₅(A).

Formalization targets

Goal: Theorem 2, (2.19)

Let 𝔸 be a linear subspace. If λ ≥ 3‖M‖∞, then

∥A^λ−A0∥L2(Π)2≤inf⁡A∈A[∥A−A0∥L2(Π)2+λ2μ2(A)rank⁡(A)].\|\hat A^\lambda - A_0\|_{L_2(\Pi)}^2 \le \inf_{A \in \mathbb A}\Big[\|A - A_0\|_{L_2(\Pi)}^2 + \lambda^2\mu^2(A)\operatorname{rank}(A)\Big].∥A^λ−A0​∥L2​(Π)2​≤A∈Ainf​[∥A−A0​∥L2​(Π)2​+λ2μ2(A)rank(A)].

The bound is deterministic: it holds for every realization of the sample on which λ ≥ 3‖M‖∞. A₀ need not lie in 𝔸, and nothing is assumed about the design beyond what makes the objects finite.

Milestones

The milestones are the displays of the proof, in the order the proof uses them:

  1. (2.8), the inequality obtained from the first-order optimality condition of the estimator, which the proof of Theorem 1 already uses;
  2. (2.20), in the case ⟨Â^λ − A₀, Â^λ − A⟩_{L₂(Π)} > 0;
  3. (2.21), the splitting of ⟨M, Â^λ − A⟩ along 𝒫_A and 𝒫_A⊥;
  4. (2.22), the inequality (λ − 2Δ)‖𝒫_A⊥(Â^λ − A)‖₁ ≤ (λ + 2Δ)‖𝒫_A(Â^λ − A)‖₁ with Δ = ‖M‖∞;
  5. the membership Â^λ − A ∈ ℂ_{A,5} and the resulting bound by μ(A);
  6. the final two-step display with the constant 1 + 2√2/3.

Significance

Theorem 2 gives a sharp oracle inequality whose only design-dependent quantity is a restricted constant. That constant is finite in situations where the global isometry of Theorem 1 fails. The result covers every linear subspace 𝔸, for example all matrices, the diagonal matrices or matrices with a prescribed sparsity pattern. In the diagonal case it becomes a sharp sparsity oracle inequality for the vector Lasso under a restricted eigenvalue condition (the paper's Theorem 14). The oracle inequalities of Bickel, Ritov and Tsybakov under the same condition have a leading constant larger than 1.

The result is proved in the paper, in about half a page that leans on the proof of Theorem 1. No machine-checked version exists. A formalization pins down two things the printed proof leaves to the reader: the convex-analytic optimality condition behind (2.8), and the "obvious modification of (2.10)" and "some algebra" behind (2.20) and the final display. It also reuses and extends the platform's matrix vocabulary: nuclear and operator norms, SVD data, and the tangent and normal projections of the matrix completion missions.

Difficulty

The estimator is defined implicitly as a minimizer, so the analysis has to go through first-order conditions. Those require the subdifferential of the nuclear norm and a choice of subgradient that matches the support of the comparison matrix A. Mathlib has neither a characterization of this subdifferential nor the monotonicity argument in matrix form. The obvious route, copying Theorem 1, fails at the step that uses Assumption 1 to pass from Frobenius to L₂(Π) norms: without a global isometry, that comparison is available only on the cone ℂ_{A,5}, and the error is known to lie there only in the case ⟨Â^λ − A₀, Â^λ − A⟩_{L₂(Π)} > 0 and only for λ ≥ 3‖M‖∞. The constant 5 = (λ + 2Δ)/(λ − 2Δ) at λ = 3Δ is not slack. A linear subspace, not just a convex set, is needed so that Â^λ − A lies in 𝔸, where the cone lives.

Formalization scope

Matrices are RealMatrix m₁ m₂ from the published MatrixCompletion definitions. These supply ⟨·,·⟩ (matrixInner), the nuclear, Frobenius and operator norms, SVD data SVD A r, the sign matrix Σuⱼvⱼᵀ, and 𝒫_A, 𝒫_A⊥ (tangentProjection, normalProjection). This mission adds two definition files.

  • Model. ⟨·,·⟩{L₂(Π)}, M, L_n and the estimator, all at a fixed outcome ω. The structure TraceRegression holds the standing assumptions: measurable Xᵢ and Yᵢ, square-integrable entries of Xᵢ, integrable Yᵢ and YᵢXᵢ, and 𝔼(Yᵢ | σ(Xᵢ)) = tr(XᵢᵀA₀) almost surely. The page leaves the integrability implicit. Without it a Bochner integral would silently be 0 and ‖·‖{L₂(Π)} would be meaningless. Expectations of matrices are entrywise. Independence of the pairs (p. 1) is not assumed: Theorem 2 does not use it. The estimator is any minimizer of L_n over 𝔸.
  • Cone and restricted constant. ℂ_{A,c₀} ⊆ 𝔸 and the predicate "μ′ is a cone constant". μ(A) can be +∞ (no constant exists), and a real infimum of an empty set is 0. So every statement is made for every cone constant μ′ for (A, 5). This is equivalent to the infimum form and makes the bound vacuous exactly when the paper's is. A formalization with a real sInf would make (2.19) false and is ruled out.

The other conventions are these. "inf over A ∈ 𝔸" is a bound for every A ∈ 𝔸. rank(A) is Matrix.rank. n ≥ 1 and λ > 0 are assumed, as on the page. (2.8) is stated for a convex 𝔸, as in the proof of Theorem 1 where it is derived. (2.21) is stated for an arbitrary matrix in place of Â^λ − A. No printed statement needed correction.

A complete development needs the subdifferential of the nuclear norm ((2.1) of the paper), the first-order condition for constrained convex minimization, the identity (2.9) and the facts (2.10), and trace duality, which is on the platform as matrix_trace_duality_inequality. The subdifferential of the nuclear norm and the projection estimates are reusable well beyond this mission. Contributions of those general lemmas are welcome.

Selected references

  • V. Koltchinskii, K. Lounici, A. B. Tsybakov, Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion, arXiv:1011.6256v4, 2016 (Ann. Statist. 39(5), 2302–2329, 2011). https://arxiv.org/abs/1011.6256
  • P. J. Bickel, Y. Ritov, A. B. Tsybakov, Simultaneous analysis of Lasso and Dantzig selector, Ann. Statist. 37(4), 1705–1732, 2009. https://doi.org/10.1214/08-AOS620
  • V. Koltchinskii, The Dantzig selector and sparsity oracle inequalities, Bernoulli 15(3), 799–828, 2009. https://doi.org/10.3150/09-BEJ187
  • S. Negahban, P. Ravikumar, M. J. Wainwright, B. Yu, A unified framework for high-dimensional analysis of M-estimators with decomposable regularizers, arXiv:1010.2731, 2010 (Statist. Sci. 27(4), 2012). https://arxiv.org/abs/1010.2731
  • G. A. Watson, Characterization of the subdifferential of some matrix norms, Linear Algebra Appl. 170, 33–45, 1992. https://doi.org/10.1016/0024-3795(92)90407-2
14 thms3 active usersReviewed
Convex OptimizationMachine LearningStatistics·Captain: mikedeng1

Nuclear-Norm Penalization and Optimal Rates for Noisy Low-Rank Matrix Completion 1: If λ ≥ 2‖M‖∞, the Nuclear-Norm Penalized Estimator Obeys Sharp Oracle Inequalities with Leading Constant 1Research Paper

Motivation

Many estimation problems in statistics and machine learning ask for an unknown matrix observed only through noisy linear measurements: matrix completion (recover a large matrix from a few noisy entries, as in collaborative filtering), multi-task regression, and quantum state tomography. A common structural prior is that the unknown matrix has low rank, and the standard convex surrogate for rank is the nuclear norm, the sum of the singular values. Penalizing a least-squares criterion by the nuclear norm gives an estimator that can be computed by convex optimization.

Koltchinskii, Lounici and Tsybakov (arXiv:1011.6256v4; Ann. Statist. 39(5), 2011) study a nuclear-norm penalized estimator in the general trace regression model and prove that it satisfies sharp oracle inequalities: the excess prediction error is bounded by the best approximation error over a class of matrices with leading constant exactly 111, plus a remainder governed by either the nuclear norm ("slow rate") or the rank ("fast rate") of the approximating matrix. A distinctive feature of their estimator is that it uses the known design distribution Π\PiΠ, which the empirical-risk estimators of the earlier literature (Candès and Plan 2010; Rohde and Tsybakov 2011; Negahban and Wainwright 2011) do not exploit; for noisy matrix completion the previously available bounds were suboptimal. Their Theorem 1 is the deterministic core from which the paper's matrix completion rates (Theorem 4) follow by bounding one random matrix in operator norm.

Setting

Let (Xi,Yi)(X_i,Y_i)(Xi​,Yi​), i=1,…,ni=1,\dots,ni=1,…,n, be random pairs, XiX_iXi​ a real m1×m2m_1\times m_2m1​×m2​ matrix and YiY_iYi​ a real number, satisfying the trace regression model

E(Yi∣Xi)=⟨A0,Xi⟩,⟨A,B⟩=tr⁡(A⊤B),\mathbb E(Y_i\mid X_i)=\langle A_0,X_i\rangle,\qquad \langle A,B\rangle=\operatorname{tr}(A^\top B),E(Yi​∣Xi​)=⟨A0​,Xi​⟩,⟨A,B⟩=tr(A⊤B),

for an unknown matrix A0A_0A0​. Let Πi\Pi_iΠi​ be the law of XiX_iXi​ and Π=1n∑iΠi\Pi=\frac1n\sum_i\Pi_iΠ=n1​∑i​Πi​. The L2(Π)L_2(\Pi)L2​(Π) inner product and semi-norm are

⟨A,B⟩L2(Π)=1n∑i=1nE(⟨A,Xi⟩⟨B,Xi⟩),∥A∥L2(Π)2=⟨A,A⟩L2(Π).\langle A,B\rangle_{L_2(\Pi)}=\frac1n\sum_{i=1}^n\mathbb E\big(\langle A,X_i\rangle\langle B,X_i\rangle\big),\qquad \|A\|^2_{L_2(\Pi)}=\langle A,A\rangle_{L_2(\Pi)}.⟨A,B⟩L2​(Π)​=n1​i=1∑n​E(⟨A,Xi​⟩⟨B,Xi​⟩),∥A∥L2​(Π)2​=⟨A,A⟩L2​(Π)​.

For a matrix AAA with singular values σj(A)\sigma_j(A)σj​(A), ∥A∥1=∑jσj(A)\|A\|_1=\sum_j\sigma_j(A)∥A∥1​=∑j​σj​(A) is the nuclear norm, ∥A∥2\|A\|_2∥A∥2​ the Frobenius norm, and ∥A∥∞=σ1(A)\|A\|_\infty=\sigma_1(A)∥A∥∞​=σ1​(A) the operator norm. If A=∑j=1rσjujvj⊤A=\sum_{j=1}^r\sigma_ju_jv_j^\topA=∑j=1r​σj​uj​vj⊤​ is a singular value decomposition, the pair (S1,S2)=(span⁡{uj},span⁡{vj})(S_1,S_2)=(\operatorname{span}\{u_j\},\operatorname{span}\{v_j\})(S1​,S2​)=(span{uj​},span{vj​}) is the support of AAA, and PSP_SPS​ is the orthogonal projector onto SSS.

Given a set A\mathbb AA of matrices and λ>0\lambda>0λ>0, the estimator is

A^λ∈argmin⁡A∈ALn(A),Ln(A)=∥A∥L2(Π)2−⟨2n∑i=1nYiXi,A⟩+λ∥A∥1.\hat A^\lambda\in\operatorname*{argmin}_{A\in\mathbb A}L_n(A),\qquad L_n(A)=\|A\|^2_{L_2(\Pi)}-\Big\langle\frac2n\sum_{i=1}^nY_iX_i,A\Big\rangle+\lambda\|A\|_1 .A^λ∈A∈Aargmin​Ln​(A),Ln​(A)=∥A∥L2​(Π)2​−⟨n2​i=1∑n​Yi​Xi​,A⟩+λ∥A∥1​.

The random matrix

M=1n∑i=1n(YiXi−E(YiXi))\mathbf M=\frac1n\sum_{i=1}^n\big(Y_iX_i-\mathbb E(Y_iX_i)\big)M=n1​i=1∑n​(Yi​Xi​−E(Yi​Xi​))

carries all the noise. Assumption 1 asks for a constant μ>0\mu>0μ>0 with ∥A∥L2(Π)2≥μ−2∥A∥22\|A\|^2_{L_2(\Pi)}\ge\mu^{-2}\|A\|_2^2∥A∥L2​(Π)2​≥μ−2∥A∥22​ for all A∈A−AA\in\mathbb A-\mathbb AA∈A−A.

Formalization targets

Goal: Theorem 1

If λ≥2∥M∥∞\lambda\ge2\|\mathbf M\|_\inftyλ≥2∥M∥∞​, then for any set A\mathbb AA

∥A^λ−A0∥L2(Π)2≤inf⁡A∈A[∥A−A0∥L2(Π)2+2λ∥A∥1],(2.3)\|\hat A^\lambda-A_0\|^2_{L_2(\Pi)}\le\inf_{A\in\mathbb A}\Big[\|A-A_0\|^2_{L_2(\Pi)}+2\lambda\|A\|_1\Big],\tag{2.3}∥A^λ−A0​∥L2​(Π)2​≤A∈Ainf​[∥A−A0​∥L2​(Π)2​+2λ∥A∥1​],(2.3)

and if moreover A\mathbb AA is convex and Assumption 1 holds,

∥A^λ−A0∥L2(Π)2≤inf⁡A∈A[∥A−A0∥L2(Π)2+(1+22)2μ2λ2rank⁡(A)],(2.4)\|\hat A^\lambda-A_0\|^2_{L_2(\Pi)}\le\inf_{A\in\mathbb A}\Big[\|A-A_0\|^2_{L_2(\Pi)}+\Big(\tfrac{1+\sqrt2}{2}\Big)^2\mu^2\lambda^2\operatorname{rank}(A)\Big],\tag{2.4}∥A^λ−A0​∥L2​(Π)2​≤A∈Ainf​[∥A−A0​∥L2​(Π)2​+(21+2​​)2μ2λ2rank(A)],(2.4)

and, for every A∈AA\in\mathbb AA∈A with support (S1,S2)(S_1,S_2)(S1​,S2​),

∥A^λ−A0∥L2(Π)2+(λ−2∥M∥∞)∥PS1⊥A^λPS2⊥∥1≤∥A−A0∥L2(Π)2+(1+22)2μ2λ2rank⁡(A).(2.5)\|\hat A^\lambda-A_0\|^2_{L_2(\Pi)}+(\lambda-2\|\mathbf M\|_\infty)\|P_{S_1^\perp}\hat A^\lambda P_{S_2^\perp}\|_1\le\|A-A_0\|^2_{L_2(\Pi)}+\Big(\tfrac{1+\sqrt2}{2}\Big)^2\mu^2\lambda^2\operatorname{rank}(A).\tag{2.5}∥A^λ−A0​∥L2​(Π)2​+(λ−2∥M∥∞​)∥PS1⊥​​A^λPS2⊥​​∥1​≤∥A−A0​∥L2​(Π)2​+(21+2​​)2μ2λ2rank(A).(2.5)

The theorem is deterministic: it holds at every realization of the sample at which λ≥2∥M∥∞\lambda\ge2\|\mathbf M\|_\inftyλ≥2∥M∥∞​.

Milestones

The milestones follow the paper's proof: the subdifferential of the nuclear norm (2.1); the basic inequality of p. 7 and the slow-rate bound (2.3); the first-order condition (2.6); the identity (2.9) and the facts (2.10); the inequality (2.11); the decomposition bound (2.12)–(2.14); the bound on Λ\LambdaΛ via (2.15); and the combined inequality (2.17). The rank bound (2.16) is included as a supporting statement (not a milestone).

Significance

Theorem 1 separates the statistical problem into a deterministic oracle inequality and a single probabilistic estimate, ∥M∥∞≤λ/2\|\mathbf M\|_\infty\le\lambda/2∥M∥∞​≤λ/2. Any concentration bound for ∥M∥∞\|\mathbf M\|_\infty∥M∥∞​ (matrix Bernstein for uniform sampling, Gaussian bounds for fixed designs) then gives a rate. The paper uses it to obtain matrix completion rates which its minimax lower bounds show to be optimal up to logarithmic factors on the class of matrices of rank at most rrr with entries bounded by aaa. The leading constant 111 means the bounds remain informative when A0A_0A0​ is not low rank but only well approximated by low-rank matrices.

The result has been proved on paper since 2011; to our knowledge no machine-checked proof exists. A formal proof requires the subdifferential of the nuclear norm and its interplay with the singular-subspace projections, which are reusable for every nuclear-norm method (singular value thresholding, robust PCA, multi-task learning).

Difficulty

The slow-rate bound (2.3) is a short computation from the definition of a minimizer and trace duality. The fast-rate bounds (2.4)–(2.5) are not: a minimizer comparison alone gives only λ∥A^λ−A∥1\lambda\|\hat A^\lambda-A\|_1λ∥A^λ−A∥1​ as remainder, which does not scale with rank⁡(A)\operatorname{rank}(A)rank(A). One needs the variational inequality (2.6) over the convex set A\mathbb AA, the exact description (2.1) of the nuclear-norm subdifferential at an arbitrary comparison matrix AAA, and a decomposition of ⟨M,A^λ−A⟩\langle\mathbf M,\hat A^\lambda-A\rangle⟨M,A^λ−A⟩ along the support of AAA in which the component orthogonal to the support is controlled in operator norm and the rest in Frobenius norm. Formally, (2.1) itself requires identifying the abstract singular values with a given decomposition and characterizing the operator-norm ball as the dual of the nuclear norm.

Formalization scope

Matrices are RealMatrix m₁ m₂ = Matrix (Fin m₁) (Fin m₂) ℝ, with the published MatrixCompletion definitions supplying the Frobenius inner product matrixInner, nuclearNorm (sum of Mathlib's singular values), spectralNorm (operator norm), frobeniusNorm, SVD data SVD A r and the projections twoSidedSingularProjection (PS1⋅PS2P_{S_1}\cdot P_{S_2}PS1​​⋅PS2​​), tangentProjection (PA\mathcal P_APA​) and normalProjection (PS1⊥⋅PS2⊥P_{S_1^\perp}\cdot P_{S_2^\perp}PS1⊥​​⋅PS2⊥​​). The sample lives on a probability space (Ω, P) with 0 < n; expectations of matrices are entrywise. Conventions committed to:

  1. Realization-wise statements. ω\omegaω is fixed; A^\hat AA^ is any matrix with A^∈A\hat A\in\mathbb AA^∈A and Ln(A^)≤Ln(A)L_n(\hat A)\le L_n(A)Ln​(A^)≤Ln​(A) for all A∈AA\in\mathbb AA∈A. Existence of a minimizer is not asserted.
  2. Infima are stated as the bound for every A∈AA\in\mathbb AA∈A (equivalent; no real sInf is used).
  3. The model (1.1) is the conditional expectation of YiY_iYi​ given the σ\sigmaσ-algebra generated by the entries of XiX_iXi​.
  4. Added regularity, not printed in the paper: every entry of XiX_iXi​ is measurable and square integrable, YiY_iYi​ is measurable and integrable, and Yi(Xi)jkY_i(X_i)_{jk}Yi​(Xi​)jk​ is integrable. Without these, Lean's Bochner integral returns 000 and ∥⋅∥L2(Π)\|\cdot\|_{L_2(\Pi)}∥⋅∥L2​(Π)​ and M\mathbf MM would be meaningless.
  5. Independence of the pairs is not assumed; the proof does not use it.
  6. Supports are given by SVD data; bounds use A.rank.
  7. Corrected statement. The first fact of (2.10), ∥∑jujvj⊤∥∞=1\|\sum_ju_jv_j^\top\|_\infty=1∥∑j​uj​vj⊤​∥∞​=1, is false for A=0A=0A=0 (empty sum); the milestone assumes r>0r>0r>0.
  8. Steps the paper states for A^λ\hat A^\lambdaA^λ or M\mathbf MM but which hold for arbitrary matrices ((2.9), (2.10), (2.12)–(2.16)) are stated for arbitrary matrices.

Ruling out trivializations: the goal states (2.3)–(2.5) with the paper's constants and remainder terms, not the intermediate bound (2.17), and A^\hat AA^ is pinned down as a minimizer over A\mathbb AA, not an arbitrary matrix.

Welcome contributions: proofs of the nuclear-norm subdifferential (2.1) and of the projection facts, which are reusable well beyond this mission, and the measure-theoretic identity 1n∑iE(YiXi)=1n∑iE(⟨A0,Xi⟩Xi)\frac1n\sum_i\mathbb E(Y_iX_i)=\frac1n\sum_i\mathbb E(\langle A_0,X_i\rangle X_i)n1​∑i​E(Yi​Xi​)=n1​∑i​E(⟨A0​,Xi​⟩Xi​) from the model.

Selected references

  • V. Koltchinskii, K. Lounici, A. B. Tsybakov, Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion, arXiv:1011.6256v4, 2016 (the source of this mission); Ann. Statist. 39(5), 2302–2329, 2011. https://arxiv.org/abs/1011.6256, https://doi.org/10.1214/11-AOS894
  • G. A. Watson, Characterization of the subdifferential of some matrix norms, Linear Algebra Appl. 170, 33–45, 1992 (reference [28] of the source; the description (2.1) of the nuclear-norm subdifferential). https://doi.org/10.1016/0024-3795(92)90407-2
  • E. J. Candès, Y. Plan, Matrix completion with noise, Proc. IEEE 98(6), 925–936, 2010. https://doi.org/10.1109/JPROC.2009.2035722
  • A. Rohde, A. B. Tsybakov, Estimation of high-dimensional low-rank matrices, Ann. Statist. 39(2), 887–930, 2011. https://doi.org/10.1214/10-AOS860
  • S. Negahban, M. J. Wainwright, Estimation of (near) low-rank matrices with noise and high-dimensional scaling, Ann. Statist. 39(2), 1069–1097, 2011. https://doi.org/10.1214/10-AOS850
19 thms3 active usersReviewed
🏆Completed
AnalysisFunctional Analysis·Captain: wurtle

The complete Crouzeix theorem: optimal similarity and a common positive boundary representationResearch Paper

Motivation

For a square matrix AAA, the spectrum alone does not control the size of p(A)p(A)p(A): a nonzero nilpotent matrix has spectrum {0}\{0\}{0} yet ∥A∥>0\|A\|>0∥A∥>0. The numerical range W(A)={u∗Au: ∥u∥=1}W(A)=\{u^*Au:\ \|u\|=1\}W(A)={u∗Au: ∥u∥=1} is a compact convex set containing the spectrum (Toeplitz–Hausdorff), and it does retain enough information. Crouzeix's conjecture (2004) asserts that for every polynomial ppp,

∥p(A)∥≤2max⁡z∈W(A)∣p(z)∣,\|p(A)\|\le 2\max_{z\in W(A)}|p(z)|,∥p(A)∥≤2z∈W(A)max​∣p(z)∣,

i.e. that W(A)W(A)W(A) is a 222-spectral set; the constant 222 would be optimal. Such bounds are used to estimate matrix functions in numerical linear algebra (for example GMRES convergence through Faber polynomials) and in operator theory. The complete version asks for the same constant when the polynomial has m×mm\times mm×m matrix coefficients, uniformly in mmm; by Paulsen's theorem this is equivalent to similarity of the conformal disk image of AAA to a contraction with condition number at most 222.

Background

  • 1918–1919 — Toeplitz and Hausdorff prove convexity of the numerical range (Math. Z. 1918, Math. Z. 1919).
  • 1972, 1984 — Arveson's dilation theory (Acta Math. 128, 1972) and Paulsen's similarity theorem (Proc. AMS 92, 1984) relate complete contractivity, dilations and similarity.
  • 1999 — Delyon and Delyon's positive integral representations (Bull. SMF 1999).
  • 2004 — Crouzeix formulates the constant-two question (IEOT 2004); 2007 — he proves a universal complete bound 11.0811.0811.08 (JFA 2007).
  • 2006 — Badea, Crouzeix and Delyon obtain the complete constant 222 for 2×22\times22×2 matrices (Math. Z. 2006).
  • 2017–2018 — Crouzeix and Palencia prove the complete bound 1+21+\sqrt21+2​ (SIMAX 2017); Ransford and Schwenninger simplify the argument (SIMAX 2018).
  • 2026 — Scalar (m=1m=1m=1) constant-two proofs appear in preprints of Jin, Lorist–Schwenninger (arXiv:2608.03841) and Luo; Åhag, Czyż and Virtanen prove the complete inequality for base matrices of order at most three (arXiv:2608.27346).
  • September 2026 — Two OpenAI preprints claim the complete inequality in all dimensions: a structural proof via an optimal similarity and a common positive boundary density, extended to all bounded Hilbert-space operators (source), and a direct coefficient proof for matrices (source).

This mission asks for a formal proof of the complete Crouzeix inequality for all bounded operators on complex Hilbert spaces, with its sharpness, as stated in Corollary 6.3 of an OpenAI preprint dated September 23, 2026 (source), together with the preprint's structural theorems as milestones. The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) (n≥1n\ge1n≥1) let W(A)={u∗Au:u∈Cn, u∗u=1}W(A)=\{u^*Au: u\in\mathbb C^n,\ u^*u=1\}W(A)={u∗Au:u∈Cn, u∗u=1}. A matrix polynomial of degree ddd with coefficient size m≥1m\ge1m≥1 is P(z)=∑k=0dBkzkP(z)=\sum_{k=0}^dB_kz^kP(z)=∑k=0d​Bk​zk with Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C). Its evaluation at AAA is

P[A]=∑k=0dAk⊗Bk ∈Mn(C)⊗Mm(C),P[A]=\sum_{k=0}^d A^k\otimes B_k\ \in M_n(\mathbb C)\otimes M_m(\mathbb C),P[A]=k=0∑d​Ak⊗Bk​ ∈Mn​(C)⊗Mm​(C),

with the base space first. All norms are Euclidean operator norms. For m=1m=1m=1 this is the usual p(A)p(A)p(A).

For a bounded operator AAA on a complex Hilbert space H≠{0}\mathcal H\neq\{0\}H={0}, W(A)={⟨x,Ax⟩:∥x∥=1}W(A)=\{\langle x,Ax\rangle:\|x\|=1\}W(A)={⟨x,Ax⟩:∥x∥=1} and K=W(A)‾K=\overline{W(A)}K=W(A)​; P[A]=∑kAk⊗BkP[A]=\sum_kA^k\otimes B_kP[A]=∑k​Ak⊗Bk​ acts on H⊗Cm\mathcal H\otimes\mathbb C^mH⊗Cm. A bounded open convex Ω⊂C\Omega\subset\mathbb CΩ⊂C is admissible if its boundary is a regular real-analytic Jordan curve. For such Ω⊃W(A)\Omega\supset W(A)Ω⊃W(A) (AAA a matrix) with interior conformal map f:Ω→Df:\Omega\to\mathbb Df:Ω→D, put T=f(A)T=f(A)T=f(A) and

κ2=min⁡{τ: I⪯H⪯τI, T∗HT⪯H for some H=H∗}.\kappa^2=\min\{\tau:\ I\preceq H\preceq\tau I,\ T^*HT\preceq H\ \text{for some } H=H^*\}.κ2=min{τ: I⪯H⪯τI, T∗HT⪯H for some H=H∗}.

Formalization targets

Milestone: geometry of the numerical range (Corollary 6.3, p. 16, first assertion)

For H≠{0}\mathcal H\neq\{0\}H={0}, K=W(A)‾K=\overline{W(A)}K=W(A)​ is compact and convex and contains spec⁡(A)\operatorname{spec}(A)spec(A).

Milestone: the zero space (Corollary 6.3, p. 16, case H={0}\mathcal H=\{0\}H={0})

If H={0}\mathcal H=\{0\}H={0}, the numerical range is empty, every polynomial, holomorphic and rational evaluation is 000, and the corresponding inequalities read 0≤00\le00≤0 (with the supremum over the empty set taken to be 000).

Milestone: optimal metric and common positive representation (Lemma 1.1, Theorems 1.2–1.3, p. 2)

For admissible Ω\OmegaΩ conformal coordinates exist; for every n≥1n\ge1n≥1 and A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) with W(A)⊂ΩW(A)\subset\OmegaW(A)⊂Ω, the problem defining κ2\kappa^2κ2 is strictly feasible with attained minimum 1≤κ2≤41\le\kappa^2\le41≤κ2≤4; for a minimizer HHH, S=H1/2S=H^{1/2}S=H1/2 satisfies ∥S∥∥S−1∥=κ≤2\|S\|\|S^{-1}\|=\kappa\le2∥S∥∥S−1∥=κ≤2 and D=Sf(A)S−1D=Sf(A)S^{-1}D=Sf(A)S−1 is a contraction with ρ(D)<1\rho(D)<1ρ(D)<1; and one continuous Λ:T→Mn(C)\Lambda:\mathbb T\to M_n(\mathbb C)Λ:T→Mn​(C) with Λ⪰0\Lambda\succeq0Λ⪰0, ∫Λ dσ=I\int\Lambda\,d\sigma=I∫Λdσ=I represents v[SAS−1]=∫Λ(t)⊗v(G(t)) dσ(t)v[SAS^{-1}]=\int\Lambda(t)\otimes v(G(t))\,d\sigma(t)v[SAS−1]=∫Λ(t)⊗v(G(t))dσ(t) for every mmm and every MmM_mMm​-valued vvv holomorphic near Ω‾\overline\OmegaΩ, giving ∥v[A]∥≤κmax⁡Ω‾∥v∥\|v[A]\|\le\kappa\max_{\overline\Omega}\|v\|∥v[A]∥≤κmaxΩ​∥v∥.

Milestone: the matrix inequality (Corollary 6.1, p. 15)

For all n,m≥1n,m\ge1n,m≥1, d≥0d\ge0d≥0, A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C), Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C): ∥P[A]∥≤2max⁡W(A)∥P∥\|P[A]\|\le2\max_{W(A)}\|P\|∥P[A]∥≤2maxW(A)​∥P∥, and no smaller universal constant works.

Goal: Corollary 6.3 (p. 16)

For every complex Hilbert space H\mathcal HH (no separability assumption) and A∈B(H)A\in B(\mathcal H)A∈B(H): if H≠{0}\mathcal H\neq\{0\}H={0} then KKK is compact, convex, contains the spectrum, and for every m≥1m\ge1m≥1

∥P[A]∥≤2sup⁡W(A)∥P∥=2max⁡K∥P∥,∥F[A]∥≤2max⁡K∥F∥,∥R[A]∥≤2max⁡K∥R∥\|P[A]\|\le 2\sup_{W(A)}\|P\|=2\max_K\|P\|,\qquad \|F[A]\|\le2\max_K\|F\|,\qquad \|R[A]\|\le 2\max_K\|R\|∥P[A]∥≤2W(A)sup​∥P∥=2Kmax​∥P∥,∥F[A]∥≤2Kmax​∥F∥,∥R[A]∥≤2Kmax​∥R∥

for matrix polynomials PPP, matrix functions FFF holomorphic on an open U⊇KU\supseteq KU⊇K (holomorphic functional calculus), and matrix rational functions RRR with poles off KKK; if H={0}\mathcal H=\{0\}H={0} the degenerate statements above hold; and the constant 222 is optimal.

Significance

The result itself. It resolves the complete Crouzeix conjecture in its operator formulation, independent of the Hilbert space, the coefficient size and the degree: W(A)‾\overline{W(A)}W(A)​ is a complete 222-spectral set for every bounded operator. The structural theorems give more than the inequality: an optimal similarity, attained, with condition number at most 222, and one positive boundary density that represents every matrix-valued analytic evaluation simultaneously. These are the objects predicted abstractly by Paulsen's and Arveson's theorems, constructed here explicitly. A companion OpenAI preprint gives an independent direct proof of the matrix inequality.

Formalizing it. Mathlib has bounded operators, the holomorphic functional calculus is only partially available, and conformal mapping of analytic Jordan domains is absent. A complete development needs the Riemann mapping theorem with boundary extension, semidefinite optimization over Hermitian matrices, Haar integration on the circle, and a finite-compression argument for nonseparable spaces.

Difficulty

Two obstacles stand out. First, the passage from the scalar to the complete inequality: scalar proofs exploit commutativity that fails for matrix coefficients, so a structure valid for every coefficient size at once is needed; here it is the optimal metric chosen before any test function. Proving κ≤2\kappa\le2κ≤2 for that metric requires an endpoint extremal pair (Proposition 2.2, p. 6) and an ordered density comparison (Lemma 5.1, p. 14). Second, the passage from matrices to arbitrary operators: the numerical range of a compression lies in W(A)W(A)W(A), but one must show every vector of H⊗Cm\mathcal H\otimes\mathbb C^mH⊗Cm and its image under P[A]P[A]P[A] live in a finite-dimensional compression, and treat holomorphic and rational calculi through contour integrals around the closed numerical range.

Formalization scope

  • H is any type with InnerProductSpace ℂ H and CompleteSpace H; operators are H →L[ℂ] H. The amplification H⊗Cm\mathcal H\otimes\mathbb C^mH⊗Cm is the completion of the algebraic tensor product, and Ak⊗BkA^k\otimes B_kAk⊗Bk​ is the completed TensorProduct.mapL.
  • supNorm S F = sSup (insert 0 (‖F ·‖ '' S)), so the supremum over an empty set is 000, matching the convention of Corollary 6.3.
  • Holomorphic evaluation is defined by a contour integral over a CalculusContour around KKK inside UUU; the goal asserts such contours exist and that the evaluation is contour-independent. Rational evaluation inverts aeval A denom; the goal asserts these denominators are units and that the rational evaluation agrees with the holomorphic one.
  • SharpConstant is witnessed by a 2×22\times22×2 matrix with sup⁡W∣P∣=1\sup_{W}|P|=1supW​∣P∣=1 and ∥P[A]∥=2\|P[A]\|=2∥P[A]∥=2.
  • The structural milestone also includes, as an extra conjunct, that the open unit disk is admissible.

Two further published supporting statements are included as items but not milestones: existence of a finite-dimensional compression representing a given vector (a step in the proof of Corollary 6.3) and invertibility of rational denominators (the well-definedness part of the rational calculus).

Selected references

  • OpenAI, The complete Crouzeix theorem: optimal similarity and a common positive boundary representation, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-complete-Crouzeix-theorem-September-23-2026/paper.pdf
  • OpenAI, A direct proof of the complete Crouzeix inequality, OpenAI Math Release preprint, September 26, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-direct-proof-of-the-complete-Crouzeix-inequality-September-26-2026/paper.pdf
  • V. I. Paulsen, Completely bounded homomorphisms of operator algebras, Proc. Amer. Math. Soc. 92 (1984), 225–228.
  • W. Arveson, Subalgebras of C-algebras II*, Acta Math. 128 (1972), 271–308.
  • M. Crouzeix, Bounds for analytical functions of matrices, Integral Equations Operator Theory 48 (2004), 461–477. https://doi.org/10.1007/s00020-002-1188-6
  • M. Crouzeix, Numerical range and functional calculus in Hilbert space, J. Funct. Anal. 244 (2007), 668–690. https://doi.org/10.1016/j.jfa.2006.10.013
  • M. Crouzeix, C. Palencia, The numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 38 (2017), 649–655. https://doi.org/10.1137/17M1116672
  • T. Ransford, F. L. Schwenninger, Remarks on the Crouzeix–Palencia proof that the numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 39 (2018), 342–345. https://doi.org/10.1137/17M1143757
  • C. Badea, M. Crouzeix, B. Delyon, Convex domains and K-spectral sets, Math. Z. 252 (2006), 345–365. https://doi.org/10.1007/s00209-005-0857-y
  • B. Delyon, F. Delyon, Generalization of von Neumann's spectral sets and integral representation of operators, Bull. Soc. Math. France 127 (1999), 25–41. https://doi.org/10.24033/bsmf.2340
  • E. Lorist, F. L. Schwenninger, A solution to Crouzeix's conjecture, arXiv:2608.03841 (2026). https://arxiv.org/abs/2608.03841v2
  • P. Åhag, R. Czyż, J. Virtanen, The complete Crouzeix conjecture in dimension three and the Clouâtre–Ostermann–Ransford conjecture, arXiv:2608.27346 (2026). https://arxiv.org/abs/2608.27346v4
  • O. Toeplitz, Das algebraische Analogon zu einem Satze von Fejér, Math. Z. 2 (1918), 187–197. https://doi.org/10.1007/BF01212904
  • F. Hausdorff, Der Wertvorrat einer Bilinearform, Math. Z. 3 (1919), 314–316. https://doi.org/10.1007/BF01292610
10 thms3 active usersReviewed
🏆Completed
AnalysisFunctional Analysis·Captain: wurtle

A direct proof of the complete Crouzeix inequalityResearch Paper

Motivation

For a square matrix AAA, the spectrum alone does not control the size of p(A)p(A)p(A): a nonzero nilpotent matrix has spectrum {0}\{0\}{0} yet ∥A∥>0\|A\|>0∥A∥>0. The numerical range W(A)={u∗Au: ∥u∥=1}W(A)=\{u^*Au:\ \|u\|=1\}W(A)={u∗Au: ∥u∥=1} is a compact convex set containing the spectrum (Toeplitz–Hausdorff), and it does retain enough information. Crouzeix's conjecture (2004) asserts that for every polynomial ppp,

∥p(A)∥≤2max⁡z∈W(A)∣p(z)∣,\|p(A)\|\le 2\max_{z\in W(A)}|p(z)|,∥p(A)∥≤2z∈W(A)max​∣p(z)∣,

i.e. that W(A)W(A)W(A) is a 222-spectral set; the constant 222 would be optimal. Such bounds are used to estimate matrix functions in numerical linear algebra (for example GMRES convergence through Faber polynomials) and in operator theory. The complete version asks for the same constant when the polynomial has m×mm\times mm×m matrix coefficients, uniformly in mmm; by Paulsen's theorem this is equivalent to similarity of the conformal disk image of AAA to a contraction with condition number at most 222.

Background

  • 1918–1919 — Toeplitz and Hausdorff prove convexity of the numerical range (Math. Z. 1918, Math. Z. 1919).
  • 1972, 1984 — Arveson's dilation theory (Acta Math. 128, 1972) and Paulsen's similarity theorem (Proc. AMS 92, 1984) relate complete contractivity, dilations and similarity.
  • 1999 — Delyon and Delyon's positive integral representations (Bull. SMF 1999).
  • 2004 — Crouzeix formulates the constant-two question (IEOT 2004); 2007 — he proves a universal complete bound 11.0811.0811.08 (JFA 2007).
  • 2006 — Badea, Crouzeix and Delyon obtain the complete constant 222 for 2×22\times22×2 matrices (Math. Z. 2006).
  • 2017–2018 — Crouzeix and Palencia prove the complete bound 1+21+\sqrt21+2​ (SIMAX 2017); Ransford and Schwenninger simplify the argument (SIMAX 2018).
  • 2026 — Scalar (m=1m=1m=1) constant-two proofs appear in preprints of Jin, Lorist–Schwenninger (arXiv:2608.03841) and Luo; Åhag, Czyż and Virtanen prove the complete inequality for base matrices of order at most three (arXiv:2608.27346).
  • September 2026 — Two OpenAI preprints claim the complete inequality in all dimensions: a structural proof via an optimal similarity and a common positive boundary density, extended to all bounded Hilbert-space operators (source), and a direct coefficient proof for matrices (source).

This mission asks for a formal proof of the complete Crouzeix inequality for matrices, with its sharpness, as stated in Theorem 1.1 of an OpenAI preprint dated September 26, 2026 (source). The preprint has not been peer reviewed and its claims have not been independently verified; on the platform the Lean goal is open.

Setting

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) (n≥1n\ge1n≥1) let W(A)={u∗Au:u∈Cn, u∗u=1}W(A)=\{u^*Au: u\in\mathbb C^n,\ u^*u=1\}W(A)={u∗Au:u∈Cn, u∗u=1}. A matrix polynomial of degree ddd with coefficient size m≥1m\ge1m≥1 is P(z)=∑k=0dBkzkP(z)=\sum_{k=0}^dB_kz^kP(z)=∑k=0d​Bk​zk with Bk∈Mm(C)B_k\in M_m(\mathbb C)Bk​∈Mm​(C). Its evaluation at AAA is

P[A]=∑k=0dAk⊗Bk ∈Mn(C)⊗Mm(C),P[A]=\sum_{k=0}^d A^k\otimes B_k\ \in M_n(\mathbb C)\otimes M_m(\mathbb C),P[A]=k=0∑d​Ak⊗Bk​ ∈Mn​(C)⊗Mm​(C),

with the base space first. All norms are Euclidean operator norms. For m=1m=1m=1 this is the usual p(A)p(A)p(A).

Formalization targets

Milestone: the inequality (Theorem 1.1, p. 1, first assertion)

For all n,m≥1n,m\ge1n,m≥1, d≥0d\ge0d≥0, A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) and B0,…,Bd∈Mm(C)B_0,\dots,B_d\in M_m(\mathbb C)B0​,…,Bd​∈Mm​(C),

∥∑k=0dAk⊗Bk∥ ≤ 2max⁡z∈W(A)∥∑k=0dBkzk∥.\Bigl\|\sum_{k=0}^dA^k\otimes B_k\Bigr\|\ \le\ 2\max_{z\in W(A)}\Bigl\|\sum_{k=0}^dB_kz^k\Bigr\| .​k=0∑d​Ak⊗Bk​​ ≤ 2z∈W(A)max​​k=0∑d​Bk​zk​.

Milestone: sharpness (Theorem 1.1, p. 1, second assertion)

If the inequality holds with a constant ccc in place of 222 for all n,m,d,A,Bn,m,d,A,Bn,m,d,A,B, then c≥2c\ge2c≥2.

Goal: Theorem 1.1 (p. 1)

Both assertions together: the constant 222 is valid and no smaller universal constant is.

Significance

The result itself. It settles the complete Crouzeix conjecture in its matrix formulation, uniformly in the base dimension nnn, the coefficient size mmm and the degree, including matrices whose numerical range is a point or a segment. The scalar case m=1m=1m=1 had recently been proved by other authors and the complete case was known only for n≤3n\le3n≤3; a scalar argument need not survive matrix amplification because coefficient matrices do not commute. Equivalently, the numerical range is a complete 222-spectral set for every matrix, which via Paulsen's theorem gives a similarity of condition number at most 222 making the conformal disk image of AAA a contraction. A companion OpenAI preprint gives a separate structural proof and extends the bound to all bounded operators on Hilbert spaces.

Formalizing it. The proof uses exterior conformal maps of analytic convex domains, Faber-type coefficients, a positive double-layer kernel, and a 2×22\times22×2 block positivity argument; Section 4 then approximates an arbitrary numerical range by analytic convex domains. A formal proof would provide numerical ranges, Faber polynomials and conformal collars in Lean, all reusable in matrix analysis. No machine-checked proof of any constant-222 Crouzeix bound is known.

Difficulty

The naive approach through the spectrum fails for non-normal matrices, and the classical Crouzeix–Palencia method (a positive double-layer potential plus a Cauchy transform of conjugate data) loses a factor and yields 1+21+\sqrt21+2​. To reach 222 in the complete setting, the argument must keep both multiplication orders FGFGFG and GFGFGF of matrix-valued test functions, since the coefficients do not commute. The preprint chooses a top singular pair (x,y)(x,y)(x,y) of F[A]F[A]F[A], represents three functionals through the resolvent, and must show that the resulting coefficient weights (one on the constant term, one half on the others) match exactly the Fourier weights of the diagonal compressions (Section 2, Proposition 2.2, p. 5; Theorem 3.2, p. 6). Degenerate numerical ranges with empty interior require a separate approximation step (Lemma 4.1, p. 9).

Formalization scope

  • Matrices are Matrix (Fin n) (Fin n) ℂ with the L2 operator norm (Matrix.Norms.L2Operator). The numerical range is the set of ⟨x,Ax⟩\langle x, Ax\rangle⟨x,Ax⟩ over unit vectors of EuclideanSpace ℂ (Fin n).
  • Coefficients are B : Fin (d+1) → Matrix (Fin m) (Fin m) ℂ; the evaluation is ∑kAk⊗KronBk\sum_k A^k\otimes_{\mathrm{Kron}}B_k∑k​Ak⊗Kron​Bk​ indexed by Fin n × Fin m, base factor first.
  • rangeMaximum A B is the sSup of ∥P(z)∥\|P(z)\|∥P(z)∥ over W(A)W(A)W(A). Since n≥1n\ge1n≥1, W(A)W(A)W(A) is nonempty and compact, so this is the true maximum; UniversalBound C quantifies over all n,m≥1n,m\ge1n,m≥1, all ddd, all AAA and BBB.
  • The goal OAI.CompleteCrouzeix.main is UniversalBound 2 ∧ ∀ C, UniversalBound C → 2 ≤ C. The two milestones state the same two clauses in the DirectCrouzeix namespace, whose definitions are identical in content.
  • No normality, invertibility or nonempty-interior hypothesis is imposed on AAA.

Selected references

  • OpenAI, A direct proof of the complete Crouzeix inequality, OpenAI Math Release preprint, September 26, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/A-direct-proof-of-the-complete-Crouzeix-inequality-September-26-2026/paper.pdf
  • OpenAI, The complete Crouzeix theorem: optimal similarity and a common positive boundary representation, OpenAI Math Release preprint, September 23, 2026. https://github.com/openai/math/blob/adc7f1241b42e322a6451854ab7e4b4c146bf78a/preprints/The-complete-Crouzeix-theorem-September-23-2026/paper.pdf
  • M. Crouzeix, Bounds for analytical functions of matrices, Integral Equations Operator Theory 48 (2004), 461–477. https://doi.org/10.1007/s00020-002-1188-6
  • M. Crouzeix, Numerical range and functional calculus in Hilbert space, J. Funct. Anal. 244 (2007), 668–690. https://doi.org/10.1016/j.jfa.2006.10.013
  • M. Crouzeix, C. Palencia, The numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 38 (2017), 649–655. https://doi.org/10.1137/17M1116672
  • T. Ransford, F. L. Schwenninger, Remarks on the Crouzeix–Palencia proof that the numerical range is a (1+2)(1+\sqrt2)(1+2​)-spectral set, SIAM J. Matrix Anal. Appl. 39 (2018), 342–345. https://doi.org/10.1137/17M1143757
  • C. Badea, M. Crouzeix, B. Delyon, Convex domains and K-spectral sets, Math. Z. 252 (2006), 345–365. https://doi.org/10.1007/s00209-005-0857-y
  • B. Delyon, F. Delyon, Generalization of von Neumann's spectral sets and integral representation of operators, Bull. Soc. Math. France 127 (1999), 25–41. https://doi.org/10.24033/bsmf.2340
  • E. Lorist, F. L. Schwenninger, A solution to Crouzeix's conjecture, arXiv:2608.03841 (2026). https://arxiv.org/abs/2608.03841v2
  • P. Åhag, R. Czyż, J. Virtanen, The complete Crouzeix conjecture in dimension three and the Clouâtre–Ostermann–Ransford conjecture, arXiv:2608.27346 (2026). https://arxiv.org/abs/2608.27346v4
  • O. Toeplitz, Das algebraische Analogon zu einem Satze von Fejér, Math. Z. 2 (1918), 187–197. https://doi.org/10.1007/BF01212904
  • F. Hausdorff, Der Wertvorrat einer Bilinearform, Math. Z. 3 (1919), 314–316. https://doi.org/10.1007/BF01292610
47 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Flows and Decompositions of Games: Harmonic and Potential Games 4: Changing Only the Nonstrategic Component Makes the Pure Nash Equilibria Coincide with the Pareto Optimal ProfilesResearch Paper

Motivation

A finite strategic game can be changed in ways that no player can detect strategically. Adding to player mmm's utility any function that does not depend on player mmm's own strategy leaves every unilateral comparison "is strategy aaa better for me than strategy bbb, given what the others do?" unchanged, so it leaves every best response and every pure Nash equilibrium unchanged. Such changes are not irrelevant, however: they move the payoff levels, and therefore change which outcomes are efficient.

Candogan, Menache, Ozdaglar and Parrilo (arXiv:1005.2405; Math. Oper. Res. 36(3), 2011, DOI 10.1287/moor.1110.0500) make this precise. They decompose every finite game uniquely into a potential component, a harmonic component and a nonstrategic component (their Theorem 4.1). The first two determine all pairwise comparisons; the third determines nothing about equilibria. Section 5.3 of the paper asks what the third component can do to efficiency, and answers with Theorem 5.9: by changing only the nonstrategic component, the pure Nash equilibria of a game can be made to coincide exactly with its Pareto optimal profiles. This mission formalizes that result.

The question matters wherever a designer can transfer payoffs without altering incentives (for instance side payments to a player that depend only on the other players' actions): the theorem says such transfers can always align equilibrium with efficiency, provided an equilibrium exists.

Setting

There is a finite set M\mathcal MM of players. Player mmm has a finite nonempty set EmE^mEm of strategies; a strategy profile is p=(pm)m∈M∈E=∏mEmp = (p^m)_{m\in\mathcal M} \in E = \prod_m E^mp=(pm)m∈M​∈E=∏m​Em, and (qm,p−m)(q^m, p^{-m})(qm,p−m) denotes ppp with player mmm's strategy replaced by qmq^mqm. A game is a family of utilities u=(um)mu = (u^m)_mu=(um)m​, um:E→Ru^m : E \to \mathbb Rum:E→R.

Two profiles are mmm-comparable if they differ, and differ only in player mmm's strategy. The game graph has node set EEE and an edge between every pair of profiles that are mmm-comparable for some mmm. On this graph:

  • C0C_0C0​ is the space of functions E→RE \to \mathbb RE→R with ⟨φ,ψ⟩0=∑pφ(p)ψ(p)\langle \varphi, \psi\rangle_0 = \sum_p \varphi(p)\psi(p)⟨φ,ψ⟩0​=∑p​φ(p)ψ(p);
  • C1C_1C1​ is the space of edge flows XXX (X(p,q)=−X(q,p)X(p,q) = -X(q,p)X(p,q)=−X(q,p) on edges, 000 off edges) with ⟨X,Y⟩1=12∑(p,q)X(p,q)Y(p,q)\langle X, Y\rangle_1 = \tfrac12\sum_{(p,q)} X(p,q)Y(p,q)⟨X,Y⟩1​=21​∑(p,q)​X(p,q)Y(p,q), summed over ordered adjacent pairs;
  • δ0:C0→C1\delta_0 : C_0 \to C_1δ0​:C0​→C1​, (δ0φ)(p,q)=φ(q)−φ(p)(\delta_0\varphi)(p,q) = \varphi(q) - \varphi(p)(δ0​φ)(p,q)=φ(q)−φ(p) on edges, is the combinatorial gradient;
  • Dm:C0→C1D_m : C_0 \to C_1Dm​:C0​→C1​ is the same difference restricted to mmm-comparable pairs, and Du=∑mDmumD u = \sum_m D_m u^mDu=∑m​Dm​um. For mmm-comparable p,qp,qp,q, (Du)(p,q)=um(q)−um(p)(Du)(p,q) = u^m(q) - u^m(p)(Du)(p,q)=um(q)−um(p): DDD records the game's pairwise comparisons.

Games form the space C0MC_0^MC0M​ with the inner product ∑m⟨um,vm⟩0\sum_m\langle u^m, v^m\rangle_0∑m​⟨um,vm⟩0​. With †\dagger† the Moore–Penrose pseudoinverse for these inner products, the potential and harmonic components of a game are

uP=D†δ0δ0†Du,uH=D†(I−δ0δ0†)Du,u_{\mathcal P} = D^\dagger\delta_0\delta_0^\dagger D u, \qquad u_{\mathcal H} = D^\dagger(I - \delta_0\delta_0^\dagger) D u ,uP​=D†δ0​δ0†​Du,uH​=D†(I−δ0​δ0†​)Du,

and the nonstrategic component is what remains. A profile ppp is a pure Nash equilibrium of uuu if um(qm,p−m)≤um(p)u^m(q^m, p^{-m}) \le u^m(p)um(qm,p−m)≤um(p) for all mmm and qmq^mqm, and it is Pareto optimal (Definition 5.3) if no profile qqq has um(q)≥um(p)u^m(q) \ge u^m(p)um(q)≥um(p) for all mmm and uk(q)>uk(p)u^k(q) > u^k(p)uk(q)>uk(p) for some kkk.

Formalization targets

Goal: Theorem 5.9

For every game uuu that has a pure Nash equilibrium there is a game uˉ\bar uuˉ with

uˉP=uP,uˉH=uH,{p:p pure NE of uˉ}={p:p Pareto optimal in uˉ}.\bar u_{\mathcal P} = u_{\mathcal P},\qquad \bar u_{\mathcal H} = u_{\mathcal H},\qquad \{p : p \text{ pure NE of } \bar u\} = \{p : p \text{ Pareto optimal in } \bar u\}.uˉP​=uP​,uˉH​=uH​,{p:p pure NE of uˉ}={p:p Pareto optimal in uˉ}.

The statement is existential and fixes nothing about uˉ\bar uuˉ beyond its potential and harmonic components; it asserts the full equality of the two sets, not one inclusion.

Milestones

  1. §5.3, p. 32. Games with the same potential and harmonic components have the same pure Nash equilibria.
  2. Lemma 5.4. For every game uuu there is a game u^\hat uu^ with u^P=uP\hat u_{\mathcal P} = u_{\mathcal P}u^P​=uP​, u^H=uH\hat u_{\mathcal H} = u_{\mathcal H}u^H​=uH​, and u^m(p)=0\hat u^m(p) = 0u^m(p)=0 for every player mmm at every pure Nash equilibrium ppp of uuu.

Significance

The result. The nonstrategic component has no influence on the pairwise comparisons, and hence on equilibria, yet Theorem 5.9 shows that it controls efficiency completely: whenever a pure equilibrium exists, some choice of it makes every equilibrium Pareto optimal and every Pareto optimal profile an equilibrium. Read the other way, two games that are strategically indistinguishable can have opposite efficiency properties, so any efficiency statement about a class of games (a price-of-anarchy bound, for instance) must depend on more than the strategic structure. The paper also uses Lemma 5.4 as a normalisation: the payoff levels at equilibria are a free parameter of the nonstrategic component.

Formalizing it. The theorem has a short proof on paper, but the proof works with the pairwise comparisons, whereas the statement is about the components uPu_{\mathcal P}uP​, uHu_{\mathcal H}uH​ defined through pseudoinverses. Connecting the two requires the identities of the decomposition: that uP+uH=D†Duu_{\mathcal P} + u_{\mathcal H} = D^\dagger D uuP​+uH​=D†Du and that DD†D=DD D^\dagger D = DDD†D=D. The mission therefore produces a machine-checked link between the linear-algebraic decomposition of games and their equilibrium sets, which other results of the paper (and of the literature on near-potential games) also need. To the best of our knowledge, none of these statements has been formalized before; the result itself is proved in the paper.

Difficulty

The construction on pp. 31–33 is explicit, so the difficulty is not finding uˉ\bar uuˉ but keeping two descriptions of "differ only in the nonstrategic component" consistent. The statement uses the component maps; the proof checks pointwise that um(p)−um(q)=uˉm(p)−uˉm(q)u^m(p) - u^m(q) = \bar u^m(p) - \bar u^m(q)um(p)−um(q)=uˉm(p)−uˉm(q) for mmm-comparable p,qp, qp,q. Passing from the second to the first needs the pseudoinverse identities for DDD and δ0\delta_0δ0​ with respect to the specific inner products of C0MC_0^MC0M​ and C1C_1C1​; a naive argument that treats D†D^\daggerD† as an inverse fails because DDD has a large kernel. A second point is the case analysis in the definition of uˉ\bar uuˉ: whether a profile is mmm-comparable to an equilibrium must be shown independent of which of two mmm-comparable profiles is examined, and the case where a non-equilibrium profile is mmm-comparable to an equilibrium for every player mmm needs the separate argument of p. 33.

Formalization scope

Players form a finite type ι with decidable equality; strategy sets E m are finite, nonempty and have decidable equality. A game is an element of PiLp 2 (fun _ => EuclideanSpace ℝ (∀ k, E k)), i.e. C0MC_0^MC0M​ with the unweighted sum inner product of Section 4; the weighted inner product of Section 6 is not used. C1C_1C1​ carries the inner product with the factor 12\tfrac1221​. The pseudoinverse is defined directly (Mathlib has none) as the inverse of LLL on (ker⁡L)⊥(\ker L)^\perp(kerL)⊥ composed with the orthogonal projection onto the range. Pure Nash equilibrium is AGT.IsPureNash from the published agt_games bundle; Pareto optimality is Definition 5.3, stated for a plain utility function.

Added hypothesis. The paper leaves implicit that GGG has a pure Nash equilibrium, and the goal carries it as a hypothesis. It is necessary: every finite game has a Pareto optimal profile (a maximizer of ∑mum\sum_m u^m∑m​um), while a game without pure equilibria, such as matching pennies, has none in any game with the same potential and harmonic components, so the set equality would fail. The paper's proof uses an equilibrium in the step "deviation to a NE increases the payoff of at least one player". Lemma 5.4 needs no such hypothesis.

"Same potential and harmonic components" is stated as equality of the two component maps of Theorem 4.1, never as membership of u−uˉu - \bar uu−uˉ in ker⁡D\ker DkerD; the two are equivalent only through the decomposition theorem. Without condition (i) the goal would be trivial (take uˉ\bar uuˉ constant, so that every profile is both an equilibrium and Pareto optimal), so condition (i) is what makes the statement nontrivial.

Needed infrastructure: the Penrose identities for the pseudoinverse; DD†D=DD D^\dagger D = DDD†D=D; the fact that DuDuDu determines each DmumD_m u^mDm​um (the mmm-comparable edge sets for different mmm are disjoint); and the explicit constructions of u^\hat uu^ and uˉ\bar uuˉ. The pseudoinverse lemmas and the "same comparisons, same equilibria" bridge are reusable throughout the series. Proofs of the milestones, of the bridge in either direction, and of the Penrose identities are welcome as separate contributions.

Selected references

  • O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010. https://arxiv.org/abs/1005.2405 — journal version: Mathematics of Operations Research 36(3):474–503, 2011. https://doi.org/10.1287/moor.1110.0500
  • D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • R. Penrose, A generalized inverse for matrices, Mathematical Proceedings of the Cambridge Philosophical Society 51(3):406–413, 1955. https://doi.org/10.1017/S0305004100030401
11 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Flows and Decompositions of Games: Harmonic and Potential Games 2: Harmonic Games Generically Have No Pure Nash EquilibriumResearch Paper

Motivation

Finite games in strategic form are the basic model of interaction between self-interested agents in economics, engineering and computer science. Among them, potential games (Monderer and Shapley, 1996) are the class with the most tractable equilibrium behaviour: every finite potential game has a pure Nash equilibrium, and simple learning dynamics such as best response and fictitious play converge to one. A natural question is what lies at the opposite end of the space of games, and how far a general game is from that tractable class.

Candogan, Menache, Ozdaglar and Parrilo (arXiv:1005.2405; Mathematics of Operations Research 36(3), 2011, DOI 10.1287/moor.1110.0500) answer this with a canonical decomposition of every finite game into a potential, a harmonic and a nonstrategic component, obtained by viewing the payoff differences of a game as a flow on a graph and applying the combinatorial Helmholtz decomposition. Harmonic games, those whose potential component vanishes, are the complement of potential games, and the paper shows that their equilibrium behaviour is opposite as well. This mission formalizes the first such result: harmonic games generically have no pure Nash equilibrium, so the guaranteed existence of pure equilibria in potential games has no counterpart on the harmonic side. The decomposition has since been used to study near-potential games and the convergence of learning dynamics in them.

Setting

A finite game has a finite set of players M\mathcal MM with M=∣M∣M = |\mathcal M|M=∣M∣ and, for each player mmm, a nonempty finite strategy set EmE^mEm with hm=∣Em∣h_m = |E^m|hm​=∣Em∣ elements. A strategy profile is p=(pm)m∈E=∏mEmp = (p^m)_m \in E = \prod_m E^mp=(pm)m​∈E=∏m​Em, and (qm,p−m)(q^m, p^{-m})(qm,p−m) denotes ppp with player mmm's strategy replaced by qmq^mqm. The utilities u=(um)mu = (u^m)_mu=(um)m​ assign to each player a function um:E→Ru^m : E \to \mathbb Rum:E→R; for fixed M\mathcal MM and EEE a game is identified with its utilities, an element of C0MC_0^MC0M​, where C0={f:E→R}C_0 = \{f : E \to \mathbb R\}C0​={f:E→R} carries the inner product ⟨φ1,φ2⟩0=∑pφ1(p)φ2(p)\langle \varphi_1,\varphi_2\rangle_0 = \sum_p \varphi_1(p)\varphi_2(p)⟨φ1​,φ2​⟩0​=∑p​φ1​(p)φ2​(p).

A profile ppp is a pure Nash equilibrium if um(pm,p−m)≥um(qm,p−m)u^m(p^m, p^{-m}) \ge u^m(q^m, p^{-m})um(pm,p−m)≥um(qm,p−m) for every player mmm and every qm∈Emq^m \in E^mqm∈Em.

Two profiles are mmm-comparable if they are distinct and differ only in player mmm's strategy. The game graph has the profiles as nodes and joins every comparable pair. An edge flow is a function XXX on ordered pairs of profiles with X(p,q)=−X(q,p)X(p,q) = -X(q,p)X(p,q)=−X(q,p) on edges and X=0X = 0X=0 off edges; the space C1C_1C1​ of edge flows carries ⟨X,Y⟩1=12∑(p,q)∈AX(p,q)Y(p,q)\langle X,Y\rangle_1 = \tfrac12\sum_{(p,q)\in A} X(p,q)Y(p,q)⟨X,Y⟩1​=21​∑(p,q)∈A​X(p,q)Y(p,q). The combinatorial gradient is (δ0φ)(p,q)=W(p,q)(φ(q)−φ(p))(\delta_0\varphi)(p,q) = W(p,q)(\varphi(q)-\varphi(p))(δ0​φ)(p,q)=W(p,q)(φ(q)−φ(p)), with WWW the edge indicator, and δ0∗\delta_0^*δ0∗​ is its adjoint. Restricting to mmm-comparable pairs gives Dm:C0→C1D_m : C_0 \to C_1Dm​:C0​→C1​, and Du=∑mDmumD u = \sum_m D_m u^mDu=∑m​Dm​um is the flow of payoff differences of the game uuu. With Πm=Dm†Dm\Pi_m = D_m^\dagger D_mΠm​=Dm†​Dm​ (Moore–Penrose pseudoinverse) and Π=diag⁡(Π1,…,ΠM)\Pi = \operatorname{diag}(\Pi_1,\dots,\Pi_M)Π=diag(Π1​,…,ΠM​), the paper's Definition 4.2 sets

P={u∣u=Πu, Du∈im⁡δ0},H={u∣u=Πu, Du∈ker⁡δ0∗},N=ker⁡D.\mathcal P = \{u \mid u = \Pi u,\ Du \in \operatorname{im}\delta_0\},\quad \mathcal H = \{u \mid u = \Pi u,\ Du \in \ker\delta_0^*\},\quad \mathcal N = \ker D .P={u∣u=Πu, Du∈imδ0​},H={u∣u=Πu, Du∈kerδ0∗​},N=kerD.

A game is a harmonic game if u∈H⊕Nu \in \mathcal H \oplus \mathcal Nu∈H⊕N: its payoff differences form a flow with no source or sink at any profile.

Formalization targets

Goal: Proposition 5.1

For finite games in which at least two players have at least two strategies each, and for any additive Haar measure μ\muμ on the finite-dimensional space H⊕N\mathcal H \oplus \mathcal NH⊕N,

μ({u∈H⊕N:u has a pure Nash equilibrium})=0.\mu\big(\{u \in \mathcal H\oplus\mathcal N : u \text{ has a pure Nash equilibrium}\}\big) = 0 .μ({u∈H⊕N:u has a pure Nash equilibrium})=0.

This is the paper's "harmonic games generically do not have pure Nash equilibria", with "generically" read as the paper defines it: true except on a set of measure zero within the harmonic games.

Stronger structural form

For each profile ppp, the harmonic games having ppp as a pure Nash equilibrium form a proper linear subspace of H⊕N\mathcal H \oplus \mathcal NH⊕N. The exceptional set of the goal is then a finite union of lower-dimensional subspaces.

Milestones

  1. Lemma 5.1: at a pure Nash equilibrium of a harmonic game, every player is indifferent among all of their strategies.
  2. Proposition 4.1: dim⁡P=∏mhm−1\dim\mathcal P = \prod_m h_m - 1dimP=∏m​hm​−1, dim⁡H=(M−1)∏mhm−∑m∏k≠mhk+1\dim\mathcal H = (M-1)\prod_m h_m - \sum_m\prod_{k\ne m}h_k + 1dimH=(M−1)∏m​hm​−∑m​∏k=m​hk​+1, dim⁡N=∑m∏k≠mhk\dim\mathcal N = \sum_m\prod_{k\ne m}h_kdimN=∑m​∏k=m​hk​.

Significance

The result separates harmonic games sharply from potential games. A finite potential game always has a pure equilibrium; a harmonic game almost never has one. Together with the decomposition theorem, it says that the obstruction to pure equilibria in a general game is carried by its harmonic component, and it motivates the paper's later results on mixed equilibria of harmonic games (the uniformly mixed profile is always a mixed equilibrium). Proposition 4.1, a milestone here, also gives the dimension of the harmonic games, (M−1)∏mhm+1(M-1)\prod_m h_m + 1(M−1)∏m​hm​+1, and so measures how large that class is.

The results are proved in the paper; none of them is machine-checked. Formalizing them requires the paper's operator layer (flows on the game graph, the gradient with its adjoint, pseudoinverses) in Lean for the first time, and pins down two points the paper leaves informal: the measure with respect to which "generically" is meant, and the shape condition on the game under which the statement holds.

Difficulty

Lemma 5.1 is a short counting argument once the divergence-free condition δ0∗Du=0\delta_0^* D u = 0δ0∗​Du=0 is unpacked, but unpacking it requires knowing that DDD kills N\mathcal NN and computing δ0∗\delta_0^*δ0∗​ from the 12\tfrac1221​-weighted inner product. The main obstacle of the goal is showing that the exceptional subspaces are proper. The proof needs a harmonic game with nonzero payoff differences, that is dim⁡H>0\dim\mathcal H > 0dimH>0, and the only route the paper offers is the dimension count of Proposition 4.1. That count rests on the full decomposition C0M=P⊕H⊕NC_0^M = \mathcal P\oplus\mathcal H\oplus\mathcal NC0M​=P⊕H⊕N, on the kernel of each DmD_mDm​ and on the connectivity of the game graph, all of which must be built in Lean. The measure-theoretic last step, that a finite union of proper subspaces is Haar-null, is in Mathlib.

A tempting shortcut fails: placing Lebesgue measure on all of C0MC_0^MC0M​ and observing that H⊕N\mathcal H \oplus \mathcal NH⊕N is a proper subspace would prove the goal without saying anything about equilibria.

Formalization scope

Players form a finite type ι with decidable equality, and the strategy sets E m are nonempty finite types, as in the paper (Em={1,…,hm}E^m = \{1,\dots,h_m\}Em={1,…,hm​}). A game is an element of PiLp 2 (fun _ => EuclideanSpace ℝ (∀ k, E k)), with the unweighted sum inner product of p. 14. C1C_1C1​ is the subspace of edge flows with the inner product 12∑\tfrac12\sum21​∑ of (7). δ0∗\delta_0^*δ0∗​ is Mathlib's adjoint, and the pseudoinverse is defined directly as the inverse of LLL on (ker⁡L)⊥(\ker L)^\perp(kerL)⊥ composed with the orthogonal projection onto im⁡L\operatorname{im} LimL. P,H,N\mathcal P,\mathcal H,\mathcal NP,H,N are defined by (28), not by the alternative description (29). Harmonic games are the submodule H ⊔ N, and pure Nash equilibrium is AGT.IsPureNash from the published agt_games definitions.

Added hypothesis. The paper leaves implicit that at least two distinct players have at least two strategies each. Its proof uses this through "dimension of H\mathcal HH is larger than zero". Without it Proposition 5.1 is false: with two players having 111 and hhh strategies, dim⁡H=(2−1)h−(h+1)+1=0\dim\mathcal H = (2-1)h - (h+1) + 1 = 0dimH=(2−1)h−(h+1)+1=0, every harmonic game is nonstrategic, and every profile is a pure equilibrium of every harmonic game. The goal and the structural theorem therefore carry this hypothesis explicitly.

The measure. The measure is an arbitrary additive Haar measure on the subspace H⊕N\mathcal H\oplus\mathcal NH⊕N itself, with the Borel σ-algebra of its subspace topology. A measure on the ambient C0MC_0^MC0M​ would make the statement trivial, because the whole subspace is null there. Proposition 4.1 is stated as equalities in Z\mathbb ZZ, so that M−1M-1M−1 and the subtraction in part 2 are not truncated.

Needed infrastructure: kernels of the DmD_mDm​ (the paper's Lemma 4.2), the projection property of D†DD^\dagger DD†D, the decomposition theorem, and the connectivity of the game graph. The operator layer is shared with the other missions of this series and is reusable for any work on flows on graphs. Proofs of the milestones, and of the structural form independently of the goal, are welcome.

Selected references

  • O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010; Mathematics of Operations Research 36(3):474–503, 2011. https://arxiv.org/abs/1005.2405, https://doi.org/10.1287/moor.1110.0500
  • D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • X. Jiang, L.-H. Lim, Y. Yao, Y. Ye, Statistical ranking and combinatorial Hodge theory, Mathematical Programming 127(1):203–244, 2011. https://doi.org/10.1007/s10107-010-0419-x
9 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Flows and Decompositions of Games: Harmonic and Potential Games 1: Every Finite Game Decomposes Uniquely into Potential, Harmonic and Nonstrategic ComponentsResearch Paper

Motivation

Potential games (Monderer and Shapley, 1996) are the finite games whose incentives are captured by a single function on strategy profiles: every unilateral change of strategy changes the deviator's payoff by exactly the change of a common potential. They have pure Nash equilibria, and natural learning dynamics such as better-reply and fictitious play converge in them. Most games are not potential games, however, and before Candogan, Menache, Ozdaglar and Parrilo there was no canonical way to say how far a given game is from one, or what the remainder looks like.

Their paper (arXiv:1005.2405; Math. Oper. Res. 36(3), 2011) answers this by viewing a game as a flow on a graph. The payoff differences between profiles that differ in one player's strategy form an edge flow on the game graph, and the classical Helmholtz (Hodge) decomposition of edge flows into gradient, harmonic and curl parts (Jiang, Lim, Yao, Ye, 2011) pulls back to a decomposition of the game itself. Every finite game becomes the sum of a potential game, a harmonic game and a component that carries no strategic information. The decomposition is the basis for the rest of the paper (equilibria of harmonic games, projections onto potential games, approximate equilibria) and for later work on dynamics in near-potential games.

Setting

Fix a finite set of players M\mathcal MM and, for each player mmm, a finite nonempty strategy set EmE^mEm with hm=∣Em∣h_m = |E^m|hm​=∣Em∣ elements. A strategy profile is p=(pm)m∈E=∏mEmp = (p^m)_m \in E = \prod_m E^mp=(pm)m​∈E=∏m​Em, and p−mp^{-m}p−m denotes the strategies of the players other than mmm. A game is a family of utilities u=(um)mu = (u^m)_mu=(um)m​ with um:E→Ru^m : E \to \mathbb Rum:E→R, so the space of games is GM,E≅C0M\mathcal G_{\mathcal M,E} \cong C_0^{\mathcal M}GM,E​≅C0M​, where C0={E→R}C_0 = \{E \to \mathbb R\}C0​={E→R} with ⟨φ,ψ⟩0=∑pφ(p)ψ(p)\langle \varphi,\psi\rangle_0 = \sum_p \varphi(p)\psi(p)⟨φ,ψ⟩0​=∑p​φ(p)ψ(p).

Two profiles are mmm-comparable if they are distinct and differ only in player mmm's strategy. The game graph has the profiles as nodes and an edge between comparable profiles. An edge flow is a function X:E×E→RX : E\times E\to\mathbb RX:E×E→R that is antisymmetric on edges and zero off edges; the space C1C_1C1​ of edge flows carries ⟨X,Y⟩1=12∑(p,q) edgeX(p,q)Y(p,q)\langle X,Y\rangle_1 = \tfrac12\sum_{(p,q)\text{ edge}} X(p,q)Y(p,q)⟨X,Y⟩1​=21​∑(p,q) edge​X(p,q)Y(p,q). Triangular flows C2C_2C2​ live on ordered 3-cliques.

The operators are: the gradient (δ0φ)(p,q)=W(p,q)(φ(q)−φ(p))(\delta_0\varphi)(p,q) = W(p,q)(\varphi(q)-\varphi(p))(δ0​φ)(p,q)=W(p,q)(φ(q)−φ(p)), with WWW the edge indicator; the curl (δ1X)(p,q,r)=X(p,q)+X(q,r)+X(r,p)(\delta_1X)(p,q,r) = X(p,q)+X(q,r)+X(r,p)(δ1​X)(p,q,r)=X(p,q)+X(q,r)+X(r,p) on 3-cliques; the per-player gradient (Dmφ)(p,q)=Wm(p,q)(φ(q)−φ(p))(D_m\varphi)(p,q) = W^m(p,q)(\varphi(q)-\varphi(p))(Dm​φ)(p,q)=Wm(p,q)(φ(q)−φ(p)), with WmW^mWm the indicator of mmm-comparability; and D:C0M→C1D : C_0^{\mathcal M}\to C_1D:C0M​→C1​, Du=∑mDmumDu = \sum_m D_m u^mDu=∑m​Dm​um, the flow of pairwise comparisons of uuu. Adjoints are written ∗{}^*∗ and Moore–Penrose pseudoinverses †{}^\dagger†. The space C0MC_0^{\mathcal M}C0M​ carries the unweighted inner product ∑m⟨um,vm⟩0\sum_m\langle u^m,v^m\rangle_0∑m​⟨um,vm⟩0​. Further, Δ1=δ1∗δ1+δ0δ0∗\Delta_1 = \delta_1^*\delta_1+\delta_0\delta_0^*Δ1​=δ1∗​δ1​+δ0​δ0∗​, Δ0,m=Dm∗Dm\Delta_{0,m} = D_m^*D_mΔ0,m​=Dm∗​Dm​, Πm=Dm†Dm\Pi_m = D_m^\dagger D_mΠm​=Dm†​Dm​, and Π=diag⁡(Π1,…,ΠM)\Pi = \operatorname{diag}(\Pi_1,\dots,\Pi_M)Π=diag(Π1​,…,ΠM​).

A game is normalized if ∑pmum(pm,p−m)=0\sum_{p^m} u^m(p^m,p^{-m}) = 0∑pm​um(pm,p−m)=0 for all p−mp^{-m}p−m and mmm (Definition 4.1). The potential, harmonic and nonstrategic subspaces are (Definition 4.2)

P={u∣u=Πu, Du∈im⁡δ0},H={u∣u=Πu, Du∈ker⁡δ0∗},N=ker⁡D.\mathcal P = \{u \mid u = \Pi u,\ Du\in\operatorname{im}\delta_0\},\qquad \mathcal H = \{u \mid u = \Pi u,\ Du\in\ker\delta_0^*\},\qquad \mathcal N = \ker D .P={u∣u=Πu, Du∈imδ0​},H={u∣u=Πu, Du∈kerδ0∗​},N=kerD.

Formalization targets

Goal: Theorem 4.1

GM,E=P⊕H⊕N,\mathcal G_{\mathcal M,E} = \mathcal P\oplus\mathcal H\oplus\mathcal N,GM,E​=P⊕H⊕N,

and every game uuu splits as u=uP+uH+uNu = u_P + u_H + u_Nu=uP​+uH​+uN​ with

uP=D†δ0δ0†Du∈P,uH=D†(I−δ0δ0†)Du∈H,uN=(I−D†D)u∈N,u_P = D^\dagger\delta_0\delta_0^\dagger Du\in\mathcal P,\quad u_H = D^\dagger(I-\delta_0\delta_0^\dagger)Du\in\mathcal H,\quad u_N = (I-D^\dagger D)u\in\mathcal N,uP​=D†δ0​δ0†​Du∈P,uH​=D†(I−δ0​δ0†​)Du∈H,uN​=(I−D†D)u∈N,

where φ=δ0†Du\varphi = \delta_0^\dagger Duφ=δ0†​Du is a potential function of uPu_PuP​, i.e. DuP=δ0φDu_P = \delta_0\varphiDuP​=δ0​φ.

Milestones

  1. Theorem 3.1 (Helmholtz decomposition), on an arbitrary finite graph: C1=im⁡δ0⊕ker⁡Δ1⊕im⁡δ1∗C_1 = \operatorname{im}\delta_0\oplus\ker\Delta_1\oplus\operatorname{im}\delta_1^*C1​=imδ0​⊕kerΔ1​⊕imδ1∗​, orthogonally, with ker⁡Δ1=ker⁡δ1∩ker⁡δ0∗\ker\Delta_1 = \ker\delta_1\cap\ker\delta_0^*kerΔ1​=kerδ1​∩kerδ0∗​.
  2. Lemma 4.1: Δ0,m=hmΠm\Delta_{0,m} = h_m\Pi_mΔ0,m​=hm​Πm​.
  3. Lemma 4.2: ker⁡Dm=ker⁡Πm=ker⁡Δ0,m\ker D_m = \ker\Pi_m = \ker\Delta_{0,m}kerDm​=kerΠm​=kerΔ0,m​, with an explicit basis indexed by E−mE^{-m}E−m.
  4. Lemma 4.4 (i)–(v): Dm†=1hmDm∗D_m^\dagger = \tfrac1{h_m}D_m^*Dm†​=hm​1​Dm∗​; (∑iDi)†Dj=(∑iDi∗Di)†Dj∗Dj(\sum_iD_i)^\dagger D_j = (\sum_iD_i^*D_i)^\dagger D_j^*D_j(∑i​Di​)†Dj​=(∑i​Di∗​Di​)†Dj∗​Dj​; D†=[D1†;… ;DM†]D^\dagger = [D_1^\dagger;\dots;D_M^\dagger]D†=[D1†​;…;DM†​]; Π=D†D\Pi = D^\dagger DΠ=D†D; DD†δ0=δ0DD^\dagger\delta_0 = \delta_0DD†δ0​=δ0​.
  5. Lemma 4.5: uuu normalized   ⟺  \iff⟺ Πmum=um\Pi_mu^m = u^mΠm​um=um for all mmm   ⟺  \iff⟺ Πu=u\Pi u = uΠu=u   ⟺  \iff⟺ u∈(ker⁡D)⊥u\in(\ker D)^\perpu∈(kerD)⊥.

Lemma 4.6 (the unique normalized game with the same pairwise comparisons is Πu\Pi uΠu) is included as a supporting theorem.

Significance

The decomposition turns questions about a game into questions about its three components. The potential component inherits the equilibrium and convergence theory of potential games. The harmonic component has a sharply different structure: harmonic games generically have no pure equilibrium, and in each of them the uniformly mixed profile is a mixed equilibrium. The nonstrategic component does not affect any equilibrium notion. The closed-form expressions also give the potential game closest to a given game, and with it bounds relating the approximate equilibria of the two games. The other missions of this series formalize those consequences; all of them rest on the operator layer and the subspaces defined here.

Theorem 4.1 is proved in the paper; to our knowledge it has not been machine-checked. A formal development produces graph-flow infrastructure that Mathlib does not yet have: edge and triangular flows with their inner products, the combinatorial gradient and curl, the Helmholtz decomposition of a finite graph, and an operator Moore–Penrose pseudoinverse on finite-dimensional inner product spaces. The paper leaves Theorem 3.1 to the literature, so a full development needs a proof of it. The pseudoinverse identities of Lemma 4.4 also have a short appendix argument in the paper that a formal proof has to make complete.

Difficulty

The decomposition is not orthogonal decomposition along a single map. The subspaces P\mathcal PP and H\mathcal HH are defined through Π\PiΠ, which is assembled player by player from the DmD_mDm​, while the flow conditions involve δ0\delta_0δ0​ and the combined operator DDD. Connecting the two requires the player operators to have mutually orthogonal ranges (Dk∗Dm=0D_k^*D_m = 0Dk∗​Dm​=0 for k≠mk\ne mk=m) and the explicit form of Dm∗DmD_m^*D_mDm∗​Dm​ as a scaled projection. Without these, Π=D†D\Pi = D^\dagger DΠ=D†D (Lemma 4.4 (iv)) and DD†δ0=δ0DD^\dagger\delta_0 = \delta_0DD†δ0​=δ0​ (Lemma 4.4 (v)) are not available, and they are what make the formulas for uPu_PuP​ and uHu_HuH​ land in P\mathcal PP and H\mathcal HH. A direct attempt to apply the Helmholtz decomposition to DuDuDu produces a flow decomposition, not a game decomposition; the pullback through DDD is not formal, because DDD is neither injective nor surjective.

Formalization scope

Players form a Fintype ι; strategy sets are E : ι → Type with Fintype, DecidableEq and Nonempty instances, and hmh_mhm​ is Fintype.card (E m). Profiles are ∀ m, E m, and (qm,p−m)(q^m,p^{-m})(qm,p−m) is Function.update p m q. The game graph is a Mathlib SimpleGraph; comparability requires p≠qp\ne qp=q, so the graph has no loops, as the Laplacian (15) requires. C0C_0C0​ is EuclideanSpace ℝ on profiles. C1C_1C1​ and C2C_2C2​ are type synonyms of the subspaces of antisymmetric (resp. alternating) functions, with inner products built from (7), including the factor 12\tfrac1221​ on C1C_1C1​. Lemma 4.4 (i) fails without it. The space of games is PiLp 2 of copies of C0C_0C0​, whose inner product is the unweighted sum used on p. 14, not the weighted inner product of the paper's Section 6. Adjoints are LinearMap.adjoint. The pseudoinverse is defined explicitly as the inverse of LLL on (ker⁡L)⊥(\ker L)^\perp(kerL)⊥ composed with the orthogonal projection onto im⁡L\operatorname{im}LimL.

P\mathcal PP, H\mathcal HH and N\mathcal NN are defined by (28), not as the ranges of the component maps; the direct-sum part of the goal is stated independently of the formulas, so the goal cannot be satisfied by construction. Lemma 4.4 is split into five items, one per identity. "Orthogonal decomposition" in Theorem 3.1 is stated as pairwise orthogonality plus spanning. The paper's statements have no hypotheses beyond the setting, and none were added except nonemptiness of the strategy sets, which the paper assumes by writing Em={1,…,hm}E^m = \{1,\dots,h_m\}Em={1,…,hm​}.

Welcome contributions: a proof of the Helmholtz decomposition on a finite simple graph, general facts about the pseudoinverse (Penrose identities, L†LL^\dagger LL†L is the projection onto (ker⁡L)⊥(\ker L)^\perp(kerL)⊥, invariance under rescaling of inner products), and the explicit adjoint formulas (12) and (22).

Selected references

  • O. Candogan, I. Menache, A. Ozdaglar, P. A. Parrilo, Flows and Decompositions of Games: Harmonic and Potential Games, arXiv:1005.2405v2, 2010; Mathematics of Operations Research 36(3):474–503, 2011. https://arxiv.org/abs/1005.2405, https://doi.org/10.1287/moor.1110.0500
  • D. Monderer, L. S. Shapley, Potential Games, Games and Economic Behavior 14(1):124–143, 1996. https://doi.org/10.1006/game.1996.0044
  • X. Jiang, L.-H. Lim, Y. Yao, Y. Ye, Statistical Ranking and Combinatorial Hodge Theory, Mathematical Programming 127:203–244, 2011. https://arxiv.org/abs/0811.1067
  • R. Penrose, A generalized inverse for matrices, Mathematical Proceedings of the Cambridge Philosophical Society 51(3):406–413, 1955. https://doi.org/10.1017/S0305004100030401
13 thms3 active usersReviewed
Numerical AnalysisOptimization·Captain: mikedeng1

The Primal-Dual Active Set Strategy as a Semismooth Newton Method IV: Global Convergence for Small Perturbations of M-MatricesResearch Paper

Motivation

Obstacle problems, contact problems and control-constrained optimal control problems lead, after discretization, to complementarity systems of the form "find y≤ψy \le \psiy≤ψ and λ≥0\lambda \ge 0λ≥0 with Ay+λ=fAy + \lambda = fAy+λ=f and λi(yi−ψi)=0\lambda_i(y_i - \psi_i) = 0λi​(yi​−ψi​)=0". The primal-dual active set strategy solves such systems by guessing which constraints are active, solving one linear system, and updating the guess. Each iteration costs a single linear solve, and in practice the method stops after few iterations.

Hintermüller, Ito and Kunisch (SIAM J. Optim. 13(3), 2002; authors' version hal-01660511v1) showed that the strategy is a semismooth Newton method for a reformulation of the complementarity system through a max-function, which gives local superlinear convergence. For convergence from arbitrary initial data the paper gives three sufficient conditions on the matrix. The first is that AAA is an M-matrix (Theorem 3.2), a class that many discretized second-order elliptic operators belong to. The M-matrix property is not stable under small perturbations: off-diagonal entries may become positive (p. 10). Theorem 3.4, the subject of this mission, shows that global convergence nevertheless survives small perturbations of an M-matrix. The paper notes that this also makes it relevant for numerical implementations.

Setting

Fix n≥0n \ge 0n≥0, vectors f,ψ∈Rnf, \psi \in \mathbb{R}^nf,ψ∈Rn and a parameter c>0c > 0c>0. Vectors are ordered componentwise. For a matrix A∈Rn×nA \in \mathbb{R}^{n\times n}A∈Rn×n the problem is

Ay+λ=f,λ−max⁡(0,λ+c(y−ψ))=0,(3.1)Ay + \lambda = f, \qquad \lambda - \max\big(0, \lambda + c(y - \psi)\big) = 0, \tag{3.1}Ay+λ=f,λ−max(0,λ+c(y−ψ))=0,(3.1)

with the maximum taken componentwise. The paper writes AAA for the matrix and calligraphic A\mathcal{A}A, I\mathcal{I}I for the active and inactive index sets.

The primal-dual active set algorithm starts from an arbitrary pair (y0,λ0)(y^0, \lambda^0)(y0,λ0). Given (yk,λk)(y^k, \lambda^k)(yk,λk) it sets

Ak={i:λik+c(yik−ψi)>0},Ik={i:λik+c(yik−ψi)≤0},\mathcal{A}_k = \{ i : \lambda^k_i + c(y^k_i - \psi_i) > 0 \}, \qquad \mathcal{I}_k = \{ i : \lambda^k_i + c(y^k_i - \psi_i) \le 0 \},Ak​={i:λik​+c(yik​−ψi​)>0},Ik​={i:λik​+c(yik​−ψi​)≤0},

and determines (yk+1,λk+1)(y^{k+1}, \lambda^{k+1})(yk+1,λk+1) from

Ayk+1+λk+1=f,yk+1=ψ on Ak,λk+1=0 on Ik.Ay^{k+1} + \lambda^{k+1} = f, \qquad y^{k+1} = \psi \text{ on } \mathcal{A}_k, \qquad \lambda^{k+1} = 0 \text{ on } \mathcal{I}_k .Ayk+1+λk+1=f,yk+1=ψ on Ak​,λk+1=0 on Ik​.

For an index set I⊆{1,…,n}\mathcal{I} \subseteq \{1,\dots,n\}I⊆{1,…,n} with complement A\mathcal{A}A, AIA_{\mathcal{I}}AI​ is the principal submatrix of AAA on I\mathcal{I}I and AIAA_{\mathcal{I}\mathcal{A}}AIA​ the block with rows in I\mathcal{I}I and columns in A\mathcal{A}A. The step above is uniquely solvable exactly when AIkA_{\mathcal{I}_k}AIk​​ is invertible.

A square matrix MMM is an M-matrix if it is nonsingular, mij≤0m_{ij} \le 0mij​≤0 for i≠ji \ne ji=j, and M−1≥0M^{-1} \ge 0M−1≥0 entrywise. For a rectangular matrix BBB, ∥B∥1\|B\|_1∥B∥1​ is the matrix norm subordinate to the one-norms on both spaces, i.e. the maximal absolute column sum ∥B∥1=max⁡j∑i∣bij∣\|B\|_1 = \max_j \sum_i |b_{ij}|∥B∥1​=maxj​∑i​∣bij​∣.

Formalization targets

Goal: Theorem 3.4

Let MMM be an M-matrix. There is ε>0\varepsilon > 0ε>0 such that for every KKK with ∥K∥1<ε\|K\|_1 < \varepsilon∥K∥1​<ε, every f,ψf, \psif,ψ and every c>0c > 0c>0, with A=M+KA = M + KA=M+K:

  1. (3.1) has exactly one solution x∗=(y∗,λ∗)x^* = (y^*, \lambda^*)x∗=(y∗,λ∗);
  2. the algorithm is well-defined: from every (yk,λk)(y^k, \lambda^k)(yk,λk) the step has exactly one solution;
  3. for arbitrary initial data,
lim⁡k→∞(yk,λk)=(y∗,λ∗).\lim_{k\to\infty} (y^k, \lambda^k) = (y^*, \lambda^*).k→∞lim​(yk,λk)=(y∗,λ∗).

The threshold ε\varepsilonε is left unspecified; the theorem asserts only its existence.

Milestones (the steps of the paper's proof)

  • Principal submatrices MIM_{\mathcal{I}}MI​ of an M-matrix are nonsingular M-matrices.
  • With ρ≥∥MI−1KI∥1\rho \ge \|M_{\mathcal{I}}^{-1}K_{\mathcal{I}}\|_1ρ≥∥MI−1​KI​∥1​ for every I\mathcal{I}I and ρ<12\rho < \tfrac12ρ<21​, every AIA_{\mathcal{I}}AI​ is invertible and
AI−1=(II+∑i=1∞(−MI−1KI)i)MI−1.A_{\mathcal{I}}^{-1} = \Big(I_{\mathcal{I}} + \sum_{i=1}^{\infty}\big(-M_{\mathcal{I}}^{-1}K_{\mathcal{I}}\big)^i\Big) M_{\mathcal{I}}^{-1}.AI−1​=(II​+i=1∑∞​(−MI−1​KI​)i)MI−1​.
  • Under the same hypothesis, for v≤0v \le 0v≤0, ∑i∈I(−AI−1v)i≥1−2ρ1−ρ ∥MI−1v∥1\sum_{i\in\mathcal{I}} \big(-A_{\mathcal{I}}^{-1}v\big)_i \ge \frac{1-2\rho}{1-\rho}\,\|M_{\mathcal{I}}^{-1}v\|_1∑i∈I​(−AI−1​v)i​≥1−ρ1−2ρ​∥MI−1​v∥1​.
  • Whenever AIA_{\mathcal{I}}AI​ is invertible, entrywise AI−1AIA≤MI−1KIA−MI−1KI(M+K)I−1AIAA_{\mathcal{I}}^{-1}A_{\mathcal{I}\mathcal{A}} \le M_{\mathcal{I}}^{-1}K_{\mathcal{I}\mathcal{A}} - M_{\mathcal{I}}^{-1}K_{\mathcal{I}}(M+K)_{\mathcal{I}}^{-1}A_{\mathcal{I}\mathcal{A}}AI−1​AIA​≤MI−1​KIA​−MI−1​KI​(M+K)I−1​AIA​.
  • For ∥K∥1\|K\|_1∥K∥1​ small (uniformly in f,ψ,cf, \psi, cf,ψ,c) and k≥1k \ge 1k≥1: ∑iyik+1<∑iyik\sum_i y^{k+1}_i < \sum_i y^k_i∑i​yik+1​<∑i​yik​ unless yk+1=yky^{k+1} = y^kyk+1=yk, so M(y)=∑iyi\mathcal{M}(y) = \sum_i y_iM(y)=∑i​yi​ is a merit function.

A companion statement records the paper's remark after the theorem: for ∥K∥1\|K\|_1∥K∥1​ small, M+KM + KM+K is a P-matrix.

Significance

The result. Theorem 3.2 makes global convergence depend on a sign pattern, which a perturbation of any size can destroy. Theorem 3.4 replaces the sign pattern by a neighbourhood: every matrix close enough to an M-matrix in ∥⋅∥1\|\cdot\|_1∥⋅∥1​ inherits unique solvability of (3.1), well-posedness of every iteration, and convergence from every starting point. As the paper observes, solvability of (3.1) for every fff is equivalent to AAA being a P-matrix (Berman–Plemmons, Thm. 10.2.15), so the theorem also yields a sufficient condition for the P-matrix property.

Formalizing it. The paper's argument is a short sketch that refers back to the proof of Theorem 3.3 and asserts that "∥K∥1\|K\|_1∥K∥1​ can be chosen sufficiently small". A formalization makes the uniformity of that choice explicit (it depends only on MMM), checks the strict decrease of the merit function including its equality case, and fixes the role of the first iterate, from which the sign facts used in (3.8) hold. To our knowledge none of the three global convergence theorems of the paper has a machine-checked proof.

Difficulty

The obvious argument is to transfer Theorem 3.2 by continuity. It fails because the M-matrix proof is monotonicity-based: it shows y∗≤yk+1≤yky^* \le y^{k+1} \le y^ky∗≤yk+1≤yk, and that ordering uses AI−1≥0A_{\mathcal{I}}^{-1} \ge 0AI−1​≥0 and AIA≤0A_{\mathcal{I}\mathcal{A}} \le 0AIA​≤0, sign conditions that a perturbation breaks immediately. What survives is weaker: a scalar merit function ∑iyi\sum_i y_i∑i​yi​ whose decrease must be quantified. The perturbation has to be controlled uniformly over all 2n2^n2n index sets, both in the multiplier term (where the decrease must remain strict whenever λIk≠0\lambda^k_{\mathcal{I}} \ne 0λIk​=0) and in the coupling term AI−1AIA(yk−ψ)AA_{\mathcal{I}}^{-1}A_{\mathcal{I}\mathcal{A}}(y^k-\psi)_{\mathcal{A}}AI−1​AIA​(yk−ψ)A​, whose positive part must be absorbed by −∑A(yik−ψi)-\sum_{\mathcal{A}}(y^k_i - \psi_i)−∑A​(yik​−ψi​). Finally, strict decrease of a merit function does not by itself give convergence; the finiteness of the possible active sets must be combined with it.

Formalization scope

Vectors are Fin n → ℝ and matrices Matrix (Fin n) (Fin n) ℝ; index sets are Finset (Fin n) and blocks are submatrices along subtype inclusions. Conventions committed to:

  • ∥B∥1\|B\|_1∥B∥1​ is the maximal absolute column sum, computed as a supremum in R≥0\mathbb{R}_{\ge0}R≥0​, equal to 000 for a matrix with no columns; it is not the entrywise sum or another operator norm;
  • the M-matrix predicate requires nonsingularity explicitly (IsUnit of the determinant), because Lean's inverse of a singular matrix is 000; it is stated for any finite index type so that it applies to principal blocks;
  • "∥K∥1\|K\|_1∥K∥1​ sufficiently small" is one ε>0\varepsilon > 0ε>0 depending only on MMM (and nnn), quantified before fff, ψ\psiψ, ccc and the initial data;
  • a step is a relation and a run is an infinite sequence of steps from arbitrary initial data; step (iv)'s "Stop" is not modelled;
  • the convergence conclusion is stated for every solution of (3.1), which by the first conclusion is the solution; convergence is in the product topology;
  • the merit-function milestone holds from k=1k = 1k=1 on, as in the paper.

The goal does not assume that M+KM + KM+K is a P-matrix, that its principal blocks are invertible, that ρ<12\rho < \tfrac12ρ<21​, or that the merit function decreases: all of these are consequences. A version with ε\varepsilonε chosen after fff, ψ\psiψ, ccc or the run, or with any of these as hypotheses, would be trivial or different and is ruled out. Well-definedness is a conclusion, so runs from every initial pair exist and the convergence conclusion is not vacuous.

In the g-estimate, the page's final ∥M−1λIk∥1\|M^{-1}\lambda^k_{\mathcal{I}}\|_1∥M−1λIk​∥1​ is a misprint for ∥MI−1λIk∥1\|M_{\mathcal{I}}^{-1}\lambda^k_{\mathcal{I}}\|_1∥MI−1​λIk​∥1​; the statement uses MI−1M_{\mathcal{I}}^{-1}MI−1​.

A complete development needs: principal submatrices of M-matrices, Neumann series for matrices with the column-sum norm, the block form of one step and the identity (3.8), the sign facts λk≤0\lambda^k \le 0λk≤0 on Ik\mathcal{I}_kIk​ and yk≥ψy^k \ge \psiyk≥ψ on Ak\mathcal{A}_kAk​ for k≥1k \ge 1k≥1, and continuity of principal minors for the P-matrix statement. The M-matrix and Neumann-series lemmas are reusable beyond this mission. Proofs of any milestone, of the companion, or of the goal through another argument are welcome.

Selected references

  • M. Hintermüller, K. Ito, K. Kunisch, The primal-dual active set strategy as a semismooth Newton method, SIAM J. Optim. 13(3):865–888, 2002. https://doi.org/10.1137/S1052623401383558 ; authors' version https://hal.science/hal-01660511v1
  • A. Berman, R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, Academic Press, 1979 (SIAM Classics reprint 1994). https://doi.org/10.1137/1.9781611971262
  • R. H. W. Hoppe, Multigrid algorithms for variational inequalities, SIAM J. Numer. Anal. 24:1046–1065, 1987. https://doi.org/10.1137/0724069
10 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization·Captain: mikedeng1

Semidefinite Programming Relaxations for Semialgebraic Problems 2: A Feasible Solution of the SDPs (7.7) Certifies That M Is Copositive, and the Test Is at Least as Strong as M = P + NResearch Paper

Copositive matrices and why they need certificates

A real symmetric matrix is copositive when its quadratic form is nonnegative on the nonnegative orthant. Copositive matrices appear wherever a quadratic objective meets sign constraints: standard quadratic programs over the simplex, linear complementarity problems, and conic reformulations of combinatorial problems such as the stability number of a graph. Parrilo's §7.5 (Math. Program. 96 (2003) 293–320) gives an example: if CCC is copositive and Q−ATCA⪰γIQ - A^TCA \succeq \gamma IQ−ATCA⪰γI, then γ\gammaγ is a lower bound on min⁡{xTQx:Ax≥0, xTx=1}\min\{x^TQx : Ax \ge 0,\ x^Tx = 1\}min{xTQx:Ax≥0, xTx=1}.

Deciding copositivity is hard. Murty and Kabadi (Math. Program. 39 (1987) 117–129) showed that checking whether a given integer matrix is not copositive is NP-complete, so the exact tests based on principal minors take an exponential number of operations in the worst case. Efficiently checkable sufficient conditions are therefore what applications use.

Timeline:

  • 1962. Diananda (Proc. Cambridge Philos. Soc. 58) studies the decomposition of a matrix as positive semidefinite plus elementwise nonnegative, condition (7.6) below, which is sufficient for copositivity and also necessary for n≤4n \le 4n≤4.
  • 1977. Choi and Lam (Math. Ann. 231) relate this decomposition to sums of squares of quartic forms (their Lemma 3.5).
  • 1987. Murty and Kabadi prove the NP-completeness result above.
  • 2000–2003. Parrilo's thesis and the 2003 paper introduce a hierarchy of semidefinite programming tests, one level per degree rrr, of which (7.6) is level 000; Theorem 7.7 makes level 111 explicit.
  • 2002. De Klerk and Pasechnik (SIAM J. Optim. 12) use this hierarchy to approximate the stability number of a graph.

Setting

Fix n≥0n \ge 0n≥0 and a real symmetric matrix M=(mij)∈Rn×nM = (m_{ij}) \in \mathbb R^{n\times n}M=(mij​)∈Rn×n. The matrix MMM is copositive if

xi≥0 for all i  ⟹  xTMx≥0.x_i \ge 0 \text{ for all } i \;\Longrightarrow\; x^T M x \ge 0 .xi​≥0 for all i⟹xTMx≥0.

For real variables z=(z1,…,zn)z = (z_1,\dots,z_n)z=(z1​,…,zn​) write z=[z12,…,zn2]T\mathbf z = [z_1^2, \dots, z_n^2]^Tz=[z12​,…,zn2​]T. Three polynomials in zzz are associated with MMM:

P(z):=zTMz=∑i,jmijzi2zj2,Pr(z)=(∑i=1nzi2)rP(z),P1(z):=∑i,j,kmijzi2zj2zk2.P(z) := \mathbf z^T M \mathbf z = \sum_{i,j} m_{ij} z_i^2 z_j^2, \qquad P_r(z) = \Bigl(\sum_{i=1}^n z_i^2\Bigr)^r P(z), \qquad P_1(z) := \sum_{i,j,k} m_{ij} z_i^2 z_j^2 z_k^2 .P(z):=zTMz=i,j∑​mij​zi2​zj2​,Pr​(z)=(i=1∑n​zi2​)rP(z),P1​(z):=i,j,k∑​mij​zi2​zj2​zk2​.

A form is positive semidefinite if it is nonnegative at every point of Rn\mathbb R^nRn, and a polynomial is a sum of squares if it is a finite sum of squares of real polynomials. A matrix AAA satisfies A⪰0A \succeq 0A⪰0 if it is symmetric and xTAx≥0x^TAx \ge 0xTAx≥0 for all x∈Rnx \in \mathbb R^nx∈Rn.

The SDPs (7.7) ask for nnn symmetric matrices Λ1,…,Λn∈Sn\Lambda^1, \dots, \Lambda^n \in \mathcal S^nΛ1,…,Λn∈Sn, with entries Λjki=Λkji\Lambda^i_{jk} = \Lambda^i_{kj}Λjki​=Λkji​, such that

M−Λi⪰0,i=1,…,n,Λiii=0,i=1,…,n,Λjji+Λjij+Λijj=0,i≠j,Λjki+Λkij+Λijk≥0,i≠j≠k.\begin{aligned} M - \Lambda^i &\succeq 0, && i = 1,\dots,n,\\ \Lambda^i_{ii} &= 0, && i = 1,\dots,n,\\ \Lambda^i_{jj} + \Lambda^j_{ji} + \Lambda^j_{ij} &= 0, && i \ne j,\\ \Lambda^i_{jk} + \Lambda^j_{ki} + \Lambda^k_{ij} &\ge 0, && i \ne j \ne k . \end{aligned}M−ΛiΛiii​Λjji​+Λjij​+Λijj​Λjki​+Λkij​+Λijk​​⪰0,=0,=0,≥0,​​i=1,…,n,i=1,…,n,i=j,i=j=k.​

Condition (7.6) asks for a decomposition M=P+NM = P + NM=P+N with P⪰0P \succeq 0P⪰0 and nij≥0n_{ij} \ge 0nij​≥0 for all i,ji,ji,j.

Formalization targets

Goal: Theorem 7.7

For every real symmetric n×nn\times nn×n matrix MMM,

(7.7) feasible  ⟹  (P1(z)≥0  ∀z∈Rn) and M copositive,and(7.6)  ⟹  (7.7) feasible.\text{(7.7) feasible} \;\Longrightarrow\; \bigl(P_1(z) \ge 0 \ \ \forall z \in \mathbb R^n\bigr) \ \text{and}\ M \text{ copositive}, \qquad\text{and}\qquad \text{(7.6)} \;\Longrightarrow\; \text{(7.7) feasible}.(7.7) feasible⟹(P1​(z)≥0  ∀z∈Rn) and M copositive,and(7.6)⟹(7.7) feasible.

The second implication is the paper's "this test is at least as powerful as condition (7.6)".

Milestones (all from §7.5, pp. 317–318)

  1. P1=PrP_1 = P_rP1​=Pr​ at r=1r = 1r=1: (∑kzk2)P(z)=∑i,j,kmijzi2zj2zk2\bigl(\sum_k z_k^2\bigr)P(z) = \sum_{i,j,k} m_{ij} z_i^2z_j^2z_k^2(∑k​zk2​)P(z)=∑i,j,k​mij​zi2​zj2​zk2​.
  2. If Pr(z)≥0P_r(z) \ge 0Pr​(z)≥0 for all zzz, then P(z)≥0P(z) \ge 0P(z)≥0 for all zzz.
  3. MMM is copositive if and only if P(z)≥0P(z) \ge 0P(z)≥0 for all z∈Rnz \in \mathbb R^nz∈Rn.
  4. P(z)P(z)P(z) is a sum of squares if and only if condition (7.6) holds.
  5. If PiP_iPi​ is a sum of squares, then so is Pi+1P_{i+1}Pi+1​.

Significance

Theorem 7.7 turns copositivity at level r=1r = 1r=1 into a single semidefinite feasibility problem whose size is polynomial in nnn: nnn symmetric n×nn \times nn×n matrices, nnn semidefinite constraints and O(n3)O(n^3)O(n3) linear ones. Its second half says that nothing is lost against the classical test (7.6): every matrix certified by the decomposition M=P+NM = P + NM=P+N is also certified by (7.7). The milestones place the result inside the hierarchy: certificates at any level rrr certify copositivity (milestones 2 and 3), and the sum-of-squares tests become weakly stronger as rrr grows (milestone 5), with (7.6) equivalent to the test at level 000 (milestone 4). This hierarchy underlies later SDP approximations of the copositive cone and of the stability number of a graph.

The paper prints no proof of Theorem 7.7. These statements are proved results of the literature; none of them is formalized in Mathlib or, as far as a search of the platform shows, elsewhere in Lean. The mission produces machine-checked statements and proofs of the level-111 test and of the structural facts about the hierarchy, built on the platform's published definition of copositivity.

Difficulty

The first half of Theorem 7.7 requires seeing a feasible point of (7.7) as a certificate for the polynomial P1P_1P1​: the semidefinite constraints control quadratic expressions in z\mathbf zz, while the linear constraints on the entries of Λ\LambdaΛ must account for every monomial zi2zj2zk2z_i^2z_j^2z_k^2zi2​zj2​zk2​ of degree six, grouped by which indices coincide. The bookkeeping over the three index patterns (all equal, two equal, all distinct) and over the superscript/subscript roles of Λjki\Lambda^i_{jk}Λjki​ is where a careless argument loses a term. The second half asks, for an arbitrary decomposition M=P+NM = P + NM=P+N, for a point satisfying all nnn semidefinite constraints and all the linear equalities and inequalities of (7.7) at once. The obvious first idea of testing M⪰0M \succeq 0M⪰0 fails: positive semidefiniteness is sufficient for copositivity but far from necessary, since every elementwise nonnegative matrix is copositive.

Formalization scope

  • MMM is Matrix (Fin n) (Fin n) ℝ with a hypothesis M.IsSymm; nnn is arbitrary, including n=0n = 0n=0.
  • Copositivity is the published definition MurtyKabadi.Reduction.Copositive (Murty–Kabadi mission), xTMx≥0x^TMx \ge 0xTMx≥0 for every coordinatewise nonnegative xxx; it is not replaced by M⪰0M \succeq 0M⪰0.
  • PPP, PrP_rPr​ and P1P_1P1​ are elements of MvPolynomial (Fin n) ℝ; P1P_1P1​ is defined by its own display, and its equality with PrP_rPr​ at r=1r = 1r=1 is a milestone.
  • "Positive semidefinite form" and "nonnegative" mean nonnegative evaluation at every point of Rn\mathbb R^nRn; "sum of squares" is Mathlib's IsSumSq in the polynomial ring.
  • ⪰0\succeq 0⪰0 is Mathlib's Matrix.PosSemidef. Λ\LambdaΛ is a family Fin n → Matrix (Fin n) (Fin n) ℝ, with Λjki\Lambda^i_{jk}Λjki​ = Λ i j k; each Λi\Lambda^iΛi is required symmetric as on the page.
  • "i≠j≠ki \ne j \ne ki=j=k" is read as i,j,ki, j, ki,j,k pairwise distinct. Under the symmetry of the Λi\Lambda^iΛi and the third constraint, the extra constraints of the literal reading hold with equality, so both readings give the same feasible set.
  • "At least as powerful as condition (7.6)" is formalized as the implication (7.6) ⇒\Rightarrow⇒ (7.7) feasible.
  • The mission does not trivialize: the hypothesis of the goal is satisfiable (the identity matrix with Λ=0\Lambda = 0Λ=0 is feasible), the conclusion is copositivity on the orthant rather than a weaker or vacuous property, and the SDP is the paper's finite system with every constraint of (7.7) present.

Contributions welcome: proofs of the milestones, general lemmas on sums of squares in MvPolynomial (closure under multiplication, Gram-matrix representations of a quadratic form in monomials) and Gram-matrix arguments for forms that are even in every variable.

Selected references

  • P. A. Parrilo, Semidefinite programming relaxations for semialgebraic problems, Math. Program. Ser. B 96 (2003) 293–320. https://doi.org/10.1007/s10107-003-0387-5
  • K. G. Murty, S. N. Kabadi, Some NP-complete problems in quadratic and nonlinear programming, Math. Program. 39 (1987) 117–129. https://doi.org/10.1007/BF02592948
  • P. H. Diananda, On non-negative forms in real variables some or all of which are non-negative, Proc. Cambridge Philos. Soc. 58 (1962) 17–25. https://doi.org/10.1017/S0305004100036185
  • M. D. Choi, T. Y. Lam, Extremal positive semidefinite forms, Math. Ann. 231 (1977) 1–18. https://doi.org/10.1007/BF01360024
  • E. de Klerk, D. V. Pasechnik, Approximation of the stability number of a graph via copositive programming, SIAM J. Optim. 12 (2002) 875–892. https://doi.org/10.1137/S1052623401383248
9 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Strongly Regular Generalized Equations IV: Strong Second-Order Sufficiency and Linearly Independent Binding Gradients Make the KKT Generalized Equation Strongly RegularResearch Paper

Motivation

A nonlinear program is rarely solved once. Its data are estimated, rounded, or varied on purpose in a parametric study, and an algorithm such as sequential quadratic programming replaces it at every iteration by a nearby linearised problem. Both uses need the same fact: near a solution, the Karush–Kuhn–Tucker (KKT) system should have exactly one solution for every small perturbation, and that solution should move Lipschitz-continuously with the perturbation. For problems with equality constraints only, or with strict complementary slackness, the classical implicit-function theorem gives this, as in Fiacco's sensitivity analysis (Fiacco 1976, reference [4] of the paper). Without strict complementarity the KKT system is not a smooth equation, and the classical theorem does not apply.

S. M. Robinson's paper Strongly regular generalized equations, Math. Oper. Res. 5 (1980) 43–62 introduced strong regularity to handle exactly this case. §2 of the paper proves an implicit-function theorem for generalized equations, §3 characterises strong regularity of linear generalized equations through a Schur complement, and §4, the subject of this mission, applies both to nonlinear programming. Its Theorem 4.1 identifies the conditions under which the KKT system is strongly regular. These conditions (strong second-order sufficiency and linearly independent binding gradients) became standard hypotheses in the stability theory of nonlinear programs and in the local convergence analysis of Newton-type methods.

Setting

Let Ω⊆Rn\Omega\subseteq\mathbb R^nΩ⊆Rn be open and let θ:Ω→R\theta:\Omega\to\mathbb Rθ:Ω→R, g:Ω→Rpg:\Omega\to\mathbb R^pg:Ω→Rp, h:Ω→Rqh:\Omega\to\mathbb R^qh:Ω→Rq be Fréchet differentiable. The program is

minimize θ(x)subject tog(x)≤0, h(x)=0.(4.1)\text{minimize } \theta(x)\quad\text{subject to}\quad g(x)\le0,\ h(x)=0.\qquad(4.1)minimize θ(x)subject tog(x)≤0, h(x)=0.(4.1)

The Lagrangian is L(x,u,v)=θ(x)+⟨u,g(x)⟩+⟨v,h(x)⟩\mathcal L(x,u,v)=\theta(x)+\langle u,g(x)\rangle+\langle v,h(x)\rangleL(x,u,v)=θ(x)+⟨u,g(x)⟩+⟨v,h(x)⟩, and L′\mathcal L'L′ is its gradient in xxx.

For a set CCC and a point zzz, the normal-cone operator ∂ψC(z)\partial\psi_C(z)∂ψC​(z) is the set of vectors yyy with ⟨y,c−z⟩≤0\langle y,c-z\rangle\le0⟨y,c−z⟩≤0 for all c∈Cc\in Cc∈C when z∈Cz\in Cz∈C, and the empty set when z∉Cz\notin Cz∈/C. The KKT conditions of (4.1) are the generalized equation

0∈F(x,u,v)+∂ψRn×R+p×Rq(x,u,v),F(x,u,v)=(L′(x,u,v), −g(x), −h(x)).(4.3)0\in F(x,u,v)+\partial\psi_{\mathbb R^n\times\mathbb R^p_+\times\mathbb R^q}(x,u,v),\qquad F(x,u,v)=\big(\mathcal L'(x,u,v),\,-g(x),\,-h(x)\big).\qquad(4.3)0∈F(x,u,v)+∂ψRn×R+p​×Rq​(x,u,v),F(x,u,v)=(L′(x,u,v),−g(x),−h(x)).(4.3)

Its middle block says g(x)≤0g(x)\le0g(x)≤0, u≥0u\ge0u≥0 and ⟨u,g(x)⟩=0\langle u,g(x)\rangle=0⟨u,g(x)⟩=0.

A generalized equation 0∈F(z)+∂ψC(z)0\in F(z)+\partial\psi_C(z)0∈F(z)+∂ψC​(z) is strongly regular at a solution z0z_0z0​ (DEFINITION, p. 45) if its linearisation T(z)=F(z0)+F′(z0)(z−z0)+∂ψC(z)T(z)=F(z_0)+F'(z_0)(z-z_0)+\partial\psi_C(z)T(z)=F(z0​)+F′(z0​)(z−z0​)+∂ψC​(z) satisfies the following. There are neighbourhoods UUU of 000 and VVV of z0z_0z0​ and a constant λ\lambdaλ such that, for every y∈Uy\in Uy∈U, the inclusion y∈T(z)y\in T(z)y∈T(z) has exactly one solution z=s(y)z=s(y)z=s(y) in VVV, and sss is λ\lambdaλ-Lipschitz on UUU.

At a solution (x0,u0,v0)(x_0,u_0,v_0)(x0​,u0​,v0​) the inequality constraints split into three groups:

  • g+g^+g+, with gi(x0)=0g_i(x_0)=0gi​(x0​)=0 and u0,i>0u_{0,i}>0u0,i​>0;
  • g0g^0g0, the weakly active ones, with gi(x0)=0=u0,ig_i(x_0)=0=u_{0,i}gi​(x0​)=0=u0,i​;
  • g−g^-g−, with gi(x0)<0g_i(x_0)<0gi​(x0​)<0.

Write L′′=L′′(x0,u0,v0)\mathcal L''=\mathcal L''(x_0,u_0,v_0)L′′=L′′(x0​,u0​,v0​) for the Hessian of the Lagrangian in xxx, H=h′(x0)H=h'(x_0)H=h′(x0​), G+=g+′(x0)G^+=g^{+\prime}(x_0)G+=g+′(x0​) and G0=g0′(x0)G^0=g^{0\prime}(x_0)G0=g0′(x0​). A square matrix is a P-matrix if all its principal minors are positive.

Formalization targets

Goal: Theorem 4.1 (p. 56)

Assume θ,g,h\theta,g,hθ,g,h are twice differentiable at x0x_0x0​ and (x0,u0,v0)(x_0,u_0,v_0)(x0​,u0​,v0​) solves (4.3). Assume also:

  • (a′) strong second-order sufficiency: ⟨y,L′′y⟩>0\langle y,\mathcal L''y\rangle>0⟨y,L′′y⟩>0 for all y≠0y\ne0y=0 with G+y=0G^+y=0G+y=0 and Hy=0Hy=0Hy=0;
  • (b) linear independence: the matrix [G+G0H]\begin{bmatrix}G^+\\G^0\\H\end{bmatrix}​G+G0H​​ has full row rank.

Then

(4.3) is strongly regular at (x0,u0,v0).\text{(4.3) is strongly regular at }(x_0,u_0,v_0).(4.3) is strongly regular at (x0​,u0​,v0​).

The Lipschitz constant is not fixed; the goal asserts that one exists.

Milestones

  1. The matrix K=[L′′HTG+T−H00−G+00]K=\begin{bmatrix}\mathcal L''&H^T&G^{+T}\\-H&0&0\\-G^+&0&0\end{bmatrix}K=​L′′−H−G+​HT00​G+T00​​ of (4.5) is nonsingular.
  2. The equations (4.8) define V,A,BV,A,BV,A,B uniquely, and the Schur complement S=[G0 0 0] K−1 [G0 0 0]TS=[G^0\ 0\ 0]\,K^{-1}\,[G^0\ 0\ 0]^TS=[G0 0 0]K−1[G0 0 0]T of (4.6) satisfies S=G0V=VTL′′VS=G^0V=V^T\mathcal L''VS=G0V=VTL′′V, so SSS is symmetric.
  3. A symmetric matrix is a P-matrix if and only if it is positive definite.
  4. SSS is positive definite.
  5. The §4 criterion (p. 55): (4.3) is strongly regular at (x0,u0,v0)(x_0,u_0,v_0)(x0​,u0​,v0​) if and only if KKK is nonsingular and SSS is a P-matrix.

A further item formalizes the example (4.9)–(4.10) on pp. 56–57: a linear generalized equation in R4\mathbb R^4R4 whose unique solution satisfies the ordinary second-order sufficient condition and (b), yet is not strongly regular.

Significance

Strong regularity is the hypothesis of Robinson's implicit-function theorem (Theorem 2.1 of the paper). Theorem 4.1 therefore yields, for a parametrised nonlinear program, a locally unique and Lipschitz-continuous KKT point together with its multipliers, without strict complementary slackness. The same property underlies the local quadratic convergence of Josephy–Newton and SQP methods, and the criterion of milestone 5 is the form in which it is usually checked. The example of (4.10) shows that the ordinary second-order sufficient condition is not enough; the weakly active constraints have to be dropped from the cone on which L′′\mathcal L''L′′ must be positive.

All statements are proved in the paper. None of them, nor the notion of strong regularity, has a machine-checked proof on this platform. The matrix milestones (1–4) are self-contained linear algebra and can be proved independently. Milestone 3 for arbitrary symmetric matrices is a variant of Sylvester's criterion, which Mathlib does not currently state. Milestone 5 rests on §3 and the appendix of the paper (the Schur-complement criterion and the reduction of a linear generalized equation over a polyhedral set), which are the subjects of the companion missions II and III of this series.

Difficulty

The obvious argument would apply the classical implicit-function theorem to the active KKT equations. It fails because of the weakly active constraints. Near (x0,u0,v0)(x_0,u_0,v_0)(x0​,u0​,v0​) a constraint with gi(x0)=0=u0,ig_i(x_0)=0=u_{0,i}gi​(x0​)=0=u0,i​ can become active or inactive under arbitrarily small perturbations, so the solution map is piecewise smooth, not smooth. Uniqueness has to hold across all the pieces simultaneously, which is a combinatorial condition: the P-matrix property of a Schur complement, not the nonsingularity of a single Jacobian. Example (4.10) shows that the natural guess (nonsingularity of every piece, guaranteed by ordinary second-order sufficiency) is insufficient: three distinct KKT points can coalesce at the origin.

The analytic part is also not routine. Strong regularity concerns the linearised problem with an arbitrary small perturbation on the right-hand side, including perturbations of the complementarity block. The criterion needs the reduction of §3 and the appendix, which localises the polyhedral set Rn×R+p×Rq\mathbb R^n\times\mathbb R^p_+\times\mathbb R^qRn×R+p​×Rq around the solution.

Formalization scope

  • Spaces. Points of Rn\mathbb R^nRn are EuclideanSpace ℝ (Fin n). The triple (x,u,v)(x,u,v)(x,u,v) lives in EuclideanSpace ℝ (Fin n ⊕ (Fin p ⊕ Fin q)), the Euclidean Rn+p+q\mathbb R^{n+p+q}Rn+p+q, so the normal cone uses the standard inner product. A product type, which carries the sup norm and no inner product, is deliberately not used.
  • Normal cone. The operator includes the clause z∈Cz\in Cz∈C, so it is empty off CCC.
  • Strong regularity. It is stated on the linearisation data, with a real Lipschitz constant λ\lambdaλ, and requires existence, uniqueness in VVV and the Lipschitz bound. Strong regularity at a point bundles a Fréchet derivative of FFF there.
  • Twice differentiable at x0x_0x0​. This is encoded as θ\thetaθ, gig_igi​, hjh_jhj​ differentiable on the open set Ω\OmegaΩ (the standing assumption of (4.1)), together with differentiability at x0x_0x0​ of their gradients. It is not C2C^2C2 on Ω\OmegaΩ, and symmetry of L′′\mathcal L''L′′ is not assumed; it follows.
  • Matrix conventions. Positive definite means ⟨w,Mw⟩>0\langle w,Mw\rangle>0⟨w,Mw⟩>0 for w≠0w\ne0w=0, without symmetry. P-matrix quantifies over all nonempty principal index sets. The Schur complement is used only together with nonsingularity of (4.5), because Mathlib's inverse of a singular matrix is 000.
  • What must not be formalized. Replacing (a′) by the ordinary second-order sufficient condition, or restricting (b) to G+G^+G+ and HHH, gives a false or a different theorem. The milestones state exactly which constraints enter each condition: (a′) uses G+G^+G+ and HHH, and (b) uses G+G^+G+, G0G^0G0 and HHH. A formalization that drops the weakly active constraints from (b), or assumes strict complementarity, trivializes the goal to the classical implicit-function theorem.
  • Infrastructure. A complete development needs the normal cone of a product of orthants, block-matrix inversion and Schur-complement identities, Sylvester-type criteria for symmetric matrices, and the reduction of a linear generalized equation over a polyhedral set to its reduced form. The linear-algebra milestones are reusable beyond this mission. Proofs of any milestone, and of the general P-matrix/positive-definite equivalence, are welcome.

Selected references

  • S. M. Robinson, Strongly regular generalized equations, Mathematics of Operations Research 5(1) (1980) 43–62. https://doi.org/10.1287/moor.5.1.43
  • A. V. Fiacco and G. P. McCormick, Nonlinear Programming: Sequential Unconstrained Minimization Techniques, Wiley, 1968 (reference [3] of the paper; second-order sufficient condition, Chapter 2).
  • A. V. Fiacco, Sensitivity analysis for nonlinear programming using penalty methods, Mathematical Programming 10 (1976) 287–311 (reference [4] of the paper). https://doi.org/10.1007/BF01580379
  • R. W. Cottle, Manifestations of the Schur complement, Linear Algebra and its Applications 8 (1974) 189–211 (reference [1] of the paper). https://doi.org/10.1016/0024-3795(74)90055-4
  • A. L. Dontchev and R. T. Rockafellar, Implicit Functions and Solution Mappings, 2nd ed., Springer, 2014 (modern account of strong regularity). https://doi.org/10.1007/978-1-4939-1037-3
9 thms3 active usersReviewed
🏆Completed
Number Theory·Captain: mikedeng1

Factoring Polynomials with Rational Coefficients I: A Reduced Lattice Basis Satisfies |b_j|² ≤ 2^{n−1}·max|x_i|² for Any t Linearly Independent Lattice VectorsResearch Paper

Motivation

A lattice in Rn\mathbb R^nRn is the set of integer combinations of nnn linearly independent vectors. Many problems in algorithmic number theory, cryptography and integer programming reduce to finding a short nonzero vector of a lattice, or a few short independent ones. Finding the shortest vector exactly is hard, but in 1982 A. K. Lenstra, H. W. Lenstra, Jr. and L. Lovász introduced a notion of reduced basis that can be computed in polynomial time and whose vectors are provably short up to a factor depending only on the dimension (Lenstra, Lenstra, Lovász 1982). Their paper used it to factor polynomials in Q[X]\mathbb Q[X]Q[X] in polynomial time; the same reduction (now called LLL) became a standard tool for simultaneous Diophantine approximation (the paper's own (1.39)), for H. W. Lenstra's integer programming algorithm in fixed dimension (Lenstra 1983), and for cryptanalysis of knapsack and RSA variants.

What makes a reduced basis useful is a set of explicit inequalities proved in Section 1 of the paper, before any algorithm appears. They compare the lengths of the basis vectors with the lattice determinant and with arbitrary lattice vectors, with constants such as 2n−12^{n-1}2n−1 and 2n(n−1)/42^{n(n-1)/4}2n(n−1)/4. This mission formalizes those inequalities.

Setting

Let n≥1n\ge1n≥1 and let ( ⋅ , ⋅ )(\,\cdot\,,\,\cdot\,)(⋅,⋅) and ∣⋅∣|\cdot|∣⋅∣ be the ordinary inner product and Euclidean length on Rn\mathbb R^nRn. Vectors b1,…,bn∈Rnb_1,\ldots,b_n\in\mathbb R^nb1​,…,bn​∈Rn form a basis for a lattice LLL when they are linearly independent over R\mathbb RR and L=∑i=1nZbiL=\sum_{i=1}^n\mathbb Z b_iL=∑i=1n​Zbi​. The determinant of LLL is

d(L)=∣det⁡(b1,b2,…,bn)∣,d(L)=|\det(b_1,b_2,\ldots,b_n)|,d(L)=∣det(b1​,b2​,…,bn​)∣,

the bib_ibi​ written as columns (1.1). The Gram–Schmidt vectors bi∗b_i^*bi∗​ and coefficients μij\mu_{ij}μij​ (1≤j<i≤n1\le j<i\le n1≤j<i≤n) are defined inductively by

bi∗=bi−∑j=1i−1μijbj∗,μij=(bi,bj∗)(bj∗,bj∗)(1.2),(1.3);b_i^*=b_i-\sum_{j=1}^{i-1}\mu_{ij}b_j^*,\qquad \mu_{ij}=\frac{(b_i,b_j^*)}{(b_j^*,b_j^*)}\qquad(1.2),(1.3);bi∗​=bi​−j=1∑i−1​μij​bj∗​,μij​=(bj∗​,bj∗​)(bi​,bj∗​)​(1.2),(1.3);

the bi∗b_i^*bi∗​ are pairwise orthogonal and not normalised. The basis is reduced if

∣μij∣≤12(1≤j<i≤n)(1.4)|\mu_{ij}|\le\tfrac12\quad(1\le j<i\le n)\qquad(1.4)∣μij​∣≤21​(1≤j<i≤n)(1.4)

and

∣bi∗+μi i−1bi−1∗∣2≥34∣bi−1∗∣2(1<i≤n)(1.5).|b_i^*+\mu_{i\,i-1}b_{i-1}^*|^2\ge\tfrac34|b_{i-1}^*|^2\quad(1<i\le n)\qquad(1.5).∣bi∗​+μii−1​bi−1∗​∣2≥43​∣bi−1∗​∣2(1<i≤n)(1.5).

The first condition is a size condition on the coefficients; the second (the Lovász condition) says that swapping bi−1b_{i-1}bi−1​ and bib_ibi​ would not shrink the (i−1)(i-1)(i−1)-th Gram–Schmidt length by more than the factor 34\frac3443​ (pp. 516–517).

Formalization targets

Goal: Proposition (1.12), p. 518

Let b1,…,bnb_1,\ldots,b_nb1​,…,bn​ be a reduced basis for LLL and let x1,…,xt∈Lx_1,\ldots,x_t\in Lx1​,…,xt​∈L be linearly independent. Then

∣bj∣2≤2n−1⋅max⁡{∣x1∣2,∣x2∣2,…,∣xt∣2}(j=1,…,t).|b_j|^2\le 2^{n-1}\cdot\max\{|x_1|^2,|x_2|^2,\ldots,|x_t|^2\}\qquad (j=1,\ldots,t).∣bj​∣2≤2n−1⋅max{∣x1​∣2,∣x2​∣2,…,∣xt​∣2}(j=1,…,t).

The statement quantifies over every reduced basis and every independent family of lattice vectors. Its case t=1t=1t=1 is Proposition (1.11).

Milestones

In the order of the paper's proofs (pp. 517–518):

  1. ∣bi∗∣2≥(34−μi i−12)∣bi−1∗∣2≥12∣bi−1∗∣2|b_i^*|^2\ge(\frac34-\mu_{i\,i-1}^2)|b_{i-1}^*|^2\ge\frac12|b_{i-1}^*|^2∣bi∗​∣2≥(43​−μii−12​)∣bi−1∗​∣2≥21​∣bi−1∗​∣2 for 1<i≤n1<i\le n1<i≤n (proof of (1.6));
  2. ∣bj∗∣2≤2i−j∣bi∗∣2|b_j^*|^2\le 2^{i-j}|b_i^*|^2∣bj∗​∣2≤2i−j∣bi∗​∣2 for 1≤j≤i≤n1\le j\le i\le n1≤j≤i≤n (proof of (1.6));
  3. ∣bi∣2=∣bi∗∣2+∑j<iμij2∣bj∗∣2≤2i−1∣bi∗∣2|b_i|^2=|b_i^*|^2+\sum_{j<i}\mu_{ij}^2|b_j^*|^2\le 2^{i-1}|b_i^*|^2∣bi​∣2=∣bi∗​∣2+∑j<i​μij2​∣bj∗​∣2≤2i−1∣bi∗​∣2 (proof of (1.6));
  4. (1.7): ∣bj∣2≤2i−1∣bi∗∣2|b_j|^2\le 2^{i-1}|b_i^*|^2∣bj​∣2≤2i−1∣bi∗​∣2 for 1≤j≤i≤n1\le j\le i\le n1≤j≤i≤n;
  5. if x=∑lrlblx=\sum_l r_lb_lx=∑l​rl​bl​ with rl∈Zr_l\in\mathbb Zrl​∈Z and iii is the largest index with ri≠0r_i\ne0ri​=0, then ∣x∣2≥∣bi∗∣2|x|^2\ge|b_i^*|^2∣x∣2≥∣bi∗​∣2 (proof of (1.11), reused as (1.13));
  6. (1.11): ∣b1∣2≤2n−1∣x∣2|b_1|^2\le 2^{n-1}|x|^2∣b1​∣2≤2n−1∣x∣2 for every nonzero x∈Lx\in Lx∈L.

Companion statements

The rest of Proposition (1.6) and the remark after it: d(L)=∏i∣bi∗∣d(L)=\prod_i|b_i^*|d(L)=∏i​∣bi∗​∣ (proof of (1.6)); (1.8) d(L)≤∏i∣bi∣≤2n(n−1)/4d(L)d(L)\le\prod_i|b_i|\le 2^{n(n-1)/4}d(L)d(L)≤∏i​∣bi​∣≤2n(n−1)/4d(L); (1.9) ∣b1∣≤2(n−1)/4d(L)1/n|b_1|\le 2^{(n-1)/4}d(L)^{1/n}∣b1​∣≤2(n−1)/4d(L)1/n; and Hadamard's inequality (1.10) d(L)≤∏i∣bi∣d(L)\le\prod_i|b_i|d(L)≤∏i​∣bi​∣ for an arbitrary basis.

Significance

Proposition (1.11) says the first vector of a reduced basis approximates a shortest nonzero lattice vector within the factor 2(n−1)/22^{(n-1)/2}2(n−1)/2; (1.12) extends this to all of the first ttt basis vectors, so that ∣bj∣2|b_j|^2∣bj​∣2 is within 2n−12^{n-1}2n−1 of the jjj-th successive minimum of LLL (the remark after (1.12)). These are the guarantees on which the paper's factoring algorithm rests: in Section 2 a reduced basis of a lattice built from a ppp-adic factor yields, through (1.11) and (1.12), an irreducible factor of the polynomial. Inequality (1.9) gives simultaneous Diophantine approximation in polynomial time, and (1.8) bounds how far a reduced basis is from orthogonal.

All of these results are proved in the paper and in textbooks. Verified LLL developments exist in Isabelle/HOL (Bottesch et al., A verified LLL algorithm, AFP 2018), but Mathlib, the library this platform builds on, has neither the reduced-basis predicate of (1.4)–(1.5) nor these bounds. A Lean development produces a reusable definition layer for lattices with the paper's conventions, Gram–Schmidt length estimates, and Hadamard's inequality in determinant form, which the other missions of this series (the reduction algorithm and the factoring application) build on.

Difficulty

The estimates on Gram–Schmidt lengths are single-variable inductions once (1.5) has been rewritten using orthogonality. The step that does not follow from a direct estimate is (1.12): the vectors x1,…,xtx_1,\ldots,x_tx1​,…,xt​ are arbitrary independent lattice vectors with no relation to the basis order, so a bound on each ∣xj∣|x_j|∣xj​∣ by a single Gram–Schmidt length does not by itself say which bjb_jbj​ it controls. A naive argument that pairs xjx_jxj​ with bjb_jbj​ fails. The determinant statements need the link between Mathlib's matrix determinant of the columns bib_ibi​ and the Gram–Schmidt lengths, which Mathlib does not state in this form.

Formalization scope

Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n) (abbreviated Vec n), a basis is a family b : Fin n → Vec n, the lattice is Submodule.span ℤ (Set.range b), and "basis for LLL" is linear independence over R\mathbb RR together with equality of that span with LLL. The vectors bi∗b_i^*bi∗​ are Mathlib's unnormalised InnerProductSpace.gramSchmidt, and μij\mu_{ij}μij​ is (1.3) verbatim. d(L)d(L)d(L) is the absolute determinant of the column matrix; it is not defined as ∏∣bi∗∣\prod|b_i^*|∏∣bi∗​∣, which would make the first companion statement true by definition. Section 1 begins "Let nnn be a positive integer", so every statement carries 0<n0<n0<n.

Lean indices run from 000 to n−1n-1n−1: the paper's bib_ibi​ is Lean's b ⟨i-1, _⟩, an exponent 2i−12^{i-1}2i−1 at paper index iii is 2i2^i2i at Lean index iii, and the pair (i−1,i)(i-1,i)(i−1,i) of (1.5) is (i,i+1)(i,i+1)(i,i+1). Exponents n(n−1)/4n(n-1)/4n(n−1)/4, (n−1)/4(n-1)/4(n−1)/4 and 1/n1/n1/n are real powers. The maximum in (1.12) is a Finset.sup' over the nonempty index set of the xjx_jxj​, and the statement is empty at t=0t=0t=0, as on the page.

Every statement about a reduced basis also assumes linear independence: the reducedness inequalities alone hold for degenerate dependent families, whose Gram–Schmidt vectors vanish, and would make the targets trivial. The goal does not assume (1.7), (1.13) or any ordering of the xjx_jxj​; those appear only as milestones. Proofs of the milestones and companions, and general lemmas on Gram–Schmidt and determinants that would belong in Mathlib, are welcome.

Selected references

  • A. K. Lenstra, H. W. Lenstra, Jr., L. Lovász, Factoring polynomials with rational coefficients, Mathematische Annalen 261, 515–534, 1982. https://doi.org/10.1007/BF01457454
  • H. W. Lenstra, Jr., Integer programming with a fixed number of variables, Mathematics of Operations Research 8(4), 538–548, 1983. https://doi.org/10.1287/moor.8.4.538
  • R. Bottesch, J. Divasón, M. Haslbeck, S. Joosten, R. Thiemann, A. Yamada, A verified LLL algorithm, Archive of Formal Proofs, 2018. https://www.isa-afp.org/entries/LLL_Basis_Reduction.html
8 thms3 active usersReviewed
🏆Completed
Machine LearningMarkov ChainReinforcement Learning·Captain: mikedeng1

Learning to Predict by the Methods of Temporal Differences: Linear TD(0) Converges in Expected Value to the Ideal Predictions on Absorbing Markov ChainsResearch Paper

Motivation

Temporal-difference (TD) methods learn to predict an eventual outcome from the differences between successive predictions rather than from the difference between each prediction and the final outcome. Sutton's 1988 paper Learning to predict by the methods of temporal differences introduced the TD(λ\lambdaλ) family and gave the first convergence proof for a TD method; before it, as the paper notes (p. 23), "no TD method has ever been proved stable or convergent to the correct predictions". TD learning is now the core of policy evaluation in reinforcement learning, and later analyses (Dayan 1992, Tsitsiklis and Van Roy 1997) start from the setting fixed here.

Timeline:

  • 1960 — Widrow and Hoff introduce the LMS (Widrow–Hoff) rule; its predictions converge in expected value to the ideal predictions for small step sizes (Widrow and Stearns 1985).
  • 1977 — Witten sketches a convergence proof for a TD-like procedure on discounted costs; many steps were left out, and Sutton (footnote 4) writes that it "now appears that the theorem he proposed is not true".
  • 1988 — Sutton proves Theorem 2 (linear TD(0), expected-value convergence on absorbing chains) and Theorem 3 (convergence of batch linear TD(0) to the maximum-likelihood predictions).
  • 1992–1997 — Dayan extends expected convergence to TD(λ\lambdaλ); Tsitsiklis and Van Roy prove almost-sure convergence of linear TD(λ\lambdaλ) under decreasing step sizes.

Setting

An absorbing Markov chain has a finite set NNN of nonterminal states, a finite set TTT of terminal states and transition probabilities pij≥0p_{ij}\ge0pij​≥0 (i∈Ni\in Ni∈N, j∈N∪Tj\in N\cup Tj∈N∪T) with ∑j∈N∪Tpij=1\sum_{j\in N\cup T}p_{ij}=1∑j∈N∪T​pij​=1. Let QQQ be the N×NN\times NN×N matrix [Q]ij=pij[Q]_{ij}=p_{ij}[Q]ij​=pij​. "Absorbing" means that every sequence terminates with probability one; for a finite chain this is Qk→0Q^k\to0Qk→0.

A sequence starts in a nonterminal state drawn from a distribution μ\muμ, follows the chain through nonterminal states q1,…,qmq_1,\dots,q_mq1​,…,qm​ until it enters a terminal state qm+1=jq_{m+1}=jqm+1​=j, and then produces a scalar outcome zzz drawn from a distribution νj\nu_jνj​ with finite mean zˉj\bar z_jzˉj​. Let [h]i=∑j∈Tpijzˉj[h]_i=\sum_{j\in T}p_{ij}\bar z_j[h]i​=∑j∈T​pij​zˉj​. The ideal prediction of state iii is the expected outcome from iii,

E{z∣i}=[∑k≥0Qkh]i=[(I−Q)−1h]i.E\{z\mid i\}=\Bigl[\sum_{k\ge0}Q^kh\Bigr]_i=\bigl[(I-Q)^{-1}h\bigr]_i .E{z∣i}=[k≥0∑​Qkh]i​=[(I−Q)−1h]i​.

The learner does not see states, only an observation vector xi∈RKx_i\in\mathbb R^Kxi​∈RK for each i∈Ni\in Ni∈N, and predicts linearly, Pt=w⊤xqtP_t=w^\top x_{q_t}Pt​=w⊤xqt​​. Linear TD(0) with weight updates after each sequence keeps www fixed during a sequence and then sets, with Pm+1=zP_{m+1}=zPm+1​=z,

w←w+∑t=1mα (Pt+1−Pt) xqt.w\leftarrow w+\sum_{t=1}^m\alpha\,(P_{t+1}-P_t)\,x_{q_t}.w←w+t=1∑m​α(Pt+1​−Pt​)xqt​​.

Sequences are experienced independently; wnw_nwn​ is the weight vector after nnn sequences. Let did_idi​ be the expected number of visits to iii in one sequence, D=diag⁡(d)D=\operatorname{diag}(d)D=diag(d), and XXX the matrix with columns xix_ixi​.

Formalization targets

Goal: Theorem 2

For every absorbing chain, start distribution μ\muμ, outcome laws with finite means and linearly independent {xi}\{x_i\}{xi​}, with every di>0d_i>0di​>0, there is ε>0\varepsilon>0ε>0 such that for 0<α<ε0<\alpha<\varepsilon0<α<ε and every w0w_0w0​,

lim⁡n→∞E{xi⊤wn}=[(I−Q)−1h]i∀i∈N.\lim_{n\to\infty}E\{x_i^\top w_n\}=\bigl[(I-Q)^{-1}h\bigr]_i\qquad\forall i\in N .n→∞lim​E{xi⊤​wn​}=[(I−Q)−1h]i​∀i∈N.

The threshold ε\varepsilonε is existential, as in the paper; no explicit value is fixed.

Milestones on the goal's path

Theorem A.1 (Neumann series under An→0A^n\to0An→0); (5) the ideal predictions; (7) d⊤=μ⊤(I−Q)−1d^\top=\mu^\top(I-Q)^{-1}d⊤=μ⊤(I−Q)−1; the mean recursion wˉn+1=wˉn+αXD(h+QX⊤wˉn−X⊤wˉn)\bar w_{n+1}=\bar w_n+\alpha XD(h+QX^\top\bar w_n-X^\top\bar w_n)wˉn+1​=wˉn​+αXD(h+QX⊤wˉn​−X⊤wˉn​); Theorem A.2 (A⊤AA^\top AA⊤A nonsingular); Theorem A.3 (A≻0  ⟺  A+A⊤≻0A\succ0\iff A+A^\top\succ0A≻0⟺A+A⊤≻0); the Lemma of p. 27; D(I−Q)D(I-Q)D(I−Q) positive definite; the eigenvalues of X⊤XD(I−Q)X^\top XD(I-Q)X⊤XD(I−Q) have positive real parts; and (I−αX⊤XD(I−Q))n→0(I-\alpha X^\top XD(I-Q))^n\to0(I−αX⊤XD(I−Q))n→0 for small α\alphaα.

Further results

Theorem 3: under repeated presentations of a finite training set, batch linear TD(0) converges (deterministically) to the maximum-likelihood predictions [(I−Q^)−1h^]i[(I-\hat Q)^{-1}\hat h]_i[(I−Q^​)−1h^]i​, with its two supporting steps (Q^n→0\hat Q^n\to0Q^​n→0 and d^⊤=μ^⊤(I−Q^)−1\hat d^\top=\hat\mu^\top(I-\hat Q)^{-1}d^⊤=μ^​⊤(I−Q^​)−1). Theorem 1: linear TD(1) and Widrow–Hoff produce the same per-sequence weight changes.

Significance

Theorem 2 shows that a bootstrapping method, which learns from its own earlier predictions, is not biased by them in the limit: in expectation it reaches the same predictions as supervised (Widrow–Hoff) learning. Theorem 3 says more: on a fixed data set, TD(0) converges to the predictions that would be exact if the maximum-likelihood model of the process were correct, which differs from the least-squares answer Widrow–Hoff converges to. Together they are the formal basis for preferring TD to Monte-Carlo targets in multi-step prediction.

The results are proved on paper, and not formalized in Lean. A formalization adds a precise model of the experience (i.i.d. sequences of an absorbing chain with terminal-dependent outcome laws), the integrability facts the paper leaves implicit, and a correct proof of the positive definiteness of D(I−Q)D(I-Q)D(I−Q), whose printed argument has a gap (see below). The matrix lemmas (Neumann series under An→0A^n\to0An→0; real-part positivity of eigenvalues of GMGMGM for G≻0G\succ0G≻0 symmetric and MMM positive definite in the non-symmetric sense; the step-size threshold) are reusable for other linear stochastic-approximation analyses.

Difficulty

The obvious argument writes E{wn+1}E\{w_{n+1}\}E{wn+1​} as a linear function of E{wn}E\{w_n\}E{wn​} and observes that the iteration matrix I−αX⊤XD(I−Q)I-\alpha X^\top XD(I-Q)I−αX⊤XD(I−Q) is a contraction for small α\alphaα. Two steps of this fail as printed. First, the paper proves that D(I−Q)D(I-Q)D(I−Q) is positive definite through the Lemma of p. 27 with a weakened notion of diagonal dominance (weak in every row, strict in one), under which the Lemma is false; with the standard notion, D(I−Q)+(D(I−Q))⊤D(I-Q)+(D(I-Q))^\topD(I−Q)+(D(I−Q))⊤ is in general not strictly diagonally dominant (a row with μi=0\mu_i=0μi​=0 that cannot leave NNN in one step has row sum 000). A correct proof combines weak dominance with reachability of every state from the support of μ\muμ, which is where di>0d_i>0di​>0 enters. Second, X⊤XD(I−Q)X^\top XD(I-Q)X⊤XD(I−Q) is not symmetric, so a small α\alphaα does not make I−αX⊤XD(I−Q)I-\alpha X^\top XD(I-Q)I−αX⊤XD(I−Q) a contraction in the Euclidean norm; the argument goes through its eigenvalues, and turning eigenvalues of modulus below one into (I−αX⊤XD(I−Q))n→0(I-\alpha X^\top XD(I-Q))^n\to0(I−αX⊤XD(I−Q))n→0 is a spectral-radius argument. The probabilistic step is also not free: wnw_nwn​ is a polynomial in nnn random sequences of unbounded length, and its integrability and the factorization E{ηijwn}=dipijE{wn}E\{\eta_{ij}w_n\}=d_ip_{ij}E\{w_n\}E{ηij​wn​}=di​pij​E{wn​} need independence across sequences.

Formalization scope

States are finite types N (nonempty) and T; the chain is the structure AbsorbingChain with blocks pN, pT and the field Qk→0Q^k\to0Qk→0. Observation vectors are x : N → Fin K → ℝ with LinearIndependent ℝ x; XXX is Matrix (Fin K) N ℝ. A sequence is an Episode (list of nonterminal states, terminal state, outcome); IsEpisodeStream states measurability, mutual independence (iIndepFun) and the law P(path=s,term=j,out∈B)=μs1ps1s2⋯psmj νj(B)P(\text{path}=s,\text{term}=j,\text{out}\in B)=\mu_{s_1}p_{s_1s_2}\cdots p_{s_mj}\,\nu_j(B)P(path=s,term=j,out∈B)=μs1​​ps1​s2​​⋯psm​j​νj​(B). Expectations are Bochner integrals, and the goal asserts integrability of xi⊤wnx_i^\top w_nxi⊤​wn​, so a non-integrable junk value 000 cannot satisfy it. did_idi​ is defined as an expectation (a sum over sequences), not as [μ⊤(I−Q)−1]i[\mu^\top(I-Q)^{-1}]_i[μ⊤(I−Q)−1]i​, so (7) is not circular. "Positive definite" is the paper's footnote 6 (y⊤Ay>0y^\top Ay>0y⊤Ay>0 for real y≠0y\ne0y=0, no symmetry), not Mathlib's Matrix.PosDef.

Trivializations ruled out: the hypothesis di>0d_i>0di​>0 is the paper's own discarding of never-visited states (without it the goal is false: an unvisited state's weight never moves); N is nonempty and μ\muμ sums to one, so the hypotheses are satisfiable and the goal is not vacuous; the sequences cannot be arbitrary random variables or a fixed sequence, since their law is pinned to μ\muμ, ppp and ν\nuν; ε\varepsilonε is chosen before α\alphaα, w0w_0w0​ and the probability space; and the update is per sequence, not the intra-sequence variant of §5.

Corrected slips: "For each nonterminal state jjj" (p. 24) means terminal; the diagonal-dominance definition of p. 27 is replaced by the standard one; I−αXD(I−Q)X⊤I-\alpha XD(I-Q)X^\topI−αXD(I−Q)X⊤ (p. 28) means I−αX⊤XD(I−Q)I-\alpha X^\top XD(I-Q)I−αX⊤XD(I−Q). Not formalized: the variance and TD(λ\lambdaλ) conjectures of p. 29, §4.3, and the extension claims of §5.

Related open goals on this platform (different models, credited, not re-posed): SuttonBartoRL.BatchTD.batch_td_converges_to_certainty_equivalence (tabular, discounted analogue of Theorem 3), and SuttonBartoRL.LinearTD.keyMatrix_posDef, posDef_of_row_col_sums, expected_td_update (continuing discounted chain with stationary DDD, where every row sum of D(I−γP)D(I-\gamma P)D(I−γP) is positive). Contributions of any milestone, of general matrix lemmas, and of reusable infrastructure for i.i.d. episode streams are welcome.

Selected references

  • R. S. Sutton, Learning to predict by the methods of temporal differences, Machine Learning 3(1), 9–44, 1988. https://doi.org/10.1023/A:1022633531479
  • B. Widrow and M. E. Hoff, Adaptive switching circuits, IRE WESCON Convention Record, 96–104, 1960.
  • B. Widrow and S. D. Stearns, Adaptive Signal Processing, Prentice-Hall, 1985.
  • J. G. Kemeny and J. L. Snell, Finite Markov Chains, Springer, 1976. https://link.springer.com/book/9780387901923
  • R. S. Varga, Matrix Iterative Analysis, Prentice-Hall, 1962 (2nd ed., Springer, 2000: https://doi.org/10.1007/978-3-642-05156-2).
  • P. Dayan, The convergence of TD(λ) for general λ, Machine Learning 8, 341–362, 1992. https://doi.org/10.1007/BF00992701
  • J. N. Tsitsiklis and B. Van Roy, An analysis of temporal-difference learning with function approximation, IEEE Transactions on Automatic Control 42(5), 674–690, 1997. https://doi.org/10.1109/9.580874
24 thms3 active usersReviewed
🏆Completed
Machine LearningOptimization·Captain: mikedeng1

Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers VII: Factor Model Fitting — the ADMM X-Update in Closed Form, Entry by EntryTextbook

Motivation

Alternating direction methods are used when one part of an optimization problem is easy to minimize and another part has a simple projection. Chapter 9 of Boyd, Parikh, Chu, Peleato and Eckstein (2011) examines this idea with nonconvex constraints. Its examples include sparse vectors, Boolean vectors and low-rank matrices. The chapter says explicitly that ADMM can fail to converge in this setting and that a limit need not be globally optimal. The useful claim here is narrower and concrete: several individual updates can still be computed exactly.

The capstone is factor-model fitting. A symmetric data matrix, such as an empirical covariance matrix, is approximated by a positive semidefinite matrix of prescribed rank plus a nonnegative diagonal matrix. This decomposition gives one component that captures shared variation and another that represents coordinate-specific variation. The chapter separates the diagonal fit from the rank constraint and writes the resulting ADMM X-update entry by entry. This mission formalizes that exact update and two other projection rules stated in the same chapter.

Setting

Fix a positive integer nnn. Write Sn\mathbb S^nSn for the real symmetric n×nn\times nn×n matrices, and let Σ∈Sn\Sigma\in\mathbb S^nΣ∈Sn be the matrix to approximate. The Frobenius norm squares and sums every ordered matrix entry: ∥X∥F2=∑i,jXij2\|X\|_F^2=\sum_{i,j}X_{ij}^2∥X∥F2​=∑i,j​Xij2​. A vector d∈Rnd\in\mathbb R^nd∈Rn is nonnegative when di≥0d_i\ge0di​≥0 for every iii, and diag⁡(d)\operatorname{diag}(d)diag(d) places those entries on a diagonal matrix. The book's reduced fitting loss is

fΣ(X)=inf⁡d≥012∥X+diag⁡(d)−Σ∥F2.f_\Sigma(X)=\inf_{d\ge0}\frac12\|X+\operatorname{diag}(d)-\Sigma\|_F^2.fΣ​(X)=d≥0inf​21​∥X+diag(d)−Σ∥F2​.

In the scaled ADMM iteration, ZZZ carries the positive semidefinite rank constraint and UUU is the scaled dual matrix. Given the current symmetric matrices Z,UZ,UZ,U and a penalty ρ>0\rho>0ρ>0, the X-step minimizes fΣ(X)+(ρ/2)∥X−Z+U∥F2f_\Sigma(X)+(\rho/2)\|X-Z+U\|_F^2fΣ​(X)+(ρ/2)∥X−Z+U∥F2​ over X∈SnX\in\mathbb S^nX∈Sn. The X-step itself has no rank or positive semidefinite restriction. The following Z-step projects onto the chosen rank-constrained positive semidefinite set. The theorem here concerns the X-step, whose definition is independent of the chosen rank.

The other two results concern Euclidean projection of vectors v∈Rnv\in\mathbb R^nv∈Rn. The cardinality card⁡(x)\operatorname{card}(x)card(x) is the number of nonzero coordinates of xxx. The sparse set is {x:card⁡(x)≤c}\{x:\operatorname{card}(x)\le c\}{x:card(x)≤c} for a nonnegative integer ccc. The Boolean cube is {0,1}n\{0,1\}^n{0,1}n. Projection means a nearest point in squared Euclidean distance; it may have more than one value when coordinates tie.

Formalization targets

Partial minimization of the diagonal

The first milestone identifies the book's infimum as the explicit componentwise loss and states that the optimizing diagonal is attained:

fΣ(X)=12∑i≠j(Xij−Σij)2+12∑i(Xii−Σii)+2,di=(Σii−Xii)+.f_\Sigma(X)=\frac12\sum_{i\ne j}(X_{ij}-\Sigma_{ij})^2+ \frac12\sum_i(X_{ii}-\Sigma_{ii})_+^2, \qquad d_i=(\Sigma_{ii}-X_{ii})_+.fΣ​(X)=21​i=j∑​(Xij​−Σij​)2+21​i∑​(Xii​−Σii​)+2​,di​=(Σii​−Xii​)+​.

The sum over i≠ji\ne ji=j counts both (i,j)(i,j)(i,j) and (j,i)(j,i)(j,i). The statement preserves that convention instead of treating a symmetric matrix as a list of independent upper-triangular entries.

Exact projections for two nonconvex sets

The page 74 milestones say that retaining the min⁡(c,n)\min(c,n)min(c,n) entries of largest absolute value gives a nearest point in {x:card⁡(x)≤c}\{x:\operatorname{card}(x)\le c\}{x:card(x)≤c}, and that rounding every coordinate to a nearest element of {0,1}\{0,1\}{0,1} gives a nearest Boolean vector. They assert nearest-point status for ties without asserting uniqueness. These are chapter results on the same theme of exact nonconvex updates, although they are independent of the factor-model goal.

Factor-model X-update

The goal identifies the unique symmetric minimizer X+X^+X+ of the X-subproblem. With aij=Zij−Uija_{ij}=Z_{ij}-U_{ij}aij​=Zij​−Uij​, its off-diagonal and diagonal entries are

Xij+=Σij+ρaij1+ρ(i≠j),Xii+={Σii+ρaii1+ρ,Σii≤aii,aii,Σii>aii.X^+_{ij}=\frac{\Sigma_{ij}+\rho a_{ij}}{1+\rho}\quad(i\ne j),\qquad X^+_{ii}=\begin{cases} \dfrac{\Sigma_{ii}+\rho a_{ii}}{1+\rho},&\Sigma_{ii}\le a_{ii},\\ a_{ii},&\Sigma_{ii}>a_{ii}. \end{cases}Xij+​=1+ρΣij​+ρaij​​(i=j),Xii+​=⎩⎨⎧​1+ρΣii​+ρaii​​,aii​,​Σii​≤aii​,Σii​>aii​.​

The target asserts both the formula and global minimality over symmetric matrices. It does not replace minimality with a stationarity condition.

Significance

The exact X-update separates the matrix fit from the nonconvex rank projection. It establishes that the factor-model algorithm's X-step is a well-defined, single-valued minimization for every symmetric current state and every positive penalty. It also makes the one-sided diagonal loss explicit: a nonnegative diagonal can absorb a shortfall below Σii\Sigma_{ii}Σii​, but cannot absorb an excess. The two vector projections give similarly exact updates for sparse and Boolean constraint sets.

The mathematical claims are given in §9.1–9.1.2 of the published monograph; they are not open conjectures. The formalization work is to check the infimum, projection and unique-minimizer statements with every domain and tie convention explicit. The mission poses theorem statements for proofs; these draft statements themselves do not yet supply machine-checked proofs. A complete development can reuse its finite matrix loss and finite vector projection vocabulary in other splitting algorithms.

Difficulty

The diagonal partial minimization is one-sided, while the proximal penalty is symmetric around Z−UZ-UZ−U. An entrywise formula alone does not show that the assembled matrix minimizes the full objective or that it is the only minimizer. Symmetry also couples the two displayed off-diagonal positions (i,j)(i,j)(i,j) and (j,i)(j,i)(j,i), so a scalar statement on one entry must agree with its transpose. For sparse projection, ties at the cutoff make a rule phrased as “the projection” ambiguous. For Boolean projection, the midpoint is a tie and requires a declared convention. These issues are part of the theorem statements, not numerical implementation details.

Formalization scope

Matrices are Matrix (Fin n) (Fin n) ℝ; symmetry is an entrywise equality predicate. The factor-model statements assume n≥1n\ge1n≥1, symmetric Σ,Z,U\Sigma,Z,UΣ,Z,U, and ρ>0\rho>0ρ>0. The book uses Zk,UkZ^k,U^kZk,Uk at an iteration; the Lean theorem uses those current matrices as parameters and does not posit convergence of an ADMM sequence. The reduced loss is literally the infimum over all componentwise nonnegative ddd, and the Frobenius square is the finite sum of entry squares. The stated X-minimization ranges over all symmetric matrices, with no positive semidefinite or rank hypothesis on XXX.

For sparse vectors, the index set has size min⁡(c,n)\min(c,n)min(c,n) and its selected magnitudes dominate unselected ones. This covers c=0c=0c=0, c>nc>nc>n and cutoff ties. The Boolean rounding function chooses zero when an entry equals 1/21/21/2. The book uses indices 1,…,n1,\ldots,n1,…,n; Fin n uses 0,…,n−10,\ldots,n-10,…,n−1. On page 75 the printed diagonal branch conditions omit the superscript kkk on ZZZ and UUU; the formalization uses the current Z,UZ,UZ,U that appear in the surrounding ADMM update. The theorem requires the candidate to minimize the book's reduced loss, preventing an arbitrary replacement loss from making the statement trivial.

The development needs finite-sum algebra, real infima with an attained lower bound, symmetry of matrices, and nearest-point arguments for finite vectors. The rank-ccc singular-value projection on page 74 is already an open target elsewhere and is outside this mission. The positive semidefinite rank-kkk eigenvalue projection on page 76 is also outside this goal; it would require a separate spectral development. Contributions that prove the three milestones or the goal against these definitions are in scope. The page also mentions rounding under integer constraints; this mission selects the preceding Boolean claim as its projection milestone.

Selected references

  • Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato and Jonathan Eckstein, Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers, Foundations and Trends in Machine Learning 3(1), 2011, pp. 73–76, §§9.1–9.1.2. DOI: 10.1561/2200000016.
7 thms3 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

On the Abstract Properties of Linear Dependence 4: Orthogonal Subspaces Have Dual MatroidsResearch Paper

Motivation

Hassler Whitney introduced matroids in On the Abstract Properties of Linear Dependence (Amer. J. Math. 57, 1935, doi:10.2307/2371182) to capture what linear dependence among the columns of a matrix and the circuit structure of a graph have in common. One of the central constructions of the paper is duality. For graphs, duality exists only for planar graphs (Whitney, Non-separable and planar graphs, Trans. AMS 34, 1932); for matroids Whitney showed that every matroid has a dual, and that duality has a direct linear-algebra model: the matroid of a subspace of Rn\mathbb R^nRn and the matroid of its orthogonal complement are duals.

Matroid duality underlies much of combinatorial optimization: the duality between cycles and cuts in graphs, the relation between a linear code and its dual code, the exchange of rank and corank in matroid intersection and partition, and the treatment of network flows as duals of potential problems. Whitney's §§11–13 are where this structure is first defined and where its linear-algebra meaning (Theorem 28) is established.

Setting

A matroid MMM is a finite set of elements e1,…,ene_1,\dots,e_ne1​,…,en​ with a rank function rrr on its subsets; equivalently, a family of independent sets, or of bases (maximal independent sets). For a subset NNN write ρ(N)\rho(N)ρ(N) for its number of elements and

n(N)=ρ(N)−r(N)n(N) = \rho(N) - r(N)n(N)=ρ(N)−r(N)

for its nullity; r(M)r(M)r(M) and n(M)n(M)n(M) are the rank and nullity of the whole set of elements.

Duality (§11). Let MMM and M′M'M′ be matroids and σ\sigmaσ a one-to-one correspondence between their elements. M′M'M′ is a dual of MMM (via σ\sigmaσ) if, for every subset NNN of MMM, with N′N'N′ the complement in M′M'M′ of σ(N)\sigma(N)σ(N),

r(N′)=r(M′)−n(N).(11.1)r(N') = r(M') - n(N). \tag{11.1}r(N′)=r(M′)−n(N).(11.1)

The matroid of a subspace (§12). Let EnE_nEn​ be nnn-dimensional Euclidean space with coordinates x1,…,xnx_1,\dots,x_nx1​,…,xn​, and let HHH be a hyperplane through the origin, which in Whitney's usage is a linear subspace of any dimension. For a set SSS of coordinates, project HHH onto the coordinate subspace ES′E'_SES′​ spanned by the axes xix_ixi​, i∈Si\in Si∈S. The matroid associated with HHH has elements e1,…,ene_1,\dots,e_ne1​,…,en​, one per coordinate, and gives the set {ei:i∈S}\{e_i: i\in S\}{ei​:i∈S} the rank

rH(S)=dim⁡πS(H).r_H(S) = \dim \pi_S(H).rH​(S)=dimπS​(H).

If HHH is the row space of a matrix M\mathbf MM, then rH(S)r_H(S)rH​(S) is the rank of the columns of M\mathbf MM indexed by SSS, so the associated matroid is the column matroid of M\mathbf MM.

In the Lean development these objects are WhitneyMatroid.Components.nullity (shared), IsDualVia M M' σ, IsDual M M', subspaceRank H S and IsAssociated M H.

Formalization targets

Goal: Theorem 28

Let HHH be a subspace of EnE_nEn​ and H′=H⊥H' = H^\perpH′=H⊥ its orthogonal complement. If MMM and M′M'M′ are the matroids associated with HHH and H′H'H′, then MMM and M′M'M′ are duals under the correspondence of equal coordinates:

∀N⊆{e1,…,en}:rM′(N‾)=r(M′)−nM(N).\forall N\subseteq\{e_1,\dots,e_n\}:\qquad r_{M'}(\overline N) = r(M') - n_M(N).∀N⊆{e1​,…,en​}:rM′​(N)=r(M′)−nM​(N).

Milestones

  1. Theorem 27. For every subspace HHH there is exactly one matroid associated with HHH.
  2. Theorem 6 (already proved on the platform). All bases have the same number of elements.
  3. Theorem 7. BBB is a base iff r(B)=r(M)r(B)=r(M)r(B)=r(M) and n(B)=0n(B)=0n(B)=0.
  4. Theorem 8. If BBB is a base and NNN is independent, then N∪N′N\cup N'N∪N′ is a base for some N′⊆BN'\subseteq BN′⊆B.
  5. Theorem 20. If M′M'M′ is a dual of MMM, then r(M′)=n(M)r(M') = n(M)r(M′)=n(M) and n(M′)=r(M)n(M') = r(M)n(M′)=r(M).
  6. Theorem 23. M′M'M′ is a dual of MMM via σ\sigmaσ iff, for every BBB, BBB is a base of MMM exactly when the complement of σ(B)\sigma(B)σ(B) is a base of M′M'M′.
  7. Theorem 21. Duality is symmetric.
  8. Theorem 22. Every matroid has a dual.

Significance

The result. Theorem 28 identifies abstract duality with orthogonal complementation. With Theorem 23 it says that the column matroid of a real matrix whose rows span HHH and the column matroid of a matrix whose rows span H⊥H^\perpH⊥ have complementary bases. This is the basis of the standard representation of the dual of a represented matroid ([Ir∣A][I_r\mid A][Ir​∣A] and [−AT∣In−r][-A^{\mathsf T}\mid I_{n-r}][−AT∣In−r​]), of the cycle/cocycle duality of graphs viewed through incidence matrices, and of the fact that a matroid representable over a field has a dual representable over the same field. Theorems 20–23 are the basic facts every later treatment of matroid duality starts from: duality exchanges rank and nullity, is symmetric, always exists, and is characterized by base complements.

Formalizing it. All of these results are classical and proved in Whitney's paper; what this mission adds is a machine-checked development of Whitney's own definition of duality, the rank identity (11.1), rather than the base-complement definition used in modern libraries. Mathlib defines the dual matroid M∗M^*M∗ by base complements and proves that it is a matroid; it does not, at the pinned revision, contain the rank formula (11.1) for M∗M^*M∗, the matroid of a real subspace, or Theorem 28. Theorem 6 is already proved on the platform and enters as a reference. Theorems 7 and 8 are close to Mathlib lemmas and are footholds rather than new content.

Difficulty

The difficulty of the goal is not in the combinatorics but in the passage between the two descriptions of a subspace. The natural first idea is to compare the ranks rH(S)r_H(S)rH​(S) and rH⊥(S‾)r_{H^\perp}(\overline S)rH⊥​(S) directly by counting dimensions of HHH and H⊥H^\perpH⊥. This does not close: rH(S)r_H(S)rH​(S) is the dimension of a projection of HHH onto coordinates, while dim⁡H⊥=n−dim⁡H\dim H^\perp = n - \dim HdimH⊥=n−dimH only controls H⊥H^\perpH⊥ as a whole, and the rank of a complementary coordinate set in M′M'M′ is not determined by the dimensions of HHH and H⊥H^\perpH⊥ alone. Some relation between coordinate projections of HHH and the structure of H⊥H^\perpH⊥ on the complementary coordinates has to be established. Theorem 27 is itself nontrivial in Lean: the rank function rHr_HrH​ has to be shown to satisfy the matroid axioms, which needs a careful treatment of coordinate projections and of submodularity of dimension. On the abstract side, Theorem 23 needs both directions of the passage between the rank identity and base complements, including the counting step r(M)+r(M′)=ρ(M)r(M) + r(M') = \rho(M)r(M)+r(M′)=ρ(M).

Formalization scope

  • Matroids are Mathlib Matroid α on a finite type α whose ground set is all of α (Whitney's matroid is its finite set of elements). This finiteness and the ground set convention are part of the definitions; all theorems are stated under them.
  • Ranks and nullities. Ranks are Mathlib's eRk, finite on a finite type and converted to integers; the nullity n(N)=ρ(N)−r(N)n(N)=\rho(N)-r(N)n(N)=ρ(N)−r(N) and the identity (11.1) are computed in Z\mathbb ZZ. No truncated subtraction appears.
  • Duality is Whitney's rank identity (11.1) for every subset, for a fixed bijection σ : α ≃ β (IsDualVia) or some bijection (IsDual). It is deliberately not defined as Mathlib's M✶: with that definition Theorem 23 would be nearly definitional and Theorem 28 would lose the rank identity. A formalization that replaces (11.1) by the base-complement condition, or states Theorem 28 only for bases, is not this mission's goal.
  • Euclidean space is EuclideanSpace ℝ (Fin n) with its standard inner product; the orthogonal hyperplane is Hᗮ. The field is R\mathbb RR, as in the paper; the analogous statement over other fields with the dot-product annihilator is a generalization and not part of this mission.
  • The associated matroid is a predicate (IsAssociated M H): ground set Fin n, and the rank of every set SSS of coordinates equals the finrank of the image of HHH under the coordinate projection onto SSS (not of H∩ES′H\cap E'_SH∩ES′​, a different set function). Existence and uniqueness is Theorem 27.
  • Implicit hypotheses made explicit: the ground sets are finite and equal to the whole element type; Whitney's "dimension rrr" and "dimension n−rn-rn−r" in Theorem 28 are consequences of H′=H⊥H'=H^\perpH′=H⊥ and are not hypotheses. The goal covers n=0n=0n=0, H={0}H=\{0\}H={0} and H=EnH=E_nH=En​.
  • Infrastructure needed and reusable: the matroid of a real subspace (equivalently the column matroid of a real matrix), with its rank function in terms of coordinate projections; the rank formula of the dual matroid; the dimension identity relating projections of HHH and sections of H⊥H^\perpH⊥. All are reusable for the other missions of this series (the Fano matroid and binary matroids) and for any later work on represented matroids. Proofs of the milestones, alternative proofs of Theorem 28 through Mathlib's M✶, and supporting lemmas on coordinate projections are welcome.

Selected references

  • H. Whitney, On the Abstract Properties of Linear Dependence, American Journal of Mathematics 57 (1935), 509–533. https://doi.org/10.2307/2371182
  • H. Whitney, Non-separable and planar graphs, Transactions of the American Mathematical Society 34 (1932), 339–362. https://doi.org/10.1090/S0002-9947-1932-1501641-2
  • J. Oxley, Matroid Theory, 2nd ed., Oxford Graduate Texts in Mathematics 21, Oxford University Press, 2011, Chapter 2 (duality). https://doi.org/10.1093/acprof:oso/9780198566946.001.0001
  • Mathlib, Mathlib.Combinatorics.Matroid (Dual, Rank). https://github.com/leanprover-community/mathlib4
12 thms3 active usersReviewed
🏆Completed
Mathematical Physics·Captain: Lucas

Varying Constants I: Dimensional Analysis, Natural Units and the Buckingham π TheoremResearch Paper

Motivation

Uzan's review Varying Constants, Gravitation and Cosmology (Living Rev. Relativity 14 (2011) 2) is about testing whether the fundamental constants of physics change in space or time. Before any experiment can be read, §2.1 of the review settles which constants it even makes sense to ask about. Two claims from that section carry the whole programme:

  • p. 14 (§2.1.2): "only the variation of dimensionless constants can be measured and in case such a variation is detected, it is impossible to determine, which dimensional constant is varying";
  • pp. 15–17 (§2.1.1): three independent constants (e.g. Stoney's G,e,cG,e,cG,e,c or Planck's c,G,ℏc,G,\hbarc,G,ℏ) can be used to define the three mechanical units, after which "all other constants are dimensionless quantities" whose values do not depend on the units, and "any variation of constants that will leave these numbers unaffected is actually just a redefinition of units".

Both claims are informal statements of a classical result of dimensional analysis, the Buckingham π\piπ theorem (E. Buckingham, Phys. Rev. 4 (1914) 345). This mission states them precisely and asks for formal proofs.

Setting

Fix ddd base units U1,…,UdU_1,\dots,U_dU1​,…,Ud​ (for mechanics d=3d=3d=3: L,M,TL,M,TL,M,T) and nnn dimensional constants. The dimension matrix D∈Rn×dD\in\mathbb R^{n\times d}D∈Rn×d says that constant iii has dimension ∏jUjDij\prod_j U_j^{D_{ij}}∏j​UjDij​​; real exponents are allowed, because Gaussian units give the charge the dimension M1/2L3/2T−1M^{1/2}L^{3/2}T^{-1}M1/2L3/2T−1 (Uzan, p. 15). A configuration x∈R>0nx\in\mathbb R^n_{>0}x∈R>0n​ lists the numerical values of the constants in some system of units.

  • A change of units is a vector s∈R>0ds\in\mathbb R^d_{>0}s∈R>0d​. It acts by (s⋅x)i=xi∏jsjDij(s\cdot x)_i=x_i\prod_j s_j^{D_{ij}}(s⋅x)i​=xi​∏j​sjDij​​.
  • An observable f:Rn→Rf:\mathbb R^n\to\mathbb Rf:Rn→R is unit invariant if f(s⋅x)=f(x)f(s\cdot x)=f(x)f(s⋅x)=f(x) for all positive x,sx,sx,s.
  • The dimensionless exponents are ZD={a∈Rn:∑iaiDij=0 ∀j}\mathcal Z_D=\{a\in\mathbb R^n:\sum_i a_iD_{ij}=0\ \forall j\}ZD​={a∈Rn:∑i​ai​Dij​=0 ∀j}, and πa(x)=∏ixiai\pi_a(x)=\prod_i x_i^{a_i}πa​(x)=∏i​xiai​​ is the corresponding power product.
  • Given ddd chosen constants e1,…,ede_1,\dots,e_de1​,…,ed​, a system of natural units for xxx is a positive sss with (s⋅x)ej=1(s\cdot x)_{e_j}=1(s⋅x)ej​​=1 for all jjj.
  • The Planck dimension matrix DPD_{\rm P}DP​ has rows [c]=LT−1[c]=LT^{-1}[c]=LT−1, [G]=L3M−1T−2[G]=L^3M^{-1}T^{-2}[G]=L3M−1T−2 and [ℏ]=L2MT−1[\hbar]=L^2MT^{-1}[ℏ]=L2MT−1.

Target

Goal (Buckingham π\piπ). Put k=n−rank⁡Dk=n-\operatorname{rank}Dk=n−rankD. There are linearly independent a(1),…,a(k)∈ZDa^{(1)},\dots,a^{(k)}\in\mathcal Z_Da(1),…,a(k)∈ZD​ such that every unit-invariant fff factors as

f(x)=F(πa(1)(x),…,πa(k)(x))(x∈R>0n).f(x)=F\big(\pi_{a^{(1)}}(x),\dots,\pi_{a^{(k)}}(x)\big)\qquad (x\in\mathbb R^n_{>0}).f(x)=F(πa(1)​(x),…,πa(k)​(x))(x∈R>0n​).

Milestones, in order:

  1. Dimensionless power products are unit invariant: a∈ZD⇒πa(s⋅x)=πa(x)a\in\mathcal Z_D\Rightarrow \pi_a(s\cdot x)=\pi_a(x)a∈ZD​⇒πa​(s⋅x)=πa​(x).
  2. dim⁡ZD=n−rank⁡D\dim\mathcal Z_D=n-\operatorname{rank}DdimZD​=n−rankD.
  3. If det⁡(Dej,k)≠0\det(D_{e_j,k})\ne0det(Dej​,k​)=0, every positive xxx has exactly one system of natural units.
  4. Values in natural units do not depend on the system of units you started from: s′⋅(r⋅x)=s⋅xs'\cdot(r\cdot x)=s\cdot xs′⋅(r⋅x)=s⋅x.
  5. Planck units: c=G=ℏ=1c=G=\hbar=1c=G=ℏ=1 holds exactly when s=(1/ℓP,1/mP,1/tP)s=(1/\ell_P,1/m_P,1/t_P)s=(1/ℓP​,1/mP​,1/tP​), where ℓP=Gℏ/c3\ell_P=\sqrt{G\hbar/c^3}ℓP​=Gℏ/c3​, mP=ℏc/Gm_P=\sqrt{\hbar c/G}mP​=ℏc/G​ and tP=Gℏ/c5t_P=\sqrt{G\hbar/c^5}tP​=Gℏ/c5​ (Uzan, p. 16).
  6. Two positive configurations agree on every πa\pi_aπa​ with a∈ZDa\in\mathcal Z_Da∈ZD​   ⟺  \iff⟺ they differ by a change of units (Uzan, p. 17).
  7. Only dimensionless variations are measurable: a unit-invariant fff takes equal values on configurations that agree on all dimensionless πa\pi_aπa​ (Uzan, p. 14).

Significance

The result. Milestones 6–7 justify the review's working convention of quoting all bounds as bounds on dimensionless numbers (αEM\alpha_{\rm EM}αEM​, μ=mp/me\mu=m_p/m_eμ=mp​/me​, αG=Gmp2/ℏc\alpha_G=Gm_p^2/\hbar cαG​=Gmp2​/ℏc, …). Milestone 2 counts how many independent numbers there are. Milestones 3–5 say that natural units are well defined.

Formalizing it. The mathematics is classical and the proofs are known. What remains is to formalize it: a reusable, general dimensional-analysis layer (unit actions, dimensionless monomials, natural units) that later missions on Uzan's review can build on.

Difficulty

Taking logarithms turns the multiplicative problem into linear algebra: changes of units act on log⁡x\log xlogx by translations through the column space of DDD, and ZD\mathcal Z_DZD​ is the annihilator of that space. Two steps carry the content. The first is the duality step (annihilator of the annihilator) behind milestone 6 and the goal. The second is the bookkeeping with real powers (Real.rpow), which only behaves well on positive bases. The goal also needs a choice of FFF with no regularity, defined through the quotient Rn/col⁡(D)\mathbb R^n/\operatorname{col}(D)Rn/col(D).

Formalization scope

  • Lean namespace VaryingConstants; all definitions are in one definition file. Indices are Fin n and Fin d, and exponents are real.
  • Positivity is an explicit hypothesis (IsPositive), not a subtype. Unit invariance constrains fff only on positive configurations.
  • ZD\mathcal Z_DZD​ is the kernel of a↦aTDa\mapsto a^{\mathsf T}Da↦aTD, and the rank is Matrix.rank over R\mathbb RR.
  • Natural units are indexed by a map e : Fin d → Fin n. The independence hypothesis is det⁡De≠0\det D_e\ne0detDe​=0.
  • There is no trivializing reading: the goal fixes the number of π\piπ-groups to n−rank⁡Dn-\operatorname{rank}Dn−rankD and requires them to be linearly independent and dimensionless, so the identity map does not qualify.

Contributions such as general lemmas on Real.rpow products and on annihilators of matrix column spaces are reusable beyond this mission.

Selected references

  • J.-P. Uzan, Varying Constants, Gravitation and Cosmology, Living Rev. Relativity 14 (2011) 2. http://www.livingreviews.org/lrr-2011-2 (§2.1, pp. 9–17).
  • E. Buckingham, On physically similar systems; illustrations of the use of dimensional equations, Phys. Rev. 4 (1914) 345. https://doi.org/10.1103/PhysRev.4.345
9 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph Theory·Captain: mikedeng1

On a Conjecture of Spectral Extremal Problems: If the Extremal Graphs for F Are Turán Graphs Plus a Fixed Number of Edges, Every F-Free Graph of Maximum Spectral Radius Is ExtremalResearch Paper

Motivation

Extremal graph theory asks how many edges a graph on nnn vertices can have without containing a fixed graph FFF. The answer, the Turán number ex(n,F)\mathrm{ex}(n,F)ex(n,F), and the graphs attaining it, the set Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) of extremal graphs, are known precisely only for special FFF; the Erdős–Stone–Simonovits theorem gives ex(n,F)=(1−1χ(F)−1+o(1))n22\mathrm{ex}(n,F) = (1 - \frac{1}{\chi(F)-1} + o(1))\frac{n^2}{2}ex(n,F)=(1−χ(F)−11​+o(1))2n2​, where χ(F)\chi(F)χ(F) is the chromatic number.

Spectral extremal graph theory asks the same question with the number of edges replaced by the spectral radius λ(G)\lambda(G)λ(G), the largest eigenvalue of the adjacency matrix. Since λ(G)≥2e(G)/n\lambda(G) \ge 2e(G)/nλ(G)≥2e(G)/n, a spectral bound implies an edge bound, and spectral extremal results are usually stronger than their edge versions. Nikiforov (Linear Algebra Appl. 427, 2007) showed that the Turán graph Tn,rT_{n,r}Tn,r​ maximises λ\lambdaλ among Kr+1K_{r+1}Kr+1​-free graphs, so for F=Kr+1F = K_{r+1}F=Kr+1​ the spectral and the edge extremal graphs coincide. Whether this happens for other FFF is the subject of the paper.

Timeline:

  • 1941 Turán: Tn,rT_{n,r}Tn,r​ is the unique extremal graph for Kr+1K_{r+1}Kr+1​.
  • 2003 Chen, Gould, Pfender, Wei (J. Combin. Theory Ser. B 89): ex(n,Fk,r+1)=e(Tn,r)+O(1)\mathrm{ex}(n, F_{k,r+1}) = e(T_{n,r}) + O(1)ex(n,Fk,r+1​)=e(Tn,r​)+O(1) for kkk copies of Kr+1K_{r+1}Kr+1​ sharing one vertex.
  • 2007 Nikiforov (Linear Algebra Appl. 427): spectral Turán theorem for Kr+1K_{r+1}Kr+1​. 2009 Nikiforov (J. Graph Theory 62): spectral stability for large forbidden subgraphs, the source of Lemma 2.5.
  • 2020 Cioabă, Feng, Tait, Zhang (Electron. J. Combin. 27): the spectral extremal graph for the friendship graph FkF_kFk​ lies in Ex(n,Fk)\mathrm{Ex}(n, F_k)Ex(n,Fk​).
  • 2022 Cioabă, Desai, Tait (European J. Combin. 99) conjecture: if the graphs in Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) are Turán graphs plus O(1)O(1)O(1) edges, then the spectral extremal graphs lie in Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) for large nnn. Before the general proof it was known for Kr+1K_{r+1}Kr+1​, the friendship graphs FkF_kFk​, the graphs Hs,kH_{s,k}Hs,k​ (Li, Peng) and the intersecting cliques Fk,rF_{k,r}Fk,r​ (Desai, Kang, Li, Ni, Tait, Wang, arXiv:2108.03587).
  • 2022/2023 Wang, Kang, Xue (arXiv:2203.10831; J. Combin. Theory Ser. B, 2023): the conjecture holds in general. This mission formalizes their Theorem 1.2.

Setting

All graphs are finite and simple. For a graph GGG on nnn vertices, A(G)A(G)A(G) is its 0/10/10/1 adjacency matrix and λ(G)\lambda(G)λ(G) is the largest eigenvalue of A(G)A(G)A(G). A graph GGG is FFF-free if no subgraph of GGG is isomorphic to FFF. The Turán number ex(n,F)\mathrm{ex}(n,F)ex(n,F) is the maximum number of edges e(G)e(G)e(G) over FFF-free graphs GGG on nnn vertices, and Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) is the set of FFF-free nnn-vertex graphs with ex(n,F)\mathrm{ex}(n,F)ex(n,F) edges. The Turán graph Tn,rT_{n,r}Tn,r​ is the complete rrr-partite graph on nnn vertices with parts of sizes ⌊n/r⌋\lfloor n/r\rfloor⌊n/r⌋ or ⌈n/r⌉\lceil n/r\rceil⌈n/r⌉.

The hypothesis on FFF is: for fixed integers r≥2r \ge 2r≥2 and a≥0a \ge 0a≥0 and all large nnn, ex(n,F)=e(Tn,r)+a\mathrm{ex}(n,F) = e(T_{n,r}) + aex(n,F)=e(Tn,r​)+a and every graph in Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) contains a spanning copy of Tn,rT_{n,r}Tn,r​, i.e. is Tn,rT_{n,r}Tn,r​ plus aaa edges. The paper states "adding O(1)O(1)O(1) edges" and fixes the constant at the start of Section 3 (p. 4): "We may assume that the graphs in Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) are obtained from Tn,rT_{n,r}Tn,r​ by adding aaa edges." The mission follows that reading. Examples: Kr+1K_{r+1}Kr+1​ with a=0a = 0a=0, the friendship graphs, and the intersecting cliques Fk,r+1F_{k,r+1}Fk,r+1​.

A graph GGG is spectral extremal for FFF if it is FFF-free and λ(G)≥λ(G′)\lambda(G) \ge \lambda(G')λ(G)≥λ(G′) for every FFF-free G′G'G′ on the same nnn vertices.

Formalization targets

Goal: Theorem 1.2

For r≥2r \ge 2r≥2, a≥0a \ge 0a≥0 and FFF satisfying the hypothesis, there is NNN such that for all n≥Nn \ge Nn≥N every spectral extremal graph GGG for FFF on nnn vertices satisfies

e(G)=ex(n,F),i.e.G∈Ex(n,F).e(G) = \mathrm{ex}(n,F), \qquad\text{i.e.}\qquad G \in \mathrm{Ex}(n,F).e(G)=ex(n,F),i.e.G∈Ex(n,F).

The statement contains no numerical constant, and NNN depends only on FFF, rrr, aaa.

Milestones

The milestones follow the proof, in order: strict monotonicity of λ\lambdaλ under proper subgraphs of a connected graph (Lemma 2.3); connectivity of GGG (Lemma 3.1); the bound λ(G)≥(1−1r)n−r4n+2an\lambda(G) \ge (1-\frac1r)n - \frac{r}{4n} + \frac{2a}{n}λ(G)≥(1−r1​)n−4nr​+n2a​ (Lemma 3.2); spectral stability for χ(F)=r+1\chi(F) = r+1χ(F)=r+1 (Corollary 2.6); for every maximum rrr-cut V1∪⋯∪VrV_1 \cup \dots \cup V_rV1​∪⋯∪Vr​, ∑ie(Vi)≤εn2\sum_i e(V_i) \le \varepsilon n^2∑i​e(Vi​)≤εn2 and ∣Vi∣=(1r±3ε)n|V_i| = (\frac1r \pm 3\sqrt\varepsilon)n∣Vi​∣=(r1​±3ε​)n (Lemma 3.3); a counting inequality for intersections (Lemma 2.8); e(G[Vi])≤ae(G[V_i]) \le ae(G[Vi​])≤a and minimum degree above (1−1r−3rε1/3)n(1 - \frac1r - 3r\varepsilon^{1/3})n(1−r1​−3rε1/3)n (Lemma 3.6); at most 2a2a2a vertices of each part have a neighbour in that part, and all others see every other part completely (Lemma 3.7); Perron entries xu≥1−20a2r2/nx_u \ge 1 - 20a^2r^2/nxu​≥1−20a2r2/n for a≥1a \ge 1a≥1 (Lemma 3.8); e(Gin)−e(Gout)≤ae(G_{in}) - e(G_{out}) \le ae(Gin​)−e(Gout​)≤a (Lemma 3.9); balancing two parts of a complete multipartite graph increases λ\lambdaλ (Lemma 2.7); and the maximum partition is balanced, ∣ni−nj∣≤1|n_i - n_j| \le 1∣ni​−nj​∣≤1 (Lemma 3.10).

Significance

The theorem settles the Cioabă–Desai–Tait conjecture: for every FFF whose extremal graphs are Turán graphs plus a bounded number of edges, the spectral extremal problem reduces to the edge extremal problem for large nnn. This recovers the earlier cases (friendship graphs, the graphs Hs,kH_{s,k}Hs,k​, intersecting cliques) at once, and it turns any future determination of Ex(n,F)\mathrm{Ex}(n,F)Ex(n,F) of this type into a spectral result with no further work.

The result is proved on paper; it has no machine-checked proof. Mathlib has Turán's theorem (extremalNumber_top, uniqueness of turanGraph) and the definition of extremalNumber, but no spectral extremal graph theory: no Perron–Frobenius theorem for graphs, no spectral Turán theorem, no stability theorem. The formalization would supply these, and the milestone statements are independently reusable: strict monotonicity of λ\lambdaλ (Lemma 2.3), the spectral comparison of complete multipartite graphs (Lemma 2.7) and spectral stability (Corollary 2.6) are standard tools of the area.

Difficulty

The natural first idea, comparing GGG with an extremal graph HHH by Rayleigh quotients, fails at the start: λ(G)≥λ(H)\lambda(G) \ge \lambda(H)λ(G)≥λ(H) gives only e(G)≥e(Tn,r)−o(n2)e(G) \ge e(T_{n,r}) - o(n^2)e(G)≥e(Tn,r​)−o(n2), far from ex(n,F)\mathrm{ex}(n,F)ex(n,F). Closing an additive gap of O(1)O(1)O(1) edges requires control of the Perron vector to within O(1/n)O(1/n)O(1/n) at every vertex and exact control of the part sizes. The second is the delicate step: an imbalance of one vertex between two parts costs Θ(1/n)\Theta(1/n)Θ(1/n) in λ\lambdaλ, while the aaa extra edges contribute only O(1/n2)O(1/n^2)O(1/n2) beyond the Turán graph, so the two effects must be compared at different scales. Further, the proof needs the deep spectral stability theorem of Nikiforov (Lemma 2.5), whose own proof is long.

Formalization scope

Graphs on nnn vertices are SimpleGraph (Fin n), matching Mathlib's extremalNumber n F; FFF is a graph on any finite type. λ(G)\lambda(G)λ(G) is the largest eigenvalue of G.adjMatrix ℝ (index 000 of Mathlib's decreasingly sorted eigenvalues₀), not an absolute value and not a norm. "FFF-free" is F.Free G (no copy of FFF, not necessarily induced). "Sufficiently large nnn" is ∃ N, ∀ n ≥ N with NNN chosen after F,r,aF, r, aF,r,a and before GGG; "sufficiently small ε\varepsilonε" is ∃ ε₀ > 0, ∀ ε ∈ (0, ε₀). Partitions V1∪⋯∪VrV_1 \cup \dots \cup V_rV1​∪⋯∪Vr​ are labellings Fin n → Fin r whose parts may be empty; the Section 3 lemmas hold for every partition maximising the number of crossing edges. Lemma 3.8 carries the extra hypothesis a≥1a \ge 1a≥1, because as printed it is false for a=0a = 0a=0 (for F=Kr+1F = K_{r+1}F=Kr+1​ and r∤nr \nmid nr∤n the Perron vector of Tn,rT_{n,r}Tn,r​ has entries below 111); the goal does not assume it.

Trivializing formalizations are ruled out: λ\lambdaλ is not defined from the edge count (which would make spectral and edge extremality the same), the hypothesis on FFF does not contain the conclusion and is satisfiable (a sorry-free check for F=Kr+1F = K_{r+1}F=Kr+1​, a=0a = 0a=0 was compiled), the conclusion is e(G)=ex(n,F)e(G) = \mathrm{ex}(n,F)e(G)=ex(n,F) and not a weaker bound, and the threshold is not chosen after GGG.

A complete development needs the Perron–Frobenius theorem for irreducible nonnegative symmetric matrices, the Rayleigh quotient characterisation of λ\lambdaλ, the spectrum of complete multipartite graphs, Nikiforov's spectral stability lemma, and max-cut partition arguments. All of these are reusable beyond this mission, and proofs of any milestone, of the cited Lemmas 2.1, 2.2 and 2.5, or of Nikiforov's spectral Turán theorem are welcome.

Selected references

  • J. Wang, L. Kang, Y. Xue, On a conjecture of spectral extremal problems, J. Combin. Theory Ser. B, 2023; arXiv:2203.10831v1 (2022). https://arxiv.org/abs/2203.10831
  • S. Cioabă, D. N. Desai, M. Tait, The spectral radius of graphs with no odd wheels, European J. Combin. 99 (2022) 103420.
  • S. Cioabă, L. H. Feng, M. Tait, X. D. Zhang, The maximum spectral radius of graphs without friendship subgraphs, Electron. J. Combin. 27(4) (2020) P4.22.
  • G. Chen, R. J. Gould, F. Pfender, B. Wei, Extremal graphs for intersecting cliques, J. Combin. Theory Ser. B 89 (2003) 159–171.
  • V. Nikiforov, Bounds on graph eigenvalues II, Linear Algebra Appl. 427 (2007) 183–189.
  • V. Nikiforov, Stability for large forbidden subgraphs, J. Graph Theory 62(4) (2009) 362–368.
  • D. N. Desai, L. Kang, Y. Li, Z. Ni, M. Tait, J. Wang, Spectral extremal graphs for intersecting cliques, arXiv:2108.03587v2 (2021). https://arxiv.org/abs/2108.03587
18 thms3 active usersReviewed
🏆Completed
Combinatorics·Captain: mikedeng1

Applied Combinatorics V: Linear Recurrence Equations and the Advancement OperatorTextbook

Motivation

Linear recurrences with constant coefficients are among the first tools of enumerative combinatorics and the analysis of algorithms: the Fibonacci numbers, the number of binary strings avoiding a pattern, the running time of a divide-and-conquer loop and the number of tilings of a strip all satisfy relations of the form c0an+k+c1an+k−1+⋯+ckan=0c_0 a_{n+k} + c_1 a_{n+k-1} + \cdots + c_k a_n = 0c0​an+k​+c1​an+k−1​+⋯+ck​an​=0. Chapter 9 of Keller and Trotter's Applied Combinatorics (appliedcombinatorics.org) treats such relations as linear equations in an operator, the advancement operator, in direct analogy with linear differential equations with constant coefficients. The chapter's Principal Theorem says that the solution set of such an equation is a vector space whose dimension equals the order of the recurrence; everything else in the chapter (general solutions for distinct and repeated roots, and the reduction of nonhomogeneous equations to homogeneous ones) is organised around it.

This mission formalizes that theorem, in the book's model of functions on all of Z\mathbb{Z}Z, together with the numbered lemmas of Section 9.5 on which its outline rests.

Setting

Let VVV be the real vector space of all functions f:Z→Rf : \mathbb{Z} \to \mathbb{R}f:Z→R, with pointwise addition and scalar multiplication. The advancement operator A:V→VA : V \to VA:V→V is

Af(n)=f(n+1)(n∈Z),A f(n) = f(n+1) \qquad (n \in \mathbb{Z}),Af(n)=f(n+1)(n∈Z),

a linear operator with Apf(n)=f(n+p)A^p f(n) = f(n+p)Apf(n)=f(n+p) for p≥0p \ge 0p≥0. For a nonnegative integer kkk and real constants c0,c1,…,ckc_0, c_1, \dots, c_kc0​,c1​,…,ck​, the advancement operator polynomial is

p(A)=c0Ak+c1Ak−1+c2Ak−2+⋯+ck,p(A) = c_0 A^k + c_1 A^{k-1} + c_2 A^{k-2} + \cdots + c_k,p(A)=c0​Ak+c1​Ak−1+c2​Ak−2+⋯+ck​,

so that p(A)f(n)=c0f(n+k)+c1f(n+k−1)+⋯+ckf(n)p(A) f(n) = c_0 f(n+k) + c_1 f(n+k-1) + \cdots + c_k f(n)p(A)f(n)=c0​f(n+k)+c1​f(n+k−1)+⋯+ck​f(n). The solution space of the homogeneous equation p(A)f=0p(A) f = 0p(A)f=0 is

W={f∈V:p(A)f=0},W = \{ f \in V : p(A) f = 0 \},W={f∈V:p(A)f=0},

the kernel of p(A)p(A)p(A), a linear subspace of VVV. In Lean, AAA is AppliedComb.Recurrence.advance : Module.End ℝ (ℤ → ℝ), p(A)p(A)p(A) is opPoly k c for a coefficient vector c : Fin (k + 1) → ℝ with c i multiplying Ak−iA^{k-i}Ak−i, and WWW is solutionSpace k c := LinearMap.ker (opPoly k c). A factor A−rA - rA−r is advance - r • 1.

Formalization targets

Goal: Theorem 9.18 (the Principal Theorem)

For a positive integer kkk and real constants c0,…,ckc_0, \dots, c_kc0​,…,ck​ with c0≠0c_0 \neq 0c0​=0 and ck≠0c_k \neq 0ck​=0,

dim⁡R{f:Z→R  :  (c0Ak+c1Ak−1+⋯+ck)f=0}=k.\dim_{\mathbb{R}} \{ f : \mathbb{Z} \to \mathbb{R} \;:\; (c_0 A^k + c_1 A^{k-1} + \cdots + c_k) f = 0 \} = k.dimR​{f:Z→R:(c0​Ak+c1​Ak−1+⋯+ck​)f=0}=k.

Milestones

  1. Lemma 9.19. If r≠0r \neq 0r=0 and (A−r)f=0(A - r) f = 0(A−r)f=0, then f(n)=f(0) rnf(n) = f(0)\, r^nf(n)=f(0)rn for every n∈Zn \in \mathbb{Z}n∈Z.
  2. Lemma 9.20. If c0,ck≠0c_0, c_k \neq 0c0​,ck​=0, g∈Vg \in Vg∈V is arbitrary and p(A)f0=gp(A) f_0 = gp(A)f0​=g, then every solution of p(A)f=gp(A) f = gp(A)f=g is f=f0+f1f = f_0 + f_1f=f0​+f1​ with f1∈Wf_1 \in Wf1​∈W.
  3. Theorem 9.21. If r1,…,rkr_1, \dots, r_kr1​,…,rk​ are distinct nonzero reals, every solution of (A−r1)(A−r2)⋯(A−rk)f=0(A - r_1)(A - r_2)\cdots(A - r_k) f = 0(A−r1​)(A−r2​)⋯(A−rk​)f=0 has the form
f(n)=c1r1n+c2r2n+⋯+ckrkn(n∈Z).f(n) = c_1 r_1^n + c_2 r_2^n + \cdots + c_k r_k^n \qquad (n \in \mathbb{Z}).f(n)=c1​r1n​+c2​r2n​+⋯+ck​rkn​(n∈Z).
  1. Lemma 9.22. If k≥1k \ge 1k≥1 and r≠0r \neq 0r=0, then (A−r)kf=0(A - r)^k f = 0(A−r)kf=0 holds exactly when
f(n)=c1rn+c2nrn+c3n2rn+⋯+cknk−1rn(n∈Z)f(n) = c_1 r^n + c_2 n r^n + c_3 n^2 r^n + \cdots + c_k n^{k-1} r^n \qquad (n \in \mathbb{Z})f(n)=c1​rn+c2​nrn+c3​n2rn+⋯+ck​nk−1rn(n∈Z)

for some real constants c1,…,ckc_1, \dots, c_kc1​,…,ck​.

Significance

The result itself. Theorem 9.18 is what justifies the standard recipe for solving a recurrence: once kkk linearly independent solutions are found, every solution is a linear combination of them, and kkk initial values pin down a unique solution. Theorems 9.21 and 9.22 name those kkk solutions when the characteristic polynomial splits over R\mathbb{R}R, and Lemma 9.20 reduces nonhomogeneous recurrences, the ones arising from counting problems with a forcing term, to one particular solution plus the homogeneous space.

Formalizing it. The book states Theorem 9.18 without a full proof ("we won't prove the full result") and leaves Lemma 9.22 as an exercise, so a formalization supplies arguments the source omits. Mathlib's LinearRecurrence develops the N\mathbb{N}N-indexed, monic version (LinearRecurrence.solSpace_rank); the bi-infinite, two-sided setting of the book, in which the constant term ckc_kck​ must be nonzero, is not in Mathlib or on the platform as of this mission.

Difficulty

The subspace part of Theorem 9.18 is immediate; the content is the dimension count, in both directions. On Z\mathbb{Z}Z a solution must extend to negative indices as well as positive ones, so an argument that works for sequences indexed by N\mathbb{N}N does not transfer: there the constant term plays no role and the dimension is kkk whatever the constant term, while on Z\mathbb{Z}Z a vanishing ckc_kck​ changes the answer. The outline in the book proceeds through factorisations of p(A)p(A)p(A), which over R\mathbb{R}R need not exist (complex roots), so the goal cannot be obtained by combining Theorems 9.21 and 9.22 alone. Lemma 9.22 requires showing that the functions njrnn^j r^nnjrn solve (A−r)kf=0(A - r)^k f = 0(A−r)kf=0 and that they exhaust its solutions, for nnn ranging over all integers.

Formalization scope

  • Functions are Z→R\mathbb{Z} \to \mathbb{R}Z→R (the real space VVV of Section 9.5, p. 199), not N→R\mathbb{N} \to \mathbb{R}N→R and not Z→C\mathbb{Z} \to \mathbb{C}Z→C. Powers rnr^nrn with nnn negative are integer powers (zpow), always of a nonzero base.
  • Dimension in the goal is Module.rank ℝ (solutionSpace k c) = k, a cardinal equality, so it also asserts finite-dimensionality.
  • The coefficient vector is c : Fin (k + 1) → ℝ; c 0 is the leading coefficient c0c_0c0​ and c (Fin.last k) the constant term ckc_kck​.
  • Theorem 9.21 asserts one inclusion, as on the page ("every solution has the form"); Lemma 9.22 asserts both ("the general solution"), as an iff.
  • Lemma 9.22 carries the hypothesis r≠0r \neq 0r=0, the standing assumption of Section 9.5.2 (p. 200), which the lemma's own sentence does not repeat.
  • No O(·), "≈" or unspecified threshold occurs in these statements, so no explicit constant is instantiated.
  • Ruling out the trivial reading: WWW is defined as the kernel of the operator polynomial p(A)p(A)p(A), never as the span of kkk chosen functions, so the goal is not a statement about the rank of a spanning family.

Needed infrastructure: linear operators on the function space ℤ → ℝ, powers and products in Module.End, Module.rank/Module.finrank, and finite sums; Mathlib's LinearRecurrence may be adapted for the forward half. The definitions advance, opPoly and solutionSpace are reusable for any later mission on recurrences or on generating functions for bi-infinite sequences. Contributions of the milestone lemmas, of a proof of the goal that avoids factorisation over C\mathbb{C}C, and of a complex-valued variant are welcome.

Selected references

  • Mitchel T. Keller and William T. Trotter, Applied Combinatorics, 2017 Edition, Chapter 9 (Recurrence Equations), CC BY-SA 4.0. appliedcombinatorics.org
  • Mathlib, Mathlib/Algebra/LinearRecurrence.lean (ℕ-indexed linear recurrences, LinearRecurrence.solSpace_rank). Mathlib docs
  • Ronald L. Graham, Donald E. Knuth and Oren Patashnik, Concrete Mathematics, 2nd ed., Addison-Wesley, 1994, Section 7.3 (solving recurrences). ISBN 978-0-201-55802-9.
6 thms3 active usersReviewed
🏆Completed
Numerical AnalysisProbabilityRandom Matrix Theory·Captain: mikedeng1

Randomized Algorithms for Estimating the Trace of an Implicit Symmetric Positive Semi-Definite Matrix IV: Sample Bound for Hutchinson's Trace EstimatorResearch Paper

Motivation

Many computations need the trace of a matrix AAA that is never formed explicitly and can only be applied to vectors: the trace of a matrix function such as trace(A−1)\mathrm{trace}(A^{-1})trace(A−1) or log⁡det⁡A=trace(log⁡A)\log\det A = \mathrm{trace}(\log A)logdetA=trace(logA) in statistics and lattice QCD, the Frobenius norm ∥B∥F2=trace(BTB)\|B\|_F^2 = \mathrm{trace}(B^TB)∥B∥F2​=trace(BTB) of an operator, or the number of triangles of a graph. The standard tool is Monte-Carlo estimation, introduced by M. F. Hutchinson (Hutchinson 1989): average MMM quadratic forms ziTAziz_i^TAz_iziT​Azi​ over random sign vectors ziz_izi​. Each sample costs one matrix–vector product, uses one random bit per entry, and needs only additions and subtractions.

Before Avron and Toledo (2011), only the variance of such estimators had been analysed. A small variance does not say how many samples guarantee a given relative error with a given probability. Avron and Toledo gave the first bounds of this kind for several estimators. This mission covers the bound for Hutchinson's estimator, their Theorem 7.1.

Setting

A Rademacher random variable takes the values +1+1+1 and −1-1−1, each with probability 1/21/21/2. Let A∈Rn×nA \in \mathbb{R}^{n\times n}A∈Rn×n be symmetric positive semi-definite. Draw M≥1M \ge 1M≥1 independent random vectors z1,…,zM∈Rnz_1, \ldots, z_M \in \mathbb{R}^nz1​,…,zM​∈Rn whose MnMnMn entries are independent Rademacher variables. Hutchinson's trace estimator is

HM=1M∑i=1MziTAzi.H_M = \frac{1}{M}\sum_{i=1}^{M} z_i^TAz_i .HM​=M1​i=1∑M​ziT​Azi​.

A single sample zTAzz^TAzzTAz is an unbiased estimator of trace(A)\mathrm{trace}(A)trace(A) (Lemma 2.1 of the paper, due to Hutchinson). For symmetric AAA its variance is 2(∥A∥F2−∑iAii2)2\bigl(\|A\|_F^2 - \sum_i A_{ii}^2\bigr)2(∥A∥F2​−∑i​Aii2​), twice the squared Frobenius mass of AAA off the diagonal.

Given ϵ>0\epsilon > 0ϵ>0 and δ∈(0,1)\delta \in (0,1)δ∈(0,1), a random estimator TTT is an (ϵ,δ)(\epsilon,\delta)(ϵ,δ)-approximator of trace(A)\mathrm{trace}(A)trace(A) if

Pr⁡(∣T−trace(A)∣≤ϵ trace(A))≥1−δ.\Pr\bigl(|T - \mathrm{trace}(A)| \le \epsilon\,\mathrm{trace}(A)\bigr) \ge 1 - \delta .Pr(∣T−trace(A)∣≤ϵtrace(A))≥1−δ.

The rank rank(A)\mathrm{rank}(A)rank(A) is the number of nonzero eigenvalues λj\lambda_jλj​ of AAA, counted with multiplicity.

Formalization targets

Goal: Theorem 7.1, sample bound for HMH_MHM​

For every symmetric positive semi-definite AAA, every 0<ϵ≤1/20 < \epsilon \le 1/20<ϵ≤1/2 and every 0<δ<10 < \delta < 10<δ<1,

M≥6ϵ−2ln⁡ ⁣(2 rank(A)δ)⟹HM is an (ϵ,δ)-approximator of trace(A).M \ge 6\epsilon^{-2}\ln\!\left(\frac{2\,\mathrm{rank}(A)}{\delta}\right) \quad\Longrightarrow\quad H_M \text{ is an } (\epsilon,\delta)\text{-approximator of } \mathrm{trace}(A).M≥6ϵ−2ln(δ2rank(A)​)⟹HM​ is an (ϵ,δ)-approximator of trace(A).

The bound depends on AAA only through its rank. It does not depend on the dimension nnn, on the condition number, or on how the trace is spread over the diagonal.

Milestones

  1. Lemma 7.2 (Achlioptas 2001, Lemma 5). For a unit vector α∈Rn\alpha \in \mathbb{R}^nα∈Rn and S=1M∑i=1M(αTzi)2S = \frac1M\sum_{i=1}^M(\alpha^Tz_i)^2S=M1​∑i=1M​(αTzi​)2, for every ϵ>0\epsilon > 0ϵ>0,
Pr⁡(∣S−1∣≥ϵ)≤2exp⁡ ⁣(−M2(ϵ22−ϵ33)).\Pr(|S - 1| \ge \epsilon) \le 2\exp\!\left(-\frac{M}{2}\left(\frac{\epsilon^2}{2} - \frac{\epsilon^3}{3}\right)\right).Pr(∣S−1∣≥ϵ)≤2exp(−2M​(2ϵ2​−3ϵ3​)).
  1. Per-direction bound (proof of Theorem 7.1, p. 8:11). Let r≥1r \ge 1r≥1 and 0<ϵ≤1/20 < \epsilon \le 1/20<ϵ≤1/2. If M≥6ϵ−2ln⁡(2r/δ)M \ge 6\epsilon^{-2}\ln(2r/\delta)M≥6ϵ−2ln(2r/δ), then Pr⁡(∣S−1∣≥ϵ)≤δ/r\Pr(|S - 1| \ge \epsilon) \le \delta/rPr(∣S−1∣≥ϵ)≤δ/r.
  2. From directions to the trace (proof of Theorem 7.1, p. 8:11). Write A=UΛUTA = U\Lambda U^TA=UΛUT and yi=UTziy_i = U^Tz_iyi​=UTzi​. If ∣1M∑iyij2−1∣≤ϵ|\frac1M\sum_i y_{ij}^2 - 1| \le \epsilon∣M1​∑i​yij2​−1∣≤ϵ for every jjj with λj≠0\lambda_j \ne 0λj​=0, then ∣HM−trace(A)∣≤ϵ trace(A)|H_M - \mathrm{trace}(A)| \le \epsilon\,\mathrm{trace}(A)∣HM​−trace(A)∣≤ϵtrace(A). This step is deterministic.
  3. Lemma 2.1 (Hutchinson). E(zTAz)=trace(A)\mathrm{E}(z^TAz) = \mathrm{trace}(A)E(zTAz)=trace(A), and for symmetric AAA, Var(zTAz)=2(∥A∥F2−∑iAii2)\mathrm{Var}(z^TAz) = 2(\|A\|_F^2 - \sum_i A_{ii}^2)Var(zTAz)=2(∥A∥F2​−∑i​Aii2​).

Significance

Theorem 7.1 gives a practitioner an explicit number of matrix–vector products after which Hutchinson's method is guaranteed to reach relative accuracy ϵ\epsilonϵ with confidence 1−δ1-\delta1−δ. No bound was available before, although the method had been in wide use for two decades. The bound exceeds the one the same paper proves for Gaussian test vectors (20ϵ−2ln⁡(2/δ)20\epsilon^{-2}\ln(2/\delta)20ϵ−2ln(2/δ)) by a ln⁡(rank(A))\ln(\mathrm{rank}(A))ln(rank(A)) factor. The authors conjecture that this factor is not needed. Later work removed it: Roosta-Khorasani and Ascher (2015) proved a rank-free bound for the Rademacher case, and Cortinovis and Kressner (2022) extended sample bounds to indefinite matrices. Sample bounds of this type underlie variance-reduced estimators such as Hutch++ (Meyer et al. 2021).

The theorem is proved in the literature. To the platform's knowledge it has no machine-checked proof. Formalizing it produces a checked Rademacher concentration inequality for averages of squared linear forms (Achlioptas' lemma, which is also a core lemma of database-friendly Johnson–Lindenstrauss projections), and a checked spectral reduction from a quadratic-form estimator to its eigen-directions. Neither is currently in Mathlib.

Difficulty

The estimator is not an average of independent copies of a bounded variable with a small range: a single sample zTAzz^TAzzTAz can deviate from trace(A)\mathrm{trace}(A)trace(A) by an amount comparable to ∥A∥Fn\|A\|_F\sqrt n∥A∥F​n​. Chebyshev's inequality with the variance of Lemma 2.1 only gives a polynomial dependence on 1/δ1/\delta1/δ. Hoeffding's inequality applied to zTAzz^TAzzTAz directly gives a dependence on nnn and on the size of the entries of AAA. Unlike the Gaussian case, the estimator cannot be written as a weighted sum of independent chi-squared variables, because rotating a Rademacher vector does not give another Rademacher vector. The central difficulty is Lemma 7.2: a tail bound for (αTz)2(\alpha^Tz)^2(αTz)2 that holds uniformly over every unit direction α\alphaα, including directions in which αTz\alpha^TzαTz is far from Gaussian (for α=e1\alpha = e_1α=e1​ it is a constant).

Formalization scope

Matrices are Matrix (Fin n) (Fin n) ℝ, and positive semi-definiteness is Matrix.PosSemidef. The Rademacher law is 12(δ1+δ−1)\tfrac12(\delta_1 + \delta_{-1})21​(δ1​+δ−1​) on ℝ. The sample space is Fin M → Fin n → ℝ with the product of MnMnMn copies of this law (hutchinsonSampleMeasure), so the law of the estimator is constructed, not assumed. HM(ω)=(M:R)−1∑iωi⋅(Aωi)H_M(\omega) = (M:\mathbb{R})^{-1}\sum_i \omega_i\cdot(A\omega_i)HM​(ω)=(M:R)−1∑i​ωi​⋅(Aωi​). Probabilities are Measure.real, and the (ϵ,δ)(\epsilon,\delta)(ϵ,δ)-approximator is Definition 4.1 verbatim. rank(A)\mathrm{rank}(A)rank(A) is Matrix.rank. In Lemma 7.2 the i.i.d. copies QiQ_iQi​ are the functions (α⋅zi)2(\alpha\cdot z_i)^2(α⋅zi​)2 on this product space.

Corrections of printed statements, each recorded in the item's Formalization Note:

  • Theorem 7.1 is printed without a range on ϵ\epsilonϵ. Its proof needs M2(ϵ22−ϵ33)≥Mϵ26\frac{M}{2}(\frac{\epsilon^2}{2} - \frac{\epsilon^3}{3}) \ge \frac{M\epsilon^2}{6}2M​(2ϵ2​−3ϵ3​)≥6Mϵ2​, which holds exactly when ϵ≤1/2\epsilon \le 1/2ϵ≤1/2. Without a range the printed statement is false: take A=1n11TA = \frac1n\mathbf 1\mathbf 1^TA=n1​11T, n=104n = 10^4n=104, ϵ=10\epsilon = 10ϵ=10 and δ=10−4\delta = 10^{-4}δ=10−4. The condition admits M=1M = 1M=1, while Pr⁡(H1>11)≈9⋅10−4>δ\Pr(H_1 > 11) \approx 9\cdot10^{-4} > \deltaPr(H1​>11)≈9⋅10−4>δ. The goal and milestone 2 are therefore stated for 0<ϵ≤1/20 < \epsilon \le 1/20<ϵ≤1/2.
  • Lemma 2.1 is printed for an arbitrary n×nn\times nn×n matrix. The variance formula fails for non-symmetric AAA: for A=(0100)A = \begin{pmatrix}0&1\\0&0\end{pmatrix}A=(00​10​) the variance is 111, not 222. Symmetry is assumed for the variance part only.
  • Proof of Theorem 7.1. The proof writes Λ=UAUT\Lambda = UAU^TΛ=UAUT together with yi=UTziy_i = U^Tz_iyi​=UTzi​. These fit together only for A=UΛUTA = U\Lambda U^TA=UΛUT, which is the convention of milestone 3.

For A=0A = 0A=0 the threshold involves ln⁡0\ln 0ln0. Lean's Real.log 0 = 0 turns the condition into M≥0M \ge 0M≥0, which agrees with the paper's reading ln⁡0=−∞\ln 0 = -\inftyln0=−∞. The conclusion then holds because HM=trace(A)=0H_M = \mathrm{trace}(A) = 0HM​=trace(A)=0, so no extra hypothesis is added. A formalization that took the law of the samples as a hypothesis could make that hypothesis unsatisfiable and the theorem vacuous; the constructed product space rules this out.

A complete development needs:

  • the product Rademacher measure and moment generating functions of Rademacher sums;
  • a Chernoff bound for averages of i.i.d. bounded variables on a product space;
  • the spectral theorem for real symmetric matrices, with rank equal to the number of nonzero eigenvalues;
  • a finite union bound.

The Rademacher concentration results are reusable beyond this mission. Proofs of any milestone are welcome, as are alternative proofs of Lemma 7.2.

Selected references

  • H. Avron and S. Toledo, Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix, Journal of the ACM 58(2), Article 8, 2011. https://doi.org/10.1145/1944345.1944349
  • M. F. Hutchinson, A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines, Communications in Statistics – Simulation and Computation 18(3), 1059–1076, 1989. https://doi.org/10.1080/03610918908812806
  • D. Achlioptas, Database-friendly random projections, Proceedings of PODS 2001, 274–281. https://doi.org/10.1145/375551.375608
  • F. Roosta-Khorasani and U. Ascher, Improved bounds on sample size for implicit matrix trace estimators, Foundations of Computational Mathematics 15, 1187–1212, 2015. https://doi.org/10.1007/s10208-014-9220-1
  • A. Cortinovis and D. Kressner, On randomized trace estimates for indefinite matrices with an application to determinants, Foundations of Computational Mathematics 22, 875–903, 2022. https://doi.org/10.1007/s10208-021-09525-9
  • R. A. Meyer, C. Musco, C. Musco and D. P. Woodruff, Hutch++: Optimal stochastic trace estimation, SOSA 2021, 142–155. https://doi.org/10.1137/1.9781611976496.16
7 thms3 active usersReviewed
🏆Completed
Numerical AnalysisProbabilityRandom Matrix Theory·Captain: mikedeng1

Randomized Algorithms for Estimating the Trace of an Implicit Symmetric Positive Semi-Definite Matrix II: Exact Rank of a Projection Matrix from the Gaussian Trace EstimatorResearch Paper

Motivation

Many matrices in scientific computing are available only implicitly: one can multiply a vector by AAA, for instance by solving a linear system or applying a matrix function, but the entries of AAA are never formed. Quantities such as the trace must then be estimated from a small number of matrix–vector products. Randomized trace estimators do exactly this: draw random vectors zzz, compute the quadratic forms zTAzz^TAzzTAz, and average.

Avron and Toledo (J. ACM 58(2), 2011) gave the first sample bounds of the form "MMM samples suffice for relative error ϵ\epsilonϵ with probability 1−δ1-\delta1−δ" for the standard estimators. Among their results is a case in which the estimate is not merely approximate but exact: when AAA is a projection matrix, its trace equals its rank, an integer, and rounding a Gaussian trace estimate recovers that integer with high probability. Computing the rank of a projection arises, for example, when charge densities are computed in electronic structure calculations without diagonalization (Bekas, Kokiopoulou and Saad 2007).

Setting

Let n≥1n \ge 1n≥1 and A∈Rn×nA \in \mathbb{R}^{n\times n}A∈Rn×n. A projection matrix here is an orthogonal projection: AAA is symmetric and A2=AA^2 = AA2=A. Equivalently, AAA is symmetric and every eigenvalue of AAA is 000 or 111; its rank rank(A)\mathrm{rank}(A)rank(A) is the number of eigenvalues equal to 111.

Fix a number of samples M≥1M \ge 1M≥1. Let z1,…,zM∈Rnz_1,\ldots,z_M \in \mathbb{R}^nz1​,…,zM​∈Rn be random vectors whose MnMnMn entries are independent standard normal random variables. The Gaussian trace estimator (Definition 3.1 of the paper) is

GM=1M∑i=1MziTAzi.G_M = \frac{1}{M}\sum_{i=1}^{M} z_i^T A z_i .GM​=M1​i=1∑M​ziT​Azi​.

Its expectation is trace(A)\mathrm{trace}(A)trace(A). For x∈Rx \in \mathbb{R}x∈R, round(x)\mathrm{round}(x)round(x) denotes the nearest integer to xxx. For k≥1k \ge 1k≥1, a random variable XXX has the χ2\chi^2χ2 distribution with kkk degrees of freedom, X∼χ2(k)X \sim \chi^2(k)X∼χ2(k), if it has the law of g12+⋯+gk2g_1^2 + \cdots + g_k^2g12​+⋯+gk2​ for independent standard normal g1,…,gkg_1, \ldots, g_kg1​,…,gk​.

Formalization targets

Goal: Lemma 5.3 (p. 8:9)

For a projection matrix AAA, a failure probability δ>0\delta > 0δ>0, and every integer M≥1M \ge 1M≥1 with M≥24 rank(A)ln⁡(2/δ)M \ge 24\,\mathrm{rank}(A)\ln(2/\delta)M≥24rank(A)ln(2/δ),

Pr⁡(round(GM)≠rank(A))≤δ.\Pr\bigl(\mathrm{round}(G_M) \ne \mathrm{rank}(A)\bigr) \le \delta .Pr(round(GM​)=rank(A))≤δ.

The number of samples depends on the rank and on δ\deltaδ only; there is no accuracy parameter, and none on nnn.

Milestones, in the order the proof uses them

  1. Law of MGMMG_MMGM​. MGM∼χ2(M rank(A))MG_M \sim \chi^2(M\,\mathrm{rank}(A))MGM​∼χ2(Mrank(A)).
  2. χ2\chi^2χ2 tail bound (cited by the paper from Li, Hastie and Church 2007). For X∼χ2(k)X \sim \chi^2(k)X∼χ2(k), k≥1k\ge1k≥1 and 0<ϵ≤120 < \epsilon \le \tfrac120<ϵ≤21​,
Pr⁡(∣X−k∣≥ϵk)≤2exp⁡(−kϵ2/6).\Pr(|X - k| \ge \epsilon k) \le 2\exp(-k\epsilon^2/6).Pr(∣X−k∣≥ϵk)≤2exp(−kϵ2/6).
  1. Tail of GMG_MGM​. For rank(A)≥1\mathrm{rank}(A) \ge 1rank(A)≥1 and 0<ϵ≤120 < \epsilon \le \tfrac120<ϵ≤21​,
Pr⁡(∣GM−rank(A)∣≥rank(A)ϵ)≤2exp⁡(−M rank(A)ϵ2/6).\Pr(|G_M - \mathrm{rank}(A)| \ge \mathrm{rank}(A)\epsilon) \le 2\exp(-M\,\mathrm{rank}(A)\epsilon^2/6).Pr(∣GM​−rank(A)∣≥rank(A)ϵ)≤2exp(−Mrank(A)ϵ2/6).
  1. Eq. (2). If moreover M≥6 rank(A)−1ϵ−2ln⁡(2/δ)M \ge 6\,\mathrm{rank}(A)^{-1}\epsilon^{-2}\ln(2/\delta)M≥6rank(A)−1ϵ−2ln(2/δ), then Pr⁡(∣GM−rank(A)∣≥rank(A)ϵ)≤δ\Pr(|G_M - \mathrm{rank}(A)| \ge \mathrm{rank}(A)\epsilon) \le \deltaPr(∣GM​−rank(A)∣≥rank(A)ϵ)≤δ.
  2. Trace of a projection. trace(A)=rank(A)\mathrm{trace}(A) = \mathrm{rank}(A)trace(A)=rank(A).

Significance

The lemma turns a randomized estimator into an exact algorithm with a controlled failure probability: the rank of an implicitly given projection is obtained from O(rank(A)log⁡(1/δ))O(\mathrm{rank}(A)\log(1/\delta))O(rank(A)log(1/δ)) matrix–vector products, independently of the dimension nnn. It is also an instance where the paper's general relative-error bound for the Gaussian estimator (Theorem 5.2, whose sample count grows like ϵ−2\epsilon^{-2}ϵ−2) is improved by exploiting the spectrum of AAA: an absolute error below 12\tfrac1221​ is a relative error ϵ=1/(2 rank(A))\epsilon = 1/(2\,\mathrm{rank}(A))ϵ=1/(2rank(A)), for which the general bound would require a number of samples quadratic in the rank, whereas Lemma 5.3 needs only a linear number.

The result is proved in the paper. The mission produces a machine-checked version of it, together with two pieces of reusable substrate: the exact χ2\chi^2χ2 law of a Gaussian quadratic form in an orthogonal projection, and a two-sided χ2\chi^2χ2 tail bound with explicit constant 1/61/61/6 on the range 0<ϵ≤1/20<\epsilon\le 1/20<ϵ≤1/2. To the best of available knowledge, none of these statements is formalized in Mathlib; a platform mission on the Johnson–Lindenstrauss lemma states a χ2\chi^2χ2 concentration bound with a different exponent, (ϵ2−ϵ3)/4(\epsilon^2-\epsilon^3)/4(ϵ2−ϵ3)/4, on the open range 0<ϵ<1/20<\epsilon<1/20<ϵ<1/2, which does not cover the value ϵ=1/2\epsilon = 1/2ϵ=1/2 needed here when rank(A)=1\mathrm{rank}(A)=1rank(A)=1.

Difficulty

The deterministic part is short; the probabilistic part is not. The step "y=Uzy = Uzy=Uz has independent standard normal entries because UUU is orthogonal" is the rotation invariance of the standard Gaussian measure on Rn\mathbb{R}^nRn, and it must be combined with the independence of the MMM samples to identify the law of a sum of M rank(A)M\,\mathrm{rank}(A)Mrank(A) squares; this is a statement about product measures and pushforwards, not about moments. The χ2\chi^2χ2 tail bound is quoted by the paper without proof. Its constant 1/61/61/6 is not the constant of the usual textbook χ2\chi^2χ2 estimates, and the bound is false outside a restricted range of ϵ\epsilonϵ (see below), so a generic sub-exponential concentration inequality with unspecified constants does not deliver it. Finally, the rounding step requires matching Mathlib's round with the event ∣GM−rank(A)∣<12|G_M - \mathrm{rank}(A)| < \tfrac12∣GM​−rank(A)∣<21​.

Formalization scope

All declarations live in the namespace TraceEstimation.ProjectionRank. Matrices are Matrix (Fin n) (Fin n) ℝ. The sample space of GMG_MGM​ is Fin M → Fin n → ℝ with the product measure Measure.pi (fun _ => Measure.pi (fun _ => gaussianReal 0 1)), so the law of the estimator is constructed, not assumed. Probabilities are Measure.real of events. "Projection matrix" is A.IsHermitian ∧ A * A = A (orthogonal projection); a non-symmetric idempotent also has eigenvalues 000 and 111, but the paper's proof diagonalizes AAA by a unitary matrix, which requires symmetry. round is Mathlib's round : ℝ → ℤ; the rank is Matrix.rank. The χ2\chi^2χ2 distribution is not defined: its role is played by the pushforward of a product of standard normals under g↦∑lgl2g \mapsto \sum_l g_l^2g↦∑l​gl2​.

Corrections of the printed text, both in the χ2\chi^2χ2 tail bound (milestone 2):

  • The paper prints Pr⁡(∣X−k∣≤ϵk)≤2exp⁡(−kϵ2/6)\Pr(|X - k| \le \epsilon k) \le 2\exp(-k\epsilon^2/6)Pr(∣X−k∣≤ϵk)≤2exp(−kϵ2/6). The inner ≤\le≤ is a misprint for ≥\ge≥; the next display applies the bound with ≥\ge≥.
  • The paper gives no range for ϵ\epsilonϵ. The bound fails for ϵ=1\epsilon = 1ϵ=1 and large kkk, since Pr⁡(X≥2k)\Pr(X \ge 2k)Pr(X≥2k) decays like e−k(1−ln⁡2)/2e^{-k(1-\ln 2)/2}e−k(1−ln2)/2, slower than e−k/6e^{-k/6}e−k/6. The mission states it for 0<ϵ≤1/20<\epsilon\le 1/20<ϵ≤1/2, and milestones 3 and 4 inherit that range; the proof uses only ϵ=1/(2 rank(A))≤1/2\epsilon = 1/(2\,\mathrm{rank}(A)) \le 1/2ϵ=1/(2rank(A))≤1/2.

The goal keeps the paper's hypotheses: δ>0\delta > 0δ>0 with no upper bound, and rank(A)=0\mathrm{rank}(A) = 0rank(A)=0 allowed (both are true cases). A statement about the event ∣GM−rank(A)∣<12|G_M - \mathrm{rank}(A)| < \tfrac12∣GM​−rank(A)∣<21​, or Eq. (2) alone, is not the goal; the goal is about round(GM)\mathrm{round}(G_M)round(GM​). The sample measure is a probability measure, so the bound ≤δ\le \delta≤δ is not vacuous.

Contributions welcome beyond the milestones: rotation invariance of the standard Gaussian vector under orthogonal matrices, the moment generating function of χ2(k)\chi^2(k)χ2(k), and the spectral fact trace(A)=rank(A)\mathrm{trace}(A) = \mathrm{rank}(A)trace(A)=rank(A) for idempotents, each reusable well outside this mission.

Selected references

  • H. Avron and S. Toledo, Randomized algorithms for estimating the trace of an implicit symmetric positive semi-definite matrix, Journal of the ACM 58(2), Article 8, 2011. https://doi.org/10.1145/1944345.1944349
  • P. Li, T. Hastie and K. Church, Nonlinear estimators and tail bounds for dimension reduction in l1l_1l1​ using Cauchy random projections, in Learning Theory (COLT 2007), Lecture Notes in Computer Science 4539, Springer, 514–529, 2007 (the version the paper cites); journal version in Journal of Machine Learning Research 8, 2497–2532, 2007, https://jmlr.org/papers/v8/li07b.html
  • C. Bekas, E. Kokiopoulou and Y. Saad, An estimator for the diagonal of a matrix, Applied Numerical Mathematics 57(11–12), 1214–1229, 2007. https://doi.org/10.1016/j.apnum.2007.01.003
  • M. F. Hutchinson, A stochastic estimator of the trace of the influence matrix for Laplacian smoothing splines, Communications in Statistics – Simulation and Computation 19(2), 433–450, 1990. https://doi.org/10.1080/03610919008812866
7 thms3 active usersReviewed
🏆Completed
Control TheoryDynamical SystemsGraph Theory·Captain: mikedeng1

On Controllability of Delayed Boolean Control Networks: Trajectory Controllability Avoiding Forbidden Trajectories Iff the Reduced Transition-Count Matrix Is IrreducibleResearch Paper

Motivation

Boolean networks model gene regulatory networks by giving each gene an on/off value and updating all values synchronously by logical rules (Kauffman, 1969). Adding external Boolean inputs gives Boolean control networks (BCNs), in which a designer (a drug, an intervention) chooses the inputs over time. The basic control-theoretic question is controllability: can the inputs drive the network from any configuration to any other? Cheng and Qi (Automatica 2009) answered it for BCNs using the semi-tensor product of matrices, which rewrites a BCN as a linear recursion on canonical basis vectors.

Biological regulation is not instantaneous: transcription and translation introduce delays, so the next value of a gene can depend on several past values. Lu, Zhong, Ho, Tang and Cao (SIAM J. Control Optim. 2016) study delayed BCNs, in which the update reads the last μ\muμ states, and give criteria for two kinds of controllability, including the case where some configurations are dangerous and must be avoided (in biology, states corresponding to disease). The mission formalizes their criteria.

Setting

Write D={0,1}\mathcal D=\{0,1\}D={0,1}. A state is x=(x1,…,xn)∈Dnx=(x_1,\dots,x_n)\in\mathcal D^nx=(x1​,…,xn​)∈Dn and an input value is u∈Dmu\in\mathcal D^mu∈Dm. Fix μ≥1\mu\ge1μ≥1. The delayed BCN (2.2) is

xi(t+1)=fi(u(t),x(t−μ+1),…,x(t)),i=1,…,n,x_i(t+1)=f_i\big(u(t),x(t-\mu+1),\dots,x(t)\big),\qquad i=1,\dots,n,xi​(t+1)=fi​(u(t),x(t−μ+1),…,x(t)),i=1,…,n,

with arbitrary Boolean functions fi:Dm+μn→Df_i:\mathcal D^{m+\mu n}\to\mathcal Dfi​:Dm+μn→D, collected into one map FFF with x(t+1)=F(u(t),X(t))x(t+1)=F(u(t),X(t))x(t+1)=F(u(t),X(t)). A trajectory is the window X(t)=(x(t−μ+1),…,x(t))X(t)=(x(t-\mu+1),\dots,x(t))X(t)=(x(t−μ+1),…,x(t)) of the last μ\muμ states; its last entry is the current state. One step maps X(t)X(t)X(t) under the input u(t)u(t)u(t) to X(t+1)=(x(t−μ+2),…,x(t+1))X(t+1)=(x(t-\mu+2),\dots,x(t+1))X(t+1)=(x(t−μ+2),…,x(t+1)). A control sequence of length kkk is U=(u(0),…,u(k−1))U=(u(0),\dots,u(k-1))U=(u(0),…,u(k−1)), with inputs chosen freely; y(i)=X(i)y(i)=X(i)y(i)=X(i) denotes the trajectory after iii steps from an initial trajectory y(0)y(0)y(0).

The transition-count matrix QQQ has rows and columns indexed by trajectories: Qb,aQ_{b,a}Qb,a​ is the number of input values uuu taking trajectory aaa to trajectory bbb in one step. For a set CtC_tCt​ of forbidden trajectories, QCtQ_{C_t}QCt​​ is QQQ with the rows and columns of CtC_tCt​ replaced by zeros, and QCt\mathbb Q_{C_t}QCt​​ is QQQ with those rows and columns deleted.

The notions of controllability are:

  • Trajectory controllable (Definition 3.1): from every initial trajectory, every trajectory XdX_dXd​ equals X(k)X(k)X(k) for some k≥1k\ge1k≥1 and some control sequence.
  • Trajectory controllable under CtC_tCt​ (Definition 3.11): for all trajectories a,b∉Cta,b\notin C_ta,b∈/Ct​ there are k≥0k\ge0k≥0 and a control sequence steering y(0)=ay(0)=ay(0)=a to y(k)=by(k)=by(k)=b with y(i)∉Cty(i)\notin C_ty(i)∈/Ct​ for i=0,…,ki=0,\dots,ki=0,…,k.
  • State controllable (Definition 4.1): from every initial trajectory, every state equals x(k)x(k)x(k) for some k>0k>0k>0 and some control sequence.

A real square matrix AAA of size N≥2N\ge2N≥2 is reducible (Definition 3.7) if a simultaneous permutation of rows and columns brings it to block upper-triangular form (A11A120A22)\begin{pmatrix}A_{11}&A_{12}\\0&A_{22}\end{pmatrix}(A11​0​A12​A22​​) with square diagonal blocks; it is irreducible otherwise, so every 1×11\times11×1 matrix is irreducible.

N1(k;ya,yb,Ct)\mathbb N_1(k;y_a,y_b,C_t)N1​(k;ya​,yb​,Ct​) counts the control sequences of length kkk steering yay_aya​ to yby_byb​ while avoiding CtC_tCt​; N2(k;a,bs)\mathbb N_2(k;a,b_s)N2​(k;a,bs​) counts those steering the initial trajectory aaa to x(k)=bsx(k)=b_sx(k)=bs​; Ξμp\Xi^{p}_\muΞμp​ is the set of trajectories with current state ppp.

Formalization targets

Goal: Theorem 3.12

the delayed BCN is trajectory controllable under Ct  ⟺  QCt is irreducible,\text{the delayed BCN is trajectory controllable under } C_t\iff \mathbb Q_{C_t}\ \text{is irreducible},the delayed BCN is trajectory controllable under Ct​⟺QCt​​ is irreducible,

for every μ≥1\mu\ge1μ≥1, nnn, mmm, every update map and every forbidden set CtC_tCt​. It is the most general criterion of the paper.

Milestones

  • Proposition 3.5: for k>0k>0k>0, N1(k;ya,yb,Ct)=ybT(QCt)kya\mathbb N_1(k;y_a,y_b,C_t)=y_b^{\mathsf T}(Q_{C_t})^ky_aN1​(k;ya​,yb​,Ct​)=ybT​(QCt​​)kya​.
  • Remark 3: N1(k;ya,yb)=ybTQkya\mathbb N_1(k;y_a,y_b)=y_b^{\mathsf T}Q^ky_aN1​(k;ya​,yb​)=ybT​Qkya​.
  • Theorem 3.10: trajectory controllable   ⟺  \iff⟺ QQQ irreducible.
  • Theorem 4.3: N2(k;a,bs)=∑b∈ΞμbsbTQka\mathbb N_2(k;a,b_s)=\sum_{b\in\Xi^{b_s}_\mu}b^{\mathsf T}Q^kaN2​(k;a,bs​)=∑b∈Ξμbs​​​bTQka.
  • Theorem 5.1: the same count while avoiding forbidden states CsC_sCs​, with QQQ zeroed on the trajectories containing a state of CsC_sCs​.
  • Corollary 5.3: trajectory controllability implies state controllability.

A supporting item, Lemma 3.9 (corrected form), relates Definition 3.7 to positivity of entries of powers for nonnegative matrices of size at least 2.

Significance

The criteria replace a question about control sequences of unbounded length by a finite test on one nonnegative integer matrix of size 2μn2^{\mu n}2μn. The counting identities give more than a yes/no answer: they enumerate the control sequences achieving a transfer, which is what a designer choosing among interventions needs, and they handle forbidden states by passing to forbidden trajectories.

The results are proved in the paper; none of them has a machine-checked proof. Formalizing them yields a reusable Lean model of delayed (and, for μ=1\mu=1μ=1, ordinary) Boolean control networks defined directly through their dynamics, together with a checked bridge from dynamic reachability to the combinatorics of nonnegative matrices. A formal version also pins down points the printed text leaves loose: Lemma 3.9 as printed is false (it characterizes primitive, not irreducible, matrices), and the two different matrices QCtQ_{C_t}QCt​​ (zeroed) and QCt\mathbb Q_{C_t}QCt​​ (deleted) must not be confused.

Difficulty

The central step is the passage between three objects: reachability under the dynamics, positivity of entries of powers of QQQ, and the block-triangular definition of irreducibility. The counting identity for powers of QQQ is a statement about sequences of inputs, not about paths in a graph, so the bijection between control sequences and weighted walks has to be established with the avoidance constraint carried at every intermediate time, including the endpoints. The equivalence between Definition 3.7 and strong connectivity is the classical graph-theoretic characterization, but it has edge cases the obvious argument misses: a 1×11\times11×1 zero matrix is irreducible by Definition 3.7 yet has no positive power, which is exactly why Definition 3.11 allows k=0k=0k=0 while Definition 3.1 does not. A proof that routes through "some power of QCt\mathbb Q_{C_t}QCt​​ is entrywise positive", following the printed Lemma 3.9, proves a false intermediate statement.

Formalization scope

Conventions committed to in Lean:

  • A state is Fin n → Bool (true is the paper's 1); a trajectory is Fin μ → State n with index 0 the oldest state and index μ−1\mu-1μ−1 the current state; μ≥1\mu\ge1μ≥1 is a standing assumption (NeZero μ); n,m≥0n,m\ge0n,m≥0 are arbitrary and no assumption is placed on the update functions.
  • Matrices are indexed by trajectories rather than by the paper's index jjj of δ2μnj\delta^j_{2^{\mu n}}δ2μnj​. The paper's Q=L⋉12mQ=L\ltimes\mathbf 1_{2^m}Q=L⋉12m​ is obtained by the simultaneous relabelling of Lemma 2.6, and every statement (entries of powers, sums over sets of trajectories, Definition 3.7) is invariant under it. QCt\mathbb Q_{C_t}QCt​​ is indexed by the subtype of allowed trajectories.
  • Irreducibility is Definition 3.7 applied to the matrix with entries cast to R\mathbb RR; it is not Mathlib's Matrix.IsIrreducible, which differs on 1×11\times11×1 matrices.
  • Pinned readings: Definition 3.1 and Definition 4.1 use k≥1k\ge1k≥1; Definition 3.11 uses k≥0k\ge0k≥0; Proposition 3.5, Theorem 4.3 and Theorem 5.1 are stated for k>0k>0k>0 (Proposition 3.5 is false at k=0k=0k=0 when ya=yb∈Cty_a=y_b\in C_tya​=yb​∈Ct​); Remark 3 holds for all k≥0k\ge0k≥0. "Avoiding CsC_sCs​" in Theorem 5.1 means that no state x(i)x(i)x(i), i=1−μ,…,ki=1-\mu,\dots,ki=1−μ,…,k, lies in CsC_sCs​, which is the theorem's own middle term N1(k;a,b,ΞCs)\mathbb N_1(k;a,b,\Xi^{C_s})N1​(k;a,b,ΞCs​). Ξμp\Xi^p_\muΞμp​ is defined semantically by eq. (4.3), since the printed index range in (4.4) is a misprint. Lemma 3.9 is included in corrected form with N≥2N\ge2N≥2.

Controllability is defined through the dynamics and control sequences, never as positivity of entries of powers of QQQ; a formalization that defines reachability by (Qk)b,a>0(Q^k)_{b,a}>0(Qk)b,a​>0 would reduce Theorems 3.10 and 3.12 to library facts and is ruled out.

Needed infrastructure: the correspondence between control sequences and products of entries of QQQ (the core of Proposition 3.5), and the equivalence of Definition 3.7 with strong connectivity of the support graph for nonnegative matrices (Mathlib's Matrix.IsIrreducible, Matrix.isIrreducible_iff_exists_pow_pos and Matrix.pow_apply_pos_iff_nonempty_path cover much of the second part for sizes at least 2). Both are reusable beyond this mission, for ordinary BCNs, probabilistic BCNs and finite automata. Contributions of either piece, or of the semi-tensor-product bridge identifying QQQ with L⋉12mL\ltimes\mathbf 1_{2^m}L⋉12m​, are welcome.

Selected references

  • J. Lu, J. Zhong, D. W. C. Ho, Y. Tang, J. Cao, On Controllability of Delayed Boolean Control Networks, SIAM J. Control Optim. 54(2):475–494, 2016. https://doi.org/10.1137/140991820
  • D. Cheng, H. Qi, Controllability and observability of Boolean control networks, Automatica 45(7):1659–1667, 2009. https://doi.org/10.1016/j.automatica.2009.03.006
  • S. A. Kauffman, Metabolic stability and epigenesis in randomly constructed genetic nets, J. Theoret. Biol. 22(3):437–467, 1969. https://doi.org/10.1016/0022-5193(69)90015-0
  • A. Berman, R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences, SIAM Classics in Applied Mathematics 9, 1994. https://doi.org/10.1137/1.9781611971262
9 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

Approximating Clique-Width and Branch-Width: Well-Linked Sets Certify Clique-WidthResearch Paper

Motivation

Clique-width is a graph parameter introduced by Courcelle and Olariu (Discrete Appl. Math. 101 (2000)) that measures how far a graph is from being built by a few labelled operations. Every problem expressible in monadic second-order logic with quantification over vertices and vertex sets (MSO1_11​) can be solved in linear time on graphs given together with a decomposition of bounded clique-width (Courcelle, Makowsky and Rotics, Theory Comput. Syst. 33 (2000)). Bounded clique-width is more general than bounded tree-width: complete graphs have unbounded tree-width but clique-width 222.

For fixed kkk there was, before this paper, no polynomial-time algorithm that either decides that a graph has clique-width at least k+1k+1k+1 or outputs a decomposition of clique-width bounded by a function of kkk; the best known algorithm, by Johansson (2001), gave width 2klog⁡n2k\log n2klogn. Oum and Seymour (J. Combin. Theory Ser. B 96 (2006)) closed this gap with approximation 23k+2−12^{3k+2}-123k+2−1, through rank-width and a factor-3 approximation for the branch-width of symmetric submodular functions.

Timeline:

  • 1991: Robertson and Seymour introduce branch-width of graphs and hypergraphs (J. Combin. Theory Ser. B 52).
  • 2000: Courcelle and Olariu define clique-width; Courcelle, Makowsky and Rotics solve MSO1_11​ problems on graphs given with a kkk-expression.
  • 2001: Johansson gives a 2klog⁡n2k\log n2klogn approximation.
  • 2006: Oum and Seymour define rank-width, prove rwd(G)≤cwd(G)≤2rwd(G)+1−1\mathrm{rwd}(G) \le \mathrm{cwd}(G) \le 2^{\mathrm{rwd}(G)+1}-1rwd(G)≤cwd(G)≤2rwd(G)+1−1, and give an O(n9log⁡n)O(n^9 \log n)O(n9logn) algorithm that outputs a (23k+2−1)(2^{3k+2}-1)(23k+2−1)-expression or certifies clique-width above kkk.

Setting

All graphs are finite and simple. For a finite set VVV, a function f:2V→Zf : 2^V \to \mathbb{Z}f:2V→Z is submodular if f(X)+f(Y)≥f(X∩Y)+f(X∪Y)f(X)+f(Y) \ge f(X\cap Y)+f(X\cup Y)f(X)+f(Y)≥f(X∩Y)+f(X∪Y) and symmetric if f(X)=f(V∖X)f(X) = f(V\setminus X)f(X)=f(V∖X).

A branch-decomposition of fff is a pair (T,L)(T, L)(T,L) where TTT is a tree with at least two vertices and all degrees at most 333, and LLL is a bijection from VVV onto the leaves of TTT. Removing an edge eee of TTT splits the leaves in two; the width of eee is fff of the set of elements of VVV on one side. The width of (T,L)(T, L)(T,L) is the largest edge width, and the branch-width bw(f)\mathrm{bw}(f)bw(f) is the least width of a branch-decomposition, with bw(f)=f(∅)\mathrm{bw}(f) = f(\emptyset)bw(f)=f(∅) when ∣V∣≤1|V| \le 1∣V∣≤1.

A set W⊆VW \subseteq VW⊆V is well-linked with respect to fff if for every partition (X,Y)(X, Y)(X,Y) of WWW and every ZZZ with X⊆Z⊆V∖YX \subseteq Z \subseteq V\setminus YX⊆Z⊆V∖Y, f(Z)≥min⁡(∣X∣,∣Y∣)f(Z) \ge \min(|X|, |Y|)f(Z)≥min(∣X∣,∣Y∣).

Let A(G)A(G)A(G) be the adjacency matrix of GGG over GF(2)\mathrm{GF}(2)GF(2). For disjoint X,Y⊆V(G)X, Y \subseteq V(G)X,Y⊆V(G), cutrkG∗(X,Y)\mathrm{cutrk}^*_G(X, Y)cutrkG∗​(X,Y) is the rank of the submatrix of A(G)A(G)A(G) with rows XXX and columns YYY, and the cut-rank function is cutrkG(X)=cutrkG∗(X,V(G)∖X)\mathrm{cutrk}_G(X) = \mathrm{cutrk}^*_G(X, V(G)\setminus X)cutrkG​(X)=cutrkG∗​(X,V(G)∖X). The rank-width rwd(G)\mathrm{rwd}(G)rwd(G) is bw(cutrkG)\mathrm{bw}(\mathrm{cutrk}_G)bw(cutrkG​).

A kkk-expression is a term built from constants ⋅i\cdot_i⋅i​ (a vertex with label i∈{1,…,k}i \in \{1,\dots,k\}i∈{1,…,k}), the operators ηi,j\eta_{i,j}ηi,j​ (i≠ji \ne ji=j; add all edges between labels iii and jjj), ρi→j\rho_{i\to j}ρi→j​ (relabel iii into jjj) and disjoint union ⊕\oplus⊕. Its value is the labelled graph it produces; GGG has clique-width cwd(G)≤k\mathrm{cwd}(G) \le kcwd(G)≤k if some kkk-expression has value isomorphic to GGG.

An interpolation of fff is a function f∗f^*f∗ on disjoint pairs (X,Y)(X, Y)(X,Y) that agrees with fff on (X,V∖X)(X, V\setminus X)(X,V∖X), is monotone, submodular in the sense f∗(A,B)+f∗(C,D)≥f∗(A∩C,B∪D)+f∗(A∪C,B∩D)f^*(A,B)+f^*(C,D) \ge f^*(A\cap C, B\cup D) + f^*(A\cup C, B\cap D)f∗(A,B)+f∗(C,D)≥f∗(A∩C,B∪D)+f∗(A∪C,B∩D), and has f∗(∅,∅)=f(∅)f^*(\emptyset,\emptyset)=f(\emptyset)f∗(∅,∅)=f(∅).

Formalization targets

Goal: Theorem 1.1, certificate form

For a graph GGG with at least one vertex and an integer k≥1k \ge 1k≥1:

∃ W, ∣W∣=3k+1, W well-linked for cutrkG  ⟹  cwd(G)≥k+1,\exists\, W,\ |W| = 3k+1,\ W \text{ well-linked for } \mathrm{cutrk}_G \;\Longrightarrow\; \mathrm{cwd}(G) \ge k+1,∃W, ∣W∣=3k+1, W well-linked for cutrkG​⟹cwd(G)≥k+1, ∄ W, ∣W∣=3k+1, W well-linked for cutrkG  ⟹  cwd(G)≤23k+2−1.\nexists\, W,\ |W| = 3k+1,\ W \text{ well-linked for } \mathrm{cutrk}_G \;\Longrightarrow\; \mathrm{cwd}(G) \le 2^{3k+2}-1.∄W, ∣W∣=3k+1, W well-linked for cutrkG​⟹cwd(G)≤23k+2−1.

The same explicit condition decides which side of the approximation holds; this is what the paper's algorithm certifies.

Milestones

  1. Proposition 4.1: properties of an interpolation, including that X↦f∗(X,B)−f(∅)X \mapsto f^*(X, B) - f(\emptyset)X↦f∗(X,B)−f(∅) is a matroid rank function on V∖BV\setminus BV∖B when f({v})−f(∅)≤1f(\{v\}) - f(\emptyset) \le 1f({v})−f(∅)≤1.
  2. Proposition 4.2: fmin⁡(X,Y)=min⁡X⊆Z⊆V∖Yf(Z)f_{\min}(X,Y) = \min_{X\subseteq Z\subseteq V\setminus Y} f(Z)fmin​(X,Y)=minX⊆Z⊆V∖Y​f(Z) is an interpolation.
  3. Theorem 5.1: a well-linked set of size kkk forces bw(f)≥k/3\mathrm{bw}(f) \ge k/3bw(f)≥k/3 (for k≠1k \ne 1k=1).
  4. Theorem 5.2: no well-linked set of size kkk implies bw(f)≤k\mathrm{bw}(f) \le kbw(f)≤k, when f({v})≤1f(\{v\}) \le 1f({v})≤1.
  5. Proposition 6.1: rk M[X1,Y1]+rk M[X2,Y2]≥rk M[X1∪X2,Y1∩Y2]+rk M[X1∩X2,Y1∪Y2]\mathrm{rk}\,M[X_1,Y_1] + \mathrm{rk}\,M[X_2,Y_2] \ge \mathrm{rk}\,M[X_1\cup X_2, Y_1\cap Y_2] + \mathrm{rk}\,M[X_1\cap X_2, Y_1\cup Y_2]rkM[X1​,Y1​]+rkM[X2​,Y2​]≥rkM[X1​∪X2​,Y1​∩Y2​]+rkM[X1​∩X2​,Y1​∪Y2​].
  6. Corollary 6.2: submodularity of cutrkG∗\mathrm{cutrk}^*_GcutrkG∗​ and cutrkG\mathrm{cutrk}_GcutrkG​.
  7. Section 6 claim: cutrkG\mathrm{cutrk}_GcutrkG​ is symmetric submodular and cutrkG∗\mathrm{cutrk}^*_GcutrkG∗​ interpolates it.
  8. Proposition 6.3: rwd(G)≤cwd(G)≤2rwd(G)+1−1\mathrm{rwd}(G) \le \mathrm{cwd}(G) \le 2^{\mathrm{rwd}(G)+1}-1rwd(G)≤cwd(G)≤2rwd(G)+1−1.

Significance

The dichotomy turns clique-width, for which no exact polynomial algorithm is known even for fixed kkk, into a parameter that can be approximated with an explicit witness in each direction. Downstream, every algorithm for graphs of bounded clique-width that needs a kkk-expression as input becomes applicable to graphs given without one, at the cost of an exponential blow-up of the width.

The result is proved in the literature; this mission formalizes it. To our knowledge none of the objects involved — branch-width of set functions, rank-width, cut-rank, kkk-expressions, clique-width — has been formalized in Mathlib, and the submodularity of submatrix rank (Proposition 6.1) is absent from Mathlib's Matrix.rank API. The formal development would give reusable definitions of branch-decompositions of arbitrary integer set functions, of cut-rank, and of clique-width, and a machine-checked link between the combinatorial and the linear-algebraic width parameters.

Difficulty

The upper bound in Theorem 5.2 is the core. The natural approach, growing a branch-decomposition one leaf split at a time while keeping the width at most kkk, gets stuck at a leaf carrying a set BBB with f(B)=kf(B) = kf(B)=k: a split of BBB into two parts of fff-value below kkk has to be found, and it must be found from the failure of well-linkedness of a set that is not obviously related to BBB. The paper's device is the interpolation f∗f^*f∗, which attaches a matroid to BBB whose base has exactly f(B)f(B)f(B) elements. Formalizing this requires handling partial branch-decompositions, their extensions, and a maximality argument over trees, none of which exists in Mathlib.

Proposition 6.3's upper bound is a second, independent difficulty: a rank-decomposition must be converted into a kkk-expression by an induction over a rooted binary tree, with a relabelling argument bounding the number of labels by the number of distinct nonzero rows of a GF(2)\mathrm{GF}(2)GF(2) matrix of rank kkk. Its lower bound needs the tree structure of a kkk-expression to be read as a branch-decomposition.

Formalization scope

The ground set is a Fintype V with DecidableEq V; subsets are Finset V; set functions are Finset V → ℤ, as in the paper. A branch-decomposition is a tree T : SimpleGraph (Fin n) with n≥2n \ge 2n≥2, all neighbour sets of size at most 333, and an injective map LLL from VVV onto the vertices of degree 111; the side of an edge uwuwuw is found by reachability from uuu after deleting uwuwuw. Branch-width, rank-width and clique-width are never computed as minima: "bw(f)≤k\mathrm{bw}(f) \le kbw(f)≤k" is the predicate "∣V∣≤1|V| \le 1∣V∣≤1 and f(∅)≤kf(\emptyset) \le kf(∅)≤k, or a branch-decomposition of width at most kkk exists", lower bounds say that every branch-decomposition has a wide edge, and "cwd(G)≤k\mathrm{cwd}(G) \le kcwd(G)≤k" is "GGG has a kkk-expression". Labels {1,…,k}\{1,\dots,k\}{1,…,k} are Fin k. The value of a kkk-expression has as vertex type the occurrences of constants (a nested sum type), and ηi,j\eta_{i,j}ηi,j​ requires i≠ji \ne ji=j. Cut-rank uses Matrix.rank over ZMod 2 of submatrices of SimpleGraph.adjMatrix. An interpolation is a function on all pairs of subsets whose axioms are imposed on disjoint pairs only.

Running time is not formalized. The paper's Theorem 1.1 asserts an O(n9log⁡n)O(n^9\log n)O(n9logn) algorithm; there is no cost model on the page, and the goal states the certificate the algorithm returns instead. Without the running time, "cwd(G)≥k+1\mathrm{cwd}(G) \ge k+1cwd(G)≥k+1 or cwd(G)≤23k+2−1\mathrm{cwd}(G) \le 2^{3k+2}-1cwd(G)≤23k+2−1" holds for every graph, so that reading is ruled out as a formalization of the goal; so are well-linkedness with respect to anything other than cutrkG\mathrm{cutrk}_GcutrkG​, widths defined by an unguarded infimum (which is 000 on an empty family), kkk-expressions whose value is not the graph up to isomorphism or whose η\etaη may join equal labels, and Theorem 5.1 stated for k=1k = 1k=1.

Correction of Theorem 5.1. As printed, Theorem 5.1 fails for k=1k = 1k=1: a singleton is always well-linked, but the edgeless graph on two vertices has cut-rank identically 000 and branch-width 0<1/30 < 1/30<1/3. The milestone carries the hypothesis k≠1k \ne 1k=1; the goal uses the theorem only at size 3k+1≥43k+1 \ge 43k+1≥4.

The graph with no vertex is excluded from the goal and from the upper bound of Proposition 6.3, since it has no kkk-expression for any kkk. Contributions welcome: proofs of the milestones, lemmas on branch-decompositions (suppressing degree-2 vertices, extending partial decompositions), and submatrix-rank submodularity, which is reusable beyond this mission.

Selected references

  • S. Oum and P. Seymour, Approximating clique-width and branch-width, J. Combin. Theory Ser. B 96 (2006) 514–528. https://doi.org/10.1016/j.jctb.2005.10.006
  • B. Courcelle and S. Olariu, Upper bounds to the clique width of graphs, Discrete Appl. Math. 101 (2000) 77–114. https://doi.org/10.1016/S0166-218X(99)00184-5
  • B. Courcelle, J. A. Makowsky and U. Rotics, Linear time solvable optimization problems on graphs of bounded clique-width, Theory Comput. Syst. 33 (2000) 125–150. https://doi.org/10.1007/s002249910009
  • N. Robertson and P. D. Seymour, Graph minors. X. Obstructions to tree-decomposition, J. Combin. Theory Ser. B 52 (1991) 153–190. https://doi.org/10.1016/0095-8956(91)90061-N
14 thms3 active usersReviewed
🏆Completed
CombinatoricsTheoretical Computer Science·Captain: mikedeng1

Sparse Approximate Solutions to Linear Systems 2: An Exact Cover by 3-Sets Exists iff Its Incidence System Has a 1/2-Approximate Solution with at Most m/3 NonzerosResearch Paper

Motivation

Many problems in signal processing, statistics and function interpolation ask for a solution of a linear system Ax≈bAx\approx bAx≈b that uses as few columns of AAA as possible: a sparse approximate solution. Natarajan's 1995 paper Sparse Approximate Solutions to Linear Systems (SIAM J. Comput. 24(2):227–234) was motivated by radial basis interpolation, where each column corresponds to a basis function and fewer columns mean a cheaper interpolant. The paper does two things. It proves that finding the sparsest approximate solution is computationally hard (§2, Theorem 1), and it analyses a greedy column-selection algorithm whose number of chosen columns is within a factor, depending on the conditioning of AAA, of the optimum (§3, Theorem 2; a separate mission of this series).

The hardness theorem is the reason the second half of the paper exists: once exact minimization is ruled out, one settles for approximation guarantees. It is cited throughout the compressed-sensing literature as the canonical statement that ℓ0\ell_0ℓ0​-minimization under an ℓ2\ell_2ℓ2​ error constraint is NP-hard, and is the starting point for the later theory of when convex relaxations recover sparse solutions.

The argument follows the classical reduction from Exact Cover by 3-sets (X3C) to minimum-weight solutions of linear systems in Garey and Johnson (1979), pp. 221 and 246, adapted to an approximate right-hand side.

Setting

Sparse approximate solution (SAS). Given a matrix A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n, a vector b∈Rmb\in\mathbb R^mb∈Rm and a tolerance ε>0\varepsilon>0ε>0, find a vector x∈Rnx\in\mathbb R^nx∈Rn with ∥Ax−b∥2≤ε\|Ax-b\|_2\le\varepsilon∥Ax−b∥2​≤ε whose number of nonzero entries, written ∥x∥0=∣{j:xj≠0}∣\|x\|_0=|\{j : x_j\neq0\}|∥x∥0​=∣{j:xj​=0}∣, is as small as possible. Here ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is the Euclidean norm.

Exact Cover by 3-sets (X3C). An instance is a ground set S={s1,…,sm}S=\{s_1,\dots,s_m\}S={s1​,…,sm​} and a list C=c1,…,cnC=c_1,\dots,c_nC=c1​,…,cn​ of subsets of SSS, each with exactly three elements. An exact cover is a sub-collection C^={cj:j∈J}\hat C=\{c_j : j\in J\}C^={cj​:j∈J}, J⊆{1,…,n}J\subseteq\{1,\dots,n\}J⊆{1,…,n}, such that every element of SSS occurs in exactly one set of C^\hat CC^.

The transformation. From an X3C instance build the SAS instance with

  • the incidence matrix A∈Rm×nA\in\mathbb R^{m\times n}A∈Rm×n: Aij=1A_{ij}=1Aij​=1 if si∈cjs_i\in c_jsi​∈cj​ and Aij=0A_{ij}=0Aij​=0 otherwise, so column jjj is the characteristic vector of cjc_jcj​;
  • the all-ones vector b=(1,1,…,1)∈Rmb=(1,1,\dots,1)\in\mathbb R^mb=(1,1,…,1)∈Rm;
  • the tolerance ε=12\varepsilon=\tfrac12ε=21​.

In Lean, SSS is Fin m, the collection is C : Fin n → Finset (Fin m) with hC : ∀ j, (C j).card = 3, an exact cover is an index set J with IsExactCover C J, the matrix is incidence C, the vector bbb is onesVec m, AxAxAx is Matrix.toEuclideanLin (incidence C) x, and ∥x∥0\|x\|_0∥x∥0​ is nnz x.

Formalization targets

Goal: correctness of the reduction

For every X3C instance (S,C)(S,C)(S,C) as above,

(∃J, {cj}j∈J is an exact cover of S)  ⟺  (∃x∈Rn, ∥Ax−b∥2≤12 and 3 ∥x∥0≤m).\bigl(\exists J,\ \{c_j\}_{j\in J}\text{ is an exact cover of }S\bigr)\iff\bigl(\exists x\in\mathbb R^n,\ \|Ax-b\|_2\le\tfrac12\ \text{and}\ 3\,\|x\|_0\le m\bigr).(∃J, {cj​}j∈J​ is an exact cover of S)⟺(∃x∈Rn, ∥Ax−b∥2​≤21​ and 3∥x∥0​≤m).

This is the sentence the proof of Theorem 1 (p. 228) establishes: "the constructed instance of SAS has a solution with m/3m/3m/3 or fewer entries if and only if the given instance of X3C has a solution."

Milestones

  1. Forward direction. If {cj}j∈J\{c_j\}_{j\in J}{cj​}j∈J​ is an exact cover, the indicator vector x=1Jx=\mathbf 1_Jx=1J​ satisfies Ax=bAx=bAx=b and 3∥x∥0=m3\|x\|_0=m3∥x∥0​=m.
  2. Entry bounds. For every xxx with ∥Ax−b∥2≤12\|Ax-b\|_2\le\frac12∥Ax−b∥2​≤21​, each entry of AxAxAx lies in [12,32][\frac12,\frac32][21​,23​].
  3. Lower bound on sparsity. For every such xxx, m≤3∥x∥0m\le3\|x\|_0m≤3∥x∥0​.
  4. Exact cover from a sparse solution. If moreover 3∥x∥0≤m3\|x\|_0\le m3∥x∥0​≤m, the sets cjc_jcj​ with xj≠0x_j\neq0xj​=0 form an exact cover.

Significance

The result. The equivalence shows that deciding whether a sparse approximate solution with a prescribed number of nonzeros exists is at least as hard as X3C, which is NP-complete. Consequently no polynomial-time algorithm computes the optimum of SAS unless P = NP, and approximation algorithms such as the greedy method of §3 are the natural object of study. The same instance shows hardness persists for 0/1 matrices, a right-hand side of all ones and a constant tolerance, so the difficulty does not come from ill-conditioned data or from vanishing precision.

Formalizing it. The reduction is proved in the paper; this mission produces a machine-checked proof of its correctness, the combinatorial core of every NP-hardness claim for ℓ0\ell_0ℓ0​-constrained least squares. No prior machine-checked version is known to exist, on the platform or elsewhere. The complexity-theoretic wrapper is out of scope (see below).

Difficulty

The forward direction is a direct computation. The converse contains the only real step, which the paper passes over with "it is clear". From ∥Ax−b∥2≤12\|Ax-b\|_2\le\frac12∥Ax−b∥2​≤21​ one gets only that every entry of AxAxAx is in [12,32][\frac12,\frac32][21​,23​]; the entries of xxx themselves are arbitrary reals, possibly negative or not equal to 111, so xxx need not be an indicator vector and Ax=bAx=bAx=b need not hold. The exact-cover property must therefore be extracted from support sizes alone: every element is covered by some column in the support, the support has at most m/3m/3m/3 columns of three elements each, and a counting argument forces the chosen sets to be pairwise disjoint. Reading off a cover from the values of xxx (for instance, taking the jjj with xj=1x_j=1xj​=1) does not work.

Formalization scope

  • Vectors live in EuclideanSpace ℝ (Fin m) and EuclideanSpace ℝ (Fin n), so ‖·‖ is the paper's ∥⋅∥2\|\cdot\|_2∥⋅∥2​. Using the sup norm of Fin m → ℝ would give a different statement.
  • The tolerance is exactly ε=12\varepsilon=\frac12ε=21​, as printed.
  • The collection is indexed, C : Fin n → Finset (Fin m): repeated sets are allowed and are distinct indices; an exact cover is a set of indices, and on the SAS side one nonzero entry is counted per index, so both sides treat duplicates consistently.
  • "m/3m/3m/3 or fewer" is written 3∥x∥0≤m3\|x\|_0\le m3∥x∥0​≤m, never with natural-number division. With this form the equivalence holds for every mmm (both sides are false when 3∤m3\nmid m3∤m), which absorbs the paper's "without loss of generality mmm is a multiple of 3"; no divisibility hypothesis is assumed. For m=0m=0m=0 both sides are true.
  • The hypothesis that every set has exactly three elements is essential for the converse (with m=9m=9m=9, O={s3,…,s9}O=\{s_3,\dots,s_9\}O={s3​,…,s9​}, c1={s1}∪Oc_1=\{s_1\}\cup Oc1​={s1​}∪O, c2={s2}∪Oc_2=\{s_2\}\cup Oc2​={s2​}∪O, c3=Oc_3=Oc3​=O, the vector x=(1,1,−1)x=(1,1,-1)x=(1,1,−1) solves Ax=bAx=bAx=b with 3∥x∥0=m3\|x\|_0=m3∥x∥0​=m, yet CCC has no exact cover since c1c_1c1​ and c2c_2c2​ must both be chosen) and is kept as hC.
  • Not formalized: the infinite-precision RAM machine model, polynomial-time many-one reductions, polynomial-time computability of the transformation (evident: an m×nm\times nm×n 0/1 matrix), and the NP-completeness of X3C (cited by the paper from Garey–Johnson). The goal is therefore the correctness of the transformation, not a statement titled "SAS is NP-hard". A statement that only records the forward direction, or that fixes xxx to be a 0/1 vector on the SAS side, would trivialize the converse and is not the target.
  • Tools a solver will need are in Mathlib: coordinate bounds for the Euclidean norm (PiLp.norm_apply_le), Finset.card_biUnion_le, and Finset.card_biUnion for disjoint unions. Contributions of a reusable exact-cover API, or of a polynomial-time reduction framework that could later wrap this equivalence into an NP-hardness theorem, are welcome.

Selected references

  • B. K. Natarajan, Sparse Approximate Solutions to Linear Systems, SIAM Journal on Computing 24(2):227–234, 1995. https://doi.org/10.1137/s0097539792240406
  • M. R. Garey and D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979 (X3C: problem [SP2], p. 221; minimum weight solution to linear equations: [MP5], p. 246).
  • F. P. Preparata and M. I. Shamos, Computational Geometry: An Introduction, Springer, 1985 (the real RAM model). https://doi.org/10.1007/978-1-4612-1098-6
6 thms3 active usersReviewed
🏆Completed
Control TheoryConvex OptimizationNumerical Analysis+2·Captain: mikedeng1

Robust Solutions to Least-Squares Problems with Uncertain Data IV: A Semidefinite Upper Bound on the Linear-Fractional Worst-Case Residual, Exact for Full PerturbationsResearch Paper

Motivation

Least-squares fitting is a standard tool in estimation, identification and data analysis, and its data AAA, bbb are rarely known exactly. El Ghaoui and Lebret (SIAM J. Matrix Anal. Appl. 18(4), 1997) proposed to choose xxx to minimize the worst-case residual over a set of admissible data perturbations. Earlier missions of this series treat unstructured perturbations of [A b][A\ b][A b] and perturbations affine in a parameter vector. §5 of the paper covers a more general model, taken from robust identification (Doyle et al.): the perturbed data depend on an uncertain matrix Δ\DeltaΔ through a linear-fractional transformation. This form covers rational dependence of the data on uncertain parameters, max-norm bounds on independent parameters, and data matrices with some columns known exactly (pp. 1046–1047).

In this generality, deciding whether the worst-case residual is finite is NP-complete, and computing it is NP-hard even when the dependence is affine (§5.3, Lemma 5.1). Theorem 5.2 gives the tractable replacement: a semidefinite program whose value bounds the worst-case residual from above, and equals it when the perturbation is unstructured. The main tool is a structured form of the S-procedure. Robust control uses the same tool, with the scalings SSS and GGG below, to bound the real structured singular value (Fan, Tits and Doyle, 1991).

Setting

Vectors carry the Euclidean norm ∥v∥\|v\|∥v∥. For a matrix XXX, ∥X∥\|X\|∥X∥ is its largest singular value (operator norm between Euclidean spaces). Let D\mathcal DD be a linear subspace of RN×N\mathbb R^{N\times N}RN×N (the perturbation structure), and fix A∈Rn×mA \in \mathbb R^{n\times m}A∈Rn×m, b∈Rnb \in \mathbb R^nb∈Rn, L∈Rn×NL \in \mathbb R^{n\times N}L∈Rn×N, RA∈RN×mR_A \in \mathbb R^{N\times m}RA​∈RN×m, Rb∈RNR_b \in \mathbb R^NRb​∈RN, D∈RN×ND \in \mathbb R^{N\times N}D∈RN×N. For Δ∈D\Delta \in \mathcal DΔ∈D with det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 the perturbed data are

A(Δ)=A+LΔ(I−DΔ)−1RA,b(Δ)=b+LΔ(I−DΔ)−1Rb.A(\Delta) = A + L\Delta(I - D\Delta)^{-1}R_A, \qquad b(\Delta) = b + L\Delta(I - D\Delta)^{-1}R_b .A(Δ)=A+LΔ(I−DΔ)−1RA​,b(Δ)=b+LΔ(I−DΔ)−1Rb​.

With the normalization ρ=1\rho = 1ρ=1 (the paper's, with no loss of generality), the worst-case residual of x∈Rmx \in \mathbb R^mx∈Rm is

rD(A,b,x)=max⁡Δ∈D, ∥Δ∥≤1∥A(Δ)x−b(Δ)∥r_{\mathcal D}(A,b,x) = \max_{\Delta \in \mathcal D,\ \|\Delta\| \le 1} \|A(\Delta)x - b(\Delta)\|rD​(A,b,x)=Δ∈D, ∥Δ∥≤1max​∥A(Δ)x−b(Δ)∥

if det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 for every such Δ\DeltaΔ, and +∞+\infty+∞ otherwise (35). The commutant scalings are S={S=ST:SΔ=ΔS ∀Δ∈D}\mathcal S = \{S = S^T : S\Delta = \Delta S\ \forall \Delta \in \mathcal D\}S={S=ST:SΔ=ΔS ∀Δ∈D} and G={G=−GT:GΔ=ΔG ∀Δ∈D}\mathcal G = \{G = -G^T : G\Delta = \Delta G\ \forall \Delta \in \mathcal D\}G={G=−GT:GΔ=ΔG ∀Δ∈D} (37). The SDP constraint is

F(λ,S,G,x)=[ΘAx−bRAx−Rb(Ax−b)T(RAx−Rb)Tλ]≻0,Θ=[λI−LSLT−LSDT+LG−DSLT+GTLTS+DG−GDT−DSDT].(38),(39)\mathcal F(\lambda,S,G,x) = \begin{bmatrix} \Theta & \begin{matrix} Ax - b \\ R_Ax - R_b\end{matrix} \\ \begin{matrix}(Ax-b)^T & (R_Ax - R_b)^T\end{matrix} & \lambda\end{bmatrix} \succ 0, \quad \Theta = \begin{bmatrix} \lambda I - LSL^T & -LSD^T + LG \\ -DSL^T + G^TL^T & S + DG - GD^T - DSD^T\end{bmatrix}. \qquad (38),(39)F(λ,S,G,x)=​Θ(Ax−b)T​(RA​x−Rb​)T​​Ax−bRA​x−Rb​​λ​​≻0,Θ=[λI−LSLT−DSLT+GTLT​−LSDT+LGS+DG−GDT−DSDT​].(38),(39)

Formalization targets

Goal: Theorem 5.2 (corrected)

For all xxx and λ\lambdaλ:

(a)S∈S, G∈G, S≻0, GΔ skew ∀Δ∈D, F(λ,S,G,x)≻0 ⟹ λ>rD(A,b,x);\text{(a)}\quad S \in \mathcal S,\ G \in \mathcal G,\ S \succ 0,\ G\Delta \text{ skew } \forall \Delta \in \mathcal D,\ \mathcal F(\lambda,S,G,x) \succ 0 \ \Longrightarrow\ \lambda > r_{\mathcal D}(A,b,x);(a)S∈S, G∈G, S≻0, GΔ skew ∀Δ∈D, F(λ,S,G,x)≻0 ⟹ λ>rD​(A,b,x); (b)D=RN×N, λ>rD(A,b,x) ⟹ ∃s>0: F(λ,sI,0,x)≻0.\text{(b)}\quad \mathcal D = \mathbb R^{N\times N},\ \lambda > r_{\mathcal D}(A,b,x) \ \Longrightarrow\ \exists s > 0:\ \mathcal F(\lambda, sI, 0, x) \succ 0 .(b)D=RN×N, λ>rD​(A,b,x) ⟹ ∃s>0: F(λ,sI,0,x)≻0.

Part (a) says the value of the SDP inf⁡{λ:(λ,S,G) feasible}\inf\{\lambda : (\lambda, S, G) \text{ feasible}\}inf{λ:(λ,S,G) feasible} (40) is an upper bound on rDr_{\mathcal D}rD​. Part (b) says this upper bound is exact for full perturbations, including the case rD=∞r_{\mathcal D} = \inftyrD​=∞, where (40) is infeasible.

Milestones

  1. Lemma 2.2, both directions: the full-block S-procedure. det⁡(I−T4Δ)≠0\det(I - T_4\Delta) \ne 0det(I−T4​Δ)=0 and T(Δ)⪰0T(\Delta) \succeq 0T(Δ)⪰0 for all ∥Δ∥≤1\|\Delta\| \le 1∥Δ∥≤1 if and only if ∥T4∥<1\|T_4\| < 1∥T4​∥<1 and a one-scalar LMI (10) holds (the "only if" under T2≠0T_2 \ne 0T2​=0 or T3=0T_3 = 0T3​=0).
  2. Lemma 2.3: sufficiency of the scaled LMI for a structured D\mathcal DD, and its strict necessity for D=RN×N\mathcal D = \mathbb R^{N\times N}D=RN×N.
  3. §5.4, p. 1047: λ>rD(A,b,x)\lambda > r_{\mathcal D}(A,b,x)λ>rD​(A,b,x) if and only if a linear-fractional matrix function of Δ\DeltaΔ is positive definite on the structured unit ball.
  4. §5.4, (38)–(39): the certificate (a) in the paper's own words.

Significance

The worst-case residual under linear-fractional uncertainty cannot be computed efficiently unless P = NP. Theorem 5.2 gives an SDP-computable upper bound with an explicit certificate (S,G)(S, G)(S,G). Since xxx enters (38) linearly, the same constraint can also be optimized over xxx (Theorem 5.3, not part of this mission). For D=RN×N\mathcal D = \mathbb R^{N\times N}D=RN×N the bound is exact, which covers the model [A(Δ) b(Δ)]=[A b]+LΔ[RA Rb][A(\Delta)\ b(\Delta)] = [A\ b] + L\Delta[R_A\ R_b][A(Δ) b(Δ)]=[A b]+LΔ[RA​ Rb​] and, as a special case, the unstructured problem of §3.

The results are proved in the paper (the proof of Theorem 5.2 is only indicated, through Appendix C). No machine-checked version of these statements, of Lemma 2.2 or of the structured S-procedure with commutant scalings is known. The formalization also fixes the statements. As printed, Lemma 2.2's "only if", Lemma 2.3 and the upper bound of Theorem 5.2 are each false in a boundary or structural case (see Formalization scope). The corrected forms stated here are the ones the paper's proofs support.

Difficulty

Part (a) reduces to robust positivity of a linear-fractional matrix function, and the difficulty is the inverse (I−DΔ)−1(I - D\Delta)^{-1}(I−DΔ)−1. The certificate is one LMI in which Δ\DeltaΔ does not appear, while the conclusion is about a rational function of Δ\DeltaΔ over a whole structured ball. The certificate also has to guarantee that I−DΔI - D\DeltaI−DΔ is invertible everywhere on that ball, and not only that the residual is small where it is defined. Evaluating F\mathcal FF at a single point does not show this. Part (b) needs a lossless S-procedure in its strict form. The standard (non-strict) S-lemma gives only ⪰\succeq⪰, and the gap between strict and non-strict inequalities is exactly where the printed statements fail. The degenerate case T2=0T_2 = 0T2​=0 is not covered by the S-lemma's regularity condition and has to be handled separately.

Formalization scope

  • Dimensions are Fin n, Fin m, Fin N; D\mathcal DD is a Submodule ℝ (Matrix (Fin N) (Fin N) ℝ), with D=RN×N\mathcal D = \mathbb R^{N\times N}D=RN×N as ⊤. The Euclidean norm is written out, because ‖·‖ on Fin n → ℝ is the sup norm. ∥Δ∥\|\Delta\|∥Δ∥ is the operator norm of Matrix.toEuclideanLin Δ, the largest singular value.
  • λ>rD(A,b,x)\lambda > r_{\mathcal D}(A,b,x)λ>rD​(A,b,x) is the predicate ResidualBelow: every Δ∈D\Delta \in \mathcal DΔ∈D with ∥Δ∥≤1\|\Delta\| \le 1∥Δ∥≤1 has det⁡(I−DΔ)≠0\det(I - D\Delta) \ne 0det(I−DΔ)=0 and residual <λ< \lambda<λ. It is false for every λ\lambdaλ when rD=∞r_{\mathcal D} = \inftyrD​=∞. No real-valued supremum is used, so the ∞\infty∞ branch of (35) cannot turn into a default 000. Matrix inverses are Mathlib's Matrix.inv, and every use carries the determinant condition.
  • ρ=1\rho = 1ρ=1 throughout, as in the paper; general ρ\rhoρ follows by scaling Δ\DeltaΔ.
  • Corrections of the printed statements. (i) (40) must require S≻0S \succ 0S≻0. Without it, N=n=m=1N = n = m = 1N=n=m=1, D=2D = 2D=2, L=1L = 1L=1, A=b=RA=Rb=0A = b = R_A = R_b = 0A=b=RA​=Rb​=0, x=0x = 0x=0, S=−1S = -1S=−1, G=0G = 0G=0 satisfy (38) for every λ>1/3\lambda > 1/3λ>1/3, while rD=∞r_{\mathcal D} = \inftyrD​=∞. (ii) GGG must make GΔG\DeltaGΔ skew-symmetric for every Δ∈D\Delta \in \mathcal DΔ∈D, which is the identity pTGq=0p^TGq = 0pTGq=0 used in the proof of Lemma 2.3. For D=span⁡{I,J}\mathcal D = \operatorname{span}\{I, J\}D=span{I,J}, J=[01−10]J = \begin{bmatrix}0&1\\-1&0\end{bmatrix}J=[0−1​10​], the printed bound certifies λ=3/2\lambda = 3/2λ=3/2 for an instance with worst-case residual 222. The added condition holds automatically when every element of D\mathcal DD is symmetric (e.g. the diagonal structures (36)) and when G=0G = 0G=0 (e.g. D=RN×N\mathcal D = \mathbb R^{N\times N}D=RN×N). (iii) Lemma 2.2's "only if" is stated under T2≠0T_2 \ne 0T2​=0 or T3=0T_3 = 0T3​=0. (iv) Lemma 2.3's necessity is stated in strict form, and its sufficiency concludes T(Δ)≻0T(\Delta) \succ 0T(Δ)≻0.
  • Not stated: "If Θ>0\Theta > 0Θ>0 at the optimum, the upper bound is also exact". The infimum over the strict LMI (38) is not attained, and the paper does not say which limit is meant. Theorem 5.3, Lemma 2.4 and Lemma 5.1 are also not stated.
  • Trivializing encodings ruled out: the goal is not a statement about the value of an infimum (which a junk value could satisfy), and the added hypotheses are satisfiable (for instance S=sIS = sIS=sI, G=0G = 0G=0 for full D\mathcal DD, which part (b) produces).
  • Infrastructure needed: the Schur complement for block matrices (in Mathlib), a lossless S-lemma for two homogeneous quadratic forms in strict and non-strict form (the platform has ConvexOptimization.s_procedure, in a different sign convention), square roots of positive definite matrices that commute with D\mathcal DD, and compactness of the structured unit ball. The S-procedure lemmas are reusable in robust control and trust-region analysis. Proofs of the milestones in any order are welcome.

Selected references

  • L. El Ghaoui and H. Lebret, Robust solutions to least-squares problems with uncertain data, SIAM J. Matrix Anal. Appl. 18(4):1035–1064, 1997. https://doi.org/10.1137/S0895479896298130
  • S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994. https://doi.org/10.1137/1.9781611970777
  • M. K. H. Fan, A. L. Tits and J. C. Doyle, Robustness in the presence of mixed parametric uncertainty and unmodeled dynamics, IEEE Trans. Automat. Control 36(1):25–38, 1991. https://doi.org/10.1109/9.62265
  • I. Pólik and T. Terlaky, A survey of the S-lemma, SIAM Review 49(3):371–418, 2007. https://doi.org/10.1137/S003614450444614X
8 thms3 active usersReviewed
🏆Completed
Convex OptimizationNumerical AnalysisOperations Research+1·Captain: mikedeng1

Robust Solutions to Least-Squares Problems with Uncertain Data III: Structured Robust Least Squares Is Solved Exactly by a Semidefinite ProgramResearch Paper

Motivation

Least squares fits a model Ax≈bAx \approx bAx≈b as if the data (A,b)(A, b)(A,b) were exact. In practice they are measured, rounded or estimated, and the least-squares solution can be very sensitive to such errors. El Ghaoui and Lebret (SIAM J. Matrix Anal. Appl. 18(4), 1997) proposed to treat the errors as deterministic, unknown but bounded, and to choose xxx minimizing the worst-case residual over all admissible data. For unstructured perturbations of [A b][A\ b][A b] bounded in Frobenius norm this leads to a second-order cone program (missions I and II of this series).

In many applications the perturbations have a known structure: a Toeplitz matrix stays Toeplitz, a parameter enters several entries at once, or only some entries are uncertain. An unstructured bound then over-estimates the worst case. The paper's §4 treats perturbations that are affine in a parameter vector δ\deltaδ bounded in Euclidean norm, and shows that the resulting structured robust least-squares (SRLS) problem is still solved exactly, now by a semidefinite program (SDP). This model of uncertainty (an ellipsoid of affinely parametrized data) is the one later adopted as the basic uncertainty set of robust optimization; see Ben-Tal and Nemirovski, Math. Oper. Res. 23(4), 1998.

Setting

Vectors carry the Euclidean norm ∥v∥=vTv\|v\| = \sqrt{v^Tv}∥v∥=vTv​. Given matrices A0,A1,…,Ap∈Rn×mA_0, A_1, \dots, A_p \in \mathbb{R}^{n\times m}A0​,A1​,…,Ap​∈Rn×m and vectors b0,b1,…,bp∈Rnb_0, b_1, \dots, b_p \in \mathbb{R}^nb0​,b1​,…,bp​∈Rn, define for every δ∈Rp\delta \in \mathbb{R}^pδ∈Rp

A(δ)=A0+∑i=1pδiAi,b(δ)=b0+∑i=1pδibi.\mathbf A(\delta) = A_0 + \sum_{i=1}^p \delta_i A_i, \qquad \mathbf b(\delta) = b_0 + \sum_{i=1}^p \delta_i b_i .A(δ)=A0​+i=1∑p​δi​Ai​,b(δ)=b0​+i=1∑p​δi​bi​.

For ρ≥0\rho \ge 0ρ≥0 and x∈Rmx \in \mathbb{R}^mx∈Rm the structured worst-case residual is

rS(A,b,ρ,x)=max⁡∥δ∥≤ρ∥A(δ)x−b(δ)∥,r_S(\mathbf A, \mathbf b, \rho, x) = \max_{\|\delta\| \le \rho} \|\mathbf A(\delta)x - \mathbf b(\delta)\|,rS​(A,b,ρ,x)=∥δ∥≤ρmax​∥A(δ)x−b(δ)∥,

and xxx is an SRLS solution if it minimizes rS(A,b,ρ,⋅)r_S(\mathbf A, \mathbf b, \rho, \cdot)rS​(A,b,ρ,⋅) over Rm\mathbb{R}^mRm. The paper takes ρ=1\rho = 1ρ=1 throughout §4 and writes rS(A,b,x)r_S(\mathbf A, \mathbf b, x)rS​(A,b,x).

For fixed xxx let M(x)=[A1x−b1 ⋯ Apx−bp]∈Rn×pM(x) = [A_1x - b_1\ \cdots\ A_px - b_p] \in \mathbb{R}^{n\times p}M(x)=[A1​x−b1​ ⋯ Ap​x−bp​]∈Rn×p and

F=M(x)TM(x),g=M(x)T(A0x−b0),h=∥A0x−b0∥2.F = M(x)^TM(x), \qquad g = M(x)^T(A_0x - b_0), \qquad h = \|A_0x - b_0\|^2 .F=M(x)TM(x),g=M(x)T(A0​x−b0​),h=∥A0​x−b0​∥2.

Since A(δ)x−b(δ)=(A0x−b0)+M(x)δ\mathbf A(\delta)x - \mathbf b(\delta) = (A_0x - b_0) + M(x)\deltaA(δ)x−b(δ)=(A0​x−b0​)+M(x)δ, the squared residual at δ\deltaδ is the quadratic function h+2gTδ+δTFδh + 2g^T\delta + \delta^TF\deltah+2gTδ+δTFδ. Finally, for scalars λ,τ\lambda, \tauλ,τ,

F(λ,τ)=[λ−τ−h−gT−gτI−F].\mathcal F(\lambda, \tau) = \begin{bmatrix} \lambda - \tau - h & -g^T \\ -g & \tau I - F \end{bmatrix}.F(λ,τ)=[λ−τ−h−g​−gTτI−F​].

Formalization targets

Goal: Theorem 4.2

With p≥1p \ge 1p≥1 and ρ=1\rho = 1ρ=1, consider the SDP in (λ,τ,x)(\lambda, \tau, x)(λ,τ,x)

minimize λsubject to[λ−τ0(A0x−b0)T0τIM(x)TA0x−b0M(x)I]⪰0.(32)\text{minimize } \lambda \quad \text{subject to} \quad \begin{bmatrix} \lambda - \tau & 0 & (A_0x - b_0)^T \\ 0 & \tau I & M(x)^T \\ A_0x - b_0 & M(x) & I \end{bmatrix} \succeq 0. \tag{32}minimize λsubject to​λ−τ0A0​x−b0​​0τIM(x)​(A0​x−b0​)TM(x)TI​​⪰0.(32)

The goal states that (a) for all xxx and λ\lambdaλ, some τ\tauτ makes (λ,τ,x)(\lambda, \tau, x)(λ,τ,x) feasible if and only if rS(A,b,x)2≤λr_S(\mathbf A, \mathbf b, x)^2 \le \lambdarS​(A,b,x)2≤λ; and (b) (λ,τ,x)(\lambda, \tau, x)(λ,τ,x) is optimal for (32) if and only if xxx is an SRLS solution, λ=rS(A,b,x)2\lambda = r_S(\mathbf A, \mathbf b, x)^2λ=rS​(A,b,x)2, and (λ,τ,x)(\lambda, \tau, x)(λ,τ,x) is feasible. This is the precise content of the paper's "the SRLS can be solved by computing an optimal solution of (32)".

Milestones

  1. Lemma 2.1 (S-procedure), in two items: the multiplier condition is sufficient for every ppp; for p=1p = 1p=1 it is also necessary when F1(ζ0)>0F_1(\zeta_0) > 0F1​(ζ0​)>0 for some ζ0\zeta_0ζ0​.
  2. Eq. (28): rS(A,b,x)2=max⁡δTδ≤1[1;δ]T[hgTgF][1;δ]r_S(\mathbf A, \mathbf b, x)^2 = \max_{\delta^T\delta \le 1} [1;\delta]^T \begin{bmatrix} h & g^T \\ g & F\end{bmatrix} [1;\delta]rS​(A,b,x)2=maxδTδ≤1​[1;δ]T[hg​gTF​][1;δ].
  3. Eq. (29): for λ≥0\lambda \ge 0λ≥0, that quadratic form is ≤λ\le \lambda≤λ on the unit ball if and only if F(λ,τ)⪰0\mathcal F(\lambda, \tau) \succeq 0F(λ,τ)⪰0 for some τ\tauτ.
  4. Theorem 4.1, first assertion: rS(A,b,x)2=min⁡{λ:∃τ, F(λ,τ)⪰0}r_S(\mathbf A, \mathbf b, x)^2 = \min\{\lambda : \exists \tau,\ \mathcal F(\lambda, \tau) \succeq 0\}rS​(A,b,x)2=min{λ:∃τ, F(λ,τ)⪰0}, the minimum attained.
  5. §4.2, Schur-complement step: the matrix of (32) is positive semidefinite if and only if F(λ,τ)\mathcal F(\lambda, \tau)F(λ,τ) is.

Significance

The result shows that a min–max problem over a nonconvex worst case (the inner problem maximizes a convex quadratic over a ball) is equivalent to a single convex SDP whose size is linear in nnn, mmm and ppp, and hence solvable in polynomial time by interior-point methods. It covers as special cases the unstructured problem of §3, least squares with uncertainty in selected entries, and Toeplitz or otherwise patterned perturbations. The exactness contrasts with the next section of the paper, where the linear-fractional and ℓ∞\ell_\inftyℓ∞​-bounded versions are in general only bounded from above, or shown NP-hard.

The result is proved in the paper; to the best of current knowledge it has not been formalized. The platform already has the one-constraint S-procedure (ConvexOptimization.s_procedure, proved, in a different sign and block convention); this mission adds the robust least-squares objects, the reduction to the S-procedure, the Schur-complement step, and the optimal-solution correspondence of Theorem 4.2. The worst-case residual and SDP (32) definitions are reusable by later robust-regression missions.

Difficulty

The obvious approach is to compute the inner maximum directly. The function δ↦h+2gTδ+δTFδ\delta \mapsto h + 2g^T\delta + \delta^TF\deltaδ↦h+2gTδ+δTFδ is convex, so its maximum over the unit ball is attained on the boundary, but it is not given by any closed-form expression in general, and maximizing a convex function is not a convex problem. Exactness therefore rests on the lossless S-procedure for one quadratic constraint, a nonconvex duality statement that fails for two or more constraints; the sufficient direction alone only yields an upper bound.

A second point is passing from "for fixed xxx" (Theorem 4.1) to "optimal over xxx" (Theorem 4.2): F(λ,τ)\mathcal F(\lambda, \tau)F(λ,τ) is quadratic in xxx, and only the Schur-complement lift (32) is jointly affine in (λ,τ,x)(\lambda, \tau, x)(λ,τ,x). The correspondence of optimal solutions must then be checked in both directions, including that the optimal λ\lambdaλ is the squared residual and not the residual.

Formalization scope

  • Data are A0 : Matrix (Fin n) (Fin m) ℝ, A : Fin p → Matrix (Fin n) (Fin m) ℝ, b0 : Fin n → ℝ, b : Fin p → Fin n → ℝ; A i is the paper's Ai+1A_{i+1}Ai+1​ (0-based index). Vectors live in Fin k → ℝ with the Euclidean norm written out as ∑ivi2\sqrt{\sum_i v_i^2}∑i​vi2​​, never Mathlib's sup norm.
  • The maximum defining rSr_SrS​ is sSup of the set of attained residuals over the closed ball; for ρ≥0\rho \ge 0ρ≥0 this set is nonempty and bounded, so sSup is the true maximum. The theorems use ρ=1\rho = 1ρ=1, as the paper does; the paper derives general ρ\rhoρ by scaling and that is not stated here.
  • Block matrices are Matrix.fromBlocks in the printed order (scalar block first: Unit ⊕ Fin p; for (32), (Unit ⊕ Fin p) ⊕ Fin n). "⪰0\succeq 0⪰0" is Mathlib's PosSemidef, which includes symmetry; all matrices here are symmetric by construction.
  • p≥1p \ge 1p≥1 is assumed in (29), Theorem 4.1 and Theorem 4.2, although the paper does not state it: for p=0p = 0p=0 the block τI\tau IτI is empty, τ\tauτ is unconstrained, every λ\lambdaλ is feasible and both SDPs lose their meaning. Eq. (28), Lemma 2.1 and the Schur-complement step hold for every ppp and are stated without it.
  • Optimality in (32) is stated as feasibility plus λ≤λ′\lambda \le \lambda'λ≤λ′ for every feasible (λ′,τ′,x′)(\lambda', \tau', x')(λ′,τ′,x′). A formalization that only proves existence of some feasible τ\tauτ, or only an inequality between the optimal values, is weaker than Theorem 4.2 and does not close the goal.
  • Theorem 4.1's second and third assertions (the one-dimensional reformulation (30)–(31) and the worst-case perturbation) are not included: they use the notion "(F,g)(F, g)(F,g)-controllable", which the paper does not define.
  • Useful infrastructure: Mathlib's Schur-complement lemmas (Matrix.PosSemidef.fromBlocks₂₂ and relatives in LinearAlgebra.Matrix.SchurComplement); the platform's ConvexOptimization.s_procedure and ConvexOptimization.single_constraint_quadratic_strong_duality with their definitions ConvexOptimization_quadraticForms, included as reference items. A bridge lemma between the platform's block convention and this mission's is a welcome contribution, as is a general-ρ\rhoρ version.

Selected references

  • L. El Ghaoui and H. Lebret, Robust Solutions to Least-Squares Problems with Uncertain Data, SIAM J. Matrix Anal. Appl. 18(4):1035–1064, 1997. https://doi.org/10.1137/S0895479896298130
  • S. Boyd, L. El Ghaoui, E. Feron and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994 (the S-procedure, p. 24). https://doi.org/10.1137/1.9781611970777
  • A. Ben-Tal and A. Nemirovski, Robust Convex Optimization, Math. Oper. Res. 23(4):769–805, 1998. https://doi.org/10.1287/moor.23.4.769
  • I. Pólik and T. Terlaky, A Survey of the S-Lemma, SIAM Review 49(3):371–418, 2007. https://doi.org/10.1137/S003614450444614X
11 thms3 active usersReviewed
PreviousPage 3 of 9Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me