Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Linear algebra

222 missions · 132 completed

Missions

Open90Completed132All222
Quantum InformationTheoretical Computer Science·Captain: mikedeng1

Quantum Singular Value Transformation and Beyond: Exponential Improvements for Quantum Matrix Arithmetics: Singular Value Transformation by Real Polynomials via Alternating Phase ModulationResearch Paper

Motivation

Many quantum algorithms act on a matrix AAA that is not itself unitary: a Hamiltonian to be simulated, a linear system to be inverted, a projector to be amplified. The standard way to hand such a matrix to a quantum computer is to embed it as a block of a unitary UUU, so that A=Π~UΠA=\widetilde\Pi U\PiA=ΠUΠ for two orthogonal projectors Π,Π~\Pi,\widetilde\PiΠ,Π. The question is then which functions f(A)f(A)f(A) can be produced from a few uses of UUU and U†U^\daggerU†.

Gilyén, Su, Low and Wiebe (arXiv:1806.01838, STOC 2019) answered it for polynomials: interleaving UUU and U†U^\daggerU† with phase rotations about Π\PiΠ and Π~\widetilde\PiΠ applies a polynomial to every singular value of AAA. This quantum singular value transformation (QSVT) recovers Hamiltonian simulation, amplitude amplification, fixed-point search, quantum walks and matrix inversion as instances of one identity, and is now the common language of these algorithms (see the survey of Martyn, Rossi, Tan and Chuang, PRX Quantum 2021).

Timeline.

  • 2016: Low, Yoder and Chuang characterize the single-qubit sequences eiφ0σz∏jW(x)eiφjσze^{i\varphi_0\sigma_z}\prod_j W(x)e^{i\varphi_j\sigma_z}eiφ0​σz​∏j​W(x)eiφj​σz​, which they call quantum signal processing (QSP) (PRX 2016).
  • 2016–2017: Low and Chuang lift QSP to Hermitian blocks by qubitization (Quantum 2019; PRL 2017).
  • 2018: this paper replaces eigenvalues by singular values, so that arbitrary (even rectangular) blocks are allowed, and removes the earlier constraint Pℜ(0)=0P_\Re(0)=0Pℜ​(0)=0 for even degree.

Setting

Let HU\mathcal H_UHU​ be a finite-dimensional complex Hilbert space, UUU a unitary on it, and Π,Π~\Pi,\widetilde\PiΠ,Π orthogonal projectors. The projected unitary is A=Π~UΠA=\widetilde\Pi U\PiA=ΠUΠ. Put d=rank⁡Πd=\operatorname{rank}\Pid=rankΠ, d~=rank⁡Π~\tilde d=\operatorname{rank}\widetilde\Pid~=rankΠ, dmin⁡=min⁡(d,d~)d_{\min}=\min(d,\tilde d)dmin​=min(d,d~). A singular value decomposition of AAA consists of orthonormal bases (ψi)i≤d(\psi_i)_{i\le d}(ψi​)i≤d​ of img Π\mathrm{img}\,\PiimgΠ and (ψ~i)i≤d~(\tilde\psi_i)_{i\le\tilde d}(ψ~​i​)i≤d~​ of img Π~\mathrm{img}\,\widetilde\PiimgΠ and numbers ς1≥⋯≥ςdmin⁡≥0\varsigma_1\ge\dots\ge\varsigma_{d_{\min}}\ge0ς1​≥⋯≥ςdmin​​≥0 with

A=∑i=1dmin⁡ςi ∣ψ~i⟩⟨ψi∣.A=\sum_{i=1}^{d_{\min}}\varsigma_i\,|\tilde\psi_i\rangle\langle\psi_i| .A=i=1∑dmin​​ςi​∣ψ~​i​⟩⟨ψi​∣.

For f:R→Cf:\mathbb R\to\mathbb Cf:R→C, the singular value transformation is f(SV)(A)=∑i≤dmin⁡f(ςi)∣ψ~i⟩⟨ψi∣f^{(SV)}(A)=\sum_{i\le d_{\min}}f(\varsigma_i)|\tilde\psi_i\rangle\langle\psi_i|f(SV)(A)=∑i≤dmin​​f(ςi​)∣ψ~​i​⟩⟨ψi​∣ when fff is odd and f(SV)(A)=∑i≤df(ςi)∣ψi⟩⟨ψi∣f^{(SV)}(A)=\sum_{i\le d}f(\varsigma_i)|\psi_i\rangle\langle\psi_i|f(SV)(A)=∑i≤d​f(ςi​)∣ψi​⟩⟨ψi​∣ when fff is even, with ςi:=0\varsigma_i:=0ςi​:=0 for i>dmin⁡i>d_{\min}i>dmin​.

The phase operator of a projector is eiφ(2Π−I)=eiφΠ+e−iφ(I−Π)e^{i\varphi(2\Pi-I)}=e^{i\varphi}\Pi+e^{-i\varphi}(I-\Pi)eiφ(2Π−I)=eiφΠ+e−iφ(I−Π). For Φ=(φ1,…,φn)∈Rn\Phi=(\varphi_1,\dots,\varphi_n)\in\mathbb R^nΦ=(φ1​,…,φn​)∈Rn, the alternating phase modulation sequence UΦU_\PhiUΦ​ is the product, from j=1j=1j=1 on the left to j=nj=nj=n on the right, of eiφj(2Π~−I)Ue^{i\varphi_j(2\widetilde\Pi-I)}Ueiφj​(2Π−I)U when n−jn-jn−j is even and of eiφj(2Π−I)U†e^{i\varphi_j(2\Pi-I)}U^\daggereiφj​(2Π−I)U† when n−jn-jn−j is odd. On the single-qubit side, R(x)=(x1−x21−x2−x)R(x)=\begin{pmatrix}x&\sqrt{1-x^2}\\ \sqrt{1-x^2}&-x\end{pmatrix}R(x)=(x1−x2​​1−x2​−x​) for x∈[−1,1]x\in[-1,1]x∈[−1,1], and Φ\PhiΦ is said to realize P∈C[x]P\in\mathbb C[x]P∈C[x] if P(x)P(x)P(x) is the top-left entry of ∏j=1neiφjσzR(x)\prod_{j=1}^n e^{i\varphi_j\sigma_z}R(x)∏j=1n​eiφj​σz​R(x) for every x∈[−1,1]x\in[-1,1]x∈[−1,1].

In Lean these are ProjUnitarySVD U Proj Projt (the decomposition data), svtOdd/svtEven, phaseRefl, altPhaseSeq, reflR and qspRefl, in the namespace QSVT19.Main.

Formalization targets

Goal: Corollary 18 (singular value transformation by real polynomials)

Let n≥1n\ge1n≥1 and let Pℜ∈R[x]P_\Re\in\mathbb R[x]Pℜ​∈R[x] have degree nnn, parity n mod 2n \bmod 2nmod2, and ∣Pℜ(x)∣≤1|P_\Re(x)|\le1∣Pℜ​(x)∣≤1 on [−1,1][-1,1][−1,1]. Then there is Φ∈Rn\Phi\in\mathbb R^nΦ∈Rn such that for every singular value decomposition of Π~UΠ\widetilde\Pi U\PiΠUΠ

Pℜ(SV)(Π~UΠ)=(⟨+∣⊗Π′)(∣0⟩⟨0∣⊗UΦ+∣1⟩⟨1∣⊗U−Φ)(∣+⟩⊗Π),P_\Re^{(SV)}(\widetilde\Pi U\Pi)=\bigl(\langle+|\otimes\Pi'\bigr)\bigl(|0\rangle\langle0|\otimes U_\Phi+|1\rangle\langle1|\otimes U_{-\Phi}\bigr)\bigl(|+\rangle\otimes\Pi\bigr),Pℜ(SV)​(ΠUΠ)=(⟨+∣⊗Π′)(∣0⟩⟨0∣⊗UΦ​+∣1⟩⟨1∣⊗U−Φ​)(∣+⟩⊗Π),

with Π′=Π~\Pi'=\widetilde\PiΠ′=Π for odd nnn and Π′=Π\Pi'=\PiΠ′=Π for even nnn. The only constraints on PℜP_\RePℜ​ are those that are necessary; no degree-dependent constant appears.

Milestones

  1. Lemma 6, Theorem 5, Theorem 4 (first claim): sum-of-squares factorization and the characterization of which polynomials, and which real parts, arise from QSP.
  2. Corollary 8: every PPP meeting four explicit conditions is realized by some Φ∈Rd\Phi\in\mathbb R^dΦ∈Rd in the reflection form; Corollary 10: every PℜP_\RePℜ​ as in the goal is ℜ[P]\Re[P]ℜ[P] for such a PPP.
  3. Definition 11 (existence of the decomposition), Table 2 (orthonormality of the spanning vectors of Definition 12), Lemma 14 (the block decomposition of UUU into one- and two-dimensional pieces).
  4. Theorem 17: if Φ\PhiΦ realizes PPP, then P(SV)(Π~UΠ)=Π~UΦΠP^{(SV)}(\widetilde\Pi U\Pi)=\widetilde\Pi U_\Phi\PiP(SV)(ΠUΠ)=ΠUΦ​Π for odd nnn and ΠUΦΠ\Pi U_\Phi\PiΠUΦ​Π for even nnn.
  5. Lemma 9 (optional): explicit phases realizing the Chebyshev polynomial TdT_dTd​.

Significance

The result. Corollary 18 says that every real polynomial of degree nnn, of definite parity and bounded by 111 on [−1,1][-1,1][−1,1], can be applied to the singular values of Π~UΠ\widetilde\Pi U\PiΠUΠ with nnn uses of UUU and U†U^\daggerU† and one ancilla qubit. Every application in §3.4–§5 of the paper (fixed-point amplitude amplification, singular vector transformation, the pseudoinverse, Hamiltonian simulation, Gibbs sampling) is this corollary applied to a suitable approximating polynomial, so a formal proof makes all of them conditional only on polynomial approximation bounds.

Formalizing it. The result is proved in the paper; none of the statements of this mission has a machine-checked proof on the platform. A formal development would provide reusable infrastructure absent from Mathlib: singular value decompositions over sub-spaces, the two-dimensional invariant-subspace decomposition of a projected unitary (a quantitative form of Jordan's lemma), and the polynomial characterization of single-qubit QSP. Theorem 3 of the paper, the W(x)W(x)W(x) form of the QSP characterization, is already posed on the platform as QAlgorithms.Childs.qsp_characterization; Corollary 8 depends on it.

Difficulty

The obvious argument for Theorem 17 is "restrict UΦU_\PhiUΦ​ to each two-dimensional subspace and read off the QSP product". Making that rigorous means proving that the subspaces of Definition 12 are pairwise orthogonal, invariant under every factor of UΦU_\PhiUΦ​, and that UUU acts on each pair of bases by exactly the reflection R(ςi)R(\varsigma_i)R(ςi​), including the degenerate blocks with ςi∈{0,1}\varsigma_i\in\{0,1\}ςi​∈{0,1}, the one-dimensional blocks HiR,HiL\mathcal H_i^R,\mathcal H_i^LHiR​,HiL​ where UΦU_\PhiUΦ​ contributes a phase e±iφ0e^{\pm i\varphi_0}e±iφ0​, and the complement H⊥\mathcal H_\perpH⊥​. The polynomial side is harder still: Lemma 6 factors a nonnegative even polynomial through its multiset of complex roots, grouping roots in (0,1)(0,1)(0,1), in [1,∞)[1,\infty)[1,∞), on the imaginary axis and in the open quadrant, while tracking degree and parity. Neither step reduces to a library lemma, and an argument that works only for Hermitian AAA, or only when Π=Π~\Pi=\widetilde\PiΠ=Π, proves a different theorem.

Formalization scope

  • HU\mathcal H_UHU​ is ι → ℂ for a Fintype ι with the inner product star v ⬝ᵥ w; operators are Matrix ι ι ℂ; "unitary" is U ∈ Matrix.unitaryGroup ι ℂ; "orthogonal projector" is IsStarProjection. The projectors are named Proj, Projt because Π is Lean notation. Indices are 0-based.
  • A singular value decomposition is the structure ProjUnitarySVD U Proj Projt of data: orthonormal families with Π=∑i∣ψi⟩⟨ψi∣\Pi=\sum_i|\psi_i\rangle\langle\psi_i|Π=∑i​∣ψi​⟩⟨ψi​∣, Π~=∑i∣ψ~i⟩⟨ψ~i∣\widetilde\Pi=\sum_i|\tilde\psi_i\rangle\langle\tilde\psi_i|Π=∑i​∣ψ~​i​⟩⟨ψ~​i​∣, nonnegative non-increasing ς\varsigmaς, and (17). The goal is posed for every such decomposition, with Φ\PhiΦ chosen first; the Definition 11 milestone shows that one exists. ςi≤1\varsigma_i\le1ςi​≤1 is a consequence and is not assumed.
  • f(SV)f^{(SV)}f(SV) is the sum over the decomposition (Definition 16), never the right-hand side of (32) or (33); a formalization that defines it by an operator expression trivializes the goal.
  • eiφ(2Π−I)e^{i\varphi(2\Pi-I)}eiφ(2Π−I) is written eiφΠ+e−iφ(I−Π)e^{i\varphi}\Pi+e^{-i\varphi}(I-\Pi)eiφΠ+e−iφ(I−Π), equal to the matrix exponential for an idempotent Π\PiΠ. The ancilla of (33) is the first tensor factor.
  • eiφσze^{i\varphi\sigma_z}eiφσz​ and the parity predicate are the published definitions of QAlgorithms_Defs_Hamiltonian. "deg ≤ k − 1" is degree < k and "parity k−1k-1k−1" is parity k+1k+1k+1, avoiding natural-number subtraction.
  • Printed slips that affect statements:
    • Corollary 10 omits ℜ[P]=Pℜ\Re[P]=P_\Reℜ[P]=Pℜ​; it is restored, as used in the proof of Corollary 18.
    • Corollary 8 and Corollary 18 are false for degree 000 (a constant eiαe^{i\alpha}eiα, respectively a constant c≠1c\neq1c=1); both are posed with d≥1d\ge1d≥1, n≥1n\ge1n≥1.
    • Theorem 17's "PPP and Φ\PhiΦ as in Corollary 8" is read as (14), the only property its proof uses.
    • Lemma 14's (25)–(28) index the HL\mathcal H^LHL blocks by [d]∖[r][d]\setminus[r][d]∖[r]; this is read as [d~]∖[r][\tilde d]\setminus[r][d~]∖[r], as in (24).
  • Contributions welcome: proofs of any milestone, general lemmas on SVDs of compressions Π~UΠ\widetilde\Pi U\PiΠUΠ, and a proof of the platform's open QSP characterization.

Selected references

  • A. Gilyén, Y. Su, G. H. Low, N. Wiebe, Quantum singular value transformation and beyond: exponential improvements for quantum matrix arithmetics, arXiv:1806.01838v1, 2018; STOC 2019. https://arxiv.org/abs/1806.01838
  • G. H. Low, T. J. Yoder, I. L. Chuang, Methodology of resonant equiangular composite quantum gates, Physical Review X 6, 041067, 2016. https://doi.org/10.1103/PhysRevX.6.041067
  • G. H. Low, I. L. Chuang, Optimal Hamiltonian simulation by quantum signal processing, Physical Review Letters 118, 010501, 2017. https://doi.org/10.1103/PhysRevLett.118.010501
  • G. H. Low, I. L. Chuang, Hamiltonian simulation by qubitization, Quantum 3, 163, 2019. https://doi.org/10.22331/q-2019-07-12-163
  • J. M. Martyn, Z. M. Rossi, A. K. Tan, I. L. Chuang, Grand unification of quantum algorithms, PRX Quantum 2, 040203, 2021. https://doi.org/10.1103/PRXQuantum.2.040203
13 thms2 active usersReviewed
OptimizationQuantum InformationTheoretical Computer Science·Captain: mikedeng1

Optimization by Decoded Quantum Interferometry 1: The Semicircle Law — the Optimal Degree-ℓ DQI State Satisfies ⟨s⟩/m → (√(μ(1−ρ)) + √(ρ(1−μ)))² When 2ℓ + 1 < d⊥Research Paper

Motivation

Decoded quantum interferometry (DQI) is a quantum algorithm, introduced by Jordan, Shutty, Wootters, Zalcman, Schmidhuber, King, Isakov, Khattar and Babbush (arXiv:2408.08292), that turns an approximate optimization problem over a finite field into a decoding problem for a linear code. It applies to max-LINSAT: given linear constraints over Fp\mathbb F_pFp​, satisfy as many of them as possible. For structured instances such as optimal polynomial intersection the authors find DQI reaching approximation ratios that no known polynomial-time classical algorithm reaches, which makes it one of the few concrete candidates for a quantum advantage in optimization.

Whether DQI is useful on an instance depends on one number: the expected fraction of constraints satisfied by the string it outputs. Theorem 4.1 of the paper computes this number, in the limit of many constraints, for the best DQI state of a given degree. Every comparison of DQI with classical algorithms in the paper (simulated annealing, Prange's algorithm, the OPI and max-XORSAT benchmarks) is a comparison against this formula, and the follow-up analysis of imperfect decoders (Theorem 10.1) is a perturbation of it.

Setting

Fix a prime ppp. A max-LINSAT instance is a matrix B∈Fpm×nB\in\mathbb F_p^{m\times n}B∈Fpm×n​ with rows b1,…,bm\mathbf b_1,\dots,\mathbf b_mb1​,…,bm​ and subsets F1,…,Fm⊆FpF_1,\dots,F_m\subseteq\mathbb F_pF1​,…,Fm​⊆Fp​; constraint iii asks that bi⋅x∈Fi\mathbf b_i\cdot\mathbf x\in F_ibi​⋅x∈Fi​ (Definition 2.1). Throughout, m>nm>nm>n and every FiF_iFi​ has the same size r∈{1,…,p−1}r\in\{1,\dots,p-1\}r∈{1,…,p−1}. Put fi(a)=+1f_i(a)=+1fi​(a)=+1 if a∈Fia\in F_ia∈Fi​ and −1-1−1 otherwise, and

f(x)=∑i=1mfi(bi⋅x),s(x)=#{i:bi⋅x∈Fi}.f(\mathbf x)=\sum_{i=1}^m f_i(\mathbf b_i\cdot\mathbf x),\qquad s(\mathbf x)=\#\{i:\mathbf b_i\cdot\mathbf x\in F_i\}.f(x)=i=1∑m​fi​(bi​⋅x),s(x)=#{i:bi​⋅x∈Fi​}.

For a real polynomial PPP of degree at most ℓ\ellℓ, the DQI state is ∣P(f)⟩=∑x∈FpnP(f(x))∣x⟩|P(f)\rangle=\sum_{\mathbf x\in\mathbb F_p^n}P(f(\mathbf x))|\mathbf x\rangle∣P(f)⟩=∑x∈Fpn​​P(f(x))∣x⟩, normalized so that ∑xP(f(x))2=1\sum_{\mathbf x}P(f(\mathbf x))^2=1∑x​P(f(x))2=1. Measuring it in the computational basis returns x\mathbf xx with probability P(f(x))2P(f(\mathbf x))^2P(f(x))2, so the expected number of satisfied constraints is

⟨s⟩=∑xP(f(x))2 s(x),\langle s\rangle=\sum_{\mathbf x}P(f(\mathbf x))^2\,s(\mathbf x),⟨s⟩=x∑​P(f(x))2s(x),

and ⟨s(m,ℓ)⟩opt\langle s^{(m,\ell)}\rangle_{\rm opt}⟨s(m,ℓ)⟩opt​ is its supremum over all such PPP.

The dual code is C⊥={d∈Fpm:BTd=0}C^\perp=\{\mathbf d\in\mathbb F_p^m:B^T\mathbf d=0\}C⊥={d∈Fpm​:BTd=0} and d⊥d^\perpd⊥ is the least Hamming weight of a nonzero codeword. The condition 2ℓ+1<d⊥2\ell+1<d^\perp2ℓ+1<d⊥ says that syndromes of errors of weight up to ℓ\ellℓ (and a little more) determine the error.

The analysis passes through rescaled constraint functions gi=(fi−fˉ)/φg_i=(f_i-\bar f)/\varphigi​=(fi​−fˉ​)/φ with Fourier transforms g~i\tilde g_ig~​i​, the elementary symmetric polynomials P(k)P^{(k)}P(k) evaluated at the gi(bi⋅x)g_i(\mathbf b_i\cdot\mathbf x)gi​(bi​⋅x), and the (ℓ+1)×(ℓ+1)(\ell+1)\times(\ell+1)(ℓ+1)×(ℓ+1) symmetric tridiagonal matrix A(m,ℓ,d)A^{(m,\ell,d)}A(m,ℓ,d) with diagonal 0,d,2d,…,ℓd0,d,2d,\dots,\ell d0,d,2d,…,ℓd and off-diagonal entries ak=k(m−k+1)a_k=\sqrt{k(m-k+1)}ak​=k(m−k+1)​, at d=(p−2r)/r(p−r)d=(p-2r)/\sqrt{r(p-r)}d=(p−2r)/r(p−r)​.

Formalization targets

Goal: Theorem 4.1 (the semicircle law)

Fix ppp, rrr and μ≥0\mu\ge0μ≥0. For any sequence of instances with m→∞m\to\inftym→∞, ℓ/m→μ\ell/m\to\muℓ/m→μ and 2ℓ+1<d⊥2\ell+1<d^\perp2ℓ+1<d⊥, writing ρ=r/p\rho=r/pρ=r/p,

lim⁡⟨s(m,ℓ)⟩optm={(μ(1−ρ)+ρ(1−μ))2,ρ≤1−μ,1,otherwise.\lim\frac{\langle s^{(m,\ell)}\rangle_{\rm opt}}{m}=\begin{cases}\big(\sqrt{\mu(1-\rho)}+\sqrt{\rho(1-\mu)}\big)^2,&\rho\le1-\mu,\\ 1,&\text{otherwise.}\end{cases}limm⟨s(m,ℓ)⟩opt​​={(μ(1−ρ)​+ρ(1−μ)​)2,1,​ρ≤1−μ,otherwise.​

For ρ=12\rho=\tfrac12ρ=21​ the curve is 12+μ(1−μ)\tfrac12+\sqrt{\mu(1-\mu)}21​+μ(1−μ)​, a semicircle, which gives the theorem its name.

Milestones

  1. The normalization of the rescaled gig_igi​, (37)–(40).
  2. Lemma A.1: under a common quadratic identity, P(x1+⋯+xm)P(x_1+\dots+x_m)P(x1​+⋯+xm​) is a fixed linear combination of elementary symmetric polynomials.
  3. The counting identity (68), ∑∣y∣=k∣g~(y)∣2=(mk)\sum_{|\mathbf y|=k}|\tilde g(\mathbf y)|^2=\binom mk∑∣y∣=k​∣g~​(y)∣2=(km​), and the Fourier picture (65) of the DQI state.
  4. Lemma 9.1 (norm =∥w∥2=\|\mathbf w\|^2=∥w∥2 when 2ℓ<d⊥2\ell<d^\perp2ℓ<d⊥) and Lemma 9.2 (the expected count is mrp+r(p−r)pwTA(m,ℓ,d)w\frac{mr}p+\frac{\sqrt{r(p-r)}}p\mathbf w^TA^{(m,\ell,d)}\mathbf wpmr​+pr(p−r)​​wTA(m,ℓ,d)w when 2ℓ+1<d⊥2\ell+1<d^\perp2ℓ+1<d⊥).
  5. The finite-size identity (131): ⟨s(m,ℓ)⟩opt/m=ρ+ρ(1−ρ) λmax⁡(m,ℓ,d)/m\langle s^{(m,\ell)}\rangle_{\rm opt}/m=\rho+\sqrt{\rho(1-\rho)}\,\lambda_{\max}^{(m,\ell,d)}/m⟨s(m,ℓ)⟩opt​/m=ρ+ρ(1−ρ)​λmax(m,ℓ,d)​/m.
  6. Lemma 9.3, λmax⁡(m,ℓ,d)/m→μd+2μ(1−μ)\lambda_{\max}^{(m,\ell,d)}/m\to\mu d+2\sqrt{\mu(1-\mu)}λmax(m,ℓ,d)​/m→μd+2μ(1−μ)​, with its lower half (114) and the Gershgorin bound (129).
  7. The algebra (132) and (136)–(137) that produce the closed form.

Significance

The result. Theorem 4.1 makes DQI's performance a closed-form function of two numbers, r/pr/pr/p and ℓ/m\ell/mℓ/m, and moves every question about an instance into coding theory: how large a d⊥d^\perpd⊥ the instance's dual code has, and whether it can be decoded efficiently up to ℓ\ellℓ errors. The OPI advantage claim of the paper, the comparison with Prange's algorithm on max-XORSAT, and the imperfect-decoding bound of Theorem 10.1 all start from this formula. The finite-size identity (131) is also useful on its own: it gives the exact optimum for any instance, not only in the limit.

Formalizing it. The theorem is proved in the paper; to our knowledge no part of it has been machine-checked. A formalization would check the Fourier bookkeeping of §8.2.1 and §9 (normalizations pn−k(mk)\sqrt{p^{n-k}\binom mk}pn−k(km​)​, character sums over Fp\mathbb F_pFp​), the claim that every degree-ℓ\ellℓ DQI state is a combination of the ∣P(k)⟩|P^{(k)}\rangle∣P(k)⟩ and conversely, and the eigenvalue asymptotics of the tridiagonal matrix. Two points of the printed text need care and are stated correctly here: Lemma 9.2 writes its decomposition in the fif_ifi​ where the normalization requires the rescaled gig_igi​, and the "otherwise =1=1=1" branch of Theorem 4.1 is argued only briefly on p. 34.

Difficulty

The algebraic steps are finite but long, and every one carries a normalization that a careless formalization gets wrong. The asymptotic step is the main obstacle. Lemma 9.3 needs a lower bound on λmax⁡\lambda_{\max}λmax​ from a test vector of growing width and a matching upper bound from Gershgorin's theorem, and the upper bound holds only under d≥−(m−2ℓ)/ℓ(m−ℓ)d\ge-(m-2\ell)/\sqrt{\ell(m-\ell)}d≥−(m−2ℓ)/ℓ(m−ℓ)​, which is exactly the regime ρ≤1−μ\rho\le1-\muρ≤1−μ. In the other regime that hypothesis fails and the Gershgorin bound overshoots, so the limit 111 needs a separate argument; the observation that ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ "increases in rrr", printed on p. 34, does not give it at fixed ppp and rrr. A second difficulty is that ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ is a supremum over polynomials, while Lemma 9.2 is a statement about weight vectors w\mathbf ww; identifying the two needs both directions of Lemma A.1's correspondence and the normalization of Lemma 9.1.

Formalization scope

All objects live in the namespace DQI.Semicircle and one definitions file. Fp\mathbb F_pFp​ is ZMod p with [Fact p.Prime]; vectors are Fin n → ZMod p; constraints are indexed by Fin m from 000. ωpa=exp⁡(2πi a/p)\omega_p^a=\exp(2\pi i\,a/p)ωpa​=exp(2πia/p) is computed from the representative of aaa in {0,…,p−1}\{0,\dots,p-1\}{0,…,p−1}. Polynomials are real with natDegree ≤ ℓ; weight vectors are real. The optimum ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ is the real supremum over exactly the normalized polynomials of degree at most ℓ\ellℓ evaluated at f(x)f(\mathbf x)f(x); its set is nonempty (constant polynomials) and bounded by mmm. The dual-distance condition is "every nonzero d\mathbf dd with BTd=0B^T\mathbf d=0BTd=0 has weight >t>t>t"; d⊥d^\perpd⊥ is never an infimum, and m>nm>nm>n (the paper's standing assumption) guarantees a nonzero codeword, so the condition forces 2ℓ<m2\ell<m2ℓ<m. λmax⁡\lambda_{\max}λmax​ is the supremum of the real spectrum. The limit "m→∞m\to\inftym→∞ with ℓ/m\ell/mℓ/m fixed" is any sequence of instances with mj→∞m_j\to\inftymj​→∞ and ℓj/mj→μ\ell_j/m_j\to\muℓj​/mj​→μ, with ppp and rrr fixed along it. Convergence of the ratio includes irrational μ\muμ with integer sizes.

Added hypotheses, all disclosed in the items: Lemma 9.2 decomposes in the gig_igi​ rather than the printed fif_ifi​; (129) assumes ℓ≥1\ell\ge1ℓ≥1 to avoid dividing by 0\sqrt00​; Lemma 9.3 imposes its hypothesis on ddd only when ℓj≥1\ell_j\ge1ℓj​≥1; (114) is stated as a lim inf⁡\liminfliminf with an explicit ε\varepsilonε.

A formalization that replaces ⟨s⟩opt\langle s\rangle_{\rm opt}⟨s⟩opt​ by a supremum over all states (which gives 111), drops "nonzero" from the distance condition (which makes it unsatisfiable), or states the goal at a single mmm is not this theorem and is ruled out by the definitions above.

Needed infrastructure: Fourier analysis on Fpn\mathbb F_p^nFpn​ (character orthogonality, Parseval), elementary symmetric polynomials and their reduction modulo a quadratic, Rayleigh quotients and Gershgorin discs for real symmetric matrices, and elementary limits. The tridiagonal-matrix bounds and the quadratic-reduction lemma are reusable beyond DQI. Proofs of any milestone, alternative arguments for the "otherwise" branch, and sharper finite-mmm bounds on λmax⁡\lambda_{\max}λmax​ are welcome.

Selected references

  • S. P. Jordan, N. Shutty, M. Wootters, A. Zalcman, A. Schmidhuber, R. King, S. V. Isakov, T. Khattar, R. Babbush, Optimization by Decoded Quantum Interferometry, arXiv:2408.08292v5, 2025. https://arxiv.org/abs/2408.08292
  • S. Gershgorin, Über die Abgrenzung der Eigenwerte einer Matrix, Izv. Akad. Nauk SSSR, Ser. Fiz.-Mat. 6, 749–754, 1931.
  • R. G. Gallager, Low-Density Parity-Check Codes, IRE Trans. Inform. Theory 8(1), 21–28, 1962. https://doi.org/10.1109/TIT.1962.1057683
14 thms2 active usersReviewed
Linear OptimizationTheoretical Computer Science·Captain: mikedeng1

A Strongly Polynomial Algorithm for Linear Exchange Markets II: A Z₊-Matrix Polyhedron P_M Lies Between an M2VPI Polyhedron and Its Scaling by B²Research Paper

Motivation

In a linear exchange market every agent owns one divisible good and has linear utilities over all goods; an equilibrium is a price vector at which every agent can spend its budget on goods that maximize utility per unit of money, and all goods are sold. Computing such an equilibrium in strongly polynomial time, with a number of arithmetic operations bounded by a polynomial in the number of agents alone, was an open question until Garg and Végh (arXiv:1809.06266; Operations Research, 2023). Their algorithm alternates two kinds of phases. One identifies "revealed" edges that appear in every equilibrium (the subject of mission I of this series). The other computes good starting prices for the current set of revealed edges by solving a linear program whose constraint matrix has a special sign structure.

No strongly polynomial algorithm is known for that linear program. Systems in which every inequality has at most one positive and at most one negative coefficient, by contrast, are strongly polynomially solvable (Megiddo, 1983; Hochbaum and Naor, 1994). The paper bridges the gap with Theorem 6.4: a polyhedron given by a Z+Z_+Z+​-matrix is sandwiched between a monotone two-variable-per-inequality polyhedron and its scaling by an explicit factor B2B^2B2. This mission formalizes that theorem and the lemmas of §7 that prove it. It is a statement about matrices and polyhedra only; no market notions enter.

Setting

Matrices are rational. For integers k,t≥0k, t \ge 0k,t≥0 a matrix M∈Qk×tM \in \mathbb{Q}^{k\times t}M∈Qk×t is a Z+Z_+Z+​-matrix, written M∈Z+(k,t)M \in \mathcal{Z}_+(k,t)M∈Z+​(k,t), if every off-diagonal entry is nonpositive and every column sum is nonnegative:

Mij≤0(i≠j),∑i=1kMij≥0(j∈[t]).M_{ij} \le 0 \quad (i \ne j), \qquad \sum_{i=1}^k M_{ij} \ge 0 \quad (j \in [t]).Mij​≤0(i=j),i=1∑k​Mij​≥0(j∈[t]).

For a non-square matrix the diagonal entries are the MiiM_{ii}Mii​ with 1≤i≤min⁡{k,t}1 \le i \le \min\{k,t\}1≤i≤min{k,t}. Square Z+Z_+Z+​-matrices are exactly the transposes of weighted Laplacians of directed graphs, or such transposes with one row and column deleted.

M2(m,t)\mathcal{M}_2(m,t)M2​(m,t) is the set of m×tm\times tm×t rational matrices with at most one positive and at most one negative entry in every row. A system Mˉx≤bˉ\bar M x \le \bar bMˉx≤bˉ with Mˉ∈M2(m,t)\bar M \in \mathcal{M}_2(m,t)Mˉ∈M2​(m,t) is a monotone two-variable-per-inequality system (M2VPI).

For M∈Z+(k,t)M \in \mathcal{Z}_+(k,t)M∈Z+​(k,t) and b∈Qkb \in \mathbb{Q}^kb∈Qk with b>0b > 0b>0, the polyhedron of interest is

PM={x∈Rt:Mx≤b, x≥0}.P_M = \{x \in \mathbb{R}^t : Mx \le b,\ x \ge 0\}.PM​={x∈Rt:Mx≤b, x≥0}.

Write ℓ\ellℓ for the number of nonzero entries of MMM, αP={αx:x∈P}\alpha P = \{\alpha x : x \in P\}αP={αx:x∈P} for α>0\alpha > 0α>0, and

B=∑j=1kbjmin⁡i∈[k]bi.B = \frac{\sum_{j=1}^k b_j}{\min_{i\in[k]} b_i}.B=mini∈[k]​bi​∑j=1k​bj​​.

In §7 the right-hand side is called γ\gammaγ instead of bbb, and λi=∑j≠iγj\lambda_i = \sum_{j\ne i}\gamma_jλi​=∑j=i​γj​.

The proof works with a square M∈Z+(t,t)M \in \mathcal{Z}_+(t,t)M∈Z+​(t,t) with positive diagonal. Its digraph ([t],H)([t],H)([t],H) has an arc ijijij whenever Mij<0M_{ij} < 0Mij​<0. DiD_iDi​ is the set of vertices reachable from iii (including iii), and M(i)M^{(i)}M(i) is the submatrix of the rows MjM_jMj​, j∈Dij \in D_ij∈Di​. The vertices split into T1T_1T1​ (at most one outgoing arc), T2T_2T2​ (at least two arcs and rk⁡M(i)=∣Di∣\operatorname{rk} M^{(i)} = |D_i|rkM(i)=∣Di​∣) and T3T_3T3​ (at least two arcs and rk⁡M(i)<∣Di∣\operatorname{rk} M^{(i)} < |D_i|rkM(i)<∣Di​∣).

Formalization targets

Goal: Theorem 6.4 (p. 15)

For M∈Z+(k,t)M \in \mathcal{Z}_+(k,t)M∈Z+​(k,t) with k≥1k \ge 1k≥1 and ℓ\ellℓ nonzero entries, and b∈Qkb \in \mathbb{Q}^kb∈Qk with b>0b > 0b>0, there are ℓ′≤ℓ\ell' \le \ellℓ′≤ℓ, Mˉ∈M2(ℓ′,t)\bar M \in \mathcal{M}_2(\ell',t)Mˉ∈M2​(ℓ′,t) and bˉ∈Qℓ′\bar b \in \mathbb{Q}^{\ell'}bˉ∈Qℓ′ with

PM⊆{x∈Rt:Mˉx≤bˉ, x≥0}⊆B2PM.P_M \subseteq \{x \in \mathbb{R}^t : \bar Mx \le \bar b,\ x \ge 0\} \subseteq B^2 P_M.PM​⊆{x∈Rt:Mˉx≤bˉ, x≥0}⊆B2PM​.

Milestones (§7, pp. 16–23)

  • Lemma 7.1: for M∈Z+(t,t)M \in \mathcal{Z}_+(t,t)M∈Z+​(t,t) and pˉ≥0\bar p \ge 0pˉ​≥0 with Mpˉ≤γM\bar p \le \gammaMpˉ​≤γ,  Mpˉ≥−λ≥−(B−1)γ\ M\bar p \ge -\lambda \ge -(B-1)\gamma Mpˉ​≥−λ≥−(B−1)γ.
  • Lemma 7.2: the Gaussian elimination of the proof, run on T∈Z+(ℓ,t)T \in \mathcal{Z}_+(\ell,t)T∈Z+​(ℓ,t), returns T′=YTT' = YTT′=YT with Y≥0Y \ge 0Y≥0, T′T'T′ upper triangular with diagonal entries in {0,1}\{0,1\}{0,1} and nonpositive off-diagonal entries, and Tkk′=1T'_{kk} = 1Tkk′​=1 whenever some Tik<0T_{ik} < 0Tik​<0 with i>ki > ki>k.
  • Claim 7.3(iii): for i∈T3i \in T_3i∈T3​, MiM_iMi​ is a linear combination of {Mh:h∈Di∖{i}}\{M_h : h \in D_i \setminus\{i\}\}{Mh​:h∈Di​∖{i}}.
  • Lemma 7.4(i): for i∈T2∪T3i \in T_2\cup T_3i∈T2​∪T3​ there is a unique q(i)∈R+tq^{(i)} \in \mathbb{R}^t_+q(i)∈R+t​ with Mℓq(i)=0M_\ell q^{(i)} = 0Mℓ​q(i)=0 (ℓ∈Di∖{i}\ell \in D_i\setminus\{i\}ℓ∈Di​∖{i}), qi(i)=1q^{(i)}_i = 1qi(i)​=1 and qℓ(i)=0q^{(i)}_\ell = 0qℓ(i)​=0 off DiD_iDi​.
  • Lemma 7.4(iv) and (iii): points r(i)∈PMr^{(i)} \in P_Mr(i)∈PM​ tight on Di∖{i}D_i\setminus\{i\}Di​∖{i} (for i∈T3i \in T_3i∈T3​) and on DiD_iDi​ with ri(i)=κ(i)r^{(i)}_i = \kappa(i)ri(i)​=κ(i) (for i∈T2i \in T_2i∈T2​).
  • Claim 7.5: κ(i) Miq(i)≤Bγi\kappa(i)\,M_i q^{(i)} \le B\gamma_iκ(i)Mi​q(i)≤Bγi​ for i∈T2i \in T_2i∈T2​.
  • The reduced case (§7, p. 16): Theorem 6.4 for square MMM with positive diagonal.

Significance

Theorem 6.4 turns an LP over a Z+Z_+Z+​ constraint matrix, for which no strongly polynomial algorithm is known, into an M2VPI system that is strongly polynomially solvable, at the price of a factor B2B^2B2. In the exchange-market algorithm B≤nB \le nB≤n, so the starting prices of each phase come within a factor n2n^2n2 of optimal (the proof of Theorem 3.7, p. 15). That bound is what lets the potential argument advance in a polynomial number of phases. The construction is not specific to markets: any LP of the form max⁡∑ixi\max \sum_i x_imax∑i​xi​ over PMP_MPM​ with MMM a Z+Z_+Z+​-matrix, which includes LPs over transposed weighted Laplacians of directed graphs, inherits the same approximation.

The result is proved in the paper; to our knowledge none of it has been machine-checked. A formalization produces a checked proof of the sandwich. It also produces reusable facts about Gaussian elimination on Z+Z_+Z+​-matrices (Lemma 7.2), which hold for any matrix whose off-diagonal entries are nonpositive and whose column sums are nonnegative.

Difficulty

The obvious approach, deleting all but two variables from each inequality of PMP_MPM​, fails: the dropped negative terms make the resulting system either too weak or invalid. The paper instead derives one new constraint per arc ijijij of HHH, as a nonnegative combination of the inequalities Mpˉ≥−λM\bar p \ge -\lambdaMpˉ​≥−λ. Finding it requires an ordering of DiD_iDi​ in which every vertex but iii has an in-neighbour placed after it, and an elimination on the permuted submatrix whose penultimate row has exactly two nonzero entries. The reverse containment {Mˉpˉ≤bˉ}⊆B2PM\{\bar M\bar p \le \bar b\} \subseteq B^2P_M{Mˉpˉ​≤bˉ}⊆B2PM​ is the hard direction. It splits by whether the rows on DiD_iDi​ are linearly independent (T2T_2T2​) or not (T3T_3T3​), and the T2T_2T2​ case needs the extra constraint pˉi≤κ(i)\bar p_i \le \kappa(i)pˉ​i​≤κ(i) and the comparison of entries of the elimination multipliers Y(ij)Y^{(ij)}Y(ij) in Claim 7.5. Every step relies on a sign invariant of the elimination that Lemma 7.2 proves by induction.

Formalization scope

Indices are 0-based (Fin k, Fin t); the paper's [n]={1,…,n}[n] = \{1,\dots,n\}[n]={1,…,n}. Matrices MMM, Mˉ\bar MMˉ and right-hand sides bbb, bˉ\bar bbˉ, γ\gammaγ are rational (ℚ), as on p. 15, and act on real vectors x∈Rtx \in \mathbb{R}^tx∈Rt through the cast. A diagonal entry of a rectangular matrix is one whose two indices agree as natural numbers. B2PMB^2P_MB2PM​ is the image {B2x:x∈PM}\{B^2x : x \in P_M\}{B2x:x∈PM​}. BBB is defined for k≥1k \ge 1k≥1 only, and every statement using it assumes k≥1k \ge 1k≥1 (resp. t≥1t \ge 1t≥1).

Not formalized: the running time O(ℓ(min⁡{k,t})3)O(\ell(\min\{k,t\})^3)O(ℓ(min{k,t})3) and the polynomial bound on the encoding size of Mˉ\bar MMˉ, bˉ\bar bbˉ in Theorem 6.4. The goal is the existence statement that the construction (13) witnesses. The standing assumptions of §7 (γ>0\gamma > 0γ>0; positive diagonal after the reduction) appear as hypotheses of the milestones that live in that setting.

Lemma 7.2 is stated about the specific elimination of the proof (p. 17), defined explicitly; an existential "there is Y≥0Y \ge 0Y≥0" form would be nearly trivial, since Y=0Y = 0Y=0 satisfies all but one clause. In the goal, Mˉ\bar MMˉ must have at most one positive and at most one negative entry per row, and ℓ′≤ℓ\ell' \le \ellℓ′≤ℓ. Dropping either requirement makes the goal weaker than the paper's theorem.

κ(i)\kappa(i)κ(i), defined in (12) through the elimination for an arbitrarily chosen arc, is restated intrinsically as the iii-th entry of (MDi,Di)−1γDi(M_{D_i,D_i})^{-1}\gamma_{D_i}(MDi​,Di​​)−1γDi​​, a number the paper shows equal (proof of Lemma 7.4(iii)). It is used only for i∈T2i \in T_2i∈T2​, where that block is invertible. Claim 7.3(i)–(ii) and Lemma 7.4(ii), which concern the elimination output for a particular arc, are not milestones.

A complete development needs the elimination and its invariants, reachability in a finite digraph, ranks of row submatrices, and the construction (13). The elimination lemmas are reusable for any Z+Z_+Z+​-matrix. Contributions are welcome on any milestone, on the reduction from rectangular MMM to the square positive-diagonal case, and on the two containments of the reduced case.

Selected references

  • J. Garg and L. A. Végh, A strongly polynomial algorithm for linear exchange markets, arXiv:1809.06266v3, 2022; Operations Research, 2023. https://arxiv.org/abs/1809.06266
  • N. Megiddo, Towards a genuinely polynomial algorithm for linear programming, SIAM Journal on Computing 12(2), 1983. https://doi.org/10.1137/0212022
  • D. S. Hochbaum and J. Naor, Simple and fast algorithms for linear and integer programs with two variables per inequality, SIAM Journal on Computing 23(6), 1994. https://doi.org/10.1137/S0097539793251876
  • R. W. Cottle and A. F. Veinott, Jr., Polyhedral sets having a least element, Mathematical Programming 3, 1972. https://doi.org/10.1007/BF01584975
11 thms2 active usersReviewed
Information TheoryQuantum Error CorrectionQuantum Information·Captain: mikedeng1

Reversing quantum dynamics with near-optimal quantum and classical fidelity I: The Reversal Operation Attains at Least the Square of the Optimal Average Entanglement FidelityResearch Paper

Motivation

Quantum error correction and quantum communication both ask the same question: after a known noise process A\mathcal AA has acted on a quantum system, how well can its effect be undone? For a given noise model the best recovery is the solution of a semidefinite program, which gives a number but no structure and no formula. Barnum and Knill showed in 2000 that a single, explicit recovery map, built from A\mathcal AA and the input state alone, is always close to the best one: its fidelity is at least the square of the optimal fidelity (arXiv:quant-ph/0004088). The map they use is now usually called the Petz recovery map or transpose channel; Petz had introduced it in operator-algebraic work on sufficiency (Petz 1986; Petz 1988). Near-optimality results of this kind underlie approximate quantum error correction and the later theory of recoverability in quantum information.

Timeline.

  • 1986–1988, D. Petz: the map ρ1/2A†(A(ρ)−1/2 ⋅ A(ρ)−1/2)ρ1/2\rho^{1/2}\mathcal A^\dagger(\mathcal A(\rho)^{-1/2}\,\cdot\,\mathcal A(\rho)^{-1/2})\rho^{1/2}ρ1/2A†(A(ρ)−1/2⋅A(ρ)−1/2)ρ1/2 characterizes when a channel can be reversed exactly on a family of states.
  • 2002, Barnum and Knill (J. Math. Phys. 43, 2097; doi:10.1063/1.1459754): in the published version, the reversal operation achieves at least the square of the optimal entanglement fidelity for a single input state.
  • arXiv v2 of the same paper (the source of this mission): the published Eq. (34) had dropped the ensemble weights; with that corrected, the bound holds for the average entanglement fidelity of any ensemble of commuting density matrices (Acknowledgments, p. 14).

Setting

A finite-dimensional quantum system is described by complex n×nn\times nn×n matrices; X†X^\daggerX† is the conjugate transpose, and a density matrix is a positive semidefinite matrix of trace one. A completely positive map A\mathcal AA is given by a finite decomposition A∼{Ai}i\mathcal A\sim\{A_i\}_iA∼{Ai​}i​ of matrices and acts by

A(X)=∑iAiXAi†.\mathcal A(X)=\sum_iA_iXA_i^\dagger .A(X)=i∑​Ai​XAi†​.

It is trace-preserving if ∑iAi†Ai=I\sum_iA_i^\dagger A_i=I∑i​Ai†​Ai​=I and trace-nonincreasing if ∑iAi†Ai≤I\sum_iA_i^\dagger A_i\le I∑i​Ai†​Ai​≤I in the Loewner order. The composite RA\mathcal R\mathcal ARA has decomposition {RkAi}(k,i)\{R_kA_i\}_{(k,i)}{Rk​Ai​}(k,i)​.

For a state ρ\rhoρ the paper defines the reversal operation

RA,ρ∼{ρ1/2Ai† A(ρ)−1/2}i,\mathcal R_{\mathcal A,\rho}\sim\{\rho^{1/2}A_i^\dagger\,\mathcal A(\rho)^{-1/2}\}_i,RA,ρ​∼{ρ1/2Ai†​A(ρ)−1/2}i​,

under the standing assumption that A(ρ)\mathcal A(\rho)A(ρ) has full support. Here X−1/2X^{-1/2}X−1/2 is the generalized inverse square root: invert the square roots of the non-zero eigenvalues and keep the zero eigenvalues.

Fidelities are measured by the entanglement fidelity Fe(ρ,K)=∑k∣tr⁡Kkρ∣2F_e(\rho,\mathcal K)=\sum_k|\operatorname{tr}K_k\rho|^2Fe​(ρ,K)=∑k​∣trKk​ρ∣2 of a map K∼{Kk}k\mathcal K\sim\{K_k\}_kK∼{Kk​}k​ and, for an ensemble E={pl,ρl}lE=\{p_l,\rho_l\}_lE={pl​,ρl​}l​ (weights pl≥0p_l\ge0pl​≥0 summing to one, density matrices ρl\rho_lρl​), by the average entanglement fidelity

Fˉe(E,K)=∑lplFe(ρl,K).\bar F_e(E,\mathcal K)=\sum_lp_lF_e(\rho_l,\mathcal K).Fˉe​(E,K)=l∑​pl​Fe​(ρl​,K).

When ρ=∑ipi∣i⟩⟨i∣\rho=\sum_ip_i|i\rangle\langle i|ρ=∑i​pi​∣i⟩⟨i∣ in an orthonormal eigenbasis, the classical fidelity is Fcl(ρ,K)=∑ipi⟨i∣K(∣i⟩⟨i∣)∣i⟩F_{\mathrm{cl}}(\rho,\mathcal K)=\sum_ip_i\langle i|\mathcal K(|i\rangle\langle i|)|i\rangleFcl​(ρ,K)=∑i​pi​⟨i∣K(∣i⟩⟨i∣)∣i⟩, the average entanglement fidelity of the ensemble of eigenstates.

Formalization targets

Goal: Theorem 3 (p. 7)

Let A\mathcal AA be trace-preserving, E={pl,ρl}lE=\{p_l,\rho_l\}_lE={pl​,ρl​}l​ an ensemble of pairwise commuting density matrices, ρ=∑lplρl\rho=\sum_lp_l\rho_lρ=∑l​pl​ρl​, and assume A(ρ)\mathcal A(\rho)A(ρ) has full support. Then for every trace-preserving completely positive R\mathcal RR,

Fˉe(E,RA,ρA)  ≥  Fˉe(E,RA)2.\bar F_e(E,\mathcal R_{\mathcal A,\rho}\mathcal A)\;\ge\;\bar F_e(E,\mathcal R\mathcal A)^2 .Fˉe​(E,RA,ρ​A)≥Fˉe​(E,RA)2.

Milestones

The milestones follow the paper's proof:

  1. Lemma 1 (p. 7): RA,ρ\mathcal R_{\mathcal A,\rho}RA,ρ​ depends only on the map A\mathcal AA, not on its decomposition.
  2. (14)–(15) (p. 7): after replacing RkR_kRk​ by PCRkP_CR_kPC​Rk​ (PCP_CPC​ the support projector of ρ\rhoρ), which leaves Fˉe\bar F_eFˉe​ unchanged and makes R\mathcal RR trace-nonincreasing, each Rk=ρ1/2Bk†A(ρ)−1/2R_k=\rho^{1/2}B_k^\dagger\mathcal A(\rho)^{-1/2}Rk​=ρ1/2Bk†​A(ρ)−1/2, and B(ρ)≤A(ρ)\mathcal B(\rho)\le\mathcal A(\rho)B(ρ)≤A(ρ).
  3. (28)–(32) (p. 9): ∑lpl∑i∣tr⁡ρlRilBil∣2≤∑lpl∑i,jtr⁡RilBjlρlBjl†Ril†\sum_lp_l\sum_i|\operatorname{tr}\rho_lR^l_iB^l_i|^2\le\sum_lp_l\sum_{i,j}\operatorname{tr}R^l_iB^l_j\rho_lB_j^{l\dagger}R_i^{l\dagger}∑l​pl​∑i​∣trρl​Ril​Bil​∣2≤∑l​pl​∑i,j​trRil​Bjl​ρl​Bjl†​Ril†​.
  4. (33)–(34) (p. 9): that sum equals tr⁡R(B(ρ))≤tr⁡R(A(ρ))≤1\operatorname{tr}\mathcal R(\mathcal B(\rho))\le\operatorname{tr}\mathcal R(\mathcal A(\rho))\le1trR(B(ρ))≤trR(A(ρ))≤1.

Two companions are also posed: Proposition 2, RA,ρ(A(ρ))=ρ\mathcal R_{\mathcal A,\rho}(\mathcal A(\rho))=\rhoRA,ρ​(A(ρ))=ρ, and Corollary 4, Fcl(ρ,RA)≤Fcl(ρ,RA,ρA)F_{\mathrm{cl}}(\rho,\mathcal R\mathcal A)\le\sqrt{F_{\mathrm{cl}}(\rho,\mathcal R_{\mathcal A,\rho}\mathcal A)}Fcl​(ρ,RA)≤Fcl​(ρ,RA,ρ​A)​ and Fe(ρ,RA)≤Fe(ρ,RA,ρA)F_e(\rho,\mathcal R\mathcal A)\le\sqrt{F_e(\rho,\mathcal R_{\mathcal A,\rho}\mathcal A)}Fe​(ρ,RA)≤Fe​(ρ,RA,ρ​A)​.

Significance

The result. Theorem 3 says that the error 1−Fˉe1-\bar F_e1−Fˉe​ of the reversal operation is at most twice the optimal error, since (1−η)2≥1−2η(1-\eta)^2\ge1-2\eta(1−η)2≥1−2η. It gives a closed-form recovery whose performance is within a factor two in error of the semidefinite optimum, for every noise process and every commuting ensemble. Taking the ensemble of eigenstates of ρ\rhoρ (Corollary 4) gives the same guarantee for classical information sent through a quantum channel; the companion mission (II of this series) applies the construction to state discrimination, where the reversal operation is the pretty good measurement.

Formalizing it. The result is proved on paper; none of it has a machine-checked proof that we know of. The mission asks for the full argument: the decomposition independence of the reversal map, the reduction to the support of ρ\rhoρ, the singular-value change of decomposition (17)–(18), the chain (19)–(26) of Cauchy–Schwarz inequalities, and the normalization (27)–(34). It also fixes in Lean the arXiv v2 statement (commuting ensembles), which is stronger than the published one.

Difficulty

The obvious approach is to compare RA,ρ\mathcal R_{\mathcal A,\rho}RA,ρ​ with an optimal R\mathcal RR term by term. That fails: the fidelity of RA\mathcal R\mathcal ARA is a sum of squared traces mixing the decompositions of R\mathcal RR and A\mathcal AA, and no termwise inequality relates it to the fidelity of RA,ρA\mathcal R_{\mathcal A,\rho}\mathcal ARA,ρ​A. The paper first rewrites every recovery in the shape of the reversal map, then chooses, for each ensemble member separately, new decompositions of A\mathcal AA and B\mathcal BB that diagonalize a coefficient matrix; making that choice legitimate needs the unitary freedom of Kraus decompositions, which Mathlib does not have. The commutation [ρ,ρl]=0[\rho,\rho_l]=0[ρ,ρl​]=0 is used to move fractional powers of ρ\rhoρ and ρl\rho_lρl​ past each other inside traces; without commutation the authors do not know whether the theorem holds (p. 10).

Formalization scope

  • Matrices are Matrix n n ℂ over a finite type n with decidable equality; Loewner order, square roots and functional calculus come from Mathlib (open scoped MatrixOrder). The map X↦∑iAiXAi†X\mapsto\sum_iA_iXA_i^\daggerX↦∑i​Ai​XAi†​ is the published PeresTerno.krausUpdate, referenced, not redefined.
  • Maps are unbundled Kraus families over arbitrary finite index types. The recovery R\mathcal RR in Theorem 3 ranges over every finite family with ∑kRk†Rk=I\sum_kR_k^\dagger R_k=I∑k​Rk†​Rk​=I.
  • X−1/2X^{-1/2}X−1/2 is cfc (fun x => (Real.sqrt x)⁻¹) X, the generalized inverse; Mathlib's junk matrix inverse is not used. The support projector is the functional calculus of the indicator of x≠0x\ne0x=0.
  • FeF_eFe​ is defined by the formula (8), which the paper derives from its purification definition. FclF_{\mathrm{cl}}Fcl​ takes an orthonormal eigenbasis and weights as data, with ρ=∑ipi∣i⟩⟨i∣\rho=\sum_ip_i|i\rangle\langle i|ρ=∑i​pi​∣i⟩⟨i∣ as a hypothesis.
  • Standing hypotheses, all from the paper: A\mathcal AA trace-preserving (§II's noise model); A(ρ)\mathcal A(\rho)A(ρ) positive definite (full support, p. 7); the ensemble is a probability vector of pairwise commuting density matrices with ρ=∑lplρl\rho=\sum_lp_l\rho_lρ=∑l​pl​ρl​.
  • In (34) the page prints tr⁡R(A(ρ))=1\operatorname{tr}\mathcal R(\mathcal A(\rho))=1trR(A(ρ))=1; after the replacement Rk↦PCRkR_k\mapsto P_CR_kRk​↦PC​Rk​ the map is only trace-nonincreasing, so the milestone states ≤1\le1≤1.
  • Trivializing encodings are ruled out: the reversal family is the literal formula (12) for the given A\mathcal AA and the ensemble's own ρ\rhoρ, and the fidelity of a composite map is (8) applied to the composite decomposition {RkAi}\{R_kA_i\}{Rk​Ai​}, never the right-hand side of the proof's chain.
  • Infrastructure a complete development needs, reusable beyond this mission: the unitary freedom of Kraus decompositions, the singular value decomposition of a complex square matrix, the trace Cauchy–Schwarz inequality for Hilbert–Schmidt products, and functional-calculus identities such as ρ1/2ρ−1/2=PC\rho^{1/2}\rho^{-1/2}=P_Cρ1/2ρ−1/2=PC​. Contributions of any of these as separate theorems are welcome. The pure-state, measurement form Popt2≤PPGM≤PoptP_{\mathrm{opt}}^2\le P_{\mathrm{PGM}}\le P_{\mathrm{opt}}Popt2​≤PPGM​≤Popt​ is already posed on the platform as QAlgorithms.Arunachalam.barnumKnill and is not repeated here.

Selected references

  • H. Barnum, E. Knill, Reversing quantum dynamics with near-optimal quantum and classical fidelity, arXiv:quant-ph/0004088v2. https://arxiv.org/abs/quant-ph/0004088
  • H. Barnum, E. Knill, same title, J. Math. Phys. 43, 2097 (2002). https://doi.org/10.1063/1.1459754
  • D. Petz, Sufficient subalgebras and the relative entropy of states of a von Neumann algebra, Commun. Math. Phys. 105, 123–131 (1986). https://doi.org/10.1007/BF01212345
  • D. Petz, Sufficiency of channels over von Neumann algebras, Quart. J. Math. 39, 97–108 (1988). https://doi.org/10.1093/qmath/39.1.97
  • B. Schumacher, Sending entanglement through noisy quantum channels, Phys. Rev. A 54, 2614 (1996). https://doi.org/10.1103/PhysRevA.54.2614
  • R. A. Horn, C. R. Johnson, Matrix Analysis, Cambridge University Press (1985), §7.3. https://doi.org/10.1017/CBO9780511810817
7 thms2 active usersReviewed
Information TheoryQuantum Error Correction·Captain: mikedeng1

Quantum LDPC Codes with Positive Rate and Minimum Distance Proportional to n^{1/2}: The Hypergraph Product of a Full-Rank [n,k,d] Parity-Check Matrix with Itself Is an [[n²+(n−k)², k², d]] CSS CodeResearch Paper

Motivation

Quantum computers need error correction, and the codes that are cheapest to run in hardware are quantum low-density parity-check (LDPC) codes: every check involves a bounded number of qubits, and every qubit takes part in a bounded number of checks. For a long time the only well-understood quantum LDPC codes were surface codes such as Kitaev's toric code, whose minimum distance grows like the square root of the length but which encode a fixed number of qubits, so their rate tends to zero. Tillich and Zémor (arXiv:0903.0566; IEEE Transactions on Information Theory, 2014; preliminary version ISIT 2009) gave the first general construction of quantum LDPC codes with positive rate and minimum distance proportional to N\sqrt NN​, from any classical LDPC code. Their hypergraph product became the standard building block of the field.

Timeline.

  • 1996: Calderbank–Shor and Steane introduce CSS codes, quantum codes built from two classical binary codes (quant-ph/9512032, quant-ph/9601029).
  • 1997: Kitaev's toric code: LDPC, distance Θ(N)\Theta(\sqrt N)Θ(N​), dimension 2 (quant-ph/9707021).
  • 2009: Tillich and Zémor: the hypergraph product, with positive rate and distance Θ(N)\Theta(\sqrt N)Θ(N​) (this mission).
  • 2020–2021: distance beyond N\sqrt NN​ for quantum LDPC codes: Nlog⁡N\sqrt N\log NN​logN by Evra, Kaufman and Zémor (arXiv:2004.07935); N3/5N^{3/5}N3/5 up to polylogarithmic factors by Hastings, Haah and O'Donnell (arXiv:2009.03921).
  • 2022: Panteleev and Kalachev construct asymptotically good quantum LDPC codes, using lifted products that generalize the hypergraph product (arXiv:2111.03654).

Setting

All codes are binary linear codes, subspaces of F2ι\mathbb F_2^{\iota}F2ι​ for a finite coordinate set ι\iotaι. The Hamming weight ∣x∣|x|∣x∣ of xxx is its number of nonzero coordinates. The minimum distance d(C)d(\mathcal C)d(C) of a code is the least weight of a nonzero codeword, with the convention d({0})=∞d(\{0\})=\inftyd({0})=∞.

A Tanner graph G=T(V,C,E)\mathcal G=\mathcal T(V,C,E)G=T(V,C,E) is the bipartite graph of a parity-check matrix H∈F2C×VH\in\mathbb F_2^{C\times V}H∈F2C×V​: the variable nodes VVV index the columns, the check nodes CCC index the rows, and c∼vc\sim vc∼v iff Hcv=1H_{cv}=1Hcv​=1. Its code is C=ker⁡H\mathcal C=\ker HC=kerH. The transpose Tanner graph GT\mathcal G^TGT is that of HTH^THT, and its code CT=ker⁡HT\mathcal C^T=\ker H^TCT=kerHT is the transpose code. It depends on the matrix HHH, not only on C\mathcal CC.

A CSS code is a pair (CX,CZ)(\mathcal C_X,\mathcal C_Z)(CX​,CZ​) of codes of the same length NNN with CZ⊥⊆CX\mathcal C_Z^\perp\subseteq\mathcal C_XCZ⊥​⊆CX​. Its quantum dimension and quantum minimum distance are

kQ=dim⁡(CX/CZ⊥),dQ=min⁡(dX,dZ),dX=min⁡{∣x∣:x∈CX∖CZ⊥},k_Q=\dim(\mathcal C_X/\mathcal C_Z^\perp),\qquad d_Q=\min(d_X,d_Z),\quad d_X=\min\{|x|:x\in\mathcal C_X\setminus\mathcal C_Z^\perp\},kQ​=dim(CX​/CZ⊥​),dQ​=min(dX​,dZ​),dX​=min{∣x∣:x∈CX​∖CZ⊥​},

with dZd_ZdZ​ defined symmetrically and min⁡∅=∞\min\emptyset=\inftymin∅=∞.

Given H1∈F2C1×V1H_1\in\mathbb F_2^{C_1\times V_1}H1​∈F2C1​×V1​​ and H2∈F2C2×V2H_2\in\mathbb F_2^{C_2\times V_2}H2​∈F2C2​×V2​​ with Tanner graphs G1,G2\mathcal G_1,\mathcal G_2G1​,G2​, the code Q(G1×G2)\mathcal Q(\mathcal G_1\times\mathcal G_2)Q(G1​×G2​) has qubits (V1×V2)⊔(C1×C2)(V_1\times V_2)\sqcup(C_1\times C_2)(V1​×V2​)⊔(C1​×C2​) and check matrices

HX=(H1⊗IV2 ∣ IC1⊗H2T),HZ=(IV1⊗H2 ∣ H1T⊗IC2),H_X=\big(H_1\otimes I_{V_2}\ \big|\ I_{C_1}\otimes H_2^T\big),\qquad H_Z=\big(I_{V_1}\otimes H_2\ \big|\ H_1^T\otimes I_{C_2}\big),HX​=(H1​⊗IV2​​ ​ IC1​​⊗H2T​),HZ​=(IV1​​⊗H2​ ​ H1T​⊗IC2​​),

with CX=ker⁡HX\mathcal C_X=\ker H_XCX​=kerHX​ and CZ=ker⁡HZ\mathcal C_Z=\ker H_ZCZ​=kerHZ​. Write ki=dim⁡Cik_i=\dim\mathcal C_iki​=dimCi​, kiT=dim⁡CiTk_i^T=\dim\mathcal C_i^TkiT​=dimCiT​, di=d(Ci)d_i=d(\mathcal C_i)di​=d(Ci​) and diT=d(CiT)d_i^T=d(\mathcal C_i^T)diT​=d(CiT​).

Formalization targets

Goal: Theorem 1 (p. 3)

Let HHH be a full-rank (n−k)×n(n-k)\times n(n−k)×n parity-check matrix of an [n,k,d][n,k,d][n,k,d] code. The code Q(G×G)\mathcal Q(\mathcal G\times\mathcal G)Q(G×G) built from two copies of its Tanner graph is a CSS code with

N=n2+(n−k)2,kQ=k2,dQ=d,N=n^2+(n-k)^2,\qquad k_Q=k^2,\qquad d_Q=d,N=n2+(n−k)2,kQ​=k2,dQ​=d,

and each row of HXH_XHX​ and HZH_ZHZ​ has weight i+ji+ji+j, with iii a row weight and jjj a column weight of HHH.

General results

  • Proposition 14 (dimension): kQ=k1k2+k1Tk2Tk_Q=k_1k_2+k_1^Tk_2^TkQ​=k1​k2​+k1T​k2T​ for any two Tanner graphs.
  • Theorem 15 (distance): dQ≥m:=min⁡(d1,d2,d1T,d2T)d_Q\ge m:=\min(d_1,d_2,d_1^T,d_2^T)dQ​≥m:=min(d1​,d2​,d1T​,d2T​), with dQ=md_Q=mdQ​=m whenever di=md_i=mdi​=m and d3−i≠∞d_{3-i}\ne\inftyd3−i​=∞, or diT=md_i^T=mdiT​=m and d3−iT≠∞d_{3-i}^T\ne\inftyd3−iT​=∞, for some i∈{1,2}i\in\{1,2\}i∈{1,2}.

The milestones follow the paper. They are Proposition 4 (validity), eq. (4), Fact 12 and Propositions 9, 10, 13 (product codes and transposes), which lead to Proposition 14. Then come eq. (17), the weight claim and Lemma 16 (lower bound), and the two claims of p. 17 and Lemma 17 (upper bound), which lead to Theorem 15. The degree count of p. 11 gives the row weights.

Significance

The result. The construction needs no orthogonality between the input codes: any two parity-check matrices give a valid CSS code. Its parameters are read off the classical inputs. A family of classical LDPC codes with fixed rate and linear distance therefore gives quantum LDPC codes with fixed rate and distance Θ(N)\Theta(\sqrt N)Θ(N​), and sparse inputs give sparse stabilizers. The toric code is the special case where both inputs are cycle graphs. The hypergraph product is also the base case of the later homological and lifted-product constructions, and the source of the standard decoding and fault-tolerance results for these codes.

Formalizing it. The theorem is proved in the paper; what is missing is a machine-checked proof. The platform holds the toric code's distance and dimension (ToricCode.toric_distance, ToricCode.toric_homologyRank), but over its own chain complex, not over a general construction. This mission produces a reusable layer: Tanner graphs as binary matrices, CSS dimension and distance with the ∞\infty∞ convention, product codes, and the parameters of the hypergraph product for arbitrary finite index sets.

Difficulty

The dimension count is linear algebra once the codes ker⁡HXT\ker H_X^TkerHXT​ and ker⁡HZT\ker H_Z^TkerHZT​ have been identified with product codes. The obstacle is the distance. Lower bounds on the minimum weights of CX\mathcal C_XCX​ and CZ\mathcal C_ZCZ​ themselves are useless: CZ⊥⊆CX\mathcal C_Z^\perp\subseteq\mathcal C_XCZ⊥​⊆CX​ contains the rows of HZH_ZHZ​, which have constant weight, so the minimum weight of CX\mathcal C_XCX​ is bounded by a constant. Any bound of order min⁡(d1,d2,d1T,d2T)\min(d_1,d_2,d_1^T,d_2^T)min(d1​,d2​,d1T​,d2T​) must use the definition of dXd_XdX​ over CX∖CZ⊥\mathcal C_X\setminus\mathcal C_Z^\perpCX​∖CZ⊥​ and show that every low-weight codeword of CX\mathcal C_XCX​ is degenerate, i.e. lies in CZ⊥\mathcal C_Z^\perpCZ⊥​. The upper bound needs an explicit codeword of CX\mathcal C_XCX​ outside CZ⊥\mathcal C_Z^\perpCZ⊥​, and showing that it is not in CZ⊥\mathcal C_Z^\perpCZ⊥​ requires an argument of its own.

Formalization scope

Lean represents a Tanner graph by its matrix H : Matrix C V (ZMod 2) over arbitrary finite index types. The code is ker H, the transpose code is ker Hᵀ, and the dual code is CodingTheory.dualCode from the published definition CodingTheory. Hamming weight is Mathlib's hammingNorm. Minimum distances live in ℕ∞, where the empty infimum is ⊤, the paper's ∞\infty∞. kQk_QkQ​ is the dimension of the quotient of CX\mathcal C_XCX​ by CZ⊥∩CX\mathcal C_Z^\perp\cap\mathcal C_XCZ⊥​∩CX​. In HXH_XHX​ and HZH_ZHZ​ the qubits are ordered (V1×V2)⊔(C1×C2)(V_1\times V_2)\sqcup(C_1\times C_2)(V1​×V2​)⊔(C1​×C2​), as on p. 18. A product code is a set of ι1×ι2\iota_1\times\iota_2ι1​×ι2​ matrices whose columns (fixed second coordinate) lie in the first code. The general results are stated without nonemptiness assumptions; they hold for empty index sets.

Theorem 1 has two disclosed differences from the page:

  • It adds the hypothesis k≤nk\le nk≤n, which is implicit in "[n,k,d][n,k,d][n,k,d]". Without it the matrix has no rows and the dimension claim fails.
  • It drops the word "LDPC", a property of families of codes. Its finite content is the row-weight clause, which is kept.

"There is a construction" is formalized as the paper's construction, the hypergraph product of HHH with itself.

Several encodings would trivialize the statements and are excluded: an N\mathbb NN-valued minimum distance that is 000 on the zero code; dXd_XdX​ taken over CX∖{0}\mathcal C_X\setminus\{0\}CX​∖{0} instead of CX∖CZ⊥\mathcal C_X\setminus\mathcal C_Z^\perpCX​∖CZ⊥​; kQk_QkQ​ computed by truncated natural subtraction; an existential "there is a code with these parameters"; and the transpose code replaced by the dual code.

A complete development needs ranks and kernels of Kronecker products over F2\mathbb F_2F2​, dimensions of product codes (Proposition 9, not in Mathlib), and the restriction of Tanner graphs to induced subgraphs. The product-code and CSS layers are reusable beyond this mission. Proofs of any milestone are welcome, as are alternative arguments for Proposition 14 via the Künneth formula.

Selected references

  • J.-P. Tillich and G. Zémor, Quantum LDPC codes with positive rate and minimum distance proportional to the square root of the blocklength, IEEE Transactions on Information Theory 60(2), 2014; preprint arXiv:0903.0566v2. https://arxiv.org/abs/0903.0566 , https://doi.org/10.1109/TIT.2013.2292061
  • A. R. Calderbank and P. W. Shor, Good quantum error-correcting codes exist, Physical Review A 54, 1996. https://arxiv.org/abs/quant-ph/9512032
  • A. M. Steane, Multiple particle interference and quantum error correction, Proceedings of the Royal Society A 452, 1996. https://arxiv.org/abs/quant-ph/9601029
  • A. Yu. Kitaev, Fault-tolerant quantum computation by anyons, Annals of Physics 303, 2003. https://arxiv.org/abs/quant-ph/9707021
  • F. J. MacWilliams and N. J. A. Sloane, The Theory of Error-Correcting Codes, North-Holland, 1977, Ch. 18 §2 (product codes).
  • S. Evra, T. Kaufman and G. Zémor, Decodable quantum LDPC codes beyond the √n distance barrier using high-dimensional expanders, FOCS 2020. https://arxiv.org/abs/2004.07935
  • M. B. Hastings, J. Haah and R. O'Donnell, Fiber bundle codes: breaking the N^{1/2} polylog(N) barrier for quantum LDPC codes, STOC 2021. https://arxiv.org/abs/2009.03921
  • P. Panteleev and G. Kalachev, Asymptotically good quantum and locally testable classical LDPC codes, STOC 2022. https://arxiv.org/abs/2111.03654
  • N. P. Breuckmann and J. N. Eberhardt, Quantum low-density parity-check codes, PRX Quantum 2, 2021. https://arxiv.org/abs/2103.06309
18 thms2 active usersReviewed
Quantum InformationTheoretical Computer Science·Captain: mikedeng1

Learning Stabilizer States by Bell Sampling: Algorithm 1 Identifies an n-Qubit Stabilizer State from 5n+2 Copies, Failing with Probability at Most 2⁻ⁿResearch Paper

Motivation

Determining an unknown quantum state of nnn qubits to good accuracy requires, in general, a number of copies of the state exponential in nnn; this follows from Holevo's theorem. One way around this barrier is to restrict the class of states. Stabilizer states are the natural candidate: they are the states produced from ∣0n⟩|0^n\rangle∣0n⟩ by Clifford circuits, they underlie quantum error-correcting codes, measurement-based computation and randomized benchmarking, and there are 2Θ(n2)2^{\Theta(n^2)}2Θ(n2) of them, so Ω(n)\Omega(n)Ω(n) copies are necessary to identify one.

Timeline.

  • Aaronson and Gottesman (2008, Identifying stabilizer states, talk, http://pirsa.org/08080052/) described a procedure identifying an unknown stabilizer state from O(n2)O(n^2)O(n2) copies with single-copy measurements, and a variant using O(n)O(n)O(n) copies with measurements collective across all copies.
  • Low (2009, arXiv:0907.2833) showed that a Clifford unitary can be identified from O(n2)O(n^2)O(n2) uses, or O(n)O(n)O(n) with access to its inverse.
  • Rocchetto (2017, arXiv:1705.00345) showed that stabilizer states are PAC-learnable efficiently.
  • Montanaro (2017, arXiv:1707.04012) gave the algorithm of this mission: O(n)O(n)O(n) copies, collective measurements on at most two copies at a time, failure probability exponentially small in nnn. Zhao, Pérez-Delgado and Fitzsimons obtained a related O(n)O(n)O(n)-copy algorithm for graph states independently (arXiv:1510.03742).

Bell sampling became a standard tool after this paper, for instance in stabilizer testing (Gross, Nezami and Walter, arXiv:1712.08628), so a machine-checked version of its analysis is a reusable base.

Setting

A state of nnn qubits is a vector ψ:{0,1}n→C\psi:\{0,1\}^n\to\mathbb Cψ:{0,1}n→C; its complex conjugate ψ∗\psi^*ψ∗ is taken entrywise in the computational basis. The paper uses the four 2×22\times22×2 matrices

σ00=(1001), σ01=(0110), σ10=(100−1), σ11=σ10σ01=(01−10),\sigma_{00}=\begin{pmatrix}1&0\\0&1\end{pmatrix},\ \sigma_{01}=\begin{pmatrix}0&1\\1&0\end{pmatrix},\ \sigma_{10}=\begin{pmatrix}1&0\\0&-1\end{pmatrix},\ \sigma_{11}=\sigma_{10}\sigma_{01}=\begin{pmatrix}0&1\\-1&0\end{pmatrix},σ00​=(10​01​), σ01​=(01​10​), σ10​=(10​0−1​), σ11​=σ10​σ01​=(0−1​10​),

which are the Pauli matrices up to the factor −i-i−i on σ11\sigma_{11}σ11​. For a string s∈{0,1}2ns\in\{0,1\}^{2n}s∈{0,1}2n, σs=σs1s2⊗⋯⊗σs2n−1s2n\sigma_s=\sigma_{s_1s_2}\otimes\cdots\otimes\sigma_{s_{2n-1}s_{2n}}σs​=σs1​s2​​⊗⋯⊗σs2n−1​s2n​​; strings are added bitwise, s⊕ts\oplus ts⊕t.

The Bell basis of C4\mathbb C^4C4 is ∣σ00⟩=12(∣00⟩+∣11⟩)|\sigma_{00}\rangle=\frac1{\sqrt2}(|00\rangle+|11\rangle)∣σ00​⟩=2​1​(∣00⟩+∣11⟩), ∣σ01⟩=12(∣01⟩+∣10⟩)|\sigma_{01}\rangle=\frac1{\sqrt2}(|01\rangle+|10\rangle)∣σ01​⟩=2​1​(∣01⟩+∣10⟩), ∣σ10⟩=12(∣00⟩−∣11⟩)|\sigma_{10}\rangle=\frac1{\sqrt2}(|00\rangle-|11\rangle)∣σ10​⟩=2​1​(∣00⟩−∣11⟩), ∣σ11⟩=12(∣01⟩−∣10⟩)|\sigma_{11}\rangle=\frac1{\sqrt2}(|01\rangle-|10\rangle)∣σ11​⟩=2​1​(∣01⟩−∣10⟩). Bell sampling on 2n2n2n qubits A1,…,An,B1,…,BnA_1,\dots,A_n,B_1,\dots,B_nA1​,…,An​,B1​,…,Bn​ measures each pair AiBiA_iB_iAi​Bi​ in the Bell basis and returns a string r∈{0,1}2nr\in\{0,1\}^{2n}r∈{0,1}2n. On two copies ∣ψ⟩∣ψ⟩|\psi\rangle|\psi\rangle∣ψ⟩∣ψ⟩ (first copy on the AAA's) the outcome rrr has probability pψ(r)=∣⟨σr∣ ψ⊗ψ⟩∣2p_\psi(r)=|\langle\sigma_r|\,\psi\otimes\psi\rangle|^2pψ​(r)=∣⟨σr​∣ψ⊗ψ⟩∣2.

A stabilizer state is ψ=U∣0n⟩\psi=U|0^n\rangleψ=U∣0n⟩ for a Clifford unitary UUU (a unitary normalising the Pauli group). Its stabilizer set T(ψ)⊆F22nT(\psi)\subseteq\mathbb F_2^{2n}T(ψ)⊆F22n​ is the set of strings ttt for which ψ\psiψ is an eigenvector of σt\sigma_tσt​, i.e. those σt\sigma_tσt​ that lie in the stabilizer group of ψ\psiψ up to a phase.

Algorithm 1. Bell-sample two fresh copies to get r0r_0r0​; repeat 2n2n2n times to get r1,…,r2nr_1,\dots,r_{2n}r1​,…,r2n​; find a basis BBB of span⁡{ri⊕r0}\operatorname{span}\{r_i\oplus r_0\}span{ri​⊕r0​}; for each element of BBB measure one copy of ψ\psiψ in the eigenbasis of the corresponding (Hermitian) Pauli matrix MMM to learn whether M∣ψ⟩=+∣ψ⟩M|\psi\rangle=+|\psi\rangleM∣ψ⟩=+∣ψ⟩ or −∣ψ⟩-|\psi\rangle−∣ψ⟩. It uses 5n+25n+25n+2 copies.

Formalization targets

Goal: Theorem 1, explicit form

For every nnn and every nnn-qubit stabilizer state ψ\psiψ, with the 2n+12n+12n+1 Bell samples independent,

Pr⁡[span⁡{ri⊕r0:1≤i≤2n}=T(ψ)] ≥ 1−2−n,\Pr\bigl[\operatorname{span}\{r_i\oplus r_0:1\le i\le 2n\}=T(\psi)\bigr]\ \ge\ 1-2^{-n},Pr[span{ri​⊕r0​:1≤i≤2n}=T(ψ)] ≥ 1−2−n,

and for every basis b1,…,bnb_1,\dots,b_nb1​,…,bn​ of T(ψ)T(\psi)T(ψ) with Hermitian Paulis MjM_jMj​, each Mjψ=±ψM_j\psi=\pm\psiMj​ψ=±ψ and every vector with the same eigenvalues under all MjM_jMj​ is a scalar multiple of ψ\psiψ. Together: Algorithm 1 identifies ψ\psiψ except with probability at most 2−n2^{-n}2−n.

Milestones

  1. σsσt=±σs⊕t\sigma_s\sigma_t=\pm\sigma_{s\oplus t}σs​σt​=±σs⊕t​.
  2. Lemma 2: pψ(r)=∣⟨ψ∣σr∣ψ∗⟩∣2/2np_\psi(r)=|\langle\psi|\sigma_r|\psi^*\rangle|^2/2^npψ​(r)=∣⟨ψ∣σr​∣ψ∗⟩∣2/2n.
  3. The Bell-sampling probabilities of a unit vector sum to 111.
  4. For a stabilizer state, ∣ψ∗⟩=c σ10⊗S∣ψ⟩|\psi^*\rangle=c\,\sigma_{10}^{\otimes S}|\psi\rangle∣ψ∗⟩=cσ10⊗S​∣ψ⟩ with ∣c∣=1|c|=1∣c∣=1.
  5. Eqn (1): pψ(r)=∣⟨ψ∣σrσ10⊗S∣ψ⟩∣2/2np_\psi(r)=|\langle\psi|\sigma_r\sigma_{10}^{\otimes S}|\psi\rangle|^2/2^npψ​(r)=∣⟨ψ∣σr​σ10⊗S​∣ψ⟩∣2/2n.
  6. T(ψ)T(\psi)T(ψ) is an nnn-dimensional subspace of F22n\mathbb F_2^{2n}F22n​.
  7. ⟨ψ∣σt∣ψ⟩=0\langle\psi|\sigma_t|\psi\rangle=0⟨ψ∣σt​∣ψ⟩=0 for t∉T(ψ)t\notin T(\psi)t∈/T(ψ).
  8. pψp_\psipψ​ is uniform on a coset {t⊕s:t∈T}\{t\oplus s:t\in T\}{t⊕s:t∈T}.
  9. For two independent outcomes, r1⊕r2r_1\oplus r_2r1​⊕r2​ is uniform on TTT.
  10. TTT and the signs on a basis of TTT determine ψ\psiψ up to a scalar.
  11. 2n2n2n uniform samples of an nnn-dimensional F2\mathbb F_2F2​-space fail to span it with probability at most 2−n2^{-n}2−n.

Significance

The theorem gives a learning algorithm whose copy complexity O(n)O(n)O(n) is optimal and whose measurements are simple: one Bell measurement on corresponding qubits of two copies. Its analysis isolates a structural fact about stabilizer states, that Bell sampling on two copies produces a uniformly random element of a coset of the stabilizer subspace, which is the engine of later work on stabilizer testing and on learning states with few non-Clifford gates.

The result is proved in the paper; no machine-checked proof of it is known. A complete formalization adds: the stabilizer formalism in a form usable from the definition "U∣0n⟩U|0^n\rangleU∣0n⟩ for a Clifford UUU" (the subspace TTT, its dimension, vanishing expectations off TTT, determination by signs); the conjugation identity, which the paper takes from a normal form cited from the literature; and the probabilistic bookkeeping of the algorithm with its exact constants.

Difficulty

The probability calculations (Lemma 2, eqn (1), the union bound) are finite sums. The difficulty lies in the stabilizer structure. The platform's definition of a stabilizer state is the image of ∣0n⟩|0^n\rangle∣0n⟩ under a Clifford unitary; from it one must derive that the strings whose σt\sigma_tσt​ fixes ψ\psiψ up to phase form an nnn-dimensional subspace, that all other Pauli expectations vanish, and that ψ∗\psi^*ψ∗ differs from ψ\psiψ by a diagonal Pauli. The paper obtains the last fact from the Dehaene–De Moor normal form ψ∝∑x∈Aiℓ(x)(−1)q(x)∣x⟩\psi\propto\sum_{x\in A}i^{\ell(x)}(-1)^{q(x)}|x\rangleψ∝∑x∈A​iℓ(x)(−1)q(x)∣x⟩, a cited theorem whose proof is not on the page; formalizing either that normal form or a direct substitute is the central step. The natural shortcut, treating TTT as given with "uniform outcomes on TTT" as a hypothesis, proves only the counting lemma and is ruled out below.

Formalization scope

  • States are StabilizerRank.QState n = (Fin n → Bool) → ℂ and stabilizer states are StabilizerRank.IsStabilizerState (published platform definition, referenced). Qubit iii is coordinate iii, false =0=0=0.
  • Strings {0,1}2n\{0,1\}^{2n}{0,1}2n are encoded as Fin n → ZMod 2 × ZMod 2, coordinate iii the pair (s2i−1,s2i)(s_{2i-1},s_{2i})(s2i−1​,s2i​) of qubit iii; ⊕\oplus⊕ is +.
  • σ11\sigma_{11}σ11​ is the page's (01−10)\begin{pmatrix}0&1\\-1&0\end{pmatrix}(0−1​10​), not the Pauli YYY. The "corresponding Pauli matrix" of step 5 is the Hermitian (−i)#{i:ti=11}σt(-i)^{\#\{i:t_i=11\}}\sigma_t(−i)#{i:ti​=11}σt​; the page does not fix this phase.
  • The Bell outcome law is the Born rule with ψ(x)ψ(y)\psi(x)\psi(y)ψ(x)ψ(y) the amplitude of ∣ψ⟩∣ψ⟩|\psi\rangle|\psi\rangle∣ψ⟩∣ψ⟩ at ∣x⟩A∣y⟩B|x\rangle_A|y\rangle_B∣x⟩A​∣y⟩B​.
  • Algorithm 1 is modelled by its outcome law: the 2n+12n+12n+1 samples are independent (fresh copies), and an event has probability ∑1E pψ(r0)∏ipψ(ri)\sum \mathbf 1_E\,p_\psi(r_0)\prod_i p_\psi(r_i)∑1E​pψ​(r0​)∏i​pψ​(ri​). Step 5 is deterministic once a basis of TTT is known, and is stated as a property of every such basis.
  • The explicit constants of p. 2 replace "O(n)O(n)O(n)" and "exponentially small": 2n+12n+12n+1 Bell samples, success probability at least 1−2−n1-2^{-n}1−2−n (the page's "fails with probability at most 2−n2^{-n}2−n", in a form that a mis-normalised outcome law cannot satisfy). The count 5n+25n+25n+2 and "at most two copies at a time" are properties of the model, not separate clauses. The running time O(n3)O(n^3)O(n3) is not formalized.
  • Lemma 2 is stated for every vector, not only unit vectors (the identity is homogeneous). The conjugation identity carries a unit phase ccc, which the page omits. "⟨ψ∣M∣ψ⟩=0\langle\psi|M|\psi\rangle=0⟨ψ∣M∣ψ⟩=0 for M∉GM\notin GM∈/G" is stated for strings outside TTT.
  • Ruled out: TTT as a hypothesis (it is always computed from ψ\psiψ), dropping the reference sample r0r_0r0​ or the independence of the samples, a degenerate outcome law, and reading "identifies" as "the samples span TTT" without the sign step.

Needed infrastructure: Kronecker-product manipulations of σs\sigma_sσs​ indexed by bit strings, the Bell basis as an orthonormal basis of (C2⊗C2)⊗n(\mathbb C^2\otimes\mathbb C^2)^{\otimes n}(C2⊗C2)⊗n, the stabilizer formalism over F22n\mathbb F_2^{2n}F22n​, and counting hyperplanes of finite F2\mathbb F_2F2​-spaces. The stabilizer-formalism layer and the union bound are reusable beyond this mission. Contributions to any milestone are welcome, in particular direct proofs of milestones 4, 6 and 7 from the Clifford definition.

Selected references

  • A. S. Holevo, Bounds for the quantity of information transmitted by a quantum communication channel, Problems of Information Transmission 9:177–183, 1973.
  • D. Gross, S. Nezami and M. Walter, Schur–Weyl duality for the Clifford group with applications: property testing, a robust Hudson theorem, and de Finetti representations, Comm. Math. Phys. 385:1325–1393, 2021. https://arxiv.org/abs/1712.08628
  • A. Montanaro, Learning stabilizer states by Bell sampling, arXiv preprint, 2017. https://arxiv.org/abs/1707.04012
  • S. Aaronson and D. Gottesman, Identifying stabilizer states, PIRSA talk, 2008. http://pirsa.org/08080052/
  • R. Low, Learning and testing algorithms for the Clifford group, Phys. Rev. A 80:052314, 2009. https://arxiv.org/abs/0907.2833
  • A. Rocchetto, Stabiliser states are efficiently PAC-learnable, arXiv preprint, 2017. https://arxiv.org/abs/1705.00345
  • L. Zhao, C. Pérez-Delgado and J. Fitzsimons, Fast graph operations in quantum computation, Phys. Rev. A 93:032314, 2016. https://arxiv.org/abs/1510.03742
  • J. Dehaene and B. De Moor, Clifford group, stabilizer states, and linear and quadratic operations over GF(2), Phys. Rev. A 68:042318, 2003. https://arxiv.org/abs/quant-ph/0304125
  • M. Van den Nest, Classical simulation of quantum computation, the Gottesman–Knill theorem, and slightly beyond, Quantum Inf. Comput. 10:258, 2010. https://arxiv.org/abs/0811.0898
  • S. Aaronson, The learnability of quantum states, Proc. R. Soc. A 463:3089, 2007. https://arxiv.org/abs/quant-ph/0608142
14 thms2 active usersReviewed
Control TheoryConvex OptimizationOptimization·Captain: mikedeng1

Quadratic Matrix Inequalities with Applications to Data-Based Control V: A Reduced LMI in P Alone and an Explicit Data-Based Stabilizing GainResearch Paper

Motivation

Data-driven control asks for a controller computed directly from measured trajectories of an unknown system, without first identifying a model. When the measurements are corrupted by noise, many systems explain the same data, and a controller is acceptable only if it works for all of them. Van Waarde, Camlibel, Eising and Trentelman (arXiv:2203.12959) model the noise by a quadratic matrix inequality (QMI). The set of systems consistent with the data is then itself the solution set of a QMI, and the design question becomes whether one QMI implies another. Their Theorem 5.1 gives a necessary and sufficient linear matrix inequality (LMI) for the existence of a common stabilizing controller, with no rank or Slater-type assumption on the data. It improves van Waarde, Camlibel, Mesbahi, IEEE TAC 2022, Thm. 14, which needed a generalized Slater condition.

The LMI of Theorem 5.1 has size 4n+m+14n+m+14n+m+1 and n(n+1)2+nm+1\tfrac{n(n+1)}{2}+nm+12n(n+1)​+nm+1 unknowns. Section 5.2 of the paper removes the controller variable: Theorem 5.3 gives an LMI of size 4n+14n+14n+1 in the Lyapunov matrix PPP and one scalar β\betaβ, and then writes a stabilizing controller as a closed-form expression in PPP and the data. This mission formalizes that reduction and the Section 3 results on QMI solution sets that it rests on.

Setting

All matrices are real. Sk\mathbb S^kSk is the set of symmetric k×kk\times kk×k matrices, A≥0A\ge 0A≥0 (A>0A>0A>0) means symmetric positive semidefinite (definite), and A†A^\daggerA† is the Moore–Penrose pseudo-inverse. For Π∈Sq+r\Pi\in\mathbb S^{q+r}Π∈Sq+r, partitioned with Π11\Pi_{11}Π11​ of size q×qq\times qq×q and Π22\Pi_{22}Π22​ of size r×rr\times rr×r,

Zr(Π)={Z∈Rr×q:[IqZ]⊤Π[IqZ]≥0},\mathcal Z_r(\Pi) = \Big\{Z\in\mathbb R^{r\times q} : \begin{bmatrix} I_q\\ Z\end{bmatrix}^\top\Pi\begin{bmatrix} I_q\\ Z\end{bmatrix}\ge 0\Big\},Zr​(Π)={Z∈Rr×q:[Iq​Z​]⊤Π[Iq​Z​]≥0},

and Zr+(Π)\mathcal Z_r^+(\Pi)Zr+​(Π) is the same set with >0>0>0. The generalized Schur complement is Π ∣ Π22=Π11−Π12Π22†Π21\Pi\,|\,\Pi_{22} = \Pi_{11}-\Pi_{12}\Pi_{22}^\dagger\Pi_{21}Π∣Π22​=Π11​−Π12​Π22†​Π21​, and Πq,r\boldsymbol\Pi_{q,r}Πq,r​ is the class of Π∈Sq+r\Pi\in\mathbb S^{q+r}Π∈Sq+r with Π22≤0\Pi_{22}\le 0Π22​≤0, Π ∣ Π22≥0\Pi\,|\,\Pi_{22}\ge 0Π∣Π22​≥0 and ker⁡Π22⊆ker⁡Π12\ker\Pi_{22}\subseteq\ker\Pi_{12}kerΠ22​⊆kerΠ12​. For W∈Rq×pW\in\mathbb R^{q\times p}W∈Rq×p, Zr(Π)W={ZW:Z∈Zr(Π)}\mathcal Z_r(\Pi)W = \{ZW : Z\in\mathcal Z_r(\Pi)\}Zr​(Π)W={ZW:Z∈Zr​(Π)} and ΠW=diag(W,Ir)⊤ Π diag(W,Ir)\Pi_W = \mathrm{diag}(W,I_r)^\top\,\Pi\,\mathrm{diag}(W,I_r)ΠW​=diag(W,Ir​)⊤Πdiag(W,Ir​).

Data. An unknown system x(t+1)=Asx(t)+Bsu(t)+w(t)x(t+1) = A_sx(t)+B_su(t)+w(t)x(t+1)=As​x(t)+Bs​u(t)+w(t) produces X=[x(0)⋯x(T)]X = [x(0)\cdots x(T)]X=[x(0)⋯x(T)] and U−=[u(0)⋯u(T−1)]U_- = [u(0)\cdots u(T-1)]U−​=[u(0)⋯u(T−1)]; X−X_-X−​ and X+X_+X+​ are the first and last TTT columns of XXX. The noise matrix W−=[w(0)⋯w(T−1)]W_- = [w(0)\cdots w(T-1)]W−​=[w(0)⋯w(T−1)] is unknown but satisfies W−⊤∈ZT(Φ)W_-^\top\in\mathcal Z_T(\Phi)W−⊤​∈ZT​(Φ) for a given Φ∈Πn,T\Phi\in\boldsymbol\Pi_{n,T}Φ∈Πn,T​. The consistent systems are

Σ={(A,B):X+=AX−+BU−+W− for some W−⊤∈ZT(Φ)}.\Sigma = \{(A,B) : X_+ = AX_-+BU_-+W_-\ \text{for some}\ W_-^\top\in\mathcal Z_T(\Phi)\}.Σ={(A,B):X+​=AX−​+BU−​+W−​ for some W−⊤​∈ZT​(Φ)}.

The data are informative for quadratic stabilization if there are KKK and P>0P>0P>0 with P−(A+BK)P(A+BK)⊤>0P-(A+BK)P(A+BK)^\top>0P−(A+BK)P(A+BK)⊤>0 for all (A,B)∈Σ(A,B)\in\Sigma(A,B)∈Σ.

Formalization targets

Goal: Theorem 5.3

With Θ=Φ12+X+Φ22\Theta = \Phi_{12}+X_+\Phi_{22}Θ=Φ12​+X+​Φ22​ and V=[X−; U−]V = [X_-;\,U_-]V=[X−​;U−​]: the data are informative if and only if some P>0P>0P>0, β>0\beta>0β>0 satisfy

P−βI−[I X+]Φ[I X+]⊤+ΘV⊤(VΦ22V⊤)†VΘ⊤≥0,[P−βI00−P]−[IX+0−X−]Φ[IX+0−X−]⊤≥0,P-\beta I-[I\ X_+]\Phi[I\ X_+]^\top+\Theta V^\top(V\Phi_{22}V^\top)^\dagger V\Theta^\top\ge 0,\qquad \begin{bmatrix}P-\beta I&0\\0&-P\end{bmatrix}-\begin{bmatrix}I&X_+\\0&-X_-\end{bmatrix}\Phi\begin{bmatrix}I&X_+\\0&-X_-\end{bmatrix}^\top\ge 0,P−βI−[I X+​]Φ[I X+​]⊤+ΘV⊤(VΦ22​V⊤)†VΘ⊤≥0,[P−βI0​0−P​]−[I0​X+​−X−​​]Φ[I0​X+​−X−​​]⊤≥0,

and then

K=(U−(Φ22+Θ⊤Γ†Θ)X−⊤)(X−(Φ22+Θ⊤Γ†Θ)X−⊤)†,Γ=P−βI−[I X+]Φ[I X+]⊤,K = \big(U_-(\Phi_{22}+\Theta^\top\Gamma^\dagger\Theta)X_-^\top\big)\big(X_-(\Phi_{22}+\Theta^\top\Gamma^\dagger\Theta)X_-^\top\big)^\dagger,\qquad \Gamma = P-\beta I-[I\ X_+]\Phi[I\ X_+]^\top,K=(U−​(Φ22​+Θ⊤Γ†Θ)X−⊤​)(X−​(Φ22​+Θ⊤Γ†Θ)X−⊤​)†,Γ=P−βI−[I X+​]Φ[I X+​]⊤,

stabilizes every (A,B)∈Σ(A,B)\in\Sigma(A,B)∈Σ. Under Φ22<0\Phi_{22}<0Φ22​<0 and rank⁡V=n+m\operatorname{rank}V = n+mrankV=n+m the same holds with strict inequalities, β=0\beta = 0β=0, and (VΦ22V⊤)−1(V\Phi_{22}V^\top)^{-1}(VΦ22​V⊤)−1. The goal states all four parts.

Milestones

  1. Lemma A.1: A⊤A≤B⊤BA^\top A\le B^\top BA⊤A≤B⊤B iff A=SBA = SBA=SB with S⊤S≤IS^\top S\le IS⊤S≤I (and the strict version), with S=AB†S = AB^\daggerS=AB†.
  2. Lemma A.2: the solutions of AM=BAM = BAM=B.
  3. Theorem 3.3: all solutions of a QMI, Z=−Π22†Π21+((−Π22)†)1/2S(Π∣Π22)1/2+(I−Π22†Π22)TZ = -\Pi_{22}^\dagger\Pi_{21}+((-\Pi_{22})^\dagger)^{1/2}S(\Pi|\Pi_{22})^{1/2}+(I-\Pi_{22}^\dagger\Pi_{22})TZ=−Π22†​Π21​+((−Π22​)†)1/2S(Π∣Π22​)1/2+(I−Π22†​Π22​)T.
  4. Theorems 3.4 and 3.5: Zr(Π)W=Zr(ΠW)\mathcal Z_r(\Pi)W = \mathcal Z_r(\Pi_W)Zr​(Π)W=Zr​(ΠW​) and its strict analogue.
  5. Corollaries 3.6 and 3.7: a QMI solution with ZW=YZW = YZW=Y exists iff Y∈Zr(ΠW)Y\in\mathcal Z_r(\Pi_W)Y∈Zr​(ΠW​).
  6. Theorem 5.1: informativity iff the LMI in (P,L,β)(P,L,\beta)(P,L,β) is feasible, with K=LP−1K = LP^{-1}K=LP−1.

Significance

Theorem 5.3 separates the computation of a Lyapunov matrix from the computation of the controller. The LMI drops from size 4n+m+14n+m+14n+m+1 to 4n+14n+14n+1 and loses the nmnmnm entries of LLL. A controller then follows from PPP by one explicit formula, with no second optimization. The noise class Πn,T\boldsymbol\Pi_{n,T}Πn,T​ covers energy bounds, bounds on individual samples, noise confined to a known subspace, and exact data, so the result applies where earlier conditions requiring Φ22<0\Phi_{22}<0Φ22​<0 or a Slater point fail.

The Section 3 results are general facts about QMIs: an explicit parameterization of all solutions, also when the solution set is unbounded, and the identification of the image of a solution set under a linear map. They are reusable wherever QMIs appear in robust control: Petersen's lemma, the elimination lemma, dissipativity analysis.

All results are proved in the paper, with the exception of the proof of Theorem 3.5, which is only described as similar to that of Theorem 3.4. None is formalized. The work here is the formal development: a pseudo-inverse calculus for real matrices, generalized Schur complements, matrix square roots in the Loewner order, and the block-matrix identities of Section 5.

Difficulty

The QMI reformulation of the stabilization problem is short. The difficulty lies in degenerate matrices. Π22\Pi_{22}Π22​ is typically singular, so every step works with pseudo-inverses, kernel inclusions and generalized Schur complements, and identities that are routine for invertible blocks need range conditions. The closed-form gain (5.10) comes from a block pseudo-inverse formula for a positive semidefinite matrix whose blocks may all be singular, and checking it requires tracking which ranges contain which. The strict statements need a separate argument: a strict inequality A⊤A<B⊤BA^\top A<B^\top BA⊤A<B⊤B does not pass to W⊤A⊤AW<W⊤B⊤BWW^\top A^\top AW<W^\top B^\top BWW⊤A⊤AW<W⊤B⊤BW without full column rank of WWW, which is why Theorem 3.5 and Corollary 3.7 assume it.

The first idea, to eliminate LLL from (5.5) by completing the square, runs into the same singular blocks: the minimizing LLL involves pseudo-inverses of data-dependent matrices whose ranges are not controlled by the LMI alone.

Formalization scope

Lean conventions:

  • Index sets are arbitrary finite types, so qqq, rrr, ppp are cardinalities. The data dimensions nnn, mmm, TTT are natural numbers, with XXX an n×(T+1)n\times(T+1)n×(T+1) matrix.
  • A≥0A\ge 0A≥0 is Mathlib's PosSemidef (which includes symmetry); A>0A>0A>0 is PosDef.
  • A†A^\daggerA† is defined as the matrix satisfying the four Penrose conditions, which exists and is unique. Mathlib's A⁻¹, which returns 000 on singular matrices, appears only in (5.11a) and in K=LP−1K = LP^{-1}K=LP−1, where the matrices are invertible.
  • Square roots are CFC.sqrt in the Loewner order. Kernel inclusions are stated on vectors. Full column rank of W∈Rq×pW\in\mathbb R^{q\times p}W∈Rq×p is rank W = p.

The statements of Theorems 5.1 and 5.3 carry the hypothesis that the data were generated by some (As,Bs)(A_s,B_s)(As​,Bs​), i.e. Σ≠∅\Sigma\neq\emptysetΣ=∅; the paper assumes this when it says the data are generated by (2.1) with noise model (2.3). Without it, informativity holds vacuously and the equivalences fail. "Stabilizing gain" is asserted with the PPP of the LMI: the Lyapunov inequality P−(A+BK)P(A+BK)⊤>0P-(A+BK)P(A+BK)^\top>0P−(A+BK)P(A+BK)⊤>0 and (A+BK)k→0(A+BK)^k\to 0(A+BK)k→0 for every (A,B)∈Σ(A,B)\in\Sigma(A,B)∈Σ. Corollaries 3.6 and 3.7 print the hypothesis ker⁡Π22⊆ker⁡Π21\ker\Pi_{22}\subseteq\ker\Pi_{21}kerΠ22​⊆kerΠ21​, which is dimensionally impossible; it is read as ker⁡Π22⊆ker⁡Π12\ker\Pi_{22}\subseteq\ker\Pi_{12}kerΠ22​⊆kerΠ12​. The printed dimensions in Lemma A.2 are corrected to those its formula requires.

A formalization in which Σ may be empty, or in which A†A^\daggerA† is replaced by the total inverse, would make the goal vacuous or false. Both are ruled out above.

Theorem 5.1 is restated here as a milestone. It is also the goal of the companion mission IV, and solvers may prove it there.

Reusable infrastructure is welcome as separate contributions: uniqueness and the basic identities of the matrix pseudo-inverse; the generalized Schur complement criterion for positive semidefiniteness of a block matrix; Douglas-type factorization (Lemma A.1); square roots of positive semidefinite matrices commuting with pseudo-inverses.

Selected references

  • H. J. van Waarde, M. K. Camlibel, J. Eising, H. L. Trentelman, Quadratic matrix inequalities with applications to data-based control, SIAM J. Control Optim., 2023; preprint arXiv:2203.12959v3 (the version cited here). https://arxiv.org/abs/2203.12959
  • H. J. van Waarde, M. K. Camlibel, M. Mesbahi, From noisy data to feedback controllers: nonconservative design via a matrix S-lemma, IEEE Trans. Automat. Control, 67 (2022), pp. 162–175. https://doi.org/10.1109/TAC.2020.3047577
  • H. J. van Waarde, J. Eising, H. L. Trentelman, M. K. Camlibel, Data informativity: a new perspective on data-driven analysis and control, IEEE Trans. Automat. Control, 65 (2020), pp. 4753–4768. https://doi.org/10.1109/TAC.2020.2966717
  • D. S. Bernstein, Matrix Mathematics, 2nd ed., Princeton University Press, 2009. https://doi.org/10.1515/9781400833344
12 thms2 active usersReviewed
Control TheoryConvex OptimizationOptimization·Captain: mikedeng1

Quadratic Matrix Inequalities with Applications to Data-Based Control II: Matrix Finsler's Lemma — Z⁰ᵣ(N) ⊆ Zᵣ(M) iff M − αN ⪰ 0 for Some α ≥ 0Research Paper

Motivation

Finsler's lemma (P. Finsler, 1937) states that for symmetric matrices M,N∈SnM,N\in\mathbb S^nM,N∈Sn, the quadratic form x⊤Mxx^\top Mxx⊤Mx is positive on every nonzero xxx with x⊤Nx=0x^\top Nx=0x⊤Nx=0 if and only if M−αN>0M-\alpha N>0M−αN>0 for some real α\alphaα. Together with the S-lemma of Yakubovich it is one of the basic tools for converting a statement about all vectors satisfying a quadratic constraint into a single linear matrix inequality (LMI) in a multiplier, which can then be checked by semidefinite programming. Both results are used throughout robust control, where uncertainty is described by quadratic constraints.

In data-driven control the unknown object is a matrix, not a vector: the system matrices (A,B)(A,B)(A,B) consistent with noisy measurements form a set of the form

Zr(N)={Z∈Rr×q:[IZ]⊤N[IZ]⩾0},\mathcal Z_r(N)=\Big\{Z\in\mathbb R^{r\times q}:\begin{bmatrix}I\\ Z\end{bmatrix}^\top N\begin{bmatrix}I\\ Z\end{bmatrix}\geqslant0\Big\},Zr​(N)={Z∈Rr×q:[IZ​]⊤N[IZ​]⩾0},

and a controller has to work for every element of such a set. H. J. van Waarde, M. K. Camlibel, J. Eising and H. L. Trentelman (arXiv:2203.12959, SIAM J. Control Optim. 2023) develop matrix-valued versions of the S-lemma and of Finsler's lemma for exactly this purpose. Their matrix S-lemma (Theorem 4.7) requires a Slater-type condition: NNN must have a positive eigenvalue. This mission concerns the complementary case in which NNN has no positive eigenvalue, where the inequality defining Zr(N)\mathcal Z_r(N)Zr​(N) degenerates into an equality and a Finsler-type statement is needed.

Setting

All matrices are real. For a symmetric matrix AAA, A⩾0A\geqslant0A⩾0 (A>0A>0A>0) means positive semidefinite (definite); A⩽0A\leqslant0A⩽0 means −A⩾0-A\geqslant0−A⩾0. A†A^\daggerA† is the Moore–Penrose pseudo-inverse, the unique matrix XXX with AXA=AAXA=AAXA=A, XAX=XXAX=XXAX=X and AXAXAX, XAXAXA symmetric.

Fix integers q⩾1q\geqslant1q⩾1 and r⩾0r\geqslant0r⩾0. A symmetric matrix M∈Sq+rM\in\mathbb S^{q+r}M∈Sq+r is partitioned as

M=[M11M12M21M22],M=\begin{bmatrix}M_{11}&M_{12}\\ M_{21}&M_{22}\end{bmatrix},M=[M11​M21​​M12​M22​​],

with M11M_{11}M11​ of size q×qq\times qq×q and M22M_{22}M22​ of size r×rr\times rr×r, and likewise NNN. For Z∈Rr×qZ\in\mathbb R^{r\times q}Z∈Rr×q write FM(Z):=[IZ]⊤M[IZ]∈SqF_M(Z):=\begin{bmatrix}I\\ Z\end{bmatrix}^\top M\begin{bmatrix}I\\ Z\end{bmatrix}\in\mathbb S^qFM​(Z):=[IZ​]⊤M[IZ​]∈Sq, and define

Zr(M)={Z:FM(Z)⩾0},Zr0(N)={Z:FN(Z)=0}.\mathcal Z_r(M)=\{Z: F_M(Z)\geqslant0\},\qquad \mathcal Z_r^0(N)=\{Z: F_N(Z)=0\}.Zr​(M)={Z:FM​(Z)⩾0},Zr0​(N)={Z:FN​(Z)=0}.

The generalized Schur complement is M ∣ M22:=M11−M12M22†M21M\,|\,M_{22}:=M_{11}-M_{12}M_{22}^\dagger M_{21}M∣M22​:=M11​−M12​M22†​M21​, and the class Πq,r\boldsymbol\Pi_{q,r}Πq,r​ consists of the symmetric MMM with M22⩽0M_{22}\leqslant0M22​⩽0, M ∣ M22⩾0M\,|\,M_{22}\geqslant0M∣M22​⩾0 and ker⁡M22⊆ker⁡M12\ker M_{22}\subseteq\ker M_{12}kerM22​⊆kerM12​. For N∈Πq,rN\in\boldsymbol\Pi_{q,r}N∈Πq,r​, the condition N ∣ N22=0N\,|\,N_{22}=0N∣N22​=0 is equivalent to NNN having no positive eigenvalue; then Zr(N)=Zr0(N)\mathcal Z_r(N)=\mathcal Z_r^0(N)Zr​(N)=Zr0​(N). Finally, set

Θ:=[I−N22†N21]⊤M[I−N22†N21]=FM(−N22†N21).(4.4)\Theta:=\begin{bmatrix}I\\ -N_{22}^\dagger N_{21}\end{bmatrix}^\top M\begin{bmatrix}I\\ -N_{22}^\dagger N_{21}\end{bmatrix}=F_M(-N_{22}^\dagger N_{21}).\qquad(4.4)Θ:=[I−N22†​N21​​]⊤M[I−N22†​N21​​]=FM​(−N22†​N21​).(4.4)

Formalization targets

Goal: Theorem 4.8 (Matrix Finsler's lemma), p. 12

First, if M−αN⩾0M-\alpha N\geqslant0M−αN⩾0 for some α∈R\alpha\in\mathbb Rα∈R, then Zr0(N)⊆Zr(M)\mathcal Z_r^0(N)\subseteq\mathcal Z_r(M)Zr0​(N)⊆Zr​(M). Second, if M,N∈Πq,rM,N\in\boldsymbol\Pi_{q,r}M,N∈Πq,r​, N ∣ N22=0N\,|\,N_{22}=0N∣N22​=0 and ker⁡Θ⊆ker⁡(M ∣ M22)\ker\Theta\subseteq\ker(M\,|\,M_{22})kerΘ⊆ker(M∣M22​), then

Zr0(N)⊆Zr(M)  ⟺  ∃ α⩾0: M−αN⩾0.\mathcal Z_r^0(N)\subseteq\mathcal Z_r(M)\iff\exists\,\alpha\geqslant0:\ M-\alpha N\geqslant0 .Zr0​(N)⊆Zr​(M)⟺∃α⩾0: M−αN⩾0.

Milestones (proof of Theorem 4.8, pp. 12–13)

  1. If Zr0(N)⊆Zr(M)\mathcal Z_r^0(N)\subseteq\mathcal Z_r(M)Zr0​(N)⊆Zr​(M), then ker⁡N22⊆ker⁡M22\ker N_{22}\subseteq\ker M_{22}kerN22​⊆kerM22​.
  2. With T:=[I0−N22†N21I]T:=\begin{bmatrix}I&0\\ -N_{22}^\dagger N_{21}&I\end{bmatrix}T:=[I−N22†​N21​​0I​], T⊤NT=diag⁡(0,N22)T^\top NT=\operatorname{diag}(0,N_{22})T⊤NT=diag(0,N22​) and
T⊤(M−αN)T=[ΘM12−N12N22†M22M21−M22N22†N21M22−αN22].(4.6)T^\top(M-\alpha N)T=\begin{bmatrix}\Theta&M_{12}-N_{12}N_{22}^\dagger M_{22}\\ M_{21}-M_{22}N_{22}^\dagger N_{21}&M_{22}-\alpha N_{22}\end{bmatrix}.\qquad(4.6)T⊤(M−αN)T=[ΘM21​−M22​N22†​N21​​M12​−N12​N22†​M22​M22​−αN22​​].(4.6)
  1. If ker⁡M22⊆ker⁡M12\ker M_{22}\subseteq\ker M_{12}kerM22​⊆kerM12​, then with D:=M22†M21−N22†N21D:=M_{22}^\dagger M_{21}-N_{22}^\dagger N_{21}D:=M22†​M21​−N22†​N21​, Θ=M ∣ M22+D⊤M22D\Theta=M\,|\,M_{22}+D^\top M_{22}DΘ=M∣M22​+D⊤M22​D and M22D=M21−M22N22†N21M_{22}D=M_{21}-M_{22}N_{22}^\dagger N_{21}M22​D=M21​−M22​N22†​N21​ (4.7a–b).
  2. Θ⩾0\Theta\geqslant0Θ⩾0 and ker⁡(M ∣ M22)=ker⁡Θ∩ker⁡(M21−M22N22†N21)\ker(M\,|\,M_{22})=\ker\Theta\cap\ker(M_{21}-M_{22}N_{22}^\dagger N_{21})ker(M∣M22​)=kerΘ∩ker(M21​−M22​N22†​N21​).
  3. T⊤(M−αN)T⩾0T^\top(M-\alpha N)T\geqslant0T⊤(M−αN)T⩾0 if and only if
M22−αN22−(M21−M22N22†N21) Θ† (M12−N12N22†M22)⩾0.(4.8)M_{22}-\alpha N_{22}-(M_{21}-M_{22}N_{22}^\dagger N_{21})\,\Theta^\dagger\,(M_{12}-N_{12}N_{22}^\dagger M_{22})\geqslant0.\qquad(4.8)M22​−αN22​−(M21​−M22​N22†​N21​)Θ†(M12​−N12​N22†​M22​)⩾0.(4.8)
  1. Some α⩾0\alpha\geqslant0α⩾0 satisfies (4.8), and then M−αN⩾0M-\alpha N\geqslant0M−αN⩾0.

A companion item formalizes Example 4.9 (p. 13): for N=[−111−1]N=\begin{bmatrix}-1&1\\1&-1\end{bmatrix}N=[−11​1−1​] and M=[100−1]M=\begin{bmatrix}1&0\\0&-1\end{bmatrix}M=[10​0−1​] all hypotheses except the one on Θ\ThetaΘ hold, the inclusion holds, and no α⩾0\alpha\geqslant0α⩾0 works.

Significance

The theorem turns an inclusion between two sets of matrices, a statement quantified over infinitely many ZZZ, into feasibility of a scalar-multiplier LMI. In the paper it is one of four matrix S-lemma variants (Theorems 4.7, 4.8, 4.10, 4.11) that together cover the cases arising in data-based control: whether the data-consistent set Zr(N)\mathcal Z_r(N)Zr​(N) has a Slater point, and whether the conclusion is non-strict or strict. Theorem 4.8 is the variant for noise models whose quadratic description has no interior, for instance exact equality constraints on the noise. Example 4.9 shows that the kernel hypothesis on Θ\ThetaΘ is genuinely needed, so the statement marks the boundary of when the lossless reduction holds.

The paper gives a complete proof. No machine-checked proof of this theorem, of the matrix S-lemma, or of Finsler's lemma in matrix form is known to exist, in Lean or elsewhere. Formalizing it produces reusable infrastructure: the Moore–Penrose pseudo-inverse of real matrices with its Penrose identities, the generalized Schur complement criterion for positive semidefiniteness of a block matrix, and congruence manipulations of 2×22\times22×2 block matrices, none of which is currently in Mathlib in this form.

Difficulty

The "if" direction is a one-line computation. For the "only if" direction the classical vector Finsler lemma is not directly applicable: it concerns vectors xxx with x⊤Nx=0x^\top Nx=0x⊤Nx=0, while the hypothesis here only controls matrices ZZZ with FN(Z)=0F_N(Z)=0FN​(Z)=0, which is a much smaller family when q>1q>1q>1, and the conclusion is non-strict. The natural first idea, applying the vector S-lemma, fails because NNN has no positive eigenvalue, so its Slater condition is violated. Instead one must exploit the structure of Πq,r\boldsymbol\Pi_{q,r}Πq,r​: the pseudo-inverse appears because N22N_{22}N22​ and M22M_{22}M22​ are typically singular, and every manipulation must track kernels and ranges exactly.

Formalization scope

The blocks are indexed by arbitrary finite types ι (size qqq) and κ (size rrr); a matrix in Sq+r\mathbb S^{q+r}Sq+r is Matrix (ι ⊕ κ) (ι ⊕ κ) ℝ, its blocks are toBlocks₁₁ etc., and Rr×q\mathbb R^{r\times q}Rr×q is Matrix κ ι ℝ. A⩾0A\geqslant0A⩾0 is Mathlib's PosSemidef, which includes symmetry. The pseudo-inverse is defined by Hilbert's choice among matrices satisfying the four Penrose conditions; since such a matrix exists and is unique, this is the pseudo-inverse and not a junk value. Kernel inclusions are stated with matrix–vector products.

One hypothesis is added and disclosed: q⩾1q\geqslant1q⩾1 (Nonempty ι) in the second statement of Theorem 4.8 and in the milestones that need it. The proof picks a nonzero vector of Rq\mathbb R^qRq, and at q=0q=0q=0 the equivalence is false (r=1r=1r=1, N=[0]N=[0]N=[0], M=[−1]M=[-1]M=[−1]). The first statement keeps a real multiplier of any sign; the second requires α⩾0\alpha\geqslant0α⩾0, as printed. The hypothesis N ∣ N22=0N\,|\,N_{22}=0N∣N22​=0 together with N∈Πq,rN\in\boldsymbol\Pi_{q,r}N∈Πq,r​ makes Zr0(N)\mathcal Z_r^0(N)Zr0​(N) nonempty, so the inclusion is never vacuous; a formalization in which Zr0(N)\mathcal Z_r^0(N)Zr0​(N) could be empty, or in which N22†N_{22}^\daggerN22†​ were replaced by the inverse (which is 000 on singular blocks in Lean), would not be this theorem.

Needed infrastructure: existence and uniqueness of the Moore–Penrose pseudo-inverse (needed to work with the definition at all), symmetry of A†A^\daggerA† for symmetric AAA, the generalized Schur complement criterion for [ABB⊤C]⩾0\begin{bmatrix}A&B\\B^\top&C\end{bmatrix}\geqslant0[AB⊤​BC​]⩾0, and positive semidefiniteness under congruence by an invertible matrix. These lemmas are reusable beyond this mission and contributions of them are welcome, as are proofs of the companion Example 4.9.

Selected references

  • H. J. van Waarde, M. K. Camlibel, J. Eising, H. L. Trentelman, Quadratic matrix inequalities with applications to data-based control, SIAM J. Control Optim., 2023; preprint arXiv:2203.12959v3. https://arxiv.org/abs/2203.12959
  • P. Finsler, Über das Vorkommen definiter und semidefiniter Formen in Scharen quadratischer Formen, Comment. Math. Helv. 9 (1937), 188–192. https://doi.org/10.1007/BF01258188
  • I. Pólik, T. Terlaky, A survey of the S-lemma, SIAM Review 49 (2007), 371–418. https://doi.org/10.1137/S003614450444614X
  • H. J. van Waarde, J. Eising, H. L. Trentelman, M. K. Camlibel, Data informativity: a new perspective on data-driven analysis and control, IEEE Trans. Automat. Control 65 (2020), 4753–4768. https://doi.org/10.1109/TAC.2020.2966717
9 thms2 active usersReviewed
Control TheoryDynamical SystemsGraph Theory·Captain: mikedeng1

Synchronization via Pinning Control on General Complex Networks II: Componentwise LMIs on the Strongly Connected Components Globally Synchronize a Pinned Network with a Directed Spanning TreeResearch Paper

Motivation

Networks of identical dynamical systems coupled along a directed graph model power grids, sensor and robot swarms, neural populations and coupled oscillators. A basic control question is how to steer every node of such a network onto a prescribed reference trajectory by acting directly on only a few nodes. This is pinning control: feedback is injected at a small set of pinned vertices, and the coupling has to carry the reference signal to the rest of the network.

For undirected or strongly connected networks, criteria for pinning synchronization go back to Wang and Chen (2002) and Chen, Liu and Lu (2007), and the first mission of this series treats the strongly connected case of Yu, Chen, Lü and Kurths (2013). Many networks of interest are not strongly connected: information flows down a hierarchy of groups, and the minimal requirement for the reference to reach every node is that the network, with the reference added as a virtual leader, contains a directed spanning tree rooted at the leader. Section 4 of that paper gives a criterion for this general case that splits into one condition per strongly connected component. This mission formalizes that criterion, Theorem 4.5, with the lemmas its proof uses and three corollaries.

Setting

There are NNN vertices with states xi(t)∈Rnx_i(t)\in\mathbb R^nxi​(t)∈Rn. The coupling configuration matrix G∈RN×NG\in\mathbb R^{N\times N}G∈RN×N has Gij≥0G_{ij}\ge0Gij​≥0 for i≠ji\ne ji=j, where Gij>0G_{ij}>0Gij​>0 records a connection from vertex jjj to vertex iii, and zero row sums, Gii=−∑j≠iGijG_{ii}=-\sum_{j\ne i}G_{ij}Gii​=−∑j=i​Gij​. Given a function f:Rn×R+→Rnf:\mathbb R^n\times\mathbb R_+\to\mathbb R^nf:Rn×R+​→Rn, a coupling strength ccc, an inner coupling matrix Γ∈Rn×n\Gamma\in\mathbb R^{n\times n}Γ∈Rn×n and pinning gains di≥0d_i\ge0di​≥0 (vertex iii is pinned when di>0d_i>0di​>0), the controlled network is

x˙i=f(xi,t)+c∑j=1NGijΓxj−c di Γ(xi−s),i=1,…,N,\dot x_i=f(x_i,t)+c\sum_{j=1}^N G_{ij}\Gamma x_j-c\,d_i\,\Gamma(x_i-s),\qquad i=1,\dots,N,x˙i​=f(xi​,t)+cj=1∑N​Gij​Γxj​−cdi​Γ(xi​−s),i=1,…,N,

where the reference sss solves s˙=f(s,t)\dot s=f(s,t)s˙=f(s,t). The network is globally synchronized when xi(t)−s(t)→0x_i(t)-s(t)\to0xi​(t)−s(t)→0 for every vertex and every pair of solutions.

The nonlinearity is controlled by Assumption 1: there is a matrix KKK with (x−y)T(f(x,t)−f(y,t))≤(x−y)TKΓ(x−y)(x-y)^{\mathsf T}(f(x,t)-f(y,t))\le(x-y)^{\mathsf T}K\Gamma(x-y)(x−y)T(f(x,t)−f(y,t))≤(x−y)TKΓ(x−y) for all x,yx,yx,y and t≥0t\ge0t≥0. Throughout §4 the paper also assumes that KKK and Γ\GammaΓ commute, that Γ\GammaΓ is positive definite, and puts θ=λmax⁡((K+KT)/2)≥0\theta=\lambda_{\max}((K+K^{\mathsf T})/2)\ge0θ=λmax​((K+KT)/2)≥0.

The vertices split into strongly connected components V1,…,VMV_1,\dots,V_MV1​,…,VM​. In the Frobenius normal form the components are ordered so that no edge goes from a later component to an earlier one, which makes GGG block lower triangular. For each component jjj the mission uses three matrices:

  • G~j\widetilde G_jGj​, the diagonal block of G−diag(d)G-\mathrm{diag}(d)G−diag(d) on VjV_jVj​;
  • AjA_jAj​, the within-component part of GGG with zero row sums;
  • Π~j=diag(Πj)\widetilde\Pi_j=\mathrm{diag}(\Pi_j)Πj​=diag(Πj​), where Πj\Pi_jΠj​ is a positive vector with ΠjTAj=0\Pi_j^{\mathsf T}A_j=0ΠjT​Aj​=0.

In Lean, component membership is a map blk : Fin N → Fin M, and Fin M carries the Frobenius order.

Formalization targets

Goal: Theorem 4.5

If, for every component jjj,

2θΠ~j+c(Π~jG~j+G~jTΠ~j)<0,(4.8)2\theta\widetilde\Pi_j+c\bigl(\widetilde\Pi_j\widetilde G_j+\widetilde G_j^{\mathsf T}\widetilde\Pi_j\bigr)<0, \tag{4.8}2θΠj​+c(Πj​Gj​+GjT​Πj​)<0,(4.8)

then the controlled network with a directed spanning tree is globally synchronized.

Milestones

  1. The θ bound (p. 1402). Commutation and Γ>0\Gamma>0Γ>0 turn Assumption 1 into (x−y)T(f(x,t)−f(y,t))≤θ(x−y)TΓ(x−y)(x-y)^{\mathsf T}(f(x,t)-f(y,t))\le\theta(x-y)^{\mathsf T}\Gamma(x-y)(x−y)T(f(x,t)−f(y,t))≤θ(x−y)TΓ(x−y).
  2. Lemma 2.13. The strict Schur complement test for a symmetric block matrix.
  3. Lemma 4.4. If Π~jG~j+G~jTΠ~j<0\widetilde\Pi_j\widetilde G_j+\widetilde G_j^{\mathsf T}\widetilde\Pi_j<0Πj​Gj​+GjT​Πj​<0 on every diagonal block of a block lower-triangular G‾\overline GG, then positive block weights Δj\Delta_jΔj​ exist with ΔΠ~G‾+G‾TΠ~Δ<0\Delta\widetilde\Pi\overline G+\overline G^{\mathsf T}\widetilde\Pi\Delta<0ΔΠG+GTΠΔ<0.
  4. (4.10). Along solutions, V=∑jΔje~jTΠ~je~jV=\sum_j\Delta_j\widetilde e_j^{\mathsf T}\widetilde\Pi_j\widetilde e_jV=∑j​Δj​ejT​Πj​ej​ satisfies V˙≤eT{[ΔΠ~(cG‾+θIN)+(cG‾+θIN)TΠ~Δ]⊗Γ}e\dot V\le e^{\mathsf T}\{[\Delta\widetilde\Pi(c\overline G+\theta I_N)+(c\overline G+\theta I_N)^{\mathsf T}\widetilde\Pi\Delta]\otimes\Gamma\}eV˙≤eT{[ΔΠ(cG+θIN​)+(cG+θIN​)TΠΔ]⊗Γ}e.

Companions

  • Corollary 4.7: the same conclusion under θΠ~j+c(A‾j−Π~jCj−Π~jD‾j)<0\theta\widetilde\Pi_j+c(\overline A_j-\widetilde\Pi_jC_j-\widetilde\Pi_j\overline D_j)<0θΠj​+c(Aj​−Πj​Cj​−Πj​Dj​)<0, which separates the outer in-degrees CjC_jCj​ from the pinning gains D‾j\overline D_jDj​.
  • Corollary 4.8 (i): an explicit coupling-strength threshold under Assumption 2.
  • Corollary 4.9: partial synchronization of the first components.

Significance

Theorem 4.5 replaces a single Nn×NnNn\times NnNn×Nn matrix inequality for the whole network with MMM inequalities, one of the size of each component. In practice the test runs component by component down the Frobenius order: decide which components need pinning, choose gains for each one separately, and get synchronization of the whole network. Corollary 4.7 makes this explicit in terms of the outer in-degrees: a component with no incoming edges from earlier components has to be pinned (Remark 4), while a component that receives enough weight from upstream needs no control. These conditions underlie the pinning scheme algorithm of §5 of the paper.

On the formal side, as far as a search of the platform and of Mathlib shows, none of these results is machine-checked. Mathlib has the positive semidefinite Schur complement and irreducible nonnegative matrices, but not the strict Schur complement, block-diagonal Lyapunov scaling, or Lyapunov arguments for networked ODEs with Kronecker-structured couplings. The mission produces, beyond the paper's theorem:

  • a reusable strict Schur complement lemma;
  • a block-triangular diagonal-stability lemma;
  • a template for Lyapunov estimates on coupled networks in Lean.

Difficulty

The obvious argument is to take one Lyapunov function weighted by a positive left null vector of the whole coupling matrix, as in the strongly connected case. Here it fails: the coupling matrix of a network that is not strongly connected has no positive left null vector, and condition (4.8) is local to each component. The central step is the passage from blockwise to global negative definiteness (Lemma 4.4). Condition (4.8) says nothing about the off-diagonal blocks that couple a component to earlier ones, and a block lower-triangular matrix whose symmetrized diagonal blocks are negative definite need not have a negative definite symmetric part; the component weights Δj\Delta_jΔj​ have to be found so that those couplings are dominated, which is a quantitative statement about Schur complements. Turning the resulting matrix inequality into convergence of the trajectories then needs a differential inequality on [0,∞)[0,\infty)[0,∞), a Kronecker-product definiteness argument with Γ\GammaΓ, and the commutation of KKK and Γ\GammaΓ to reach the θ bound.

Formalization scope

States are Fin n → ℝ and matrices are indexed by Fin N, Fin n, or the subtype of one component's vertices. Solutions are functions on ℝ that satisfy their ODE on [0,∞)[0,\infty)[0,∞) through HasDerivWithinAt … (Set.Ici 0). "For any initial conditions" means for every pair of solutions (s,x)(s,x)(s,x); existence of solutions is not claimed. Convergence is componentwise, which agrees with every norm on Rn\mathbb R^nRn. "Positive definite" is Mathlib's Matrix.PosDef, which includes symmetry, and X<0X<0X<0 is (-X).PosDef. λmax⁡\lambda_{\max}λmax​ is the least Rayleigh bound, IsLamMax, never a supremum of a possibly empty set.

The vertices are not permuted into Frobenius form. The hypotheses say instead that:

  • every component is nonempty;
  • every component is strongly connected inside itself;
  • every edge between components points forward in the order;
  • every vertex is reachable from a pinned vertex.

The weights Πj\Pi_jΠj​ are tied to the paper's object by ΠjTAj=0\Pi_j^{\mathsf T}A_j=0ΠjT​Aj​=0. The standing assumptions of p. 1402 (Assumption 1, KΓ=ΓKK\Gamma=\Gamma KKΓ=ΓK, θ=λmax⁡((K+KT)/2)≥0\theta=\lambda_{\max}((K+K^{\mathsf T})/2)\ge0θ=λmax​((K+KT)/2)≥0, Γ>0\Gamma>0Γ>0) are hypotheses of every goal-level statement. The goal does not assume the weights Δj\Delta_jΔj​, the bound (4.10), or definiteness of a whole-network matrix; it assumes only (4.8) on each component, so it cannot be trivialized by assuming its own conclusion. For n=0n=0n=0 the λmax⁡\lambda_{\max}λmax​ hypothesis cannot be met, so that degenerate dimension is excluded.

The pages contain three misprints. (4.10) has "−c-c−c" in its third line and "++++++" in its last; the last line, with a single +++, is formalized. Corollary 4.9 ranges "i=1,…,Ni=1,\dots,Ni=1,…,N" where the component range is meant.

A complete development needs a Gronwall-type decay lemma on [0,∞)[0,\infty)[0,∞), the strict Schur complement, definiteness of Kronecker products, and the square root of a positive definite matrix commuting with matrices that commute with it. Each of these is reusable well beyond this mission, and contributions to any of them are welcome, as are proofs of the milestones in any order.

Selected references

  • W. Yu, G. Chen, J. Lü, J. Kurths, Synchronization via pinning control on general complex networks, SIAM J. Control Optim. 51(2) (2013), 1395–1416. https://doi.org/10.1137/100781699
  • X. F. Wang, G. Chen, Pinning control of scale-free dynamical networks, Physica A 310 (2002), 521–531. https://doi.org/10.1016/S0378-4371(02)00772-0
  • T. Chen, X. Liu, W. Lu, Pinning complex networks by a single controller, IEEE Trans. Circuits Syst. I 54(6) (2007), 1317–1326. https://doi.org/10.1109/TCSI.2007.895383
  • S. Boyd, L. El Ghaoui, E. Feron, V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory, SIAM, 1994. https://doi.org/10.1137/1.9781611970777
  • R. A. Brualdi, H. J. Ryser, Combinatorial Matrix Theory, Cambridge University Press, 1991. https://doi.org/10.1017/CBO9781107325708
7 thms2 active usersReviewed
CombinatoricsMarkov ChainTheoretical Computer Science·Captain: mikedeng1

High Order Random Walks: Beyond Spectral Gap 2: On a Two-Sided λ-Local Spectral Expander, Spec(M⁺_k) ⊆ {1} ∪ ⋃_j [(k+1−j)/(k+2) ± √(k+1)·ε_k/(k+2)] and Eigenvectors Lie Near U^j_kResearch Paper

Motivation

High-dimensional expanders are simplicial complexes whose local structure forces global mixing. Random walks on their kkk-dimensional faces, the high order random walks, are used to analyse sampling algorithms: the bases-exchange walk on the bases of a matroid is such a walk, and its spectral analysis by Anari, Liu, Oveis Gharan and Vinzant (arXiv:1811.01816) settled the Mihail–Vazirani conjecture on counting matroid bases. Agreement tests and PCP constructions use the same walks (Dinur–Kaufman, FOCS 2017).

Most of these applications use only the second eigenvalue of the walk. Kaufman and Oppenheim (arXiv:1707.02799v3) observe that this eigenvalue cannot be very small, because of natural obstructions such as cochains pulled up from lower dimensions, and ask instead for the whole spectrum and the structure of the eigenvectors. For complexes whose links have both small second eigenvalue and bounded-below smallest eigenvalue (two-sided local spectral expanders), they show that the spectrum of the walk on kkk-faces clusters around k+1k+1k+1 explicit values, each cluster corresponding to cochains built from a lower dimension.

Timeline. Garland (1973, doi:10.2307/1970833) introduced the localization method relating global cohomology to spectra of links. Kaufman and Mass (ITCS 2017, arXiv:1604.02947) defined high order random walks and bounded their second eigenvalue. Oppenheim (Discrete Comput. Geom. 2018, arXiv:1709.04431) developed the local spectral expansion framework and its trickle-down theorem. Kaufman and Oppenheim gave the decomposition theorems this mission formalizes; arXiv v3 (2021) corrects an error of the published version. Alev and Lau (arXiv:2001.02827) later improved the one-sided bounds.

Setting

Let XXX be a pure nnn-dimensional finite simplicial complex on a vertex set VVV: a finite family of finite subsets of VVV, closed under subsets, in which every face lies in a face with n+1n+1n+1 vertices. X(k)X(k)X(k) is the set of faces with k+1k+1k+1 vertices, and X(−1)={∅}X(-1)=\{\emptyset\}X(−1)={∅}. A weight is a function m:X→(0,∞)m:X\to(0,\infty)m:X→(0,∞) with m(τ)=∑σ∈X(k+1), τ⊆σm(σ)m(\tau)=\sum_{\sigma\in X(k+1),\,\tau\subseteq\sigma}m(\sigma)m(τ)=∑σ∈X(k+1),τ⊆σ​m(σ) for τ∈X(k)\tau\in X(k)τ∈X(k), k≤n−1k\le n-1k≤n−1.

A kkk-cochain is a function ϕ:X(k)→R\phi:X(k)\to\mathbb Rϕ:X(k)→R; the space Ck(X)C^k(X)Ck(X) carries the inner product ⟨ϕ,ψ⟩=∑σ∈X(k)m(σ)ϕ(σ)ψ(σ)\langle\phi,\psi\rangle=\sum_{\sigma\in X(k)}m(\sigma)\phi(\sigma)\psi(\sigma)⟨ϕ,ψ⟩=∑σ∈X(k)​m(σ)ϕ(σ)ψ(σ). C0k(X)C^k_0(X)C0k​(X) is the subspace of cochains orthogonal to the constants.

  • The signless differential dk:Ck→Ck+1d_k:C^k\to C^{k+1}dk​:Ck→Ck+1 is dkϕ(σ)=∑τ⊂σ, τ∈X(k)ϕ(τ)d_k\phi(\sigma)=\sum_{\tau\subset\sigma,\,\tau\in X(k)}\phi(\tau)dk​ϕ(σ)=∑τ⊂σ,τ∈X(k)​ϕ(τ), and dk∗d_k^*dk∗​ is its adjoint.
  • The upper random walk Mk+M^+_kMk+​ on X(k)X(k)X(k) stays at τ\tauτ with probability 1k+2\frac1{k+2}k+21​ and moves to τ′\tau'τ′ with probability m(τ∪τ′)(k+2)m(τ)\frac{m(\tau\cup\tau')}{(k+2)m(\tau)}(k+2)m(τ)m(τ∪τ′)​ when τ∪τ′∈X(k+1)\tau\cup\tau'\in X(k+1)τ∪τ′∈X(k+1); equivalently dk∗dk=(k+2)Mk+d_k^*d_k=(k+2)M^+_kdk∗​dk​=(k+2)Mk+​.
  • The link of τ\tauτ is Xτ={η: η∩τ=∅, τ∪η∈X}X_\tau=\{\eta:\ \eta\cap\tau=\emptyset,\ \tau\cup\eta\in X\}Xτ​={η: η∩τ=∅, τ∪η∈X} with weight mτ(η)=m(τ∪η)m_\tau(\eta)=m(\tau\cup\eta)mτ​(η)=m(τ∪η). On its vertices, (M′)τ,0+(M')^+_{\tau,0}(M′)τ,0+​ is the non-lazy walk; μτ\mu_\tauμτ​ and ντ\nu_\tauντ​ are its second largest and smallest eigenvalues.
  • XXX is a two-sided λ\lambdaλ-local spectral expander if −λ≤ντ-\lambda\le\nu_\tau−λ≤ντ​ and μτ≤λ\mu_\tau\le\lambdaμτ​≤λ for every face τ\tauτ of dimension −1,…,n−2-1,\dots,n-2−1,…,n−2.

For 0≤k≤n−10\le k\le n-10≤k≤n−1 the paper defines subspaces of C0k(X)C^k_0(X)C0k​(X): V00=C00V^0_0=C^0_0V00​=C00​; for k≥1k\ge1k≥1, Vkj=dk−1⋯dj(C0j)V^j_k=d_{k-1}\cdots d_j(C^j_0)Vkj​=dk−1​⋯dj​(C0j​) for j<kj<kj<k and Vkk=ker⁡dk−1∗V^k_k=\ker d^*_{k-1}Vkk​=kerdk−1∗​; and Uk0=Vk0U^0_k=V^0_kUk0​=Vk0​, Ukj=Vkj∩(Vkj−1)⊥U^j_k=V^j_k\cap(V^{j-1}_k)^\perpUkj​=Vkj​∩(Vkj−1​)⊥ for 0<j<k0<j<k0<j<k, Ukk=VkkU^k_k=V^k_kUkk​=Vkk​. With ε0=λ\varepsilon_0=\lambdaε0​=λ and εk=2k(1+2kk)εk−1+(k+1)λ\varepsilon_k=2k(1+2k\sqrt k)\varepsilon_{k-1}+(k+1)\lambdaεk​=2k(1+2kk​)εk−1​+(k+1)λ, PUP_{U}PU​ denotes the weighted orthogonal projection onto UUU.

Formalization targets

Goal: Theorem 5.9 (p. 22)

If εk≤12(1+2(k+1)k+1)\varepsilon_k\le\frac{1}{2(1+2(k+1)\sqrt{k+1})}εk​≤2(1+2(k+1)k+1​)1​ for 0≤k≤n−20\le k\le n-20≤k≤n−2 and εn−1<12n\varepsilon_{n-1}<\frac1{2\sqrt n}εn−1​<2n​1​, then for 0≤k≤n−10\le k\le n-10≤k≤n−1

Spec⁡(Mk+)⊆{1}∪⋃j=0k[k+1−jk+2−k+1k+2εk, k+1−jk+2+k+1k+2εk],\operatorname{Spec}(M^+_k)\subseteq\{1\}\cup\bigcup_{j=0}^{k}\Big[\tfrac{k+1-j}{k+2}-\tfrac{\sqrt{k+1}}{k+2}\varepsilon_k,\ \tfrac{k+1-j}{k+2}+\tfrac{\sqrt{k+1}}{k+2}\varepsilon_k\Big],Spec(Mk+​)⊆{1}∪j=0⋃k​[k+2k+1−j​−k+2k+1​​εk​, k+2k+1−j​+k+2k+1​​εk​],

and an eigenvector ϕ∈C0k\phi\in C^k_0ϕ∈C0k​ whose eigenvalue lies in the jjj-th interval satisfies ∥ϕ−PUkjϕ∥≤k+1εk1−k+1εk∥ϕ∥\|\phi-P_{U^j_k}\phi\|\le\frac{\sqrt{k+1}\varepsilon_k}{1-\sqrt{k+1}\varepsilon_k}\|\phi\|∥ϕ−PUkj​​ϕ∥≤1−k+1​εk​k+1​εk​​∥ϕ∥.

Milestones

  • the localization identities (Lemma 3.6, Corollary 3.7, Propositions 4.1, 4.2) and the two-sided bound of Lemma 4.3;
  • Lemma 5.1 and the orthogonal decomposition C0k(X)=Ukk⊕⋯⊕Uk0C^k_0(X)=U^k_k\oplus\cdots\oplus U^0_kC0k​(X)=Ukk​⊕⋯⊕Uk0​ (§5.3);
  • Theorem 5.6: ∥dk∗dkPUkjϕ−(k+1−j)PUkjϕ∥≤εk∥PUkjϕ∥\|d^*_kd_kP_{U^j_k}\phi-(k+1-j)P_{U^j_k}\phi\|\le\varepsilon_k\|P_{U^j_k}\phi\|∥dk∗​dk​PUkj​​ϕ−(k+1−j)PUkj​​ϕ∥≤εk​∥PUkj​​ϕ∥;
  • Corollary 5.8: the same for Mk+M^+_kMk+​, with k+1−jk+2\frac{k+1-j}{k+2}k+2k+1−j​ and εkk+2\frac{\varepsilon_k}{k+2}k+2εk​​.

Significance

The result. Theorem 5.9 describes the spectrum of Mk+M^+_kMk+​, not only its second eigenvalue. The eigenvalue k+1−jk+2\frac{k+1-j}{k+2}k+2k+1−j​ is the one carried by cochains pulled up from dimension jjj, so it explains which cochains are shrunk slowly by the walk and which quickly. It is the two-sided counterpart of the paper's one-sided mixing bound (Theorem 5.4, the subject of the first mission in this series). It gives approximate eigenspaces explicitly, which a mixing-time analysis or an agreement-test analysis can use in place of a bound on a single eigenvalue.

Formalizing it. No machine-checked development of simplicial-complex random walks, Garland's method, or local spectral expansion is known to exist; Mathlib has simplicial complexes in a geometric sense but no weighted cochain calculus. The mission produces the cochain calculus of §2–§4 together with the spectral statements of §5.3. The statements are those of the arXiv v3 preprint. They are published results but have not been formalized.

Difficulty

The obvious route would show that the spaces UkjU^j_kUkj​ are exact eigenspaces. That holds for the complete complex but not in general: d∗dd^*dd∗d maps UkjU^j_kUkj​ only approximately into itself, and the error has to be controlled through every lower dimension at once. Theorem 5.6 is an induction on kkk in which the error εk−1\varepsilon_{k-1}εk−1​ of dimension k−1k-1k−1 enters dimension kkk multiplied by norms of dk−1∗dk−1d^*_{k-1}d_{k-1}dk−1∗​dk−1​ and its square root. Controlling these factors on the correct subspaces, rather than on all of Ck−1C^{k-1}Ck−1, is the delicate step: dk−1∗dk−1=(k+1)Mk−1+d^*_{k-1}d_{k-1}=(k+1)M^+_{k-1}dk−1∗​dk−1​=(k+1)Mk−1+​ has norm k+1k+1k+1 on Ck−1(X)C^{k-1}(X)Ck−1(X), attained on the constants, and the bound needed is on the complement of the constants. Passing from Corollary 5.8 to the spectral statement of Theorem 5.9 needs the intervals to be disjoint and the eigenvector to be split along the orthogonal decomposition.

Formalization scope

  • Encoding. Faces are Finset V and XXX is a Finset (Finset V); faces are indexed by their number of vertices (cells X (k + 1) is X(k)X(k)X(k)). Cochains are functions Finset V → ℝ, and every operator vanishes off XXX.
  • Supports. Subspaces, eigenvectors and orthogonal complements consist of functions supported on X(k)X(k)X(k) (Supp X (k + 1)). Without this, a function living off the faces would have norm 000, would be an eigenvector with eigenvalue 000, and would make the spectral statement false; a formalization without supports is ruled out for this reason.
  • Weights and adjoints. The weight is strictly positive on faces. d∗d^*d∗ is defined by its explicit formula, and Lemma 3.6 states that this formula is the adjoint.
  • Expansion. The eigenvalue conditions on links are stated in Rayleigh form on the weighted complement of the constants, ∣⟨(M′)τ,0+g,g⟩∣≤λ∥g∥2|\langle(M')^+_{\tau,0}g,g\rangle|\le\lambda\|g\|^2∣⟨(M′)τ,0+​g,g⟩∣≤λ∥g∥2; this encodes −λ≤ντ-\lambda\le\nu_\tau−λ≤ντ​ and μτ≤λ\mu_\tau\le\lambdaμτ​≤λ and needs no connectivity. Definition 1.2 is followed where Definition 4.4 misprints the two-sided clause.
  • Projections. PUϕP_U\phiPU​ϕ is characterised relationally (IsWProj: u∈Uu\in Uu∈U and ϕ−u⊥U\phi-u\perp Uϕ−u⊥U) instead of by an operator. On these finite-dimensional subspaces it exists and is unique.
  • Indices and constants. εk\varepsilon_kεk​ is eps lam k, with the recursion shifted by one index. kkk is quantified inside each conclusion, and εn−1\varepsilon_{n-1}εn−1​ is written without natural subtraction. The statements follow the printed constants of arXiv v3.

A complete development needs finite-dimensional weighted inner-product spaces of cochains, Garland localization, Courant–Fischer for self-adjoint operators on these spaces, and orthogonal projections onto images of iterated differentials. The cochain calculus and the localization identities are reusable for any weighted simplicial complex, and the first mission of this series needs the same objects. Proofs of the localization identities, of the decomposition, and of any milestone are welcome, as are proofs of the results with weaker hypotheses.

Selected references

  • T. Kaufman, I. Oppenheim, High Order Random Walks: Beyond Spectral Gap, arXiv:1707.02799v3, 2021. https://arxiv.org/abs/1707.02799
  • H. Garland, p-adic curvature and the cohomology of discrete subgroups of p-adic groups, Annals of Mathematics 97, 1973. https://doi.org/10.2307/1970833
  • T. Kaufman, D. Mass, High dimensional random walks and colorful expansion, ITCS 2017. https://arxiv.org/abs/1604.02947
  • I. Oppenheim, Local spectral expansion approach to high dimensional expanders Part I: Descent of spectral gaps, Discrete & Computational Geometry 59, 2018. https://arxiv.org/abs/1709.04431
  • N. Anari, K. Liu, S. Oveis Gharan, C. Vinzant, Log-concave polynomials II: high-dimensional walks and an FPRAS for counting bases of a matroid, STOC 2019. https://arxiv.org/abs/1811.01816
  • V. L. Alev, L. C. Lau, Improved analysis of higher order random walks and applications, STOC 2020. https://arxiv.org/abs/2001.02827
15 thms2 active usersReviewed
CombinatoricsMarkov ChainTheoretical Computer Science·Captain: mikedeng1

High Order Random Walks: Beyond Spectral Gap 1: On a One-Sided λ-Local Spectral Expander, ‖M⁺_k φ‖ ≤ ((k+1)/(k+2) + (k+1)λ/2)‖φ‖ for Every k-Cochain φ Orthogonal to the ConstantsResearch Paper

Motivation

A high dimensional expander is a simplicial complex whose local structure forces global expansion. The high order random walks on such a complex move from a kkk-face to a kkk-face through a common (k+1)(k+1)(k+1)-face. They were studied for their connection to agreement tests in probabilistically checkable proofs (Dinur–Kaufman 2017; Kaufman–Mass 2017), and they later became a tool for sampling. Anari, Liu, Oveis Gharan and Vinzant (arXiv:1811.01816) used the mixing bound of this mission to prove the Mihail–Vazirani conjecture: the bases-exchange walk of every matroid mixes rapidly.

Timeline:

  • 1973. Garland (Ann. of Math. 97) shows that spectral gaps in the links of a complex control its cohomology. Inner products are localized to links; this is now called Garland's method.
  • 2017. Kaufman and Mass (arXiv:1604.02947) bound the second eigenvalue of the high order walks on complexes with well-expanding links. Dinur and Kaufman obtain the optimal bound under a two-sided spectral gap in the links, as Kaufman–Oppenheim explain.
  • 2018. Oppenheim (Discrete Comput. Geom. 59) shows how spectral gaps descend from top-dimensional links to lower ones ("trickling down").
  • 2017–2021. Kaufman and Oppenheim (arXiv:1707.02799v3) obtain the optimal mixing bound under a one-sided gap only: negative eigenvalues of the links do not matter. This is the target of this mission.

Setting

Let VVV be a type of vertices. A pure nnn-dimensional finite simplicial complex XXX is a finite family of finite subsets of VVV that is closed under subsets, has faces of at most n+1n+1n+1 elements, and has every face contained in a face of exactly n+1n+1n+1 elements. A face with k+1k+1k+1 elements is a kkk-face; X(k)X(k)X(k) is the set of kkk-faces, and X(−1)={∅}X(-1)=\{\emptyset\}X(−1)={∅}.

A weight function is a map mmm from the faces of XXX to (0,∞)(0,\infty)(0,∞) that is balanced: for −1≤k≤n−1-1\le k\le n-1−1≤k≤n−1 and τ∈X(k)\tau\in X(k)τ∈X(k),

m(τ)=∑σ∈X(k+1), τ⊆σm(σ).m(\tau)=\sum_{\sigma\in X(k+1),\ \tau\subseteq\sigma}m(\sigma).m(τ)=σ∈X(k+1), τ⊆σ∑​m(σ).

A kkk-cochain is a function ϕ:X(k)→R\phi:X(k)\to\mathbb Rϕ:X(k)→R. The cochains carry the inner product ⟨ϕ,ψ⟩=∑σ∈X(k)m(σ)ϕ(σ)ψ(σ)\langle\phi,\psi\rangle=\sum_{\sigma\in X(k)}m(\sigma)\phi(\sigma)\psi(\sigma)⟨ϕ,ψ⟩=∑σ∈X(k)​m(σ)ϕ(σ)ψ(σ) and the norm ∥⋅∥\|\cdot\|∥⋅∥. The cochains orthogonal to the constants form C0k(X,R)={ϕ:∑σ∈X(k)m(σ)ϕ(σ)=0}C^k_0(X,\mathbb R)=\{\phi:\sum_{\sigma\in X(k)}m(\sigma)\phi(\sigma)=0\}C0k​(X,R)={ϕ:∑σ∈X(k)​m(σ)ϕ(σ)=0}.

The upper random walk Mk+M^+_kMk+​ acts on kkk-cochains by

Mk+ϕ(τ)=1k+2 ϕ(τ)+∑τ′∈X(k), τ∪τ′∈X(k+1)m(τ∪τ′)(k+2) m(τ) ϕ(τ′).M^+_k\phi(\tau)=\frac{1}{k+2}\,\phi(\tau)+\sum_{\tau'\in X(k),\ \tau\cup\tau'\in X(k+1)}\frac{m(\tau\cup\tau')}{(k+2)\,m(\tau)}\,\phi(\tau').Mk+​ϕ(τ)=k+21​ϕ(τ)+τ′∈X(k), τ∪τ′∈X(k+1)∑​(k+2)m(τ)m(τ∪τ′)​ϕ(τ′).

It stays put with probability 1/(k+2)1/(k+2)1/(k+2), and otherwise moves to a neighbouring kkk-face with probability proportional to the weight of their union.

The link of a face τ\tauτ is Xτ={η∈X:η∩τ=∅, τ∪η∈X}X_\tau=\{\eta\in X:\eta\cap\tau=\emptyset,\ \tau\cup\eta\in X\}Xτ​={η∈X:η∩τ=∅, τ∪η∈X}, weighted by mτ(η)=m(τ∪η)m_\tau(\eta)=m(\tau\cup\eta)mτ​(η)=m(τ∪η). On the vertices of XτX_\tauXτ​, the non-lazy upper walk (M′)τ,0+=2Mτ,0+−I(M')^+_{\tau,0}=2M^+_{\tau,0}-I(M′)τ,0+​=2Mτ,0+​−I is the weighted random walk on the 1-skeleton of the link. Let μτ\mu_\tauμτ​ be its second largest eigenvalue. XXX is a one-sided λ\lambdaλ-local spectral expander if μτ≤λ\mu_\tau\le\lambdaμτ​≤λ for every face τ\tauτ of dimension −1,…,n−2-1,\dots,n-2−1,…,n−2. The empty face is included, and its link is XXX itself.

Formalization targets

Goal: Theorem 5.4 (p. 17)

Let 0≤λ≤10\le\lambda\le10≤λ≤1 and let XXX be a one-sided λ\lambdaλ-local spectral expander. Then for every 0≤k≤n−10\le k\le n-10≤k≤n−1 and every ϕ∈C0k(X,R)\phi\in C^k_0(X,\mathbb R)ϕ∈C0k​(X,R),

∥Mk+ϕ∥≤(k+1k+2+k+12 λ)∥ϕ∥.\|M^+_k\phi\|\le\Big(\frac{k+1}{k+2}+\frac{k+1}{2}\,\lambda\Big)\|\phi\|.∥Mk+​ϕ∥≤(k+2k+1​+2k+1​λ)∥ϕ∥.

Milestones

They follow the paper's proof order:

  • Lemma 3.6 and Corollary 3.7: the adjoint d∗d^*d∗ of the signless differential ddd, and the factorizations d∗d=(k+2)Mk+d^*d=(k+2)M^+_kd∗d=(k+2)Mk+​, dd∗=(k+1)Mk−dd^*=(k+1)M^-_kdd∗=(k+1)Mk−​.
  • Proposition 4.1 (1)–(3), Garland's localization identities, and Proposition 4.2:
∥dϕ∥2=∥d∗ϕ∥2+∥ϕ∥2+∑τ∈X(k−1)⟨(M′)τ,0+(I−Mτ,0−)ϕτ,ϕτ⟩.\|d\phi\|^2=\|d^*\phi\|^2+\|\phi\|^2+\sum_{\tau\in X(k-1)}\langle (M')^+_{\tau,0}(I-M^-_{\tau,0})\phi_\tau,\phi_\tau\rangle .∥dϕ∥2=∥d∗ϕ∥2+∥ϕ∥2+τ∈X(k−1)∑​⟨(M′)τ,0+​(I−Mτ,0−​)ϕτ​,ϕτ​⟩.
  • Lemma 4.3, which bounds the link terms by (k+1)μ∥ϕ∥2(k+1)\mu\|\phi\|^2(k+1)μ∥ϕ∥2.
  • Lemma 5.1.
  • Theorem 5.2 (the Decomposition Theorem).
  • Corollary 5.3, in its general and its one-sided form:
∥dϕ∥2≤∑j=0k(k+1−j+(k+j+2)(k+1−j)2λ)∥ϕj∥2,∥ϕ∥2=∑j=0k∥ϕj∥2.\|d\phi\|^2\le\sum_{j=0}^{k}\Big(k+1-j+\frac{(k+j+2)(k+1-j)}{2}\lambda\Big)\|\phi^j\|^2,\qquad \|\phi\|^2=\sum_{j=0}^k\|\phi^j\|^2.∥dϕ∥2≤j=0∑k​(k+1−j+2(k+j+2)(k+1−j)​λ)∥ϕj∥2,∥ϕ∥2=j=0∑k​∥ϕj∥2.

Significance

The result. The coefficient k+1k+2\frac{k+1}{k+2}k+2k+1​ is the baseline in the paper's mixing bound, and the bound is optimal up to the O(λ)O(\lambda)O(λ) term. It needs a gap on one side only: links may have eigenvalues near −1-1−1. This matters in two places. The links of a matroid's independence complex are only one-sided expanders, so the matroid application needs exactly this case. And the links of Ramanujan complexes are one-sided expanders, so this bound gives optimal mixing on them; the two-sided bound of Dinur–Kaufman does not apply to them.

Formalizing it. The theorem is proved on paper; the Lean statements in this mission are proof targets. Completing the mission would give machine-checked proofs of the mixing bound, Garland's localization identities, and the Decomposition Theorem, built on definitions of weighted simplicial complexes, links, and their random walks. Lemma 4.3 and Corollary 5.3 are stated with a correction: as printed they are false when a link eigenvalue bound is negative (see Formalization scope).

Difficulty

The obvious argument fails. The tempting route bounds the second eigenvalue of Mk+M^+_kMk+​ directly from the link spectra, by induction on kkk. But Mk+M^+_kMk+​ has large eigenvalues near k+1−jk+2\frac{k+1-j}{k+2}k+2k+1−j​ for every jjj, coming from cochains of the form dψd\psidψ with ψ\psiψ of lower degree. A single spectral-gap estimate cannot separate these levels from one another. The paper instead splits ϕ\phiϕ into contributions from every degree j≤kj\le kj≤k; this is the Decomposition Theorem, and each piece is controlled separately. Formally, the main costs are:

  • the double-counting behind Proposition 4.1 (Appendix A, pp. 28–29);
  • a square root of a positive self-adjoint operator on a weighted finite-dimensional space (Theorem 5.2);
  • the bookkeeping of degrees and links.

Formalization scope

Faces are Finset V. XXX is a Finset (Finset V), and X(k)X(k)X(k) is cells X (k + 1): faces are indexed by their number of vertices. Cochains are functions Finset V → ℝ that are read only on the relevant faces. Every operator is zero off XXX. The weight is positive on faces; the paper writes R+\mathbb R^+R+, and mmm appears in denominators. Every goal-level statement carries the standing assumption of §2: XXX is pure nnn-dimensional and mmm is a weight. Orthogonality to the constants is always weighted by mmm (or by mτm_\taumτ​ in a link).

The adjoint d∗d^*d∗ is defined by its explicit formula; that it is the adjoint is Lemma 3.6. The eigenvalue condition μτ≤λ\mu_\tau\le\lambdaμτ​≤λ is stated in Rayleigh form: ⟨(M′)τ,0+g,g⟩≤λ∥g∥2\langle (M')^+_{\tau,0}g,g\rangle\le\lambda\|g\|^2⟨(M′)τ,0+​g,g⟩≤λ∥g∥2 for every ggg on the vertices of XτX_\tauXτ​ that is mτm_\taumτ​-orthogonal to the constants. It is equivalent to the eigenvalue form even for disconnected links. A Rayleigh bound over all ggg, constants included, would be unsatisfiable for λ<1\lambda<1λ<1 and would make the goal vacuous; it is ruled out. The predicate quantifies over every face of dimension −1-1−1 to n−2n-2n−2, including ∅\emptyset∅.

Corrections, all disclosed in the items:

  • Lemma 4.3 is stated with a bound μ≥max⁡(μk,0)\mu\ge\max(\mu_k,0)μ≥max(μk​,0). The printed version with μk<0\mu_k<0μk​<0 fails already for the complete graph on three vertices.
  • Corollary 5.3 accordingly takes μi≥0\mu_i\ge0μi​≥0 and λ≥0\lambda\ge0λ≥0. Its two formal statements retain the page's assumption that every link of dimension at least one is connected, including XXX itself.
  • The proof of Theorem 5.4 ends with (k+1)λ(k+1)\lambda(k+1)λ; the statement's k+12λ\frac{k+1}{2}\lambda2k+1​λ is formalized.

Welcome contributions: proofs of any milestone. Reusable lemmas on finite weighted inner products, on double counting over faces of a Finset (Finset V), and on links are useful beyond this mission; the companion mission on two-sided expanders uses the same objects.

Selected references

  • T. Kaufman, I. Oppenheim, High Order Random Walks: Beyond Spectral Gap, arXiv:1707.02799v3, 2021. https://arxiv.org/abs/1707.02799
  • N. Anari, K. Liu, S. Oveis Gharan, C. Vinzant, Log-concave polynomials II: High-dimensional walks and an FPRAS for counting bases of a matroid, STOC 2019. https://arxiv.org/abs/1811.01816
  • H. Garland, p-adic curvature and the cohomology of discrete subgroups of p-adic groups, Ann. of Math. 97:375–423, 1973. https://doi.org/10.2307/1970781
  • T. Kaufman, D. Mass, High dimensional random walks and colorful expansion, ITCS 2017. https://arxiv.org/abs/1604.02947
  • I. Oppenheim, Local spectral expansion approach to high dimensional expanders Part I: Descent of spectral gaps, Discrete Comput. Geom. 59(2):293–330, 2018. https://arxiv.org/abs/1709.04431
13 thms2 active usersReviewed
Mathematical PhysicsQuantum Information·Captain: mikedeng1

Quantum Algorithm for Simulating Real Time Evolution of Lattice Hamiltonians 2: Strictly Local Lieb–Robinson Bound ‖[A_X(t),B_Y]‖ ≤ 2‖A‖‖B‖|X|(2ζ₀|t|)^ℓ/ℓ! with ℓ = ⌊dist(X,Y)⌋Research Paper

Motivation

Simulating the time evolution e−iHte^{-iHt}e−iHt of a many-body Hamiltonian is one of the main proposed uses of quantum computers. For a Hamiltonian H=∑XhXH = \sum_X h_XH=∑X​hX​ whose terms act on small, nearby groups of sites of a lattice, Haah, Hastings, Kothari and Low give a quantum algorithm whose gate count is nearly linear in the space-time volume ntn tnt, and show that this is optimal up to logarithmic factors. The algorithm decomposes e−iHte^{-iHt}e−iHt into evolutions of overlapping blocks, and the error of each step is controlled by a Lieb–Robinson bound: in a locally interacting system, an operator evolved for time ttt stays, up to a superexponentially small error, inside a region whose size grows linearly with ttt.

Lieb–Robinson bounds go back to Lieb and Robinson (1972), who proved a finite propagation speed for quantum spin systems. Hastings (2004), Nachtergaele and Sims (2006) and Hastings and Koma (2006) gave the commutator form used today and applied it to the decay of correlations in gapped ground states. Appendix C of the paper re-derives the bound in a self-contained way. Section C.4 treats strictly local interactions, where every term is supported on a set of diameter at most 111, and obtains a bound with an explicit factor (2ζ0∣t∣)ℓ/ℓ!(2\zeta_0|t|)^\ell/\ell!(2ζ0​∣t∣)ℓ/ℓ!. This mission formalizes that bound.

Setting

Let Λ\LambdaΛ be a finite set of sites with a metric dist\mathrm{dist}dist. Every site carries Cq\mathbb{C}^qCq, and operators act on ⨂x∈ΛCq\bigotimes_{x \in \Lambda} \mathbb{C}^q⨂x∈Λ​Cq; all norms ∥⋅∥\|\cdot\|∥⋅∥ are operator norms. An operator is supported on X⊆ΛX \subseteq \LambdaX⊆Λ if it has the form m⊗1Λ∖Xm \otimes \mathbb{1}_{\Lambda \setminus X}m⊗1Λ∖X​. For finite sets of sites, dist(X,Y)=min⁡x∈X,y∈Ydist(x,y)\mathrm{dist}(X, Y) = \min_{x \in X, y \in Y} \mathrm{dist}(x, y)dist(X,Y)=minx∈X,y∈Y​dist(x,y), diam(X)=max⁡x,x′∈Xdist(x,x′)\mathrm{diam}(X) = \max_{x, x' \in X} \mathrm{dist}(x, x')diam(X)=maxx,x′∈X​dist(x,x′), and X∼YX \sim YX∼Y means X∩Y≠∅X \cap Y \ne \emptysetX∩Y=∅.

A Hamiltonian is a family (hX)X⊆Λ(h_X)_{X \subseteq \Lambda}(hX​)X⊆Λ​ of Hermitian operators, hXh_XhX​ supported on XXX, with H=∑X⊆ΛhXH = \sum_{X \subseteq \Lambda} h_XH=∑X⊆Λ​hX​; for a region Ω\OmegaΩ, HΩ=∑Z⊆ΩhZH_\Omega = \sum_{Z \subseteq \Omega} h_ZHΩ​=∑Z⊆Ω​hZ​. The Heisenberg evolution of an operator OOO is O(t;J)=eiJtOe−iJtO(t; J) = e^{iJt} O e^{-iJt}O(t;J)=eiJtOe−iJt, and O(t)=O(t;H)O(t) = O(t; H)O(t)=O(t;H). The interaction is strictly local if hX=0h_X = 0hX​=0 whenever diam(X)>1\mathrm{diam}(X) > 1diam(X)>1, and its strength is measured by

ζ0=max⁡x∈Λ∑Q∋x∣Q∣ ∥hQ∥.\zeta_0 = \max_{x \in \Lambda} \sum_{Q \ni x} |Q|\, \|h_Q\| .ζ0​=x∈Λmax​Q∋x∑​∣Q∣∥hQ​∥.

The proof works with two auxiliary quantities attached to a fixed operator BBB supported on YYY:

CB(X,t)=sup⁡A∈AX, ∥A∥≤1∥[A(t),B]∥,DB(X,t)=∥[hX(t),B]∥,C_B(X, t) = \sup_{A \in \mathcal{A}_X,\ \|A\| \le 1} \|[A(t), B]\|, \qquad D_B(X, t) = \|[h_X(t), B]\|,CB​(X,t)=A∈AX​, ∥A∥≤1sup​∥[A(t),B]∥,DB​(X,t)=∥[hX​(t),B]∥,

where AX\mathcal{A}_XAX​ is the algebra of operators supported on XXX. A tuple (Z1,…,Zk)(Z_1, \dots, Z_k)(Z1​,…,Zk​) is linked from XXX if X∼Z1∼⋯∼ZkX \sim Z_1 \sim \cdots \sim Z_kX∼Z1​∼⋯∼Zk​.

Formalization targets

Goal: display (48)

For AAA supported on XXX, BBB supported on YYY, ℓ=⌊dist(X,Y)⌋\ell = \lfloor \mathrm{dist}(X, Y) \rfloorℓ=⌊dist(X,Y)⌋ and every real ttt,

∥[A(t),B]∥≤2 ∥A∥ ∥B∥ ∣X∣ (2ζ0∣t∣)ℓℓ!.\|[A(t), B]\| \le 2\,\|A\|\,\|B\|\,|X|\,\frac{(2\zeta_0|t|)^{\ell}}{\ell!} .∥[A(t),B]∥≤2∥A∥∥B∥∣X∣ℓ!(2ζ0​∣t∣)ℓ​.

Milestones

  1. The elementary bounds (28): CB(Z,0)≤2∥B∥δZ∼YC_B(Z, 0) \le 2\|B\|\delta_{Z \sim Y}CB​(Z,0)≤2∥B∥δZ∼Y​, CB(Z,t)≤2∥B∥C_B(Z, t) \le 2\|B\|CB​(Z,t)≤2∥B∥, and the same for DBD_BDB​ with an extra factor ∥hZ∥\|h_Z\|∥hZ​∥.
  2. The integral inequality (24): CB(X,t)≤CB(X,0)+∑Z∼X2∫0∣t∣DB(Z,s) dsC_B(X, t) \le C_B(X, 0) + \sum_{Z \sim X} 2\int_0^{|t|} D_B(Z, s)\, dsCB​(X,t)≤CB​(X,0)+∑Z∼X​2∫0∣t∣​DB​(Z,s)ds.
  3. The closed recursion (42): CB(X,t)≤CB(X,0)+2∑Z:X∼Z∥hZ∥∫0∣t∣CB(Z,s) dsC_B(X, t) \le C_B(X, 0) + 2\sum_{Z : X \sim Z} \|h_Z\| \int_0^{|t|} C_B(Z, s)\, dsCB​(X,t)≤CB​(X,0)+2∑Z:X∼Z​∥hZ​∥∫0∣t∣​CB​(Z,s)ds.
  4. The truncated iteration (44): CB(X,t)≤2∥B∥(2∣t∣)ℓℓ!∑Z1,…,Zℓ:linked∏j∥hZj∥C_B(X, t) \le 2\|B\| \frac{(2|t|)^\ell}{\ell!} \sum_{Z_1, \dots, Z_\ell : \text{linked}} \prod_j \|h_{Z_j}\|CB​(X,t)≤2∥B∥ℓ!(2∣t∣)ℓ​∑Z1​,…,Zℓ​:linked​∏j​∥hZj​​∥.
  5. The counting bounds (45)–(46): ∑Q:P∼Q∼S∥hQ∥≤ζ0∑p∈Pδdist(p,S)≤1\sum_{Q : P \sim Q \sim S} \|h_Q\| \le \zeta_0 \sum_{p \in P} \delta_{\mathrm{dist}(p, S) \le 1}∑Q:P∼Q∼S​∥hQ​∥≤ζ0​∑p∈P​δdist(p,S)≤1​ and its weighted, distance-tracking companion.
  6. Lemma 5, eq. (4) = (49): ∥OX(t;H)−OX(t;HΩ)∥≤∣X∣ ∥OX∥ (2ζ0∣t∣)ℓ/ℓ!\|O_X(t; H) - O_X(t; H_\Omega)\| \le |X|\,\|O_X\|\,(2\zeta_0|t|)^\ell/\ell!∥OX​(t;H)−OX​(t;HΩ​)∥≤∣X∣∥OX​∥(2ζ0​∣t∣)ℓ/ℓ! with ℓ=⌊dist(X,Λ∖Ω)⌋\ell = \lfloor \mathrm{dist}(X, \Lambda \setminus \Omega) \rfloorℓ=⌊dist(X,Λ∖Ω)⌋, under the added hypothesis dist(X,Λ∖Ω)≥1\mathrm{dist}(X, \Lambda \setminus \Omega) \ge 1dist(X,Λ∖Ω)≥1.

The goal is (48) rather than Lemma 5 because (48) is proved in full on pp. 26–27, while Lemma 5 is obtained "by manipulation analogous to Eq. (39)" and is false as printed when ℓ=0\ell = 0ℓ=0.

Significance

The bound (48) states that commutators with distant operators are suppressed by a factor that, at fixed ttt, decays faster than any exponential in the distance. The same factor controls Lemma 5, which is what the decomposition lemmas of the paper (Lemma 6 and its corollaries) use to bound the error of replacing a global evolution by evolutions of overlapping blocks; that in turn gives the paper's gate counts. Bounds of this type also underlie the exponential clustering of correlations in gapped ground states and the quasi-adiabatic continuation technique.

The results are proved in the literature and in this paper. A search of the local Prove2Me prior-art index found no matching formal statement for this finite spin-system bound. The mission seeks a machine-checked proof of the strictly local bound with its explicit constant, together with reusable infrastructure: operators supported on subsets of a tensor product of matrix algebras, their Heisenberg evolution, and an integral inequality for commutator growth.

Difficulty

The obvious argument expands A(t)=∑k(it)kadHk(A)/k!A(t) = \sum_k (it)^k \mathrm{ad}_H^k(A)/k!A(t)=∑k​(it)kadHk​(A)/k! and notes that the first ℓ\ellℓ nested commutators with BBB vanish. This does not give the stated bound: the norm of adHk(A)\mathrm{ad}_H^k(A)adHk​(A) grows like k!k!k! times the number of growing clusters of terms, and the tail of the series is not controlled by its leading term. The explicit factor (2ζ0∣t∣)ℓ/ℓ!(2\zeta_0|t|)^\ell/\ell!(2ζ0​∣t∣)ℓ/ℓ!, with no exponential prefactor, requires precise control of the time-dependent supremum CB(Z,s)C_B(Z,s)CB​(Z,s) and the combinatorics of linked chains. A second difficulty is Lemma 5, whose printed form is false at ℓ=0\ell = 0ℓ=0 and whose proof in the paper is a one-line reference to an analogous computation.

Formalization scope

Sites are an arbitrary finite metric space Λ\LambdaΛ ([Fintype Λ] [MetricSpace Λ]); operators are matrices Matrix (Λ → Fin q) (Λ → Fin q) ℂ in the product basis, with the same local dimension qqq at every site. This generalizes the paper's qubits on a lattice in RD\mathbb{R}^DRD. The norm is the L2L^2L2 operator norm (Matrix.Norms.L2Operator), never the entrywise or Frobenius norm. SupportedOn X M states M=m⊗1M = m \otimes \mathbb{1}M=m⊗1 entrywise, and is not vacuous: a nonzero operator on a single site satisfies it, and only scalars are supported on ∅\emptyset∅. The Hamiltonian is time-independent and sums over every subset of Λ\LambdaΛ; strict locality is the hypothesis 1<diam(X)⇒hX=01 < \mathrm{diam}(X) \Rightarrow h_X = 01<diam(X)⇒hX​=0 on the terms. The constant ζ0\zeta_0ζ0​ is carried as an upper bound of the site sums ∑Q∋x∣Q∣ ∥hQ∥\sum_{Q \ni x} |Q|\,\|h_Q\|∑Q∋x​∣Q∣∥hQ​∥, which is equivalent to the paper's maximum for these monotone bounds; no bound ∥hX∥≤1\|h_X\| \le 1∥hX​∥≤1 is assumed. dist(X,Y)\mathrm{dist}(X, Y)dist(X,Y) is a minimum over nonempty sets and 000 if a set is empty, ℓ\ellℓ is its natural-number floor, and CBC_BCB​ is a real supremum over a nonempty set bounded by 2∥B∥2\|B\|2∥B∥. The integral milestones (24) and (42) are stated for t≥0t \ge 0t≥0; the goal, (44) and Lemma 5 hold for every real ttt. Lemma 5 carries one disclosed added hypothesis, dist(x,y)≥1\mathrm{dist}(x, y) \ge 1dist(x,y)≥1 for x∈Xx \in Xx∈X, y∉Ωy \notin \Omegay∈/Ω, without which it is false.

None of the statements is trivialized: the goal mentions neither CBC_BCB​ nor linked sums, its norm is the operator norm, the integrals are of continuous functions on compact intervals, the supremum is over a nonempty bounded set, and no disjointness of XXX and YYY is assumed, so it covers ℓ=0\ell = 0ℓ=0 as well.

A complete development needs the derivative of t↦eiHtAe−iHtt \mapsto e^{iHt} A e^{-iHt}t↦eiHtAe−iHt, unitarity of eiHte^{iHt}eiHt for Hermitian HHH, commutation of operators with disjoint supports, Grönwall-type iteration of integral inequalities, and the simplex-volume identity ∫Δkdt=∣t∣k/k!\int_{\Delta^k} dt = |t|^k/k!∫Δk​dt=∣t∣k/k!. The support and evolution layer is reusable for any lattice-system result. Contributions that prove the milestones in order, or that develop the support calculus independently, are welcome.

Selected references

  • J. Haah, M. B. Hastings, R. Kothari, G. H. Low, Quantum algorithm for simulating real time evolution of lattice Hamiltonians, SIAM J. Comput. (2021); arXiv:1801.03922v4 (2020). https://arxiv.org/abs/1801.03922
  • E. H. Lieb, D. W. Robinson, The finite group velocity of quantum spin systems, Comm. Math. Phys. 28 (1972) 251–257. https://doi.org/10.1007/BF01645779
  • M. B. Hastings, Lieb–Schultz–Mattis in higher dimensions, Phys. Rev. B 69 (2004) 104431. https://arxiv.org/abs/cond-mat/0305505
  • B. Nachtergaele, R. Sims, Lieb–Robinson bounds and the exponential clustering theorem, Comm. Math. Phys. 265 (2006) 119–130. https://arxiv.org/abs/math-ph/0506030
  • M. B. Hastings, T. Koma, Spectral gap and exponential decay of correlations, Comm. Math. Phys. 265 (2006) 781–804. https://arxiv.org/abs/math-ph/0507008
10 thms2 active usersReviewed
Computational GeometryMachine Learning·Captain: mikedeng1

Turning Big Data into Tiny Data: Constant-Size Coresets for k-Means, PCA, and Projective Clustering I: The Rank-m SVD Truncation Plus Its Residual Preserves the Cost of Every j-Dimensional ShapeResearch Paper

Motivation

Large data sets make clustering and subspace fitting expensive because a candidate solution must be evaluated against every input point. A dimensionality reduction replaces the data by a lower-rank matrix whose costs approximate those of the original input for an entire class of candidate solutions. Feldman, Schmidt, and Sohler study reductions that retain enough information for kkk-means, principal component analysis, and projective clustering. Their journal paper identifies a rank truncation and one residual scalar that preserve the fitting cost of every shape lying in a low-dimensional linear subspace Feldman, Schmidt, and Sohler (2020), Theorem 22.

The published article also records that some coreset sizes in its 2013 conference version were incorrect. This mission uses the 2020 journal statement and its page numbering throughout. The authors cite earlier SVD-based approximations to kkk-means on p. 613, while their Theorem 22 gives a uniform cost guarantee for arbitrary nonempty shapes contained in a jjj-dimensional subspace Feldman, Schmidt, and Sohler (2020), pp. 603, 613, 620.

Setting

The input is a real matrix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d. Its nnn rows are points in Rd\mathbb R^dRd. For a nonempty set of candidate locations or shapes C⊆RdC\subseteq\mathbb R^dC⊆Rd, let dist⁡(ai,C)\operatorname{dist}(a_i,C)dist(ai​,C) be the infimum of Euclidean distances from row aia_iai​ to points of CCC. The shape cost is

dist⁡2(A,C)=∑i=1ndist⁡(ai,C)2.\operatorname{dist}^2(A,C)=\sum_{i=1}^{n}\operatorname{dist}(a_i,C)^2.dist2(A,C)=i=1∑n​dist(ai​,C)2.

The set CCC need not be closed and need not be a subspace. For example, it can be a finite set of cluster centers. The restriction is that all of its points lie in some linear subspace of dimension jjj. This matches the paper's shape class in §5; the affine case is treated separately Feldman, Schmidt, and Sohler (2020), pp. 619–620.

Fix a singular value decomposition A=UΣVTA=U\Sigma V^TA=UΣVT, where UUU and VVV are orthogonal and the diagonal entries of the rectangular matrix Σ\SigmaΣ are nonnegative and nonincreasing. The entry σi\sigma_iσi​ is indexed from one. The rank-mmm truncation A(m)=UΣ(m)VTA^{(m)}=U\Sigma^{(m)}V^TA(m)=UΣ(m)VT keeps the first mmm diagonal entries and sets the rest to zero. Its squared Frobenius residual is Δ=∥A−A(m)∥F2\Delta=\|A-A^{(m)}\|_F^2Δ=∥A−A(m)∥F2​. The corrected cost of CCC is dist⁡2(A(m),C)+Δ\operatorname{dist}^2(A^{(m)},C)+\Deltadist2(A(m),C)+Δ Feldman, Schmidt, and Sohler (2020), Definition 1 and §2.

Formalization targets

Linear subspace estimates

The milestones first record the matrix Pythagorean identity, the jσm+12j\sigma_{m+1}^2jσm+12​ projection and residual bounds, and the lower bound on the cost of a linear jjj-subspace. They then state the residual-corrected approximation in Corollary 16:

∥AY∥F2≤∥A(m)Y∥F2+Δ≤(1+ε)∥AY∥F2,m≥⌈j/ε⌉+j−1.\|AY\|_F^2\le\|A^{(m)}Y\|_F^2+\Delta\le(1+\varepsilon)\|AY\|_F^2, \qquad m\ge\lceil j/\varepsilon\rceil+j-1.∥AY∥F2​≤∥A(m)Y∥F2​+Δ≤(1+ε)∥AY∥F2​,m≥⌈j/ε⌉+j−1.

Here YYY has d−jd-jd−j orthonormal columns spanning the complement of the candidate subspace. Corollary 20, Corollary 21, and display (9) connect these linear estimates to costs of general sets CCC Feldman, Schmidt, and Sohler (2020), pp. 604, 613–615, 619–620.

Goal: uniform shape-cost preservation

The goal is Theorem 22. For 1≤j≤d−11\le j\le d-11≤j≤d−1, 0<ε≤10<\varepsilon\le10<ε≤1, and ⌈8j/ε2⌉−1≤m≤min⁡{n,d}−1\lceil8j/\varepsilon^2\rceil-1\le m\le\min\{n,d\}-1⌈8j/ε2⌉−1≤m≤min{n,d}−1, every nonempty CCC contained in a linear jjj-dimensional subspace satisfies

∣(dist⁡2(A(m),C)+∥A−A(m)∥F2)−dist⁡2(A,C)∣≤εdist⁡2(A,C).\left|\bigl(\operatorname{dist}^2(A^{(m)},C)+\|A-A^{(m)}\|_F^2\bigr) -\operatorname{dist}^2(A,C)\right| \le\varepsilon\operatorname{dist}^2(A,C).​(dist2(A(m),C)+∥A−A(m)∥F2​)−dist2(A,C)​≤εdist2(A,C).

The quantifier over CCC makes this a guarantee for every admissible candidate on the same reduced data, rather than a statement about one selected optimum Feldman, Schmidt, and Sohler (2020), Theorem 22, p. 620.

Significance

The theorem preserves objective values after replacing AAA by a rank-mmm matrix and one number. For a fixed jjj and accuracy parameter, the rank threshold depends on jjj and ε\varepsilonε, with no direct dependence on the number of points nnn or ambient dimension ddd except the upper bound on feasible mmm. In the paper, the result leads to a guarantee for kkk-means candidates, since kkk centers span a linear subspace of dimension at most kkk Feldman, Schmidt, and Sohler (2020), Corollary 23, p. 621.

The result is proved in the paper, but this mission's Lean theorems are posed with sorry; they do not yet have machine-checked proofs. A completed development would connect a reusable rectangular SVD model, matrix projection identities, infimum distances to arbitrary nonempty sets, and a uniform cost inequality. The SVD definition is already published in the platform library; the row-cost and singular-value conventions here supply the interface needed for this paper Feldman, Schmidt, and Sohler (2020), §§2, 3, 5.

Difficulty

The linear subspace bound compares a projection cost with a tail sum of squared singular values. The paper recalls that fact in §3 without proving it, so the formal development needs a suitable singular-value inequality or a derivation from existing matrix approximation results. For general shapes CCC, a bound on the cost of one linear subspace does not by itself control the distance from each projected point to every point of CCC. The remaining milestones state the projection error, the squared-distance perturbation bound, and the Pythagorean cost split that address that gap Feldman, Schmidt, and Sohler (2020), pp. 613, 619–621.

The proof printed after Theorem 22 invokes earlier corollaries under a stronger rank threshold than the theorem states. The mission keeps the printed theorem threshold, whose claim remains valid; a formal proof must bridge that discrepancy Feldman, Schmidt, and Sohler (2020), pp. 620–621.

Formalization scope

Matrices are Matrix (Fin n) (Fin d) ℝ, and rows are points of EuclideanSpace ℝ (Fin d). Squared Frobenius norm is an explicit finite sum of squared entries. Shape cost sums squared Metric.infDist values over rows. Since Mathlib assigns a real default value to distance from the empty set while the paper assigns infinity, every theorem about a general shape CCC requires C.Nonempty. This is the page's own requirement for Theorem 22 and Corollary 21, and is also needed for display (9).

The SVD and its truncation use the published ProjLikeRetr.FixedRank.IsSVD and truncSVD. Every SVD statement quantifies over an arbitrary valid triple (U,Σ,V)(U,\Sigma,V)(U,Σ,V); tied singular values do not fix a unique truncation. The local σi\sigma_iσi​ is one-based, while truncSVD m keeps zero-based diagonal positions below mmm. Orthonormal columns of XXX satisfy XTX=IX^TX=IXTX=I, their orthogonal complement has d−jd-jd−j columns, and projection in ambient coordinates is AXXTAXX^TAXXT. Theorem 22 quantifies over arbitrary nonempty CCC contained in a linear jjj-subspace; it does not restrict CCC to subspaces or replace linear containment by affine containment.

The integer inequalities in Lean use additive forms such as ⌈8j/ε2⌉≤m+1\lceil8j/\varepsilon^2\rceil\le m+1⌈8j/ε2⌉≤m+1 to avoid truncated natural-number subtraction. The theorem retains the printed mmm threshold, including the proof gap described above. Running-time clauses are outside the mission's mathematical statements. Contributions are welcome toward the singular-value lower bound, the projection and infimum-distance identities, and the final uniform inequality; the matrix and distance definitions are reusable in the companion affine-subspace mission.

Selected references

  • Dan Feldman, Melanie Schmidt, and Christian Sohler, Turning Big Data into Tiny Data: Constant-Size Coresets for k-Means, PCA, and Projective Clustering, SIAM Journal on Computing 49(3):601–657, 2020. DOI: 10.1137/18M1209854.
11 thms2 active usersReviewed
Numerical AnalysisProbabilityTheoretical Computer Science·Captain: mikedeng1

Low Rank Approximation and Regression in Input Sparsity Time 1: A Sparse Embedding Matrix with O((r/ε)⁴ log²(r/ε)) Rows Is a (1 ± ε) Subspace Embedding for a Rank-r Matrix with Probability 9/10Research Paper

Motivation

Many matrix algorithms spend most of their time reading their input. A matrix with few nonzero entries should admit routines whose cost scales with that number, rather than with the product of its dimensions. Clarkson and Woodruff study random maps that compress a matrix before a regression or low rank approximation calculation while retaining the geometric information those calculations need. Their sparse embedding has one nonzero entry per input coordinate, so applying it to a sparse matrix can be charged to the matrix's nonzero entries. The probability guarantee for its geometry is Theorem 11 of the preprint, the target of this mission.

The paper proves further results for faster regression and low rank approximation after sketching. Those applications use the subspace guarantee as an input. This mission concentrates on that guarantee and the statements in §3 that support it. The source is the 5 April 2013 arXiv version; theorem and page labels below refer to that version.

Setting

Fix a real matrix A∈Rn×dA\in\mathbb R^{n\times d}A∈Rn×d of rank rrr. Its column space is C(A)={Ax:x∈Rd}C(A)=\{Ax:x\in\mathbb R^d\}C(A)={Ax:x∈Rd}. A map S:Rn→RtS:\mathbb R^n\to\mathbb R^tS:Rn→Rt is a subspace embedding for AAA when it approximately preserves the length of every vector in C(A)C(A)C(A) simultaneously. The dimension rrr, rather than the number of rows nnn, controls the size required of the compressed space.

Here SSS is the sparse embedding matrix ΦD\Phi DΦD. Each input coordinate iii independently chooses one bucket h(i)∈[t]h(i)\in[t]h(i)∈[t] uniformly. The binary matrix Φ\PhiΦ has a 111 at (h(i),i)(h(i),i)(h(i),i) and zero elsewhere in column iii. Independently, DDD is diagonal with a fair sign +1+1+1 or −1-1−1 at each coordinate. Thus the output in bucket jjj is the signed sum of input coordinates assigned to jjj. The probability in this mission is over the joint, uniform choice of all bucket assignments and signs, with AAA fixed in advance. This is the construction in §2, p. 7.

For an orthonormal basis matrix U∈Rn×rU\in\mathbb R^{n\times r}U∈Rn×r of C(A)C(A)C(A), the leverage score of row iii is ui=∑j=1rUij2u_i=\sum_{j=1}^r U_{ij}^2ui​=∑j=1r​Uij2​. A threshold T>0T>0T>0 separates light coordinates, with ui≤Tu_i\le Tui​≤T, from heavy coordinates, with ui>Tu_i>Tui​>T. The paper describes this split after sorting rows by leverage; the threshold description selects the same coordinates and keeps the input's original order. The bucket event EhE_hEh​ bounds the sum of light leverage scores assigned to each bucket. The heavy event EBE_BEB​ says that distinct heavy coordinates receive distinct buckets. These are properties of hhh alone; the later concentration statements take probability over the independent signs after fixing a suitable hhh.

Formalization targets

Sparse subspace embedding

There is an absolute constant C>0C>0C>0 such that for every AAA of rank r≥1r\ge1r≥1, every 0<ε≤1/20<\varepsilon\le1/20<ε≤1/2, and every integer t≥C(r/ε)4log⁡2(r/ε)t\ge C(r/\varepsilon)^4\log^2(r/\varepsilon)t≥C(r/ε)4log2(r/ε),

Pr⁡h,D ⁣[∀y∈C(A),∣∥ΦDy∥22−∥y∥22∣≤ε∥y∥22]≥910.\Pr_{h,D}\!\left[ \forall y\in C(A),\quad \bigl|\|\Phi Dy\|_2^2-\|y\|_2^2\bigr| \le\varepsilon\|y\|_2^2 \right]\ge\frac9{10}.h,DPr​[∀y∈C(A),​∥ΦDy∥22​−∥y∥22​​≤ε∥y∥22​]≥109​.

The event contains the universal quantifier over yyy: one draw must work for the whole column space. The squared-norm estimate implies the norm formulation printed in Theorem 11, p. 11 on this range of ε\varepsilonε. The paper gives its proof in §3, pp. 7–11.

Supporting targets

The milestone list follows the paper's statements: a coordinate bound from §3.1; the weighted bucket estimate of Lemma 2; light-coordinate concentration in Lemma 3; the collision and exact-preservation statement of Lemma 5; the heavy-light cross-term estimate in Lemma 6; fixed-vector preservation in Lemma 7; and the passage to the whole subspace in Lemma 8. Their distinct probability spaces matter. Lemmas 2 and 5 concern bucket assignments, Lemmas 3, 6, and 7 concern signs for a fixed suitable assignment, and Lemma 8 is a general statement about a random linear map.

Significance

Theorem 11 gives a single compact random matrix that retains the Euclidean geometry of every vector in a specified rank-rrr column space with probability at least 9/109/109/10. It supports sketch-and-solve algorithms: a computation performed on ΦDA\Phi DAΦDA can use a much smaller row dimension while reasoning about the original column space. The construction also has exactly one nonzero per column, the structural fact behind its input-sparsity running time. The running-time bound is stated in the paper, but this mission's Lean target concerns the mathematical norm guarantee.

The paper already proves the theorem; the open work here is a machine-checked development of its statement and proof. The finite probability model, explicit squared norms, leverage scores, and bucket events can support later formalizations of other sparse sketching results. No machine-checked proof of Theorem 11 is claimed by this proposal. A complete development may reuse proved concentration inequalities from Mathlib or the platform, but the cited inequalities need their hypotheses checked against the finite-sign and weighted-bucket models used here.

Difficulty

A fixed-vector estimate does not itself imply that one random sketch works for all vectors of an uncountable subspace: the quantifier cannot simply be moved through the probability. Collisions also have different effects on high- and low-leverage coordinates. Heavy coordinates need a no-collision event; light coordinates can share buckets only while their total bucket weight remains controlled. The paper's statements keep these events and probability spaces separate. The final whole-subspace claim requires a uniform estimate whose failure probability accounts for the dimension rrr.

Formalization scope

Vectors are functions Fin n → ℝ, matrices are finite real matrices, and ∥v∥22\|v\|_2^2∥v∥22​ and ∥M∥F2\|M\|_F^2∥M∥F2​ are explicit sums of coordinate squares. The sample space is the product of all bucket maps and all Boolean sign assignments, with counting probability. Every theorem with a freely chosen bucket count assumes t>0t>0t>0; otherwise a Fin 0 sample space could make division by its cardinality meaningless. The theorem's size threshold forces this automatically when r≥1r\ge1r≥1 and 0<ε≤1/20<\varepsilon\le1/20<ε≤1/2. Matrix rank is Mathlib's matrix rank.

The formalization fixes 0<ε≤1/20<\varepsilon\le1/20<ε≤1/2 in Theorem 11. The upper bound prevents the logarithmic size expression from degenerating near r=ε=1r=\varepsilon=1r=ε=1, and r≥1r\ge1r≥1 keeps its logarithm and division meaningful. Positive TTT and WWW are explicit where needed; Lemma 6 restricts δC≤e−1\delta_C\le e^{-1}δC​≤e−1. The heavy/light split uses leverage thresholds rather than a row permutation, and constants described as absolute are quantified before every dimension, matrix, error, and failure parameter. In particular, Theorem 11's event quantifies over all xxx inside the probability, while Lemma 7 fixes yyy before sampling signs. These choices exclude degenerate distributions, vacuous error ranges, and a fixed-vector claim masquerading as the goal.

The refined ttt clause at the end of Theorem 11 is left out: its printed s2/30s^2/30s2/30 conflicts with the proof's collision requirement 30s230s^230s2, and its threshold parameter is not fixed in the claim. Lemma 1 and the cited Hanson–Wright moment result, Theorem 4, are proof tools outside this proposal's milestone set. Contributions that formalize those tools faithfully, prove the bucket and sign estimates, or connect the finite model to existing probability libraries are useful for the goal.

Selected references

  • Kenneth L. Clarkson and David P. Woodruff, Low Rank Approximation and Regression in Input Sparsity Time, arXiv:1207.6365v4, 2013. Preprint.
9 thms2 active usersReviewed
AlgebraCombinatoricsDiscrete Geometry·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 5: For h ≥ 2, Two h-Scattered Linear Sets Are PΓL(r, qⁿ)-Equivalent iff Their Subspaces Are ΓL(r, qⁿ)-EquivalentResearch Paper

Motivation

Linear sets are point sets of a finite projective space defined by a subspace over a subfield. They appear throughout finite geometry, for instance in the study of semifields and, through the correspondence studied by Sheekey and Van de Voorde (arXiv:1806.05929), maximum rank distance (MRD) codes; see Polverino's survey (doi:10.1016/j.disc.2009.04.007). In these applications one needs to decide when two linear sets are the same up to a collineation, which can be difficult (Csajbók–Zanella, arXiv:1501.03441; Csajbók–Marino–Polverino, arXiv:1607.06962). The natural candidate answer, "when their defining subspaces are in the same orbit of the semilinear group", is only a sufficient condition: on the projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) there are maximum scattered subspaces in different ΓL(2,qn)\Gamma\mathrm L(2,q^n)ΓL(2,qn)-orbits defining equivalent linear sets (the two papers just cited).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590, Combinatorica 41 (2021)) introduced hhh-scattered subspaces, a generalisation of scattered subspaces, and showed in their §4 that for h≥2h \ge 2h≥2 the sufficient condition is also necessary. This mission formalizes that result, Theorem 4.5.

Setting

Let Fq⊆Fqn\mathbb F_q \subseteq \mathbb F_{q^n}Fq​⊆Fqn​ be finite fields and let VVV be an rrr-dimensional vector space over Fqn\mathbb F_{q^n}Fqn​; it is also a vector space over Fq\mathbb F_qFq​. The projective space PG(V,Fqn)=PG(r−1,qn)\mathrm{PG}(V,\mathbb F_{q^n}) = \mathrm{PG}(r-1,q^n)PG(V,Fqn​)=PG(r−1,qn) has as points the one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces ⟨u⟩Fqn\langle u\rangle_{\mathbb F_{q^n}}⟨u⟩Fqn​​, u≠0u \ne 0u=0.

For an Fq\mathbb F_qFq​-subspace UUU of VVV, the Fq\mathbb F_qFq​-linear set of UUU is

LU={⟨u⟩Fqn:u∈U∖{0}},L_U = \{\langle u\rangle_{\mathbb F_{q^n}} : u \in U\setminus\{0\}\},LU​={⟨u⟩Fqn​​:u∈U∖{0}},

of rank dim⁡FqU\dim_{\mathbb F_q} UdimFq​​U.

For 0<h≤r−10 < h \le r-10<h≤r−1, the subspace UUU is hhh-scattered (Definition 1.1) if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U) \le hdimFq​​(S∩U)≤h. The linear set LUL_ULU​ of an hhh-scattered UUU is called hhh-scattered (Definition 4.1); for h=2h = 2h=2 it is scattered with respect to lines.

The group ΓL(r,qn)\Gamma\mathrm L(r,q^n)ΓL(r,qn) consists of the bijective additive maps fff of VVV that are semilinear: f(av)=aσf(v)f(av) = a^\sigma f(v)f(av)=aσf(v) for some field automorphism σ\sigmaσ of Fqn\mathbb F_{q^n}Fqn​. Each fff induces a collineation φf\varphi_fφf​ of PG(V,Fqn)\mathrm{PG}(V,\mathbb F_{q^n})PG(V,Fqn​), ⟨u⟩↦⟨f(u)⟩\langle u\rangle \mapsto \langle f(u)\rangle⟨u⟩↦⟨f(u)⟩, and these collineations form PΓL(r,qn)\mathrm P\Gamma\mathrm L(r,q^n)PΓL(r,qn). Two linear sets are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent if φf(LU)=LW\varphi_f(L_U) = L_Wφf​(LU​)=LW​ for some fff; two subspaces are ΓL\Gamma\mathrm LΓL-equivalent if f(U)=Wf(U) = Wf(U)=W for some fff.

Formalization targets

Goal: Theorem 4.5 (p. 14)

For h≥2h \ge 2h≥2 and hhh-scattered Fq\mathbb F_qFq​-subspaces UUU, WWW of V(r,qn)V(r,q^n)V(r,qn),

LU∼PΓL(r,qn)LW  ⟺  U∼ΓL(r,qn)W.L_U \sim_{\mathrm P\Gamma\mathrm L(r,q^n)} L_W \iff U \sim_{\Gamma\mathrm L(r,q^n)} W .LU​∼PΓL(r,qn)​LW​⟺U∼ΓL(r,qn)​W.

Milestones (in the order of the proof)

  1. Proposition 2.1 (p. 3): an hhh-scattered subspace is iii-scattered for every 0<i<h0 < i < h0<i<h.
  2. Proposition 4.2 (p. 13, quoted from Bonoli–Polverino [5]): on a projective line PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), (1) a linear set with q+1q+1q+1 points has rank 222; (2) two subspaces defining the same linear set of size q+1q+1q+1 and sharing a nonzero vector coincide.
  3. Proposition 4.3 (p. 13): if UUU is 222-scattered and LW=LUL_W = L_ULW​=LU​, then dim⁡FqW=dim⁡FqU\dim_{\mathbb F_q} W = \dim_{\mathbb F_q} UdimFq​​W=dimFq​​U.
  4. Lemma 4.4 (p. 13): if UUU is 222-scattered and LU=LWL_U = L_WLU​=LW​, then U=λWU = \lambda WU=λW for some λ∈Fqn∗\lambda\in\mathbb F_{q^n}^*λ∈Fqn∗​.

Significance

The result. Theorem 4.5 says that, for h≥2h\ge2h≥2, an hhh-scattered linear set remembers its defining subspace up to a scalar and up to the semilinear group. The equivalence problem for such linear sets, a geometric question about point sets, becomes the equivalence problem for subspaces, which is algebraic and can be attacked with linearized polynomials. Through the correspondence of Sheekey and Van de Voorde between maximum (r−1)(r-1)(r−1)-scattered subspaces and MRD codes, the paper derives from it (Theorem 4.10, not part of this mission) that two Fq\mathbb F_qFq​-linear MRD codes with minimum distance n−r+1n-r+1n−r+1, r>2r>2r>2, and left idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​ are equivalent if and only if their associated linear sets in PG(r−1,qn)\mathrm{PG}(r-1,q^n)PG(r−1,qn) are PΓL\mathrm P\Gamma\mathrm LPΓL-equivalent. Lemma 4.4 and Proposition 4.3 are of independent use: they say that the rank and, up to scalars, the subspace of any linear set scattered with respect to lines are invariants of the point set.

The formalization. The theorem is proved in the paper; no part of it, nor any statement about linear sets over a field extension, is machine-checked in Mathlib. The mission produces a formal model of linear sets, of the semilinear group and of its induced collineations that later finite-geometry missions can reuse, together with formal proofs of the four milestones. Proposition 4.2 is quoted from [5] without proof in the paper, so formalizing it means formalizing Bonoli and Polverino's argument.

Difficulty

The "if" direction is a direct computation, LUf=LUφfL_{U^f} = L_U^{\varphi_f}LUf​=LUφf​​. The obvious approach to the converse, reconstructing UUU from LUL_ULU​ point by point, fails because a point ⟨u⟩\langle u\rangle⟨u⟩ of LUL_ULU​ determines U∩⟨u⟩U\cap\langle u\rangleU∩⟨u⟩ only up to a scalar of Fqn∗\mathbb F_{q^n}^*Fqn∗​, and these scalars can a priori differ from point to point. Without the condition h≥2h \ge 2h≥2 they really do differ: for h=1h = 1h=1 the theorem is false. The step that needs h≥2h\ge2h≥2 is the rigidity of the intersections of UUU with two-dimensional Fqn\mathbb F_{q^n}Fqn​-subspaces, which is where the quoted result on linear sets of size q+1q+1q+1 on a projective line enters. Proposition 4.2 itself is a counting statement about point weights on PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn) and is not available in any library.

Formalization scope

  • Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are arbitrary finite fields F, K with [Algebra F K]; qqq is Fintype.card F. VVV is a finite-dimensional K-module with a compatible F-module structure ([IsScalarTower F K V]), and rrr is Module.finrank K V.
  • IsHScattered F K h U includes the range 0<h<r0 < h < r0<h<r and the spanning condition ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}} = V⟨U⟩Fqn​​=V, as in Definition 1.1. With h≥2h\ge2h≥2 this forces r≥3r\ge3r≥3.
  • A point is the K-submodule K ∙ u; linearSet F K U is a Set (Submodule K V) and ∣LU∣|L_U|∣LU​∣ is its Set.ncard.
  • ΓL\Gamma\mathrm LΓL is the set of f : V ≃+ V for which some σ : K ≃+* K gives f (a • v) = σ a • f v. The collineation φf\varphi_fφf​ sends a subspace PPP to Submodule.span K (f '' P). The image UfU^fUf is the set f '' U, and λW\lambda WλW is (λ • ·) '' W with λ≠0\lambda\ne0λ=0.
  • Two trivializing readings are excluded. Restricting to linear maps (GL, PGL) would prove a different, weaker statement; taking PΓL\mathrm{P}\Gamma\mathrm{L}PΓL-equivalence to mean "some bijection of points maps LUL_ULU​ to LWL_WLW​" would make the "only if" direction false. Both equivalences quantify over the full semilinear group, and the collineation is the one induced by the same fff.
  • Proposition 4.2 is a result the paper numbers but quotes from [5] (Bonoli–Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4)). It is a milestone with its own proof obligation and is not assumed. The two parts are separate items.
  • Proposition 2.1's "for any i<hi < hi<h" is read as 0<i<h0 < i < h0<i<h, the range on which Definition 1.1 defines iii-scattered.

Welcome contributions: the general theory of linear sets (point weights, ∣LU∣≤(qk−1)/(q−1)|L_U| \le (q^k-1)/(q-1)∣LU​∣≤(qk−1)/(q−1) with equality iff UUU is scattered), the fact that a semilinear map of VVV maps Fq\mathbb F_qFq​-subspaces to Fq\mathbb F_qFq​-subspaces, and the counting argument behind Proposition 4.2. These are reusable for every linear-set mission.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, Combinatorica 41 (2021); arXiv:1906.10590v2 (2020). https://arxiv.org/abs/1906.10590
  • G. Bonoli, O. Polverino, Fq\mathbb F_qFq​-linear blocking sets in PG(2,q4)\mathrm{PG}(2,q^4)PG(2,q4), Innov. Incidence Geom. 2 (2005), 35–56. https://doi.org/10.2140/iig.2005.2.35
  • B. Csajbók, G. Marino, O. Polverino, Classes and equivalence of linear sets in PG(1,qn)\mathrm{PG}(1,q^n)PG(1,qn), J. Combin. Theory Ser. A 157 (2018), 402–426. https://arxiv.org/abs/1607.06962
  • B. Csajbók, C. Zanella, On the equivalence of linear sets, Des. Codes Cryptogr. 81 (2016), 269–281. https://arxiv.org/abs/1501.03441
  • O. Polverino, Linear sets in finite projective spaces, Discrete Math. 310 (2010), 3096–3107. https://doi.org/10.1016/j.disc.2009.04.007
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://arxiv.org/abs/1806.05929
9 thms2 active usersReviewed
AlgebraCombinatoricsDiscrete Geometry·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 4: For n ≥ h + 3, the Delsarte Dual of a Maximum h-Scattered Subspace of Dimension rn/(h + 1) Is Maximum (n − h − 2)-ScatteredResearch Paper

Motivation

Scattered subspaces are a central object of finite geometry. An Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space is scattered when every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace meets it in Fq\mathbb F_qFq​-dimension at most one. They give the largest scattered linear sets of projective spaces, and through them constructions of two-intersection sets, two-weight codes, strongly regular graphs and, most prominently, maximum rank distance (MRD) codes. Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2) generalise the notion to hhh-scattered subspaces, which meet every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace in Fq\mathbb F_qFq​-dimension at most hhh, prove the dimension bound rn/(h+1)rn/(h+1)rn/(h+1), and ask when it is attained.

When h+1h+1h+1 divides rrr, direct sums of known examples reach the bound (Theorem 2.6 of the paper). For other values of rrr the paper introduces a duality, the Delsarte dual, which turns a maximum hhh-scattered subspace of one space into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of a space of another dimension. The name comes from Delsarte's duality on MRD codes, which the paper shows corresponds to it (Theorem 4.12). This mission is about that duality: Theorem 3.3 of the paper.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, with n=dim⁡FqFqnn=\dim_{\mathbb F_q}\mathbb F_{q^n}n=dimFq​​Fqn​. Write V(r,qn)V(r,q^n)V(r,qn) for an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space; it is also an Fq\mathbb F_qFq​-space of dimension rnrnrn.

Definition 1.1. For 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace UUU of V=V(r,qn)V=V(r,q^n)V=V(r,qn) is hhh-scattered if ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V and every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV satisfies dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h. It is maximum hhh-scattered if no hhh-scattered subspace of VVV has larger Fq\mathbb F_qFq​-dimension. The paper's Theorem 2.3 shows that an hhh-scattered subspace either has dimension rrr and defines a subgeometry, or has dimension at most rn/(h+1)rn/(h+1)rn/(h+1).

The setting of §3. Let V\mathbb VV be a kkk-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space, written as a direct sum V=Λ⊕Γ\mathbb V=\Lambda\oplus\GammaV=Λ⊕Γ of Fqn\mathbb F_{q^n}Fqn​-subspaces with dim⁡Λ=r\dim\Lambda=rdimΛ=r and dim⁡Γ=k−r\dim\Gamma=k-rdimΓ=k−r. Let WWW be a kkk-dimensional Fq\mathbb F_qFq​-subspace of V\mathbb VV with ⟨W⟩Fqn=V\langle W\rangle_{\mathbb F_{q^n}}=\mathbb V⟨W⟩Fqn​​=V and W∩Γ={0}W\cap\Gamma=\{0\}W∩Γ={0}, and put

U=⟨W,Γ⟩Fq∩Λ,U=\langle W,\Gamma\rangle_{\mathbb F_q}\cap\Lambda ,U=⟨W,Γ⟩Fq​​∩Λ,

an Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ. Every kkk-dimensional Fq\mathbb F_qFq​-subspace of Λ\LambdaΛ with k>rk>rk>r arises in this way (Lunardon and Polverino, cited as [21, Theorems 1, 2] in the paper). Let β:V×V→Fqn\beta:\mathbb V\times\mathbb V\to\mathbb F_{q^n}β:V×V→Fqn​ be a non-degenerate reflexive sesquilinear form with companion automorphism σ\sigmaσ (linear in the first argument, β(v,aw)=aσβ(v,w)\beta(v,aw)=a^\sigma\beta(v,w)β(v,aw)=aσβ(v,w)) which takes values in Fq\mathbb F_qFq​ on W×WW\times WW×W; equivalently, β\betaβ extends a non-degenerate reflexive form β′:W×W→Fq\beta':W\times W\to\mathbb F_qβ′:W×W→Fq​. Write Γ⊥={v:β(v,g)=0 ∀g∈Γ}\Gamma^\perp=\{v:\beta(v,g)=0\ \forall g\in\Gamma\}Γ⊥={v:β(v,g)=0 ∀g∈Γ}, an rrr-dimensional subspace. The Delsarte dual of UUU (Definition 3.2) is the Fq\mathbb F_qFq​-subspace

Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,\bar U=W+\Gamma^\perp=\{w+\Gamma^\perp:w\in W\}\subseteq\mathbb V/\Gamma^\perp ,Uˉ=W+Γ⊥={w+Γ⊥:w∈W}⊆V/Γ⊥,

a subspace of a (k−r)(k-r)(k−r)-dimensional Fqn\mathbb F_{q^n}Fqn​-space.

Formalization targets

Goal: Theorem 3.3

Suppose UUU is a maximum hhh-scattered Fq\mathbb F_qFq​-subspace of Λ=V(r,qn)\Lambda=V(r,q^n)Λ=V(r,qn) of dimension k=rn/(h+1)k=rn/(h+1)k=rn/(h+1), and n≥h+3n\ge h+3n≥h+3. Then

Uˉ is a maximum (n−h−2)-scattered Fq-subspace of V/Γ⊥=V ⁣(rnh+1−r, qn),dim⁡FqUˉ=k.\bar U \text{ is a maximum } (n-h-2)\text{-scattered } \mathbb F_q\text{-subspace of } \mathbb V/\Gamma^\perp=V\!\left(\tfrac{rn}{h+1}-r,\ q^n\right),\qquad \dim_{\mathbb F_q}\bar U=k .Uˉ is a maximum (n−h−2)-scattered Fq​-subspace of V/Γ⊥=V(h+1rn​−r, qn),dimFq​​Uˉ=k.

The statement holds for every admissible choice of the embedding and of β\betaβ.

Milestones

  1. Theorem 2.7 (p. 8): a maximum hhh-scattered subspace of dimension rn/(h+1)rn/(h+1)rn/(h+1) meets every hyperplane HHH in dimension between rn/(h+1)−nrn/(h+1)-nrn/(h+1)−n and rn/(h+1)−n+hrn/(h+1)-n+hrn/(h+1)−n+h.
  2. The identity (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ (p. 9) for Fq\mathbb F_qFq​-subspaces SSS of WWW, where S∗=⟨S⟩FqnS^*=\langle S\rangle_{\mathbb F_{q^n}}S∗=⟨S⟩Fqn​​ and ⊥′\perp'⊥′ is orthogonality for β′\beta'β′.
  3. Proposition 3.1 (p. 9): if k>rk>rk>r and every hyperplane MMM of Λ\LambdaΛ satisfies dim⁡Fq(M∩U)<k−1\dim_{\mathbb F_q}(M\cap U)<k-1dimFq​​(M∩U)<k−1 (condition (⋄)(\diamond)(⋄)), then dim⁡FqUˉ=k\dim_{\mathbb F_q}\bar U=kdimFq​​Uˉ=k.
  4. Theorem 2.3 (p. 4): the dimension bound rn/(h+1)rn/(h+1)rn/(h+1) for hhh-scattered subspaces.

Significance

The result. Theorem 3.3 converts a maximum hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) of dimension rn/(h+1)rn/(h+1)rn/(h+1) into a maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspace of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn). For h=r−1h=r-1h=r−1 it was known through MRD codes; the paper proves it for every hhh. Its consequences in the paper are Corollaries 3.4 and 3.5 and Theorem 3.6: when n≥4n\ge4n≥4 is even and r≥3r\ge3r≥3 is odd, maximum (n−3)(n-3)(n−3)-scattered subspaces of V(r(n−2)/2,qn)V(r(n-2)/2,q^n)V(r(n−2)/2,qn) exist which the direct sum construction of Theorem 2.6 cannot produce, because n−2n-2n−2 does not divide r(n−2)/2r(n-2)/2r(n−2)/2. Theorem 3.3 is also the geometric counterpart of Delsarte duality of MRD codes (Theorem 4.12 of the paper).

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. A formalization would provide a reusable treatment of sesquilinear forms whose restriction to an Fq\mathbb F_qFq​-form is controlled, of orthogonal complements across the field extension Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​, and of the passage between Λ\LambdaΛ, V/Γ\mathbb V/\GammaV/Γ and V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥. Theorems 2.3 and 2.7 are also the goals of companion missions in this series; here they enter as milestones.

Difficulty

The definition of Uˉ\bar UUˉ is easy; the content is in two dimension statements. First, W+Γ⊥W+\Gamma^\perpW+Γ⊥ must not collapse: W∩Γ⊥={0}W\cap\Gamma^\perp=\{0\}W∩Γ⊥={0} is not automatic and depends on the hyperplane condition (⋄)(\diamond)(⋄) on UUU, which in turn needs the upper bound of Theorem 2.7, whose proof in the paper is a long counting argument with Gaussian binomials (Section 5). Second, the scattered property must be transported through the duality: a large intersection of Uˉ\bar UUˉ with an (n−h−2)(n-h-2)(n−h−2)-dimensional subspace of V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥ must be converted into a large intersection of UUU with a hyperplane of Λ\LambdaΛ. This conversion runs through three different spaces and two different orthogonalities, ⊥\perp⊥ over Fqn\mathbb F_{q^n}Fqn​ and ⊥′\perp'⊥′ over Fq\mathbb F_qFq​, and the identification (S∗)⊥=(S⊥′)∗(S^*)^\perp=(S^{\perp'})^*(S∗)⊥=(S⊥′)∗ between them requires that WWW have an Fq\mathbb F_qFq​-basis which is an Fqn\mathbb F_{q^n}Fqn​-basis of V\mathbb VV. Maximality is a further step that uses the bound of Theorem 2.3 in V/Γ⊥\mathbb V/\Gamma^\perpV/Γ⊥.

Formalization scope

Fq\mathbb F_qFq​ and Fqn\mathbb F_{q^n}Fqn​ are finite fields F, K with Algebra F K; V\mathbb VV is a finite-dimensional K-module with a compatible F-structure (IsScalarTower F K 𝕍). The setting of §3 is a structure DelsarteSetting F K 𝕍 holding Λ,Γ\Lambda,\GammaΛ,Γ (complementary), WWW (with dim⁡FqW=dim⁡FqnV\dim_{\mathbb F_q}W=\dim_{\mathbb F_{q^n}}\mathbb VdimFq​​W=dimFqn​​V, spanning, W∩Γ=0W\cap\Gamma=0W∩Γ=0), σ:Fqn≃Fqn\sigma:\mathbb F_{q^n}\simeq\mathbb F_{q^n}σ:Fqn​≃Fqn​ and β:V→FqnV→σFqn\beta:\mathbb V\to_{\mathbb F_{q^n}}\mathbb V\to_{\sigma}\mathbb F_{q^n}β:V→Fqn​​V→σ​Fqn​ with non-degeneracy, reflexivity and β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​. The embedding of Λ\LambdaΛ into V\mathbb VV is data, not a theorem; its existence is cited by the paper and is not an item. The paper's β′\beta'β′ is the restriction of β\betaβ to WWW.

Conventions pinned:

  • UUU is an F-subspace of the type ↥Λ, and "h-scattered in Λ\LambdaΛ" is Definition 1.1 with ambient space Λ\LambdaΛ, including 0<h<r0<h<r0<h<r and ⟨U⟩Fqn=Λ\langle U\rangle_{\mathbb F_{q^n}}=\Lambda⟨U⟩Fqn​​=Λ. The dual is (n − h − 2)-scattered in the quotient 𝕍 ⧸ Γ^⊥, whose dimension is k−rk-rk−r.
  • Every rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out: (h+1)dim⁡U=rn(h+1)\dim U=rn(h+1)dimU=rn. Hyperplanes are subspaces with dim⁡+1=dim⁡\dim+1=\dimdim+1=dim of the ambient space; dim⁡<k−1\dim<k-1dim<k−1 is written dim⁡+1<k\dim+1<kdim+1<k. The only natural-number subtraction is the index n−h−2n-h-2n−h−2, exact because n≥h+3n\ge h+3n≥h+3.
  • The paper's k>rk>rk>r is a hypothesis of Proposition 3.1, as on the page, and is derived (not assumed) in Theorem 3.3.

The form must be non-degenerate and Fq\mathbb F_qFq​-valued on WWW: with β=0\beta=0β=0 one would get Γ⊥=V\Gamma^\perp=\mathbb VΓ⊥=V and a zero quotient, and without β(W,W)⊆Fq\beta(W,W)\subseteq\mathbb F_qβ(W,W)⊆Fq​ the subspace W+Γ⊥W+\Gamma^\perpW+Γ⊥ is not the paper's Delsarte dual; both conditions are fields of the setting and may not be dropped.

Cited inputs: none of the milestones is proved elsewhere; Theorems 2.3 and 2.7 duplicate the goals of companion missions 1 and 3 and may be closed by importing their proofs once published. Contributions welcome: the sesquilinear-form infrastructure (dimension of orthogonal complements, the extension of β′\beta'β′ from WWW to V\mathbb VV), Proposition 3.1, and the transport argument of Theorem 3.3.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590v2
  • G. Lunardon, O. Polverino, Translation ovoids of orthogonal polar spaces, Forum Math. 16 (2004), 663–669 (the embedding used in §3).
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243 (the case h = 1 of the bound).
  • P. Delsarte, Bilinear forms over a finite field, with applications to coding theory, J. Combin. Theory Ser. A 25 (1978), 226–241 (Delsarte duality of rank-metric codes).
8 thms2 active usersReviewed
AlgebraCombinatoricsDiscrete Geometry·Captain: mikedeng1

Generalising the Scattered Property of Subspaces 2: If h + 1 Divides r and n ≥ h + 1, Maximum h-Scattered 𝔽_q-Subspaces of V(r, qⁿ) of Dimension rn/(h + 1) ExistResearch Paper

Motivation

A scattered subspace is an Fq\mathbb F_qFq​-subspace UUU of an Fqn\mathbb F_{q^n}Fqn​-vector space VVV that meets every one-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace of VVV in an Fq\mathbb F_qFq​-subspace of dimension at most one. Scattered subspaces produce scattered linear sets in projective spaces over finite fields, and through them two-intersection sets, two-weight codes, translation caps and maximum rank distance (MRD) codes. Blokhuis and Lavrauw (Geom. Dedicata 2000) proved that a scattered subspace of V(r,qn)V(r,q^n)V(r,qn) has dimension at most rn/2rn/2rn/2, and constructions of that dimension are known whenever rnrnrn is even (see Bartoli, Giulietti, Marino, Polverino 2018 and the references there).

Csajbók, Marino, Polverino and Zullo (arXiv:1906.10590v2, Combinatorica 41, 2021) replace "one-dimensional" by "hhh-dimensional". The resulting hhh-scattered subspaces interpolate between scattered subspaces (h=1h=1h=1) and subspaces meeting every hyperplane in small dimension (h=r−1h=r-1h=r−1), which Sheekey and Van de Voorde (Des. Codes Cryptogr. 2020) showed to be equivalent to MRD codes with an idealiser isomorphic to Fqn\mathbb F_{q^n}Fqn​. For the new notion the paper proves an upper bound on the dimension (Theorem 2.3) and shows that the bound is attained when h+1h+1h+1 divides rrr (Theorem 2.6). This mission is the attainment half.

Setting

Let Fq⊆Fqn\mathbb F_q\subseteq\mathbb F_{q^n}Fq​⊆Fqn​ be finite fields, so n=[Fqn:Fq]n=[\mathbb F_{q^n}:\mathbb F_q]n=[Fqn​:Fq​], and let V=V(r,qn)V=V(r,q^n)V=V(r,qn) be an rrr-dimensional Fqn\mathbb F_{q^n}Fqn​-vector space with r≥1r\ge1r≥1. Every Fqn\mathbb F_{q^n}Fqn​-space is also an Fq\mathbb F_qFq​-space of dimension rnrnrn. For an integer hhh with 0<h≤r−10<h\le r-10<h≤r−1, an Fq\mathbb F_qFq​-subspace U≤VU\le VU≤V is hhh-scattered (Definition 1.1) if

  1. UUU spans VVV over Fqn\mathbb F_{q^n}Fqn​, ⟨U⟩Fqn=V\langle U\rangle_{\mathbb F_{q^n}}=V⟨U⟩Fqn​​=V, and
  2. dim⁡Fq(S∩U)≤h\dim_{\mathbb F_q}(S\cap U)\le hdimFq​​(S∩U)≤h for every hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace SSS of VVV.

An hhh-scattered subspace of largest possible Fq\mathbb F_qFq​-dimension is maximum hhh-scattered. Theorem 2.3 of the paper says that an hhh-scattered UUU either has dimension rrr and defines a subgeometry (an Fq\mathbb F_qFq​-basis of UUU is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV), or satisfies

dim⁡FqU≤rnh+1.(1)\dim_{\mathbb F_q}U\le\frac{rn}{h+1}.\tag{1}dimFq​​U≤h+1rn​.(1)

Two building blocks appear in the statements. If V=V1⊕⋯⊕VtV=V_1\oplus\dots\oplus V_tV=V1​⊕⋯⊕Vt​ with Vi=V(ri,qn)V_i=V(r_i,q^n)Vi​=V(ri​,qn) and Ui≤ViU_i\le V_iUi​≤Vi​ are Fq\mathbb F_qFq​-subspaces, then U=U1⊕⋯⊕UtU=U_1\oplus\dots\oplus U_tU=U1​⊕⋯⊕Ut​ is the direct sum of the UiU_iUi​. For r≤nr\le nr≤n the Gabidulin-type subspace of Fqn r\mathbb F_{q^n}^{\,r}Fqnr​ is

Gr={(x,xq,xq2,…,xqr−1):x∈Fqn},G_r=\{(x,x^{q},x^{q^2},\dots,x^{q^{r-1}}) : x\in\mathbb F_{q^n}\},Gr​={(x,xq,xq2,…,xqr−1):x∈Fqn​},

the image of an Fq\mathbb F_qFq​-linear map, since x↦xqjx\mapsto x^{q^j}x↦xqj fixes Fq\mathbb F_qFq​.

Formalization targets

Goal: Theorem 2.6 (p. 7)

If h≥1h\ge1h≥1, h+1h+1h+1 divides rrr and n≥h+1n\ge h+1n≥h+1, then V(r,qn)V(r,q^n)V(r,qn) contains an Fq\mathbb F_qFq​-subspace UUU that is maximum hhh-scattered and satisfies

dim⁡FqU=rnh+1.\dim_{\mathbb F_q}U=\frac{rn}{h+1}.dimFq​​U=h+1rn​.

Milestones, in the order the paper uses them

  • Proposition 2.1 (p. 3): for h>1h>1h>1, every hhh-scattered subspace is iii-scattered for all 0<i<h0<i<h0<i<h.
  • Theorem 2.3 (p. 4): the dichotomy above, subgeometry or bound (1).
  • Theorem 2.4 (p. 6): if UiU_iUi​ is hih_ihi​-scattered in ViV_iVi​, then U1⊕⋯⊕UtU_1\oplus\dots\oplus U_tU1​⊕⋯⊕Ut​ is min⁡ihi\min_i h_imini​hi​-scattered in V1⊕⋯⊕VtV_1\oplus\dots\oplus V_tV1​⊕⋯⊕Vt​.
  • Theorem 2.4, second sentence (p. 6): if every UiU_iUi​ is hhh-scattered with dim⁡FqUi=rin/(h+1)\dim_{\mathbb F_q}U_i=r_in/(h+1)dimFq​​Ui​=ri​n/(h+1), then the direct sum is hhh-scattered of dimension rn/(h+1)rn/(h+1)rn/(h+1).
  • Example 2.5 (p. 7): for 2≤r≤n2\le r\le n2≤r≤n, GrG_rGr​ is maximum (r−1)(r-1)(r−1)-scattered of dimension nnn.

Significance

Together with Theorem 2.3, the goal settles the largest dimension of an hhh-scattered subspace of V(r,qn)V(r,q^n)V(r,qn) whenever h+1∣rh+1\mid rh+1∣r and n≥h+1n\ge h+1n≥h+1: it is exactly rn/(h+1)rn/(h+1)rn/(h+1). The subspaces it produces are the input of the paper's Delsarte duality (Theorem 3.3), which turns maximum hhh-scattered subspaces of V(r,qn)V(r,q^n)V(r,qn) reaching bound (1) into maximum (n−h−2)(n-h-2)(n−h−2)-scattered subspaces of V(rn/(h+1)−r,qn)V(rn/(h+1)-r,q^n)V(rn/(h+1)−r,qn) and so gives constructions also when h+1∤rh+1\nmid rh+1∤r. The direct-sum theorem is also of independent use: it extends the direct-sum construction for scattered linear sets of Bartoli, Giulietti, Marino and Polverino to every hhh, and Example 2.5 gives the subspace counterpart of Gabidulin codes.

All results in this mission are proved in the paper. To our knowledge none of them has a machine-checked proof; no formal library contains scattered subspaces, linear sets or Gabidulin-type subspaces. The remaining work is formalizing the paper's arguments: the counting of roots of linearized polynomials behind Example 2.5, the Grassmann-formula and quotient-space argument of Theorem 2.4, and the bound (1) of Theorem 2.3, which the companion mission on the dimension bound states as its goal.

Difficulty

The construction itself is short; the work lies in the three ingredients. The obvious approach to Theorem 2.4 fails: an hhh-dimensional Fqn\mathbb F_{q^n}Fqn​-subspace WWW of V1⊕V2V_1\oplus V_2V1​⊕V2​ need not be the sum of its intersections with V1V_1V1​ and V2V_2V2​, so the intersection W∩UW\cap UW∩U cannot be bounded summand by summand. Example 2.5 needs that a nonzero qqq-polynomial ∑j<rajxqj\sum_{j<r}a_jx^{q^j}∑j<r​aj​xqj has at most qr−1q^{r-1}qr−1 roots in Fqn\mathbb F_{q^n}Fqn​, and the root set is an Fq\mathbb F_qFq​-subspace. Maximality is not a property of a single subspace: it quantifies over every hhh-scattered subspace of VVV and so needs the full upper bound of Theorem 2.3, including the case n<h+1n<h+1n<h+1 handled there by Proposition 2.1.

Formalization scope

Fq\mathbb F_qFq​ is a finite field F, Fqn\mathbb F_{q^n}Fqn​ a finite field K with Algebra F K, so q=q=q= Fintype.card F and n=n=n= Module.finrank F K. VVV is a finite-dimensional K-module with a compatible F-module structure (IsScalarTower F K V), and r=r=r= Module.finrank K V. An Fq\mathbb F_qFq​-subspace is a Submodule F V; its intersection with an Fqn\mathbb F_{q^n}Fqn​-subspace S is S.restrictScalars F ⊓ U.

Conventions the statements commit to:

  • The range 0<h<r0<h<r0<h<r and the spanning condition are part of IsHScattered; without the range every spanning subspace would be hhh-scattered for h≥rh\ge rh≥r.
  • Every quotient rn/(h+1)rn/(h+1)rn/(h+1) is multiplied out, as (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn or ≤rn\le rn≤rn; no natural-number division is used.
  • The direct sum in Theorem 2.4 is external: V=∏i<tViV=\prod_{i<t}V_iV=∏i<t​Vi​ ((i : Fin t) → V i) and U=U=U= Submodule.pi Set.univ U. The minimum h=min⁡ihih=\min_i h_ih=mini​hi​ is given by h≤hih\le h_ih≤hi​ for all iii and h=hih=h_ih=hi​ for some iii. The second part of Theorem 2.4 assumes t≥1t\ge1t≥1.
  • Example 2.5 is stated on Fin r → K, with GrG_rGr​ the range of the F-linear map x↦(xqj)j<rx\mapsto(x^{q^j})_{j<r}x↦(xqj)j<r​, and assumes r≥2r\ge2r≥2 so that (r−1)(r-1)(r−1)-scattered is within Definition 1.1's range.
  • The goal assumes r≥1r\ge1r≥1: h+1h+1h+1 divides 000, but the zero space has no hhh-scattered subspace. The upper end h<rh<rh<r follows from h+1∣rh+1\mid rh+1∣r.
  • "Defines a subgeometry" in Theorem 2.3 is: some subset of UUU spans UUU over Fq\mathbb F_qFq​ and is an Fqn\mathbb F_{q^n}Fqn​-basis of VVV.

The goal is not satisfied by a small subspace: both the dimension equality (h+1)dim⁡FqU=rn(h+1)\dim_{\mathbb F_q}U=rn(h+1)dimFq​​U=rn and maximality among all hhh-scattered subspaces of VVV are part of its conclusion.

Results the paper cites without a number (the Blokhuis–Lavrauw bound for h=1h=1h=1, the direct-sum theorem for scattered linear sets) are not items. Theorem 2.3 is restated here because the maximality in Theorem 2.6 rests on it; it duplicates the goal of the companion mission. Useful infrastructure beyond this mission: roots of linearized polynomials over finite fields, dimension formulas for subspaces under restriction of scalars, and direct sums of hhh-scattered subspaces. Contributions on any milestone are welcome, and the goal can be closed from the milestones alone.

Selected references

  • B. Csajbók, G. Marino, O. Polverino, F. Zullo, Generalising the scattered property of subspaces, arXiv:1906.10590v2, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/1906.10590, https://doi.org/10.1007/s00493-020-4347-y
  • A. Blokhuis, M. Lavrauw, Scattered spaces with respect to a spread in PG(n, q), Geom. Dedicata 81 (2000), 231–243. https://doi.org/10.1023/A:1005283806897
  • D. Bartoli, M. Giulietti, G. Marino, O. Polverino, Maximum scattered linear sets and complete caps in Galois spaces, Combinatorica 38 (2018), 255–278. https://doi.org/10.1007/s00493-016-3531-6
  • J. Sheekey, G. Van de Voorde, Rank-metric codes, linear sets, and their duality, Des. Codes Cryptogr. 88 (2020), 655–675. https://doi.org/10.1007/s10623-019-00703-z
10 thms2 active usersReviewed
ProbabilityRandom Matrix TheoryStatistics·Captain: mikedeng1

User-Friendly Tail Bounds for Sums of Random Matrices IV: The Matrix Bennett and Bernstein Inequalities for Independent Zero-Mean Random Matrices with Bounded Largest EigenvalueResearch Paper

Motivation

The scalar Bernstein and Bennett inequalities bound the upper tail of a sum of independent, zero-mean random variables that are bounded above: the tail is governed by the total variance at moderate deviations and by the uniform bound in the far tail. Many questions in randomized numerical linear algebra, matrix completion, covariance estimation, graph sparsification and statistical learning reduce to the same question for a sum of independent random matrices, where the quantity of interest is the largest eigenvalue or the spectral norm of the sum rather than a scalar.

Ahlswede and Winter (2002) introduced a matrix Laplace transform method based on the Golden–Thompson inequality. Oliveira (2010) and Gross (2011) proved matrix Bernstein-type bounds with this method. Tropp (arXiv:1004.4389, Found. Comput. Math. 12 (2012)) replaced the Golden–Thompson step with Lieb's concavity theorem, obtaining a master tail bound for independent sums (Theorem 3.6) from which matrix Bennett and Bernstein inequalities follow with the variance parameter ∥∑kEXk2∥\|\sum_k \mathbb E X_k^2\|∥∑k​EXk2​∥, the natural analogue of the scalar variance. This mission formalizes §6 of that paper.

Timeline:

  • 1924–1962, Bernstein and Bennett: scalar inequalities for bounded and subexponential sums.
  • 2002, Ahlswede–Winter: the matrix Laplace transform method, via Golden–Thompson.
  • 2010, Oliveira; Gross: matrix Bernstein-type bounds by the Ahlswede–Winter method.
  • 2010–2012, Tropp: master tail bound via Lieb's theorem; matrix Bennett and Bernstein inequalities (Theorems 6.1, 6.2) with variance parameter ∥∑kEXk2∥\|\sum_k\mathbb E X_k^2\|∥∑k​EXk2​∥.

Setting

All matrices are d×dd\times dd×d complex matrices with d≥1d\ge 1d≥1. For a self-adjoint (Hermitian) matrix AAA, λmax⁡(A)\lambda_{\max}(A)λmax​(A) is its largest eigenvalue and ∥A∥\|A\|∥A∥ its spectral norm. The semidefinite order A≼BA\preccurlyeq BA≼B means that B−AB-AB−A is positive semidefinite. Functions of a self-adjoint matrix are defined spectrally: if A=QΛQ∗A=Q\Lambda Q^*A=QΛQ∗, then f(A)=Qf(Λ)Q∗f(A)=Qf(\Lambda)Q^*f(A)=Qf(Λ)Q∗; this gives the matrix exponential eAe^AeA and, on positive-definite matrices, the matrix logarithm log⁡A\log AlogA. The trace is tr⁡\operatorname{tr}tr.

A random matrix is a measurable map X:Ω→Cd×dX:\Omega\to\mathbb C^{d\times d}X:Ω→Cd×d on a probability space (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P); its expectation EX\mathbb E XEX is taken entrywise. A finite sequence X1,…,XnX_1,\dots,X_nX1​,…,Xn​ of random self-adjoint matrices is independent if the maps are mutually independent.

The setting of the goal: X1,…,XnX_1,\dots,X_nX1​,…,Xn​ are independent random self-adjoint matrices with

EXk=0andλmax⁡(Xk)≤R almost surely,\mathbb E X_k=0\qquad\text{and}\qquad \lambda_{\max}(X_k)\le R\ \text{almost surely},EXk​=0andλmax​(Xk​)≤R almost surely,

and the total variance is σ2:=∥∑kE(Xk2)∥\sigma^2:=\big\|\sum_k \mathbb E(X_k^2)\big\|σ2:=​∑k​E(Xk2​)​. Bennett's function is h(u):=(1+u)log⁡(1+u)−uh(u):=(1+u)\log(1+u)-uh(u):=(1+u)log(1+u)−u for u≥0u\ge0u≥0.

Formalization targets

Goal: Theorem 6.1 (matrix Bernstein, bounded case)

For every t≥0t\ge0t≥0, the following chain holds:

P{λmax⁡(∑kXk)≥t}≤d⋅exp⁡(−σ2R2 h(Rtσ2))≤d⋅exp⁡(−t2/2σ2+Rt/3),\mathbb P\Big\{\lambda_{\max}\Big(\sum_k X_k\Big)\ge t\Big\}\le d\cdot\exp\Big(-\frac{\sigma^2}{R^2}\,h\Big(\frac{Rt}{\sigma^2}\Big)\Big)\le d\cdot\exp\Big(\frac{-t^2/2}{\sigma^2+Rt/3}\Big),P{λmax​(k∑​Xk​)≥t}≤d⋅exp(−R2σ2​h(σ2Rt​))≤d⋅exp(σ2+Rt/3−t2/2​),

and the last term is at most d e−3t2/8σ2d\,e^{-3t^2/8\sigma^2}de−3t2/8σ2 for t≤σ2/Rt\le\sigma^2/Rt≤σ2/R and at most d e−3t/8Rd\,e^{-3t/8R}de−3t/8R for t≥σ2/Rt\ge\sigma^2/Rt≥σ2/R. The first inequality is the matrix Bennett inequality, the second the matrix Bernstein inequality, and the case split the split Bernstein inequality.

Milestones, in attack order

  1. Theorem 3.6, the master tail bound P{λmax⁡(∑kXk)≥t}≤e−θttr⁡exp⁡(∑klog⁡EeθXk)\mathbb P\{\lambda_{\max}(\sum_k X_k)\ge t\}\le e^{-\theta t}\operatorname{tr}\exp(\sum_k\log\mathbb E e^{\theta X_k})P{λmax​(∑k​Xk​)≥t}≤e−θttrexp(∑k​logEeθXk​) for θ>0\theta>0θ>0.
  2. Corollary 3.7: a semidefinite bound EeθXk≼eg(θ)Ak\mathbb E e^{\theta X_k}\preccurlyeq e^{g(\theta)A_k}EeθXk​≼eg(θ)Ak​ gives P{λmax⁡(∑kXk)≥t}≤d e−θt+g(θ)λmax⁡(∑kAk)\mathbb P\{\lambda_{\max}(\sum_k X_k)\ge t\}\le d\,e^{-\theta t+g(\theta)\lambda_{\max}(\sum_k A_k)}P{λmax​(∑k​Xk​)≥t}≤de−θt+g(θ)λmax​(∑k​Ak​).
  3. Lemma 6.7: if EX=0\mathbb E X=0EX=0 and λmax⁡(X)≤1\lambda_{\max}(X)\le1λmax​(X)≤1, then EeθX≼exp⁡((eθ−θ−1) EX2)\mathbb E e^{\theta X}\preccurlyeq\exp\big((e^\theta-\theta-1)\,\mathbb E X^2\big)EeθX≼exp((eθ−θ−1)EX2) for θ>0\theta>0θ>0.
  4. Theorem 6.1(i), the matrix Bennett inequality on its own.
  5. The numerical bound h(u)≥u2/21+u/3h(u)\ge\dfrac{u^2/2}{1+u/3}h(u)≥1+u/3u2/2​ for u≥0u\ge0u≥0, from the proof of Theorem 6.1.

Further items

Lemma 6.8 (the matrix mgf bound EeθX≼exp⁡(θ22(1−θ)A2)\mathbb E e^{\theta X}\preccurlyeq\exp(\frac{\theta^2}{2(1-\theta)}A^2)EeθX≼exp(2(1−θ)θ2​A2) under EXp≼p!2A2\mathbb E X^p\preccurlyeq\frac{p!}{2}A^2EXp≼2p!​A2) and Theorem 6.2 (matrix Bernstein, subexponential case: P{λmax⁡(∑kXk)≥t}≤dexp⁡(−t2/2σ2+Rt)\mathbb P\{\lambda_{\max}(\sum_k X_k)\ge t\}\le d\exp(\frac{-t^2/2}{\sigma^2+Rt})P{λmax​(∑k​Xk​)≥t}≤dexp(σ2+Rt−t2/2​), split as d e−t2/4σ2d\,e^{-t^2/4\sigma^2}de−t2/4σ2 and d e−t/4Rd\,e^{-t/4R}de−t/4R) are included as further theorems.

Significance

Matrix Bernstein is the most used inequality of the paper: it bounds the spectral norm of a sum of independent bounded random matrices with only a logarithmic dimensional factor, and it is the standard tool behind sampling bounds for matrix completion, randomized low-rank approximation, spectral sparsification, covariance estimation and the analysis of random features. Theorem 6.1 assumes only an upper bound on the largest eigenvalue of each summand, so it applies to summands with unbounded smallest eigenvalues; applied to {Xk}\{X_k\}{Xk​} and {−Xk}\{-X_k\}{−Xk​} separately it controls both tails.

The results are proved in the paper. As far as the local catalog shows, no machine-checked proof of the matrix Bennett or Bernstein inequality for complex Hermitian matrices exists; the platform has a matrix Bernstein statement for real symmetric matrices in a different form (Wainwright, Theorem 6.17), still open, and scalar Bennett and Bernstein inequalities. Formalizing Theorem 6.1 produces a reusable matrix concentration inequality together with its two ingredients, the matrix mgf bound of Lemma 6.7 and the scalar inequality relating Bennett's and Bernstein's exponents.

Difficulty

The scalar argument multiplies moment generating functions of independent summands. For matrices, eA+B≠eAeBe^{A+B}\ne e^Ae^BeA+B=eAeB unless AAA and BBB commute, so E tr⁡eθ∑kXk\mathbb E\,\operatorname{tr} e^{\theta\sum_k X_k}Etreθ∑k​Xk​ does not factor; the master bound of Theorem 3.6 rests on Lieb's concavity theorem for A↦tr⁡exp⁡(H+log⁡A)A\mapsto\operatorname{tr}\exp(H+\log A)A↦trexp(H+logA), which is not in Mathlib. The mgf bound of Lemma 6.7 needs a semidefinite comparison between functions of a random matrix, the transfer rule f≤gf\le gf≤g on the spectrum ⇒f(A)≼g(A)\Rightarrow f(A)\preccurlyeq g(A)⇒f(A)≼g(A), and the operator monotonicity of the logarithm. The remaining steps (optimizing over θ\thetaθ, the inequality between hhh and the Bernstein exponent) are real analysis.

Formalization scope

Matrices are Matrix (Fin d) (Fin d) ℂ with [NeZero d]; λmax⁡\lambda_{\max}λmax​ is the supremum of the real spectrum; ∥⋅∥\|\cdot\|∥⋅∥ is the operator norm on ℓ2d\ell_2^dℓ2d​; eAe^AeA and log⁡A\log AlogA are Mathlib's continuous functional calculus cfc; the semidefinite order is Mathlib's MatrixOrder; expectation is entrywise. A random matrix is a measurable map, each XkX_kXk​ is Hermitian at every ω\omegaω, independence is iIndepFun, and the measure is a probability measure. The bound λmax⁡(Xk)≤R\lambda_{\max}(X_k)\le Rλmax​(Xk​)≤R is assumed almost surely; no lower bound on the eigenvalues is assumed. The paper's standing regularity (§2.2) is made explicit as integrability of the entries of XkX_kXk​ and Xk2X_k^2Xk2​ (and of eθXke^{\theta X_k}eθXk​ where its expectation is taken). The infimum over θ>0\theta>0θ>0 in Theorem 3.6 and Corollary 3.7 is stated for every admissible θ>0\theta>0θ>0.

The printed formulas divide by RRR and σ2\sigma^2σ2, so 0<R0<R0<R and 0<σ20<\sigma^20<σ2 are hypotheses of Theorems 6.1 and 6.2; with Lean's convention x/0=0x/0=0x/0=0, the case σ2=0\sigma^2=0σ2=0 would turn the Bennett bound into the trivial value ddd, so the statement is not allowed to degenerate there. The chain is a conjunction of the probability bound and the inequalities between consecutive bounds, so the weaker reading "the probability is below each bound" does not satisfy it.

A complete development needs the matrix Laplace transform method, Lieb's theorem (or a substitute), operator monotonicity of the logarithm, the transfer rule for the functional calculus, and the scalar inequality h(u)≥(u2/2)/(1+u/3)h(u)\ge(u^2/2)/(1+u/3)h(u)≥(u2/2)/(1+u/3). The first four are reusable for every matrix concentration inequality of this paper and beyond. Contributions to any milestone are welcome.

Selected references

  • J. A. Tropp, User-Friendly Tail Bounds for Sums of Random Matrices, arXiv:1004.4389v7, 2011; Found. Comput. Math. 12 (2012) 389–434. https://arxiv.org/abs/1004.4389, https://doi.org/10.1007/s10208-011-9099-z
  • R. Ahlswede and A. Winter, Strong converse for identification via quantum channels, IEEE Trans. Inform. Theory 48 (2002) 569–579. https://doi.org/10.1109/18.985947
  • R. I. Oliveira, Sums of random Hermitian matrices and an inequality by Rudelson, Electron. Commun. Probab. 15 (2010) 203–212. https://arxiv.org/abs/1004.3821
  • D. Gross, Recovering low-rank matrices from few coefficients in any basis, IEEE Trans. Inform. Theory 57 (2011) 1548–1566. https://arxiv.org/abs/0910.1879
  • E. H. Lieb, Convex trace functions and the Wigner–Yanase–Dyson conjecture, Adv. Math. 11 (1973) 267–288. https://doi.org/10.1016/0001-8708(73)90011-X
  • G. Lugosi, Concentration-of-measure inequalities, lecture notes, 2009 (Theorems 5 and 6, scalar Bennett and Bernstein). https://www.econ.upf.edu/~lugosi/anu.pdf
9 thms2 active usersReviewed
ProbabilityRandom Matrix Theory·Captain: mikedeng1

User-Friendly Tail Bounds for Sums of Random Matrices II: Matrix Gaussian and Rademacher Series Have Subgaussian Tails with Variance Parameter ‖Σ A_k²‖Research Paper

Motivation

A matrix Gaussian series ∑kγkAk\sum_k \gamma_k A_k∑k​γk​Ak​, a sum of fixed self-adjoint matrices each multiplied by an independent standard normal variable, is the simplest sum of independent random matrices. It already appears in the analysis of random designs, in compressed sensing, in randomized numerical linear algebra and in quantum information, wherever one needs to know how large the spectrum of a random linear combination of matrices can be. Its Rademacher analogue ∑kεkAk\sum_k \varepsilon_k A_k∑k​εk​Ak​, with random signs, plays the same role in symmetrization arguments.

For real coefficients aka_kak​ the answer is classical: ∑kγkak\sum_k \gamma_k a_k∑k​γk​ak​ is normal with variance ∑kak2\sum_k a_k^2∑k​ak2​, so its upper tail is at most e−t2/2σ2e^{-t^2/2\sigma^2}e−t2/2σ2. Tropp's paper (arXiv:1004.4389v7) shows that the same bound holds for the largest eigenvalue of a matrix series, with an explicit dimensional factor and with the variance parameter ∥∑kAk2∥\|\sum_k A_k^2\|∥∑k​Ak2​∥.

Timeline. Noncommutative Khintchine inequalities (Lust-Piquard 1986; Lust-Piquard and Pisier 1991) control the moments of matrix Rademacher and Gaussian series and imply tail bounds of this type. Ahlswede and Winter (2002, arXiv:quant-ph/0012127) introduced the matrix Laplace transform method, whose bounds depend on the sum of the norms ∑k∥Ak2∥\sum_k\|A_k^2\|∑k​∥Ak2​∥. Oliveira (2010, arXiv:1004.3821) obtained bounds of the same form as Theorem 4.1. Tropp (2012) derived the result from a master inequality built on Lieb's concavity theorem (1973), which produces the norm of the sum, ∥∑kAk2∥\|\sum_k A_k^2\|∥∑k​Ak2​∥, as variance parameter. The paper itself notes that Theorem 4.1 and Corollary 4.2 are not new results; the contribution is the route through the master bound.

Setting

Fix a dimension d≥1d\ge1d≥1. Matrices are d×dd\times dd×d complex arrays; a matrix is self-adjoint if it equals its conjugate transpose. For a self-adjoint AAA, λmax⁡(A)\lambda_{\max}(A)λmax​(A) is its largest eigenvalue, and ∥A∥\|A\|∥A∥ is the spectral norm, the operator norm on Cd\mathbb C^dCd with the Euclidean norm. Functions of a self-adjoint matrix are defined through its eigen-decomposition: eAe^AeA, log⁡A\log AlogA (for positive-definite AAA), cosh⁡A\cosh AcoshA. The semidefinite order A≼HA\preccurlyeq HA≼H means that H−AH-AH−A is positive semidefinite.

A random matrix is a measurable map from a probability space (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) into the d×dd\times dd×d complex matrices; its expectation EX\mathbb E XEX is taken entry by entry. A Rademacher variable takes the values ±1\pm1±1 with probability 1/21/21/2 each; a standard normal variable has law N(0,1)N(0,1)N(0,1).

The data of the mission are fixed self-adjoint matrices A1,…,AnA_1,\dots,A_nA1​,…,An​ and independent scalar variables ξ1,…,ξn\xi_1,\dots,\xi_nξ1​,…,ξn​, all standard normal or all Rademacher. The variance parameter is

σ2:=∥∑kAk2∥.\sigma^2 := \Big\|\sum_k A_k^2\Big\|.σ2:=​k∑​Ak2​​.

Formalization targets

Goal: Theorem 4.1 (p. 14)

For all t≥0t\ge0t≥0,

P{λmax⁡(∑kξkAk)≥t}≤d e−t2/2σ2,P{∥∑kξkAk∥≥t}≤2d e−t2/2σ2.\mathbb P\Big\{\lambda_{\max}\Big(\sum_k\xi_kA_k\Big)\ge t\Big\}\le d\,e^{-t^2/2\sigma^2},\qquad \mathbb P\Big\{\Big\|\sum_k\xi_kA_k\Big\|\ge t\Big\}\le 2d\,e^{-t^2/2\sigma^2}.P{λmax​(k∑​ξk​Ak​)≥t}≤de−t2/2σ2,P{​k∑​ξk​Ak​​≥t}≤2de−t2/2σ2.

Milestones

  1. Theorem 3.6 (master tail bound, p. 12): for independent random self-adjoint XkX_kXk​ and every ttt,
P{λmax⁡(∑kXk)≥t}≤inf⁡θ>0e−θttr⁡exp⁡(∑klog⁡EeθXk).\mathbb P\Big\{\lambda_{\max}\Big(\sum_kX_k\Big)\ge t\Big\}\le\inf_{\theta>0}e^{-\theta t}\operatorname{tr}\exp\Big(\sum_k\log\mathbb Ee^{\theta X_k}\Big).P{λmax​(k∑​Xk​)≥t}≤θ>0inf​e−θttrexp(k∑​logEeθXk​).
  1. Corollary 3.7 (p. 12): if EeθXk≼eg(θ)Ak\mathbb Ee^{\theta X_k}\preccurlyeq e^{g(\theta)A_k}EeθXk​≼eg(θ)Ak​ with g≥0g\ge0g≥0, then the tail is at most dinf⁡θ>0e−θt+g(θ)ρd\inf_{\theta>0}e^{-\theta t+g(\theta)\rho}dinfθ>0​e−θt+g(θ)ρ with ρ=λmax⁡(∑kAk)\rho=\lambda_{\max}(\sum_kA_k)ρ=λmax​(∑k​Ak​).
  2. Display (2.4) (p. 8): cosh⁡(A)≼eA2/2\cosh(A)\preccurlyeq e^{A^2/2}cosh(A)≼eA2/2 for every self-adjoint AAA.
  3. Lemma 4.3 (p. 15): EeεθA≼eθ2A2/2\mathbb Ee^{\varepsilon\theta A}\preccurlyeq e^{\theta^2A^2/2}EeεθA≼eθ2A2/2 for Rademacher ε\varepsilonε and EeγθA=eθ2A2/2\mathbb Ee^{\gamma\theta A}=e^{\theta^2A^2/2}EeγθA=eθ2A2/2 for standard normal γ\gammaγ.

Further item: Corollary 4.2 (p. 15)

For fixed d1×d2d_1\times d_2d1​×d2​ matrices BkB_kBk​ and σ2=max⁡{∥∑kBkBk∗∥,∥∑kBk∗Bk∥}\sigma^2=\max\{\|\sum_kB_kB_k^*\|,\|\sum_kB_k^*B_k\|\}σ2=max{∥∑k​Bk​Bk∗​∥,∥∑k​Bk∗​Bk​∥},

P{∥∑kξkBk∥≥t}≤(d1+d2) e−t2/2σ2.\mathbb P\Big\{\Big\|\sum_k\xi_kB_k\Big\|\ge t\Big\}\le(d_1+d_2)\,e^{-t^2/2\sigma^2}.P{​k∑​ξk​Bk​​≥t}≤(d1​+d2​)e−t2/2σ2.

Significance

The result. Theorem 4.1 is the template for every inequality in the paper: a scalar tail bound carried over to matrices at the cost of a factor ddd, with a variance parameter that is the norm of a sum rather than a sum of norms. The difference matters: ∑k∥Ak2∥\sum_k\|A_k^2\|∑k​∥Ak2​∥ can exceed ∥∑kAk2∥\|\sum_kA_k^2\|∥∑k​Ak2​∥ by a factor of ddd, and §4 of the paper shows that both the variance parameter and the dimensional factor in (4.3) are needed in general. Corollary 4.2 transfers the bound to the largest singular value of a rectangular series, which covers Gaussian matrices with nonuniform variances (§4.3).

Formalizing it. The theorem is proved in the paper; the work here is to formalize that proof. The milestones are reusable beyond this mission: Theorem 3.6 and Corollary 3.7 are the common entry point of the Chernoff, Bernstein and Azuma missions of this series, and the Rademacher half of Lemma 4.3 is used again in the matrix Azuma mission. No machine-checked proof of these matrix inequalities was found in Mathlib or on the platform when this mission was drafted.

Difficulty

The scalar argument bounds Eeθ∑kXk\mathbb E e^{\theta\sum_k X_k}Eeθ∑k​Xk​ by the product of the individual mgfs, using ea+b=eaebe^{a+b}=e^ae^bea+b=eaeb. For matrices this identity fails when the summands do not commute, and the trace inequality that replaces it for two matrices (Golden–Thompson) has no analogue for three or more. Controlling the trace mgf of a sum of many noncommuting independent matrices therefore requires a genuinely matrix-analytic input with no scalar counterpart; the naive product bound is not available. A second difficulty is infrastructural: matrix functions, the semidefinite order and expectations of random matrices must be combined in a single setting.

Formalization scope

Matrices are Matrix (Fin d) (Fin d) ℂ with [NeZero d]; self-adjointness is IsHermitian; eAe^AeA, log⁡A\log AlogA, cosh⁡A\cosh AcoshA are Mathlib's continuous functional calculus cfc; ≼\preccurlyeq≼ is Mathlib's Loewner order under MatrixOrder; λmax⁡\lambda_{\max}λmax​ is the supremum of the real spectrum; ∥⋅∥\|\cdot\|∥⋅∥ is the operator norm on ℓ2\ell_2ℓ2​. Expectation is entrywise, and the paper's standing regularity assumption is made explicit as entrywise integrability of every matrix whose expectation is taken. The infimum over θ>0\theta>0θ>0 is stated pointwise: the bound is asserted for every θ>0\theta>0θ>0 at which the mgfs exist, which is equivalent to the infimum form. Independence is iIndepFun of the scalar variables, and "Gaussian or Rademacher" is the disjunction of two hypotheses, never a mixture of laws.

The variance parameter is the norm of the sum ∥∑kAk2∥\|\sum_kA_k^2\|∥∑k​Ak2​∥; a formalization with ∑k∥Ak2∥\sum_k\|A_k^2\|∑k​∥Ak2​∥, with a constant different from 1/21/21/2, or with the dimensional factor omitted is a different theorem. At σ2=0\sigma^2=0σ2=0, Lean's division by zero makes the bound the trivial ddd; this is the only degenerate case and it is valid.

The development needs: the spectral calculus for Hermitian matrices, monotonicity of the trace exponential, operator monotonicity of the matrix logarithm, Lieb's theorem, and moments of the Gaussian. These are reusable well beyond this paper; proofs of the milestones, of supporting matrix-analysis lemmas, and alternative routes (for instance through noncommutative Khintchine inequalities) are all welcome.

Selected references

  • J. A. Tropp, User-Friendly Tail Bounds for Sums of Random Matrices, Found. Comput. Math. 12 (2012) 389–434; cited from arXiv:1004.4389v7. https://arxiv.org/abs/1004.4389, https://doi.org/10.1007/s10208-011-9099-z
  • R. Ahlswede and A. Winter, Strong converse for identification via quantum channels, IEEE Trans. Inform. Theory 48 (2002) 569–579. https://arxiv.org/abs/quant-ph/0012127
  • R. I. Oliveira, Sums of random Hermitian matrices and an inequality by Rudelson, Electron. Commun. Probab. 15 (2010) 203–212. https://arxiv.org/abs/1004.3821
  • E. H. Lieb, Convex trace functions and the Wigner–Yanase–Dyson conjecture, Adv. Math. 11 (1973) 267–288. https://doi.org/10.1016/0001-8708(73)90011-X
  • F. Lust-Piquard and G. Pisier, Non commutative Khintchine and Paley inequalities, Ark. Mat. 29 (1991) 241–260. https://doi.org/10.1007/BF02384340
8 thms2 active usersReviewed
ProbabilityRandom Matrix Theory·Captain: mikedeng1

User-Friendly Tail Bounds for Sums of Random Matrices I: The Master Tail Bound — the Largest Eigenvalue of an Independent Sum Is Controlled by the Sum of the Matrix Cumulant Generating FunctionsResearch Paper

Motivation

Sums of independent random matrices appear wherever a large matrix is built from random pieces: sample covariance matrices in statistics, random sparsification and sampling in numerical linear algebra, random graphs and their Laplacians, and compressed sensing. The basic question is how far the largest eigenvalue of such a sum can stray above its typical value. For sums of independent real random variables the answer is given by the classical inequalities of Chernoff, Hoeffding and Bernstein, all derived by the Laplace transform method: bound the tail by the moment generating function, and use independence to factor the moment generating function of the sum.

Ahlswede and Winter (2002) showed that a matrix analogue of the Laplace transform method exists, and Oliveira (2010) refined the starting inequality. Tropp's paper (arXiv:1004.4389) replaced the Ahlswede–Winter decoupling step by a consequence of Lieb's concavity theorem (Lieb 1973) and obtained a single master tail bound from which matrix versions of the Gaussian-series, Chernoff, Bernstein and Azuma inequalities follow with sharp variance parameters. This mission formalizes that master bound, the first of five missions covering the paper.

Timeline:

  • 1973: Lieb proves concavity of A↦tr⁡exp⁡(H+log⁡A)A\mapsto \operatorname{tr}\exp(H+\log A)A↦trexp(H+logA) on positive-definite matrices; Epstein gives a second proof (Epstein 1973).
  • 2002: Ahlswede and Winter introduce the matrix Laplace transform method, decoupling summands with the Golden–Thompson inequality.
  • 2010: Oliveira's variant of the matrix Laplace transform bound.
  • 2010–2012: Tropp derives the master bound for independent sums from Lieb's theorem (journal version: Found. Comput. Math. 12 (2012)); in 2011 he also derives Lieb's theorem from the joint convexity of quantum relative entropy (arXiv:1101.1070).

Setting

All matrices are d×dd\times dd×d arrays of complex numbers with d≥1d\ge1d≥1. A matrix AAA is self-adjoint (Hermitian) when A=A∗A=A^*A=A∗; it then has real eigenvalues, and λmax⁡(A)\lambda_{\max}(A)λmax​(A) denotes the largest one. For a function f:R→Rf:\mathbb R\to\mathbb Rf:R→R and a self-adjoint A=QΛQ∗A=Q\Lambda Q^*A=QΛQ∗ with QQQ unitary and Λ\LambdaΛ diagonal, f(A):=Qf(Λ)Q∗f(A):=Qf(\Lambda)Q^*f(A):=Qf(Λ)Q∗. This defines the matrix exponential eAe^{A}eA of every self-adjoint matrix and the matrix logarithm log⁡A\log AlogA of every positive-definite matrix, with log⁡(eA)=A\log(e^A)=Alog(eA)=A. The trace exponential is A↦tr⁡eAA\mapsto\operatorname{tr}e^{A}A↦treA.

A random self-adjoint matrix is a measurable map XXX from a probability space (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) to the self-adjoint matrices. Its expectation EX\mathbb E XEX is the matrix of the expectations of its entries. A finite sequence X1,…,XnX_1,\dots,X_nX1​,…,Xn​ is independent when the maps are jointly independent. The matrix moment generating function and matrix cumulant generating function of XXX are

MX(θ):=E eθX,ΞX(θ):=log⁡E eθX,θ∈R,M_X(\theta):=\mathbb E\,e^{\theta X},\qquad \Xi_X(\theta):=\log\mathbb E\,e^{\theta X},\qquad\theta\in\mathbb R,MX​(θ):=EeθX,ΞX​(θ):=logEeθX,θ∈R,

which may fail to exist for some θ\thetaθ. In the Lean development these objects are lambdaMax, mexp, mlog, trExp and mean in the namespace MatrixTail.Master.

Formalization targets

Goal: the master tail bound (Theorem 3.6)

For independent random self-adjoint matrices X1,…,XnX_1,\dots,X_nX1​,…,Xn​ and every t∈Rt\in\mathbb Rt∈R,

P{λmax⁡(∑kXk)≥t}≤inf⁡θ>0{e−θt⋅tr⁡exp⁡(∑klog⁡E eθXk)}.\mathbb P\Bigl\{\lambda_{\max}\Bigl(\sum_k X_k\Bigr)\ge t\Bigr\}\le\inf_{\theta>0}\Bigl\{e^{-\theta t}\cdot\operatorname{tr}\exp\Bigl(\sum_k\log\mathbb E\,e^{\theta X_k}\Bigr)\Bigr\}.P{λmax​(k∑​Xk​)≥t}≤θ>0inf​{e−θt⋅trexp(k∑​logEeθXk​)}.

It contains no constants and no assumption beyond independence: every later inequality of the paper specializes it.

Milestones

  1. Proposition 3.1 (Laplace transform method): P{λmax⁡(Y)≥t}≤inf⁡θ>0{e−θt Etr⁡eθY}\mathbb P\{\lambda_{\max}(Y)\ge t\}\le\inf_{\theta>0}\{e^{-\theta t}\,\mathbb E\operatorname{tr}e^{\theta Y}\}P{λmax​(Y)≥t}≤infθ>0​{e−θtEtreθY}.
  2. Theorem 3.2 (Lieb): for fixed self-adjoint HHH, A↦tr⁡exp⁡(H+log⁡A)A\mapsto\operatorname{tr}\exp(H+\log A)A↦trexp(H+logA) is concave on the positive-definite cone.
  3. Corollary 3.3: Etr⁡exp⁡(H+X)≤tr⁡exp⁡(H+log⁡E eX)\mathbb E\operatorname{tr}\exp(H+X)\le\operatorname{tr}\exp(H+\log\mathbb E\,e^{X})Etrexp(H+X)≤trexp(H+logEeX).
  4. Lemma 3.4 (subadditivity of matrix cgfs): Etr⁡exp⁡(∑kθXk)≤tr⁡exp⁡(∑klog⁡E eθXk)\mathbb E\operatorname{tr}\exp(\sum_k\theta X_k)\le\operatorname{tr}\exp(\sum_k\log\mathbb E\,e^{\theta X_k})Etrexp(∑k​θXk​)≤trexp(∑k​logEeθXk​) for θ∈R\theta\in\mathbb Rθ∈R.

Significance

The master bound reduces every tail estimate for λmax⁡\lambda_{\max}λmax​ of an independent sum to semidefinite bounds on the individual cumulant generating functions. The paper's matrix Gaussian and Rademacher series bound, matrix Chernoff inequality and matrix Bernstein inequality are each one such bound away from it, and the matrix Bernstein inequality in particular is a standard tool in randomized numerical linear algebra, matrix completion and covariance estimation. Missions II–IV of this series take the master bound as their first milestone.

All results here are proved in the literature. What remains is formalization: none of Lieb's concavity theorem, the matrix Laplace transform bound or the subadditivity of matrix cumulant generating functions is in Mathlib, and a machine-checked Lieb theorem would be reusable throughout quantum information theory (strong subadditivity of entropy, joint convexity of relative entropy).

Difficulty

The scalar argument factors Eexp⁡(∑kθXk)=∏kE eθXk\mathbb E\exp(\sum_k\theta X_k)=\prod_k\mathbb E\,e^{\theta X_k}Eexp(∑k​θXk​)=∏k​EeθXk​, which needs ea+b=eaebe^{a+b}=e^ae^bea+b=eaeb. For non-commuting matrices eA+B≠eAeBe^{A+B}\ne e^Ae^BeA+B=eAeB, so this step fails. The Golden–Thompson inequality tr⁡eA+H≤tr⁡(eAeH)\operatorname{tr}e^{A+H}\le\operatorname{tr}(e^Ae^H)treA+H≤tr(eAeH) handles two summands but its three-matrix analogue is false, so it does not iterate. Lieb's concavity theorem is the deep input; it does not follow from elementary properties of the exponential, which is neither operator monotone nor operator convex. On the formal side, the matrix functional calculus of Mathlib carries little of the trace-function theory the statements rely on.

Formalization scope

Matrices are Matrix (Fin d) (Fin d) ℂ with [NeZero d] wherever λmax⁡\lambda_{\max}λmax​ appears; for d=0d=0d=0 the largest eigenvalue would be 000 and the bound would fail at t≤0t\le0t≤0. Exponential and logarithm are Mathlib's continuous functional calculus cfc. Random matrices are measurable maps for the Borel σ-algebra on the entries, independence is iIndepFun, and P is a probability measure. Expectation is entrywise.

The paper's standing assumption that expectations exist is made explicit and only where an expectation is taken: every entry of eθXke^{\theta X_k}eθXk​ is integrable for the θ\thetaθ in question. The infimum over θ>0\theta>0θ>0 is stated as the bound for every θ>0\theta>0θ>0 at which the moment generating functions exist; since an inequality p≤inf⁡θF(θ)p\le\inf_\theta F(\theta)p≤infθ​F(θ) is equivalent to p≤F(θ)p\le F(\theta)p≤F(θ) for every θ\thetaθ, and the paper treats a non-existent moment generating function as +∞+\infty+∞, this is exact. A real-valued infimum over θ\thetaθ, or dropping the integrability hypotheses, would make the statements trivially true through Lean's default values (inf⁡\infinf of an unbounded set and the integral of a non-integrable function are 000); the formalization rules both out.

Useful infrastructure beyond this mission: trace inequalities for cfc on Hermitian matrices, monotonicity of the trace exponential in the semidefinite order, and Lieb's concavity theorem itself. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • J. A. Tropp, User-Friendly Tail Bounds for Sums of Random Matrices, arXiv:1004.4389v7 (2011); Found. Comput. Math. 12 (2012) 389–434. https://arxiv.org/abs/1004.4389, https://doi.org/10.1007/s10208-011-9099-z
  • R. Ahlswede and A. Winter, Strong converse for identification via quantum channels, IEEE Trans. Inform. Theory 48(3) (2002) 569–579. https://arxiv.org/abs/quant-ph/0012127
  • R. I. Oliveira, Sums of random Hermitian matrices and an inequality by Rudelson, Electron. Commun. Probab. 15 (2010) 203–212. https://arxiv.org/abs/1004.3821
  • E. H. Lieb, Convex trace functions and the Wigner–Yanase–Dyson conjecture, Adv. Math. 11 (1973) 267–288. https://doi.org/10.1016/0001-8708(73)90011-X
  • H. Epstein, Remarks on two theorems of E. Lieb, Comm. Math. Phys. 31 (1973) 317–325. https://doi.org/10.1007/BF01646492
  • J. A. Tropp, From joint convexity of quantum relative entropy to a concavity theorem of Lieb, Proc. Amer. Math. Soc. 140 (2012) 1757–1760. https://arxiv.org/abs/1101.1070
6 thms2 active usersReviewed
Control TheoryDynamical SystemsGraph Theory·Captain: mikedeng1

Synchronization and Transient Stability in Power Networks and Nonuniform Kuramoto Oscillators 2: λ₂(L(P_ij cos φ_ij)) > λ_critical Gives Phase Cohesiveness and Exponential Frequency SynchronizationResearch Paper

Motivation

Transient stability of a power grid asks whether the generators of the network return to synchronous operation after a large disturbance such as a fault or a line trip. In the classical network-reduced model the rotor angles obey second-order swing equations, and stability certificates usually come from energy functions evaluated numerically. Dörfler and Bullo (arXiv:0910.5673v4; SIAM J. Control Optim. 50(3), 2012) relate this problem to a first-order system of coupled phase oscillators, the non-uniform Kuramoto model, and derive purely algebraic conditions on the network parameters under which the oscillators synchronize. Such conditions read as "the network connectivity dominates non-uniformity, losses and lack of phase cohesiveness" and are checked from the data alone, without simulation.

The paper gives two such sufficient conditions. This mission formalizes the second, Theorem V.5, which measures connectivity by the algebraic connectivity of the lossless coupling and therefore applies to sparse (connected, not necessarily complete) networks. A companion mission treats Theorem V.3, the condition for complete graphs.

Timeline. For the classical Kuramoto model, Jadbabaie, Motee and Barahona (ACC, 2004) and Chopra and Spong (IEEE TAC, 2009) analysed synchronization with the Lyapunov function ∥Hθ∥22\|H\theta\|_2^2∥Hθ∥22​, and Chopra and Spong proved frequency synchronization under cohesive phases. Dörfler and Bullo (2009–2012) extended the analysis to non-uniform time constants DiD_iDi​, phase shifts φij\varphi_{ij}φij​ and non-complete graphs, using a weighted Lyapunov function.

Setting

There are n≥2n\ge2n≥2 oscillators with phases θi\theta_iθi​, time constants Di>0D_i>0Di​>0, natural frequencies ωi∈R\omega_i\in\mathbb Rωi​∈R, coupling weights Pij≥0P_{ij}\ge0Pij​≥0 and phase shifts φij∈[0,π/2[\varphi_{ij}\in[0,\pi/2[φij​∈[0,π/2[ (i≠ji\ne ji=j), with Pii=φii=0P_{ii}=\varphi_{ii}=0Pii​=φii​=0. The non-uniform Kuramoto model is

Diθ˙i=ωi−∑j=1nPijsin⁡(θi−θj+φij),i=1,…,n.(8)D_i\dot\theta_i=\omega_i-\sum_{j=1}^nP_{ij}\sin(\theta_i-\theta_j+\varphi_{ij}),\qquad i=1,\dots,n. \tag{8}Di​θ˙i​=ωi​−j=1∑n​Pij​sin(θi​−θj​+φij​),i=1,…,n.(8)

In this mission P=PTP=P^TP=PT, and its non-zero entries induce a connected graph.

  • H∈Rn(n−1)/2×nH\in\mathbb R^{n(n-1)/2\times n}H∈Rn(n−1)/2×n is the incidence matrix of the complete graph: Hθ=(θ2−θ1,… )H\theta=(\theta_2-\theta_1,\dots)Hθ=(θ2​−θ1​,…) lists all pairwise differences, and ∥Hθ∥22=∑i<j(θi−θj)2\|H\theta\|_2^2=\sum_{i<j}(\theta_i-\theta_j)^2∥Hθ∥22​=∑i<j​(θi​−θj​)2.
  • Δ(γ)\Delta(\gamma)Δ(γ) is the set of configurations contained in an open arc of length γ\gammaγ, i.e. max⁡i,j∣θi−θj∣<γ\max_{i,j}|\theta_i-\theta_j|<\gammamaxi,j​∣θi​−θj​∣<γ.
  • The Laplacian of a symmetric matrix AAA is L(aij)=diag⁡(∑jaij)−AL(a_{ij})=\operatorname{diag}(\sum_ja_{ij})-AL(aij​)=diag(∑j​aij​)−A and λ2(L(aij))\lambda_2(L(a_{ij}))λ2​(L(aij​)) is its second-smallest eigenvalue, the algebraic connectivity. The lossless coupling is the matrix (Pijcos⁡φij)(P_{ij}\cos\varphi_{ij})(Pij​cosφij​).
  • κ=∑kDk\kappa=\sum_kD_kκ=∑k​Dk​, α=min⁡i≠j{DiDj}/max⁡i≠j{DiDj}\alpha=\sqrt{\min_{i\ne j}\{D_iD_j\}/\max_{i\ne j}\{D_iD_j\}}α=mini=j​{Di​Dj​}/maxi=j​{Di​Dj​}​, φmax⁡=max⁡i,jφij\varphi_{\max}=\max_{i,j}\varphi_{ij}φmax​=maxi,j​φij​, Ω=∑iωi/∑iDi\Omega=\sum_i\omega_i/\sum_iD_iΩ=∑i​ωi​/∑i​Di​.
  • The critical value is
λcritical=∥HD−1ω∥2+n ∥[∑jP1jD1sin⁡φ1j,…,∑jPnjDnsin⁡φnj]∥2cos⁡(φmax⁡)(κ/n)α/max⁡i≠j{DiDj}.(33)\lambda_{\mathrm{critical}}=\frac{\|HD^{-1}\omega\|_2+\sqrt n\,\big\|\big[\sum_j\tfrac{P_{1j}}{D_1}\sin\varphi_{1j},\dots,\sum_j\tfrac{P_{nj}}{D_n}\sin\varphi_{nj}\big]\big\|_2}{\cos(\varphi_{\max})(\kappa/n)\alpha/\max_{i\ne j}\{D_iD_j\}}. \tag{33}λcritical​=cos(φmax​)(κ/n)α/maxi=j​{Di​Dj​}∥HD−1ω∥2​+n​​[∑j​D1​P1j​​sinφ1j​,…,∑j​Dn​Pnj​​sinφnj​]​2​​.(33)
  • The radii γmax⁡∈ ]π/2−φmax⁡,π]\gamma_{\max}\in\,]\pi/2-\varphi_{\max},\pi]γmax​∈]π/2−φmax​,π] and γmin⁡∈[0,π/2−φmax⁡[\gamma_{\min}\in[0,\pi/2-\varphi_{\max}[γmin​∈[0,π/2−φmax​[ solve sinc⁡(γmax⁡)/sinc⁡(π/2−φmax⁡)=sin⁡(γmin⁡)/cos⁡(φmax⁡)=λcritical/λ2(L(Pijcos⁡φij))\operatorname{sinc}(\gamma_{\max})/\operatorname{sinc}(\pi/2-\varphi_{\max})=\sin(\gamma_{\min})/\cos(\varphi_{\max})=\lambda_{\mathrm{critical}}/\lambda_2(L(P_{ij}\cos\varphi_{ij}))sinc(γmax​)/sinc(π/2−φmax​)=sin(γmin​)/cos(φmax​)=λcritical​/λ2​(L(Pij​cosφij​)).

Formalization targets

Goal: Theorem V.5 (Synchronization condition II)

If λ2(L(Pijcos⁡φij))>λcritical\lambda_2(L(P_{ij}\cos\varphi_{ij}))>\lambda_{\mathrm{critical}}λ2​(L(Pij​cosφij​))>λcritical​, then

  1. for every γ∈[γmin⁡,αγmax⁡]\gamma\in[\gamma_{\min},\alpha\gamma_{\max}]γ∈[γmin​,αγmax​] the set {θ∈Δ(π):∥Hθ∥2≤γ}\{\theta\in\Delta(\pi):\|H\theta\|_2\le\gamma\}{θ∈Δ(π):∥Hθ∥2​≤γ} is positively invariant, and every solution with θ(0)∈Δ(π)\theta(0)\in\Delta(\pi)θ(0)∈Δ(π), ∥Hθ(0)∥2<αγmax⁡\|H\theta(0)\|_2<\alpha\gamma_{\max}∥Hθ(0)∥2​<αγmax​ eventually satisfies ∥Hθ(t)∥2≤γ\|H\theta(t)\|_2\le\gamma∥Hθ(t)∥2​≤γ for every γ>γmin⁡\gamma>\gamma_{\min}γ>γmin​;
  2. for every such solution the frequencies converge exponentially to a common θ˙∞∈[θ˙min⁡(0),θ˙max⁡(0)]\dot\theta_\infty\in[\dot\theta_{\min}(0),\dot\theta_{\max}(0)]θ˙∞​∈[θ˙min​(0),θ˙max​(0)]; if φ≡0\varphi\equiv0φ≡0, then θ˙∞=Ω\dot\theta_\infty=\Omegaθ˙∞​=Ω and the rate is no worse than
λfe(γ)=λ2(L(Pij))cos⁡(γ)cos⁡(∠(D1,1))2/Dmax⁡(γ∈ ]γmin⁡,π/2[).\lambda_{\mathrm{fe}}(\gamma)=\lambda_2(L(P_{ij}))\cos(\gamma)\cos(\angle(D\mathbf 1,\mathbf 1))^2/D_{\max}\qquad(\gamma\in\,]\gamma_{\min},\pi/2[).λfe​(γ)=λ2​(L(Pij​))cos(γ)cos(∠(D1,1))2/Dmax​(γ∈]γmin​,π/2[).

Milestones

Lemma V.8 (the identity (36) that replaces HD−1HTHD^{-1}H^THD−1HT by κ\kappaκ), Lemma V.9 (a quadratic-form bound by λ2\lambda_2λ2​), the sinc estimate and the bound X~\tilde XX~ on the lossy coupling (p. 25), the Lyapunov-derivative bound (37), the sandwich bounds (39) on WWW, the existence and uniqueness of γmin⁡,γmax⁡\gamma_{\min},\gamma_{\max}γmin​,γmax​ from the analysis of (41), and the eventual entry of every trajectory into {∥Hθ∥2<π/2−φmax⁡}\{\|H\theta\|_2<\pi/2-\varphi_{\max}\}{∥Hθ∥2​<π/2−φmax​}.

Significance

The condition is checkable from network data: λ2\lambda_2λ2​ of a weighted Laplacian, two vector norms and the extreme time constants. It applies to sparse networks, where the complete-graph condition of Theorem V.3 does not, and specializes for classical Kuramoto oscillators to K>∥Hω∥2K>\|H\omega\|_2K>∥Hω∥2​ (Remark V.7). Through the singular-perturbation argument of Section IV, conditions of this kind certify transient stability of the network-reduced power system.

The result is proved in the paper; no machine-checked version is known. A formalization fixes several points the printed text leaves loose: the norm ∥Hθ∥2\|H\theta\|_2∥Hθ∥2​ is written on p. 23 with a double sum that counts each pair twice; the chain defining X~\tilde XX~ on p. 25 is printed with its inequalities reversed; and "reaches {∥Hθ∥2≤γmin⁡}\{\|H\theta\|_2\le\gamma_{\min}\}{∥Hθ∥2​≤γmin​}" holds only asymptotically. The formal statements make each of these precise.

Difficulty

The obvious Lyapunov function, ∥Hθ∥22\|H\theta\|_2^2∥Hθ∥22​, has a sign-indefinite derivative as soon as the DiD_iDi​ differ, because the coupling Pij/DiP_{ij}/D_iPij​/Di​ is not symmetric. The weighted function W(Hθ)=14∑i,jDiDj∣θi−θj∣2W(H\theta)=\frac14\sum_{i,j}D_iD_j|\theta_i-\theta_j|^2W(Hθ)=41​∑i,j​Di​Dj​∣θi​−θj​∣2 restores a symmetric structure, but only through the non-obvious identity (36). After that, the sinusoidal coupling has to be bounded below by a quadratic form on a set where the phase differences stay below π\piπ, the lossy coupling has to be bounded above uniformly in the state, and the resulting ultimate-boundedness argument has to be run with sublevel sets of WWW, which are ellipsoids rather than balls of ∥Hθ∥2\|H\theta\|_2∥Hθ∥2​ unless all DiD_iDi​ coincide. The constants α\alphaα, γmin⁡\gamma_{\min}γmin​, γmax⁡\gamma_{\max}γmax​ come from this mismatch, and the passage from sublevel sets back to balls is the most delicate step.

Formalization scope

  • Configurations are real lifts θ∈Rn\theta\in\mathbb R^nθ∈Rn; Δ(π)\Delta(\pi)Δ(π) means θi−θj<π\theta_i-\theta_j<\piθi​−θj​<π for all i,ji,ji,j, and ∥Hθ∥2\|H\theta\|_2∥Hθ∥2​ is the pair-sum norm. A solution is a function θ:R→Rn\theta:\mathbb R\to\mathbb R^nθ:R→Rn with right derivative at 000 and derivative at every t>0t>0t>0 equal to the vector field of (8), and statements quantify over every solution. θ˙\dot\thetaθ˙ is the vector field evaluated along the solution.
  • Added hypotheses: n≥2n\ge2n≥2 (needed for λ2\lambda_2λ2​ and the extrema over i≠ji\ne ji=j), and φij=φji\varphi_{ij}=\varphi_{ji}φij​=φji​, which the page uses silently (the lossless coupling must be a symmetric Laplacian) and which holds for power networks. Pij≥0P_{ij}\ge0Pij​≥0 off the diagonal, since §V.B allows zero weights.
  • Corrections: ∥Hθ∥2\|H\theta\|_2∥Hθ∥2​ sums over pairs i<ji<ji<j; the X~\tilde XX~ chain is stated as ∥HX∥2≤X~\|HX\|_2\le\tilde X∥HX∥2​≤X~; the attraction clause of 1) is stated as "eventually below every γ>γmin⁡\gamma>\gamma_{\min}γ>γmin​"; the rate of (19) is taken positive (it is printed with a minus sign), and the "Moreover" rate is stated for every γ∈ ]γmin⁡,π/2[\gamma\in\,]\gamma_{\min},\pi/2[γ∈]γmin​,π/2[ because (19) depends on an arc length the theorem does not name. The page's "Moreover, if γmax⁡=0\gamma_{\max}=0γmax​=0" is read as φmax⁡=0\varphi_{\max}=0φmax​=0, a misprint: γmax⁡>π/2−φmax⁡\gamma_{\max}>\pi/2-\varphi_{\max}γmax​>π/2−φmax​ is never zero.
  • γmin⁡,γmax⁡\gamma_{\min},\gamma_{\max}γmin​,γmax​ are quantified subject to their defining equations, and a milestone proves they exist and are unique, so they are not free parameters. Condition (33) is satisfiable (equal ratios ωi/Di\omega_i/D_iωi​/Di​ and φ≡0\varphi\equiv0φ≡0 give λcritical=0\lambda_{\mathrm{critical}}=0λcritical​=0), so the goal is not vacuous.
  • Source: the arXiv preprint v4 of the SICON article; every page and number refers to that preprint.
  • Infrastructure: weighted graph Laplacians, their second eigenvalue and Courant–Fischer-type bounds, incidence matrices, and ultimate-boundedness arguments for ODEs. The Laplacian and incidence-matrix layer is reusable for consensus and network-dynamics missions; contributions on any milestone are welcome.

Selected references

  • F. Dörfler, F. Bullo, Synchronization and Transient Stability in Power Networks and Nonuniform Kuramoto Oscillators, SIAM J. Control Optim. 50(3), 2012; preprint arXiv:0910.5673v4. https://arxiv.org/abs/0910.5673v4
  • N. Chopra, M. W. Spong, On exponential synchronization of Kuramoto oscillators, IEEE Trans. Automatic Control 54(2), pp. 353–357, 2009 (reference [32] of the source).
  • A. Jadbabaie, N. Motee, M. Barahona, On the stability of the Kuramoto model of coupled nonlinear oscillators, American Control Conference, Boston, 2004, pp. 4296–4301 (reference [33] of the source).
  • H. K. Khalil, Nonlinear Systems, 3rd ed., Prentice Hall, 2002 (ultimate boundedness, Theorem 4.18; reference [51] of the source).
14 thms2 active usersReviewed
Graph TheoryProbabilityTheoretical Computer Science·Captain: mikedeng1

Spectral Sparsification of Graphs 1: Sampling Each Edge of a High-Conductance Graph with Probability min(1, Υ/min(dᵢ, dⱼ)) Gives a (1+ε)-Spectral Approximation with Few EdgesResearch Paper

Motivation

A spectral sparsifier of a graph is a much sparser weighted graph whose Laplacian quadratic form is within a factor σ\sigmaσ of the original on every vector. Spielman and Teng introduced the notion in Spectral Sparsification of Graphs as a strengthening of the cut sparsifiers of Benczúr and Karger: a spectral sparsifier preserves every cut, and in addition every quantity determined by the Laplacian quadratic form, such as effective resistances, eigenvalues and the behaviour of random walks. Sparsifiers are the reason linear systems in graph Laplacians can be solved in nearly linear time: one preconditions with a sparsifier and solves the sparse system instead (Spielman–Teng, arXiv:cs/0607105).

The construction in the paper has two halves: decompose the graph into pieces of high conductance, then sparsify each piece by random sampling. This mission is the second half, Theorem 6.1 of §6: in a graph whose normalized Laplacian has a spectral gap, keeping each edge independently with probability inversely proportional to the smaller degree of its endpoints, and reweighting kept edges by the inverse probability, produces a (1+ϵ)(1+\epsilon)(1+ϵ)-spectral approximation with few edges, with high probability.

Timeline. Benczúr and Karger (1996) sampled edges with probabilities depending on edge strength and preserved cuts. Achlioptas and McSherry (2001) analysed random sampling of matrices through the random-matrix norm bound of Füredi and Komlós (1981), corrected by Vu (2007). Spielman and Teng (arXiv 2008, SIAM J. Comput. 2011) proved Theorem 6.1 by refining the Füredi–Komlós trace method for downsampling graphs that may already be sparse. Spielman and Srivastava (2008) later replaced conductance-based probabilities by effective resistances.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be an unweighted graph on a finite vertex set VVV, n=∣V∣n=|V|n=∣V∣, with degrees did_idi​, adjacency matrix AAA, diagonal degree matrix DDD and Laplacian LG=D−AL_G=D-ALG​=D−A. Its quadratic form is

xTLGx=∑{u,v}∈E(x(u)−x(v))2,x∈RV.x^TL_Gx=\sum_{\{u,v\}\in E}(x(u)-x(v))^2,\qquad x\in\mathbb R^V .xTLG​x={u,v}∈E∑​(x(u)−x(v))2,x∈RV.

A weighted graph G~\widetilde GG on VVV with weights w(u,v)≥0w(u,v)\ge0w(u,v)≥0 has the form xTLG~x=∑{u,v}w(u,v)(x(u)−x(v))2x^TL_{\widetilde G}x=\sum_{\{u,v\}}w(u,v)(x(u)-x(v))^2xTLG​x=∑{u,v}​w(u,v)(x(u)−x(v))2. G~\widetilde GG is a σ\sigmaσ-approximation of GGG if for all xxx

1σ xTLG~x≤xTLGx≤σ xTLG~x.\tfrac1\sigma\,x^TL_{\widetilde G}x\le x^TL_Gx\le\sigma\,x^TL_{\widetilde G}x .σ1​xTLG​x≤xTLG​x≤σxTLG​x.

When every degree is positive, the normalized Laplacian is LG=D−1/2LGD−1/2\mathcal L_G=D^{-1/2}L_GD^{-1/2}LG​=D−1/2LG​D−1/2; its eigenvalues lie in [0,2][0,2][0,2], and a lower bound λ\lambdaλ on its smallest non-zero eigenvalue measures how well connected each component of GGG is (by Cheeger's inequality it is equivalent to high conductance up to squaring).

Sampling. For a parameter Υ>1\Upsilon>1Υ>1, edge (i,j)(i,j)(i,j) is assigned

pi,j=min⁡(1,Υmin⁡(di,dj)),p_{i,j}=\min\Big(1,\frac{\Upsilon}{\min(d_i,d_j)}\Big),pi,j​=min(1,min(di​,dj​)Υ​),

each edge is kept independently with probability pi,jp_{i,j}pi,j​, and a kept edge gets weight 1/pi,j1/p_{i,j}1/pi,j​. The sampled adjacency matrix A~\widetilde AA then has E[A~]=A\mathbf E[\widetilde A]=AE[A]=A; D~\widetilde DD is the diagonal matrix of weighted degrees of the sampled graph.

The procedure. In Theorem 6.1 sampling is applied only to the edges FFF of an induced subgraph G(S)G(S)G(S), S⊆VS\subseteq VS⊆V; the other edges H=E−FH=E-FH=E−F are kept with weight 1. Sample((S,F),ϵ,p,λ)\mathtt{Sample}((S,F),\epsilon,p,\lambda)Sample((S,F),ϵ,p,λ) sets Υ=(12k/(ϵλ))2\Upsilon=(12k/(\epsilon\lambda))^2Υ=(12k/(ϵλ))2 and uses the degrees did_idi​ of G(S)G(S)G(S); the paper takes k=max⁡(log⁡2(3/p),log⁡2∣S∣)k=\max(\log_2(3/p),\log_2|S|)k=max(log2​(3/p),log2​∣S∣).

Formalization targets

Goal: Theorem 6.1 (p. 8)

For ϵ,p∈(0,1/2)\epsilon,p\in(0,1/2)ϵ,p∈(0,1/2), GGG without isolated vertices whose smallest non-zero normalized Laplacian eigenvalue is at least λ>0\lambda>0λ>0, S⊆VS\subseteq VS⊆V, and an even integer k≥max⁡(log⁡2(3/p),log⁡2∣S∣)k\ge\max(\log_2(3/p),\log_2|S|)k≥max(log2​(3/p),log2​∣S∣): with probability at least 1−p1-p1−p, simultaneously

(S.1)  G~=(V,F~∪H) is a (1+ϵ)-approximation of G,(S.2)  ∣F~∣≤288 k2(ϵλ)2 ∣S∣.\text{(S.1)}\ \ \widetilde G=(V,\widetilde F\cup H)\ \text{is a }(1+\epsilon)\text{-approximation of }G,\qquad \text{(S.2)}\ \ |\widetilde F|\le\frac{288\,k^2}{(\epsilon\lambda)^2}\,|S| .(S.1)  G=(V,F∪H) is a (1+ϵ)-approximation of G,(S.2)  ∣F∣≤(ϵλ)2288k2​∣S∣.

Milestones, in the order the proof uses them

  • Lemma 6.2 (p. 8): if λ2(D−1/2LD−1/2)≥λ\lambda_2(D^{-1/2}LD^{-1/2})\ge\lambdaλ2​(D−1/2LD−1/2)≥λ and ∥D−1/2(L−L~)D−1/2∥≤ϵ<λ\|D^{-1/2}(L-\widetilde L)D^{-1/2}\|\le\epsilon<\lambda∥D−1/2(L−L)D−1/2∥≤ϵ<λ, then G~\widetilde GG is a λ/(λ−ϵ)\lambda/(\lambda-\epsilon)λ/(λ−ϵ)-approximation of a connected GGG.
  • Claim 6.5 (p. 13): ∣Δi,j∣≤1/Υ|\Delta_{i,j}|\le1/\Upsilon∣Δi,j​∣≤1/Υ for Δ=D−1(A~−A)\Delta=D^{-1}(\widetilde A-A)Δ=D−1(A−A), on every outcome of positive probability.
  • Lemma 6.6 (p. 13): E[Δr,tkΔt,rl]≤Υ−(k+l−1)dr−1\mathbf E[\Delta_{r,t}^k\Delta_{t,r}^l]\le\Upsilon^{-(k+l-1)}d_r^{-1}E[Δr,tk​Δt,rl​]≤Υ−(k+l−1)dr−1​ for every edge, k≥1k\ge1k≥1, l≥0l\ge0l≥0.
  • Lemma 6.4 (p. 10): E[Tr⁡(Δk)]≤nkk/Υk/2\mathbf E[\operatorname{Tr}(\Delta^k)]\le nk^k/\Upsilon^{k/2}E[Tr(Δk)]≤nkk/Υk/2 for even kkk.
  • Lemma 6.3 (p. 9): Pr⁡[∥D−1/2(A~−A)D−1/2∥≥2kn1/k/Υ]≤2−k\Pr[\|D^{-1/2}(\widetilde A-A)D^{-1/2}\|\ge 2kn^{1/k}/\sqrt\Upsilon]\le2^{-k}Pr[∥D−1/2(A−A)D−1/2∥≥2kn1/k/Υ​]≤2−k for even k>0k>0k>0.
  • Theorem 6.8 (p. 15, Chernoff bound, cited from Raghavan 1988).
  • Lemma 6.7 (p. 14): Pr⁡[∥D−1/2(D−D~)D−1/2∥≥ϵ]≤2ne−Υϵ2/3\Pr[\|D^{-1/2}(D-\widetilde D)D^{-1/2}\|\ge\epsilon]\le2ne^{-\Upsilon\epsilon^2/3}Pr[∥D−1/2(D−D)D−1/2∥≥ϵ]≤2ne−Υϵ2/3 for 0<ϵ<10<\epsilon<10<ϵ<1.

Significance

Theorem 6.1 is the sampling engine of the first nearly-linear-time spectral sparsification algorithm: combined with a decomposition of an arbitrary graph into high-conductance pieces (§7–§10 of the paper), it yields sparsifiers with O(nlog⁡cn/ϵ2)O(n\log^c n/\epsilon^2)O(nlogcn/ϵ2) edges, which in turn give the nearly-linear-time Laplacian solvers that underlie fast algorithms for electrical flows, maximum flow approximation and graph partitioning. Lemma 6.3 is a self-contained random-matrix result: a norm bound for the normalized deviation of a downsampled graph that does not assume the original graph is dense.

The result is proved in the paper. As far as is known, none of it is formalized in Lean or Mathlib: Mathlib has the graph Laplacian (SimpleGraph.lapMatrix) and the spectral theorem for Hermitian matrices, but no normalized Laplacian, no spectral approximation and no trace-method bounds for random matrices. A complete formalization would be the first machine-checked proof of a spectral sparsification theorem, and the milestones (the trace-method moment bound, Chernoff for weighted two-point sums) are reusable on their own.

Difficulty

The obvious argument — bound each entry of A~−A\widetilde A-AA−A and apply a matrix concentration inequality — needs either a matrix Chernoff bound (not in the paper, and not in Mathlib) or the Füredi–Komlós trace method, which assumes every edge can appear and so fails when the graph is already sparse: a vertex of small degree has no room for its entries to average out. The paper's sampling probabilities keep every edge at a vertex of degree at most Υ\UpsilonΥ, and the trace computation has to exploit exactly this through the moment bound of Lemma 6.6 and a combinatorial count of closed walks. Formally, the obstacles are the walk-counting argument of Lemma 6.4, the passage from a trace bound to an eigenvalue bound for the non-symmetric Δ\DeltaΔ (similar to a symmetric matrix), and Lemma 6.2's restriction to the orthogonal complement of the kernel, which must handle disconnected GGG in the goal.

Formalization scope

  • Vertex sets are finite types V; graphs are SimpleGraph V with decidable adjacency; weighted graphs are weight functions V → V → ℝ (symmetric, nonnegative, loopless). The quadratic form is 12∑u,vw(u,v)(x(u)−x(v))2\frac12\sum_{u,v}w(u,v)(x(u)-x(v))^221​∑u,v​w(u,v)(x(u)−x(v))2; a σ\sigmaσ-approximation keeps both inequalities of (2).
  • The probability space is explicit: an outcome is the set TTT of kept edges, with probability ∏e∈Tpe∏e∉T(1−pe)\prod_{e\in T}p_e\prod_{e\notin T}(1-p_e)∏e∈T​pe​∏e∈/T​(1−pe​); probabilities and expectations are finite sums. The goal is a probability bound over this law, not the existence of a good set of edges, which would be a much weaker statement.
  • Eigenvalue conditions are stated with real eigenpairs: "smallest non-zero eigenvalue ≥λ\ge\lambda≥λ" means every eigenvalue μ≠0\mu\ne0μ=0 satisfies μ≥λ\mu\ge\lambdaμ≥λ; "∥M∥≤t\|M\|\le t∥M∥≤t" ("≥t\ge t≥t") for symmetric MMM means every (some) eigenvalue has absolute value ≤t\le t≤t (≥t\ge t≥t).
  • Hypotheses made explicit (the paper leaves them implicit): in Theorem 6.1, kkk is an even integer with k≥log⁡2(3/p)k\ge\log_2(3/p)k≥log2​(3/p), k≥log⁡2∣S∣k\ge\log_2|S|k≥log2​∣S∣ (the proof applies Lemma 6.3 with Sample's kkk, which the paper defines as a real maximum; the printed statement is the case where that maximum is an even integer), every vertex has degree ≥1\ge1≥1, and λ>0\lambda>0λ>0; in Lemma 6.2, 0≤ϵ<λ0\le\epsilon<\lambda0≤ϵ<λ; in Lemma 6.7, 0<ϵ<10<\epsilon<10<ϵ<1 (without it the printed bound is false for large ϵ\epsilonϵ); in Lemmas 6.3–6.7 and Claim 6.5, positive degrees; in Lemma 6.3, k>0k>0k>0; in Theorem 6.8, β>0\beta>0β>0, ϵ>0\epsilon>0ϵ>0, pi∈[0,1]p_i\in[0,1]pi​∈[0,1]. GGG is not assumed connected in Theorem 6.1.
  • In Theorem 6.1 the probabilities use the degrees of G(S)G(S)G(S) (the input of Sample\mathtt{Sample}Sample), while λ\lambdaλ refers to GGG; nnn in Sample\mathtt{Sample}Sample is ∣S∣|S|∣S∣.
  • Trivializing readings ruled out: a one-sided "approximation", a goal that chooses the kept edges existentially, and a spectral hypothesis with λ≤0\lambda\le0λ≤0 or without positive degrees are all excluded by the statements.
  • Out of scope: running times, the decomposition algorithms of §7–§10, Cheeger's inequality (Theorem 4.1, cited and not used here), the weighted generalization remarked on p. 10, and the use of Theorem 6.1 in Lemma 9.1.
  • Contributions welcome: proofs of any milestone; a Loewner-order formulation equivalence; a general matrix Chernoff or trace-method library from which Lemma 6.3 follows.

Selected references

  • D. A. Spielman, S.-H. Teng, Spectral Sparsification of Graphs, arXiv:0808.4134v3, 2010; SIAM J. Comput. 40(4), 2011. https://arxiv.org/abs/0808.4134
  • A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
  • D. Achlioptas, F. McSherry, Fast computation of low rank matrix approximations, STOC 2001. https://doi.org/10.1145/380752.380858
  • Z. Füredi, J. Komlós, The eigenvalues of random symmetric matrices, Combinatorica 1(3), 1981. https://doi.org/10.1007/BF02579329
  • V. H. Vu, Spectral norm of random matrices, Combinatorica 27(6), 2007. https://doi.org/10.1007/s00493-007-2190-z
  • P. Raghavan, Probabilistic construction of deterministic algorithms: approximating packing integer programs, J. Comput. Syst. Sci. 37(2), 1988. https://doi.org/10.1016/0022-0000(88)90003-7
  • D. A. Spielman, N. Srivastava, Graph sparsification by effective resistances, STOC 2008; arXiv:0803.0929. https://arxiv.org/abs/0803.0929
13 thms2 active usersReviewed
Graph TheoryProbabilityRandom Matrix Theory+1·Captain: mikedeng1

Graph Sparsification by Effective Resistances 1: Sampling O(n log n/ε²) Edges by Effective Resistance Yields a (1±ε) Spectral Sparsifier with Probability 1/2Research Paper

Motivation

Many graph algorithms run in time proportional to the number of edges. A sparsifier of a weighted graph GGG is a graph HHH on the same vertices with far fewer edges that approximates GGG for the purpose at hand, so that the algorithm can be run on HHH instead. Benczúr and Karger (1996) showed that every graph has a sparsifier with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges preserving the weight of every cut up to a factor 1±ε1\pm\varepsilon1±ε. Spielman and Teng (2004) introduced the stronger spectral notion, in which the Laplacian quadratic form is preserved for every real vector, not only for cut indicators; their sparsifiers had O(nlog⁡cn)O(n\log^c n)O(nlogcn) edges for a large constant ccc and were the first step of their nearly-linear-time solvers for symmetric diagonally dominant linear systems.

Spielman and Srivastava (arXiv:0803.0929, STOC 2008, SIAM J. Comput. 2011) proved that independent sampling of O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges, each edge with probability proportional to its weight times its effective resistance, yields a spectral sparsifier. The result improved both earlier bounds, replaced a recursive partitioning construction by a one-line sampling rule, and made effective resistance a standard tool in graph algorithms. Batson, Spielman and Srivastava (arXiv:0808.0163) later obtained O(n/ε2)O(n/\varepsilon^2)O(n/ε2) edges deterministically, by a slower method built on the same matrix Π\PiΠ.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a connected weighted undirected graph with n=∣V∣n=|V|n=∣V∣ vertices, m=∣E∣m=|E|m=∣E∣ edges and weights we>0w_e>0we​>0. Orient every edge arbitrarily, so that it has a head and a tail (distinct vertices).

  • The incidence matrix B∈Rm×nB\in\mathbb R^{m\times n}B∈Rm×n has B(e,v)=1B(e,v)=1B(e,v)=1 if vvv is the head of eee, −1-1−1 if vvv is its tail, and 000 otherwise; beb_ebe​ denotes its row for eee. WWW is the diagonal m×mm\times mm×m matrix with W(e,e)=weW(e,e)=w_eW(e,e)=we​.
  • The Laplacian is L=BTWBL=B^{\mathsf T}WBL=BTWB, with quadratic form xTLx=∑ewe (x(head e)−x(tail e))2x^{\mathsf T}Lx=\sum_e w_e\,(x(\mathrm{head}\,e)-x(\mathrm{tail}\,e))^2xTLx=∑e​we​(x(heade)−x(taile))2.
  • L+L^{+}L+ is the Moore–Penrose pseudoinverse of LLL: if L=∑i=1n−1λiuiuiTL=\sum_{i=1}^{n-1}\lambda_iu_iu_i^{\mathsf T}L=∑i=1n−1​λi​ui​uiT​ over its nonzero eigenvalues, then L+=∑i=1n−1λi−1uiuiTL^{+}=\sum_{i=1}^{n-1}\lambda_i^{-1}u_iu_i^{\mathsf T}L+=∑i=1n−1​λi−1​ui​uiT​.
  • The effective resistance of the edge eee is Re=beL+beTR_e=b_eL^{+}b_e^{\mathsf T}Re​=be​L+beT​: the potential difference across eee when a unit current enters at one end and leaves at the other, the edges being resistors of conductance wew_ewe​.
  • Π=W1/2BL+BTW1/2\Pi=W^{1/2}BL^{+}B^{\mathsf T}W^{1/2}Π=W1/2BL+BTW1/2 is an m×mm\times mm×m matrix with Π(e,e)=weRe\Pi(e,e)=w_eR_eΠ(e,e)=we​Re​.
  • Sparsify(G,q)(G,q)(G,q) draws qqq edges independently with replacement, the edge eee with probability pe=weRe/∑fwfRfp_e=w_eR_e/\sum_f w_fR_fpe​=we​Re​/∑f​wf​Rf​, and gives eee the weight we/(qpe)w_e/(qp_e)we​/(qpe​) for each time it is drawn. Its output HHH has Laplacian L~=BTW1/2SW1/2B\tilde L=B^{\mathsf T}W^{1/2}SW^{1/2}BL~=BTW1/2SW1/2B, where SSS is the random diagonal matrix with S(e,e)=#{draws of e}/(qpe)S(e,e)=\#\{\text{draws of }e\}/(qp_e)S(e,e)=#{draws of e}/(qpe​).

Formalization targets

Goal: Theorem 1

There are an absolute constant CCC and a threshold N0N_0N0​ such that, for every n≥N0n\ge N_0n≥N0​, every connected weighted graph on nnn vertices and every 1/n<ε≤11/\sqrt n<\varepsilon\le11/n​<ε≤1, with q=⌈9C2nlog⁡n/ε2⌉q=\lceil 9C^2n\log n/\varepsilon^2\rceilq=⌈9C2nlogn/ε2⌉, with probability at least 1/21/21/2

∀x∈Rn:(1−ε) xTLx  ≤  xTL~x  ≤  (1+ε) xTLx.\forall x\in\mathbb R^n:\qquad (1-\varepsilon)\,x^{\mathsf T}Lx\;\le\;x^{\mathsf T}\tilde Lx\;\le\;(1+\varepsilon)\,x^{\mathsf T}Lx .∀x∈Rn:(1−ε)xTLx≤xTL~x≤(1+ε)xTLx.

The constant CCC is left unfixed; the statement asserts the shape q=O(nlog⁡n/ε2)q=O(n\log n/\varepsilon^2)q=O(nlogn/ε2) with the paper's explicit dependence on CCC.

Milestones

  1. Lemma 3 (four parts): Π\PiΠ is an orthogonal projection; im⁡Π=im⁡W1/2B\operatorname{im}\Pi=\operatorname{im}W^{1/2}BimΠ=imW1/2B; the eigenvalues of Π\PiΠ are 111 with multiplicity n−1n-1n−1 and 000 with multiplicity m−n+1m-n+1m−n+1; Π(e,e)=∥Π(⋅,e)∥2\Pi(e,e)=\|\Pi(\cdot,e)\|^2Π(e,e)=∥Π(⋅,e)∥2.
  2. Lemma 4: for a nonnegative diagonal SSS, ∥ΠSΠ−ΠΠ∥2≤ε\|\Pi S\Pi-\Pi\Pi\|_2\le\varepsilon∥ΠSΠ−ΠΠ∥2​≤ε implies (1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx(1-\varepsilon)x^{\mathsf T}Lx\le x^{\mathsf T}B^{\mathsf T}W^{1/2}SW^{1/2}Bx\le(1+\varepsilon)x^{\mathsf T}Lx(1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx for all xxx.
  3. Lemma 5 (Rudelson–Vershynin): for independent samples y1,…,yqy_1,\dots,y_qy1​,…,yq​ of a random vector with ∥y∥2≤M\|y\|_2\le M∥y∥2​≤M and ∥E yyT∥2≤1\|\mathbb E\,yy^{\mathsf T}\|_2\le1∥EyyT∥2​≤1, and q≥2q\ge2q≥2,
E∥1q∑j=1qyjyjT−E yyT∥2≤CMlog⁡qqwhenever the right side is <1.\mathbb E\Big\|\frac1q\sum_{j=1}^q y_jy_j^{\mathsf T}-\mathbb E\,yy^{\mathsf T}\Big\|_2\le CM\sqrt{\frac{\log q}{q}}\quad\text{whenever the right side is }<1.E​q1​j=1∑q​yj​yjT​−EyyT​2​≤CMqlogq​​whenever the right side is <1.

Significance

Theorem 1 says that every weighted graph is spectrally approximated by a reweighted subgraph with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges. A spectral approximation preserves cut weights, the eigenvalues of the Laplacian up to 1±ε1\pm\varepsilon1±ε, effective resistances, and the condition number of LLL as a preconditioner, so any algorithm whose output depends on these quantities can run on HHH. Combined with fast approximate computation of effective resistances (the second mission of this series), it gives a nearly-linear-time construction, and it is the sampling step used in Laplacian solvers, in sparsification of sums of rank-one matrices, and in leverage-score sampling for regression, where weRew_eR_ewe​Re​ is exactly the statistical leverage of a row.

The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission formalizes the statement and the paper's proof structure: the linear algebra of Π\PiΠ (Lemma 3), the deterministic reduction from quadratic forms to a spectral-norm bound (Lemma 4), and the matrix concentration inequality (Lemma 5), which is the substantive analytic input and is itself a reusable result about sums of independent rank-one matrices.

Difficulty

The deterministic part is linear algebra over the pseudoinverse. The obstacle is concentration: the expected Laplacian of HHH equals LLL, but bounding the deviation uniformly over all x∈Rnx\in\mathbb R^nx∈Rn is a statement about the spectral norm of a random matrix, and a union bound over a net of directions costs a factor of nnn in the sample count rather than log⁡n\log nlogn. Scalar Chernoff bounds per cut, which suffice for cut sparsifiers, do not give the spectral statement. Lemma 5 is the matrix inequality that removes this loss, and no inequality of this kind (a concentration bound for the spectral norm of a sum of independent random matrices) is in Mathlib.

Formalization scope

All declarations sit in the namespace EffResSparsify.Sampling.

  • Graphs. A structure WGraph V E with orientation maps head, tail : E → V, weights w : E → ℝ, and the fields head e ≠ tail e (no loops) and 0 < w e. Parallel edges are allowed; nothing in §3 uses simplicity. Connectivity is a separate hypothesis on the underlying simple graph and includes V≠∅V\ne\emptysetV=∅. In Theorem 1 the vertex type is Fin n; the edge type is an arbitrary finite type.
  • Pseudoinverse. L+L^{+}L+ is the matrix of the published Moore–Penrose pseudoinverse HarmonicGames.Decomposition.pinv of x↦Lxx\mapsto Lxx↦Lx on Euclidean RV\mathbb R^VRV; it equals the spectral formula above and is the gauge-fixed inverse, never "some solution of Lx=yLx=yLx=y".
  • Sampling. pep_epe​ is defined as weRe/∑fwfRfw_eR_e/\sum_f w_fR_fwe​Re​/∑f​wf​Rf​; the identity ∑fwfRf=n−1\sum_f w_fR_f=n-1∑f​wf​Rf​=n−1 is part of the proof. An outcome of Sparsify is a sequence in EqE^qEq with probability ∏ipsi\prod_i p_{s_i}∏i​psi​​, and probabilities and expectations are finite sums over EqE^qEq, with no measure theory.
  • Norms and logarithms. ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is the ℓ2\ell_2ℓ2​ operator norm on matrices (Matrix.Norms.L2Operator); vector norms in Lemma 5 are Euclidean; log⁡\loglog is natural (the base is absorbed into CCC).
  • Constants. In Theorem 1, ∃C>0, ∃N0, ∀n≥N0\exists C>0,\ \exists N_0,\ \forall n\ge N_0∃C>0, ∃N0​, ∀n≥N0​ precede the graph and ε\varepsilonε; the sample count is ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, rounded up because the printed value is not an integer. In Lemma 5, ∃C>0\exists C>0∃C>0 precedes the dimension, the distribution, MMM and qqq.
  • Corrected statement. Lemma 5 as printed, with right side min⁡(CMlog⁡q/q,1)\min(CM\sqrt{\log q/q},1)min(CMlogq/q​,1), is false (at q=1q=1q=1 the bound is 000). The formal milestone is Rudelson and Vershynin's own Theorem 3.1: q≥2q\ge2q≥2, and the bound a=CMlog⁡q/qa=CM\sqrt{\log q/q}a=CMlogq/q​ holds when a<1a<1a<1. It is stated for finitely supported distributions, which is all Theorem 1 uses. Theorem 1 applies it with a≤ε/2a\le\varepsilon/2a≤ε/2, so the correction does not affect the goal.
  • Not a trivialization. Theorem 1 does not take Lemma 5, a bound on E∥ΠSΠ−Π∥2\mathbb E\|\Pi S\Pi-\Pi\|_2E∥ΠSΠ−Π∥2​, or a free sample count as a hypothesis; a statement with any of these, or with "∃q\exists q∃q" in place of ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, is a different theorem.

Reusable beyond this mission: the weighted Laplacian with its pseudoinverse and effective resistances, and Lemma 5, which applies to any sampling scheme for sums of rank-one matrices (leverage-score sampling, column subset selection). Contributions toward a matrix Chernoff or Rudelson-type inequality in Mathlib are welcome.

Selected references

  • D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
  • M. Rudelson, R. Vershynin, Sampling from large matrices: an approach through geometric functional analysis, J. ACM 54(4), 2007. https://doi.org/10.1145/1255443.1255449
  • M. Rudelson, Random vectors in the isotropic position, J. Funct. Anal. 164(1), 1999. https://doi.org/10.1006/jfan.1998.3384
  • A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
  • D. A. Spielman, S.-H. Teng, Spectral sparsification of graphs, SIAM J. Comput. 40(4), 2011 (arXiv:0808.4134). https://arxiv.org/abs/0808.4134
  • J. Batson, D. A. Spielman, N. Srivastava, Twice-Ramanujan sparsifiers, SIAM J. Comput. 41(6), 2012 (arXiv:0808.0163). https://arxiv.org/abs/0808.0163
9 thms2 active usersReviewed
Markov Chain·Captain: mikedeng1

Search via Quantum Walk 3: For an Irreducible Chain with Positive Self-Loops the Discriminant diag(π)^{1/2}·P·diag(π)^{−1/2} Has Exactly One Singular Value Equal to 1Research Paper

Motivation

Quantum walks give quadratic speed-ups for a class of search problems that classical algorithms solve by running a Markov chain until it hits a marked state. Ambainis's element-distinctness algorithm (Ambainis 2007) and Szegedy's quantization of reversible Markov chains (Szegedy 2004) are the two starting points. Magniez, Nayak, Roland and Santha (arXiv:quant-ph/0608026v4, SIAM J. Comput. 2011) combined them into one search algorithm whose cost is governed by the eigenvalue gap of a reversible chain PPP.

For a non-reversible chain the relevant spectral quantity is not the eigenvalue gap of PPP. It is the singular value gap of a related matrix, the discriminant D(P)D(P)D(P). In §5 the paper observes that its search algorithm and the proof of its main theorem carry over to non-reversible chains once the eigenvalue gap of PPP is replaced by the singular value gap of D(P)D(P)D(P). Positivity of that gap therefore decides whether the algorithm can be used at all. The paper also notes that irreducibility, and even ergodicity, does not guarantee a positive gap. Its Proposition 3 (p. 17, proved in the appendix on pp. 20–21) gives a simple sufficient condition: every state has a positive probability of staying where it is. This mission formalizes that proposition.

Setting

Let XXX be a finite set of states. A Markov chain on XXX is a real matrix P=(pxy)x,y∈XP=(p_{xy})_{x,y\in X}P=(pxy​)x,y∈X​ with nonnegative entries whose rows sum to one; pxyp_{xy}pxy​ is the probability of moving from xxx to yyy. The graph underlying PPP has an edge x→yx\to yx→y whenever pxy>0p_{xy}>0pxy​>0. The chain is irreducible if this graph is strongly connected, so that every state can be reached from every other state.

A stationary distribution of PPP is a vector π=(πx)x∈X\pi=(\pi_x)_{x\in X}π=(πx​)x∈X​ with

πx>0,∑xπx=1,∑xπxpxy=πy(y∈X).\pi_x>0,\qquad \sum_x \pi_x=1,\qquad \sum_x \pi_x p_{xy}=\pi_y\quad(y\in X).πx​>0,x∑​πx​=1,x∑​πx​pxy​=πy​(y∈X).

Every irreducible chain has exactly one.

The discriminant of PPP is the matrix

D(P)=diag⁡(π)1/2⋅P⋅diag⁡(π)−1/2,D(P)xy=πx pxyπy,D(P)=\operatorname{diag}(\pi)^{1/2}\cdot P\cdot \operatorname{diag}(\pi)^{-1/2},\qquad D(P)_{xy}=\frac{\sqrt{\pi_x}\,p_{xy}}{\sqrt{\pi_y}},D(P)=diag(π)1/2⋅P⋅diag(π)−1/2,D(P)xy​=πy​​πx​​pxy​​,

viewed as an operator on CX\mathbb C^XCX with the inner product ⟨u,w⟩=∑xux‾wx\langle u,w\rangle=\sum_x\overline{u_x}w_x⟨u,w⟩=∑x​ux​​wx​. Its singular values σ0≥σ1≥⋯≥σ∣X∣−1≥0\sigma_0\ge\sigma_1\ge\dots\ge\sigma_{|X|-1}\ge 0σ0​≥σ1​≥⋯≥σ∣X∣−1​≥0 are the square roots of the eigenvalues of D(P)†D(P)D(P)^\dagger D(P)D(P)†D(P), repeated according to multiplicity. The vector v=(πx)x∈Xv=(\sqrt{\pi_x})_{x\in X}v=(πx​​)x∈X​ satisfies D(P)v=vD(P)v=vD(P)v=v and vTD(P)=vTv^{\mathsf T}D(P)=v^{\mathsf T}vTD(P)=vT, so 111 is always a singular value of D(P)D(P)D(P). When PPP is reversible, D(P)D(P)D(P) is symmetric and its singular values are the absolute values of the eigenvalues of PPP. In general the two can differ.

Formalization targets

Goal: Proposition 3

If PPP is an irreducible Markov chain on a finite state space XXX with pxx>0p_{xx}>0pxx​>0 for every xxx, then D(P)D(P)D(P) has exactly one singular value equal to 111:

#{ i<∣X∣: σi(D(P))=1 }=1.\#\{\,i<|X|:\ \sigma_i(D(P))=1\,\}=1 .#{i<∣X∣: σi​(D(P))=1}=1.

Together with the bound below, this says that 1=σ0>σ11=\sigma_0>\sigma_11=σ0​>σ1​, i.e. the singular value gap 1−σ11-\sigma_11−σ1​ is positive. The goal asserts no explicit lower bound on the gap, so it does not depend on any quantitative estimate.

Milestones, in the order the proof uses them

  1. Eq. (9). For unit vectors u,v∈CXu,v\in\mathbb C^Xu,v∈CX,
∣u†D(P)v∣≤(∑x,y∣ux∣2pxy)1/2(∑x,y∣vy∣2πxπypxy)1/2≤1.|u^\dagger D(P)v|\le\Bigl(\sum_{x,y}|u_x|^2p_{xy}\Bigr)^{1/2}\Bigl(\sum_{x,y}|v_y|^2\tfrac{\pi_x}{\pi_y}p_{xy}\Bigr)^{1/2}\le 1 .∣u†D(P)v∣≤(x,y∑​∣ux​∣2pxy​)1/2(x,y∑​∣vy​∣2πy​πx​​pxy​)1/2≤1.
  1. Lemma 3. Every singular value of D(P)D(P)D(P) lies in [0,1][0,1][0,1].
  2. §5, p. 17. v=(πx)v=(\sqrt{\pi_x})v=(πx​​) is a left and right eigenvector of D(P)D(P)D(P) with eigenvalue 111.
  3. Equality case. If u,wu,wu,w are unit vectors with u†D(P)w=1u^\dagger D(P)w=1u†D(P)w=1, then ux=wyπx/πyu_x=w_y\sqrt{\pi_x/\pi_y}ux​=wy​πx​/πy​​ whenever pxy>0p_{xy}>0pxy​>0.
  4. Path chaining. If uy=uxπy/πxu_y=u_x\sqrt{\pi_y/\pi_x}uy​=ux​πy​/πx​​ along every edge x→yx\to yx→y and PPP is irreducible, then uy=ux1πy/πx1u_y=u_{x_1}\sqrt{\pi_y/\pi_{x_1}}uy​=ux1​​πy​/πx1​​​ for all x1,yx_1,yx1​,y.

Significance

The result. Proposition 3 is what makes the search algorithm of the paper usable with non-reversible chains. Theorem 8 of the paper bounds the cost of finding a marked element in terms of the singular value gap of D(P)D(P)D(P), and it needs that gap to be positive. The hypothesis pxx>0p_{xx}>0pxx​>0 costs little: replacing PPP by αI+(1−α)P\alpha I+(1-\alpha)PαI+(1−α)P for any α∈(0,1)\alpha\in(0,1)α∈(0,1) makes every self-loop positive and keeps the stationary distribution. The proposition also connects to the classical study of non-reversible chains: the squared singular values of D(P)D(P)D(P) are the eigenvalues of the multiplicative reversiblization PP∗PP^*PP∗, which Fill (1991) used to bound convergence to stationarity.

Formalizing it. The proposition and its proof are in the paper and are not in dispute. To our knowledge neither is machine-checked anywhere. The work is a formal proof of the known argument. It exercises Mathlib's recently added singular values of linear maps between finite-dimensional inner product spaces and its theory of irreducible nonnegative matrices, in a setting where the matrix is neither symmetric nor normal.

Difficulty

The obvious route goes through eigenvalues. Irreducibility plus self-loops make PPP aperiodic, so by Perron–Frobenius the eigenvalue 111 of PPP is simple and every other eigenvalue has modulus less than 111. This does not settle the question. The singular values of a non-normal matrix are not the moduli of its eigenvalues, and the paper points out ergodic chains whose discriminant has zero singular value gap even though their eigenvalue gap is positive. Simplicity of the eigenvalue 111 of PPP therefore says nothing about the multiplicity of the singular value 111 of D(P)D(P)D(P).

The real content is the equality case of a Cauchy–Schwarz inequality in CX×X\mathbb C^{X\times X}CX×X. It has to be translated into an edge-by-edge relation between the coordinates of the left and right singular vectors, then propagated along directed paths of the chain's graph. The self-loops are what identify the left and right singular vectors with each other. Bookkeeping that is routine on paper costs effort here: passing between the eigenvalue sequence of D(P)†D(P)D(P)^\dagger D(P)D(P)†D(P) and the dimension of its 111-eigenspace, and between paths in Mathlib's quiver of positive entries and chains of equalities.

Formalization scope

  • States and chain. The state space is a Fintype with decidable equality. PPP is a real matrix in Matrix.rowStochastic ℝ X, and irreducibility is Mathlib's Matrix.IsIrreducible (nonnegative entries and a strongly connected quiver with an edge x→yx\to yx→y iff pxy>0p_{xy}>0pxy​>0). For a row-stochastic matrix this agrees with "every state is reachable from every other state".
  • Stationary distribution. It enters as data π\piπ with the three properties above. Positivity is explicit because diag⁡(π)−1/2\operatorname{diag}(\pi)^{-1/2}diag(π)−1/2 needs it. Existence and uniqueness (Perron–Frobenius) are neither needed nor stated.
  • Discriminant. D(P)D(P)D(P) is the complex matrix with entries πxpxy/πy\sqrt{\pi_x}p_{xy}/\sqrt{\pi_y}πx​​pxy​/πy​​, acting on EuclideanSpace ℂ X. Its singular values are Mathlib's LinearMap.singularValues, a sequence indexed by N\mathbb NN that is 000 beyond ∣X∣|X|∣X∣. The goal counts the indices i<∣X∣i<|X|i<∣X∣ with σi=1\sigma_i=1σi​=1. The inner product u†D(P)wu^\dagger D(P)wu†D(P)w is Mathlib's inner ℂ u (D(P) w). Since the equality-case milestone assumes this equals 111 exactly, no phase ambiguity remains.
  • What is not assumed. Reversibility of PPP is not assumed. Neither is aperiodicity, primitivity, or a "lazy" bound pxx≥1/2p_{xx}\ge 1/2pxx​≥1/2: the hypothesis is exactly pxx>0p_{xx}>0pxx​>0 for every xxx.
  • Ruled-out trivializations. "111 is a singular value of D(P)D(P)D(P)" holds for every chain and is not the goal. The goal is that this singular value has multiplicity one. A conclusion such as "some singular value is <1<1<1" would also be too weak.
  • Cost. The paper's search algorithm and its cost bounds (Theorem 8) are out of scope. This mission is purely linear-algebraic.
  • Welcome contributions. Proofs of the milestones. The path-chaining milestone is a reusable fact about functions that are multiplicative along the edges of a strongly connected quiver. A general lemma relating the multiplicity of a singular value to the dimension of an eigenspace of T†TT^\dagger TT†T would be useful well beyond this mission.

Selected references

  • F. Magniez, A. Nayak, J. Roland, M. Santha, Search via Quantum Walk, SIAM J. Comput. 40(1):142–164, 2011; arXiv:quant-ph/0608026v4. https://arxiv.org/abs/quant-ph/0608026 (DOI 10.1137/090745854)
  • M. Szegedy, Quantum speed-up of Markov chain based algorithms, Proc. 45th IEEE FOCS, 32–41, 2004. https://doi.org/10.1109/FOCS.2004.53
  • A. Ambainis, Quantum walk algorithm for element distinctness, SIAM J. Comput. 37(1):210–239, 2007; arXiv:quant-ph/0311001. https://arxiv.org/abs/quant-ph/0311001
  • J. A. Fill, Eigenvalue bounds on convergence to stationarity for nonreversible Markov chains, with an application to the exclusion process, Ann. Appl. Probab. 1(1):62–87, 1991. https://doi.org/10.1214/aoap/1177005981
7 thms2 active usersReviewed
Quantum Information·Captain: marwahaha

Entanglement with zero distillable secret key in local dimension tenOpen Problem

Motivation

Positive partial transpose imposes strong constraints on quantum maps, but composition may retain entanglement. Explicit finite-dimensional examples make that distinction a precise algebraic target. The pinned manuscript supplies the research context.

Setting

The selected maps act on complex 10 by 10 matrices. Complete positivity is quantified over matrix amplifications, while separability is expressed by finite sums of positive tensor factors.

Formalization target

The selected goal is OAI.DimensionTen.main_pair. Its central assertion is

Φ1=phiOne,Φ2=phiTwo,¬EB(Φ2∘Φ1).\Phi_1=\mathrm{phiOne},\quad\Phi_2=\mathrm{phiTwo},\quad\neg\mathrm{EB}(\Phi_2\circ\Phi_1).Φ1​=phiOne,Φ2​=phiTwo,¬EB(Φ2​∘Φ1​).

The theorem states that there exist maps Φ₁ and Φ₂ from 10×10 complex matrices to 10×10 complex matrices, equal to the defined maps phiOne and phiTwo, each of which is PPT, meaning complex-linear, completely positive, and such that composing with the transpose of the output is also completely positive (complete positivity means that applying the map to one factor of any positive semidefinite block matrix on ℂᵏ⊗ℂ¹⁰, for every k≥1, yields a positive semidefinite matrix). Here phiOne sends A to the 6×6 matrix obtained from the transpose of A by embedding it as a symmetric tensor in ℂ⁴⊗ℂ⁴, applying the tensor square of an explicit 4×4 pencil map built from four integer 6×4 blocks, and compressing to the antisymmetric subspace, then padding it to a 10×10 matrix in the first six coordinates. phiTwo is the Hilbert–Schmidt adjoint of an associated complementary map, which uses a Hodge-type complement matrix, applied to the compression of its input onto the first six coordinates. Moreover, letting Z be the Choi matrix of the composition Φ₂∘Φ₁, a 100×100 matrix with entries given by the images of the matrix units, Z is nonzero; no nonzero product vector u⊗v with u,v∈ℂ¹⁰ lies in the range of Z, that is, whenever Z applied to some w∈ℂ¹⁰ˣ¹⁰ equals u⊗v then u=0 or v=0; and Φ₂∘Φ₁ is not entanglement breaking, where entanglement breaking means completely positive and sending every positive semidefinite amplification to a separable matrix, a finite sum of Kronecker products of positive semidefinite matrices. This theorem is admitted in the source, not proved.

Significance and status

The selected target is the explicit pair of PPT maps in dimension ten, including its nonzero Choi matrix and product-vector obstruction. It does not state a secret-key distillation theorem. The separate 21-dimensional channel is retained as an additional reference. The target is currently Open on Prove2Me. The manuscript's mathematical argument and a machine-checked proof of the selected statement are separate deliverables.

Difficulty

PPT properties and non-entanglement-breaking composition require different certificates. The range condition must exclude every nonzero product vector.

Formalization scope

The exact published goal, its hypotheses and its referenced definition blocks specify the requested formalization. The explanatory formula above is a summary; all quantifiers and additional clauses in the linked statement remain required.

Additional published targets are included as separate references:

  • OAI.DimensionTen.exists_channel_fin21 (Open).

Selected references

  • OpenAI, Entanglement with zero distillable secret key in local dimension ten, preprint, 2026. Manuscript.
  • OpenAI, accompanying formal statements, commit adc7f1241b42. Selected goal source.
9 thms2 active usersReviewed
PreviousPage 2 of 4Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me