Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Random Matrix Theory

61 missions · 27 completed

Missions

Open34Completed27All61
Graph TheoryLinear algebraProbability+1·Captain: mikedeng1

Graph Sparsification by Effective Resistances 1: Sampling O(n log n/ε²) Edges by Effective Resistance Yields a (1±ε) Spectral Sparsifier with Probability 1/2Research Paper

Motivation

Many graph algorithms run in time proportional to the number of edges. A sparsifier of a weighted graph GGG is a graph HHH on the same vertices with far fewer edges that approximates GGG for the purpose at hand, so that the algorithm can be run on HHH instead. Benczúr and Karger (1996) showed that every graph has a sparsifier with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges preserving the weight of every cut up to a factor 1±ε1\pm\varepsilon1±ε. Spielman and Teng (2004) introduced the stronger spectral notion, in which the Laplacian quadratic form is preserved for every real vector, not only for cut indicators; their sparsifiers had O(nlog⁡cn)O(n\log^c n)O(nlogcn) edges for a large constant ccc and were the first step of their nearly-linear-time solvers for symmetric diagonally dominant linear systems.

Spielman and Srivastava (arXiv:0803.0929, STOC 2008, SIAM J. Comput. 2011) proved that independent sampling of O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges, each edge with probability proportional to its weight times its effective resistance, yields a spectral sparsifier. The result improved both earlier bounds, replaced a recursive partitioning construction by a one-line sampling rule, and made effective resistance a standard tool in graph algorithms. Batson, Spielman and Srivastava (arXiv:0808.0163) later obtained O(n/ε2)O(n/\varepsilon^2)O(n/ε2) edges deterministically, by a slower method built on the same matrix Π\PiΠ.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a connected weighted undirected graph with n=∣V∣n=|V|n=∣V∣ vertices, m=∣E∣m=|E|m=∣E∣ edges and weights we>0w_e>0we​>0. Orient every edge arbitrarily, so that it has a head and a tail (distinct vertices).

  • The incidence matrix B∈Rm×nB\in\mathbb R^{m\times n}B∈Rm×n has B(e,v)=1B(e,v)=1B(e,v)=1 if vvv is the head of eee, −1-1−1 if vvv is its tail, and 000 otherwise; beb_ebe​ denotes its row for eee. WWW is the diagonal m×mm\times mm×m matrix with W(e,e)=weW(e,e)=w_eW(e,e)=we​.
  • The Laplacian is L=BTWBL=B^{\mathsf T}WBL=BTWB, with quadratic form xTLx=∑ewe (x(head e)−x(tail e))2x^{\mathsf T}Lx=\sum_e w_e\,(x(\mathrm{head}\,e)-x(\mathrm{tail}\,e))^2xTLx=∑e​we​(x(heade)−x(taile))2.
  • L+L^{+}L+ is the Moore–Penrose pseudoinverse of LLL: if L=∑i=1n−1λiuiuiTL=\sum_{i=1}^{n-1}\lambda_iu_iu_i^{\mathsf T}L=∑i=1n−1​λi​ui​uiT​ over its nonzero eigenvalues, then L+=∑i=1n−1λi−1uiuiTL^{+}=\sum_{i=1}^{n-1}\lambda_i^{-1}u_iu_i^{\mathsf T}L+=∑i=1n−1​λi−1​ui​uiT​.
  • The effective resistance of the edge eee is Re=beL+beTR_e=b_eL^{+}b_e^{\mathsf T}Re​=be​L+beT​: the potential difference across eee when a unit current enters at one end and leaves at the other, the edges being resistors of conductance wew_ewe​.
  • Π=W1/2BL+BTW1/2\Pi=W^{1/2}BL^{+}B^{\mathsf T}W^{1/2}Π=W1/2BL+BTW1/2 is an m×mm\times mm×m matrix with Π(e,e)=weRe\Pi(e,e)=w_eR_eΠ(e,e)=we​Re​.
  • Sparsify(G,q)(G,q)(G,q) draws qqq edges independently with replacement, the edge eee with probability pe=weRe/∑fwfRfp_e=w_eR_e/\sum_f w_fR_fpe​=we​Re​/∑f​wf​Rf​, and gives eee the weight we/(qpe)w_e/(qp_e)we​/(qpe​) for each time it is drawn. Its output HHH has Laplacian L~=BTW1/2SW1/2B\tilde L=B^{\mathsf T}W^{1/2}SW^{1/2}BL~=BTW1/2SW1/2B, where SSS is the random diagonal matrix with S(e,e)=#{draws of e}/(qpe)S(e,e)=\#\{\text{draws of }e\}/(qp_e)S(e,e)=#{draws of e}/(qpe​).

Formalization targets

Goal: Theorem 1

There are an absolute constant CCC and a threshold N0N_0N0​ such that, for every n≥N0n\ge N_0n≥N0​, every connected weighted graph on nnn vertices and every 1/n<ε≤11/\sqrt n<\varepsilon\le11/n​<ε≤1, with q=⌈9C2nlog⁡n/ε2⌉q=\lceil 9C^2n\log n/\varepsilon^2\rceilq=⌈9C2nlogn/ε2⌉, with probability at least 1/21/21/2

∀x∈Rn:(1−ε) xTLx  ≤  xTL~x  ≤  (1+ε) xTLx.\forall x\in\mathbb R^n:\qquad (1-\varepsilon)\,x^{\mathsf T}Lx\;\le\;x^{\mathsf T}\tilde Lx\;\le\;(1+\varepsilon)\,x^{\mathsf T}Lx .∀x∈Rn:(1−ε)xTLx≤xTL~x≤(1+ε)xTLx.

The constant CCC is left unfixed; the statement asserts the shape q=O(nlog⁡n/ε2)q=O(n\log n/\varepsilon^2)q=O(nlogn/ε2) with the paper's explicit dependence on CCC.

Milestones

  1. Lemma 3 (four parts): Π\PiΠ is an orthogonal projection; im⁡Π=im⁡W1/2B\operatorname{im}\Pi=\operatorname{im}W^{1/2}BimΠ=imW1/2B; the eigenvalues of Π\PiΠ are 111 with multiplicity n−1n-1n−1 and 000 with multiplicity m−n+1m-n+1m−n+1; Π(e,e)=∥Π(⋅,e)∥2\Pi(e,e)=\|\Pi(\cdot,e)\|^2Π(e,e)=∥Π(⋅,e)∥2.
  2. Lemma 4: for a nonnegative diagonal SSS, ∥ΠSΠ−ΠΠ∥2≤ε\|\Pi S\Pi-\Pi\Pi\|_2\le\varepsilon∥ΠSΠ−ΠΠ∥2​≤ε implies (1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx(1-\varepsilon)x^{\mathsf T}Lx\le x^{\mathsf T}B^{\mathsf T}W^{1/2}SW^{1/2}Bx\le(1+\varepsilon)x^{\mathsf T}Lx(1−ε)xTLx≤xTBTW1/2SW1/2Bx≤(1+ε)xTLx for all xxx.
  3. Lemma 5 (Rudelson–Vershynin): for independent samples y1,…,yqy_1,\dots,y_qy1​,…,yq​ of a random vector with ∥y∥2≤M\|y\|_2\le M∥y∥2​≤M and ∥E yyT∥2≤1\|\mathbb E\,yy^{\mathsf T}\|_2\le1∥EyyT∥2​≤1, and q≥2q\ge2q≥2,
E∥1q∑j=1qyjyjT−E yyT∥2≤CMlog⁡qqwhenever the right side is <1.\mathbb E\Big\|\frac1q\sum_{j=1}^q y_jy_j^{\mathsf T}-\mathbb E\,yy^{\mathsf T}\Big\|_2\le CM\sqrt{\frac{\log q}{q}}\quad\text{whenever the right side is }<1.E​q1​j=1∑q​yj​yjT​−EyyT​2​≤CMqlogq​​whenever the right side is <1.

Significance

Theorem 1 says that every weighted graph is spectrally approximated by a reweighted subgraph with O(nlog⁡n/ε2)O(n\log n/\varepsilon^2)O(nlogn/ε2) edges. A spectral approximation preserves cut weights, the eigenvalues of the Laplacian up to 1±ε1\pm\varepsilon1±ε, effective resistances, and the condition number of LLL as a preconditioner, so any algorithm whose output depends on these quantities can run on HHH. Combined with fast approximate computation of effective resistances (the second mission of this series), it gives a nearly-linear-time construction, and it is the sampling step used in Laplacian solvers, in sparsification of sums of rank-one matrices, and in leverage-score sampling for regression, where weRew_eR_ewe​Re​ is exactly the statistical leverage of a row.

The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission formalizes the statement and the paper's proof structure: the linear algebra of Π\PiΠ (Lemma 3), the deterministic reduction from quadratic forms to a spectral-norm bound (Lemma 4), and the matrix concentration inequality (Lemma 5), which is the substantive analytic input and is itself a reusable result about sums of independent rank-one matrices.

Difficulty

The deterministic part is linear algebra over the pseudoinverse. The obstacle is concentration: the expected Laplacian of HHH equals LLL, but bounding the deviation uniformly over all x∈Rnx\in\mathbb R^nx∈Rn is a statement about the spectral norm of a random matrix, and a union bound over a net of directions costs a factor of nnn in the sample count rather than log⁡n\log nlogn. Scalar Chernoff bounds per cut, which suffice for cut sparsifiers, do not give the spectral statement. Lemma 5 is the matrix inequality that removes this loss, and no inequality of this kind (a concentration bound for the spectral norm of a sum of independent random matrices) is in Mathlib.

Formalization scope

All declarations sit in the namespace EffResSparsify.Sampling.

  • Graphs. A structure WGraph V E with orientation maps head, tail : E → V, weights w : E → ℝ, and the fields head e ≠ tail e (no loops) and 0 < w e. Parallel edges are allowed; nothing in §3 uses simplicity. Connectivity is a separate hypothesis on the underlying simple graph and includes V≠∅V\ne\emptysetV=∅. In Theorem 1 the vertex type is Fin n; the edge type is an arbitrary finite type.
  • Pseudoinverse. L+L^{+}L+ is the matrix of the published Moore–Penrose pseudoinverse HarmonicGames.Decomposition.pinv of x↦Lxx\mapsto Lxx↦Lx on Euclidean RV\mathbb R^VRV; it equals the spectral formula above and is the gauge-fixed inverse, never "some solution of Lx=yLx=yLx=y".
  • Sampling. pep_epe​ is defined as weRe/∑fwfRfw_eR_e/\sum_f w_fR_fwe​Re​/∑f​wf​Rf​; the identity ∑fwfRf=n−1\sum_f w_fR_f=n-1∑f​wf​Rf​=n−1 is part of the proof. An outcome of Sparsify is a sequence in EqE^qEq with probability ∏ipsi\prod_i p_{s_i}∏i​psi​​, and probabilities and expectations are finite sums over EqE^qEq, with no measure theory.
  • Norms and logarithms. ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is the ℓ2\ell_2ℓ2​ operator norm on matrices (Matrix.Norms.L2Operator); vector norms in Lemma 5 are Euclidean; log⁡\loglog is natural (the base is absorbed into CCC).
  • Constants. In Theorem 1, ∃C>0, ∃N0, ∀n≥N0\exists C>0,\ \exists N_0,\ \forall n\ge N_0∃C>0, ∃N0​, ∀n≥N0​ precede the graph and ε\varepsilonε; the sample count is ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, rounded up because the printed value is not an integer. In Lemma 5, ∃C>0\exists C>0∃C>0 precedes the dimension, the distribution, MMM and qqq.
  • Corrected statement. Lemma 5 as printed, with right side min⁡(CMlog⁡q/q,1)\min(CM\sqrt{\log q/q},1)min(CMlogq/q​,1), is false (at q=1q=1q=1 the bound is 000). The formal milestone is Rudelson and Vershynin's own Theorem 3.1: q≥2q\ge2q≥2, and the bound a=CMlog⁡q/qa=CM\sqrt{\log q/q}a=CMlogq/q​ holds when a<1a<1a<1. It is stated for finitely supported distributions, which is all Theorem 1 uses. Theorem 1 applies it with a≤ε/2a\le\varepsilon/2a≤ε/2, so the correction does not affect the goal.
  • Not a trivialization. Theorem 1 does not take Lemma 5, a bound on E∥ΠSΠ−Π∥2\mathbb E\|\Pi S\Pi-\Pi\|_2E∥ΠSΠ−Π∥2​, or a free sample count as a hypothesis; a statement with any of these, or with "∃q\exists q∃q" in place of ⌈9C2nlog⁡n/ε2⌉\lceil 9C^2n\log n/\varepsilon^2\rceil⌈9C2nlogn/ε2⌉, is a different theorem.

Reusable beyond this mission: the weighted Laplacian with its pseudoinverse and effective resistances, and Lemma 5, which applies to any sampling scheme for sums of rank-one matrices (leverage-score sampling, column subset selection). Contributions toward a matrix Chernoff or Rudelson-type inequality in Mathlib are welcome.

Selected references

  • D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
  • M. Rudelson, R. Vershynin, Sampling from large matrices: an approach through geometric functional analysis, J. ACM 54(4), 2007. https://doi.org/10.1145/1255443.1255449
  • M. Rudelson, Random vectors in the isotropic position, J. Funct. Anal. 164(1), 1999. https://doi.org/10.1006/jfan.1998.3384
  • A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
  • D. A. Spielman, S.-H. Teng, Spectral sparsification of graphs, SIAM J. Comput. 40(4), 2011 (arXiv:0808.4134). https://arxiv.org/abs/0808.4134
  • J. Batson, D. A. Spielman, N. Srivastava, Twice-Ramanujan sparsifiers, SIAM J. Comput. 41(6), 2012 (arXiv:0808.0163). https://arxiv.org/abs/0808.0163
9 thms1 active userReviewed
Mathematical PhysicsProbability·Captain: marwahaha

All-temperature pressure for orthogonally invariant Ising spin glassesOpen Problem

Motivation

An Ising spin system probes a quadratic form only on cube vertices. The source asks whether random orthogonal eigenvectors allow its pressure to be determined by the limiting eigenvalue distribution at every positive temperature. The source is OpenAI's September 2026 manuscript.

Setting

The pressure is the normalized logarithm of the average Boltzmann weight under the uniform spin prior. Eigenvectors are Haar orthogonal, and the deterministic empirical eigenvalue laws converge weakly to a compactly supported probability law. The variational formula uses an edge-extended spectral transform.

Formalization targets

EPN(β)→Vβ,PN(β)→Vβ almost surely(β>0).\mathbb E P_N(\beta)\to\mathcal V_\beta,\qquad P_N(\beta)\to\mathcal V_\beta\ \text{almost surely}\qquad(\beta>0).EPN​(β)→Vβ​,PN​(β)→Vβ​ almost surely(β>0).

For a spin system on N Ising spins σ ∈ {−1,1}^N, the rotated pressure for eigenvalues λ₁,…,λ_N, an orthogonal rotation U and a field c is (1/N) times the log of the average over all 2^N spin configurations of exp(H(σ)), where H(σ) = (1/2)∑ᵢ λᵢ (Uσ)ᵢ² + ∑ᵢ cᵢσᵢ. The theorem states that, for any probability space (Ω,P), random N×N orthogonal matrices U_N that are measurable and whose laws are right-invariant under multiplication (Haar-type), and any deterministic eigenvalue arrays (eig_N,i), the following holds under these assumptions: ν is a probability measure on ℝ whose support lies in [a,b] and contains both a and b; for every ε>0, eventually in N all eigenvalues lie in [a−ε,b+ε]; the empirical spectral laws (1/N)∑ᵢ δ_{eig_N,i} converge weakly to ν; and the inverse temperature β is strictly positive. Then, with eigenvalues β·eig_N,i, rotation U_N(ω)⁻¹ and zero external field, the expected rotated pressure ∫ pressure dP converges as N → ∞, and the pressure itself converges for P-almost every ω, in both cases to the real part of the variational functional of the measureR transform of the β-rescaled law of ν, evaluated at the edge β·b.

The goal is OAI.InvariantIsing.positive_temperature_pressure_unconditional. Supporting targets are listed below; they retain their individual hypotheses and are separate statements.

  • gaussianPattern ground limit unconditional.
  • gaussianPattern norm limits unconditional.
  • gaussianPattern pressure limit unconditional.
  • ground state limit unconditional.
  • limiting pressure of extreme limits unconditional.
  • limiting wasserstein field pressure of extreme limits unconditional.
  • random field pressure tendsto ae unconditional.
  • random pressure limit unconditional.
  • random pressure tendsto ae unconditional.
  • random pressure tendsto in measure unconditional.

Significance

The selected goal is the all-positive-temperature zero-field pressure theorem. The attached results also cover field laws, random spectra, Gaussian-pattern pressure and ground energy, and related norm limits under their stated assumptions. The manuscript presents a mathematical argument; the attached goal currently has status Open, so the requested contribution is a Lean proof of the displayed formal target.

Difficulty

Weak spectral convergence does not control rare extreme eigenvalues. The explicit no-outlier condition is essential to the selected statement’s comparison with the limiting spectral functional.

Formalization scope

The spin prior is uniform probability, and temperature is implemented by multiplying eigenvalues by β\betaβ. The no-outlier condition holds eventually within every enlargement of the limiting support interval. Almost-sure convergence and expectation convergence are both conclusions; other attached variants keep their own uniform-integrability and field hypotheses.

The shared definitions are supplied by InvariantIsing. The target uses Lean 4.33.1 with the pinned Mathlib environment. Contributions should preserve the existing statement and develop reusable supporting lemmas in its definitions.

Selected references

  • OpenAI, All-temperature pressure for orthogonally invariant Ising spin glasses, preprint, September 2026. Manuscript.
  • OpenAI, accompanying Lean statement. Pinned source.
12 thms1 active userReviewed
AnalysisProbability·Captain: mikedeng1

Phase Transition of the Largest Eigenvalue for Nonnull Complex Sample Covariance Matrices 2: Spikes above 1+γ⁻¹ Give √M Fluctuations of the Largest Eigenvalue with Limit G_k, the k×k GUE LawResearch Paper

Motivation

Sample covariance matrices are the basic object of multivariate statistics: principal component analysis, signal detection and factor models all start from the eigenvalues of S=1M∑k=1My⃗ky⃗k ∗S = \frac1M\sum_{k=1}^M \vec y_k \vec y_k^{\,*}S=M1​∑k=1M​y​k​y​k∗​ computed from MMM samples of an NNN-dimensional vector. When NNN is comparable to MMM, the eigenvalues of SSS no longer approximate those of the population covariance Σ\SigmaΣ. The question is then whether a few large population eigenvalues ("spikes") are visible in the sample spectrum at all, and how the top sample eigenvalue fluctuates when they are.

Baik, Ben Arous and Péché (Ann. Probab. 33 (2005) 1643–1697) answered this for complex Gaussian samples. They found a sharp threshold 1+γ−11+\gamma^{-1}1+γ−1, where γ2=M/N\gamma^2 = M/Nγ2=M/N, now called the BBP phase transition. This mission formalizes the supercritical half of the answer, Theorem 1.1(b).

Timeline.

  • 2000–2001: Johansson (Comm. Math. Phys. 209, 2000) and Johnstone (Ann. Statist. 29) proved that for Σ=I\Sigma = IΣ=I the largest eigenvalue, centred at (1+γ−1)2(1+\gamma^{-1})^2(1+γ−1)2 and scaled by M2/3M^{2/3}M2/3, has the Tracy–Widom law. Johansson treated the complex case, Johnstone the real case.
  • 2005: Baik, Ben Arous and Péché treated Σ\SigmaΣ with finitely many eigenvalues different from 111. Spikes at or below 1+γ−11+\gamma^{-1}1+γ−1 give M2/3M^{2/3}M2/3 fluctuations with limit laws FkF_kFk​ (part (a), a separate mission of this series). Spikes above 1+γ−11+\gamma^{-1}1+γ−1 give M\sqrt MM​ fluctuations with limit GkG_kGk​ (part (b)).
  • 2006: Baik and Silverstein (J. Multivariate Anal. 97) located the outlying eigenvalue for general, non-Gaussian samples. Bai and Yao (Ann. IHP 44, 2008) obtained Gaussian fluctuations of the outliers for general samples.

Setting

Let gkjg_{kj}gkj​, 1≤k≤M1 \le k \le M1≤k≤M, 1≤j≤N1 \le j \le N1≤j≤N, be independent standard complex Gaussians: g=a+ibg = a + ibg=a+ib with a,ba, ba,b independent real normal variables of mean 000 and variance 1/21/21/2. Fix a unitary matrix UUU and positive population eigenvalues ℓ1,…,ℓN\ell_1, \dots, \ell_Nℓ1​,…,ℓN​. The samples are

y⃗k=U diag(ℓ1,…,ℓN) g⃗k,\vec y_k = U\,\mathrm{diag}(\sqrt{\ell_1},\dots,\sqrt{\ell_N})\,\vec g_k,y​k​=Udiag(ℓ1​​,…,ℓN​​)g​k​,

which are independent mean-zero complex Gaussian vectors with covariance Σ=U diag(ℓ) U∗\Sigma = U\,\mathrm{diag}(\ell)\,U^*Σ=Udiag(ℓ)U∗. The sample covariance matrix is S=1M∑ky⃗ky⃗k ∗S = \frac1M\sum_k \vec y_k\vec y_k^{\,*}S=M1​∑k​y​k​y​k∗​, and λ1\lambda_1λ1​ is its largest eigenvalue.

The regime has M,N→∞M, N \to \inftyM,N→∞ with M/N=γ2M/N = \gamma^2M/N=γ2 and γ\gammaγ in a compact subset of [1,∞)[1,\infty)[1,∞). A fixed number rrr of the ℓj\ell_jℓj​ differ from 111. For some 1≤k≤r1 \le k \le r1≤k≤r the top kkk coincide, ℓ1=⋯=ℓk\ell_1 = \cdots = \ell_kℓ1​=⋯=ℓk​, with common value in a compact subset of (1+γ−1,∞)(1+\gamma^{-1},\infty)(1+γ−1,∞). The others, ℓk+1,…,ℓr\ell_{k+1},\dots,\ell_rℓk+1​,…,ℓr​, lie in a compact subset of (0,ℓ1)(0,\ell_1)(0,ℓ1​).

The limit law is the finite GUE distribution. Let Zk=∫Rk∏i<j∣ξi−ξj∣2∏ie−ξi2/2 dξZ_k = \int_{\mathbb R^k}\prod_{i<j}|\xi_i-\xi_j|^2\prod_i e^{-\xi_i^2/2}\,d\xiZk​=∫Rk​∏i<j​∣ξi​−ξj​∣2∏i​e−ξi2​/2dξ. Then

Gk(x)=1Zk∫(−∞,x]k∏1≤i<j≤k∣ξi−ξj∣2∏i=1ke−ξi2/2 dξ1⋯dξk,G_k(x) = \frac1{Z_k}\int_{(-\infty,x]^k}\prod_{1\le i<j\le k}|\xi_i-\xi_j|^2\prod_{i=1}^k e^{-\xi_i^2/2}\,d\xi_1\cdots d\xi_k,Gk​(x)=Zk​1​∫(−∞,x]k​1≤i<j≤k∏​∣ξi​−ξj​∣2i=1∏k​e−ξi2​/2dξ1​⋯dξk​,

which is the law of the largest eigenvalue of a k×kk\times kk×k Gaussian unitary ensemble matrix (Definition 1.2).

Formalization targets

Goal: Theorem 1.1(b)

P((λ1−(ℓ1+ℓ1γ−2ℓ1−1))⋅Mℓ12−ℓ12γ−2/(ℓ1−1)2≤x)⟶Gk(x)for every x∈R.\mathbb P\left(\Big(\lambda_1 - \Big(\ell_1 + \frac{\ell_1\gamma^{-2}}{\ell_1-1}\Big)\Big)\cdot\frac{\sqrt M}{\sqrt{\ell_1^2 - \ell_1^2\gamma^{-2}/(\ell_1-1)^2}} \le x\right) \longrightarrow G_k(x)\qquad\text{for every } x \in \mathbb R.P((λ1​−(ℓ1​+ℓ1​−1ℓ1​γ−2​))⋅ℓ12​−ℓ12​γ−2/(ℓ1​−1)2​M​​≤x)⟶Gk​(x)for every x∈R.

Companion: Corollary 1.1(b)

λ1−ℓ1(1+γ−2ℓ1−1)⟶0in probability.\lambda_1 - \ell_1\Big(1 + \frac{\gamma^{-2}}{\ell_1-1}\Big) \longrightarrow 0 \quad\text{in probability.}λ1​−ℓ1​(1+ℓ1​−1γ−2​)⟶0in probability.

Milestones

The milestones follow the proof in §4, in attack order:

  • the critical points of the phase fff, (218)–(219);
  • the contour estimates, Lemmas 4.1 and 4.2;
  • the uniform kernel asymptotics, Proposition 4.1;
  • the Hermite-polynomial identities (287), (295), (288) and (292);
  • the closed form (299) of the limiting kernel K2K_2K2​;
  • the Fredholm-determinant representation of GkG_kGk​, Lemma 1.1:
Gk(x)=det⁡(1−Hx(k)),H(k)(u,v)=ck−1ck pk(u)pk−1(v)−pk−1(u)pk(v)u−v e−(u2+v2)/4.G_k(x) = \det\big(1 - \mathbf H^{(k)}_x\big),\qquad H^{(k)}(u,v) = \frac{c_{k-1}}{c_k}\,\frac{p_k(u)p_{k-1}(v) - p_{k-1}(u)p_k(v)}{u-v}\,e^{-(u^2+v^2)/4}.Gk​(x)=det(1−Hx(k)​),H(k)(u,v)=ck​ck−1​​u−vpk​(u)pk−1​(v)−pk−1​(u)pk​(v)​e−(u2+v2)/4.

Here pnp_npn​ are the orthonormal polynomials for the weight e−x2/2e^{-x^2/2}e−x2/2 and cnc_ncn​ their leading coefficients.

Significance

The result. Below the threshold the top eigenvalue sticks to the bulk edge (1+γ−1)2(1+\gamma^{-1})^2(1+γ−1)2. Above it, Theorem 1.1(b) and Corollary 1.1(b) show that λ1\lambda_1λ1​ separates from the bulk to the explicit location ℓ1(1+γ−2/(ℓ1−1))\ell_1(1+\gamma^{-2}/(\ell_1-1))ℓ1​(1+γ−2/(ℓ1​−1)). Its fluctuations shrink from order M−2/3M^{-2/3}M−2/3 to order M−1/2M^{-1/2}M−1/2, and their law is the top eigenvalue of a k×kk\times kk×k GUE, with kkk the multiplicity of the spike. This gives:

  • a detection threshold for spiked signals in high dimension;
  • the centring and scaling of tests based on the top sample eigenvalue;
  • the first instance of a kkk-dependent family of finite-GUE limits in a spiked model.

Formalizing it. The result is proved in the paper and is not open. Nothing in this mission has a machine-checked proof yet. A complete development would include:

  • the first formal statements of the spiked complex Wishart model;
  • the GUE law GkG_kGk​ and its Fredholm representation;
  • a uniform steepest-descent analysis with explicit contours.

The two contour lemmas (4.1, 4.2) and the Hermite identities are elementary and are footholds. Proposition 4.1 and Lemma 1.1 are substantial. The paper does not prove Lemma 1.1 but cites it as a standard result of random matrix theory (its references [28, 41]).

Difficulty

The obvious route is to diagonalise the sample matrix, write down the eigenvalue density and take a limit. That density involves the Harish-Chandra–Itzykson–Zuber integral. Its large-NNN limit is not accessible directly, because the spike enters through a determinant with NNN nearly coincident columns.

The paper instead starts from an exact Fredholm-determinant formula (Proposition 2.1, posed in mission 1 of this series). In it the kernel factors into two contour integrals H\mathcal HH and J\mathcal JJ with phase f(z)=−μ(z−q)+log⁡z−γ−2log⁡(1−z)f(z) = -\mu(z-q) + \log z - \gamma^{-2}\log(1-z)f(z)=−μ(z−q)+logz−γ−2log(1−z). Above the threshold the two factors are governed by different points. J\mathcal JJ has a nondegenerate saddle at π1=ℓ1−1\pi_1 = \ell_1^{-1}π1​=ℓ1−1​. For H\mathcal HH the natural saddle 1/(μπ1)1/(\mu\pi_1)1/(μπ1​) lies beyond the pole at π1\pi_1π1​, so the contour must be deformed through a pole of order kkk, and the leading term is a residue rather than a saddle contribution. The estimates must hold uniformly in γ\gammaγ and in the remaining spikes, and the convergence must be strong enough (Hilbert–Schmidt) to pass to Fredholm determinants.

Formalization scope

Model. Complex Gaussian samples with mean zero and no centring. S=1M∑ky⃗ky⃗k ∗S = \frac1M\sum_k\vec y_k\vec y_k^{\,*}S=M1​∑k​y​k​y​k∗​, with the factor 1/M1/M1/M. Σ=U diag(ℓ) U∗\Sigma = U\,\mathrm{diag}(\ell)\,U^*Σ=Udiag(ℓ)U∗ for every unitary UUU. This is the model of the paper's (59), (61) and Proposition 2.1; the introduction's mentions of 1/N1/N1/N, of centring and of the real density (1) are inconsistent with those formulas. λ1\lambda_1λ1​ is the supremum of the eigenvalues of the Hermitian matrix SSS, and probabilities are measures of sets of sample arrays.

Regime. The regime is in sequence form:

  • Nn→∞N_n \to \inftyNn​→∞ and γn=Mn/Nn∈[1,γ0]\gamma_n = \sqrt{M_n/N_n} \in [1,\gamma_0]γn​=Mn​/Nn​​∈[1,γ0​];
  • 1+γn−1+c≤ℓ1=⋯=ℓk≤C1+\gamma_n^{-1}+c \le \ell_1 = \cdots = \ell_k \le C1+γn−1​+c≤ℓ1​=⋯=ℓk​≤C;
  • c≤ℓj≤ℓ1−cc \le \ell_j \le \ell_1 - cc≤ℓj​≤ℓ1​−c for k<j≤rk < j \le rk<j≤r;
  • ℓj=1\ell_j = 1ℓj​=1 for j>rj > rj>r.

The fixed margins c,Cc, Cc,C encode the compact subsets whose open ends move with γ\gammaγ. Convergence is pointwise in xxx.

Analytic conventions.

  • The Fredholm determinant is the Fredholm series ∑n(−1)nn!∫(x,∞)ndet⁡[K(ui,uj)]\sum_n\frac{(-1)^n}{n!}\int_{(x,\infty)^n}\det[K(u_i,u_j)]∑n​n!(−1)n​∫(x,∞)n​det[K(ui​,uj​)].
  • H(k)H^{(k)}H(k) takes its continuous diagonal value.
  • pn=Hen/((2π)1/4n!)p_n = \mathrm{He}_n/((2\pi)^{1/4}\sqrt{n!})pn​=Hen​/((2π)1/4n!​) with Mathlib's probabilists' Hermite polynomials, equal to the paper's (31).
  • The closed contours Γ\GammaΓ, Σ\SigmaΣ in H\mathcal HH, J\mathcal JJ are explicit circles satisfying the paper's constraints.
  • Σ∞\Sigma_\inftyΣ∞​ is the imaginary axis.
  • Residues of a−kφ(a)a^{-k}\varphi(a)a−kφ(a) are Taylor coefficients.

Ruled-out trivialisations. Five shortcuts would make the statements trivial, and none is available:

  • division by zero on the kernel diagonal is replaced by the diagonal value;
  • the Fredholm series is shown to be 111 on the zero kernel, so it is not identically junk;
  • the conditionally convergent real form of contour integrals is not used;
  • Σ\SigmaΣ is not specialised to a diagonal matrix;
  • the regime is shown satisfiable in a sorry-free check.

Infrastructure. The needed infrastructure is the complex Wishart model, eigenvalues of random Hermitian matrices, Fredholm determinants of integral operators, and contour integrals with uniform estimates. The Hermite and Fredholm layers can be reused for any orthogonal-polynomial ensemble. Contributions welcome:

  • proofs of the elementary milestones ((218)–(219), (287), (295), (288), (292), (299), Lemmas 4.1, 4.2);
  • Lemma 1.1 via Christoffel–Darboux and Andréief;
  • the operator-theoretic step from Hilbert–Schmidt convergence of kernels to convergence of Fredholm series.

Selected references

  • J. Baik, G. Ben Arous, S. Péché, Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices, Ann. Probab. 33(5) (2005) 1643–1697. https://doi.org/10.1214/009117905000000233
  • K. Johansson, Shape fluctuations and random matrices, Comm. Math. Phys. 209 (2000) 437–476. https://doi.org/10.1007/s002200050027
  • I. M. Johnstone, On the distribution of the largest eigenvalue in principal components analysis, Ann. Statist. 29 (2001) 295–327. https://doi.org/10.1214/aos/1009210544
  • J. Baik, J. W. Silverstein, Eigenvalues of large sample covariance matrices of spiked population models, J. Multivariate Anal. 97 (2006) 1382–1408. https://doi.org/10.1016/j.jmva.2005.08.003
  • Z. Bai, J. Yao, Central limit theorems for eigenvalues in a spiked population model, Ann. Inst. H. Poincaré Probab. Statist. 44 (2008) 447–474. https://doi.org/10.1214/07-AIHP118
15 thms1 active userReviewed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Phase Transition of the Largest Eigenvalue for Nonnull Complex Sample Covariance Matrices 4: The Exponential Last Passage Time Has the Law of the Largest Sample EigenvalueResearch Paper

Motivation

Random growth models and random matrices share limit laws. The first exact instance was found by Johansson (Shape fluctuations and random matrices, Comm. Math. Phys. 2000), who showed that the last passage time of a lattice model with geometric or exponential weights has the law of the largest eigenvalue of a Laguerre (complex Wishart) random matrix. Baik, Ben Arous and Péché (Ann. Probab. 33 (2005)) extended the identity to weights whose rate depends on the row. On the matrix side this is a sample covariance matrix with a general population covariance Σ\SigmaΣ; on the growth side it is a corner growth model, or a series of exponential queues, with inhomogeneous service rates.

The identity is the reason the paper's main result, the phase transition of the largest sample eigenvalue as a few population eigenvalues ("spikes") cross the critical value 1+γ−11 + \gamma^{-1}1+γ−1, is also a theorem about last passage percolation and tandem queues. In the queueing reading, a spike is a slow server, and the phase transition describes how slow a few servers must be before they change the centring and the fluctuation scale of the exit time.

Timeline:

  • 2000, Johansson: equal rates; the geometric and exponential last passage time has the law of the largest Laguerre eigenvalue (his Proposition 1.4 is the case π1=⋯=πN\pi_1 = \cdots = \pi_Nπ1​=⋯=πN​ of (307)).
  • 2001, Baryshnikov and, independently, Gravner, Tracy and Widom: the tandem-queue and GUE-minor descriptions of the same object.
  • 2005, Baik, Ben Arous and Péché: row-dependent rates πi\pi_iπi​ (Proposition 6.1), via the Robinson–Schensted–Knuth (RSK) formula for geometric weights (310) and a scaling limit.

Setting

Last passage time. Attach a real weight X(i,j)X(i,j)X(i,j) to every site of the grid {1,…,N}×{1,…,M}\{1,\ldots,N\}\times\{1,\ldots,M\}{1,…,N}×{1,…,M}. An up/right path from (1,1)(1,1)(1,1) to (N,M)(N,M)(N,M) is a sequence of N+M−1N+M-1N+M−1 sites starting at (1,1)(1,1)(1,1), ending at (N,M)(N,M)(N,M), each step adding (1,0)(1,0)(1,0) or (0,1)(0,1)(0,1). The last passage time is

L(N,M)=max⁡π:(1,1)↗(N,M)∑(i,j)∈πX(i,j).(306)L(N,M) = \max_{\pi:(1,1)\nearrow(N,M)} \sum_{(i,j)\in\pi} X(i,j). \qquad (306)L(N,M)=π:(1,1)↗(N,M)max​(i,j)∈π∑​X(i,j).(306)

Exponential environment. Given positive numbers π1,…,πN\pi_1,\ldots,\pi_Nπ1​,…,πN​, the X(i,j)X(i,j)X(i,j) are independent and X(i,j)X(i,j)X(i,j) is exponential of mean 1/(πiM)1/(\pi_iM)1/(πi​M), i.e. density πiMe−πiMx\pi_iMe^{-\pi_iMx}πi​Me−πi​Mx on x≥0x\ge0x≥0. All MMM sites of row iii share one rate.

Sample covariance matrix. Let gkjg_{kj}gkj​, 1≤k≤M1\le k\le M1≤k≤M, 1≤j≤N1\le j\le N1≤j≤N, be independent standard complex Gaussians (real and imaginary parts independent N(0,1/2)N(0,1/2)N(0,1/2)). For a unitary UUU and ℓj=πj−1\ell_j = \pi_j^{-1}ℓj​=πj−1​ (308), the samples y⃗k=U diag(ℓj) gk\vec y_k = U\,\mathrm{diag}(\sqrt{\ell_j})\,g_ky​k​=Udiag(ℓj​​)gk​ are mean-zero complex Gaussian vectors with covariance Σ=U diag(ℓ) U∗\Sigma = U\,\mathrm{diag}(\ell)\,U^*Σ=Udiag(ℓ)U∗, and

S=1M∑k=1My⃗ky⃗k ∗,λ1=largest eigenvalue of S.S = \frac1M\sum_{k=1}^M \vec y_k\vec y_k^{\,*}, \qquad \lambda_1 = \text{largest eigenvalue of } S.S=M1​k=1∑M​y​k​y​k∗​,λ1​=largest eigenvalue of S.

Schur functions and geometric weights. For a partition λ\lambdaλ, the Schur function sλ(x)s_\lambda(x)sλ​(x) is the sum over semistandard Young tableaux TTT of shape λ\lambdaλ of ∏cxT(c)\prod_{c}x_{T(c)}∏c​xT(c)​. A geometric variable of parameter q∈[0,1)q\in[0,1)q∈[0,1) has P(Y=k)=(1−q)qk\mathbb P(Y = k) = (1-q)q^kP(Y=k)=(1−q)qk.

Formalization targets

Goal: Proposition 6.1

For 1≤N≤M1\le N\le M1≤N≤M, positive π1,…,πN\pi_1,\ldots,\pi_Nπ1​,…,πN​ and every unitary UUU,

P(L(N,M)≤x)=P(λ1(M,N)≤x)for all x∈R.(309)\mathbb P\big(L(N,M)\le x\big) = \mathbb P\big(\lambda_1(M,N)\le x\big) \qquad \text{for all } x\in\mathbb R. \qquad (309)P(L(N,M)≤x)=P(λ1​(M,N)≤x)for all x∈R.(309)

The two sides are defined independently: one by a maximum over lattice paths of exponential weights, the other by the spectrum of a Gaussian random matrix.

Milestones

  1. The recurrence (313): for every array of weights and every site with a,b≥2a, b\ge2a,b≥2,
L(a,b)=max⁡{L(a−1,b),L(a,b−1)}+X(a,b).L(a,b) = \max\{L(a-1,b), L(a,b-1)\} + X(a,b).L(a,b)=max{L(a−1,b),L(a,b−1)}+X(a,b).
  1. The Cauchy identity (311): ∑λsλ(x)sλ(y)=∏i,j(1−xiyj)−1\sum_\lambda s_\lambda(x)s_\lambda(y) = \prod_{i,j}(1-x_iy_j)^{-1}∑λ​sλ​(x)sλ​(y)=∏i,j​(1−xi​yj​)−1 for xi,yj≥0x_i,y_j\ge0xi​,yj​≥0, xiyj<1x_iy_j<1xi​yj​<1.
  2. The geometric formula (310): for independent geometric weights Y(i,j)Y(i,j)Y(i,j) of parameter xiyjx_iy_jxi​yj​, xi,yj∈[0,1)x_i,y_j\in[0,1)xi​,yj​∈[0,1),
P(G(N,M)≤n)=∏i,j(1−xiyj)∑λ:λ1≤nsλ(x)sλ(y).\mathbb P\big(G(N,M)\le n\big) = \prod_{i,j}(1-x_iy_j)\sum_{\lambda:\lambda_1\le n}s_\lambda(x)s_\lambda(y).P(G(N,M)≤n)=i,j∏​(1−xi​yj​)λ:λ1​≤n∑​sλ​(x)sλ​(y).
  1. The exponential formula (307): for M≥NM\ge NM≥N and distinct πi\pi_iπi​,
P(L(N,M)≤x)=1C∫[0,x]Ndet⁡(e−Mπiξj)V(π)V(ξ)∏jξjM−N dξ.\mathbb P\big(L(N,M)\le x\big) = \frac1C\int_{[0,x]^N}\frac{\det(e^{-M\pi_i\xi_j})}{V(\pi)}V(\xi)\prod_{j}\xi_j^{M-N}\,d\xi.P(L(N,M)≤x)=C1​∫[0,x]N​V(π)det(e−Mπi​ξj​)​V(ξ)j∏​ξjM−N​dξ.

Significance

The proposition makes every distributional statement about λ1\lambda_1λ1​ in the paper a statement about last passage percolation with row-dependent rates: the FkF_kFk​ (generalised Tracy–Widom) fluctuations at the critical spike value, the Gaussian fluctuations above it, and the fixed-dimension limit. Through (312)–(313) it also covers the exit time of MMM customers from NNN exponential servers in series, an operations research object. The geometric formula (310) is the entry point of the RSK method for exactly solvable growth models.

These results are proved in the literature; the paper cites (310) and (311) and derives (307) from them by a limit. None of them is machine-checked as far as this series knows. Formalizing them requires a Lean development of Schur functions, the Cauchy identity and the RSK correspondence on matrices with nonnegative integer entries, and of the Wishart eigenvalue density, each reusable well beyond this mission.

Difficulty

The recurrence (313) is elementary. Everything else is not. The geometric formula (310) needs the RSK bijection between nonnegative integer matrices and pairs of semistandard tableaux of the same shape, together with Schensted's theorem that the first row of the shape is the last passage time; neither is in Mathlib. The passage from (310) to (307) is a scaling limit xi=1−Mπi/Lx_i = 1 - M\pi_i/Lxi​=1−Mπi​/L, n=xLn = xLn=xL, L→∞L\to\inftyL→∞, in which a sum over partitions must converge to a multiple integral. The matrix side needs the joint eigenvalue density of a complex Wishart matrix with general Σ\SigmaΣ, which uses the Harish-Chandra–Itzykson–Zuber integral. A direct coupling of the two sides is not known; the identity is an equality of laws, proved by computing both.

Formalization scope

The development lives in the namespace SpikedWishart.LastPassage. Conventions:

  • Sites and indices are 0-based; the paper's (1,1)(1,1)(1,1) and (N,M)(N,M)(N,M) are (0,0)(0,0)(0,0) and (N−1,M−1)(N-1,M-1)(N−1,M−1), and N,M≥1N, M\ge1N,M≥1.
  • LLL is defined as the maximum over paths (306), never by the recurrence (313), so (313) is a genuine statement.
  • The exponential law is Mathlib's expMeasure with rate πiM\pi_iMπi​M.
  • The sample model is mean zero, uncentred, with factor 1/M1/M1/M and E∣g∣2=1\mathbb E|g|^2 = 1E∣g∣2=1; this is the model of (59), (61) and (307), and the page's centring by the sample mean and S=(1/N)XX∗S = (1/N)XX^*S=(1/N)XX∗ are printed slips. The covariance is U diag(π−1)U∗U\,\mathrm{diag}(\pi^{-1})U^*Udiag(π−1)U∗ for every unitary UUU; specialising to diagonal Σ\SigmaΣ would prove a special case.
  • N≤MN\le MN≤M is a disclosed addition to the goal, matching the page's "for M≥NM\ge NM≥N" in (307).
  • Proposition 6.1 prints L(M,N)L(M,N)L(M,N); the object is (306)'s L(N,M)L(N,M)L(N,M).
  • Schur functions are the tableau sum with variables extended by zero. The Cauchy identity is stated with the exponent −1-1−1 that the page omits. In (307) the constant CCC is the integral of the same integrand over (0,∞)N(0,\infty)^N(0,∞)N, and the πi\pi_iπi​ are distinct so that V(π)≠0V(\pi)\ne0V(π)=0; the goal has no distinctness hypothesis.

A formalization in which either side of (309) is defined through the other, or through (307), would be trivial and is excluded: both laws are defined from scratch. Contributions are welcome on RSK and Schur function infrastructure, on the Wishart density, and on the measurability of λ1\lambda_1λ1​.

Selected references

  • J. Baik, G. Ben Arous, S. Péché, Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices, Ann. Probab. 33(5):1643–1697, 2005. https://doi.org/10.1214/009117905000000233
  • K. Johansson, Shape fluctuations and random matrices, Comm. Math. Phys. 209:437–476, 2000. https://doi.org/10.1007/s002200050027
  • Y. Baryshnikov, GUEs and queues, Probab. Theory Related Fields 119:256–274, 2001. https://doi.org/10.1007/PL00008760
  • J. Gravner, C. A. Tracy, H. Widom, Limit theorems for height fluctuations in a class of discrete space and time growth models, J. Stat. Phys. 102:1085–1132, 2001. https://doi.org/10.1023/A:1004879725949
  • R. P. Stanley, Enumerative Combinatorics, Vol. 2, Cambridge University Press, 1999 (the paper's reference [36] for the Cauchy identity). https://doi.org/10.1017/CBO9780511609589
9 thms1 active userReviewed
AnalysisProbability·Captain: mikedeng1

Phase Transition of the Largest Eigenvalue for Nonnull Complex Sample Covariance Matrices 1: Spikes at or below 1+γ⁻¹ Give M^{2/3} Fluctuations of the Largest Eigenvalue with Limit F_kResearch Paper

Motivation

Sample covariance matrices are the basic object of multivariate statistics: principal component analysis, factor models and signal detection all start from the eigenvalues of S=1M∑k=1My⃗ky⃗k ∗S=\frac1M\sum_{k=1}^M\vec y_k\vec y_k^{\,*}S=M1​∑k=1M​y​k​y​k∗​ built from MMM observations of NNN variables. When NNN is comparable to MMM, the largest eigenvalue λ1\lambda_1λ1​ of SSS is no longer a consistent estimate of the largest population eigenvalue, and the question of when a "spike" in the population covariance is visible in λ1\lambda_1λ1​ becomes a question about the law of λ1\lambda_1λ1​ at large M,NM,NM,N.

Timeline.

  • 2000–2001: for null covariance Σ=I\Sigma=IΣ=I, Johansson (complex samples, arXiv:math/9903134) and Johnstone (real samples, doi:10.1214/aos/1009210544) showed that λ1\lambda_1λ1​, centred at (1+γ−1)2(1+\gamma^{-1})^2(1+γ−1)2 and scaled by M2/3M^{2/3}M2/3, converges to a Tracy–Widom law.
  • 2003: Péché (reference [31] of the 2005 paper) showed that finitely many population eigenvalues below 222 (at M=NM=NM=N) leave this limit unchanged.
  • 2005: Baik, Ben Arous and Péché (doi:10.1214/009117905000000233), for complex Gaussian samples, located the threshold exactly at 1+γ−11+\gamma^{-1}1+γ−1 and identified the limit laws on both sides and at the threshold. This transition is now called the BBP phase transition.

This mission formalizes the critical and subcritical side of that transition, Theorem 1.1(a) of the 2005 paper.

Setting

Let g=a+ibg=a+ibg=a+ib with a,ba,ba,b independent real normal variables of mean 000 and variance 1/21/21/2: a standard complex Gaussian. Let G=(gkj)G=(g_{kj})G=(gkj​), 1≤k≤M1\le k\le M1≤k≤M, 1≤j≤N1\le j\le N1≤j≤N, be i.i.d. standard complex Gaussians. Fix an N×NN\times NN×N unitary matrix UUU and positive reals ℓ1,…,ℓN\ell_1,\dots,\ell_Nℓ1​,…,ℓN​, the population eigenvalues, and put Σ=U diag(ℓ) U∗\Sigma=U\,\mathrm{diag}(\ell)\,U^*Σ=Udiag(ℓ)U∗. The samples are y⃗k=U diag(ℓj) g⃗k\vec y_k=U\,\mathrm{diag}(\sqrt{\ell_j})\,\vec g_ky​k​=Udiag(ℓj​​)g​k​, mean-zero complex Gaussian vectors with covariance Σ\SigmaΣ. The sample covariance matrix is S=1M∑ky⃗ky⃗k ∗S=\frac1M\sum_k\vec y_k\vec y_k^{\,*}S=M1​∑k​y​k​y​k∗​ and λ1\lambda_1λ1​ is its largest eigenvalue. Write γ=M/N≥1\gamma=\sqrt{M/N}\ge1γ=M/N​≥1.

The limit laws are built from the Airy function Ai(u)=12π∫eiua+ia3/3 da\mathrm{Ai}(u)=\frac1{2\pi}\int e^{iua+ia^3/3}\,daAi(u)=2π1​∫eiua+ia3/3da, integrated along a contour from ∞e5iπ/6\infty e^{5i\pi/6}∞e5iπ/6 to ∞eiπ/6\infty e^{i\pi/6}∞eiπ/6, and the Airy kernel

A(u,v)=∫0∞Ai(u+z) Ai(z+v) dz.A(u,v)=\int_0^\infty\mathrm{Ai}(u+z)\,\mathrm{Ai}(z+v)\,dz .A(u,v)=∫0∞​Ai(u+z)Ai(z+v)dz.

For m≥1m\ge1m≥1, s(m)(u)=12π∫eiua+ia3/3(ia)−m das^{(m)}(u)=\frac1{2\pi}\int e^{iua+ia^3/3}(ia)^{-m}\,das(m)(u)=2π1​∫eiua+ia3/3(ia)−mda (with the pole a=0a=0a=0 above the contour) and t(m)(v)=12π∫eiva+ia3/3(−ia)m−1 dat^{(m)}(v)=\frac1{2\pi}\int e^{iva+ia^3/3}(-ia)^{m-1}\,dat(m)(v)=2π1​∫eiva+ia3/3(−ia)m−1da. The Fredholm determinant of a kernel KKK on L2((x,∞))L^2((x,\infty))L2((x,∞)) is its Fredholm series

det⁡(1−K)=∑n≥0(−1)nn!∫(x,∞)ndet⁡[K(ui,uj)]i,j=1n du,\det(1-K)=\sum_{n\ge0}\frac{(-1)^n}{n!}\int_{(x,\infty)^n}\det[K(u_i,u_j)]_{i,j=1}^n\,du ,det(1−K)=n≥0∑​n!(−1)n​∫(x,∞)n​det[K(ui​,uj​)]i,j=1n​du,

and

Fk(x)=det⁡(1−A−∑m=1ks(m)⊗t(m))L2((x,∞)).F_k(x)=\det\Big(1-A-\sum_{m=1}^k s^{(m)}\otimes t^{(m)}\Big)_{L^2((x,\infty))}.Fk​(x)=det(1−A−m=1∑k​s(m)⊗t(m))L2((x,∞))​.

F0F_0F0​ is the GUE Tracy–Widom distribution and F1=FGOE2F_1=F_{\rm GOE}^2F1​=FGOE2​.

Formalization targets

Goal: Theorem 1.1(a)

Fix integers 0≤k≤r0\le k\le r0≤k≤r. Let M,N→∞M,N\to\inftyM,N→∞ with γ∈[1,γ0]\gamma\in[1,\gamma_0]γ∈[1,γ0​], and suppose ℓr+1=⋯=ℓN=1\ell_{r+1}=\dots=\ell_N=1ℓr+1​=⋯=ℓN​=1, ℓ1=⋯=ℓk=1+γ−1\ell_1=\dots=\ell_k=1+\gamma^{-1}ℓ1​=⋯=ℓk​=1+γ−1 and ℓk+1,…,ℓr\ell_{k+1},\dots,\ell_rℓk+1​,…,ℓr​ stay in a compact subset of (0,1+γ−1)(0,1+\gamma^{-1})(0,1+γ−1). Then for every real xxx,

P((λ1−(1+γ−1)2)γ(1+γ)4/3M2/3≤x)→Fk(x).\mathbb P\Big(\big(\lambda_1-(1+\gamma^{-1})^2\big)\frac{\gamma}{(1+\gamma)^{4/3}}M^{2/3}\le x\Big)\to F_k(x).P((λ1​−(1+γ−1)2)(1+γ)4/3γ​M2/3≤x)→Fk​(x).

The goal leaves UUU arbitrary and allows γ\gammaγ to vary inside [1,γ0][1,\gamma_0][1,γ0​] along the sequence. A companion item states Corollary 1.1(a): λ1−(1+γ−1)2→0\lambda_1-(1+\gamma^{-1})^2\to0λ1​−(1+γ−1)2→0 in probability.

Milestones

  1. The Airy equation and the identity of the two forms (11), (12) of the Airy kernel.
  2. Lemma 3.3: FkF_kFk​ is well defined, and s(m)s^{(m)}s(m) has the closed form (203).
  3. The eigenvalue density (61) and Andréief's identity (65).
  4. Hankel's formula (75).
  5. Proposition 2.1: the exact identity P(λ1≤ξ)=det⁡(1−KM,N)L2((ξ,∞))\mathbb P(\lambda_1\le\xi)=\det(1-K_{M,N})_{L^2((\xi,\infty))}P(λ1​≤ξ)=det(1−KM,N​)L2((ξ,∞))​ for a double contour integral kernel.
  6. The double critical point (109), (111) of the phase function f(z)=−μ(z−q)+log⁡z−γ−2log⁡(1−z)f(z)=-\mu(z-q)+\log z-\gamma^{-2}\log(1-z)f(z)=−μ(z−q)+logz−γ−2log(1−z).
  7. The descent Lemmas 3.1 and 3.2 along explicit contour pieces.
  8. Proposition 3.1: convergence of the rescaled contour integrals H,J\mathcal H,\mathcal JH,J at rate M−1/3M^{-1/3}M−1/3 with exponential tails.
  9. The kernel identity (200).

Significance

Theorem 1.1(a) shows that 1+γ−11+\gamma^{-1}1+γ−1 is the exact threshold. Spikes strictly below it do not change the Tracy–Widom limit of λ1\lambda_1λ1​. kkk spikes exactly at it produce a new family of limit laws FkF_kFk​ on the same M2/3M^{2/3}M2/3 scale. Together with part (b), where λ1\lambda_1λ1​ separates and fluctuates on the scale M−1/2M^{-1/2}M−1/2, it gives the first complete description of the transition. It is the reference point for spiked-model results on detection limits in PCA, for the real case (Bloemendal–Virág, Mo) and for finite-rank perturbations of Wigner matrices (Péché, Féral–Péché).

The paper's proof is complete and has been in the literature since 2005. No part of it is machine-checked. The mission produces:

  • a formal statement of the theorem;
  • formal definitions of the Airy function by its contour integral, of the Airy kernel and of Fredholm determinants as Fredholm series;
  • the exact finite-NNN determinantal formula of Proposition 2.1;
  • the uniform steepest-descent estimates;
  • formal statements of the classical identities used along the way (Andréief, Hankel).

Difficulty

The obvious approach is to compute the law of λ1\lambda_1λ1​ from the eigenvalue density, which is explicit (61). It fails because the density is an NNN-fold integral whose integrand is a signed determinant, so no direct limit exists. The paper converts it into a Fredholm determinant of a double contour integral kernel. Two steps then carry the difficulty.

First, the steepest-descent analysis. With kkk spikes at 1+γ−11+\gamma^{-1}1+γ−1, the poles of the integrand sit exactly at the double critical point pc=γ/(γ+1)p_c=\gamma/(\gamma+1)pc​=γ/(γ+1) of the phase function. The contour cannot pass through the critical point and must enclose these poles, so it has to be routed at distance of order M−1/3M^{-1/3}M−1/3 to the left of pcp_cpc​. All estimates must be uniform in γ\gammaγ and in the remaining spikes.

Second, the passage from kernel convergence to convergence of Fredholm determinants. It needs bounds strong enough to control every term of the Fredholm series, which is what the exponential tails in Proposition 3.1 provide. The functions s(m)s^{(m)}s(m) grow polynomially, so even the finiteness of FkF_kFk​ (Lemma 3.3) needs an argument.

Formalization scope

Lean encoding:

  • Samples are mean-zero with E y⃗y⃗ ∗=Σ\mathbb E\,\vec y\vec y^{\,*}=\SigmaEy​y​∗=Σ, S=1M∑ky⃗ky⃗k ∗S=\frac1M\sum_k\vec y_k\vec y_k^{\,*}S=M1​∑k​y​k​y​k∗​, and there is no centring by the sample mean. This is the model of the paper's (59) and Proposition 2.1. The printed text on p. 1645 differs in three slips.
  • Σ=U diag(ℓ) U∗\Sigma=U\,\mathrm{diag}(\ell)\,U^*Σ=Udiag(ℓ)U∗ ranges over every unitary UUU.
  • λ1\lambda_1λ1​ is the largest eigenvalue of the Hermitian matrix SSS.
  • The asymptotic regime is written with sequences Mn,NnM_n,N_nMn​,Nn​, Nn→∞N_n\to\inftyNn​→∞ and γn∈[1,γ0]\gamma_n\in[1,\gamma_0]γn​∈[1,γ0​]. "In a compact subset of (0,1+γ−1)(0,1+\gamma^{-1})(0,1+γ−1)" is read with a fixed margin ccc: c≤ℓj≤1+γn−1−cc\le\ell_j\le1+\gamma_n^{-1}-cc≤ℓj​≤1+γn−1​−c.
  • Indices are 000-based.
  • Exponents 2/32/32/3, 4/34/34/3, 1/31/31/3 are real powers of positive reals.
  • FkF_kFk​ is defined as the Fredholm series of the kernel A+∑ms(m)⊗t(m)A+\sum_m s^{(m)}\otimes t^{(m)}A+∑m​s(m)⊗t(m), the paper's (201). The paper proves that this equals its Definition 1.1.
  • Contour integrals are Bochner integrals along two-ray broken lines, where the integrands decay like e−t3/3e^{-t^3/3}e−t3/3. Closed contours are circles with real centres.

Trivializing formalizations ruled out:

  • The Airy kernel is defined by (12), never by the divided difference (11), whose diagonal would be the junk value 000.
  • Ai is never written as the real integral 1π∫0∞cos⁡(t3/3+ut) dt\frac1\pi\int_0^\infty\cos(t^3/3+ut)\,dtπ1​∫0∞​cos(t3/3+ut)dt, which is not Lebesgue integrable and would be 000.
  • A non-summable Fredholm series would be 000, so summability is a milestone.
  • The goal quantifies over every unitary UUU and every admissible sequence, so it does not specialize Σ\SigmaΣ. Its hypotheses are satisfiable, for example by Mn=NnM_n=N_nMn​=Nn​, ℓ≡1\ell\equiv1ℓ≡1, r=k=0r=k=0r=k=0.

Infrastructure needed and reusable:

  • the Airy function and its decay;
  • trace-class or Hadamard-bound control of Fredholm series;
  • the complex Wishart eigenvalue density, which needs the Harish-Chandra–Itzykson–Zuber integral;
  • Andréief's identity;
  • steepest-descent estimates for contour integrals.

The Fredholm-determinant layer and the Airy function are reusable in any Tracy–Widom result. Andréief's identity and Hankel's formula are reusable well beyond random matrices.

Contributions welcome: proofs of any milestone, and lemmas that bound Fredholm series by Hadamard's inequality.

Selected references

  • J. Baik, G. Ben Arous, S. Péché, Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices, Ann. Probab. 33(5) (2005), 1643–1697. https://doi.org/10.1214/009117905000000233
  • K. Johansson, Shape fluctuations and random matrices, Comm. Math. Phys. 209 (2000), 437–476. https://arxiv.org/abs/math/9903134
  • I. M. Johnstone, On the distribution of the largest eigenvalue in principal components analysis, Ann. Statist. 29 (2001), 295–327. https://doi.org/10.1214/aos/1009210544
  • C. A. Tracy, H. Widom, Level-spacing distributions and the Airy kernel, Comm. Math. Phys. 159 (1994), 151–174. https://arxiv.org/abs/hep-th/9211141
  • C. Andréief, Note sur une relation entre les intégrales définies des produits des fonctions, Mém. Soc. Sci. Phys. Nat. Bordeaux 2 (1883), 1–14.
15 thms1 active userReviewed
Linear algebraProbability·Captain: mikedeng1

Random Matrices: Universality of ESDs and the Circular Law 2: The ESD of A_n/√n Converges to μ iff the Normalized Log-Determinants of A_n/√n − zI Converge to μ's Log-Potential for a.e. zResearch Paper

Motivation

The eigenvalues of a large non-Hermitian random matrix are hard to study directly. For Hermitian matrices, the empirical spectral distribution (ESD) is controlled by the resolvent and the Stieltjes transform, both stable under small perturbations. For non-Hermitian matrices no such tool exists: eigenvalues can move a long way under tiny perturbations, and the moment method fails because moments do not determine a measure on C\mathbb CC. The route that works, going back to Girko (1984) and used by Bai (1997), Götze–Tikhomirov (2007), Pan–Zhou (2007) and Tao–Vu (2008), passes through logarithmic determinants. The identity 1nlog⁡∣det⁡(A−zI)∣=∫log⁡∣w−z∣ dμA(w)\frac1n\log|\det(A-zI)|=\int\log|w-z|\,d\mu_A(w)n1​log∣det(A−zI)∣=∫log∣w−z∣dμA​(w) links the ESD μA\mu_AμA​ to a scalar quantity. That scalar is computable from the singular values of A−zIA-zIA−zI, which are eigenvalues of a Hermitian matrix.

Tao and Vu, with an appendix by Krishnapur (Ann. Probab. 38 (2010) 2023–2065), turn this link into an exact criterion. Theorem 1.15 of that paper states that the ESD of a normalized i.i.d. random matrix converges to a measure μ\muμ if and only if the normalized log-determinants converge to the logarithmic potential of μ\muμ for almost every zzz. The same holds for a regularized version built from the singular values. This mission formalizes Theorem 1.15 and the main steps of its proof (§8 and Appendix A of the published article).

Setting

Let xxx be a complex random variable with Ex=0\mathbf E x=0Ex=0 and E∣x∣2=1\mathbf E|x|^2=1E∣x∣2=1, and let (xij)i,j≥1(x_{ij})_{i,j\ge1}(xij​)i,j≥1​ be independent copies of xxx on a probability space (Ω,P)(\Omega,\mathbf P)(Ω,P). For each nnn, Xn=(xij)1≤i,j≤nX_n=(x_{ij})_{1\le i,j\le n}Xn​=(xij​)1≤i,j≤n​. Let MnM_nMn​ be deterministic n×nn\times nn×n complex matrices with

(1.3)sup⁡n1n2∥Mn∥22<∞,∥M∥22=∑i,j∣mij∣2,\text{(1.3)}\qquad\sup_n\frac1{n^2}\|M_n\|_2^2<\infty,\qquad\|M\|_2^2=\sum_{i,j}|m_{ij}|^2,(1.3)nsup​n21​∥Mn​∥22​<∞,∥M∥22​=i,j∑​∣mij​∣2,

and put An=Mn+XnA_n=M_n+X_nAn​=Mn​+Xn​.

For A∈Mn(C)A\in M_n(\mathbb C)A∈Mn​(C) with eigenvalues λ1,…,λn\lambda_1,\dots,\lambda_nλ1​,…,λn​, counted with algebraic multiplicity, the ESD is μA=1n∑iδλi\mu_A=\frac1n\sum_i\delta_{\lambda_i}μA​=n1​∑i​δλi​​. Its singular values are σ1(A)≥⋯≥σn(A)≥0\sigma_1(A)\ge\dots\ge\sigma_n(A)\ge0σ1​(A)≥⋯≥σn​(A)≥0. A sequence of random measures μn\mu_nμn​ converges in probability to a deterministic μ\muμ if, for every continuous compactly supported f:C→Rf:\mathbb C\to\mathbb Rf:C→R, ∫f dμn−∫f dμ\int f\,d\mu_n-\int f\,d\mu∫fdμn​−∫fdμ tends to 000 in probability. It converges almost surely if, with probability one, ∫f dμn→∫f dμ\int f\,d\mu_n\to\int f\,d\mu∫fdμn​→∫fdμ for all such fff at once. The logarithmic potential of a measure μ\muμ is z↦∫log⁡∣w−z∣ dμ(w)z\mapsto\int\log|w-z|\,d\mu(w)z↦∫log∣w−z∣dμ(w).

Hypothesis (1.4) states that, for almost every zzz, the ESDs of the deterministic matrices (1nMn−zI)(1nMn−zI)∗(\frac1{\sqrt n}M_n-zI)(\frac1{\sqrt n}M_n-zI)^*(n​1​Mn​−zI)(n​1​Mn​−zI)∗ converge to a limit.

In Lean everything lives in the namespace UnivESD.LogDet. The ESD is esd, the one-based singular value is sv, logPotential is the logarithmic potential, and ConvInProb/ConvAS/ESDConvInProb/ESDConvAS are the modes of convergence. IIDArray is the entry model, HSBound is (1.3), shiftA M xs z n ω is 1nAn−zI\frac1{\sqrt n}A_n-zIn​1​An​−zI, and Cond14 is (1.4).

Formalization targets

Goal: Theorem 1.15

Let μ\muμ be a probability measure on C\mathbb CC with ∫∣z∣2 dμ<∞\int|z|^2\,d\mu<\infty∫∣z∣2dμ<∞. The following are equivalent:

  1. μ1nAn→μ\mu_{\frac1{\sqrt n}A_n}\to\muμn​1​An​​→μ in probability;
  2. for a.e. zzz, 1nlog⁡∣det⁡(1nAn−zI)∣→∫Clog⁡∣w−z∣ dμ(w)\displaystyle\frac1n\log\Big|\det\big(\tfrac1{\sqrt n}A_n-zI\big)\Big|\to\int_{\mathbb C}\log|w-z|\,d\mu(w)n1​log​det(n​1​An​−zI)​→∫C​log∣w−z∣dμ(w) in probability;
  3. for a.e. zzz there are εn>0\varepsilon_n>0εn​>0, εn→0\varepsilon_n\to0εn​→0, with
1nlog⁡det⁡((1nAn−zI)(1nAn−zI)∗+εnI)→2∫Clog⁡∣w−z∣ dμ(w)\frac1n\log\det\Big(\big(\tfrac1{\sqrt n}A_n-zI\big)\big(\tfrac1{\sqrt n}A_n-zI\big)^*+\varepsilon_nI\Big)\to2\int_{\mathbb C}\log|w-z|\,d\mu(w)n1​logdet((n​1​An​−zI)(n​1​An​−zI)∗+εn​I)→2∫C​log∣w−z∣dμ(w)

in probability.

Under (1.4) the same equivalence holds with almost sure convergence throughout.

Milestones, in the order the proof uses them

  • (8.1): for a.e. zzz, w↦log⁡∣w−z∣w\mapsto\log|w-z|w↦log∣w−z∣ is μ\muμ-integrable.
  • Lemma A.3 (Weyl's comparison for products): ∏j≤J∣λj∣≤∏j≤Jσj(A)\prod_{j\le J}|\lambda_j|\le\prod_{j\le J}\sigma_j(A)∏j≤J​∣λj​∣≤∏j≤J​σj​(A) and ∏j≥Jσj(A)≤∏j≥J∣λj∣\prod_{j\ge J}\sigma_j(A)\le\prod_{j\ge J}|\lambda_j|∏j≥J​σj​(A)≤∏j≥J​∣λj​∣.
  • (8.3): P(σn−i≤ci/n)=O(exp⁡(−n0.01))\mathbf P(\sigma_{n-i}\le ci/n)=O(\exp(-n^{0.01}))P(σn−i​≤ci/n)=O(exp(−n0.01)) for 2n0.99≤i≤n−12n^{0.99}\le i\le n-12n0.99≤i≤n−1.
  • (8.2): 1n∑i=1n(log⁡σi2+εn−log⁡σi)→0\frac1n\sum_{i=1}^n\big(\log\sqrt{\sigma_i^2+\varepsilon_n}-\log\sigma_i\big)\to0n1​∑i=1n​(logσi2​+εn​​−logσi​)→0 almost surely.
  • p. 2057: almost surely, eventually, 1n∑(1−κ)n<i≤nlog⁡1σi≤O(κlog⁡1κ)\frac1n\sum_{(1-\kappa)n<i\le n}\log\frac1{\sigma_i}\le O(\kappa\log\frac1\kappa)n1​∑(1−κ)n<i≤n​logσi​1​≤O(κlogκ1​), and the same bound for log⁡1∣λi∣\log\frac1{|\lambda_i|}log∣λi​∣1​.

Significance

Theorem 1.15 reduces convergence of a non-Hermitian ESD to a family of scalar limit statements. Each of these can be attacked through Hermitian tools, because the regularized log-determinant in (iii) is a smooth functional of the singular values. Corollary 1.16 of the paper derives from it a practical criterion: the ESD converges to μ\muμ once the singular value distributions of 1nAn−zI\frac1{\sqrt n}A_n-zIn​1​An​−zI converge for a.e. zzz to laws ηz\eta_zηz​ with ∫log⁡t dηz=2∫log⁡∣w−z∣ dμ\int\log t\,d\eta_z=2\int\log|w-z|\,d\mu∫logtdηz​=2∫log∣w−z∣dμ. With the universality principle (Theorem 1.5, the companion mission) and Mehta's computation for complex Gaussian matrices, this yields the circular law for i.i.d. matrices with finite variance.

The theorem is proved in the source. To our knowledge neither it nor any of its milestones has a machine-checked proof. Mathlib has the ingredients for the objects (characteristic polynomials and their roots, LinearMap.singularValues, the strong law of large numbers) but not the results. A formal proof would give the platform its first verified bridge between eigenvalue and singular value asymptotics. Lemma A.3 alone, Weyl's multiplicative majorization, is a standard linear-algebra fact absent from Mathlib.

Difficulty

Two things make the obvious argument fail. First, log⁡\loglog is unbounded at 000. Vague convergence of μ1nAn\mu_{\frac1{\sqrt n}A_n}μn​1​An​​ controls ∫f dμn\int f\,d\mu_n∫fdμn​ only for continuous compactly supported fff, while log⁡∣w−z∣\log|w-z|log∣w−z∣ has a singularity at w=zw=zw=z and grows at infinity. Passing between (i) and (ii) therefore requires uniform control of the eigenvalues (and singular values) near 000 after the shift: the contribution of the smallest ones must vanish. Second, eigenvalues are not stable under perturbation, so this control cannot be read off the eigenvalues. It has to come from the singular values, through a lower-tail bound on σn−i\sigma_{n-i}σn−i​ that is exponentially small in a power of nnn, and through a deterministic inequality transferring bounds from singular values to eigenvalues. The smallest singular values (iii below n0.99n^{0.99}n0.99) need a separate polynomial lower bound (the paper's Lemma 4.1, posed in the companion mission). The tail bound in its printed form is false at that end of the range.

Formalization scope

Conventions committed to in Lean:

  • The ESD is n−1n^{-1}n−1 times the sum of Dirac masses over the root multiset of the characteristic polynomial, so multiplicities are kept. Test functions are real-valued, continuous and compactly supported. Almost sure ESD convergence uses one null set for all test functions.
  • The matrices XnX_nXn​ are the top-left corners of one infinite i.i.d. array. In-probability statements do not depend on how the XnX_nXn​ are coupled across nnn, but almost-sure statements do, and the paper's proof applies the strong law to this array. The limit in (1.4) is required to be a probability measure, which is equivalent under (1.3).
  • The second-moment condition on μ\muμ is Integrable (‖w‖²) μ. The logarithmic potential is a Bochner integral, which is 000 when not integrable; by (8.1) this happens only for a null set of zzz, which "for a.e. zzz" ignores.
  • Real.log 0 = 0. In (ii), a singular matrix would contribute 000 instead of −∞-\infty−∞; for this model the determinant is almost surely nonzero eventually. Every milestone with log⁡σi\log\sigma_ilogσi​ or log⁡∣λi∣\log|\lambda_i|log∣λi​∣ carries positivity of those quantities in its conclusion.
  • Singular values are one-based (sv A i is Mathlib's singularValues (i-1)). Eigenvalue enumerations are Fin n-indexed, and the paper's λi\lambda_iλi​ is index i−1i-1i−1.
  • The paper's O(⋅)O(\cdot)O(⋅) constants are existential and fixed before nnn. In the κlog⁡(1/κ)\kappa\log(1/\kappa)κlog(1/κ) bounds the constant is fixed before κ\kappaκ; a κ\kappaκ-dependent constant would make the bounds empty.

Disclosed corrections to the printed text:

  1. (iii)'s matrix. Theorem 1.15 prints a mis-bracketed product, and (1.8) prints (C+εnI)(C∗+εnI)(C+\varepsilon_nI)(C^*+\varepsilon_nI)(C+εn​I)(C∗+εn​I). The Lean uses CC∗+εnICC^*+\varepsilon_nICC∗+εn​I with C=1nAn−zIC=\frac1{\sqrt n}A_n-zIC=n​1​An​−zI, the matrix of (8.2) and of the proof of Corollary 1.16.
  2. (8.3)'s range. It is printed for 1≤i≤n−n0.991\le i\le n-n^{0.99}1≤i≤n−n0.99, which is false for small iii: for Gaussian entries and Mn=0M_n=0Mn​=0, nσn−1n\sigma_{n-1}nσn−1​ has a non-degenerate limit law. It is posed on 2n0.99≤i≤n−12n^{0.99}\le i\le n-12n0.99≤i≤n−1, the range the proof covers and the use needs.
  3. Lemma A.3, second inequality. It is posed for 1≤J≤n1\le J\le n1≤J≤n, since σ0\sigma_0σ0​ is undefined. The eigenvalues are ordered ∣λ1∣≥⋯≥∣λn∣|\lambda_1|\ge\dots\ge|\lambda_n|∣λ1​∣≥⋯≥∣λn​∣, not ∣λ1∣≤⋯≤∣λn∣|\lambda_1|\le\dots\le|\lambda_n|∣λ1​∣≤⋯≤∣λn​∣ as printed: the printed order is a slip. With it, both inequalities are weaker than Weyl's and cannot support the use on p. 2057, which orders the eigenvalues decreasingly. The decreasing order implies the printed form.
  4. (8.2) and (8.1). (8.2) is stated for every deterministic εn>0\varepsilon_n>0εn​>0 with εn→0\varepsilon_n\to0εn​→0; the proof uses nothing else. (8.1) is stated as μ\muμ-integrability plus local integrability of z↦∫∣log⁡∣w−z∣∣ dμ(w)z\mapsto\int|\log|w-z||\,d\mu(w)z↦∫∣log∣w−z∣∣dμ(w).

A trivializing formalization is ruled out by construction. The goal mentions only AnA_nAn​ and μ\muμ. The proof's comparison ensemble Bn=n diag(λi)B_n=\sqrt n\,\mathrm{diag}(\lambda_i)Bn​=n​diag(λi​) is not a hypothesis. No statement takes a log-potential or a log-determinant as an input that could be fixed to make it hold.

The companion mission (Theorem 1.5, universality) poses Theorem 2.1 (the replacement principle), Lemma 1.7 (tightness) and Lemma 4.1 (least singular value), which the proof here also uses. They are not restated here. Once that mission is published they belong here as references. Contributions are welcome on the linear-algebra layer (Lemma A.3, multiplicative Weyl majorization), the Fubini argument of (8.1), and the singular-value tail bound (8.3). These are reusable well beyond this paper.

Selected references

  • T. Tao, V. Vu (appendix by M. Krishnapur), Random matrices: Universality of ESDs and the circular law, Ann. Probab. 38(5) (2010) 2023–2065. https://doi.org/10.1214/10-AOP534 (source of this mission; published version).
  • V. L. Girko, The circular law, Teor. Veroyatnost. i Primenen. 29 (1984) 669–679. https://doi.org/10.1137/1129095
  • Z. D. Bai, Circular law, Ann. Probab. 25(1) (1997) 494–529. https://doi.org/10.1214/aop/1024404298
  • F. Götze, A. Tikhomirov, The circular law for random matrices, Ann. Probab. 38(4) (2010) 1444–1491. https://doi.org/10.1214/09-AOP522
  • T. Tao, V. Vu, Random matrices: the circular law, Commun. Contemp. Math. 10(2) (2008) 261–307. https://doi.org/10.1142/S0219199708002788
  • H. Weyl, Inequalities between the two kinds of eigenvalues of a linear transformation, Proc. Natl. Acad. Sci. USA 35 (1949) 408–411. https://doi.org/10.1073/pnas.35.7.408
10 thms1 active userReviewed
Linear algebraProbability·Captain: mikedeng1

Random Matrices: Universality of ESDs and the Circular Law 1: For i.i.d. Zero-Mean Unit-Variance Entries, the ESD of (M_n + X_n)/√n Does Not Depend on the Entry Distribution in the LimitResearch Paper

Motivation

The eigenvalues of a large random matrix with independent entries follow deterministic limiting laws. For non-Hermitian matrices with i.i.d. entries of mean zero and variance one, the circular law asserts that the eigenvalues of 1nXn\frac1{\sqrt n}X_nn​1​Xn​ become uniformly distributed on the unit disk. These laws are used across statistics (covariance and signal-plus-noise models), numerical analysis (spectra of perturbed matrices), mathematical physics and the theory of neural networks; what makes them usable is universality: the limit depends only on the mean and variance of the entries, not on their distribution.

Timeline of the circular law and its universality:

  • 1965: Ginibre computes the joint eigenvalue density for complex Gaussian entries; Mehta (1967) derives the circular law in that case.
  • 1984: Girko proposes a general approach via log-determinants; his argument has gaps.
  • 1997: Bai gives the first rigorous proof for continuous entries with finite (2+η)(2+\eta)(2+η)-th moment and bounded density.
  • 2007–2008: Götze–Tikhomirov, Pan–Zhou and Tao–Vu remove the density assumption under extra moment conditions, using lower bounds on the least singular value.
  • 2010: Tao and Vu (Ann. Probab. 38 (2010) 2023–2065) prove universality under the minimal assumption of finite variance, and with a deterministic shift MnM_nMn​; the circular law in full generality follows.

This mission formalizes the main universality theorem of that paper (Theorem 1.5) together with the lemmas its proof rests on.

Setting

Let AAA be an n×nn\times nn×n complex matrix with eigenvalues λ1,…,λn\lambda_1,\dots,\lambda_nλ1​,…,λn​, counted with algebraic multiplicity. Its empirical spectral distribution (ESD) is the probability measure

μA=1n∑i=1nδλi\mu_A=\frac1n\sum_{i=1}^n\delta_{\lambda_i}μA​=n1​i=1∑n​δλi​​

on C\mathbb CC. The Hilbert–Schmidt norm is ∥A∥22=trace(AA∗)=∑i,j∣aij∣2\|A\|_2^2=\mathrm{trace}(AA^*)=\sum_{i,j}|a_{ij}|^2∥A∥22​=trace(AA∗)=∑i,j​∣aij​∣2.

A complex random variable xxx has zero mean and unit variance if Ex=0\mathbf E x=0Ex=0 and E∣x∣2=1\mathbf E|x|^2=1E∣x∣2=1. Given such xxx and yyy, let Xn=(xij)1≤i,j≤nX_n=(x_{ij})_{1\le i,j\le n}Xn​=(xij​)1≤i,j≤n​ and Yn=(yij)1≤i,j≤nY_n=(y_{ij})_{1\le i,j\le n}Yn​=(yij​)1≤i,j≤n​ have entries that are i.i.d. copies of xxx, resp. yyy. Let MnM_nMn​ be deterministic n×nn\times nn×n matrices with

sup⁡n1n2∥Mn∥22<∞,(1.3)\sup_n\frac1{n^2}\|M_n\|_2^2<\infty,\qquad(1.3)nsup​n21​∥Mn​∥22​<∞,(1.3)

and set An=Mn+XnA_n=M_n+X_nAn​=Mn​+Xn​, Bn=Mn+YnB_n=M_n+Y_nBn​=Mn​+Yn​.

Measures on C\mathbb CC carry the vague topology: test functions are continuous compactly supported f:C→Rf:\mathbb C\to\mathbb Rf:C→R. The random measures μ1nAn−μ1nBn\mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}μn​1​An​​−μn​1​Bn​​ converge to zero in probability if, for every test function fff and ε>0\varepsilon>0ε>0,

P(∣∫f dμ1nAn−∫f dμ1nBn∣≥ε)→0,\mathbf P\Bigl(\Bigl|\int f\,d\mu_{\frac1{\sqrt n}A_n}-\int f\,d\mu_{\frac1{\sqrt n}B_n}\Bigr|\ge\varepsilon\Bigr)\to0,P(​∫fdμn​1​An​​−∫fdμn​1​Bn​​​≥ε)→0,

and almost surely if, with probability one, the difference of integrals tends to zero for every test function. The additional hypothesis

(1.4)μ(1nMn−zI)(1nMn−zI)∗ converges for almost every z∈C(1.4)\qquad \mu_{(\frac1{\sqrt n}M_n-zI)(\frac1{\sqrt n}M_n-zI)^*}\ \text{converges for almost every } z\in\mathbb C(1.4)μ(n​1​Mn​−zI)(n​1​Mn​−zI)∗​ converges for almost every z∈C

concerns only the deterministic shift.

Formalization targets

Goal: Theorem 1.5 (universality principle)

μ1nAn−μ1nBn⟶0 in probability;(1.4) ⟹ μ1nAn−μ1nBn⟶0 almost surely.\mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}\longrightarrow0\ \text{in probability};\qquad (1.4)\ \Longrightarrow\ \mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}\longrightarrow0\ \text{almost surely}.μn​1​An​​−μn​1​Bn​​⟶0 in probability;(1.4) ⟹ μn​1​An​​−μn​1​Bn​​⟶0 almost surely.

The statement involves no limiting law: it compares two ensembles, so it holds whether or not μ1nAn\mu_{\frac1{\sqrt n}A_n}μn​1​An​​ itself converges.

Milestones

The proof combines three results, each a milestone:

  • Theorem 2.1 (replacement principle), in probability and almost surely: if 1n2(∥An∥22+∥Bn∥22)\frac1{n^2}(\|A_n\|_2^2+\|B_n\|_2^2)n21​(∥An​∥22​+∥Bn​∥22​) is bounded and, for almost every zzz, 1nlog⁡∣det⁡(1nAn−zI)∣−1nlog⁡∣det⁡(1nBn−zI)∣→0\frac1n\log|\det(\frac1{\sqrt n}A_n-zI)|-\frac1n\log|\det(\frac1{\sqrt n}B_n-zI)|\to0n1​log∣det(n​1​An​−zI)∣−n1​log∣det(n​1​Bn​−zI)∣→0, then μ1nAn−μ1nBn→0\mu_{\frac1{\sqrt n}A_n}-\mu_{\frac1{\sqrt n}B_n}\to0μn​1​An​​−μn​1​Bn​​→0.
  • Lemma 1.7 (tightness): 1n2∥An∥22\frac1{n^2}\|A_n\|_2^2n21​∥An​∥22​ and ∫∣z∣2 dμ1nAn\int|z|^2\,d\mu_{\frac1{\sqrt n}A_n}∫∣z∣2dμn​1​An​​ are almost surely bounded.
  • Proposition 2.2 (converging determinant): for every zzz, the log-determinant difference (2.2) tends to zero in probability, and almost surely if (1.4) holds at zzz.

Supporting milestones: the linear-algebra Lemmas A.1 (interlacing), A.2 (Weyl's second-moment inequality) and A.4 (negative second moment); the probabilistic dominated convergence Lemma 3.1; Girko's identity (Lemma 3.3); the least singular value bound (Lemma 4.1); the lower tail bound for distances to subspaces (Proposition 5.1); and the high- and low-dimensional row contributions (Lemmas 4.2 and 4.3).

Significance

The result. Theorem 1.5 with Mn=0M_n=0Mn​=0 and yyy complex Gaussian transfers Mehta's computation for the Ginibre ensemble to every zero-mean unit-variance entry distribution: this is the circular law under the optimal moment assumption (Theorem 1.10 of the paper). With nonzero MnM_nMn​ it gives universality for perturbed and non-centred matrices, including results with entries of nonzero mean. The replacement principle (Theorem 2.1) is a general tool: it reduces vague convergence of non-Hermitian ESDs to convergence of log-determinants and applies to ensembles without independent entries.

Formalizing it. The theorem is proved in the paper; no part of it, and no ESD of a non-Hermitian matrix, has been formalized. The mission produces a machine-checked statement of universality in the vague topology and a library of reusable pieces: ESDs of complex matrices, convergence of random measures in probability and almost surely, interlacing and Weyl-type inequalities for singular values, and Girko's identity. Lemmas 4.1 and 5.1 rest on results the paper cites (Tao–Vu's least singular value bound, Talagrand's concentration inequality); formalizing those is part of the work.

Difficulty

The ESD of a non-Hermitian matrix is not stable under small perturbations: eigenvalues of a nearly singular matrix can move a long way, so the moment method and the Stieltjes transform method that settle the Hermitian case do not apply. The log-determinant 1nlog⁡∣det⁡(1nAn−zI)∣\frac1n\log|\det(\frac1{\sqrt n}A_n-zI)|n1​log∣det(n​1​An​−zI)∣ is a stable proxy only if the small singular values of 1nAn−zI\frac1{\sqrt n}A_n-zIn​1​An​−zI are controlled, and with only a second moment on the entries the entries can be unbounded, which defeats standard concentration arguments. The obvious approach, comparing AnA_nAn​ and BnB_nBn​ by swapping entries one at a time, needs smooth bounded statistics of the matrix, and the log-determinant is neither: it is unbounded near singular matrices.

Formalization scope

Matrices are Matrix (Fin n) (Fin n) ℂ; eigenvalues are the roots of the characteristic polynomial as a multiset, so the ESD counts algebraic multiplicity; for n=0n=0n=0 the ESD is the zero measure, harmless because every statement is asymptotic. The Hilbert–Schmidt norm is written as an explicit sum, not Mathlib's default (sup) matrix norm. Singular values are Mathlib's zero-indexed LinearMap.singularValues, shifted so that σ1\sigma_1σ1​ is the largest.

Conventions committed to:

  • Coupling. XnX_nXn​ is the top-left n×nn\times nn×n corner of one infinite i.i.d. array; the almost-sure statements depend on this choice, the in-probability ones do not. No relation between the xxx- and yyy-arrays is assumed.
  • (1.4) asks for a probability measure as the vague limit; under (1.3) any vague limit of these ESDs is one.
  • Almost sure convergence of ESDs uses one null set for all test functions.
  • Junk values. Lean has log⁡0=0\log 0=0log0=0 and 1/0=01/0=01/0=0. Theorem 2.1 therefore states its "determinants are nonzero" clause explicitly, and Proposition 2.2 concludes it (the paper's (2.2) is −∞-\infty−∞ at a vanishing determinant, so its convergence includes nonvanishing); Lemmas 4.2 and 4.3 assert positivity of the row distances they take logarithms of; Lemma 3.1's (1+δ)(1+\delta)(1+δ)-moment is a lower integral with values in [0,∞][0,\infty][0,∞], since a Bochner integral would vanish for non-integrable functions and make the hypothesis vacuous.
  • O(⋅)O(\cdot)O(⋅) constants are existential and fixed before the quantities they must not depend on: before ε\varepsilonε in Lemmas 4.2 and 4.3, before the sample point in Lemma 4.1, after ccc and before n,d,Wn,d,Wn,d,W and the row shift in Proposition 5.1.
  • Section 4 setting. Lemmas 4.2 and 4.3 carry the standing reductions of §4 as hypotheses: z=0z=0z=0, the row bound (4.2) ∥Zi∥=O(n)\|Z_i\|=O(\sqrt n)∥Zi​∥=O(n​) for n/2≤i≤nn/2\le i\le nn/2≤i≤n (which the paper obtains by permuting rows), and, for Lemma 4.3, convergence of μ1nMnMn∗\mu_{\frac1nM_nM_n^*}μn1​Mn​Mn∗​​. Proposition 5.1 quantifies over every deterministic row shift.
  • Printed slip. On p. 2045 the YiY_iYi​ are called "the rows of 1nBn\frac1{\sqrt n}B_nn​1​Bn​" and then normalized again; here YiY_iYi​ are the rows of BnB_nBn​, matching XiX_iXi​.

A trivializing formalization is excluded: the goal mentions only ESDs, i.i.d. entries, (1.3) and (1.4) — no log-determinant or singular value hypothesis — and its in-probability half holds without (1.4). Lemmas 6.3 and 6.4 and the internal Lemmas 3.2, 3.4, 5.3, 6.1, 6.6, 6.7 and Theorems 5.2, B.1 are not posed. Contributions are welcome on any milestone, and particularly on the deterministic Lemmas A.1, A.2, A.4 and 3.3, which are reusable well beyond this mission.

Selected references

  • T. Tao, V. Vu (appendix by M. Krishnapur), Random matrices: universality of ESDs and the circular law, The Annals of Probability 38(5) (2010) 2023–2065. https://doi.org/10.1214/10-AOP534 (the source; the published article is the citation basis)
  • J. Ginibre, Statistical ensembles of complex, quaternion, and real matrices, J. Math. Phys. 6 (1965) 440–449. https://doi.org/10.1063/1.1704292
  • V. L. Girko, The circular law, Teor. Veroyatnost. i Primenen. 29 (1984) 669–679; English translation Theory Probab. Appl. 29 (1985) 694–706. https://doi.org/10.1137/1129095
  • Z. D. Bai, Circular law, Ann. Probab. 25 (1997) 494–529. https://doi.org/10.1214/aop/1024404298
  • T. Tao, V. Vu, Random matrices: the circular law, Commun. Contemp. Math. 10 (2008) 261–307. https://doi.org/10.1142/S0219199708002788
  • R. B. Dozier, J. W. Silverstein, On the empirical distribution of eigenvalues of large dimensional information-plus-noise-type matrices, J. Multivariate Anal. 98 (2007) 678–694. https://doi.org/10.1016/j.jmva.2006.09.006
17 thms1 active userReviewed
Linear algebraOptimizationProbability·Captain: mikedeng1

Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization 2: Nearly Isometric Random Maps Have δ_r ≤ δ with Probability 1 − e^(−c₁p) Once p ≥ c₀r(m+n)log(mn)Research Paper

Motivation

Many problems in system identification, collaborative filtering, low-dimensional embedding and model reduction ask for the matrix of least rank in an affine space. Affine rank minimization — given a linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp and b∈Rpb\in\mathbb R^pb∈Rp, find a matrix of minimum rank with A(X)=b\mathcal A(X)=bA(X)=b — is NP-hard in general. Recht, Fazel and Parrilo (arXiv:0706.4138; SIAM Review 52(3), 2010, doi:10.1137/070697835) showed that the convex relaxation which minimizes the nuclear norm ∥X∥∗\|X\|_*∥X∥∗​ (the sum of the singular values) instead of the rank recovers the minimum-rank solution exactly whenever A\mathcal AA satisfies a restricted isometry property on low-rank matrices. That deterministic theorem is the subject of the companion mission in this series.

A deterministic condition is only useful if maps satisfying it exist and are common. This mission formalizes the paper's second main result: random linear maps from a broad class — including Gaussian, symmetric Bernoulli and sparse random matrices — satisfy the restricted isometry property with overwhelming probability once the number of measurements ppp is of order r(m+n)log⁡(mn)r(m+n)\log(mn)r(m+n)log(mn). This parallels the role of random matrices in compressed sensing (Candès–Tao 2005; Baraniuk, Davenport, DeVore and Wakin 2008), where the vector restricted isometry property is established for random measurement matrices by a concentration and covering argument.

Setting

Write ⟨X,Y⟩=Tr⁡(X⊤Y)\langle X,Y\rangle=\operatorname{Tr}(X^\top Y)⟨X,Y⟩=Tr(X⊤Y) for the trace inner product on Rm×n\mathbb R^{m\times n}Rm×n and ∥X∥F\|X\|_F∥X∥F​ for the Frobenius norm. A linear map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp is given by ppp measurement matrices X1,…,XpX_1,\dots,X_pX1​,…,Xp​ through A(X)i=⟨Xi,X⟩\mathcal A(X)_i=\langle X_i,X\rangleA(X)i​=⟨Xi​,X⟩; ∥A(X)∥\|\mathcal A(X)\|∥A(X)∥ is the Euclidean norm in Rp\mathbb R^pRp, and ∥A∥=sup⁡{∥A(X)∥:∥X∥F≤1}\|\mathcal A\|=\sup\{\|\mathcal A(X)\|:\|X\|_F\le1\}∥A∥=sup{∥A(X)∥:∥X∥F​≤1} is the operator norm.

The rrr-restricted isometry constant δr(A)\delta_r(\mathcal A)δr​(A) (Definition 3.1) is the smallest δ≥0\delta\ge0δ≥0 such that

(1−δ)∥X∥F≤∥A(X)∥≤(1+δ)∥X∥Ffor all X with rank⁡X≤r.(1-\delta)\|X\|_F\le\|\mathcal A(X)\|\le(1+\delta)\|X\|_F\qquad\text{for all }X\text{ with }\operatorname{rank}X\le r.(1−δ)∥X∥F​≤∥A(X)∥≤(1+δ)∥X∥F​for all X with rankX≤r.

A random linear map A\mathcal AA is nearly isometrically distributed (Definition 4.1) if for every XXX, E∥A(X)∥2=∥X∥F2\mathbb E\|\mathcal A(X)\|^2=\|X\|_F^2E∥A(X)∥2=∥X∥F2​; for every X≠0X\ne0X=0 and 0<ϵ<10<\epsilon<10<ϵ<1,

P(∣∥A(X)∥2−∥X∥F2∣≥ϵ∥X∥F2)≤2exp⁡(−p2(ϵ2/2−ϵ3/3));\mathbb P\big(\big|\|\mathcal A(X)\|^2-\|X\|_F^2\big|\ge\epsilon\|X\|_F^2\big)\le2\exp\Big(-\frac p2\big(\epsilon^2/2-\epsilon^3/3\big)\Big);P(​∥A(X)∥2−∥X∥F2​​≥ϵ∥X∥F2​)≤2exp(−2p​(ϵ2/2−ϵ3/3));

and for some γ>0\gamma>0γ>0 and all t>0t>0t>0, P(∥A∥≥1+mn/p+t)≤exp⁡(−γpt2)\mathbb P(\|\mathcal A\|\ge1+\sqrt{mn/p}+t)\le\exp(-\gamma pt^2)P(∥A∥≥1+mn/p​+t)≤exp(−γpt2).

For subspaces T1,T2T_1,T_2T1​,T2​ of a Euclidean space, the projection distance is ρ(T1,T2)=∥PT1−PT2∥\rho(T_1,T_2)=\|P_{T_1}-P_{T_2}\|ρ(T1​,T2​)=∥PT1​​−PT2​​∥, the operator norm of the difference of the orthogonal projections (4.10). For subspaces V⊆RmV\subseteq\mathbb R^mV⊆Rm, W⊆RnW\subseteq\mathbb R^nW⊆Rn, the subspace Σ(V,W)⊆Rm×n\Sigma(V,W)\subseteq\mathbb R^{m\times n}Σ(V,W)⊆Rm×n consists of the matrices whose column space lies in VVV and whose row space lies in WWW.

Formalization targets

Goal: Theorem 4.2

Fix 0<δ<10<\delta<10<δ<1. There are c0,c1>0c_0,c_1>0c0​,c1​>0 depending only on δ\deltaδ such that for all 1≤r≤m≤n1\le r\le m\le n1≤r≤m≤n with mn≥2mn\ge2mn≥2, all p≥c0 r(m+n)log⁡(mn)p\ge c_0\,r(m+n)\log(mn)p≥c0​r(m+n)log(mn), and every nearly isometric random map A:Rm×n→Rp\mathcal A:\mathbb R^{m\times n}\to\mathbb R^pA:Rm×n→Rp,

P(δr(A)>δ)≤e−c1p.\mathbb P\big(\delta_r(\mathcal A)>\delta\big)\le e^{-c_1p}.P(δr​(A)>δ)≤e−c1​p.

Milestones

  • Lemma 4.3. For a fixed subspace UUU with d=dim⁡U≤pd=\dim U\le pd=dimU≤p and 0<δ<10<\delta<10<δ<1, the map is a δ\deltaδ-isometry on all of UUU except with probability at most 2(12/δ)dexp⁡(−p2(δ2/8−δ3/24))2(12/\delta)^d\exp(-\frac p2(\delta^2/8-\delta^3/24))2(12/δ)dexp(−2p​(δ2/8−δ3/24)).
  • Lemma 4.4. If A\mathcal AA is a δ\deltaδ-isometry on a ddd-dimensional U1U_1U1​, it is a δ′\delta'δ′-isometry on any ddd-dimensional U2U_2U2​, with δ′=δ+(1+∥A∥)ρ(U1,U2)\delta'=\delta+(1+\|\mathcal A\|)\rho(U_1,U_2)δ′=δ+(1+∥A∥)ρ(U1​,U2​).
  • (4.17). ρ(Σ(V1,W1),Σ(V2,W2))≤ρ(V1,V2)+ρ(W1,W2)\rho(\Sigma(V_1,W_1),\Sigma(V_2,W_2))\le\rho(V_1,V_2)+\rho(W_1,W_2)ρ(Σ(V1​,W1​),Σ(V2​,W2​))≤ρ(V1​,V2​)+ρ(W1​,W2​).
  • Lemma 4.5. For 0<ϵ≤10<\epsilon\le10<ϵ≤1, the family {Σ(V,W):dim⁡V=dim⁡W=r}\{\Sigma(V,W):\dim V=\dim W=r\}{Σ(V,W):dimV=dimW=r} has an ϵ\epsilonϵ-net in ρ\rhoρ of size at most (2C0/ϵ)r(m+n−2r)(2C_0/\epsilon)^{r(m+n-2r)}(2C0​/ϵ)r(m+n−2r), with C0C_0C0​ absolute.

Significance

The theorem supplies the hypothesis of the paper's recovery theorem for random measurements: with δ=1/10\delta=1/10δ=1/10 and rank 5r5r5r, it shows that O(r(m+n)log⁡(mn))O(r(m+n)\log(mn))O(r(m+n)log(mn)) random linear measurements suffice for nuclear norm minimization to recover every matrix of rank at most rrr exactly. Since a rank-rrr matrix has r(m+n−r)r(m+n-r)r(m+n−r) degrees of freedom, this is within a logarithmic factor of the information-theoretic count. The result made the nuclear norm heuristic a guaranteed method and seeded the theory of low-rank matrix recovery, including matrix completion.

The result is proved in the paper, though Lemma 4.5 rests on Szarek's covering estimates for the Grassmannian, cited without proof. To the best of the curators' search of the platform, none of these statements is machine-checked: there is no formal treatment of the matrix restricted isometry property, of nets on Grassmannians in the projection metric, or of nearly isometric random maps. A formalization would supply the probabilistic half of a fully verified low-rank recovery guarantee, together with reusable pieces — the projection distance, the stability of near isometry under subspace perturbation, and a covering bound for Grassmannians.

Difficulty

The set of matrices of rank at most rrr is not a subspace, so concentration for one matrix and a union bound over a single net in Rm×n\mathbb R^{m\times n}Rm×n do not suffice: a net of the unit ball of all matrices has size exponential in mnmnmn, which would require ppp of order mnmnmn. The set must instead be covered by finitely many r2r^2r2-dimensional subspaces, which requires a quantitative covering of the Grassmannians G(m,r)G(m,r)G(m,r) and G(n,r)G(n,r)G(n,r) in the projection distance — the content of Lemma 4.5, whose source in the literature (Szarek) does not give the constant explicitly. A second subtlety is that the event "A\mathcal AA is a near-isometry on all of a subspace" involves an uncountable family of matrices, and the bound for the supremum of ∥A(X)∥\|\mathcal A(X)\|∥A(X)∥ over a unit sphere has to be controlled from the finitely many points of a net.

Formalization scope

All statements live in the namespace MinRankRecovery.RandomRIP. Matrices are Matrix (Fin m) (Fin n) ℝ; the Frobenius norm and the trace inner product come from the published module HighDimStat_MatrixRank_Core. A linear map is represented by its ppp measurement matrices Xs : Fin p → Matrix (Fin m) (Fin n) ℝ, which loses no generality. A random map is Xs : Ω → Fin p → Matrix … on a probability space (Ω, μ), with measurable entries.

Conventions committed to:

  • δr\delta_rδr​ is the infimum of the admissible δ≥0\delta\ge0δ≥0 and is defined for every rrr; the paper's 1≤r≤m≤n1\le r\le m\le n1≤r≤m≤n appears as hypotheses of the goal.
  • ∥A∥\|\mathcal A\|∥A∥ is a supremum over the nonempty, bounded Frobenius unit ball.
  • (4.1) includes integrability. (4.2) is imposed for X≠0X\ne0X=0 only, since at X=0X=0X=0 the printed inequality fails for large ppp. γ\gammaγ in (4.3) may depend on the distribution and dimensions.
  • Probability statements bound the (outer) measure of the failure event, since events quantified over all matrices need not be measurable.
  • For ρ\rhoρ and Σ(V,W)\Sigma(V,W)Σ(V,W), matrices are vectorized into EuclideanSpace ℝ (Fin m × Fin n), which carries the Frobenius inner product. Lemma 4.4 is stated on EuclideanSpace ℝ ι for any finite index type.
  • Real.log is the natural logarithm.

Two printed statements are corrected. Theorem 4.2 assumes mn≥2mn\ge2mn≥2: at m=n=r=1m=n=r=1m=n=r=1, log⁡(mn)=0\log(mn)=0log(mn)=0 and a two-point random scalar map is nearly isometric while violating the conclusion. Lemma 4.5 is posed for 0<ϵ≤10<\epsilon\le10<ϵ≤1, since for large ϵ\epsilonϵ the right side drops below 111.

The constants c0,c1c_0,c_1c0​,c1​ of the goal are quantified before the dimensions, the distribution and γ\gammaγ; a formalization in which they may depend on m,n,p,rm,n,p,rm,n,p,r or on the distribution, or in which the near-isometry hypothesis is unsatisfiable, would be trivial and is ruled out by these choices.

A complete development needs: orthogonal projections and operator norms on finite-dimensional inner product spaces (Mathlib), volumetric ϵ\epsilonϵ-nets of spheres in subspaces, covering bounds for real Grassmannians in the projection metric, and the measure-theoretic union bound. The Grassmannian covering bound and the stability lemma are reusable beyond this mission. Contributions of any milestone, including Lemma 4.5 on its own, are welcome.

Selected references

  • B. Recht, M. Fazel, P. A. Parrilo, Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization, SIAM Review 52(3):471–501, 2010. Preprint arXiv:0706.4138v1. https://arxiv.org/abs/0706.4138
  • E. J. Candès, T. Tao, Decoding by Linear Programming, IEEE Trans. Inform. Theory 51(12), 2005. https://doi.org/10.1109/TIT.2005.858979
  • R. Baraniuk, M. Davenport, R. DeVore, M. Wakin, A Simple Proof of the Restricted Isometry Property for Random Matrices, Constructive Approximation 28(3), 2008. https://doi.org/10.1007/s00365-007-9003-x
  • S. J. Szarek, Metric entropy of homogeneous spaces, in Quantum Probability, Banach Center Publ. 43, 1998. https://arxiv.org/abs/math/9701213
  • E. J. Candès, Y. Plan, Tight Oracle Inequalities for Low-Rank Matrix Recovery From a Minimal Number of Noisy Random Measurements, IEEE Trans. Inform. Theory 57(4), 2011. https://arxiv.org/abs/1001.0339
9 thms1 active userReviewed
Machine LearningProbabilityStatistics·Captain: mikedeng1

High-Dimensional Probability XI: Dvoretzky-Milman's TheoremTextbook

Motivation

A striking fact discovered by Dvoretzky in the 1960s (conjectured by Grothendieck, and sharpened into its modern quantitative form by Milman in 1971) is that every high-dimensional convex body, however irregular, contains a round slice: a random low-dimensional section (or projection) of any bounded convex set in Rn\mathbb R^nRn is, with high probability, close to a Euclidean ball — provided the dimension of the slice is small enough relative to a single geometric parameter of the body. This is remarkable because it holds for every bounded set, arbitrarily irregular; no special structure is assumed beyond boundedness. This chapter proves the theorem in its Gaussian form, as a culmination of every geometric and probabilistic tool the book develops: chaining and Dudley's inequality (Chapter 8), the matrix deviation inequality (Chapter 9), and Gaussian width and the stable dimension (Chapter 7) all combine into a single closing argument.

Setting

Fix a subset T⊆RnT\subseteq\mathbb R^nT⊆Rn. For a standard Gaussian vector g∼N(0,In)g\sim N(0,I_n)g∼N(0,In​), the Gaussian width of TTT is w(T):=Esup⁡x∈T⟨g,x⟩w(T) := \mathbb E\sup_{x\in T}\langle g,x\ranglew(T):=Esupx∈T​⟨g,x⟩ (Chapter 7), and the stable dimension of a bounded TTT is d(T):=w(T)2/diam(T)2d(T) := w(T)^2/\mathrm{diam}(T)^2d(T):=w(T)2/diam(T)2 up to an absolute constant factor (Definition 7.6.2) — a robust substitute for the ordinary linear-algebraic dimension of TTT, which can jump discontinuously under a small perturbation of TTT, unlike d(T)d(T)d(T).

An m×nm\times nm×n Gaussian random matrix with i.i.d. N(0,1)N(0,1)N(0,1) entries is a random matrix AAA each of whose mnmnmn entries is an independent standard normal random variable.

Formalization targets

Goal (Theorem 11.3.3, Dvoretzky-Milman's theorem, Gaussian form)

∃ c>0:m≤cε2d(T)  ⟹  P[(1−ε)B⊆conv(AT)⊆(1+ε)B]≥0.99\exists\,c>0:\quad m\le c\varepsilon^2 d(T) \;\Longrightarrow\; \mathbb P\bigl[(1-\varepsilon)B \subseteq \mathrm{conv}(AT) \subseteq (1+\varepsilon)B\bigr] \ge 0.99∃c>0:m≤cε2d(T)⟹P[(1−ε)B⊆conv(AT)⊆(1+ε)B]≥0.99

for every m×nm\times nm×n Gaussian random matrix AAA with i.i.d. N(0,1)N(0,1)N(0,1) entries, every bounded T⊆RnT\subseteq\mathbb R^nT⊆Rn containing the origin, and every ε∈(0,1)\varepsilon\in(0,1)ε∈(0,1), where BBB is the Euclidean ball of radius w(T)w(T)w(T) centered at the origin. The probability 0.990.990.99 is the book's own literal numeral, not a free parameter — this is the theorem the book actually states, not a family of theorems indexed by a confidence level.

Significance

Dvoretzky-Milman's theorem is one of the foundational results of the local theory of Banach spaces (asymptotic geometric analysis): it says every nnn-dimensional normed space contains an almost-Euclidean subspace of dimension proportional to (a geometric invariant closely related to) log⁡n\log nlogn in the worst case, and much larger for spaces whose unit ball is already well-behaved (the stable dimension of the cube [−1,1]n[-1,1]^n[−1,1]n, for instance, is proportional to nnn itself — Example 11.3.6). This underlies results throughout convex geometry, compressed sensing, and high-dimensional statistics wherever a random low-dimensional projection needs to be shown to preserve geometric structure. The book's own framing makes clear why this chapter is placed last: the theorem's proof is a genuine capstone, invoking Chevet's inequality (itself built from the matrix deviation inequality of Chapter 9, which is built from chaining, Chapter 8) as its main technical tool.

The theorem and its proof are classical (Milman 1971; this book's specific route via Chevet's inequality is a standard modern exposition). This mission formalizes the goal theorem's statement — including its two supporting geometric quantities, Gaussian width and stable dimension, and the notion of a Gaussian random matrix — as a complete, faithful target for a solver, in the book's own sub-namespace built for this chapter (no dependency here is reusable from an earlier chunk, since none of this book series' Chapter 7 or Chapter 9 definitions has yet been published).

Difficulty

The natural first idea — bound conv(AT)\mathrm{conv}(AT)conv(AT) directly using concentration of ∥Ax∥2\|Ax\|_2∥Ax∥2​ for each fixed x∈Tx\in Tx∈T — runs into exactly the uniform-supremum obstacle the whole book has been building tools to overcome: a bound that holds for one xxx at a time, even with a union bound over a net of TTT, does not obviously extend to the full convex hull without first controlling sup⁡x∈T∣⟨Ax,y⟩−w(T)∥y∥2∣\sup_{x\in T}|\langle Ax,y\rangle - w(T)\|y\|_2|supx∈T​∣⟨Ax,y⟩−w(T)∥y∥2​∣ uniformly over both x∈Tx\in Tx∈T and yyy on the unit sphere of the target space — a two-parameter supremum. The book's actual route goes through Chevet's inequality, itself proved using the matrix deviation inequality's own chaining-based argument, to control this two-sided supremum, and then converts the resulting inequality into the containment (1−ε)B⊆conv(AT)⊆(1+ε)B(1-\varepsilon)B\subseteq\mathrm{conv}(AT)\subseteq(1+\varepsilon)B(1−ε)B⊆conv(AT)⊆(1+ε)B via a support- function duality argument (a convex body is pinned down by its support function, so bounding sup⁡x∈T⟨Ax,y⟩\sup_{x\in T}\langle Ax,y\ranglesupx∈T​⟨Ax,y⟩ uniformly over yyy on the sphere is exactly what is needed).

Formalization scope

A is Ω → Matrix (Fin m) (Fin n) ℝ with an explicit IsGaussianMatrix hypothesis (entries i.i.d. N(0,1)N(0,1)N(0,1), formalized entrywise with joint independence). conv(AT) is convexHull ℝ of the image of T under A's mulVec, round-tripped through EuclideanSpace's continuous linear equivalence with the underlying function type. w(T) reuses this mission series' ExpSup/GaussianWidth convention (redefined locally, per the drafts-cannot-import-drafts rule, following the same ProbabilityTheory.stdGaussian-based realization of a standard Gaussian vector as 08-matrix-deviation). The stable dimension d(T)d(T)d(T) is formalized directly as w(T)2/diam(T)2w(T)^2/ \mathrm{diam}(T)^2w(T)2/diam(T)2 rather than via the book's literal (but only asymptotically equivalent, per Exercise 7.6.1) definition through a squared Gaussian width h(T−T)2h(T-T)^2h(T−T)2 — the goal theorem's own proof uses only the inequality direction of that equivalence, and the goal's hypothesis already carries an unpinned absolute constant that absorbs the equivalence constant, so this substitution preserves the theorem's exact truth content (see StableDimension's own doc-comment and MODERATION_NOTES.md for the full argument) rather than approximating it.

Ball-center deviation, disclosed. The book's printed theorem statement carries no hypothesis that TTT contains the origin; its proof opens by translating TTT so that it does ("Translating TTT if necessary, we can assume that TTT contains the origin"), and Remark 11.3.4 then confirms the ball is centered at the origin in that case. This mission states the WLOG-reduced case directly — adding 0∈T0\in T0∈T as an explicit hypothesis — rather than also formalizing the translation argument that recovers the fully general (untranslated) statement. This is disclosed as a genuine narrowing of the literal printed statement, though not of what the book's own proof actually establishes.

This mission covers Theorem 11.3.3 only, with no milestones: BRIEF.md explicitly instructs that if the chapter's full proof chain (general matrix deviation inequality, Chevet's inequality, random projections of sets — Theorems 11.1.5, 11.2.4, 11.3.1) proves too heavy for the session, milestones should be cut rather than the goal substituted. All three are left out, not approximated, given this chapter's five from-scratch definitions already needed for the goal's own statement. ExpSup, GaussianWidth, StableDimension and IsGaussianMatrix are reusable by any later development needing Gaussian width, the stable dimension, or a Gaussian random matrix. Solvers' contributions are welcome on the goal theorem itself and, beyond this mission's current scope, on the three named milestones.

Selected references

  • A. Dvoretzky, Some results on convex bodies and Banach spaces, Proc. Internat. Sympos. Linear Spaces (Jerusalem, 1960), 123–160.
  • V. D. Milman, A new proof of A. Dvoretzky's theorem on cross-sections of convex bodies, Funkcional. Anal. i Priložen. 5 (1971), 28–37.
  • R. Vershynin, High-Dimensional Probability: An Introduction with Applications in Data Science, Cambridge University Press, 2018, Chapter 11. https://doi.org/10.1017/9781108231596
5 thms1 active userReviewed
PreviousPage 2 of 2Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me