Let 1≤r≤k be integers and let G be an r×k random matrix with independent standard normal entries. Let
λmin(GG⊤)=x∈Rr, ∥x∥2=1minx⊤GG⊤x=σmin(G⊤)2
be the smallest eigenvalue of the r×r Wishart matrix GG⊤, where σmin(G⊤)=inf∥x∥2=1∥G⊤x∥2 is the smallest singular value of the tall k×r matrix G⊤. Then for every t>0,
P{λmin(GG⊤)≤t}≤Γ(k−r+2)1(2t(k+r))(k−r+1)/2.
The bound comes from Edelman's estimate for the density of λmin,
fλmin(λ)≤Γ(2r)Γ(k−r+1)2(k−r−1)/2Γ(2k+1)λ(k−r−1)/2e−λ/2,λ>0,
after dropping e−λ/2, bounding 2(k−r+1)/2Γ(2k+1)/Γ(2r)≤((k+r)/2)(k−r+1)/2 (via Γ(z+21)≤z1/2Γ(z) and (r+i)(k−i)≤((k+r)/2)2), and integrating over (0,t].
This is the key probabilistic input for the tail of ∥G†∥=λmin(GG⊤)−1/2 (Chen–Dongarra / Halko–Martinsson–Tropp Prop. A.3) and for the inverse moments E∥(GG⊤)−1∥p (Tropp–Webber Lemma B.3).
Formalization Note. The law of G is gaussianMatrix r k on Fin r → Fin k → ℝ; λmin(GG⊤) is written sMin (Matrix.of G)ᵀ ^ 2. The hypothesis r≥1 is necessary: for r=0 the sphere in R0 is empty, sMin is 0 and the event is the whole space, while the right-hand side is <1 for small t. Γ is Real.Gamma and the exponent is a real power.
Source
A. Edelman, Eigenvalues and condition numbers of random matrices, SIAM J. Matrix Anal. Appl. 9(4) (1988), Prop. 5.1 (density bound for λ_min of a Wishart matrix); combined as in J. A. Tropp and R. J. Webber, Randomized algorithms for low-rank matrix approximation: design, analysis, and applications, arXiv:2306.12418, Appendix B, proof of Lemma B.3, eqs. (B.5)–(B.7); the statement is eq. (B.7).