Graph Sparsification by Effective Resistances 1: Sampling O(n log n/ε²) Edges by Effective Resistance Yields a (1±ε) Spectral Sparsifier with Probability 1/2Research Paper
Motivation
Many graph algorithms run in time proportional to the number of edges. A sparsifier of a weighted graph is a graph on the same vertices with far fewer edges that approximates for the purpose at hand, so that the algorithm can be run on instead. Benczúr and Karger (1996) showed that every graph has a sparsifier with edges preserving the weight of every cut up to a factor . Spielman and Teng (2004) introduced the stronger spectral notion, in which the Laplacian quadratic form is preserved for every real vector, not only for cut indicators; their sparsifiers had edges for a large constant and were the first step of their nearly-linear-time solvers for symmetric diagonally dominant linear systems.
Spielman and Srivastava (arXiv:0803.0929, STOC 2008, SIAM J. Comput. 2011) proved that independent sampling of edges, each edge with probability proportional to its weight times its effective resistance, yields a spectral sparsifier. The result improved both earlier bounds, replaced a recursive partitioning construction by a one-line sampling rule, and made effective resistance a standard tool in graph algorithms. Batson, Spielman and Srivastava (arXiv:0808.0163) later obtained edges deterministically, by a slower method built on the same matrix .
Setting
Let be a connected weighted undirected graph with vertices, edges and weights . Orient every edge arbitrarily, so that it has a head and a tail (distinct vertices).
- The incidence matrix has if is the head of , if is its tail, and otherwise; denotes its row for . is the diagonal matrix with .
- The Laplacian is , with quadratic form .
- is the Moore–Penrose pseudoinverse of : if over its nonzero eigenvalues, then .
- The effective resistance of the edge is : the potential difference across when a unit current enters at one end and leaves at the other, the edges being resistors of conductance .
- is an matrix with .
- Sparsify draws edges independently with replacement, the edge with probability , and gives the weight for each time it is drawn. Its output has Laplacian , where is the random diagonal matrix with .
Formalization targets
Goal: Theorem 1
There are an absolute constant and a threshold such that, for every , every connected weighted graph on vertices and every , with , with probability at least
The constant is left unfixed; the statement asserts the shape with the paper's explicit dependence on .
Milestones
- Lemma 3 (four parts): is an orthogonal projection; ; the eigenvalues of are with multiplicity and with multiplicity ; .
- Lemma 4: for a nonnegative diagonal , implies for all .
- Lemma 5 (Rudelson–Vershynin): for independent samples of a random vector with and , and ,
Significance
Theorem 1 says that every weighted graph is spectrally approximated by a reweighted subgraph with edges. A spectral approximation preserves cut weights, the eigenvalues of the Laplacian up to , effective resistances, and the condition number of as a preconditioner, so any algorithm whose output depends on these quantities can run on . Combined with fast approximate computation of effective resistances (the second mission of this series), it gives a nearly-linear-time construction, and it is the sampling step used in Laplacian solvers, in sparsification of sums of rank-one matrices, and in leverage-score sampling for regression, where is exactly the statistical leverage of a row.
The result is proved in the paper; to our knowledge no machine-checked proof exists. This mission formalizes the statement and the paper's proof structure: the linear algebra of (Lemma 3), the deterministic reduction from quadratic forms to a spectral-norm bound (Lemma 4), and the matrix concentration inequality (Lemma 5), which is the substantive analytic input and is itself a reusable result about sums of independent rank-one matrices.
Difficulty
The deterministic part is linear algebra over the pseudoinverse. The obstacle is concentration: the expected Laplacian of equals , but bounding the deviation uniformly over all is a statement about the spectral norm of a random matrix, and a union bound over a net of directions costs a factor of in the sample count rather than . Scalar Chernoff bounds per cut, which suffice for cut sparsifiers, do not give the spectral statement. Lemma 5 is the matrix inequality that removes this loss, and no inequality of this kind (a concentration bound for the spectral norm of a sum of independent random matrices) is in Mathlib.
Formalization scope
All declarations sit in the namespace EffResSparsify.Sampling.
- Graphs. A structure
WGraph V Ewith orientation mapshead,tail : E → V, weightsw : E → ℝ, and the fieldshead e ≠ tail e(no loops) and0 < w e. Parallel edges are allowed; nothing in §3 uses simplicity. Connectivity is a separate hypothesis on the underlying simple graph and includes . In Theorem 1 the vertex type isFin n; the edge type is an arbitrary finite type. - Pseudoinverse. is the matrix of the published Moore–Penrose pseudoinverse
HarmonicGames.Decomposition.pinvof on Euclidean ; it equals the spectral formula above and is the gauge-fixed inverse, never "some solution of ". - Sampling. is defined as ; the identity is part of the proof. An outcome of Sparsify is a sequence in with probability , and probabilities and expectations are finite sums over , with no measure theory.
- Norms and logarithms. is the operator norm on matrices (
Matrix.Norms.L2Operator); vector norms in Lemma 5 are Euclidean; is natural (the base is absorbed into ). - Constants. In Theorem 1, precede the graph and ; the sample count is , rounded up because the printed value is not an integer. In Lemma 5, precedes the dimension, the distribution, and .
- Corrected statement. Lemma 5 as printed, with right side , is false (at the bound is ). The formal milestone is Rudelson and Vershynin's own Theorem 3.1: , and the bound holds when . It is stated for finitely supported distributions, which is all Theorem 1 uses. Theorem 1 applies it with , so the correction does not affect the goal.
- Not a trivialization. Theorem 1 does not take Lemma 5, a bound on , or a free sample count as a hypothesis; a statement with any of these, or with "" in place of , is a different theorem.
Reusable beyond this mission: the weighted Laplacian with its pseudoinverse and effective resistances, and Lemma 5, which applies to any sampling scheme for sums of rank-one matrices (leverage-score sampling, column subset selection). Contributions toward a matrix Chernoff or Rudelson-type inequality in Mathlib are welcome.
Selected references
- D. A. Spielman, N. Srivastava, Graph Sparsification by Effective Resistances, arXiv:0803.0929v4, 2009; SIAM J. Comput. 40(6), 2011. https://arxiv.org/abs/0803.0929, https://doi.org/10.1137/080734029
- M. Rudelson, R. Vershynin, Sampling from large matrices: an approach through geometric functional analysis, J. ACM 54(4), 2007. https://doi.org/10.1145/1255443.1255449
- M. Rudelson, Random vectors in the isotropic position, J. Funct. Anal. 164(1), 1999. https://doi.org/10.1006/jfan.1998.3384
- A. A. Benczúr, D. R. Karger, Approximating s-t minimum cuts in Õ(n²) time, STOC 1996. https://doi.org/10.1145/237814.237827
- D. A. Spielman, S.-H. Teng, Spectral sparsification of graphs, SIAM J. Comput. 40(4), 2011 (arXiv:0808.4134). https://arxiv.org/abs/0808.4134
- J. Batson, D. A. Spielman, N. Srivastava, Twice-Ramanujan sparsifiers, SIAM J. Comput. 41(6), 2012 (arXiv:0808.0163). https://arxiv.org/abs/0808.0163