Geometric Bounds for Eigenvalues of Markov Chains 2: Odd Closed Paths Bound the Smallest Eigenvalue, β_min ≥ −1 + 2/ιResearch Paper
Motivation
The speed at which a finite reversible Markov chain approaches its stationary distribution is controlled by its eigenvalues. For a chain with eigenvalues , the distance to stationarity after steps is governed by , where (Diaconis and Stroock 1991, Proposition 3). Upper bounds on the second eigenvalue are the familiar half of this picture, and they are what Cheeger-type and Poincaré inequalities provide. The other half is the smallest eigenvalue : a chain whose smallest eigenvalue is close to oscillates almost periodically and mixes slowly whatever is. A chain is aperiodic exactly when , but that qualitative fact gives no rate.
Diaconis and Stroock's paper gives geometric bounds for both ends of the spectrum, expressed through systems of paths in the graph of the chain. Their bound on uses closed paths with an odd number of edges, the combinatorial witnesses of aperiodicity. The paper has been a standard reference for path (canonical-path, multicommodity-flow) methods in the analysis of Markov chain Monte Carlo since its publication.
Timeline:
- 1988–1989, Jerrum and Sinclair: conductance (Cheeger-type) bounds on for chains on combinatorial structures.
- 1991, Diaconis and Stroock: path bounds for (Proposition 1, the Poincaré inequality ) and for (Proposition 2, this mission), with the specializations to random walks on graphs (Corollaries 1 and 2).
Setting
Let be a finite set and the transition matrix of an irreducible Markov chain on , reversible with respect to a probability distribution :
The operator is self-adjoint on , with inner product , so its eigenvalues are real. Write and let be the smallest eigenvalue of .
The graph of the chain has vertex set , an edge from to when , and a self-loop at when . An odd closed path at is a sequence of edges from back to , with an odd number of edges, in which no directed edge is traversed twice. Its length is
A system of odd paths chooses one such path for every point, and its load is
the maximum over directed edges of the weighted length of the paths through (display (1.7) of the paper).
For the random walk on a graph , when , with the degree, and . There is the maximum degree, the largest number of edges of a path in , and .
Formalization targets
Goal: Proposition 2
For an irreducible, aperiodic, reversible chain and every system of odd closed paths,
Milestones (the steps of the paper's proof)
- The identity (1.8): .
- Along an odd closed path : .
- For every : .
- Every eigenvalue of satisfies .
Companions
- Corollary 2. For the random walk on a connected, non-bipartite graph and any system of odd paths, .
- Remark 1.3. With odd paths for every ordered pair and : .
Significance
Proposition 2 turns aperiodicity into a number. With Proposition 1, which bounds through paths between pairs of points, it bounds the absolute spectral gap entirely in terms of path geometry, and so bounds the variation distance to stationarity through Proposition 3. Corollary 2 is the form most often applied: for a random walk on a non-bipartite graph, a choice of short odd cycles that do not crowd any single edge certifies that the walk does not oscillate.
Proposition 2 and its corollary are proved in the paper. As far as a search of the platform shows, no machine-checked proof exists. The platform already has the vocabulary (stochastic matrices, stationarity, reversibility, eigenvalues and the inner product, from the published Levin–Peres–Wilmer layer) and the qualitative fact that is not an eigenvalue of an irreducible aperiodic chain. This mission adds the quantitative bound, the identity (1.8), and the path inequality, all reusable for other path-based eigenvalue estimates.
Difficulty
Each step is elementary, but the bookkeeping is where a proof can go wrong. The Cauchy–Schwarz step is applied along each path separately, and the resulting double sum over points and over the edges of their paths must be exchanged into a sum over edges. That exchange is exact only if each path traverses each directed edge at most once. A path that crosses an edge twice contributes twice, while counts it once. Self-loops are edges here, and the sum over directed edges in the last step must match the sum over ordered pairs , including , in the identity (1.8). The alternating signs work only because the number of edges is odd; an even closed path cancels instead of doubling it.
The bound is also only as good as the chosen paths: short odd cycles that spread their load over many edges give a small , and the choice of is part of every application.
Formalization scope
The chain is a real matrix P : Matrix V V ℝ on a Fintype V, with the published predicates IsStochastic, Irreducible, Aperiodic, IsStationary (which includes that is a probability vector) and DetailedBalance. is edgeMeasure, the inner product innerPi, eigenvalues IsEigenvalue (a real eigenvalue with a nonzero real eigenfunction). is the infimum of the real eigenvalues of , a minimum for a stochastic matrix on a nonempty set.
Paths are vertex lists. A path traverses the directed edges between consecutive vertices, each with . The paper defines "by analogy with (1.4)", whose paths may not repeat an edge. For the directed edges of §1C this rule is read as "no directed edge twice". Under the unordered reading a vertex of degree one would have no odd closed path, contradicting the page's remark that such paths always exist for irreducible aperiodic chains. is a real supremum over the finite set of directed edges with , and it is only when there is no edge. A system of odd paths on a nonempty set excludes that case, so the bound is never reduced to by . The system is a universally quantified hypothesis of every statement, never an existential one. No milestone assumes the inequality of milestone 3 or the identity (1.8) as a hypothesis. No assumption is made.
Milestones 3 and 4 do not assume aperiodicity: the existence of an odd path system implies it. The identity (1.8) assumes only stochasticity and stationarity. Corollary 2 assumes only that the graph is connected and not 2-colorable; the chain properties follow from these. In Corollary 2, counts paths through a directed edge, which is at most the count through the unordered edge, so the stated bound implies the one with the unordered count. Only the first half of Remark 1.3 is stated; its second half needs Proposition 1's quantity, which belongs to another mission of the series.
Contributions welcome: proofs of the milestones in order, a general Cauchy–Schwarz-along-paths lemma shared with the Poincaré inequality, and the existence of odd path systems for irreducible aperiodic chains.
Selected references
- P. Diaconis and D. Stroock, Geometric bounds for eigenvalues of Markov chains, Ann. Appl. Probab. 1(1):36–61, 1991. https://doi.org/10.1214/aoap/1177005980
- A. Sinclair and M. Jerrum, Approximate counting, uniform generation and rapidly mixing Markov chains, Inform. and Comput. 82(1):93–133, 1989. https://doi.org/10.1016/0890-5401(89)90067-9
- D. A. Levin, Y. Peres and E. L. Wilmer, Markov Chains and Mixing Times, American Mathematical Society, 2009 (2nd ed. 2017). https://doi.org/10.1090/mbk/107