Logarithmic Sobolev Inequalities for Finite Markov Chains 5: The Log-Sobolev Constant of K(x, y) = π(y) Is (1 − 2π_)/log(1/π_ − 1)Research Paper
Motivation
The log-Sobolev constant of a finite Markov chain controls how fast the chain forgets its starting point in relative entropy and in , and it gives sharper mixing-time bounds than the spectral gap when the stationary distribution has very small atoms. Diaconis and Saloff-Coste (Ann. Appl. Probab. 6 (1996)) made this constant a standard tool for finite chains. A practical obstacle runs through their paper: is defined by a nonlinear variational problem, and exact values are known for very few chains. Lower bounds on for a complicated chain are usually obtained by comparison with a simple chain whose constant is known exactly.
The Appendix of that paper computes such a reference value. For the chain that forgets its state in one step, , it determines in closed form for every positive , and with it the log-Sobolev constant of every chain on two points and of the random walk on the complete graph.
Timeline. Rothaus's work on log-Sobolev inequalities (references [38–40] of the paper) studied the constant through its minimizers, the approach the Appendix follows. Diaconis and Saloff-Coste (1996) give the formula , and note that Higuchi and Yoshida independently found the asymmetric two-point value.
Setting
Let be a finite set and a Markov kernel on it: and . Let be an invariant probability, , with for every . Functions on are real. Write , , , and .
The Dirichlet form is . The entropy functional is
which is nonnegative and vanishes exactly when is constant. The spectral gap and the log-Sobolev constant are
Equivalently, is the best constant in .
The chain of the mission is : at each step it draws a fresh point from , ignoring its current state. Its invariant measure is , and is its smallest atom. In Lean the objects are dirichlet, entL, gap, logSobolev, indepChain and piMin in the namespace LogSobolevMC.TwoPoint.
Formalization targets
Goal: Theorem A.1
For a positive probability on with , the chain has
and in particular, for with , . The goal is an equality, so it contains both a log-Sobolev inequality with this constant and the existence of functions that make it sharp.
Milestones
- Lemma 3.1: for every chain.
- (proof of Theorem A.1).
- Either , or the infimum is attained at a nonconstant nonnegative function (proof of Theorem A.1).
- (A.3): a positive minimizer of a reversible chain satisfies .
- (A.1): the explicit pair , solves the two-equation system of the proof of Theorem A.2.
- Theorem A.2: the two-point chain with both rows , , has , with the limit value at .
Consequences
Corollary A.3 (every two-point chain), Corollary A.4 ( for every finite chain) and Corollary A.5 (the complete graph, , and on ).
Significance
The result. Theorem A.1 is one of the few exact log-Sobolev constants known for a whole family of chains. Since this chain has , the formula shows that can be smaller than by a factor of order , which answers the question on p. 715 of how far and can be apart. Corollary A.4 turns this into a general tool: any spectral gap bound gives a log-Sobolev bound, losing only a factor . Corollary A.3 settles every chain on two points, and Corollary A.5 gives the complete graph, a frequent reference chain for comparison arguments.
Formalizing it. These results are proved in the paper. To our knowledge none of them, nor the log-Sobolev constant of a finite Markov chain itself, has a machine-checked formalization. The mission produces the definitions of , , and for finite chains, and exact values that later comparison arguments can cite.
Difficulty
The upper bound needs only a good test function. The lower bound is the hard part: it is a statement about every function on , and is neither quadratic nor convex. The obvious route, comparing with the spectral gap, loses exactly the logarithmic factor the theorem is about. Reducing to two-valued functions requires the infimum to be attained and analysed through its minimizers. The two-point problem that remains is a one-parameter inequality on an interval. The authors describe its solution as a calculus exercise that depended on numerical guessing, and it has removable singularities at .
Formalization scope
is a Fintype with decidable equality. is a Matrix V V ℝ and a function V → ℝ. Stochasticity, invariance, distributions and reversibility are the published MarkovMixing predicates (IsStochastic, IsStationary, IsDist, DetailedBalance) from mm_basic, and is MarkovMixing.distVar from mm_lower. Positivity of is a hypothesis throughout, as in §2.1. The infima and are Lean sInfs over exactly the sets of (2.4) and (3.1). is the bilinear form . is the variational gap, not the eigenvalue-based MarkovMixing.spectralGap, which agrees with it only for reversible chains.
Disclosed additions, all at removable singularities of the printed formulas: in Theorem A.1 (and in its uniform case); the explicit limit value at in Theorem A.2; strict in Corollary A.3; and in Corollary A.5. In (A.3), reversibility, positivity of and are added. Irreducibility is not assumed anywhere.
Trivializing formalizations are ruled out. A closed form evaluated at would be Lean's value , so each such case is excluded or replaced by its limit. Real.log of a nonpositive number and an sInf over an empty or unbounded set do not occur under the stated hypotheses. Dropping the positivity or invariance of , or replacing by the eigenvalue gap, would change the statements. Stating the goal for two points only, or assuming the minimizer is two-valued, would state a step of the proof.
Contributions welcome: the general facts , and the existence of minimizers are reusable for every log-Sobolev development on finite spaces. The two-point calculus of Theorem A.2 is self-contained real analysis.
Selected references
- P. Diaconis and L. Saloff-Coste, Logarithmic Sobolev inequalities for finite Markov chains, Ann. Appl. Probab. 6(3):695–750, 1996. https://doi.org/10.1214/aoap/1034968224
- D. A. Levin, Y. Peres and E. L. Wilmer, Markov Chains and Mixing Times, AMS, 2009 (source of the
MarkovMixingdefinitions used here). https://doi.org/10.1090/mbk/058