Theorem 11.2 -- the Matthews upper bound on cover times
ProvedMarkovMixing.matthews_uppermarkov-chainsmixing-timesprobability
Let be an irreducible Markov chain on a finite state space with states. Write for the expected number of steps to reach from , and define the two extremal quantities
where is the cover time — the first time the chain has visited every state — so is the worst-case expected time to see the whole state space.
The theorem (the Matthews method, Theorem 11.2 of Levin–Peres–Wilmer) asserts:
Covering costs at most a harmonic-sum factor beyond the worst single hitting time. The proof is a striking randomization trick: reveal the states in uniformly random order and bound the expected extra time to collect each new one; the -th freshly revealed state is the last of to be visited with probability .
Preamble
import Definitions.Def_mm_network
Formal statement
namespace MarkovMixing
/-- **Theorem 11.2, the Matthews method** (LPW): for an irreducible chain on
`n` states, `t_cov ≤ t_hit (1 + 1/2 + ⋯ + 1/n)`. -/
theorem matthews_upper {V : Type*} [Fintype V] [DecidableEq V] [Nonempty V]
(P : Matrix V V ℝ) (hP : IsStochastic P) (hirr : Irreducible P) :
coverTimeMax P ≤
hitTimeMax P * ∑ k ∈ Finset.Icc 1 (Fintype.card V), (1 : ℝ) / k := by
sorry
end MarkovMixing
Source
D. A. Levin, Y. Peres, E. L. Wilmer, Markov Chains and Mixing Times, AMS 2009, https://documents.epfl.ch/groups/i/ip/ipg/www/2013-2014/Random_Walks/markovmixing.pdf, Section 11.2, Theorem 11.2, pp. 143-144