Continuous-time convergence without aperiodicity
ProvedMarkovMixing.heat_kernel_convergenceLet be an irreducible Markov chain on a finite state space — aperiodicity is not assumed — with stationary distribution . The heat kernel at real time is
the law at time of the walk taking -steps at the arrival times of a rate-one Poisson clock. Write for the total variation distance and .
The theorem (Theorem 20.1 of Levin–Peres–Wilmer) asserts:
Every irreducible finite chain converges in continuous time — the periodicity obstruction that forces the aperiodicity hypothesis in the discrete Convergence Theorem (Mission II) simply disappears, because the Poisson number of completed jumps spreads over all residue classes: for every , so the continuous chain is automatically "aperiodic". This is the basic payoff of the continuous-time formalism and the reason laziness can always be traded for Poissonization.
import Definitions.Def_mm_continuous
namespace MarkovMixing
/-- **Theorem 20.1** (LPW): for an irreducible chain — aperiodicity is *not*
needed — the heat kernel converges to the stationary distribution:
`max_x ‖H_t(x,·) − π‖_TV → 0` as `t → ∞`. -/
theorem heat_kernel_convergence {V : Type*} [Fintype V] [DecidableEq V]
[Nonempty V] (P : Matrix V V ℝ) (hP : IsStochastic P)
(hirr : Irreducible P) (π : V → ℝ) (hπ : IsStationary P π) :
Filter.Tendsto (fun t : ℝ => contDistStationary P π t)
Filter.atTop (nhds 0) := by
sorry
end MarkovMixing