The asymptotic variance exists in
ProvedTierneyMH.Peskun.asymptotic_variance_existsmarkov-chainsmcmcp2o-batch-p200bp2o-gran-per-chapterp2o-plan-paperp2o-v1probability
Let be a probability measure on a measurable space , let be a Markov kernel reversible with respect to , let , and let be the Markov chain with initial distribution and kernel . Then the limit
exists in ; it may be .
This justifies the definition of the asymptotic variance used in Theorem 4. By Kipnis and Varadhan (1986), a central limit theorem holds for when the limit is finite.
Formalization Note The variance is Mathlib's extended variance with values in and the division by is carried out in ; the term at is and does not affect the limit. The page reads "The limit is guaranteed to exit", a misprint for "exist".
Preamble
import Mathlib import Definitions.Def_TierneyMH_Peskun_chainMeasure open MeasureTheory ProbabilityTheory Filter open scoped ENNReal Topology
Formal statement
namespace TierneyMH.Peskun
/-- **Proof of Theorem 4** (Tierney 1998, p. 6): the limit defining the asymptotic variance
exists, possibly infinite. For a reversible Markov kernel `H` with invariant distribution `π`,
`f ∈ L²₀(π)` and the chain `X₀, X₁, …` started from `π`, the sequence
`(1/n) Var_H(∑_{i=1}^{n} f(X_i))` converges in `[0, ∞]`. The variance is Mathlib's
`ℝ≥0∞`-valued `evariance`, and the division is in `ℝ≥0∞`; its value at `n = 0` (`0 / 0 = 0`)
does not affect the limit. (The page says "guaranteed to exit", a slip for "exist".) -/
theorem asymptotic_variance_exists {E : Type*} [MeasurableSpace E]
(π : Measure E) [IsProbabilityMeasure π]
(H : Kernel E E) [IsMarkovKernel H] (hH : Kernel.IsReversible H π)
(f : E → ℝ) (hf_meas : Measurable f) (hf : MemLp f 2 π) (hf0 : ∫ x, f x ∂π = 0) :
∃ v : ℝ≥0∞, Tendsto (fun n : ℕ => evariance (pathSum f n) (chainMeasure π H) / n)
atTop (𝓝 v) := by sorry
end TierneyMH.Peskun
Source
L. Tierney, A Note on Metropolis–Hastings Kernels for General State Spaces, Ann. Appl. Probab. 8(1) (1998) 1–9, DOI 10.1214/aoap/1027961031, p. 6, proof of Theorem 4 (first sentence)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.