Eq. (50): a.s.
ProvedStochApproxDyn.WeakAPT.shifted_martingale_slln_eq50law-of-large-numbersmartingalesp2o-batch-pfp1ap2o-gran-per-chapterp2o-plan-paperp2o-v1stochastic-approximation
Let be a probability space with a filtration , let be a separable metric space with its Borel -algebra, and let be progressively measurable. Let be uniformly continuous, let , and let for . Then, almost surely,
This is the analogue of (47) with conditioning two windows back instead of one; together with (51) it lets one compare the block integrals of in window with those of in window .
Formalization Note Only progressive measurability of is assumed; condition (ii) of a weak asymptotic pseudotrajectory is not needed. Conditional expectations are Mathlib's condExp; the index runs over and is evaluated at only.
Preamble
import Mathlib import Definitions.Def_StochApproxDyn_WeakAPT_WeakAsymptoticPseudotrajectory import Definitions.Def_StochApproxDyn_WeakAPT_BlockIntegral
Formal statement
namespace StochApproxDyn.WeakAPT
open MeasureTheory Filter Topology
open scoped NNReal
/-- Benaïm (1999), §10, proof of Theorem 10.1, Eq. (50), p. 62: for a progressively measurable
process `X`, a uniformly continuous `f : M → [0, 1]` and `T > 0`, almost surely
`(1/n) ∑_{i=1}^n [U_{i+1}(f,T) - E(U_{i+1}(f,T) | 𝓕_{(i-1)T})] → 0`. -/
theorem shifted_martingale_slln_eq50
{Ω M : Type*} {m0 : MeasurableSpace Ω} [MetricSpace M] [TopologicalSpace.SeparableSpace M]
[MeasurableSpace M] [BorelSpace M]
(P : Measure Ω) [IsProbabilityMeasure P] (ℱ : Filtration ℝ≥0 m0) (X : ℝ≥0 → Ω → M)
(hX : IsProgressivelyMeasurable ℱ X)
(f : M → ℝ) (hf : UniformContinuous f) (hf01 : ∀ y, f y ∈ Set.Icc (0 : ℝ) 1)
(T : ℝ≥0) (hT : 0 < T) :
∀ᵐ ω ∂P, Tendsto
(fun n : ℕ => (1 / (n : ℝ)) * ∑ i ∈ Finset.Icc 1 n,
(blockIntegral X f T (i + 1) ω -
(P[blockIntegral X f T (i + 1) | ℱ (((i - 1 : ℕ) : ℝ≥0) * T)]) ω))
atTop (𝓝 0) := by sorry
end StochApproxDyn.WeakAPT
Source
Benaïm, Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités XXXIII, LNM 1709 (1999), DOI 10.1007/BFb0096509, Section 10, proof of Theorem 10.1, p. 62 (PDF p. 63), Eq. (50)
Human review
Confirmed by the mission captain (proposal self-audit).
Confirmed by the moderator at approval.