Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Stochastic Systems

434 missions · 142 completed

The mathematics of systems that evolve under randomness, modeled as families of random variables indexed by time — from Markov chains and martingales to Brownian motion and stochastic differential equations. The field spans stochastic analysis, filtering and optimal control under uncertainty, ergodic behavior of random dynamics, and concentration of measure, with models reaching across physics, engineering, finance, and biology.

Missions

Open292Completed142All434
AnalysisProbability·Captain: mikedeng1

On Well-Posedness of Forward–Backward SDEs—A Unified Approach 1: Under Cases I–III the FBSDE Has a Decoupling Field with Bounded Difference Quotients and a Unique L² Solution on [0, T]Research Paper

Motivation

A forward–backward stochastic differential equation (FBSDE) couples a forward SDE, solved from an initial state, with a backward SDE, solved from a terminal condition that depends on the forward state. Such systems arise from the stochastic maximum principle, from quasilinear parabolic PDEs through Feynman–Kac formulas, and in mathematical finance. Whenever a control problem or a market model is solved through its first-order conditions, a fully coupled FBSDE appears, and the question is whether it has a unique solution.

The history has a recurring gap: each method covers a different regime, and none handles coefficients that are random, fully coupled, and have a forward diffusion depending on the martingale integrand ZZZ, over an arbitrary horizon.

  • 1993: F. Antonelli proved well-posedness over a small time interval by contraction, under a smallness condition on the coupling.
  • 1994: J. Ma, P. Protter and J. Yong introduced the four-step scheme, solving Markovian FBSDEs with deterministic coefficients over arbitrary horizons through a quasilinear PDE; the forward diffusion may not depend on zzz in a degenerate way.
  • 1995–1999: Y. Hu, S. Peng and Z. Wu developed the method of continuation, which allows random coefficients over arbitrary horizons under a monotonicity condition on the coefficients.
  • 1999–2002: E. Pardoux and S. Tang, and F. Delarue, extended the PDE and fixed-point approaches under weak-coupling or strong-monotonicity conditions, in the Markovian setting.
  • 2015: J. Ma, Z. Wu, D. Zhang and J. Zhang (the source of this mission) gave a unified approach through the decoupling field and a scalar ordinary differential equation that dominates its spatial derivative.

Setting

Fix a horizon T>0T>0T>0 and a probability space carrying a one-dimensional Brownian motion BBB, with F\mathbb FF its natural filtration augmented by the null sets. All processes are real valued. The FBSDE (1.1) is

Xt=x+∫0tb(s,Θs) ds+∫0tσ(s,Θs) dBs,Yt=g(XT)+∫tTf(s,Θs) ds−∫tTZs dBs,X_t=x+\int_0^t b(s,\Theta_s)\,ds+\int_0^t\sigma(s,\Theta_s)\,dB_s,\qquad Y_t=g(X_T)+\int_t^T f(s,\Theta_s)\,ds-\int_t^T Z_s\,dB_s ,Xt​=x+∫0t​b(s,Θs​)ds+∫0t​σ(s,Θs​)dBs​,Yt​=g(XT​)+∫tT​f(s,Θs​)ds−∫tT​Zs​dBs​,

for t∈[0,T]t\in[0,T]t∈[0,T], with Θ=(X,Y,Z)\Theta=(X,Y,Z)Θ=(X,Y,Z). The coefficients b,σ,fb,\sigma,fb,σ,f depend on (t,ω,x,y,z)(t,\omega,x,y,z)(t,ω,x,y,z) and ggg on (x,ω)(x,\omega)(x,ω). Assumption 2.1 asks that they be progressively measurable for fixed (x,y,z)(x,y,z)(x,y,z), that I02=E{(∫0T[∣b∣+∣f∣](t,0,0,0)dt)2+∫0T∣σ∣2(t,0,0,0)dt+∣g(0)∣2}I_0^2=\mathbb E\{(\int_0^T[|b|+|f|](t,0,0,0)dt)^2+\int_0^T|\sigma|^2(t,0,0,0)dt+|g(0)|^2\}I02​=E{(∫0T​[∣b∣+∣f∣](t,0,0,0)dt)2+∫0T​∣σ∣2(t,0,0,0)dt+∣g(0)∣2} be finite, and that they be Lipschitz in (x,y,z)(x,y,z)(x,y,z) with a common constant K0K_0K0​, uniformly in ω\omegaω. Solutions are sought in the space L2\mathbb L^2L2 of progressively measurable Θ\ThetaΘ with ∥Θ∥L22=E{sup⁡t(∣Xt∣2+∣Yt∣2)+∫0T∣Zt∣2dt}<∞\|\Theta\|^2_{\mathbb L^2}=\mathbb E\{\sup_t(|X_t|^2+|Y_t|^2)+\int_0^T|Z_t|^2dt\}<\infty∥Θ∥L22​=E{supt​(∣Xt​∣2+∣Yt​∣2)+∫0T​∣Zt​∣2dt}<∞.

A decoupling field (Definition 2.2) is a random field u(t,x)u(t,x)u(t,x) with u(T,⋅)=gu(T,\cdot)=gu(T,⋅)=g such that, on every short interval [t1,t2][t_1,t_2][t1​,t2​] and from every square-integrable initial state, the FBSDE with terminal map u(t2,⋅)u(t_2,\cdot)u(t2​,⋅) is uniquely solvable and its solution satisfies Yt=u(t,Xt)Y_t=u(t,X_t)Yt​=u(t,Xt​).

The difference quotients (3.1) of the coefficients — b~i,σ~i,f~i\tilde b_i,\tilde\sigma_i,\tilde f_ib~i​,σ~i​,f~​i​ in the variables x,y,zx,y,zx,y,z (i=1,2,3i=1,2,3i=1,2,3) and h~\tilde hh~ for ggg — enter the scalar function

F=f1+f2y+y(b1+b2y)+(f3+b3y) y (σ1+σ2y)1−σ3y,F=f_1+f_2y+y(b_1+b_2y)+\frac{(f_3+b_3y)\,y\,(\sigma_1+\sigma_2y)}{1-\sigma_3y},F=f1​+f2​y+y(b1​+b2​y)+1−σ3​y(f3​+b3​y)y(σ1​+σ2​y)​,

and its essential supremum F‾(t,y)\overline F(t,y)F(t,y) and infimum F‾(t,y)\underline F(t,y)F​(t,y) over all quotients give the dominating ODEs (3.13): y‾t=h‾+∫tTF‾(s,y‾s)ds\overline y_t=\overline h+\int_t^T\overline F(s,\overline y_s)dsy​t​=h+∫tT​F(s,y​s​)ds and y‾t=h‾+∫tTF‾(s,y‾s)ds\underline y_t=\underline h+\int_t^T\underline F(s,\underline y_s)dsy​t​=h​+∫tT​F​(s,y​s​)ds, with h‾,h‾\overline h,\underline hh,h​ the bounds of h~\tilde hh~.

Formalization targets

Goal: Theorem 7.4

Fix c1,c2,c3c_1,c_2,c_3c1​,c2​,c3​ with c1>0c_1>0c1​>0, 0<c2<c30<c_2<c_30<c2​<c3​, c1c3<1c_1c_3<1c1​c3​<1 (5.13). There are ε>0\varepsilon>0ε>0 and C>0C>0C>0, depending only on TTT, K0K_0K0​ and c1,c2,c3c_1,c_2,c_3c1​,c2​,c3​, such that whenever Assumption 2.1 holds and the quotients satisfy one of the nine conditions of Cases I–III ((5.14); (5.15)–(5.18); (5.19)–(5.22)), uniformly in the quotient arguments, then (i) the FBSDE has a decoupling field uuu whose quotient (u(t,x1)−u(t,x2))/(x1−x2)(u(t,x_1)-u(t,x_2))/(x_1-x_2)(u(t,x1​)−u(t,x2​))/(x1​−x2​) obeys the bound assumed of h~\tilde hh~ with c2c_2c2​ replaced by c3c_3c3​, and (ii) for every xxx there is a unique solution in L2\mathbb L^2L2, with

∥Θ∥L22≤C [ ∣x∣2+I02 ].\|\Theta\|^2_{\mathbb L^2}\le C\,\big[\,|x|^2+I_0^2\,\big].∥Θ∥L22​≤C[∣x∣2+I02​].

Milestones

  • Lemma 5.1: comparison for scalar backward ODEs between a sub- and a super-solution.
  • Theorems 5.9, 5.10, 5.11: under each case, the dominating ODEs have bounded solutions with the bound of hhh transported to c3c_3c3​, and 1−σ3y1-\sigma_3y1−σ3​y stays away from 000.
  • Theorems 6.1, 6.2, 6.3: over a short horizon T≤δT\le\deltaT≤δ, unique solvability, solutions of (3.13) in a band, and a random field uuu whose quotients lie between y‾\underline yy​ and y‾\overline yy​.
  • Theorem 2.3: a decoupling field gives a unique global solution with Yt=u(t,Xt)Y_t=u(t,X_t)Yt​=u(t,Xt​).

A companion statement, Corollary 7.5, gives well-posedness over [0,T][0,T][0,T] under the sign conditions (7.5) or (7.6), with no smallness constant.

Significance

The theorem replaces structural assumptions (small horizon, monotonicity, deterministic coefficients, σ\sigmaσ independent of zzz) by conditions that can be read off the coefficients through a scalar ODE. It covers random coefficients and a forward diffusion that depends on zzz, the case in which the classical Riccati-type obstruction σ3h=1\sigma_3h=1σ3​h=1 appears, and it recovers the earlier sufficient conditions as special cases (§7.4 of the paper). The decoupling field produced in (i) is uniformly Lipschitz, which is the input to the comparison and stability results of §8 and to numerical schemes based on Yt=u(t,Xt)Y_t=u(t,X_t)Yt​=u(t,Xt​).

The result is proved in the paper; nothing here is open mathematically. None of it is formalized: there is no machine-checked existence theory for coupled FBSDEs in any proof assistant this mission is aware of. A complete development would be the first formal well-posedness theorem for a fully coupled FBSDE, and the milestones — the ODE comparison lemma, the small-time theory, and the patching argument of Theorem 2.3 — are each self-contained.

Difficulty

The obvious approach is a contraction argument on [0,T][0,T][0,T]. It works only when TTT is small, because the Lipschitz constant of the solution map grows with the coupling; iterating it over a partition requires a terminal condition u(ti,⋅)u(t_i,\cdot)u(ti​,⋅) whose Lipschitz constant does not deteriorate from one subinterval to the next. Controlling that constant is the whole problem. Its spatial derivative satisfies a backward stochastic Riccati equation with quadratic growth in both yyy and zzz and a singularity where 1−σ3y=01-\sigma_3y=01−σ3​y=0; such equations need not have bounded solutions, and the standard comparison theory for quadratic BSDEs does not apply off the region where the generator is Lipschitz. A second difficulty is the small-time theory itself: when σ\sigmaσ depends on zzz, even a linear FBSDE with constant coefficients is well posed on short intervals only if σ3h≠1\sigma_3h\ne1σ3​h=1 (Theorem 7.1 of the paper), so in Cases II and III, where σ3\sigma_3σ3​ and hhh are large, the contraction argument does not apply even for small TTT.

Formalization scope

The development reuses the platform's Peng1990.SMP.Stochastic (standard Brownian motion, LF2L^2_{\mathcal F}LF2​, the L2L^2L2 Itô integral IsItoIntegral) and the augmented Brownian filtration of ReflectedBSDE.Existence.Setting. Time is R≥0\mathbb R_{\ge0}R≥0​, time integrals are over real intervals, and the stochastic integral ∫t1tσ dB\int_{t_1}^t\sigma\,dB∫t1​t​σdB is Jt−Jt1J_t-J_{t_1}Jt​−Jt1​​ for an Itô integral process JJJ of 1(t1,t2]σ(s,Θs)\mathbf 1_{(t_1,t_2]}\sigma(s,\Theta_s)1(t1​,t2​]​σ(s,Θs​).

Committed conventions:

  • Lipschitz bounds use the ℓ1\ell^1ℓ1 norm on R3\mathbb R^3R3 and hold for every ω\omegaω; I02I_0^2I02​ and ∥Θ∥L22\|\Theta\|^2_{\mathbb L^2}∥Θ∥L22​ are lower Lebesgue integrals in [0,∞][0,\infty][0,∞].
  • Uniqueness is uniqueness in L2\mathbb L^2L2: X,YX,YX,Y agree a.s. at each time and ZZZ agrees dt⊗dPdt\otimes d\mathbb Pdt⊗dP-a.e.
  • Solutions are unique only up to modification, so (7.2) is asserted for one solution in L2\mathbb L^2L2.
  • Definition 2.2's "0=t1<t2≤T0=t_1<t_2\le T0=t1​<t2​≤T" is read as 0≤t10\le t_10≤t1​, as the proof of Theorem 2.3 uses it.
  • Every condition on the quotients holds for every t∈[0,T]t\in[0,T]t∈[0,T], almost surely, for all arguments with distinct coordinates. F‾(t,c)≤ε\overline F(t,c)\le\varepsilonF(t,c)≤ε is stated in exactly that form. F‾,F‾,h‾,h‾\overline F,\underline F,\overline h,\underline hF,F​,h,h​ as functions are EReal\mathrm{EReal}EReal-valued, and solutions of (3.13) keep them finite.
  • "(1−σ3y)−1(1-\sigma_3y)^{-1}(1−σ3​y)−1 is bounded" is ∣1−σ~3yt∣≥κ>0|1-\tilde\sigma_3y_t|\ge\kappa>0∣1−σ~3​yt​∣≥κ>0. Every use of α3=b2−b3σ2/σ3\alpha_3=b_2-b_3\sigma_2/\sigma_3α3​=b2​−b3​σ2​/σ3​ carries σ~3≠0\tilde\sigma_3\ne0σ~3​=0, and (5.19), (5.21) carry the heading σ3≠0\sigma_3\ne0σ3​=0 of Table 3 in the goal.
  • The quotient bounds on uuu hold for each ttt and each pair x1≠x2x_1\ne x_2x1​=x2​ almost surely.
  • Lemma 5.1 additionally assumes y1≤y2y^1\le y^2y1≤y2 and L≥0L\ge0L≥0, both implicit on the page.

The constants ε\varepsilonε, δ\deltaδ and CCC are chosen before the probability space and the coefficients. A formalization that places them after the coefficients, integrates without integrability, divides at the pole 1−σ3y=01-\sigma_3y=01−σ3​y=0, uses a real-valued essential supremum of an unbounded family, or states uniqueness without a solution class would make the statements vacuous or false; none of these is used.

Contributions are welcome on every milestone. The ODE layer (Lemma 5.1 and the a priori bounds of Theorems 5.9–5.11) needs only real analysis and is a natural first target. The stochastic layer needs Itô-integral facts (linearity, restriction to subintervals, the Burkholder–Davis–Gundy and Doob inequalities in L2L^2L2) and the Lipschitz BSDE theory; these are reusable well beyond this mission.

Selected references

  • J. Ma, Z. Wu, D. Zhang, J. Zhang, On well-posedness of forward–backward SDEs—a unified approach, Ann. Appl. Probab. 25(4):2168–2214, 2015. https://arxiv.org/abs/1110.4658
  • F. Antonelli, Backward–forward stochastic differential equations, Ann. Appl. Probab. 3(3):777–793, 1993. https://doi.org/10.1214/aoap/1177005363
  • J. Ma, P. Protter, J. Yong, Solving forward–backward stochastic differential equations explicitly — a four step scheme, Probab. Theory Related Fields 98:339–359, 1994. https://doi.org/10.1007/BF01192258
  • Y. Hu, S. Peng, Solution of forward–backward stochastic differential equations, Probab. Theory Related Fields 103:273–283, 1995. https://doi.org/10.1007/BF01204218
  • S. Peng, Z. Wu, Fully coupled forward–backward stochastic differential equations and applications to optimal control, SIAM J. Control Optim. 37(3):825–843, 1999. https://doi.org/10.1137/S0363012996313549
  • F. Delarue, On the existence and uniqueness of solutions to FBSDEs in a non-degenerate case, Stochastic Process. Appl. 99:209–286, 2002. https://doi.org/10.1016/S0304-4149(02)00085-6
  • J. Ma, J. Yong, Forward–Backward Stochastic Differential Equations and their Applications, Lecture Notes in Math. 1702, Springer, 1999. https://doi.org/10.1007/978-3-540-48831-6
14 thms1 active userReviewed
Markov ChainProbabilityStatistics·Captain: mikedeng1

Can Local Particle Filters Beat the Curse of Dimensionality?: The Block Particle Filter Has a Local Error Bound Uniform in Time and in the Model DimensionResearch Paper

Motivation

Nonlinear filtering asks for the conditional law of an unobserved Markov process given noisy partial observations of it. It is the computational core of data assimilation in weather forecasting, oceanography and geophysics, of target tracking, and of inference in large networked systems. The standard numerical method, the particle filter, replaces the conditional law by a cloud of NNN weighted samples. Its error is well understood in fixed dimension, but in practice it degrades exponentially in the dimension of the state: the number of particles needed for a fixed accuracy grows exponentially with the number of variables. This phenomenon, the curse of dimensionality of particle filters, has been documented empirically and analysed by Bickel, Li and Bengtsson and by Snyder et al. (Bickel–Li–Bengtsson 2008; Snyder et al. 2008), and it is a main obstacle to their use in high-dimensional data assimilation.

Rebeschini and van Handel (arXiv:1301.6585v2, Ann. Appl. Probab. 25(5), 2015) gave the first rigorous proof that a local variant of the particle filter, the block particle filter, has an approximation error that does not depend on the model dimension, for models with local interactions above a mixing threshold. The result is the standard theoretical reference for localization in sequential Monte Carlo.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite graph with graph distance ddd, and fix a neighbourhood size r≥1r\ge1r≥1. The rrr-neighbourhood of a vertex is N(v)={v′:d(v,v′)≤r}N(v)=\{v':d(v,v')\le r\}N(v)={v′:d(v,v′)≤r}, and the rrr-inner boundary of J⊆VJ\subseteq VJ⊆V is ∂J={v∈J:N(v)⊈J}\partial J=\{v\in J:N(v)\not\subseteq J\}∂J={v∈J:N(v)⊆J}. Each vertex carries a Polish state space Xv\mathbb X^vXv with a reference measure ψv\psi^vψv, and an observation space Yv\mathbb Y^vYv; write X=∏vXv\mathbb X=\prod_v\mathbb X^vX=∏v​Xv and ψ=⨂vψv\psi=\bigotimes_v\psi^vψ=⨂v​ψv.

The hidden process (Xn)n≥0(X_n)_{n\ge0}(Xn​)n≥0​ is a Markov chain on X\mathbb XX with transition density p(x,z)=∏vpv(x,zv)p(x,z)=\prod_{v}p^v(x,z^v)p(x,z)=∏v​pv(x,zv) with respect to ψ\psiψ, where each pv(x,zv)p^v(x,z^v)pv(x,zv) depends on xxx only through xN(v)x^{N(v)}xN(v) (locality). The observation YnY_nYn​ has density g(x,y)=∏vgv(xv,yv)g(x,y)=\prod_v g^v(x^v,y^v)g(x,y)=∏v​gv(xv,yv) given Xn=xX_n=xXn​=x. For a fixed observation sequence, the filter is the recursion

π0=δx,πn=CnPπn−1,\pi_0=\delta_x,\qquad \pi_n=\mathsf C_n\mathsf P\pi_{n-1},π0​=δx​,πn​=Cn​Pπn−1​,

where P\mathsf PP applies the transition kernel and Cn\mathsf C_nCn​ reweights by g(⋅,Yn)g(\cdot,Y_n)g(⋅,Yn​) and renormalizes (the Bayes formula).

A partition K\mathcal KK of VVV into blocks defines the blocking operator Bρ=⨂K∈KBKρ\mathsf B\rho=\bigotimes_{K\in\mathcal K}\mathsf B^K\rhoBρ=⨂K∈K​BKρ, which replaces a measure by the product of its block marginals. The block particle filter with NNN particles is

π^n=CnBSNPπ^n−1,\hat\pi_n=\mathsf C_n\mathsf B\mathsf S^N\mathsf P\hat\pi_{n-1},π^n​=Cn​BSNPπ^n−1​,

where SN\mathsf S^NSN replaces a measure by the empirical measure of NNN i.i.d. samples from it. The local quantities are ∣K∣∞=max⁡Kcard⁡K|\mathcal K|_\infty=\max_K\operatorname{card}K∣K∣∞​=maxK​cardK, Δ=max⁡vcard⁡N(v)\Delta=\max_v\operatorname{card}N(v)Δ=maxv​cardN(v), and ΔK=max⁡Kcard⁡{K′:d(K,K′)≤r}\Delta_{\mathcal K}=\max_K\operatorname{card}\{K':d(K,K')\le r\}ΔK​=maxK​card{K′:d(K,K′)≤r}. The error is measured locally:

∣∣∣ρ−ρ′∣∣∣J=sup⁡f∈XJ, ∣f∣≤1E[∣ρ(f)−ρ′(f)∣2]1/2,|||\rho-\rho'|||_J=\sup_{f\in\mathbb X^J,\,|f|\le1}\mathbf E\big[|\rho(f)-\rho'(f)|^2\big]^{1/2},∣∣∣ρ−ρ′∣∣∣J​=f∈XJ,∣f∣≤1sup​E[∣ρ(f)−ρ′(f)∣2]1/2,

where XJ\mathbb X^JXJ is the class of measurable functions depending only on the coordinates in JJJ.

Formalization targets

Goal: Theorem 2.1

There is 0<ε0<10<\varepsilon_0<10<ε0​<1 depending only on (Δ,ΔK)(\Delta,\Delta_{\mathcal K})(Δ,ΔK​) such that, if ε0<ε<1\varepsilon_0<\varepsilon<1ε0​<ε<1, 0<κ<10<\kappa<10<κ<1, ε≤pv≤ε−1\varepsilon\le p^v\le\varepsilon^{-1}ε≤pv≤ε−1 and κ≤gv≤κ−1\kappa\le g^v\le\kappa^{-1}κ≤gv≤κ−1, then for all n≥0n\ge0n≥0, x∈Xx\in\mathbb Xx∈X, K∈KK\in\mathcal KK∈K, J⊆KJ\subseteq KJ⊆K,

∣∣∣πnx−π^nx∣∣∣J≤αcard⁡J[e−β1d(J,∂K)+eβ2∣K∣∞N],|||\pi^x_n-\hat\pi^x_n|||_J\le\alpha\operatorname{card}J\Big[e^{-\beta_1d(J,\partial K)}+\frac{e^{\beta_2|\mathcal K|_\infty}}{\sqrt N}\Big],∣∣∣πnx​−π^nx​∣∣∣J​≤αcardJ[e−β1​d(J,∂K)+N​eβ2​∣K∣∞​​],

with 0<α,β1,β2<∞0<\alpha,\beta_1,\beta_2<\infty0<α,β1​,β2​<∞ depending only on (ε,κ,r,Δ,ΔK)(\varepsilon,\kappa,r,\Delta,\Delta_{\mathcal K})(ε,κ,r,Δ,ΔK​). The goal states the constants existentially, as the paper does, so that it survives any improvement of them.

Milestones

The proof splits the error through the block filter π~n=CnBPπ~n−1\tilde\pi_n=\mathsf C_n\mathsf B\mathsf P\tilde\pi_{n-1}π~n​=Cn​BPπ~n−1​:

  1. elementary lemmas: Lemma 4.1 (minorization), Lemma 4.2 (reweighting), Lemma 4.3 (weighted Neumann series);
  2. Theorem 3.1, the Dobrushin comparison theorem;
  3. Theorem 4.14, the bias term ∥πnx−π~nx∥J≤8e−β1−e−β(1−ε2Δ)card⁡J e−βd(J,∂K)\|\pi^x_n-\tilde\pi^x_n\|_J\le\frac{8e^{-\beta}}{1-e^{-\beta}}(1-\varepsilon^{2\Delta})\operatorname{card}J\,e^{-\beta d(J,\partial K)}∥πnx​−π~nx​∥J​≤1−e−β8e−β​(1−ε2Δ)cardJe−βd(J,∂K);
  4. Proposition 4.17, stability of the block filter from product initial laws;
  5. Lemma 4.19, Lemma 4.20 (products of empirical measures) and Proposition 4.22, the one-step sampling errors;
  6. Theorem 4.23, the variance term ∣∣∣π~nx−π^nx∣∣∣J≤card⁡J 64ΔKeβ1−e−βε−4∣K∣∞κ−4∣K∣∞ΔKN|||\tilde\pi^x_n-\hat\pi^x_n|||_J\le\operatorname{card}J\,\frac{64\Delta_{\mathcal K}e^\beta}{1-e^{-\beta}}\frac{\varepsilon^{-4|\mathcal K|_\infty}\kappa^{-4|\mathcal K|_\infty\Delta_{\mathcal K}}}{\sqrt N}∣∣∣π~nx​−π^nx​∣∣∣J​≤cardJ1−e−β64ΔK​eβ​N​ε−4∣K∣∞​κ−4∣K∣∞​ΔK​​.

Theorems 4.14 and 4.23 together give Theorem 2.1 by the triangle inequality.

Significance

The theorem shows that the error of a local particle filter can be controlled by quantities that are local in the graph: neither the assumptions nor the bound depend on the time horizon or on card⁡V\operatorname{card}VcardV. On a square lattice, choosing blocks of side length of order log⁡N\log NlogN balances the two terms and gives a local error, at most locations, that tends to zero as N→∞N\to\inftyN→∞ uniformly in time and in the lattice size (the paper's Corollary 2.5, which is not part of this mission): the number of particles needed for a given local accuracy does not grow with the dimension. The result identifies decay of correlations of the filter, established through the Dobrushin comparison theorem, as the mechanism that makes localization work, and it underlies later work on local particle filters and their spatial bias.

The result is proved on paper. No part of it is formalized, and the formal library has no nonlinear filter, no particle filter and no Dobrushin comparison theorem. The mission produces machine-checked statements of the main theorem and of the intermediate results of its proof, with explicit constants for the two halves; proofs of any milestone, or of the goal from Theorems 4.14 and 4.23, are the remaining work.

Difficulty

The obvious argument fails in two places. First, the standard particle filter error bound is uniform in time only through filter stability, and its constants are exponential in the dimension, because the reweighting step compares likelihoods over all of VVV at once. Localizing the sampling (blocking) removes this, but introduces a bias at block boundaries that must not accumulate over time. Controlling that bias requires showing that the filter has decay of correlations uniformly in time, which is a statement about conditional distributions of a high-dimensional measure, not about its marginals. Second, the sampling error must be propagated through the block filter dynamics in a norm strong enough to compose: the weak ∣∣∣⋅∣∣∣|||\cdot|||∣∣∣⋅∣∣∣ norm does not contract under the block filter, which is why the paper measures one-step errors in total variation after one further step of dynamics.

Formalization scope

The Lean development is in the namespace LocalPF.Block. Committed conventions:

  • the graph distance takes values in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞}, and e−βd=0e^{-\beta d}=0e−βd=0 for d=∞d=\inftyd=∞; the partition is a surjective block label map;
  • the filter, block filter and block particle filter are defined by their recursions for a fixed observation sequence, and every statement holds for every observation sequence (Remark 2.4); the reference measure of the observations is omitted;
  • the block particle filter is represented by the law of its particle array at each step, built with the Giry monad bind, and the step-nnn estimate as a function of that array;
  • total variation norms ∥⋅∥\|\cdot\|∥⋅∥, ∥⋅∥J\|\cdot\|_J∥⋅∥J​ are suprema in [0,∞][0,\infty][0,∞]; ∣∣∣⋅∣∣∣J≤B|||\cdot|||_J\le B∣∣∣⋅∣∣∣J​≤B is stated as E[∣ρ(f)−ρ′(f)∣2]≤B2\mathbf E[|\rho(f)-\rho'(f)|^2]\le B^2E[∣ρ(f)−ρ′(f)∣2]≤B2 for every test function, with lower Lebesgue integrals;
  • r≥1r\ge1r≥1 and N≥1N\ge1N≥1; reference measures are σ\sigmaσ-finite.

Added or changed hypotheses, each disclosed in the item: strict positivity and integrability of gvg^vgv in Theorem 4.14 and Proposition 4.17 (the paper assumes no bounds on ggg there; without them the Bayes formula is undefined); explicit bounds 0<a≤Λ≤b0<a\le\Lambda\le b0<a≤Λ≤b in Lemma 4.2, whose ∣∣∣⋅∣∣∣|||\cdot|||∣∣∣⋅∣∣∣ clause is stated for Giry-measurable random probability measures; ε<1\varepsilon<1ε<1 in Theorem 4.23, excluding only the case where the paper's bound is +∞+\infty+∞; Lemma 4.19 and Proposition 4.22 are stated for every deterministic probability measure in place of the random previous estimate, which is stronger.

The statement admits no trivializing reading: the constants of Theorem 2.1 are quantified before the graph and the model, so they cannot depend on card⁡V\operatorname{card}VcardV; the goal and Theorem 4.23 assert that the particle-array law is a probability measure, so a zero law cannot make the expectation vanish; test functions are measurable and bounded, so the integrals are not junk values; N≥1N\ge1N≥1 excludes division by 0\sqrt00​; and the correction step's normalizer is positive and finite under the stated hypotheses.

Needed infrastructure: product measures over finite index sets and their marginals, the Giry monad and measurability of the maps it composes, conditional distributions on products of Polish spaces, and matrix Neumann series. The Dobrushin comparison theorem and the V-statistic bound (Lemma 4.20) are reusable beyond filtering. Proofs of any milestone are welcome, and so are formal statements of the remaining results of §4 (Propositions 4.4, 4.8, 4.9, Corollary 4.13).

Selected references

  • P. Rebeschini and R. van Handel, Can local particle filters beat the curse of dimensionality?, Ann. Appl. Probab. 25(5), 2809–2866, 2015. arXiv:1301.6585, doi:10.1214/14-AAP1061
  • P. Bickel, B. Li and T. Bengtsson, Sharp failure rates for the bootstrap particle filter in high dimensions, IMS Collections 3, 318–329, 2008. doi:10.1214/074921708000000228
  • C. Snyder, T. Bengtsson, P. Bickel and J. Anderson, Obstacles to high-dimensional particle filtering, Monthly Weather Review 136(12), 4629–4640, 2008. doi:10.1175/2008MWR2529.1
  • H.-O. Georgii, Gibbs Measures and Phase Transitions, de Gruyter, 2nd ed., 2011 (Theorem 8.20, the Dobrushin comparison theorem). doi:10.1515/9783110250329
13 thms1 active userReviewed
Operations ResearchOptimal TransportProbability·Captain: mikedeng1

A Stochastic Control Approach to No-Arbitrage Bounds Given Marginals, with an Application to Lookback Options: The Robust Superhedging Bound of g(X*_T) Given the Law of X_T Equals μ^HL(g)Research Paper

Model-free bounds for lookback options

A lookback option pays a function of the running maximum of the underlying asset over the life of the contract. When the prices of European call options of all strikes at the maturity are quoted, the risk-neutral law μ\muμ of the terminal price is known, but the law of the whole path is not. The robust (model-free) superhedging cost of the lookback payoff is the cheapest initial capital that, combined with a static position in the quoted calls and dynamic trading in the underlying, dominates the payoff in every model consistent with μ\muμ.

Hobson (Finance Stoch. 1998) computed this cost for g(x)=xg(x)=xg(x)=x by a pathwise inequality, and identified the extremal model through the Azéma–Yor solution of the Skorokhod embedding problem (Azéma–Yor 1979). Galichon, Henry-Labordère and Touzi (Ann. Appl. Probab. 2014, arXiv:1401.3921) recast model-free bounds as a dual stochastic control problem in which the marginal constraint is penalised by a Lagrange multiplier λ\lambdaλ. Their Theorem 3.1 recovers Hobson's bound for every C1C^1C1 nondecreasing ggg from that dual, with an explicit optimal multiplier and stopping time. The result is one of the founding examples of martingale optimal transport.

Setting

Let BBB be a real Brownian motion with continuous paths and B0=0B_0=0B0​=0, adapted to a filtration (Ft)t≥0(\mathcal F_t)_{t\ge0}(Ft​)t≥0​ with increments independent of the past, and let Xt=X0+BtX_t=X_0+B_tXt​=X0​+Bt​ for a spot X0∈RX_0\in\mathbb RX0​∈R. Write Xτ∗=max⁡t≤τXtX^*_\tau=\max_{t\le\tau}X_tXτ∗​=maxt≤τ​Xt​. Let T∞\mathcal T_\inftyT∞​ be the set of stopping times τ\tauτ for which the stopped process (Xt∧τ)t≥0(X_{t\wedge\tau})_{t\ge0}(Xt∧τ​)t≥0​ is a uniformly integrable martingale.

The marginal is a probability measure μ\muμ on R\mathbb RR with finite first moment and mean ∫x μ(dx)=X0\int x\,\mu(dx)=X_0∫xμ(dx)=X0​. Its call prices are c(x)=∫(y−x)+μ(dy)c(x)=\int(y-x)^+\mu(dy)c(x)=∫(y−x)+μ(dy). The payoff is ξ=g(X∗)\xi=g(X^*)ξ=g(X∗) with g:R→R+g:\mathbb R\to\mathbb R_+g:R→R+​ of class C1C^1C1 and nondecreasing.

For a multiplier λ:R→R\lambda:\mathbb R\to\mathbb Rλ:R→R and τ∈T∞\tau\in\mathcal T_\inftyτ∈T∞​ set J(λ,τ)=E[g(Xτ∗)−λ(Xτ)]J(\lambda,\tau)=\mathbb E[g(X^*_\tau)-\lambda(X_\tau)]J(λ,τ)=E[g(Xτ∗​)−λ(Xτ​)] and uλ(X0,X0)=sup⁡τ∈T∞J(λ,τ)u^\lambda(X_0,X_0)=\sup_{\tau\in\mathcal T_\infty}J(\lambda,\tau)uλ(X0​,X0​)=supτ∈T∞​​J(λ,τ). The admissible multipliers are

Λ0μ={λ∈L1(μ): sup⁡τ∈T∞E[λ(Xτ)−]<∞},\Lambda^\mu_0=\Big\{\lambda\in\mathbb L^1(\mu):\ \sup_{\tau\in\mathcal T_\infty}\mathbb E[\lambda(X_\tau)^-]<\infty\Big\},Λ0μ​={λ∈L1(μ): τ∈T∞​sup​E[λ(Xτ​)−]<∞},

and the reduced superhedging problem (3.7) is

Uμ(ξ)=inf⁡λ∈Λ0μ{∫λ dμ+uλ(X0,X0)}.U^\mu(\xi)=\inf_{\lambda\in\Lambda^\mu_0}\Big\{\int\lambda\,d\mu+u^\lambda(X_0,X_0)\Big\}.Uμ(ξ)=λ∈Λ0μ​inf​{∫λdμ+uλ(X0​,X0​)}.

The barycenter function is b(x)=∫[x,∞)y μ(dy)/μ([x,∞))b(x)=\int_{[x,\infty)}y\,\mu(dy)/\mu([x,\infty))b(x)=∫[x,∞)​yμ(dy)/μ([x,∞)) for μ((x,∞))>0\mu((x,\infty))>0μ((x,∞))>0 and b(x)=xb(x)=xb(x)=x otherwise. The Hardy–Littlewood transform μHL\mu^{HL}μHL is the probability measure with

μHL([y,∞))=inf⁡ξ<yc(ξ)y−ξ.\mu^{HL}([y,\infty))=\inf_{\xi<y}\frac{c(\xi)}{y-\xi}.μHL([y,∞))=ξ<yinf​y−ξc(ξ)​.

The Azéma–Yor stopping time is τ∗=inf⁡{t>0:Xt∗≥b(Xt)}\tau^*=\inf\{t>0:X^*_t\ge b(X_t)\}τ∗=inf{t>0:Xt∗​≥b(Xt​)}, and the candidate multiplier is

λ∗(x)=∫ℓμx ⁣∫ℓμyg′(b(ξ)) b(dξ)b(ξ)−ξ dy,\lambda^*(x)=\int_{\ell^\mu}^{x}\!\int_{\ell^\mu}^{y}g'(b(\xi))\,\frac{b(d\xi)}{b(\xi)-\xi}\,dy ,λ∗(x)=∫ℓμx​∫ℓμy​g′(b(ξ))b(ξ)−ξb(dξ)​dy,

that is, the convex function vanishing below ℓμ\ell^\muℓμ that solves the weak ODE (3.21) with ψ=b−1\psi=b^{-1}ψ=b−1.

Formalization targets

Goal: Theorem 3.1

If sup⁡τ∈T∞E[g(Xτ∗)]<∞\sup_{\tau\in\mathcal T_\infty}\mathbb E[g(X^*_\tau)]<\inftysupτ∈T∞​​E[g(Xτ∗​)]<∞ and μHL(g)=∫g dμHL<∞\mu^{HL}(g)=\int g\,d\mu^{HL}<\inftyμHL(g)=∫gdμHL<∞, then

Uμ(ξ)=μ(λ∗)+J(λ∗,τ∗)=μHL(g).U^\mu(\xi)=\mu(\lambda^*)+J(\lambda^*,\tau^*)=\mu^{HL}(g).Uμ(ξ)=μ(λ∗)+J(λ∗,τ∗)=μHL(g).

The goal is the paper's theorem for the reduced problem (3.7), in its full two-equality form: the value, its attainment by (λ∗,τ∗)(\lambda^*,\tau^*)(λ∗,τ∗), and its closed form.

Milestones

  1. The Neumann condition (3.23) for Peskir's candidate vψv^\psivψ.
  2. Lemma 3.1: uλ≤vψu^\lambda\le v^\psiuλ≤vψ for convex λ∈Λ0μ\lambda\in\Lambda^\mu_0λ∈Λ0μ​ and every relaxed free boundary ψ∈Ψλ\psi\in\Psi^\lambdaψ∈Ψλ.
  3. Step (1) of Lemma 3.2: μ(λ)−λ(X0)=∫(c−c0) dλ′′\mu(\lambda)-\lambda(X_0)=\int(c-c_0)\,d\lambda''μ(λ)−λ(X0​)=∫(c−c0​)dλ′′, with c0(x)=(X0−x)+c_0(x)=(X_0-x)^+c0​(x)=(X0​−x)+.
  4. Lemma 3.2: μ(λ)+uλ(X0,X0)≤g(X0)+∫φ(ψ(m),m)g′(m) dm\mu(\lambda)+u^\lambda(X_0,X_0)\le g(X_0)+\int\varphi(\psi(m),m)g'(m)\,dmμ(λ)+uλ(X0​,X0​)≤g(X0​)+∫φ(ψ(m),m)g′(m)dm.
  5. The pointwise minimizations (3.27) and (3.28).
  6. Steps (2) and (3) of Lemma 3.3: properties of λ∗\lambda^*λ∗, and the integration by parts giving μHL(g)\mu^{HL}(g)μHL(g).
  7. Lemma 3.3, the upper bound Uμ(ξ)≤μHL(g)U^\mu(\xi)\le\mu^{HL}(g)Uμ(ξ)≤μHL(g).
  8. The Azéma–Yor facts: τ∗∈T∞\tau^*\in\mathcal T_\inftyτ∗∈T∞​, Xτ∗∼μX_{\tau^*}\sim\muXτ∗​∼μ, Xτ∗∗∼μHLX^*_{\tau^*}\sim\mu^{HL}Xτ∗∗​∼μHL.
  9. The lower bound Uμ(ξ)≥μHL(g)U^\mu(\xi)\ge\mu^{HL}(g)Uμ(ξ)≥μHL(g) of Section 3.4.

Significance

The theorem identifies the model-free price of a lookback payoff as an explicit functional of the call prices, μHL(g)\mu^{HL}(g)μHL(g), and exhibits the extremal model (Brownian motion stopped at τ∗\tau^*τ∗) and the optimal static hedge (λ∗\lambda^*λ∗). It shows that the dual stochastic control formulation is sharp on a nontrivial path-dependent payoff, which is the template for later work on martingale optimal transport with path-dependent costs.

The result has been proved since 2014 (and Hobson's bound since 1998). It has not been formalized. A complete development would provide machine-checked versions of the Azéma–Yor embedding, the law of the maximum at the embedding, a verification theorem for a reflected optimal stopping problem with a nonsmooth obstacle, and the convex-analytic identities linking call prices to second-derivative measures. Each of these is reusable well beyond this paper.

Difficulty

The upper bound requires a verification argument for an optimal stopping problem of the pair (X,X∗)(X,X^*)(X,X∗) with a reflection at the diagonal, where the candidate vψv^\psivψ is only as regular as the convex multiplier λ\lambdaλ: second derivatives are measures and the free boundary ψ\psiψ solves its ODE only in a relaxed sense. An Itô formula for C2C^2C2 functions does not apply; an Itô–Tanaka (local time) argument for concave functions of XXX, with the reflection term killed by the Neumann condition, is needed, followed by a localisation that uses uniform integrability and the integrability condition in Λ0μ\Lambda^\mu_0Λ0μ​. The lower bound needs the Azéma–Yor embedding and the law of Xτ∗∗X^*_{\tau^*}Xτ∗∗​, neither of which is in Mathlib; the naive appeal to "the embedding exists" does not give the joint law of the stopped value and the maximum.

Formalization scope

The Lean development lives in the namespace LookbackMOT.HL and uses Mathlib's IsBrownianReal, IsStoppingTime, stoppedProcess, stoppedValue, Martingale, UniformIntegrable and HasLaw. Committed conventions:

  • What is formalized. The goal is the reduced problem (3.7), not the superhedging problem (2.6): (2.6) needs stochastic integrals, which Mathlib does not have. The bridge between them (Proposition 2.1, the claim (3.4), Proposition 3.1) is outside this mission. The theorem's hypothesis sup⁡P∈P∞EP[ξ+]<∞\sup_{\mathbb P\in\mathcal P_\infty}\mathbb E^{\mathbb P}[\xi^+]<\inftysupP∈P∞​​EP[ξ+]<∞ is stated through Proposition 3.1 with λ=0\lambda=0λ=0 as sup⁡τ∈T∞E[g(Xτ∗)]<∞\sup_{\tau\in\mathcal T_\infty}\mathbb E[g(X^*_\tau)]<\inftysupτ∈T∞​​E[g(Xτ∗​)]<∞. The horizon TTT disappears: the stopping problem is over T∞\mathcal T_\inftyT∞​ with time in [0,∞)[0,\infty)[0,∞).
  • Standing hypotheses. The Brownian motion lives on an arbitrary filtered probability space with everywhere-continuous paths and B0=0B_0=0B0​=0; the paper's canonical space is one instance. The mean condition and integrability of μ\muμ (p. 7) are assumed throughout. The spot X0X_0X0​ is any real number. μ([0,∞))=1\mu([0,\infty))=1μ([0,∞))=1 is assumed only in (3.27).
  • Added conditions. Every τ∈T∞\tau\in\mathcal T_\inftyτ∈T∞​ is a.s. finite (implied by uniform integrability). Every λ∈Λ0μ\lambda\in\Lambda^\mu_0λ∈Λ0μ​ is measurable.
  • Expectations of payoffs are E[φ+]−E[φ−]\mathbb E[\varphi^+]-\mathbb E[\varphi^-]E[φ+]−E[φ−] in the extended reals, with ∞−∞=−∞\infty-\infty=-\infty∞−∞=−∞; value functions are extended reals.
  • Derivatives. λ′\lambda'λ′ is the right derivative and λ′′\lambda''λ′′ its Stieltjes measure. The weak ODE (3.21) is used both as a change of variables (λ′′\lambda''λ′′ is the image of g′(m)/(m−ψ(m)) dmg'(m)/(m-\psi(m))\,dmg′(m)/(m−ψ(m))dm under ψ\psiψ) and on intervals (λ′(ψ(y2))−λ′(ψ(y1))=∫y1y2g′(m)/(m−ψ(m)) dm\lambda'(\psi(y_2))-\lambda'(\psi(y_1))=\int_{y_1}^{y_2}g'(m)/(m-\psi(m))\,dmλ′(ψ(y2​))−λ′(ψ(y1​))=∫y1​y2​​g′(m)/(m−ψ(m))dm), the two forms the paper's proofs use.
  • The multiplier λ∗\lambda^*λ∗. It is written as λ∗(x)=∫X0<m<rμg′(m)(x−b−1(m))+/(m−b−1(m)) dm\lambda^*(x)=\int_{X_0<m<r^\mu}g'(m)(x-b^{-1}(m))^+/(m-b^{-1}(m))\,dmλ∗(x)=∫X0​<m<rμ​g′(m)(x−b−1(m))+/(m−b−1(m))dm, the change of variables m=b(ξ)m=b(\xi)m=b(ξ) in (3.14) and the solution of (3.21) with ψ=b−1\psi=b^{-1}ψ=b−1 that the proof of Lemma 3.3 uses. It agrees with the b(dξ)b(d\xi)b(dξ) formula when bbb is continuous; at the jumps of bbb (atoms of μ\muμ) the Lebesgue–Stieltjes reading of (3.14) can fail to be μ\muμ-integrable.
  • Measures given by identities. μHL\mu^{HL}μHL and λ′′\lambda''λ′′ enter as measures satisfying their defining identities on intervals; each exists and is unique.
  • Printed slips not copied. (3.12) prints the numerator c(y)c(y)c(y); the formalization uses c(ξ)c(\xi)c(ξ). bbb, μHL\mu^{HL}μHL and λ∗\lambda^*λ∗ are extended from x≥0x\ge0x≥0 to all of R\mathbb RR by the same formulas.

No trivializing reading is available. Payoff expectations are never Bochner integrals (which would be 000 for non-integrable payoffs). τ≡0\tau\equiv0τ≡0 lies in T∞\mathcal T_\inftyT∞​ and λ≡0\lambda\equiv0λ≡0 in Λ0μ\Lambda^\mu_0Λ0μ​, so neither the supremum nor the infimum is over an empty set. The predicates for μHL\mu^{HL}μHL and λ′′\lambda''λ′′ are satisfiable (witnessed for μ=δX0\mu=\delta_{X_0}μ=δX0​​ in a sorry-free check). XτX_\tauXτ​ is only evaluated where τ<∞\tau<\inftyτ<∞ a.s. Every division has a positive denominator on the sets that carry mass.

Contributions welcome: the Azéma–Yor embedding and the law of the maximum; an Itô–Tanaka or local-time calculus sufficient for concave functions of Brownian motion and its maximum; the call-price identities of convex analysis; and the analysis of μHL\mu^{HL}μHL.

Selected references

  • A. Galichon, P. Henry-Labordère, N. Touzi, A stochastic control approach to no-arbitrage bounds given marginals, with an application to lookback options, Ann. Appl. Probab. 24 (2014) 312–336. https://arxiv.org/abs/1401.3921 (v1, the version cited)
  • D. Hobson, Robust hedging of the lookback option, Finance Stoch. 2 (1998) 329–347. https://doi.org/10.1007/s007800050046
  • J. Azéma, M. Yor, Une solution simple au problème de Skorokhod, Séminaire de Probabilités XIII, LNM 721 (1979) 90–115. https://doi.org/10.1007/BFb0070852
  • G. Peskir, Optimal stopping of the maximum process: the maximality principle, Ann. Probab. 26 (1998) 1614–1640. https://doi.org/10.1214/aop/1022855875
  • L. Carraro, N. El Karoui, J. Obłój, On Azéma–Yor processes, their optimal properties and the Bachelier–drawdown equation, Ann. Probab. 40 (2012) 372–400. https://arxiv.org/abs/0902.1328
13 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Limit Theorems for Nearly Unstable Hawkes Processes 3: The Nearly Unstable Hawkes-Based Price Model Converges in Law to a Heston-Type ProcessResearch Paper

Why prices built from self-exciting order flow

High-frequency prices move by discrete ticks, and successive moves are strongly correlated: an upward tick tends to be followed by a downward one. Bacry, Delattre, Hoffmann and Muzy (BDHM12, BDHM13b) proposed to model the upward and downward price jumps as the two components of a bidimensional Hawkes process, a pair of counting processes in which every event raises the rate of future events of both kinds. In this model the price is the difference N+−N−N^{+}-N^{-}N+−N−, and its microstructure features (discreteness, negative autocorrelation of increments) are built in. Under the stability condition ∫ϕ1+∫ϕ2<1\int\phi_1+\int\phi_2<1∫ϕ1​+∫ϕ2​<1 on the excitation kernels, the price rescaled over long horizons converges to a Brownian motion with a constant volatility BDHM12.

Empirical calibrations of Hawkes models on financial data, however, find kernel norms (branching ratios) very close to the critical value 111 (HBB13, FS12). Jaisson and Rosenbaum (JR15) study exactly this regime: a sequence of models whose stability condition is almost violated, observed over a time horizon of the right order. Their Theorem 3.1 shows that the rescaled price then converges to a Heston-type process, a Brownian motion time-changed by a Cox–Ingersoll–Ross (CIR) variance. This gives a microstructural foundation for stochastic volatility models of Heston type Hes93, which are standard in option pricing.

Setting

Fix μ>0\mu>0μ>0 and two nonnegative measurable kernels ϕ1,ϕ2\phi_1,\phi_2ϕ1​,ϕ2​ on R+\mathbb R_+R+​ with ∫0∞(ϕ1+ϕ2)=1\int_0^\infty(\phi_1+\phi_2)=1∫0∞​(ϕ1​+ϕ2​)=1, finite mean m=∫0∞s(ϕ1+ϕ2)(s) dsm=\int_0^\infty s(\phi_1+\phi_2)(s)\,dsm=∫0∞​s(ϕ1​+ϕ2​)(s)ds, ϕ2\phi_2ϕ2​ nonzero on a set of positive measure, and differentiable with bounded integrable derivatives (Assumption 3). Let (aT)(a_T)(aT​) be positive numbers with aT<1a_T<1aT​<1, aT→1a_T\to1aT​→1, and set ϕiT=aTϕi\phi^T_i=a_T\phi_iϕiT​=aT​ϕi​.

For each observation horizon TTT (along a sequence T→∞T\to\inftyT→∞), the bidimensional Hawkes process (NT+,NT−)(N^{T+},N^{T-})(NT+,NT−) is a pair of counting processes started at 000, with unit jumps and no common jumps, whose intensities with respect to their joint history are

λtT+=μ+∫0tϕ1T(t−s) dNsT++∫0tϕ2T(t−s) dNsT−,λtT−=μ+∫0tϕ2T(t−s) dNsT++∫0tϕ1T(t−s) dNsT−.\lambda^{T+}_t=\mu+\int_0^t\phi^T_1(t-s)\,dN^{T+}_s+\int_0^t\phi^T_2(t-s)\,dN^{T-}_s,\qquad \lambda^{T-}_t=\mu+\int_0^t\phi^T_2(t-s)\,dN^{T+}_s+\int_0^t\phi^T_1(t-s)\,dN^{T-}_s .λtT+​=μ+∫0t​ϕ1T​(t−s)dNsT+​+∫0t​ϕ2T​(t−s)dNsT−​,λtT−​=μ+∫0t​ϕ2T​(t−s)dNsT+​+∫0t​ϕ1T​(t−s)dNsT−​.

"Intensity" means: for 0≤a<b≤T0\le a<b\le T0≤a<b≤T and every event AAA of the history up to time aaa, E[(NbT±−NaT±)1A]=E[∫abλsT±1A ds]\mathbb E[(N^{T\pm}_b-N^{T\pm}_a)\mathbf 1_A]=\mathbb E[\int_a^b\lambda^{T\pm}_s\mathbf 1_A\,ds]E[(NbT±​−NaT±​)1A​]=E[∫ab​λsT±​1A​ds].

The renormalized price is

PtT=1T(NTtT+−NTtT−),t∈[0,1].P^T_t=\frac1T\big(N^{T+}_{Tt}-N^{T-}_{Tt}\big),\qquad t\in[0,1].PtT​=T1​(NTtT+​−NTtT−​),t∈[0,1].

Two further conditions fix the regime. Display (3): T(1−aT)→λT(1-a_T)\to\lambdaT(1−aT​)→λ for some λ>0\lambda>0λ>0. Assumption 4: with ψ+T=∑k≥1(aT(ϕ1+ϕ2))∗k\psi^T_+=\sum_{k\ge1}(a_T(\phi_1+\phi_2))^{*k}ψ+T​=∑k≥1​(aT​(ϕ1​+ϕ2​))∗k and ρT(x)=Tψ+T(Tx)/∥ψ+T∥1\rho^T(x)=T\psi^T_+(Tx)/\|\psi^T_+\|_1ρT(x)=Tψ+T​(Tx)/∥ψ+T​∥1​, there is KρK_\rhoKρ​ with ∣ρT(x)∣≤Kρ|\rho^T(x)|\le K_\rho∣ρT(x)∣≤Kρ​ for all x≥0x\ge0x≥0 and all TTT. Write ϕ=ϕ1−ϕ2\phi=\phi_1-\phi_2ϕ=ϕ1​−ϕ2​ and ∥ϕ∥1=∫0∞(ϕ1−ϕ2)\|\phi\|_1=\int_0^\infty(\phi_1-\phi_2)∥ϕ∥1​=∫0∞​(ϕ1​−ϕ2​).

Formalization targets

Goal: Theorem 3.1

Under (3) and Assumptions 3 and 4, PTP^TPT converges in law, for the Skorohod topology on [0,1][0,1][0,1], to the process PPP defined by

dCt=(2μλ−Ct)λm dt+1mCt dBt1,C0=0,dPt=11−∥ϕ∥1Ct dBt2,P0=0,dC_t=\Big(\frac{2\mu}{\lambda}-C_t\Big)\frac{\lambda}{m}\,dt+\frac1m\sqrt{C_t}\,dB^1_t,\quad C_0=0,\qquad dP_t=\frac{1}{1-\|\phi\|_1}\sqrt{C_t}\,dB^2_t,\quad P_0=0,dCt​=(λ2μ​−Ct​)mλ​dt+m1​Ct​​dBt1​,C0​=0,dPt​=1−∥ϕ∥1​1​Ct​​dBt2​,P0​=0,

with (B1,B2)(B^1,B^2)(B1,B2) a two-dimensional Brownian motion. The goal asserts that this system has a solution and that PTP^TPT converges in law to the PPP-coordinate of every solution.

Milestones

In the order of the proof (§4.4):

  1. Display (11): NtT+−NtT−=∫0t(1+ΨT(t−u))(dMuT+−dMuT−)N^{T+}_t-N^{T-}_t=\int_0^t(1+\Psi^T(t-u))(dM^{T+}_u-dM^{T-}_u)NtT+​−NtT−​=∫0t​(1+ΨT(t−u))(dMuT+​−dMuT−​), with ψT\psi^TψT the resolvent of ϕ1T−ϕ2T\phi^T_1-\phi^T_2ϕ1T​−ϕ2T​, ΨT(x)=∫0xψT\Psi^T(x)=\int_0^x\psi^TΨT(x)=∫0x​ψT and MT±M^{T\pm}MT± the compensated counting processes.
  2. Lemma 4.12: XsT=(λsTT+−λsTT−)/T→0X^T_s=(\lambda^{T+}_{sT}-\lambda^{T-}_{sT})/T\to0XsT​=(λsTT+​−λsTT−​)/T→0 uniformly in probability on [0,1][0,1][0,1].
  3. Lemma 4.13: the brackets of (B1)T=∫0⋅TdMT++dMT−T(λT++λT−)(B^1)^T=\int_0^{\cdot T}\frac{dM^{T+}+dM^{T-}}{\sqrt{T(\lambda^{T+}+\lambda^{T-})}}(B1)T=∫0⋅T​T(λT++λT−)​dMT++dMT−​ and (B2)T(B^2)^T(B2)T (same with dMT+−dMT−dM^{T+}-dM^{T-}dMT+−dMT−) satisfy [(Bi)T,(Bj)T]t→t1i=j[(B^i)^T,(B^j)^T]_t\to t\mathbf 1_{i=j}[(Bi)T,(Bj)T]t​→t1i=j​ in probability.
  4. Lemma 4.14: ((B1)T,(B2)T)⇒(B1,B2)((B^1)^T,(B^2)^T)\Rightarrow(B^1,B^2)((B1)T,(B2)T)⇒(B1,B2) jointly.
  5. Lemma 4.15: (CT,(B2)T)⇒(C,B2)(C^T,(B^2)^T)\Rightarrow(C,B^2)(CT,(B2)T)⇒(C,B2) jointly, with CtT=(λtTT++λtTT−)/TC^T_t=(\lambda^{T+}_{tT}+\lambda^{T-}_{tT})/TCtT​=(λtTT+​+λtTT−​)/T, CCC the CIR process above and B2B^2B2 independent of CCC.
  6. Lemma 4.16: RtT=∫0t∫T(t−u)∞ψT d(M‾uT+−M‾uT−)→0R^T_t=\int_0^t\int_{T(t-u)}^\infty\psi^T\,d(\overline M^{T+}_u-\overline M^{T-}_u)\to0RtT​=∫0t​∫T(t−u)∞​ψTd(MuT+​−MuT−​)→0 u.c.p.
  7. Lemma 4.17: ∫0∞∫x∞ϕi(s) ds dx<∞\int_0^\infty\int_x^\infty\phi_i(s)\,ds\,dx<\infty∫0∞​∫x∞​ϕi​(s)dsdx<∞.
  8. The Step 6 decomposition of PtTP^T_tPtT​ into a multiple of M‾tT+−M‾tT−\overline M^{T+}_t-\overline M^{T-}_tMtT+​−MtT−​, minus RtTR^T_tRtT​, minus a vanishing multiple of M‾tT+−M‾tT−\overline M^{T+}_t-\overline M^{T-}_tMtT+​−MtT−​.

Significance

The theorem identifies the scaling limit of a microstructure price model at near-criticality, and the limit is not a Brownian motion with constant volatility but a stochastic-volatility process: the variance CCC is itself a CIR diffusion driven by a Brownian motion independent of the one driving the price. It explains, from the order-flow level, why Heston-type dynamics arise at macroscopic scales, and it identifies which features of the microscopic excitation survive in the macroscopic volatility and price diffusion.

The result is proved in the paper; nothing about it is open. It has not been formalized. A machine-checked version would formalize a complete scaling-limit argument for point processes: the resolvent calculus of Hawkes processes, the martingale central limit theorem for pure-jump martingales, joint Skorohod convergence, and the identification of the limit of stochastic integrals. Each of these is reusable well beyond this paper.

Difficulty

The price is a difference of two processes whose sum is nearly unstable. One might expect the CIR limit of the one-dimensional case (Theorem 2.2 of the same paper, applied to NT++NT−N^{T+}+N^{T-}NT++NT−) to give the result directly. It does not: the price is driven by the difference of the martingales, with a volatility that depends on the sum of the intensities, and the limit requires the joint convergence of the variance proxy CTC^TCT and the price martingale (B2)T(B^2)^T(B2)T, with one time change for both coordinates. Marginal convergence of each coordinate is not enough to pass to the limit in ∫CT d(B2)T\int\sqrt{C^T}\,d(B^2)^T∫CT​d(B2)T. Joint convergence in turn needs the cross-bracket of (B1)T(B^1)^T(B1)T and (B2)T(B^2)^T(B2)T to vanish, which depends on the imbalance XTX^TXT being negligible (Lemma 4.12), and the zero set of the CIR process having Lebesgue measure zero. The signed kernel ϕ1−ϕ2\phi_1-\phi_2ϕ1​−ϕ2​ produces a signed resolvent, for which the positivity arguments of the one-dimensional case are unavailable.

Formalization scope

  • Asymptotics. TTT runs along a sequence Tn→∞T_n\to\inftyTn​→∞; each Hawkes pair lives on its own probability space.
  • Hawkes pair. Time is real with all conditions imposed for t≥0t\ge0t≥0; NT±N^{T\pm}NT± are N\mathbb NN-valued, nondecreasing, right-continuous, with unit jumps and no common jumps. The filtration is the joint natural filtration. The intensity identity is stated with lower Lebesgue integrals in [0,∞][0,\infty][0,∞], so no integrability is assumed silently. The intensity counts jumps at s≤ts\le ts≤t (cadlag); inside stochastic integrands ((Bi)T(B^i)^T(Bi)T, brackets) its left limit is used.
  • Integrals. Integrals against dNdNdN and dMdMdM have deterministic or predictable integrands and are written pathwise, as sums over jump times minus Lebesgue integrals. Brackets are sums of products of jumps.
  • ∥ϕ∥1\|\phi\|_1∥ϕ∥1​ is the signed integral ∫(ϕ1−ϕ2)\int(\phi_1-\phi_2)∫(ϕ1​−ϕ2​), the value the proof uses (Step 6, p. 31). It coincides with the L1L^1L1 norm when ϕ1≥ϕ2\phi_1\ge\phi_2ϕ1​≥ϕ2​; reading it as ∫∣ϕ1−ϕ2∣\int|\phi_1-\phi_2|∫∣ϕ1​−ϕ2​∣ would give a different limit when ϕ1−ϕ2\phi_1-\phi_2ϕ1​−ϕ2​ changes sign.
  • Convergence in law for the Skorohod topology on [0,1][0,1][0,1] is stated in coupling form (copies of the laws converging almost surely in D[0,1]D[0,1]D[0,1]), equivalent to weak convergence on the Polish space D[0,1]D[0,1]D[0,1]. Joint statements use R2\mathbb R^2R2-valued paths with one time change.
  • Limit SDEs use the published Ethier–Kurtz substrate (EthierKurtz.SolvesBrownianSDE, IsStandardBrownian, state space R2\mathbb R^2R2): strong solutions, global in time, restricted to [0,1][0,1][0,1]. "The process defined by" the system is encoded as existence of a solution plus convergence to every solution.

The formalization rules out the trivializing readings: the Hawkes predicate follows p. 5 clause by clause and is satisfied by a pair of independent Poisson processes when ϕi≡0\phi_i\equiv0ϕi​≡0, so it is not vacuous; the kernels are ϕiT=aTϕi\phi^T_i=a_T\phi_iϕiT​=aT​ϕi​, not ϕi\phi_iϕi​; the limit is pinned by its equation, its coefficients and its initial value, not "some process"; and the convergence is in the Skorohod topology, not of finite-dimensional laws only.

Needed infrastructure: convolution powers and resolvents on R+\mathbb R_+R+​, pathwise Stieltjes integrals against counting processes, the martingale property of compensated Hawkes processes, a martingale functional CLT for pure-jump martingales, Skorohod-topology tools on D[0,1]D[0,1]D[0,1], and convergence of stochastic integrals under joint convergence. The one-dimensional CIR limit (mission 2 of this series) is used inside Lemma 4.15; the definitions are restated here. The martingale functional CLT used for Lemma 4.14 is Theorem VIII.3.11 of Jacod and Shiryaev (1987), as cited in JR15. Contributions to any milestone, or to reusable lemmas they need, are welcome.

Selected references

  • [JR15] T. Jaisson, M. Rosenbaum, Limit theorems for nearly unstable Hawkes processes, Ann. Appl. Probab. 25(2):600–631, 2015. arXiv:1310.2033v2, https://arxiv.org/abs/1310.2033 ; https://doi.org/10.1214/14-AAP1005
  • [BDHM12] E. Bacry, S. Delattre, M. Hoffmann, J.-F. Muzy, Scaling limits for Hawkes processes and application to financial statistics, preprint, 2012. https://arxiv.org/abs/1202.0842
  • [BDHM13b] E. Bacry, S. Delattre, M. Hoffmann, J.-F. Muzy, Modelling microstructure noise with mutually exciting point processes, Quant. Finance 13(1):65–77, 2013. https://doi.org/10.1080/14697688.2011.647054
  • [HBB13] S. J. Hardiman, N. Bercot, J.-P. Bouchaud, Critical reflexivity in financial markets: a Hawkes process analysis, preprint, 2013. https://arxiv.org/abs/1302.1405
  • [FS12] V. Filimonov, D. Sornette, Quantifying reflexivity in financial markets: toward a prediction of flash crashes, Phys. Rev. E 85:056108, 2012. https://doi.org/10.1103/PhysRevE.85.056108
  • [Hes93] S. L. Heston, A closed-form solution for options with stochastic volatility with applications to bond and currency options, Rev. Financ. Stud. 6(2):327–343, 1993. https://doi.org/10.1093/rfs/6.2.327
17 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Limit Theorems for Nearly Unstable Hawkes Processes 2: When T(1 − a_T) → λ the Rescaled Intensity Converges in Law to a CIR Process and the Rescaled Hawkes Process to Its IntegralResearch Paper

Motivation

An event stream can raise its own future event rate. A Hawkes process models this feedback by adding to a baseline rate the effects of past arrivals. The parameter measuring total excitation can approach its stability boundary, at which long clusters make a fixed time scale an unreliable guide to the observed count. Jaisson and Rosenbaum identify a regime in which observation time and the distance to that boundary balance, leaving a stochastic limit rather than a deterministic average Jaisson and Rosenbaum, 2015. Their theorem gives a precise bridge from an event count with jumps to a continuous square-root diffusion. The paper notes a practical reason for this bridge: intermediate-scale inference can use diffusion methods to estimate the baseline rate and two aggregate kernel parameters, though it cannot recover the entire excitation kernel Jaisson and Rosenbaum, §2.4, p. 10.

Setting

For each observation horizon TTT, let NtTN^T_tNtT​ count events up to time ttt, with N0T=0N^T_0=0N0T​=0. The process is observed on [0,T][0,T][0,T] and has intensity

λtT=μ+∫0tϕT(t−s) dNsT,ϕT=aTϕ,\lambda^T_t=\mu+\int_0^t\phi^T(t-s)\,dN^T_s, \qquad \phi^T=a_T\phi,λtT​=μ+∫0t​ϕT(t−s)dNsT​,ϕT=aT​ϕ,

where μ>0\mu>0μ>0 is the baseline rate. The integral against NTN^TNT is a sum over its unit jumps. The nonnegative kernel ϕ\phiϕ has total mass one and finite mean m=∫0∞sϕ(s) dsm=\int_0^\infty s\phi(s)\,dsm=∫0∞​sϕ(s)ds; its derivative is bounded and integrable. The coefficients satisfy 0<aT<10<a_T<10<aT​<1 and aT→1a_T\to1aT​→1. Thus aTa_TaT​ is the total mass of ϕT\phi^TϕT, and the model approaches the stability boundary from below. The natural filtration is generated by the observed count. The intensity relation is the identity for conditional expected increments on every interval 0≤a<b≤T0\le a<b\le T0≤a<b≤T and every event observable at time aaa Jaisson and Rosenbaum, §2.1, p. 5.

The resolvent ψT=∑k≥1(ϕT)∗k\psi^T=\sum_{k\ge1}(\phi^T)^{*k}ψT=∑k≥1​(ϕT)∗k collects excitation across repeated generations. Its rescaled density is ρT(x)=TψT(Tx)/∥ψT∥1\rho^T(x)=T\psi^T(Tx)/\|\psi^T\|_1ρT(x)=TψT(Tx)/∥ψT∥1​. The mission uses the paper's additional bound sup⁡T,x≥0∣ρT(x)∣<∞\sup_{T,x\ge0}|\rho^T(x)|<\inftysupT,x≥0​∣ρT(x)∣<∞ and the balance condition T(1−aT)→λ>0T(1-a_T)\to\lambda>0T(1−aT​)→λ>0. Here λ\lambdaλ is a fixed limiting parameter, distinct from the time-dependent intensity λtT\lambda^T_tλtT​. The processes to be compared on a common interval are

CtT=(1−aT)λtTT,VtT=1−aTTNtTT,0≤t≤1.C^T_t=(1-a_T)\lambda^T_{tT},\qquad V^T_t=\frac{1-a_T}{T}N^T_{tT},\qquad 0\le t\le1.CtT​=(1−aT​)λtTT​,VtT​=T1−aT​​NtTT​,0≤t≤1.

Formalization targets

The main target is Theorem 2.2, p. 10: CTC^TCT converges in law in the Skorohod topology on D[0,1]D[0,1]D[0,1] to the unique strong solution, started at zero, of the Cox–Ingersoll–Ross equation

Xt=∫0t(μ−Xs)λm ds+λm∫0tXs dBs.X_t=\int_0^t(\mu-X_s)\frac{\lambda}{m}\,ds +\frac{\sqrt\lambda}{m}\int_0^t\sqrt{X_s}\,dB_s.Xt​=∫0t​(μ−Xs​)mλ​ds+mλ​​∫0t​Xs​​dBs​.

Separately, VTV^TVT converges in law in the same path topology to t↦∫0tXs dst\mapsto\int_0^tX_s\,dst↦∫0t​Xs​ds. These are two convergence claims, each on its own path space law. The statement also asserts that the strong solution exists, so convergence to “every solution” cannot hold merely because there are no solutions.

The supporting targets follow the paper's stated results. Lemma 4.1 and Proposition 2.1 identify the resolvent renewal identity and the intensity's resolvent form; both are supporting theorem items. Lemmas 4.2–4.5 give separation and decay estimates for the plus-sign Fourier transforms of ϕ\phiϕ and ρT\rho^TρT, followed by L2L^2L2 convergence of ρT\rho^TρT to the exponential density (λ/m)e−xλ/m(\lambda/m)e^{-x\lambda/m}(λ/m)e−xλ/m. Lemma 4.9 gives a fourth-moment increment bound for the paper's residual process YTY^TYT, and Proposition 4.1 states that YTY^TYT tends to zero uniformly in probability on [0,1][0,1][0,1]. The latter six are source-stated milestones, with their pages and texts recorded separately.

Significance

The theorem identifies the scale at which a nearly unstable event model retains random dynamics. It also identifies the diffusion coefficients: the drift relaxes toward μ\muμ at rate λ/m\lambda/mλ/m, and the noise has coefficient λ/m\sqrt\lambda/mλ​/m times the square root of the current intensity. The second convergence claim transfers this intensity behavior to accumulated events. Those coefficients make the limit more informative than a statement that merely names a generic continuous process Jaisson and Rosenbaum, Theorem 2.2.

The result is proved in the paper but has no matching published Hawkes formalization in the local Prove2Me index used for this mission. Machine-checked definitions for Brownian motion and strong SDE solutions from the Ethier–Kurtz development are already available and referenced here. The new formal work is the Hawkes model, its path-space convergence, the density estimates, and the limit theorem itself. Formalizing the stated milestones would also leave reusable analytic and probability interfaces for other nearly unstable point-process limits.

Difficulty

Pointwise convergence of an intensity or of finitely many observations does not control its law as a cadlag path. Excitation also couples each event to later events, so a direct independent-increment argument is unavailable. The resolvent has to be controlled at the observation scale, including its high-frequency behavior, while the stochastic remainder has to be controlled uniformly over time. The final limit is a square-root SDE: its coefficient is not globally Lipschitz at zero, and a claim about its law must keep the initial condition and Brownian driver explicit Jaisson and Rosenbaum, §§4.2–4.3.

Formalization scope

The horizon TTT is a positive real sequence tending to infinity, as the paper's footnote specifies; aTa_TaT​ is a sequence in (0,1)(0,1)(0,1) tending to one. Each index may have its own probability space. The count is natural-number valued, nondecreasing, right-continuous, starts at zero, and has unit jumps. Its filtration is generated by evaluations of NTN^TNT. The intensity identity uses extended nonnegative integrals, avoiding an arbitrary real value for an infinite expectation. The right-continuous intensity includes an event at the current time, so CTC^TCT is cadlag. Its predictable left-limit version is available for stochastic integrands. All results use the half-line kernel and ϕT=aTϕ\phi^T=a_T\phiϕT=aT​ϕ; they never replace it by ϕ\phiϕ in the Hawkes process.

Skorohod convergence is represented by a coupling whose cadlag paths approach each other after increasing homeomorphic time changes of [0,1][0,1][0,1]. This is the representation form of weak convergence in D[0,1]D[0,1]D[0,1] with the J1J_1J1​ topology. The limit SDE uses the published global strong-solution predicate, then restricts its paths to [0,1][0,1][0,1]. Its drift is exactly (μ−x)λ/m(\mu-x)\lambda/m(μ−x)λ/m and diffusion exactly (λ/m)x(\sqrt\lambda/m)\sqrt{x}(λ​/m)x​; Real.sqrt on negative arguments does not affect its nonnegative solution. The renewal theorem item additionally makes the unknown fff measurable and locally bounded so its real convolution integral has its stated meaning. Fourier denominators exclude zero explicitly, while the zero-frequency bound is stated separately. The density convergence uses an extended nonnegative squared integral, and uniform probability convergence uses an extended supremum. These choices rule out default-zero values, a vacuous Hawkes class, a free limit process, and finite-dimensional convergence in place of path convergence.

The development needs half-line convolution and summable resolvents, natural filtrations and compensated point processes, Fourier bounds, cadlag path laws, and Itô SDEs. The convolution, path-space, and point-process interfaces are suitable for reuse. Contributions should preserve the exact hypotheses, constants, and two distinct convergence conclusions of the source theorem.

Selected references

  • T. Jaisson and M. Rosenbaum, Limit theorems for nearly unstable Hawkes processes, Annals of Applied Probability 25(2), 2015, arXiv:1310.2033v2. Preprint; DOI.
13 thms1 active userReviewed
ProbabilityStatistics·Captain: mikedeng1

Limit Theorems for Nearly Unstable Hawkes Processes 1: When T(1 − a_T) → ∞ the Rescaled Hawkes Process Is Asymptotically Deterministic in L²Research Paper

Motivation

A Hawkes process is a model for events that make further events more likely for a time. It is used when event times cluster, including transaction arrivals in financial markets. Jaisson and Rosenbaum study what happens when the feedback approaches the threshold at which the usual stable model ceases to have a finite long-run mean intensity. The behavior depends on how fast the observation horizon grows relative to that approach to instability. Their first regime says that, when the horizon grows sufficiently faster, the observed count still becomes deterministic after normalization. The precise result is Theorem 2.1 of Jaisson and Rosenbaum (2015).

The mission concerns that first regime alone. It isolates an L2L^2L2 statement that controls the whole observed path at once, rather than a count at one fixed time. Later results in the paper use a different balance between the horizon and the feedback parameter and produce stochastic diffusion limits. Those later regimes are separate missions in this series.

Setting

For each horizon T>0T>0T>0, let NtTN^T_tNtT​ count events through time ttt, starting from N0T=0N^T_0=0N0T​=0. It is observed for 0≤t≤T0\le t\le T0≤t≤T on a probability space that may depend on TTT. Its intensity is the nonnegative process

λtT=μ+∫0tϕT(t−s) dNsT,μ>0.\lambda_t^T=\mu+\int_0^t\phi^T(t-s)\,dN_s^T,\qquad \mu>0.λtT​=μ+∫0t​ϕT(t−s)dNsT​,μ>0.

The baseline μ\muμ creates events even before any excitation. At each jump of NTN^TNT, the kernel ϕT\phi^TϕT adds an effect that depends on the elapsed time since that event. The intensity property is specified relative to the natural filtration FtT=σ(NsT:0≤s≤t)\mathcal F_t^T=\sigma(N_s^T:0\le s\le t)FtT​=σ(NsT​:0≤s≤t): for 0≤a<b≤T0\le a<b\le T0≤a<b≤T and A∈FaTA\in\mathcal F_a^TA∈FaT​, the expected number of new events on AAA equals the expected integrated intensity on AAA over (a,b](a,b](a,b]. This is the defining condition used in §2.1 of the paper.

Assumption 1 fixes a nonnegative measurable kernel ϕ\phiϕ of total mass one and finite first moment m=∫0∞sϕ(s) dsm=\int_0^\infty s\phi(s)\,dsm=∫0∞​sϕ(s)ds. Its derivative is bounded and integrable. The horizon-dependent kernel is ϕT=aTϕ\phi^T=a_T\phiϕT=aT​ϕ, with 0<aT<10<a_T<10<aT​<1 and aT→1a_T\to1aT​→1. Thus ∥ϕT∥1=aT\|\phi^T\|_1=a_T∥ϕT∥1​=aT​ approaches the stability boundary. The paper also defines the compensated count MtT=NtT−∫0tλsT dsM_t^T=N_t^T-\int_0^t\lambda_s^T\,dsMtT​=NtT​−∫0t​λsT​ds and the resolvent ψT=∑k≥1(ϕT)∗k\psi^T=\sum_{k\ge1}(\phi^T)^{*k}ψT=∑k≥1​(ϕT)∗k, where each convolution uses nonnegative time. These enter the supporting results.

Formalization targets

The goal is Theorem 2.1, in the regime T(1−aT)→∞T(1-a_T)\to\inftyT(1−aT​)→∞. Its L2L^2L2 assertion is

E ⁣[(sup⁡v∈[0,1]1−aTT∣NTvT−E[NTvT]∣)2]⟶0.\mathbb E\!\left[\left(\sup_{v\in[0,1]}\frac{1-a_T}{T} \left|N^T_{Tv}-\mathbb E[N^T_{Tv}]\right|\right)^2\right]\longrightarrow0.E​(v∈[0,1]sup​T1−aT​​​NTvT​−E[NTvT​]​)2​⟶0.

The supremum is inside the expectation. The time variable vvv runs over the entire unit interval, so this is a statement about the normalized path of the count. The normalizing factor depends on both the horizon and the distance 1−aT1-a_T1−aT​ from the stability boundary.

The milestone list consists of the paper's renewal identity (Lemma 4.1), its two representations of the Hawkes mean and centered count, the exact mass of ψT\psi^TψT, a pathwise fluctuation bound, the Doob L2L^2L2 estimate for MTM^TMT, and the finite-horizon bound with constant 4μ/[T(1−aT)]4\mu/[T(1-a_T)]4μ/[T(1−aT​)]. The final estimate has no asymptotic hypothesis; the goal adds the regime condition and takes its limit. The unnumbered milestones are the displays in §4.1, pp. 14–15, and Lemma 4.1 appears in §4.2, p. 15.

Significance

The result identifies a regime in which near instability does not produce macroscopic random fluctuations at the paper's normalization. It supplies a boundary between the familiar deterministic large-horizon behavior of stable Hawkes processes and the diffusion behavior obtained under the paper's other scaling. The theorem controls the largest fluctuation over the whole observation interval, which is stronger than a statement at each fixed vvv or a bound on the supremum of separate variances.

The mathematical result is proved in the paper; the target here is a machine-checked proof of the same result. A completed development would also provide reusable Lean definitions for a simple counting process, its generated filtration, pathwise jump integration, Hawkes intensity, and nonnegative-time convolution resolvent. It would make explicit the maximal inequality and renewal estimates needed for other Hawkes scaling questions. This mission currently poses these statements as open Lean proof obligations; it does not claim the paper's proof is already formalized.

Difficulty

The near-instability parameter aTa_TaT​ tends to one, so estimates for a Hawkes process with a fixed a<1a<1a<1 cannot simply be used with a uniform constant. The scale of the mean and the size of the fluctuations both change with TTT. There is also a pathwise issue: the theorem places a supremum over all v∈[0,1]v\in[0,1]v∈[0,1] inside an L2L^2L2 expectation. A separate estimate for each vvv does not provide the required control of the path maximum.

The point-process side adds another layer. The compensated count is a continuous-time martingale with jumps, and the intensity depends on its own event history. The result therefore needs the correct relation among the natural filtration, the intensity identity, the resolvent, and the martingale maximum. The book-keeping at a jump matters: the cadlag intensity includes the jump at its time, while stochastic compensator integrals use the same process only up to a set of times of Lebesgue measure zero.

Formalization scope

The Lean development indexes the paper's implicit horizons as a sequence Tn>0T_n>0Tn​>0 tending to infinity; the multipliers an∈(0,1)a_n\in(0,1)an​∈(0,1) tend to one, and Tn(1−an)→∞T_n(1-a_n)\to\inftyTn​(1−an​)→∞. Each NTnN^{T_n}NTn​ may use a different probability space. Time is represented by real numbers, with the counting-process conditions applied on nonnegative time and the Hawkes intensity identity applied only through the observation horizon. The count is natural-number valued, right-continuous, nondecreasing, and has unit jumps. The Hawkes intensity is defined by a finite sum over jumps in (0,t](0,t](0,t], and the conditional intensity identity uses extended nonnegative expectations, so an infinite expectation is not silently assigned zero.

The kernel ϕ\phiϕ is measurable and nonnegative on [0,∞)[0,\infty)[0,∞), has total mass one and finite first moment, and has an integrable bounded derivative; differentiability at zero is one-sided. The resolvent starts at the first convolution power, not at an identity term. Its L1L^1L1 mass is taken over positive time. The path supremum and its squared expectation are extended nonnegative quantities. Ordinary real expectations of NTvTN^T_{Tv}NTvT​ are retained because their integrability follows from the Hawkes assumptions; the theorem does not assume it separately.

The Hawkes predicate is the paper's natural-filtration intensity condition for ϕT=aTϕ\phi^T=a_T\phiϕT=aT​ϕ. A vacuous process condition, an intensity built from ϕ\phiϕ instead of ϕT\phi^TϕT, or a supremum taken outside the expectation would change the target. Contributions to the generic counting-process and resolvent definitions, the renewal identity, the finite-horizon martingale estimates, and the goal theorem are all within scope. The source's p. 14 bound omits an absolute value on the centered count; the Lean milestone states the absolute-value form required by its subsequent squared estimate, while its verbatim field preserves the printed form.

Selected references

  • Thibault Jaisson and Mathieu Rosenbaum, Limit theorems for nearly unstable Hawkes processes, Annals of Applied Probability 25(2), 2015, arXiv:1310.2033v2. Pinned preprint; DOI.
10 thms1 active userReviewed
AnalysisProbability·Captain: mikedeng1

Affine Volterra Processes 3: Global Solutions with Nonpositive Real Part of the Square-Root Riccati–Volterra EquationResearch Paper

Motivation

The Volterra square-root model describes a nonnegative, time-dependent state whose present value depends on a weighted history. Ordinary square-root diffusions use a constant kernel and have a Markov state; replacing that kernel by a function of elapsed time allows persistent or singular memory. This matters for the transform formulas used to characterize distributions of such processes. Those formulas depend on a deterministic nonlinear integral equation, and require a solution that exists at every finite time. Abi Jaber, Larsson and Pulido isolate that requirement in Lemma 6.3 of Affine Volterra processes, arXiv:1708.08796v3 (2019).

The paper's Section 6 treats processes in the nonnegative orthant and its Section 7 specializes the framework to a Volterra Heston model. The present mission concerns the deterministic equation behind the Section 6 transform. The stochastic existence theorem and the transform identity are separate results in the same paper. Keeping this mission on the integral equation makes its analytic content usable independently of a chosen probability space.

Setting

Fix a finite coordinate set of size ddd. A diagonal kernel consists of real functions Ki(t)K_i(t)Ki​(t) for t≥0t\ge0t≥0, with the iii-th entry of the matrix kernel equal to KiK_iKi​ and all off-diagonal entries zero. A resolvent of the first kind for KiK_iKi​ is a nonnegative measure LiL_iLi​ for which the convolution Ki∗LiK_i*L_iKi​∗Li​ equals one at positive times. The relevant regularity condition, labeled (2.5), requires local square integrability and positive-time translation bounds of order hγih^{\gamma_i}hγi​ for some γi∈(0,2]\gamma_i\in(0,2]γi​∈(0,2]. Condition (3.4) requires a kernel to be nonnegative, nonzero, nonincreasing and continuous at positive times. It also requires its resolvent measure to have decreasing interval masses Li([s,s+t])L_i([s,s+t])Li​([s,s+t]) as sss increases. Each shifted function ΔhKi(t)=Ki(t+h)\Delta_hK_i(t)=K_i(t+h)Δh​Ki​(t)=Ki​(t+h) must satisfy (3.4) for 0≤h≤10\le h\le10≤h≤1, with its own resolvent. These are the assumptions of Theorem 6.1 and hence of its Lemma 6.3 (pp. 6, 14, 28–29).

Let u=(ui)u=(u_i)u=(ui​) be a complex row vector and let f(t)=(fi(t))f(t)=(f_i(t))f(t)=(fi​(t)) be a locally integrable complex row function. Let BBB be a real matrix whose off-diagonal entries are nonnegative, and let σi>0\sigma_i>0σi​>0. The iii-th square-root Riccati–Volterra equation is

ψi(t)=uiKi(t)+∫0tKi(t−s)(fi(s)+∑jψj(s)Bji+σi22ψi(s)2) ds.\psi_i(t)=u_iK_i(t)+\int_0^t K_i(t-s)\left(f_i(s)+\sum_j\psi_j(s)B_{ji}+\frac{\sigma_i^2}{2}\psi_i(s)^2\right)\,ds.ψi​(t)=ui​Ki​(t)+∫0t​Ki​(t−s)(fi​(s)+j∑​ψj​(s)Bji​+2σi2​​ψi​(s)2)ds.

The index BjiB_{ji}Bji​ selects column iii: in the paper's notation B=(b1  ⋯  bd)B=(b^1\;\cdots\;b^d)B=(b1⋯bd) and the coupling is ψ(s)bi\psi(s)b^iψ(s)bi. The kernel acts only on the iii-th equation, while BBB couples the coordinates. The coefficient b0b^0b0 from the stochastic process does not enter this equation (equation (6.3), p. 27).

Formalization targets

The goal is the global existence, uniqueness and sign statement of Lemma 6.3. If Re⁡ui≤0\operatorname{Re}u_i\le0Reui​≤0 and Re⁡fi≤0\operatorname{Re}f_i\le0Refi​≤0, then

∃! ψ∈Lloc2(R+,Cd)solving (6.3) globally, withRe⁡ψi≤0for every i.\exists!\,\psi\in L^2_{\mathrm{loc}}(\mathbb R_+,\mathbb C^d) \quad\text{solving (6.3) globally, with}\quad \operatorname{Re}\psi_i\le0\quad\text{for every }i.∃!ψ∈Lloc2​(R+​,Cd)solving (6.3) globally, withReψi​≤0for every i.

For functions defined only up to null sets, the equation, uniqueness and sign conclusion are understood almost everywhere. The goal has no fixed time horizon and no hard-coded kernel: it covers every diagonal kernel satisfying the paper's conditions. The five milestones record the source's analytic support: the shifted resolvent bounds (3.9)–(3.10), the L2L^2L2 stability lemma C.1, maximal-solution Theorem B.1, global-solution Corollary B.3 and nonnegative-orthant invariance Theorem C.2. Their statements and locations are recorded in the milestone list.

Significance

Global solvability makes the square-root transform equation meaningful at any finite horizon. Uniqueness fixes the transform parameter determined by a kernel and forcing function. The nonpositive real part is the sign property needed in the paper's subsequent exponential-affine transform argument for nonnegative states (Theorem 6.1(ii), pp. 28–29). Without a global solution, that argument would only address a time interval before a possible blow-up.

The result is proved in the cited paper; this mission asks for a machine-checked development of that known theorem and its supporting integral-equation results. Its reusable output includes an L2L^2L2 notion of Volterra solution, the first-kind resolvent hypotheses, maximal lifetime, stability under changes of forcing and kernel, and a comparison statement for diagonal systems. The goal and milestones are presently proof obligations, not claims of existing machine-checked proofs.

Difficulty

Local solvability alone does not control the quadratic term ψi2\psi_i^2ψi2​ for arbitrarily large time. In particular, a generic local fixed-point theorem can yield a maximal solution whose L2L^2L2 norm diverges at a finite horizon. Sign information for the real part is also coupled to the imaginary part through that quadratic term; checking each coordinate independently does not establish invariance of the nonpositive half-plane. The analysis has to preserve the kernel's first-kind resolvent conditions and the off-diagonal sign pattern of BBB across the coupled system. Singular kernels allowed by (2.5) prevent replacing the problem with a standard ordinary differential equation.

Formalization scope

Time is represented by real numbers and every local LpL^pLp condition is restricted to positive bounded intervals. Vectors are functions on Fin d; matrix LpL^pLp membership is componentwise. These finite-dimensional norms are equivalent to the Euclidean and operator norms used in the paper. The kernel regularity estimates are Big-O statements as hhh tends to zero through positive values. A first-kind resolvent is a nonnegative measure supported on nonnegative times, with the convolution identity and interval-mass monotonicity stated directly. The convolution at positive time is an interval integral; the bound at zero in (3.10) uses the integral on [0,0][0,0][0,0], while the source describes a right-continuous extension when available.

Solutions are locally square integrable and satisfy their equations almost everywhere. The integrability of each asserted convolution is part of the solution predicate, so the default zero value of a nonintegrable Lean integral cannot create a spurious solution. A maximal lifetime is extended-nonnegative-real valued, allowing infinity, and a finite lifetime requires an infinite extended L2L^2L2 norm. Sign conditions on locally integrable forcing and on the solution are almost everywhere. Measurable time dependence of the nonlinear drift is made explicit for Theorem B.1 and Corollary B.3, where it is necessary to interpret their integrals. The condition b0≥0b^0\ge0b0≥0 of the square-root process is omitted from the goal because b0b^0b0 is absent from (6.3).

The development needs Mathlib's Bochner integrals, local LpL^pLp predicates, measures, complex arithmetic and asymptotic filters. Proof contributions to the five source milestones and the goal are welcome, including infrastructure for nonconvolution Volterra resolvents where the paper cites earlier literature. The formalization must keep the coefficient σi2/2\sigma_i^2/2σi2​/2, the column index BjiB_{ji}Bji​, and every shift h∈[0,1]h\in[0,1]h∈[0,1].

Selected references

  • E. Abi Jaber, M. Larsson and S. Pulido, Affine Volterra processes, arXiv:1708.08796v3, 2019. Preprint.
  • G. Gripenberg, S.-O. Londen and O. Staffans, Volterra Integral and Functional Equations, Cambridge University Press, 1990. DOI.
8 thms1 active userReviewed
AnalysisProbability·Captain: mikedeng1

Affine Volterra Processes 2: The Exponential-Affine Transform Formula via the Riccati–Volterra EquationResearch Paper

Motivation

Many stochastic models have a present state that depends on a weighted history of past drift and noise. A stochastic Volterra equation captures this dependence through a kernel KKK: a recent increment and an older increment can enter the current state with different weights. Classical affine diffusions arise from the special constant kernel K=IK=IK=I. For those diffusions, conditional Fourier–Laplace transforms can often be found from finite-dimensional Riccati ordinary differential equations. The paper by Abi Jaber, Larsson and Pulido asks for an analogous transform when the kernel retains memory. Its Theorem 4.3 gives a formula for a continuous affine Volterra process under a stated Riccati–Volterra solution assumption.

The result matters for models in which the history cannot be replaced by the current state alone. The transform characterizes conditional distributions and integrated path functionals in the form used by the paper's later results. The present mission isolates Theorem 4.3 and four of its stated supporting claims. The paper proves these results; the mission seeks machine-checked proofs of their Lean statements.

Setting

Fix a positive integer ddd and a deterministic, matrix-valued kernel K:[0,∞)→Rd×dK:[0,\infty)\to\mathbb R^{d\times d}K:[0,∞)→Rd×d whose entries are locally square integrable. The Volterra convolution of KKK with a vector function vvv is (K∗v)(t)=∫0tK(t−s)v(s) ds(K*v)(t)=\int_0^t K(t-s)v(s)\,ds(K∗v)(t)=∫0t​K(t−s)v(s)ds. Matrix convolutions retain the order of multiplication: (K∗R)(t)=∫0tK(t−s)R(s) ds(K*R)(t)=\int_0^t K(t-s)R(s)\,ds(K∗R)(t)=∫0t​K(t−s)R(s)ds.

Let A0,…,AdA^0,\ldots,A^dA0,…,Ad be real symmetric matrices and b0,…,bdb^0,\ldots,b^db0,…,bd real column vectors. Their affine covariance and drift are a(x)=A0+∑ixiAia(x)=A^0+\sum_i x_iA^ia(x)=A0+∑i​xi​Ai and b(x)=b0+∑ixibib(x)=b^0+\sum_i x_i b^ib(x)=b0+∑i​xi​bi. The matrix B=(b1 ⋯ bd)B=(b^1\ \cdots\ b^d)B=(b1 ⋯ bd) has the bib^ibi as columns. For a complex row uuu, write A(u)=(uA1u⊤,…,uAdu⊤)A(u)=(uA^1u^\top,\ldots,uA^du^\top)A(u)=(uA1u⊤,…,uAdu⊤); the transpose is ordinary, with no complex conjugation.

An affine Volterra process XXX is a continuous solution of

Xt=x0+∫0tK(t−s)b(Xs) ds+∫0tK(t−s)σ(Xs) dWs.X_t=x_0+\int_0^t K(t-s)b(X_s)\,ds+\int_0^t K(t-s)\sigma(X_s)\,dW_s.Xt​=x0​+∫0t​K(t−s)b(Xs​)ds+∫0t​K(t−s)σ(Xs​)dWs​.

Here WWW is a ddd-dimensional Brownian motion on a usual stochastic basis, x0x_0x0​ is deterministic, and XXX stays in a state space EEE. The continuous coefficient σ\sigmaσ obeys σ(x)σ(x)⊤=a(x)\sigma(x)\sigma(x)^\top=a(x)σ(x)σ(x)⊤=a(x) on EEE, where a(x)a(x)a(x) is positive semidefinite. This is Definition 4.1 and the standing setting of Section 4 of the paper.

Formalization targets

The main target is Theorem 4.3. Fix a finite horizon TTT, a complex row uuu, and an integrable complex-row function fff. Suppose a square-integrable function ψ\psiψ solves the Riccati–Volterra equation

ψ=uK+(f+ψB+12A(ψ))∗K.\psi=uK+\bigl(f+\psi B+\tfrac12A(\psi)\bigr)*K.ψ=uK+(f+ψB+21​A(ψ))∗K.

Define YYY by the stochastic integral and drift in equations (4.4)–(4.5). The theorem identifies YtY_tYt​ with a conditional mean plus a quadratic correction:

Yt=E[uXT+(f∗X)T∣Ft]+12∫tTψ(T−s)a(E[Xs∣Ft])ψ(T−s)⊤ ds,0≤t≤T.Y_t=\mathbb E[uX_T+(f*X)_T\mid\mathcal F_t] +\tfrac12\int_t^T\psi(T-s)a(\mathbb E[X_s\mid\mathcal F_t])\psi(T-s)^\top\,ds, \qquad 0\le t\le T.Yt​=E[uXT​+(f∗X)T​∣Ft​]+21​∫tT​ψ(T−s)a(E[Xs​∣Ft​])ψ(T−s)⊤ds,0≤t≤T.

It also states that eYe^{Y}eY is a local martingale on [0,T][0,T][0,T]. If it is a true martingale, then the exponential-affine transform formula is

E ⁣[euXT+(f∗X)T∣Ft]=eYt,t≤T.\mathbb E\!\left[e^{uX_T+(f*X)_T}\mid\mathcal F_t\right]=e^{Y_t},\qquad t\le T.E[euXT​+(f∗X)T​∣Ft​]=eYt​,t≤T.

The milestone list records Lemma 4.2's conditional and unconditional means, the mean Volterra equation stated in the proof of Theorem 4.3, the resolvent commutation claim in the proof of Lemma 4.4, and Lemma 4.4's equivalent Riccati equation. A second-kind resolvent RBR_BRB​ of −KB-KB−KB uses the paper's sign convention H∗RB=RB∗H=H−RBH*R_B=R_B*H=H-R_BH∗RB​=RB​∗H=H−RB​ for H=−KBH=-KBH=−KB; the equivalent equation uses EB=K−RB∗KE_B=K-R_B*KEB​=K−RB​∗K.

Significance

The conditional transform links a path-dependent stochastic equation to a deterministic nonlinear Volterra equation. It supplies a way to describe the law of a future state together with a linear functional of its past. The conditional-mean milestone separately gives a usable formula for E[XT∣Ft]\mathbb E[X_T\mid\mathcal F_t]E[XT​∣Ft​], while the resolvent milestones identify the deterministic kernel relations needed by the transform.

The source provides proofs of these claims. The formalization task is to check their assumptions and equalities against a precise model of Brownian Itô integration, conditional expectation, and matrix convolution. Published Lean definitions for Brownian motion and an Itô integral relation are reused. The affine Volterra process, its Riccati equation, and these theorem statements are drafted here; their proofs remain open.

Difficulty

The conditional payoff involves the entire path before TTT, while XXX generally has no finite-dimensional Markov state. Consequently, the familiar affine-diffusion formula in terms of XtX_tXt​ alone is not the target of Theorem 4.3. Deterministic matrix convolutions are order-sensitive, and the two resolvents of −KB-KB−KB and −BK-BK−BK have different kernels. Stochastic convolutions also have integrands that depend on the terminal time. The passage from fixed-time integral equalities to a continuous local-martingale process requires care about versions and filtration adaptation.

Formalization scope

Processes use nonnegative real time, while deterministic kernels and interval integrals use real time. Finite-dimensional LpL^pLp conditions are checked componentwise. Kernel and resolvent identities between locally integrable functions hold almost everywhere on positive time. Riccati equations hold almost everywhere on [0,T][0,T][0,T]; stochastic and conditional identities hold almost surely at each fixed time. The local-martingale claim uses the real and imaginary parts of the complex exponential, stopped at TTT.

The process definition includes the Section 4 assumptions on symmetry, covariance positivity, continuity of σ\sigmaσ, deterministic x0x_0x0​, and the usual stochastic basis. Brownian Itô terms are constrained by the published integral relation. Deterministic drift convolutions require integrable integrands. The theorem asserts integrability of the payoff and of XsX_sXs​ as conclusions, preventing conditional expectation from defaulting to zero. In (4.6) the conditional means E[Xs∣Ft]\mathbb E[X_s\mid\mathcal F_t]E[Xs​∣Ft​] enter the dsdsds-integral through a jointly measurable version in (s,ω)(s,\omega)(s,ω), so that integral cannot default to zero. The dimension is positive, and the theorem does not specialize the kernel to III or insert a resolvent assumption into its goal.

A complete development will need reusable results on locally integrable matrix kernels and their resolvents, stochastic Fubini interchange, moment bounds for Volterra solutions, and conditional expectation of the resulting integrals. The moment bound is posed as Lemma 3.1 in the companion existence mission. This draft includes the four listed milestones; Lemmas 2.1 and 2.5 from the source are left for a fuller stochastic Fubini and semimartingale encoding. Contributions that preserve their general hypotheses and conclusions are welcome.

Selected references

  • E. Abi Jaber, M. Larsson, and S. Pulido, Affine Volterra processes, arXiv:1708.08796v3, 2019. Preprint
14 thms1 active userReviewed
AnalysisProbability·Captain: mikedeng1

Affine Volterra Processes 1: Nonnegative Weak Solutions of Stochastic Volterra Equations with Resolvent-Monotone KernelsResearch Paper

Motivation

Many stochastic models use a process whose response to a disturbance depends on the time elapsed since that disturbance. An ordinary stochastic differential equation uses only the current state and instantaneous coefficients. A stochastic Volterra equation instead weights its past drift and noise through a convolution kernel. Such equations include the constant kernel as a familiar limiting case, while singular or decaying kernels allow different memory patterns. The paper Affine Volterra processes studies this class to obtain non-Markovian models that retain tractable affine transform formulas. Before any transform can be used for a nonnegative state variable, the underlying equation must actually admit a solution that stays nonnegative. Abi Jaber, Larsson and Pulido, §§1–3.

The mission focuses on the paper's existence and invariance theorem, Theorem 3.6 of the pinned preprint. It is a separate question from uniqueness or explicit transforms: the coefficients are only continuous with linear growth, so classical contraction arguments for Lipschitz coefficients do not directly settle it. The proof also has to preserve the boundary of the nonnegative orthant despite a drift and noise term that depend on the entire past. Abi Jaber, Larsson and Pulido, Theorems 3.3–3.6.

Setting

Fix dimensions d,m≥0d,m\ge0d,m≥0. The kernel KKK is a deterministic function from nonnegative time to real d×dd\times dd×d matrices. The drift bbb maps Rd\mathbb R^dRd to Rd\mathbb R^dRd, and the diffusion coefficient σ\sigmaσ maps Rd\mathbb R^dRd to real d×md\times md×m matrices. Given a deterministic initial state x0x_0x0​ and an mmm-dimensional Brownian motion WWW, a continuous adapted process XXX solves

Xt=x0+∫0tK(t−s)b(Xs) ds+∫0tK(t−s)σ(Xs) dWs,t≥0.X_t=x_0+\int_0^t K(t-s)b(X_s)\,ds+ \int_0^t K(t-s)\sigma(X_s)\,dW_s,\qquad t\ge0.Xt​=x0​+∫0t​K(t−s)b(Xs​)ds+∫0t​K(t−s)σ(Xs​)dWs​,t≥0.

The deterministic and stochastic terms are matrix-vector convolutions: an event at time sss has an effect at time ttt weighted by K(t−s)K(t-s)K(t−s). A weak solution is allowed to choose its stochastic basis and Brownian motion. A strong solution is adapted to the completed filtration generated by its prescribed Brownian motion. All bases satisfy the usual completeness and right-continuity conditions. The equation is read at each fixed time almost surely, with XXX having continuous sample paths. Abi Jaber, Larsson and Pulido, (1.1), §3.

The paper's condition (2.5) asks each scalar kernel entry to be locally square-integrable and to satisfy two estimates of order hγh^\gammahγ as h↓0h\downarrow0h↓0: the integral of its square over [0,h][0,h][0,h], and the squared L2L^2L2 difference between its time shift by hhh and itself over each finite interval. The exponent satisfies 0<γ≤20<\gamma\le20<γ≤2 and may differ by entry. For the goal, KKK is diagonal. Each diagonal entry KiK_iKi​ is nonnegative, nonzero, nonincreasing and continuous on positive time. Its resolvent of the first kind LiL_iLi​ is a nonnegative measure whose convolution with KiK_iKi​ is the constant one; condition (3.4) also requires the interval mass Li([s,s+t])L_i([s,s+t])Li​([s,s+t]) to be nonincreasing in sss for every t≥0t\ge0t≥0. Abi Jaber, Larsson and Pulido, (2.5), (2.13), (3.4).

Formalization targets

Nonnegative weak existence

The goal is Theorem 3.6. Write R+d={x∈Rd:xi≥0 for all i}\mathbb R^d_+=\{x\in\mathbb R^d:x_i\ge0\text{ for all }i\}R+d​={x∈Rd:xi​≥0 for all i}. Suppose KKK is diagonal and satisfies (2.5) and (3.4) componentwise. Suppose bbb and σ\sigmaσ are continuous, satisfy max⁡{∣b(x)∣,∥σ(x)∥}≤cLG(1+∣x∣)\max\{|b(x)|,\|\sigma(x)\|\}\le c_{\mathrm{LG}}(1+|x|)max{∣b(x)∣,∥σ(x)∥}≤cLG​(1+∣x∣), and obey the boundary condition for every x∈Rdx\in\mathbb R^dx∈Rd:

xi=0⟹bi(x)≥0 and σik(x)=0for every k.x_i=0\quad\Longrightarrow\quad b_i(x)\ge0\ \text{and}\ \sigma_{ik}(x)=0\quad\text{for every }k.xi​=0⟹bi​(x)≥0 and σik​(x)=0for every k.

Then the target is

∀x0∈R+d,∃ a continuous weak solution X of (1.1) with Xt∈R+d.\forall x_0\in\mathbb R^d_+,\quad \exists\text{ a continuous weak solution }X\text{ of (1.1) with }X_t\in\mathbb R^d_+.∀x0​∈R+d​,∃ a continuous weak solution X of (1.1) with Xt​∈R+d​.

The milestone list records the paper's moment bound, strong existence for Lipschitz coefficients, and general weak existence with a first-kind resolvent. They are numbered results from the same preprint and establish distinct parts of the existence framework. Abi Jaber, Larsson and Pulido, Lemma 3.1 and Theorems 3.3, 3.4, 3.6.

Significance

The conclusion says more than finite-time nonnegativity of a proposed process: it asserts that a stochastic basis, Brownian motion and continuous solution actually exist for every nonnegative initial condition under the stated kernel and boundary assumptions. This supports later use of the affine transform results on state spaces with nonnegative coordinates. The paper treats this existence theorem as one of the main inputs to its square-root and rough-volatility examples. Abi Jaber, Larsson and Pulido, §§3, 6.

The theorem is already proved in the source paper. The formalization task is to state and eventually verify that known result in Lean, including the exact memory-kernel condition and the stochastic basis chosen by weak existence. The published Brownian and Itô-integral definitions are reused. A verified solution would leave reusable definitions for Volterra kernels, first-kind resolvents, and weak convolution equations, as well as machine-checked statements for the supporting existence theorems.

Difficulty

For Lipschitz coefficients, the paper obtains a unique strong solution. The goal permits only continuous coefficients of linear growth. Approximating them by better-behaved coefficients does not by itself guarantee that a limit solves the original convolution equation or remains in the nonnegative orthant. The stochastic convolution depends on the full history through K(t−s)K(t-s)K(t−s), and the boundary condition must be propagated through that memory. A direct appeal to an ordinary SDE invariance theorem therefore does not cover the claim. The first-kind resolvent and the monotonicity in (3.4) are central to the stated assumptions. Abi Jaber, Larsson and Pulido, proofs of Theorems 3.4 and 3.6.

Formalization scope

Lean uses EthierKurtz.SDEState d, a Euclidean ddd-vector, for states; real matrices for KKK and σ\sigmaσ; nonnegative real process time; and real arguments for deterministic kernels and interval integrals. Local L2L^2L2 membership is componentwise, which is equivalent to membership under any norm on the finite-dimensional matrix space. The matrix norm in linear growth is the Euclidean operator norm. The big-OOO bounds in (2.5) are taken as hhh tends to zero from the right. Each diagonal kernel has its own exponent and its own positive resolvent measure. A general matrix first-kind resolvent is encoded entrywise as the difference of two measures finite on compact positive-time intervals, so it may have infinite total mass.

The weak-solution predicate existentially quantifies the stochastic basis, Brownian motion and continuous process. Each stochastic convolution has a witness satisfying the published Brownian Itô relation; an unconstrained process cannot witness the equation. Drift terms carry interval integrability, avoiding a default-zero value for a nonintegrable integral. The stochastic basis is complete at time zero and right-continuous. The goal asserts orthant membership at every fixed time almost surely; continuous paths yield an orthant-valued version. The zero-time equation and empty-index cases are included. Contributions that formalize stochastic-convolution continuity, compactness of path laws, first-kind resolvent calculus, or invariance of the orthant are in scope.

Selected references

  • E. Abi Jaber, M. Larsson and S. Pulido, Affine Volterra processes, arXiv:1708.08796v3, 2019. Preprint
12 thms1 active userReviewed
Dynamical SystemsProbability·Captain: mikedeng1

Coexistence and Extinction for Stochastic Kolmogorov Systems 2: If a Boundary Ergodic Measure Is a Sink, then E(min_i X_i(t))^δ → 0 for Every Small δ > 0Research Paper

Why stochastic extinction matters

A population can disappear because its average growth rate is negative when it is rare, even if its deterministic dynamics would support coexistence. Interactions among several species make this harder to assess: a species may be rare while the remaining species fluctuate among several possible long-run configurations. Hening and Nguyen study this problem for nonlinear systems driven by correlated environmental Brownian noise. Their analysis treats the noncompact state space [0,∞)n[0,\infty)^n[0,∞)n, where population sizes have no fixed upper bound. The central result of this mission gives a quantitative form of approach to the boundary when one boundary community acts as a sink: the expected positive moment of the smallest population size tends to zero. The source is Hening and Nguyen, Coexistence and extinction for stochastic Kolmogorov systems, arXiv:1704.06984v1, Theorems 1.2 and 5.1.

The population system and its boundary laws

There are n≥1n\ge1n≥1 species. Their abundances form X(t)=(X1(t),…,Xn(t))∈R+n=[0,∞)nX(t)=(X_1(t),\ldots,X_n(t))\in\mathbb R^n_+=[0,\infty)^nX(t)=(X1​(t),…,Xn​(t))∈R+n​=[0,∞)n. Species iii has per capita drift fi(x)f_i(x)fi​(x) and environmental noise intensity gi(x)g_i(x)gi​(x) at state xxx. A matrix Γ\GammaΓ correlates the noise: E=Γ⊤BE=\Gamma^\top BE=Γ⊤B for a vector BBB of independent standard Brownian motions, and Σ=Γ⊤Γ=(σij)\Sigma=\Gamma^\top\Gamma=(\sigma_{ij})Σ=Γ⊤Γ=(σij​). The stochastic Kolmogorov system is

dXi(t)=Xi(t)fi(X(t)) dt+Xi(t)gi(X(t)) dEi(t),i=1,…,n.dX_i(t)=X_i(t)f_i(X(t))\,dt+X_i(t)g_i(X(t))\,dE_i(t),\qquad i=1,\ldots,n.dXi​(t)=Xi​(t)fi​(X(t))dt+Xi​(t)gi​(X(t))dEi​(t),i=1,…,n.

The factor XiX_iXi​ makes the state Xi=0X_i=0Xi​=0 absorbing in that coordinate. Consequently each collection of present species defines an invariant face of the orthant. The interior R+n,∘=(0,∞)n\mathbb R^{n,\circ}_+=(0,\infty)^nR+n,∘​=(0,∞)n consists of states where every species is present. The paper uses ∥x∥=∑i∣xi∣\|x\|=\sum_i|x_i|∥x∥=∑i​∣xi​∣ throughout. Its standing Assumption 1.1 requires local Lipschitz coefficients, nondegenerate noise in each population subspace, and a negative large-state drift condition (1.2) expressed through positive cic_ici​ and γb\gamma_bγb​. These conditions place the same control on the unbounded part of the orthant in every theorem below. Source, §1.1, pp. 3–4.

A probability measure μ\muμ is invariant if the law of X(t)X(t)X(t) remains μ\muμ when X(0)X(0)X(0) has law μ\muμ. It is ergodic if it is an extreme point of the invariant probability measures. Let MMM contain the ergodic invariant measures supported on the boundary ∂R+n\partial\mathbb R^n_+∂R+n​. This set includes the Dirac law δ∗\delta_*δ∗​ at zero. For any invariant μ\muμ, the invasion rate of species iii is

λi(μ)=∫(fi(x)−12σiigi(x)2) μ(dx).\lambda_i(\mu)=\int\left(f_i(x)-\tfrac12\sigma_{ii}g_i(x)^2\right)\,\mu(dx).λi​(μ)=∫(fi​(x)−21​σii​gi​(x)2)μ(dx).

The term σiigi2/2\sigma_{ii}g_i^2/2σii​gi2​/2 records the effect of environmental variation on logarithmic population growth. For μ∈M\mu\in Mμ∈M, let IμI_\muIμ​ be its present species and R+μ\mathbb R^\mu_+R+μ​ its coordinate face. The set MμM_\muMμ​ contains boundary ergodic measures supported on the boundary of that face. Assumption 1.3 requires λi(μ)<0\lambda_i(\mu)<0λi​(μ)<0 for every i∉Iμi\notin I_\mui∈/Iμ​ and, when Iμ≠∅I_\mu\ne\varnothingIμ​=∅, a positive invasion rate among IμI_\muIμ​ for every finite convex combination of measures in MμM_\muMμ​. Thus the missing species decline near μ\muμ, while the community on its face resists collapse to a smaller face. Source, pp. 5–6.

Formalization targets

The goal is Theorem 1.2 in the explicit quantification of Theorem 5.1. Let δ0>0\delta_0>0δ0​>0 satisfy the paper's bound (3.2). For every 0<δ<δ00<\delta<\delta_00<δ<δ0​ and every x∈R+n,∘x\in\mathbb R^{n,\circ}_+x∈R+n,∘​,

lim⁡t→∞Ex(min⁡1≤i≤nXi(t))δ=0.\lim_{t\to\infty}\mathbb E_x\left(\min_{1\le i\le n}X_i(t)\right)^\delta=0.t→∞lim​Ex​(1≤i≤nmin​Xi​(t))δ=0.

This is the moment form of approach to the boundary. It does not specify which species tends to zero on a given path. The companion targets retain the paper's route: strong solutions and face invariance in Lemma 3.1, moment and Feller estimates in Lemma 3.2, zero resident invasion rates in Lemma 5.1, the weighted negative margin (5.1)–(5.2), the averaged drift bound in Lemma 5.2, local contraction in Proposition 5.1, global control in Lemma 5.3, the capped one-step bound (5.11)–(5.12), and transience in the interior. Source, §§3 and 5.

What the result gives

The conclusion detects extinction pressure without asking in advance which coordinate disappears. Since the minimum of the coordinates is small whenever the system is near any boundary face, it applies even when trajectories may approach different faces. The paper uses this result before its stronger classification theorem, which adds assumptions to determine the fate of particular species. Theorem 1.2 is proved in the cited paper; this mission seeks a machine-checked development of that known result and its supporting stochastic estimates. In particular, the formalization makes explicit how invariant measures on smaller faces control a statement about solutions starting in the full interior. Source, Theorems 1.2 and 1.3.

Where the difficulty lies

A negative invasion rate at one boundary law does not by itself control the whole trajectory. The surviving species can fluctuate toward a still smaller face, where a missing species may have a different growth rate. Assumption 1.3 excludes that obstruction by quantifying over boundary ergodic laws of the selected face. Another obstacle is unbounded population size: a local bound near the face cannot alone give convergence of expected moments. The paper combines face-specific estimates with global moment control; encoding both regimes faithfully is the main mathematical burden. The compact-state intuition cited in the paper does not immediately apply to the noncompact orthant. Source, Remark 1.6 and §5.

Formalization scope

Lean represents Rn\mathbb R^nRn by the published EthierKurtz.SDEState n, with coordinates indexed by Fin n from zero to n−1n-1n−1. The SDE uses the published strong Brownian solution interface; a common probability space, Brownian motion, and solution family replace the paper's notation Px\mathbb P_xPx​ and Ex\mathbb E_xEx​. The model reads coefficients at the componentwise positive part off the orthant, where the source never evaluates them. Assumption 1.1(3)'s strict limit superior becomes an equivalent eventual negative ε\varepsilonε bound. Ergodicity is extremality. The index set IμI_\muIμ​ is defined through positive μ\muμ-mass of xi>0x_i>0xi​>0. Finite convex combinations, rather than a closure of their hull, implement the paper's Conv⁡\operatorname{Conv}Conv.

The stated goal requires n≥1n\ge1n≥1 and δ>0\delta>0δ>0; δ=0\delta=0δ=0 would make the displayed expectation equal to one. Theorem 5.1 suppresses the latter restriction, while Theorem 1.2 states it. Lemma 5.2's displayed average divides by TTT, so its TeT_eTe​ is positive, as its proof says, despite the printed Te≥0T_e\ge0Te​≥0. The weights, time threshold, and contraction exponent are chosen before the points and times over which their bounds hold. Boundary ergodic measures are not assumed to be absent; the explicit δ∗∈M\delta_*\in Mδ∗​∈M target records nonemptiness. The definitions of UθU_\thetaUθ​, invariant measures and invasion rates, together with finite-dimensional stochastic integration and moment estimates, are reusable beyond this mission. Contributions that establish these interfaces or prove the listed paper statements are in scope.

The radius MMM of (3.1) is positive. The freely chosen δ0\delta_0δ0​ is below one, as Appendix A uses, and the extinction weights are selected with ∑i∈Iμp^i≤δ0\sum_{i\in I_\mu}\widehat p_i\le\delta_0∑i∈Iμ​​p​i​≤δ0​. Scaling all positive weights and the margin preserves (5.2) and makes the paper's CUC_UCU​ finite. Bounds involving real expectations explicitly include integrability, so Lean's value for a nonintegrable integral cannot satisfy them by default. The transience target applies to each compact interior set with nonempty interior, as the proof on p. 24 does.

Selected references

  • Alexandru Hening and Dang H. Nguyen, Coexistence and extinction for stochastic Kolmogorov systems, Annals of Applied Probability 28(3), 2018. Formalization uses arXiv:1704.06984v1, 23 April 2017, especially pp. 3–7, 13–14, and 20–24.
18 thms1 active userReviewed
Dynamical SystemsProbability·Captain: mikedeng1

Coexistence and Extinction for Stochastic Kolmogorov Systems 3: Almost Surely the Occupation Measures Settle on One Sink Measure µ, and Every Species Absent from µ Dies Out at Rate λ_i(µ) < 0Research Paper

Motivation

Ecologists model interacting populations — competitors, predators and prey, food chains — by Kolmogorov systems, in which the growth of each species is proportional to its current abundance. Environmental fluctuations turn these into stochastic differential equations, and the basic question becomes which species persist and which go extinct. Hening and Nguyen (arXiv:1704.06984, Ann. Appl. Probab. 28(3), 2018) gave sharp answers for a general class of such systems on the non-compact state space [0,∞)n[0,\infty)^n[0,∞)n, extending the compact-simplex theory of Schreiber, Benaïm and Atchadé (SBA11).

The paper has three main results: persistence when every boundary ergodic measure repels (Theorem 1.1), extinction in mean when one boundary measure attracts (Theorem 1.2), and a classification of which species die out (Theorem 1.3). This mission formalizes the third. When the community does not persist, Theorem 1.3 says that each path settles near exactly one "sink" measure on the boundary, and identifies the species that vanish and their rates of decay.

Timeline: Schreiber, Benaïm and Atchadé (2011) proved persistence criteria for stochastic population models on the simplex {y∈R+n:y1+⋯+yn=1}\{y \in \mathbb R^n_+ : y_1 + \dots + y_n = 1\}{y∈R+n​:y1​+⋯+yn​=1}. Evans, Hening and Schreiber (EHS15, 2015), studying patch-selection strategies in stochastic environments, extended the limit theorem for occupation measures to locally compact state spaces. Hening and Nguyen (2017/2018) proved persistence with exponential convergence and the extinction classification for general Kolmogorov systems.

Setting

Let n≥1n \ge 1n≥1, R+n=[0,∞)n\mathbb R^n_+ = [0,\infty)^nR+n​=[0,∞)n, R+n,∘=(0,∞)n\mathbb R^{n,\circ}_+ = (0,\infty)^nR+n,∘​=(0,∞)n, ∂R+n=R+n∖R+n,∘\partial\mathbb R^n_+ = \mathbb R^n_+\setminus\mathbb R^{n,\circ}_+∂R+n​=R+n​∖R+n,∘​, and ∥x∥=∑i∣xi∣\|x\| = \sum_i |x_i|∥x∥=∑i​∣xi​∣. The abundances X=(X1,…,Xn)X = (X_1,\dots,X_n)X=(X1​,…,Xn​) solve

dXi(t)=Xi(t)fi(X(t)) dt+Xi(t)gi(X(t)) dEi(t),i=1,…,n,dX_i(t) = X_i(t)f_i(X(t))\,dt + X_i(t)g_i(X(t))\,dE_i(t),\qquad i = 1,\dots,n,dXi​(t)=Xi​(t)fi​(X(t))dt+Xi​(t)gi​(X(t))dEi​(t),i=1,…,n,

where E=Γ⊤BE = \Gamma^\top BE=Γ⊤B for an nnn-dimensional standard Brownian motion BBB, and Σ=Γ⊤Γ=(σij)\Sigma = \Gamma^\top\Gamma = (\sigma_{ij})Σ=Γ⊤Γ=(σij​). Assumption 1.1 asks that (gigjσij)(g_ig_j\sigma_{ij})(gi​gj​σij​) be positive definite, that fi,gif_i, g_ifi​,gi​ be locally Lipschitz, and that a dissipativity condition (1.2) with a vector c>0c > 0c>0 and a constant γb>0\gamma_b > 0γb​>0 hold at infinity.

An invariant probability measure μ\muμ is one with ∫P(t,x,A) μ(dx)=μ(A)\int P(t,x,A)\,\mu(dx) = \mu(A)∫P(t,x,A)μ(dx)=μ(A) for all ttt; it is ergodic if it is an extreme point of the invariant probability measures. M\mathcal MM is the set of ergodic invariant probability measures supported on ∂R+n\partial\mathbb R^n_+∂R+n​; it contains the Dirac mass δ∗\delta^*δ∗ at the origin. For μ∈M\mu \in \mathcal Mμ∈M, IμI_\muIμ​ is the set of species charged by μ\muμ and IμcI^c_\muIμc​ its complement. The Lyapunov exponent of species iii at μ\muμ is

λi(μ)=∫(fi(x)−σiigi2(x)2)μ(dx).\lambda_i(\mu) = \int\Big(f_i(x) - \frac{\sigma_{ii}g_i^2(x)}{2}\Big)\mu(dx).λi​(μ)=∫(fi​(x)−2σii​gi2​(x)​)μ(dx).

A measure μ∈M\mu \in \mathcal Mμ∈M is a sink (Assumption 1.3) if λi(μ)<0\lambda_i(\mu) < 0λi​(μ)<0 for all i∈Iμci \in I^c_\mui∈Iμc​ and, if Iμ≠∅I_\mu \ne \emptysetIμ​=∅, every finite convex combination ν\nuν of ergodic measures living on the relative boundary of the face of μ\muμ has max⁡i∈Iμλi(ν)>0\max_{i\in I_\mu}\lambda_i(\nu) > 0maxi∈Iμ​​λi​(ν)>0. M1\mathcal M^1M1 is the set of sinks and M2=M∖M1\mathcal M^2 = \mathcal M\setminus\mathcal M^1M2=M∖M1.

The occupation measures of a path are Π~t=1t∫0t1{X(s)∈⋅}ds\widetilde\Pi_t = \frac1t\int_0^t\mathbf 1_{\{X(s)\in\cdot\}}dsΠt​=t1​∫0t​1{X(s)∈⋅}​ds, and U(ω)\mathcal U(\omega)U(ω) is the set of weak limits of Π~t(ω)\widetilde\Pi_t(\omega)Πt​(ω) as t→∞t\to\inftyt→∞. Assumption 1.4 asks that ∥x∥δ1∑igi2/(1+∑i(∣fi∣+gi2))→0\|x\|^{\delta_1}\sum_ig_i^2/(1+\sum_i(|f_i|+g_i^2)) \to 0∥x∥δ1​∑i​gi2​/(1+∑i​(∣fi​∣+gi2​))→0 for some δ1>0\delta_1 > 0δ1​>0; Assumption 1.5 asks that M2=∅\mathcal M^2 = \emptysetM2=∅ or that every finite convex combination ν\nuν of measures of M2\mathcal M^2M2 has max⁡iλi(ν)>0\max_i\lambda_i(\nu) > 0maxi​λi​(ν)>0.

Formalization targets

Goal: Theorem 1.3

Under Assumptions 1.1, 1.4, 1.5 and M1≠∅\mathcal M^1 \ne \emptysetM1=∅, for every x∈R+n,∘x \in \mathbb R^{n,\circ}_+x∈R+n,∘​,

∑μ∈M1Pxμ=1,Pxμ:=Px{U(ω)={μ}, lim⁡t→∞ln⁡Xi(t)t=λi(μ)<0, i∈Iμc}>0.\sum_{\mu\in\mathcal M^1} P^\mu_x = 1,\qquad P^\mu_x := \mathbb P_x\Big\{\mathcal U(\omega) = \{\mu\},\ \lim_{t\to\infty}\frac{\ln X_i(t)}{t} = \lambda_i(\mu) < 0,\ i\in I^c_\mu\Big\} > 0 .μ∈M1∑​Pxμ​=1,Pxμ​:=Px​{U(ω)={μ}, t→∞lim​tlnXi​(t)​=λi​(μ)<0, i∈Iμc​}>0.

Milestones

In the order the proof uses them: δ∗∈M\delta^* \in \mathcal Mδ∗∈M; Lemma 3.3 (moment bound and a zero-mean identity for invariant measures); Lemma 5.1 (λi(μ)=0\lambda_i(\mu) = 0λi​(μ)=0 for i∈Iμi \in I_\mui∈Iμ​); Lemma 5.4 (bounded weighted time averages and a strong law for the stochastic integral); Lemma 5.5 (time spent in a compact set, and staying away from a face on a finite horizon); Lemma 5.6 (convergence of unbounded time averages); Lemma 5.7 (U(ω)\mathcal U(\omega)U(ω) consists of invariant measures); Lemma 5.8 (a limit set inside the face of a sink is that sink); Lemma 5.9 (sinks attract nearby paths with high probability); and the case M2=∅\mathcal M^2 = \emptysetM2=∅, where M=M1={δ∗}\mathcal M = \mathcal M^1 = \{\delta^*\}M=M1={δ∗}.

Significance

Theorem 1.3 turns local information — the signs of finitely many Lyapunov exponents at boundary ergodic measures — into a global almost-sure description of long-run behaviour: the community converges, in the sense of empirical distributions, to one of the sinks, each sink is reached with positive probability, and the species absent from it decay exponentially at explicit rates. In the applications of §2 of the paper (competitive Lotka–Volterra systems, food chains) this answers which species survive.

The theorem is proved on paper. No part of it is machine-checked. A formalization would produce a checked interface between Itô calculus for multidimensional SDEs, ergodic theory of Feller processes (occupation measures, invariant and ergodic measures), and the stochastic-persistence framework; the statements of Lemmas 5.4–5.7 are reusable for other SDE models with a Lyapunov-type condition.

Difficulty

The obvious argument — the occupation measures converge to some invariant measure, and the Lyapunov exponents at that measure decide the fate of each species — breaks down at two points. First, the state space is not compact and the functions fi−σiigi2/2f_i - \sigma_{ii}g_i^2/2fi​−σii​gi2​/2 are unbounded, so weak convergence of occupation measures does not by itself give convergence of time averages of these functions; a pathwise uniform-integrability bound (Lemmas 5.4 and 5.6) is required, and this is where Assumption 1.4 enters. Second, a limit point of occupation measures is in general a mixture of ergodic measures, possibly including repellers; ruling out every mixture that is not a single sink requires the separate arguments of Lemma 5.8 and of the M2\mathcal M^2M2 step, together with a supermartingale built from a Lyapunov function near each sink (Lemma 5.9).

Formalization scope

The state space is EuclideanSpace ℝ (Fin n) with the published Ethier–Kurtz strong-SDE layer; coordinates are indexed by Fin n, the norm in every assumption is the ℓ1\ell^1ℓ1 norm, and n≥1n \ge 1n≥1 is a hypothesis. The process is a family of strong solutions XxX^xXx, one from each x∈R+nx \in \mathbb R^n_+x∈R+n​, driven by one Brownian motion on one probability space. The coefficients are read at the positive part of the state, which is the state itself on R+n\mathbb R^n_+R+n​. Ergodic means extremal among invariant probability measures, IμI_\muIμ​ is the set of coordinates that are not μ\muμ-a.s. zero, Conv\mathrm{Conv}Conv means finite convex combinations with positive weights (as on p. 5), and weak limits are taken along sequences, tested against bounded continuous functions. The sum in (1.11) is an unconditional sum in [0,∞][0,\infty][0,∞] over the set M1\mathcal M^1M1, with no finiteness assumption.

Deviations from the page, each disclosed in the item: (5.19) is stated for every finite horizon rather than for neTen_eT_ene​Te​, which is undefined under the lemma's hypotheses; Lemma 5.9 takes k≥1k \ge 1k≥1; the convention δ1≤δ0\delta_1 \le \delta_0δ1​≤δ0​ of Assumption 1.4 is an explicit hypothesis where the exponent δ1\delta_1δ1​ appears; integrability claims that the paper treats as automatic are part of the conclusions; and (5.17) is stated for every continuous version of the Itô integral. Lemma 5.6 is stated for each path that stays in the orthant, which the solution does almost surely. The proof's claim "U(ω)⊂Conv(M)∖Conv(M2)\mathcal U(\omega) \subset \mathrm{Conv}(\mathcal M)\setminus\mathrm{Conv}(\mathcal M^2)U(ω)⊂Conv(M)∖Conv(M2)" is left as source context: its inclusion in the finite convex hull of M\mathcal MM requires an additional argument when M\mathcal MM is infinite.

The statements cannot be made vacuous by the definitions: δ∗∈M\delta^* \in \mathcal Mδ∗∈M is itself a milestone, so M\mathcal MM is never empty, and the occupation measures are probability measures for t>0t > 0t>0; every constant (K^\widehat KK, K^1\widehat K_1K1​, β\betaβ, Δ\DeltaΔ) is chosen before the points it must be uniform in.

A complete development needs Itô's formula for ln⁡Xi\ln X_ilnXi​, the strong law for continuous martingales with bounded quadratic-variation growth, Prokhorov's theorem and lower semicontinuity of integrals under weak convergence, and the Feller and strong Markov properties of (1.1). Contributions of any of these, and of the milestones in any order, are welcome.

Selected references

  • A. Hening, D. H. Nguyen, Coexistence and extinction for stochastic Kolmogorov systems, Ann. Appl. Probab. 28(3), 2018, DOI 10.1214/17-AAP1347; arXiv:1704.06984v1. https://arxiv.org/abs/1704.06984
  • S. J. Schreiber, M. Benaïm, K. A. S. Atchadé, Persistence in fluctuating environments, J. Math. Biol. 62(5), 655–683, 2011. MR 2786721, https://mathscinet.ams.org/mathscinet-getitem?mr=2786721
  • S. N. Evans, A. Hening, S. J. Schreiber, Protected polymorphisms and evolutionary stability of patch-selection strategies in stochastic environments, J. Math. Biol. 71(2), 325–359, 2015. MR 3367678, https://mathscinet.ams.org/mathscinet-getitem?mr=3367678
  • R. Khasminskii, Stochastic Stability of Differential Equations, 2nd ed., Springer, 2012. MR 2894052, https://mathscinet.ams.org/mathscinet-getitem?mr=2894052
20 thms1 active userReviewed
AnalysisDynamical SystemsProbability·Captain: mikedeng1

Averaging Dynamics Driven by Fractional Brownian Motion: Young Solutions of dxⁿ = fₙ(t, xⁿ)dB Converge in Probability in C^α to the Solution of dx = f̄(x)dB When |fₙ − f̄|_{−κ,γ} → 0Research Paper

Why oscillating coefficients matter

An equation driven by fractional Brownian motion can respond to a rapidly varying coefficient even when that coefficient has no useful pointwise limit. Hairer and Li study this issue for fractional Brownian motion with Hurst index above one half. Their Section 3 isolates a deterministic averaging statement: if the time antiderivatives of the coefficients approach those of a limiting coefficient in a suitable negative Hölder norm, the solutions approach the limiting solution in probability. This statement supplies a common target for averaging models whose fast variables have very different origins. The authors use it later with mixing fast processes, and also present a quasi-periodic example. The result and its role in the paper are stated in Hairer and Li, Section 3.

The problem sits at the boundary of two familiar views of differential equations. A pathwise Young equation is defined from individual sufficiently regular paths, whereas the available estimates for the oscillating coefficient and the fractional Brownian driver involve probability and conditional expectation. The mission records the precise point where these descriptions meet. It treats the published article, rather than a preprint, and targets its Theorem 3.13.

Driver, coefficients, and solutions

An mmm-dimensional fractional Brownian motion B=(B1,…,Bm)B=(B^1,\ldots,B^m)B=(B1,…,Bm) with index HHH is a centered Gaussian process with independent coordinates and covariance

E[BsiBtj]=1i=j∣s∣2H+∣t∣2H−∣t−s∣2H2.\mathbb E[B_s^iB_t^j]=\mathbf1_{i=j}\frac{|s|^{2H}+|t|^{2H}-|t-s|^{2H}}2.E[Bsi​Btj​]=1i=j​2∣s∣2H+∣t∣2H−∣t−s∣2H​.

The paper works with a two-sided process and 1/2<H<11/2<H<11/2<H<1. It uses a version whose sample paths are locally β\betaβ-Hölder for every β<H\beta<Hβ<H. The mission names that version condition separately, because the covariance law alone does not select particular sample paths. The relevant past sigma algebra at time sss is generated by increments Bu−BvB_u-B_vBu​−Bv​ with u,v≤su,v\le su,v≤s. These conventions come from pp. 1826 and 1831–1832 of the article.

For a path xxx on [0,T][0,T][0,T], write ∣x∣α|x|_\alpha∣x∣α​ for its homogeneous Hölder seminorm and ∣x∣∞|x|_\infty∣x∣∞​ for its supremum norm. The norm on Cα[0,T]C^\alpha[0,T]Cα[0,T] is ∣x∣∞+∣x∣α|x|_\infty+|x|_\alpha∣x∣∞​+∣x∣α​. A Young integral ∫stfr dbr\int_s^t f_r\,db_r∫st​fr​dbr​ is the limit of left-point sums over partitions of [s,t][s,t][s,t] as the largest cell shrinks to zero. A Young solution from x0x_0x0​ is an α\alphaα-Hölder path satisfying its integral equation at every time, with value x0x_0x0​ at time zero. Here BC2BC^2BC2 means bounded, twice continuously differentiable maps with bounded derivatives through order two; Cζ,2C^{\zeta,2}Cζ,2 means ζ\zetaζ-Hölder in time with values in BC2BC^2BC2. These are the paper's conventions on pp. 1829 and 1835–1838.

The negative Hölder bound ∣f∣−κ,γ≤K|f|_{-\kappa,\gamma}\le K∣f∣−κ,γ​≤K means that the time antiderivative of fff has increments bounded by K∣t−s∣1−κK|t-s|^{1-\kappa}K∣t−s∣1−κ, and that the difference of those increments at spatial points x,yx,yx,y is bounded by K∣t−s∣1−κ∣x−y∣γK|t-s|^{1-\kappa}|x-y|^\gammaK∣t−s∣1−κ∣x−y∣γ. Both bounds apply on the time window in question when ∣t−s∣≤1|t-s|\le1∣t−s∣≤1. This is equation (3.12) in the article. It measures cancellation over time; it does not require f(t,x)f(t,x)f(t,x) itself to be small.

Formalization targets

The goal is the dBdBdB part of Theorem 3.13. Let fnf_nfn​ be Cζ,2C^{\zeta,2}Cζ,2, let the limiting fˉ\bar ffˉ​ be autonomous and in BC2BC^2BC2, and suppose ∣fn−fˉ∣−κ,γ→0|f_n-\bar f|_{-\kappa,\gamma}\to0∣fn​−fˉ​∣−κ,γ​→0. The exponents satisfy 1/2<α<H−κ1/2<\alpha<H-\kappa1/2<α<H−κ, H−κ>1/2H-\kappa>1/2H−κ>1/2, H−κ+γα>1H-\kappa+\gamma\alpha>1H−κ+γα>1, and α<ζ≤1\alpha<\zeta\le1α<ζ≤1. For Young solutions with the same starting point,

dxtn=fn(t,xtn) dBt,dxt=fˉ(xt) dBt,dx_t^n=f_n(t,x_t^n)\,dB_t,\qquad dx_t=\bar f(x_t)\,dB_t,dxtn​=fn​(t,xtn​)dBt​,dxt​=fˉ​(xt​)dBt​,

the target is

∀ε>0,P(∥xn−x∥Cα[0,T]>ε)⟶0.\forall\varepsilon>0,\qquad P\bigl(\|x^n-x\|_{C^\alpha[0,T]}>\varepsilon\bigr)\longrightarrow0.∀ε>0,P(∥xn−x∥Cα[0,T]​>ε)⟶0.

The milestone list follows the statements used around this target: the Hölder composition estimate of Lemma 2.1, the RKHS estimate of Lemma 3.3, the fractional Brownian integral estimate of Lemma 3.4, the stochastic sewing lemma of Lemma 3.5, the Young case of (3.18) from Lemmas 3.10 and 3.12, the Kolmogorov inclusions (3.24), and the deterministic stability estimate of Lemma 2.2. Each is a separate formal theorem. The authors' proofs follow their statements in Sections 2 and 3 and the Appendix; Lemma 3.5 is quoted from Lê, Theorem 2.1 without proof in the article.

What the result provides

The target gives convergence of entire solution paths in a Hölder topology, in probability. In the paper, this lets a model-specific estimate of the negative Hölder distance be used to conclude convergence of the corresponding dynamical system. Theorem A is obtained by adding such an estimate for a stationary mixing fast process; the deterministic statement here isolates the part independent of that model. These uses are described in Sections 1 and 3.

The published paper proves the result. This mission asks for machine-checked proofs of the stated Lean theorems. Its reusable work would include a pathwise Young integral over arbitrary partitions, Hölder norms that retain the value +∞+\infty+∞, a two-sided vector fractional Brownian motion interface, and stochastic estimates for time-dependent integrands. The goal and milestones in this proposal are statements with proof placeholders; the local build checks their types, not their proofs.

Main obstruction

Pointwise control of fn−fˉf_n-\bar ffn​−fˉ​ is unavailable: a rapidly oscillating function can be large at most times and still have small time antiderivatives. Applying a pathwise Young stability estimate directly to fn−fˉf_n-\bar ffn​−fˉ​ therefore leaves a coefficient norm that need not tend to zero. The integral estimate must connect cancellation measured by ∣⋅∣−κ,γ|\cdot|_{-\kappa,\gamma}∣⋅∣−κ,γ​ with LpL^pLp bounds on the driven equation. The dependence on the past of the fractional Brownian motion makes this step more delicate than an estimate for a deterministic integrand. The required estimates and their domains appear in Lemmas 3.4–3.12.

Formalization scope

Time is R\mathbb RR for the two-sided driver; coefficient and solution assertions use [0,T][0,T][0,T] with T>0T>0T>0. State spaces are finite-dimensional real Euclidean spaces. The goal takes H∈(1/2,1)H\in(1/2,1)H∈(1/2,1) from the standing setting of Section 3.1, and it assumes the locally Hölder version of BBB described on p. 1826. The solutions are required almost surely to satisfy the Young equation from the same x0x_0x0​. This requirement fixes the processes to the equations; the convergence claim cannot be obtained by choosing arbitrary paths. Probability of the norm event uses the measure of that set, and the conclusion is convergence in probability in the full CαC^\alphaCα norm.

The Lean definitions use [0,∞][0,\infty][0,∞] for path and process seminorms, so unbounded suprema are not replaced by a default real value. The negative Hölder hypothesis uses real bounds Kn→0K_n\to0Kn​→0 instead of an infimum that could be meaningless on an empty class. The Young integral quantifies over every monotone partition and the mesh limit of its left-point sums. The fBm definition includes Gaussianity, means, and every cross-coordinate covariance; its path version is explicit. Interval integrals in the coefficient bound are applied to time-continuous coefficients in the goal. Lemmas 3.4 and 3.10 use the increment filtration, the case needed for this theorem.

The paper's Lemma 2.2 needs a common initial value for its homogeneous-seminorm estimate; the formal statement includes it and records the printed issue. The paper writes the limiting coefficient with a time argument but uses an autonomous coefficient in (3.23), which the goal adopts. This proposal covers the dBdBdB equation. The final dtdtdt extension in Theorem 3.13 and the conditional-expectation estimate (3.19) remain outside its current items. Contributions that close these gaps, or supply a general conditional Wiener integral matching the article's notation, would extend the development.

Selected references

  • M. Hairer and X.-M. Li, Averaging dynamics driven by fractional Brownian motion, Annals of Probability 48(4), 2020, 1826–1860. DOI.
  • K. Lê, A stochastic sewing lemma and applications, 2018, arXiv:1810.10500, cited as [23] in Hairer and Li. arXiv.
9 thms1 active userReviewed
Control TheoryDynamic ProgrammingProbability·Captain: mikedeng1

McKean–Vlasov Optimal Control: The Dynamic Programming Principle 1: The Weak Formulation's Value Function Is Upper Semi-Analytic and Satisfies the DPPResearch Paper

Motivation

A McKean–Vlasov control problem asks a planner to steer a stochastic differential equation whose coefficients depend not only on the current path of the state but also on its (conditional) distribution. Such problems describe the cooperative optimum of a large population of interacting agents: when each agent reacts to the empirical distribution of all others and a social planner chooses everybody's control, the limit as the population grows is a McKean–Vlasov control problem (Lacker 2017). When all agents are also exposed to a common noise (a shared source of randomness, such as a market factor), the relevant distribution is the conditional law of the state given that noise.

Bellman's dynamic programming principle (DPP) is the standard route from a control problem to its Hamilton–Jacobi–Bellman equation and to verification arguments. For McKean–Vlasov dynamics it fails in the naive state variable, because the problem is time-inconsistent; it can be recovered by taking the (conditional) law of the state as the state.

Timeline. Laurière and Pironneau (2014) and Bensoussan, Frehse and Yam (2013–2017) proved a DPP for densities of the state law. Pham and Wei (2017, SICON) proved a DPP over closed-loop controls in a Markovian setting with a common-noise filtration, under regularity assumptions; Pham and Wei (2018, ESAIM:COCV) treated the case without common noise. Bayraktar, Cosso and Pham (2018, Trans. AMS) obtained a randomised DPP, again Markovian and without common noise. Djete, Possamaï and Tan (2022) proved the DPP for the general non-Markovian problem with common noise, under Borel measurability of the coefficients only. This mission formalizes their DPP for the weak formulation.

Setting

Fix a horizon T>0T>0T>0, dimensions n,d,ℓ∈Nn,d,\ell\in\mathbb Nn,d,ℓ∈N, a nonempty Polish space (U,ρ)(U,\rho)(U,ρ) of control values, a point u0∈Uu_0\in Uu0​∈U and an exponent p≥0p\ge0p≥0. Let Ck:=C([0,T],Rk)\mathcal C^k:=C([0,T],\mathbb R^k)Ck:=C([0,T],Rk) with the uniform norm, P(E)\mathcal P(E)P(E) the Borel probability measures on EEE with the weak topology, and xt∧⋅x_{t\wedge\cdot}xt∧⋅​ the path xxx stopped at time ttt. The coefficients b,σ,σ0,Lb,\sigma,\sigma_0,Lb,σ,σ0​,L are maps [0,T]×Cn×P(Cn×U)×U→Rn,Rn×d,Rn×ℓ,R[0,T]\times\mathcal C^n\times\mathcal P(\mathcal C^n\times U)\times U\to\mathbb R^n,\mathbb R^{n\times d},\mathbb R^{n\times\ell},\mathbb R[0,T]×Cn×P(Cn×U)×U→Rn,Rn×d,Rn×ℓ,R, and g:Cn×P(Cn)→Rg:\mathcal C^n\times\mathcal P(\mathcal C^n)\to\mathbb Rg:Cn×P(Cn)→R; all are Borel measurable, and b,σ,σ0,Lb,\sigma,\sigma_0,Lb,σ,σ0​,L depend on the path and the measure only through their restrictions to [0,t][0,t][0,t] (non-anticipative).

A weak control γ\gammaγ with initial condition (t,ν)∈[0,T]×P(Cn)(t,\nu)\in[0,T]\times\mathcal P(\mathcal C^n)(t,ν)∈[0,T]×P(Cn) consists of a probability space carrying two filtrations Fγ⊇Gγ\mathbb F^\gamma\supseteq\mathbb G^\gammaFγ⊇Gγ (the second models the common noise), a state XγX^\gammaXγ, Brownian motions WγW^\gammaWγ (idiosyncratic) and BγB^\gammaBγ (common) on [t,T][t,T][t,T], a predictable UUU-valued control αγ\alpha^\gammaαγ, and measure-valued processes μsγ=L(Xs∧⋅γ∣Gsγ)\mu^\gamma_s=\mathcal L(X^\gamma_{s\wedge\cdot}\mid\mathcal G^\gamma_s)μsγ​=L(Xs∧⋅γ​∣Gsγ​) and μˉsγ=L((Xs∧⋅γ,αsγ)∣Gsγ)\bar\mu^\gamma_s=\mathcal L((X^\gamma_{s\wedge\cdot},\alpha^\gamma_s)\mid\mathcal G^\gamma_s)μˉ​sγ​=L((Xs∧⋅γ​,αsγ​)∣Gsγ​), such that Xt∧⋅γ∼ν(t)X^\gamma_{t\wedge\cdot}\sim\nu(t)Xt∧⋅γ​∼ν(t), an integrability condition of order ppp holds, a compatibility condition between the two filtrations holds, and

dXsγ=b(s,Xγ,μˉsγ,αsγ) ds+σ(s,Xγ,μˉsγ,αsγ) dWsγ+σ0(s,Xγ,μˉsγ,αsγ) dBsγ,s∈[t,T].dX^\gamma_s=b(s,X^\gamma,\bar\mu^\gamma_s,\alpha^\gamma_s)\,ds+\sigma(s,X^\gamma,\bar\mu^\gamma_s,\alpha^\gamma_s)\,dW^\gamma_s+\sigma_0(s,X^\gamma,\bar\mu^\gamma_s,\alpha^\gamma_s)\,dB^\gamma_s,\qquad s\in[t,T].dXsγ​=b(s,Xγ,μˉ​sγ​,αsγ​)ds+σ(s,Xγ,μˉ​sγ​,αsγ​)dWsγ​+σ0​(s,Xγ,μˉ​sγ​,αsγ​)dBsγ​,s∈[t,T].

The reward and the value function are

J(t,γ)=E[∫tTL(s,Xs∧⋅γ,μˉsγ,αsγ) ds+g(XT∧⋅γ,μTγ)],VW(t,ν)=sup⁡γ∈ΓW(t,ν)J(t,γ),J(t,\gamma)=\mathbb E\Big[\int_t^TL(s,X^\gamma_{s\wedge\cdot},\bar\mu^\gamma_s,\alpha^\gamma_s)\,ds+g(X^\gamma_{T\wedge\cdot},\mu^\gamma_T)\Big],\qquad V_W(t,\nu)=\sup_{\gamma\in\Gamma_W(t,\nu)}J(t,\gamma),J(t,γ)=E[∫tT​L(s,Xs∧⋅γ​,μˉ​sγ​,αsγ​)ds+g(XT∧⋅γ​,μTγ​)],VW​(t,ν)=γ∈ΓW​(t,ν)sup​J(t,γ),

with ∞−∞:=−∞\infty-\infty:=-\infty∞−∞:=−∞ and sup⁡∅=−∞\sup\emptyset=-\inftysup∅=−∞. Each weak control also carries Asγ=∫ts∨tπ(αrγ) drA^\gamma_s=\int_t^{s\vee t}\pi(\alpha^\gamma_r)\,drAsγ​=∫ts∨t​π(αrγ​)dr, where π\piπ is a Borel isomorphism of UUU onto a subset of [0,1][0,1][0,1], and the continuous conditional-law process μ^γ\hat\mu^\gammaμ^​γ of (Xγ,Aγ,Wγ,Bγ)(X^\gamma,A^\gamma,W^\gamma,B^\gamma)(Xγ,Aγ,Wγ,Bγ) given Gγ\mathbb G^\gammaGγ.

Formalization targets

Goal: Theorem 3.1

VW:[0,T]×P(Cn)→[−∞,∞]V_W:[0,T]\times\mathcal P(\mathcal C^n)\to[-\infty,\infty]VW​:[0,T]×P(Cn)→[−∞,∞] is upper semi-analytic (every superlevel set {VW>c}\{V_W>c\}{VW​>c} is analytic), and for every stopping time τ⋆\tau^\starτ⋆ of the canonical filtration of Ω⋆:=Cℓ×C([0,T],P(Cn×C×Cd×Cℓ))\Omega^\star:=\mathcal C^\ell\times C([0,T],\mathcal P(\mathcal C^n\times\mathcal C\times\mathcal C^d\times\mathcal C^\ell))Ω⋆:=Cℓ×C([0,T],P(Cn×C×Cd×Cℓ)) with values in [t,T][t,T][t,T], setting τγ:=τ⋆(Bγ,t,μ^γ)\tau^\gamma:=\tau^\star(B^{\gamma,t},\hat\mu^\gamma)τγ:=τ⋆(Bγ,t,μ^​γ),

VW(t,ν)=sup⁡γ∈ΓW(t,ν)E[∫tτγL(s,Xs∧⋅γ,μˉsγ,αsγ) ds+VW(τγ,μτγγ)].V_W(t,\nu)=\sup_{\gamma\in\Gamma_W(t,\nu)}\mathbb E\Big[\int_t^{\tau^\gamma}L(s,X^\gamma_{s\wedge\cdot},\bar\mu^\gamma_s,\alpha^\gamma_s)\,ds+V_W(\tau^\gamma,\mu^\gamma_{\tau^\gamma})\Big].VW​(t,ν)=γ∈ΓW​(t,ν)sup​E[∫tτγ​L(s,Xs∧⋅γ​,μˉ​sγ​,αsγ​)ds+VW​(τγ,μτγγ​)].

Milestones

The canonical reformulation on Ωˉ:=Ω^×C([0,T],P(Ω^))\bar\Omega:=\hat\Omega\times C([0,T],\mathcal P(\hat\Omega))Ωˉ:=Ω^×C([0,T],P(Ω^)) with weak control rules PˉW(t,ν)\bar{\mathcal P}_W(t,\nu)PˉW​(t,ν) (Definition 4.1): Lemma 4.4(i) (weak controls and weak control rules correspond), Corollary 4.6 (VW(t,ν)=sup⁡Pˉ∈PˉW(t,ν)J(t,Pˉ)V_W(t,\nu)=\sup_{\bar{\mathbb P}\in\bar{\mathcal P}_W(t,\nu)}J(t,\bar{\mathbb P})VW​(t,ν)=supPˉ∈PˉW​(t,ν)​J(t,Pˉ)), Lemma 4.7 (analytic graphs, VWV_WVW​ u.s.a.), Lemma 4.8 (stability under conditioning at a stopping time), Lemma 4.9 (dependence on the initial law only through ν^(t)\hat\nu(t)ν^(t)), (4.10) (moment truncation VWM↗VWV^M_W\nearrow V_WVWM​↗VW​, analytic and u.s.a.) and Lemma 4.10 (universally measurable ε\varepsilonε-optimal families and concatenation).

Significance

The result. The theorem gives the DPP for McKean–Vlasov control with common noise in a non-Markovian setting, with no regularity on the coefficients beyond Borel measurability and no integrability on the rewards. It is the starting point for the dynamic programming (HJB) equation on the space of probability measures, for the Markovian corollaries of §3.2 of the paper, and, through the equivalence of formulations in the companion work, for the strong formulations treated in the second mission of this series.

Formalizing it. The result is proved on paper; nothing of it is machine-checked. A formal development needs a working theory of weak controls with conditional laws, a controlled martingale problem on a space of measure-valued paths, and analytic-set measurability in continuous time. None of these exists in Mathlib, and the analytic-selection layer on Prove2Me (Bertsekas–Shreve, Chapter 7) is stated but not yet proved.

Difficulty

The obvious argument conditions an optimal-ish control on its information at the stopping time and pastes in near-optimal controls from the conditioned states. Each step fails without additional structure: VWV_WVW​ is not known to be measurable, so E[VW(τγ,μτγγ)]\mathbb E[V_W(\tau^\gamma,\mu^\gamma_{\tau^\gamma})]E[VW​(τγ,μτγγ​)] is not obviously meaningful; conditioning a weak control on its information at τγ\tau^\gammaτγ need not yield a weak control, because the conditional-law constraint involves the common-noise filtration and a compatibility condition between filtrations; and choosing a near-optimal control for each conditioned state is a selection problem over an uncountable family of probability spaces. The state of the problem is a law, which is itself defined only up to null sets, so random-time evaluations such as μτγγ\mu^\gamma_{\tau^\gamma}μτγγ​ need a continuous version.

Formalization scope

The Lean development lives in the namespace MKVDPP.Weak. Conventions:

  • Times are in R≥0\mathbb R_{\ge0}R≥0​; paths are elements of C([0,T],Rk)C([0,T],\mathbb R^k)C([0,T],Rk) with Rk\mathbb R^kRk Euclidean; a path is read at times beyond TTT as its value at TTT.
  • Expectations and time integrals are E[ξ+]−E[ξ−]\mathbb E[\xi^+]-\mathbb E[\xi^-]E[ξ+]−E[ξ−] in [−∞,∞][-\infty,\infty][−∞,∞] with ∞−∞=−∞\infty-\infty=-\infty∞−∞=−∞, computed as lower integrals.
  • The supremum defining VWV_WVW​ ranges over weak controls on probability spaces in Type (universe 0).
  • "The integrals are implicitly assumed to be well-defined" is pinned to local Itô integrals (EthierKurtz.HasBrownianItoIntegral) of integrands that are a.s. square integrable on [t,T][t,T][t,T], taken against the shifted Brownian motions Wγ,tW^{\gamma,t}Wγ,t, Bγ,tB^{\gamma,t}Bγ,t; no L2(P)L^2(\mathbb P)L2(P) condition, which would shrink ΓW\Gamma_WΓW​.
  • The conditional-law requirement "for dP⊗dsd\mathbb P\otimes dsdP⊗ds-a.e. (s,ω)(s,\omega)(s,ω)" is read in Fubini form; μTγ\mu^\gamma_TμTγ​ and μτγγ\mu^\gamma_{\tau^\gamma}μτγγ​ are the XXX-marginals of the continuous process μ^γ\hat\mu^\gammaμ^​γ.
  • "Local martingale on [t,T][t,T][t,T]" in Definition 4.1 is pinned to: every localised process Sφ,mS^{\varphi,m}Sφ,m, m≥1m\ge1m≥1, is an (Fˉ,Pˉ)(\bar{\mathbb F},\bar{\mathbb P})(Fˉ,Pˉ)-martingale on [t,T][t,T][t,T]. The page integrates ∣Sˉ∣|\bar S|∣Sˉ∣ and Sˉφ\bar S^\varphiSˉφ from 000. Here they run from the initial time ttt, because before ttt the canonical control may be ∂\partial∂, where the coefficients are undefined, and a coefficient that is not integrable before ttt would empty P^W(t,⋅)\hat{\mathcal P}_W(t,\cdot)P^W​(t,⋅).
  • The cemetery value ∂\partial∂ of the canonical control is read as u0u_0u0​ inside the coefficients (a null set under Definition 4.1).
  • In (3.2), (+∞)+(−∞)(+\infty)+(-\infty)(+∞)+(−∞) inside the expectation is −∞-\infty−∞.
  • Lemma 4.4(i)'s converse carries the hypothesis that the canonical AAA is a.s. ∫t⋅∨tπ(αˉr) dr\int_t^{\cdot\vee t}\pi(\bar\alpha_r)\,dr∫t⋅∨t​π(αˉr​)dr; without it the converse is false, because Definition 4.1 leaves AAA before ttt unconstrained.

The goal does not mention the canonical space Ωˉ\bar\OmegaΩˉ, weak control rules or any selection; a formalization of ΓW\Gamma_WΓW​ that is empty, or a value function that is constant, would trivialize it. A sanity file exhibits a weak control in the degenerate case n=d=ℓ=0n=d=\ell=0n=d=ℓ=0 for every t≤Tt\le Tt≤T, so the structure is satisfiable.

Infrastructure a complete development needs: conditional laws and r.c.p.d. on Polish spaces, the predictable σ\sigmaσ-algebra, stochastic integrals against a filtration, the Stroock–Varadhan martingale problem, Itô's formula, and analytic sets with the Jankov–von Neumann selection theorem. The analytic-selection results and the martingale-problem/SDE correspondence are reusable well beyond this mission. Contributions on any milestone, and on proving the referenced Bertsekas–Shreve selection theorems, are welcome. Out of scope: Theorem 3.4 (it rests on the companion paper), the Markovian results of §3.2, and the HJB discussion of §3.3.

Selected references

  • M. F. Djete, D. Possamaï, X. Tan, McKean–Vlasov optimal control: the dynamic programming principle, Ann. Probab. 50(2), 2022; cited as arXiv:1907.08860v2. https://arxiv.org/abs/1907.08860v2
  • H. Pham, X. Wei, Dynamic programming for optimal control of stochastic McKean–Vlasov dynamics, SIAM J. Control Optim. 55(2):1069–1101, 2017. https://arxiv.org/abs/1604.04057
  • D. Lacker, Limit theory for controlled McKean–Vlasov dynamics, SIAM J. Control Optim. 55(3):1641–1672, 2017. https://arxiv.org/abs/1609.08064
  • N. El Karoui, X. Tan, Capacities, measurable selection and dynamic programming part II: application in stochastic control problems, 2013. https://arxiv.org/abs/1310.3364
  • E. Bayraktar, A. Cosso, H. Pham, Randomized dynamic programming principle and Feynman–Kac representation for optimal control of McKean–Vlasov dynamics, Trans. Amer. Math. Soc. 370(3):2115–2160, 2018. https://doi.org/10.1090/tran/7118
  • M. Laurière, O. Pironneau, Dynamic programming for mean-field type control, C. R. Math. Acad. Sci. Paris 352(9):707–713, 2014. https://doi.org/10.1016/j.crma.2014.07.008
  • A. Bensoussan, J. Frehse, S. Yam, Mean Field Games and Mean Field Type Control Theory, SpringerBriefs in Mathematics, Springer, 2013. https://doi.org/10.1007/978-1-4614-8508-7
  • D. Bertsekas, S. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. https://web.mit.edu/dimitrib/www/SOC_1978.pdf
  • D. Stroock, S. Varadhan, Multidimensional Diffusion Processes, Springer, 1997. https://doi.org/10.1007/3-540-28999-2
14 thms1 active userReviewed
Control TheoryDynamic ProgrammingProbability·Captain: mikedeng1

McKean–Vlasov Optimal Control: The Dynamic Programming Principle 2: Under Lipschitz Coefficients the Common-Noise-Adapted Strong Formulation Satisfies the DPPResearch Paper

Why common noise changes the control problem

A controller may act on a large population of interacting particles while all particles also experience a shared random disturbance. In the population limit, the state of a representative particle depends on the distribution of states conditional on the common noise. The controller therefore influences both its own state and the conditional population law. The usual state variable for dynamic programming must carry that law, and a future decision may use only information available from common noise. Djete, Possamaï and Tan establish a dynamic programming principle for this setting in McKean–Vlasov optimal control: the dynamic programming principle, Theorem 3.2. Their result permits path dependent coefficients and merely Borel reward functions, so ordinary continuity arguments do not determine the value function's measurability.

The paper distinguishes a weak formulation, in which the stochastic basis varies with the control, from a strong formulation on a fixed space. This mission concerns the latter, restricted to controls predictable from common noise, under the paper's Lipschitz and growth Assumption 2.8. The companion mission treats the weak dynamic programming principle, Theorem 3.1. The present mission asks for a machine checked account of the strong formulation and of the transfer between its intrinsic, fixed space and canonical descriptions.

State, noise and admissible controls

Fix a horizon T>0T>0T>0. A state trajectory belongs to Cn=C([0,T],Rn)\mathcal C^n=C([0,T],\mathbb R^n)Cn=C([0,T],Rn). The two driving noises are a ddd dimensional idiosyncratic Brownian motion WWW and an ℓ\ellℓ dimensional common Brownian motion BBB. The control space UUU is nonempty and Polish. At time sss, the controlled drift bbb and diffusions σ,σ0\sigma,\sigma_0σ,σ0​ may depend on the stopped state path Xs∧⋅X_{s\wedge\cdot}Xs∧⋅​, the control αs\alpha_sαs​, and the conditional law μˉs\bar\mu_sμˉ​s​ of the stopped state and control given common noise. The running and terminal rewards are LLL and ggg.

A B\mathbb BB strong control has a continuous state satisfying the controlled stochastic equation, the conditional laws required by the paper, finite quadratic control energy, and an α\alphaα predictable for the common noise filtration. Its reward J(t,γ)J(t,\gamma)J(t,γ) is the expected running reward from ttt to TTT plus the terminal reward. The value VSB(t,ν)V_S^{\mathbb B}(t,\nu)VSB​(t,ν) is the supremum of these rewards over such controls from initial path law ν\nuν. The initial law lies in P2(Cn)\mathcal P_2(\mathcal C^n)P2​(Cn), the laws with a finite second moment. The coefficient hypothesis uses the quadratic Wasserstein distance W2W_2W2​ and one constant C>0C>0C>0 for both a Lipschitz bound and a quadratic growth bound. These conditions are Assumption 2.8 of the source paper, p. 8.

The paper also fixes a canonical probability space Ωt\Omega^tΩt carrying an initial path and Brownian increments after ttt. Its common noise predictable controls form A2B(t,ν)\mathcal A_2^{\mathbb B}(t,\nu)A2B​(t,ν). Proposition 2.10 says this fixed space computes the same value as the intrinsic strong formulation. The precise probability law on Ωt\Omega^tΩt is characterized by the initial stopped path law and independent standard Brownian increments; the paper does not choose a unique construction.

Formalization targets

The goal is Theorem 3.2, p. 10. It first asserts that the value on [0,T]×P2(Cn)[0,T]\times\mathcal P_2(\mathcal C^n)[0,T]×P2​(Cn) is upper semi analytic: each strict superlevel set {(t,ν):VSB(t,ν)>c}\{(t,\nu):V_S^{\mathbb B}(t,\nu)>c\}{(t,ν):VSB​(t,ν)>c} is analytic. For an initial pair (t,ν)(t,\nu)(t,ν) and a stopping time τ∈[t,T]\tau\in[t,T]τ∈[t,T] for the raw common noise filtration on Ωt\Omega^tΩt, it then asserts

VSB(t,ν)=sup⁡α∈A2B(t,ν)E ⁣[∫tτL(s,Xs∧⋅α,μˉsα,αs) ds+VSB(τ,μτα)].V_S^{\mathbb B}(t,\nu)=\sup_{\alpha\in\mathcal A_2^{\mathbb B}(t,\nu)} \mathbb E\!\left[\int_t^\tau L(s,X^\alpha_{s\wedge\cdot},\bar\mu_s^\alpha,\alpha_s)\,ds +V_S^{\mathbb B}(\tau,\mu_\tau^\alpha)\right].VSB​(t,ν)=α∈A2B​(t,ν)sup​E[∫tτ​L(s,Xs∧⋅α​,μˉ​sα​,αs​)ds+VSB​(τ,μτα​)].

Here μτα\mu_\tau^\alphaμτα​ is the law of the stopped state conditional on information from common noise at τ\tauτ. The milestone sequence follows the paper's supporting results: strong solution existence and uniqueness (Theorem A.3(i)); equivalence of intrinsic and fixed space values (Proposition 2.10); induction of canonical rules from strong controls (the forward clause of Lemma 4.4(ii)); the canonical value identity (Corollary 4.6); the Wiener represented rule class and its value (Lemma 4.11); analytic rule graphs and value measurability (Lemma 4.12); and stability of a strong rule under conditioning at a stopping time (Lemma 4.13(i)). Each is a source indexed target, rather than an invented intermediate assertion.

What the result provides

The identity permits the value after a random common noise stopping time to be evaluated from the stopped conditional state law. This is the form needed to compare control decisions before and after a random observation time. Upper semi analyticity supplies measurable superlevel sets for the value even when LLL and ggg lack continuity. The paper proves these statements mathematically; the mission seeks their Lean formalization, not a new theorem about the underlying control problem.

A complete formalization would also provide reusable definitions of conditional measure valued flows, Brownian motion relative to a filtration over a shifted interval, a local Itô equation, and canonical martingale control rules. The two published Ethier–Kurtz definitions supply the local Itô relation and probability augmentation of a filtration. They are shared infrastructure rather than new statements of this paper.

Where the difficulty lies

The state law in the coefficients is conditional on common noise and changes with the control. A pathwise solution of the state equation must therefore remain consistent with its own conditional law. A naive argument that restarts an ordinary diffusion at τ\tauτ does not establish that consistency for a restarted control. It also does not ensure that a restarted control remains predictable from common noise. The paper's canonical rule formulation and its conditioning and measurability results address those obstructions. The reward may be unbounded and extended real valued, so the expectation convention and its behavior at infinite positive and negative parts matter to the statement itself.

Formalization scope and conventions

Paths are continuous maps on compact real intervals with uniform norm; Rk\mathbb R^kRk is Mathlib's Euclidean space, including k=0k=0k=0. Probability measures carry weak convergence topology, and P2\mathcal P_2P2​ is its finite second moment subtype. The product of path space and UUU uses Mathlib's product metric; matrix norms are Frobenius. Supremums range over admissible controls, solutions and conditional law versions. They are EReal valued, so the empty supremum is −∞-\infty−∞. The signed expectation is positive part minus negative part with ∞−∞=−∞\infty-\infty=-\infty∞−∞=−∞, as in the paper. The model fixes a Borel embedding of UUU into [0,1][0,1][0,1] and a cemetery control for invalid reconstructed paths.

The Lean statements pin the paper's implicit “well defined” stochastic integral to a pathwise square integrable local Itô relation and almost surely integrable drift. A conditional law equality stated for dP⊗dsd\mathbb P\otimes dsdP⊗ds almost every pair is expressed in Fubini form. The localized processes printed in Definition 4.1 define its local martingale requirement. The terminal law and the stopped law in the target are quantified as versions of their stated conditional distributions. The fixed canonical law is any law satisfying the paper's initial distribution and Brownian conditions; the target is stated for every such family. These conventions rule out free conditional laws, arbitrary future stopping times, and a value that is −∞-\infty−∞ solely because a formalization made the control class empty. A full development must establish nonemptiness and version independence as part of the cited supporting theory.

The scope ends with Theorem 3.2 and the listed milestones. Lemma 4.13(ii), the more involved measurable selection and concatenation result, remains a future contribution. Theorem 3.4 uses a separate companion result; the Markovian corollaries and the heuristic Hamilton–Jacobi discussion of §3.3 are outside this mission.

Selected references

  • M. F. Djete, D. Possamaï and X. Tan, McKean–Vlasov optimal control: the dynamic programming principle, arXiv:1907.08860v2, 2020; published in Annals of Probability 50(2), 2022. Preprint. This mission cites the preprint's page and theorem numbering.
14 thms1 active userReviewed
Operations ResearchPartial Differential EquationsProbability·Captain: mikedeng1

Steady-State Analysis of the Join-the-Shortest-Queue Model in the Halfin-Whitt Regime 2: The JSQ Diffusion Limit Satisfies a Foster-Lyapunov Drift ConditionResearch Paper

Motivation

Join-the-shortest-queue (JSQ) is the basic load-balancing rule for a system of nnn parallel single-server queues: every arriving customer joins a queue of minimal length. It is optimal in several senses for homogeneous servers and is the reference policy against which cheaper rules (power-of-ddd choices, join-the-idle-queue) are measured. In the Halfin–Whitt regime, where the arrival rate is nλn\lambdanλ with λ=1−β/n\lambda = 1-\beta/\sqrt nλ=1−β/n​ for a fixed β>0\beta>0β>0, Eschenfeldt and Gamarnik (arXiv:1502.00999) proved that the suitably centred and scaled numbers of queues of length at least one and at least two converge, on finite time intervals, to a two-dimensional reflected diffusion. Braverman (arXiv:1801.05121) justified the interchange of limits (the stationary distributions of the nnn-server chains converge to the stationary distribution of the diffusion). One ingredient of that result is that the diffusion is exponentially ergodic, so it has a unique stationary distribution that is approached at a geometric rate. This mission formalizes the analytic core of that ingredient: a Foster–Lyapunov drift condition for the diffusion's generator.

Timeline. Eschenfeldt and Gamarnik (2015) proved the process-level diffusion limit, the first analysis of JSQ in this regime. Mukherjee, Borst, van Leeuwaarden and Whiting (J. Appl. Probab. 53, 2016) showed that a class of load-balancing schemes shares the same diffusion limit. Braverman (arXiv 2018, v2 2019; Math. Oper. Res. 45(3), 2020) proved tightness of the scaled stationary distributions and exponential ergodicity of the limit, which together give the interchange of limits.

Setting

The state space is the closed quadrant Ω=(−∞,0]×[0,∞)\Omega = (-\infty,0]\times[0,\infty)Ω=(−∞,0]×[0,∞). For f:Ω→Rf:\Omega\to\mathbb Rf:Ω→R write f1=∂f/∂x1f_1 = \partial f/\partial x_1f1​=∂f/∂x1​, f2=∂f/∂x2f_2 = \partial f/\partial x_2f2​=∂f/∂x2​, f11=∂f1/∂x1f_{11} = \partial f_1/\partial x_1f11​=∂f1​/∂x1​. On the boundary ∂Ω\partial\Omega∂Ω these are one-sided derivatives, and C2(Ω)C^2(\Omega)C2(Ω) denotes the twice continuously differentiable functions in this sense.

The diffusion limit Y=(Y1,Y2)Y=(Y_1,Y_2)Y=(Y1​,Y2​) solves

Y1(t)=Y1(0)+2W(t)−βt+∫0t(−Y1(s)+Y2(s)) ds−U(t),Y2(t)=Y2(0)+U(t)−∫0tY2(s) ds,Y_1(t)=Y_1(0)+\sqrt2W(t)-\beta t+\int_0^t(-Y_1(s)+Y_2(s))\,ds-U(t),\qquad Y_2(t)=Y_2(0)+U(t)-\int_0^tY_2(s)\,ds,Y1​(t)=Y1​(0)+2​W(t)−βt+∫0t​(−Y1​(s)+Y2​(s))ds−U(t),Y2​(t)=Y2​(0)+U(t)−∫0t​Y2​(s)ds,

with WWW a standard Brownian motion and UUU a nondecreasing regulator that increases only when Y1=0Y_1=0Y1​=0. For f∈C2(Ω)f\in C^2(\Omega)f∈C2(Ω) with the reflection condition f1(0,x2)=f2(0,x2)f_1(0,x_2)=f_2(0,x_2)f1​(0,x2​)=f2​(0,x2​), its generator acts by

GYf(x)=(−x1+x2−β)f1(x)−x2f2(x)+f11(x),x∈Ω.G_Yf(x)=(-x_1+x_2-\beta)f_1(x)-x_2f_2(x)+f_{11}(x),\qquad x\in\Omega .GY​f(x)=(−x1​+x2​−β)f1​(x)−x2​f2​(x)+f11​(x),x∈Ω.

The construction of the Lyapunov function uses an auxiliary integer n≥1n\ge1n≥1 and the fluid operator

Lf(x)=(−x1+x2−βn)f1(x)−x2f2(x),Lf(x)=\Big(-x_1+x_2-\frac{\beta}{\sqrt n}\Big)f_1(x)-x_2f_2(x),Lf(x)=(−x1​+x2​−n​β​)f1​(x)−x2​f2​(x),

the generator of the deterministic fluid path v1′=−v1+v2−β/nv_1'=-v_1+v_2-\beta/\sqrt nv1′​=−v1​+v2​−β/n​, v2′=−v2v_2'=-v_2v2′​=−v2​. A smoothed indicator ϕ(ℓ,u)\phi^{(\ell,u)}ϕ(ℓ,u) (a piecewise cubic that rises from 000 at ℓ\ellℓ to 111 at uuu) and two levels β<κ1<κ2\beta<\kappa_1<\kappa_2β<κ1​<κ2​ define the PDEs

Lf(1)(x)=−ϕ(κ1/n,κ2/n)(−x1),Lf(2)(x)=−ϕ(κ1/n,κ2/n)(x2),x∈Ω,Lf^{(1)}(x)=-\phi^{(\kappa_1/\sqrt n,\kappa_2/\sqrt n)}(-x_1),\qquad Lf^{(2)}(x)=-\phi^{(\kappa_1/\sqrt n,\kappa_2/\sqrt n)}(x_2),\qquad x\in\Omega,Lf(1)(x)=−ϕ(κ1​/n​,κ2​/n​)(−x1​),Lf(2)(x)=−ϕ(κ1​/n​,κ2​/n​)(x2​),x∈Ω,

each with the reflection condition. Their solutions are written explicitly in terms of the fluid hitting times τ~(κ)\tilde\tau^{(\kappa)}τ~(κ) (through the Lambert W function) and τ\tauτ, and the curves Γ(κ)\Gamma^{(\kappa)}Γ(κ) that split Ω\OmegaΩ into regions S0,…,S3S_0,\dots,S_3S0​,…,S3​.

Formalization targets

Goal: Theorem 4

For every β>0\beta>0β>0 there exist c>0c>0c>0, d>0d>0d>0, a compact set KKK and V∈C2(Ω)V\in C^2(\Omega)V∈C2(Ω) with V≥1V\ge1V≥1 on Ω\OmegaΩ, V(x)→∞V(x)\to\inftyV(x)→∞ as ∣x∣→∞|x|\to\infty∣x∣→∞ in Ω\OmegaΩ, and V1(0,x2)=V2(0,x2)V_1(0,x_2)=V_2(0,x_2)V1​(0,x2​)=V2​(0,x2​), such that

GYV(x)≤−cV(x)+d 1(x∈K),x∈Ω.G_YV(x)\le -cV(x)+d\,1(x\in K),\qquad x\in\Omega .GY​V(x)≤−cV(x)+d1(x∈K),x∈Ω.

The constants are unspecified and depend only on β\betaβ; the statement involves no nnn.

Milestones

  1. (5.6)–(5.7): ϕ(ℓ,u)\phi^{(\ell,u)}ϕ(ℓ,u) has an absolutely continuous derivative with ϕ′(ℓ)=ϕ′(u)=0\phi'(\ell)=\phi'(u)=0ϕ′(ℓ)=ϕ′(u)=0, ∣ϕ′∣≤4/(u−ℓ)|\phi'|\le 4/(u-\ell)∣ϕ′∣≤4/(u−ℓ) and ∣ϕ′′∣≤12/(u−ℓ)2|\phi''|\le12/(u-\ell)^2∣ϕ′′∣≤12/(u−ℓ)2.
  2. Lemma 10: τ~(κ)\tilde\tau^{(\kappa)}τ~(κ) extends to {x2=0}\{x_2=0\}{x2​=0}, vanishes on {x1=−κ/n}\{x_1=-\kappa/\sqrt n\}{x1​=−κ/n​}, and has explicit one-sided partial derivatives.
  3. Lemma 11: the explicit f(1)f^{(1)}f(1) is nonnegative, lies in C2(Ω)C^2(\Omega)C2(Ω), and has explicit first partials.
  4. Lemma 12: the explicit six-case f(2)f^{(2)}f(2) is well defined, lies in C2(Ω)C^2(\Omega)C2(Ω), and has the partials (C.8)–(C.9).
  5. Lemma 8: for ϵ>0\epsilon>0ϵ>0, κ1=β+ϵ\kappa_1=\beta+\epsilonκ1​=β+ϵ, κ2=β+2ϵ\kappa_2=\beta+2\epsilonκ2​=β+2ϵ, both PDEs have C2(Ω)C^2(\Omega)C2(Ω) solutions with
f(1)≤log⁡2,f(2)≤log⁡2+ϵβ on a box,∣f1(1)∣≤4nϵlog⁡2, ∣f11(1)∣≤12nϵ2log⁡2, ∣f1(2)∣≤nβ, ∣f11(2)∣≤nβϵ(1+4β+ϵϵ).f^{(1)}\le\log2,\quad f^{(2)}\le\log2+\tfrac{\epsilon}{\beta}\ \text{on a box},\qquad |f^{(1)}_1|\le\tfrac{4\sqrt n}{\epsilon}\log2,\ |f^{(1)}_{11}|\le\tfrac{12n}{\epsilon^2}\log2,\ |f^{(2)}_1|\le\tfrac{\sqrt n}{\beta},\ |f^{(2)}_{11}|\le\tfrac{n}{\beta\epsilon}\big(1+4\tfrac{\beta+\epsilon}{\epsilon}\big).f(1)≤log2,f(2)≤log2+βϵ​ on a box,∣f1(1)​∣≤ϵ4n​​log2, ∣f11(1)​∣≤ϵ212n​log2, ∣f1(2)​∣≤βn​​, ∣f11(2)​∣≤βϵn​(1+4ϵβ+ϵ​).

Significance

By the criterion of Down, Meyn and Tweedie (Ann. Probab. 23, 1995, Theorem 5.2), a drift inequality of the form (5.2) with compact KKK and V→∞V\to\inftyV→∞ implies that the diffusion is positive Harris recurrent and exponentially ergodic in the VVV-norm (Theorem 3 and Corollary 1 of the paper). Together with tightness of the prelimit stationary distributions (mission 1 of this series), this gives convergence of the stationary distributions of the JSQ chains to that of the diffusion. That justifies approximating steady-state JSQ performance by the diffusion.

The construction itself is reusable. Solving the fluid-model PDE Lf=−(smoothed indicator)Lf=-(\text{smoothed indicator})Lf=−(smoothed indicator) and exponentiating the solution is a general route from fluid stability to exponential ergodicity of a diffusion. This mission writes that route out for one reflected diffusion with explicit hitting-time formulas.

Status: the result is proved in the paper; no part of it has a machine-checked proof. Theorem 3 and Corollary 1 are not posed, because they rest on the cited Down–Meyn–Tweedie theory and on the existence of the reflected process, neither of which Mathlib has.

Difficulty

The reflecting boundary rules out the first candidates. The condition V1(0,x2)=V2(0,x2)V_1(0,x_2)=V_2(0,x_2)V1​(0,x2​)=V2​(0,x2​) excludes exponentials of linear functions such as ea(x2−x1)e^{a(x_2-x_1)}ea(x2​−x1​) unless a=0a=0a=0. The natural candidate from the fluid model, the exponential of the fluid time needed to reach a box, has a discontinuous integrand and is not in C2(Ω)C^2(\Omega)C2(Ω), so GYG_YGY​ cannot be applied to it. The milestone functions f(1)f^{(1)}f(1), f(2)f^{(2)}f(2) are given piecewise across the curves Γ(κ1)\Gamma^{(\kappa_1)}Γ(κ1​), Γ(κ2)\Gamma^{(\kappa_2)}Γ(κ2​) and the lines x1=−κi/nx_1=-\kappa_i/\sqrt nx1​=−κi​/n​, through implicitly defined hitting times. Three things are hard: C2C^2C2 regularity across these interfaces, the Lambert W asymptotics as x2↓0x_2\downarrow0x2​↓0, and second-derivative bounds that hold uniformly on the unbounded domain Ω\OmegaΩ with the stated dependence on nnn and ϵ\epsilonϵ.

Formalization scope

  • Points of Ω\OmegaΩ are pairs ℝ × ℝ, and Ω\OmegaΩ is Set.Iic 0 ×ˢ Set.Ici 0. Partials are fderivWithin ℝ f Ω in the coordinate directions, which are one-sided at boundary points. C2(Ω)C^2(\Omega)C2(Ω) is ContDiffOn ℝ 2 f Ω.
  • GYG_YGY​ is the generator formula of p. 16, and every statement applies it only to C2(Ω)C^2(\Omega)C2(Ω) functions with the reflection condition. The process (2.1) and the extended generator are not constructed. V∈C2(Ω)V\in C^2(\Omega)V∈C2(Ω) is part of the conclusion of Theorem 4, so a VVV whose derivatives within Ω\OmegaΩ are undefined (and default to 000) cannot satisfy (5.2) vacuously. Dropping V≥1V\ge1V≥1, V→∞V\to\inftyV→∞, the compactness of KKK, or c,d>0c,d>0c,d>0 would make (5.2) trivial, and all four are kept.
  • The auxiliary nnn is an integer n≥1n\ge1n≥1; no relation between β\betaβ and n\sqrt nn​ is assumed.
  • The Lambert W function (principal branch) is defined locally, since Mathlib has none. τ\tauτ takes values in WithTop ℝ, with ∞\infty∞ when no solution exists, and its real value is used only where it is finite. ν∗\nu^*ν∗ (the curve Γ(κ)\Gamma^{(\kappa)}Γ(κ)) is the solution of a nonlinear system whose uniqueness is Lemma 5.
  • Two printed misprints are corrected. Lemma 8's "for every ϵ>0\epsilon>0ϵ>0" is formalized with κ1=β+ϵ\kappa_1=\beta+\epsilonκ1​=β+ϵ, κ2=β+2ϵ\kappa_2=\beta+2\epsilonκ2​=β+2ϵ, the choice its proof makes; read literally, the printed statement is false. In (C.5) of Lemma 10 the identity τ~2=−τ~1τ~\tilde\tau_2=-\tilde\tau_1\tilde\tauτ~2​=−τ~1​τ~ is formalized as τ~2=τ~1τ~\tilde\tau_2=\tilde\tau_1\tilde\tauτ~2​=τ~1​τ~, which is what implicit differentiation gives.
  • Lemmas 5, 6 and 9 (properties of Γ(κ)\Gamma^{(\kappa)}Γ(κ), τ\tauτ and WWW) are milestones of mission 1; here their objects are only definitions. Contributions proving those facts in this namespace, or general lemmas on the Lambert W function, are welcome.

Selected references

  • A. Braverman, Steady-State Analysis of the Join-the-Shortest-Queue Model in the Halfin-Whitt Regime, Math. Oper. Res. 45(3), 2020; preprint arXiv:1801.05121v2, 2019. https://arxiv.org/abs/1801.05121, https://doi.org/10.1287/moor.2019.1023
  • P. Eschenfeldt, D. Gamarnik, Join the Shortest Queue with Many Servers. The Heavy-Traffic Asymptotics, 2015 (Math. Oper. Res. 43(3), 2018). https://arxiv.org/abs/1502.00999
  • D. Down, S. P. Meyn, R. L. Tweedie, Exponential and Uniform Ergodicity of Markov Processes, Ann. Probab. 23, 1671–1691, 1995. https://doi.org/10.1214/aop/1176987798
  • D. Mukherjee, S. C. Borst, J. S. H. van Leeuwaarden, P. A. Whiting, Universality of Load Balancing Schemes on the Diffusion Scale, J. Appl. Probab. 53, 1111–1124, 2016. https://projecteuclid.org/euclid.jap/1481132840
9 thms1 active userReviewed
Control TheoryMachine LearningOperations Research+1·Captain: mikedeng1

Convergence Analysis of Machine Learning for Mean Field Control, Finite Horizon: The N-Agent Discrete-Time Neural-Net Value Is Within O(N^{-1/max(d,4)} + n_in^{-1/(3(d+1))} + √Δt) of the MKV OptimumResearch Paper

Motivation

Mean field control studies the optimal control of a very large population of interacting agents through the limit in which the population is replaced by its distribution. The limit problem is a McKean–Vlasov (MKV) control problem: the dynamics and the cost of a representative agent depend on the law of its own state. Such problems arise in systemic risk, crowd motion, energy management and the planning of large distributed systems; the reference account is Carmona and Delarue, Probabilistic Theory of Mean Field Games with Applications I–II (Springer, 2018).

MKV control problems are rarely solvable in closed form, and grid-based numerical methods suffer from the dimension of the state. A practical alternative is to simulate a finite population on a time grid, parametrize the feedback control by a neural network, and minimize the simulated cost by stochastic gradient descent. Carmona and Laurière, Convergence analysis of machine learning algorithms for the numerical solution of mean field control and games: II — the finite horizon case (Ann. Appl. Probab. 32(6), 2022, doi:10.1214/21-AAP1715), quantify how close this computable proxy is to the true optimum. This mission formalizes the statement of their main result and of the propositions and lemmas its proof is built from.

Setting

Fix a horizon T>0T>0T>0, a state dimension ddd, a control dimension kkk (controls take values in A=RkA=\mathbb R^kA=Rk), an initial law μ0\mu_0μ0​ on Rd\mathbb R^dRd, a drift b(t,x,μ,α)b(t,x,\mu,\alpha)b(t,x,μ,α), a volatility σ(t,x,μ)\sigma(t,x,\mu)σ(t,x,μ) (not controlled), a running cost f(t,x,μ,α)f(t,x,\mu,\alpha)f(t,x,μ,α) and a terminal cost g(x,μ)g(x,\mu)g(x,μ); μ\muμ ranges over P2(Rd)\mathcal P_2(\mathbb R^d)P2​(Rd), the probability measures with finite second moment, compared with the Wasserstein distance W2W_2W2​.

Problem 1 (the MKV problem). On a probability space carrying a ddd-dimensional Wiener process WWW and an independent X0∼μ0X_0\sim\mu_0X0​∼μ0​, minimize over progressively measurable square-integrable controls α∈A\alpha\in\mathbb Aα∈A

J(α)=E[∫0Tf(t,Xt,L(Xt),αt) dt+g(XT,L(XT))],dXt=b(t,Xt,L(Xt),αt) dt+σ(t,Xt,L(Xt)) dWt,J(\alpha)=\mathbb E\Big[\int_0^Tf(t,X_t,\mathcal L(X_t),\alpha_t)\,dt+g(X_T,\mathcal L(X_T))\Big],\qquad dX_t=b(t,X_t,\mathcal L(X_t),\alpha_t)\,dt+\sigma(t,X_t,\mathcal L(X_t))\,dW_t,J(α)=E[∫0T​f(t,Xt​,L(Xt​),αt​)dt+g(XT​,L(XT​))],dXt​=b(t,Xt​,L(Xt​),αt​)dt+σ(t,Xt​,L(Xt​))dWt​,

where L(Xt)\mathcal L(X_t)L(Xt​) is the law of XtX_tXt​.

Problem 3 (the NNN-agent problem). NNN agents with independent Wiener processes WiW^iWi and i.i.d. initial states X0i∼μ0X^i_0\sim\mu_0X0i​∼μ0​ use a common feedback function v(t,x)v(t,x)v(t,x); the law is replaced by the empirical measure μtN=1N∑jδXtj\mu^N_t=\frac1N\sum_j\delta_{X^j_t}μtN​=N1​∑j​δXtj​​, and the cost is JN(v)=1N∑iE[∫0Tf(t,Xti,μtN,v(t,Xti)) dt+g(XTi,μTN)]J^N(v)=\frac1N\sum_i\mathbb E[\int_0^Tf(t,X^i_t,\mu^N_t,v(t,X^i_t))\,dt+g(X^i_T,\mu^N_T)]JN(v)=N1​∑i​E[∫0T​f(t,Xti​,μtN​,v(t,Xti​))dt+g(XTi​,μTN​)].

Problem 2 (the computable proxy). With Δt=T/NT\Delta t=T/N_TΔt=T/NT​ and tn=nΔtt_n=n\Delta ttn​=nΔt, the NNN agents follow the Euler scheme

Xˇtn+1i=Xˇtni+b(tn,Xˇtni,μˇtn,φ(tn,Xˇtni))Δt+σ(tn,Xˇtni,μˇtn)ΔWˇni\check X^i_{t_{n+1}}=\check X^i_{t_n}+b(t_n,\check X^i_{t_n},\check\mu_{t_n},\varphi(t_n,\check X^i_{t_n}))\Delta t+\sigma(t_n,\check X^i_{t_n},\check\mu_{t_n})\Delta\check W^i_nXˇtn+1​i​=Xˇtn​i​+b(tn​,Xˇtn​i​,μˇ​tn​​,φ(tn​,Xˇtn​i​))Δt+σ(tn​,Xˇtn​i​,μˇ​tn​​)ΔWˇni​

with i.i.d. Gaussian increments ΔWˇni∼N(0,Δt Id)\Delta\check W^i_n\sim\mathcal N(0,\Delta t\,I_d)ΔWˇni​∼N(0,ΔtId​), and JˇN(φ)\check J^N(\varphi)JˇN(φ) is the expected time-discretized cost. The feedback φ\varphiφ ranges over Nd+1,nin,kψ\mathbf N^\psi_{d+1,n_{\rm in},k}Nd+1,nin​,kψ​, the one-hidden-layer neural networks from (t,x)∈Rd+1(t,x)\in\mathbb R^{d+1}(t,x)∈Rd+1 to Rk\mathbb R^kRk with ninn_{\rm in}nin​ hidden neurons and activation ψ\psiψ; ψ\psiψ is 2π2\pi2π-periodic, of class C3\mathcal C^3C3, with ψ^1=∫−ππψ(x)e−ix dx≠0\hat\psi_1=\int_{-\pi}^{\pi}\psi(x)e^{-ix}\,dx\ne0ψ^​1​=∫−ππ​ψ(x)e−ixdx=0.

The standing assumptions (§2.2 and Appendix A of the paper) make b,σb,\sigmab,σ affine in (x,μˉ,α)(x,\bar\mu,\alpha)(x,μˉ​,α) (A1), make f,gf,gf,g differentiable in (x,α,μ)(x,\alpha,\mu)(x,α,μ) (in μ\muμ in the sense of the L-derivative) with Lipschitz derivatives (A2)–(A3), make fff strongly convex in α\alphaα (A4), and add the regularity (B1)–(B3), (C1)–(C3). Under them the reduced Hamiltonian b⋅y+fb\cdot y+fb⋅y+f has a minimizer α^(t,x,μ,y)\hat\alpha(t,x,\mu,y)α^(t,x,μ,y), the Pontryagin forward–backward system has a solution (X,Y,Z)(X,Y,Z)(X,Y,Z) with marginal flow μt\mu_tμt​, and Yt=V(t,Xt)Y_t=V(t,X_t)Yt​=V(t,Xt​) for a regular decoupling field VVV. The optimal feedback is v^(t,x)=α^(t,x,μt,V(t,x))\hat v(t,x)=\hat\alpha(t,x,\mu_t,V(t,x))v^(t,x)=α^(t,x,μt​,V(t,x)).

Formalization targets

Goal: Theorem 3 (p. 4070)

inf⁡α∈AJ(α) ≥ inf⁡φ∈Nd+1,nin,kψJˇN(φ)−C(N−1/max⁡(d,4)1+ln⁡(N)1{d=4}+nin−1/(3(d+1))+Δt)\inf_{\alpha\in\mathbb A}J(\alpha)\ \ge\ \inf_{\varphi\in\mathbf N^\psi_{d+1,n_{\rm in},k}}\check J^N(\varphi)-C\Big(N^{-1/\max(d,4)}\sqrt{1+\ln(N)\mathbf 1_{\{d=4\}}}+n_{\rm in}^{-1/(3(d+1))}+\sqrt{\Delta t}\Big)α∈Ainf​J(α) ≥ φ∈Nd+1,nin​,kψ​inf​JˇN(φ)−C(N−1/max(d,4)1+ln(N)1{d=4}​​+nin−1/(3(d+1))​+Δt​)

for a constant CCC depending only on the data and on ψ\psiψ, for all N,nin,NT≥1N,n_{\rm in},N_T\ge1N,nin​,NT​≥1.

The three steps

  1. Proposition 7 (finite population): inf⁡αJ(α)≥JN(v^)−c1N−2/max⁡(d,4)(1+ln⁡(N)1{d=4})\inf_\alpha J(\alpha)\ge J^N(\hat v)-c_1\sqrt{N^{-2/\max(d,4)}(1+\ln(N)\mathbf 1_{\{d=4\}})}infα​J(α)≥JN(v^)−c1​N−2/max(d,4)(1+ln(N)1{d=4}​)​.
  2. Proposition 8 (network class): some φ^∈Nd+1,nin,kψ\hat\varphi\in\mathbf N^\psi_{d+1,n_{\rm in},k}φ^​∈Nd+1,nin​,kψ​ with bounded Lipschitz constants has JN(v^)≥JN(φ^)−K2nin−1/(3(d+1))J^N(\hat v)\ge J^N(\hat\varphi)-K_2n_{\rm in}^{-1/(3(d+1))}JN(v^)≥JN(φ^​)−K2​nin−1/(3(d+1))​.
  3. Proposition 15 (time step): ∣JN(φ)−JˇN(φ)∣≤CΔt|J^N(\varphi)-\check J^N(\varphi)|\le C\sqrt{\Delta t}∣JN(φ)−JˇN(φ)∣≤CΔt​ for regular feedbacks.

Supporting results

Lemma 18 (Lipschitz continuity of α^\hat\alphaα^), Proposition 10 (network approximation of a function and its first two xxx-derivatives at rate nin−1/(2(d+1))n_{\rm in}^{-1/(2(d+1))}nin−1/(2(d+1))​ on [0,T]×Bˉd(0,R)[0,T]\times\bar B_d(0,R)[0,T]×Bˉd​(0,R)), (C.2) (moment bounds uniform in NNN), Proposition 13 (stability of JNJ^NJN under feedbacks close on a ball), Lemma 19 (time regularity of the particle system) and Lemma 14 (strong error CNΔtCN\Delta tCNΔt of the Euler scheme).

Significance

The theorem certifies the standard deep-learning approach to mean field control: the value computed by minimizing the simulated finite-population, discrete-time cost over networks is, up to an explicit error with separate rates for population size, network width and time step, no larger than the true MKV value. The rates also expose where the method loses: the nin−1/(3(d+1))n_{\rm in}^{-1/(3(d+1))}nin−1/(3(d+1))​ term is a curse of dimensionality in the network step (Remark 11).

The result is proved in the paper (§3 and Appendices B–D); the proof of Proposition 7 is a modification of Carmona–Delarue, Vol. II, Theorem 6.17. None of it is formalized. A formal development would provide the first machine-checked bridge between a stochastic control problem of McKean–Vlasov type and a concrete learning architecture, and its intermediate results (moment and stability estimates for interacting particle systems, the strong error of an Euler scheme with constants independent of the number of particles, simultaneous approximation of a function and its derivatives by periodic networks) are reusable on their own.

Difficulty

Each step rests on research-level analysis. Proposition 7 needs the Pontryagin principle for McKean–Vlasov control, the propagation of chaos for the optimally controlled system, and the Fournier–Guillin rate for empirical measures, whose max⁡(d,4)\max(d,4)max(d,4) exponent and logarithmic correction at d=4d=4d=4 appear in the bound. Proposition 8 requires approximating the optimal feedback together with its first two derivatives in xxx, because the time-discretization step needs regularity of the approximating network; standard universal approximation results give no control of derivatives, and the available simultaneous approximation results hold only for periodic functions, which forces a localization to a ball whose radius must be balanced against the approximation rate. Proposition 15 cannot be obtained from classical Euler estimates for a system of NdNdNd equations, whose constants grow with NNN: the estimates must be done agent by agent through the empirical measure.

Formalization scope

Rd\mathbb R^dRd is Fin d → ℝ with the sup norm; every constant is existential, so all statements are norm-independent. Time is ℝ≥0 for processes. Solutions of (2.2) and (3.2) use the published Itô-process predicate Peng1990.SMP.IsItoProcess (for X−X0X-X_0X−X0​, with continuous paths and the natural filtration of the initial data and the noise); the backward equation of the Pontryagin system uses Peng1990.SMP.SolvesBSDE; W2W_2W2​ is the published WassersteinDRO.Duality.wassersteinDistance. Problem 2 is law-level: the Euler scheme is a deterministic map of initial positions and increments, integrated against μ0⊗N⊗N(0,ΔtId)⊗NNT\mu_0^{\otimes N}\otimes\mathcal N(0,\Delta t I_d)^{\otimes NN_T}μ0⊗N​⊗N(0,ΔtId​)⊗NNT​; Lemma 14 couples it with the continuous system through the Brownian increments, as the paper does.

The hypotheses are bundled as Coeff ((A1)–(A4), (B1), (B3), (C1), with witnesses for every derivative; the L-derivative is the Fréchet derivative of the lift on L2([0,1])L^2([0,1])L2([0,1])) and DecouplingField ((2.6), existence of a solution of (2.7) on some Problem-1 space, Yt=V(t,Xt)Y_t=V(t,X_t)Yt​=V(t,Xt​), (B2), (C2), (C3)). Disclosed readings: ggg's L-convexity is (A4) without α\alphaα and with right-hand side 000; unique solvability of (2.7), uniqueness and Lipschitz continuity of α^\hat\alphaα^ are not assumed (the last is Lemma 18); Proposition 13 lets its constant depend on bounds for ∣v(0,0)∣,∣w(0,0)∣|v(0,0)|,|w(0,0)|∣v(0,0)∣,∣w(0,0)∣, as its proof does; Proposition 15 reads the first bound of (3.16) as C1(1+∣(t,x)∣)C_1(1+|(t,x)|)C1​(1+∣(t,x)∣). Infima are stated pointwise (∀α ∀η>0 ∃φ\forall\alpha\,\forall\eta>0\,\exists\varphi∀α∀η>0∃φ), never as a real ⨅, and N,nin,NT≥1N,n_{\rm in},N_T\ge1N,nin​,NT​≥1 throughout. The hypothesis bundle is not vacuous: a sorry-free check exhibits the model b=σ=0b=\sigma=0b=σ=0, f=∣α∣2f=|\alpha|^2f=∣α∣2, g=0g=0g=0, μ0=δ0\mu_0=\delta_0μ0​=δ0​ with α^=0\hat\alpha=0α^=0, V=0V=0V=0 satisfying every assumption on any Problem-1 space. Junk values cannot trivialize the goal: the costs are Bochner integrals whose integrability follows from the assumptions, so a non-integrable cost would only make the claimed inequality harder, never vacuous.

Contributions are welcome at every level: proofs of the milestones, in particular the self-contained Lemmas 14 and 19, (C.2) and Proposition 13; infrastructure for the L-derivative, Itô's formula for the published Itô processes, empirical-measure convergence rates, and trigonometric approximation of Cr\mathcal C^rCr periodic functions.

Selected references

  • R. Carmona, M. Laurière, Convergence analysis of machine learning algorithms for the numerical solution of mean field control and games: II — the finite horizon case, Ann. Appl. Probab. 32(6) (2022), 4065–4105. https://doi.org/10.1214/21-AAP1715
  • R. Carmona, F. Delarue, Probabilistic Theory of Mean Field Games with Applications I–II, Springer (2018). https://doi.org/10.1007/978-3-319-58920-6
  • N. Fournier, A. Guillin, On the rate of convergence in Wasserstein distance of the empirical measure, Probab. Theory Relat. Fields 162 (2015), 707–738. https://doi.org/10.1007/s00440-014-0583-7
  • S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4) (1990), 966–979. https://doi.org/10.1137/0328054
15 thms1 active userReviewed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Graphon Mean Field Systems V: On Percolated Graphs Sampled From a Lipschitz Graphon the Mean-Square Error Is at Most κ(q)/(nβₙ)^{1/q}Research Paper

Motivation

Large systems of interacting diffusions — neurons, oscillators, agents in a network game, particles in a queueing or load-balancing model — are usually analysed through their mean-field limit: as the population grows, each particle interacts with the empirical law of the others, and the system is replaced by a single nonlinear (McKean–Vlasov) equation. The classical theory assumes that every particle interacts with every other one with the same strength. Real networks are heterogeneous and sparse: particle iii interacts with particle jjj only through an edge of a random graph, and the number of neighbours of a particle is much smaller than the population size.

Bayraktar, Chakraborty and Wu (Ann. Appl. Probab. 33(5), 2023) describe the heterogeneity by a graphon and prove laws of large numbers and rates of convergence for such systems. This mission is the fifth of a series formalizing that paper. Its subject is the paper's quantitative result for not-so-dense graphs: when the edges are sampled from a Lipschitz graphon and then thinned by a sparsity factor βn\beta_nβn​, the average mean-square distance between each particle and its graphon limit is of order (nβn)−1/q(n\beta_n)^{-1/q}(nβn​)−1/q for every q>1q>1q>1.

Setting

Let I=[0,1]I=[0,1]I=[0,1] with Lebesgue measure. A graphon is a measurable symmetric function G:I×I→[0,1]G:I\times I\to[0,1]G:I×I→[0,1]. Fix a horizon T>0T>0T>0 and write Cd=C([0,T]:Rd)\mathcal C_d=C([0,T]:\mathbb R^d)Cd​=C([0,T]:Rd) with the norm ∥x∥∗,T=sup⁡0≤s≤T∣xs∣\|x\|_{*,T}=\sup_{0\le s\le T}|x_s|∥x∥∗,T​=sup0≤s≤T​∣xs​∣.

One probability space carries, for every label u∈Iu\in Iu∈I, an initial state Xu(0)X_u(0)Xu​(0) with law μu(0)\mu_u(0)μu​(0) and a standard ddd-dimensional Brownian motion BuB_uBu​, the whole family {Xu(0),Bu:u∈I}\{X_u(0),B_u:u\in I\}{Xu​(0),Bu​:u∈I} being independent. The limit system (4.2) is a continuum of diffusions, one per label:

Xu(t)=Xu(0)+∫0t ⁣∫I ⁣∫Rdb(Xu(s),x) G(u,v) μv,s(dx) dv ds+∫0tσ(Xu(s)) dBu(s),μu,t=L(Xu(t)).X_u(t)=X_u(0)+\int_0^t\!\int_I\!\int_{\mathbb R^d}b(X_u(s),x)\,G(u,v)\,\mu_{v,s}(dx)\,dv\,ds+\int_0^t\sigma(X_u(s))\,dB_u(s),\qquad \mu_{u,t}=\mathcal L(X_u(t)).Xu​(t)=Xu​(0)+∫0t​∫I​∫Rd​b(Xu​(s),x)G(u,v)μv,s​(dx)dvds+∫0t​σ(Xu​(s))dBu​(s),μu,t​=L(Xu​(t)).

The particles are independent but not identically distributed; their laws are coupled through the dvdvdv-integral.

The not-so-dense nnn-particle system (4.1) uses the same initial states and Brownian motions at the labels i/ni/ni/n:

Xin(t)=Xi/n(0)+∫0t1nβn∑j=1nξijn b(Xin(s),Xjn(s)) ds+∫0tσ(Xin(s)) dBi/n(s),i=1,…,n.X^n_i(t)=X_{i/n}(0)+\int_0^t\frac{1}{n\beta_n}\sum_{j=1}^n\xi^n_{ij}\,b(X^n_i(s),X^n_j(s))\,ds+\int_0^t\sigma(X^n_i(s))\,dB_{i/n}(s),\qquad i=1,\dots,n.Xin​(t)=Xi/n​(0)+∫0t​nβn​1​j=1∑n​ξijn​b(Xin​(s),Xjn​(s))ds+∫0t​σ(Xin​(s))dBi/n​(s),i=1,…,n.

The edges are percolated samples of GGG (Condition 4.3): ξijn=ξjin∼Bernoulli(βnG(i/n,j/n))\xi^n_{ij}=\xi^n_{ji}\sim\mathrm{Bernoulli}(\beta_nG(i/n,j/n))ξijn​=ξjin​∼Bernoulli(βn​G(i/n,j/n)), independent for 1≤i≤j≤n1\le i\le j\le n1≤i≤j≤n and independent of the noise. A particle has about nβnn\beta_nnβn​ neighbours, which is why the interaction is scaled by 1/(nβn)1/(n\beta_n)1/(nβn​).

The standing hypotheses are Condition 4.1 — u↦μu(0)u\mapsto\mu_u(0)u↦μu​(0) measurable with bounded second moments; bbb bounded and Lipschitz; σ\sigmaσ bounded, Lipschitz and invertible with bounded inverse; βn∈(0,1]\beta_n\in(0,1]βn​∈(0,1] and nβn→∞n\beta_n\to\inftynβn​→∞ — and Condition 2.3: on finitely many intervals I1,…,INI_1,\dots,I_NI1​,…,IN​ covering III, the map u↦μu(0)u\mapsto\mu_u(0)u↦μu​(0) is Lipschitz in the Wasserstein distance W2W_2W2​, and GGG is Lipschitz on every block Ii×IjI_i\times I_jIi​×Ij​.

Formalization targets

Goal: Theorem 4.2

Under Conditions 2.3, 4.1 and 4.3, for each q∈(1,∞)q\in(1,\infty)q∈(1,∞) there is κ(q)∈(0,∞)\kappa(q)\in(0,\infty)κ(q)∈(0,∞) with

1n∑i=1nE∥Xin−Xi/n∥∗,T2≤κ(q)(nβn)1/qfor all n∈N.\frac1n\sum_{i=1}^n\mathbb E\big\|X^n_i-X_{i/n}\big\|_{*,T}^2\le\frac{\kappa(q)}{(n\beta_n)^{1/q}}\qquad\text{for all }n\in\mathbb N .n1​i=1∑n​E​Xin​−Xi/n​​∗,T2​≤(nβn​)1/qκ(q)​for all n∈N.

The constant depends on qqq and on the data, never on nnn. The bound is on the average over particles, not on the maximum.

Milestones

  1. Lemma 7.1: all moments of the coupling error are bounded uniformly in nnn and iii.
  2. (7.10): E[ξijn∣Xjn(s)−Xj/n(s)∣2]≤(2E∣Xjn(s)−Xj/n(s)∣2+κ(q)(nβn)−1/q)βnG(i/n,j/n)\mathbb E[\xi^n_{ij}|X^n_j(s)-X_{j/n}(s)|^2]\le\big(2\mathbb E|X^n_j(s)-X_{j/n}(s)|^2+\kappa(q)(n\beta_n)^{-1/q}\big)\beta_nG(i/n,j/n)E[ξijn​∣Xjn​(s)−Xj/n​(s)∣2]≤(2E∣Xjn​(s)−Xj/n​(s)∣2+κ(q)(nβn​)−1/q)βn​G(i/n,j/n).
  3. (7.15): the interaction error Rsn,2R^{n,2}_sRsn,2​ is at most (κ/n)∑jE∣Xjn(s)−Xj/n(s)∣2+κ(q)(nβn)−1/q(\kappa/n)\sum_j\mathbb E|X^n_j(s)-X_{j/n}(s)|^2+\kappa(q)(n\beta_n)^{-1/q}(κ/n)∑j​E∣Xjn​(s)−Xj/n​(s)∣2+κ(q)(nβn​)−1/q.
  4. Theorem 2.1(b) for (4.2): W2,T(μu,μv)≤κ∣u−v∣W_{2,T}(\mu_u,\mu_v)\le\kappa|u-v|W2,T​(μu​,μv​)≤κ∣u−v∣ for u,vu,vu,v in one interval IiI_iIi​.
  5. §7.3 display: the discretization error Rsn,4R^{n,4}_sRsn,4​ is at most κ/n2\kappa/n^2κ/n2.

Significance

Theorem 4.2 gives an explicit rate for the convergence of a particle system on a sparse random graph to its graphon limit. Its companion, Theorem 4.1 (mission IV), proves the law of large numbers under weaker hypotheses but without a rate. The rate says that the effective sample size is nβnn\beta_nnβn​, the typical degree, not nnn: graphs with βn→0\beta_n\to0βn​→0 still approximate the graphon system as long as the degree grows. Results of this type justify replacing a large heterogeneous network by its graphon limit in control and game problems, such as graphon mean-field games, where the error of the replacement must be quantified.

The paper proves the theorem by hand; none of its results has a machine-checked proof. The formalization produces precise statements of the not-so-dense model, of the estimates of §7.1 that hold for any sparsity, and of the discretization bound, each usable on its own. The milestones (7.10) and (7.15) are the paper's key estimates for sparse interactions and are shared with mission IV.

Difficulty

The obvious approach is to compare each XinX^n_iXin​ with Xi/nX_{i/n}Xi/n​ by Gronwall's inequality, after bounding the difference of drifts. That step fails at the interaction term: the edge ξijn\xi^n_{ij}ξijn​ and the error Xjn−Xj/nX^n_j-X_{j/n}Xjn​−Xj/n​ are dependent, because the edge enters the dynamics of particle jjj. A plain Cauchy–Schwarz bound loses a factor 1/βn1/\beta_n1/βn​ and gives nothing when βn→0\beta_n\to0βn​→0. Estimates (7.10) and (7.15) quantify how weak this dependence is, and they are where the hypotheses that σ\sigmaσ is invertible with bounded inverse and that nβn→∞n\beta_n\to\inftynβn​→∞ are needed. The discretization term needs the Lipschitz regularity of the limit laws in the label (Theorem 2.1(b)), itself a fixed-point estimate on a space of measure-valued maps.

Formalization scope

The Lean development uses Mathlib's unitInterval for III, Fin d → ℝ with its sup norm for Rd\mathbb R^dRd (all constants are existential, so the choice of norm does not matter), time ℝ≥0, and the path space Cd\mathcal C_dCd​ as continuous maps on [0,T][0,T][0,T] with the sup norm. Brownian motions, Itô integrals and Itô processes are those of the published Peng1990.SMP.Stochastic; Wasserstein distances are the published WassersteinDRO.Duality.wassersteinDistance, valued in [0,∞][0,\infty][0,∞]. Particle iii is Lean's i : Fin n with label (i+1)/n(i+1)/n(i+1)/n.

Committed conventions:

  • A solution of (4.2) has continuous paths, AE-measurable path maps, and path laws in the class M\mathcal MM (measurable in uuu, bounded second moments); each XuX_uXu​ is a strong solution for the filtration of (Xu(0),Bu)(X_u(0),B_u)(Xu​(0),Bu​). A solution of (4.1) is a strong solution for the filtration of the edges, the initial states and the Brownian motions of the nnn labels.
  • The edges are {0,1}\{0,1\}{0,1}-valued, symmetric, with the diagonal included, mutually independent over i≤ji\le ji≤j, and independent of the σ-algebra of the noise.
  • Condition 4.1(d) is required for n≥1n\ge1n≥1; the invertibility of σ\sigmaσ is that of a d×dd\times dd×d matrix; the intervals of Condition 2.3 are order-connected subsets of III.
  • Expectations of nonnegative quantities are lower Lebesgue integrals, so no expectation is silently 000 for a non-integrable integrand.

The solution predicates are not vacuous: the zero-coefficient system Xu(t)=Xu(0)X_u(t)=X_u(0)Xu​(t)=Xu​(0) satisfies both, Condition 4.1 and Condition 4.3 are satisfiable, and every statement quantifies over solutions rather than assuming the conclusion. The constant κ(q)\kappa(q)κ(q) is chosen after qqq and before nnn, so it cannot depend on nnn, and the bound is the paper's average over iii, not a weaker or a stronger form. At n=0n=0n=0 both sides of every rate are 000.

The paper's proofs are in its §5 (Theorem 2.1), §7.1 (Lemma 7.1, (7.10), (7.15)) and §7.3 (Theorem 4.2). Stochastic analysis at that level — Burkholder–Davis–Gundy and Rosenthal inequalities, Girsanov's theorem for these SDEs, Gronwall arguments for measure-valued fixed points — is mostly absent from Mathlib, and contributions of such infrastructure are welcome, as are proofs of any milestone.

Selected references

  • E. Bayraktar, S. Chakraborty, R. Wu, Graphon mean field systems, Ann. Appl. Probab. 33(5):3587–3619, 2023. https://doi.org/10.1214/22-AAP1901
  • L. Lovász, Large Networks and Graph Limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060
  • B. Bollobás, C. Borgs, J. Chayes, O. Riordan, Percolation on dense graph sequences, Ann. Probab. 38(1):150–183, 2010. https://doi.org/10.1214/09-AOP478
  • S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4):966–979, 1990. https://doi.org/10.1137/0328054
11 thms1 active userReviewed
Operations ResearchProbability·Captain: mikedeng1

Steady-State Analysis of the Join-the-Shortest-Queue Model in the Halfin-Whitt Regime 1: Diffusion-Scaled Stationary Queue Lengths Have Expectations Bounded Uniformly in nResearch Paper

Motivation

Join-the-shortest-queue (JSQ) is the load-balancing rule in which each arriving job is sent to a server with the fewest jobs. It is a baseline in the design of server farms and data centers, and in the many-server Halfin–Whitt regime, where the load per server approaches one at rate 1/n1/\sqrt n1/n​, it combines near-full utilization with vanishing waiting. Eschenfeldt and Gamarnik (arXiv:1502.00999, 2015) proved that the suitably scaled JSQ process converges, over bounded time intervals, to a two-dimensional reflected diffusion; Mukherjee, Borst, van Leeuwaarden and Whiting (J. Appl. Probab. 53, 2016) gave the form of the result that Braverman quotes as Theorem 1. Process-level convergence over bounded time intervals says nothing about the stationary distribution. To conclude that the stationary distributions converge as well, one needs tightness of the scaled stationary distributions, uniformly in the number of servers nnn.

Braverman (arXiv:1801.05121, Math. Oper. Res. 45(3), 2020) supplied this, together with positive recurrence of the diffusion limit. This mission formalizes the first of the two main results, Theorem 2, and the chain of lemmas the paper uses to prove it.

Setting

There are nnn identical servers, each with its own infinite buffer. Jobs arrive as a Poisson process of rate nλn\lambdanλ and service times are i.i.d. exponential with mean one. An arriving job joins a server with the fewest jobs, ties broken arbitrarily. The Halfin–Whitt regime is

λ=1−β/n,β>0 fixed.\lambda = 1 - \beta/\sqrt n,\qquad \beta > 0 \text{ fixed}.λ=1−β/n​,β>0 fixed.

For i≥1i \ge 1i≥1, QiQ_iQi​ is the number of servers with at least iii jobs. The process Q=(Q1,Q2,… )Q = (Q_1, Q_2, \dots)Q=(Q1​,Q2​,…) is a continuous-time Markov chain on

S={q∈{0,1,…,n}∞ ∣ qi≥qi+1, ∑iqi<∞}.S = \Big\{ q \in \{0,1,\dots,n\}^\infty \ \Big|\ q_i \ge q_{i+1},\ \textstyle\sum_i q_i < \infty \Big\}.S={q∈{0,1,…,n}∞ ​ qi​≥qi+1​, ∑i​qi​<∞}.

Its generator GQG_QGQ​ sends qqq to q+e(i)q + e^{(i)}q+e(i) at rate nλn\lambdanλ when q1=⋯=qi−1=n>qiq_1 = \dots = q_{i-1} = n > q_iq1​=⋯=qi−1​=n>qi​, and to q−e(i)q - e^{(i)}q−e(i) at rate qi−qi+1q_i - q_{i+1}qi​−qi+1​. The fluid-scaled coordinates are X1=(Q1−n)/n≤0X_1 = (Q_1 - n)/n \le 0X1​=(Q1​−n)/n≤0, the negative of the fraction of idle servers, and Xi=Qi/nX_i = Q_i/nXi​=Qi​/n for i≥2i \ge 2i≥2. The diffusion-scaled coordinates are nXi\sqrt n X_in​Xi​. Expectations E\mathbb EE are taken under a stationary distribution π\piπ of the chain.

The proof works with functions on Ω=(−∞,0]×[0,∞)\Omega = (-\infty, 0] \times [0, \infty)Ω=(−∞,0]×[0,∞) and with the first-order operator

Lf(x)=(−x1+x2−β/n)f1(x)−x2f2(x),Lf(x) = (-x_1 + x_2 - \beta/\sqrt n) f_1(x) - x_2 f_2(x),Lf(x)=(−x1​+x2​−β/n​)f1​(x)−x2​f2​(x),

where fif_ifi​ is the partial derivative in xix_ixi​, taken one-sided on ∂Ω\partial\Omega∂Ω.

Formalization targets

Goal: Theorem 2

For each β>0\beta > 0β>0 there is a constant C(β)C(\beta)C(β) such that for all n≥1n \ge 1n≥1 with β<n\beta < \sqrt nβ<n​ and every stationary distribution,

E∣nXi∣≤C(β),  i=1,2,E∣nXi∣≤C(β),  i≥3.\mathbb E\big|\sqrt n X_i\big| \le C(\beta),\ \ i = 1, 2,\qquad \mathbb E\big|n X_i\big| \le C(\beta),\ \ i \ge 3.E​n​Xi​​≤C(β),  i=1,2,E​nXi​​≤C(β),  i≥3.

The constant depends on β\betaβ only, not on nnn, the stationary distribution, or iii.

Milestones, in the order the proof uses them

  1. Lemma 1: E GQf(Q)=0\mathbb E\,G_Q f(Q) = 0EGQ​f(Q)=0 whenever E∣f(Q)∣<∞\mathbb E|f(Q)| < \inftyE∣f(Q)∣<∞.
  2. Lemma 2: EQ1=nλ\mathbb E Q_1 = n\lambdaEQ1​=nλ and EQi=nλ P(Q1=⋯=Qi−1=n)\mathbb E Q_i = n\lambda\,\mathbb P(Q_1 = \dots = Q_{i-1} = n)EQi​=nλP(Q1​=⋯=Qi−1​=n).
  3. Lemma 3: the generator, applied to f(x1,x2)f(x_1, x_2)f(x1​,x2​), equals Lf(x)+(f2−f1)(x)λ1(x1=0)+ε(x)Lf(x) + (f_2 - f_1)(x)\lambda 1(x_1 = 0) + \varepsilon(x)Lf(x)+(f2​−f1​)(x)λ1(x1​=0)+ε(x) with an explicit remainder ε\varepsilonε built from second weak derivatives.
  4. Lemmas 5 and 6: the curve Γ(κ)\Gamma^{(\kappa)}Γ(κ) and the hitting time τ(x)\tau(x)τ(x) of the fluid model; existence and uniqueness, finiteness, derivative formulas and monotonicity in κ\kappaκ.
  5. Lemma 7 and Lemma 4: for κ>β\kappa > \betaκ>β, the explicit function f∗f^*f∗ of (4.14) solves
Lf(x)=−((x2−κ/n)∨0) on Ω,f1(0,x2)=f2(0,x2),Lf(x) = -\big((x_2 - \kappa/\sqrt n)\vee 0\big)\ \text{on } \Omega,\qquad f_1(0, x_2) = f_2(0, x_2),Lf(x)=−((x2​−κ/n​)∨0) on Ω,f1​(0,x2​)=f2​(0,x2​),

with f11∗,f12∗,f22∗≥0f^*_{11}, f^*_{12}, f^*_{22} \ge 0f11∗​,f12∗​,f22∗​≥0, vanishing second derivatives for x2≤κ/nx_2 \le \kappa/\sqrt nx2​≤κ/n​, and explicit upper bounds of order n/β\sqrt n/\betan​/β above that level. 6. (3.18): E((X2−κ/n)∨0)≤1βn(12+6κκ−β)P(X2≥κ/n−1/n)\mathbb E\big((X_2 - \kappa/\sqrt n)\vee 0\big) \le \frac{1}{\beta\sqrt n}\big(12 + \frac{6\kappa}{\kappa - \beta}\big)\mathbb P(X_2 \ge \kappa/\sqrt n - 1/n)E((X2​−κ/n​)∨0)≤βn​1​(12+κ−β6κ​)P(X2​≥κ/n​−1/n). 7. Theorem 2, (2.2): the i=1,2i = 1, 2i=1,2 half of the goal.

Significance

Theorem 2 shows that in steady state the number of idle servers and the number of servers holding two or more jobs are O(n)O(\sqrt n)O(n​) on average, and the number of servers holding i≥3i \ge 3i≥3 jobs is O(1)O(1)O(1) on average, uniformly in nnn. Combined with the process-level limit and the positive recurrence of the limiting diffusion (Theorem 3, the companion mission), it yields Proposition 1: the diffusion-scaled stationary distribution converges to the stationary distribution of the diffusion. This justifies the diffusion as a steady-state approximation for JSQ.

The method is the generator-comparison or Stein's-method approach: a Lyapunov function solving a first-order PDE for the fluid model, with explicit bounds on its derivatives. It applies to other many-server systems, and the paper is an example of that approach on an infinite-dimensional chain whose diffusion limit is two-dimensional.

The result is proved in the paper; no machine-checked proof is known to exist. The work remaining is to formalize the known proof: the adjoint relation for a countable-state chain with bounded rates, the Taylor expansion of the generator, and the explicit analysis of f∗f^*f∗ through the fluid curves.

Difficulty

The obvious route is to bound P(Q1=⋯=Qi−1=n)\mathbb P(Q_1 = \dots = Q_{i-1} = n)P(Q1​=⋯=Qi−1​=n) in Lemma 2 directly. The paper notes that no good handle on these probabilities exists. The PDE route needs a solution whose second derivatives are bounded by O(n)O(\sqrt n)O(n​). General results that give such bounds require a continuous fluid vector field, and the JSQ fluid model is discontinuous because of the reflection at x1=0x_1 = 0x1​=0. So f∗f^*f∗ is constructed explicitly from the fluid paths, and its derivatives must be bounded by hand through the implicitly defined τ(x)\tau(x)τ(x) and ν∗(x1)\nu^*(x_1)ν∗(x1​).

A second difficulty is dimensional: the chain is infinite-dimensional while the PDE is two-dimensional, so the remainder of Lemma 3 contains a term with q3q_3q3​ that is controlled only by combining Lemma 2 with the monotonicity of f2∗f^*_2f2∗​.

Formalization scope

  • Model. States are functions ℕ → ℕ with 0-based indices: Lean q.1 i is the paper's qi+1q_{i+1}qi+1​, so the goal's "i≥3i \ge 3i≥3" is Lean index ≥2\ge 2≥2. Each state is bounded by nnn, nonincreasing and eventually zero. The generator genQ is the displayed formula on p. 6.
  • Stationarity. No process is constructed. A stationary distribution is a probability π\piπ on SSS satisfying global balance πGQ=0\pi G_Q = 0πGQ​=0, which characterizes stationarity for this chain with bounded rates. Such a π\piπ exists, since the chain is positive recurrent for λ<1\lambda < 1λ<1 (Bramson 2011), so statements quantifying over it are not vacuous. Expectations are sums against π\piπ. Lemma 1 keeps its integrability hypothesis, and all other expectations are of bounded functions.
  • Parameters. λ=1−β/n\lambda = 1 - \beta/\sqrt nλ=1−β/n​ with 0<β<n0 < \beta < \sqrt n0<β<n​, so that λ>0\lambda > 0λ>0; λ\lambdaλ is free in Lemmas 1–2. Constants are quantified as ∃C\exists C∃C after β\betaβ and before nnn.
  • Misprint. The printed Theorem 2 omits E\mathbb EE. Read as an almost-sure bound it is false, so the expectation version, which the paper proves, is the target.
  • Derivatives. Points of Ω\OmegaΩ are pairs in ℝ × ℝ. Partial derivatives are named functions asserted to be one-sided derivatives along coordinate lines (HasDerivWithinAt on Set.Iic 0 or Set.Ici 0). Weak second derivatives are a.e. derivatives of absolutely continuous functions, in integral form on compact intervals. A "solution" of the PDE whose derivatives are the junk values of a derivative operator is thereby excluded. The PDE needs genuine derivatives, and Lemma 7 is about the explicit f∗f^*f∗ of (4.14), not about an arbitrary function.
  • Fluid objects. ν∗,η∗\nu^*, \eta^*ν∗,η∗ are the components of the unique solution of (4.8). τ\tauτ is valued in WithTop ℝ, with ∞\infty∞ as ⊤, so a missing solution is never read as 000. f∗f^*f∗ is an if cascade, and Lemma 7 states the agreement of its branches. f∗f^*f∗ is defined by the closed form (4.14), not through the fluid model (4.1).
  • Not included. Lemma 9 (via the Lambert W function, which Mathlib lacks), the bootstrapping argument of App. A.4 (not a numbered result), Theorems 1 and 3, and Proposition 1.

Contributions of reusable infrastructure are welcome: the adjoint relation for countable-state chains with bounded rates, and FTC/Taylor lemmas for absolutely continuous first derivatives.

Selected references

  • A. Braverman, Steady-State Analysis of the Join-the-Shortest-Queue Model in the Halfin–Whitt Regime, Math. Oper. Res. 45(3), 2020; arXiv:1801.05121v2. https://arxiv.org/abs/1801.05121
  • P. Eschenfeldt, D. Gamarnik, Join the Shortest Queue with Many Servers. The Heavy Traffic Asymptotics, arXiv preprint, 2015. https://arxiv.org/abs/1502.00999
  • D. Mukherjee, S. C. Borst, J. S. H. van Leeuwaarden, P. A. Whiting, Universality of Load Balancing Schemes on the Diffusion Scale, J. Appl. Probab. 53, 1111–1124, 2016. https://projecteuclid.org/euclid.jap/1481132840
  • M. Bramson, Stability of Join the Shortest Queue Networks, Ann. Appl. Probab. 21, 1568–1625, 2011. https://doi.org/10.1214/10-AAP726
  • S. Halfin, W. Whitt, Heavy-Traffic Limits for Queues with Many Exponential Servers, Oper. Res. 29(3), 1981. https://doi.org/10.1287/opre.29.3.567
17 thms1 active userReviewed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Graphon Mean Field Systems IV: Law of Large Numbers for Particle Systems on Percolated Not-So-Dense Graphs With nβₙ → ∞Research Paper

Motivation

Large networks are often modeled through a graphon, a measurable function that records how likely two labeled vertices are to interact. For interacting diffusions, this lets one ask whether a finite random network has a predictable population limit. Bayraktar, Chakraborty and Wu study that question for graphon weighted systems, including graphs obtained by independently retaining potential edges with a sparsity parameter βn\beta_nβn​. Their not-so-dense regime allows βn\beta_nβn​ to decrease, provided the typical interaction scale nβnn\beta_nnβn​ diverges. Theorem 4.1 is the paper's law of large numbers for this regime; its two conclusions distinguish convergence of the population's empirical law from mean-square closeness of each particle to a coupled graphon limit. Bayraktar, Chakraborty and Wu, 2023.

The authors present three main convergence results: continuity of the continuum graphon system in Section 2, a dense-system law of large numbers in Section 3, and the percolated-system law of large numbers in Section 4. Section 7 establishes the latter. The graphon and cut-metric framework used here follows the graph-limit treatment cited by the paper. Bayraktar, Chakraborty and Wu, 2023; Lovász, 2012.

Setting

Let I=[0,1]I=[0,1]I=[0,1]. A graphon is a symmetric measurable G:I2→[0,1]G:I^2\to[0,1]G:I2→[0,1]. The cut norm ∥W∥□\|W\|_\square∥W∥□​ measures the largest absolute integral of WWW over a measurable rectangle S×US\times US×U. A sequence of step graphons GnG_nGn​ approaches GGG when ∥Gn−G∥□→0\|G_n-G\|_\square\to0∥Gn​−G∥□​→0. The related operator norm ∥W∥∞→1\|W\|_{\infty\to1}∥W∥∞→1​ measures the effect of WWW on bounded measurable functions. Remark 2.1 says cut convergence implies convergence in this operator norm. Bayraktar, Chakraborty and Wu, 2023, Remark 2.1.

Fix a dimension d≥1d\ge1d≥1 and horizon T>0T>0T>0. A label u∈Iu\in Iu∈I has an initial state Xu(0)∈RdX_u(0)\in\mathbb R^dXu​(0)∈Rd and an independent ddd-dimensional Brownian motion BuB_uBu​. The initial states are independent of each other and of the Brownian motions. The limiting graphon particle XuX_uXu​ is a continuous path whose drift averages b(Xu(s),x)G(u,v)b(X_u(s),x)G(u,v)b(Xu​(s),x)G(u,v) against the time-sss laws of all labels vvv, and whose diffusion matrix is σ(Xu(s))\sigma(X_u(s))σ(Xu​(s)). The time-sss law at label vvv is μv,s=L(Xv(s))\mu_{v,s}=\mathcal L(X_v(s))μv,s​=L(Xv​(s)). The family of path laws μu=L(Xu)\mu_u=\mathcal L(X_u)μu​=L(Xu​) is measurable in uuu and has uniformly bounded second moments. Bayraktar, Chakraborty and Wu, 2023, (4.2).

For nnn particles, label iii means i/ni/ni/n, with 1≤i≤n1\le i\le n1≤i≤n. Each undirected edge weight ξijn=ξjin\xi^n_{ij}=\xi^n_{ji}ξijn​=ξjin​ is Bernoulli with mean βnGn(i/n,j/n)\beta_nG_n(i/n,j/n)βn​Gn​(i/n,j/n); diagonal weights are included. These edge variables are independent of the Brownian motions and initial states. The finite particle XinX_i^nXin​ uses the same initial state and Brownian motion as Xi/nX_{i/n}Xi/n​. Its drift is the sum of ξijnb(Xin,Xjn)\xi^n_{ij}b(X_i^n,X_j^n)ξijn​b(Xin​,Xjn​) divided by nβnn\beta_nnβn​; its diffusion is σ(Xin)\sigma(X_i^n)σ(Xin​). The coefficients bbb and σ\sigmaσ are bounded and Lipschitz, and σ(x)\sigma(x)σ(x) is invertible with uniformly bounded inverse. Initial laws have uniformly bounded second moments, 0<βn≤10<\beta_n\le10<βn​≤1, and nβn→∞n\beta_n\to\inftynβn​→∞. Bayraktar, Chakraborty and Wu, 2023, Conditions 4.1–4.2.

Formalization targets

Let Cd=C([0,T];Rd)\mathcal C_d=C([0,T];\mathbb R^d)Cd​=C([0,T];Rd), μn=n−1∑i=1nδXin\mu^n=n^{-1}\sum_{i=1}^{n}\delta_{X_i^n}μn=n−1∑i=1n​δXin​​, and μˉ=∫Iμu du\bar\mu=\int_I\mu_u\,duμˉ​=∫I​μu​du. The main target, Theorem 4.1, first asserts convergence in probability in the weak topology on P(Cd)\mathcal P(\mathcal C_d)P(Cd​):

μn→Pμˉ.\mu^n\xrightarrow{\mathbb P}\bar\mu.μnP​μˉ​.

This uses Condition 2.2(a): on each of finitely many intervals covering III, the initial law varies continuously in Wasserstein distance W2W_2W2​. If the graphon also satisfies Condition 2.2(b), its stated sectional continuity outside null sets, the theorem adds

1n∑i=1nE∥Xin−Xi/n∥∗,T2⟶0,∥x∥∗,T=sup⁡0≤s≤T∣xs∣.\frac1n\sum_{i=1}^{n}\mathbb E\|X_i^n-X_{i/n}\|_{*,T}^2\longrightarrow0, \qquad \|x\|_{*,T}=\sup_{0\le s\le T}|x_s|.n1​i=1∑n​E∥Xin​−Xi/n​∥∗,T2​⟶0,∥x∥∗,T​=0≤s≤Tsup​∣xs​∣.

The milestones record the paper's cut-to-operator observation, uniform coupling moments, the one-edge and two-edge estimates, the bound on the second interaction-error term, the quantitative coupling lemma, and the empirical law of large numbers for the independent limiting particles. The second displayed limit is conditional on 2.2(b); the first is not. Bayraktar, Chakraborty and Wu, 2023, Theorem 4.1.

Significance

The first conclusion identifies the population-level limit even when the sampled network has a decreasing edge-retention probability. It gives a deterministic law on path space, rather than only a limit at one time. The second conclusion is stronger: it compares each finite particle with the limiting particle built from the same initial state and Brownian motion, averaged over all labels. This comparison is available when the extra graphon continuity assumption holds. Bayraktar, Chakraborty and Wu, 2023, Theorem 4.1 and Remark 4.1.

The mathematical results were proved in the published paper. The present mission asks for machine-checked Lean proofs of its specified statements; the draft theorems themselves currently contain sorry. Reusable outputs would include the percolated-edge model, a path-law formulation of graphon diffusions, and estimates for random interactions that depend on the particle states they influence. The paper's proofs appear in Sections 5–7, with the sparse-system argument in Section 7. Bayraktar, Chakraborty and Wu, 2023.

Difficulty

The edge variables are independent of the driving noise, but a particle's state depends on its incident edges. Therefore an expression such as E[ξijn∣Xjn−Xj/n∣2]\mathbb E[\xi^n_{ij}|X_j^n-X_{j/n}|^2]E[ξijn​∣Xjn​−Xj/n​∣2] cannot be factored into the edge mean times the error moment. The same dependence affects pairs of edges in the squared interaction sum. Equations (7.10), (7.14), and (7.15) quantify the discrepancy. A second difficulty is that cut convergence controls integrals against fixed bounded tests, while the dynamics and their path laws supply tests that vary with the system. The paper's regularity conditions and quantitative estimates are needed to connect those forms of control. Bayraktar, Chakraborty and Wu, 2023, Sections 7.1–7.2.

Formalization scope

Lean represents III by Mathlib's unit interval, Rd\mathbb R^dRd by Fin d → ℝ, and continuous paths by maps from [0,T][0,T][0,T] into that vector space. The chosen vector and matrix norms are fixed sup-type norms; finite-dimensional norm equivalence preserves the limit statements and the estimates with existential constants. The horizon and dimension are explicitly positive. Particle index i : Fin n denotes the paper's (i+1)(i+1)(i+1)st particle, and empirical laws use positive sizes n+1n+1n+1 to avoid division by zero. Wasserstein distances use extended nonnegative reals, while nonnegative expectations use lower integrals.

The noise lives on one probability space. The continuum equation uses the natural filtration of its own initial state and Brownian motion. The finite equation uses the natural filtration of its edge array, sampled initial states, and Brownian motions. A solution carries a measurable continuous-path law family in the paper's class M\mathcal MM; this prevents a nonmeasurable pushforward or a default-zero integral from silently satisfying an equation. Edge symmetry, Bernoulli marginals, independence, and diagonal self-loops are explicit. The zero-coefficient system has a separate sorry-free Lean witness for both solution predicates, ruling out a vacuous solution concept.

The formalization uses the published Peng1990.SMP.Stochastic Itô interface and WassersteinDRO.Duality.wassersteinDistance definition. Contributions can prove the listed estimates, strengthen their reusable stochastic and measure-theoretic infrastructure, or connect this mission's local setting to the other graphon missions after their definitions are published. The auxiliary changed-measure particles of Section 7.1 are outside the initial milestone list. Bayraktar, Chakraborty and Wu, 2023, Sections 4 and 7.

Selected references

  • E. Bayraktar, S. Chakraborty and R. Wu, Graphon mean field systems, Annals of Applied Probability 33(5):3587–3619, 2023. DOI.
  • L. Lovász, Large Networks and Graph Limits, American Mathematical Society Colloquium Publications 60, 2012. DOI.
13 thms1 active userReviewed
Control TheoryPartial Differential EquationsProbability·Captain: mikedeng1

Reflected Solutions of Backward SDE's, and Related Obstacle Problems for PDE's 3: Uniqueness for the Parabolic Obstacle ProblemResearch Paper

Motivation

Reflected backward stochastic differential equations describe processes that must remain above a prescribed obstacle. El Karoui, Kapoudjian, Pardoux, Peng and Quenez connect that probabilistic construction to a parabolic partial differential equation with an obstacle in their 1997 paper. A representation by a stochastic process is useful only if the associated differential equation identifies a definite function. The comparison result in Theorem 8.6 supplies that identification: within a specified growth class, two viscosity solutions cannot disagree. This mission isolates that deterministic uniqueness statement. The companion existence and stochastic representation result is Theorem 8.5 of the same paper.

Setting

Fix a terminal time T>0T>0T>0 and a spatial dimension d≥1d\ge1d≥1. At time t∈[0,T]t\in[0,T]t∈[0,T] and point x∈Rdx\in\mathbb R^dx∈Rd, the drift b(t,x)b(t,x)b(t,x) is a vector and the diffusion coefficient σ(t,x)\sigma(t,x)σ(t,x) is a d×dd\times dd×d matrix. Both are continuous and Lipschitz in xxx uniformly over ttt. A continuous terminal payoff g(x)g(x)g(x) has at most polynomial growth. The continuous generator f(t,x,r,z)f(t,x,r,z)f(t,x,r,z) depends on a scalar value rrr and a vector zzz; it has polynomial growth at (r,z)=(0,0)(r,z)=(0,0)(r,z)=(0,0) and is Lipschitz in (r,z)(r,z)(r,z). The continuous obstacle h(t,x)h(t,x)h(t,x) has a polynomial upper bound and satisfies h(T,x)≤g(x)h(T,x)\le g(x)h(T,x)≤g(x).

Write a(t,x)=σ(t,x)σ(t,x)⊤a(t,x)=\sigma(t,x)\sigma(t,x)^\topa(t,x)=σ(t,x)σ(t,x)⊤. The associated second order spatial operator is Ltϕ=12Tr⁡(aD2ϕ)+b⋅DϕL_t\phi=\tfrac12\operatorname{Tr}(aD^2\phi)+b\cdot D\phiLt​ϕ=21​Tr(aD2ϕ)+b⋅Dϕ. The obstacle problem asks for a function whose terminal value is ggg and whose interior value obeys

min⁡{u−h, −∂tu−Ltu−f(t,x,u,Du σ)}=0.\min\{u-h,\,-\partial_tu-L_tu-f(t,x,u,Du\,\sigma)\}=0.min{u−h,−∂t​u−Lt​u−f(t,x,u,Duσ)}=0.

A parabolic superjet or subjet at an interior point is a triple (p,q,X)(p,q,X)(p,q,X) of a time slope, spatial slope and symmetric second order matrix that bounds the function locally above or below by the associated quadratic expansion, up to o(∣s−t∣+∣y−x∣2)o(|s-t|+|y-x|^2)o(∣s−t∣+∣y−x∣2). These jets let a continuous function satisfy the differential inequality without having ordinary derivatives. A viscosity subsolution uses superjets and a terminal upper bound; a viscosity supersolution uses subjets and a terminal lower bound. A viscosity solution satisfies both definitions.

Formalization targets

Uniqueness in the polynomial growth class

The goal is the paper's Theorem 8.6. Under the coefficient assumptions above and condition (27), every pair of continuous viscosity solutions with polynomial growth agrees on the entire closed time strip:

(u,v solve (24) and have polynomial growth)⟹u(t,x)=v(t,x)for every (t,x)∈[0,T]×Rd.\bigl(u,v\text{ solve (24) and have polynomial growth}\bigr) \Longrightarrow u(t,x)=v(t,x)\quad\text{for every }(t,x)\in[0,T]\times\mathbb R^d.(u,v solve (24) and have polynomial growth)⟹u(t,x)=v(t,x)for every (t,x)∈[0,T]×Rd.

Condition (27) gives a continuous modulus mRm_RmR​ for the change in fff between bounded spatial points, with argument ∣x−y∣(1+∣z∣)|x-y|(1+|z|)∣x−y∣(1+∣z∣) and mR(0)=0m_R(0)=0mR​(0)=0. The quantifiers include every radius R>0R>0R>0, every bounded scalar argument, and every gradient vector zzz. The milestone is Lemma 8.7, which controls the location and separation of the maximizers of the paper's doubled-variable function Φα(t,x,y)=u(t,x)−v(t,y)−α∣x−y∣2/2\Phi_\alpha(t,x,y)=u(t,x)-v(t,y)-\alpha|x-y|^2/2Φα​(t,x,y)=u(t,x)−v(t,y)−α∣x−y∣2/2.

Significance

The theorem shows that the obstacle PDE has at most one solution in the natural class allowed by polynomially growing coefficients and payoffs. Together with Theorem 8.5, which identifies the reflected backward SDE value as a viscosity solution, and the growth estimate at the end of Section 8, it yields the paper's probabilistic representation of the unique solution. Theorem 8.6 alone asserts uniqueness, so it makes no existence claim.

The formal development provides reusable interfaces for parabolic jets, viscosity inequalities, the obstacle operator and uniform polynomial growth on a finite time strip. Those interfaces can serve other comparison theorems and other parabolic obstacle problems. The mathematical result is proved in the 1997 article; this mission asks for a Lean proof of its deterministic uniqueness statement. The proposal declares the theorem with a proof placeholder and includes the comparison lemma as an intermediate target.

Difficulty

The first obstruction is that the candidate solutions need only be continuous. Subtracting their PDE expressions directly would assume derivatives they may not possess. The paper instead uses viscosity jets, and its comparison argument invokes the theorem of sums from Crandall, Ishii and Lions' viscosity-solutions guide. The generator's spatial modulus must control a gradient argument that grows as the two spatial points approach each other. Lemma 8.7 provides the necessary separation limit for the maximizers. The argument also treats a polynomial growth class on all of Rd\mathbb R^dRd, so a comparison confined to one fixed bounded ball would not establish the stated result.

Formalization scope

Lean uses nonnegative real time and functions on Rd\mathbb R^dRd represented by Fin d → ℝ. The terminal time and dimension are positive. Bounds with existential constants use the finite-dimensional sup norm, which is equivalent to the Euclidean norm in the paper. The displayed quadratic form, Tr⁡(aX)\operatorname{Tr}(aX)Tr(aX) and qσq\sigmaqσ are written by coordinate sums, so their signs, factor 12\tfrac1221​, and matrix order are exact. The obstacle is bounded only above in the data assumptions, exactly as condition (22) states. Condition (27) is imposed only on uniqueness, not folded into the definition of viscosity solution.

Jets are taken at 0<t<T0<t<T0<t<T through a one-sided little-ooo bound in the relative neighborhood of the interior strip. The terminal equality comes from the two terminal inequalities; the viscosity tests impose no separate condition at t=0t=0t=0. The printed text calls S(d)S(d)S(d) “symmetric nonnegative matrices,” but the proof of Theorem 8.6 uses arbitrary symmetric matrices produced by the theorem of sums. The formal definition therefore uses all symmetric matrices and records this correction for review.

The mission permits every continuous solution of polynomial growth. It does not restrict candidates to smooth, bounded or stochastic-representation functions. The companion reflected SDE construction, penalization limit and existence theorem are outside this mission's goal; the general stochastic interface Peng1990.SMP.Stochastic is listed as series context but is not imported by the deterministic statements. Useful contributions include the comparison proof, the lemma on doubled-variable maximizers, and reusable lemmas about jet transformations and the matrix trace inequality.

Selected references

  • N. El Karoui, C. Kapoudjian, É. Pardoux, S. Peng and M.-C. Quenez, Reflected solutions of backward SDE's, and related obstacle problems for PDE's, The Annals of Probability 25(2), 1997, pp. 702–737. DOI.
  • M. G. Crandall, H. Ishii and P.-L. Lions, User's guide to viscosity solutions of second order partial differential equations, Bulletin of the American Mathematical Society 27(1), 1992, pp. 1–67. DOI.
14 thms1 active userReviewed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Graphon Mean Field Systems II: The Empirical Measure of the Dense Graphon-Weighted Particle System Converges in Probability to the Averaged Graphon LawResearch Paper

Interacting diffusions on large weighted graphs

Classical mean field theory describes nnn exchangeable diffusions, each interacting with the empirical average of all the others. As n→∞n\to\inftyn→∞ the particles become independent copies of a McKean–Vlasov process (propagation of chaos). Many systems of interest are not exchangeable. Particles sit at the vertices of a network and interact only with their neighbours, as in models of opinion dynamics, epidemics on contact networks, synchronisation of oscillators and systemic risk in financial networks. When the network is dense and its adjacency structure converges, the natural limit object is a graphon, a symmetric measurable function G:[0,1]2→[0,1]G:[0,1]^2\to[0,1]G:[0,1]2→[0,1] that encodes the limiting edge density between "positions" u,v∈[0,1]u,v\in[0,1]u,v∈[0,1] (Lovász, Large Networks and Graph Limits, 2012).

Bayraktar, Chakraborty and Wu (Ann. Appl. Probab. 33(5), 2023) develop a law of large numbers for such systems. This mission formalizes their second main result, Theorem 3.1. Under cut-metric convergence of the interaction kernels, the empirical measure of the nnn-particle system converges in probability to the averaged law of a continuum graphon particle system. Related work includes Bhamidi, Budhiraja and Wu (Stochastic Process. Appl., 2019) on weakly interacting particles on inhomogeneous random graphs, Coppini, Dietert and Giacomin (Stoch. Dyn., 2020) on Erdős–Rényi graphs, and Bet, Coppini and Nardi (arXiv:2006.07670) on oscillators on dense random graphs.

Setting

Write I=[0,1]I=[0,1]I=[0,1] with Lebesgue measure and fix a horizon T>0T>0T>0. Let Cd=C([0,T]:Rd)\mathcal C_d=C([0,T]:\mathbb R^d)Cd​=C([0,T]:Rd) with the uniform norm ∥x∥∗,T=sup⁡s≤T∣xs∣\|x\|_{*,T}=\sup_{s\le T}|x_s|∥x∥∗,T​=sups≤T​∣xs​∣. On one probability space take independent initial states Xu(0)X_u(0)Xu​(0) with laws μu(0)\mu_u(0)μu​(0) and independent ddd-dimensional Brownian motions BuB_uBu​, for all u∈Iu\in Iu∈I. The graphon particle system (2.1) for a graphon GGG and Lipschitz coefficients b,σb,\sigmab,σ is the continuum of nonlinear diffusions

Xu(t)=Xu(0)+∫0t ⁣ ⁣∫I ⁣∫Rdb(Xu(s),x)G(u,v) μv,s(dx) dv ds+∫0t ⁣ ⁣∫I ⁣∫Rdσ(Xu(s),x)G(u,v) μv,s(dx) dv dBu(s),X_u(t)=X_u(0)+\int_0^t\!\!\int_I\!\int_{\mathbb R^d}b(X_u(s),x)G(u,v)\,\mu_{v,s}(dx)\,dv\,ds+\int_0^t\!\!\int_I\!\int_{\mathbb R^d}\sigma(X_u(s),x)G(u,v)\,\mu_{v,s}(dx)\,dv\,dB_u(s),Xu​(t)=Xu​(0)+∫0t​∫I​∫Rd​b(Xu​(s),x)G(u,v)μv,s​(dx)dvds+∫0t​∫I​∫Rd​σ(Xu​(s),x)G(u,v)μv,s​(dx)dvdBu​(s),

where μv,s\mu_{v,s}μv,s​ is the law of Xv(s)X_v(s)Xv​(s). Write μu∈P(Cd)\mu_u\in\mathcal P(\mathcal C_d)μu​∈P(Cd​) for the path law of XuX_uXu​ and μˉ=∫Iμu du\bar\mu=\int_I\mu_u\,duμˉ​=∫I​μu​du for the averaged law.

The nnn-particle system (3.1) places particle iii at label i/ni/ni/n, starts it at Xi/n(0)X_{i/n}(0)Xi/n​(0), drives it by Bi/nB_{i/n}Bi/n​, and weights its interaction with particle jjj by ξijn\xi^n_{ij}ξijn​:

Xin(t)=Xi/n(0)+∫0t1n∑j=1nξijn b(Xin(s),Xjn(s)) ds+∫0t1n∑j=1nξijn σ(Xin(s),Xjn(s)) dBi/n(s).X^n_i(t)=X_{i/n}(0)+\int_0^t\frac1n\sum_{j=1}^n\xi^n_{ij}\,b(X^n_i(s),X^n_j(s))\,ds+\int_0^t\frac1n\sum_{j=1}^n\xi^n_{ij}\,\sigma(X^n_i(s),X^n_j(s))\,dB_{i/n}(s).Xin​(t)=Xi/n​(0)+∫0t​n1​j=1∑n​ξijn​b(Xin​(s),Xjn​(s))ds+∫0t​n1​j=1∑n​ξijn​σ(Xin​(s),Xjn​(s))dBi/n​(s).

The weights come from a step graphon GnG_nGn​, constant on the squares of the nnn-grid. Either ξijn=Gn(i/n,j/n)\xi^n_{ij}=G_n(i/n,j/n)ξijn​=Gn​(i/n,j/n), or ξijn=ξjin\xi^n_{ij}=\xi^n_{ji}ξijn​=ξjin​ are independent Bernoulli(Gn(i/n,j/n))(G_n(i/n,j/n))(Gn​(i/n,j/n)) variables for i≤ji\le ji≤j, independent of the noise (Condition 3.1). The kernels converge in the cut norm ∥W∥□=sup⁡S,T∣∫S×TW∣\|W\|_\square=\sup_{S,T}\big|\int_{S\times T}W\big|∥W∥□​=supS,T​​∫S×T​W​. Two further norms appear: the operator norm ∥W∥=sup⁡∥g∥∞≤1∫I∣∫IW(u,v)g(v) dv∣ du\|W\|=\sup_{\|g\|_\infty\le1}\int_I|\int_I W(u,v)g(v)\,dv|\,du∥W∥=sup∥g∥∞​≤1​∫I​∣∫I​W(u,v)g(v)dv∣du, and the Wasserstein-2 distance W2,TW_{2,T}W2,T​ on P(Cd)\mathcal P(\mathcal C_d)P(Cd​).

Formalization targets

Goal: Theorem 3.1

Assume the initial laws are measurable in uuu with a uniform (2+ε)(2+\varepsilon)(2+ε)-moment and b,σb,\sigmab,σ are Lipschitz (Condition 2.1). Assume u↦μu(0)u\mapsto\mu_u(0)u↦μu​(0) is W2W_2W2​-continuous on each interval of a finite cover of III (Condition 2.2(a)), and that Condition 3.1 holds with Gn→GG_n\to GGn​→G in the cut metric. Then

μn:=1n∑i=1nδXin⟶μˉin P(Cd) in probability.\mu^n:=\frac1n\sum_{i=1}^n\delta_{X^n_i}\longrightarrow\bar\mu\quad\text{in }\mathcal P(\mathcal C_d)\text{ in probability}.μn:=n1​i=1∑n​δXin​​⟶μˉ​in P(Cd​) in probability.

If, in addition, GGG is continuous at (u,v)(u,v)(u,v) for a.e. vvv at each interior point uuu of the cover (Condition 2.2(b)), then

1n∑i=1nE∥Xin−Xi/n∥∗,T2⟶0.\frac1n\sum_{i=1}^n\mathbb E\|X^n_i-X_{i/n}\|^2_{*,T}\longrightarrow0 .n1​i=1∑n​E∥Xin​−Xi/n​∥∗,T2​⟶0.

Milestones

In order: Remark 2.1, where cut-norm convergence implies operator-norm convergence; Theorem 2.1(a), continuity of u↦μuu\mapsto\mu_uu↦μu​ in W2,TW_{2,T}W2,T​; the weak-LLN bound (6.4); the discretization bound (6.11); Lemma 6.1,

lim sup⁡n1n∑iE∥Xin−Xi/n∥∗,T2≤κ(M)lim sup⁡n∥Gn−G∥+κM−ε;\limsup_{n}\frac1n\sum_i\mathbb E\|X^n_i-X_{i/n}\|^2_{*,T}\le\kappa(M)\limsup_n\|G_n-G\|+\kappa M^{-\varepsilon};nlimsup​n1​i∑​E∥Xin​−Xi/n​∥∗,T2​≤κ(M)nlimsup​∥Gn​−G∥+κM−ε;

Lemma 6.2, a law of large numbers for the continuum particles X1/n,…,Xn/nX_{1/n},\dots,X_{n/n}X1/n​,…,Xn/n​; the approximation of GGG by continuous graphons; the continuity (6.12) of μˉ\bar\muμˉ​ in the graphon, in a corrected qualitative form; the empirical coupling bound for W2,TW_{2,T}W2,T​; and (6.14).

Significance

Theorem 3.1 shows that the averaged graphon law μˉ\bar\muμˉ​ is the correct macroscopic description of a dense heterogeneous particle system. This holds for deterministic weights and for Erdős–Rényi-type random weights, and the graphon may be discontinuous. It is the foundation for graphon mean field games and for control of large networked systems, where μˉ\bar\muμˉ​ replaces the intractable nnn-particle law. Under the regularity Condition 2.2(b) the convergence holds in L2L^2L2, particle by particle, along the natural coupling.

The result is proved in the paper (§6.1–§6.2). Nothing in it is formalized. A formal proof would produce reusable infrastructure: graphons, the cut and operator norms, Lusin approximation of graphons, Wasserstein distances between empirical measures, and laws of large numbers for random probability measures on path space. It also needs pathwise stability estimates for SDE systems built on Itô integrals, which goes well beyond what Mathlib has today.

Difficulty

The particles are neither exchangeable nor identically distributed. The classical propagation-of-chaos argument compares each particle with an i.i.d. copy of one McKean–Vlasov process, and it does not apply here. Each XinX^n_iXin​ must be compared with its own limit Xi/nX_{i/n}Xi/n​, and the error has two sources: the random or discretized weights ξijn\xi^n_{ij}ξijn​, and the replacement of GGG by GnG_nGn​. Cut-metric convergence controls Gn−GG_n-GGn​−G only through integrals against bounded test functions. The interaction term, however, integrates the unbounded function b(Xi/n(s),⋅)b(X_{i/n}(s),\cdot)b(Xi/n​(s),⋅) against varying laws μj/n,s\mu_{j/n,s}μj/n,s​. When GGG is merely measurable, the map u↦μuu\mapsto\mu_uu↦μu​ need not be continuous, and the error of replacing ∫I⋅ dv\int_I\cdot\,dv∫I​⋅dv by the average over the labels j/nj/nj/n need not vanish. The direct estimate therefore fails for (3.3) without Condition 2.2(b), and this is the case the goal must cover.

Formalization scope

The setting file GraphonMF.DenseLLN.Setting fixes these conventions:

  • Rd\mathbb R^dRd is Fin d → ℝ with the sup norm. All statements are invariant under this choice: constants are existential and the other conclusions are limits.
  • Processes are path-valued maps Ω→Cd\Omega\to\mathcal C_dΩ→Cd​, and Cd\mathcal C_dCd​ carries its Borel σ-algebra.
  • Each SDE is encoded through the published Itô-process predicate Peng1990.SMP.IsItoProcess. The filtrations are the uncompleted natural filtrations σ(Xu(0),Bu(r):r≤t)\sigma(X_u(0),B_u(r):r\le t)σ(Xu​(0),Bu​(r):r≤t) and σ(ξn,Xj/n(0),Bj/n(r):j≤n,r≤t)\sigma(\xi^n,X_{j/n}(0),B_{j/n}(r):j\le n,r\le t)σ(ξn,Xj/n​(0),Bj/n​(r):j≤n,r≤t).
  • A solution of (2.1) carries the membership of its law family in the class M\mathcal MM (measurable in uuu, uniformly bounded second moments), which makes every Bochner integral of the drift meaningful.
  • W2W_2W2​ and W2,TW_{2,T}W2,T​ are the published WassersteinDRO.Duality.wassersteinDistance with values in [0,∞][0,\infty][0,∞].
  • Expectations of nonnegative quantities are lower Lebesgue integrals.
  • Convergence in probability is topological: P(μn∉U)→0\mathbb P(\mu^n\notin U)\to0P(μn∈/U)→0 for every weak-topology neighbourhood UUU of μˉ\bar\muμˉ​.
  • The nnn-particle system shares the noise of the graphon system: particle iii (Lean index iii, label (i+1)/n(i+1)/n(i+1)/n) uses X(i+1)/n(0)X_{(i+1)/n}(0)X(i+1)/n​(0) and B(i+1)/nB_{(i+1)/n}B(i+1)/n​.
  • Each ξn\xi^nξn is assumed measurable.

Two encodings would trivialize the targets, and both are ruled out. A pointwise or almost-sure reading of (3.3), or convergence of ∫f dμn\int f\,d\mu^n∫fdμn for a single test function, is not the claim. Choosing the constants of Lemma 6.1 and (6.11) after the sequence (Gn)(G_n)(Gn​) would make them nearly empty, so they are chosen before it. A sorry-free check confirms that the solution predicates are satisfiable: with b=σ=0b=\sigma=0b=σ=0 the constant paths solve both systems.

Solvers will need several pieces of library work: the inequality ∥W∥∞→1≤4∥W∥□\|W\|_{\infty\to1}\le4\|W\|_\square∥W∥∞→1​≤4∥W∥□​, BDG-type moment bounds for the Itô integrals of Peng's library, Gronwall estimates, Lusin's theorem on [0,1]2[0,1]^2[0,1]2, and the metrization of weak convergence on P(Cd)\mathcal P(\mathcal C_d)P(Cd​) (Lévy–Prokhorov). Contributions to any of these are welcome independently of the goal. The paper's proofs are in its §5 (Theorem 2.1) and §6.1–§6.2 (Lemmas 6.1, 6.2 and Theorem 3.1).

Selected references

  • E. Bayraktar, S. Chakraborty, R. Wu, Graphon mean field systems, Ann. Appl. Probab. 33(5):3587–3619, 2023. https://doi.org/10.1214/22-AAP1901
  • L. Lovász, Large Networks and Graph Limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060
  • S. Bhamidi, A. Budhiraja, R. Wu, Weakly interacting particle systems on inhomogeneous random graphs, Stochastic Process. Appl. 129:2174–2206, 2019. https://doi.org/10.1016/j.spa.2018.06.014
  • F. Coppini, H. Dietert, G. Giacomin, A law of large numbers and large deviations for interacting diffusions on Erdős–Rényi graphs, Stoch. Dyn. 20:2050010, 2020. https://doi.org/10.1142/S0219493720500100
  • G. Bet, F. Coppini, F. R. Nardi, Weakly interacting oscillators on dense random graphs, arXiv preprint, 2020. https://arxiv.org/abs/2006.07670
  • A.-S. Sznitman, Topics in propagation of chaos, École d'Été de Probabilités de Saint-Flour XIX, LNM 1464, 1991. https://doi.org/10.1007/BFb0085169
15 thms1 active userReviewed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Graphon Mean Field Systems III: With Edge Weights Sampled From a Lipschitz Graphon, Each Particle Is Within κ/n of Its Graphon Limit in Mean SquareResearch Paper

Interacting diffusions on large heterogeneous networks

Classical mean-field theory describes nnn diffusions that interact symmetrically, each feeling the empirical average of all the others, and shows that as n→∞n\to\inftyn→∞ every particle behaves like an independent copy of a single McKean–Vlasov process. Many systems of interest are not symmetric: neurons, agents in a financial network, or oscillators interact through a graph, and particles in different parts of the graph feel different neighbourhoods. A graphon G:[0,1]2→[0,1]G:[0,1]^2\to[0,1]G:[0,1]2→[0,1] is the limit object of dense graph sequences (Lovász, Large Networks and Graph Limits, AMS 2012), and it is the natural way to describe the interaction structure of such systems in the limit.

Bayraktar, Chakraborty and Wu (Ann. Appl. Probab. 33(5), 2023) study a continuum of diffusions indexed by labels u∈[0,1]u\in[0,1]u∈[0,1] whose interaction is weighted by a graphon, and prove laws of large numbers and rates of convergence for nnn-particle systems on graphs sampled from the graphon. This mission targets their uniform rate of convergence for weights sampled from a Lipschitz graphon (Theorem 3.2).

Setting

Write I=[0,1]I=[0,1]I=[0,1] with Lebesgue measure. Fix a horizon T∈(0,∞)T\in(0,\infty)T∈(0,∞) and let Cd=C([0,T]:Rd)\mathcal C_d=C([0,T]:\mathbb R^d)Cd​=C([0,T]:Rd) with ∥x∥∗,t=sup⁡0≤s≤t∣xs∣\|x\|_{*,t}=\sup_{0\le s\le t}|x_s|∥x∥∗,t​=sup0≤s≤t​∣xs​∣.

On one probability space, {Bu:u∈I}\{B_u:u\in I\}{Bu​:u∈I} are i.i.d. ddd-dimensional Brownian motions and {Xu(0):u∈I}\{X_u(0):u\in I\}{Xu​(0):u∈I} are independent initial states with laws μu(0)\mu_u(0)μu​(0), independent of the Brownian motions. Given a graphon GGG and coefficients b,σb,\sigmab,σ, the graphon particle system (2.1) is

Xu(t)=Xu(0)+∫0t ⁣ ⁣∫I ⁣∫Rdb(Xu(s),x)G(u,v) μv,s(dx) dv ds+∫0t ⁣ ⁣∫I ⁣∫Rdσ(Xu(s),x)G(u,v) μv,s(dx) dv dBu(s),X_u(t)=X_u(0)+\int_0^t\!\!\int_I\!\int_{\mathbb R^d}b(X_u(s),x)G(u,v)\,\mu_{v,s}(dx)\,dv\,ds+\int_0^t\!\!\int_I\!\int_{\mathbb R^d}\sigma(X_u(s),x)G(u,v)\,\mu_{v,s}(dx)\,dv\,dB_u(s),Xu​(t)=Xu​(0)+∫0t​∫I​∫Rd​b(Xu​(s),x)G(u,v)μv,s​(dx)dvds+∫0t​∫I​∫Rd​σ(Xu​(s),x)G(u,v)μv,s​(dx)dvdBu​(s),

with μu,t=L(Xu(t))\mu_{u,t}=\mathcal L(X_u(t))μu,t​=L(Xu​(t)). The particles are independent but not identically distributed, and their laws are coupled through the dvdvdv-integral.

The nnn-particle system (3.1) uses the same randomness at the labels i/ni/ni/n:

Xin(t)=Xi/n(0)+∫0t1n∑j=1nξijn b(Xin(s),Xjn(s)) ds+∫0t1n∑j=1nξijn σ(Xin(s),Xjn(s)) dBi/n(s),X^n_i(t)=X_{i/n}(0)+\int_0^t\frac1n\sum_{j=1}^n\xi^n_{ij}\,b(X^n_i(s),X^n_j(s))\,ds+\int_0^t\frac1n\sum_{j=1}^n\xi^n_{ij}\,\sigma(X^n_i(s),X^n_j(s))\,dB_{i/n}(s),Xin​(t)=Xi/n​(0)+∫0t​n1​j=1∑n​ξijn​b(Xin​(s),Xjn​(s))ds+∫0t​n1​j=1∑n​ξijn​σ(Xin​(s),Xjn​(s))dBi/n​(s),

so particle iii and the continuum particle at u=i/nu=i/nu=i/n share their initial state and Brownian motion.

The hypotheses are:

  • Condition 2.1: u↦μu(0)u\mapsto\mu_u(0)u↦μu​(0) is measurable, sup⁡uE∣Xu(0)∣2+ε<∞\sup_u\mathbb E|X_u(0)|^{2+\varepsilon}<\inftysupu​E∣Xu​(0)∣2+ε<∞ for some ε>0\varepsilon>0ε>0, and bbb, σ\sigmaσ are Lipschitz in both arguments.
  • Condition 2.3: there are finitely many intervals I1,…,INI_1,\dots,I_NI1​,…,IN​ covering III and a κ>0\kappa>0κ>0 with W2(μu1(0),μu2(0))≤κ∣u1−u2∣W_2(\mu_{u_1}(0),\mu_{u_2}(0))\le\kappa|u_1-u_2|W2​(μu1​​(0),μu2​​(0))≤κ∣u1​−u2​∣ on each IiI_iIi​ and ∣G(u1,v1)−G(u2,v2)∣≤κ(∣u1−u2∣+∣v1−v2∣)|G(u_1,v_1)-G(u_2,v_2)|\le\kappa(|u_1-u_2|+|v_1-v_2|)∣G(u1​,v1​)−G(u2​,v2​)∣≤κ(∣u1​−u2​∣+∣v1​−v2​∣) on each block Ii×IjI_i\times I_jIi​×Ij​. The graphon may jump across block boundaries.
  • Condition 3.2: the weights are sampled from GGG itself, either deterministically, ξijn=G(i/n,j/n)\xi^n_{ij}=G(i/n,j/n)ξijn​=G(i/n,j/n), or as a random graph, ξijn=ξjin∼Bernoulli(G(i/n,j/n))\xi^n_{ij}=\xi^n_{ji}\sim\mathrm{Bernoulli}(G(i/n,j/n))ξijn​=ξjin​∼Bernoulli(G(i/n,j/n)) independently for i≤ji\le ji≤j and independently of the noise.

Formalization targets

Goal: Theorem 3.2 (p. 3596)

Under Conditions 2.1, 2.3 and 3.2 there is κ∈(0,∞)\kappa\in(0,\infty)κ∈(0,∞) such that

max⁡i=1,…,nE∥Xin−Xi/n∥∗,T2≤κn∀n∈N.\max_{i=1,\dots,n}\mathbb E\|X^n_i-X_{i/n}\|^2_{*,T}\le\frac{\kappa}{n}\qquad\forall n\in\mathbb N.i=1,…,nmax​E∥Xin​−Xi/n​∥∗,T2​≤nκ​∀n∈N.

Milestones (§6.3, in attack order)

  • (6.15): E∥Xin−Xi/n∥∗,t2\mathbb E\|X^n_i-X_{i/n}\|^2_{*,t}E∥Xin​−Xi/n​∥∗,t2​ is bounded by κ\kappaκ times the time-integrated mean-square mismatch between the finite-nnn drift and diffusion and their graphon counterparts.
  • The drift mismatch is split by (6.16) into three terms T~sn,1,T~sn,2,T~sn,3\tilde T^{n,1}_s,\tilde T^{n,2}_s,\tilde T^{n,3}_sT~sn,1​,T~sn,2​,T~sn,3​, bounded by
T~sn,1≤2κmax⁡iE∣Xin(s)−Xi/n(s)∣2  (6.17),T~sn,2≤κn  (6.18),T~sn,3≤κn2  (6.19).\tilde T^{n,1}_s\le2\kappa\max_i\mathbb E|X^n_i(s)-X_{i/n}(s)|^2\ \ (6.17),\qquad\tilde T^{n,2}_s\le\frac{\kappa}{n}\ \ (6.18),\qquad\tilde T^{n,3}_s\le\frac{\kappa}{n^2}\ \ (6.19).T~sn,1​≤2κimax​E∣Xin​(s)−Xi/n​(s)∣2  (6.17),T~sn,2​≤nκ​  (6.18),T~sn,3​≤n2κ​  (6.19).
  • Theorem 2.1(b) (p. 3593): under Condition 2.3, W2,T(μu,μv)≤κ∣u−v∣W_{2,T}(\mu_u,\mu_v)\le\kappa|u-v|W2,T​(μu​,μv​)≤κ∣u−v∣ whenever u,vu,vu,v lie in the same interval IiI_iIi​. It is used in (6.19).

Significance

The result. Theorem 3.2 gives a quantitative propagation of chaos for heterogeneous interactions: with weights sampled from a blockwise Lipschitz graphon, every particle of the finite system, not just an average particle, is within O(n−1/2)O(n^{-1/2})O(n−1/2) in root-mean-square path distance of the continuum particle with the same label. The rate matches the classical mean-field rate (e.g. Sznitman 1991), so heterogeneity of the interaction costs nothing in the exponent. The same estimate covers the deterministic weighted graph and the random graph sampled from GGG (in the annealed sense), and it is the dense counterpart of Theorem 4.2 for percolated graphs.

Formalizing it. The result is proved in the paper (§6.3); it has no machine-checked proof. A formal development would produce a reusable account of graphon particle systems and their finite-nnn approximations: graphon-weighted McKean–Vlasov drifts, couplings through shared noise, and the decomposition of the interaction error into a Lipschitz feedback term, a law-of-large-numbers term and a Riemann-sum discretization term.

Difficulty

The obvious approach is to compare XinX^n_iXin​ with Xi/nX_{i/n}Xi/n​ directly and close a Gronwall inequality. The difficulty is that the comparison involves the empirical, graph-weighted average of the other particles, which is neither the graphon average nor an average of independent terms. Three different errors must be controlled simultaneously and uniformly in iii: the feedback of all particles' errors into particle iii, the fluctuation of a sum of independent but non-identically distributed terms whose weights may themselves be random, and the error of replacing an integral over labels by a sum over the grid {j/n}\{j/n\}{j/n}. The last needs regularity of the law μu\mu_uμu​ in the label uuu, which is itself a theorem about the graphon system (Theorem 2.1(b)) and fails at block boundaries of GGG, where only the small number of boundary cells saves the 1/n21/n^21/n2 rate. Averaging over iii, as in the law of large numbers of Theorem 3.1, is not enough: the goal bounds the maximum.

Formalization scope

  • Rd\mathbb R^dRd is Fin d → ℝ with the sup norm; matrices are measured entrywise. All statements are norm-invariant because every constant is existential. Particle i∈{1,…,n}i\in\{1,\dots,n\}i∈{1,…,n} is Lean's i : Fin n with label (i+1)/n(i+1)/n(i+1)/n; time is ℝ≥0; III is Mathlib's unitInterval.
  • Brownian motions, Itô integrals and Itô processes are the published Peng1990.SMP.Stochastic definitions; an SDE with random initial value X(0)X(0)X(0) is stated as an Itô process for X−X(0)X-X(0)X−X(0). Each continuum particle uses the natural filtration of (Xu(0),Bu)(X_u(0),B_u)(Xu​(0),Bu​); the nnn-particle system uses the natural filtration of the weights, initial states and Brownian motions at the labels.
  • W2W_2W2​ and W2,TW_{2,T}W2,T​ are the published WassersteinDRO.Duality.wassersteinDistance 2, valued in [0,∞][0,\infty][0,∞]; expectations of nonnegative quantities are lower Lebesgue integrals.
  • A solution of (2.1) is required to have continuous paths, measurable path maps, and a law family in the class M\mathcal MM (measurable in uuu, uniformly bounded second moments), as Proposition 2.1 asserts; this makes every inner integral meaningful.
  • The constant κ\kappaκ is chosen after the data and before nnn and iii. A κ\kappaκ chosen after nnn, a bound on the average over iii, or a solution predicate that no process satisfies would trivialize the goal; the first two are excluded by the statement, and a sanity check exhibits the zero-coefficient system as a solution of both systems.
  • Condition 2.2 is not assumed, and the weights come from GGG, not from a step graphon GnG_nGn​; no cut-metric hypothesis appears.
  • Needed infrastructure: Doob/Burkholder–Davis–Gundy for Itô integrals, Gronwall's inequality in integrated form, moment bounds for the graphon system, Kantorovich–Rubinstein-type duality for Lipschitz test functions, and independence of functionals of independent noises. Proofs of the milestones, of Theorem 2.1(b), and of the goal are all welcome; the paper's proofs are in its §5–§6.

Selected references

  • E. Bayraktar, S. Chakraborty, R. Wu, Graphon mean field systems, Ann. Appl. Probab. 33(5):3587–3619, 2023. https://doi.org/10.1214/22-AAP1901
  • L. Lovász, Large Networks and Graph Limits, AMS Colloquium Publications 60, 2012. https://doi.org/10.1090/coll/060
  • A.-S. Sznitman, Topics in propagation of chaos, École d'Été de Probabilités de Saint-Flour XIX, LNM 1464, Springer, 1991. https://doi.org/10.1007/BFb0085169
  • S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4):966–979, 1990. https://doi.org/10.1137/0328054
10 thms1 active userReviewed
Dynamic ProgrammingMarkov ChainOperations Research+1·Captain: mikedeng1

More Risk-Sensitive Markov Decision Processes 5: Under Positive Harris Recurrence a Risk-Neutral Optimal Stationary Policy Is Optimal for Power-Utility Average CostResearch Paper

Motivation

Classical Markov decision theory minimizes expected cost. A decision maker who dislikes variability, such as an insurer, a portfolio manager or an operator of a service system, may instead evaluate a random cost YYY by its certainty equivalent U−1(E[U(Y)])U^{-1}(\mathbb E[U(Y)])U−1(E[U(Y)]) for an increasing utility (disutility) function UUU. Bäuerle and Rieder (More Risk-Sensitive Markov Decision Processes, Math. Oper. Res. 39(1), 2014; authors' manuscript at KIT 1000039663) develop dynamic programming for this criterion with general UUU. Classical risk-sensitive MDPs, studied since Howard and Matheson (1972), use the exponential utility, and for it the average cost problem differs considerably from the risk-neutral one (Cavazos-Cadena and Fernández-Gaucherand 2000; Di Masi and Stettner 1999). Their §5 asks what happens in the long run. The average cost per stage is evaluated through a power utility U(y)=yγU(y)=y^\gammaU(y)=yγ. Does risk sensitivity change which stationary policy is optimal?

This mission formalizes their answer, Theorem 5.2, and the results its proof uses (manuscript p. 17).

Setting

A controlled Markov process in discrete time has a standard Borel state space EEE and action space AAA. A measurable set D⊆E×AD\subseteq E\times AD⊆E×A lists the admissible state–action pairs, and every D(x)={a:(x,a)∈D}D(x)=\{a:(x,a)\in D\}D(x)={a:(x,a)∈D} is nonempty. A transition law Q(⋅∣x,a)Q(\cdot\mid x,a)Q(⋅∣x,a) gives the distribution of the next state, and a measurable cost ccc satisfies 0<c‾≤c≤cˉ0<\underline c\le c\le\bar c0<c​≤c≤cˉ on DDD.

A history-dependent policy σ=(gn)n≥0\sigma=(g_n)_{n\ge0}σ=(gn​)n≥0​ chooses the action An=gn(X0,A0,…,Xn)∈D(Xn)A_n=g_n(X_0,A_0,\dots,X_n)\in D(X_n)An​=gn​(X0​,A0​,…,Xn​)∈D(Xn​) measurably from the past. The set of all such policies is Π\PiΠ. Each σ\sigmaσ and initial state xxx determine a probability measure Pxσ\mathbb P^\sigma_xPxσ​ on trajectories, with X0=xX_0=xX0​=x and Xn+1∼Q(⋅∣Xn,An)X_{n+1}\sim Q(\cdot\mid X_n,A_n)Xn+1​∼Q(⋅∣Xn​,An​). The accumulated cost is Cn=∑k=0n−1c(Xk,Ak)C^n=\sum_{k=0}^{n-1}c(X_k,A_k)Cn=∑k=0n−1​c(Xk​,Ak​).

A stationary policy π=(f,f,… )\pi=(f,f,\dots)π=(f,f,…) uses a measurable decision rule fff with f(x)∈D(x)f(x)\in D(x)f(x)∈D(x) at every stage. Under it, (Xn)(X_n)(Xn​) is the Markov chain with kernel Pf(x,⋅)=Q(⋅∣x,f(x))P_f(x,\cdot)=Q(\cdot\mid x,f(x))Pf​(x,⋅)=Q(⋅∣x,f(x)).

Fix γ>0\gamma>0γ>0 and U(y)=yγU(y)=y^\gammaU(y)=yγ. The risk-sensitive average cost (5.1) and its optimal value are

Jσ(x)=lim sup⁡n→∞1n U−1(Exσ[U(Cn)]),J(x)=inf⁡σ∈ΠJσ(x).J_\sigma(x)=\limsup_{n\to\infty}\frac1n\,U^{-1}\Big(\mathbb E^\sigma_x\big[U(C^n)\big]\Big),\qquad J(x)=\inf_{\sigma\in\Pi}J_\sigma(x).Jσ​(x)=n→∞limsup​n1​U−1(Exσ​[U(Cn)]),J(x)=σ∈Πinf​Jσ​(x).

The risk-neutral average cost is ρσ(x)=lim sup⁡n1nExσ[Cn]\rho_\sigma(x)=\limsup_n\frac1n\mathbb E^\sigma_x[C^n]ρσ​(x)=limsupn​n1​Exσ​[Cn], the case γ=1\gamma=1γ=1.

A Markov chain is Harris recurrent if, for some nonzero σ\sigmaσ-finite measure φ\varphiφ, every set BBB with φ(B)>0\varphi(B)>0φ(B)>0 is visited infinitely often almost surely from every starting point. It is positive Harris recurrent if it also has an invariant probability measure (Meyn and Tweedie 2009, §§9–10). The MDP is called positive Harris recurrent if the state chain of every stationary policy is.

Formalization targets

Goal: Theorem 5.2

Let γ≥1\gamma\ge1γ≥1 and let the MDP be positive Harris recurrent. If π∗=(f∗,f∗,… )\pi^*=(f^*,f^*,\dots)π∗=(f∗,f∗,…) satisfies ρπ∗(x)≤ρσ(x)\rho_{\pi^*}(x)\le\rho_\sigma(x)ρπ∗​(x)≤ρσ​(x) for all σ∈Π\sigma\in\Piσ∈Π and x∈Ex\in Ex∈E, then

Jπ∗(x)≤Jσ(x)for all σ∈Π, x∈E,soJπ∗=J.J_{\pi^*}(x)\le J_\sigma(x)\quad\text{for all }\sigma\in\Pi,\ x\in E,\qquad\text{so}\qquad J_{\pi^*}=J .Jπ∗​(x)≤Jσ​(x)for all σ∈Π, x∈E,soJπ∗​=J.

The optimal policy does not depend on γ\gammaγ.

Milestones

  1. §5.1, p. 17. For γ>0\gamma>0γ>0, homogeneity gives Jσ(x)=lim sup⁡nU−1(Exσ[U(Cn/n)])J_\sigma(x)=\limsup_n U^{-1}(\mathbb E^\sigma_x[U(C^n/n)])Jσ​(x)=limsupn​U−1(Exσ​[U(Cn/n)]).
  2. Theorem 5.1. If the state chain of a stationary policy π\piπ is positive Harris recurrent, there is a number ρ\rhoρ with
lim⁡n→∞1n(Exπ[(Cn)γ])1/γ=ρ=lim⁡n→∞1nExπ[Cn]for all γ>0, x∈E.\lim_{n\to\infty}\frac1n\Big(\mathbb E^\pi_x\big[(C^n)^\gamma\big]\Big)^{1/\gamma}=\rho=\lim_{n\to\infty}\frac1n\mathbb E^\pi_x[C^n]\qquad\text{for all }\gamma>0,\ x\in E.n→∞lim​n1​(Exπ​[(Cn)γ])1/γ=ρ=n→∞lim​n1​Exπ​[Cn]for all γ>0, x∈E.
  1. Proof of Theorem 5.2. For γ≥1\gamma\ge1γ≥1 and every σ∈Π\sigma\in\Piσ∈Π: ρσ(x)≤Jσ(x)\rho_\sigma(x)\le J_\sigma(x)ρσ​(x)≤Jσ​(x).

Significance

The result. Theorem 5.2 reduces a risk-sensitive long-run problem to a classical one. Under positive Harris recurrence, any stationary policy that is optimal for the expected average cost, for instance one obtained from the average-cost optimality equation, is also optimal for every convex power criterion γ≥1\gamma\ge1γ≥1, simultaneously. Theorem 5.1 explains why: along a positive Harris recurrent chain the empirical average cost Cn/nC^n/nCn/n converges almost surely to a constant, so in the limit the power utility sees no randomness at all. The contrast is with exponential utility, where the risk-sensitive average cost generally differs from the risk-neutral one and leads to a multiplicative Poisson equation. Positive homogeneity of the utility is what removes the risk effect.

Formalizing it. The results are proved in the paper. As far as is known they have no machine-checked proof, and the platform has no strong law of large numbers for Harris chains on general state spaces. The mission produces a Borel MDP with history-dependent policies and Ionescu-Tulcea path measures, a reusable definition of (positive) Harris recurrence for an arbitrary Markov kernel, and a formal comparison of risk-neutral and risk-sensitive average costs. Each milestone is a self-contained target.

Difficulty

Milestones 1 and 3 are elementary once the expectations are handled correctly: Cn≥0C^n\ge0Cn≥0 holds only almost surely, and Jensen's inequality has to be applied with real powers. The central difficulty is Theorem 5.1. It needs the ergodic theorem for positive Harris recurrent chains, Cn/n→∫c(x,f(x)) μf(dx)C^n/n\to\int c(x,f(x))\,\mu_f(dx)Cn/n→∫c(x,f(x))μf​(dx) almost surely from every initial state (Meyn and Tweedie, Theorem 17.0.1). It also needs an identification of the state process under Pxπ\mathbb P^\pi_xPxπ​ with the canonical chain of PfP_fPf​. The natural first idea, to quote a convergence theorem in total variation, fails: positive Harris recurrence allows periodic chains, for which Pfn(x,⋅)P_f^n(x,\cdot)Pfn​(x,⋅) need not converge. Pathwise averages converge, marginal laws need not, and the argument has to work with the former.

Formalization scope

  • EEE and AAA are standard Borel spaces. No topology is used, and the continuity–compactness conditions (CC) of §2 play no role in §5. D(x)≠∅D(x)\neq\emptysetD(x)=∅ for every xxx is a standing hypothesis.
  • Policies are deterministic and history-dependent, gn:(E×A)n×E→Ag_n:(E\times A)^n\times E\to Agn​:(E×A)n×E→A with gn(hn)∈D(xn)g_n(h_n)\in D(x_n)gn​(hn​)∈D(xn​). Pxσ\mathbb P^\sigma_xPxσ​ is Mathlib's Kernel.trajMeasure on (E×A)N0(E\times A)^{\mathbb N_0}(E×A)N0​. Stationary policies act through gn(hn)=f(xn)g_n(h_n)=f(x_n)gn​(hn​)=f(xn​).
  • (5.1) is defined only for U(y)=yγU(y)=y^\gammaU(y)=yγ, with Real.rpow. For n≥1n\ge1n≥1 all terms of the sequences lie in [c‾,cˉ][\underline c,\bar c][c​,cˉ], so real limits superior are meaningful. The term n=0n=0n=0 (Lean's 1/0=01/0=01/0=0) is irrelevant.
  • The risk-neutral average cost, which the paper leaves undefined, is the lim sup⁡\limsuplimsup of 1nExσ[Cn]\frac1n\mathbb E^\sigma_x[C^n]n1​Exσ​[Cn]. Risk-neutral optimality of π∗\pi^*π∗ and the conclusion of Theorem 5.2 both range over all history-dependent policies. Restricting either to stationary policies would change the theorem.
  • Harris recurrence is defined from scratch on the canonical chain of a Markov kernel and kept equivalent to Meyn–Tweedie's notion. Weakening it to "has an invariant probability", or strengthening it to total-variation ergodicity (which excludes periodic chains), would make a different theorem. Neither is acceptable.
  • Positive Harris recurrence is assumed for every stationary policy, exactly as in the paper. Theorem 5.4 (vanishing discount) and Corollary 5.3 (finite unichain models) are outside the mission.

Contributions are welcome at every level. Reusable pieces, such as the identification of the state process with the chain of PfP_fPf​, the strong law for positive Harris chains, or bounded-convergence lemmas for path measures, are valuable beyond this mission.

Selected references

  • N. Bäuerle and U. Rieder, More Risk-Sensitive Markov Decision Processes, Mathematics of Operations Research 39(1):105–120, 2014. https://doi.org/10.1287/moor.2013.0601 (authors' manuscript: https://publikationen.bibliothek.kit.edu/1000039663)
  • S. P. Meyn and R. L. Tweedie, Markov Chains and Stochastic Stability, 2nd ed., Cambridge University Press, 2009. https://doi.org/10.1017/CBO9780511626630
  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • R. A. Howard and J. E. Matheson, Risk-sensitive Markov decision processes, Management Science 18(7):356–369, 1972. https://doi.org/10.1287/mnsc.18.7.356
7 thms1 active userReviewed
Graph TheoryOperations ResearchProbability·Captain: mikedeng1

Graphon Mean Field Systems I: The Law of the Graphon Particle System Depends Continuously on the Graphon in the Cut MetricResearch Paper

Motivation

Large interacting diffusion systems often have different interaction strengths between different pairs of agents. A graphon gives a continuum description of such weighted networks: each agent carries a label in [0,1][0,1][0,1], and a kernel assigns the strength of interaction between two labels. The question in this mission is whether the law of the resulting continuum stochastic system changes continuously when its graphon changes. This matters when a large finite network is represented by an approximate graphon, since an approximation of the network should lead to an approximation of the dynamics. Bayraktar, Chakraborty and Wu establish this stability as Theorem 2.1(c) of Graphon mean field systems.

The paper also studies dense and less dense finite-particle systems. Their convergence results use a limiting graphon particle system even when the limiting kernel is only measurable, with no continuity in the labels. Theorem 2.1(c) is the continuity result that makes approximation by simpler graphons useful in those later sections Bayraktar–Chakraborty–Wu, §§3–4.

Setting

Let I=[0,1]I=[0,1]I=[0,1], fix a time horizon T>0T>0T>0, and let Cd=C([0,T];Rd)\mathcal C_d=C([0,T];\mathbb R^d)Cd​=C([0,T];Rd) be the space of continuous paths with the uniform norm ∥x∥∗,t=sup⁡0≤s≤t∣xs∣\|x\|_{*,t}=\sup_{0\le s\le t}|x_s|∥x∥∗,t​=sup0≤s≤t​∣xs​∣. A graphon G:I2→[0,1]G:I^2\to[0,1]G:I2→[0,1] is measurable and symmetric. Its cut norm is the largest absolute integral of GGG over a measurable rectangle S×U⊆I2S\times U\subseteq I^2S×U⊆I2. For two graphons, their cut distance is the cut norm of their difference.

For each label u∈Iu\in Iu∈I, an initial state Xu(0)X_u(0)Xu​(0) and a ddd-dimensional Brownian motion BuB_uBu​ live on one probability space. Initial states are mutually independent, Brownian motions are mutually independent, and the two families are independent of each other. The initial state has law μu(0)\mu_u(0)μu​(0). The process XuX_uXu​ evolves with a drift obtained by averaging b(Xu(s),x)G(u,v)b(X_u(s),x)G(u,v)b(Xu​(s),x)G(u,v) first against the time-sss law of XvX_vXv​ and then over v∈Iv\in Iv∈I. Its diffusion coefficient averages the matrix-valued σ(Xu(s),x)G(u,v)\sigma(X_u(s),x)G(u,v)σ(Xu​(s),x)G(u,v) in the same way and drives BuB_uBu​. This is the graphon particle system (2.1) Bayraktar–Chakraborty–Wu, p. 3591.

Condition 2.1 requires measurable initial laws, a uniform (2+ε)(2+\varepsilon)(2+ε) moment for some ε>0\varepsilon>0ε>0, and a common global Lipschitz bound for bbb and σ\sigmaσ. The path-law family μ=(L(Xu))u∈I\mu=(\mathcal L(X_u))_{u\in I}μ=(L(Xu​))u∈I​ belongs to M\mathcal MM when it is measurable as a family of probability measures on Cd\mathcal C_dCd​ and has uniformly bounded second moments. The distance W2,tW_{2,t}W2,t​ between path laws uses the supremum norm through time ttt; W2,tMW^\mathcal M_{2,t}W2,tM​ is the supremum of these distances over labels Bayraktar–Chakraborty–Wu, pp. 3591–3592.

Formalization targets

Stability of path laws

For graphons GnG_nGn​ converging to GGG in cut metric, let μuGn\mu^{G_n}_uμuGn​​ and μuG\mu^G_uμuG​ be the laws of the associated solutions, with the same initial laws and coefficients. The target is

∥Gn−G∥□⟶0⟹∫I[W2,T(μuGn,μuG)]2 du⟶0.\|G_n-G\|_\square\longrightarrow0 \quad\Longrightarrow\quad \int_I[W_{2,T}(\mu^{G_n}_u,\mu^G_u)]^2\,du\longrightarrow0.∥Gn​−G∥□​⟶0⟹∫I​[W2,T​(μuGn​​,μuG​)]2du⟶0.

The conclusion is an integrated law convergence statement. It does not assert that the laws converge uniformly in uuu or that paths converge almost surely. This is precisely Theorem 2.1(c) Bayraktar–Chakraborty–Wu, p. 3593.

Supporting results

The mission also states the paper's cut-to-operator convergence (Remark 2.1), existence of frozen-flow solutions (5.2), the squared estimate established in the proof of (5.3), well-posedness and moments for the nonlinear system (Proposition 2.1), and the quantitative stability display on p. 3604. These are the source's claims used to reach the target, with their provenance attached to each milestone Bayraktar–Chakraborty–Wu, §§2 and 5.

Significance

Stability shows that the continuum model is robust to graphon approximation in a metric natural for dense networks. Together with Proposition 2.1, it gives a well-defined solution-law family whose dependence on the network kernel can be controlled. The paper uses this framework in its later laws of large numbers for finite interacting systems Bayraktar–Chakraborty–Wu, §§3–4.

The theorem is proved in the paper; this mission asks for a machine-checked proof of the faithful statements. A complete development would also supply reusable Lean interfaces for graphons, cut and operator norms, measurable families of path laws, and stochastic systems whose coefficients depend on those families. The Itô-process and general Wasserstein definitions already available as published modules are reused. The remaining graphon-specific definitions and the estimates in §5 are open proof targets.

Difficulty

A direct stability argument for stochastic differential equations would compare the two coefficients point by point. Cut convergence does not provide pointwise convergence of Gn(u,v)G_n(u,v)Gn​(u,v) to G(u,v)G(u,v)G(u,v), nor a uniform bound on their difference that tends to zero. The drift and diffusion also contain laws generated by the processes being compared, so a change in the graphon feeds back into the law family. The central challenge is to control these coupled differences using only a weak kernel metric while retaining the measurable structure needed to integrate over labels Bayraktar–Chakraborty–Wu, §5.2.

The result also depends on a well-posedness theory for a continuum of stochastic equations. The laws need to vary measurably with uuu even though the paper does not assume the sample paths themselves vary measurably with uuu Bayraktar–Chakraborty–Wu, Remark 2.3(b).

Formalization scope

Lean uses unitInterval for III, nonnegative real time, and continuous maps from [0,T][0,T][0,T] to Fin d → ℝ for Cd\mathcal C_dCd​. The norm on Rd\mathbb R^dRd is the sup norm; the paper's Euclidean norm is equivalent in finite dimension, so existential Lipschitz and stability constants may change while the qualitative claim remains the same. The diffusion coefficient is a d×dd\times dd×d matrix, measured through its entries. Wasserstein quantities and nonnegative expectations are valued in [0,∞][0,\infty][0,∞], avoiding defaults for infinite moments. The path-law family uses the measurable space of measures, with the Borel space on paths. A zero-time or zero-dimensional state space is admitted where the formulas still have their stated meaning; T>0T>0T>0 and ε>0\varepsilon>0ε>0 are explicit.

For each graphon, a solution is a continuous-path process driven by the same given initial variables and Brownian motions, adapted to the natural filtration of those variables for each label. Its path map is almost everywhere measurable, its law family belongs to M\mathcal MM, and the nested interaction integrals are required to be integrable. These clauses prevent a zero measure from arising through a nonmeasurable pushforward and prevent a nonintegrable Bochner integral from silently evaluating to zero. The graphons are explicitly measurable, symmetric, and [0,1][0,1][0,1]-valued, so the real cut and operator norms are used only on bounded kernels. The theorem also asserts measurability of each Wasserstein integrand, reflecting the paper's treatment of the displayed integral.

The paper's proofs are in §§5–7; this mission concerns §5. Contributions to any stated milestone and to the reusable measure and Itô lemmas needed for them are welcome. A formalization that assumes the stability limit, that treats arbitrary unbounded kernels as graphons, or that uses an empty solution class would not establish this target.

Selected references

  • E. Bayraktar, S. Chakraborty and R. Wu, Graphon mean field systems, Annals of Applied Probability 33(5), 3587–3619, 2023. DOI 10.1214/22-AAP1901.
9 thms1 active userReviewed
Operations ResearchPartial Differential EquationsProbability·Captain: mikedeng1

Global C¹ Regularity of the Value Function in Optimal Stopping Problems 2: In Finite Horizon, Probabilistic Regularity of the Boundary Makes the Time Derivative of the Value Function ContinuousResearch Paper

Motivation

In an optimal stopping problem the value function VVV and the gain function GGG agree on the stopping set D={V=G}D=\{V=G\}D={V=G}, and V>GV>GV>G on the continuation set CCC. The smooth fit principle says that, at the boundary ∂C\partial C∂C between them, VVV meets GGG with matching first derivatives. Smooth fit is one of the boundary conditions in the free-boundary problems that characterise optimal stopping boundaries. It is behind the integral equations for the early-exercise boundary of the American put and for many problems in sequential analysis and finance (Peskir & Shiryaev, 2006). On a finite horizon the value depends on the remaining time, and continuity of the time derivative ∂tV\partial_tV∂t​V across ∂C\partial C∂C is the step that justifies the local time-space calculus applied to VVV (Peskir, 2005).

Before De Angelis & Peskir (2020) such continuity results were proved problem by problem, or under sign conditions that the main examples do not satisfy: G=0G=0G=0 on the stopping set and H<0H<0H<0 globally, which fails for the American put. Their paper gives two general results. Theorem 8 covers the space derivative, and Theorem 15, the subject of this mission, covers the time derivative on a finite horizon. Both are stated for a strong Markov process realised as a stochastic flow, and both rest on probabilistic regularity of the boundary.

Setting

Fix a horizon T>0T>0T>0 and d=m+1≥1d=m+1\ge1d=m+1≥1. The process is the time-space process Xst,x=(t+s,Xsx)X^{t,x}_s=(t+s,X^x_s)Xst,x​=(t+s,Xsx​). Its first coordinate is time, and (Xsx)s≥0, x∈Rd−1(X^x_s)_{s\ge0,\,x\in\mathbb R^{d-1}}(Xsx​)s≥0,x∈Rd−1​ is a stochastic flow on a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) with a right-continuous filtration (Fs)(\mathcal F_s)(Fs​), adapted to it, with X0x=xX^x_0=xX0x​=x. Its paths are right-continuous with left limits, it is left-continuous over stopping times, and it is strong Markov. The flow is continuous in the space variable if, outside one null set, x↦Xsx(ω)x\mapsto X^x_s(\omega)x↦Xsx​(ω) is continuous for every sss.

Given continuous functions λ≥0\lambda\ge0λ≥0, GGG and HHH of (t,x)(t,x)(t,x), write Λst,x=∫0sλ(t+u,Xux) du\Lambda^{t,x}_s=\int_0^s\lambda(t+u,X^x_u)\,duΛst,x​=∫0s​λ(t+u,Xux​)du. The value function is

V(t,x)=sup⁡0≤τ≤T−tE[e−Λτt,xG(t+τ,Xτx)+∫0τe−Λst,xH(t+s,Xsx) ds]V(t,x)=\sup_{0\le\tau\le T-t}\mathsf E\Big[e^{-\Lambda^{t,x}_\tau}G(t+\tau,X^x_\tau)+\int_0^\tau e^{-\Lambda^{t,x}_s}H(t+s,X^x_s)\,ds\Big]V(t,x)=0≤τ≤T−tsup​E[e−Λτt,x​G(t+τ,Xτx​)+∫0τ​e−Λst,x​H(t+s,Xsx​)ds]

over stopping times τ\tauτ bounded by the remaining time T−tT-tT−t. The sets are C={V>G}C=\{V>G\}C={V>G} and D={V=G}D=\{V=G\}D={V=G} inside [0,T]×Rd−1[0,T]\times\mathbb R^{d-1}[0,T]×Rd−1, and ∂C=D∩C‾\partial C=D\cap\overline C∂C=D∩C. The problem is well posed if the expected payoffs are integrable and the first entry time τD\tau_DτD​ into DDD is optimal.

The first hitting time of a set AAA is σAt,x=inf⁡{s∈(0,T−t]:Xst,x∈A}\sigma^{t,x}_A=\inf\{s\in(0,T-t]:X^{t,x}_s\in A\}σAt,x​=inf{s∈(0,T−t]:Xst,x​∈A}. A point zzz is probabilistically regular for AAA if P(σAz=0)=1P(\sigma^z_A=0)=1P(σAz​=0)=1. The generator LX\mathbb L_XLX​ (2.14) acts in the space variable, with diffusion matrix σij\sigma_{ij}σij​, drift μi\mu_iμi​, killing rate λ\lambdaλ and jump measure ν\nuν. Its coefficient formula is tied to the flow by the right derivative at zero of the killed spatial semigroup applied to G(t,⋅)G(t,\cdot)G(t,⋅). The function H~=Gt+LXG+H\tilde H=G_t+\mathbb L_XG+HH~=Gt​+LX​G+H appears in the hypotheses.

Formalization targets

Goal: Theorem 15, global form (p. 20)

Assume well-posedness, (5.9) (VVV continuous on [0,T]×Rd−1[0,T]\times\mathbb R^{d-1}[0,T]×Rd−1 and C1C^1C1 on CCC), (5.10) (G∈C1,2G\in C^{1,2}G∈C1,2) and (5.11) (Lipschitz continuity of H~\tilde HH~ and λ\lambdaλ in ttt, uniformly in xxx), and a continuous flow. Assume the local conditions (5.12)–(5.13) and probabilistic regularity for D∘D^\circD∘ at every z∈∂Cz\in\partial Cz∈∂C. Then

∂tV exists and is continuous on [0,T]×Rd−1.\partial_tV\ \text{exists and is continuous on }[0,T]\times\mathbb R^{d-1}.∂t​V exists and is continuous on [0,T]×Rd−1.

Milestones

  1. (5.17): along every sequence (tn,xn)∈C(t_n,x_n)\in C(tn​,xn​)∈C with (tn,xn)→z(t_n,x_n)\to z(tn​,xn​)→z, lim inf⁡nVt(tn,xn)≥Gt(z)\displaystyle\liminf_{n}V_t(t_n,x_n)\ge G_t(z)nliminf​Vt​(tn​,xn​)≥Gt​(z).
  2. (5.20): along the same sequences, lim sup⁡nVt(tn,xn)≤Gt(z)\displaystyle\limsup_{n}V_t(t_n,x_n)\le G_t(z)nlimsup​Vt​(tn​,xn​)≤Gt​(z).
  3. Theorem 15, (5.14): at a single regular z∈∂Cz\in\partial Cz∈∂C,
∂tV(z)=∂tG(z)andlim⁡C∋(t,x)→z∂tV(t,x)=∂tG(z).\partial_tV(z)=\partial_tG(z)\quad\text{and}\quad\lim_{C\ni(t,x)\to z}\partial_tV(t,x)=\partial_tG(z).∂t​V(z)=∂t​G(z)andC∋(t,x)→zlim​∂t​V(t,x)=∂t​G(z).

Significance

The result. Theorem 15 turns a probabilistic property of the boundary, which can be checked through sample-path arguments, into the analytic smooth-fit condition in time. Continuity of ∂tV\partial_tV∂t​V across ∂C\partial C∂C is the hypothesis that the change-of-variable formula with local time on curves and surfaces requires. That formula yields the free-boundary integral equations for optimal stopping boundaries. The theorem needs no sign condition on GGG or HHH and no strong Feller property. The time-space process is never strong Feller, which is exactly why the earlier strong Feller route to boundary regularity does not apply here.

Formalizing it. The result is proved in the paper; nothing here is open mathematics. As far as is known no part of it has been machine-checked. Mathlib has stopping times and conditional expectation, but no stochastic flows, no generators of jump diffusions and no optimal stopping in continuous time. A complete development formalizes the proof on pp. 20–23 together with the upper semicontinuity of hitting times of open sets (Lemma 4 and Corollary 6 of the paper, posed in the companion mission on the space derivative).

Difficulty

The infinite-horizon argument (Theorem 13, via Theorem 8) perturbs the starting point and reuses the optimal stopping time of the unperturbed problem. On a finite horizon this fails in the time variable. Shifting the start from tnt_ntn​ to tn+εnt_n+\varepsilon_ntn​+εn​ shortens the remaining horizon, so the stopping time optimal for V(tn,xn)V(t_n,x_n)V(tn​,xn​) is no longer admissible for V(tn+εn,xn)V(t_n+\varepsilon_n,x_n)V(tn​+εn​,xn​). A first-order comparison of payoffs therefore cannot be used. The proof truncates the stopping time and controls the truncated part, which is the role of the identity (5.12) and of the window [T−t−ε,T−t][T-t-\varepsilon,T-t][T−t−ε,T−t] in (5.13). The convergence τn→0\tau_n\to0τn​→0 of the optimal stopping times has to come from regularity of zzz for the interior D∘D^\circD∘ and continuity of the flow, not from the strong Feller property.

Formalization scope

  • Space Rd−1\mathbb R^{d-1}Rd−1 is EuclideanSpace ℝ (Fin m) with d=m+1d=m+1d=m+1. Time is ℝ≥0. Points of the time-space domain are pairs in ℝ × EuclideanSpace ℝ (Fin m), and [0,T]×Rd−1[0,T]\times\mathbb R^{d-1}[0,T]×Rd−1 is Set.Icc 0 T ×ˢ univ.
  • PxP_xPx​ and Ex\mathsf E_xEx​ are PPP and E\mathsf EE of the flow started at xxx. All stopping times are for one common right-continuous filtration and are finite valued. Admissible times for (t,x)(t,x)(t,x) satisfy τ≤T−t\tau\le T-tτ≤T−t.
  • Hitting and entry times take values in [0,∞][0,\infty][0,∞] (WithTop ℝ≥0) with inf⁡∅=∞\inf\emptyset=\inftyinf∅=∞, and are capped by the horizon.
  • Expectations are Bochner integrals. Well-posedness carries integrability of every admissible payoff and optimality of a stopping time equal to τD\tau_DτD​ almost surely, so VVV is attained and is not a junk supremum.
  • ∂C:=D∩C‾\partial C:=D\cap\overline C∂C:=D∩C. "C∋(t,x)→zC\ni(t,x)\to zC∋(t,x)→z" is the filter NC(z)\mathcal N_C(z)NC​(z), and ∂tV\partial_tV∂t​V is the derivative of s↦V(s,x)s\mapsto V(s,x)s↦V(s,x) within [0,T][0,T][0,T]. The pointwise clause "continuous at zzz" means convergence along CCC; the global clause is ContinuousOn on [0,T]×Rd−1[0,T]\times\mathbb R^{d-1}[0,T]×Rd−1.
  • (5.13) is an integrable majorant valid simultaneously for all points of the window. The ball b(z,ε)b(z,\varepsilon)b(z,ε) is the max-metric ball, which is equivalent because ε\varepsilonε is existential. (5.12) includes integrability of both sides.
  • D∘D^\circD∘ is the interior in R×Rd−1\mathbb R\times\mathbb R^{d-1}R×Rd−1. No point with t=Tt=Tt=T is probabilistically regular, so the global hypothesis requires C‾\overline CC to avoid t=Tt=Tt=T. This is the paper's scope, not an addition.
  • The model is not specialized: any d≥1d\ge1d≥1, general λ\lambdaλ, jumps allowed, càdlàg paths, unbounded GGG, HHH and VVV. A formalization that takes Λ≡0\Lambda\equiv0Λ≡0, d=1d=1d=1, continuous paths, or the strong Feller property is a different theorem.

Contributions welcome: the hitting-time lemmas (upper semicontinuity of σD∘\sigma_{D^\circ}σD∘​ under a continuous flow), dominated-convergence lemmas for the truncated stopping times, and the two halves (5.17) and (5.20).

Selected references

  • T. De Angelis, G. Peskir, Global C¹ regularity of the value function in optimal stopping problems, Ann. Appl. Probab. 30(3), 2020. Preprint arXiv:1812.04564v2. https://arxiv.org/abs/1812.04564v2
  • G. Peskir, A. Shiryaev, Optimal Stopping and Free-Boundary Problems, Birkhäuser, 2006. https://doi.org/10.1007/978-3-7643-7390-0
  • G. Peskir, A change-of-variable formula with local time on curves, J. Theoret. Probab. 18, 2005. https://doi.org/10.1007/s10959-005-3517-6
  • R. M. Blumenthal, R. K. Getoor, Markov Processes and Potential Theory, Academic Press, 1968.
8 thms1 active userReviewed
PreviousPage 13 of 18Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me