Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Stochastic Systems

434 missions · 138 completed

The mathematics of systems that evolve under randomness, modeled as families of random variables indexed by time — from Markov chains and martingales to Brownian motion and stochastic differential equations. The field spans stochastic analysis, filtering and optimal control under uncertainty, ergodic behavior of random dynamics, and concentration of measure, with models reaching across physics, engineering, finance, and biology.

Missions

Open296Completed138All434
Operations ResearchProbability·Captain: mikedeng1

Understanding the Efficiency of Multi-Server Service Systems I: With Poisson Arrivals and Finitely Many Service-Time Values of Mean 1, the Number of Busy Servers in M/G/∞ Is Poisson(λ)Research Paper

Motivation

Call centers, hospital wards, telephone exchanges and server farms all face the same staffing question: given an arrival rate λ\lambdaλ, how many servers sss are needed to keep congestion at a fixed level? A widely used answer is the square-root staffing rule

s=λ+γλ,s = \lambda + \gamma\sqrt{\lambda},s=λ+γλ​,

where the grade of service γ>0\gamma > 0γ>0 sets the congestion level. It says that the safety capacity above the offered load grows like the square root of the load, which is the quantitative form of the economy of scale of large service systems.

Whitt (Management Science 38(5), 1992, pp. 708–723) explains the rule through an associated infinite-server (IS) model, in which every customer starts service immediately on arrival. If the number of busy servers NNN in the IS model is Poisson with mean λ\lambdaλ, its mean and variance are both λ\lambdaλ, so the event "more than sss servers busy" has roughly constant probability when s−λs - \lambdas−λ is a fixed multiple of λ\sqrt\lambdaλ​. The Poisson law of NNN is therefore the probabilistic fact on which the heuristic rests. This mission formalizes that fact as proved in §2.4–§2.5 of the paper: first for deterministic unit service times (M/D/∞), then for service times taking finitely many values with mean 111 (M/G/∞ with finite support).

Timeline:

  • The stationary number in system of M/G/∞ is classically known to be Poisson with mean λ⋅E[S]\lambda \cdot E[S]λ⋅E[S] for general service-time laws (Palm's theorem; see Gross et al., Fundamentals of Queueing Theory).
  • Halfin and Whitt (Operations Research 29, 1981) proved the heavy-traffic limit theorem that justifies square-root staffing for GI/M/s queues.
  • Whitt (1992) gave the elementary IS derivation formalized here, with the finite-support M/G/∞ case argued through splitting a Poisson stream into independent class streams.

Setting

Time is measured in units of the mean service time. Let T0,T1,T2,…T_0, T_1, T_2, \dotsT0​,T1​,T2​,… be i.i.d. exponential random variables with rate λ>0\lambda > 0λ>0, the interarrival times, and let τn=T0+⋯+Tn−1\tau_n = T_0 + \cdots + T_{n-1}τn​=T0​+⋯+Tn−1​ be the nnn-th arrival epoch. The arrival counting process A(t)A(t)A(t) is the number of n≥1n \ge 1n≥1 with τn≤t\tau_n \le tτn​≤t, the number of arrivals in (0,t](0, t](0,t]. This is a Poisson process of rate λ\lambdaλ.

Customers are numbered k=0,1,2,…k = 0, 1, 2, \dotsk=0,1,2,…; customer kkk arrives at τk+1\tau_{k+1}τk+1​, is served at once, and has service time DkD_kDk​. Following the paper (proof of Proposition 2.3, p. 712), an arrival at time ttt is counted and a departure at time ttt is not, so customer kkk is present at ttt iff τk+1≤t<τk+1+Dk\tau_{k+1} \le t < \tau_{k+1} + D_kτk+1​≤t<τk+1​+Dk​. The number of busy servers is

N(t)=#{k:τk+1≤t<τk+1+Dk}.N(t) = \#\{k : \tau_{k+1} \le t < \tau_{k+1} + D_k\}.N(t)=#{k:τk+1​≤t<τk+1​+Dk​}.

For the M/G/∞ case fix m≥1m \ge 1m≥1 classes with probabilities p1,…,pmp_1, \dots, p_mp1​,…,pm​ and values d1,…,dm≥0d_1, \dots, d_m \ge 0d1​,…,dm​≥0. Each customer carries a class label JkJ_kJk​, the labels are i.i.d. with P(Jk=i)=piP(J_k = i) = p_iP(Jk​=i)=pi​ and independent of the interarrival times, and Dk=dJkD_k = d_{J_k}Dk​=dJk​​. The class-iii busy count is Ni(t)=#{k:Jk=i, τk+1≤t<τk+1+di}N_i(t) = \#\{k : J_k = i,\ \tau_{k+1} \le t < \tau_{k+1} + d_i\}Ni​(t)=#{k:Jk​=i, τk+1​≤t<τk+1​+di​}.

Formalization targets

Goal: the M/G/∞ claim (§2.5, p. 713)

If ∑i=1mpidi=1\sum_{i=1}^m p_i d_i = 1∑i=1m​pi​di​=1 and t>max⁡idit > \max_i d_it>maxi​di​, then

P(N(t)=k)=e−λλkk!,k=0,1,2,…P\big(N(t) = k\big) = e^{-\lambda}\frac{\lambda^k}{k!}, \qquad k = 0, 1, 2, \dotsP(N(t)=k)=e−λk!λk​,k=0,1,2,…

The law depends on the service-time distribution only through its mean.

Milestones

  1. Proposition 2.3 (p. 712): with unit service times, N(t)=A(t)−A(t−1)N(t) = A(t) - A(t-1)N(t)=A(t)−A(t−1), pathwise.
  2. Proof of Proposition 2.4 (p. 712): for t≥1t \ge 1t≥1, A(t)−A(t−1)A(t) - A(t-1)A(t)−A(t−1) has the same law as A(1)A(1)A(1).
  3. Proposition 2.4 (p. 712): in M/D/∞ with unit service times, N(t)∼Poisson(λ)N(t) \sim \mathrm{Poisson}(\lambda)N(t)∼Poisson(λ) for each t>1t > 1t>1.
  4. §2.5, splitting (p. 713): the class-iii arrivals form independent Poisson streams of rates λpi\lambda p_iλpi​; stated as independence and Poisson laws of the class counts in one window (ai,bi](a_i, b_i](ai​,bi​] per class.
  5. §2.5, "Hence" (p. 713): for t>max⁡idit > \max_i d_it>maxi​di​, the Ni(t)N_i(t)Ni​(t) are independent, Ni(t)∼Poisson(λpidi)N_i(t) \sim \mathrm{Poisson}(\lambda p_i d_i)Ni​(t)∼Poisson(λpi​di​), and N(t)=∑iNi(t)N(t) = \sum_i N_i(t)N(t)=∑i​Ni​(t) almost surely.

A companion item, Proposition 2.1 (p. 710), states that (2) implies λ=s+γ2/2−γs+γ2/4\lambda = s + \gamma^2/2 - \gamma\sqrt{s + \gamma^2/4}λ=s+γ2/2−γs+γ2/4​ and s−γs≤λ≤s−γs+γ2/2s - \gamma\sqrt s \le \lambda \le s - \gamma\sqrt s + \gamma^2/2s−γs​≤λ≤s−γs​+γ2/2, connecting (2) to the utilization equation λ=s−γs\lambda = s - \gamma\sqrt sλ=s−γs​.

Significance

The goal is the step that turns the IS heuristic from a special case into a statement about general service: since N(t)N(t)N(t) is Poisson with mean λ\lambdaλ whatever the finite service-time law of mean 111, the square-root rule derived from M/D/∞ applies unchanged to M/G/∞, and the paper uses this to argue that sss-server congestion is nearly insensitive to the service distribution beyond its mean when sss is large.

The results are classical and proved; none has a machine-checked proof on Prove2Me. Formalizing them adds:

  • a Poisson process built from exponential interarrival times, with the stationary-increment property derived rather than assumed;
  • Poisson splitting (thinning by i.i.d. labels) with independence of the class streams, a tool reused throughout queueing and inventory theory;
  • the M/G/∞ Poisson law for discrete service times, complementing the open platform items ServiceParts.Palm.units_in_resupply_poisson_finite_time and ServiceParts.Palm.palm_theorem, which treat service times with a density.

The open item QueueingFundamentals.Foundations.poisson_count_cdf (the marginal law A(t)∼Poisson(λt)A(t) \sim \mathrm{Poisson}(\lambda t)A(t)∼Poisson(λt)) is related but distinct from milestone 2, which concerns the increment over (t−1,t](t-1, t](t−1,t].

Difficulty

The paper's arguments are short, but each hides a probabilistic fact that is not elementary from the definitions. The increment law of milestone 2 requires the memoryless property at the deterministic time t−1t - 1t−1: the residual time to the next arrival after t−1t-1t−1 must be shown exponential and independent of the past, which is a statement about a random index (the number of arrivals by t−1t-1t−1), not about a fixed interarrival time. Splitting (milestone 4) requires a joint computation over all classes at once: the class counts are built from the same arrival epochs, so their independence is a genuine property of Poisson processes, false for general renewal arrivals, and cannot be obtained one class at a time. The overlapping windows (t−di,t](t - d_i, t](t−di​,t] of different classes make this unavoidable.

Formalization scope

  • The arrival process is the published definition QueueingFundamentals.Foundations.ArrivalProcess: IsExpInterarrivals μ lam T (measurable, mutually independent, exponential with rate lam), arrivalTime, countingProcess. The Poisson process is not postulated through an increment-law axiom; a definition with such a field would make milestones 2 and 3 a projection and is ruled out.
  • The model IsMarkedPoisson adds measurable, i.i.d. class labels J : ℕ → Ω → Fin m with P(J k = i) = p i, independent of the interarrival sequence. Service time of customer k is d (J k). Labels, not values, distinguish classes, so equal d i are not merged.
  • Counts are Set.ncard, which is 000 on an infinite set. Milestone 1 carries the hypothesis that only finitely many arrivals occur by ttt, and the decomposition N(t)=∑iNi(t)N(t) = \sum_i N_i(t)N(t)=∑i​Ni​(t) is stated almost surely. Poisson laws are stated pointwise, P(X=k)=e−cck/k!P(X = k) = e^{-c}c^k/k!P(X=k)=e−cck/k!, avoiding pushforwards of possibly non-measurable maps.
  • Standing conventions: service rate 111; the system starts empty at time 000; arrival counted at ttt, departure not; "steady state" means the law at each fixed t>max⁡idit > \max_i d_it>maxi​di​, with no limit t→∞t \to \inftyt→∞; the paper's 1≤i≤n1 \le i \le n1≤i≤n is Fin m. The constraint ∑ipidi=1\sum_i p_i d_i = 1∑i​pi​di​=1 forces m≥1m \ge 1m≥1, and the label law forces pi≥0p_i \ge 0pi​≥0 and ∑ipi=1\sum_i p_i = 1∑i​pi​=1. Added hypotheses: di≥0d_i \ge 0di​≥0 (service times are nonnegative) and, in Proposition 2.1, γ>0\gamma > 0γ>0 (the paper's grade of service).
  • Infrastructure welcome: memorylessness of the Poisson process at a fixed time, Poisson thinning with independent marks, and the finite-sum version of Mathlib's IndepFun.hasLaw_add_poissonMeasure. These are reusable well beyond this mission.

Selected references

  • W. Whitt, Understanding the efficiency of multi-server service systems, Management Science 38(5):708–723, 1992. https://doi.org/10.1287/mnsc.38.5.708
  • S. Halfin and W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29(3):567–588, 1981. https://doi.org/10.1287/opre.29.3.567
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. I, 3rd ed., Wiley, 1968.
  • D. Gross, J. F. Shortle, J. M. Thompson and C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008. https://doi.org/10.1002/9781118625651
8 thms2 active usersReviewed
AnalysisOperations Research·Captain: mikedeng1

The G/GI/N Queue in the Halfin–Whitt Regime 1: The Regulator Equation z(t) = x(t) + ∫₀ᵗ (z(t−s)+a)⁺ dB(s) Has a Unique Càdlàg Solution, Lipschitz on Bounded Intervals and Measurable in xResearch Paper

Motivation

The G/GI/NG/GI/NG/GI/N queue has NNN identical servers, a general arrival process, and independent service times with a common distribution FFF. In the Halfin–Whitt regime the number of servers and the offered load grow together, so that the fraction of delayed customers stays strictly between 000 and 111. This is the standard asymptotic model of large call centers and service systems (Halfin and Whitt, Operations Research 29, 1981, doi:10.1287/opre.29.3.567). For exponential service times the diffusion limit has been known since 1981; for general service distributions the queue length is no longer Markov, and its limit requires a different device.

Reed (Annals of Applied Probability 19, 2009, arXiv:0912.2837) supplied that device. The number in system QQQ satisfies a nonlinear convolution equation, (2.8) on p. 9 of the paper, in which the only nonlinearity is the term ∫0t(Q(t−s)−N)+ dF(s)\int_0^t (Q(t-s)-N)^+\,dF(s)∫0t​(Q(t−s)−N)+dF(s). Section 3 of the paper isolates that equation as a deterministic regulator map: a map that takes an input path to the unique solution of the equation. Its fluid limit (Theorem 4.1) and diffusion limit (Theorem 5.1) are both obtained by applying this map, through the continuous mapping theorem, to the limits of simpler free processes. The regulator map plays here the role that the one-sided reflection map plays in conventional heavy-traffic theory.

Timeline:

  • 1981. Halfin and Whitt: the diffusion limit for exponential service times.
  • 2000. Puhalskii and Reiman: the GI/PH/NGI/PH/NGI/PH/N case, with phase-type service (MR1778580).
  • 2004. Jelenković, Mandelbaum and Momčilović: deterministic service times (MR2074672).
  • 2009. Reed: general service times, via the regulator map of Proposition 3.1. This mission covers that proposition.

Setting

A path is a function x:[0,∞)→Rx:[0,\infty)\to\mathbb Rx:[0,∞)→R. It is càdlàg if it is right continuous everywhere and has a finite left limit at every t>0t>0t>0. D[0,∞)D[0,\infty)D[0,∞) is the set of càdlàg paths. For T≥0T\ge0T≥0 the supremum metric on [0,T][0,T][0,T] is ∥x∥T=sup⁡0≤t≤T∣x(t)∣\|x\|_T=\sup_{0\le t\le T}|x(t)|∥x∥T​=sup0≤t≤T​∣x(t)∣.

Let BBB be a cumulative distribution function on R\mathbb RR, that is, B(t)=μ((−∞,t])B(t)=\mu((-\infty,t])B(t)=μ((−∞,t]) for a probability measure μ\muμ, and let a∈Ra\in\mathbb Ra∈R. Write y+=max⁡(y,0)y^+=\max(y,0)y+=max(y,0). For an input x∈D[0,∞)x\in D[0,\infty)x∈D[0,∞), the regulator equation (3.1) asks for a path z∈D[0,∞)z\in D[0,\infty)z∈D[0,∞) with

z(t)=x(t)+∫[0,t](z(t−s)+a)+ dB(s),t≥0.z(t)=x(t)+\int_{[0,t]}\big(z(t-s)+a\big)^+\,dB(s),\qquad t\ge0 .z(t)=x(t)+∫[0,t]​(z(t−s)+a)+dB(s),t≥0.

The integral runs over the closed interval [0,t][0,t][0,t], so an atom of BBB at 000 counts. The regulator map φBa\varphi^a_BφBa​ sends xxx to the solution zzz. The paper applies it with B=FB=FB=F, the service-time distribution: a=−1a=-1a=−1 for the fluid-scaled queue and a=0a=0a=0 for the diffusion-scaled one.

The proof works with the operator ΨBa(u)(t)=∫[0,t](u(t−s)+a)+ dB(s)\Psi^a_B(u)(t)=\int_{[0,t]}(u(t-s)+a)^+\,dB(s)ΨBa​(u)(t)=∫[0,t]​(u(t−s)+a)+dB(s) and the successive approximations u0=0u_0=0u0​=0, un+1=x+ΨBa(un)u_{n+1}=x+\Psi^a_B(u_n)un+1​=x+ΨBa​(un​) of (A.3).

D[0,∞)D[0,\infty)D[0,∞) carries the Kolmogorov σ-algebra, the one generated by the evaluations x↦x(t)x\mapsto x(t)x↦x(t), t≥0t\ge0t≥0. In the Lean development the objects are IsCadlag, supNorm, Dpath, SolvesRegulator, psi and picard.

Formalization targets

Goal: Proposition 3.1

Assume μ({0})<1\mu(\{0\})<1μ({0})<1. Then there is a map φBa:D[0,∞)→D[0,∞)\varphi^a_B:D[0,\infty)\to D[0,\infty)φBa​:D[0,∞)→D[0,∞) with the following properties:

  • φBa(x)\varphi^a_B(x)φBa​(x) solves (3.1) for every xxx;
  • every càdlàg solution of (3.1) agrees with φBa(x)\varphi^a_B(x)φBa​(x) on [0,∞)[0,\infty)[0,∞);
  • for each T≥0T\ge0T≥0 there is a constant CTC_TCT​ with
∥φBa(x1)−φBa(x2)∥T≤CT ∥x1−x2∥Tfor all x1,x2∈D[0,∞);\|\varphi^a_B(x_1)-\varphi^a_B(x_2)\|_T\le C_T\,\|x_1-x_2\|_T\quad\text{for all } x_1,x_2\in D[0,\infty);∥φBa​(x1​)−φBa​(x2​)∥T​≤CT​∥x1​−x2​∥T​for all x1​,x2​∈D[0,∞);
  • φBa\varphi^a_BφBa​ is measurable for the Kolmogorov σ-algebra.

The constant CTC_TCT​ is not fixed. The proof gives (1−ε)−⌈T/δ⌉(1-\varepsilon)^{-\lceil T/\delta\rceil}(1−ε)−⌈T/δ⌉, but the goal asserts only its existence.

Milestones, in the order of the paper's proof

  1. Point mass at c>0c>0c>0, (A.1)–(A.2). Equation (3.1) is the recursion z=xz=xz=x on [0,c)[0,c)[0,c) and z(t)=x(t)+(z(t−c)+a)+z(t)=x(t)+(z(t-c)+a)^+z(t)=x(t)+(z(t−c)+a)+ for t≥ct\ge ct≥c. Its solution is unique, and ∥z1−z2∥t≤k∥x1−x2∥t\|z_1-z_2\|_t\le k\|x_1-x_2\|_t∥z1​−z2​∥t​≤k∥x1​−x2​∥t​ for (k−1)c≤t<kc(k-1)c\le t<kc(k−1)c≤t<kc.
  2. Uniqueness. Assume B(y+δ)−B(y)<ε<1B(y+\delta)-B(y)<\varepsilon<1B(y+δ)−B(y)<ε<1 for all y≥0y\ge0y≥0 and μ([0,δ])<ε\mu([0,\delta])<\varepsilonμ([0,δ])<ε. Then two càdlàg solutions agree on [0,∞)[0,\infty)[0,∞).
  3. Lipschitz continuity. Under the same assumption, ∥z2−z1∥kδ≤(1−ε)−k∥x2−x1∥kδ\|z_2-z_1\|_{k\delta}\le(1-\varepsilon)^{-k}\|x_2-x_1\|_{k\delta}∥z2​−z1​∥kδ​≤(1−ε)−k∥x2​−x1​∥kδ​ for every k≥1k\ge1k≥1.
  4. Existence. Under the same assumption, the successive approximations converge uniformly on every [0,T][0,T][0,T] to a càdlàg solution.
  5. Measurability of ΨBa\Psi^a_BΨBa​. ΨBa\Psi^a_BΨBa​ maps càdlàg paths to càdlàg paths, and u↦ΨBa(u)(t)u\mapsto\Psi^a_B(u)(t)u↦ΨBa​(u)(t) is measurable for each t≥0t\ge0t≥0.
  6. Example 1. For unit deterministic service times, the fluid equation (4.7) has the unique solution Qˉ(t)=1+t−⌊t⌋\bar Q(t)=1+t-\lfloor t\rfloorQˉ​(t)=1+t−⌊t⌋.
  7. Proof of Corollary 5.1. Take equilibrium initial conditions. The input of (4.7) is then identically 111, and Qˉ≡1\bar Q\equiv1Qˉ​≡1 is the unique solution.

Significance

Proposition 3.1 is the deterministic core of the paper. Uniqueness makes the queue length a well-defined function of its free process. Lipschitz continuity in the topology of uniform convergence on compacts carries convergence of the inputs over to convergence of the outputs. Measurability is needed because the inputs are random: it makes the output a random element of D[0,∞)D[0,\infty)D[0,∞), so that the continuous mapping theorem applies. Without the proposition neither Theorem 4.1 nor Theorem 5.1 can be stated in the form the paper gives. Example 1 and Corollary 5.1 are the two explicit solutions the paper extracts from it: a periodic, discontinuous sawtooth, and a constant.

The proposition is proved in the paper's Appendix (pp. 32–36). As far as the platform's records show, none of it has been formalized. The mission produces a machine-checked version with every convention fixed. It also corrects the statement: as printed, the proposition fails when BBB is the unit mass at 000, because the equation then reads z(t)=x(t)+(z(t)+a)+z(t)=x(t)+(z(t)+a)^+z(t)=x(t)+(z(t)+a)+. With a=0a=0a=0 and x≡1x\equiv1x≡1 this has no solution. The goal therefore carries the hypothesis μ({0})<1\mu(\{0\})<1μ({0})<1. That hypothesis holds for every service distribution of mean 111 on [0,∞)[0,\infty)[0,∞), which is the only case the paper uses. It also covers the mixed cases that fall between the two cases of the printed proof, such as an atom at 000 together with mass elsewhere.

Theorems 4.1 and 5.1 themselves, which are weak convergence in D[0,∞)D[0,\infty)D[0,∞) with the Skorohod J1J_1J1​ topology, are not part of this mission.

Difficulty

The equation is a Volterra equation with a nonlinear but 111-Lipschitz integrand. The first idea is to treat it as a contraction in ∥⋅∥T\|\cdot\|_T∥⋅∥T​. That fails: the kernel BBB has total mass 111, so on [0,T][0,T][0,T] the operator ΨBa\Psi^a_BΨBa​ is only nonexpansive, not contractive. The contraction has to be recovered locally, from windows of length δ\deltaδ on which BBB puts mass less than 111. This works only if such windows exist, and they do not exist when BBB is a point mass at 000.

Atoms are the second difficulty. With atoms, t↦ΨBa(u)(t)t\mapsto\Psi^a_B(u)(t)t↦ΨBa​(u)(t) is càdlàg but not continuous, and the closed-interval convention matters at every step. The third is measurability. The map u↦∫(u(t−s)+a)+ dB(s)u\mapsto\int(u(t-s)+a)^+\,dB(s)u↦∫(u(t−s)+a)+dB(s) is not continuous in uuu for the Skorohod topology when BBB has atoms, so the paper splits BBB into its continuous and discrete parts.

Formalization scope

  • Paths. A path is ℝ → ℝ, and only its values on [0,∞)[0,\infty)[0,∞) are constrained or read. Every equation is asserted for t≥0t\ge0t≥0, and every uniqueness claim is equality on [0,∞)[0,\infty)[0,∞) (Set.EqOn … (Set.Ici 0)). D[0,∞)D[0,\infty)D[0,∞) is the structure Dpath of càdlàg paths.
  • Integrals. BBB is a probability measure μ\muμ on R\mathbb RR. ∫0t⋯dB(s)\int_0^t\cdots dB(s)∫0t​⋯dB(s) is the integral over the closed interval Set.Icc 0 t, so it includes an atom at 000, and mass on (−∞,0)(-\infty,0)(−∞,0) never enters.
  • Explicit readings of the paper's phrases.
    • "Unique solution in D[0,∞)D[0,\infty)D[0,∞)" means unique among càdlàg paths, up to equality on [0,∞)[0,\infty)[0,∞).
    • "Lipschitz continuous in the topology of uniform convergence over bounded intervals" means ∀T ∃CT ∀x1,x2\forall T\ \exists C_T\ \forall x_1,x_2∀T ∃CT​ ∀x1​,x2​. The constant is chosen before the inputs.
    • "Measurable with respect to the Borel σ-field generated by the Skorohod J1J_1J1​ topology" means measurable for the Kolmogorov σ-algebra generated by the evaluations at times t≥0t\ge0t≥0. The paper uses this identification on p. 35, and it is Theorem 16.6 of Billingsley (1999). J1J_1J1​ is not defined.
    • "Uniform convergence" in the existence proof means ∥un−u⋆∥T→0\|u_n-u^\star\|_T\to0∥un​−u⋆∥T​→0 for every TTT.
  • Added hypothesis in the goal: μ({0})<1\mu(\{0\})<1μ({0})<1 (see Significance).
  • Window conditions in milestones 2–4. These are the paper's B(y+δ)−B(y)<εB(y+\delta)-B(y)<\varepsilonB(y+δ)−B(y)<ε for y≥0y\ge0y≥0, plus μ([0,δ])<ε\mu([0,\delta])<\varepsilonμ([0,δ])<ε for the first window, which the proof uses as "B(δ)<εB(\delta)<\varepsilonB(δ)<ε".
  • Junk values. The real supremum ∥⋅∥T\|\cdot\|_T∥⋅∥T​ and the Bochner integral take junk values (zero) on unbounded or non-integrable data. Every statement applies them only to càdlàg paths, which are bounded and measurable on [0,T][0,T][0,T]. This is also why solutions are required to be càdlàg: a solution taken among arbitrary functions could exploit the zero value of a non-integrable integral. Likewise, the goal cannot be satisfied by a φ\varphiφ whose values solve (3.1) only vacuously, and cannot be satisfied by dropping the càdlàg requirement on the output.
  • Printed slips corrected in the Lean and disclosed in the items:
    • (A.2)'s step "k<t≤(k+1)ck<t\le(k+1)ck<t≤(k+1)c" means kc≤t<(k+1)ckc\le t<(k+1)ckc≤t<(k+1)c;
    • (A.3) "for n≥1n\ge1n≥1" starts at n=0n=0n=0;
    • (4.18) has Qˉ(t)\bar Q(t)Qˉ​(t) on the right where (4.7) gives Qˉ(t−1)\bar Q(t-1)Qˉ​(t−1);
    • Corollary 5.1 cites "Theorem 5.1 of Section 4", meaning Theorem 4.1.

Infrastructure. A complete development needs the following, all reusable beyond this mission:

  • càdlàg paths on a half-line and their boundedness on compacts;
  • Lebesgue–Stieltjes convolution integrals of càdlàg paths against a probability measure;
  • the Kolmogorov σ-algebra on path space.

The related platform objects are of other shapes:

  • ChenWhitt93.Reflection.Basic (IsCadlagOn, vector-valued paths on [0,T][0,T][0,T]) and EthierKurtz_HasCadlagPaths (processes indexed by R≥0\mathbb R_{\ge0}R≥0​) define càdlàg paths in other settings.
  • BellmanDP.Inventory.renewal_equation_exists_unique is a linear renewal equation with a density kernel of mass below 111.

Contributions are welcome on any milestone, in any order. The windowed estimates (milestones 2–4) and the measurability step (milestone 5) are independent of each other.

Selected references

  • J. Reed, The G/GI/N queue in the Halfin–Whitt regime, Annals of Applied Probability 19(6), 2009, 2211–2269. arXiv:0912.2837v1, doi:10.1214/09-AAP609
  • S. Halfin, W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29(3), 1981, 567–588. doi:10.1287/opre.29.3.567
  • A. A. Puhalskii, M. I. Reiman, The multiclass GI/PH/N queue in the Halfin–Whitt regime, Advances in Applied Probability 32, 2000, 564–595. MR1778580
  • P. Jelenković, A. Mandelbaum, P. Momčilović, Heavy traffic limits for queues with many deterministic servers, Queueing Systems 47, 2004, 53–69. MR2074672
  • P. Billingsley, Convergence of Probability Measures, 2nd ed., Wiley, 1999, Chapter 16. doi:10.1002/9780470316962
13 thms2 active usersReviewed
Markov ChainOperations Research·Captain: mikedeng1

Stability Properties of Constrained Queueing Systems and Scheduling Policies for Maximum Throughput in Multihop Radio Networks I: Policy π₀ Is Throughput-Optimal, C′ ⊂ C_π₀ ⊂ C ⊂ C̄′Research Paper

Motivation

In a wireless multihop network, a switch, or a parallel computer, transmissions interfere: two links that share a receiver, or two crossbar paths that share a port, cannot be active in the same time slot. The scheduler must choose, slot by slot, a set of links that may operate together and decide which traffic each one carries. The basic question is which arrival rates a network can sustain at all, and whether a single scheduling rule sustains every one of them without knowing the rates.

Tassiulas and Ephremides answered both questions in 1992 for a general slotted model with interference constraints, multihop routing and several traffic classes (IEEE Trans. Automat. Control 37(12):1936–1948). Their policy, here called π0\pi_0π0​, weighs each link by the largest queue-length difference it can reduce and activates a maximum-weight feasible set. It is the origin of the max-weight and back-pressure scheduling rules that later became standard in switch scheduling (McKeown, Mekkittikul, Anantharam and Walrand, 1999) and in stochastic network optimization (Georgiadis, Neely and Tassiulas, 2006).

Setting

A constrained queueing network has LLL nodes, NNN servers (links) and JJJ customer classes. Server iii moves customers from its origin node q(i)q(i)q(i) to its destination node h(i)h(i)h(i). Class jjj leaves the network on reaching a node of its destination set VjV_jVj​; at every other node lll it has a queue (l,j)(l,j)(l,j), whose length at the end of slot ttt is Xlj(t)∈NX_{lj}(t)\in\mathbb NXlj​(t)∈N.

The constraint set SSS is the family of sets of servers that may be active in the same slot. Assumption C.1 says that every subset of an activation set is an activation set. In each slot a stationary policy, given the state x=X(t−1)x=X(t-1)x=X(t−1), chooses a set of servers in SSS and the class each active server serves; an activation rule never activates more servers of queue (l,j)(l,j)(l,j) than there are customers xljx_{lj}xlj​. The class of all such rules is HHH. An activated server iii completes its service with probability mim_imi​, independently. New arrivals Alj(t)A_{lj}(t)Alj​(t) are i.i.d. over slots, independent across queues and of the services, with finite second moments and means alja_{lj}alj​. Under a stationary rule the vector X(t)X(t)X(t) is a Markov chain on N{queues}\mathbb N^{\{\text{queues}\}}N{queues}.

The chain is stable (Definition 3.1) if, from every transient state, it enters a closed communicating class with probability one, and every state of a closed communicating class is positive recurrent. The stability region CπC_\piCπ​ of a policy is the set of rate vectors aaa for which the system is stable under π\piπ; the stability region of the system is C=⋃π∈HCπC=\bigcup_{\pi\in H}C_\piC=⋃π∈H​Cπ​.

A family f=(fij)≥0f=(f_{ij})\ge0f=(fij​)≥0 is an aaa-admissible flow if it satisfies flow conservation, alj=∑q(i)=lfij−∑h(i)=lfija_{lj}=\sum_{q(i)=l}f_{ij}-\sum_{h(i)=l}f_{ij}alj​=∑q(i)=l​fij​−∑h(i)=l​fij​ at every queue; f^i=∑jfij\hat f_i=\sum_jf_{ij}f^​i​=∑j​fij​ is its total flow through server iii. With co(S)\mathrm{co}(S)co(S) the convex hull of the indicator vectors of the activation sets,

C′={a≥0: ∃f∈Fa, c∈co(S), mi−1f^i<ci if f^i>0, f^i=0 if ci=0}.C'=\{a\ge0:\ \exists f\in F_a,\ c\in\mathrm{co}(S),\ m_i^{-1}\hat f_i<c_i\text{ if }\hat f_i>0,\ \hat f_i=0\text{ if }c_i=0\}.C′={a≥0: ∃f∈Fa​, c∈co(S), mi−1​f^​i​<ci​ if f^​i​>0, f^​i​=0 if ci​=0}.

Formalization targets

Goal: Theorem 3.2

C′⊂C⊂Cˉ′,C′⊂Cπ0⊂C⊂Cˉπ0.C'\subset C\subset\bar C',\qquad C'\subset C_{\pi_0}\subset C\subset\bar C_{\pi_0}.C′⊂C⊂Cˉ′,C′⊂Cπ0​​⊂C⊂Cˉπ0​​.

The system stability region is pinned between C′C'C′ and its closure, and policy π0\pi_0π0​, whatever its tie-breaking, stabilizes every rate vector in C′C'C′. Inclusions are not strict.

Milestones

  1. Lemma A.1: co(S)\mathrm{co}(S)co(S) is closed under 0≤a≤c0\le a\le c0≤a≤c (under C.1).
  2. Lemma 3.1: Cˉ′={a:∃f∈Fa, c∈co(S), M−1f^≤c}\bar C'=\{a:\exists f\in F_a,\ c\in\mathrm{co}(S),\ M^{-1}\hat f\le c\}Cˉ′={a:∃f∈Fa​, c∈co(S), M−1f^​≤c}.
  3. Theorem 3.1: a function bounded below with drift ≤−ϵ\le-\epsilon≤−ϵ outside a finite set, and finite conditional expectation on it, makes a countable chain stable in the sense of Definition 3.1.
  4. (A.6)–(A.7): for V(x)=∑l,jxlj2V(x)=\sum_{l,j}x_{lj}^2V(x)=∑l,j​xlj2​, the one-step drift under π0\pi_0π0​ is finite everywhere and below −ϵ-\epsilon−ϵ once V(x)≥bV(x)\ge bV(x)≥b.
  5. Lemma 3.2: C′⊂Cπ0C'\subset C_{\pi_0}C′⊂Cπ0​​.
  6. Lemma 3.3: for a∉Cˉ′a\notin\bar C'a∈/Cˉ′, the system is unstable under every policy in HHH.

An optional item states the claim of Remark 1: if a∈Cˉ′∖C′a\in\bar C'\setminus C'a∈Cˉ′∖C′, then δa∉Cˉ′\delta a\notin\bar C'δa∈/Cˉ′ for every δ>1\delta>1δ>1.

Significance

Theorem 3.2 shows that a throughput-optimal stationary policy exists, which is not obvious: stability regions of different policies need not be nested, so a policy whose region contains all the others has to be exhibited. It also describes the system stability region by a deterministic flow condition, C′C'C′, which can be checked without simulating any policy. The same drift argument underlies the stability proofs of max-weight switch schedulers, back-pressure routing and the drift-plus-penalty method.

The result is proved in the paper, with a proof sketched in places (Theorem 3.1 is called "a trivial extension of Foster's criteria", Lemma A.1 is omitted, Lemma 3.3 is argued by ergodicity in a paragraph). As far as a search of the platform shows, none of these statements has a machine-checked proof: Foster's criterion is posed on the platform only for irreducible chains on N\mathbb NN, and the back-pressure results already posed concern fluid models of other networks. A complete formal development would supply the reducible-chain Foster criterion, the convex-geometry lemma on co(S)\mathrm{co}(S)co(S), the quadratic drift computation and the ergodic converse.

Difficulty

The obvious argument is a quadratic Lyapunov drift bound, but it does not go through as is in three places. First, the drift bound needs a direction of decrease from every large state: the largest queue must be connected to a destination through servers that can actually be activated, which is where assumption C.2 and the topology of SSS enter (A.21)–(A.24). Second, stage 3 of π0\pi_0π0​ defers some activations to respect the rule "no service for nonexisting customers", so the chosen schedule is not exactly maximum-weight and the loss has to be bounded uniformly. Third, the chain is in general reducible, so Foster's criterion for irreducible chains does not apply; the extension must show that every closed class meets the finite exceptional set and that transient states are left almost surely. The converse, Lemma 3.3, needs a law-of-large-numbers argument for an arbitrary stationary rule on a positive recurrent class, together with compactness of acyclic flows (Lemma 3.1).

Formalization scope

Nodes, servers and classes are Fin L, Fin N, Fin J (0-based). SSS is a Set (Finset (Fin N)); a queue is a pair (l,j)(l,j)(l,j) with l∉Vjl\notin V_jl∈/Vj​, and a state is a function from queues to N\mathbb NN. A multiclass activation vector assigns to each server an optional class. The transition matrix of the queue-length chain is written out explicitly as a sum over arrival vectors and Bernoulli service outcomes; Definition 3.1 is stated through this matrix (first-entry probabilities, essential states, positive recurrence), with values in [0,∞][0,\infty][0,∞].

Conventions committed to, and hypotheses added relative to the page:

  • Standing assumptions of the goal: C.1; ∅∈S\emptyset\in S∅∈S (the idle schedule is always allowed); 0<mi≤10<m_i\le10<mi​≤1; and C.2 in a topological form, a chain of servers from every non-destination node of class jjj to VjV_jVj​ (stronger than the printed sentence, which covers only nodes that class jjj can reach).
  • Every single server is an activation set, {i}∈S\{i\}\in S{i}∈S. The proof of Lemma 3.2 uses this at (A.24) without stating it; without it a server that can never be activated breaks the drift bound and Lemma 3.2.
  • Stability regions quantify over laws. CπC_\piCπ​ is the set of nonnegative rate vectors for which the chain is stable for every arrival law with finite second moments and those means. C′C'C′ is intersected with a≥0a\ge0a≥0.
  • π0\pi_0π0​ is a family. Statements hold for every rule satisfying the three stages, with arbitrary tie-breaking.
  • Expectations of unbounded functions are real series with explicit summability, so a divergent expectation is never read as 000.

A formalization in which CπC_\piCπ​ asks for stability under one convenient arrival law, or in which negative rates are admitted, or in which π0\pi_0π0​ is one fixed tie-break, would be a different theorem; the definitions rule each of these out.

Infrastructure needed: hitting probabilities and positive recurrence for countable chains (reusable beyond this mission), convex hulls of finite point sets, a cycle-cancelling bound for multicommodity flows, and the ergodic theorem for positive recurrent chains. Proofs of any milestone, and reusable lemmas on countable Markov chains, are welcome.

Selected references

  • L. Tassiulas and A. Ephremides, Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks, IEEE Trans. Automat. Control 37(12):1936–1948, 1992. https://doi.org/10.1109/9.182479
  • F. G. Foster, On the stochastic matrices associated with certain queuing processes, Ann. Math. Statist. 24(3):355–360, 1953. https://doi.org/10.1214/aoms/1177728976
  • N. McKeown, A. Mekkittikul, V. Anantharam and J. Walrand, Achieving 100% throughput in an input-queued switch, IEEE Trans. Commun. 47(8):1260–1267, 1999. https://doi.org/10.1109/26.780463
  • L. Georgiadis, M. J. Neely and L. Tassiulas, Resource allocation and cross-layer control in wireless networks, Found. Trends Netw. 1(1):1–144, 2006. https://doi.org/10.1561/1300000001
9 thms2 active usersReviewed
Markov ChainProbability·Captain: mikedeng1

Random Walks in a Random Environment 3: With One-Way Mirrors σ ∈ {0, θ}, X_n/(n/log_θ n) → ½ in Probability if γθ = 1, and n^(−1/ρ)X_n Has Limit Laws Along Subsequences if γθ > 1Research Paper

Why the walk slows down

A random walk in a random environment uses transition probabilities selected once for each site, rather than probabilities resampled at every step. Even when the site environments are independent and identically distributed, the walker revisits the same local bias whenever it returns to a site. Its long-time motion can therefore differ sharply from that of a walk with a single averaged right-step probability. Solomon’s 1975 paper established the recurrence and speed classification for this one-dimensional model and then examined a two-value example in which some sites are one-way mirrors: the walker can pass through them to the right but cannot cross them to the left. The example isolates how a sequence of random intervals between mirrors produces slow growth and phase-dependent limit laws Solomon 1975, §2.

The present mission concerns §2 of that paper, pp. 10–20. Its central question is how far the walker has traveled after nnn steps when the mean crossing time reaches or exceeds the critical threshold. At criticality, a logarithmic correction replaces ordinary linear speed. Above criticality, the paper gives limits along subsequences whose logarithmic fractional parts approach a fixed phase.

The walk and its mirror environment

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space and let αj\alpha_jαj​, j∈Zj\in\mathbb Zj∈Z, be independent, identically distributed random variables in [0,1][0,1][0,1]. The environment is the complete sequence α=(αj)j∈Z\alpha=(\alpha_j)_{j\in\mathbb Z}α=(αj​)j∈Z​. Conditional on a fixed environment, a nearest-neighbour walk starts at X0=0X_0=0X0​=0 and, from site jjj, moves to j+1j+1j+1 with probability αj\alpha_jαj​ and to j−1j-1j−1 with probability 1−αj1-\alpha_j1−αj​. The annealed probability PPP averages the conditional path law over the environment. In Lean this joint law is specified on every finite path cylinder together with every measurable event of the whole environment, so it determines the dependence between XXX and α\alphaα.

Fix θ>1\theta>1θ>1 and 0<γ<10<\gamma<10<γ<1. Solomon’s example has αj=1\alpha_j=1αj​=1 with probability 1−γ1-\gamma1−γ and αj=(1+θ)−1\alpha_j=(1+\theta)^{-1}αj​=(1+θ)−1 with probability γ\gammaγ. Equivalently, the left-to-right odds ratio σj=(1−αj)/αj\sigma_j=(1-\alpha_j)/\alpha_jσj​=(1−αj​)/αj​ takes values 000 and θ\thetaθ. A site with σj=0\sigma_j=0σj​=0 is a one-way mirror. Write V0=0V_0=0V0​=0 and let VnV_nVn​ be the position of the nnnth mirror strictly to the right of zero. Let TjT_jTj​ be the first time the walk reaches site jjj, with Tj=∞T_j=\inftyTj​=∞ if it never does. For b>0b>0b>0, log⁡bx\log_b xlogb​x means the logarithm in base bbb, and {x}=x−⌊x⌋\{x\}=x-\lfloor x\rfloor{x}=x−⌊x⌋ is the fractional part.

The parameters used below are

ν=2θ(θ−1)2,K=1−γγν,ρ=log⁡1/γθ.\nu=\frac{2\theta}{(\theta-1)^2},\qquad K=\frac{1-\gamma}{\gamma}\nu,\qquad \rho=\log_{1/\gamma}\theta.ν=(θ−1)22θ​,K=γ1−γ​ν,ρ=log1/γ​θ.

When γθ>1\gamma\theta>1γθ>1, the paper specifies a probability law FεF_\varepsilonFε​ on [0,∞)[0,\infty)[0,∞) by its Laplace transform

∫0∞e−ux dFε(x)=exp⁡[−Ku∑j∈Z(γθ)j−ε1+νuθj−ε],u>0.\int_0^\infty e^{-ux}\,dF_\varepsilon(x)=\exp\left[-Ku\sum_{j\in\mathbb Z}\frac{(\gamma\theta)^{j-\varepsilon}}{1+\nu u\theta^{j-\varepsilon}}\right],\qquad u>0.∫0∞​e−uxdFε​(x)=exp​−Kuj∈Z∑​1+νuθj−ε(γθ)j−ε​​,u>0.

Here Fε(t)F_\varepsilon(t)Fε​(t) also denotes that law’s distribution function at ttt. The bilateral series converges in the supercritical parameter range. The source’s notation uses the same letter for a distribution and its distribution function; the Lean development keeps these roles separate as a measure and its value on (−∞,t](-\infty,t](−∞,t].

Formalization targets

The first clause of Theorem (2.20) is the critical growth law. If γθ=1\gamma\theta=1γθ=1, then

Xnn/log⁡θn→P12.\frac{X_n}{n/\log_\theta n}\xrightarrow{P}\frac12.n/logθ​nXn​​P​21​.

The second clause describes the supercritical case. If γθ>1\gamma\theta>1γθ>1, nk→∞n_k\to\inftynk​→∞, and {log⁡θnk}→ε\{\log_\theta n_k\}\to\varepsilon{logθ​nk​}→ε, then for each x>0x>0x>0,

P ⁣(nk−1/ρXnk<x)⟶1−Fλ(x) ⁣(((1−γ)x)−ρ),λ(x)=ε+log⁡1/γ((1−γ)x).P\!\left(n_k^{-1/\rho}X_{n_k}<x\right)\longrightarrow 1-F_{\lambda(x)}\!\left(((1-\gamma)x)^{-\rho}\right), \qquad \lambda(x)=\varepsilon+\log_{1/\gamma}((1-\gamma)x).P(nk−1/ρ​Xnk​​<x)⟶1−Fλ(x)​(((1−γ)x)−ρ),λ(x)=ε+log1/γ​((1−γ)x).

Both clauses are the goal. The milestones record the transform identity of Lemma (2.5), its approximation and scaling limits in Lemmas (2.6)–(2.7), the mirror passage-time limits of Lemma (2.10), and the ordinary passage-time limits of Theorem (2.18). The fractional part in the goal uses base θ\thetaθ; the two passage-time results use base 1/γ1/\gamma1/γ, exactly as printed Solomon 1975, pp. 12–19.

What the result gives

The critical law identifies the constant in the growth scale n/log⁡θnn/\log_\theta nn/logθ​n. The supercritical law shows that a single power normalization n1/ρn^{1/\rho}n1/ρ does not erase the logarithmic phase of the environment: the limiting distribution depends on the phase approached by the chosen subsequence. These assertions describe the position XnX_nXn​ itself, rather than only the time needed to reach a distant site. They complement the paper’s general speed theorem by resolving the zero-speed behavior in a concrete model Solomon 1975, Theorems (1.16) and (2.20).

The results are proved in the 1975 paper; the open work here is machine checking their definitions, statements, and proofs. The development also yields reusable interfaces for a nearest-neighbour chain specified by cylinder probabilities, first-passage times that can be infinite, and Laplace-transform arguments for random time changes. The mission’s statements currently compile locally with proof placeholders, so they are formalization targets rather than machine-checked theorems.

Where the difficulty lies

The one-way mirrors create independent, identically distributed blocks of crossing times, but those times have tails governed by the random spacing between mirrors. At γθ=1\gamma\theta=1γθ=1, their accumulation produces a logarithmic correction; at γθ>1\gamma\theta>1γθ>1, the underlying geometric scales preserve the fractional part of a logarithm. An ordinary law of large numbers for passage times therefore cannot supply both limits. Moreover, a limit for passage times to the random mirror positions VnV_nVn​ does not immediately give a limit for passage times to deterministic sites, and converting a passage-time limit into a position limit requires control of the inverse time change. The source separates these tasks across the milestone results Solomon 1975, pp. 11–20.

Formalization scope

The Lean environment is the pinned Mathlib revision 0df444a360eaa60ab8c11dca51a86af692955474. The position and environment are integer-indexed; time is natural-number-indexed. The one-way-mirror parameter range is θ>1\theta>1θ>1, 0<γ<10<\gamma<10<γ<1, γθ≥1\gamma\theta\ge1γθ≥1. The strict bounds on γ\gammaγ make both atom probabilities meaningful and the logarithm base 1/γ1/\gamma1/γ valid. The source uses these bounds implicitly. All probabilities concern the annealed joint law, not an arbitrary process with the same one-time marginals.

First-passage times are extended natural numbers, with infinity on paths that never hit the target. The real-valued limits convert finite passage times to real numbers; under the stated model, infinite passage times form a null event. The location of a nonexistent next mirror is assigned zero for a total Lean function, again only on a null event in this model. The Laplace transform of an infinite passage time is defined as zero. Convergence in probability uses TendstoInMeasure; convergence in law is expressed by convergence of distribution functions at continuity points. The limit-law family is constrained to probability measures supported on [0,∞)[0,\infty)[0,∞) with the exact transform (2.12), preventing a degenerate or unrelated choice of FFF.

A complete proof needs measurable cylinder laws, independence of the mirror gaps, hitting-time and transform calculations, asymptotics of one-sided and bilateral series, distributional convergence from Laplace transforms, and inversion from passage time to position. Work on any of these components is in scope. The statement keeps both source regimes and every constant; replacing the joint walk law by independent marginals or choosing an arbitrary limit distribution would change the theorem.

Selected references

  • Fred Solomon, Random Walks in a Random Environment, The Annals of Probability 3(1):1–31, 1975. DOI: 10.1214/aop/1176996444.
9 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Regenerative Stochastic Processes 4: Cumulative Processes on the Same Regeneration Points Are Jointly Asymptotically NormalResearch Paper

Motivation

Many quantities in queueing, inventory and reliability models are additive functionals of a regenerative process: the total work processed by a server up to time ttt, the cost accumulated by an inventory policy, the time a machine spends broken. Each such quantity grows by independent, identically distributed amounts over the cycles between successive regeneration points. W. L. Smith called these cumulative processes in Regenerative stochastic processes (Proc. R. Soc. Lond. A, 1955), the paper that introduced the term "regenerative process" and laid out its limit theory. Long-run averages of such quantities are estimated by simulation and by statistical observation of real systems. Confidence intervals for these estimates, and the regenerative method of simulation output analysis, rest on the central limit theorem for cumulative processes. When several quantities are estimated at once (a ratio of two rewards, a vector of costs), they rest on its joint version for several cumulative processes driven by the same regenerations.

Timeline:

  • 1949. Feller proves the central limit theorem for the renewal counting process.
  • 1952. Anscombe proves that a central limit theorem survives replacing the number of summands by a random index mtm_tmt​ with mt/ψ(t)→1m_t/\psi(t)\to 1mt​/ψ(t)→1 in probability, without independence between the index and the summands (Anscombe, Proc. Camb. Phil. Soc. 48, 1952).
  • 1955. Smith extends Anscombe's theorem to random vectors and deduces the univariate (Theorem 9, Corollary 9·1) and multivariate (Theorem 10) central limit theorems for cumulative processes (Smith 1955).

Setting

On a probability space (Ω,P)(\Omega, P)(Ω,P), let t1,t2,…t_1, t_2, \dotst1​,t2​,… be independent, identically distributed, non-negative random variables with P{t1=0}<1P\{t_1 = 0\} < 1P{t1​=0}<1 (a renewal process), and t0=0t_0 = 0t0​=0. The regeneration epochs are Tk=t0+t1+⋯+tkT_k = t_0 + t_1 + \dots + t_kTk​=t0​+t1​+⋯+tk​ (k≥0k \ge 0k≥0), and ntn_tnt​ is the number of epochs in [0,t][0,t][0,t] (in Smith's words, the greatest kkk with Tk−1≤tT_{k-1} \le tTk−1​≤t, where T−1=0T_{-1} = 0T−1​=0). Write μr=Et1r\mu_r = E t_1^rμr​=Et1r​.

A real process wtw_twt​ with w0=0w_0 = 0w0​=0 is a cumulative process if (C1) its cycle increments yn=Δnwt=wTn−wTn−1y_n = \Delta_n w_t = w_{T_n} - w_{T_{n-1}}yn​=Δn​wt​=wTn​​−wTn−1​​, n≥1n \ge 1n≥1, are i.i.d., and (C2) with probability one its paths have bounded variation on every finite interval. The variation process w~t=∫0t∣dwt∣\tilde w_t = \int_0^t |\mathrm d w_t|w~t​=∫0t​∣dwt​∣ has increments y~n=Δnw~t\tilde y_n = \Delta_n \tilde w_ty~​n​=Δn​w~t​. Moments are written κr=Eynr\kappa_r = E y_n^rκr​=Eynr​ and κ~r=Ey~n r\tilde\kappa_r = E \tilde y_n^{\,r}κ~r​=Ey~​nr​.

MMM cumulative processes wt(1),…,wt(M)w^{(1)}_t, \dots, w^{(M)}_twt(1)​,…,wt(M)​ are based on the same sequence of regeneration points when the cycle vectors (tn,yn(1),…,yn(M),y~n(1),…,y~n(M))(t_n, y^{(1)}_n, \dots, y^{(M)}_n, \tilde y^{(1)}_n, \dots, \tilde y^{(M)}_n)(tn​,yn(1)​,…,yn(M)​,y~​n(1)​,…,y~​n(M)​) are i.i.d. in nnn. Put κ1(i)=Ey1(i)\kappa^{(i)}_1 = E y^{(i)}_1κ1(i)​=Ey1(i)​. The covariance matrices are

akl=cov⁡(y1(k),y1(l)),bkl=cov⁡(y1(k)−κ1(k)μ1t1,  y1(l)−κ1(l)μ1t1).a_{kl} = \operatorname{cov}(y^{(k)}_1, y^{(l)}_1), \qquad b_{kl} = \operatorname{cov}\Big(y^{(k)}_1 - \tfrac{\kappa^{(k)}_1}{\mu_1} t_1,\; y^{(l)}_1 - \tfrac{\kappa^{(l)}_1}{\mu_1} t_1\Big).akl​=cov(y1(k)​,y1(l)​),bkl​=cov(y1(k)​−μ1​κ1(k)​​t1​,y1(l)​−μ1​κ1(l)​​t1​).

Formalization targets

Goal: Theorem 10

If μ1<∞\mu_1 < \inftyμ1​<∞ and E(y~1(i))2<∞E(\tilde y^{(i)}_1)^2 < \inftyE(y~​1(i)​)2<∞ for every iii, then as t→∞t \to \inftyt→∞

(wt(i)−κ1(i)nt(t/μ1)1/2)i=1M→ d N(0,a),\left(\frac{w^{(i)}_t - \kappa^{(i)}_1 n_t}{(t/\mu_1)^{1/2}}\right)_{i=1}^M \xrightarrow{\ d\ } \mathcal N(0, a),((t/μ1​)1/2wt(i)​−κ1(i)​nt​​)i=1M​ d ​N(0,a),

and if in addition μ2<∞\mu_2 < \inftyμ2​<∞,

(wt(i)−(κ1(i)/μ1) t(t/μ1)1/2)i=1M→ d N(0,b).\left(\frac{w^{(i)}_t - (\kappa^{(i)}_1/\mu_1)\,t}{(t/\mu_1)^{1/2}}\right)_{i=1}^M \xrightarrow{\ d\ } \mathcal N(0, b).((t/μ1​)1/2wt(i)​−(κ1(i)​/μ1​)t​)i=1M​ d ​N(0,b).

Milestones

  • The renewal strong law nt/t→1/μ1n_t/t \to 1/\mu_1nt​/t→1/μ1​ almost surely (§5·3).
  • Lemma 8: if μ1<∞\mu_1 < \inftyμ1​<∞ and κ~p<∞\tilde\kappa_p < \inftyκ~p​<∞, then (wt+Zt−wt)/t1/p→0(w_{t+Z_t} - w_t)/t^{1/p} \to 0(wt+Zt​​−wt​)/t1/p→0 almost surely, where Zt=∑1nt+1ti−tZ_t = \sum_1^{n_t+1} t_i - tZt​=∑1nt​+1​ti​−t.
  • Theorem B (Anscombe): P{∑1mtyi/(σψ(t)1/2)≤α}→Φ(α)P\{\sum_1^{m_t} y_i/(\sigma\psi(t)^{1/2}) \le \alpha\} \to \Phi(\alpha)P{∑1mt​​yi​/(σψ(t)1/2)≤α}→Φ(α) for i.i.d. centred yiy_iyi​ with variance σ2>0\sigma^2 > 0σ2>0 and mt/ψ(t)→1m_t/\psi(t) \to 1mt​/ψ(t)→1 in probability.
  • Its MMM-dimensional form (§5·4): ψ(t)−1/2∑1mtyj→dN(0,a)\psi(t)^{-1/2}\sum_1^{m_t} \mathbf y_j \xrightarrow{d} \mathcal N(0, a)ψ(t)−1/2∑1mt​​yj​d​N(0,a) for i.i.d. centred random vectors.
  • Theorem 9: if Ey1=0E y_1 = 0Ey1​=0 and var⁡y1=σ2>0\operatorname{var} y_1 = \sigma^2 > 0vary1​=σ2>0, then P{wt/(σ(t/μ1)1/2)≤α}→Φ(α)P\{w_t/(\sigma(t/\mu_1)^{1/2}) \le \alpha\} \to \Phi(\alpha)P{wt​/(σ(t/μ1​)1/2)≤α}→Φ(α).
  • Corollary 9·1: the univariate forms of both assertions of the goal, with normalisations σ=(κ2−κ12)1/2\sigma = (\kappa_2 - \kappa_1^2)^{1/2}σ=(κ2​−κ12​)1/2 and γ=var⁡(y1−(κ1/μ1)t1)\gamma = \operatorname{var}(y_1 - (\kappa_1/\mu_1)t_1)γ=var(y1​−(κ1​/μ1​)t1​).

Significance

Theorem 10 is the multivariate central limit theorem for regenerative processes. Its second assertion with M=2M = 2M=2 and the delta method gives the asymptotic normality of ratio estimators wt(1)/wt(2)w^{(1)}_t / w^{(2)}_twt(1)​/wt(2)​, the basis of the regenerative method of simulation output analysis. With wt=ntw_t = n_twt​=nt​, Corollary 9·1 recovers Feller's central limit theorem for renewal processes, which Smith points out (p. 9). The first assertion, with the random centring κ1nt\kappa_1 n_tκ1​nt​, needs only μ1<∞\mu_1 < \inftyμ1​<∞, which matters for heavy-tailed cycle lengths.

The results are classical and proved, and none of them is formalized. Mathlib has the central limit theorem for i.i.d. real sums with a deterministic number of terms and multivariate Gaussian laws, but no random-index central limit theorem, no renewal counting process and no regenerative process. A formal development would supply Anscombe's theorem (useful well beyond renewal theory, for sequential analysis and random sums), the renewal strong law and a reusable model of cumulative processes.

Difficulty

The obvious argument writes wtw_twt​ as the sum of the first ntn_tnt​ cycle increments plus a remainder and applies the classical central limit theorem. This fails at two points. First, the number of summands ntn_tnt​ is random and depends on the summands themselves (cycle lengths and rewards are typically dependent), so the classical theorem with a deterministic index does not apply and conditioning on ntn_tnt​ destroys the i.i.d. structure. Anscombe's theorem is needed exactly for this; it requires control of the partial sums uniformly over a window of indices around t/μ1t/\mu_1t/μ1​, not at a single index. Second, the remainder over the incomplete cycle at time ttt must be shown negligible on the scale t\sqrt tt​ using only a second moment of the cycle variation; Lemma 8 does this almost surely. For the vector statement, the scalar theorem must be lifted to convergence in distribution in RM\mathbb R^MRM with a possibly degenerate covariance matrix, where the scalar theorem's hypothesis σ>0\sigma > 0σ>0 can fail along some directions.

Formalization scope

  • Time is real; every limit is along t→∞t \to \inftyt→∞ in R\mathbb RR. Processes are functions w:R→Ω→Rw : \mathbb R \to \Omega \to \mathbb Rw:R→Ω→R (or a family indexed by Fin M); cycle lengths are a sequence N→Ω→R\mathbb N \to \Omega \to \mathbb RN→Ω→R with t0=0t_0 = 0t0​=0.
  • ntn_tnt​ is a natural number, the number of epochs Tj≤tT_j \le tTj​≤t; on the null event where infinitely many epochs are ≤t\le t≤t it is 000. Finiteness is never assumed.
  • w~t\tilde w_tw~t​ is the total variation (eVariationOn) of the path on [0,t][0,t][0,t], set to 000 for all ttt on paths of infinite variation, as Smith allows.
  • Condition (C1) is read for the whole cycle vector (tn,yn,y~n)(t_n, y_n, \tilde y_n)(tn​,yn​,y~​n​). No independence between components is assumed. Assuming the cycle length independent of the rewards, or the components independent, would make aaa diagonal or force bbb into a special form; that trivialization is ruled out.
  • "Jointly normally distributed with covariance matrix aaa" is TendstoInDistribution to multivariateGaussian 0 a on EuclideanSpace ℝ (Fin M). The matrices aaa and bbb are defined as covariance matrices, hence positive semidefinite, so the limit is a genuine (possibly degenerate) Gaussian law and not Mathlib's Dirac fallback for non-PSD input.
  • The scalar statements keep the paper's form: convergence of P{⋅≤α}P\{\cdot \le \alpha\}P{⋅≤α} to Φ(α)=\Phi(\alpha) =Φ(α)= cdf (gaussianReal 0 1) α for every real α\alphaα. The paper's implicit σ>0\sigma > 0σ>0 and γ>0\gamma > 0γ>0 are explicit hypotheses; without them the quotients are 000 in Lean and the statements would be false.
  • μ1<∞\mu_1 < \inftyμ1​<∞, μ2<∞\mu_2 < \inftyμ2​<∞ and Ey~2<∞E\tilde y^2 < \inftyEy~​2<∞ are Integrable hypotheses, never encoded through the value of an integral.

Contributions welcome: a proof of Anscombe's theorem from Mathlib's central limit theorem; the renewal strong law from strong_law_ae; measurability lemmas for ntn_tnt​ and w~t\tilde w_tw~t​; the Cramér–Wold step.

Selected references

  • W. L. Smith, Regenerative stochastic processes, Proc. R. Soc. Lond. A 232(1188):6–31, 1955. https://doi.org/10.1098/rspa.1955.0198
  • F. J. Anscombe, Large-sample theory of sequential estimation, Proc. Cambridge Philos. Soc. 48, 600, 1952 (cited in Smith 1955, p. 31).
  • W. Feller, Fluctuation theory of recurrent events, Trans. Amer. Math. Soc. 67, 98, 1949 (cited in Smith 1955, p. 31).
  • J. L. Doob, Renewal theory from the point of view of the theory of probability, Trans. Amer. Math. Soc. 63, 422, 1948 (cited in Smith 1955, p. 31).
9 thms2 active usersReviewed
Operations ResearchOptimizationProbability·Captain: mikedeng1

A 2-Approximation Algorithm for Stochastic Inventory Control Models with Lost Sales: The Dual-Balancing Policy Costs at Most Twice Any Nonanticipatory Policy under Independent DemandsResearch Paper

Motivation

Inventory systems in which unmet demand is lost, not backlogged, are the norm in retail: a customer who finds an empty shelf buys elsewhere. With a positive lead time LLL between ordering and delivery, the optimal policy for such a system depends on the entire pipeline of outstanding orders, so dynamic programming is intractable beyond small LLL. Optimal policies are not of base-stock type, and for decades no policy with a provable guarantee on its expected cost was known for this model.

Levi, Janakiraman and Nagarajan (Math. Oper. Res. 33(2), 2008) gave the first such guarantee. Their dual-balancing policy balances, in every period, the expected holding cost against the expected lost-sales penalty of the units ordered now, and it costs at most twice as much as an optimal policy.

Timeline.

  • 2007. Levi, Pál, Roundy and Shmoys (Math. Oper. Res. 32(2)) introduce marginal cost accounting and the dual-balancing policy for the backlogging model, with a worst-case guarantee of 2.
  • 2008. Levi, Janakiraman and Nagarajan extend the guarantee to lost sales (this mission). In their model the truncated inventory positions of the two policies can cross back and forth inside a lead time, which the backlogging argument never meets.
  • 2009. Huh, Janakiraman, Muckstadt and Rusmevichientong (Management Science, 2009) prove that order-up-to policies are asymptotically optimal in the lost-sales model as the penalty cost grows.
  • 2021 onward. Xin (Oper. Res., 2021; SSRN 7134538) analyses capped base-stock policies for i.i.d. lost-sales demand, culminating in a 2.33-approximation guarantee for that policy class, whose main theorem is proved on Prove2Me.

Page and display numbers in this mission refer to the authors' accepted manuscript (28 pages, pp. 1–28), not to the journal's pages 351–374.

Setting

Periods are t=1,…,Tt=1,\dots,Tt=1,…,T. An order Qs≥0Q_s\ge0Qs​≥0 placed in period sss arrives at the start of period s+Ls+Ls+L, where L≥1L\ge1L≥1 is an integer. Before the horizon there are x0≥0x_0\ge0x0​≥0 units on hand and pipeline orders Qj=qj≥0Q_j=q_j\ge0Qj​=qj​≥0 for 1−L≤j≤01-L\le j\le01−L≤j≤0. Demands D1,…,DT≥0D_1,\dots,D_T\ge0D1​,…,DT​≥0 have finite means. The information Fs\mathcal F_sFs​ available at the start of period sss contains D1,…,Ds−1D_1,\dots,D_{s-1}D1​,…,Ds−1​ and possibly more. A feasible policy chooses QsQ_sQs​ as an Fs\mathcal F_sFs​-measurable quantity.

The on-hand inventory ItI_tIt​ at the start of period ttt, after the arrival, satisfies I1=x0+Q1−LI_1=x_0+Q_{1-L}I1​=x0​+Q1−L​ and

It+1=(It−Dt)++Qt+1−L.I_{t+1}=(I_t-D_t)^+ + Q_{t+1-L}.It+1​=(It​−Dt​)++Qt+1−L​.

Demand (Dt−It)+(D_t-I_t)^+(Dt​−It​)+ is lost. Costs are a holding rate ht≥0h_t\ge0ht​≥0, a lost-sales penalty pt≥0p_t\ge0pt​≥0 and an ordering cost ct≥0c_t\ge0ct​≥0 per unit, where ptp_tpt​ and ctc_tct​ are non-increasing in ttt.

Marginal cost accounting. Under first-ordered-first-consumed bookkeeping, HsH_sHs​ is the ordering cost csQsc_sQ_scs​Qs​ plus the holding cost that the QsQ_sQs​ units incur until the end of the horizon, and Πs=ps+L(Ds+L−Is+L)+\Pi_s=p_{s+L}(D_{s+L}-I_{s+L})^+Πs​=ps+L​(Ds+L​−Is+L​)+ is the lost-sales penalty in the period in which they arrive. The cost of a policy PPP is

C(P)=∑s=1T−L(HsP+ΠsP).\mathcal C(P)=\sum_{s=1}^{T-L}\bigl(H^P_s+\Pi^P_s\bigr).C(P)=s=1∑T−L​(HsP​+ΠsP​).

It omits only costs that are the same for every policy.

The truncated inventory position of period sss with respect to t≤st\le st≤s is Yst=Is+∑j=s+1−LtQjY_{st}=I_s+\sum_{j=s+1-L}^{t}Q_jYst​=Is​+∑j=s+1−Lt​Qj​. For two policies BBB and PPP, the set TH\mathcal T_HTH​ holds the periods t≤T−Lt\le T-Lt≤T−L with YstB<YstPY^B_{st}<Y^P_{st}YstB​<YstP​ for every s∈[t,t+L]s\in[t,t+L]s∈[t,t+L], and TΠ\mathcal T_\PiTΠ​ holds the remaining periods t≤T−Lt\le T-Lt≤T−L.

A dual-balancing policy BBB orders, in each period t≤T−Lt\le T-Lt≤T−L, the amount that equalises the two conditional expectations

E[HtB∣Ft]=E[ΠtB∣Ft]=:Zt.E[H^B_t\mid\mathcal F_t]=E[\Pi^B_t\mid\mathcal F_t]=:Z_t.E[HtB​∣Ft​]=E[ΠtB​∣Ft​]=:Zt​.

Formalization targets

Goal: Theorem 3.1

If demands are independent, then for every feasible policy PPP

E[C(B)]≤2 E[C(P)].E[\mathcal C(B)]\le 2\,E[\mathcal C(P)].E[C(B)]≤2E[C(P)].

Comparing with every feasible PPP, rather than with an optimal policy, gives the guarantee without assuming that an optimum is attained.

Milestones, in attack order

  1. (11) For t≤s≤t+Lt\le s\le t+Lt≤s≤t+L, It+L=Yst−D[s,t+L)+∑r=st+L−1(Dr−Ir)+I_{t+L}=Y_{st}-D_{[s,t+L)}+\sum_{r=s}^{t+L-1}(D_r-I_r)^+It+L​=Yst​−D[s,t+L)​+∑r=st+L−1​(Dr​−Ir​)+.
  2. Lemma 3.2. On every sample path, ∑t∈THHtB≤∑tHtP\sum_{t\in\mathcal T_H}H^B_t\le\sum_{t}H^P_t∑t∈TH​​HtB​≤∑t​HtP​.
  3. Lemma 3.3. On every sample path, ∑t∈TΠΠtB≤∑tΠtP\sum_{t\in\mathcal T_\Pi}\Pi^B_t\le\sum_{t}\Pi^P_t∑t∈TΠ​​ΠtB​≤∑t​ΠtP​.
  4. (14) E[C(P)]≥E[∑t(1t∈THHtB+1t∈TΠΠtB)]E[\mathcal C(P)]\ge E\bigl[\sum_t(\mathbb 1_{t\in\mathcal T_H}H^B_t+\mathbb 1_{t\in\mathcal T_\Pi}\Pi^B_t)\bigr]E[C(P)]≥E[∑t​(1t∈TH​​HtB​+1t∈TΠ​​ΠtB​)].
  5. Lemma 3.1. E[C(B)]=2∑t=1T−LE[Zt]E[\mathcal C(B)]=2\sum_{t=1}^{T-L}E[Z_t]E[C(B)]=2∑t=1T−L​E[Zt​].
  6. Lemma 3.4. This lemma characterises the crossing events Ast=[YstB<YstP]∩[Ys+1,tB≥Ys+1,tP]A_{st}=[Y^B_{st}<Y^P_{st}]\cap[Y^B_{s+1,t}\ge Y^P_{s+1,t}]Ast​=[YstB​<YstP​]∩[Ys+1,tB​≥Ys+1,tP​].
  7. Lemmas 3.5 and 3.6. Under independence, conditioning on t∈THt\in\mathcal T_Ht∈TH​ (respectively t∈TΠt\in\mathcal T_\Pit∈TΠ​) does not lower the conditional expected holding (respectively lost-sales) cost of BBB below ZtZ_tZt​.

Significance

The result. The theorem gives a constant-factor guarantee for a lost-sales system with lead times, for arbitrary independent and non-identical demand distributions. The policy is computed online, one period at a time, from one-dimensional conditional expectations, which an optimal policy cannot be. The guarantee holds with time-dependent holding costs and with non-increasing ordering and penalty costs. Section 5 of the paper extends it to correlated demand structures, which are out of this mission's scope.

Formalizing it. The theorem is proved on paper and, to our knowledge, has no machine-checked proof. The mission produces the lost-sales dynamics, the truncated inventory position, marginal cost accounting and the sample-path amortization lemmas as reusable Lean objects. It also produces a formal treatment of the conditional-expectation step under independence, which the backlogging analysis does not need. The sibling mission on the backlogging model, LeviBalancing.DualBalancing, provides the shared instance and policy definitions that are reused here.

Difficulty

In the backlogging model, t∈THt\in\mathcal T_Ht∈TH​ is decided by information available at time ttt, so the cost comparison can be made period by period after conditioning on Ft\mathcal F_tFt​. With lost sales this fails: the truncated positions of BBB and of the benchmark can cross from below to above and back inside the window [t,t+L][t,t+L][t,t+L]. Whether t∈THt\in\mathcal T_Ht∈TH​ is therefore not known at time ttt, and conditioning on that event moves the conditional expectations of HtBH^B_tHtB​ and ΠtB\Pi^B_tΠtB​ away from ZtZ_tZt​. A newcomer's first idea, to reuse the backlogging argument with Ft\mathcal F_tFt​-measurable indicators, does not apply. The lost-sales penalty also cannot be charged period by period: Lemma 3.3 is a global amortization over intervals. The non-increasing penalties are what make that amortization possible when ptp_tpt​ varies.

Formalization scope

  • Periods are integers. The pipeline QjQ_jQj​, j≤0j\le0j≤0, is shared by every policy through the published order. Instance, cumDemand, order, DemandProcess and IsFeasiblePolicy are reused from LeviBalancing.DualBalancing. The new layer is one definition file, LostSalesBalancing.DualBalancing.Model.
  • Orders and demands are real (fractional orders, as in §3.1). The randomized integral-order variant is out of scope.
  • Cost generality is that of Theorem 3.1. Rates are only required to be ≥0\ge0≥0, which strengthens the paper's stationary h,p>0h,p>0h,p>0. Accordingly (11) is stated in lost units, and Lemma 3.4(iv) is stated as positive lost demand, not positive penalty.
  • Independence. The paper assumes independent demands but lets Fs\mathcal F_sFs​ hold more than past demands. The formalization requires Ft\mathcal F_tFt​ to be independent of (Dt,…,DT)(D_t,\dots,D_T)(Dt​,…,DT​) for every ttt, which for the natural filtration is exactly mutual independence. Finite means are integrability.
  • "OPT" becomes every feasible policy in Theorem 3.1, (14) and Lemmas 3.5–3.6. In the sample-path statements, (11) and Lemmas 3.2–3.4, it becomes every nonnegative order sequence.
  • Conditional events. Pr⁡(A∣F) E[X∣F,A]\Pr(A\mid\mathcal F)\,E[X\mid\mathcal F,A]Pr(A∣F)E[X∣F,A] is written E[1AX∣F]E[\mathbb 1_AX\mid\mathcal F]E[1A​X∣F], which never divides by a zero probability.
  • Expected costs are lower Lebesgue integrals in [0,∞][0,\infty][0,∞]. The dual-balancing predicate requires HtBH^B_tHtB​ and ΠtB\Pi^B_tΠtB​ to be integrable, so no conditional expectation takes Mathlib's default value 000.
  • Lemma 3.4(iii) is stated with Ds≥IsP−ΔQsD_s\ge I^P_s-\Delta Q_sDs​≥IsP​−ΔQs​. The printed strict inequality excludes a tie at which the event AstA_{st}Ast​ does occur.
  • A trivializing formalization is ruled out: the dual-balancing predicate and the independence hypothesis are jointly satisfiable with T>LT>LT>L (checked locally on an explicit instance), and no statement is meaningful only when T≤LT\le LT≤L, the case in which every cost is zero.

Contributions welcome: proofs of the sample-path lemmas, which need only finite sums and the recursion; the conditional-expectation lemmas, which need a Harris-type argument for independent coordinates; and the existence of a measurable balancing order, which this mission does not pose.

Selected references

  • R. Levi, G. Janakiraman, M. Nagarajan, A 2-Approximation Algorithm for Stochastic Inventory Control Models with Lost Sales, Mathematics of Operations Research 33(2), 351–374, 2008. https://doi.org/10.1287/moor.1070.0285
  • R. Levi, M. Pál, R. O. Roundy, D. B. Shmoys, Approximation Algorithms for Stochastic Inventory Control Models, Mathematics of Operations Research 32(2), 284–302, 2007. https://doi.org/10.1287/moor.1060.0205
  • W. T. Huh, G. Janakiraman, J. A. Muckstadt, P. Rusmevichientong, Asymptotic Optimality of Order-Up-To Policies in Lost Sales Inventory Systems, Management Science, 2009. https://doi.org/10.1287/mnsc.1080.0945
  • L. Xin, capped base-stock policies in lost-sales inventory models, Operations Research, 2021. https://doi.org/10.1287/opre.2020.2019
  • L. Xin, Capped Base-Stock Policies: A 2.33-Approximation, SSRN working paper 7134538, 2026. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=7134538
12 thms2 active usersReviewed
Probability·Captain: mikedeng1

The Two-Parameter Poisson–Dirichlet Distribution Derived from a Stable Subordinator 2: Wendel's Formula E[exp(−λ/V_n)] = e^{−λ} φ_α(λ)^{n−1} ψ_α(λ)^{−n} for PD(α, 0)Research Paper

Motivation

A random discrete distribution is a random sequence of nonnegative numbers summing to 111. Ranked in decreasing order, V1≥V2≥⋯V_1\ge V_2\ge\cdotsV1​≥V2​≥⋯, such sequences model the relative sizes of species in a population, of cycles of a random permutation, of excursion intervals of a Markov process, and of atoms of random measures used as priors in Bayesian nonparametrics. The two-parameter Poisson–Dirichlet family PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) is the main family of such laws; Pitman and Yor (Ann. Probab. 1997) derived its properties from a stable subordinator.

The special case PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), 0<α<10<\alpha<10<α<1, describes the ranked lengths of the excursion intervals of a stable(α\alphaα) subordinator's range, or of a Bessel process away from zero, up to time 111. A basic question about it is the law of a single ranked term VnV_nVn​. The answer goes through the Laplace transform of 1/Vn1/V_n1/Vn​:

  • Darling (1952) found the characteristic function of the limit of Sn/X(n,1)S_n/X_{(n,1)}Sn​/X(n,1)​ (sum over maximum of i.i.d. heavy-tailed variables), which is that of 1/V11/V_11/V1​.
  • Lamperti (1961) derived the corresponding Laplace transform from renewal theory, for n=1n=1n=1.
  • Wendel (1964) obtained the transform for every n≥2n\ge2n≥2 from the range of a stable subordinator.
  • Pitman and Yor (1997), Proposition 11, explained the formula through an exact decomposition of 1/Vn1/V_n1/Vn​ into independent, infinitely divisible pieces.

Setting

Fix 0<α<10<\alpha<10<α<1. Let Y~1,Y~2,…\tilde Y_1,\tilde Y_2,\dotsY~1​,Y~2​,… be independent, with Y~n\tilde Y_nY~n​ having the beta distribution beta(1−α,nα)\mathrm{beta}(1-\alpha,n\alpha)beta(1−α,nα) on (0,1)(0,1)(0,1). Form the stick-breaking sequence V~1=Y~1\tilde V_1=\tilde Y_1V~1​=Y~1​ and V~n=(1−Y~1)⋯(1−Y~n−1)Y~n\tilde V_n=(1-\tilde Y_1)\cdots(1-\tilde Y_{n-1})\tilde Y_nV~n​=(1−Y~1​)⋯(1−Y~n−1​)Y~n​ for n≥2n\ge2n≥2, and let V1≥V2≥⋯V_1\ge V_2\ge\cdotsV1​≥V2​≥⋯ be its terms in decreasing order. The law of (Vn)(V_n)(Vn​) is PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) (Definition 1 of the paper, with θ=0\theta=0θ=0).

From (Vn)(V_n)(Vn​) define Rn=Vn+1/VnR_n=V_{n+1}/V_nRn​=Vn+1​/Vn​, A0=0A_0=0A0​=0 and, for n≥1n\ge1n≥1,

An=V1+⋯+VnVn+1,Σn=Vn+1+Vn+2+⋯Vn.A_n=\frac{V_1+\cdots+V_n}{V_{n+1}},\qquad \Sigma_n=\frac{V_{n+1}+V_{n+2}+\cdots}{V_n}.An​=Vn+1​V1​+⋯+Vn​​,Σn​=Vn​Vn+1​+Vn+2​+⋯​.

For λ≥0\lambda\ge0λ≥0 the paper's two Laplace exponents are

ϕα(λ)=α∫1∞e−λxx−α−1 dx,ψα(λ)=1+α∫01(1−e−λx)x−α−1 dx,\phi_\alpha(\lambda)=\alpha\int_1^\infty e^{-\lambda x}x^{-\alpha-1}\,dx,\qquad \psi_\alpha(\lambda)=1+\alpha\int_0^1\left(1-e^{-\lambda x}\right)x^{-\alpha-1}\,dx,ϕα​(λ)=α∫1∞​e−λxx−α−1dx,ψα​(λ)=1+α∫01​(1−e−λx)x−α−1dx,

and ψα(λ)=Γ(1−α)λα+ϕα(λ)\psi_\alpha(\lambda)=\Gamma(1-\alpha)\lambda^\alpha+\phi_\alpha(\lambda)ψα​(λ)=Γ(1−α)λα+ϕα​(λ).

The proof represents (Vn)(V_n)(Vn​) through a Poisson random measure (PRM) Λα\Lambda_\alphaΛα​ on (0,∞)(0,\infty)(0,∞) with Λα(x,∞)=Cx−α\Lambda_\alpha(x,\infty)=Cx^{-\alpha}Λα​(x,∞)=Cx−α: its ranked points Δ1>Δ2>⋯\Delta_1>\Delta_2>\cdotsΔ1​>Δ2​>⋯ satisfy Xn:=CΔn−α=ε1+⋯+εnX_n:=C\Delta_n^{-\alpha}=\varepsilon_1+\cdots+\varepsilon_nXn​:=CΔn−α​=ε1​+⋯+εn​ with εi\varepsilon_iεi​ i.i.d. standard exponential, and Vn=Δn/∑mΔmV_n=\Delta_n/\sum_m\Delta_mVn​=Δn​/∑m​Δm​.

Formalization targets

Goal: Proposition 11

For every n≥1n\ge1n≥1,

1Vn=1+An−1+Σna.s.,\frac1{V_n}=1+A_{n-1}+\Sigma_n\quad\text{a.s.},Vn​1​=1+An−1​+Σn​a.s.,

where (i) An−1A_{n-1}An−1​ is distributed as the sum of n−1n-1n−1 independent copies of A1A_1A1​, with E[e−λAn−1]=ϕα(λ)n−1E[e^{-\lambda A_{n-1}}]=\phi_\alpha(\lambda)^{n-1}E[e−λAn−1​]=ϕα​(λ)n−1; (ii) Σn\Sigma_nΣn​ is distributed as the sum of nnn independent copies of Σ1\Sigma_1Σ1​, with E[e−λΣn]=ψα(λ)−nE[e^{-\lambda\Sigma_n}]=\psi_\alpha(\lambda)^{-n}E[e−λΣn​]=ψα​(λ)−n; (iii) An−1A_{n-1}An−1​ and Σn\Sigma_nΣn​ are independent.

Milestones

  • Proposition 10 (iii): Xn=LVn−αX_n=LV_n^{-\alpha}Xn​=LVn−α​, with L=lim⁡nVnαL=\lim nV_n^\alphaL=limnVnα​, are the arrival times of a unit Poisson process, and Vn=Xn−1/α/∑mXm−1/αV_n=X_n^{-1/\alpha}/\sum_mX_m^{-1/\alpha}Vn​=Xn−1/α​/∑m​Xm−1/α​.
  • Lemma 24 (i)–(ii): CΔn−αC\Delta_n^{-\alpha}CΔn−α​ is gamma(n)(n)(n); the ratios Δi/Δn\Delta_i/\Delta_nΔi​/Δn​, i<ni<ni<n, are the order statistics of n−1n-1n−1 i.i.d. variables of density αx−α−1\alpha x^{-\alpha-1}αx−α−1 on (1,∞)(1,\infty)(1,∞), independent of (Δn,Δn+1,… )(\Delta_n,\Delta_{n+1},\dots)(Δn​,Δn+1​,…).
  • (66): P(A1∈dx)=αx−α−1dx 1(x>1)P(A_1\in dx)=\alpha x^{-\alpha-1}dx\,1(x>1)P(A1​∈dx)=αx−α−1dx1(x>1).
  • (67): E[e−λΣn∣Δ1,…,Δn]=exp⁡(−Δn−α∫01(1−e−λu)Λα(du))E[e^{-\lambda\Sigma_n}\mid\Delta_1,\dots,\Delta_n]=\exp\left(-\Delta_n^{-\alpha}\int_0^1(1-e^{-\lambda u})\Lambda_\alpha(du)\right)E[e−λΣn​∣Δ1​,…,Δn​]=exp(−Δn−α​∫01​(1−e−λu)Λα​(du)).
  • Proposition 8: the RnR_nRn​ are independent and Rn∼beta(nα,1)R_n\sim\mathrm{beta}(n\alpha,1)Rn​∼beta(nα,1).
  • (34): ψα(λ)=Γ(1−α)λα+ϕα(λ)\psi_\alpha(\lambda)=\Gamma(1-\alpha)\lambda^\alpha+\phi_\alpha(\lambda)ψα​(λ)=Γ(1−α)λα+ϕα​(λ).

Consequence: Corollary 12 (Wendel's formula)

E[exp⁡(−λ/Vn)]=e−λ ϕα(λ)n−1 ψα(λ)−n(λ≥0).E\left[\exp(-\lambda/V_n)\right]=e^{-\lambda}\,\phi_\alpha(\lambda)^{n-1}\,\psi_\alpha(\lambda)^{-n}\qquad(\lambda\ge0).E[exp(−λ/Vn​)]=e−λϕα​(λ)n−1ψα​(λ)−n(λ≥0).

Significance

The result. Proposition 11 turns 1/Vn1/V_n1/Vn​ into the sum of the constant 111 and two independent variables, each a sum of i.i.d. pieces with explicit Laplace exponents. Wendel's formula (38) is a one-line consequence, and since 1/Vn>01/V_n>01/Vn​>0 it determines the law of VnV_nVn​. The same decomposition is reused later in the paper: Proposition 26 combines (35) and (67) into a conditional form of (38) given R1,…,Rn−1R_1,\dots,R_{n-1}R1​,…,Rn−1​ and XnX_nXn​, which the paper uses in later calculations.

Formalizing it. All results here are proved in the paper; none is machine-checked. A formal proof needs the Poisson representation of PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) (Proposition 10, itself resting on Perman–Pitman–Yor 1992), elementary but non-trivial facts about Poisson arrival times (gamma laws, order statistics, independence of ratios), and a conditional Laplace functional of a Poisson process. Each milestone is a self-contained target; Lemma 24 and (67) are statements about Poisson arrival times only and do not mention Poisson–Dirichlet laws.

Difficulty

The identity 1/Vn=1+An−1+Σn1/V_n=1+A_{n-1}+\Sigma_n1/Vn​=1+An−1​+Σn​ is algebra once ∑mVm=1\sum_mV_m=1∑m​Vm​=1. The content is in the laws. On the stick-breaking side, the VnV_nVn​ are the order statistics of a dependent sequence, and neither An−1A_{n-1}An−1​ nor Σn\Sigma_nΣn​ has an evident structure: the ranking destroys the independence of the Y~n\tilde Y_nY~n​. The proof passes to the Poisson side, where the ranked points of a PRM have tractable conditional laws, and then must transport the conclusions back through a representation that holds only in distribution. Part (ii) requires a conditional computation (67) given nnn points, followed by integration against a gamma law; part (iii) requires the mutual independence of all the ratios RnR_nRn​, an infinite family.

Formalization scope

The Lean development lives in namespace PoissonDirichlet.Wendel; its definitions file contains every object above.

  • Sequences are 0-based: V ω k is Vk+1V_{k+1}Vk+1​, Aseq (V ω) k is AkA_kAk​, Sigseq (V ω) k is Σk+1\Sigma_{k+1}Σk+1​, ratio (V ω) k is Rk+1R_{k+1}Rk+1​. Exponents n−1n-1n−1 and nnn become k and k + 1.
  • PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) is Definition 1 with θ=0\theta=0θ=0. The law of (Y~n)(\tilde Y_n)(Y~n​) is a probability measure on sequences with independent coordinates of the stated beta laws. "VVV has law PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0)" means P(V∈s)P(V\in s)P(V∈s) equals the mass of the preimage of sss under the ranked stick-breaking map, for every measurable sss. Ranked values are defined with the extended cardinal Set.encard.
  • AnA_nAn​ and Σn\Sigma_nΣn​ are the VVV-quotients of (31)–(32), not the RRR-expressions; ϕα,ψα\phi_\alpha,\psi_\alphaϕα​,ψα​ are the integrals (33)–(34), not Laplace transforms.
  • "Distributed as the sum of mmm independent copies of XXX" is equality with the mmm-fold convolution power of the law of XXX, the Dirac mass at 000 when m=0m=0m=0.
  • Every statement carries 0<α<10<\alpha<10<α<1 except Lemma 24, which holds for all α>0\alpha>0α>0.
  • The local time LLL of (24) is a random variable with the hypothesis that nVnα→LnV_n^\alpha\to LnVnα​→L almost surely; this is its definition.
  • The PRM is used only through its ranked points, encoded by arrival times: Δn=(C/Xn)1/α\Delta_n=(C/X_n)^{1/\alpha}Δn​=(C/Xn​)1/α with Xn=ε1+⋯+εnX_n=\varepsilon_1+\cdots+\varepsilon_nXn​=ε1​+⋯+εn​, εi\varepsilon_iεi​ i.i.d. standard exponential. This is the paper's own (27)–(28). In (67) the εi\varepsilon_iεi​ are also assumed measurable, so that the conditioning σ\sigmaσ-algebra is a sub-σ\sigmaσ-algebra.
  • Lemma 24 (iii) is not stated; its only use is (67), which is stated. Corollary 12 states only the formula (38).

The formalization does not use Measure.map of a possibly non-measurable map in any definition: every equality of laws for such maps is stated through preimages. It does not use Set.ncard or limUnder. Every Laplace transform is the integral of a function with values in (0,1](0,1](0,1], and both exponent integrals are integrable under the stated parameter range, so no statement holds because an integral takes the junk value 000.

Useful infrastructure beyond this mission: arrival times of a Poisson process and their gamma and order-statistic laws; convolution powers of measures on R\mathbb RR; the Laplace functional of a Poisson random measure. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator, Ann. Probab. 25(2):855–900, 1997. https://doi.org/10.1214/aop/1024404422
  • M. Perman, J. Pitman and M. Yor, Size-biased sampling of Poisson point processes and excursions, Probab. Theory Related Fields 92:21–39, 1992.
  • J. G. Wendel, Zero-free intervals of semi-stable Markov processes, Math. Scand. 14:21–34, 1964.
  • J. Lamperti, A contribution to renewal theory, Proc. Amer. Math. Soc. 12:724–731, 1961.
  • D. A. Darling, The influence of the maximum term in the addition of independent random variables, Trans. Amer. Math. Soc. 73:95–107, 1952.
9 thms2 active usersReviewed
Probability·Captain: mikedeng1

The Two-Parameter Poisson–Dirichlet Distribution Derived from a Stable Subordinator 1: Under PD(α, 0) the Ratios V_{n+1}/V_n Are Independent with beta(nα, 1) LawsResearch Paper

Motivation

Random partitions describe a population split into species, clusters, or types. If the species frequencies are put in decreasing order, the first frequency is the largest species, the second is the next largest, and so on. The Poisson–Dirichlet distribution gives a family of laws for these ranked frequencies. Its two parameters connect different random partition models, while the one-parameter case PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) has a particularly direct description through ratios of neighboring frequencies. Pitman and Yor state that these ratios are independent and have explicit beta distributions, even though the ranked frequencies themselves have a complicated joint law (Pitman and Yor 1997, Proposition 8).

The result matters when a statistic of a random partition depends on the relative sizes of its largest components. A ratio Vn+1/VnV_{n+1}/V_nVn+1​/Vn​ describes the gap between two successive ranked species without requiring their total scale. An independent sequence of such ratios also gives a way to generate the entire ranked sequence. The paper records this converse immediately after Proposition 8 as Corollary 9 (Pitman and Yor 1997, p. 862).

Setting

Fix 0<α<10<\alpha<10<α<1. A beta(a,b)(a,b)(a,b) distribution is a probability distribution on (0,1)(0,1)(0,1) with density proportional to xa−1(1−x)b−1x^{a-1}(1-x)^{b-1}xa−1(1−x)b−1. Let Y~n\widetilde Y_nYn​, for n=1,2,…n=1,2,\ldotsn=1,2,…, be independent beta(1−α,nα)(1-\alpha,n\alpha)(1−α,nα) random variables. They break an initial mass of one into successive stick lengths

V~n=Y~n∏i=1n−1(1−Y~i).\widetilde V_n=\widetilde Y_n\prod_{i=1}^{n-1}(1-\widetilde Y_i).Vn​=Yn​i=1∏n−1​(1−Yi​).

Sort these lengths in decreasing order, counting repeated values separately, and write the resulting sequence as V1≥V2≥⋯V_1\geq V_2\geq\cdotsV1​≥V2​≥⋯. The law of this ranked sequence is PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), the θ=0\theta=0θ=0 case of Definition 1 in the paper (Pitman and Yor 1997, p. 857). The paper's broader definition takes 0≤α<10\leq\alpha<10≤α<1 and θ>−α\theta>-\alphaθ>−α, with beta(1−α,θ+nα)(1-\alpha,\theta+n\alpha)(1−α,θ+nα) stick factors. This mission retains that general definition so later statements use the same object, but its theorems concern θ=0\theta=0θ=0 and 0<α<10<\alpha<10<α<1.

Define the adjacent ranked ratio Rn=Vn+1/VnR_n=V_{n+1}/V_nRn​=Vn+1​/Vn​. The source proves that the ranked masses are strictly positive almost surely under the Poisson–Dirichlet law, so these ratios have their ordinary probabilistic meaning (Pitman and Yor 1997, Proposition 2). The random sequence R1,R2,…R_1,R_2,\ldotsR1​,R2​,… is different from the independent stick factors Y~n\widetilde Y_nYn​: the latter are defined before ranking, whereas each RnR_nRn​ compares consecutive masses after ranking.

Formalization targets

Goal: Proposition 8

For a sequence (Vn)(V_n)(Vn​) with PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) law, the variables Rn=Vn+1/VnR_n=V_{n+1}/V_nRn​=Vn+1​/Vn​ are mutually independent, and each has beta(nα,1)(n\alpha,1)(nα,1) distribution. The equivalent cumulative distribution formula is part of the target:

P(Rn≤r)=rnα(n≥1, 0≤r≤1).\mathbb P(R_n\leq r)=r^{n\alpha}\qquad(n\geq1,\ 0\leq r\leq1).P(Rn​≤r)=rnα(n≥1, 0≤r≤1).

The exponent and beta parameter use the paper's one-based nnn. Independence concerns the full infinite family, rather than only pairs of ratios (Pitman and Yor 1997, Proposition 8, equations (21)–(22)).

Supporting targets

Proposition 10(i) establishes a local-time limit L=lim⁡n→∞nVnαL=\lim_{n\to\infty}nV_n^\alphaL=limn→∞​nVnα​, both almost surely and in LpL^pLp for every real p≥1p\geq1p≥1. Proposition 10(iii) identifies the transformed sequence Xn=LVn−αX_n=LV_n^{-\alpha}Xn​=LVn−α​ with the arrival times of a unit-rate Poisson process: it has the joint law of partial sums of independent standard exponential variables. The proposition also recovers VnV_nVn​ by normalizing Xn−1/αX_n^{-1/\alpha}Xn−1/α​. Finally, the proof of Proposition 8 states that consecutive Poisson arrival ratios Xn/Xn+1X_n/X_{n+1}Xn​/Xn+1​ are independent beta(n,1)(n,1)(n,1) variables (Pitman and Yor 1997, pp. 862, 870). These are the three curated milestones. Corollary 9 is included as a companion: independent beta(nα,1)(n\alpha,1)(nα,1) ratios, inserted into the paper's convergent series and finite products, produce a PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) sequence.

Significance

Proposition 8 converts a statement about the order statistics of infinitely many dependent masses into an explicit product law for their ratios. It gives direct distributional information about every neighboring pair in a Poisson–Dirichlet partition. Together with Corollary 9, it specifies both how to read the ratios from a ranked partition and how to reconstruct a ranked partition from ratios. The formulas can therefore serve as a common interface for calculations and simulation involving PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) (Pitman and Yor 1997, Propositions 8–10).

The mathematical results in this mission were proved in the 1997 paper; the open work here is a machine-checked Lean proof of their stated forms. Such a development would add reusable facts about infinite beta sequences, ranked stick lengths, Poisson arrival times, and their joint laws. The independent-arrival-ratio statement is useful beyond the Poisson–Dirichlet setting because its assumptions only concern standard exponential increments.

Difficulty

The stick factors are independent before their lengths are sorted, but sorting is a global operation: a particular ranked mass may have come from any stick index. Their independence therefore does not directly give independence of adjacent ranked ratios. Even a marginal calculation for one ratio does not establish mutual independence of the entire sequence. The local-time and arrival-time assertions in Proposition 10 encode the extra structure needed to state the joint result. The real technical burden is to relate the distribution obtained from ranked stick lengths to the distribution of an infinite Poisson arrival sequence, while retaining the almost-sure limits and normalization stated by the authors.

Formalization scope

Lean represents every sequence as a function N→R\mathbb N\to\mathbb RN→R, with index k=0k=0k=0 denoting the paper's first index n=1n=1n=1. stick implements equation (4); ranked defines the (k+1)(k+1)(k+1)-st largest nonnegative length by upper-level-set cardinality, counted with multiplicity. It uses extended cardinality so an infinite upper-level set cannot be assigned cardinality zero. IsStickLaw records independence and the beta(1−α,θ+(k+1)α)(1-\alpha,\theta+(k+1)\alpha)(1−α,θ+(k+1)α) coordinate laws. HasPD describes the distribution of the ranked stick sequence by probabilities of measurable preimages. This commits the mission to Definition 1 rather than a ratio construction of PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0).

All mission theorems require 0<α<10<\alpha<10<α<1, and every source probability space is a probability measure. Ratios and negative real powers occur only as random quantities whose bases are positive almost surely under that law. Their exceptional values on null sets do not affect the distributional claims. The local time is identified by its almost-sure defining limit, rather than by a default value assigned when a limit fails. The LpL^pLp clause uses the norm of the approximation error. The Poisson arrival law is stated jointly on measurable sets of infinite real sequences; it is not reduced to one-dimensional exponential marginals. These choices rule out vacuous interpretations through a nonmeasurable Measure.map, a finite-cardinality default on an infinite set, a junk integral, limUnder at a nonexistent limit, or a dropped parameter range.

The development needs Mathlib's beta and exponential measures, infinite product and independence APIs, measurable sequence spaces, real powers, infinite sums, and LpL^pLp norms. Results about ranked values and arrival ratios would be reusable in later Poisson–Dirichlet missions. Contributions that establish these source statements at full strength, or their necessary measurable and summability infrastructure, fit the scope.

Selected references

  • J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator, Annals of Probability 25(2):855–900, 1997. DOI: 10.1214/aop/1024404422.
5 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Shock Models and Wear Processes II: If the Probabilities of Surviving k Shocks Have Decreasing Successive Ratios, the Poisson Shock Life Distribution Is IHRResearch Paper

Motivation

A component may be exposed to shocks that arrive at random times. Its chance of lasting for a given time depends both on how often shocks arrive and on how likely it is to survive successive shocks. Reliability calculations often begin with the latter, discrete sequence, while replacement and life-testing questions concern the resulting lifetime distribution. Esary, Marshall, and Proschan study how a property imposed on the shock sequence appears in the continuous lifetime law. Their Theorem 3.1 gives several such inheritance results; this mission targets its increasing-hazard-rate assertion (Esary, Marshall, and Proschan 1973, Theorem 3.1).

An increasing hazard rate (IHR) means that the remaining life of a component that has survived to age ttt becomes stochastically shorter as ttt increases. This is a concrete way to express wear-out. The paper treats “increasing” as weakly increasing throughout, so a constant hazard rate is included (Esary, Marshall, and Proschan 1973, pp. 628, 631).

Setting

Shocks arrive according to a homogeneous Poisson process with rate λ>0\lambda>0λ>0. Let Pˉk\bar P_kPˉk​ be the probability that the component survives the first kkk shocks. The sequence starts at k=0k=0k=0 and satisfies 1=Pˉ0≥Pˉ1≥⋯≥01=\bar P_0\geq\bar P_1\geq\cdots\geq01=Pˉ0​≥Pˉ1​≥⋯≥0 for the target theorem. The probability of failure on the (k+1)(k+1)(k+1)st shock is pk+1=Pˉk−Pˉk+1p_{k+1}=\bar P_k-\bar P_{k+1}pk+1​=Pˉk​−Pˉk+1​. At a nonnegative time ttt, the chance of exactly kkk shock arrivals is wk(t)=e−λt(λt)k/k!w_k(t)=e^{-\lambda t}(\lambda t)^k/k!wk​(t)=e−λt(λt)k/k!. The survival function of the component is therefore the Poisson mixture

Hˉ(t)=∑k=0∞Pˉkwk(t),t≥0,\bar H(t)=\sum_{k=0}^{\infty}\bar P_k w_k(t),\qquad t\geq0,Hˉ(t)=k=0∑∞​Pˉk​wk​(t),t≥0,

and the paper sets Hˉ(t)=1\bar H(t)=1Hˉ(t)=1 for t<0t<0t<0. At positive times its density is h(t)=λ∑k≥0pk+1wk(t)h(t)=\lambda\sum_{k\geq0}p_{k+1}w_k(t)h(t)=λ∑k≥0​pk+1​wk​(t). The failure-on-shock sequence and the positive-time density are both part of the mission because the paper compares their shape as well (Esary, Marshall, and Proschan 1973, (2.1)–(2.3)).

A nonnegative sequence is PF₂ here when its successive ratios decrease weakly, wherever those ratios are defined. For the survival probabilities this says θk=Pˉk/Pˉk−1\theta_k=\bar P_k/\bar P_{k-1}θk​=Pˉk​/Pˉk−1​ decreases with k≥1k\geq1k≥1. A survival function is IHR when, for each x>0x>0x>0, the survival ratio Hˉ(t+x)/Hˉ(t)\bar H(t+x)/\bar H(t)Hˉ(t+x)/Hˉ(t) decreases with age ttt wherever it is defined. These are the discrete and continuous conditions connected by the target (Esary, Marshall, and Proschan 1973, Definition 2.3 and p. 631).

Formalization targets

Increasing hazard rate from PF₂ shock survival

The goal is Theorem 3.1(3.2):

(Pˉk)k≥0 is PF2⟹Hˉ is IHR.(\bar P_k)_{k\geq0}\text{ is PF}_2 \quad\Longrightarrow\quad \bar H\text{ is IHR}.(Pˉk​)k≥0​ is PF2​⟹Hˉ is IHR.

It covers any nonnegative, weakly decreasing shock-survival sequence with Pˉ0=1\bar P_0=1Pˉ0​=1 and a positive Poisson rate. It does not fix a finite number of shocks or a special survival law (Esary, Marshall, and Proschan 1973, p. 632).

Density and hazard estimates

The milestone list includes the positive-time density formula (2.3), the upper bound h(t)/Hˉ(t)≤λh(t)/\bar H(t)\leq\lambdah(t)/Hˉ(t)≤λ in (2.5), the derivative estimate h′(t)≥−λh(t)h'(t)\geq-\lambda h(t)h′(t)≥−λh(t) from the proof of (3.1), and that proof's sign-change claim for h(t)−ce−θth(t)-ce^{-\theta t}h(t)−ce−θt. It culminates in Theorem 3.1(3.1), which says that PF₂ failure-on-shock probabilities give a PF₂ positive-time density. These are statements made explicitly by the authors and form the neighboring shape result and the estimates cited in the proof of the IHR goal (Esary, Marshall, and Proschan 1973, pp. 628–629, 632–633).

Further results of the paper

The mission also poses, outside the milestone list, the other inheritance results of the same section and of §6 whose formulation uses the same objects:

∑j≥kPˉj/Pˉk decreasing ⇒ H DMRL(3.3),Pˉk∑j≥0Pˉj≥∑j≥kPˉj ⇒ H NBUE(3.6),Pˉk/Pˉk−1 increasing ⇒ H DHR(Theorem 3.2 (3.8)),Sk≥0 ⇒ Hˉ IHR(Theorem 3.3),\begin{aligned} &\textstyle\sum_{j\ge k}\bar P_j/\bar P_k\ \text{decreasing}\ \Rightarrow\ H\ \text{DMRL}\quad(3.3),\qquad \bar P_k\sum_{j\ge0}\bar P_j\ge\sum_{j\ge k}\bar P_j\ \Rightarrow\ H\ \text{NBUE}\quad(3.6),\\ &\bar P_k/\bar P_{k-1}\ \text{increasing}\ \Rightarrow\ H\ \text{DHR}\quad\text{(Theorem 3.2 (3.8))},\qquad S_k\ge0\ \Rightarrow\ \bar H\ \text{IHR}\quad\text{(Theorem 3.3)}, \end{aligned}​∑j≥k​Pˉj​/Pˉk​ decreasing ⇒ H DMRL(3.3),Pˉk​∑j≥0​Pˉj​≥∑j≥k​Pˉj​ ⇒ H NBUE(3.6),Pˉk​/Pˉk−1​ increasing ⇒ H DHR(Theorem 3.2 (3.8)),Sk​≥0 ⇒ Hˉ IHR(Theorem 3.3),​

where Sk=∑j=0k(kj)[Pˉj+1Pˉk−j+1−PˉjPˉk−j+2]S_k=\sum_{j=0}^k\binom kj[\bar P_{j+1}\bar P_{k-j+1}-\bar P_j\bar P_{k-j+2}]Sk​=∑j=0k​(jk​)[Pˉj+1​Pˉk−j+1​−Pˉj​Pˉk−j+2​] is the condition of Murthy and Lientz, strictly weaker than PF₂. Theorem 6.1 specializes to independent shock magnitudes, Pˉk=∏i=1kFi(x)\bar P_k=\prod_{i=1}^kF_i(x)Pˉk​=∏i=1k​Fi​(x) (exponential, IHR or DHR as Fi(x)F_i(x)Fi​(x) is constant, decreasing or increasing in iii), and Theorem 6.2 shows that a random threshold, Pˉk=∫0∞[F(x)]k dG(x)\bar P_k=\int_0^\infty[F(x)]^k\,dG(x)Pˉk​=∫0∞​[F(x)]kdG(x), always gives a logarithmically convex density on (0,∞)(0,\infty)(0,∞) (Esary, Marshall, and Proschan 1973, pp. 632, 634, 647).

Significance

The target makes a discrete reliability assumption useful for continuous-time decisions. One may model or estimate the sequence Pˉk\bar P_kPˉk​ from how the component responds to successive shocks and then infer an ageing property of its lifetime under Poisson arrivals. The conclusion is about residual lifetime at every age, not just its mean or one tail probability. The companion PF₂-density statement shows that the same transfer applies to failure-on-shock probabilities and the resulting continuous density (Esary, Marshall, and Proschan 1973, Theorem 3.1).

The 1973 results are proved in the paper. In this mission the Lean statements compile as open theorems; their mathematical proofs are still to be formalized. A completed development would make the Poisson-series model, its density, and the discrete-to-continuous shape claims reusable in later formalizations of shock and wear models. The other missions in this paper's series consider cumulative damage, first passage under wear, and random thresholds using related ideas.

Difficulty

The survival function mixes infinitely many shock counts. Each count has its own time-dependent Poisson weight, so a decreasing ratio of adjacent Pˉk\bar P_kPˉk​ terms does not give the desired comparison of survival ratios by a termwise inequality. The paper invokes a variation-diminishing property of a totally positive Poisson kernel for the corresponding shape arguments (Esary, Marshall, and Proschan 1973, p. 633). A formal proof must also justify differentiation and rearrangement of the infinite series, including sequences that reach zero after finitely many shocks.

Formalization scope

The Lean model uses real-valued functions for Pˉk\bar P_kPˉk​, Hˉ\bar HHˉ, and hhh, with the shock count indexed from zero. The Poisson mixture is the definition of Hˉ\bar HHˉ; no random lifetime is introduced in place of it. The value Hˉ(t)=1\bar H(t)=1Hˉ(t)=1 for negative time follows (2.1). IHR is expressed for all real ages s≤ts\leq ts≤t by cross-multiplying the survival-ratio comparison. With Pˉ0=1\bar P_0=1Pˉ0​=1, this includes the boundary at zero without an atom there. PF₂ sequence and density conditions are also cross-multiplied. This gives the paper's ratio statements wherever denominators are positive and retains the natural zero-survival cases without using real division by zero.

The source treats Pˉk\bar P_kPˉk​ as probabilities, takes λ>0\lambda>0λ>0, and restricts variables to avoid zero denominators; Lean states the rate, nonnegativity, weak monotonicity, and the ratio convention explicitly. Formula (2.3) is represented by the derivative identity Hˉ′=−h\bar H'=-hHˉ′=−h at positive time. The bound (2.5) is h≤λHˉh\leq\lambda\bar Hh≤λHˉ, equivalent to the hazard-rate statement wherever survival is positive. The sign-change milestone excludes a strict positive–negative–positive pattern at increasing positive times, matching the authors' “at most two, in the order negative, positive, negative” wording. These conventions prevent an empty IHR statement or a trivial result caused by totalized division.

A complete proof needs reusable facts about convergence and differentiation of Poisson-weighted series and about preservation of sign patterns under the Poisson kernel. Contributions to that infrastructure, the density and hazard estimates, and the PF₂ transfer are in scope, as are the further results above. For those, the reversed classes are stated on the life-distribution domain: DHR compares ages 0≤s≤t0\le s\le t0≤s≤t only, because Theorem 3.2 allows Pˉ0<1\bar P_0<1Pˉ0​<1, an atom at the origin; a logarithmically convex density is the reversed cross-multiplied PF₂ inequality for hhh on (0,∞)(0,\infty)(0,∞). Mean residual lives and mean lives are computed in [0,∞][0,\infty][0,∞] (they are infinite when ∑kPˉk=∞\sum_k\bar P_k=\infty∑k​Pˉk​=∞), and their ratios are taken only where Hˉ(t)>0\bar H(t)>0Hˉ(t)>0. In Theorem 6.1 only the numbers Fi(x)∈[0,1]F_i(x)\in[0,1]Fi​(x)∈[0,1] enter, and "exponential" includes the rate 000; in Theorem 6.2 the shock and threshold laws are probability measures on R\mathbb RR with no mass on (−∞,0)(-\infty,0)(−∞,0). The paper's further remark that a survival function needs Pˉk→0\bar P_k\to0Pˉk​→0 is not imposed: none of the theorems uses it.

Selected references

  • J. D. Esary, A. W. Marshall, and F. Proschan, Shock Models and Wear Processes, The Annals of Probability 1(4), 627–649, 1973. DOI: 10.1214/aop/1176996891.
  • S. Karlin, Total Positivity, Vol. I, Stanford University Press, 1968 (the variation-diminishing property cited on p. 633 of the paper).
  • R. E. Barlow and F. Proschan, Mathematical Theory of Reliability, Wiley, 1965 (IHR and DHR distributions in reliability).
8 thms2 active usersReviewed
AnalysisHarmonic AnalysisProbability·Captain: mikedeng1

Distribution Function Inequalities for Martingales 3: For Brownian Motion Stopped at Any Stopping Time τ, EΦ(X*(τ)) and EΦ(τ^{1/2}) Are ComparableResearch Paper

Motivation

The size of a martingale can be measured in two ways: by its maximal function, the largest absolute value it reaches, and by a quadratic quantity that records how much it has moved, the square function in discrete time or the elapsed time in the case of Brownian motion. The Burkholder–Davis–Gundy inequalities say that these two measurements are comparable in every LpL^pLp norm and, more generally, under EΦ(⋅)E\Phi(\cdot)EΦ(⋅) for every Φ\PhiΦ of moderate growth. They are a basic tool of stochastic analysis, harmonic analysis and the theory of stochastic integration.

D. L. Burkholder's 1971 Wald Memorial Lectures, published as Distribution Function Inequalities for Martingales (Ann. Probability 1 (1973)), organise these results around one device: a distribution function inequality ("good-λ\lambdaλ" inequality) between two random variables, which a single lemma then converts into integral inequalities for all Φ\PhiΦ of moderate growth. The paper opens its second chapter with "a particularly easy but important special case": Brownian motion stopped at an arbitrary stopping time. This mission formalizes that case, §§6–8 of the paper.

Timeline. Burkholder proved the LpL^pLp square-function inequalities for martingales, 1<p<∞1<p<\infty1<p<∞, in 1966 (Ann. Math. Statist. 37); B. Davis extended the comparison of the maximal and square functions to p=1p=1p=1 in 1970 (Israel J. Math. 8); Burkholder and R. F. Gundy introduced the extrapolation method for operators on martingales in 1970 (Acta Math. 124); Burkholder, Davis and Gundy proved two-sided Φ\PhiΦ inequalities in 1972 (Proc. Sixth Berkeley Symp. 2, 223–240), the Brownian case being their Theorem 7.2, under the additional assumption that Φ\PhiΦ is the integral of a function that itself satisfies a growth condition. The 1973 paper states Theorem 6.1 below as "Theorem 7.2 of [6] with Φ\PhiΦ more general", that assumption removed.

Setting

Let (Ω,A,P)(\Omega,\mathcal A,P)(Ω,A,P) be a probability space and X={X(t), 0≤t<∞}X=\{X(t),\,0\le t<\infty\}X={X(t),0≤t<∞} a one-dimensional Brownian motion: a real process with independent increments and continuous sample functions, with X(t)X(t)X(t) normally distributed, EX(t)=0EX(t)=0EX(t)=0, EX2(t)=tEX^2(t)=tEX2(t)=t. Let B(t)\mathcal B(t)B(t) be the σ\sigmaσ-field generated by {X(s), 0≤s≤t}\{X(s),\,0\le s\le t\}{X(s),0≤s≤t}. A stopping time of XXX is a function τ:Ω→[0,∞]\tau:\Omega\to[0,\infty]τ:Ω→[0,∞] with {τ<t}∈B(t)\{\tau<t\}\in\mathcal B(t){τ<t}∈B(t) for every t>0t>0t>0. For 0≤b≤∞0\le b\le\infty0≤b≤∞ put

X∗(b)=sup⁡t≥0∣X(b∧t)∣,X^*(b)=\sup_{t\ge0}|X(b\wedge t)| ,X∗(b)=t≥0sup​∣X(b∧t)∣,

so X∗(τ)X^*(\tau)X∗(τ) is the maximal function of Brownian motion stopped at τ\tauτ.

A function Φ:[0,∞]→[0,∞]\Phi:[0,\infty]\to[0,\infty]Φ:[0,∞]→[0,∞] is of moderate growth if it is non-decreasing and continuous, Φ(0)=0\Phi(0)=0Φ(0)=0, and

Φ(2λ)≤c(6.1) Φ(λ),λ>0.(6.1)\Phi(2\lambda)\le c_{(6.1)}\,\Phi(\lambda),\qquad\lambda>0. \tag{6.1}Φ(2λ)≤c(6.1)​Φ(λ),λ>0.(6.1)

Examples are Φ(λ)=λp\Phi(\lambda)=\lambda^pΦ(λ)=λp for 0<p<∞0<p<\infty0<p<∞. No convexity is assumed. In Lean these are IsBM X P, IsStoppingTimeOf X τ, maxStopped X b ω and IsPhi Φ c.

Formalization targets

Goal: Theorem 6.1

For every stopping time τ\tauτ of XXX,

c EΦ(τ1/2)≤EΦ(X∗(τ))≤C EΦ(τ1/2),(6.2)c\,E\Phi(\tau^{1/2})\le E\Phi(X^*(\tau))\le C\,E\Phi(\tau^{1/2}), \tag{6.2}cEΦ(τ1/2)≤EΦ(X∗(τ))≤CEΦ(τ1/2),(6.2)

where c,C>0c,C>0c,C>0 depend only on c(6.1)c_{(6.1)}c(6.1)​. Neither τ\tauτ nor any moment is assumed finite.

Milestones

  1. (8.1) Wald's identity EX2(τ)=EτEX^2(\tau)=E\tauEX2(τ)=Eτ for a bounded stopping time τ\tauτ (cited in the paper from Doob).
  2. Theorem 6.2. For β>1\beta>1β>1, δ>0\delta>0δ>0 and every λ>0\lambda>0λ>0,
P(τ1/2>βλ, X∗(τ)≤δλ)≤δ2β2−1P(τ1/2>λ),(6.3)P(\tau^{1/2}>\beta\lambda,\ X^*(\tau)\le\delta\lambda)\le\frac{\delta^2}{\beta^2-1}P(\tau^{1/2}>\lambda), \tag{6.3}P(τ1/2>βλ, X∗(τ)≤δλ)≤β2−1δ2​P(τ1/2>λ),(6.3) P(X∗(τ)>βλ, τ1/2≤δλ)≤δ2(β−1)2P(X∗(τ)>λ).(6.4)P(X^*(\tau)>\beta\lambda,\ \tau^{1/2}\le\delta\lambda)\le\frac{\delta^2}{(\beta-1)^2}P(X^*(\tau)>\lambda). \tag{6.4}P(X∗(τ)>βλ, τ1/2≤δλ)≤(β−1)2δ2​P(X∗(τ)>λ).(6.4)
  1. Lemma 7.1. If nonnegative f,gf,gf,g satisfy P(g>βλ,f≤δλ)≤εP(g>λ)P(g>\beta\lambda,f\le\delta\lambda)\le\varepsilon P(g>\lambda)P(g>βλ,f≤δλ)≤εP(g>λ) for all λ>0\lambda>0λ>0, and Φ(βλ)≤γΦ(λ)\Phi(\beta\lambda)\le\gamma\Phi(\lambda)Φ(βλ)≤γΦ(λ), Φ(δ−1λ)≤ηΦ(λ)\Phi(\delta^{-1}\lambda)\le\eta\Phi(\lambda)Φ(δ−1λ)≤ηΦ(λ) with γε<1\gamma\varepsilon<1γε<1, then
EΦ(g)≤γη1−γεEΦ(f).E\Phi(g)\le\frac{\gamma\eta}{1-\gamma\varepsilon}E\Phi(f).EΦ(g)≤1−γεγη​EΦ(f).

Significance

Theorem 6.1 is the Brownian case of the Burkholder–Davis–Gundy inequalities: for Brownian motion the stopping time τ\tauτ plays the role of the square function, since τ\tauτ is the quadratic variation of XXX up to time τ\tauτ. The result controls the stopped maximum through elapsed quadratic variation without a finite-time or integrability assumption. Lemma 7.1 is reusable: the paper applies it again in §§10–21 to discrete-time martingales.

The results are classical and proved; the mission's Lean statements remain open. Mathlib has Brownian motion as a predicate on processes (IsBrownianReal), while this development still needs optional sampling at the paper's stopping times and maximal inequalities for Brownian motion. A formal proof of this mission would provide Wald's identity at bounded optional times, a general good-λ\lambdaλ lemma, and the Brownian inequality with explicit dependence of the constants on c(6.1)c_{(6.1)}c(6.1)​.

Difficulty

The obvious route, integrating the tail bounds (6.3)–(6.4) against dΦd\PhidΦ, does not close by itself: the right-hand side of each good-λ\lambdaλ inequality contains the same random variable as the left-hand side, and nothing in the hypotheses says that EΦ(τ1/2)E\Phi(\tau^{1/2})EΦ(τ1/2) or EΦ(X∗(τ))E\Phi(X^*(\tau))EΦ(X∗(τ)) is finite, nor that τ\tauτ is finite. The theorem has to hold in that generality, with constants that see only c(6.1)c_{(6.1)}c(6.1)​ and not Φ\PhiΦ itself. On the probabilistic side, the stopping times of the paper are defined by the strict events {τ<t}\{\tau<t\}{τ<t} relative to the raw natural filtration B(t)\mathcal B(t)B(t), which is not right-continuous, while the one probabilistic input, Wald's identity (8.1), is a statement about optional sampling of the martingale X2(t)−tX^2(t)-tX2(t)−t in continuous time, for which Mathlib has no theorem yet.

Formalization scope

  • Probability spaces are (Ω : Type) [MeasurableSpace Ω] (P : Measure Ω) [IsProbabilityMeasure P]; time is ℝ≥0 and stopping times are valued in ℝ≥0∞.
  • Brownian motion IsBM X P is Mathlib's IsBrownianReal X P plus two explicit conjuncts the paper assumes: every sample function is continuous, and each X(t)X(t)X(t) is measurable (so B(t)⊆A\mathcal B(t)\subseteq\mathcal AB(t)⊆A). X(0)=0X(0)=0X(0)=0 holds almost surely.
  • IsStoppingTimeOf X τ is exactly the paper's condition {τ<t}∈B(t)\{\tau<t\}\in\mathcal B(t){τ<t}∈B(t), t>0t>0t>0, with B(t)\mathcal B(t)B(t) the raw generated σ\sigmaσ-field; it is weaker than Mathlib's IsStoppingTime, so the theorems are stronger than their Mathlib-stopping-time versions.
  • τ1/2\tau^{1/2}τ1/2, X∗(τ)X^*(\tau)X∗(τ), Φ\PhiΦ and all expectations take values in [0,∞][0,\infty][0,∞] (ℝ≥0∞, lintegral), with ∞1/2=∞\infty^{1/2}=\infty∞1/2=∞; both sides of (6.2) may be infinite. (8.1) is stated with lintegral on both sides.
  • The growth condition is required for all λ∈[0,∞]\lambda\in[0,\infty]λ∈[0,∞], equivalent to (6.1) by continuity. Φ≢0\Phi\not\equiv0Φ≡0, which the paper assumes "to eliminate the trivial case", is dropped: all conclusions hold trivially for Φ≡0\Phi\equiv0Φ≡0.
  • "The choice of ccc and CCC depends only on c(6.1)c_{(6.1)}c(6.1)​" is formalized with the quantifier order ∀ c, ∃ C₁ C₂ > 0, ∀ Ω P X τ Φ, IsPhi Φ c → …. A version in which the constants are chosen after Φ\PhiΦ, XXX or τ\tauτ would be trivial whenever the right-hand side is positive and is ruled out by this order.
  • In Lemma 7.1, f,gf,gf,g may take the value ∞\infty∞ and γ,η\gamma,\etaγ,η are nonnegative; both choices are harmless (see the item notes).

Contributions welcome: Wald's identity and optional sampling for Brownian motion at optional times, the Lebesgue–Stieltjes layer-cake formula EΦ(h)=∫0∞P(h>λ) dΦ(λ)E\Phi(h)=\int_0^\infty P(h>\lambda)\,d\Phi(\lambda)EΦ(h)=∫0∞​P(h>λ)dΦ(λ) for continuous non-decreasing Φ\PhiΦ (reusable for every Φ\PhiΦ inequality of the series), and the good-λ\lambdaλ lemma, which the later missions of this series share.

Selected references

  • D. L. Burkholder, Distribution function inequalities for martingales, Ann. Probability 1 (1973), 19–42. https://doi.org/10.1214/aop/1176997023
  • D. L. Burkholder, B. J. Davis, R. F. Gundy, Integral inequalities for convex functions of operators on martingales, Proc. Sixth Berkeley Symp. Math. Statist. Probab. 2 (1972), 223–240. https://digicoll.lib.berkeley.edu/record/113227
  • D. L. Burkholder, R. F. Gundy, Extrapolation and interpolation of quasi-linear operators on martingales, Acta Math. 124 (1970), 249–304. https://doi.org/10.1007/BF02394576
  • B. Davis, On the integrability of the martingale square function, Israel J. Math. 8 (1970), 187–190. https://doi.org/10.1007/BF02771562
  • D. L. Burkholder, Martingale transforms, Ann. Math. Statist. 37 (1966), 1494–1504. https://doi.org/10.1214/aoms/1177699141
7 thms2 active usersReviewed
Control TheoryProbability·Captain: mikedeng1

Backward-Forward Stochastic Differential Equations 2: The Coupled Backward-Forward System Has a Unique Adapted Solution When k Times the H∞ Norm of D Is Below OneResearch Paper

Motivation

A backward-forward stochastic differential equation couples two equations that run in opposite time directions: a forward equation for a state UUU, started from a given input, and a backward equation for a quantity VVV, pinned at a terminal time by a random variable YYY. Each equation's coefficients depend on both unknowns, so the solution at time ttt depends on the past of UUU and on the conditional future of VVV. Such systems arise in stochastic control (the adjoint equation of the stochastic maximum principle runs backward while the state runs forward) and in mathematical finance (an asset's price is forward, a hedge or value process is backward).

Antonelli's 1993 paper (Ann. Appl. Probab. 3(3), 777–793) is one of the first treatments of the coupled problem. Pardoux and Peng (1990) had established existence and uniqueness for decoupled backward equations driven by Brownian motion. Antonelli proved existence and uniqueness for the coupled system under a smallness condition, and gave examples (§3) showing that without such a condition a solution may fail to exist. This mission formalizes the bounded-variation case of that result, Theorem 3.1.

Setting

Fix a horizon T>0T > 0T>0 and a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) with a filtration (Ft)t≥0(\mathcal F_t)_{t\ge 0}(Ft​)t≥0​ satisfying the usual hypotheses: it is right-continuous, and F0\mathcal F_0F0​ contains every PPP-null set.

An integrator AAA is an adapted process whose paths have bounded variation on [0,T][0,T][0,T], with A0=0A_0 = 0A0​=0. It is written A=A+−A−A = A^+ - A^-A=A+−A− with A±A^\pmA± adapted, nondecreasing and right-continuous, and At++At−=∣A∣tA^+_t + A^-_t = |A|_tAt+​+At−​=∣A∣t​, the total variation of AAA on [0,t][0,t][0,t]. It is bounded: ∣A∣T≤β|A|_T \le \beta∣A∣T​≤β. The pathwise integral ∫sthr dAr\int_s^t h_r\,dA_r∫st​hr​dAr​ is the Lebesgue–Stieltjes integral over (s,t](s,t](s,t].

The system involves two integrators A,CA, CA,C and the increasing process

Dt=max⁡(∣A∣t,∣C∣t),D_t = \max(|A|_t, |C|_t),Dt​=max(∣A∣t​,∣C∣t​),

whose pathwise Stieltjes measure is dDdDdD. The Doléans measure μ\muμ of DDD on (0,T]×Ω(0,T]\times\Omega(0,T]×Ω gives the norm

∥V∥L1(μ)=E(∫0T∣Vt∣ dDt),\|V\|_{L^1(\mu)} = E\Big(\int_0^T |V_t|\,dD_t\Big),∥V∥L1(μ)​=E(∫0T​∣Vt​∣dDt​),

and L1(μ)L^1(\mu)L1(μ) is the space of jointly measurable processes with finite norm. The size of DDD is ∥D∥H∞=ess sup⁡DT\|D\|_{\mathbf H^\infty} = \operatorname{ess\,sup} D_T∥D∥H∞​=esssupDT​.

The data are coefficients f,g:[0,T]×Ω×R2→Rf, g : [0,T]\times\Omega\times\mathbb R^2\to\mathbb Rf,g:[0,T]×Ω×R2→R, a constant k>0k > 0k>0, a terminal value YYY and a forward input JJJ. They satisfy:

  1. f,gf, gf,g are kkk-Lipschitz in (x,y)(x,y)(x,y): ∣ζs(ω,x,y)−ζs(ω,xˉ,yˉ)∣≤k(∣x−xˉ∣+∣y−yˉ∣)|\zeta_s(\omega,x,y) - \zeta_s(\omega,\bar x,\bar y)| \le k(|x-\bar x| + |y-\bar y|)∣ζs​(ω,x,y)−ζs​(ω,xˉ,yˉ​)∣≤k(∣x−xˉ∣+∣y−yˉ​∣) for ζ=f,g\zeta = f, gζ=f,g;
  2. f,gf, gf,g are adapted in (s,ω)(s,\omega)(s,ω);
  3. fs(0,0),gs(0,0)∈L1(μ)f_s(0,0), g_s(0,0) \in L^1(\mu)fs​(0,0),gs​(0,0)∈L1(μ).

In addition Y∈L1(P)Y \in L^1(P)Y∈L1(P) is FT\mathcal F_TFT​-measurable and J∈L1(μ)J \in L^1(\mu)J∈L1(μ) is adapted. The system is

Ut=Jt+∫0tfs(Us,Vs) dAs,Vt=E(∫tTgs(Us,Vs) dCs+Y  ∣  Ft),(3.1–3.2)U_t = J_t + \int_0^t f_s(U_s,V_s)\,dA_s, \qquad V_t = E\Big(\int_t^T g_s(U_s,V_s)\,dC_s + Y \;\Big|\; \mathcal F_t\Big), \tag{3.1–3.2}Ut​=Jt​+∫0t​fs​(Us​,Vs​)dAs​,Vt​=E(∫tT​gs​(Us​,Vs​)dCs​+Y​Ft​),(3.1–3.2)

and its right-hand side defines an operator Γ(U,V)=(F(U,V),G(U,V))\Gamma(U,V) = (F(U,V), G(U,V))Γ(U,V)=(F(U,V),G(U,V)), (3.3). A solution in the L1(μ)⊗L1(μ)L^1(\mu)\otimes L^1(\mu)L1(μ)⊗L1(μ) sense is a pair (U,V)∈L1(μ)⊗L1(μ)(U,V)\in L^1(\mu)\otimes L^1(\mu)(U,V)∈L1(μ)⊗L1(μ) with U=F(U,V)U = F(U,V)U=F(U,V) and V=G(U,V)V = G(U,V)V=G(U,V) μ\muμ-a.e.

Formalization targets

Goal: Theorem 3.1

If ∣dA∣|dA|∣dA∣ and ∣dC∣|dC|∣dC∣ are dominated by dDdDdD and

k ∥D∥H∞<1,k\,\|D\|_{\mathbf H^\infty} < 1,k∥D∥H∞​<1,

then there is a progressively measurable solution (U,V)(U,V)(U,V) of (3.1)–(3.2) in the L1(μ)⊗L1(μ)L^1(\mu)\otimes L^1(\mu)L1(μ)⊗L1(μ) sense, and any two progressively measurable solutions agree μ\muμ-a.e.:

∥U−U′∥L1(μ)+∥V−V′∥L1(μ)=0.\|U - U'\|_{L^1(\mu)} + \|V - V'\|_{L^1(\mu)} = 0.∥U−U′∥L1(μ)​+∥V−V′∥L1(μ)​=0.

Milestones

  1. Remark 2.2, (2.6): E(H∫[0,∞)a(s) dCs)=E(∫[0,∞)Hsa(s) dCs)E(H\int_{[0,\infty)} a(s)\,dC_s) = E(\int_{[0,\infty)} H_s a(s)\,dC_s)E(H∫[0,∞)​a(s)dCs​)=E(∫[0,∞)​Hs​a(s)dCs​) for an adapted increasing càdlàg CCC, a positive Borel aaa, HHH positive or in L1L^1L1, and the càdlàg version HsH_sHs​ of E(H∣Fs)E(H\mid\mathcal F_s)E(H∣Fs​). The proof of Theorem 3.1 uses it with C=DC = DC=D, a≡1a \equiv 1a≡1.
  2. Γ\GammaΓ maps L1(μ)⊗L1(μ)L^1(\mu)\otimes L^1(\mu)L1(μ)⊗L1(μ) into itself (pp. 785–787).
  3. The Lipschitz estimates (p. 787): ∣F(U,V)t−F(U~,V~)t∣≤k∫0t(∣Us−U~s∣+∣Vs−V~s∣) dDs|F(U,V)_t - F(\tilde U,\tilde V)_t| \le k\int_0^t(|U_s-\tilde U_s| + |V_s-\tilde V_s|)\,dD_s∣F(U,V)t​−F(U~,V~)t​∣≤k∫0t​(∣Us​−U~s​∣+∣Vs​−V~s​∣)dDs​, and the conditional analogue for GGG on (t,T](t,T](t,T].
  4. The contraction estimate (p. 788):
∥Γ(U,V)−Γ(U~,V~)∥L1⊗L1≤k∥D∥H∞ ∥(U,V)−(U~,V~)∥L1⊗L1.\|\Gamma(U,V) - \Gamma(\tilde U,\tilde V)\|_{L^1\otimes L^1} \le k\|D\|_{\mathbf H^\infty}\,\|(U,V) - (\tilde U,\tilde V)\|_{L^1\otimes L^1}.∥Γ(U,V)−Γ(U~,V~)∥L1⊗L1​≤k∥D∥H∞​∥(U,V)−(U~,V~)∥L1⊗L1​.

Significance

The theorem identifies a regime in which a coupled forward-backward system is well posed. The integrability required is only L1L^1L1, and the smallness condition k∥D∥H∞<1k\|D\|_{\mathbf H^\infty} < 1k∥D∥H∞​<1 ties the Lipschitz constant to the total mass of the driving integrators. With As=Cs=sA_s = C_s = sAs​=Cs​=s it reads kT<1kT < 1kT<1, a small-horizon condition. The paper's Example 1 (mission 3 of this series) shows that at k=1k = 1k=1, T≥1T \ge 1T≥1 a solution may fail to exist, so some restriction of this type is necessary. Later work on forward-backward equations, for instance the four-step scheme of Ma, Protter and Yong (1994), replaced the smallness condition by other structural assumptions. Antonelli's small-horizon result remains the base case those methods extend.

The result is proved in the paper. No machine-checked version of it, or of any backward stochastic differential equation, exists in Mathlib or on the platform. The formalization adds three things on top of the paper. It makes the solution concept precise: versions, integrability, and μ\muμ-a.e. equality. It repairs a gap in the printed proof (see Formalization scope). And it builds pathwise Lebesgue–Stieltjes integration against adapted bounded-variation processes, together with the optional projection identity (2.6), as reusable infrastructure.

Difficulty

The Banach fixed point theorem does the final step once the contraction estimate holds. The difficulty lies in reaching that estimate. The VVV-component is a conditional expectation, defined for each ttt only up to a null set, and these null sets accumulate when the process is integrated against dDdDdD, which may charge random times. The estimate has to be transported from "for each ttt, almost surely" to "μ\muμ-almost everywhere". That needs càdlàg versions and the optional projection theorem, which Mathlib lacks. A second point: the naive bound treats the forward and backward differences separately and gives the constant 2k∥D∥H∞2k\|D\|_{\mathbf H^\infty}2k∥D∥H∞​. Obtaining k∥D∥H∞k\|D\|_{\mathbf H^\infty}k∥D∥H∞​ requires combining both differences inside one conditional expectation, and that uses the adaptedness of the forward difference.

Formalization scope

Time is R≥0\mathbb R_{\ge 0}R≥0​ with horizon T>0T > 0T>0; integrators are frozen after TTT. Each integrator carries its minimal Jordan decomposition as data, tied to Mathlib's eVariationOn. Pathwise measures are Mathlib's Stieltjes measures, and integrals are over (s,t](s,t](s,t]. Norms are lower integrals in [0,∞][0,\infty][0,∞]. Every conditional expectation is accompanied by the integrability of its argument, since Mathlib's condExp of a non-integrable function is 000. A version of G(U,V)G(U,V)G(U,V) must be jointly measurable and have càdlàg paths on [0,T][0,T][0,T]. Without the càdlàg requirement, two versions can differ on the graph of a random time charged by dDdDdD, and the contraction estimate fails.

The formalization commits to these readings of the paper:

  • Domination. The paper asserts (p. 786) that ∣A∣≪D|A|\ll D∣A∣≪D and ∣C∣≪D|C|\ll D∣C∣≪D with densities at most 111. This is false for D=max⁡(∣A∣,∣C∣)D = \max(|A|,|C|)D=max(∣A∣,∣C∣) in general: take ∣A∣t=t|A|_t = t∣A∣t​=t and ∣C∣t=2⋅1{t≥ε}|C|_t = 2\cdot 1\{t\ge\varepsilon\}∣C∣t​=2⋅1{t≥ε}. It is assumed explicitly, as "D−∣A∣D - |A|D−∣A∣ and D−∣C∣D - |C|D−∣C∣ are nondecreasing on [0,T][0,T][0,T]". The paper's Example 1 (A=CA = CA=C) satisfies it.
  • Adaptedness. "Adapted" solutions are progressively measurable. For each (x,y)(x,y)(x,y), f(⋅,⋅,x,y)f(\cdot,\cdot,x,y)f(⋅,⋅,x,y) is required to be progressively measurable, since with a merely adapted integrand ∫0tf dA\int_0^t f\,dA∫0t​fdA need not be adapted. The weaker printed hypothesis is kept for ggg.
  • Norm of DDD. ∥D∥H∞\|D\|_{\mathbf H^\infty}∥D∥H∞​ is ess sup⁡DT\operatorname{ess\,sup} D_TesssupDT​, not the bound β\betaβ. The hypothesis k∥D∥H∞<1k\|D\|_{\mathbf H^\infty} < 1k∥D∥H∞​<1 is weaker than kβ<1k\beta < 1kβ<1, and the theorem keeps it.
  • Small departures. The constant k1k_1k1​ bounding JJJ becomes finiteness. "∣A∣T,∣C∣T<β|A|_T, |C|_T < \beta∣A∣T​,∣C∣T​<β" becomes "≤β\le \beta≤β". In the positive case of Remark 2.2, the version of E(H∣Ft)E(H\mid\mathcal F_t)E(H∣Ft​) is [0,∞][0,\infty][0,∞]-valued and characterized by its integrals over Ft\mathcal F_tFt​-sets.

The solution concept rules out trivial solutions. It requires U,V∈L1(μ)U, V\in L^1(\mu)U,V∈L1(μ), the integrability of every argument of the conditional expectation, and a càdlàg version, and existence asserts a progressively measurable pair. A pair satisfying the equations only through Lean's junk values therefore does not count.

A complete development needs:

  • measurability of pathwise Stieltjes integrals in ω\omegaω;
  • the optional projection theorem for càdlàg processes (Dellacherie–Meyer VI.47, VI.57);
  • existence of càdlàg versions of martingales under the usual hypotheses;
  • completeness of L1L^1L1 over the progressive σ-algebra.

All four are reusable well beyond this mission. Contributions to any of them are welcome, as is a proof of any milestone in isolation.

Selected references

  • F. Antonelli, Backward-forward stochastic differential equations, Ann. Appl. Probab. 3(3) (1993) 777–793. https://doi.org/10.1214/aoap/1177005363
  • E. Pardoux, S. Peng, Adapted solution of a backward stochastic differential equation, Systems Control Lett. 14 (1990) 55–61. https://doi.org/10.1016/0167-6911(90)90082-6
  • C. Dellacherie, P.-A. Meyer, Probabilities and Potential B: Theory of Martingales, North-Holland Mathematics Studies 72, 1982. ISBN 0-444-86526-8
  • P. Protter, Stochastic Integration and Differential Equations, Springer, 1990. https://doi.org/10.1007/978-3-662-02619-9
  • J. Ma, P. Protter, J. Yong, Solving forward-backward stochastic differential equations explicitly — a four step scheme, Probab. Theory Related Fields 98 (1994) 339–359. https://doi.org/10.1007/BF01192258
8 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Implicit Renewal Theory and Tails of Solutions of Random Equations 1: The Implicit Renewal Theorem — If E|M|^κ = 1 Then P(R > t) ~ C₊t^{−κ} and P(R < −t) ~ C₋t^{−κ}Research Paper

Motivation

Many stochastic models produce a stationary quantity RRR that solves a random equation R=dΨ(R)R \overset{d}{=} \Psi(R)R=dΨ(R), with Ψ\PsiΨ a random map independent of RRR. The random difference equation R=dQ+MRR \overset{d}{=} Q + MRR=dQ+MR (perpetuities in insurance and finance, the ARCH and GARCH volatility models, random walks in random environments), the Lindley equation S=d(X+S)+S \overset{d}{=} (X+S)^+S=d(X+S)+ of queueing theory, and the random recurrences behind probabilistic analyses of algorithms are all of this form. In these models the law of RRR is rarely explicit, while the decay of its tail P(R>t)P(R>t)P(R>t) is what governs ruin probabilities, extreme values and buffer overflows.

Kesten (1973) showed that the stationary solution of R=dQ+MRR \overset{d}{=} Q + MRR=dQ+MR has a power-law tail when E∣M∣κ=1E|M|^\kappa = 1E∣M∣κ=1 for some κ>0\kappa>0κ>0, by a long argument specific to that equation. Goldie (1991) separated the renewal-theoretic core of the phenomenon from the particular equation: the implicit renewal theorem (Theorem 2.3) gives the power-law tail of any random variable RRR whose tails are comparable to those of MRMRMR, with an explicit formula for the constant. Kesten's theorem and the tail results for several other random equations then follow by checking one integrability condition. The theorem is the standard entry point to the subject, reproduced in the monograph of Buraczewski, Damek and Mikosch (2016).

Timeline:

  • Kesten (1973): power tails for multivariate random difference equations, including the one-dimensional case R=dQ+MRR \overset{d}{=} Q+MRR=dQ+MR.
  • Grincevičius (1975, 1981): limit laws for random walks on the line and the random difference equation R=dQ+MRR \overset{d}{=} Q+MRR=dQ+MR in one dimension (Lithuanian Math. J. 15, 21).
  • Goldie (1991): the implicit renewal theorem for arbitrary RRR, explicit constants, rates of convergence, and applications to several random equations.

Setting

Let (Ω,A,P)(\Omega,\mathcal A,P)(Ω,A,P) be a probability space and MMM, RRR two independent real random variables. No equation is assumed for RRR.

A probability law on R\mathbb RR is arithmetic if it is concentrated on a lattice {nλ:n∈Z}\{n\lambda:n\in\mathbb Z\}{nλ:n∈Z} for some λ>0\lambda>0λ>0, and nonarithmetic otherwise. Fix κ>0\kappa>0κ>0. The Cramér-type conditions on MMM are

E∣M∣κ=1,E∣M∣κlog⁡+∣M∣<∞,the law of log⁡∣M∣ given M≠0 is nonarithmetic.E|M|^\kappa = 1,\qquad E|M|^\kappa\log^+|M|<\infty,\qquad \text{the law of }\log|M|\text{ given }M\ne0\text{ is nonarithmetic.}E∣M∣κ=1,E∣M∣κlog+∣M∣<∞,the law of log∣M∣ given M=0 is nonarithmetic.

Under them, m:=E∣M∣κlog⁡∣M∣m := E|M|^\kappa\log|M|m:=E∣M∣κlog∣M∣ is finite and positive (Lemma 2.2), with 0alog⁡0:=00^a\log 0 := 00alog0:=0.

The tails of RRR enter through two tail-comparison conditions

(2.8) ∫0∞∣P(R>t)−P(MR>t)∣ tκ−1dt<∞,(2.9) ∫0∞∣P(R<−t)−P(MR<−t)∣ tκ−1dt<∞,\text{(2.8)}\ \int_0^\infty|P(R>t)-P(MR>t)|\,t^{\kappa-1}dt<\infty,\qquad \text{(2.9)}\ \int_0^\infty|P(R<-t)-P(MR<-t)|\,t^{\kappa-1}dt<\infty ,(2.8) ∫0∞​∣P(R>t)−P(MR>t)∣tκ−1dt<∞,(2.9) ∫0∞​∣P(R<−t)−P(MR<−t)∣tκ−1dt<∞,

and the constants

C±=1m∫0∞(P(±R>t)−P(±MR>t))tκ−1dt,C=12m∫0∞(P(∣R∣>t)−P(∣MR∣>t))tκ−1dt.C_\pm=\frac1m\int_0^\infty\bigl(P(\pm R>t)-P(\pm MR>t)\bigr)t^{\kappa-1}dt, \qquad C=\frac1{2m}\int_0^\infty\bigl(P(|R|>t)-P(|MR|>t)\bigr)t^{\kappa-1}dt .C±​=m1​∫0∞​(P(±R>t)−P(±MR>t))tκ−1dt,C=2m1​∫0∞​(P(∣R∣>t)−P(∣MR∣>t))tκ−1dt.

In the Lean development these are CramerConditions κ (P.map M), cramerMean, TailCondPlus, TailCondMinus, Cplus, Cminus and Ctwo, in the namespace GoldieRenewal.Implicit.

Formalization targets

Goal: Theorem 2.3

Let MMM satisfy the Cramér-type conditions and let RRR be independent of MMM.

Case 1 (M≥0M\ge0M≥0 a.s.): (2.8) implies P(R>t)∼C+t−κP(R>t)\sim C_+t^{-\kappa}P(R>t)∼C+​t−κ, and (2.9) implies P(R<−t)∼C−t−κP(R<-t)\sim C_-t^{-\kappa}P(R<−t)∼C−​t−κ, as t→∞t\to\inftyt→∞.

Case 2 (P(M<0)>0P(M<0)>0P(M<0)>0): (2.8) and (2.9) together imply

tκP(R>t)→C,tκP(R<−t)→C,t→∞.t^\kappa P(R>t)\to C,\qquad t^\kappa P(R<-t)\to C,\qquad t\to\infty .tκP(R>t)→C,tκP(R<−t)→C,t→∞.

The relation P(R>t)∼C+t−κP(R>t)\sim C_+t^{-\kappa}P(R>t)∼C+​t−κ means tκP(R>t)→C+t^\kappa P(R>t)\to C_+tκP(R>t)→C+​, including C+=0C_+=0C+​=0.

Milestones

Lemma 2.2 (negative drift of log⁡∣M∣\log|M|log∣M∣, m∈(0,∞)m\in(0,\infty)m∈(0,∞)); Lemmas 9.1–9.2 (smoothed integrable functions are directly Riemann-integrable); Lemma 9.3 (a Tauberian step from averaged to pointwise tails); the renewal equation (9.8) rˇ=gˇ1∗ν\check r=\check g_1*\nurˇ=gˇ​1​∗ν and its key-renewal limit in Case 1; the Case 2a step law (9.11) with mean 2m2m2m and nonarithmetic (9.12)–(9.13), and the renewal identity (9.15); the reduction (9.16) of Case 2b to Case 1.

Significance

The theorem turns a question about an unknown law into a question about integrability. For a random equation R=dΨ(R)R\overset{d}{=}\Psi(R)R=dΨ(R) it suffices to compare Ψ(R)\Psi(R)Ψ(R) with MRMRMR, which is often a moment computation; this yields power tails, with constants given by expectations, for perpetuities, Lindley-type equations, random polynomial and maximum equations (Goldie 1991, §§4–8). The explicit constant also decides when the tail is genuinely of order t−κt^{-\kappa}t−κ: the theorem has content only when E∣R∣κ=∞E|R|^\kappa=\inftyE∣R∣κ=∞, since otherwise C++C−=0C_++C_-=0C+​+C−​=0.

The theorem has been proved for thirty years; it is not formalized in any proof assistant known to the mission. A formal development would provide reusable infrastructure absent from Mathlib: direct Riemann integrability, renewal measures of walks on the whole line, the two-sided key renewal theorem (Athreya, McDonald and Ney 1978), and a Tauberian lemma for monotone tails. The sibling missions on Kesten's theorem and on rates of convergence are built on the same setting.

Difficulty

The obvious argument writes P(R>t)P(R>t)P(R>t) as a telescoping sum along the multiplicative walk Πn=M1⋯Mn\Pi_n=M_1\cdots M_nΠn​=M1​⋯Mn​ and applies the key renewal theorem to the result. It fails at three points. First, the function the key renewal theorem would be applied to, g1(t)=eκt(P(R>et)−P(MR>et))g_1(t)=e^{\kappa t}(P(R>e^t)-P(MR>e^t))g1​(t)=eκt(P(R>et)−P(MR>et)), is only integrable under (2.8), not directly Riemann-integrable, and the key renewal theorem is false for general integrable functions; so no conclusion about P(R>t)P(R>t)P(R>t) itself follows directly. Second, when MMM takes both signs, log⁡∣Πn∣\log|\Pi_n|log∣Πn​∣ alone is not a random walk that controls P(ΠnR>et)P(\Pi_nR>e^t)P(Πn​R>et): the sign of Πn\Pi_nΠn​ decides which tail of RRR is involved, so the walk is Markov-modulated. Third, the walk lives on the whole line and may jump to −∞-\infty−∞ (when P(M=0)>0P(M=0)>0P(M=0)>0), so renewal theory on [0,∞)[0,\infty)[0,∞), the version in most textbooks, does not apply.

Formalization scope

  • One probability space with IsProbabilityMeasure P; M, R measurable real random variables; independence is IndepFun R M P. In (9.16) the copy M′M'M′ lives on the same space, with IdentDistrib M' M P P and iIndepFun of (R,M,M′)(R,M,M')(R,M,M′).
  • Cramér conditions are stated on the law P.map M; the moments are lower Lebesgue integrals in [0,∞][0,\infty][0,∞]. The conditional law in (2.5) conditions on {x≠0}\{x\neq0\}{x=0} before taking log⁡∣x∣\log|x|log∣x∣, so Lean's Real.log 0 = 0 never enters; Elog⁡∣M∣E\log|M|Elog∣M∣ is an extended real with log⁡0=−∞\log 0=-\inftylog0=−∞.
  • Tails are real numbers P.real {ω | t < R ω} with the paper's strict inequalities. (2.8), (2.9) are IntegrableOn … (Set.Ioi 0); the constants are Bochner integrals, used only under the corresponding integrability hypothesis.
  • "∼\sim∼" is Tendsto (fun t => t ^ κ * P.real {…}) atTop (𝓝 C).
  • Direct Riemann integrability follows Feller (1971, §XI.1), with suprema in [0,∞][0,\infty][0,∞]. The smoothing is fˇ(t)=∫−∞te−(t−u)f(u) du\check f(t)=\int_{-\infty}^t e^{-(t-u)}f(u)\,dufˇ​(t)=∫−∞t​e−(t−u)f(u)du.
  • The tilted law η\etaη, its renewal measure and the Case 2a laws are defined from the law of MMM; no i.i.d. sequence appears in a statement.

Three formalizations would trivialize the goal and are excluded: reading "∼\sim∼" as a ratio P(R>t)/(C+t−κ)→1P(R>t)/(C_+t^{-\kappa})\to1P(R>t)/(C+​t−κ)→1 (which is false when C+=0C_+=0C+​=0); assuming E∣R∣κ<∞E|R|^\kappa<\inftyE∣R∣κ<∞ (which forces C++C−=0C_++C_-=0C+​+C−​=0); and placing a key-renewal-theorem conclusion among the hypotheses.

Contributions welcome: proofs of any milestone; a general two-sided key renewal theorem for nonarithmetic laws with positive mean (reusable beyond this mission); Mathlib-quality lemmas on direct Riemann integrability and renewal measures.

Selected references

  • C. M. Goldie, Implicit renewal theory and tails of solutions of random equations, Ann. Appl. Probab. 1(1):126–166, 1991. https://doi.org/10.1214/aoap/1177005985
  • H. Kesten, Random difference equations and renewal theory for products of random matrices, Acta Math. 131:207–248, 1973. https://doi.org/10.1007/BF02392040
  • K. B. Athreya, D. McDonald, P. Ney, Limit theorems for semi-Markov processes and renewal theory for Markov chains, Ann. Probab. 6(5):788–797, 1978. https://doi.org/10.1214/aop/1176995429
  • W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II, 2nd ed., Wiley, 1971.
  • D. Buraczewski, E. Damek, T. Mikosch, Stochastic Models with Power-Law Tails: The Equation X = AX + B, Springer, 2016. https://doi.org/10.1007/978-3-319-29679-1
14 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Regenerative Stochastic Processes 1: The State Probabilities of an Aperiodic Equilibrium Process Converge to (1/μ₁)∫φ_A(v){1 − F(v)}dvResearch Paper

Motivation

Many stochastic systems studied in operations research "start afresh" at certain random instants: a single-server queue each time a customer arrives to find the server idle, an inventory system each time stock is replenished to its order level, a reliability system each time a failed unit is replaced. Between such instants the system may evolve in a complicated way, but its future after one of them does not depend on its past. W. L. Smith's 1955 paper Regenerative stochastic processes made this idea into a general theory. Its first main result, Theorem 2, says that the state probabilities of such a process converge as time grows, and gives the limit explicitly in terms of the behaviour of the process within one cycle and the law of the cycle length.

This limit theorem is the standard way of proving that a queue, an inventory or a reliability model has a limiting distribution and of computing it: one exhibits regeneration points and evaluates one cycle.

Timeline.

  • 1948: Blackwell proves that the renewal function of a non-lattice renewal process has increments H(t+h)−H(t)→h/μ1H(t+h) - H(t) \to h/\mu_1H(t+h)−H(t)→h/μ1​ (Duke Math. J. 15).
  • 1949: Erdős, Feller and Pollard prove the discrete (lattice) renewal theorem.
  • 1954: Smith proves the key renewal theorem for bounded, non-increasing, integrable kernels, and a version for kernels tending to zero when some convolution power of the cycle law has an absolutely continuous part (Proc. Roy. Soc. Edinburgh A 64).
  • 1955: Smith introduces regenerative and equilibrium processes and proves Theorem 2 (this paper).

Setting

A general renewal process is a sequence t0,t1,t2,…t_0, t_1, t_2, \dotst0​,t1​,t2​,… of independent non-negative random variables in which t1,t2,…t_1, t_2, \dotst1​,t2​,… have a common law FFF, not concentrated at 000, with mean μ1=∫x dF(x)∈(0,∞]\mu_1 = \int x\,dF(x) \in (0,\infty]μ1​=∫xdF(x)∈(0,∞], and the delay t0t_0t0​ has a law KKK. The regeneration epochs are Tk=t0+⋯+tkT_k = t_0 + \dots + t_kTk​=t0​+⋯+tk​, and ntn_tnt​ is the number of epochs in [0,t][0,t][0,t]. The renewal measure is

HK=∑n≥0K∗F∗n,H_K = \sum_{n \ge 0} K * F^{*n},HK​=n≥0∑​K∗F∗n,

so that HK([0,t])=E ntH_K([0,t]) = \mathbb E\, n_tHK​([0,t])=Ent​. The law FFF is periodic with period ϖ>0\varpi > 0ϖ>0 if all its mass sits on {0,ϖ,2ϖ,… }\{0, \varpi, 2\varpi, \dots\}{0,ϖ,2ϖ,…}; otherwise ϖ=0\varpi = 0ϖ=0 and FFF is aperiodic. FFF belongs to the class S\mathfrak SS if some convolution power F∗kF^{*k}F∗k, k≥1k \ge 1k≥1, has a non-zero absolutely continuous component.

An equilibrium process E(z,A,{ti})\mathcal E(\mathfrak z, \mathcal A, \{t_i\})E(z,A,{ti​}) consists of a process xtx_txt​ on a measurable state space X\mathfrak XX, a class A\mathcal AA of measurable sets of states, a family of probability measures P{⋅∣z}P\{\cdot \mid z\}P{⋅∣z} indexed by boundary conditions z∈zz \in \mathfrak zz∈z, and under each of them a general renewal process whose cycle law FFF does not depend on zzz and whose delay has law KzK_zKz​. For each A∈AA \in \mathcal AA∈A there is a measurable function φA\varphi_AφA​, depending on AAA only, such that

P{xt∈A∣z; nt>0; Lt}=φA(t−Lt),P\{x_t \in A \mid z;\ n_t > 0;\ L_t\} = \varphi_A(t - L_t),P{xt​∈A∣z; nt​>0; Lt​}=φA​(t−Lt​),

where LtL_tLt​ is the epoch of the last regeneration at or before ttt. In words: once a regeneration has occurred, the chance of being in AAA at time ttt depends only on the time elapsed since the last one.

Formalization targets

Goal: Theorem 2

If the process is aperiodic (ϖ=0\varpi = 0ϖ=0) and the regeneration event is certain (Kz(+∞)=1K_z(+\infty) = 1Kz​(+∞)=1), then for every zzz and every A∈AA \in \mathcal AA∈A satisfying one of the regularity conditions (iv)′'′ (φA{1−F}\varphi_A\{1-F\}φA​{1−F} integrable and monotonic), (iv)a′′''_aa′′​ (μ1<∞\mu_1 < \inftyμ1​<∞ and φA{1−F}\varphi_A\{1-F\}φA​{1−F} of locally bounded variation) or (iv)b′′''_bb′′​ (μ1<∞\mu_1 < \inftyμ1​<∞ and F∈SF \in \mathfrak SF∈S),

lim⁡t→∞P{xt∈A∣z}=1μ1∫0∞φA(v){1−F(v)} dv,\lim_{t\to\infty} P\{x_t \in A \mid z\} = \frac{1}{\mu_1} \int_0^\infty \varphi_A(v)\{1 - F(v)\}\,dv,t→∞lim​P{xt​∈A∣z}=μ1​1​∫0∞​φA​(v){1−F(v)}dv,

the limit being 000 when μ1=∞\mu_1 = \inftyμ1​=∞.

Milestones

  1. Theorem A(a), the key renewal theorem: for bounded, non-increasing, integrable Ψ\PsiΨ and aperiodic FFF, ∫0tΨ(t−t′) dHK(t′)→(K(+∞)/μ1)∫0∞Ψ\int_0^t \Psi(t-t')\,dH_K(t') \to (K(+\infty)/\mu_1)\int_0^\infty \Psi∫0t​Ψ(t−t′)dHK​(t′)→(K(+∞)/μ1​)∫0∞​Ψ.
  2. Lemma A: for F∈SF \in \mathfrak SF∈S, (1−G∗(s))/(1−F∗(s))(1 - G^*(s))/(1 - F^*(s))(1−G∗(s))/(1−F∗(s)) is the Laplace–Stieltjes transform of a function of bounded variation with net variation λ1/μ1\lambda_1/\mu_1λ1​/μ1​.
  3. Theorem 1: the same limit for bounded integrable Ψ→0\Psi \to 0Ψ→0 when F∈SF \in \mathfrak SF∈S and μ1<∞\mu_1 < \inftyμ1​<∞.
  4. (3·4·3): P{xt∈A∣z}=P{xt∈A,t0>t∣z}+∫0tφA(t−τ){1−F(t−τ)} dHKz(τ)P\{x_t \in A \mid z\} = P\{x_t \in A, t_0 > t \mid z\} + \int_0^t \varphi_A(t-\tau)\{1-F(t-\tau)\}\,dH_{K_z}(\tau)P{xt​∈A∣z}=P{xt​∈A,t0​>t∣z}+∫0t​φA​(t−τ){1−F(t−τ)}dHKz​​(τ).
  5. (3·4·5): ∫t−Δtg(t−v) dHK(v)→μ1−1∫0Δg\int_{t-\Delta}^t g(t-v)\,dH_K(v) \to \mu_1^{-1}\int_0^\Delta g∫t−Δt​g(t−v)dHK​(v)→μ1−1​∫0Δ​g for the page's kernel g=φA(1−F)g=\varphi_A(1-F)g=φA​(1−F) of locally bounded variation.
  6. (3·4·7): ∫0t−Δ{1−F(t−v)} dH(v)→μ1−1∫Δ∞{1−F}\int_0^{t-\Delta}\{1-F(t-v)\}\,dH(v) \to \mu_1^{-1}\int_\Delta^\infty\{1-F\}∫0t−Δ​{1−F(t−v)}dH(v)→μ1−1​∫Δ∞​{1−F}; the limit is at most ε\varepsilonε for large enough Δ\DeltaΔ.

Significance

The result. Theorem 2 reduces the long-run behaviour of a regenerative system to a one-cycle computation: the limiting probability of AAA is the expected time spent in AAA during a cycle divided by the expected cycle length. It underlies the existence of limiting distributions for the waiting time in the GI/G/1 queue, the number in system in many queueing networks, inventory levels under (s,S)(s,S)(s,S) policies and the availability of repairable systems, and it is the continuous-time counterpart of the ergodic theorem for positive recurrent Markov chains. The paper's later sections apply it to semi-Markov processes.

Formalizing it. The results here are classical and proved; none is machine-checked. Mathlib has measure convolution and the strong law of large numbers but no renewal measure, no Blackwell or key renewal theorem, and no regenerative process. On Prove2Me only the discrete Erdős–Feller–Pollard renewal theorem for renewal sequences is proved. A completed mission supplies the continuous-time key renewal theorem in two forms, a reusable renewal-measure interface, and a general limit theorem for regenerative processes on which queueing and inventory results can be built.

Difficulty

The decomposition (3·4·3) is a direct consequence of independence and the renewal structure. The difficulty is the key renewal theorem. Blackwell's theorem controls HKH_KHK​ on intervals of fixed length; passing from intervals to a general kernel requires the kernel to be directly Riemann integrable, which is why Theorem A asks for monotonicity and Theorem 2 lists three alternative regularity conditions. A merely integrable kernel tending to zero is not enough for a general aperiodic FFF: HKH_KHK​ may concentrate on a set where the kernel has tall narrow spikes. Theorem 1 removes monotonicity only for F∈SF \in \mathfrak SF∈S, through a Laplace-transform argument that needs Lemma A, the uniqueness theorem for Laplace transforms and the fact that the singular part of HKH_KHK​ contributes nothing in the limit. Blackwell's theorem itself, for a non-lattice law with possibly infinite mean, is not in any library and is a substantial development of its own.

Formalization scope

Laws are measures on R\mathbb RR carried by [0,∞)[0,\infty)[0,∞); the distribution function is F(t)=F((−∞,t])F(t) = F((-\infty,t])F(t)=F((−∞,t]) and 1−F(v)=F((v,∞))1 - F(v) = F((v,\infty))1−F(v)=F((v,∞)). The mean μ1\mu_1μ1​ is an extended non-negative real, so μ1=∞\mu_1 = \inftyμ1​=∞ is a value; every statement with a 1/μ11/\mu_11/μ1​ treats μ1=∞\mu_1 = \inftyμ1​=∞ and μ1<∞\mu_1 < \inftyμ1​<∞ as separate cases rather than relying on a default value of division. Stieltjes integrals ∫0t⋯dHK\int_0^t \cdots dH_K∫0t​⋯dHK​ are integrals against the renewal measure over the closed interval [0,t][0,t][0,t]. Aperiodicity is the lattice condition on FFF, not a density condition. The delay law KKK in Theorem A and Theorem 1 may have mass below one.

In the equilibrium process the conditional-probability representation is stated as the defining identity of conditional probability for every Borel set of last-regeneration epochs, every t≥0t \ge 0t≥0, every zzz and every A∈AA \in \mathcal AA∈A. The paper writes TntT_{n_t}Tnt​​ for the last regeneration epoch, although under its own indexing that symbol is the first epoch after ttt; the formalization uses the last epoch at or before ttt. The delay t0t_0t0​ is real-valued, so the regeneration event is certain (hypothesis (iii)); improper delays and cycles, which §3 of the paper also allows, are outside this mission.

A trivializing formalization would condition only on {nt>0}\{n_t > 0\}{nt​>0} rather than on the epoch of the last regeneration, or fix μ1<∞\mu_1 < \inftyμ1​<∞ globally; both are ruled out, and hypothesis (iv) is imposed separately for the one set AAA of the conclusion.

Infrastructure needed: Blackwell's renewal theorem (non-lattice, finite or infinite mean), direct Riemann integrability, Laplace–Stieltjes transforms of functions of bounded variation and their uniqueness. All of these are reusable well beyond this paper; contributions of any of them are welcome. The convolution power and the Laplace–Stieltjes transform are taken from the published definition QueueingFundamentals.MG1.transforms.

Selected references

  • W. L. Smith, Regenerative stochastic processes, Proc. R. Soc. Lond. A 232 (1955), 6–31. https://doi.org/10.1098/rspa.1955.0198
  • W. L. Smith, Asymptotic renewal theorems, Proc. Roy. Soc. Edinburgh A 64 (1954), 9–48. https://doi.org/10.1017/S0080454100007482
  • D. Blackwell, A renewal theorem, Duke Math. J. 15 (1948), 145–150. https://doi.org/10.1215/S0012-7094-48-01568-3
  • P. Erdős, W. Feller, H. Pollard, A property of power series with positive coefficients, Bull. Amer. Math. Soc. 55 (1949), 201–204. https://doi.org/10.1090/S0002-9904-1949-09203-0
  • S. Asmussen, Applied Probability and Queues, 2nd ed., Springer, 2003, Ch. V–VI. https://doi.org/10.1007/b97236
10 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Regenerative Stochastic Processes 3: A Cumulative Process Has Mean (κ₁/μ₁)t + o(t) and Variance (t/μ₁){σ₂² − 2ρσ₁σ₂κ₁/μ₁ + σ₁²(κ₁/μ₁)²} + o(t)Research Paper

Why cumulative-process moments matter

Many stochastic systems accumulate a real-valued quantity while repeatedly returning to a state at which a new cycle begins. A queue may accumulate work or cost, a component may accumulate wear, and a recurrent system may accumulate time in a state. The observations at a fixed clock time usually cut through a cycle. This makes the moments of the observed process different from the moments of a sum stopped exactly at a regeneration epoch. W. L. Smith introduced cumulative processes to state mean, variance, ergodic, and central limit results for this setting in a common language (Smith 1955, §5).

The mean growth rate describes the long-run reward per unit time. The variance growth rate also records the dependence between a cycle's length and its reward. That dependence matters in systems where unusually long cycles tend to accumulate unusually large rewards; assuming the two are independent would erase a term in Smith's formula (Smith 1955, Theorem 8). This mission targets the exact first-order mean and variance asymptotics, along with the source results Smith uses to pass from completed cycles to observations at ordinary times.

Renewal and cumulative-process setting

Work on one probability space (Ω,P)(\Omega,P)(Ω,P). The cycle lengths t1,t2,…t_1,t_2,\ldotst1​,t2​,… are nonnegative, independent, identically distributed random variables whose common law is not concentrated at zero. Set T0=0T_0=0T0​=0 and Tn=t1+⋯+tnT_n=t_1+\cdots+t_nTn​=t1​+⋯+tn​ for n≥1n\geq1n≥1. Thus TnT_nTn​ is the nnnth renewal epoch after the initial renewal at time zero. For t≥0t\geq0t≥0, ntn_tnt​ counts the epochs Tk≤tT_k\leq tTk​≤t, including T0T_0T0​. The corresponding renewal function is HU(t)=E[nt]H_U(t)=\mathbb E[n_t]HU​(t)=E[nt​], where U=δ0U=\delta_0U=δ0​ is Smith's zero-delay law. These conventions come from §2·1 and §5·2 of the paper (Smith 1955, pp. 9 and 23).

A cumulative process wtw_twt​ is real valued, starts at w0=0w_0=0w0​=0, and has almost surely bounded variation on each finite nonnegative time interval. The cycle reward is yn=wTn−wTn−1y_n=w_{T_n}-w_{T_{n-1}}yn​=wTn​​−wTn−1​​. Write w~t\tilde w_tw~t​ for the total variation of the path on [0,t][0,t][0,t] and y~n\tilde y_ny~​n​ for its variation on [Tn−1,Tn][T_{n-1},T_n][Tn−1​,Tn​]. For the moment results, the cycle vectors (tn,yn,y~n)(t_n,y_n,\tilde y_n)(tn​,yn​,y~​n​) are independent and identically distributed across nnn. Their coordinates within one cycle may be dependent. This joint-cycle interpretation is required by Smith's common joint distribution for (ti,yi)(t_i,y_i)(ti​,yi​) in the proof of Lemma 5 (Smith 1955, pp. 23–24).

Let μr=E[t1r]\mu_r=\mathbb E[t_1^r]μr​=E[t1r​], κr=E[y1r]\kappa_r=\mathbb E[y_1^r]κr​=E[y1r​], and κ~r=E[y~1r]\tilde\kappa_r=\mathbb E[\tilde y_1^r]κ~r​=E[y~​1r​] when the moments exist. Put σ12=var⁡(t1)\sigma_1^2=\operatorname{var}(t_1)σ12​=var(t1​), σ22=var⁡(y1)\sigma_2^2=\operatorname{var}(y_1)σ22​=var(y1​), and c=cov⁡(t1,y1)c=\operatorname{cov}(t_1,y_1)c=cov(t1​,y1​). Smith writes c=ρσ1σ2c=\rho\sigma_1\sigma_2c=ρσ1​σ2​, with ρ\rhoρ the cycle length–reward correlation. The covariance remains defined when either variance is zero. The auxiliary sum Yt=∑i=1nt+1yiY_t=\sum_{i=1}^{n_t+1}y_iYt​=∑i=1nt​+1​yi​ includes a reward beyond the cycles completed by time ttt, exactly as in (5·2·1) (Smith 1955, p. 23).

Formalization targets

The first target is the mean part of Theorem 8. If μ1\mu_1μ1​ and κ~1\tilde\kappa_1κ~1​ are finite, then

Ewt=κ1μ1t+o(t)(t→∞).\mathbb E w_t=\frac{\kappa_1}{\mu_1}t+o(t)\qquad(t\to\infty).Ewt​=μ1​κ1​​t+o(t)(t→∞).

The goal includes the variance part under the additional assumptions μ2<∞\mu_2<\inftyμ2​<∞ and κ~2<∞\tilde\kappa_2<\inftyκ~2​<∞:

var⁡(wt)=tμ1{σ22−2cκ1μ1+σ12(κ1μ1)2}+o(t).\operatorname{var}(w_t)=\frac{t}{\mu_1} \left\{\sigma_2^2-2c\frac{\kappa_1}{\mu_1} +\sigma_1^2\left(\frac{\kappa_1}{\mu_1}\right)^2\right\}+o(t).var(wt​)=μ1​t​{σ22​−2cμ1​κ1​​+σ12​(μ1​κ1​​)2}+o(t).

Both limits are along real time, and neither assumes that a cycle's length and reward are independent. The milestone list contains the mean and variance limits for YtY_tYt​, the cycle-moment estimate used for the incomplete cycle, and Theorem 8(i) as the explicit mean target (Smith 1955, Lemmas 4, 5, 9 and Theorem 8).

What the result supplies

The theorem gives a linear approximation to the process's expected value and variance, with errors smaller than the observation horizon. The leading variance coefficient separates reward variability, cycle-length variability, and their covariance. It can therefore be used without a false independence assumption when the duration of a cycle affects the amount accumulated during it. The formulas are first-order statements; they do not claim a bounded error or a limiting distribution (Smith 1955, (5·3·6)–(5·3·7)).

Formalizing these statements requires reusable definitions of renewal counts, path variation, random-cycle rewards, and the moment conditions that make expectations and variances genuine. The statement is a draft target, not a claim that Smith's proof already has a machine-checked reconstruction. A completed development would also give formal tools for other regenerative reward models whose observations occur between renewal epochs.

Main mathematical difficulty

The auxiliary sum YtY_tYt​ is sampled at a random index, while wtw_twt​ is observed at a deterministic clock time. They differ by part of a cycle that crosses ttt. Ordinary laws for sums of a fixed number of independent rewards do not directly control either this random index or the crossing-cycle contribution. At second order, a bound on the mean difference alone does not determine the variance difference. The length–reward covariance must also survive the passage from completed cycles to the continuous-time process (Smith 1955, pp. 24–28).

Formalization scope and conventions

Lean uses real time and real-valued paths. Cycle laws are represented by random variables on one probability space; the renewal at zero is explicit. The renewal count takes the value zero on a path with infinitely many renewals before a finite time, a null event under the nondegenerate i.i.d. length law. Variation is represented by Mathlib's extended nonnegative eVariationOn and converted to a real number only under the almost-sure bounded-variation condition. The theorem states integrability of wtw_twt​ and its square as consequences of the cycle-moment assumptions, avoiding default values for divergent real integrals or variance. A finite rrrth moment is an integrability condition, not a comparison between a real number and infinity.

The paper's exact identity (5·2·2) is off by one under its own definitions of ntn_tnt​ and YtY_tYt​; the mission targets its valid asymptotic consequence (5·2·3). The last variance in the printed Lemma 5 coefficient is σ22\sigma_2^2σ22​, while Theorem 8 and the calculation require σ12\sigma_1^2σ12​. Milestone provenance retains the printed text; the Lean statements use the corrected coefficient. Lemma 9 is formalized for the absolute pppth moment E∣y1∣p\mathbb E|y_1|^pE∣y1​∣p of the cycle increment, which is the printed statement for a nonnegative cycle quantity such as the variation y~n\tilde y_ny~​n​ to which Theorem 8 applies it. Solvers may contribute the renewal and random-index estimates needed for the listed targets. A definition that makes rewards independent of cycle lengths would remove the covariance term and would not represent this mission's model.

Selected references

  • W. L. Smith, Regenerative stochastic processes, Proceedings of the Royal Society of London, Series A 232(1188):6–31, 1955. DOI: 10.1098/rspa.1955.0198.
7 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Renewal Theory and Its Ramifications: The Elementary Renewal Theorem H(t)/t → 1/μ₁ as t → ∞, Including the Case μ₁ = ∞Research Paper

Motivation

A renewal process models the successive replacements of an article that fails and is replaced at once: light bulbs, machine components, the inter-arrival times of a queue. The central quantity is the renewal function H(t)H(t)H(t), the expected number of replacements up to time ttt. Long-run average costs of maintenance and inventory policies, the throughput of regenerative systems and the rates in renewal–reward arguments are all read off the growth of H(t)H(t)H(t). W. L. Smith's survey Renewal Theory and Its Ramifications (J. R. Statist. Soc. B, 1958) organized the field around this function and opened with its oldest general limit result, the elementary renewal theorem, proved in full in §1.2 (pp. 245–247).

Timeline.

  • 1941 — W. Feller gives the first rigorous proof of the elementary renewal theorem, through a Tauberian theorem for Laplace integrals.
  • 1946 — C. Stein proves, for general sequential sampling procedures, that the stopping index has a finite exponential moment; for renewal processes this gives finite moments of all orders of the count NtN_tNt​.
  • 1948 — J. L. Doob gives a purely probabilistic proof, through the strong law of large numbers.
  • 1958 — Smith presents Doob's proof in modified form: an identity for the residual lifetime gives the lower bound, and a truncation of the lifetimes gives the upper bound, also when the mean lifetime is infinite.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) be a probability space and X1,X2,…X_1, X_2, \dotsX1​,X2​,… real random variables that are mutually independent, identically distributed, non-negative, and not almost surely zero: P(Xi=0)<1P(X_i = 0) < 1P(Xi​=0)<1. Lifetimes equal to zero with positive probability are allowed.

  • The renewal epochs are S0=0S_0 = 0S0​=0 and Sn=X1+⋯+XnS_n = X_1 + \dots + X_nSn​=X1​+⋯+Xn​.
  • The counting variable NtN_tNt​ is the number of n≥1n \ge 1n≥1 with Sn≤tS_n \le tSn​≤t, the number of renewals in [0,t][0,t][0,t]; for t≥0t \ge 0t≥0 it is the largest nnn with Sn≤tS_n \le tSn​≤t.
  • The renewal function is H(t)=ENtH(t) = \mathbb E N_tH(t)=ENt​ and the mean lifetime is μ1=EXi∈(0,∞]\mu_1 = \mathbb E X_i \in (0,\infty]μ1​=EXi​∈(0,∞].
  • The residual lifetime ζt\zeta_tζt​ is defined by SNt+1=t+ζtS_{N_t+1} = t + \zeta_tSNt​+1​=t+ζt​.
  • For Δ>0\Delta > 0Δ>0 the truncated process is Xi†=min⁡(Xi,Δ)X_i^\dagger = \min(X_i,\Delta)Xi†​=min(Xi​,Δ), with associated Sn†S_n^\daggerSn†​, Nt†N_t^\daggerNt†​, H†H^\daggerH†, μ1†\mu_1^\daggerμ1†​, ζt†\zeta_t^\daggerζt†​.

In Lean these are IsRenewalProcess P X, S X n, N X t, H X P t, mu1 X P, zeta X t and trunc Δ X in the namespace SmithRenewal.Elementary.

Formalization targets

Goal: the elementary renewal theorem (§1.2, p. 246)

H(t)t⟶μ1−1(t→∞),\frac{H(t)}{t} \longrightarrow \mu_1^{-1} \qquad (t \to \infty),tH(t)​⟶μ1−1​(t→∞),

with μ1≤∞\mu_1 \le \inftyμ1​≤∞ and μ1−1=0\mu_1^{-1} = 0μ1−1​=0 when μ1=∞\mu_1 = \inftyμ1​=∞. No moment beyond the first is assumed, and not even the first: the infinite-mean case is part of the goal.

Milestones, in the order of the paper's argument

  1. Stein's result (p. 245). There is θ0>0\theta_0 > 0θ0​>0 with EeθNt<∞\mathbb E e^{\theta N_t} < \inftyEeθNt​<∞ for every real θ≤θ0\theta \le \theta_0θ≤θ0​; hence NtN_tNt​ has finite moments of all orders and H(t)<∞H(t) < \inftyH(t)<∞.
  2. Equation (1.1) (p. 246). If μ1<∞\mu_1 < \inftyμ1​<∞, then for t≥0t \ge 0t≥0
t+Eζt=μ1{1+H(t)}.t + \mathbb E\zeta_t = \mu_1\{1 + H(t)\}.t+Eζt​=μ1​{1+H(t)}.
  1. Lower bound (p. 246). If μ1<∞\mu_1 < \inftyμ1​<∞, lim inf⁡t→∞H(t)/t≥μ1−1\liminf_{t\to\infty} H(t)/t \ge \mu_1^{-1}liminft→∞​H(t)/t≥μ1−1​.
  2. Truncation (p. 246). (Xi†)(X_i^\dagger)(Xi†​) is a renewal process, Sn†≤SnS_n^\dagger \le S_nSn†​≤Sn​, Nt†≥NtN_t^\dagger \ge N_tNt†​≥Nt​, H†(t)≥H(t)H^\dagger(t) \ge H(t)H†(t)≥H(t) and ζt†≤Δ\zeta_t^\dagger \le \Deltaζt†​≤Δ.
  3. Upper bound (p. 246). For every Δ>0\Delta > 0Δ>0,
lim sup⁡t→∞H(t)t≤lim sup⁡t→∞H†(t)t≤{μ1†}−1.\limsup_{t\to\infty}\frac{H(t)}{t} \le \limsup_{t\to\infty}\frac{H^\dagger(t)}{t} \le \{\mu_1^\dagger\}^{-1}.t→∞limsup​tH(t)​≤t→∞limsup​tH†(t)​≤{μ1†​}−1.
  1. Letting Δ→∞\Delta \to \inftyΔ→∞ (p. 247). μ1†→μ1\mu_1^\dagger \to \mu_1μ1†​→μ1​ in [0,∞][0,\infty][0,∞].

Significance

The result. The elementary renewal theorem is the law of large numbers for the renewal function: in the long run renewals occur at mean rate 1/μ11/\mu_11/μ1​. It is the basis of the renewal–reward theorem, of long-run average cost formulas for replacement, maintenance and (s,S)(s,S)(s,S) inventory policies, and of rate computations for regenerative queues. The sharper results of Smith's survey — Blackwell's theorem (1.2) and the key renewal theorem (1.3) — refine it and reduce to it on averaging.

Formalizing it. The theorem has been proved since 1941; what this mission adds is a machine-checked development of the continuous-time, real-valued renewal process in Lean, which Mathlib does not contain. Mathlib has the strong law of large numbers, independence and identical distribution, but no renewal counting process, no Wald identity and no renewal function. The platform holds a proved discrete Erdős–Feller–Pollard theorem for integer renewal sequences, a different statement about a different object; to the curators' knowledge the elementary renewal theorem for general non-negative lifetimes has not been formalized.

Difficulty

The almost-sure statement Nt/t→1/μ1N_t/t \to 1/\mu_1Nt​/t→1/μ1​ is close to the strong law, since SNt≤t<SNt+1S_{N_t} \le t < S_{N_t+1}SNt​​≤t<SNt​+1​. The obvious next step, taking expectations, fails: almost-sure convergence does not imply convergence of means, and Nt/tN_t/tNt​/t has no evident integrable dominating function. The exact relation (1.1) involves a sum with a random number of terms stopped at Nt+1N_t + 1Nt​+1, and by itself it bounds H(t)/tH(t)/tH(t)/t from one side only, because the residual lifetime ζt\zeta_tζt​ can have infinite mean. When μ1=∞\mu_1 = \inftyμ1​=∞ the relation is unavailable altogether, yet the theorem still claims a limit. Throughout, NtN_tNt​ is a priori allowed to be infinite on a null set and H(t)H(t)H(t) to be infinite, so finiteness itself is part of what must be established.

Formalization scope

  • Representation. Lifetimes are X : ℕ → Ω → ℝ, with the paper's X1,X2,…X_1, X_2, \dotsX1​,X2​,… as X 0, X 1, …. IsRenewalProcess P X bundles measurability, mutual independence (iIndepFun), IdentDistrib (X i) (X 0), non-negativity at every sample point, and P {X 0 = 0} < 1. Strict positivity is not assumed.
  • Counting. NtN_tNt​ is the cardinality in ℕ∞ of {n≥1:Sn≤t}\{n \ge 1 : S_n \le t\}{n≥1:Sn​≤t}; it is 000 for t<0t < 0t<0 and may be ∞\infty∞ on a null set.
  • Expectations. H(t)H(t)H(t), μ1\mu_1μ1​ and Eζt\mathbb E\zeta_tEζt​ are lower Lebesgue integrals with values in [0,∞][0,\infty][0,∞]. No finiteness is presupposed; finiteness of H(t)H(t)H(t) is milestone 1.
  • Ratios and limits. H(t)/tH(t)/tH(t)/t is formed in [0,∞][0,\infty][0,∞] and limits are taken as t→∞t \to \inftyt→∞ along the reals; μ1−1\mu_1^{-1}μ1−1​ is the inverse in [0,∞][0,\infty][0,∞], so ∞−1=0\infty^{-1} = 0∞−1=0 is the paper's convention.
  • Residual lifetime. ζt=SNt+1−t\zeta_t = S_{N_t+1} - tζt​=SNt​+1​−t, reading NtN_tNt​ through ENat.toNat; on the null event Nt=∞N_t = \inftyNt​=∞ this is S1−tS_1 - tS1​−t, which never affects an expectation.
  • Truncation. H†H^\daggerH†, μ1†\mu_1^\daggerμ1†​, ζt†\zeta_t^\daggerζt†​ are the same definitions applied to trunc Δ X, never separate formulas.

Ruled out. A goal restricted to μ1<∞\mu_1 < \inftyμ1​<∞, a renewal function defined through ∑rP(Sr≤t)\sum_r P(S_r \le t)∑r​P(Sr​≤t) or the renewal equation, or a real-valued ratio with 1/μ11/\mu_11/μ1​ in R\mathbb RR (where 1/0=01/0 = 01/0=0 and an infinite integral becomes 000) would each be a different, weaker or trivially true statement; none of them is the goal.

Needed infrastructure and welcome contributions. A Wald identity for stopping indices of i.i.d. sums with values in [0,∞][0,\infty][0,∞]; the comparison of a renewal count with a negative binomial count; uniform-in-ttt moment bounds for NtN_tNt​; and the lim inf/lim sup squeeze in [0,∞][0,\infty][0,∞]. The renewal process definitions and the Wald identity are reusable for Blackwell's theorem, the key renewal theorem and renewal–reward arguments. Alternative proofs of the goal (Feller's Tauberian route, a uniform-integrability argument) are welcome as long as they prove the stated goal.

Selected references

  • W. L. Smith, Renewal Theory and Its Ramifications, J. R. Statist. Soc. B 20(2):243–283, 1958. https://doi.org/10.1111/j.2517-6161.1958.tb00294.x
  • W. Feller, On the integral equation of renewal theory, Ann. Math. Statist. 12(3):243–267, 1941. https://doi.org/10.1214/aoms/1177731708
  • C. Stein, A note on cumulative sums, Ann. Math. Statist. 17(4):498–499, 1946. https://doi.org/10.1214/aoms/1177730890
  • J. L. Doob, Renewal theory from the point of view of the theory of probability, Trans. Amer. Math. Soc. 63(3):422–438, 1948. https://doi.org/10.1090/S0002-9947-1948-0025098-8
8 thms2 active usersReviewed
Markov ChainProbability·Captain: mikedeng1

Random Walks in a Random Environment 1: Transience to +∞, to −∞, or Recurrence According to Σ n⁻¹P(ρ_n > 1) < ∞, Σ n⁻¹P(ρ_n < 1) < ∞, or Both Infinite (E ln σ < 0, > 0, = 0)Research Paper

Motivation

A random walk on the integers in which the probability of stepping right depends on the current site is the simplest model of motion through a disordered medium: a particle diffusing in a crystal with impurities, a molecule moving along a heterogeneous polymer, or a gene frequency drifting under fluctuating selection. When the site-dependent probabilities are themselves drawn at random, the result is a random walk in a random environment (RWRE). Fred Solomon's 1975 paper [Solomon 1975] gave the first rigorous analysis of this model on Z\mathbb ZZ with independent, identically distributed site probabilities, and its recurrence criterion opened the subject now surveyed in [Zeitouni 2004].

Timeline. Chung [Chung 1960, pp. 65–71] gave the hitting probabilities and the recurrence/transience criterion for a nearest-neighbour chain on Z\mathbb ZZ with fixed, site-dependent transition probabilities. Fluctuation theory, as presented in Chung's A Course in Probability Theory [Chung 1968, Ch. 8], characterises when a sum of i.i.d. random variables drifts to −∞-\infty−∞, to +∞+\infty+∞, or oscillates, through the series ∑1nP(Sn>0)\sum\frac1nP(S_n>0)∑n1​P(Sn​>0) and ∑1nP(Sn<0)\sum\frac1nP(S_n<0)∑n1​P(Sn​<0). Solomon (1975) combined the two to classify the RWRE on Z\mathbb ZZ, and also computed its speed and exhibited sub-ballistic and non-Gaussian behaviour. Kesten, Kozlov and Spitzer (1975) [KKS 1975] identified stable limit laws in the transient sub-ballistic regime, and Sinai (1982) [Sinai 1982] found the (log⁡n)2(\log n)^2(logn)2 scaling of the recurrent case.

Setting

Let α=(αn)n∈Z\alpha=(\alpha_n)_{n\in\mathbb Z}α=(αn​)n∈Z​ be independent, identically distributed random variables with values in [0,1][0,1][0,1]. Given a fixed sequence a=(an)a=(a_n)a=(an​) in [0,1][0,1][0,1] (an environment), the chain MaM_aMa​ on Z\mathbb ZZ jumps from nnn to n+1n+1n+1 with probability ana_nan​ and to n−1n-1n−1 with probability βn=1−an\beta_n=1-a_nβn​=1−an​. The random walk in a random environment (Xn)n≥0(X_n)_{n\ge0}(Xn​)n≥0​ is the process obtained by first drawing α\alphaα and then running MαM_\alphaMα​ from X0=0X_0=0X0​=0; jointly,

P(α∈A, X0=x0,…,Xn=xn)=∫{α∈A}1{x0=0}∏k<nMα(xk,xk+1) dP.P(\alpha\in A,\ X_0=x_0,\dots,X_n=x_n)=\int_{\{\alpha\in A\}}\mathbf 1\{x_0=0\}\prod_{k<n}M_\alpha(x_k,x_{k+1})\,dP .P(α∈A, X0​=x0​,…,Xn​=xn​)=∫{α∈A}​1{x0​=0}k<n∏​Mα​(xk​,xk+1​)dP.

The walk is a Markov chain given the environment, but not after averaging over it. Define

σn=βnαn∈[0,∞],ρn=σ1⋯σn (n≥1),ρ−n=σ−1⋯σ−n (n≥1),\sigma_n=\frac{\beta_n}{\alpha_n}\in[0,\infty],\qquad \rho_n=\sigma_1\cdots\sigma_n\ (n\ge1),\qquad \rho_{-n}=\sigma_{-1}\cdots\sigma_{-n}\ (n\ge1),σn​=αn​βn​​∈[0,∞],ρn​=σ1​⋯σn​ (n≥1),ρ−n​=σ−1​⋯σ−n​ (n≥1),

and, for a fixed environment, the hitting probability fij=P(Xn=j for some n>0∣X0=i)f_{ij}=P(X_n=j\text{ for some }n>0\mid X_0=i)fij​=P(Xn​=j for some n>0∣X0​=i). The quantity E(ln⁡σ)E(\ln\sigma)E(lnσ) is defined when the expectation of the positive or of the negative part of ln⁡σ∈[−∞,∞]\ln\sigma\in[-\infty,\infty]lnσ∈[−∞,∞] is finite.

Formalization targets

Goal: Theorem (1.7)

Assume α0\alpha_0α0​ is not almost surely constant and either 0≤αn<10\le\alpha_n<10≤αn​<1 for all nnn or 0<αn≤10<\alpha_n\le10<αn​≤1 for all nnn. Then

∑n≥11nP(ρn>1)<∞⇒Xn→+∞,∑n≥11nP(ρn<1)<∞⇒Xn→−∞,\sum_{n\ge1}\tfrac1nP(\rho_n>1)<\infty\Rightarrow X_n\to+\infty,\qquad \sum_{n\ge1}\tfrac1nP(\rho_n<1)<\infty\Rightarrow X_n\to-\infty,n≥1∑​n1​P(ρn​>1)<∞⇒Xn​→+∞,n≥1∑​n1​P(ρn​<1)<∞⇒Xn​→−∞,

and if both series diverge, −∞=lim inf⁡Xn<lim sup⁡Xn=+∞-\infty=\liminf X_n<\limsup X_n=+\infty−∞=liminfXn​<limsupXn​=+∞, all almost surely. When E(ln⁡σ)E(\ln\sigma)E(lnσ) is defined, the three cases are exactly E(ln⁡σ)<0E(\ln\sigma)<0E(lnσ)<0, >0>0>0, =0=0=0.

Milestones

Theorem (0.1): almost-sure properties of the walk in almost every fixed environment transfer to the RWRE. Lemma (1.1)(i)–(ii): the hitting probabilities fijf_{ij}fij​ in a fixed environment with 0<an<10<a_n<10<an​<1, as ratios of series in σ\sigmaσ. Lemma (1.5): in a fixed environment, ∑(ρ−n)−1\sum(\rho_{-n})^{-1}∑(ρ−n​)−1 and ∑ρn\sum\rho_n∑ρn​ decide transience to +∞+\infty+∞, to −∞-\infty−∞, or recurrence. Lemma (1.6): fluctuation theory for i.i.d. sums, including the summability of eSne^{S_n}eSn​. Two claims from the proof of (1.7) (p. 5): the boundary cases where αn\alpha_nαn​ equals 111 or 000 with positive probability, and the equivalence E(ln⁡σ)<0  ⟺  Sn→−∞  ⟺  ∑1nP(ρn>1)<∞E(\ln\sigma)<0\iff S_n\to-\infty\iff\sum\frac1nP(\rho_n>1)<\inftyE(lnσ)<0⟺Sn​→−∞⟺∑n1​P(ρn​>1)<∞ for Sn=ln⁡σ1+⋯+ln⁡σnS_n=\ln\sigma_1+\dots+\ln\sigma_nSn​=lnσ1​+⋯+lnσn​. A companion item asserts that the RWRE exists for every law of α0\alpha_0α0​ on [0,1][0,1][0,1].

Significance

The theorem classifies the long-run behaviour of the RWRE on Z\mathbb ZZ by a condition on the law of a single site variable, with no moment assumption. It shows that the averaged drift Eα0−Eβ0E\alpha_0-E\beta_0Eα0​−Eβ0​ is not the right quantity: a walk can be recurrent or transient to the left while its average step is positive, because the criterion involves Eln⁡σE\ln\sigmaElnσ, a geometric rather than arithmetic mean. The criterion is the starting point for the speed law (Theorem (1.16) of the same paper), for the limit laws of Kesten–Kozlov–Spitzer and Sinai, and for the large-deviation theory of RWRE.

Solomon's results are proved; none of them, nor the fixed-environment criterion of Chung, is formalized in Lean. This mission produces machine-checked statements of the full trichotomy including the boundary cases σ∈{0,∞}\sigma\in\{0,\infty\}σ∈{0,∞}, of the classical hitting-probability formulas for birth–death chains on Z\mathbb ZZ, and of the fluctuation-theory criterion with infinite-valued expectations allowed.

Difficulty

The naive approach applies the law of large numbers to XnX_nXn​; it fails because the increments Xj−Xj−1X_{j}-X_{j-1}Xj​−Xj−1​ are neither independent nor stationary once the environment is averaged out. The argument must instead pass through a fixed environment, where the criterion of Lemma (1.5) involves the full random series ∑ρn\sum\rho_n∑ρn​ and ∑ρ−n−1\sum\rho_{-n}^{-1}∑ρ−n−1​, and then decide when these series converge almost surely. That step requires fluctuation theory for ln⁡ρn=∑k≤nln⁡σk\ln\rho_n=\sum_{k\le n}\ln\sigma_klnρn​=∑k≤n​lnσk​, a random walk whose steps may be infinite and may have no mean. In Lean, the main missing infrastructure is the fluctuation-theory criterion ∑1nP(Sn>0)<∞  ⟺  Sn→−∞\sum\frac1nP(S_n>0)<\infty\iff S_n\to-\infty∑n1​P(Sn​>0)<∞⟺Sn​→−∞, which Mathlib does not have, and the transfer from quenched to annealed statements for a process defined only through its cylinder laws.

Formalization scope

Everything lives in the namespace SolomonRWRE.Recurrence. The fixed-environment chain is IsChainInEnv P a i X, specified by its cylinder probabilities. The RWRE is IsRWRE P α X on an arbitrary probability space: measurable αn\alpha_nαn​ with values in [0,1][0,1][0,1] at every outcome, iIndepFun α P, identically distributed, and the joint cylinder law above. σn\sigma_nσn​, ρn\rho_nρn​, fijf_{ij}fij​ and all series are in [0,∞][0,\infty][0,∞] (ℝ≥0∞), so "<∞<\infty<∞" and "=∞=\infty=∞" are literal; series over n≥1n\ge1n≥1 are indexed by n+1n+1n+1 in Lean. ln⁡σ\ln\sigmalnσ and SnS_nSn​ are extended reals, E(ln⁡σ)E(\ln\sigma)E(lnσ) is the difference of two lower Lebesgue integrals, and "defined" means one of them is finite. Recurrence is always stated in the paper's "in fact" form: lim inf⁡Xn=−∞\liminf X_n=-\inftyliminfXn​=−∞ and lim sup⁡Xn=+∞\limsup X_n=+\inftylimsupXn​=+∞. "Correspond respectively" is formalized as three equivalences between the series conditions and the sign conditions.

Two trivializing formalizations are ruled out. Without nondegeneracy (α≡12\alpha\equiv\frac12α≡21​) both series vanish and (i), (ii) would contradict each other; the hypothesis is part of every statement that needs it. A cylinder law that cannot be met would make every theorem vacuous; a sorry-free check confirms that the environment α≡1\alpha\equiv1α≡1 with Xn=nX_n=nXn​=n satisfies IsRWRE, and the companion item asserts existence for every law of α0\alpha_0α0​. The page's alternative "0≤αn<10\le\alpha_n<10≤αn​<1 for all nnn or 0<αn≤10<\alpha_n\le10<αn​≤1 for all nnn" is kept, since a single range [0,1][0,1][0,1] would let 0⋅∞=00\cdot\infty=00⋅∞=0 change ρn\rho_nρn​.

Needed infrastructure: hitting probabilities of birth–death chains (reusable for any nearest-neighbour chain), the fluctuation-theory criterion for i.i.d. sums with extended values (reusable throughout applied probability), and a quenched-to-annealed transfer lemma. Contributions to any of these are welcome.

Selected references

  • F. Solomon, Random walks in a random environment, The Annals of Probability 3(1):1–31, 1975. https://doi.org/10.1214/aop/1176996444
  • K. L. Chung, Markov Chains with Stationary Transition Probabilities, Springer, Berlin, 1960 (pp. 65–71; reference [1] of Solomon 1975, https://doi.org/10.1214/aop/1176996444).
  • K. L. Chung, A Course in Probability Theory, Harcourt, Brace and World, New York, 1968 (Ch. 8; reference [2] of Solomon 1975, https://doi.org/10.1214/aop/1176996444).
  • H. Kesten, M. V. Kozlov, F. Spitzer, A limit law for random walk in a random environment, Compositio Mathematica 30(2):145–168, 1975. http://www.numdam.org/item/CM_1975__30_2_145_0/
  • Ya. G. Sinai, The limiting behavior of a one-dimensional random walk in a random medium, Theory of Probability and its Applications 27(2):256–268, 1982. https://doi.org/10.1137/1127028
  • O. Zeitouni, Random walks in random environment, Lectures on Probability Theory and Statistics (Saint-Flour 2001), Lecture Notes in Mathematics 1837, Springer, 2004. https://doi.org/10.1007/978-3-540-39874-5_2
9 thms2 active usersReviewed
Dynamical SystemsOperations ResearchProbability·Captain: mikedeng1

Subadditive Ergodic Theory 3: A Separable Continuous-Parameter Subadditive Process with E(Ω_I) < ∞ Has x₀ₜ/t → ξ with Probability One and in Mean, E(ξ) = γResearch Paper

Motivation

Many random growth models attach a cost, distance, or accumulated quantity to each time interval. If the quantity over a long interval is at most the sum over two adjacent intervals, it is subadditive. A stable rate over long intervals is useful even when the underlying random system does not have a simple independent-increment description. Kingman's 1973 account places percolation and products of random matrices among the applications of this framework. Its basic theorem treats integer time; the present mission concerns the change to every nonnegative real time. Kingman, §1.1 and §1.4.

The change matters because observing a process at integer times can miss arbitrarily large behavior between observations. Kingman gives a smooth stationary-increment example in Theorem 3 where no prescribed increasing bound eventually controls the values at all real times. Theorem 4 gives a condition that does control this local behavior. These two results together explain why the continuous-time statement needs more than a formal change of index type. Kingman, Theorems 3–4.

Setting

Work on a probability space (S,F,P)(S,\mathcal F,P)(S,F,P). A continuous-parameter subadditive process is a family of real random variables xstx_{st}xst​ indexed by 0≤s<t0\le s<t0≤s<t. It satisfies xsu≤xst+xtux_{su}\le x_{st}+x_{tu}xsu​≤xst​+xtu​ whenever 0≤s<t<u0\le s<t<u0≤s<t<u. Its stationarity says that, for every real shift τ≥0\tau\ge0τ≥0, the complete shifted family (xs+τ,t+τ)s<t(x_{s+\tau,t+\tau})_{s<t}(xs+τ,t+τ​)s<t​ has the same joint distribution as (xst)s<t(x_{st})_{s<t}(xst​)s<t​. Finally, the mean gt=E(x0t)g_t=E(x_{0t})gt​=E(x0t​) exists as a finite real number for each t>0t>0t>0 and obeys gt≥−Atg_t\ge-Atgt​≥−At for one constant AAA. These are the continuous-time versions of Kingman's conditions S₁, S₂, and S₃. Equality of the law of each individual coordinate would be too weak for S₂. Kingman, pp. 883–884, 887.

For an interval I⊆[0,∞)I\subseteq[0,\infty)I⊆[0,∞), the oscillation is ΩI=sup⁡s<t, s,t∈I∣xst∣\Omega_I=\sup_{s<t,\,s,t\in I}|x_{st}|ΩI​=sups<t,s,t∈I​∣xst​∣. A process has the local oscillation condition when E(ΩI)<∞E(\Omega_I)<\inftyE(ΩI​)<∞ for one nondegenerate interval III. In §1.4 the paper states that this condition then holds on every bounded interval. The quantity γ=inf⁡t>0gt/t\gamma=\inf_{t>0}g_t/tγ=inft>0​gt​/t is the mean growth rate. Kingman, (1.4.1), (1.4.6)–(1.4.7).

The paper also requires separability. Here this means that, outside one probability-zero set, the value at every admissible pair of times can be approached along a sequence from a fixed countable dense set of pairs. It is a condition on how the uncountable family is observed, and it permits discontinuous sample paths. Kingman cites the standard separability convention without defining it in §1.4; the mission makes the convention explicit. Kingman, Theorem 4 and following discussion.

Formalization targets

Theorem 4: convergence at all real times

For a separable process satisfying S₁–S₃ and the local oscillation condition, the target is an integrable real random variable ξ\xiξ such that

x0tt⟶ξalmost surely and in L1(P)(t→∞, t∈R),E(ξ)=γ=inf⁡u>0guu.\frac{x_{0t}}{t}\longrightarrow\xi\quad\text{almost surely and in }L^1(P) \quad(t\to\infty,\ t\in\mathbb R), \qquad E(\xi)=\gamma=\inf_{u>0}\frac{g_u}{u}.tx0t​​⟶ξalmost surely and in L1(P)(t→∞, t∈R),E(ξ)=γ=u>0inf​ugu​​.

The time variable ranges over all real values tending to infinity. The integer-time assertion (1.4.8) is a separate milestone, not the goal. Other milestones identify the deterministic mean rate, extend the oscillation condition to bounded intervals, record the bounds at times between consecutive integers, and state the vanishing of normalized unit-interval oscillation. Each comes from a sentence or display in §1.4. Kingman, Theorem 4 and proof.

Significance

Theorem 4 gives a long-run rate for a broad stationary subadditive family without assuming that its trajectories are continuous or differentiable. Its mean statement identifies the expectation of the random limit with a deterministic infimum of normalized expectations. The paper notes that the usual continuous-time ergodic theorem for additive integral processes is a corollary, because such processes satisfy its oscillation condition. The condition is therefore compatible with familiar additive models while also covering discontinuous subadditive ones. Kingman, p. 890.

The theorem and its argument are known from the paper; this mission asks for a machine-checked development of the stated result. A completed development would provide reusable formal interfaces for joint-law stationarity of an uncountable family, separability, extended-valued oscillations, and almost-sure plus L1L^1L1 limits. The proposed theorem statements compile as open goals; compiling them does not prove them. Kingman, §1.4.

Difficulty

An integer-time subadditive theorem controls x0n/nx_{0n}/nx0n​/n only on its discrete skeleton. It cannot by itself rule out large values of x0t/tx_{0t}/tx0t​/t for times between consecutive integers; Theorem 3 shows that such behavior can occur even with smooth stationary sample paths and finite expectations. A continuous-time result must control local variation as the observation window moves to large times. The uncountable supremum in ΩI\Omega_IΩI​ also needs a genuine extended value and a measurability convention. Kingman, Theorems 3–4.

The paper's displayed assertion (1.4.1), that gt/tg_t/tgt​/t converges as real t→∞t\to\inftyt→∞ under S₁–S₃ alone, needs qualification: a discontinuous additive function can make a deterministic subadditive mean with no such limit. The corresponding milestone includes the finite-oscillation condition assumed by Theorem 4. This correction is disclosed in the theorem's formalization note. Kingman, (1.4.1), (1.4.7).

Formalization scope

Lean indexes the family by R→R→S→R\mathbb R\to\mathbb R\to S\to\mathbb RR→R→S→R and uses only 0≤s<t0\le s<t0≤s<t; values at other pairs carry no meaning. Each valid coordinate is measurable. S₁ is pointwise in the sample point, while S₂ is equality of the probability laws of the complete path before and after every nonnegative real shift. S₃ states integrability of x0tx_{0t}x0t​ for every t>0t>0t>0 and one linear lower bound on its mean. The sample-space type is called SSS so that ΩI\Omega_IΩI​ denotes oscillation without ambiguity.

Oscillation is valued in the extended nonnegative reals. Thus an unbounded supremum is infinite, and the expected-oscillation condition cannot hold because of a default real-supremum value. Separability is the countable graph-approximation condition outside one measurable null set. The premise is finiteness on one closed interval [a,b][a,b][a,b] with 0≤a<b0\le a<b0≤a<b; the propagation milestone covers bounded intervals with either choice of endpoints. The limit in Theorem 4 uses the filter at infinity on real time. Its almost-sure convergence and convergence in mean are separate clauses, and ξ\xiξ is integrable. No continuity of paths, ergodicity, or independence is assumed.

A complete proof may build on Mathlib's measure theory, filters, Borel–Cantelli lemmas, and real analysis. The process and oscillation definitions, along with the finite-oscillation and skeleton statements, are reusable beyond this particular theorem. Contributions that establish these interfaces and the named intermediate statements are within scope. A statement limited to integer times, a marginal-only version of stationarity, or a real supremum that returns a default value on an unbounded set would not express this target.

Selected references

  • J. F. C. Kingman, Subadditive ergodic theory, The Annals of Probability 1(6):883–899, 1973. DOI: 10.1214/aop/1176996798.
7 thms2 active usersReviewed
CombinatoricsMarkov ChainProbability·Captain: mikedeng1

On the Generalized “Birth-and-Death” Process 2: For Constant Rates λ₀ ≤ μ₀ the Cumulative Population M_∞ Has Law Q_M = ((λ₀+μ₀)/2λ₀)(2M)! x^M/(2^{2M}(M!)²(2M−1))Research Paper

Motivation

A birth-and-death process describes a population in which each individual independently gives birth and dies at given rates. Kendall's 1948 paper (doi:10.1214/aoms/1177730285) solved the process with arbitrary time-dependent rates and, in its §4, introduced a second random variable alongside the population size: the cumulative population MtM_tMt​, the number of individuals that have ever been alive up to time ttt. Kendall gives two readings. If ntn_tnt​ is the number of current cases of a disease, MtM_tMt​ is the total number of cases recorded so far, and for an epidemic that is almost certain to die out, M∞M_\inftyM∞​ measures its overall severity. If ntn_tnt​ is the viable count of a bacterial population, MtM_tMt​ is the total count, in which living and dead organisms are not distinguished.

The question of this mission is the exact distribution of M∞M_\inftyM∞​ for the simplest transient process, with constant rates. Kendall answers it in §5 by solving a first-order partial differential equation for the joint generating function of (nt,Mt)(n_t, M_t)(nt​,Mt​). The resulting law involves central binomial coefficients, the same numbers that count the total progeny of a critical binary branching process.

Setting

Let λ0>0\lambda_0 > 0λ0​>0 and μ0>0\mu_0 > 0μ0​>0 be constants. In the simple birth-and-death process with these rates, a population of size nnn moves to n+1n + 1n+1 at rate λ0n\lambda_0 nλ0​n and to n−1n - 1n−1 at rate μ0n\mu_0 nμ0​n. It starts from one ancestor, n0=1n_0 = 1n0​=1. The cumulative population MtM_tMt​ starts at M0=n0=1M_0 = n_0 = 1M0​=n0​=1 and shares all the positive jumps of ntn_tnt​, so it never decreases. The process is transient (dies out with probability one) when λ0≤μ0\lambda_0 \le \mu_0λ0​≤μ0​.

Write Pn,M(t)P_{n,M}(t)Pn,M​(t) for the joint law of (nt,Mt)(n_t, M_t)(nt​,Mt​) and

ψ(z,w,t)=∑n=0∞∑M=0∞Pn,M(t) znwM\psi(z, w, t) = \sum_{n=0}^\infty\sum_{M=0}^\infty P_{n,M}(t)\,z^n w^Mψ(z,w,t)=n=0∑∞​M=0∑∞​Pn,M​(t)znwM

for its generating function (30). Kendall shows that ψ\psiψ satisfies

∂ψ∂t={λ0wz2−(λ0+μ0)z+μ0}∂ψ∂z,ψ(z,w,0)=zw,(31–32)\frac{\partial\psi}{\partial t} = \{\lambda_0 w z^2 - (\lambda_0 + \mu_0) z + \mu_0\}\frac{\partial\psi}{\partial z}, \qquad \psi(z, w, 0) = zw, \tag{31–32}∂t∂ψ​={λ0​wz2−(λ0​+μ0​)z+μ0​}∂z∂ψ​,ψ(z,w,0)=zw,(31–32)

and solves it with the roots α<β\alpha < \betaα<β of the quadratic (49), λ0wz2−(λ0+μ0)z+μ0=0\lambda_0 w z^2 - (\lambda_0 + \mu_0) z + \mu_0 = 0λ0​wz2−(λ0​+μ0​)z+μ0​=0:

ψ(z,w,t)=w α(β−z)+β(z−α)e−λ0w(β−α)t(β−z)+(z−α)e−λ0w(β−α)t.(50)\psi(z, w, t) = w\,\frac{\alpha(\beta - z) + \beta(z - \alpha)e^{-\lambda_0 w(\beta - \alpha)t}}{(\beta - z) + (z - \alpha)e^{-\lambda_0 w(\beta - \alpha)t}}. \tag{50}ψ(z,w,t)=w(β−z)+(z−α)e−λ0​w(β−α)tα(β−z)+β(z−α)e−λ0​w(β−α)t​.(50)

Setting z=1z = 1z=1 forgets ntn_tnt​, so ψ(1,w,t)\psi(1, w, t)ψ(1,w,t) generates the law of MtM_tMt​. Finally

x=4λ0μ0(λ0+μ0)2,QM=λ0+μ02λ0 (2M)!22M(M!)2 xM2M−1(M=1,2,3,… ).(52–53)x = \frac{4\lambda_0\mu_0}{(\lambda_0 + \mu_0)^2}, \qquad Q_M = \frac{\lambda_0 + \mu_0}{2\lambda_0}\,\frac{(2M)!}{2^{2M}(M!)^2}\,\frac{x^M}{2M - 1}\quad(M = 1, 2, 3, \dots). \tag{52–53}x=(λ0​+μ0​)24λ0​μ0​​,QM​=2λ0​λ0​+μ0​​22M(M!)2(2M)!​2M−1xM​(M=1,2,3,…).(52–53)

The Lean names are disc, alpha, beta, psi, x, Q and SolvesPDE, in the namespace KendallBD.Cumul.

Formalization targets

Goal: the law of the cumulative population (§5, (50)–(53), p. 11)

For 0<λ0≤μ00 < \lambda_0 \le \mu_00<λ0​≤μ0​:

  1. for every w∈(0,1)w \in (0, 1)w∈(0,1), ψ\psiψ of (50) satisfies (31) at every z∈[0,1]z \in [0, 1]z∈[0,1], t≥0t \ge 0t≥0, and ψ(z,w,0)=zw\psi(z, w, 0) = zwψ(z,w,0)=zw;
  2. for every w∈(0,1)w \in (0, 1)w∈(0,1),
lim⁡t→∞ψ(1,w,t)=∑M≥1QMwM;\lim_{t\to\infty}\psi(1, w, t) = \sum_{M \ge 1} Q_M w^M;t→∞lim​ψ(1,w,t)=M≥1∑​QM​wM;
  1. QM≥0Q_M \ge 0QM​≥0 and ∑M≥1QM=1\sum_{M\ge1} Q_M = 1∑M≥1​QM​=1.

Milestones (pp. 10–11)

  • (49): for 0<w<10 < w < 10<w<1 the roots satisfy 0<α<1<β0 < \alpha < 1 < \beta0<α<1<β.
  • (50): ψ\psiψ solves (31) with the boundary condition (32).
  • (51): ψ(1,w,∞)=wα=[λ0+μ0−(λ0+μ0)2−4λ0μ0w]/(2λ0)\psi(1, w, \infty) = w\alpha = [\lambda_0 + \mu_0 - \sqrt{(\lambda_0 + \mu_0)^2 - 4\lambda_0\mu_0 w}]/(2\lambda_0)ψ(1,w,∞)=wα=[λ0​+μ0​−(λ0​+μ0​)2−4λ0​μ0​w​]/(2λ0​).

Companions

  • (54): (Q1,Q2,Q3,Q4)=μ0λ0+μ0(1,14x,18x2,564x3)(Q_1, Q_2, Q_3, Q_4) = \frac{\mu_0}{\lambda_0 + \mu_0}(1, \frac14 x, \frac18 x^2, \frac{5}{64}x^3)(Q1​,Q2​,Q3​,Q4​)=λ0​+μ0​μ0​​(1,41​x,81​x2,645​x3).
  • (48): for λ0<μ0\lambda_0 < \mu_0λ0​<μ0​ the law has mean μ0/(μ0−λ0)\mu_0/(\mu_0 - \lambda_0)μ0​/(μ0​−λ0​) and variance λ0μ0(λ0+μ0)/(μ0−λ0)3\lambda_0\mu_0(\lambda_0 + \mu_0)/(\mu_0 - \lambda_0)^3λ0​μ0​(λ0​+μ0​)/(μ0​−λ0​)3.
  • The balanced case λ0=μ0\lambda_0 = \mu_0λ0​=μ0​: x=1x = 1x=1, QMQ_MQM​ decays like M−3/2M^{-3/2}M−3/2, and the mean of M∞M_\inftyM∞​ is infinite.

Significance

The result. The law (52) gives the full distribution of the total size of a transient linear birth-and-death population, not only its moments: the probability Q1=μ0/(λ0+μ0)Q_1 = \mu_0/(\lambda_0 + \mu_0)Q1​=μ0​/(λ0​+μ0​) that the ancestor dies childless, the tail behaviour, and the dichotomy between the subcritical case (finite mean μ0/(μ0−λ0)\mu_0/(\mu_0 - \lambda_0)μ0​/(μ0​−λ0​), geometric-type tail with ratio x<1x < 1x<1) and the critical case (heavy M−3/2M^{-3/2}M−3/2 tail, infinite mean). In the epidemic reading this is the distribution of the final size of a minor outbreak; it is also the total-progeny law of the embedded binary Galton–Watson tree (Harris 1963).

Formalizing it. The result is classical and proved, but it is not formalized anywhere known to this mission. A formal proof would combine three separate pieces: the explicit solution of a first-order PDE by characteristics, checked as a classical solution on the region where a probability generating function lives; a limit t→∞t \to \inftyt→∞ that selects one root of a quadratic; and the binomial series of 1−1−y1 - \sqrt{1 - y}1−1−y​ together with its boundary value at y=1y = 1y=1. The companions make the moments (48), which §4 derives by a separate route, a consequence of the law.

Difficulty

Checking that (50) satisfies (31) is calculus once the derivatives exist. The obstacles are elsewhere. First, the roots must be ordered as 0<α<1<β0 < \alpha < 1 < \beta0<α<1<β, which fails at w=1w = 1w=1 when λ0<μ0\lambda_0 < \mu_0λ0​<μ0​ (the roots are then 111 and μ0/λ0\mu_0/\lambda_0μ0​/λ0​): every statement about α\alphaα, β\betaβ, ψ\psiψ has to be made for 0<w<10 < w < 10<w<1, and the law is identified from the power series on that interval. Second, the normalization ∑QM=1\sum Q_M = 1∑QM​=1 is a statement at the boundary y=xw=xy = xw = xy=xw=x of the series for 1−1−y1 - \sqrt{1 - y}1−1−y​; at λ0=μ0\lambda_0 = \mu_0λ0​=μ0​ this is y=1y = 1y=1, the edge of the disc of convergence, where convergence of the series is not automatic and where the value 1−x=(μ0−λ0)/(λ0+μ0)\sqrt{1 - x} = (\mu_0 - \lambda_0)/(\lambda_0 + \mu_0)1−x​=(μ0​−λ0​)/(λ0​+μ0​) uses λ0≤μ0\lambda_0 \le \mu_0λ0​≤μ0​. For λ0>μ0\lambda_0 > \mu_0λ0​>μ0​ the same series sums to μ0/λ0<1\mu_0/\lambda_0 < 1μ0​/λ0​<1, so the hypothesis is essential. Third, the asymptotic M−3/2M^{-3/2}M−3/2 in the balanced case needs the asymptotics of central binomial coefficients.

Formalization scope

All objects are real functions; the process and the joint law Pn,M(t)P_{n,M}(t)Pn,M​(t) are not constructed, exactly as in the paper. "The law of M∞M_\inftyM∞​" is read, as on p. 11, as the coefficients of the generating function lim⁡t→∞ψ(1,w,t)\lim_{t\to\infty}\psi(1, w, t)limt→∞​ψ(1,w,t), and ψ\psiψ is tied to the process through the equation (31) and the boundary condition (32). The committed conventions are:

  • constant rates 0<λ0≤μ00 < \lambda_0 \le \mu_00<λ0​≤μ0​ (strict λ0<μ0\lambda_0 < \mu_0λ0​<μ0​ for the moment companion, λ0=μ0\lambda_0 = \mu_0λ0​=μ0​ for the balanced companion);
  • α\alphaα and β\betaβ are given by the quadratic formula, α\alphaα with the minus sign, Real.sqrt the nonnegative root;
  • statements about α\alphaα, β\betaβ, ψ\psiψ hold for w∈(0,1)w \in (0, 1)w∈(0,1); (31) is asserted for z∈[0,1]z \in [0, 1]z∈[0,1], t≥0t \ge 0t≥0, and the boundary condition for every real zzz;
  • (31) is SolvesPDE: both partial derivatives exist as HasDerivAt facts and satisfy the equation, never an equation between deriv values;
  • Q0=0Q_0 = 0Q0​=0 (since M∞≥M0=1M_\infty \ge M_0 = 1M∞​≥M0​=1), and QMQ_MQM​ keeps the printed shape (2M)!/(22M(M!)2)(2M)!/(2^{2M}(M!)^2)(2M)!/(22M(M!)2) with 2M−12M - 12M−1 in the reals;
  • "infinite mean" is non-summability of ∑MQM\sum M Q_M∑MQM​; the variance is stated through the second moment.

A goal that only asserted the power series identity 1−1−y=∑M≥1(2M)!22M(M!)2(2M−1)yM1 - \sqrt{1 - y} = \sum_{M\ge1}\frac{(2M)!}{2^{2M}(M!)^2(2M-1)}y^M1−1−y​=∑M≥1​22M(M!)2(2M−1)(2M)!​yM would be a different and easier theorem with no birth-and-death content; the goal therefore ties QMQ_MQM​ to ψ\psiψ of (50) and ψ\psiψ to the equation (31)–(32).

A complete development needs the binomial series for 1−y\sqrt{1 - y}1−y​ with real coefficients (Mathlib has Nat.centralBinom and general binomial series, and the platform has the generating function of the central binomial coefficients as a proof tool), the boundary behaviour of a power series with nonnegative coefficients, and Stirling-type asymptotics of (2MM)4−M\binom{2M}{M}4^{-M}(M2M​)4−M. These are reusable well beyond this mission. Contributions proving any milestone or companion, or the series lemma on its own, are welcome.

Selected references

  • D. G. Kendall, On the generalized "birth-and-death" process, Annals of Mathematical Statistics 19(1):1–15, 1948. doi:10.1214/aoms/1177730285
  • T. E. Harris, The Theory of Branching Processes, Springer, 1963. doi:10.1007/978-3-642-51866-9
5 thms2 active usersReviewed
Control TheoryProbability·Captain: mikedeng1

Backward-Forward Stochastic Differential Equations 1: A Backward Equation Driven by a Bounded-Variation Integrator Has a Unique Adapted Solution in L¹(μ) Under Integrability AloneResearch Paper

Motivation

Backward stochastic differential equations (BSDEs) prescribe a process by its terminal value rather than its initial value: the unknown VVV must be adapted to the information flow, yet must reach a given random variable YYY at the horizon TTT. They arise in mathematical finance (pricing and hedging, where YYY is a contingent claim), in stochastic control (adjoint equations of the stochastic maximum principle) and in economics, where the stochastic differential utility of Duffie and Epstein (1992) defines the utility of a consumption stream as the solution of a backward equation.

Timeline:

  • 1990. Pardoux and Peng prove existence and uniqueness of adapted solutions for Lipschitz BSDEs driven by a Brownian motion, with square-integrable data (doi:10.1016/0167-6911(90)90082-6).
  • 1992. Duffie and Epstein introduce stochastic differential utility and state a conjecture on the well-posedness of the defining backward equation under LpL^pLp integrability (doi:10.2307/2951600).
  • 1993. Antonelli treats the backward equation with a general bounded-variation integrator AAA in place of dtdtdt, under integrability alone, and answers the Duffie–Epstein question for p=1p=1p=1 (doi:10.1214/aoap/1177005363). This mission formalizes that result, §2 of the paper.

Setting

Let (Ω,F,(Ft)0≤t≤T,P)(\Omega,\mathcal F,(\mathcal F_t)_{0\le t\le T},P)(Ω,F,(Ft​)0≤t≤T​,P) be a complete filtered probability space satisfying the usual hypotheses: the filtration is right-continuous and F0\mathcal F_0F0​ contains every PPP-null set. Let AAA be an adapted process with right-continuous paths of bounded variation, A0=0A_0=0A0​=0, whose total variation process ∣A∣t|A|_t∣A∣t​ satisfies ∣A∣T≤β|A|_T\le\beta∣A∣T​≤β for a constant β>0\beta>0β>0. Integrals ∫sthr dAr\int_s^t h_r\,dA_r∫st​hr​dAr​ are pathwise Lebesgue–Stieltjes integrals over (s,t](s,t](s,t].

The Doléans–Dade measure μ\muμ of ∣A∣|A|∣A∣ is the finite measure on [0,T]×Ω[0,T]\times\Omega[0,T]×Ω with

∫X dμ=E(∫0TXs ∣dAs∣),\int X\,d\mu=E\Big(\int_0^T X_s\,|dA_s|\Big),∫Xdμ=E(∫0T​Xs​∣dAs​∣),

and L1(μ)L^1(\mu)L1(μ) is the space of jointly measurable processes VVV with ∥V∥L1(μ)=E(∫0T∣Vt∣ ∣dAt∣)<+∞\|V\|_{L^1(\mu)}=E\big(\int_0^T|V_t|\,|dA_t|\big)<+\infty∥V∥L1(μ)​=E(∫0T​∣Vt​∣∣dAt​∣)<+∞.

The data are a driver gs(ω,u)g_s(\omega,u)gs​(ω,u), jointly measurable, and a terminal value YYY, subject to hypotheses 1–4:

  1. ∣gs(u)−gs(v)∣≤k∣u−v∣|g_s(u)-g_s(v)|\le k|u-v|∣gs​(u)−gs​(v)∣≤k∣u−v∣ for some k>0k>0k>0, all u,vu,vu,v and all s∈[0,T]s\in[0,T]s∈[0,T];
  2. gs(⋅,u)g_s(\cdot,u)gs​(⋅,u) is Fs\mathcal F_sFs​-measurable;
  3. E(∫0T∣gs(0)∣ ∣dAs∣)<+∞E\big(\int_0^T|g_s(0)|\,|dA_s|\big)<+\inftyE(∫0T​∣gs​(0)∣∣dAs​∣)<+∞;
  4. Y∈L1(P)Y\in L^1(P)Y∈L1(P) is FT\mathcal F_TFT​-measurable.

The backward equation is the fixed-point problem for

G(V)t=E(∫tTgs(Vs) dAs+Y ∣ Ft).(2.1)G(V)_t=E\Big(\int_t^T g_s(V_s)\,dA_s+Y\ \Big|\ \mathcal F_t\Big).\tag{2.1}G(V)t​=E(∫tT​gs​(Vs​)dAs​+Y ​ Ft​).(2.1)

When At=tA_t=tAt​=t this is the Duffie–Epstein equation Vt=E(∫tTgs(Vs) ds+Y∣Ft)V_t=E\big(\int_t^T g_s(V_s)\,ds+Y\mid\mathcal F_t\big)Vt​=E(∫tT​gs​(Vs​)ds+Y∣Ft​).

Formalization targets

Goal: Theorem 2.4

Under hypotheses 1–4 there is a progressively measurable process V∈L1(μ)V\in L^1(\mu)V∈L1(μ) with càdlàg paths such that

E(∫0T∣G(V)t−Vt∣ ∣dAt∣)=0,E\Big(\int_0^T|G(V)_t-V_t|\,|dA_t|\Big)=0,E(∫0T​∣G(V)t​−Vt​∣∣dAt​∣)=0,

VVV is a semimartingale through the decomposition

Vt=E(∫0Tgs(Vs) dAs+Y ∣ Ft)−∫0tgs(Vs) dAs,(2.9)V_t=E\Big(\int_0^T g_s(V_s)\,dA_s+Y\ \Big|\ \mathcal F_t\Big)-\int_0^t g_s(V_s)\,dA_s,\tag{2.9}Vt​=E(∫0T​gs​(Vs​)dAs​+Y ​ Ft​)−∫0t​gs​(Vs​)dAs​,(2.9)

and any two solutions in L1(μ)L^1(\mu)L1(μ) agree μ\muμ-almost everywhere.

Milestones

In the order of the paper's argument:

  1. Remark 2.2, (2.6): E(H∫[0,∞)a(s) dCs)=E(∫[0,∞)Hs a(s) dCs)E\big(H\int_{[0,\infty)}a(s)\,dC_s\big)=E\big(\int_{[0,\infty)}H_s\,a(s)\,dC_s\big)E(H∫[0,∞)​a(s)dCs​)=E(∫[0,∞)​Hs​a(s)dCs​) for an adapted increasing càdlàg CCC and a càdlàg version HtH_tHt​ of E(H∣Ft)E(H\mid\mathcal F_t)E(H∣Ft​), for HHH positive or in L1L^1L1.
  2. Lemma 2.3: GGG maps L1(μ)L^1(\mu)L1(μ) into L1(μ)L^1(\mu)L1(μ).
  3. The relation ∑i=0n(−1)iAt((n−i)−)At(i)=0\sum_{i=0}^n(-1)^iA_t^{((n-i)-)}A_t^{(i)}=0∑i=0n​(−1)iAt((n−i)−)​At(i)​=0 between the iterated integrals A(n)=((A⋅A)⋯ )⋅AA^{(n)}=((A\cdot A)\cdots)\cdot AA(n)=((A⋅A)⋯)⋅A and A(n−)=((A−⋅A)−⋯ )⋅AA^{(n-)}=((A_-\cdot A)_-\cdots)\cdot AA(n−)=((A−​⋅A)−​⋯)⋅A.
  4. (2.7): ∣G(n)(U)t−G(n)(V)t∣≤knE(∫tT(As−−At)[n−1]∣Us−Vs∣ dAs∣Ft)|G^{(n)}(U)_t-G^{(n)}(V)_t|\le k^nE\big(\int_t^T(A_{s-}-A_t)^{[n-1]}|U_s-V_s|\,dA_s\mid\mathcal F_t\big)∣G(n)(U)t​−G(n)(V)t​∣≤knE(∫tT​(As−​−At​)[n−1]∣Us​−Vs​∣dAs​∣Ft​).
  5. (2.8): E∫0T∣G(n)(U)t−G(n)(V)t∣ dAt≤knE∫0TAt−(n−)∣Ut−Vt∣ dAtE\int_0^T|G^{(n)}(U)_t-G^{(n)}(V)_t|\,dA_t\le k^nE\int_0^TA^{(n-)}_{t-}|U_t-V_t|\,dA_tE∫0T​∣G(n)(U)t​−G(n)(V)t​∣dAt​≤knE∫0T​At−(n−)​∣Ut​−Vt​∣dAt​.
  6. At(n−)≤Atn/n!A^{(n-)}_t\le A_t^n/n!At(n−)​≤Atn​/n!.
  7. The iterate bound ∥G(n)(U)−G(n)(V)∥L1(μ)≤kn(βn/n!)∥U−V∥L1(μ)\|G^{(n)}(U)-G^{(n)}(V)\|_{L^1(\mu)}\le k^n(\beta^n/n!)\|U-V\|_{L^1(\mu)}∥G(n)(U)−G(n)(V)∥L1(μ)​≤kn(βn/n!)∥U−V∥L1(μ)​.

Milestones 3–7 live inside the proof, after its reduction to nondecreasing AAA.

Significance

The result. Theorem 2.4 gives well-posedness of a backward equation with no square-integrability and no Brownian structure: the filtration is arbitrary (subject to the usual hypotheses), the integrator may jump, and only first moments are required. In the case At=tA_t=tAt​=t it settles the p=1p=1p=1 case of the Duffie–Epstein conjecture, so stochastic differential utility is well defined for integrable consumption data. The same fixed-point scheme, with the Doléans measure of a dominating process, is the basis of the coupled backward–forward result of §3 of the paper (a separate mission of this series).

Formalizing it. The theorem is proved in the literature but, as far as is known, has no machine-checked proof; Mathlib has conditional expectations, filtrations, martingales and Stieltjes measures, but no càdlàg process theory, no optional projection and no Doléans measure. A complete development produces these pieces. Its milestones also make precise points the paper leaves implicit: G is defined only up to versions, and the iterate bound is printed with GGG in place of G(n)G^{(n)}G(n).

Difficulty

The obvious approach is to show that GGG itself is a contraction on L1(μ)L^1(\mu)L1(μ). It is not in general: the one-step bound is kβk\betakβ, and nothing makes kβ<1k\beta<1kβ<1. The argument must instead control the nnn-th iterate. This needs exchanging a conditional expectation with a Stieltjes integral against a random measure, which is the optional projection identity (2.6). It also needs iterated integrals against an integrator with jumps, where the continuous-case identity A(n)=An/n!A^{(n)}=A^n/n!A(n)=An/n! fails and only the inequality A(n−)≤An/n!A^{(n-)}\le A^n/n!A(n−)≤An/n! survives. A second difficulty is measure-theoretic: G(V)tG(V)_tG(V)t​ is defined only almost surely for each fixed ttt, and the L1(μ)L^1(\mu)L1(μ) norm sees the whole path. A version must be chosen with càdlàg paths before the equation even makes sense in L1(μ)L^1(\mu)L1(μ).

Formalization scope

  • Time is R≥0\mathbb R_{\ge0}R≥0​ with a horizon T>0T>0T>0; only [0,T][0,T][0,T] matters. Integrals ∫st\int_s^t∫st​ are over (s,t](s,t](s,t].
  • The integrator is a structure BVIntegrator carrying AAA with its Jordan decomposition A=A+−A−A=A^+-A^-A=A+−A− as data, tied to Mathlib's eVariationOn so that A++A−=∣A∣A^++A^-=|A|A++A−=∣A∣. ∣dA∣=dA++dA−|dA|=dA^++dA^-∣dA∣=dA++dA− are Stieltjes measures of the paths.
  • L1(μ)L^1(\mu)L1(μ) norms are lower integrals in [0,∞][0,\infty][0,∞]; membership is joint measurability plus a finite norm.
  • G(V)G(V)G(V) is never a Lean function. Statements quantify over versions: jointly measurable processes WWW, càdlàg on [0,T][0,T][0,T], with Wt=E(ξt∣Ft)W_t=E(\xi_t\mid\mathcal F_t)Wt​=E(ξt​∣Ft​) a.s. for each ttt, where every ξt=∫tTgs(Vs) dAs+Y\xi_t=\int_t^Tg_s(V_s)\,dA_s+Yξt​=∫tT​gs​(Vs​)dAs​+Y is required to be integrable. Picard iterates are chains of such versions.
  • Explicit choices relative to the page: the usual hypotheses and right-continuous integrators (Protter's conventions, p. 778); integrability of every conditional-expectation argument; càdlàg versions; AAA nondecreasing in milestones 3–7, as in the proof; in (2.6), C0≥0C_0\ge0C0​≥0 with C0−=0C_{0-}=0C0−​=0, an [0,∞][0,\infty][0,∞]-valued version of E(H∣Ft)E(H\mid\mathcal F_t)E(H∣Ft​) in the positive case, and in the L1L^1L1 case finiteness of E(∣H∣∫a dC)E(|H|\int a\,dC)E(∣H∣∫adC); "semimartingale" expressed by the decomposition (2.9), with the martingale property stated for Mmin⁡(t,T)M_{\min(t,T)}Mmin(t,T)​; G(n)G^{(n)}G(n) in place of the printed GGG in the iterate bound.
  • A formalization that lets G(V)G(V)G(V) be a conditional expectation of a non-integrable argument (Mathlib returns 000), or that states only existence or only uniqueness, is trivial and is ruled out: both halves are in the goal, and every version carries the integrability of its argument.
  • Reusable infrastructure: optional projection for increasing integrators, càdlàg versions of martingales, iterated Stieltjes integrals and their factorial bounds. Contributions to any of these are welcome, as are proofs of the special case At=tA_t=tAt​=t.

Selected references

  • F. Antonelli, Backward-forward stochastic differential equations, Ann. Appl. Probab. 3(3) (1993) 777–793. doi:10.1214/aoap/1177005363
  • D. Duffie and L. G. Epstein, Stochastic differential utility, Econometrica 60(2) (1992) 353–394. doi:10.2307/2951600
  • E. Pardoux and S. Peng, Adapted solution of a backward stochastic differential equation, Systems Control Lett. 14(1) (1990) 55–61. doi:10.1016/0167-6911(90)90082-6
  • C. Dellacherie and P.-A. Meyer, Probabilities and Potential B, North-Holland, 1982 (Theorem VI.57).
  • P. Protter, Stochastic Integration and Differential Equations, Springer, 1990. doi:10.1007/978-3-662-02619-9
10 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions 2: Geometric Convergence Rate of the Random Directions Algorithm to UniformResearch Paper

Motivation

Generating points uniformly distributed over a bounded region S⊆RnS\subseteq\mathbb R^nS⊆Rn is a basic subroutine in Monte Carlo integration, in estimating the volume of a region, in randomized search for optimization, and in identifying redundant constraints of mathematical programs. When SSS is given only implicitly, for instance by a system of inequalities, the classical methods break down in high dimension: transformation methods need a tractable description of SSS, and rejection from an enclosing box or ball accepts a fraction of proposals that decays exponentially with nnn.

Smith (Oper. Res. 32(6), 1984) studied a family of Markov chain methods, mixing algorithms, that avoid rejection altogether. The best known member is the Random Directions Algorithm, now called hit-and-run: from the current point, pick a direction uniformly at random and move to a uniformly random point of SSS on the line through the current point in that direction. Boneh and Golan (1979) proposed it for constraint identification and conjectured, without proof, that it generates uniform points; Smith (1980, 1984) proved asymptotic uniformity, and Section 3 of the 1984 paper gives an explicit geometric convergence rate. This mission targets that rate, Theorem 3.

Later work, in particular Lovász (Math. Program. 86, 1999) and Lovász and Vempala (SIAM J. Comput. 35, 2006), proved polynomial mixing bounds for hit-and-run on convex bodies. Smith's bound is exponential in nnn, but it holds for every open bounded region, convex or not, and from every starting point.

Setting

Write VVV for nnn-dimensional Lebesgue measure (content) on Rn\mathbb R^nRn and ∥⋅∥\|\cdot\|∥⋅∥ for the Euclidean norm. Let S⊆RnS\subseteq\mathbb R^nS⊆Rn be open, bounded and nonempty.

  • The uniform distribution over SSS is λ(A)=V(A∩S)/V(S)\lambda(A)=V(A\cap S)/V(S)λ(A)=V(A∩S)/V(S).
  • For x∈Sx\in Sx∈S and a unit vector ddd, the line set is L=S∩{x+td:t∈R}L=S\cap\{x+td:t\in\mathbb R\}L=S∩{x+td:t∈R}, and its length is ℓ(x,d)=Leb1{t:x+td∈S}\ell(x,d)=\mathrm{Leb}_1\{t: x+td\in S\}ℓ(x,d)=Leb1​{t:x+td∈S}. For convex SSS this is the chord length; in general LLL may consist of many segments.
  • One step of the Random Directions Algorithm from x∈Sx\in Sx∈S: draw ddd uniformly on the unit sphere {d:∥d∥=1}\{d:\|d\|=1\}{d:∥d∥=1}, then draw Xi+1X_{i+1}Xi+1​ uniformly on LLL. The transition kernel is
P(A∣x)=∫Leb1{t:x+td∈S∩A}ℓ(x,d) σ(dd),P(A\mid x)=\int \frac{\mathrm{Leb}_1\{t:x+td\in S\cap A\}}{\ell(x,d)}\,\sigma(\mathrm dd),P(A∣x)=∫ℓ(x,d)Leb1​{t:x+td∈S∩A}​σ(dd),

with σ\sigmaσ the normalized surface measure of the sphere, and Pm(A∣x)=P(Xm∈A∣X0=x)P^m(A\mid x)=P(X_m\in A\mid X_0=x)Pm(A∣x)=P(Xm​∈A∣X0​=x) is its mmm-step iterate.

  • R⋆R^\starR⋆ is the radius of the smallest ball containing SSS, Vn(r)V_n(r)Vn​(r) the volume of a ball of radius rrr, and
γ=V(S)Vn(R⋆)∈(0,1]\gamma=\frac{V(S)}{V_n(R^\star)}\in(0,1]γ=Vn​(R⋆)V(S)​∈(0,1]

the fraction of its smallest enclosing ball that SSS fills.

  • Sn(r)=nVn(1)rn−1S_n(r)=nV_n(1)r^{n-1}Sn​(r)=nVn​(1)rn−1 is the surface area of a sphere of radius rrr, and d=diam⁡Sd=\operatorname{diam}Sd=diamS.

Formalization targets

Goal: Theorem 3 (p. 1304)

For n≥2n\ge2n≥2, every x∈Sx\in Sx∈S, every measurable A⊆SA\subseteq SA⊆S and every m≥1m\ge1m≥1,

∣P(Xm∈A∣X0=x)−λ(A)∣<(1−γn 2n−1)m−1.\bigl|P(X_m\in A\mid X_0=x)-\lambda(A)\bigr|<\Bigl(1-\frac{\gamma}{n\,2^{n-1}}\Bigr)^{m-1}.​P(Xm​∈A∣X0​=x)−λ(A)​<(1−n2n−1γ​)m−1.

The constant is the paper's. The bound is uniform in the starting point and in AAA, and it depends on SSS only through nnn and γ\gammaγ.

Milestones (the steps of the paper's proof, in order)

  1. Lemma 1 for this algorithm: λ\lambdaλ is stationary, λ(A)=∫SP(A∣x) λ(dx)\lambda(A)=\int_S P(A\mid x)\,\lambda(\mathrm dx)λ(A)=∫S​P(A∣x)λ(dx).
  2. Doob's Case (b) bound: for a chain with stationary law π\piπ and a minorization P(A∣x)≥δ φ(A∩C)P(A\mid x)\ge\delta\,\varphi(A\cap C)P(A∣x)≥δφ(A∩C) on a closed set CCC that carries π\piπ, ∣Pm(A∣x)−π(A)∣≤(1−δφ(C))m−1|P^m(A\mid x)-\pi(A)|\le(1-\delta\varphi(C))^{m-1}∣Pm(A∣x)−π(A)∣≤(1−δφ(C))m−1.
  3. Density formula: P(A∣x)=∫Af(y∣x) dyP(A\mid x)=\int_A f(y\mid x)\,\mathrm dyP(A∣x)=∫A​f(y∣x)dy with f(y∣x)=2/(Sn(∥y−x∥) ℓ(x,y))f(y\mid x)=2/\bigl(S_n(\|y-x\|)\,\ell(x,y)\bigr)f(y∣x)=2/(Sn​(∥y−x∥)ℓ(x,y)).
  4. Density lower bound: f(y∣x)>δ=2/(d Sn(d))f(y\mid x)>\delta=2/(d\,S_n(d))f(y∣x)>δ=2/(dSn​(d)) for all distinct x,y∈Sx,y\in Sx,y∈S when n≥2n\ge2n≥2.
  5. Constant comparison: δ V(S)≥γ/(n2n−1)\delta\,V(S)\ge\gamma/(n2^{n-1})δV(S)≥γ/(n2n−1).

Significance

The result. Theorems 1 and 2 of the paper (the companion mission) establish only that the chain converges to λ\lambdaλ. Theorem 3 makes this quantitative: the deviation from uniformity decays geometrically, at a rate computable from the dimension and the shape ratio γ\gammaγ alone. It shows which features of a region govern convergence, it gives a stopping rule with a guarantee, and it holds for non-convex regions, which the later polynomial-time analyses of hit-and-run do not cover. The paper notes the bound is of practical use only in low dimension; its value lies in being explicit and fully general.

Formalizing it. The theorem is proved in the paper, but parts of the proof are heuristic: the density is derived by a limit over small cubes, and the step from δ\deltaδ to γ\gammaγ uses a claim about circumscribed spheres that is false as stated (see below). A machine-checked proof would produce, as reusable components, a general-state-space Doeblin bound (no such theorem currently exists on the platform; the existing Doeblin results are finite-state), a measure-theoretic definition of hit-and-run as a Markov kernel, and the polar-coordinates computation of its density. None of these has, to our knowledge, been formalized.

Difficulty

The obvious argument is: the density is bounded below on SSS, so Doeblin's condition holds, so the chain converges geometrically. Each step hides work. The density is not given by the algorithm but must be derived: the algorithm draws a direction and a scalar, and the change of variables from (direction, signed distance) to the endpoint is two-to-one and carries the Jacobian ∥y−x∥n−1\|y-x\|^{n-1}∥y−x∥n−1, which is where SnS_nSn​ and the factor 2 come from. The Doeblin step needs a stationary law and the fact that the chain started in SSS never leaves SSS. For non-convex SSS, the paper's "diameter along the ray" must be replaced by the measure of the line set, and the maximal chord does not bound the distance ∥y−x∥\|y-x\|∥y−x∥; the diameter of SSS is needed instead. Finally, the paper's assertion that the ball of radius d/2d/2d/2 circumscribes SSS fails already for an equilateral triangle, so the final comparison must go through the smallest enclosing ball's radius R⋆≥d/2R^\star\ge d/2R⋆≥d/2.

Formalization scope

  • Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n) with Lebesgue measure. The region is a set S with IsOpen S and Bornology.IsBounded S; boundedness is the paper's standing assumption ("bounded regions").
  • The transition law is a Mathlib ProbabilityTheory.Kernel built operationally from the algorithm: the uniform law on the line set, integrated against the normalized surface measure of the unit sphere (Mathlib's Measure.toSphere, divided by its total mass nVn(1)nV_n(1)nVn​(1)). Off SSS the kernel is the identity, which the chain started in SSS never uses. The mmm-step law is the published MarkovChainCLT.iterKernel.
  • λ\lambdaλ is Lebesgue measure restricted to SSS divided by V(S)V(S)V(S). γ\gammaγ uses the infimum of radii of closed balls containing SSS; the ball is not a free parameter. δ=2/(d Sn(d))\delta=2/(d\,S_n(d))δ=2/(dSn​(d)) is defined from d=diam⁡Sd=\operatorname{diam}Sd=diamS, not assumed.
  • Deviations from the printed statement. (i) The goal assumes n≥2n\ge2n≥2: for n=1n=1n=1 the strict inequality is false (on an interval X1X_1X1​ is already uniform and γ=1\gamma=1γ=1, so both sides vanish for m≥2m\ge2m≥2). (ii) The density uses the line-set length ℓ(x,y)\ell(x,y)ℓ(x,y) instead of "the diameter of SSS along the ray", which coincides for convex SSS. (iii) The paper's d=max⁡x,yd(x,y)d=\max_{x,y}d(x,y)d=maxx,y​d(x,y) is taken as diam⁡S\operatorname{diam}SdiamS. (iv) The Doob step is stated with a kernel-form minorization rather than a lower bound on the density of the absolutely continuous part, which it is implied by, and with CCC a closed set carrying the stationary law, which is what C=SC=SC=S means inside Rn\mathbb R^nRn. (v) The final comparison is stated as δV(S)≥γ/(n2n−1)\delta V(S)\ge\gamma/(n2^{n-1})δV(S)≥γ/(n2n−1), the true inequality behind the paper's false circumscribed-sphere claim. No statement weakens the paper's constant.
  • Ruled out. The kernel is not defined through the density formula (which would make milestone 3 definitional and remove the algorithm from the goal), and neither stationarity nor a minorization is a hypothesis of the goal: Theorem 3 assumes only conditions on nnn, SSS, xxx, AAA and mmm.
  • Contributions welcome: the general Doeblin bound, the polar-coordinates density computation (useful for any line-sampling algorithm), and proofs that the kernel is Markov on SSS and reversible with respect to λ\lambdaλ.

Selected references

  • R. L. Smith, Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions, Operations Research 32(6):1296–1308, 1984. https://doi.org/10.1287/opre.32.6.1296
  • A. Boneh and A. Golan, Constraints' redundancy and feasible region boundedness by random feasible point generator (RFPG), Third European Congress on Operations Research (EURO III), Amsterdam, 1979.
  • J. L. Doob, Stochastic Processes, Wiley, 1953 (Case (b), p. 197).
  • L. Lovász, Hit-and-run mixes fast, Mathematical Programming 86:443–461, 1999. https://doi.org/10.1007/s101070050099
  • L. Lovász and S. Vempala, Hit-and-run from a corner, SIAM Journal on Computing 35(4):985–1005, 2006. https://doi.org/10.1137/S009753970544727X
10 thms2 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions 1: Symmetric Mixing Algorithms Converge to the Uniform Distribution from Every Starting PointResearch Paper

Motivation

Sampling uniformly from a bounded region can be difficult when direct transformation of a familiar random variable is unavailable and rejection sampling spends most of its trials outside the region. Robert L. Smith studied procedures that move within the region: from the current point, choose a direction, form the line set through that point inside the region, and choose the next point uniformly on that line set. The resulting sequence is a homogeneous Markov chain. The Random Directions Algorithm, later commonly called hit-and-run, is a central instance of this construction. Smith's 1984 paper establishes conditions under which the chain approaches the uniform distribution even when its initial point is fixed rather than sampled uniformly (Smith 1984, pp. 1298–1301).

For simulation, the initial point is usually chosen because it is known to be feasible. The question is therefore whether the distribution after many moves forgets that particular choice. A stationary distribution alone does not answer this: stationarity describes what happens if the chain already starts with that distribution. Smith's Theorem 2 gives the stronger, pointwise starting-state statement for the class of symmetric mixing algorithms satisfying his two regularity assumptions (Smith 1984, p. 1301).

Setting

Let SSS be the state region and VVV its finite, nonzero content measure. In Smith's geometric setting, SSS is a bounded kkk-dimensional measurable region in Rn\mathbb R^nRn, and VVV is kkk-dimensional content; at k=0k=0k=0, content is counting measure. A Markov transition kernel PPP assigns to every current point x∈Sx\in Sx∈S a probability P(x,A)P(x,A)P(x,A) of entering a measurable set A⊆SA\subseteq SA⊆S on the next move. For the associated chain (X0,X1,…)(X_0,X_1,\ldots)(X0​,X1​,…), the mmm-step transition probability is Pm(x,A)=P(Xm∈A∣X0=x)P^m(x,A)=\mathbb P(X_m\in A\mid X_0=x)Pm(x,A)=P(Xm​∈A∣X0​=x).

The uniform law is λ(A)=V(A)/V(S)\lambda(A)=V(A)/V(S)λ(A)=V(A)/V(S). Smith's Assumption (a) gives a measurable transition density f(y∣x)f(y\mid x)f(y∣x) relative to VVV:

P(x,A)=∫Af(y∣x) V(dy).P(x,A)=\int_A f(y\mid x)\,V(dy).P(x,A)=∫A​f(y∣x)V(dy).

For a symmetric mixing algorithm, the paper states that this density satisfies f(y∣x)=f(x∣y)f(y\mid x)=f(x\mid y)f(y∣x)=f(x∣y) for all x,y∈Sx,y\in Sx,y∈S. Assumption (b) says f(y∣x)>0f(y\mid x)>0f(y∣x)>0 for all such pairs. These are pointwise conditions, including states of zero VVV-measure. A nonempty measurable set AAA is closed if P(x,A)=1P(x,A)=1P(x,A)=1 for every x∈Ax\in Ax∈A. The chain is indecomposable in the paper's sense when it has no two disjoint closed sets (Smith 1984, pp. 1299–1300).

Formalization targets

Stationarity and indecomposability

Lemma 1 asserts that λ\lambdaλ is stationary: λ(A)=∫SP(x,A) λ(dx)\lambda(A)=\int_S P(x,A)\,\lambda(dx)λ(A)=∫S​P(x,A)λ(dx) for every measurable AAA. Lemma 2 excludes two disjoint closed sets. Both are direct prerequisites of the goal. Smith's Theorem 1 also establishes uniqueness of the stationary distribution and almost-sure convergence of empirical visit frequencies under a stationary start; it is described in the source, but its trajectory-level formalization is outside this proposal (Smith 1984, p. 1300).

Convergence from every starting point

The mission goal is Smith's Theorem 2. For every x∈Sx\in Sx∈S and every measurable A⊆SA\subseteq SA⊆S,

lim⁡m→∞Pm(x,A)=λ(A).\lim_{m\to\infty}P^m(x,A)=\lambda(A).m→∞lim​Pm(x,A)=λ(A).

This is the paper's explicit meaning of strongly mixing. The milestone list also records the proof's stated nonperiodicity condition: for every n≥2n\ge2n≥2, the nnn-step transition law has no two disjoint closed sets. It is a target in its own right because it concerns all higher-step kernels, not only the one-step chain (Smith 1984, p. 1301).

Significance

Theorem 2 makes the uniform law the limiting distribution of the sample at time mmm, for any fixed feasible initial point. The paper's Theorem 1 supplies a different guarantee about long-run empirical frequencies under a stationary start, although it is not a target of this proposal. Smith later specializes the framework to the Random Directions Algorithm and gives a quantitative rate under additional geometric conditions; that rate is the subject of the companion mission (Smith 1984, pp. 1303–1304).

These results are proved in the paper but the declarations in this proposal are theorem statements with sorry, not machine-checked proofs. A completed formalization would turn the paper's measure-theoretic claims into reusable statements about general measurable state spaces and kernels. The normalized content law, the density interface, and closed-set predicate can be reused when studying other Monte Carlo kernels with the same hypotheses.

Difficulty

The main obstacle is the jump from stationary behavior to convergence from every starting point. Symmetry identifies the candidate stationary law, and strict positivity limits how the chain can split into closed parts, but neither sentence by itself establishes the claimed limit of Pm(x,A)P^m(x,A)Pm(x,A). The distinction matters especially at starting points in VVV-null sets: an almost-everywhere starting-state result would leave out precisely the universal claim in Theorem 2. The paper appeals to a general-state Markov-chain convergence result for this step (Smith 1984, p. 1301).

Formalization scope

Lean uses a measurable type α\alphaα as the whole region SSS, a finite measure VVV with V(S)≠0V(S)\ne0V(S)=0, a Markov kernel PPP, and an extended-nonnegative density f:α→α→R≥0∞f:\alpha\to\alpha\to\mathbb R_{\ge0}^{\infty}f:α→α→R≥0∞​. The density is jointly measurable and is linked to PPP by the integral identity above; symmetry is pointwise, and positivity is added only for Lemma 2 and Theorems 1–2. This abstract representation retains the hypotheses those results use without fixing a particular Euclidean dimension. It covers the counting-content case as well as continuous content, although it does not construct the geometric direction-and-chord algorithm. The Random Directions kernel belongs to the companion mission.

The uniform law is normalized by V(S)V(S)V(S). Finiteness and nonzero total content prevent a meaningless inverse or an empty probability space. The mmm-step law is the published MarkovChainCLT.iterKernel. Theorem 2 quantifies over every xxx, rather than λ\lambdaλ-almost every xxx, and uses setwise convergence on each measurable AAA. No invariance, uniqueness, minorization, or convergence premise is added to the goal. Detaching fff from PPP would empty out the substantive assertion. Formal contributions can target the density-to-invariance argument, the closed-set conditions, and the general-state convergence theorem needed for the goal. The paper's separate pathwise Theorem 1 remains an appropriate later extension.

Selected references

  • Robert L. Smith, Efficient Monte Carlo Procedures for Generating Points Uniformly Distributed over Bounded Regions, Operations Research 32(6), 1296–1308, 1984. DOI: 10.1287/opre.32.6.1296.
8 thms2 active usersReviewed
Dynamical SystemsOperations Research·Captain: mikedeng1

Stability and Instability of Fluid Models for Reentrant Lines 4: The Lu–Kumar Network Has an Unstable Work-Conserving Fluid Model iff m₂ + m₄ ≥ 1Research Paper

Motivation

A reentrant line is a queueing network in which every customer follows one fixed route but may return to a station after visiting another one. A manufacturing line can have this pattern when a product revisits the same machine at different processing stages. A station can then have little nominal workload and still face unstable queues under an unfortunate service order. Dai and Weiss studied this gap between nominal capacity and fluid stability for reentrant lines in their 1996 paper. The four-class line associated with Lu and Kumar is their sharp example: its behavior changes at a simple cross-station inequality that is different from either station's ordinary workload constraint.

The paper establishes several positive stability results for other disciplines and networks, then gives an exact boundary for the Lu–Kumar line. Here the exact boundary is the focus. The result concerns fluid models, deterministic large-scale approximations of queue trajectories. It does not assert positive Harris recurrence or transience of the underlying stochastic network in both directions. The paper cites Dai's earlier implication from a stable fluid model to a stable stochastic discipline, but the converse was still open in its concluding discussion (Dai and Weiss 1996, pp. 119 and 133).

Setting

There are four customer classes, encountered in order 1→2→3→41\to2\to3\to41→2→3→4. Classes 111 and 444 use station 111; classes 222 and 333 use station 222. Each class kkk has a positive mean service time mkm_kmk​ and service rate μk=1/mk\mu_k=1/m_kμk​=1/mk​. The external arrival rate is normalized to one. The nominal workloads are ρ1=m1+m4\rho_1=m_1+m_4ρ1​=m1​+m4​ and ρ2=m2+m3\rho_2=m_2+m_3ρ2​=m2​+m3​, both assumed strictly below one. These assumptions say that each station has enough average capacity for its own stages, but they leave the scheduling decision unresolved.

At time ttt, Qk(t)≥0Q_k(t)\ge0Qk​(t)≥0 is the amount of class-kkk fluid, and Tk(t)T_k(t)Tk​(t) is the cumulative service time devoted to that class. The fluid equations balance the inflow and outflow of each class. Outside fluid enters class 111 at unit rate; completion of class kkk feeds class k+1k+1k+1 until class 444 exits. Service times and idle times are nondecreasing, and a station's idle time can increase only when its total queue content is zero. A pair (Q,T)(Q,T)(Q,T) with these properties is a work-conserving fluid solution.

The Lu–Kumar priority discipline gives class 444 priority over class 111 at station 111, and class 222 priority over class 333 at station 222. Its fluid model adds the priority complementarity condition: service capacity available to a priority prefix can be unused only when that prefix has no immediate workload. For either model, fluid stability means that some common time δ>0\delta>0δ>0 empties every admissible solution with ∑kQk(0)=1\sum_kQ_k(0)=1∑k​Qk​(0)=1, with all queues remaining zero for t≥δt\ge\deltat≥δ. Instability is the negation of this statement; it does not require every solution to diverge.

Formalization targets

Exact threshold

Theorem 5.1 and Remark 1 give two connected classifications, under mk>0m_k>0mk​>0, ρ1<1\rho_1<1ρ1​<1, and ρ2<1\rho_2<1ρ2​<1:

¬FluidStable⁡(all work-conserving solutions)⟺m2+m4≥1,\neg\operatorname{FluidStable}(\text{all work-conserving solutions}) \quad\Longleftrightarrow\quad m_2+m_4\ge1,¬FluidStable(all work-conserving solutions)⟺m2​+m4​≥1, ¬FluidStable⁡(Lu–Kumar priority solutions)⟺m2+m4≥1.\neg\operatorname{FluidStable}(\text{Lu–Kumar priority solutions}) \quad\Longleftrightarrow\quad m_2+m_4\ge1.¬FluidStable(Lu–Kumar priority solutions)⟺m2​+m4​≥1.

The first clause captures the paper's existence of an unstable work-conserving policy: on the unstable side, the named priority discipline supplies one; on the other side, every work-conserving fluid model is stable. The second clause records the particular policy classification stated in Remark 1. Equality belongs to the unstable side: the paper exhibits a periodic nonempty solution there (Dai and Weiss 1996, pp. 125–127).

Supporting targets

The milestones follow the paper's own statements and proof claims. The real-analysis extinction criterion of Lemma 2.2(ii) and the maximum-of-components criterion of Lemma 3.2 provide the stability language. Display (3.2), already available as a proved platform theorem, identifies the derivative of an attained maximum at a regular point. The priority condition (4.4) implies the ordinary work-conserving condition (1.13). The unstable half records one first cycle, one solution with every scaled cycle, and instability of the priority model. The stable half records the authors' explicit parameter choice, the two linear Lyapunov conditions, and stability of every work-conserving fluid solution.

Significance

The threshold says that the two station-load inequalities alone do not characterize stability of all work-conserving service orders. The extra inequality m2+m4<1m_2+m_4<1m2​+m4​<1 determines when the entire work-conserving fluid class is stable; its failure admits a concrete priority discipline with a nonempty trajectory. At the boundary m2+m4=1m_2+m_4=1m2​+m4​=1, growth need not be strict: periodic fluid behavior already defeats finite-time stability. The result therefore distinguishes the paper's global stability region from the larger parameter region in which both stations are nominally underloaded (Dai and Weiss 1996, Remark 1, p. 125).

A machine-checked development would give reusable definitions for a four-stage reentrant fluid model, its priority complementarity condition, and the precise unit-initial-state notion of stability. The local Lean statements in this proposal compile, but their proofs remain open. The published maximum-derivative fact is the one already proved platform component used by this mission. The other milestones identify the mathematical work needed to formalize the known 1996 result, rather than presenting the result as a new open conjecture.

Difficulty

The ordinary load test ρi<1\rho_i<1ρi​<1 controls how much service each station needs on average, but it does not control which class receives service when several buffers at a station are nonempty. In the Lu–Kumar priority discipline, serving a high-priority downstream class changes the future arrival pattern seen by the other station. Thus a direct argument from ρ1<1\rho_1<1ρ1​<1 and ρ2<1\rho_2<1ρ2​<1 to queue extinction fails. On the stable side, checking a single station's workload is also insufficient: its content may fall while earlier-stage fluid continues to feed it. The paper formulates two linear components and a finite maximum; the challenge is to obtain a uniform negative drift whenever that maximum is positive, including times when one station is empty and the other determines the active component (Dai and Weiss 1996, pp. 126–128).

Formalization scope

Classes and stations are Fin 4 and Fin 2, with zero-based Lean indices: paper class kkk is Lean index k−1k-1k−1. The fixed station map is (0,1,1,0)(0,1,1,0)(0,1,1,0). Service times remain real parameters with explicit positivity hypotheses. Paths are total functions of real time, while equations and conclusions apply only on t≥0t\ge0t≥0. The external arrival rate is one, and initial size is the sum ∑kQk(0)\sum_kQ_k(0)∑k​Qk​(0), since class contents are nonnegative. The nominal-load assumptions are the two strict inequalities in (5.1). The named priority ranking is a permutation; it encodes only the station-local comparisons that matter.

Conditions (1.13) and (4.4), printed as complementarity or “increases only when empty,” use an equivalent interval-constancy condition in Lean. No extra Lipschitz or continuity assumption is placed on solutions: the fluid equations and monotone capacity constraints are intended to supply that regularity. Derivatives at regular points are represented with HasDerivAt. Lemma 2.2(ii) uses the non-strict bound g˙≤−ε\dot g\le-\varepsilong˙​≤−ε, the version used by the paper's applications, although its displayed hypothesis prints g˙<−ε\dot g<-\varepsilong˙​<−ε. The p. 127 line involving G1G_1G1​ prints (1−θ2)Q4(1-\theta_2)Q_4(1−θ2​)Q4​; (5.3) fixes the intended coefficient as (1−θ1)Q4(1-\theta_1)Q_4(1−θ1​)Q4​.

The goal uses Definition 1.3 exactly: one uniform emptying time for all solutions of unit initial content. An impossible solution predicate, or an instability claim that only asks for a nonzero state at time zero, would not represent the paper's theorem. The mission needs finite-index sum and maximum infrastructure, absolute continuity and almost-everywhere differentiation on nonnegative time, plus elementary algebra of service rates and the cycle scaling. These components can be reused in later fluid-network missions. Contributions that preserve the source's hypotheses and boundary case are welcome.

Selected references

  • J. G. Dai and G. Weiss, Stability and instability of fluid models for reentrant lines, Mathematics of Operations Research 21(1), 115–134, 1996. DOI: 10.1287/moor.21.1.115.
14 thms2 active usersReviewed
Dynamical SystemsOperations Research·Captain: mikedeng1

Stability and Instability of Fluid Models for Reentrant Lines 5: Without Immediate Feedback, Every Work-Conserving Fluid Model of a Two-Station Kelly-Type Line Is StableResearch Paper

Motivation

A multiclass queueing network can be unstable even when every station has enough capacity on average: the queue lengths grow without bound although each server's nominal load is below one. Kumar and Seidman, Lu and Kumar (1991) and Rybko and Stolyar (1992) exhibited such networks under simple priority disciplines. This raised the question of which networks are stable under every reasonable policy, and which policies are stable in every network. Dai (1995) reduced the stability of a queueing network to the stability of its deterministic fluid model, so that the question becomes one about solutions of a system of linear equations and inequalities.

Dai and Weiss (1996) use this reduction to study reentrant lines, the model of semiconductor wafer fabrication in which a single route visits the same machines many times. Section 6 of their paper treats Kelly-type lines, in which every visit to a station has the same mean service time. Kelly (1979) showed that such networks with exponential service times are stable under FIFO and have a product-form stationary distribution. Theorem 6.1 shows that with two stations, and a route that never visits the same station twice in a row, stability holds under every work-conserving policy, not only FIFO. This mission formalizes that theorem.

Setting

A reentrant line has stations 1,…,I1,\dots,I1,…,I and classes 1,…,K1,\dots,K1,…,K. Fluid enters class 111 at rate 111, moves from class kkk to class k+1k+1k+1 on service, and leaves after class KKK. Class kkk is served at station σ(k)\sigma(k)σ(k) with mean service time mk>0m_k > 0mk​>0 and rate μk=1/mk\mu_k = 1/m_kμk​=1/mk​. The constituency of station iii is Ci={k:σ(k)=i}C_i = \{k : \sigma(k) = i\}Ci​={k:σ(k)=i} and its nominal workload is ρi=∑k∈Cimk\rho_i = \sum_{k\in C_i} m_kρi​=∑k∈Ci​​mk​. The traffic condition (1.7) is ρi<1\rho_i < 1ρi​<1 for every iii.

A fluid model solution is a pair (Q,T)(Q, T)(Q,T): Qk(t)≥0Q_k(t) \ge 0Qk​(t)≥0 is the fluid in class kkk at time ttt and Tk(t)T_k(t)Tk​(t) the cumulative service time given to class kkk by time ttt. They satisfy, for t≥0t \ge 0t≥0,

Qk(t)=Qk(0)+μk−1Tk−1(t)−μkTk(t)(μ0T0(t)=t),Q_k(t) = Q_k(0) + \mu_{k-1}T_{k-1}(t) - \mu_k T_k(t) \quad (\mu_0 T_0(t) = t),Qk​(t)=Qk​(0)+μk−1​Tk−1​(t)−μk​Tk​(t)(μ0​T0​(t)=t),

Tk(0)=0T_k(0) = 0Tk​(0)=0 with TkT_kTk​ nondecreasing, and the idle time Ui(t)=t−Bi(t)U_i(t) = t - B_i(t)Ui​(t)=t−Bi​(t), where Bi(t)=∑k∈CiTk(t)B_i(t) = \sum_{k\in C_i} T_k(t)Bi​(t)=∑k∈Ci​​Tk​(t), is nondecreasing. The solution is work-conserving if UiU_iUi​ increases only at times when station iii holds no fluid. The immediate volume of station iii is Wi(t)=∑k∈CimkQk(t)W_i(t) = \sum_{k \in C_i} m_k Q_k(t)Wi​(t)=∑k∈Ci​​mk​Qk​(t).

The line is of Kelly type with station means β1,…,βI\beta_1, \dots, \beta_Iβ1​,…,βI​ if mk=βσ(k)m_k = \beta_{\sigma(k)}mk​=βσ(k)​ for every class kkk. Its routing has no immediate feedback if σ(k+1)≠σ(k)\sigma(k+1) \ne \sigma(k)σ(k+1)=σ(k) for every k<Kk < Kk<K. A set of fluid solutions is stable (Definition 1.3) if there is a δ>0\delta > 0δ>0 such that every solution in the set with ∣Q(0)∣=∑kQk(0)=1|Q(0)| = \sum_k Q_k(0) = 1∣Q(0)∣=∑k​Qk​(0)=1 is empty from time δ\deltaδ on.

Formalization targets

Goal: Theorem 6.1

For a two-station Kelly-type reentrant line without immediate feedback that satisfies (1.7), the work-conserving fluid model is stable: there is δ>0\delta > 0δ>0 with

∑kQk(0)=1 ⟹ Qk(t)=0for all t≥δ, k=1,…,K,\sum_k Q_k(0) = 1 \ \Longrightarrow\ Q_k(t) = 0 \quad \text{for all } t \ge \delta,\ k = 1,\dots,K,k∑​Qk​(0)=1 ⟹ Qk​(t)=0for all t≥δ, k=1,…,K,

for every work-conserving fluid solution (Q,T)(Q,T)(Q,T). The number of classes KKK is arbitrary, of either parity, and the route may start at either station.

Milestones

The milestones follow the proof on p. 130 and the two general lemmas it uses: the extinction criterion of Lemma 2.2 (ii); the derivative of a maximum at an active index, display (3.2), already proved on the platform; the piecewise-linear Lyapunov Lemma 3.2; the drift identity Gi(t)=Gi(0)+∣Ci∣t−Bi(t)/βiG_i(t) = G_i(0) + |C_i|t - B_i(t)/\beta_iGi​(t)=Gi​(0)+∣Ci​∣t−Bi​(t)/βi​ for Gi=∑k∈CiQk+G_i = \sum_{k\in C_i} Q_k^+Gi​=∑k∈Ci​​Qk+​, with Qk+=∑l≤kQlQ_k^+ = \sum_{l\le k} Q_lQk+​=∑l≤k​Ql​; the comparison Wi(t)=0⇒Gi(t)≤Gj(t)W_i(t) = 0 \Rightarrow G_i(t) \le G_j(t)Wi​(t)=0⇒Gi​(t)≤Gj​(t); and the verification that G1,G2G_1, G_2G1​,G2​ meet the hypotheses of Lemma 3.2 with εi=1/βi−∣Ci∣\varepsilon_i = 1/\beta_i - |C_i|εi​=1/βi​−∣Ci​∣.

Significance

The result. Theorem 6.1 gives a class of networks in which stability needs no knowledge of the scheduling policy: any policy that never idles a server with work waiting is stable whenever the nominal loads are below one. For queueing networks this is the property usually called global stability. Through Theorem 1.1 of the paper (Dai 1995, Theorem 4.3) the fluid statement implies positive Harris recurrence of the corresponding multiclass queueing network under every work-conserving head-of-the-line policy. The paper's Remarks 2 and 3 show the boundary: with immediate feedback (the line 1,2,2,2,1,11,2,2,2,1,11,2,2,2,1,1 with all means 0.30.30.3), or with three stations, a Kelly-type line can be unstable. A two-station Kelly-type line without immediate feedback is a unidirectional ring with one customer type, so the theorem is a special case of the ring-network result the paper proves as Theorem 6.2. That result is an open goal on the platform (ProcessingNetworks.GlobalStability.ring_globally_stable, Dai and Harrison's Theorem 8.24) in a different encoding of the fluid model.

Formalizing it. The theorem is proved in the paper, and the mission formalizes that proof. No machine-checked proof of the result, or of the Lyapunov lemmas it uses, is known to exist. The mission also produces reusable pieces: a fluid model of reentrant lines in the paper's own formulation, an extinction lemma for absolutely continuous functions, and the max-of-linear Lyapunov lemma, which the paper uses again in §§3 and 5.

Difficulty

The obvious Lyapunov function, the total workload, does not work: a work-conserving policy may starve a station while the other one is busy, so the total content need not decrease. The paper's components Gi=∑k∈CiQk+G_i = \sum_{k\in C_i}Q_k^+Gi​=∑k∈Ci​​Qk+​ each decrease at the constant rate 1/βi−∣Ci∣1/\beta_i - |C_i|1/βi​−∣Ci​∣ while station iii is busy. When station iii is idle, GiG_iGi​ can grow, and the argument then needs the comparison Gi≤GjG_i \le G_jGi​≤Gj​, which requires the alternating route. The analytic difficulty is the passage from these pointwise statements to extinction. Fluid paths are only Lipschitz. The maximum G=max⁡(G1,G2)G = \max(G_1, G_2)G=max(G1​,G2​) need not be differentiable where the maximum switches, and the drift statements hold only almost everywhere. Lemma 2.2 (ii) and the derivative-of-a-maximum fact (3.2) make this step rigorous. The proof for odd KKK is not printed ("can be proved similarly"), and the formal goal covers it.

Formalization scope

All objects live in the namespace DaiWeissFluid.KellyType. The conventions are fixed as follows.

  • Classes and stations are 0-based (Fin K, Fin I). The paper's class kkk is Lean k - 1.
  • Paths are total functions ℝ → Fin K → ℝ, and every equation is imposed for t≥0t \ge 0t≥0 only. Derivatives are taken at t>0t > 0t>0 via HasDerivAt.
  • Work conservation (1.13) is stated in interval form: UiU_iUi​ is constant on every interval [s,t]⊆[0,∞)[s,t] \subseteq [0,\infty)[s,t]⊆[0,∞) on which station iii holds fluid throughout. For the continuous nondecreasing UiU_iUi​ this is equivalent to the paper's Stieltjes condition. Lipschitz continuity of the paths is not assumed, because it follows from the model.
  • mk>0m_k > 0mk​>0 is an explicit hypothesis. ∣Q(0)∣|Q(0)|∣Q(0)∣ is ∑kQk(0)\sum_k Q_k(0)∑k​Qk​(0).
  • Stability is Definition 1.3, which constrains only solutions with ∣Q(0)∣=1|Q(0)| = 1∣Q(0)∣=1.
  • The paper's Theorem 6.1 says "any work-conserving policy is stable", which is stability of the queueing network (Definition 1.1). Its proof establishes stability of the work-conserving fluid model, and the queueing-level conclusion follows from the cited Theorem 1.1 (Dai 1995). The goal is the fluid statement. Theorem 1.1 and the stochastic model are not formalized.
  • Lemma 2.2 (ii) is stated with the hypothesis g˙≤−ε\dot g \le -\varepsilong˙​≤−ε, where the page prints <<<. This is the form in which every application uses it, and it gives a stronger lemma.
  • The drift identity is stated for every Kelly-type line, which implies the printed K=2nK = 2nK=2n display. The printed "G2(t)=G2(t)+nt−…G_2(t) = G_2(t) + nt - \dotsG2​(t)=G2​(t)+nt−…" is read as G2(0)+nt−…G_2(0) + nt - \dotsG2​(0)+nt−….
  • Condition (b) and the Lemma 3.2 check are stated for both parities of KKK and both starting stations. A station with no classes has its εi\varepsilon_iεi​ left free.

The goal must not be trivialized. It quantifies over all work-conserving solutions with ∣Q(0)∣=1|Q(0)| = 1∣Q(0)∣=1, and this set is nonempty: a sorry-free witness with K=2K = 2K=2 is checked locally. Neither the Kelly-type hypothesis nor the absence of immediate feedback may be dropped (Remark 2), nor may the goal be generalized beyond two stations (Remark 3). Restricting it to even KKK, or to a route starting at station 1, would weaken it.

Contributions welcome: proofs of the general Lemmas 2.2 (ii) and 3.2, which apply across the whole series; the drift identity, which is pure algebra from (1.8); the continuity facts for fluid paths (Lipschitz bounds from (1.10)–(1.12)); and the final assembly.

Selected references

  • J. G. Dai and G. Weiss, Stability and instability of fluid models for reentrant lines, Mathematics of Operations Research 21(1), 115–134, 1996. https://doi.org/10.1287/moor.21.1.115
  • J. G. Dai, On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models, Annals of Applied Probability 5(1), 49–77, 1995. https://doi.org/10.1214/aoap/1177004828
  • S. H. Lu and P. R. Kumar, Distributed scheduling based on due dates and buffer priorities, IEEE Transactions on Automatic Control 36(12), 1406–1416, 1991. https://doi.org/10.1109/9.106156
  • F. P. Kelly, Reversibility and Stochastic Networks, Wiley, 1979.
  • J. G. Dai and J. M. Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press, 2020. https://doi.org/10.1017/9781108772662
11 thms2 active usersReviewed
Operations ResearchOptimizationProbability·Captain: mikedeng1

Asymptotic Optimality of Order-up-to Policies in Lost Sales Inventory Systems: Ordering Up to the Newsvendor Level for Penalty b + τh Is Asymptotically Optimal as b → ∞Research Paper

Motivation

Periodic-review inventory systems face a simple choice each period: how much to order before the next demand is known. When unmet demand is lost, the order can affect the stock available several periods later without preserving a backlog that records earlier shortages. This makes the optimal policy difficult to describe when replenishment takes time. An order-up-to policy offers a practical rule: order enough to bring the inventory position to a fixed level. Huh, Janakiraman, Muckstadt and Rusmevichientong ask when that simple rule performs as well as the best admissible lost-sales policy as the penalty for a lost unit grows. Their working paper, pp. 3–4 and 17–18, proves asymptotic optimality for a particular level obtained from a related backorder system.

The motivating costs are concrete. A lost sale may represent an expedited service part or a missed sale whose cost is much larger than one period of holding inventory. The paper's central comparison concerns the high-penalty regime while holding the demand law, lead time and holding rate fixed. The fixed-level policy can be computed from the distribution of demand over the lead time plus the order period; it does not require solving the full lost-sales control problem. The paper also supplies a finite-penalty bound, which this mission retains as a milestone. Huh et al., pp. 3–4, 17–18.

Setting

Let D1,D2,…D_1,D_2,\ldotsD1​,D2​,… be independent, identically distributed nonnegative demands with finite positive mean. An order takes a fixed integer lead time τ≥1\tau\ge1τ≥1 to arrive. At the start of period ttt, the order placed τ\tauτ periods earlier arrives; then a new order is placed, and demand DtD_tDt​ is observed. Unmet demand is lost. At period end, each unit remaining on hand incurs holding cost h>0h>0h>0, and each lost unit incurs penalty b>0b>0b>0. The inventory position counts on-hand units and outstanding orders. An order-up-to-SSS policy raises this position to S≥0S\ge0S≥0 whenever possible.

Write CL,S(h,b)C^{\mathcal L,S}(h,b)CL,S(h,b) for the long-run average cost of that policy and CL∗(h,b)C^{\mathcal L*}(h,b)CL∗(h,b) for the infimum over admissible policies. The corresponding backorder system retains unmet demand as negative net inventory and charges bbb per backordered unit per period. For an order-up-to level SSS, its stationary average cost is

CB,S(h,b)=hE[(S−D)+]+bE[(D−S)+],D=∑i=1τ+1Di.C^{\mathcal B,S}(h,b)=h\mathbb E[(S-\mathbf D)^+]+b\mathbb E[(\mathbf D-S)^+],\qquad \mathbf D=\sum_{i=1}^{\tau+1}D_i.CB,S(h,b)=hE[(S−D)+]+bE[(D−S)+],D=i=1∑τ+1​Di​.

The newsvendor level SB∗(h,b)S^{\mathcal B*}(h,b)SB∗(h,b) is the smallest nonnegative SSS with Pr⁡(D≤S)≥b/(b+h)\Pr(\mathbf D\le S)\ge b/(b+h)Pr(D≤S)≥b/(b+h); it attains the best backorder order-up-to cost CB∗(h,b)C^{\mathcal B*}(h,b)CB∗(h,b). The paper's Assumption 1 concerns this lead-time demand D\mathbf DD: if mD(t)=E[D−t∣D>t]m_{\mathbf D}(t)=\mathbb E[\mathbf D-t\mid\mathbf D>t]mD​(t)=E[D−t∣D>t] when the conditioning event has positive probability and zero otherwise, then mD(t)/t→0m_{\mathbf D}(t)/t\to0mD​(t)/t→0 as t→∞t\to\inftyt→∞. Huh et al., pp. 3–4, 9, 11–12.

Formalization targets

Asymptotically optimal order-up-to level

Fix hhh, τ\tauτ and the demand law satisfying Assumption 1. Set Sb+τh=SB∗(h,b+τh)S_{b+\tau h}=S^{\mathcal B*}(h,b+\tau h)Sb+τh​=SB∗(h,b+τh). The goal is the equivalent multiplicative form of Theorem 15(b): for every ε>0\varepsilon>0ε>0, all sufficiently large bbb satisfy

inf⁡S≥0CL,S(h,b)≤CL,Sb+τh(h,b)≤(1+ε)CL∗(h,b).\inf_{S\ge0}C^{\mathcal L,S}(h,b)\le C^{\mathcal L,S_{b+\tau h}}(h,b)\le(1+\varepsilon)C^{\mathcal L*}(h,b).S≥0inf​CL,S(h,b)≤CL,Sb+τh​(h,b)≤(1+ε)CL∗(h,b).

The infimum over order-up-to levels captures the paper's best such policy. The right-hand comparator remains the infimum over all admissible lost-sales policies. The multiplicative form also covers an almost-surely constant demand law, where both costs can be zero and a literal ratio would be undefined. Huh et al., Theorem 15(b), p. 17.

Explicit finite-penalty bound

Theorem 15(a) is a milestone. With S′=SB∗(h,b/(τ+1))S'=S^{\mathcal B*}(h,b/(\tau+1))S′=SB∗(h,b/(τ+1)) and ψ(S′;h,q)=qE[(D−S′)+]/(hE[(S′−D)+])\psi(S';h,q)=q\mathbb E[(\mathbf D-S')^+]/(h\mathbb E[(S'-\mathbf D)^+])ψ(S′;h,q)=qE[(D−S′)+]/(hE[(S′−D)+]), its factor is

1+νbψ(S′;h,b/(τ+1))1+ψ(S′;h,b/(τ+1)),νb=(b+τh)(τ+1)b.\frac{1+\nu_b\psi(S';h,b/(\tau+1))}{1+\psi(S';h,b/(\tau+1))},\qquad \nu_b=\frac{(b+\tau h)(\tau+1)}{b}.1+ψ(S′;h,b/(τ+1))1+νb​ψ(S′;h,b/(τ+1))​,νb​=b(b+τh)(τ+1)​.

The milestone states the bound where the expected holding quantity in ψ\psiψ is positive. Earlier milestones state the pathwise comparison of the systems, the two-sided average-cost comparison with penalties b/(τ+1)b/(\tau+1)b/(τ+1) and b+τhb+\tau hb+τh, the lower bound on unrestricted lost-sales optimal cost, the newsvendor formula, and the backorder sensitivity results used by the theorem. Huh et al., Lemmas 5, 9, 13 and Theorems 6, 15, pp. 11–18.

Significance

The theorem gives a specific computable stock level whose relative cost loss vanishes in the high-penalty regime. It addresses the gap between a tractable backorder benchmark and the more difficult lost-sales control problem. The finite-penalty factor states how the comparison depends on lead time, holding cost, penalty and the shortage-to-holding ratio; the asymptotic statement alone would not quantify that dependence. The paper establishes these mathematical results; the mission asks for machine-checked proofs of the stated Lean targets. Huh et al., pp. 17–18.

Formalizing the result would also supply reusable infrastructure for coupled inventory systems: measurable demand-path laws, pathwise recursions with delayed delivery, extended nonnegative long-run costs, and a clean comparison between an explicit policy and the infimum over unrestricted policies. The backorder newsvendor and mean-residual-life components can be reused beyond this particular lost-sales model.

Difficulty

The backorder system has a closed stationary cost formula, while a lost-sales order-up-to process generally cannot be replaced directly by that formula. The paper notes that its on-hand inventory distribution need not converge from every starting state, even under a fixed order-up-to policy. One must therefore justify the long-run comparison without assuming stationarity from an arbitrary start. A second difficulty is the benchmark: comparing only against other order-up-to policies is too weak to establish Theorem 15, because the goal uses the optimal cost over all admissible lost-sales policies. Huh et al., pp. 14–16, 18.

Formalization scope

Lean reuses the published CappedBaseStock lost-sales model. Its demands are nonnegative and i.i.d. with finite positive mean; τ≥1\tau\ge1τ≥1 and h,b>0h,b>0h,b>0. Period zero in Lean is period one in the paper. Both coupled processes start with zero on-hand stock and an empty pipeline. Inventory XtX_tXt​ is read immediately after delivery, before current demand. Lost-sales costs lie in [0,∞][0,\infty][0,∞] and use the limsup of expected Cesàro averages; the backorder closed form uses real Bochner expectations under finite-mean demand. The paper's stationary lost-sales cost and this Cesàro cost are identified using its long-run results, but those convergence results are outside this proposal. Huh et al., pp. 14–16.

The paper prints nonnegative rates in Theorem 15, while its displayed newsvendor fraction and shortage-to-holding ratios require positive denominators. Theorem 6(a) therefore states the ratio limit for nonconstant demand laws. The main theorem uses a multiplicative limit bound that also covers constant demand, where the printed ratio is undefined.

The quantity CL∗C^{\mathcal L*}CL∗ is an infimum over measurable, history-dependent policies with private randomization; no attaining policy is assumed. The backorder optimum is an infimum over nonnegative order-up-to levels. Assumption 1 is imposed on the sum of τ+1\tau+1τ+1 demands, and the limit b→∞b\to\inftyb→∞ is expressed by a positive threshold uniform over all parameter records with the fixed lead time and holding rate. The mission excludes a restricted policy comparator, a fixed penalty, a one-period lead-time specialization, and Assumption 1 on single-period demand. Solvers may contribute proofs of any milestone, along with finite-mean and measurability lemmas needed to connect the model to the backorder benchmarks.

Selected references

  • W. T. Huh, G. Janakiraman, J. A. Muckstadt and P. Rusmevichientong, Asymptotic Optimality of Order-up-to Policies in Lost Sales Inventory Systems, working paper, December 4, 2006; published in Management Science 55(3), 2009. DOI: 10.1287/mnsc.1080.0945.
  • G. Janakiraman, S. Seshadri and G. Shanthikumar, A Comparison of the Optimal Costs of Two Canonical Inventory Systems, working paper, Stern School of Business, New York University, 2005; bound quoted in Huh et al., §5, p. 13. Quoted source.
11 thms2 active usersReviewed
Control TheoryDynamic ProgrammingOperations Research+2·Captain: mikedeng1

Stochastic Optimal Control: The Discrete-Time Case IX: Imperfect State Information — Reduction to a Perfect-Information Model through a Statistic Sufficient for ControlTextbook

Motivation

In most control problems the controller does not see the state of the system. It sees noisy observations, remembers its past controls, and must act on that record. Inventory systems with delayed or inaccurate counts, maintenance of machines whose wear is only inspected, target tracking, and medical treatment planned from test results all have this form. The standard device for such problems is to replace the hidden state by a summary of the record, most often the conditional distribution of the state given the observations, and to solve a dynamic program whose state is that summary.

For finite or countable spaces this reduction goes back to Åström (1965) and Striebel (1965), who introduced the conditional distribution of the state as a "sufficient statistic" for control. Chapter 10 of Bertsekas and Shreve, Stochastic Optimal Control: The Discrete-Time Case (Academic Press 1978; Athena Scientific 1996) carries it out for Borel state, control and observation spaces, with universally measurable policies and costs that are only lower semianalytic. In that generality the measurability of the reduced model is the whole difficulty, and the chapter isolates exactly what a summary must satisfy for the reduction to be exact.

Setting

The imperfect state information model (ISI) of Definition 10.3 has a nonempty Borel state space SSS, control space CCC and observation space ZZZ; a discount factor α>0\alpha>0α>0; a lower semianalytic cost g:SC→R∗=[−∞,∞]g:SC\to R^*=[-\infty,\infty]g:SC→R∗=[−∞,∞]; a Borel state transition kernel t(dx′∣x,u)t(dx'\mid x,u)t(dx′∣x,u); Borel observation kernels s0(dz∣x)s_0(dz\mid x)s0​(dz∣x) and s(dz∣u,x)s(dz\mid u,x)s(dz∣u,x); and a horizon NNN. The initial state x0x_0x0​ has distribution p∈P(S)p\in P(S)p∈P(S), z0∼s0(⋅∣x0)z_0\sim s_0(\cdot\mid x_0)z0​∼s0​(⋅∣x0​), and then xk+1∼t(⋅∣xk,uk)x_{k+1}\sim t(\cdot\mid x_k,u_k)xk+1​∼t(⋅∣xk​,uk​), zk+1∼s(⋅∣uk,xk+1)z_{k+1}\sim s(\cdot\mid u_k,x_{k+1})zk+1​∼s(⋅∣uk​,xk+1​). The controller knows the information vector ik=(z0,u0,…,uk−1,zk)∈Iki_k=(z_0,u_0,\dots,u_{k-1},z_k)\in I_kik​=(z0​,u0​,…,uk−1​,zk​)∈Ik​ and must choose uk∈Uk(ik)u_k\in U_k(i_k)uk​∈Uk​(ik​), where the constraint set Γk={(ik,u)∣u∈Uk(ik)}\Gamma_k=\{(i_k,u)\mid u\in U_k(i_k)\}Γk​={(ik​,u)∣u∈Uk​(ik​)} is analytic.

A policy π=(μ0,…,μN−1)\pi=(\mu_0,\dots,\mu_{N-1})π=(μ0​,…,μN−1​) consists of universally measurable stochastic kernels μk(duk∣p;ik)\mu_k(du_k\mid p;i_k)μk​(duk​∣p;ik​) that respect the constraints (Definition 10.4). Together with ppp it determines probability measures Pk(π,p)P_k(\pi,p)Pk​(π,p) on the histories (x0,z0,u0,…,xk,zk,uk)(x_0,z_0,u_0,\dots,x_k,z_k,u_k)(x0​,z0​,u0​,…,xk​,zk​,uk​), the cost

JN,π(p)=∫[∑k=0N−1αkg(xk,uk)]dPN−1(π,p),J_{N,\pi}(p)=\int\Big[\sum_{k=0}^{N-1}\alpha^k g(x_k,u_k)\Big]dP_{N-1}(\pi,p),JN,π​(p)=∫[k=0∑N−1​αkg(xk​,uk​)]dPN−1​(π,p),

and the optimal cost JN∗(p)=inf⁡πJN,π(p)J^*_N(p)=\inf_\pi J_{N,\pi}(p)JN∗​(p)=infπ​JN,π​(p) (Definition 10.5). Assumption (F+)(F^+)(F+) asks that the expected discounted negative part of the cost be finite for every policy and initial distribution; (F−)(F^-)(F−) asks the same of the positive part.

A statistic is a sequence of Borel maps ηk:P(S)Ik→Yk\eta_k:P(S)I_k\to Y_kηk​:P(S)Ik​→Yk​ into nonempty Borel spaces. It is sufficient for control (Definition 10.6) if (a) the constraints can be read off from it, Γk={(ik,u)∣(ηk(p;ik),u)∈Γ^k}\Gamma_k=\{(i_k,u)\mid(\eta_k(p;i_k),u)\in\hat\Gamma_k\}Γk​={(ik​,u)∣(ηk​(p;ik​),u)∈Γ^k​} with Γ^k\hat\Gamma_kΓ^k​ analytic; (b) the conditional law of ηk+1\eta_{k+1}ηk+1​ given (ηk,uk)(\eta_k,u_k)(ηk​,uk​) is a Borel kernel t^k(dyk+1∣yk,uk)\hat t_k(dy_{k+1}\mid y_k,u_k)t^k​(dyk+1​∣yk​,uk​), for every ppp and every policy; and (c) the conditional expectation of g(xk,uk)g(x_k,u_k)g(xk​,uk​) given (ηk,uk)(\eta_k,u_k)(ηk​,uk​) is a lower semianalytic function g^k(yk,uk)\hat g_k(y_k,u_k)g^​k​(yk​,uk​). The perfect state information model (PSI) of Definition 10.7 has states yk∈Yky_k\in Y_kyk​∈Yk​, constraints U^k(yk)=(Γ^k)yk\hat U_k(y_k)=(\hat\Gamma_k)_{y_k}U^k​(yk​)=(Γ^k​)yk​​, costs g^k\hat g_kg^​k​ and transitions t^k\hat t_kt^k​; its cost and optimal cost at y∈Y0y\in Y_0y∈Y0​ are J^N,π^(y)\hat J_{N,\hat\pi}(y)J^N,π^​(y) and J^N∗(y)\hat J^*_N(y)J^N∗​(y). The initial distribution of y0y_0y0​ is

φ(p)(Y‾0)=∫Ss0({z0∣η0(p;z0)∈Y‾0}∣x0) p(dx0).\varphi(p)(\underline Y_0)=\int_S s_0(\{z_0\mid\eta_0(p;z_0)\in\underline Y_0\}\mid x_0)\,p(dx_0).φ(p)(Y​0​)=∫S​s0​({z0​∣η0​(p;z0​)∈Y​0​}∣x0​)p(dx0​).

A Markov (PSI) policy μ^k(du∣yk)\hat\mu_k(du\mid y_k)μ^​k​(du∣yk​) acts in (ISI) through μk(du∣p;ik)=μ^k(du∣ηk(p;ik))\mu_k(du\mid p;i_k)=\hat\mu_k(du\mid\eta_k(p;i_k))μk​(du∣p;ik​)=μ^​k​(du∣ηk​(p;ik​)).

Formalization targets

Goal: Proposition 10.3

Under (F+,F^+)(F^+,\hat F^+)(F+,F^+) or (F−,F^−)(F^-,\hat F^-)(F−,F^−),

JN∗(p)=∫Y0J^N∗(y0) φ(p)(dy0)∀p∈P(S),J^*_N(p)=\int_{Y_0}\hat J^*_N(y_0)\,\varphi(p)(dy_0)\qquad\forall p\in P(S),JN∗​(p)=∫Y0​​J^N∗​(y0​)φ(p)(dy0​)∀p∈P(S),

and a Markov (PSI) policy that is optimal, φ(p)\varphi(p)φ(p)-optimal or weakly φ(p)\varphi(p)φ(p)-ε\varepsilonε-optimal for (PSI) is respectively optimal, optimal at ppp, or ε\varepsilonε-optimal at ppp for (ISI); under (F+,F^+)(F^+,\hat F^+)(F+,F^+) an ε\varepsilonε-optimal (PSI) policy is ε\varepsilonε-optimal for (ISI). Here π^\hat\piπ^ is weakly qqq-ε\varepsilonε-optimal if ∫J^N,π^ dq≤∫J^N∗ dq+ε\int\hat J_{N,\hat\pi}\,dq\le\int\hat J^*_N\,dq+\varepsilon∫J^N,π^​dq≤∫J^N∗​dq+ε when ∫J^N∗ dq>−∞\int\hat J^*_N\,dq>-\infty∫J^N∗​dq>−∞ and ∫J^N,π^ dq≤−1/ε\int\hat J_{N,\hat\pi}\,dq\le-1/\varepsilon∫J^N,π^​dq≤−1/ε otherwise, and qqq-optimal if q({y0∣J^N,π^(y0)=J^N∗(y0)})=1q(\{y_0\mid\hat J_{N,\hat\pi}(y_0)=\hat J^*_N(y_0)\})=1q({y0​∣J^N,π^​(y0​)=J^N∗​(y0​)})=1 (Definition 10.8).

Milestones

  1. Lemma 10.1: the process (η0,u0,…,ηk,uk)(\eta_0,u_0,\dots,\eta_k,u_k)(η0​,u0​,…,ηk​,uk​) generated in (ISI) by a Markov (PSI) policy has the law P^k[π^,φ(p)]\hat P_k[\hat\pi,\varphi(p)]P^k​[π^,φ(p)].
  2. Proposition 10.2: JN,π^(p)=∫J^N,π^ dφ(p)J_{N,\hat\pi}(p)=\int\hat J_{N,\hat\pi}\,d\varphi(p)JN,π^​(p)=∫J^N,π^​dφ(p) for Markov π^\hat\piπ^.
  3. Corollary 10.2.1: JN∗(p)≤∫J^N∗ dφ(p)J^*_N(p)\le\int\hat J^*_N\,d\varphi(p)JN∗​(p)≤∫J^N∗​dφ(p).
  4. Lemma 10.2: every (ISI) policy is matched in cost by some Markov (PSI) policy.
  5. Proposition 10.4: ε\varepsilonε-optimal nonrandomized (ISI) policies that depend on iki_kik​ only through ηk(p;ik)\eta_k(p;i_k)ηk​(p;ik​).
  6. Proposition 10.6: the identity maps on P(S)IkP(S)I_kP(S)Ik​ form a statistic sufficient for control.

Significance

Proposition 10.3 says that an imperfect-information problem loses nothing by being solved in the reduced model: the optimal cost is the φ(p)\varphi(p)φ(p)-average of the reduced optimal cost, and good reduced policies are good original policies. Combined with Proposition 10.6, every (ISI) model has such a reduction, so the finite-horizon dynamic programming theory of Chapter 8 (existence of ε\varepsilonε-optimal policies, the dynamic programming algorithm) transfers to partially observed problems on Borel spaces. Proposition 10.4 turns this into a structural statement about the original problem: nearly optimal controllers need to retain only the statistic.

These results are proved in the book. None of them is formalized: the platform's related results (Bäuerle–Rieder's partially observable models with observation densities, and the linear-quadratic-Gaussian separation theorem) work in different models and do not cover universally measurable policies, analytic constraints, or lower semianalytic costs. A machine-checked version makes the conditional-expectation bookkeeping of the reduction explicit, and the definitions of this mission (universal measurability, lower semianalytic functions, the book's extended integral, history measures built from universally measurable kernels) are reusable by every other chapter of the book.

Difficulty

The obvious argument says: replace the state by the statistic, observe that costs and transitions depend only on the statistic, and conclude. In the Borel setting each step is a measurability claim that the naive argument does not supply. The conditions of Definition 10.6 are almost-everywhere statements about conditional distributions under every pair (p,π)(p,\pi)(p,π), while the reduced model needs genuine kernels; the policies are only universally measurable, so integrals and compositions must be taken with respect to completions; the costs take the values ±∞\pm\infty±∞, so interchanging sums and integrals requires the finiteness assumptions (F±)(F^\pm)(F±) and (F^±)(\hat F^\pm)(F^±); and the inequality JN∗≥∫J^N∗ dφ(p)J^*_N\ge\int\hat J^*_N\,d\varphi(p)JN∗​≥∫J^N∗​dφ(p) requires producing, from an arbitrary history-dependent (ISI) policy, a Markov (PSI) policy with the same cost, which the naive argument does not do.

Formalization scope

  • Horizon. Only finite horizons N≥1N\ge1N≥1 are covered, hence only the cases (F+,F^+)(F^+,\hat F^+)(F+,F^+) and (F−,F^−)(F^-,\hat F^-)(F−,F^−) of the book's statements; the infinite-horizon cases (P,P^)(P,\hat P)(P,P^), (N,N^)(N,\hat N)(N,N^), (D,D^)(D,\hat D)(D,D^) are out of scope.
  • Extended reals. Costs live in EReal with the book's convention ∞−∞=+∞\infty-\infty=+\infty∞−∞=+∞ written out explicitly (badd, bsum, extIntegral); Mathlib's EReal subtraction (⊤−⊤=⊥\top-\top=\bot⊤−⊤=⊥) is never used where both terms can be infinite.
  • Spaces and measures. SSS, CCC, ZZZ, YkY_kYk​ are Borel spaces in the sense of Definition 7.7 with their Borel σ\sigmaσ-algebras; P(S)P(S)P(S) carries the weak topology and the Giry σ\sigmaσ-algebra. Policies are families of maps into ProbabilityMeasure C that are measurable for the completion of every probability measure. History measures are characterized by their values on rectangles. Families indexed by the stage are indexed by all of N\mathbb NN; only stages k<Nk<Nk<N are constrained.
  • Conditional statements. Conditions (22) and (23) are stated through the defining relations of conditional probability and expectation, for every ppp and every policy, with (23) required when g(xk,uk)g(x_k,u_k)g(xk​,uk​) is quasi-integrable.
  • Policies in Proposition 10.3. The (PSI) policies in the optimality transfers are Markov, as in Proposition 10.2.
  • No trivialization. Definition 10.6 is the full definition: analytic Γ^k\hat\Gamma_kΓ^k​ with full projection, Borel kernels t^k\hat t_kt^k​ satisfying (22) for every ppp and policy, and lower semianalytic g^k\hat g_kg^​k​ satisfying (23); a weaker notion would make Proposition 10.6 empty.

Contributions are welcome on any milestone. Basic facts that a full development needs, such as composition of universally measurable maps (Proposition 7.44), measurability of integrals against universally measurable kernels (Proposition 7.46), and existence of the history measures (Proposition 7.45), can be posed and proved as supporting lemmas; they are reusable across the book.

Selected references

  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978; Athena Scientific, 1996, Chapter 10. https://web.mit.edu/dimitrib/www/soc.html
  • K. J. Åström, Optimal control of Markov processes with incomplete state information, Journal of Mathematical Analysis and Applications 10 (1965) 174–205. https://doi.org/10.1016/0022-247X(65)90154-X
  • C. Striebel, Sufficient statistics in the optimum control of stochastic systems, Journal of Mathematical Analysis and Applications 12 (1965) 576–592. https://doi.org/10.1016/0022-247X(65)90027-2
  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Springer, 2011, Chapter 5. https://doi.org/10.1007/978-3-642-18324-9
12 thms2 active usersReviewed
PreviousPage 3 of 12Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me