Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Probability

1,628 missions · 680 completed

Missions

Open948Completed680All1628
Operations ResearchOptimization·Captain: mikedeng1

The Sample Average Approximation Method for Stochastic Discrete Optimization 1: Under Assumption A, 1 − P(Ŝ^ε_N ⊂ S^ε) Decays Exponentially Fast in the Sample Size NResearch Paper

Motivation

Many decision problems in operations research ask for the best element of a finite set of alternatives when each alternative's cost is random: which projects to fund when resource use is uncertain, which crew pairings to fly when delays are random, which items to pack into a knapsack whose overflow is penalized. The expected cost is rarely available in closed form, because it is a high-dimensional integral over the distribution of the random data. The sample average approximation (SAA) method replaces the expectation by an average over a random sample and solves the resulting deterministic problem with a standard discrete optimization routine. The method is widely used in stochastic programming (see Shapiro, Dentcheva and Ruszczyński, Lectures on Stochastic Programming, SIAM 2009, Ch. 5, https://doi.org/10.1137/1.9780898718751).

Kleywegt and Shapiro (preprint; published with Homem-de-Mello as SIAM J. Optim. 12(2):479–502, 2002, https://doi.org/10.1137/S1052623499363220) ask why the method works so well for discrete problems. Their answer is a large-deviations statement: when the feasible set is finite, the probability that the SAA problem returns a wrong answer decays exponentially in the sample size. This mission formalizes that result, Proposition 2.2 of the two-author preprint, together with its consistency companion, Proposition 2.1.

Setting

Let S\mathcal SS be a nonempty finite set, WWW a random element of a measurable space W\mathcal WW, and G:S×W→RG : \mathcal S \times \mathcal W \to \mathbb RG:S×W→R such that G(x,⋅)G(x,\cdot)G(x,⋅) is measurable and E∣G(x,W)∣<∞\mathbb E|G(x,W)| < \inftyE∣G(x,W)∣<∞ for every x∈Sx \in \mathcal Sx∈S. The true problem (1.1) is

v∗=min⁡x∈Sg(x),g(x)=E G(x,W).v^* = \min_{x \in \mathcal S} g(x), \qquad g(x) = \mathbb E\, G(x, W).v∗=x∈Smin​g(x),g(x)=EG(x,W).

Let W1,W2,…W^1, W^2, \dotsW1,W2,… be an independent, identically distributed sample with the law of WWW. The sample average function and the SAA problem (2.1) are

g^N(x)=1N∑n=1NG(x,Wn),v^N=min⁡x∈Sg^N(x).\hat g_N(x) = \frac1N \sum_{n=1}^N G(x, W^n), \qquad \hat v_N = \min_{x \in \mathcal S} \hat g_N(x).g^​N​(x)=N1​n=1∑N​G(x,Wn),v^N​=x∈Smin​g^​N​(x).

For ε≥0\varepsilon \ge 0ε≥0, the ε\varepsilonε-optimal sets are Sε={x∈S:g(x)≤v∗+ε}\mathcal S^\varepsilon = \{x \in \mathcal S : g(x) \le v^* + \varepsilon\}Sε={x∈S:g(x)≤v∗+ε} and S^Nε={x∈S:g^N(x)≤v^N+ε}\hat{\mathcal S}^\varepsilon_N = \{x \in \mathcal S : \hat g_N(x) \le \hat v_N + \varepsilon\}S^Nε​={x∈S:g^​N​(x)≤v^N​+ε}; at ε=0\varepsilon = 0ε=0 they are the optimal sets S∗\mathcal S^*S∗ and S^N\hat{\mathcal S}_NS^N​. Two numbers drive the analysis: the maximal deviation δN=max⁡x∈S∣g^N(x)−g(x)∣\delta_N = \max_{x \in \mathcal S}|\hat g_N(x) - g(x)|δN​=maxx∈S​∣g^​N​(x)−g(x)∣ of (2.2), and the well-conditioning number

α(ε)=min⁡x∈S∖Sεg(x)−v∗−ε\alpha(\varepsilon) = \min_{x \in \mathcal S \setminus \mathcal S^\varepsilon} g(x) - v^* - \varepsilonα(ε)=x∈S∖Sεmin​g(x)−v∗−ε

of (2.3), the gap between the ε\varepsilonε-optimal solutions and the rest.

For a real random variable XXX with moment generating function M(t)=E etXM(t) = \mathbb E\, e^{tX}M(t)=EetX and logarithmic moment generating function Λ(t)=log⁡M(t)∈(−∞,+∞]\Lambda(t) = \log M(t) \in (-\infty, +\infty]Λ(t)=logM(t)∈(−∞,+∞], the rate function is I(z)=sup⁡t≥0{tz−Λ(t)}I(z) = \sup_{t \ge 0}\{tz - \Lambda(t)\}I(z)=supt≥0​{tz−Λ(t)}. Assumption A requires that for every x∈Sx \in \mathcal Sx∈S the moment generating function of G(x,W)G(x, W)G(x,W) be finite in a neighbourhood of t=0t = 0t=0.

Formalization targets

Goal: Proposition 2.2

Under Assumption A, for every ε≥0\varepsilon \ge 0ε≥0 there is γ>0\gamma > 0γ>0 with

lim sup⁡N→∞1Nlog⁡[1−P(S^Nε⊂Sε)]≤−γ.(2.5)\limsup_{N \to \infty} \frac1N \log\Big[1 - P\big(\hat{\mathcal S}^\varepsilon_N \subset \mathcal S^\varepsilon\big)\Big] \le -\gamma. \tag{2.5}N→∞limsup​N1​log[1−P(S^Nε​⊂Sε)]≤−γ.(2.5)

The constant γ\gammaγ is not specified: it depends on α(ε)\alpha(\varepsilon)α(ε) through rate functions and cannot be computed before the problem is solved. The goal asserts only its existence, which is the paper's claim.

Milestones

  1. α(ε)>0\alpha(\varepsilon) > 0α(ε)>0 whenever S∖Sε≠∅\mathcal S \setminus \mathcal S^\varepsilon \ne \emptysetS∖Sε=∅ (2.3).
  2. δN<α(ε)/2\delta_N < \alpha(\varepsilon)/2δN​<α(ε)/2 implies S^Nε⊂Sε\hat{\mathcal S}^\varepsilon_N \subset \mathcal S^\varepsilonS^Nε​⊂Sε.
  3. The union bound 1−P(S^Nε⊂Sε)≤∑x∈SP{∣g^N(x)−g(x)∣≥α(ε)/2}1 - P(\hat{\mathcal S}^\varepsilon_N \subset \mathcal S^\varepsilon) \le \sum_{x \in \mathcal S} P\{|\hat g_N(x) - g(x)| \ge \alpha(\varepsilon)/2\}1−P(S^Nε​⊂Sε)≤∑x∈S​P{∣g^​N​(x)−g(x)∣≥α(ε)/2}.
  4. The large-deviations upper bound (2.4): 1Nlog⁡P(ZN≥a)≤−I(a)\frac1N \log P(Z_N \ge a) \le -I(a)N1​logP(ZN​≥a)≤−I(a) for i.i.d. averages ZNZ_NZN​.
  5. I(a)>0I(a) > 0I(a)>0 for aaa above the mean, when MMM is finite near 000.
  6. Under Assumption A, P{∣g^N(x)−g(x)∣≥r}≤e−Nγx+e−Nγx′P\{|\hat g_N(x) - g(x)| \ge r\} \le e^{-N\gamma_x} + e^{-N\gamma'_x}P{∣g^​N​(x)−g(x)∣≥r}≤e−Nγx​+e−Nγx′​ with γx,γx′>0\gamma_x, \gamma'_x > 0γx​,γx′​>0.

Companions

Proposition 2.1 (v^N→v∗\hat v_N \to v^*v^N​→v∗ w.p.1, and S^Nε⊂Sε\hat{\mathcal S}^\varepsilon_N \subset \mathcal S^\varepsilonS^Nε​⊂Sε w.p.1 for NNN large enough), the almost-sure convergence δN→0\delta_N \to 0δN​→0 of (2.2), the singleton consequence (Sε={x∗}\mathcal S^\varepsilon = \{x^*\}Sε={x∗} implies S^Nε={x∗}\hat{\mathcal S}^\varepsilon_N = \{x^*\}S^Nε​={x∗} eventually), the facts I(μ)=0=min⁡II(\mu) = 0 = \min II(μ)=0=minI, the Example of §3.2 showing that a sample size N>k/2N > k/2N>k/2 can be required, and the computation α(0)=min⁡ici\alpha(0) = \min_i c_iα(0)=mini​ci​ on the hypercube with best value 1/k1/p1/k^{1/p}1/k1/p (§4).

Significance

Proposition 2.2 explains the practical behaviour of the SAA method on discrete problems: an exact optimal solution of the true problem is obtained with probability approaching one exponentially fast, so a moderate sample often suffices even when the number of feasible solutions is astronomically large. It is the basis of the paper's replication argument (§3.2: the probability of success p(N)p(N)p(N) of one SAA replication tends to one exponentially fast) and identifies α(ε)\alpha(\varepsilon)α(ε) as the quantity that governs the difficulty of a stochastic discrete problem, which the numerical study of §4 then examines. Later sample-size estimates for SAA (Shapiro, Dentcheva and Ruszczyński 2009, §5.3) refine the same argument into explicit, non-asymptotic bounds.

The result is proved in the paper. The mission produces a machine-checked proof of it and of its ingredients, including a Lean statement of the Cramér–Chernoff upper bound with the rate function III in the extended reals and the positivity of III above the mean under a local moment condition. To our knowledge none of these is formalized on the platform or in Mathlib in this form.

Difficulty

The argument is short on paper; the formal difficulty is in the large-deviations step. Mathlib has the Chernoff inequality P(X≥a)≤e−ta EetXP(X \ge a) \le e^{-ta}\,\mathbb E e^{tX}P(X≥a)≤e−taEetX and the factorization of moment generating functions of independent sums, but the step from there to 1Nlog⁡P(ZN≥a)≤−I(a)\frac1N \log P(Z_N \ge a) \le -I(a)N1​logP(ZN​≥a)≤−I(a) requires passing to a supremum over ttt in the extended reals, handling ttt where M(t)=∞M(t) = \inftyM(t)=∞, and the case P(ZN≥a)=0P(Z_N \ge a) = 0P(ZN​≥a)=0. The positivity I(a)>0I(a) > 0I(a)>0 requires Λ′(0)=μ\Lambda'(0) = \muΛ′(0)=μ, i.e. differentiating the moment generating function at an interior point of its domain. A naive attempt that works with real logarithms fails at probability zero, where log⁡0\log 0log0 is not −∞-\infty−∞, and an attempt that bounds δN\delta_NδN​ by Chebyshev's inequality gives only a polynomial rate.

Formalization scope

The feasible set is a Finset of an arbitrary type X, assumed nonempty; minima and maxima over it are Finset.inf' and Finset.sup', so they are attained. The sample is a sequence W : ℕ → Ω → 𝒲 of measurable maps on a probability space, mutually independent (iIndepFun) and identically distributed with W 0; the paper's WnW^nWn is W (n - 1), and g(x)g(x)g(x) is the expectation of G(x,W1)G(x, W^1)G(x,W1). Measurability of G(x,⋅)G(x,\cdot)G(x,⋅) is Borel measurability. Logarithms of probabilities are ENNReal.log, with log⁡0=−∞\log 0 = -\inftylog0=−∞, and the limit superior in (2.5) is taken in the extended reals; this is the paper's convention and it makes the goal correct when Sε=S\mathcal S^\varepsilon = \mathcal SSε=S, where the event is sure. Assumption A is stated as integrability of etG(x,W)e^{tG(x,W)}etG(x,W) for ttt near 000, not through the value of Mathlib's mgf, which is 000 where the expectation is infinite. The logarithmic moment generating function is the published definition BellWilliams2001.ThresholdPolicy.logMGF (extended-real valued, +∞+\infty+∞ off the domain of MMM), and III is the supremum over t≥0t \ge 0t≥0 only, as on p. 3. Wherever α(ε)\alpha(\varepsilon)α(ε) appears, the nonemptiness of S∖Sε\mathcal S \setminus \mathcal S^\varepsilonS∖Sε is a hypothesis; the goal does not mention α\alphaα and needs none.

A trivializing formalization is ruled out: with Real.log the event "S^Nε⊂Sε\hat{\mathcal S}^\varepsilon_N \subset \mathcal S^\varepsilonS^Nε​⊂Sε is sure" would give log⁡0=0\log 0 = 0log0=0 and make the goal false, and a rate function built from mgf would count infinite moment generating functions as Λ=log⁡0=0\Lambda = \log 0 = 0Λ=log0=0; neither encoding is used.

A complete development needs the Cramér–Chernoff bound for i.i.d. sums with an extended-real rate function, differentiability of the moment generating function at interior points, and the strong law of large numbers applied to finitely many functions. The large-deviations items (milestones 4 and 5, and I(μ)=0I(\mu) = 0I(μ)=0) are stated for an arbitrary i.i.d. real sequence and are reusable beyond this mission. Proofs of any item, including the optional examples, are welcome.

Selected references

  • A. J. Kleywegt and A. Shapiro, The sample average approximation method for stochastic discrete optimization, preprint (two-author version), https://edoc.hu-berlin.de/server/api/core/bitstreams/2dcf2d5b-5fb9-44d1-b36a-5e378c803717/content. Published with T. Homem-de-Mello in SIAM J. Optim. 12(2):479–502, 2002. https://doi.org/10.1137/S1052623499363220
  • A. Dembo and O. Zeitouni, Large Deviations Techniques and Applications, 2nd ed., Springer, 1998. https://doi.org/10.1007/978-1-4612-5320-4
  • A. Shapiro, D. Dentcheva and A. Ruszczyński, Lectures on Stochastic Programming: Modeling and Theory, SIAM, 2009. https://doi.org/10.1137/1.9780898718751
9 thms2 active usersReviewed
Algorithmic Game TheoryMachine Learning·Captain: mikedeng1

A Simple Adaptive Procedure Leading to Correlated Equilibrium 2: Playing an Invariant Vector of the Regret Matrix (3.1) Drives Every Regret R_t(j,k) to Zero Almost SurelyResearch Paper

Motivation

A correlated equilibrium (Aumann, 1974) is a probability distribution over the strategy profiles of a game such that no player gains by deviating from the strategy it recommends. It is the natural solution concept for repeated play by adaptive agents, because the set of correlated equilibria is a polytope described by linear inequalities and, as Hart and Mas-Colell showed, it can be reached by simple learning rules that use only a player's own past payoffs and regrets.

Hart and Mas-Colell's paper (Econometrica 68 (2000) 1127–1150) has two procedures. Its Main Theorem concerns regret matching (2.2), in which a player switches away from its last strategy with probabilities proportional to its regrets; it is the subject of a companion mission. Section 3 studies a variant in which, at every period, the player plays an invariant vector of the regret matrix, and proves with Blackwell's approachability theorem (Blackwell, 1956) that the player's regrets vanish almost surely, whatever the other players do. This result, Theorem A, is the target of this mission. It is the conditional ("internal") counterpart of Hannan's no-regret property (Hannan, 1957) and the template for later internal-regret algorithms in online learning (Cesa-Bianchi and Lugosi, 2006).

Timeline. Hannan (1957) gave a procedure with vanishing unconditional regret; Blackwell (1956) proved the approachability theorem and derived a universally consistent procedure from it; Foster and Vohra (1997) obtained convergence to correlated equilibria through calibrated forecasts; Fudenberg and Levine (1995, 1999) introduced universal consistency and calibrated smooth fictitious play; Hart and Mas-Colell (2000) gave Theorem A and regret matching.

Setting

A finite game Γ=(N,(Si)i∈N,(ui)i∈N)\Gamma=(N,(S^i)_{i\in N},(u^i)_{i\in N})Γ=(N,(Si)i∈N​,(ui)i∈N​) has a finite set NNN of players, a finite nonempty strategy set SiS^iSi for each player, and payoffs ui:S→Ru^i:S\to\mathbb Rui:S→R on S=∏iSiS=\prod_i S^iS=∏i​Si. For s∈Ss\in Ss∈S and k∈Sik\in S^ik∈Si, ui(k,s−i)u^i(k,s^{-i})ui(k,s−i) is iii's payoff when iii's coordinate of sss is replaced by kkk.

The game is played at t=1,2,…t=1,2,\dotst=1,2,…. After the history ht=(s1,…,st)h_t=(s_1,\dots,s_t)ht​=(s1​,…,st​) each player chooses a mixed action, and given hth_tht​ the players randomize independently. For j≠kj\ne kj=k in SiS^iSi the regret of player iii for not having played kkk whenever it played jjj is

Dti(j,k)=1t∑τ≤t: sτi=j[ui(k,sτ−i)−ui(sτ)],Rti(j,k)=max⁡{Dti(j,k),0}.D^i_t(j,k)=\frac1t\sum_{\tau\le t:\,s^i_\tau=j}\big[u^i(k,s^{-i}_\tau)-u^i(s_\tau)\big],\qquad R^i_t(j,k)=\max\{D^i_t(j,k),0\}.Dti​(j,k)=t1​τ≤t:sτi​=j∑​[ui(k,sτ−i​)−ui(sτ​)],Rti​(j,k)=max{Dti​(j,k),0}.

With Rti(j,j):=0R^i_t(j,j):=0Rti​(j,j):=0, a probability vector qti∈Δ(Si)q^i_t\in\Delta(S^i)qti​∈Δ(Si) satisfies (3.1) if

∑k∈Siqti(k)Rti(k,j)=qti(j)∑k∈SiRti(j,k)for every j∈Si,\sum_{k\in S^i}q^i_t(k)R^i_t(k,j)=q^i_t(j)\sum_{k\in S^i}R^i_t(j,k)\qquad\text{for every }j\in S^i,k∈Si∑​qti​(k)Rti​(k,j)=qti​(j)k∈Si∑​Rti​(j,k)for every j∈Si,

i.e. qtiq^i_tqti​ is an invariant distribution of the transition matrix of regret matching. The empirical distribution of play is zt(s)=1t∣{τ≤t:sτ=s}∣z_t(s)=\frac1t|\{\tau\le t: s_\tau=s\}|zt​(s)=t1​∣{τ≤t:sτ​=s}∣.

Formalization targets

Goal: Theorem A (p. 1133)

If at every period t+1t+1t+1 player iii plays a probability vector satisfying (3.1), then, whatever the other players do,

Rti(j,k)→t→∞0almost surely, for all j≠k in Si.R^i_t(j,k)\xrightarrow[t\to\infty]{}0\quad\text{almost surely, for all }j\ne k\text{ in }S^i.Rti​(j,k)t→∞​0almost surely, for all j=k in Si.

Milestones (the proof of Theorem A, pp. 1135–1138)

  1. (3.5): the nonnegative matrix with entries λ(j,k)\lambda(j,k)λ(j,k) off the diagonal and 000 on it has an invariant vector qλ∈Δ(Si)q_\lambda\in\Delta(S^i)qλ​∈Δ(Si).
  2. (3.4a)–(3.4b): for the vector payoff v(si,s−i)∈RLv(s^i,s^{-i})\in\mathbb R^Lv(si,s−i)∈RL, L={(j,k):j≠k}L=\{(j,k):j\ne k\}L={(j,k):j=k}, the quantity λ⋅v(q,s−i)\lambda\cdot v(q,s^{-i})λ⋅v(q,s−i) equals ∑jα(j)ui(j,s−i)\sum_j\alpha(j)u^i(j,s^{-i})∑j​α(j)ui(j,s−i).
  3. Blackwell's condition for R−L\mathbb R^L_-R−L​: for λ≥0\lambda\ge0λ≥0 and qλq_\lambdaqλ​ solving (3.5), λ⋅v(qλ,s−i)=0\lambda\cdot v(q_\lambda,s^{-i})=0λ⋅v(qλ​,s−i)=0 for every s−is^{-i}s−i.
  4. Support function: wR−L(λ)=0w_{\mathbb R^L_-}(\lambda)=0wR−L​​(λ)=0 on R+L\mathbb R^L_+R+L​ and +∞+\infty+∞ elsewhere.
  5. Closest point: DtD_tDt​ has coordinates Dti(j,k)D^i_t(j,k)Dti​(j,k), the projection onto R−L\mathbb R^L_-R−L​ is [Dt]−[D_t]^-[Dt​]−, and λ(Dt)=[Dt]+\lambda(D_t)=[D_t]^+λ(Dt​)=[Dt​]+ is the regret vector.
  6. Blackwell's approachability theorem, "Moreover" part: the Blackwell procedure drives dist⁡(Dt,C)\operatorname{dist}(D_t,\mathcal C)dist(Dt​,C) to 000 almost surely against any opponent.

Companions

The Corollary (p. 1134): if every player follows (3.1), ztz_tzt​ converges almost surely to the set of correlated equilibria. The equivalence of (3.1) with invariance for the (2.2) matrix (p. 1133). Theorem B (p. 1139): the procedure proportional to unconditional regrets [Dti(k)]+[D^i_t(k)]^+[Dti​(k)]+ satisfies Hannan's universal consistency (4.1).

Significance

Theorem A shows that conditional regrets can be driven to zero by a stationary rule of fixed size mi×mim^i\times m^imi×mi, with no assumption on the other players beyond conditional independence. Combined with the Proposition of §3 it gives the Corollary: if all players follow such a rule, play converges to the set of correlated equilibria. The same argument with a different vector payoff yields Theorem B, a short proof of Hannan consistency. The approachability reduction used here is the standard route from vector-valued games to no-regret learning.

Theorem A and Blackwell's theorem are proved results. What this mission adds is a machine-checked development: a formal statement of Theorem A for arbitrary opponents, a formal statement of Blackwell's procedure in Hart and Mas-Colell's form (condition (3.2) via the support function, opponents that see the whole history), and the algebra connecting the two. Prove2Me already has Blackwell's original THEOREM 1 (strategies depending only on past payoff vectors, geometric separation condition); it is a different statement, and deriving this one from it, or proving it directly, is part of the work.

Difficulty

The algebra (milestones 1–5) is finite-dimensional and elementary, apart from the existence of an invariant vector, which needs a fixed-point or Perron–Frobenius type argument for a matrix that is not stochastic. The probabilistic core is milestone 6. The geometric picture of the paper (Figure 1) shows that the expected next average payoff moves closer to C\mathcal CC, but that controls only dist⁡(E[Dt+1∣ht],C)\operatorname{dist}(E[D_{t+1}\mid h_t],\mathcal C)dist(E[Dt+1​∣ht​],C), not the realized averages (footnote 15 of the paper); the opponent adapts to the whole history, so the increments are neither independent nor identically distributed, and the almost-sure statement has to be obtained on a measure known only through its conditional laws given each history.

Formalization scope

  • The game is finite with nonempty strategy sets; payoffs are real. Δ(Q)\Delta(Q)Δ(Q) is Mathlib's stdSimplex. RL\mathbb R^LRL is EuclideanSpace ℝ L with its inner product and Euclidean distance.
  • Time is 0-based in Lean (play τ is sτ+1s_{\tau+1}sτ+1​); every regret quantity is a function of a finite history Fin t → S, and every statement uses histories of length t+1≥1t+1\ge1t+1≥1.
  • A behaviour profile assigns a probability vector to every player, period and history. A play is any sequence of random variables on any probability space such that, given each history of positive probability, the next profile has the product law of the players' mixed actions. Theorem A constrains only player iii, and only from period 2 on; the other players are arbitrary.
  • The zero diagonal of (3.1) is explicit. The support function's value +∞+\infty+∞ is never computed in the reals: (3.2) is encoded as "λ⋅v(qλ,b)≤M\lambda\cdot v(q_\lambda,b)\le Mλ⋅v(qλ​,b)≤M for every real upper bound MMM of λ⋅C\lambda\cdot\mathcal Cλ⋅C", and milestone 4 uses IsLUB/¬ BddAbove.
  • In Blackwell's theorem, nonemptiness of C\mathcal CC is stated explicitly (it is implicit in the existence of the closest point), and the choices λ↦qλ\lambda\mapsto q_\lambdaλ↦qλ​ and the projection FFF are given as functions with the stated properties.
  • Requiring qtiq^i_tqti​ to be a probability vector rules out the trivial solution q=0q=0q=0 of (3.1); the goal mentions neither vvv, R−L\mathbb R^L_-R−L​ nor Blackwell, so it cannot be discharged by its own milestones' definitions.

Useful infrastructure, reusable beyond this mission: the existence of invariant vectors of nonnegative matrices, projections onto orthants, and a general Blackwell approachability theorem for history-dependent opponents. Proofs of any milestone, of the companions, and alternative proofs of Theorem A are welcome.

Selected references

  • S. Hart and A. Mas-Colell, A simple adaptive procedure leading to correlated equilibrium, Econometrica 68(5) (2000), 1127–1150. https://doi.org/10.1111/1468-0262.00153
  • D. Blackwell, An analog of the minimax theorem for vector payoffs, Pacific Journal of Mathematics 6 (1956), 1–8. https://doi.org/10.2140/pjm.1956.6.1
  • R. J. Aumann, Subjectivity and correlation in randomized strategies, Journal of Mathematical Economics 1 (1974), 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • J. Hannan, Approximation to Bayes risk in repeated play, Contributions to the Theory of Games III (1957), 97–139. https://doi.org/10.1515/9781400882151-006
  • D. P. Foster and R. V. Vohra, Calibrated learning and correlated equilibrium, Games and Economic Behavior 21 (1997), 40–55. https://doi.org/10.1006/game.1997.0595
  • N. Cesa-Bianchi and G. Lugosi, Prediction, Learning, and Games, Cambridge University Press, 2006. https://doi.org/10.1017/CBO9780511546921
9 thms2 active usersReviewed
Harmonic AnalysisTheoretical Computer Science·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 1: A Discrete Gaussian on L + u Plus Continuous Gaussian Noise ν_s Is Within Statistical Distance 4ε of ν_t, t = √(r² + s²)Research Paper

Motivation

The learning with errors (LWE) problem underlies most of post-quantum public-key cryptography. Its hardness rests on Regev's reduction from worst-case lattice problems to LWE (Regev, J. ACM 2009). The reduction is iterative: it repeatedly turns samples of a discrete Gaussian on a lattice into samples of a narrower one. Its classical step, Lemma 3.11, needs the following fact. Adding continuous Gaussian noise to a discrete Gaussian sample gives, up to a small statistical distance, a continuous Gaussian. That fact is Claim 3.9 of the paper. Through Corollary 3.10 it turns a lattice point plus noise into an LWE-type sample with a periodic Gaussian error.

The tool behind it is the smoothing parameter of Micciancio and Regev (SIAM J. Comput. 2007). Above this width a discrete Gaussian on a lattice behaves like a continuous one. Claims of this type have since become standard in lattice-based cryptography: discrete Gaussian sampling, trapdoors, and the convolution theorems of Peikert (CRYPTO 2010).

This mission formalizes Claim 3.9 from the published J. ACM article (Article 34, 2009). The paper's main theorem, Theorem 3.1, is a quantum reduction about efficient algorithms. It is outside this series of missions.

Setting

Work in Rn\mathbb{R}^nRn with the Euclidean norm and Lebesgue measure. For s>0s > 0s>0 the Gaussian function is ρs(x)=exp⁡(−π∥x/s∥2)\rho_s(x) = \exp(-\pi\|x/s\|^2)ρs​(x)=exp(−π∥x/s∥2), its shift is ρs,c(x)=ρs(x−c)\rho_{s,c}(x) = \rho_s(x - c)ρs,c​(x)=ρs​(x−c), and νs=ρs/sn\nu_s = \rho_s/s^nνs​=ρs​/sn is a probability density (Eqs. (4)–(5)). For a countable set AAA, ρs(A)=∑x∈Aρs(x)\rho_s(A) = \sum_{x \in A}\rho_s(x)ρs​(A)=∑x∈A​ρs​(x).

A lattice L⊂RnL \subset \mathbb{R}^nL⊂Rn is the set of integer combinations of nnn linearly independent vectors. Its dual is L∗={y:⟨x,y⟩∈Z ∀x∈L}L^* = \{y : \langle x, y\rangle \in \mathbb{Z}\ \forall x \in L\}L∗={y:⟨x,y⟩∈Z ∀x∈L}, and det⁡(L∗)=1/det⁡(L)\det(L^*) = 1/\det(L)det(L∗)=1/det(L), where det⁡(L)\det(L)det(L) is the volume of a fundamental parallelepiped. For u∈Rnu \in \mathbb{R}^nu∈Rn and r>0r > 0r>0, the discrete Gaussian DL+u,rD_{L+u,r}DL+u,r​ is the distribution on the coset L+uL + uL+u with mass ρr(y)/ρr(L+u)\rho_r(y)/\rho_r(L+u)ρr​(y)/ρr​(L+u) at yyy (Eq. (6)).

For ϵ>0\epsilon > 0ϵ>0 the smoothing parameter ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is the smallest sss with ρ1/s(L∗∖{0})≤ϵ\rho_{1/s}(L^*\setminus\{0\}) \le \epsilonρ1/s​(L∗∖{0})≤ϵ (Definition 2.10).

The statistical distance of two densities is Δ(φ1,φ2)=∫Rn∣φ1−φ2∣\Delta(\varphi_1,\varphi_2) = \int_{\mathbb{R}^n}|\varphi_1 - \varphi_2|Δ(φ1​,φ2​)=∫Rn​∣φ1​−φ2​∣, with no factor 12\tfrac1221​, so it ranges in [0,2][0,2][0,2].

Let r,s>0r, s > 0r,s>0 and t=r2+s2t = \sqrt{r^2+s^2}t=r2+s2​. The distribution YYY is obtained by sampling y∼DL+u,ry \sim D_{L+u,r}y∼DL+u,r​ and adding independent noise with density νs\nu_sνs​. Its density is

Y(x)=∑y∈L+uDL+u,r(y) νs(x−y).Y(x) = \sum_{y \in L+u} D_{L+u,r}(y)\,\nu_s(x - y).Y(x)=y∈L+u∑​DL+u,r​(y)νs​(x−y).

Formalization targets

Goal: Claim 3.9 (p. 34:25)

If rs/t≥ηϵ(L)rs/t \ge \eta_\epsilon(L)rs/t≥ηϵ​(L) for some 0<ϵ<120 < \epsilon < \tfrac120<ϵ<21​, then

Δ(Y,νt)≤4ϵ.\Delta(Y, \nu_t) \le 4\epsilon .Δ(Y,νt​)≤4ϵ.

Milestones, in attack order

  1. Lemma 2.14 (Poisson summation), already proved on the platform and used here as a reference: f(L)=det⁡(L∗)f^(L∗)f(L) = \det(L^*)\hat f(L^*)f(L)=det(L∗)f^​(L∗).
  2. The remark after Definition 2.10 (p. 34:19). The map s↦ρ1/s(L∗∖{0})s \mapsto \rho_{1/s}(L^*\setminus\{0\})s↦ρ1/s​(L∗∖{0}) is continuous and strictly decreasing on (0,∞)(0,\infty)(0,∞), with limits ∞\infty∞ at 000 and 000 at ∞\infty∞, and ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is its inverse.
  3. The Fourier transform of a shifted Gaussian (p. 34:25), ρσ,c^(w)=e−2πi⟨c,w⟩σnρ1/σ(w)\widehat{\rho_{\sigma,c}}(w) = e^{-2\pi i\langle c,w\rangle}\sigma^n\rho_{1/\sigma}(w)ρσ,c​​(w)=e−2πi⟨c,w⟩σnρ1/σ​(w).
  4. Claim 3.8 (p. 34:24). If r≥ηϵ(L)r \ge \eta_\epsilon(L)r≥ηϵ​(L), then ρr(L+c)∈rndet⁡(L∗)(1±ϵ)\rho_r(L+c) \in r^n\det(L^*)(1\pm\epsilon)ρr​(L+c)∈rndet(L∗)(1±ϵ).
  5. Eq. (11) (p. 34:25), Y(x)=s−nρt(x) ρrs/t,(r/t)2x−u(L)/ρr,−u(L)Y(x) = s^{-n}\rho_t(x)\,\rho_{rs/t,(r/t)^2x-u}(L)/\rho_{r,-u}(L)Y(x)=s−nρt​(x)ρrs/t,(r/t)2x−u​(L)/ρr,−u​(L).
  6. The pointwise bound (p. 34:26), ∣Y(x)−ρt(x)/tn∣≤ρt(x)/tn⋅4ϵ|Y(x) - \rho_t(x)/t^n| \le \rho_t(x)/t^n\cdot 4\epsilon∣Y(x)−ρt​(x)/tn∣≤ρt​(x)/tn⋅4ϵ.

A supporting item states the bridge used in both proofs: if s≥ηϵ(L)s \ge \eta_\epsilon(L)s≥ηϵ​(L), then ρ1/s(L∗∖{0})≤ϵ\rho_{1/s}(L^*\setminus\{0\}) \le \epsilonρ1/s​(L∗∖{0})≤ϵ.

Significance

Claim 3.9 is what makes Regev's iterative step classical. A discrete Gaussian sample, blurred by continuous noise, cannot be told apart from a continuous Gaussian of the combined width, except with probability 2ϵ2\epsilon2ϵ. Corollary 3.10 projects this onto a direction zzz and reduces it modulo 1 to obtain LWE samples with periodic Gaussian error Ψβ\Psi_\betaΨβ​. Without it, the reduction from lattice problems to LWE has no way to produce its error distribution. Claim 3.8, a milestone here, says that above the smoothing parameter the discrete Gaussian measure is almost invariant under shifts. It is the basic estimate of the theory.

The results are proved in the paper; none of them is formalized. Lean's Mathlib has lattices, their covolume, dual submodules and the Gaussian Fourier transform. The platform has the Poisson summation formula for lattices. This mission adds the smoothing parameter, discrete Gaussians on cosets, and the first machine-checked convolution theorem for discrete and continuous Gaussians. Later work, such as Corollary 3.10 or Peikert's general convolution theorem, can build on it.

Difficulty

Neither density is a finite object. YYY is an infinite sum over a coset of a lattice, normalized by another infinite sum. A direct term-by-term comparison of Y(x)Y(x)Y(x) with νt(x)\nu_t(x)νt​(x) fails: the sum defining Y(x)Y(x)Y(x) is a Gaussian sum over a shifted lattice, and its value genuinely varies with the position of (r/t)2x−u(r/t)^2x - u(r/t)2x−u relative to LLL; for narrow Gaussians the variation is of order one. The claim is that this oscillation is uniformly small, with a relative error that depends only on ϵ\epsilonϵ, not on nnn, xxx or uuu. Two ratios of lattice sums must be bounded at once, uniformly in xxx. The constant 4ϵ4\epsilon4ϵ uses ϵ<12\epsilon < \tfrac12ϵ<21​ in an essential way, because (1+ϵ)/(1−ϵ)(1+\epsilon)/(1-\epsilon)(1+ϵ)/(1−ϵ) must stay below 1+4ϵ1+4\epsilon1+4ϵ.

The smoothing parameter is defined as a least element. That the least element exists, i.e. that the infimum is attained, is itself a statement about continuity and strict monotonicity of an infinite sum in its width.

Formalization scope

  • Rn\mathbb{R}^nRn is EuclideanSpace ℝ (Fin n).
  • A lattice is a Submodule ℤ with [DiscreteTopology L] [IsZLattice ℝ L].
  • L∗L^*L∗ is LinearMap.BilinForm.dualSubmodule (innerₗ _) L.
  • det⁡(L∗)\det(L^*)det(L∗) is written det⁡(L)−1\det(L)^{-1}det(L)−1 with det⁡(L)\det(L)det(L) = ZLattice.covolume L.
  • Lattice sums are real tsums. They are genuinely summable, so no summability hypothesis is added.
  • ηϵ(L)\eta_\epsilon(L)ηϵ​(L) is the real infimum of {s>0:ρ1/s(L∗∖{0})≤ϵ}\{s > 0 : \rho_{1/s}(L^*\setminus\{0\}) \le \epsilon\}{s>0:ρ1/s​(L∗∖{0})≤ϵ}. Its attainment is milestone 2, not part of the definition.
  • YYY is defined by its density, the formula on the first line of the proof.
  • Δ\DeltaΔ is a lower Lebesgue integral with values in [0,∞][0,\infty][0,∞] and no 12\tfrac1221​. A Bochner integral of a non-integrable difference would be 000 and make the bound free; this form rules that trivialization out.

Added hypotheses, each disclosed in the item.

  • ϵ>0\epsilon > 0ϵ>0 in Claim 3.9 and the pointwise bound (Claim 3.8 prints it). Definition 2.10 defines ηϵ\eta_\epsilonηϵ​ only for ϵ>0\epsilon > 0ϵ>0, and for ϵ≤0\epsilon \le 0ϵ≤0 the defining set is empty, so the hypothesis ηϵ(L)≤rs/t\eta_\epsilon(L) \le rs/tηϵ​(L)≤rs/t would be vacuous.
  • r>0r > 0r>0 in Claim 3.8, where ρr\rho_rρr​ requires it, and likewise s>0s > 0s>0 in the supporting item "s≥ηϵ(L)⇒ρ1/s(L∗∖{0})≤ϵs \ge \eta_\epsilon(L) \Rightarrow \rho_{1/s}(L^*\setminus\{0\}) \le \epsilons≥ηϵ​(L)⇒ρ1/s​(L∗∖{0})≤ϵ".
  • n≥1n \ge 1n≥1 in the smoothing remark, which fails for n=0n = 0n=0, where L∗∖{0}L^*\setminus\{0\}L∗∖{0} is empty.

Other conventions.

  • Lemma 2.14 is printed "for any function", with technical conditions omitted (p. 34:20). The referenced platform theorem is the version for Schwartz functions in translated form; every Gaussian used here is Schwartz.
  • Eq. (11) is formalized as the equality of its first and fifth lines, the real-valued completing-the-square identity. The Fourier-side lines are not stated.
  • The Fourier transform is Mathlib's 𝓕, ∫h(x)e−2πi⟨x,w⟩dx\int h(x)e^{-2\pi i\langle x,w\rangle}dx∫h(x)e−2πi⟨x,w⟩dx, as on p. 34:20.

Reusable beyond this mission: the Gaussian, coset-sum and smoothing-parameter definitions, Claim 3.8, and the shifted Fourier transform. Proofs of any milestone are welcome, and so are proofs of the summability and Schwartz facts for Gaussians on lattices that every milestone needs.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • D. Micciancio and O. Regev, Worst-Case to Average-Case Reductions Based on Gaussian Measures, SIAM Journal on Computing 37(1), 2007. https://doi.org/10.1137/S0097539705447360
  • C. Peikert, An Efficient and Parallel Gaussian Sampler for Lattices, CRYPTO 2010, LNCS 6223. https://doi.org/10.1007/978-3-642-14623-7_5
9 thms2 active usersReviewed
AnalysisTheoretical Computer Science·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 3: The Periodic Gaussians Ψ_α and Ψ_β Are Within Statistical Distance 9(β/α − 1) When 0 < α < β ≤ 2αResearch Paper

Motivation

The Learning with Errors (LWE) problem, introduced by Regev in On Lattices, Learning with Errors, Random Linear Codes, and Cryptography (J. ACM 56(6), 2009, Article 34; doi:10.1145/1568318.1568324), asks to recover a secret vector s∈Zpns \in \mathbb{Z}_p^ns∈Zpn​ from noisy inner products ⟨a,s⟩/p+e mod 1\langle a, s\rangle/p + e \bmod 1⟨a,s⟩/p+emod1. The noise eee is drawn from a periodic normal distribution Ψβ\Psi_\betaΨβ​ on the circle T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z: a centred normal variable reduced modulo 111. LWE has since become the main hardness assumption of lattice-based cryptography, including the post-quantum standards built on it.

Regev's reductions repeatedly need to compare Ψα\Psi_\alphaΨα​ and Ψβ\Psi_\betaΨβ​ for nearby parameters, for instance when the noise parameter is known only up to a small relative error. Claim 2.2 of the paper (p. 34:16) quantifies this: the two periodic normal distributions are close in statistical distance, linearly in the relative change β/α−1\beta/\alpha - 1β/α−1. This mission formalizes Claim 2.2 and the steps of its proof. The source is the published J. ACM article; the paper's main theorem, a quantum reduction from worst-case lattice problems to LWE, is outside this series.

Setting

Identify T=R/Z\mathbb{T} = \mathbb{R}/\mathbb{Z}T=R/Z with the segment [0,1)[0,1)[0,1) with addition modulo 111. For β>0\beta > 0β>0 the normal density with mean 000 and standard deviation β/2π\beta/\sqrt{2\pi}β/2π​ is

νβ(x)=1βexp⁡(−π(xβ)2),x∈R,\nu_\beta(x) = \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{x}{\beta}\Bigr)^2\Bigr), \qquad x \in \mathbb{R},νβ​(x)=β1​exp(−π(βx​)2),x∈R,

(Eq. (5) in dimension one), and the periodic normal density (Eq. (7)) is its periodization

Ψβ(r)=∑k=−∞∞1βexp⁡(−π(r−kβ)2),r∈[0,1),\Psi_\beta(r) = \sum_{k=-\infty}^{\infty} \frac{1}{\beta}\exp\Bigl(-\pi\Bigl(\frac{r-k}{\beta}\Bigr)^2\Bigr), \qquad r \in [0,1),Ψβ​(r)=k=−∞∑∞​β1​exp(−π(βr−k​)2),r∈[0,1),

the density of a νβ\nu_\betaνβ​-distributed variable reduced modulo 111.

The statistical distance of two densities φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ (p. 34:14) is

Δ(φ1,φ2)=∫∣φ1−φ2∣,\Delta(\varphi_1, \varphi_2) = \int |\varphi_1 - \varphi_2|,Δ(φ1​,φ2​)=∫∣φ1​−φ2​∣,

the integral taken over R\mathbb{R}R for densities on the line and over [0,1)[0,1)[0,1) for densities on T\mathbb{T}T. The paper uses this normalization without a factor 12\tfrac1221​, so that Δ\DeltaΔ ranges in [0,2][0,2][0,2] on probability densities. In Lean these objects are RegevLWE.PeriodicGauss.nu, Psi, statDist and statDistT.

Formalization targets

Goal: Claim 2.2

For any 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,

Δ(Ψα,Ψβ)≤9(βα−1).\Delta(\Psi_\alpha, \Psi_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(Ψα​,Ψβ​)≤9(αβ​−1).

The hypotheses and the constant 999 are exactly as printed.

Milestones

  1. The bound on the line (proof of Claim 2.2, first sentence). For 0<α<β≤2α0 < \alpha < \beta \le 2\alpha0<α<β≤2α,
Δ(να,νβ)≤9(βα−1).\Delta(\nu_\alpha, \nu_\beta) \le 9\Bigl(\frac{\beta}{\alpha} - 1\Bigr).Δ(να​,νβ​)≤9(αβ​−1).
  1. Reduction modulo 1 does not increase Δ\DeltaΔ (p. 34:15, used on p. 34:16): for integrable φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ on R\mathbb{R}R, the periodizations φ~i(r)=∑kφi(r−k)\tilde\varphi_i(r) = \sum_k \varphi_i(r-k)φ~​i​(r)=∑k​φi​(r−k) satisfy Δ(φ~1,φ~2)≤Δ(φ1,φ2)\Delta(\tilde\varphi_1, \tilde\varphi_2) \le \Delta(\varphi_1, \varphi_2)Δ(φ~​1​,φ~​2​)≤Δ(φ1​,φ2​).
  2. The three displayed steps of the proof after normalizing to α=1\alpha = 1α=1, β=1+ϵ\beta = 1 + \epsilonβ=1+ϵ, 0<ϵ≤10 < \epsilon \le 10<ϵ≤1: the first display (a triangle-inequality split and an exact evaluation), the pointwise bound
∣e−π(1−1/(1+ϵ)2)x2−1∣≤π(1−1/(1+ϵ)2)x2≤2πϵx2,\bigl|e^{-\pi(1-1/(1+\epsilon)^2)x^2} - 1\bigr| \le \pi\bigl(1 - 1/(1+\epsilon)^2\bigr)x^2 \le 2\pi\epsilon x^2,​e−π(1−1/(1+ϵ)2)x2−1​≤π(1−1/(1+ϵ)2)x2≤2πϵx2,

and the final evaluation

ϵ+2πϵ∫Rx2e−πx2/(1+ϵ)2 dx=ϵ+ϵ(1+ϵ)3≤9ϵ.\epsilon + 2\pi\epsilon\int_{\mathbb{R}} x^2 e^{-\pi x^2/(1+\epsilon)^2}\,dx = \epsilon + \epsilon(1+\epsilon)^3 \le 9\epsilon.ϵ+2πϵ∫R​x2e−πx2/(1+ϵ)2dx=ϵ+ϵ(1+ϵ)3≤9ϵ.

Significance

Claim 2.2 is a stability statement for the LWE error distribution. It lets an algorithm that works for one noise parameter be applied to a nearby one at a controlled cost in statistical distance, which is how Regev's reductions tolerate an approximately known parameter. It also states a quantitative fact about wrapped normal distributions, which appear outside cryptography, for example in directional statistics.

The result is proved in the paper; no machine-checked proof is known to this mission. Formalizing it produces a reusable one-dimensional toolkit: the L1L^1L1 distance between two centred normal densities, the second moment of a Gaussian in Regev's normalization, and the contraction of L1L^1L1 distance under periodization. Each of these is a building block for formalizing the rest of the paper's analysis of Gaussian noise.

Difficulty

The arithmetic is elementary; the work is in the analysis. The statement on T\mathbb{T}T involves infinite series inside an integral, and the passage from the line to the circle requires exchanging a sum over Z\mathbb{Z}Z with an integral and controlling the series almost everywhere. A direct attack on Ψα−Ψβ\Psi_\alpha - \Psi_\betaΨα​−Ψβ​ termwise on [0,1)[0,1)[0,1) does not by itself produce a bound in terms of β/α−1\beta/\alpha - 1β/α−1; the comparison has to be made on the line first. On the line, the scaling to α=1\alpha = 1α=1 is a change of variables in a Lebesgue integral, and the evaluation of ∫x2e−πx2/σ2dx=σ3/(2π)\int x^2 e^{-\pi x^2/\sigma^2}dx = \sigma^3/(2\pi)∫x2e−πx2/σ2dx=σ3/(2π) requires Gaussian moment identities in the paper's normalization rather than Mathlib's.

Formalization scope

  • Reals and densities. Everything is one-dimensional over R\mathbb{R}R; distributions are represented by their densities, not by measures. T\mathbb{T}T is the interval Set.Ico 0 1 with Lebesgue measure; Ψβ\Psi_\betaΨβ​ is a real tsum over k∈Zk \in \mathbb{Z}k∈Z, which converges absolutely for β≠0\beta \ne 0β=0.
  • Statistical distance. Δ\DeltaΔ is a lower Lebesgue integral ∫⁻ ENNReal.ofReal |φ₁ - φ₂| valued in [0,∞][0,\infty][0,∞], with no factor 12\tfrac1221​, as on p. 34:14. Bounds are compared through ENNReal.ofReal. A Bochner integral would be 000 on a non-integrable difference and would make any upper bound trivially true; the extended-valued integral rules this out.
  • Added hypotheses. None on the goal or on the line bound. The modulo-1 milestone assumes φ1,φ2\varphi_1, \varphi_2φ1​,φ2​ integrable (the paper states the data-processing fact for random variables, whose densities are integrable); only the "modulo 1" instance used in the proof is stated, not the general inequality for arbitrary randomized functions. The pointwise bound is stated for every ϵ≥0\epsilon \ge 0ϵ≥0, a harmless generalization of the proof's range 0<ϵ≤10 < \epsilon \le 10<ϵ≤1. The first display is stated as its three component facts (inequality, evaluation =ϵ= \epsilon=ϵ, and the rewriting of the integrand), which together give the printed chain.
  • No trivialization. The goal is Claim 2.2 on T\mathbb{T}T, not the bound on the line, and neither side can collapse to a junk value: the left side is an extended nonnegative integral and the right side is positive under the hypotheses.
  • Welcome contributions. Gaussian moment lemmas in the normalization e−πx2/s2e^{-\pi x^2/s^2}e−πx2/s2, the periodization contraction for general integrable functions, and a measure-level statement identifying Ψβ\Psi_\betaΨβ​ with the pushforward of νβ\nu_\betaνβ​ under reduction modulo 111.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • D. Micciancio and S. Goldwasser, Complexity of Lattice Problems: A Cryptographic Perspective, Kluwer, 2002 (cited on p. 34:15 for the data-processing property of statistical distance). https://doi.org/10.1007/978-1-4615-0897-7
7 thms2 active usersReviewed
Number TheoryTheoretical Computer Science·Captain: mikedeng1

On Lattices, Learning with Errors, Random Linear Codes, and Cryptography 5: If Every χ^⋆k Is Below ⌊p/2⌋/2 with Probability > 1 − δ, the Cryptosystem Decrypts Correctly with Probability ≥ 1 − δResearch Paper

Motivation

Learning with errors (LWE) asks to recover a secret vector s∈Zpns \in \mathbb Z_p^ns∈Zpn​ from noisy inner products (ai,⟨ai,s⟩+ei)(a_i, \langle a_i, s\rangle + e_i)(ai​,⟨ai​,s⟩+ei​), where the aia_iai​ are uniform and the errors eie_iei​ are drawn from a narrow distribution χ\chiχ on Zp\mathbb Z_pZp​. Regev introduced the problem and showed that solving it is at least as hard as solving worst-case lattice problems by a quantum algorithm (Regev 2009). The same paper uses LWE to build a public-key cryptosystem, the ancestor of most lattice-based encryption schemes in use today, including the schemes standardized by NIST in 2024 (ML-KEM, derived from Kyber).

A cryptosystem has two halves: security (an eavesdropper learns nothing about the plaintext) and correctness (the legitimate receiver recovers the plaintext). This mission is the correctness half of Regev's scheme: Lemma 5.1 of the paper, which converts a tail bound on the noise into a bound on the probability that decryption fails. The source is the published article, Journal of the ACM 56(6), Article 34 (2009). The paper's main theorem, a quantum reduction from lattice problems to LWE, is outside this series.

Setting

Fix an integer p≥2p \ge 2p≥2 and let Zp={0,1,…,p−1}\mathbb Z_p = \{0, 1, \dots, p-1\}Zp​={0,1,…,p−1} with addition modulo ppp. Fix integers n,m≥0n, m \ge 0n,m≥0 and a probability distribution χ\chiχ on Zp\mathbb Z_pZp​. All additions are in Zp\mathbb Z_pZp​, and ⟨a,s⟩=∑jajsj\langle a, s\rangle = \sum_j a_j s_j⟨a,s⟩=∑j​aj​sj​ for a,s∈Zpna, s \in \mathbb Z_p^na,s∈Zpn​.

  • Distance from zero. For a∈Zpa \in \mathbb Z_pa∈Zp​, ∣a∣|a|∣a∣ (absZ) is the integer aaa if a∈{0,…,⌊p/2⌋}a \in \{0, \dots, \lfloor p/2\rfloor\}a∈{0,…,⌊p/2⌋} and p−ap - ap−a otherwise.
  • Convolution powers. χ⋆k\chi^{\star k}χ⋆k (convPow χ k) is the law of the sum of kkk independent samples from χ\chiχ; χ⋆0\chi^{\star 0}χ⋆0 is the point mass at 000.
  • Private key. s∈Zpns \in \mathbb Z_p^ns∈Zpn​, chosen uniformly.
  • Public key. a1,…,am∈Zpna_1, \dots, a_m \in \mathbb Z_p^na1​,…,am​∈Zpn​ independent and uniform, e1,…,em∈Zpe_1, \dots, e_m \in \mathbb Z_pe1​,…,em​∈Zp​ independent with law χ\chiχ, and (ai,bi)i=1m(a_i, b_i)_{i=1}^m(ai​,bi​)i=1m​ with bi=⟨ai,s⟩+eib_i = \langle a_i, s\rangle + e_ibi​=⟨ai​,s⟩+ei​ (publicKey).
  • Encryption. A subset S⊆[m]S \subseteq [m]S⊆[m] is chosen uniformly among all 2m2^m2m subsets. The bit 000 is encrypted as (∑i∈Sai,∑i∈Sbi)\bigl(\sum_{i\in S} a_i, \sum_{i\in S} b_i\bigr)(∑i∈S​ai​,∑i∈S​bi​) and the bit 111 as (∑i∈Sai,⌊p/2⌋+∑i∈Sbi)\bigl(\sum_{i\in S} a_i, \lfloor p/2\rfloor + \sum_{i\in S} b_i\bigr)(∑i∈S​ai​,⌊p/2⌋+∑i∈S​bi​) (encrypt).
  • Decryption. A pair (a,b)(a, b)(a,b) decrypts to 000 if b−⟨a,s⟩b - \langle a, s\rangleb−⟨a,s⟩ is closer to 000 than to ⌊p/2⌋\lfloor p/2\rfloor⌊p/2⌋ modulo ppp, i.e. ∣b−⟨a,s⟩∣<∣b−⟨a,s⟩−⌊p/2⌋∣|b - \langle a, s\rangle| < |b - \langle a, s\rangle - \lfloor p/2\rfloor|∣b−⟨a,s⟩∣<∣b−⟨a,s⟩−⌊p/2⌋∣, and to 111 otherwise (decrypt, decodeResidue).

The outcome distribution outcome n m χ c of a bit ccc is the law of the decrypted bit when all of sss, a1,…,ama_1,\dots,a_ma1​,…,am​, e1,…,eme_1,\dots,e_me1​,…,em​ and SSS are drawn as above.

Formalization targets

Goal: Lemma 5.1 (Correctness), p. 34:35

Let δ>0\delta > 0δ>0 and assume that for every k∈{0,1,…,m}k \in \{0, 1, \dots, m\}k∈{0,1,…,m},

Pr⁡e∼χ⋆k[ ∣e∣<⌊p2⌋/2 ]>1−δ.\Pr_{e \sim \chi^{\star k}}\Bigl[\,|e| < \Bigl\lfloor \frac p2\Bigr\rfloor\Big/2\,\Bigr] > 1 - \delta .e∼χ⋆kPr​[∣e∣<⌊2p​⌋/2]>1−δ.

Then for each bit c∈{0,1}c \in \{0,1\}c∈{0,1},

Pr⁡[decryption of an encryption of c equals c]≥1−δ,\Pr[\text{decryption of an encryption of } c \text{ equals } c] \ge 1 - \delta ,Pr[decryption of an encryption of c equals c]≥1−δ,

the probability being over all the randomness of the protocol. The lemma has no hard-coded parameters: ppp, mmm, nnn, χ\chiχ and δ\deltaδ are arbitrary, and the paper's concrete choice (ppp prime in [n2,2n2][n^2, 2n^2][n2,2n2], χ=Ψˉα(n)\chi = \bar\Psi_{\alpha(n)}χ=Ψˉα(n)​) is supplied separately by Claim 5.2.

Milestones (proof of Lemma 5.1, p. 34:36)

  1. Residue identity. For an encryption (a,b)(a, b)(a,b) of 000, b−⟨a,s⟩=∑i∈Seib - \langle a, s\rangle = \sum_{i\in S} e_ib−⟨a,s⟩=∑i∈S​ei​; for an encryption of 111, b−⟨a,s⟩=⌊p/2⌋+∑i∈Seib - \langle a, s\rangle = \lfloor p/2\rfloor + \sum_{i\in S} e_ib−⟨a,s⟩=⌊p/2⌋+∑i∈S​ei​.
  2. Residue law. For a fixed SSS, ∑i∈Sei∼χ⋆∣S∣\sum_{i\in S} e_i \sim \chi^{\star |S|}∑i∈S​ei​∼χ⋆∣S∣.
  3. Rounding. If ∣x∣<⌊p/2⌋/2|x| < \lfloor p/2\rfloor/2∣x∣<⌊p/2⌋/2 then xxx is closer to 000 than to ⌊p/2⌋\lfloor p/2\rfloor⌊p/2⌋, so the residue xxx decrypts to 000 and the residue ⌊p/2⌋+x\lfloor p/2\rfloor + x⌊p/2⌋+x decrypts to 111.

Significance

The result. Lemma 5.1 is the interface between the noise distribution and the scheme: any bound on the tails of the convolution powers χ⋆k\chi^{\star k}χ⋆k, k≤mk \le mk≤m, gives a bound on the decryption error, independently of the security analysis. With Claim 5.2 it shows that the paper's parameters decrypt correctly except with negligible probability. The same template (residue equals accumulated noise; small noise rounds correctly) underlies the correctness proofs of essentially every later LWE-based encryption scheme.

Formalizing it. The result is proved in the paper and is elementary; it is not open. As far as is known, no machine-checked statement of Regev's scheme as a probability experiment exists on Prove2Me; related platform items concern a different scheme (a dual-Regev variant with deterministic noise bounds over an even modulus). The mission's contribution is a faithful, reusable definition of the cryptosystem as a probability experiment over all of its randomness, together with a proof of its correctness lemma. The definitions (the distance ∣⋅∣|\cdot|∣⋅∣ on Zp\mathbb Z_pZp​, convolution powers of a distribution on Zp\mathbb Z_pZp​, i.i.d. product distributions) are reusable by later missions on the security proof (Claim 5.3, Lemma 5.4) or on other LWE schemes.

Difficulty

The arithmetic is short; the work lies in the probability bookkeeping. The hypothesis controls the law of the noise for each fixed subset size, while the conclusion is about a single experiment in which SSS is random and independent of the errors, and the keys sss and aia_iai​ are random too. The step that needs care is identifying the law of ∑i∈Sei\sum_{i\in S} e_i∑i∈S​ei​ for a fixed SSS with χ⋆∣S∣\chi^{\star|S|}χ⋆∣S∣ from a product distribution, and then averaging over SSS; the uniform choices of sss and aia_iai​ must be shown not to affect the residue. A second point is the rounding step: ∣⋅∣|\cdot|∣⋅∣ is a cyclic distance on Zp\mathbb Z_pZp​, and the strict inequality ∣x∣<⌊p/2⌋/2|x| < \lfloor p/2\rfloor/2∣x∣<⌊p/2⌋/2 is sharp (at ∣x∣=⌊p/2⌋/2|x| = \lfloor p/2\rfloor/2∣x∣=⌊p/2⌋/2 the residue is equidistant and decrypts to 111), so odd and even ppp and ties must be handled exactly as printed.

Formalization scope

  • p:Np : \mathbb Np:N with [NeZero p] and the hypothesis 2≤p2 \le p2≤p (the paper defines Zp\mathbb Z_pZp​ for p≥2p \ge 2p≥2, p. 34:14). Primality, part of the paper's parameter choice, is not assumed: Lemma 5.1 does not use it.
  • Zp\mathbb Z_pZp​ is ZMod p, vectors are Fin n → ZMod p, ⟨a,s⟩\langle a, s\rangle⟨a,s⟩ is a ⬝ᵥ s, bits are Fin 2, and subsets of [m][m][m] are Finset (Fin m).
  • Distributions are PMFs. χ⋆k\chi^{\star k}χ⋆k is defined recursively by binds; the i.i.d. errors use the product PMF with mass ∏iχ(ei)\prod_i \chi(e_i)∏i​χ(ei​); uniform choices are PMF.uniformOfFintype. The experiment outcome n m χ c draws sss, then aaa, then eee, then SSS, all independently.
  • ∣a∣|a|∣a∣ is computed from the representative a.val; ⌊p/2⌋\lfloor p/2\rfloor⌊p/2⌋ is natural-number division p / 2; ⌊p/2⌋/2\lfloor p/2\rfloor/2⌊p/2⌋/2 is compared in R\mathbb RR, since it can be a half-integer.
  • Decryption ties (∣x∣=∣x−⌊p/2⌋∣|x| = |x - \lfloor p/2\rfloor|∣x∣=∣x−⌊p/2⌋∣) decrypt to 111, as printed ("Otherwise, the decryption is 1").
  • Probabilities in the goal are real numbers (toReal of PMF masses, exact because they are at most 111). The form ENNReal.ofReal (1 − δ) < Pr was rejected: for δ≥1\delta \ge 1δ≥1 it would add the hypothesis Pr⁡>0\Pr > 0Pr>0, which the page does not make.
  • The goal is not a statement about a fixed key, a fixed subset SSS or a fixed error vector: the probability is over all of sss, aia_iai​, eie_iei​ and SSS, and the hypothesis quantifies over every k∈{0,…,m}k \in \{0, \dots, m\}k∈{0,…,m}. A formalization conditioning on any of these would be a different (weaker) theorem. For k=0k = 0k=0 the hypothesis reads 1>1−δ1 > 1 - \delta1>1−δ, true for δ>0\delta > 0δ>0, so it imposes no hidden restriction.
  • No printed slip was found in Lemma 5.1 or its proof.

Contributions welcome: proofs of the three milestones and the goal; general lemmas on convolution powers and product distributions of PMFs on finite groups.

Selected references

  • O. Regev, On Lattices, Learning with Errors, Random Linear Codes, and Cryptography, Journal of the ACM 56(6), Article 34, 2009. https://doi.org/10.1145/1568318.1568324
  • O. Regev, The Learning with Errors Problem, IEEE Conference on Computational Complexity (invited survey), 2010. https://doi.org/10.1109/CCC.2010.26
  • NIST, Module-Lattice-Based Key-Encapsulation Mechanism Standard, FIPS 203, 2024. https://doi.org/10.6028/NIST.FIPS.203
5 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Quantitative Stability in Stochastic Programming: The Method of Probability Metrics 4: Minimal-Risk Stable Portfolios Are Stable in the Stability Index and the Spectral MeasureResearch Paper

Motivation

Stable distributions were proposed as models of asset returns by Mandelbrot and Fama in the 1960s, because empirical returns show heavier tails than the normal law allows; Rachev and Mittnik's monograph Stable Paretian Models in Finance (2000) collects the later development. When the vector ϱ\varrhoϱ of per-share returns of sss assets follows a multivariate α\alphaα-stable law with α∈(1,2)\alpha\in(1,2)α∈(1,2), its distribution is determined by the stability index α\alphaα, a shift m0∈Rsm_0\in\mathbb R^sm0​∈Rs, and a finite Borel measure Γ\GammaΓ on the unit sphere, the spectral measure. The risk of a portfolio is then measured by the scale parameter of the return, and choosing an efficient portfolio becomes a deterministic optimization problem in (α,Γ)(\alpha,\Gamma)(α,Γ).

In practice neither α\alphaα nor Γ\GammaΓ is known: both are estimated from data. Whether the optimal portfolio is robust to estimation error is therefore a practical question. Section 5 of Rachev and Römisch, Quantitative stability in stochastic programming: The method of probability metrics (Math. Oper. Res. 27(4), 2002; this mission follows the authors' preprint), answers it with an explicit modulus, as an application of the paper's general stability theory for stochastic programs under perturbations of the underlying probability measure.

Setting

Fix s∈Ns\in\mathbb Ns∈N and equip Rs\mathbb R^sRs with the Euclidean scalar product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥\|\cdot\|∥⋅∥.

  • Σs={ξ∈Rs:⟨ξ,ξ⟩=1}\Sigma^s=\{\xi\in\mathbb R^s:\langle\xi,\xi\rangle=1\}Σs={ξ∈Rs:⟨ξ,ξ⟩=1} is the unit sphere, and P(Σs)\mathcal P(\Sigma^s)P(Σs) is the set of Borel probability measures on it (normalized spectral measures).
  • X={x∈R+s:∑i=1sxi=1}X=\{x\in\mathbb R^s_+:\sum_{i=1}^s x_i=1\}X={x∈R+s​:∑i=1s​xi​=1} is the set of portfolios: xix_ixi​ is the proportion of shares held in asset iii.
  • For α∈(1,2)\alpha\in(1,2)α∈(1,2) and Γ∈P(Σs)\Gamma\in\mathcal P(\Sigma^s)Γ∈P(Σs), the risk of xxx is
rα,Γ(x)=∫Σs∣⟨x,ξ⟩∣α Γ(dξ).r_{\alpha,\Gamma}(x)=\int_{\Sigma^s}|\langle x,\xi\rangle|^\alpha\,\Gamma(d\xi).rα,Γ​(x)=∫Σs​∣⟨x,ξ⟩∣αΓ(dξ).
  • Problem (22) is min⁡{rα,Γ(x):x∈X}\min\{r_{\alpha,\Gamma}(x):x\in X\}min{rα,Γ​(x):x∈X}, with optimal value v(α,Γ)v(\alpha,\Gamma)v(α,Γ) and solution set S(α,Γ)S(\alpha,\Gamma)S(α,Γ).
  • The dual Lipschitz metric ζ1\zeta_1ζ1​ (the Fortet–Mourier metric of order 111) on P(Σs)\mathcal P(\Sigma^s)P(Σs) is
ζ1(Γ,Γ~)=sup⁡{∣∫Σsf dΓ−∫Σsf dΓ~∣:f:Σs→R, ∣f(ξ)−f(ξ~)∣≤∥ξ−ξ~∥}.\zeta_1(\Gamma,\tilde\Gamma)=\sup\Big\{\Big|\int_{\Sigma^s}f\,d\Gamma-\int_{\Sigma^s}f\,d\tilde\Gamma\Big|: f:\Sigma^s\to\mathbb R,\ |f(\xi)-f(\tilde\xi)|\le\|\xi-\tilde\xi\|\Big\}.ζ1​(Γ,Γ~)=sup{​∫Σs​fdΓ−∫Σs​fdΓ~​:f:Σs→R, ∣f(ξ)−f(ξ~​)∣≤∥ξ−ξ~​∥}.
  • The growth function of (22) is ψ(τ)=min⁡{rα,Γ(x)−v(α,Γ):d(x,S(α,Γ))≥τ, x∈X}\psi(\tau)=\min\{r_{\alpha,\Gamma}(x)-v(\alpha,\Gamma): d(x,S(\alpha,\Gamma))\ge\tau,\ x\in X\}ψ(τ)=min{rα,Γ​(x)−v(α,Γ):d(x,S(α,Γ))≥τ, x∈X} for τ≥0\tau\ge0τ≥0, its generalized inverse is ψ−1(t)=sup⁡{τ≥0:ψ(τ)≤t}\psi^{-1}(t)=\sup\{\tau\ge0:\psi(\tau)\le t\}ψ−1(t)=sup{τ≥0:ψ(τ)≤t}, and the stability modulus is Ψ(η)=η+ψ−1(2η)\Psi(\eta)=\eta+\psi^{-1}(2\eta)Ψ(η)=η+ψ−1(2η).
  • Γ\GammaΓ is nonsingular if ∫Σs∣⟨x,ξ⟩∣2Γ(dξ)=0\int_{\Sigma^s}|\langle x,\xi\rangle|^2\Gamma(d\xi)=0∫Σs​∣⟨x,ξ⟩∣2Γ(dξ)=0 implies x=0x=0x=0.

Formalization targets

Goal: Theorem 5.2, first assertion (p. 25)

For each (α,Γ)∈(1,2)×P(Σs)(\alpha,\Gamma)\in(1,2)\times\mathcal P(\Sigma^s)(α,Γ)∈(1,2)×P(Σs) there is δ>0\delta>0δ>0 such that

sup⁡x∈S(α~,Γ~)d(x,S(α,Γ))≤Ψ(α ζ1(Γ,Γ~)+e−1∣α−α~∣)\sup_{x\in S(\tilde\alpha,\tilde\Gamma)}d\big(x,S(\alpha,\Gamma)\big)\le\Psi\big(\alpha\,\zeta_1(\Gamma,\tilde\Gamma)+e^{-1}|\alpha-\tilde\alpha|\big)x∈S(α~,Γ~)sup​d(x,S(α,Γ))≤Ψ(αζ1​(Γ,Γ~)+e−1∣α−α~∣)

whenever (α~,Γ~)∈(1,2)×P(Σs)(\tilde\alpha,\tilde\Gamma)\in(1,2)\times\mathcal P(\Sigma^s)(α~,Γ~)∈(1,2)×P(Σs) and ζ1(Γ,Γ~)+∣α−α~∣<δ\zeta_1(\Gamma,\tilde\Gamma)+|\alpha-\tilde\alpha|<\deltaζ1​(Γ,Γ~)+∣α−α~∣<δ. The modulus Ψ\PsiΨ is not fixed: it is whatever the growth of the unperturbed problem gives.

Companion: Theorem 5.2, "Moreover" (p. 25)

If Γ\GammaΓ is nonsingular, then (22) has a unique solution and Ψ(η)≤Cη1/2\Psi(\eta)\le C\eta^{1/2}Ψ(η)≤Cη1/2 for some C>0C>0C>0 and all sufficiently small η≥0\eta\ge0η≥0.

Milestones

  1. Lemma 5.1, first assertion (p. 24): f0(ξ,x)=∣⟨x,ξ⟩∣αf_0(\xi,x)=|\langle x,\xi\rangle|^\alphaf0​(ξ,x)=∣⟨x,ξ⟩∣α is convex in xxx, and ∣f0(ξ,x)−f0(ξ~,x~)∣≤α(∥ξ−ξ~∥+∥x−x~∥)|f_0(\xi,x)-f_0(\tilde\xi,\tilde x)|\le\alpha(\|\xi-\tilde\xi\|+\|x-\tilde x\|)∣f0​(ξ,x)−f0​(ξ~​,x~)∣≤α(∥ξ−ξ~​∥+∥x−x~∥) on Σs×X\Sigma^s\times XΣs×X.
  2. Lemma 5.1, second assertion (p. 24): S(α,Γ)≠∅S(\alpha,\Gamma)\ne\emptysetS(α,Γ)=∅, and 14α(α−1)∫Σs∣⟨x−x∗,z⟩∣2Γ(dz)≤rα,Γ(x)−v(α,Γ)\frac14\alpha(\alpha-1)\int_{\Sigma^s}|\langle x-x_*,z\rangle|^2\Gamma(dz)\le r_{\alpha,\Gamma}(x)-v(\alpha,\Gamma)41​α(α−1)∫Σs​∣⟨x−x∗​,z⟩∣2Γ(dz)≤rα,Γ​(x)−v(α,Γ) for all x∈Xx\in Xx∈X and some x∗∈S(α,Γ)x_*\in S(\alpha,\Gamma)x∗​∈S(α,Γ).
  3. Proof of Theorem 5.2 (p. 25): sup⁡t∈[−1,1]∣∣t∣α−∣t∣α~∣≤e−1∣α−α~∣\sup_{t\in[-1,1]}\big||t|^\alpha-|t|^{\tilde\alpha}\big|\le e^{-1}|\alpha-\tilde\alpha|supt∈[−1,1]​​∣t∣α−∣t∣α~​≤e−1∣α−α~∣.
  4. Proof of Theorem 5.2 (p. 25): ∣rα,Γ(x)−rα~,Γ~(x)∣≤αζ1(Γ,Γ~)+e−1∣α−α~∣|r_{\alpha,\Gamma}(x)-r_{\tilde\alpha,\tilde\Gamma}(x)|\le\alpha\zeta_1(\Gamma,\tilde\Gamma)+e^{-1}|\alpha-\tilde\alpha|∣rα,Γ​(x)−rα~,Γ~​(x)∣≤αζ1​(Γ,Γ~)+e−1∣α−α~∣ for x∈Xx\in Xx∈X.
  5. Proof of Theorem 5.2 (p. 25): for nonsingular Γ\GammaΓ, c∥x∥2≤∫Σs∣⟨x,ξ⟩∣2Γ(dξ)c\|x\|^2\le\int_{\Sigma^s}|\langle x,\xi\rangle|^2\Gamma(d\xi)c∥x∥2≤∫Σs​∣⟨x,ξ⟩∣2Γ(dξ) for some c=c(s,Γ)>0c=c(s,\Gamma)>0c=c(s,Γ)>0.
  6. Proof of Theorem 5.2 (p. 25): for nonsingular Γ\GammaΓ, (22) has a unique solution x∗x_*x∗​ and 14cα(α−1)∥x−x∗∥2≤rα,Γ(x)−v(α,Γ)\frac14c\alpha(\alpha-1)\|x-x_*\|^2\le r_{\alpha,\Gamma}(x)-v(\alpha,\Gamma)41​cα(α−1)∥x−x∗​∥2≤rα,Γ​(x)−v(α,Γ) on XXX.

Significance

The theorem bounds how far the optimal portfolios can move when the stability index and the spectral measure are both perturbed, with a modulus computed from the unperturbed problem alone. Combined with the companion, the efficient portfolio of a nonsingular spectral measure is unique and moves by at most O((ζ1(Γ,Γ~)+∣α−α~∣)1/2)O\big((\zeta_1(\Gamma,\tilde\Gamma)+|\alpha-\tilde\alpha|)^{1/2}\big)O((ζ1​(Γ,Γ~)+∣α−α~∣)1/2). Since ζ1\zeta_1ζ1​ metrizes weak convergence on the compact sphere, any consistent estimator of Γ\GammaΓ in the weak topology, together with a consistent estimator of α\alphaα, yields consistent estimates of the optimal portfolio, and convergence rates for ζ1\zeta_1ζ1​ translate into rates for the portfolio. The paper notes (Example 5.3) that spectral measures of linear transformations of independent stable variables with a full-rank matrix are nonsingular, so the Hölder case covers the discrete spectral measures used in practice.

The result is proved in the paper; nothing here is open. To our knowledge none of it is machine-checked: Mathlib has strong convexity and the real power function but no stability theory of stochastic programs and no Fortet–Mourier metrics. The mission produces a checked proof of the result and a reusable formal treatment of the growth-function modulus Ψ\PsiΨ in a concrete, fully explicit instance.

Difficulty

The obvious argument compares the optimal values of the two problems and concludes that a perturbed minimizer is nearly optimal for the unperturbed problem. Turning near-optimality into a distance bound requires the growth function ψ\psiψ and its generalized inverse; ψ\psiψ is defined by an infimum over a set that may be empty, and ψ−1\psi^{-1}ψ−1 by a supremum that may be infinite, so this step has to be handled in extended arithmetic with care. A second difficulty is the ζ1\zeta_1ζ1​ term: the map ξ↦∣⟨x,ξ⟩∣α\xi\mapsto|\langle x,\xi\rangle|^\alphaξ↦∣⟨x,ξ⟩∣α must be shown to be α\alphaα-Lipschitz on the sphere uniformly over x∈Xx\in Xx∈X, which uses ∥x∥≤1\|x\|\le1∥x∥≤1 on the simplex. The change of exponent from α\alphaα to α~\tilde\alphaα~ is controlled by a sharp calculus inequality whose constant e−1e^{-1}e−1 needs α,α~≥1\alpha,\tilde\alpha\ge1α,α~≥1. In the nonsingular case, the quadratic form ∫∣⟨x,ξ⟩∣2Γ(dξ)\int|\langle x,\xi\rangle|^2\Gamma(d\xi)∫∣⟨x,ξ⟩∣2Γ(dξ) must be shown to dominate c∥x∥2c\|x\|^2c∥x∥2, a compactness argument on the unit sphere of Rs\mathbb R^sRs.

Formalization scope

  • Rs\mathbb R^sRs is EuclideanSpace ℝ (Fin s) with coordinates indexed 0,…,s−10,\dots,s-10,…,s−1. The paper says "the (Euclidean) scalar product", so Euclidean norms are the paper's own.
  • Σs\Sigma^sΣs is Metric.sphere 0 1. A spectral measure is a probability measure on Rs\mathbb R^sRs with Γ((Σs)c)=0\Gamma((\Sigma^s)^c)=0Γ((Σs)c)=0, and every integral is a set integral over Σs\Sigma^sΣs. For s=0s=0s=0 the sphere is empty, no spectral measure exists, and every statement is vacuous, as in the paper.
  • The standing assumption α∈(1,2)\alpha\in(1,2)α∈(1,2) of Section 5 is a hypothesis of every statement. The α\alphaα-stable law itself is not formalized: the characteristic function on p. 23 only motivates (22), and the mission captures problem (22) exactly.
  • ζ1\zeta_1ζ1​ is a supremum in [0,∞][0,\infty][0,∞] over functions on Rs\mathbb R^sRs that are 111-Lipschitz on Σs\Sigma^sΣs, integrated over Σs\Sigma^sΣs only. Such functions are continuous on the compact sphere, so no integral can collapse to a default value. For probability measures, ζ1≤2\zeta_1\le2ζ1​≤2.
  • vvv is the real infimum of rα,Γr_{\alpha,\Gamma}rα,Γ​ over XXX. SSS is the set of minimizers. The paper's "min" in ψ\psiψ is read as an infimum in the extended reals, equal to +∞+\infty+∞ when no feasible point is at distance at least τ\tauτ. Distances to sets are extended distances (Metric.infEDist, +∞+\infty+∞ to the empty set), and ψ−1\psi^{-1}ψ−1 and Ψ\PsiΨ take values in [0,∞][0,\infty][0,∞].
  • Ruled out: a real-valued supremum for ψ−1\psi^{-1}ψ−1 (which would be 000 on unbounded sets), a real distance (which is 000 to the empty set), and test functions integrated over all of Rs\mathbb R^sRs (whose off-sphere values could make an integral undefined). Any of these would make the goal trivially true.
  • "Sufficiently small η\etaη" is read as "all η∈[0,η0]\eta\in[0,\eta_0]η∈[0,η0​] for some η0>0\eta_0>0η0​>0". Milestone 6 holds for every constant c>0c>0c>0 of the norm bound of milestone 5, fixed before α\alphaα, as c=c(s,Γ)c=c(s,\Gamma)c=c(s,Γ) on the page.

Welcome contributions: the inequality ∣∣t∣α−∣t∣α~∣≤e−1∣α−α~∣\big||t|^\alpha-|t|^{\tilde\alpha}\big|\le e^{-1}|\alpha-\tilde\alpha|​∣t∣α−∣t∣α~​≤e−1∣α−α~∣ on [−1,1][-1,1][−1,1], strong convexity of ∣t∣α|t|^\alpha∣t∣α on [−1,1][-1,1][−1,1], and a general lemma converting a growth function and a uniform objective perturbation into a distance bound; the last is reusable for every stability result of the paper.

Selected references

  • S. T. Rachev, W. Römisch, Quantitative stability in stochastic programming: The method of probability metrics, Mathematics of Operations Research 27(4) (2002) 792–818. https://doi.org/10.1287/moor.27.4.792.304 (preprint at edoc.hu-berlin.de, followed here).
  • S. T. Rachev, S. Mittnik, Stable Paretian Models in Finance, Wiley, Chichester, 2000 (reference [33] of the paper).
  • G. Samorodnitsky, M. S. Taqqu, Stable Non-Gaussian Random Processes, Chapman & Hall, 1994. https://doi.org/10.1201/9780203738818
  • B. Mandelbrot, The variation of certain speculative prices, Journal of Business 36(4) (1963) 394–419. https://doi.org/10.1086/294632
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
8 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Quantitative Stability in Stochastic Programming: The Method of Probability Metrics 1: Solution Sets Move by at Most Ψ of the Minimal Information DistanceResearch Paper

Motivation

A stochastic program minimizes an expected cost under expected-value constraints, and the expectation is taken with respect to a probability distribution μ\muμ of the random data. In applications μ\muμ is rarely known: it is estimated from samples, replaced by a finite scenario tree, or chosen from a parametric family. Whether the optimal value and the optimal decisions of the approximate problem are close to those of the true problem therefore decides whether the approximation can be trusted. Quantitative stability asks for explicit bounds on the change of optimal values and solution sets in terms of a distance between μ\muμ and its perturbation ν\nuν.

S. T. Rachev and W. Römisch (Quantitative stability in stochastic programming: The method of probability metrics, Math. Oper. Res. 27(4), 2002; this mission follows the authors' preprint) organize this question around a single probability distance, built directly from the integrands of the problem. Their general results (Section 2) are then specialized to two-stage linear and mixed-integer programs, to chance constraints, to empirical approximations, and to a portfolio problem. This mission covers the general part: Proposition 2.1 and Theorems 2.2 and 2.3.

Setting

Let X⊆RmX\subseteq\mathbb R^mX⊆Rm be a nonempty closed set, Ξ⊆Rs\Xi\subseteq\mathbb R^sΞ⊆Rs a closed set, and fj:Ξ×Rm→R‾f_j:\Xi\times\mathbb R^m\to\overline{\mathbb R}fj​:Ξ×Rm→R, j=0,…,dj=0,\dots,dj=0,…,d, normal integrands: each epigraph {(x,r):fj(ξ,x)≤r}\{(x,r):f_j(\xi,x)\le r\}{(x,r):fj​(ξ,x)≤r} is closed and the epigraphical mapping ξ↦epi⁡fj(ξ,⋅)\xi\mapsto\operatorname{epi} f_j(\xi,\cdot)ξ↦epifj​(ξ,⋅) is measurable. For a Borel probability measure ν\nuν on Ξ\XiΞ the problem is

min⁡{∫Ξf0(ξ,x) ν(dξ): x∈X, ∫Ξfj(ξ,x) ν(dξ)≤0, j=1,…,d},\min\Big\{\int_\Xi f_0(\xi,x)\,\nu(d\xi):\ x\in X,\ \int_\Xi f_j(\xi,x)\,\nu(d\xi)\le0,\ j=1,\dots,d\Big\},min{∫Ξ​f0​(ξ,x)ν(dξ): x∈X, ∫Ξ​fj​(ξ,x)ν(dξ)≤0, j=1,…,d},

with feasible set M(ν)M(\nu)M(ν), optimal value v(ν)v(\nu)v(ν) and solution set S(ν)S(\nu)S(ν); μ\muμ is the original measure.

For a nonempty set U⊆Rm\mathcal U\subseteq\mathbb R^mU⊆Rm, the localized problem restricts xxx to X∩cl⁡UX\cap\operatorname{cl}\mathcal UX∩clU, with feasible set MU(ν)M_{\mathcal U}(\nu)MU​(ν), value vU(ν)v_{\mathcal U}(\nu)vU​(ν) and solutions SU(ν)S_{\mathcal U}(\nu)SU​(ν). The admissible measures PFU\mathcal P_{\mathcal F_{\mathcal U}}PFU​​ are those under which ∫inf⁡x∈X,∥x∥≤rfj(ξ,x)ν(dξ)>−∞\int\inf_{x\in X,\|x\|\le r}f_j(\xi,x)\nu(d\xi)>-\infty∫infx∈X,∥x∥≤r​fj​(ξ,x)ν(dξ)>−∞ for every r>0r>0r>0 and sup⁡x∈X∩cl⁡U∫fj(ξ,x)ν(dξ)<∞\sup_{x\in X\cap\operatorname{cl}\mathcal U}\int f_j(\xi,x)\nu(d\xi)<\inftysupx∈X∩clU​∫fj​(ξ,x)ν(dξ)<∞. The minimal information distance is

dFU(μ,ν)=sup⁡x∈X∩cl⁡U max⁡j=0,…,d∣∫Ξfj(ξ,x) μ(dξ)−∫Ξfj(ξ,x) ν(dξ)∣.d_{\mathcal F_{\mathcal U}}(\mu,\nu)=\sup_{x\in X\cap\operatorname{cl}\mathcal U}\ \max_{j=0,\dots,d}\Big|\int_\Xi f_j(\xi,x)\,\mu(d\xi)-\int_\Xi f_j(\xi,x)\,\nu(d\xi)\Big|.dFU​​(μ,ν)=x∈X∩clUsup​ j=0,…,dmax​​∫Ξ​fj​(ξ,x)μ(dξ)−∫Ξ​fj​(ξ,x)ν(dξ)​.

The constraints are metrically regular at (xˉ,0)(\bar x,0)(xˉ,0) if there are a≥0a\ge0a≥0, ε>0\varepsilon>0ε>0 with d(x,My(μ))≤amax⁡jmax⁡{0,∫fj(ξ,x)μ(dξ)−yj}d(x,M_y(\mu))\le a\max_j\max\{0,\int f_j(\xi,x)\mu(d\xi)-y_j\}d(x,My​(μ))≤amaxj​max{0,∫fj​(ξ,x)μ(dξ)−yj​} for x∈Xx\in Xx∈X near xˉ\bar xxˉ and small y∈Rdy\in\mathbb R^dy∈Rd, where My(μ)M_y(\mu)My​(μ) is the feasible set with right-hand sides yyy. A nonempty set is a CLM set (complete local minimizing set) with respect to an open U\mathcal UU if it equals SU(ν)S_{\mathcal U}(\nu)SU​(ν) and lies in U\mathcal UU. The growth function is ψ(τ)=inf⁡{∫f0(ξ,x)μ(dξ)−v(μ):d(x,S(μ))≥τ, x∈MU(μ)}\psi(\tau)=\inf\{\int f_0(\xi,x)\mu(d\xi)-v(\mu):d(x,S(\mu))\ge\tau,\ x\in M_{\mathcal U}(\mu)\}ψ(τ)=inf{∫f0​(ξ,x)μ(dξ)−v(μ):d(x,S(μ))≥τ, x∈MU​(μ)}, with ψ−1(t)=sup⁡{τ≥0:ψ(τ)≤t}\psi^{-1}(t)=\sup\{\tau\ge0:\psi(\tau)\le t\}ψ−1(t)=sup{τ≥0:ψ(τ)≤t} and Ψ(η)=η+ψ−1(η)\Psi(\eta)=\eta+\psi^{-1}(\eta)Ψ(η)=η+ψ−1(η).

Formalization targets

Goal: Theorem 2.3, δ-local form

Under the assumptions of Theorem 2.2 — μ∈PFU\mu\in\mathcal P_{\mathcal F_{\mathcal U}}μ∈PFU​​; S(μ)≠∅S(\mu)\ne\emptysetS(μ)=∅ and U\mathcal UU an open bounded neighbourhood of S(μ)S(\mu)S(μ); if d≥1d\ge1d≥1, x↦∫f0(ξ,x)μ(dξ)x\mapsto\int f_0(\xi,x)\mu(d\xi)x↦∫f0​(ξ,x)μ(dξ) Lipschitz on X∩cl⁡UX\cap\operatorname{cl}\mathcal UX∩clU; metric regularity at every (xˉ,0)(\bar x,0)(xˉ,0), xˉ∈S(μ)\bar x\in S(\mu)xˉ∈S(μ) — there are L^≥1\hat L\ge1L^≥1 and δ>0\delta>0δ>0 with

∅≠SU(ν)⊆S(μ)+Ψ(L^ dFU(μ,ν))Bfor all ν∈PFU, dFU(μ,ν)<δ.\emptyset\ne S_{\mathcal U}(\nu)\subseteq S(\mu)+\Psi\big(\hat L\,d_{\mathcal F_{\mathcal U}}(\mu,\nu)\big)\mathbb B\qquad\text{for all }\nu\in\mathcal P_{\mathcal F_{\mathcal U}},\ d_{\mathcal F_{\mathcal U}}(\mu,\nu)<\delta.∅=SU​(ν)⊆S(μ)+Ψ(L^dFU​​(μ,ν))Bfor all ν∈PFU​​, dFU​​(μ,ν)<δ.

The constants are existential: the goal fixes the shape of the estimate, not its constants.

Milestones

  1. Proposition 2.1: (x,ν)↦∫fj(ξ,x)ν(dξ)(x,\nu)\mapsto\int f_j(\xi,x)\nu(d\xi)(x,ν)↦∫fj​(ξ,x)ν(dξ) is lower semicontinuous on (X∩cl⁡U)×(PFU,dFU)(X\cap\operatorname{cl}\mathcal U)\times(\mathcal P_{\mathcal F_{\mathcal U}},d_{\mathcal F_{\mathcal U}})(X∩clU)×(PFU​​,dFU​​), and ν↦MU(ν)\nu\mapsto M_{\mathcal U}(\nu)ν↦MU​(ν) has a closed graph.
  2. Display (5) and its converse: near xˉ∈S(μ)\bar x\in S(\mu)xˉ∈S(μ), MU(μ)M_{\mathcal U}(\mu)MU​(μ) and MU(ν)M_{\mathcal U}(\nu)MU​(ν) lie within a dFU(μ,ν)a\,d_{\mathcal F_{\mathcal U}}(\mu,\nu)adFU​​(μ,ν) of each other.
  3. Theorem 2.2: Berge upper semicontinuity of SUS_{\mathcal U}SU​ at μ\muμ, the Lipschitz estimate ∣v(μ)−vU(ν)∣≤L dFU(μ,ν)|v(\mu)-v_{\mathcal U}(\nu)|\le L\,d_{\mathcal F_{\mathcal U}}(\mu,\nu)∣v(μ)−vU​(ν)∣≤LdFU​​(μ,ν), and the CLM property, for ν\nuν near μ\muμ; for d=0d=0d=0, the estimate with L=1L=1L=1 for all ν\nuν.
  4. Theorem 2.3 for d=0d=0d=0, for every ν∈PFU\nu\in\mathcal P_{\mathcal F_{\mathcal U}}ν∈PFU​​, as printed.

Significance

Theorem 2.2 shows that the distance dFUd_{\mathcal F_{\mathcal U}}dFU​​ carries exactly the information about μ\muμ that the problem uses: any probability metric that dominates it inherits the Lipschitz estimate of optimal values. This is the mechanism by which the paper derives stability with respect to Fortet–Mourier metrics for two-stage programs, with respect to discrepancies for mixed-integer and chance-constrained programs, and convergence rates for empirical approximations via empirical-process bounds. Theorem 2.3 adds the solution sets: their deviation is controlled by Ψ\PsiΨ, which is determined by the growth of the objective near S(μ)S(\mu)S(μ); quadratic growth yields Hölder continuity with rate 12\tfrac1221​ (Remark 2.4).

The results are proved on paper. No machine-checked version of these stability theorems, of metric regularity for expected-value constraints, or of the minimal information distance exists on the platform. The formalization also settles the exact quantifier structure of Theorem 2.3: its printed form ("for each ν\nuν") is true only for d=0d=0d=0, and the mission states the δ-local form that the proof establishes.

Difficulty

The obvious argument compares the two problems pointwise in xxx: the integrals differ by at most dFU(μ,ν)d_{\mathcal F_{\mathcal U}}(\mu,\nu)dFU​​(μ,ν), so the optimal values should too. This works without constraints, but with d≥1d\ge1d≥1 the feasible sets themselves move, and a point feasible for μ\muμ need not be feasible for ν\nuν. Controlling this displacement needs metric regularity of the constraint system, which is only local, around each point of S(μ)S(\mu)S(μ); passing from local to uniform constants requires compactness of S(μ)S(\mu)S(μ) and a covering argument. A second difficulty is extended-real analysis: the integrands take the value +∞+\infty+∞, lower semicontinuity must come from Fatou's lemma under the integrability conditions defining PFU\mathcal P_{\mathcal F_{\mathcal U}}PFU​​, and the existence of localized solutions depends on this lower semicontinuity on the compact set X∩cl⁡UX\cap\operatorname{cl}\mathcal UX∩clU.

Formalization scope

Rm\mathbb R^mRm and Rs\mathbb R^sRs are EuclideanSpace ℝ (Fin m), EuclideanSpace ℝ (Fin s); the paper never fixes its norm, and every statement has existential constants, so the Euclidean norm is a faithful instance. Measures are Borel probability measures on the subtype Ξ\XiΞ. Integrals of extended-real integrands use the published DupacovaWets.Consistency.expect (+∞+\infty+∞ when ∫f+=∞\int f^+=\infty∫f+=∞). The integrands are indexed by Fin (d+1), with index 000 the objective. Values vvv, vUv_{\mathcal U}vU​ and ψ\psiψ are infima in R‾\overline{\mathbb R}R (+∞+\infty+∞ on empty sets; the paper's "min" in ψ\psiψ is read as an infimum); dFUd_{\mathcal F_{\mathcal U}}dFU​​, ψ−1\psi^{-1}ψ−1 and Ψ\PsiΨ take values in [0,∞][0,\infty][0,∞]; distances to sets are extended distances (infinite to the empty set). Lower semicontinuity and closed graphs in Proposition 2.1 are stated sequentially, which is equivalent in the extended pseudometric space (PFU,dFU)(\mathcal P_{\mathcal F_{\mathcal U}},d_{\mathcal F_{\mathcal U}})(PFU​​,dFU​​). The balls B(xˉ,εˉ)B(\bar x,\bar\varepsilon)B(xˉ,εˉ) in (5) are closed balls.

Standing assumptions carried by every statement: XXX nonempty and closed, Ξ\XiΞ closed, all fjf_jfj​ normal integrands, and measures in PFU\mathcal P_{\mathcal F_{\mathcal U}}PFU​​. Every value estimate asserts that both optimal values are finite, so no bound holds through an ∞−∞\infty-\infty∞−∞ convention, and the distance to an empty feasible set is +∞+\infty+∞, so metric regularity cannot hold vacuously. The one deliberate deviation from the page is the δ in the goal, explained above.

A complete development needs Fatou's lemma for extended-real integrands bounded below by an integrable function, measurability of infima of normal integrands, and Berge's stability theorem for parametric programs. The first two are reusable for every stochastic-programming mission on the platform. Contributions of these lemmas as separate theorems are welcome.

Selected references

  • S. T. Rachev, W. Römisch, Quantitative stability in stochastic programming: The method of probability metrics, Math. Oper. Res. 27(4) (2002), 792–818. https://doi.org/10.1287/moor.27.4.792.304
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998 (normal integrands, Ch. 14; metric regularity, Ch. 9). https://doi.org/10.1007/978-3-642-02431-3
  • B. Bank, J. Guddat, D. Klatte, B. Kummer, K. Tammer, Non-Linear Parametric Optimization, Akademie-Verlag, Berlin, 1982 (Berge stability, Thm. 4.2.1).
  • D. Klatte, A note on quantitative stability results in nonlinear optimization, in: Proceedings 19. Jahrestagung Mathematische Optimierung, Seminarbericht Nr. 90, Humboldt-Universität Berlin, 1987, 77–86 (the proof pattern of Theorem 2.2).
10 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Bounded Rationality in Newsvendor Models IV: Raising the Payoff Scale from λ₂ to λ₁ > λ₂ Strictly Raises the Expected Profit of a Logit Decision MakerResearch Paper

Motivation

A standard way to coordinate a supply chain is to align incentives: contracts are written so that the retailer's profit is a fixed fraction λ\lambdaλ of the whole chain's profit. With buy-back terms b=(1−λ)pb=(1-\lambda)pb=(1−λ)p and wholesale price w=(1−λ)p+λcw=(1-\lambda)p+\lambda cw=(1−λ)p+λc, for instance, the retailer's profit is λπS(x)\lambda\pi_S(x)λπS​(x), where πS\pi_SπS​ is the chain's newsvendor profit. A perfectly rational retailer maximising λπS\lambda\pi_SλπS​ picks the same order as a central planner maximising πS\pi_SπS​, so the chain is coordinated (Cachon, Supply Chain Coordination with Contracts, 2003). Laboratory subjects working under such contracts nevertheless fail to reach the coordinated outcome (Katok and Wu, Contracting in Supply Chains: A Laboratory Investigation, Management Science 2009).

Su, Bounded Rationality in Newsvendor Models, MSOM 10(4), 2008 gives a model-based explanation. A boundedly rational decision maker chooses better options more often, but not always the best. The choice probabilities depend on the actual size of the payoffs, not only on their ranking, so scaling the payoff by λ\lambdaλ changes behaviour. This mission formalizes the paper's §7 result: a larger stake in the same payoff raises the expected payoff. The source is the published MSOM 2008 article.

Setting

A decision maker chooses xxx from a decision domain S⊆RS\subseteq\mathbb RS⊆R to maximise a utility uuu. Under the multinomial logit model with bounded-rationality parameter β>0\beta>0β>0, the choice X♭X^\flatX♭ is random with density (eq. (2))

ψ(x)=eu(x)/β∫Seu(v)/β dv(x∈S),\psi(x)=\frac{e^{u(x)/\beta}}{\int_S e^{u(v)/\beta}\,dv}\qquad (x\in S),ψ(x)=∫S​eu(v)/βdveu(x)/β​(x∈S),

and ψ=0\psi=0ψ=0 off SSS. Large β\betaβ means near-uniform choice; β→0\beta\to0β→0 recovers the perfectly rational choice. In Lean this is logitDensity S u β, and the expectation of g(X♭)g(X^\flat)g(X♭) is logitExp S u β g =∫g(y)ψ(y) dy=\int g(y)\psi(y)\,dy=∫g(y)ψ(y)dy.

Proposition 5 takes an arbitrary payoff π\piπ on SSS. Two decision makers have the same β\betaβ but different stakes in π\piπ: their utilities are u1=λ1πu_1=\lambda_1\piu1​=λ1​π and u2=λ2πu_2=\lambda_2\piu2​=λ2​π. The resulting behavioral decisions X1♭X^\flat_1X1♭​ and X2♭X^\flat_2X2♭​ have densities ψ1\psi_1ψ1​ and ψ2\psi_2ψ2​.

In the newsvendor instance, demand DDD has density fff on [0,∞)[0,\infty)[0,∞), a unit costs ccc and sells for p>cp>cp>c, and the expected profit is (eq. (3))

π(x)=p Emin⁡(D,x)−c x.\pi(x)=p\,E\min(D,x)-c\,x .π(x)=pEmin(D,x)−cx.

SSS is the smallest interval containing the support of fff. A retailer who receives the share λ\lambdaλ of the chain's profit has utility λπ\lambda\piλπ.

Formalization targets

Goal: Proposition 5 (p. 580)

If λ1>λ2\lambda_1>\lambda_2λ1​>λ2​ and π\piπ is not almost everywhere constant on SSS, then

Eπ(X1♭)>Eπ(X2♭).E\pi(X^\flat_1)>E\pi(X^\flat_2).Eπ(X1♭​)>Eπ(X2♭​).

The goal leaves SSS, π\piπ, β\betaβ and the sign of the λi\lambda_iλi​ free. Its only standing requirement is that the two logit laws and their expected payoffs exist.

Milestones (proof of Proposition 5, p. 587)

  1. Eqs. (54)–(55): with K=∫Seu1/β/∫Seu2/βK=\int_Se^{u_1/\beta}\big/\int_Se^{u_2/\beta}K=∫S​eu1​/β/∫S​eu2​/β, for x∈Sx\in Sx∈S
ψ1(x)>ψ2(x)  ⟺  π(x)>βln⁡Kλ1−λ2.\psi_1(x)>\psi_2(x)\iff \pi(x)>\frac{\beta\ln K}{\lambda_1-\lambda_2}.ψ1​(x)>ψ2​(x)⟺π(x)>λ1​−λ2​βlnK​.
  1. Eqs. (56)–(57): π(X1♭)\pi(X^\flat_1)π(X1♭​) first-order stochastically dominates π(X2♭)\pi(X^\flat_2)π(X2♭​):
P(π(X1♭)≥k)≥P(π(X2♭)≥k)for all k∈R.P(\pi(X^\flat_1)\ge k)\ge P(\pi(X^\flat_2)\ge k)\quad\text{for all }k\in\mathbb R.P(π(X1♭​)≥k)≥P(π(X2♭​)≥k)for all k∈R.

Corollary 2 (p. 580)

For the newsvendor profit, 0<c<p0<c<p0<c<p, β>0\beta>0β>0 and shares 0<λ2<λ10<\lambda_2<\lambda_10<λ2​<λ1​, Eπ(X1♭)>Eπ(X2♭)E\pi(X^\flat_1)>E\pi(X^\flat_2)Eπ(X1♭​)>Eπ(X2♭​). Here the existence of the logit laws and the non-constancy of π\piπ are proved, not assumed.

Significance

The result. Proposition 5 says that proportional incentive alignment does not coordinate a boundedly rational chain. A retailer with share λ<1\lambda<1λ<1 makes noisier decisions than a sole owner with the same β\betaβ, so the chain's expected profit is strictly lower. Two consequences follow in §7. Two-part tariffs, which make the retailer the sole residual claimant (λ=1\lambda=1λ=1), restore coordination. Arrangements that give the retailer an effective stake λ>1\lambda>1λ>1 in each decision may supercoordinate: the decentralised chain can earn more than a centralised but boundedly rational one. The statement applies to any logit decision problem, not only to the newsvendor.

Formalizing it. The paper's proof is short but informal. Formalization makes three things explicit. First, the existence conditions for the logit laws: when SSS is unbounded, eλπ/βe^{\lambda\pi/\beta}eλπ/β need not be integrable. Second, the non-constancy hypothesis that strictness needs. Third, the correction of the printed strict inequalities in (56)–(57). Corollary 2 additionally needs the newsvendor-specific facts that the logit law exists without a finite-mean assumption and that π\piπ is never constant on SSS. To our knowledge none of these results has a machine-checked proof.

Difficulty

The natural first attempt is to differentiate λ↦Eλπ(X♭)\lambda\mapsto E_\lambda\pi(X^\flat)λ↦Eλ​π(X♭) and identify the derivative as Var⁡λ(π)/β\operatorname{Var}_\lambda(\pi)/\betaVarλ​(π)/β. On an unbounded domain this needs differentiation under the integral sign with uniform domination in λ\lambdaλ, and a finite variance at every intermediate λ\lambdaλ. Neither is among the hypotheses, which give integrability only at λ1\lambda_1λ1​ and λ2\lambda_2λ2​. The paper instead compares the two densities directly through a single crossing. Turning that into a strict inequality between expectations needs a measure-theoretic argument that a nonnegative integrand with zero integral vanishes almost everywhere, together with the non-constancy hypothesis. For Corollary 2 the main work is analytic: proving that p Emin⁡(D,x)−cxp\,E\min(D,x)-cxpEmin(D,x)−cx decays at least linearly without assuming ED<∞E D<\inftyED<∞, and that it is strictly decreasing near the right end of SSS.

Formalization scope

All quantities are real (ℝ). Integrals are Lebesgue/Bochner integrals, and "the density of Xi♭X^\flat_iXi♭​" is logitDensity S (fun x => λᵢ * π x) β. The following conventions are committed.

  • Standing readings. β>0\beta>0β>0, since eq. (2) divides by β\betaβ. In Corollary 2, 0<c<p0<c<p0<c<p, and "λi\lambda_iλi​ share" is read as λi>0\lambda_i>0λi​>0; λi>1\lambda_i>1λi​>1 is allowed. One β\betaβ is shared by both decision makers, as the page says.
  • Proposition 5's implicit hypotheses, each disclosed in the item. SSS and π\piπ are measurable. eλiπ/βe^{\lambda_i\pi/\beta}eλi​π/β and πeλiπ/β\pi e^{\lambda_i\pi/\beta}πeλi​π/β are integrable on SSS. π\piπ is not a.e. constant on SSS. The last one is necessary: for constant π\piπ both sides are equal.
  • Corrected slip. Eqs. (56)–(57) print a strict >>> for every kkk. This is false for kkk outside the essential range of π\piπ, where both probabilities are 000 or both are 111. The milestone states the weak dominance for all kkk, which is the proof's own conclusion. (57)'s {π≤k}\{\pi\le k\}{π≤k} should be {π<k}\{\pi<k\}{π<k}; this does not matter for the weak form.
  • Decision domain in Corollary 2: the convex hull of the pointwise support of fff. No finite mean of DDD is assumed.
  • No trivialising encoding. Lean evaluates the integral of a non-integrable function to 000, which would make every logit density and expectation 000. Proposition 5 therefore assumes the integrability it needs, and Corollary 2 must prove it. Non-constancy rules out the case where both sides are equal.

Not formalized: the §7 discussion of two-part tariffs, sales rebates and supercoordination, which the paper argues rather than states.

Needed infrastructure: positivity of integrals of positive functions, set integrals over sub-level sets, and the newsvendor profit's derivative π′=pFˉ−c\pi'=p\bar F-cπ′=pFˉ−c. The single-crossing lemma and the stochastic-dominance lemma apply to any one-parameter Gibbs family and are reusable beyond this mission. Proofs of the milestones, of the goal, and of Corollary 2 are all welcome.

Selected references

  • X. Su, Bounded Rationality in Newsvendor Models, Manufacturing & Service Operations Management 10(4):566–589, 2008. https://doi.org/10.1287/msom.1070.0200
  • G. P. Cachon, Supply Chain Coordination with Contracts, in Handbooks in OR & MS vol. 11, 2003. https://doi.org/10.1016/S0927-0507(03)11006-7
  • E. Katok, D. Y. Wu, Contracting in Supply Chains: A Laboratory Investigation, Management Science 55(12):1953–1968, 2009. https://doi.org/10.1287/mnsc.1090.1089
  • S. P. Anderson, A. de Palma, J.-F. Thisse, Discrete Choice Theory of Product Differentiation, MIT Press, 1992.
6 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Bounded Rationality in Newsvendor Models III: With x* at the Midpoint, a Decreasing Demand Density Gives E X♭ > x* and an Increasing One Gives E X♭ < x*Research Paper

Why order quantities can move away from likely demand

A seller choosing inventory before demand is known faces two kinds of uncertainty: uncertainty about demand and uncertainty about how consistently the decision maker selects a profitable quantity. The classical newsvendor model treats the seller as choosing a quantity that maximizes expected profit. In the bounded-rationality model of Su (2008), the chosen quantity is random, and quantities with higher expected profit receive greater probability. This makes it possible to ask whether a systematic change in the demand density creates a systematic change in the seller's average order, even when the classically optimal order is fixed.

The question matters for interpreting inventory decisions. An order above the classical optimum might reflect the shape of demand rather than a changed selling price, purchase cost, or demand forecast. Su's Proposition 4 isolates this effect by placing the classical optimum at the midpoint of the possible demand range. The resulting shift is called rare-event bias: the average behavioral order moves toward the end of the demand range where realizations are less likely. The target and its source are the published Manufacturing & Service Operations Management article, not a numerical approximation or a later restatement. Su (2008), §6, p. 577.

Demand, profit, and logit choice

Let demand DDD be nonnegative and have a density fff supported on [a,b][a,b][a,b], with 0≤a<b0\le a<b0≤a<b. Its distribution function is F(x)=∫−∞xf(t) dtF(x)=\int_{-\infty}^{x}f(t)\,dtF(x)=∫−∞x​f(t)dt, and its survival function is Fˉ(x)=1−F(x)\bar F(x)=1-F(x)Fˉ(x)=1−F(x). The midpoint and half-width of the demand range are m=(a+b)/2m=(a+b)/2m=(a+b)/2 and r=(b−a)/2r=(b-a)/2r=(b−a)/2. The seller pays ccc per unit ordered and sells each fulfilled unit at price ppp, where 0<c<p0<c<p0<c<p. For order quantity xxx, expected fulfilled demand is E[min⁡(D,x)]\mathbb E[\min(D,x)]E[min(D,x)], and expected profit is

π(x)=p E[min⁡(D,x)]−cx.\pi(x)=p\,\mathbb E[\min(D,x)]-cx.π(x)=pE[min(D,x)]−cx.

The optimal order x∗x^*x∗ maximizes π\piπ over real order quantities. The mission studies the case x∗=mx^*=mx∗=m. The paper gives the usual critical-fractile characterization Fˉ(x∗)=c/p\bar F(x^*)=c/pFˉ(x∗)=c/p; the first supporting target below makes its midpoint consequence explicit rather than assuming it as a substitute for optimality. Su (2008), §4, p. 572, and Appendix, p. 586.

Under logit choice, the seller selects a random behavioral order X♭X^\flatX♭ from the decision domain S=[a,b]S=[a,b]S=[a,b]. Its density is

ψ(x)=eπ(x)/β∫abeπ(v)/β dv,x∈[a,b],\psi(x)=\frac{e^{\pi(x)/\beta}}{\int_a^b e^{\pi(v)/\beta}\,dv},\qquad x\in[a,b],ψ(x)=∫ab​eπ(v)/βdveπ(x)/β​,x∈[a,b],

and ψ(x)=0\psi(x)=0ψ(x)=0 outside that interval. The parameter β>0\beta>0β>0 measures the amount of choice noise. The quantity compared with x∗x^*x∗ is the genuine mean E[X♭]=∫abxψ(x) dx\mathbb E[X^\flat]=\int_a^b x\psi(x)\,dxE[X♭]=∫ab​xψ(x)dx. The profit, decision domain, and sign in the exponential follow equations (2)–(4) of the paper. Su (2008), pp. 571–572.

Formalization targets

The supporting targets from the appendix identify the critical fractile at the midpoint, compare profits at reflected quantities, and express the behavioral mean through reflected choice densities:

c=pFˉ(m),π(m+y)−π(m−y)=p∫0y∫0v[f(m−z)−f(m+z)] dz dv,c=p\bar F(m),\qquad \pi(m+y)-\pi(m-y) =p\int_0^y\int_0^v [f(m-z)-f(m+z)]\,dz\,dv,c=pFˉ(m),π(m+y)−π(m−y)=p∫0y​∫0v​[f(m−z)−f(m+z)]dzdv,

for 0<y≤r0<y\le r0<y≤r, followed by

E[X♭]=m+∫0rv[ψ(m+v)−ψ(m−v)] dv.\mathbb E[X^\flat] =m+\int_0^r v[\psi(m+v)-\psi(m-v)]\,dv.E[X♭]=m+∫0r​v[ψ(m+v)−ψ(m−v)]dv.

These are the source's appendix displays (43)–(53). The profit comparison is strictly positive when fff is strictly decreasing. The goal, Proposition 4, contains both directions:

f strictly decreasing on [a,b]⟹E[X♭]>x∗=m,f strictly increasing on [a,b]⟹E[X♭]<x∗=m.\begin{aligned} f\text{ strictly decreasing on }[a,b]&\Longrightarrow \mathbb E[X^\flat]>x^*=m,\\ f\text{ strictly increasing on }[a,b]&\Longrightarrow \mathbb E[X^\flat]<x^*=m. \end{aligned}f strictly decreasing on [a,b]f strictly increasing on [a,b]​⟹E[X♭]>x∗=m,⟹E[X♭]<x∗=m.​

The proposition states a directional bias, rather than a formula for its size. The increasing-density direction is part of the printed proposition even though the appendix explicitly works through only the decreasing-density case. Su (2008), Proposition 4, p. 577; proof, pp. 586–587.

What the result establishes

Holding the optimal order at mmm removes a shift in the rational optimum from the comparison. A decreasing density then gives more demand mass toward aaa, yet the average behavioral order lies above mmm; an increasing density reverses the conclusion. Thus the mean of the choice distribution cannot generally be inferred from the modal or classically optimal order alone. This is a qualitative property of the continuous logit newsvendor, not a claim about every possible bounded-rationality model. Su (2008), §6, p. 577.

The result is proved in the published paper. The formalization work here is to supply machine-checked proofs of the stated Lean targets, together with reusable definitions of density-based expected sales, newsvendor profit, and a continuous logit choice law. These declarations are proposed open targets; a successful local build checks that their statements are well formed, but it does not constitute proofs. The reflection identity for a general continuous utility can also serve other one-dimensional logit-choice comparisons on symmetric bounded domains.

Where the mathematical work lies

The classical first-order condition determines x∗x^*x∗, but it does not determine the mean of the logit distribution. Even when the optimal order is exactly mmm, the profit function may have different values at m+ym+ym+y and m−ym-ym−y, and the exponential normalization changes how those values affect the mean. A direct appeal to the monotonicity of fff alone therefore does not establish the conclusion. The appendix records the reflected profit and mean identities that a complete proof must justify for the density-based model. In Lean, these claims also require careful treatment of integration and the distribution function at interval boundaries. Su (2008), Appendix, pp. 586–587.

Formalization scope and conventions

The Lean development represents fff as a real-valued integrable density, nonnegative everywhere, zero on negative demand, and of total integral one. For this mission it is also zero outside [a,b][a,b][a,b]. The decision domain is exactly [a,b][a,b][a,b]; under either strict monotonicity assumption its closure agrees with the smallest interval containing the demand support. The logit density uses e+π/βe^{+\pi/\beta}e+π/β, and its expectation is an ordinary real integral. Because profit is continuous and [a,b][a,b][a,b] is compact with a<ba<ba<b, the normalizer is finite and positive. A zero-valued Lean integral on non-integrable input must not make any target true accidentally.

The standing readings are β>0\beta>0β>0 and 0<c<p0<c<p0<c<p. The source says “decreasing” and “increasing” while its displayed proof uses a strict density inequality; the goal therefore requires strict monotonicity. A constant density can have x∗=mx^*=mx∗=m and E[X♭]=m\mathbb E[X^\flat]=mE[X♭]=m, showing why a strict conclusion cannot follow from weak monotonicity alone. At y=0y=0y=0, the two reflected densities are equal, so the proof's phrase “for every y∈[0,r]y\in[0,r]y∈[0,r]” for a strict comparison is read as 0<y≤r0<y\le r0<y≤r. The paper's prose also swaps the inequality labels for overordering and underordering; the formal inequalities follow the conclusion of its proof. These corrections are disclosed in the item descriptions and audit notes. Su (2008), §6, p. 577; Appendix, p. 587.

The midpoint is required to be a maximizer of the defined profit function over all real orders. It is not supplied as an unrelated parameter or characterized by the critical-fractile equality by fiat. The central reusable components are the density, its cumulative distribution function, expected fulfilled demand, and the logit density and expectation. Contributions that establish their continuity, integrability, and reflection properties directly advance the goal.

Selected references

  • Xuanming Su, Bounded Rationality in Newsvendor Models, Manufacturing & Service Operations Management 10(4):566–589, 2008. DOI: 10.1287/msom.1070.0200.
7 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

On the Structure of Lost-Sales Inventory Models 2: The Optimal Lost-Sales Order Obeys the Karlin–Scarf–Morton Bounds z̄_t(v) ∈ Z(s̄) for All t ≤ TResearch Paper

Why bounds on the lost-sales order matter

In the periodic-review inventory system with lost sales and a positive lead time LLL, demand that cannot be met from stock is lost rather than backlogged. Unlike the backorder model, whose optimal policy is a base-stock policy depending only on the inventory position, the lost-sales model needs the whole pipeline of outstanding orders as its state, and its optimal policy has no closed form. Exact dynamic programming is impractical beyond small lead times, so practitioners and researchers rely on structural information: monotonicity of the optimal order, and simple bounds that bracket it.

The classical bounds go back to Karlin and Scarf (1958), who studied the case L=1L = 1L=1, and Morton (1969), who obtained bounds for general LLL in terms of fractiles of cumulative demand. Zipkin (2008, DOI 10.1287/opre.1070.0482) recovered these bounds inside a unified framework built on a transformed state variable, the partial sums of the pipeline. This mission formalizes that recovery: §4 of the paper, from the closed form of the arriving inventory to Corollary 9.

Timeline. Karlin and Scarf (1958) treat the one-period lead time; Morton (1969) proves the fractile bounds for any LLL and uses the partial-sum state; Nahmias (1979) gives the closed form (7) for the inventory on hand when an order arrives; Zipkin (2008) derives the bounds again by an induction on the re-accounted recursion, together with L♮L^\naturalL♮-convexity results for the original recursion.

The model

Periods are t=1,…,Tt = 1, \dots, Tt=1,…,T. In each period the order due arrives, a new order z≥0z \ge 0z≥0 is placed, and demand ddd occurs. Demands are independent, identically distributed and nonnegative, with law μ\muμ. The costs are a unit procurement cost ccc, a unit holding cost h^\hat hh^, a unit lost-sales penalty ppp, and a discount factor γ\gammaγ; write h=h^−γch = \hat h - \gamma ch=h^−γc.

The state is the vector v=(v0,…,vL−1)v = (v_0, \dots, v_{L-1})v=(v0​,…,vL−1​) with vl=∑k≥lxkv_l = \sum_{k \ge l} x_kvl​=∑k≥l​xk​, where x0x_0x0​ is the inventory on hand and x1,…,xL−1x_1, \dots, x_{L-1}x1​,…,xL−1​ are the outstanding orders, oldest first. The state space is the cone

V={v∈RL:v0≥v1≥⋯≥vL−1≥0}.V = \{ v \in \mathbb R^L : v_0 \ge v_1 \ge \dots \ge v_{L-1} \ge 0 \}.V={v∈RL:v0​≥v1​≥⋯≥vL−1​≥0}.

After demand ddd and order zzz the state becomes

v+=([v0−v1−d]++v1, v2, …, vL−1, 0)+ze,v_+ = \big([v_0 - v_1 - d]^+ + v_1,\ v_2,\ \dots,\ v_{L-1},\ 0\big) + z e,v+​=([v0​−v1​−d]++v1​, v2​, …, vL−1​, 0)+ze,

with eee the vector of ones. Let y+Ly_{+L}y+L​ be the inventory on hand when the current order arrives, LLL periods later.

The §4 accounting charges to period ttt the expected cost of period t+Lt + Lt+L, when the order of period ttt is on hand:

q0(y)=cy+hE[[y−d]+]+pE[[y−d]−],q(v,z)=γLE[q0(y+L)].q^0(y) = c y + h E\big[[y - d]^+\big] + p E\big[[y - d]^-\big], \qquad q(v, z) = \gamma^L E\big[q^0(y_{+L})\big].q0(y)=cy+hE[[y−d]+]+pE[[y−d]−],q(v,z)=γLE[q0(y+L​)].

The optimal costs satisfy

gt(v,z)=q(v,z)+γE[ft+1(v+)],ft(v)=min⁡z≥0gt(v,z),fT+1=0,g_t(v, z) = q(v, z) + \gamma E\big[f_{t+1}(v_+)\big], \qquad f_t(v) = \min_{z \ge 0} g_t(v, z), \qquad f_{T+1} = 0,gt​(v,z)=q(v,z)+γE[ft+1​(v+​)],ft​(v)=z≥0min​gt​(v,z),fT+1​=0,

and the optimal policy zˉt(v)\bar z_t(v)zˉt​(v) is the smallest minimizer of gt(v,⋅)g_t(v, \cdot)gt​(v,⋅).

Assume 0<c+h<p+h0 < c + h < p + h0<c+h<p+h and set θˉ=(c+h)/(p+h)\bar\theta = (c + h)/(p + h)θˉ=(c+h)/(p+h). Let d[l,L]d_{[l,L]}d[l,L]​ be the total demand of periods t+l,…,t+Lt + l, \dots, t + Lt+l,…,t+L. The fractiles are

sˉl=min⁡{s:Pr⁡{d[l,L]>s}≤θˉ},l=0,…,L.\bar s_l = \min\{ s : \Pr\{ d_{[l,L]} > s \} \le \bar\theta \}, \qquad l = 0, \dots, L.sˉl​=min{s:Pr{d[l,L]​>s}≤θˉ},l=0,…,L.

Let V(sˉ)={v∈V:vl≤sˉl, l<L}V(\bar s) = \{ v \in V : v_l \le \bar s_l,\ l < L \}V(sˉ)={v∈V:vl​≤sˉl​, l<L}. The set Z(sˉ)Z(\bar s)Z(sˉ) consists of the policies with z(v)=0z(v) = 0z(v)=0 for v∉V(sˉ)v \notin V(\bar s)v∈/V(sˉ), and, for v∈V(sˉ)v \in V(\bar s)v∈V(sˉ), z(v)≤sˉLz(v) \le \bar s_Lz(v)≤sˉL​ and vl+z(v)≤sˉlv_l + z(v) \le \bar s_lvl​+z(v)≤sˉl​ for every l<Ll < Ll<L.

Formalization targets

Goal: Corollary 9 (Karlin–Scarf, Morton)

For every period t≤Tt \le Tt≤T and every v∈Vv \in Vv∈V, the smallest optimal order exists and

zˉt(v)∈Z(sˉ).\bar z_t(v) \in Z(\bar s).zˉt​(v)∈Z(sˉ).

Milestones

  1. (7), the closed form of Nahmias: y+L=z+[max⁡0≤l<L{vl−d[l,L)}]+y_{+L} = z + \big[\max_{0 \le l < L} \{ v_l - d_{[l,L)} \}\big]^+y+L​=z+[max0≤l<L​{vl​−d[l,L)​}]+, where d[l,L)d_{[l,L)}d[l,L)​ is the demand of periods t+l,…,t+L−1t + l, \dots, t + L - 1t+l,…,t+L−1.
  2. Lemma 6: the last-period policy zˉT(v)\bar z_T(v)zˉT​(v) is in Z(sˉ)Z(\bar s)Z(sˉ).
  3. Lemma 7: the last-period optimal cost fT(v)f_T(v)fT​(v) is nondecreasing in vvv.
  4. Proof of Theorem 8: gt(v,z)g_t(v, z)gt​(v,z) is convex in zzz.
  5. Theorem 8: for all t≤Tt \le Tt≤T, ft(v)f_t(v)ft​(v) is nondecreasing in vvv, and zˉt(v)≤zˉT(v)\bar z_t(v) \le \bar z_T(v)zˉt​(v)≤zˉT​(v).

The goal asserts the bounds as stated by the paper, with the fractiles left as functions of the demand law. It fixes no numerical constants.

Significance

The bounds turn a high-dimensional control problem into a box around the decision. The order is limited by the fractile sˉL\bar s_LsˉL​ of one-period demand, and also by every partial inventory position vlv_lvl​ against the fractile of (L−l+1)(L-l+1)(L−l+1)-period demand. They justify base-stock-like heuristics for lost-sales systems, restrict the search space in numerical dynamic programming, and are the starting point of the weighted bounds in Corollary 10 of the same paper. Monotonicity of the optimal cost in the pipeline (Theorem 8) is a structural fact used throughout the lost-sales literature.

The results are proved in the literature. To our knowledge none of them is machine-checked. A complete development adds a checked derivation of the classical bounds from first principles. It also adds reusable components: the closed form (7) for lost-sales dynamics, the fractile function for sums of i.i.d. demands, and a finite-horizon dynamic program over a continuum of actions in which the existence of a least minimizer is established rather than assumed.

Difficulty

The bound at the last period (Lemma 6) is a newsvendor-type argument once y+Ly_{+L}y+L​ is written in closed form. Propagating it backwards is harder. The tempting argument is that E[ft+1(v+)]E[f_{t+1}(v_+)]E[ft+1​(v+​)] only adds a cost that grows with zzz, so the optimal order can only shrink. That requires ft+1f_{t+1}ft+1​ to be nondecreasing in the state, which is not a property of the one-period cost alone. Monotonicity of ftf_tft​ in turn needs the minimization over zzz to preserve it, and the paper's argument for that uses convexity of gtg_tgt​ in zzz, which the paper derives from L♮L^\naturalL♮-convexity of the original recursion. Even Lemma 7, the last-period case, is proved on the page only for L=1L = 1L=1, through a convex-order comparison of the arriving inventory; the general case is asserted to be similar. The existence of a minimizer at every stage also has to be established, since the action set is unbounded and the value functions are defined as infima.

Formalization scope

The Lean development lives in the namespace ZipkinLostSales.Bounds. The conventions are these.

  • Periods. Periods are indexed by the number of periods to go k=T+1−tk = T + 1 - tk=T+1−t. fB M 0 is fT+1=0f_{T+1} = 0fT+1​=0, gB M k is gT−kg_{T-k}gT−k​, and fB M (k+1) is fT−kf_{T-k}fT−k​. By stationarity, "for all t≤Tt \le Tt≤T" becomes "for all k≥0k \ge 0k≥0", and t=Tt = Tt=T is k=0k = 0k=0, where gT=qg_T = qgT​=q.
  • Indexing. States are Fin L → ℝ, indexed from 0, with the paper's convention vL=0v_L = 0vL​=0. The fractiles sˉ0,…,sˉL\bar s_0, \dots, \bar s_Lsˉ0​,…,sˉL​ are indexed by Fin (L+1). "Nondecreasing in vvv" is monotonicity on VVV for the componentwise order.
  • The minimum over zzz. The paper's min⁡z≥0\min_{z \ge 0}minz≥0​ is an infimum over z≥0z \ge 0z≥0. Under the assumptions every q(v,z)q(v, z)q(v,z) with z≥0z \ge 0z≥0 is nonnegative, so the infimum is not a junk value.
  • The optimal policy. "The policy zˉt(v)\bar z_t(v)zˉt​(v)" is the least minimizer (IsLeast), following the tie-breaking rule on p. 938. Its existence is part of the goal, Lemma 6, and Theorem 8. The least minimizer is not defined as the sInf of the set of minimizers: that sInf is 000 when the set is empty, and 000 always lies in Z(sˉ)Z(\bar s)Z(sˉ), so that encoding would make the goal trivially true.
  • The fractiles. The minimum in (6) is an sInf. Under the assumptions the set is nonempty and bounded below, and the infimum is attained. d[l,L]d_{[l,L]}d[l,L]​ is the sum of coordinates j≥lj \ge lj≥l of L+1L + 1L+1 independent demands.
  • The arriving inventory. y+Ly_{+L}y+L​ is defined by iterating the on-hand dynamics yt+j+1=[yt+j−dt+j]++xj+1y_{t+j+1} = [y_{t+j} - d_{t+j}]^+ + x_{j+1}yt+j+1​=[yt+j​−dt+j​]++xj+1​. (7) is a theorem, not the definition.
  • Assumptions. These are bundled in Assumptions. The paper states L≥1L \ge 1L≥1, nonnegative independent demand, and 0<c+h<p+h0 < c + h < p + h0<c+h<p+h. Three readings are added: demand has finite mean, which makes q0q^0q0 finite; "unit cost" and "discount rate" are read as c,h^,p≥0c, \hat h, p \ge 0c,h^,p≥0 and 0<γ≤10 < \gamma \le 10<γ≤1; and "the dtd_tdt​ are independent" with stationary data is read as i.i.d. with one law. hhh may be negative.
  • §4 versus §2. Everything is stated for §4's re-accounted recursion. The paper identifies its optimal policy with that of §2 by "some algebra" that it does not display, and that identification is not formalized. The convexity milestone is posed directly for §4's gtg_tgt​ for the same reason.

A sorry-free check shows that the assumptions are jointly satisfiable, with L=1L = 1L=1, demand ≡1\equiv 1≡1, c=h^=1c = \hat h = 1c=h^=1, p=3p = 3p=3 and γ=1/2\gamma = 1/2γ=1/2. There sˉ=(2,1)\bar s = (2, 1)sˉ=(2,1), and the least optimal last-period order at v=0v = 0v=0 is 1∈Z(sˉ)1 \in Z(\bar s)1∈Z(sˉ).

A complete development needs:

  • product measures of i.i.d. demands and integrals against them;
  • convexity and monotonicity of expectations of piecewise-linear functions;
  • the right-continuity of the tail, so that the fractile is attained;
  • an existence argument for least minimizers of convex coercive functions on [0,∞)[0, \infty)[0,∞).

The closed form (7) and the fractile lemmas are reusable for other lost-sales and newsvendor missions. Proofs of the milestones in any order are welcome, as are auxiliary lemmas on measurability and integrability of the value functions.

Selected references

  • P. Zipkin, On the Structure of Lost-Sales Inventory Models, Operations Research 56(4), 937–944, 2008. https://doi.org/10.1287/opre.1070.0482
  • S. Karlin, H. Scarf, Inventory models of the Arrow–Harris–Marschak type with time lag, in Arrow, Karlin, Scarf (eds.), Studies in the Mathematical Theory of Inventory and Production, Chapter 10, Stanford University Press, 1958.
  • T. E. Morton, Bounds on the solution of the lagged optimal inventory equation with no demand backlogging and proportional costs, SIAM Review 11, 572–576, 1969.
  • S. Nahmias, Simple approximations for a variety of dynamic leadtime lost-sales inventory models, Operations Research 27, 904–924, 1979.
8 thms2 active usersReviewed
Dynamic ProgrammingOperations Research·Captain: mikedeng1

Old and New Methods for Lost-Sales Inventory Systems 2: The Optimal Discounted Cost Is Nondecreasing in the Lead Time, and System L − 1 Bounds System L Through (6)Research Paper

Motivation

In a periodic-review inventory system, an order placed today arrives only after a lead time of LLL periods. When unmet demand is lost rather than backlogged, the optimal ordering problem is a dynamic program whose state records the stock on hand and every order still in the pipeline. The problem goes back to Karlin and Scarf (1958) and Morton (1969, 1971). It is computationally difficult because the state dimension grows with the lead time, and few structural facts about how the optimal cost depends on the system's parameters are known.

Zipkin (2008), Old and New Methods for Lost-Sales Inventory Systems, states one such fact in its abstract: the optimal cost is increasing in the lead time. Section 5 of the paper makes this precise for the discounted cost by comparing the system with lead time LLL to the one with lead time L−1L-1L−1, and derives from the comparison a lower bound, (6), on the cost of the longer system in terms of the solution of the shorter one. The paper uses that bound to start the computation of system LLL from the solution of system L−1L-1L−1, and reports it in the "Bound" rows of its numerical tables. The paper also remarks that the argument applies to any system with control lag.

Setting

The state of the system with lead time L≥1L \ge 1L≥1 is x=(x0,…,xL−1)x = (x_0, \dots, x_{L-1})x=(x0​,…,xL−1​): x0x_0x0​ is the stock on hand after this period's arrival, and xlx_lxl​ is the order that arrives lll periods from now. With an order z≥0z \ge 0z≥0 and a demand ddd, the next state is

x+=([x0−d]++x1, x2, …, xL−1, z),x_+ = \bigl([x_0 - d]^+ + x_1,\ x_2,\ \dots,\ x_{L-1},\ z\bigr),x+​=([x0​−d]++x1​, x2​, …, xL−1​, z),

and demand in excess of x0x_0x0​ is lost. Demands are independent with a common law DDD on [0,∞)[0,\infty)[0,∞) with finite mean.

The costs are a unit procurement cost c≥0c \ge 0c≥0, a unit holding cost h^≥0\hat h \ge 0h^≥0, a unit lost-sales penalty p≥0p \ge 0p≥0 and a discount factor γ∈[0,1)\gamma \in [0,1)γ∈[0,1). After the paper's standard transformation, the holding cost becomes h=h^−γch = \hat h - \gamma ch=h^−γc and the cost charged to the current order is

q0(y)=cy+hE[[y−d]+]+pE[[y−d]−],ql(xl)=γlE[q0(y+l)],q^0(y) = cy + hE\bigl[[y-d]^+\bigr] + pE\bigl[[y-d]^-\bigr], \qquad q^l(x^l) = \gamma^l E\bigl[q^0(y_{+l})\bigr],q0(y)=cy+hE[[y−d]+]+pE[[y−d]−],ql(xl)=γlE[q0(y+l​)],

where xl=(x0,…,xl)x^l = (x_0,\dots,x_l)xl=(x0​,…,xl​) and y+ly_{+l}y+l​ is the stock on hand lll periods later. The one-period cost of system LLL is q(x,z)=qL(x,z)q(x,z) = q^L(x,z)q(x,z)=qL(x,z). Writing x+l−1=([x0−d]++x1,x2,…,xl)x_+^{l-1} = ([x_0-d]^+ + x_1, x_2, \dots, x_l)x+l−1​=([x0​−d]++x1​,x2​,…,xl​) for the first lll components of the next state, the costs satisfy the recursion ql(xl)=γE[ql−1(x+l−1)]q^l(x^l) = \gamma E[q^{l-1}(x_+^{l-1})]ql(xl)=γE[ql−1(x+l−1​)].

The optimal cost f∗Lf^{*L}f∗L is the limit of the finite-horizon costs of recursion (2),

ft(x)=min⁡z≥0{q(x,z)+γE[ft+1(x+)]},fT+1=0,f_t(x) = \min_{z\ge0}\bigl\{q(x,z) + \gamma E[f_{t+1}(x_+)]\bigr\}, \qquad f_{T+1} = 0,ft​(x)=z≥0min​{q(x,z)+γE[ft+1​(x+​)]},fT+1​=0,

as the horizon TTT grows. It satisfies the optimality equation (3), f(x)=min⁡z≥0{q(x,z)+γE[f(x+)]}f(x) = \min_{z\ge 0}\{q(x,z)+\gamma E[f(x_+)]\}f(x)=minz≥0​{q(x,z)+γE[f(x+​)]}.

Formalization targets

Goal: lead-time comparison and the bound (6)

For L≥2L \ge 2L≥2, every state xL−1≥0x^{L-1} \ge 0xL−1≥0 of system LLL, and xL−2x^{L-2}xL−2 the state of system L−1L-1L−1 obtained by dropping the most recent order,

f∗L−1(xL−2)≤qL−1(xL−1)+f∗L(xL−1)f^{*L-1}(x^{L-2}) \le q^{L-1}(x^{L-1}) + f^{*L}(x^{L-1})f∗L−1(xL−2)≤qL−1(xL−1)+f∗L(xL−1)

and

f∗L(xL−1)≥γE[f∗L−1(x+L−2)].(6)f^{*L}(x^{L-1}) \ge \gamma E\bigl[f^{*L-1}(x_+^{L-2})\bigr]. \tag{6}f∗L(xL−1)≥γE[f∗L−1(x+L−2​)].(6)

The first inequality is the formal content of "the system cost is nondecreasing in LLL" in the discounted case: the systems live on state spaces of different dimension, and system L−1L-1L−1 pays one extra period cost qL−1(xL−1)q^{L-1}(x^{L-1})qL−1(xL−1) before system LLL starts to accumulate costs. The second is the bound the paper uses numerically.

Milestones

  1. The recursion ql(xl)=γE[ql−1(x+l−1)]q^l(x^l) = \gamma E[q^{l-1}(x_+^{l-1})]ql(xl)=γE[ql−1(x+l−1​)] (§2, p. 1257).
  2. The optimal cost satisfies the optimality equation (3) (p. 1257), the minimum over z≥0z \ge 0z≥0 is attained when c>0c > 0c>0 or h^>0\hat h > 0h^>0, and f∗Lf^{*L}f∗L is the least nonnegative solution.

A further statement, not a milestone, records that f∗L(x)<∞f^{*L}(x) < \inftyf∗L(x)<∞ for x≥0x \ge 0x≥0, the discounted analogue of the paper's remark (p. 1256) that the optimal lost-sales cost is bounded when mean demand is finite.

Significance

The result. Monotonicity in the lead time is a basic comparative-statics fact about lost-sales systems that is not obvious from the dynamic program, because the two systems have state spaces of different dimension. Inequality (6) turns it into a computational tool: the solution of system L−1L-1L−1 yields a lower bound for system LLL, which can be used to warm-start value iteration for the larger system and to certify the quality of heuristics.

The formalization. The results are proved in the paper, informally and in a few lines; none of them has a machine-checked proof. A formal development requires making the paper's coupling argument (system L−1L-1L−1 placing, one period ahead, the order system LLL places now) precise as an inequality between value functions on spaces of different dimension. The optimality equation for a dynamic program with a continuous state space and an unbounded action set z≥0z \ge 0z≥0 is a reusable result for other inventory models with the same structure.

Difficulty

The paper's argument constructs a non-Markovian policy for system L−1L-1L−1 from an optimal policy of system LLL. Turned into a statement about value functions, the policy-based argument needs a theory of history-dependent policies and their costs that the definitions here deliberately avoid: the optimal cost is defined through the operator of (2), not as an infimum over policies. Either that theory is built, or the comparison has to be expressed directly between value functions on two state spaces of different dimension, where the extra order of system LLL has no counterpart in system L−1L-1L−1.

The optimality equation (3) is not automatic either. Showing that the limit of value iteration is a fixed point requires interchanging an infimum over the noncompact set z≥0z \ge 0z≥0 with an increasing limit; for a general monotone operator with a noncompact action set the interchange fails, so the lost-sales structure has to be used.

Formalization scope

The Lean development lives in the namespace LostSalesOldNew.LeadTime. Its conventions:

  • States of system LLL are Fin L → ℝ; xL=(x,z)x^L = (x,z)xL=(x,z) is Fin.snoc x z; xL−2x^{L-2}xL−2 is Fin.init x (dropping the most recent order, not the oldest); shift x d is x+l−1x_+^{l-1}x+l−1​ and next x z d is the full transition. The goal is stated with lead times n=L−1≥1n = L-1 \ge 1n=L−1≥1 and n+1n+1n+1, so no natural-number subtraction occurs.
  • Demand is a probability measure D on ℝ with D (Iio 0) = 0 and finite mean (Integrable id D); the demands of several periods have the product law Measure.pi. The paper's i.i.d. assumption is encoded this way.
  • The sign conditions c,h^,p≥0c, \hat h, p \ge 0c,h^,p≥0 and 0≤γ<10 \le \gamma < 10≤γ<1 are fields of the cost structure. The paper leaves the signs implicit; γ<1\gamma < 1γ<1 is its condition for (3).
  • The optimal cost f∗Lf^{*L}f∗L is defined as sup⁡nTn0\sup_n T^n 0supn​Tn0, the limit of the finite-horizon costs of (2). The paper calls f∗f^*f∗ "the solution" of (3) and asserts uniqueness without naming a function class; uniqueness in such a class is not formalized, and the milestone states instead that f∗Lf^{*L}f∗L is the least nonnegative solution. That f∗Lf^{*L}f∗L solves (3) is a milestone, not a definition.
  • Optimal costs take values in [0,∞][0,\infty][0,∞], with expectations of value functions as lower Lebesgue integrals and qqq embedded by ENNReal.ofReal; this is exact on nonnegative states because q≥0q \ge 0q≥0 there under the sign conditions. The paper's min⁡\minmin is an infimum over z≥0z \ge 0z≥0 in the operator, and its attainment is a separate clause of the milestone, stated under c>0c > 0c>0 or h^>0\hat h > 0h^>0 (with c=h^=0c = \hat h = 0c=h^=0 and unbounded demand the minimum is not attained); negative orders are excluded. The first goal inequality is kept in additive form, since subtraction in [0,∞][0,\infty][0,∞] truncates.
  • States satisfy x≥0x \ge 0x≥0 in every theorem.

A trivializing reading is ruled out: the goal is not stated as (6) alone, which would drop the monotonicity claim, and the separate finiteness statement shows that the inequalities compare finite numbers rather than holding because one side is ∞\infty∞.

The average-cost version of §5 is not formalized (it presupposes an average-cost optimal policy), nor is uniqueness in (3) beyond minimality. Related platform formulations of the lost-sales system, such as CappedBaseStock_Model (Xin's capped base-stock analysis), use another state convention, an empty initial pipeline and the average-cost criterion, so they are not referenced. Contributions welcome: the recursion for qlq^lql (a Fubini computation over product measures), the optimality equation, the finiteness bound, and the goal.

Selected references

  • P. Zipkin, Old and New Methods for Lost-Sales Inventory Systems, Operations Research 56(5):1256–1263, 2008. https://doi.org/10.1287/opre.1070.0471
  • S. Karlin, H. Scarf, Inventory models of the Arrow–Harris–Marschak type with time lag, in Studies in the Mathematical Theory of Inventory and Production, Stanford University Press, 1958.
  • T. E. Morton, Bounds on the solution of the lagged optimal inventory equation with no demand backlogging and proportional costs, SIAM Review 11(4):572–596, 1969. https://doi.org/10.1137/1011090
  • T. E. Morton, The near-myopic nature of the lagged-proportional-cost inventory problem with lost sales, Operations Research 19(7):1708–1716, 1971. https://doi.org/10.1287/opre.19.7.1708
  • G. Janakiraman, R. O. Roundy, Lost-sales problems with stochastic lead times: convexity results for base-stock policies, Operations Research 52(5):795–803, 2004. https://doi.org/10.1287/opre.1040.0130
5 thms2 active usersReviewed
AnalysisOperations ResearchStochastic Systems+1·Captain: mikedeng1

Some Useful Functions for Functional Limit Theorems 3: The First-Passage-Time Map Is M₁-Continuous and J₁-Continuous at Strictly Increasing PathsResearch Paper

Why first passage times need a continuity theorem

Functional limit theorems in queueing and applied probability are rarely proved from scratch. A limit theorem is established once for a primitive process, such as a random walk, a cumulative input or a renewal-reward process, and then transferred to the quantities of interest through the continuous mapping theorem: if Xn⇒XX_n \Rightarrow XXn​⇒X in a function space and fff is continuous at almost every path of XXX, then f(Xn)⇒f(X)f(X_n) \Rightarrow f(X)f(Xn​)⇒f(X). The method works only if the functions in use are known to be continuous, and in which topology.

Ward Whitt's 1980 paper supplies these facts for composition, addition, the supremum, the reflecting barrier, the inverse or first passage time, and time reversal. This mission covers §7, the first passage time. Its role in applications is direct: the counting process of a renewal process is the first passage time of the partial-sum process. A limit theorem for cumulative work can therefore yield one for the number of completed jobs, and a limit theorem for a cumulative input can yield one for the time it takes to reach a level, when the mapping theorem's hypotheses hold.

Timeline. Skorohod (1956) introduced the topologies J1J_1J1​ and M1M_1M1​ on the space DDD of right-continuous paths with left limits. Vervaat (1972) studied functional central limit theorems for processes with positive drift and their inverses, and Whitt (1971) studied weak convergence of first passage time processes. Whitt's 1980 paper restates M1M_1M1​ continuity (Theorem 7.1) and adds the J1J_1J1​ result: the map is continuous at every strictly increasing path (Theorem 7.2), although it is not J1J_1J1​-continuous on its whole domain.

Setting

A path is a function x:[0,∞)→Rx : [0,\infty) \to \mathbb Rx:[0,∞)→R. It belongs to D=D([0,∞),R)D = D([0,\infty),\mathbb R)D=D([0,∞),R) when it is right-continuous and has a left limit at every t>0t > 0t>0.

  • J1J_1J1​ convergence. On a compact interval [0,b][0,b][0,b], xn→xx_n \to xxn​→x in J1J_1J1​ when there are increasing homeomorphisms λn\lambda_nλn​ of [0,b][0,b][0,b] with sup⁡t∣λn(t)−t∣→0\sup_t |\lambda_n(t) - t| \to 0supt​∣λn​(t)−t∣→0 and sup⁡t∣xn(t)−x(λn(t))∣→0\sup_t |x_n(t) - x(\lambda_n(t))| \to 0supt​∣xn​(t)−x(λn​(t))∣→0. On [0,∞)[0,\infty)[0,∞) this is required on [0,b][0,b][0,b] for every bbb at which xxx is continuous.
  • UUU convergence. Uniform convergence on compact subintervals.
  • M1M_1M1​ convergence. The completed graph of xxx on [0,b][0,b][0,b] adds to the graph the vertical segment joining x(t−)x(t-)x(t−) and x(t)x(t)x(t) at each jump. xn→xx_n \to xxn​→x in M1M_1M1​ when the completed graphs admit parametric representations (continuous, order-preserving maps from [0,1][0,1][0,1] onto the completed graph) that are uniformly close in both time and space.
  • The supremum. x↑(t)=sup⁡0≤s≤tx(s)x^{\uparrow}(t) = \sup_{0 \le s \le t} x(s)x↑(t)=sup0≤s≤t​x(s).
  • The domain EEE. The set of x∈Dx \in Dx∈D that are unbounded above and have x(0)≥0x(0) \ge 0x(0)≥0.
  • First passage time. For x∈Ex \in Ex∈E,
x−1(t)=inf⁡{s≥0:x(s)>t},t≥0.x^{-1}(t) = \inf\{s \ge 0 : x(s) > t\}, \qquad t \ge 0.x−1(t)=inf{s≥0:x(s)>t},t≥0.
  • D0D_0D0​. The nondecreasing paths in DDD, and CCC the continuous ones.

Formalization targets

Goal: Theorem 7.2, continuity clause

If xn,x∈Ex_n, x \in Exn​,x∈E, xxx is strictly increasing, and xn→xx_n \to xxn​→x in J1J_1J1​, then

xn−1→x−1(J1).x_n^{-1} \to x^{-1} \quad (J_1).xn−1​→x−1(J1​).

The theorem says that every strictly increasing path is a continuity point of the first passage time map for J1J_1J1​. It fixes no constants, so a sharper variant of a milestone does not invalidate it.

Milestones

  1. J1J_1J1​ convergence implies M1M_1M1​ convergence (§6, p. 80).
  2. The supremum map is M1M_1M1​-continuous on paths with x(0)≥0x(0) \ge 0x(0)≥0 (§6, p. 80, as used in the proof of Theorem 7.1).
  3. x∈Ex \in Ex∈E implies x−1∈E∩D0([0,∞),[0,∞))x^{-1} \in E \cap D_0([0,\infty),[0,\infty))x−1∈E∩D0​([0,∞),[0,∞)) (§7, p. 82).
  4. x↑∈Ex^{\uparrow} \in Ex↑∈E and (x↑)−1=x−1(x^{\uparrow})^{-1} = x^{-1}(x↑)−1=x−1 (proof of Theorem 7.1).
  5. Theorem 7.1. If xn,x∈Ex_n, x \in Exn​,x∈E and xn→xx_n \to xxn​→x in M1M_1M1​, then xn−1→x−1x_n^{-1} \to x^{-1}xn−1​→x−1 in M1M_1M1​.
  6. For strictly increasing x∈Ex \in Ex∈E, x−1x^{-1}x−1 is continuous with x−1(0)=0x^{-1}(0) = 0x−1(0)=0.
  7. M1M_1M1​ convergence to a continuous limit starting at 000 is UUU convergence.
  8. UUU convergence implies J1J_1J1​ convergence.
  9. Theorem 7.4. If cn→∞c_n \to \inftycn​→∞, xn∈Ex_n \in Exn​∈E, cn(xn↑−e)→xc_n(x_n^{\uparrow} - e) \to xcn​(xn↑​−e)→x and cn(xn−1−e)→−xc_n(x_n^{-1} - e) \to -xcn​(xn−1​−e)→−x in J1J_1J1​, then x∈Cx \in Cx∈C.

Significance

The result. Theorem 7.2 lets J1J_1J1​ functional limit theorems pass to first passage times when the limit has strictly increasing paths. The typical case is the fluid limit x(t)=μtx(t) = \mu tx(t)=μt of a cumulative process, with μ>0\mu>0μ>0. Together with the composition results of §3, it supports Theorem 7.3's centered inverse limit: if cn→∞c_n \to \inftycn​→∞, xn∈Ex_n \in Exn​∈E, x(0)=0x(0)=0x(0)=0, xxx has no positive jumps, and cn(xn−e)→xc_n(x_n-e) \to xcn​(xn​−e)→x in J1J_1J1​, then cn(xn−1−e)→−xc_n(x_n^{-1}-e) \to -xcn​(xn−1​−e)→−x in J1J_1J1​. This is one step from a central limit theorem for partial sums to one for counting processes. Theorem 7.4 shows a limitation: convergence of both the centered supremum and the centered inverse in J1J_1J1​ forces a continuous limit.

Formalizing it. The results are proved and classical, but none of them has a machine-checked proof. The mission produces the M1M_1M1​ topology on D([0,∞),R)D([0,\infty),\mathbb R)D([0,∞),R) in Lean, the first passage time map with its basic properties, and the comparison between J1J_1J1​, M1M_1M1​ and UUU. That infrastructure is reused by every later formalization that goes through counting processes or the M1M_1M1​ topology, including the planned wave of §§3–7 corollaries in this series.

Difficulty

The first passage time map is not J1J_1J1​-continuous. On p. 82 the paper gives paths xn→xx_n \to xxn​→x in J1J_1J1​ whose inverses converge only in M1M_1M1​: a flat stretch of the limit becomes a jump of x−1x^{-1}x−1, which the inverses of the approximating paths approach through two separate jumps. Inverting the time changes λn\lambda_nλn​ of the J1J_1J1​ convergence cannot handle that split, because J1J_1J1​ matches jumps one to one. The hypothesis that xxx is strictly increasing excludes flat stretches of the limit. The technical weight lies in completed graphs and their parametric representations, which Mathlib does not have, and in the restriction to compact intervals at continuity points of the limit.

Formalization scope

  • Paths are total functions R→R\mathbb R \to \mathbb RR→R. Only [0,∞)[0,\infty)[0,∞) matters, and every statement is on Ici 0. All convergences are sequential, which is equivalent because the spaces are metrizable (Theorem 2.6). Membership of every path in DDD is part of each convergence.
  • J1J_1J1​ is the shared layer of the series: the metric (2.1) with [0,∞][0,\infty][0,∞]-valued distances, extended to [0,∞)[0,\infty)[0,∞) through restrictions to [a,b][a,b][a,b] whose endpoints are continuity points or endpoints.
  • M1M_1M1​ is not defined in the paper. The mission defines it with the convention x(0−):=0x(0-) := 0x(0−):=0 at the origin, so the completed graph on [0,b][0,b][0,b] starts with the segment from (0,0)(0,0)(0,0) to (0,x(0))(0,x(0))(0,x(0)). With the convention x(0−)=x(0)x(0-) = x(0)x(0−)=x(0), Theorem 7.1 is false. For x(s)=(s−1)+x(s) = (s-1)^+x(s)=(s−1)+ and xn=x+1/nx_n = x + 1/nxn​=x+1/n, xn−1x_n^{-1}xn−1​ jumps from 000 to 111 at t=1/nt = 1/nt=1/n while x−1(0)=1x^{-1}(0) = 1x−1(0)=1. The convention is Whitt's later M1′M_1'M1′​. Two milestones carry a hypothesis that this convention forces, and each says so: the supremum milestone requires xn(0),x(0)≥0x_n(0), x(0) \ge 0xn​(0),x(0)≥0 (as on EEE), and the M1⇒UM_1 \Rightarrow UM1​⇒U milestone requires x(0)=0x(0) = 0x(0)=0. The goal, which is stated in J1J_1J1​, does not depend on the convention.
  • x−1x^{-1}x−1 is a real infimum. Its set is nonempty because paths in EEE are unbounded above, so every statement that uses x−1x^{-1}x−1 assumes membership in EEE. The inequality x(s)>tx(s) > tx(s)>t is strict, as on the page.
  • Omitted. The measurability clause of Theorem 7.2 refers to the Borel σ-field of J1J_1J1​, which the series does not build, and it is not stated. Replacing it by measurability for the product σ-algebra would be a different statement. The second clause of the §6 sentence on D0D_0D0​ is also not stated.
  • Ruled out. A formalization in which x−1x^{-1}x−1 is applied outside EEE (giving the junk value 000), or in which J1J_1J1​ convergence omits membership in DDD (making the restriction clause vacuous), would trivialize the goal. Both are excluded.

Contributions welcome: the general theory of parametric representations (existence, and the M1M_1M1​ comparison with J1J_1J1​ and UUU), which is reusable for any M1M_1M1​ result. Alternative proofs of Theorem 7.2 that avoid M1M_1M1​ are also welcome.

Selected references

  • W. Whitt, Some Useful Functions for Functional Limit Theorems, Mathematics of Operations Research 5(1), 1980, 67–85. https://doi.org/10.1287/moor.5.1.67
  • A. V. Skorohod, Limit theorems for stochastic processes, Theory of Probability and Its Applications 1(3), 1956, 261–290. https://doi.org/10.1137/1101022
  • W. Whitt, Weak convergence of first passage time processes, Journal of Applied Probability 8(2), 1971, 417–422. https://doi.org/10.2307/3211913
  • W. Vervaat, Functional central limit theorems for processes with positive drift and their inverses, Zeitschrift für Wahrscheinlichkeitstheorie 23, 1972, 245–253. https://doi.org/10.1007/BF00532510
  • W. Whitt, Stochastic-Process Limits, Springer, 2002, §13.6. https://doi.org/10.1007/b97479
14 thms2 active usersReviewed
Graph TheoryOperations ResearchStochastic Systems·Captain: mikedeng1

Stability Properties of Constrained Queueing Systems and Scheduling Policies for Maximum Throughput in Multihop Radio Networks II: Outside C̄′ the Queues Grow to Infinity a.s. under Every PolicyResearch Paper

Motivation

In a multihop radio network, links that are close to each other interfere, so only certain sets of links can transmit in the same time slot. Tassiulas and Ephremides (IEEE TAC 1992) modelled this as a constrained queueing system and asked which arrival rates any scheduler can sustain. Their answer has two halves. The first, Theorem 3.2, shows that a maximum-weight ("back-pressure") policy stabilizes the network for every rate vector in an explicit region C′C'C′, and that no stationary policy does better than its closure. The second, Theorem 4.1 and the subject of this mission, removes the restriction to stationary policies: outside the closure Cˉ′\bar C'Cˉ′, every scheduler, however it uses the past, lets the queues grow without bound almost surely.

The pair of results is the origin of throughput-optimal scheduling in wireless and switched networks: max-weight scheduling in input-queued switches, back-pressure routing, and the Lyapunov-drift framework of network utility maximization all start from this region and this converse. The converse is what makes "throughput-optimal" a meaningful claim: it certifies that Cˉ′\bar C'Cˉ′ is a hard limit, not merely the limit of one policy class.

Setting

There are LLL queues and NNN servers (links). Server iii serves queue q(i)q(i)q(i) and sends each served customer to a queue h(i)h(i)h(i) or out of the system. Time is slotted and a service takes one slot. An activation set is a set of servers that may be active in the same slot; the constraint set SSS is the family of all activation sets, and assumption C.1 says that every subset of an activation set is an activation set. The activation vector of a set ccc is its indicator vector in {0,1}N\{0,1\}^N{0,1}N, and co(S)\mathrm{co}(S)co(S) is the convex hull of the activation vectors.

A history-dependent policy π∈G~\pi\in\tilde Gπ∈G~ chooses, at the start of slot ttt, an activation set E(t)∈SE(t)\in SE(t)∈S as a function of the queue-length vectors X(0),…,X(t−1)X(0),\dots,X(t-1)X(0),…,X(t−1), never activating more servers of a queue than it has customers. The queue lengths evolve by

Xl(t)=Xl(t−1)−#{i∈E(t):q(i)=l}+#{i∈E(t):h(i)=l}+Al(t),X_l(t)=X_l(t-1)-\#\{i\in E(t):q(i)=l\}+\#\{i\in E(t):h(i)=l\}+A_l(t),Xl​(t)=Xl​(t−1)−#{i∈E(t):q(i)=l}+#{i∈E(t):h(i)=l}+Al​(t),

where the arrivals Al(t)A_l(t)Al​(t) are i.i.d. over ttt, independent across queues, with finite second moments and means ala_lal​.

The routing matrix RRR has rli=1r_{li}=1rli​=1 if h(i)=lh(i)=lh(i)=l and rli=−1r_{li}=-1rli​=−1 if q(i)=lq(i)=lq(i)=l. A vector f≥0f\ge0f≥0 indexed by servers is an aaa-admissible flow if a=−Rfa=-Rfa=−Rf. The region C′C'C′ is the set of a≥0a\ge0a≥0 that admit such a flow and a point c∈co(S)c\in\mathrm{co}(S)c∈co(S) with fi<cif_i<c_ifi​<ci​ wherever fi>0f_i>0fi​>0 and fi=0f_i=0fi​=0 wherever ci=0c_i=0ci​=0.

The proof uses the flow network NafN_{af}Naf​: the queues plus an originator ooo and a terminal ddd, an edge (o,l)(o,l)(o,l) of capacity ala_lal​ for every queue, and an edge of capacity fkf_kfk​ from q(k)q(k)q(k) to h(k)h(k)h(k) (or to ddd) for every server kkk. A cut is a set WWW of queues on the originator's side; its capacity CafC_{af}Caf​ is the total capacity of the edges leaving W∪{o}W\cup\{o\}W∪{o}.

Formalization targets

Goal: Theorem 4.1

a∉Cˉ′ ⟹ lim⁡t→∞∑l=1LXl(t)=∞a.s., for every π∈G~ and every initial state.a\notin\bar C'\ \Longrightarrow\ \lim_{t\to\infty}\sum_{l=1}^L X_l(t)=\infty\quad\text{a.s., for every }\pi\in\tilde G\text{ and every initial state.}a∈/Cˉ′ ⟹ t→∞lim​l=1∑L​Xl​(t)=∞a.s., for every π∈G~ and every initial state.

Milestones, in the order the proof uses them

  1. Lemma A.1: under C.1, c∈co(S)c\in\mathrm{co}(S)c∈co(S) and 0≤x≤c0\le x\le c0≤x≤c imply x∈co(S)x\in\mathrm{co}(S)x∈co(S).
  2. Lemma 3.1 (one class, unit service): Cˉ′={a≥0:∃f∈Fa, c∈co(S), f≤c}\bar C'=\{a\ge0:\exists f\in F_a,\ c\in\mathrm{co}(S),\ f\le c\}Cˉ′={a≥0:∃f∈Fa​, c∈co(S), f≤c}.
  3. Lemma 4.1: if a∉Cˉ′a\notin\bar C'a∈/Cˉ′, the maximum over f∈co(S)f\in\mathrm{co}(S)f∈co(S) of the mincut capacity of NafN_{af}Naf​ is attained and is strictly below ∑lal\sum_l a_l∑l​al​.
  4. Corollary 4.1: there is one ϵ>0\epsilon>0ϵ>0 such that ∑l∈Wafal−ϵ\sum_{l\in W_{af}}a_l-\epsilon∑l∈Waf​​al​−ϵ bounds the server capacity leaving WafW_{af}Waf​, for every f∈co(S)f\in\mathrm{co}(S)f∈co(S) and every mincut.
  5. (4.7), pathwise: ∑lXl(t)≥min⁡Q∑τ=1t(∑l∈Q(Al(τ)−al)+ϵ)\sum_l X_l(t)\ge\min_{Q}\sum_{\tau=1}^t\big(\sum_{l\in Q}(A_l(\tau)-a_l)+\epsilon\big)∑l​Xl​(t)≥minQ​∑τ=1t​(∑l∈Q​(Al​(τ)−al​)+ϵ) for every policy and every arrival sequence.
  6. (4.12): each of these 2L2^L2L partial sums tends to +∞+\infty+∞ almost surely.

Significance

Theorem 4.1 closes the characterization of the throughput region of a constrained queueing network. With Theorem 3.2 it says that the set of sustainable rates is C′C'C′ up to its boundary, for all policies and not only stationary ones, and that allowing schedules to depend on the entire history, on time, or on long-range planning cannot enlarge it. Every later throughput-optimality result for max-weight-type policies in switches and wireless networks cites this converse, and the region co(S)\mathrm{co}(S)co(S) of "average activation vectors" is the standard capacity region of interference-constrained networks.

The result has been proved since 1992 and has not, to our knowledge, been machine-checked. A formalization adds a precise statement of the policy class G~\tilde GG~ (history-dependent, non-anticipating, never serving empty queues), a sample-path inequality (4.7) that is independent of probability and reusable for any arrival model, and a cut-based description of Cˉ′\bar C'Cˉ′ through Lemma 4.1 and Corollary 4.1.

Difficulty

The obvious argument fails at the policy class. For a stationary policy the queue-length process is a Markov chain and an instability argument can use its ergodic behaviour; a history-dependent policy has no such structure, and the time-average activation vector λ(t)=1t∑τ≤tE(τ)\lambda(t)=\frac1t\sum_{\tau\le t}E(\tau)λ(t)=t1​∑τ≤t​E(τ) wanders in co(S)\mathrm{co}(S)co(S) without converging. The argument must therefore find, for every possible average λ\lambdaλ, a set of queues whose net inflow exceeds its outflow by a margin that does not depend on λ\lambdaλ. That uniformity is the content of Lemma 4.1 and Corollary 4.1: it needs the max-flow/min-cut theorem on NafN_{af}Naf​, the continuity of the mincut capacity in fff, the compactness of co(S)\mathrm{co}(S)co(S), and Lemma A.1 to bring a maximum flow back into co(S)\mathrm{co}(S)co(S). Comparing ∑lal\sum_l a_l∑l​al​ with the total service capacity, or using a single fixed cut, does not work: the bottleneck set of queues depends on how the policy spreads its activations.

Formalization scope

Queues are Fin L and servers Fin N, indexed from 0. A server's destination is Option (Fin L), none meaning out of the system. SSS is a Set (Finset (Fin N)); C.1 is a predicate, and every theorem that needs it also assumes ∅∈S\emptyset\in S∅∈S (otherwise SSS may be empty and no policy exists). Rate vectors are Fin L → ℝ, and C′C'C′ includes a≥0a\ge0a≥0. Service times are one slot, so M=IM=IM=I. The goal's hypothesis is a∉Cˉ′a\notin\bar C'a∈/Cˉ′ with C′C'C′ defined from flows, as in the introduction of §IV; the printed theorem uses the closure of the stability region CCC, which equals Cˉ′\bar C'Cˉ′ by Theorem 3.2 of the paper. A policy is a function from the history X(0),…,X(t)X(0),\dots,X(t)X(0),…,X(t) to the activation set of slot t+1t+1t+1, required to choose sets in SSS and to activate no more servers of a queue than it has customers; the queue dynamics are written in N\mathbb NN, where this requirement makes the subtraction exact. Arrivals are random vectors in NL\mathbb N^LNL, i.i.d. in time (iIndepFun, IdentDistrib), independent across queues, with integrable squares; aaa is their mean, not a free parameter.

The statement does not hold vacuously: a one-queue, one-server example with constant arrivals of two customers per slot satisfies every hypothesis of the goal, including the existence of runs, and lies outside Cˉ′\bar C'Cˉ′ (checked in a sanity file). A formalization in which policies may see future arrivals, or may serve empty queues, or in which aaa is unrelated to the arrival law, is a different theorem.

A complete development needs: the max-flow/min-cut theorem for finite networks with parallel edges (posed elsewhere on the platform in other encodings, not proved), continuity of a minimum of finitely many linear functions, compactness of a convex hull of finitely many points, and Mathlib's strong law of large numbers. The pathwise bound (4.7) and the cut lemmas are reusable for any interference-constrained network. Proofs of any milestone, and alternative routes to Lemma 4.1 (for instance through linear-programming duality), are welcome.

Selected references

  • L. Tassiulas and A. Ephremides, Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks, IEEE Transactions on Automatic Control 37(12):1936–1948, 1992. https://doi.org/10.1109/9.182479
  • C. H. Papadimitriou and K. Steiglitz, Combinatorial Optimization: Algorithms and Complexity, Prentice-Hall, 1982 (reference [17] of the paper, for the max-flow/min-cut theorem).
  • L. R. Ford and D. R. Fulkerson, Maximal flow through a network, Canadian Journal of Mathematics 8:399–404, 1956. https://doi.org/10.4153/CJM-1956-045-5
9 thms2 active usersReviewed
Machine LearningMarkov ChainReinforcement Learning·Captain: mikedeng1

An Analysis of Temporal-Difference Learning with Function Approximation 2: For Every Sampling Distribution q and 5/6 < α < 1, Off-Line q-Sampled TD(0) Can Diverge in ExpectationResearch Paper

Motivation

Temporal-difference learning estimates the future cost of a system from observed transitions. In a Markov model, a state has a distribution of possible successors and each transition carries a cost. An agent may approximate the future cost with a small number of basis functions rather than store one number per state. This is useful when the state set is large or countably infinite, but the sampling rule then matters: the states used to update the approximation need not arrive in the same proportions as visits to the underlying Markov chain.

Tsitsiklis and Van Roy distinguish sampling along the chain from drawing current states independently from a chosen distribution qqq. Their 1996 LIDS report, §9 constructs an example where the latter version of TD(0) has a mean parameter vector whose norm grows without bound. The example applies to every sampling distribution qqq on a countable state space with at least two states and every discount factor α\alphaα strictly between 5/65/65/6 and 111. The mission formalizes that quantified counterexample, rather than selecting a particular two-state distribution.

Setting

Let SSS be a finite or countably infinite set of states. A transition matrix PPP assigns a probability distribution pijp_{ij}pij​ over next states jjj to each current state iii. A transition cost g(i,j)g(i,j)g(i,j) is incurred when the chain moves from iii to jjj, and 0<α<10<\alpha<10<α<1 discounts later costs. The cost-to-go J∗(i)J^*(i)J∗(i) is the expected sum of discounted costs along a chain started at iii. An invariant distribution π\piπ satisfies πTP=πT\pi^{\mathsf T}P=\pi^{\mathsf T}πTP=πT.

A feature vector ϕ(i)∈RK\phi(i)\in\mathbb R^Kϕ(i)∈RK represents an approximate cost ϕ(i)Tr\phi(i)^{\mathsf T}rϕ(i)Tr, where r∈RKr\in\mathbb R^Kr∈RK is learned. The weighted norm ∥J∥D\|J\|_D∥J∥D​ uses the weights π(i)\pi(i)π(i), and Π\PiΠ projects onto the span of the features in that norm. The one-step operator T(0)T^{(0)}T(0) sends JJJ to the expected immediate cost plus α\alphaα times the next-state value. These are the objects of §§2–4 of the report.

In qqq-sampled TD(0), each current state ItI_tIt​ is drawn independently from a probability distribution qqq; a successor JtJ_tJt​ is then drawn from row P(It,⋅)P(I_t,\cdot)P(It​,⋅). Each new pair is independent of the earlier pairs. The parameter changes by

rt+1=rt+γtϕ(It)[g(It,Jt)+αϕ(Jt)Trt−ϕ(It)Trt].r_{t+1}=r_t+\gamma_t\phi(I_t)\left[g(I_t,J_t)+\alpha\phi(J_t)^{\mathsf T}r_t-\phi(I_t)^{\mathsf T}r_t\right].rt+1​=rt​+γt​ϕ(It​)[g(It​,Jt​)+αϕ(Jt​)Trt​−ϕ(It​)Trt​].

The step sizes γt\gamma_tγt​ satisfy the report's Assumption 4: they are chosen in advance, nonnegative and nonincreasing, their sum diverges, and the sum of their squares converges. Assumption 1 asks for a unique positive invariant law, finite stationary second moment of the transition costs, and finite cost-to-go from each state. Assumption 2 asks for linearly independent features with finite stationary second moments.

Formalization targets

Divergence of the mean

For every qqq and 5/6<α<15/6<\alpha<15/6<α<1, Theorem 3 asserts the existence of PPP, ggg, and a feature map satisfying Assumptions 1 and 2, together with a unique projected fixed-point parameter r∗r^*r∗, such that for every r0≠r∗r_0\ne r^*r0​=r∗,

ΠT(0)(ϕTr)=ϕTr  ⟺  r=r∗,lim⁡t→∞∥E[rt∣r0]∥=∞.\Pi T^{(0)}(\phi^{\mathsf T}r)=\phi^{\mathsf T}r\iff r=r^*, \qquad \lim_{t\to\infty}\bigl\|\mathbb E[r_t\mid r_0]\bigr\|=\infty.ΠT(0)(ϕTr)=ϕTr⟺r=r∗,t→∞lim​​E[rt​∣r0​]​=∞.

The expectation is over the independent state–successor samples. The target is the norm of the mean vector; it does not assert divergence of individual sample paths. The formal goal quantifies over every probability space carrying samples with the stated joint law, so a choice of representation for the random process does not change the theorem.

Supporting statements

The milestones follow the claims in the proof of Theorem 3, pp. 24–25: existence of a full-support transition distribution; the one-feature construction and its assumptions; the general and specialized recurrences for E[rt]\mathbb E[r_t]E[rt​]; a positive lower bound for their coefficient Δ\DeltaΔ; and unbounded growth from that lower bound. The numerical inequality retains the report's threshold 5/(6α)5/(6\alpha)5/(6α) and its explicit positive factor 6αp(s2)−56\alpha p(s_2)-56αp(s2​)−5.

Significance

The theorem identifies a limit of using TD(0) with linear approximation when the current states are sampled according to a distribution unrelated to the chain's invariant law. The constructed Markov chain itself has a well-defined zero cost-to-go, and the approximation uses only one nonzero feature direction. Nevertheless, the mean of the parameter sequence diverges for every nonfixed initialization. Thus the issue is present even without noisy costs or a complicated feature space. The report contrasts this with its convergence result for the on-line algorithm under additional assumptions; the counterexample says that those conclusions cannot be transferred to arbitrary independent state sampling by changing only the sample source. Tsitsiklis and Van Roy, §9.

The report proves Theorem 3 on paper. This mission asks for a machine-checked proof of its full quantifier structure, including countably infinite state spaces and arbitrary qqq. A completed development would supply reusable Lean interfaces for countable Markov kernels, path laws, weighted projections, independent state–successor samples, and expected stochastic recurrences. The proposal currently contains the statements and definitions; the theorem proofs are open.

Difficulty

The apparent simplicity of the one-dimensional example hides two issues. First, the statement is uniform over qqq, including distributions that put zero mass on nearly every state. A proof must choose the two feature states in response to qqq while preserving the strict positivity needed for growth. Second, the recurrence concerns E[rt]\mathbb E[r_t]E[rt​], where rtr_trt​ depends on all earlier random pairs. The step at time ttt uses a fresh pair, and the factorization of its mean requires that temporal independence, plus justified integrability. Writing a positive scalar coefficient alone does not establish divergence of the expected parameter sequence for the sampled process.

Formalization scope

The Lean state space is a countable discrete measurable type with at least two elements. PPP is a Markov kernel, its path law comes from the Ionescu–Tulcea construction, and the cost-to-go is the expectation of the discounted path sum. Weighted L2(S,D)L_2(S,D)L2​(S,D) membership is expressed by summability of π(i)J(i)2\pi(i)J(i)^2π(i)J(i)2. The projection uses the inverse of the weighted Gram matrix under the independence and positive-mass assumptions that make it invertible. Only T(0)T^{(0)}T(0) is needed here. The number KKK of basis functions is existential, like the report's matrix Φ\PhiΦ, but must be at least one: an empty parameter space would leave the universal divergence clause with no nonfixed initializations. The report's own example has K=1K=1K=1.

Assumption 1 includes uniqueness of π\piπ, positive mass at each state, the stationary squared-cost moment, and absolute integrability of the cost-to-go. Assumption 2 includes linear independence and integrability of squared features. Assumption 4 retains square-summability even though the displayed growth argument uses the divergent first-power sum. The general mean recurrence assumes bounded costs and features so its integrals and countable sums are meaningful; the constructed example satisfies those bounds. The goal additionally states finite-time integrability of the parameter vector. The source indexes states by 1 and 2; the formalization uses two distinct states s1,s2s_1,s_2s1​,s2​ and records the proof's ordering 0<q(s1)0<q(s_1)0<q(s1​) and q(s2)≤q(s1)q(s_2)\le q(s_1)q(s2​)≤q(s1​) in the growth milestone. The goal's quantification over probability spaces is restricted to Lean's Type universe.

The general mean recurrence is written with the immediate cost outside the matrix factor multiplying E[rt]\mathbb E[r_t]E[rt​]. This follows the algorithm displayed on p. 24 and corrects two slips in the printed recurrence on p. 25: its next-state subscript and the placement of the mean-cost term. Contributions to the path-law facts, independent-sampling calculations, countable weighted sums, and scalar growth theorem all support the same fixed goal.

Selected references

  • J. N. Tsitsiklis and B. Van Roy, An Analysis of Temporal-Difference Learning with Function Approximation, MIT Laboratory for Information and Decision Systems report LIDS-P-2322, 1996; published in IEEE Transactions on Automatic Control 42(5), 1997. MIT record.
9 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

Bounded Rationality in Newsvendor Models II: The Logit Newsvendor's Expected Order and Expected Profit Are Partial Derivatives of the Log-Partition Function A(η₁, η₂)Research Paper

Motivation

The newsvendor problem is the basic model of a one-period inventory decision: a seller orders xxx units at unit cost ccc before a random demand DDD is observed, and sells min⁡(D,x)\min(D,x)min(D,x) units at unit price p>cp > cp>c. A perfectly rational newsvendor orders the critical fractile x∗=F−1(1−c/p)x^* = F^{-1}(1-c/p)x∗=F−1(1−c/p), where FFF is the distribution function of DDD. Laboratory experiments (Schweitzer and Cachon 2000; Bolton and Katok 2008) found that human subjects systematically deviate from x∗x^*x∗: their orders are noisy and, on average, pulled toward mean demand.

Su (2008) explains these patterns with a model of bounded rationality taken from the logit choice literature (Luce 1959; McFadden 1981). The decision maker does not pick the best order; instead each order is chosen with probability density proportional to the exponential of its expected profit, scaled by a noise parameter β>0\beta > 0β>0. The resulting random order, the behavioral solution X♭X^\flatX♭, is the object of the paper. For uniform demand it is a truncated normal and its moments are explicit (§4.1). For a general demand distribution there is no closed form, and §4.3 of the paper characterizes the moments of X♭X^\flatX♭ through a single function instead. This mission formalizes that characterization, Proposition 2.

Setting

Demand DDD has a density fff: f≥0f \ge 0f≥0, f(x)=0f(x) = 0f(x)=0 for x<0x < 0x<0, and ∫f=1\int f = 1∫f=1. For an order quantity xxx, the expected sales are Emin⁡(D,x)=∫min⁡(t,x)f(t) dtE\min(D,x) = \int \min(t,x)f(t)\,dtEmin(D,x)=∫min(t,x)f(t)dt and the expected profit is (eq. (3))

π(x)=p Emin⁡(D,x)−c x.\pi(x) = p\,E\min(D,x) - c\,x .π(x)=pEmin(D,x)−cx.

The decision domain SSS is the smallest interval containing the support of fff: the boundedly rational newsvendor may order any quantity between the smallest and the largest possible demand. The behavioral solution X♭X^\flatX♭ is the random order with density (eqs. (4), (11))

ψp,c(x)=eπ(x)/β∫Seπ(v)/β dv=e(pEmin⁡(D,x)−cx)/β∫Se(pEmin⁡(D,v)−cv)/β dv,x∈S,\psi_{p,c}(x) = \frac{e^{\pi(x)/\beta}}{\int_S e^{\pi(v)/\beta}\,dv} = \frac{e^{(pE\min(D,x)-cx)/\beta}}{\int_S e^{(pE\min(D,v)-cv)/\beta}\,dv}, \qquad x \in S,ψp,c​(x)=∫S​eπ(v)/βdveπ(x)/β​=∫S​e(pEmin(D,v)−cv)/βdve(pEmin(D,x)−cx)/β​,x∈S,

and ψp,c(x)=0\psi_{p,c}(x) = 0ψp,c​(x)=0 for x∉Sx \notin Sx∈/S.

A family of densities forms an sss-dimensional exponential family if they have the form h(x;η)=l(x)exp⁡{∑i=1sηiTi(x)−A(η)}h(x;\eta) = l(x)\exp\{\sum_{i=1}^s \eta_i T_i(x) - A(\eta)\}h(x;η)=l(x)exp{∑i=1s​ηi​Ti​(x)−A(η)} (eq. (10)); the ηi\eta_iηi​ are the natural parameters, the TiT_iTi​ the sufficient statistics and AAA the log-partition function. Su observes that the choice densities ψp,c\psi_{p,c}ψp,c​ are of this form with s=2s = 2s=2, natural parameters η1=p/β\eta_1 = p/\betaη1​=p/β and η2=c/β\eta_2 = c/\betaη2​=c/β, statistics T1(x)=Emin⁡(D,x)T_1(x) = E\min(D,x)T1​(x)=Emin(D,x) and T2(x)=−xT_2(x) = -xT2​(x)=−x, and

A(η1,η2)=ln⁡(∫Seη1Emin⁡(D,v)−η2v dv).(12)A(\eta_1,\eta_2) = \ln\Big(\int_S e^{\eta_1 E\min(D,v) - \eta_2 v}\,dv\Big). \qquad (12)A(η1​,η2​)=ln(∫S​eη1​Emin(D,v)−η2​vdv).(12)

In the Lean development these objects are IsDemandDensity f, expMin f, nvProfit f p c (π\piπ), decisionDomain f (SSS), logitDensity S (nvProfit f p c) β (ψp,c\psi_{p,c}ψp,c​), logitExp S u β g (the expectation E g(X♭)E\,g(X^\flat)Eg(X♭)) and logPartition f η₁ η₂ (AAA), all in the namespace BoundedNV.ExpFam.

Formalization targets

Goal: Proposition 2 (p. 575)

With η1=p/β\eta_1 = p/\betaη1​=p/β and η2=c/β\eta_2 = c/\betaη2​=c/β, both partial derivatives of AAA exist at (η1,η2)(\eta_1,\eta_2)(η1​,η2​), and

EX♭=−∂A∂η2(η1,η2),(14)EX^\flat = -\frac{\partial A}{\partial\eta_2}(\eta_1,\eta_2), \qquad (14)EX♭=−∂η2​∂A​(η1​,η2​),(14) Eπ(X♭)=p ∂A∂η1(η1,η2)+c ∂A∂η2(η1,η2).(15)E\pi(X^\flat) = p\,\frac{\partial A}{\partial\eta_1}(\eta_1,\eta_2) + c\,\frac{\partial A}{\partial\eta_2}(\eta_1,\eta_2). \qquad (15)Eπ(X♭)=p∂η1​∂A​(η1​,η2​)+c∂η2​∂A​(η1​,η2​).(15)

Milestones

  1. Observation (p. 575). The normalizer ∫Seη1Emin⁡(D,v)−η2vdv\int_S e^{\eta_1 E\min(D,v)-\eta_2 v}dv∫S​eη1​Emin(D,v)−η2​vdv is finite and positive, ψp,c\psi_{p,c}ψp,c​ is a probability density, and ψp,c(x)=1S(x)exp⁡{η1T1(x)+η2T2(x)−A(η1,η2)}\psi_{p,c}(x) = \mathbf 1_S(x)\exp\{\eta_1T_1(x)+\eta_2T_2(x)-A(\eta_1,\eta_2)\}ψp,c​(x)=1S​(x)exp{η1​T1​(x)+η2​T2​(x)−A(η1​,η2​)}.
  2. Fact (13) for i=1i = 1i=1. ∂A/∂η1(η1,η2)=E T1(X♭)=E[Emin⁡(D,x)∣x=X♭]\partial A/\partial\eta_1(\eta_1,\eta_2) = E\,T_1(X^\flat) = E\big[E\min(D,x)\big|_{x = X^\flat}\big]∂A/∂η1​(η1​,η2​)=ET1​(X♭)=E[Emin(D,x)​x=X♭​].
  3. Fact (13) for i=2i = 2i=2, i.e. (14). ∂A/∂η2(η1,η2)=E T2(X♭)=−EX♭\partial A/\partial\eta_2(\eta_1,\eta_2) = E\,T_2(X^\flat) = -EX^\flat∂A/∂η2​(η1​,η2​)=ET2​(X♭)=−EX♭.

Significance

Proposition 2 turns the computation of the expected order and the expected profit of a boundedly rational newsvendor, which are integrals against the density (11), into the differentiation of one function of two variables. The paper uses this in two ways (p. 575): moments of X♭X^\flatX♭ can be approximated numerically from finite differences of AAA, and β\betaβ can be estimated from aggregate laboratory data by the method of moments, choosing β\betaβ so that −∂A/∂η2-\partial A/\partial\eta_2−∂A/∂η2​ at (p/β,c/β)(p/\beta,c/\beta)(p/β,c/β) matches the observed average order.

The result is classical in structure: (13) is the standard identity for exponential families (see, e.g., Lehmann and Casella 1998). What the formalization adds is the verification that the identity applies to this particular family under the paper's hypotheses, including demand distributions with unbounded support, where the decision domain SSS is a half-line and the integrals are improper. To our knowledge, no part of the paper has been formalized before.

Difficulty

The identity (13) rests on differentiating under the integral sign in (12). The textbook justification requires the natural parameter to lie in the interior of the natural parameter space, together with a dominating function for the derivative of the integrand. Neither is on the page: the paper states the Fact for exponential families in general. For bounded SSS the domination is immediate; for unbounded SSS it is not, and the natural first idea, to bound Emin⁡(D,v)E\min(D,v)Emin(D,v) by the mean of DDD, fails because the paper assumes no finite mean. The required control comes instead from the growth of Emin⁡(D,v)=∫0v(1−F)E\min(D,v) = \int_0^v (1-F)Emin(D,v)=∫0v​(1−F), which is sublinear in vvv, against the linear decay −η2v-\eta_2 v−η2​v with η2=c/β>0\eta_2 = c/\beta > 0η2​=c/β>0. This must be established uniformly for parameters in a neighborhood of (p/β,c/β)(p/\beta,c/\beta)(p/β,c/β).

Formalization scope

All quantities are real. Integrals are Lebesgue (Bochner) integrals over R\mathbb RR or over SSS, and partial derivatives are derivatives of the one-variable sections t↦A(t,η2)t\mapsto A(t,\eta_2)t↦A(t,η2​) and t↦A(η1,t)t\mapsto A(\eta_1,t)t↦A(η1​,t). The conventions committed to are:

  1. Standing readings. β>0\beta > 0β>0, because eq. (2) divides by β\betaβ and β=0\beta = 0β=0 (perfect rationality) is a limit the formula does not define; 0<c0 < c0<c is added to the paper's c<pc < pc<p, as it is needed for x∗x^*x∗ to exist and, on an unbounded SSS, for the integral in (12) to be finite.
  2. No finite mean of DDD is assumed, and SSS may be unbounded.
  3. Decision domain. SSS is the convex hull of the pointwise support {x:f(x)≠0}\{x : f(x)\ne 0\}{x:f(x)=0} of the given density fff.
  4. Base factor. The page writes l(x)≡1l(x)\equiv 1l(x)≡1; with the density understood on SSS, as in (11), the Lean statement uses the indicator of SSS.
  5. Statistic T2T_2T2​. T2(x)=−xT_2(x) = -xT2​(x)=−x, so E T2(X♭)=−EX♭E\,T_2(X^\flat) = -EX^\flatET2​(X♭)=−EX♭, and (14) is (13) with i=2i = 2i=2.
  6. No corrected slips. The signs of (14) and (15) were checked and are right as printed.

Junk values ruled out. In Lean, ln⁡0=0\ln 0 = 0ln0=0, x/0=0x/0 = 0x/0=0, the integral of a non-integrable function is 000, and deriv of a non-differentiable function is 000. If the statements used these silently, every identity could hold because every term vanishes. The milestones therefore assert integrability and positivity of the normalizer and that ψp,c\psi_{p,c}ψp,c​ integrates to 111. Every derivative is stated with HasDerivAt, which asserts differentiability.

The Fact (13) is not formalized for abstract exponential families, whose hypotheses the page does not state; it is specialized to this family. The method-of-moments remarks after Proposition 2 and the empirical §5 are not part of the mission.

The infrastructure needed is differentiation of parametric integrals over unbounded domains (Mathlib's hasDerivAt_integral_of_dominated_loc_of_deriv_le) and elementary facts about Emin⁡(D,v)E\min(D,v)Emin(D,v): continuity, 0≤Emin⁡(D,v)≤v0 \le E\min(D,v) \le v0≤Emin(D,v)≤v for v≥0v \ge 0v≥0, and sublinear growth. The last of these is reusable for any newsvendor model with general demand. Contributions of proofs for each milestone, and of a lemma establishing the uniform domination near (p/β,c/β)(p/\beta,c/\beta)(p/β,c/β), are welcome.

The source is the published article in Manufacturing & Service Operations Management (2008); page numbers are the journal's.

Selected references

  • X. Su, Bounded Rationality in Newsvendor Models, Manufacturing & Service Operations Management 10(4):566–589, 2008. https://doi.org/10.1287/msom.1070.0200
  • M. E. Schweitzer, G. P. Cachon, Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence, Management Science 46(3):404–420, 2000. https://doi.org/10.1287/mnsc.46.3.404.12070
  • G. E. Bolton, E. Katok, Learning by Doing in the Newsvendor Problem: A Laboratory Investigation of the Role of Experience and Feedback, Manufacturing & Service Operations Management 10(3):519–538, 2008. https://doi.org/10.1287/msom.1060.0190
  • E. L. Lehmann, G. Casella, Theory of Point Estimation, 2nd ed., Springer, 1998. https://doi.org/10.1007/b98854
7 thms2 active usersReviewed
Operations ResearchOptimization·Captain: mikedeng1

On the Relationship Between Inventory Costs and Variety Benefits in Retail Assortments II: Optimal Variety Rises with Price and Store Volume and Falls as the No-Purchase Preference VanishesResearch Paper

Motivation

A retailer deciding how many variants of a product to carry (colours, sizes, flavours) faces a trade-off. A broader assortment captures customers whose favourite variant would otherwise be missing, but it splits demand into more, smaller streams, each of which needs its own safety stock. van Ryzin and Mahajan (Management Science 45(11), 1999) combine a multinomial logit model of customer choice with a newsvendor model of inventory and show that the optimal assortment always consists of the kkk most popular variants for some kkk (their Theorem 1). That reduces "how much variety" to a single index, and the paper's Theorem 2 then answers which economic parameters push that index up or down: the selling price, the strength of the customers' outside option, and the store's traffic volume. These comparative statics are the paper's main managerial predictions (high-margin categories and high-traffic "super stores" carry more variety; categories with a weak outside option carry less), and they are what later work on assortment planning cites the model for.

Setting

There are nnn variants N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. Variant jjj has a preference vj>0v_j>0vj​>0 and the option of buying nothing has preference v0>0v_0>0v0​>0. The variants are numbered so that v1≥v2≥⋯≥vnv_1\ge v_2\ge\dots\ge v_nv1​≥v2​≥⋯≥vn​, and Ai={1,…,i}A_i=\{1,\dots,i\}Ai​={1,…,i} denotes the set of the iii most popular variants (A0=∅A_0=\emptysetA0​=∅, An=NA_n=NAn​=N).

When the store offers an assortment S⊆NS\subseteq NS⊆N, each customer buys variant j∈Sj\in Sj∈S with the multinomial logit share

qj(S)=vj∑k∈Svk+v0.q_j(S)=\frac{v_j}{\sum_{k\in S}v_k+v_0}.qj​(S)=∑k∈S​vk​+v0​vj​​.

Each variant sells at price ppp and costs ccc per unit, with 0<c<p0<c<p0<c<p. Let Φ\PhiΦ be the standard normal distribution function and define the critical fractile z=Φ−1(1−c/p)z=\Phi^{-1}(1-c/p)z=Φ−1(1−c/p); it moves with ppp.

Two models of aggregate demand are compared. In the independent population model, λ>0\lambda>0λ>0 customers arrive on average, demand for variant jjj is normal with mean λqj\lambda q_jλqj​ and standard deviation σ(λqj)β\sigma(\lambda q_j)^\betaσ(λqj​)β, where σ>0\sigma>0σ>0 and 0≤β<10\le\beta<10≤β<1, and each variant is stocked at its newsvendor optimum. The resulting optimal expected profit is

πI(S,v)=(p−c)λ∑j∈Sqj−pσλβe−z2/22π∑j∈Sqjβ.\pi_I(S,v)=(p-c)\lambda\sum_{j\in S}q_j-\frac{p\sigma\lambda^\beta e^{-z^2/2}}{\sqrt{2\pi}}\sum_{j\in S}q_j^\beta .πI​(S,v)=(p−c)λj∈S∑​qj​−2π​pσλβe−z2/2​j∈S∑​qjβ​.

In the trend-following population model all λ\lambdaλ customers make the same choice, so variant jjj sells λ\lambdaλ units with probability qjq_jqj​ and nothing otherwise, and the optimal expected profit is

πT(S,v)=∑j∈S(pqj−c)+λ.\pi_T(S,v)=\sum_{j\in S}(pq_j-c)^+\lambda .πT​(S,v)=j∈S∑​(pqj​−c)+λ.

Inside the proofs, tjt_jtj​ and wjw_jwj​ denote the shares on AiA_iAi​ and on Ai+1A_{i+1}Ai+1​.

Formalization targets

Goal: Theorem 2 (p. 1504)

For all n>i≥1n>i\ge1n>i≥1:

(a)π(Ai+1,v)>π(Ai,v)  for all sufficiently high p, for π=πI and π=πT;\text{(a)}\quad \pi(A_{i+1},v)>\pi(A_i,v)\ \text{ for all sufficiently high } p,\ \text{for } \pi=\pi_I \text{ and } \pi=\pi_T;(a)π(Ai+1​,v)>π(Ai​,v)  for all sufficiently high p, for π=πI​ and π=πT​; (b)π(Ai+1,v)<π(Ai,v)  for all sufficiently small v0>0, for π=πI and π=πT;\text{(b)}\quad \pi(A_{i+1},v)<\pi(A_i,v)\ \text{ for all sufficiently small } v_0>0,\ \text{for } \pi=\pi_I \text{ and } \pi=\pi_T;(b)π(Ai+1​,v)<π(Ai​,v)  for all sufficiently small v0​>0, for π=πI​ and π=πT​; (c)πI(Ai+1,v)>πI(Ai,v)  for all sufficiently large λ.\text{(c)}\quad \pi_I(A_{i+1},v)>\pi_I(A_i,v)\ \text{ for all sufficiently large } \lambda .(c)πI​(Ai+1​,v)>πI​(Ai​,v)  for all sufficiently large λ.

The goal is a single Lean theorem whose conjuncts are (a), (b) and (c), each for every admissible value of the parameters held fixed. In the trend-following half of (b) it carries the extra hypothesis p v1>c∑j≤ivjp\,v_1>c\sum_{j\le i}v_jpv1​>c∑j≤i​vj​; see Formalization scope.

Milestones

  1. Equation (6): the critical fractile is the unique solution of Φ(z)=1−c/p\Phi(z)=1-c/pΦ(z)=1−c/p.
  2. Equation (13): πI(Ai+1,v)≥πI(Ai,v)\pi_I(A_{i+1},v)\ge\pi_I(A_i,v)πI​(Ai+1​,v)≥πI​(Ai​,v) if and only if
(1−cp)2πσλ1−βez2/2 ≥ ∑j≤i+1wjβ−∑j≤itjβ∑j≤i+1wj−∑j≤itj,\Big(1-\frac cp\Big)\frac{\sqrt{2\pi}}{\sigma}\lambda^{1-\beta}e^{z^2/2}\ \ge\ \frac{\sum_{j\le i+1}w_j^\beta-\sum_{j\le i}t_j^\beta}{\sum_{j\le i+1}w_j-\sum_{j\le i}t_j},(1−pc​)σ2π​​λ1−βez2/2 ≥ ∑j≤i+1​wj​−∑j≤i​tj​∑j≤i+1​wjβ​−∑j≤i​tjβ​​,

together with the strict version. 3. Equation (14): πT(Ai+1,v)≥πT(Ai,v)\pi_T(A_{i+1},v)\ge\pi_T(A_i,v)πT​(Ai+1​,v)≥πT​(Ai​,v) if and only if ∑j≤i+1(pwj−c)+≥∑j≤i(ptj−c)+\sum_{j\le i+1}(pw_j-c)^+\ge\sum_{j\le i}(pt_j-c)^+∑j≤i+1​(pwj​−c)+≥∑j≤i​(ptj​−c)+, with the strict version. 4. zzz and the left side of (13) are increasing in ppp on (c,∞)(c,\infty)(c,∞). 5. As v0→0v_0\to0v0​→0, qj→vj/∑k∈Svkq_j\to v_j/\sum_{k\in S}v_kqj​→vj​/∑k∈S​vk​, so ∑wj−∑tj→0\sum w_j-\sum t_j\to0∑wj​−∑tj​→0. 6. As v0→0v_0\to0v0​→0, the numerator of the right side of (13) converges to a positive constant. 7. The left side of (13) is increasing (and unbounded) in λ\lambdaλ.

Significance

The result. Theorem 2 gives three qualitative predictions with opposite signs, all from one model: higher margins favour broader assortments, a vanishing outside option favours narrower ones (customers then buy something regardless, so extra variants mainly cannibalise each other and add safety stock), and in the independent model higher volume favours broader assortments through risk pooling, a scale economy that the trend-following model does not have because its profit is proportional to λ\lambdaλ. Combined with Theorem 1 these statements locate the optimal number of variants, not only its direction of change.

Formalizing it. The theorem is proved in the paper, but the published argument is a sketch: the positivity of the limiting numerator in (b) is asserted ("one can easily show"), and the trend-following half of (b) is dispatched in one sentence that does not cover every case (see below). A machine-checked development fixes exactly which hypotheses each part needs. No part of this paper has been formalized before, and Mathlib has no normal quantile function; the development of Φ−1\Phi^{-1}Φ−1 and of the monotonicity of (1−c/p)ez2/2(1-c/p)e^{z^2/2}(1−c/p)ez2/2 in ppp is reusable for any newsvendor analysis.

Difficulty

The comparisons are between finite sums of real powers of shares whose denominators all move with the parameter. Three steps are not routine. For (a), the left side of (13) is a product of 1−c/p1-c/p1−c/p and ez2/2e^{z^2/2}ez2/2, and ez2/2e^{z^2/2}ez2/2 is not monotone in ppp (it decreases while z<0z<0z<0, i.e. while p<2cp<2cp<2c); so monotonicity of the product depends on the shape of the normal distribution, and part (a) also needs this left side to grow without bound, which the paper does not state. For (b), the positivity of the limiting numerator is where the ordering v1≥⋯≥vnv_1\ge\dots\ge v_nv1​≥⋯≥vn​ and β<1\beta<1β<1 enter; it fails for unordered preferences. For the trend-following half of (b), the positive parts (⋅)+(\cdot)^+(⋅)+ make the comparison piecewise, and the strict inequality can fail outright.

Formalization scope

All objects live in RetailVariety.Statics. Variants are Fin n, 0-based (the paper's variant jjj is ⟨j-1, _⟩), and AiA_iAi​ is A n i, the indices with value below iii, so A0=∅A_0=\emptysetA0​=∅. The preferences are v : Fin n → ℝ with 0 < v j and Antitone v; v0v_0v0​ is a separate real v0, not a variant. The shares are share v v0 S j. Φ\PhiΦ is ProbabilityTheory.cdf (gaussianReal 0 1), and zzz is criticalFractile p c, the infimum of {x:Φ(x)≥1−c/p}\{x:\Phi(x)\ge1-c/p\}{x:Φ(x)≥1−c/p}; it is a function of ppp, never a free parameter. Powers are real powers (Real.rpow); shares of offered variants are positive, so the convention 00=10^0=100=1 does not enter. (x)+(x)^+(x)+ is max x 0. Price, cost, volume, σ\sigmaσ, β\betaβ and v0v_0v0​ are explicit arguments of profitI and profitT.

"Sufficiently high/low" is encoded as an eventual statement: ∀ᶠ p in atTop, ∀ᶠ v0 in 𝓝[>] 0 (a right limit, since v0>0v_0>0v0​>0), ∀ᶠ lam in atTop. Fixed parameters stay in the paper's ranges: c>0c>0c>0, σ>0\sigma>0σ>0, 0≤β<10\le\beta<10≤β<1 throughout, λ>0\lambda>0λ>0 and v0>0v_0>0v0​>0 in (a), c<pc<pc<p in (b) and (c).

One deviation from the printed statement. In the trend-following model, part (b) as printed is false: with n=3n=3n=3, v=(1,1,1)v=(1,1,1)v=(1,1,1), i=2i=2i=2 and p=1.5cp=1.5cp=1.5c, every share is below 1/21/21/2, so πT(A2,v)=πT(A3,v)=0\pi_T(A_2,v)=\pi_T(A_3,v)=0πT​(A2​,v)=πT​(A3​,v)=0 for every v0>0v_0>0v0​>0. The goal therefore assumes p v1>c∑j≤ivjp\,v_1>c\sum_{j\le i}v_jpv1​>c∑j≤i​vj​ for that conjunct only (the most popular variant earns a positive margin on AiA_iAi​ when v0→0v_0\to0v0​→0); the condition is also necessary for the strict inequality.

Formalizations that would trivialize the mission are ruled out: an existential ("for some ppp") in place of the eventual quantifiers; non-strict inequalities in the goal; a critical fractile zzz independent of ppp; dropping the trend-following half of (a); and equal preferences or a fixed number of variants.

Needed infrastructure: the normal quantile and its basic properties, monotonicity facts about the normal distribution function and density, limits of the shares as v0→0v_0\to0v0​→0, and elementary inequalities for x↦xβx\mapsto x^\betax↦xβ with 0≤β<10\le\beta<10≤β<1. Proofs of any milestone, and of the quantile facts as standalone lemmas, are welcome.

Selected references

  • G. van Ryzin and S. Mahajan, On the Relationship Between Inventory Costs and Variety Benefits in Retail Assortments, Management Science 45(11):1496–1509, 1999. https://doi.org/10.1287/mnsc.45.11.1496
9 thms2 active usersReviewed
Stochastic Systems·Captain: mikedeng1

The Two-Parameter Poisson–Dirichlet Distribution Derived from a Stable Subordinator 4: The Density of V_1 under PD(α, θ) Is Determined by the PD(α, α + θ) Law of V_1Research Paper

Motivation

A random discrete distribution is a random sequence of frequencies V1≥V2≥⋯≥0V_1 \ge V_2 \ge \cdots \ge 0V1​≥V2​≥⋯≥0 with ∑nVn=1\sum_n V_n = 1∑n​Vn​=1. Such sequences model the relative sizes of species in a large population, of allele classes in population genetics, of cycles of a random permutation, of prime factors of a random integer, and of the excursion intervals of a Brownian motion or Bessel process. The two-parameter Poisson–Dirichlet family PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ), 0≤α<10 \le \alpha < 10≤α<1, θ>−α\theta > -\alphaθ>−α, contains Kingman's one-parameter law PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) (Ewens sampling formula, random permutations) and the law PD(α,0)\mathrm{PD}(\alpha, 0)PD(α,0) of the ranked jumps of a stable subordinator. It is the reference prior in Bayesian nonparametrics (the Pitman–Yor process) and the reference model in the combinatorics of random partitions.

J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator (Ann. Probab. 25 (1997)), extend what was known for PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) and PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) to the whole family. This mission formalizes one of their results: an identity (Proposition 19, p. 867) that describes the law of the largest frequency V1V_1V1​ under PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) through the law of the largest frequency under PD(α,α+θ)\mathrm{PD}(\alpha,\alpha+\theta)PD(α,α+θ).

Timeline. McCloskey (1965) showed that sampling from PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) discovers the frequencies in the stick-breaking order of independent beta(1,θ)\mathrm{beta}(1,\theta)beta(1,θ) variables. Dickman (1930) found the distribution of the largest prime factor; Vershik (1986) recorded it as the case α=0\alpha = 0α=0, θ=1\theta = 1θ=1 of an equation of this form. Engen (1978) introduced the two-parameter stick-breaking scheme for θ>0\theta > 0θ>0. Perman, Pitman and Yor (1992) and Pitman (1996) proved that this scheme is the size-biased permutation of the ranked frequencies for the whole parameter range (Proposition 2 here). Pitman and Yor (1997) derived (52) for all 0≤α<10 \le \alpha < 10≤α<1, θ>−α\theta > -\alphaθ>−α.

Setting

Fix 0≤α<10 \le \alpha < 10≤α<1 and θ>−α\theta > -\alphaθ>−α. Let Y~1,Y~2,…\tilde Y_1, \tilde Y_2, \dotsY~1​,Y~2​,… be independent random variables, Y~n\tilde Y_nY~n​ having the beta distribution beta(1−α,θ+nα)\mathrm{beta}(1-\alpha, \theta + n\alpha)beta(1−α,θ+nα), with density Γ(a+b)Γ(a)Γ(b)xa−1(1−x)b−1\frac{\Gamma(a+b)}{\Gamma(a)\Gamma(b)}x^{a-1}(1-x)^{b-1}Γ(a)Γ(b)Γ(a+b)​xa−1(1−x)b−1 on (0,1)(0,1)(0,1) for a=1−αa = 1-\alphaa=1−α, b=θ+nαb = \theta+n\alphab=θ+nα. Break a stick of length one:

V~1=Y~1,V~n=(1−Y~1)⋯(1−Y~n−1) Y~n(n≥2).(4)\tilde V_1 = \tilde Y_1, \qquad \tilde V_n = (1-\tilde Y_1)\cdots(1-\tilde Y_{n-1})\,\tilde Y_n \quad (n \ge 2). \tag{4}V~1​=Y~1​,V~n​=(1−Y~1​)⋯(1−Y~n−1​)Y~n​(n≥2).(4)

Let V1≥V2≥⋯V_1 \ge V_2 \ge \cdotsV1​≥V2​≥⋯ be the ranked values of the pieces V~n\tilde V_nV~n​. The law of (Vn)(V_n)(Vn​) is PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) (Definition 1, p. 857); Pα,θP_{\alpha,\theta}Pα,θ​ denotes probability for this construction.

A random variable V~1\tilde V_1V~1​ is a size-biased pick from (Vn)(V_n)(Vn​) if P(V~1=Vn∣V1,V2,… )=VnP(\tilde V_1 = V_n \mid V_1, V_2, \dots) = V_nP(V~1​=Vn​∣V1​,V2​,…)=Vn​ for every nnn: it is the frequency of the species of an individual drawn at random. A size-biased permutation continues the sampling without replacement, (2) and p. 857. A sample from (Vn)(V_n)(Vn​) is a random index NNN with P(N=n∣V)=VnP(N = n \mid V) = V_nP(N=n∣V)=Vn​ (113).

In Lean all sequences are ℕ → ℝ, 0-based (V ω 0 is V1V_1V1​); the objects are stick, ranked, IsStickLaw, HasPD, IsSizeBiasedPick, IsSizeBiasedPerm, IsSample, deleteAt, insertAt in the namespace PoissonDirichlet.MaxDensity.

Formalization targets

Goal: Proposition 19, identity (52)

For 0≤α<10 \le \alpha < 10≤α<1, θ>−α\theta > -\alphaθ>−α, the variable V1V_1V1​ lies in (0,1)(0,1)(0,1) almost surely and

Pα,θ(V1∈dx)dx=Γ(θ+1)Γ(θ+α)Γ(1−α) x−α−1(1−x)α+θ−1  Pα,α+θ ⁣(V1<x1−x),0<x<1.\frac{P_{\alpha,\theta}(V_1 \in dx)}{dx} = \frac{\Gamma(\theta+1)}{\Gamma(\theta+\alpha)\Gamma(1-\alpha)}\, x^{-\alpha-1}(1-x)^{\alpha+\theta-1}\; P_{\alpha,\alpha+\theta}\!\left(V_1 < \frac{x}{1-x}\right), \qquad 0 < x < 1.dxPα,θ​(V1​∈dx)​=Γ(θ+α)Γ(1−α)Γ(θ+1)​x−α−1(1−x)α+θ−1Pα,α+θ​(V1​<1−xx​),0<x<1.

Milestones

  1. Proposition 2 (p. 857): V1>V2>⋯>0V_1 > V_2 > \cdots > 0V1​>V2​>⋯>0, ∑nVn=1\sum_n V_n = 1∑n​Vn​=1 a.s., and (V~n)(\tilde V_n)(V~n​) is a size-biased permutation of (Vn)(V_n)(Vn​).
  2. Corollary 3 (p. 858): every size-biased pick from a PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) sequence has the beta(1−α,θ+α)\mathrm{beta}(1-\alpha,\theta+\alpha)beta(1−α,θ+α) law.
  3. Display (6) (p. 858): E∑nf(Vn)=E[f(V~1)/V~1]=Γ(θ+1)Γ(θ+α)Γ(1−α)∫01f(u)(1−u)α+θ−1u−α−1 duE\sum_n f(V_n) = E[f(\tilde V_1)/\tilde V_1] = \frac{\Gamma(\theta+1)}{\Gamma(\theta+\alpha)\Gamma(1-\alpha)}\int_0^1 f(u)(1-u)^{\alpha+\theta-1}u^{-\alpha-1}\,duE∑n​f(Vn​)=E[f(V~1​)/V~1​]=Γ(θ+α)Γ(1−α)Γ(θ+1)​∫01​f(u)(1−u)α+θ−1u−α−1du.
  4. The stick-tail identity (p. 876): (V~2,V~3,… )/(1−V~1)(\tilde V_2, \tilde V_3, \dots)/(1-\tilde V_1)(V~2​,V~3​,…)/(1−V~1​) has the Pα,α+θP_{\alpha,\alpha+\theta}Pα,α+θ​ law of (V~1,V~2,… )(\tilde V_1, \tilde V_2, \dots)(V~1​,V~2​,…), independently of V~1\tilde V_1V~1​.
  5. Display (91) (p. 876): Pα,θ(V1∈dx,V1=V~1)=x Pα,θ(V1∈dx)P_{\alpha,\theta}(V_1 \in dx, V_1 = \tilde V_1) = x\,P_{\alpha,\theta}(V_1 \in dx)Pα,θ​(V1​∈dx,V1​=V~1​)=xPα,θ​(V1​∈dx).
  6. Display (92) (p. 876): the same quantity equals Γ(θ+1)Γ(θ+α)Γ(1−α)x−α(1−x)α+θ−1 dx Pα,α+θ(V1<x/(1−x))\frac{\Gamma(\theta+1)}{\Gamma(\theta+\alpha)\Gamma(1-\alpha)}x^{-\alpha}(1-x)^{\alpha+\theta-1}\,dx\,P_{\alpha,\alpha+\theta}(V_1 < x/(1-x))Γ(θ+α)Γ(1−α)Γ(θ+1)​x−α(1−x)α+θ−1dxPα,α+θ​(V1​<x/(1−x)).
  7. Uniqueness (p. 877): (52), imposed for all θ>−α\theta > -\alphaθ>−α, determines the family of laws of V1V_1V1​.
  8. Propositions 34 and 35 (p. 881): deleting a sampled frequency and renormalising maps PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) to PD(α,θ+α)\mathrm{PD}(\alpha,\theta+\alpha)PD(α,θ+α), independently of VN∼beta(1−α,θ+α)V_N \sim \mathrm{beta}(1-\alpha,\theta+\alpha)VN​∼beta(1−α,θ+α); inserting an independent beta variable reverses it.

Significance

The result. The law of V1V_1V1​ under PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) has no closed form. Identity (52) is a functional equation in the parameter: on (1/2,1)(1/2,1)(1/2,1) the last factor equals one and the density is explicit; on (1/(n+1),1/n)(1/(n+1), 1/n)(1/(n+1),1/n) it is expressed through the law of V1V_1V1​ under PD(α,α+θ)\mathrm{PD}(\alpha,\alpha+\theta)PD(α,α+θ) on (1/n,1)(1/n, 1)(1/n,1). Specialised to α=0\alpha = 0α=0, θ=1\theta = 1θ=1 it is Dickman's equation for the largest prime factor of a random integer and for the longest cycle of a random permutation. The size-biased tools of the milestones (Corollary 3, (6), Propositions 34 and 35) are the standard way to compute with PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) and its partition structure.

Formalizing it. All results here are proved in the literature; none is formalized. Mathlib has the beta distribution, infinite product measures, independence and conditional expectation, but no random discrete distributions, no ranking of a countable sequence, and no size-biased sampling. The mission produces these objects and the first theorems about them: the identification of the stick-breaking scheme with the size-biased permutation of the ranked frequencies (cited by the paper, not proved there), the structural distribution, and the density identity.

Difficulty

The obvious obstacle is Proposition 2: the identification of the stick-breaking order with the size-biased order of the ranked values is a statement about conditional probabilities given an infinite sequence, it is only cited in the paper, and its proof (Perman–Pitman–Yor, Pitman) goes through exchangeable partitions or Poisson point processes. Everything else in the mission rests on it. A second obstacle is the events themselves: {V1=V~1}\{V_1 = \tilde V_1\}{V1​=V~1​} coincides with {max⁡n≥2V~n<V~1}\{\max_{n \ge 2}\tilde V_n < \tilde V_1\}{maxn≥2​V~n​<V~1​} only because the pieces are almost surely distinct, and conditioning on V~1=x\tilde V_1 = xV~1​=x needs the independence of the renormalised tail from V~1\tilde V_1V~1​, which is not a pointwise identity but a statement about infinite product measures. Reading (52) off the page as a pointwise identity of densities is not enough: densities are defined only almost everywhere.

Formalization scope

The parameter range 0≤α<10 \le \alpha < 10≤α<1, θ>−α\theta > -\alphaθ>−α of Definition 1 is a hypothesis of every statement; α=0\alpha = 0α=0 is included. A sequence "has the PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) distribution" (HasPD) if it is a.e.-measurable and, for some law μ\muμ of independent beta variables as in Definition 1 (IsStickLaw), P(V∈S)=μ(ranked stick∈S)P(V \in S) = \mu(\text{ranked stick} \in S)P(V∈S)=μ(ranked stick∈S) for every measurable SSS. Ranked values are defined with Set.encard, so infinitely many large terms are never counted as zero. Conditional probabilities are conditional expectations of indicators; size-biased picks, permutations and samples are measurable random variables, an assumption the page makes implicitly. Expectations of nonnegative functions are lower Lebesgue integrals. The density identity is an equality of measures on Borel subsets of (0,1)(0,1)(0,1), with two probability spaces for the two parameter values. Indices are 0-based. Insertion (p. 881) is defined with the index n−1n-1n−1 for the shifted tail, where the page prints n+1n+1n+1.

The formalization rules out the trivial readings: no Measure.map of a possibly non-measurable map (which would be the zero measure), no Set.ncard in the ranking, no Bochner integral of a possibly non-integrable function (whose value would be 000), no limUnder, and no dropped parameter range. Corollary 3 quantifies over every pick from every PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) sequence, not over the stick-breaking construction where it is the hypothesis. A sorry-free check shows that IsStickLaw is inhabited for every admissible (α,θ)(\alpha,\theta)(α,θ), so HasPD is not vacuous.

Contributions are welcome at every level: measurability of ranked, the law of the renormalised stick tail (infinite product measures), Proposition 2 through exchangeable partitions, and the recursion of the uniqueness statement, which is pure measure theory. The definitions are reusable by the other missions of this series.

Selected references

  • J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator, Ann. Probab. 25(2):855–900, 1997. https://doi.org/10.1214/aop/1024404422
  • M. Perman, J. Pitman and M. Yor, Size-biased sampling of Poisson point processes and excursions, Probab. Theory Related Fields 92:21–39, 1992. https://doi.org/10.1007/BF01205234
  • J. Pitman, Random discrete distributions invariant under size-biased permutation, Adv. Appl. Probab. 28:525–539, 1996. https://doi.org/10.2307/1428070
  • K. Dickman, On the frequency of numbers containing prime factors of a certain relative magnitude, Arkiv för Matematik, Astronomi och Fysik 22:1–14, 1930.
  • S. Engen, Stochastic Abundance Models, Chapman and Hall, 1978.
  • J. W. McCloskey, A model for the distribution of individuals by species in an environment, PhD thesis, Michigan State University, 1965.
  • A. M. Vershik, The asymptotic distribution of factorizations of natural numbers into prime divisors, Soviet Math. Dokl. 34:57–61, 1986.
13 thms2 active usersReviewed
Stochastic Systems·Captain: mikedeng1

The Two-Parameter Poisson–Dirichlet Distribution Derived from a Stable Subordinator 3: Moments E_{α,θ}(V_n^p) of the n-th Largest PD(α, θ) Frequency as One Integral of φ_α and ψ_αResearch Paper

Motivation

Random discrete distributions — a random sequence of nonnegative frequencies V1≥V2≥…V_1\ge V_2\ge\dotsV1​≥V2​≥… summing to one — model the relative sizes of species in a population, of cycles in a random permutation, of excursion intervals of a Markov process, and of clusters in Bayesian nonparametric models. The two-parameter Poisson–Dirichlet law PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) is the family that contains Kingman's one-parameter law PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) (Ewens sampling, random permutations) and the law PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) of ranked excursion lengths of a stable subordinator. J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator (Ann. Probab. 25 (1997)), developed its distribution theory systematically. In Bayesian nonparametrics the same family appears as the Pitman–Yor process prior.

A basic quantitative question about any random discrete distribution is the size of its nnn-th largest atom. This mission formalizes the paper's answer for PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ): every moment E(Vnp)E(V_n^p)E(Vnp​) as one explicit integral.

Timeline. The moment formula for PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) (Corollary 18 below) was known before 1997 (references [63, 73, 25, 50] of the paper). The Laplace transform of 1/Vn1/V_n1/Vn​ under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) was obtained, in different settings, by Darling (1952) and Lamperti (1961) for n=1n=1n=1 and by Wendel (1964) for n=2,3,…n=2,3,\dotsn=2,3,…. Perman, Pitman and Yor (1992) proved that PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) has density a constant times Lθ/αL^{\theta/\alpha}Lθ/α relative to PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0). Pitman and Yor (1997) combined these into Proposition 17.

Setting

Fix 0≤α<10\le\alpha<10≤α<1 and θ>−α\theta>-\alphaθ>−α. Let Y~1,Y~2,…\tilde Y_1,\tilde Y_2,\dotsY~1​,Y~2​,… be independent with Y~n∼beta(1−α,θ+nα)\tilde Y_n\sim\mathrm{beta}(1-\alpha,\theta+n\alpha)Y~n​∼beta(1−α,θ+nα), the law with density Γ(a+b)Γ(a)Γ(b)xa−1(1−x)b−1\frac{\Gamma(a+b)}{\Gamma(a)\Gamma(b)}x^{a-1}(1-x)^{b-1}Γ(a)Γ(b)Γ(a+b)​xa−1(1−x)b−1 on (0,1)(0,1)(0,1). Break a unit stick:

V~1=Y~1,V~n=(1−Y~1)⋯(1−Y~n−1)Y~n(n≥2),\tilde V_1=\tilde Y_1,\qquad \tilde V_n=(1-\tilde Y_1)\cdots(1-\tilde Y_{n-1})\tilde Y_n\quad(n\ge2),V~1​=Y~1​,V~n​=(1−Y~1​)⋯(1−Y~n−1​)Y~n​(n≥2),

and let V1≥V2≥…V_1\ge V_2\ge\dotsV1​≥V2​≥… be the ranked values of the V~n\tilde V_nV~n​. The law of (Vn)(V_n)(Vn​) is PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) (Definition 1); Eα,θE_{\alpha,\theta}Eα,θ​ denotes expectation under it.

For 0<α<10<\alpha<10<α<1 and λ≥0\lambda\ge0λ≥0 the paper introduces

ϕα(λ)=α∫1∞e−λxx−α−1 dx,ψα(λ)=1+α∫01(1−e−λx)x−α−1 dx.\phi_\alpha(\lambda)=\alpha\int_1^\infty e^{-\lambda x}x^{-\alpha-1}\,dx,\qquad \psi_\alpha(\lambda)=1+\alpha\int_0^1(1-e^{-\lambda x})x^{-\alpha-1}\,dx .ϕα​(λ)=α∫1∞​e−λxx−α−1dx,ψα​(λ)=1+α∫01​(1−e−λx)x−α−1dx.

Under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) the local time L=lim⁡n→∞nVnαL=\lim_{n\to\infty}nV_n^\alphaL=limn→∞​nVnα​ exists almost surely. From (Vn)(V_n)(Vn​) one derives Rn=Vn+1/VnR_n=V_{n+1}/V_nRn​=Vn+1​/Vn​, An=(V1+⋯+Vn)/Vn+1A_n=(V_1+\dots+V_n)/V_{n+1}An​=(V1​+⋯+Vn​)/Vn+1​ (with A0=0A_0=0A0​=0) and Xn=LVn−αX_n=LV_n^{-\alpha}Xn​=LVn−α​. Finally

Cα,θ=Γ(θ+1)Γ(θ/α+1)Γ(1−α)θ/α.C_{\alpha,\theta}=\frac{\Gamma(\theta+1)}{\Gamma(\theta/\alpha+1)}\Gamma(1-\alpha)^{\theta/\alpha}.Cα,θ​=Γ(θ/α+1)Γ(θ+1)​Γ(1−α)θ/α.

The Lean declarations Xseq, pdConst, and expIntE are in PoissonDirichlet.Moments; the other objects come from the frozen shared PoissonDirichlet.Ratio and PoissonDirichlet.Wendel modules.

Formalization targets

Goal: Proposition 17

For 0<α<10<\alpha<10<α<1, θ>−α\theta>-\alphaθ>−α, p>0p>0p>0 with θ+p>0\theta+p>0θ+p>0, and n=1,2,…n=1,2,\dotsn=1,2,…,

Eα,θ(Vnp)=Γ(1−α)θ/αΓ(n)Γ(θ+1)Γ(θ+p)Γ(θ/α+n)Γ(θ/α+1)∫0∞tp+θ−1e−tϕα(t)n−1ψα(t)−θ/α−n dt.E_{\alpha,\theta}(V_n^p)=\frac{\Gamma(1-\alpha)^{\theta/\alpha}}{\Gamma(n)}\frac{\Gamma(\theta+1)}{\Gamma(\theta+p)}\frac{\Gamma(\theta/\alpha+n)}{\Gamma(\theta/\alpha+1)}\int_0^\infty t^{p+\theta-1}e^{-t}\phi_\alpha(t)^{n-1}\psi_\alpha(t)^{-\theta/\alpha-n}\,dt .Eα,θ​(Vnp​)=Γ(n)Γ(1−α)θ/α​Γ(θ+p)Γ(θ+1)​Γ(θ/α+1)Γ(θ/α+n)​∫0∞​tp+θ−1e−tϕα​(t)n−1ψα​(t)−θ/α−ndt.

Milestones, in attack order

  1. (86): for X>0X>0X>0 a.s. and p>0p>0p>0, E[X−p]=1Γ(p)∫0∞tp−1E[e−tX] dtE[X^{-p}]=\frac1{\Gamma(p)}\int_0^\infty t^{p-1}E[e^{-tX}]\,dtE[X−p]=Γ(p)1​∫0∞​tp−1E[e−tX]dt.
  2. Proposition 26: under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), E[exp⁡(−λ/Vn)∣R1,…,Rn−1,Xn]=exp⁡(−λ(1+An−1))exp⁡[−Xn(ψα(λ)−1)]E[\exp(-\lambda/V_n)\mid R_1,\dots,R_{n-1},X_n]=\exp(-\lambda(1+A_{n-1}))\exp[-X_n(\psi_\alpha(\lambda)-1)]E[exp(−λ/Vn​)∣R1​,…,Rn−1​,Xn​]=exp(−λ(1+An−1​))exp[−Xn​(ψα​(λ)−1)].
  3. (36): under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), E[exp⁡(−λAn−1)]=ϕα(λ)n−1E[\exp(-\lambda A_{n-1})]=\phi_\alpha(\lambda)^{n-1}E[exp(−λAn−1​)]=ϕα​(λ)n−1.
  4. Under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), XnX_nXn​ is gamma(n)\mathrm{gamma}(n)gamma(n) and independent of An−1A_{n-1}An−1​.
  5. Lemma 27: under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), for ℓ>−1\ell>-1ℓ>−1, p>0p>0p>0, p+ℓα>0p+\ell\alpha>0p+ℓα>0,
E[LℓVnp]=Γ(ℓ+n)Γ(n)Γ(p+ℓα)∫0∞tp+ℓα−1e−tϕα(t)n−1ψα(t)−ℓ−n dt.E[L^\ell V_n^p]=\frac{\Gamma(\ell+n)}{\Gamma(n)\Gamma(p+\ell\alpha)}\int_0^\infty t^{p+\ell\alpha-1}e^{-t}\phi_\alpha(t)^{n-1}\psi_\alpha(t)^{-\ell-n}\,dt .E[LℓVnp​]=Γ(n)Γ(p+ℓα)Γ(ℓ+n)​∫0∞​tp+ℓα−1e−tϕα​(t)n−1ψα​(t)−ℓ−ndt.
  1. Proposition 14: Eα,θ[f(V)]=Cα,θEα,0[Lθ/αf(V)]E_{\alpha,\theta}[f(V)]=C_{\alpha,\theta}E_{\alpha,0}[L^{\theta/\alpha}f(V)]Eα,θ​[f(V)]=Cα,θ​Eα,0​[Lθ/αf(V)] for nonnegative measurable fff, and Cα,θ=1/Eα,0(Lθ/α)C_{\alpha,\theta}=1/E_{\alpha,0}(L^{\theta/\alpha})Cα,θ​=1/Eα,0​(Lθ/α).

Two consequences close the list: (50), np/αEα,θ(Vnp)→Cα,θ/Cα,θ+pn^{p/\alpha}E_{\alpha,\theta}(V_n^p)\to C_{\alpha,\theta}/C_{\alpha,\theta+p}np/αEα,θ​(Vnp​)→Cα,θ​/Cα,θ+p​, and Corollary 18, the PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) formula

E0,θ(Vnp)=Γ(θ)Γ(θ+p)θnΓ(n)∫0∞tp−1e−tE(t)n−1e−θE(t) dt,E(t)=∫t∞x−1e−xdx.E_{0,\theta}(V_n^p)=\frac{\Gamma(\theta)}{\Gamma(\theta+p)}\frac{\theta^n}{\Gamma(n)}\int_0^\infty t^{p-1}e^{-t}E(t)^{n-1}e^{-\theta E(t)}\,dt,\qquad E(t)=\int_t^\infty x^{-1}e^{-x}dx .E0,θ​(Vnp​)=Γ(θ+p)Γ(θ)​Γ(n)θn​∫0∞​tp−1e−tE(t)n−1e−θE(t)dt,E(t)=∫t∞​x−1e−xdx.

Significance

The ranked frequencies of PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) have no tractable joint density; their one-dimensional laws are known only through transforms. Proposition 17 makes every moment of VnV_nVn​ computable by a single quadrature, for all parameters at once. It yields the large-nnn decay (50), Vn≈(L/n)1/αV_n\approx(L/n)^{1/\alpha}Vn​≈(L/n)1/α in mean, and recovers the classical PD(0,θ)\mathrm{PD}(0,\theta)PD(0,θ) formula in the limit α↓0\alpha\downarrow0α↓0. The intermediate statements, the conditional Wendel formula and the joint moments E[LℓVnp]E[L^\ell V_n^p]E[LℓVnp​], are used elsewhere in the paper (Proposition 16, Lemma 29).

All statements are proved in the 1997 paper, except Proposition 14, which the paper quotes from Perman, Pitman and Yor (1992). To our knowledge none of them has been machine-checked. A formal development would produce the first verified construction of the Poisson–Dirichlet family in Lean, together with reusable facts about stick-breaking with beta variables, ranked rearrangements of sequences, and the Laplace-transform representation of negative moments.

Difficulty

The identity (86) and the final integration are elementary. The difficulty lies upstream. The naive route, computing E(Vnp)E(V_n^p)E(Vnp​) from the stick-breaking definition, fails: VnV_nVn​ is the nnn-th ranked value of the V~k\tilde V_kV~k​, and ranking destroys the product structure of the beta variables. The paper instead works under PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0), where the ranked sequence is the normalized sequence of points of a Poisson random measure (equivalently, transformed arrival times of a unit Poisson process). Proposition 14 is itself a deep change-of-measure result about stable subordinators, and the existence of the local time LLL is an almost sure limit theorem. Neither has any counterpart in Mathlib.

Formalization scope

Sequences are indexed from 000 in Lean: the paper's VnV_nVn​ is V ω (n-1), and statements "for n=1,2,…n=1,2,\dotsn=1,2,…" quantify over k : ℕ with n=k+1n=k+1n=k+1. PD(α,θ)\mathrm{PD}(\alpha,\theta)PD(α,θ) is defined exactly as Definition 1, with independent beta coordinates (Mathlib's betaMeasure) and the ranked values defined with Set.encard. The law is stated through preimages, so no measurability of the ranking map is presupposed. The local time LLL is carried as a random variable together with its defining almost sure limit (24). Expectations of quantities that may be infinite are lower integrals. The conditional expectation of Proposition 26 is stated through its defining property, for every nonnegative measurable test function of (R1,…,Rn−1,Xn)(R_1,\dots,R_{n-1},X_n)(R1​,…,Rn−1​,Xn​). The parameter ranges 0<α<10<\alpha<10<α<1, θ>−α\theta>-\alphaθ>−α (and θ>0\theta>0θ>0 at α=0\alpha=0α=0) are hypotheses wherever the page has them. Two hypotheses are added and disclosed: θ+p>0\theta+p>0θ+p>0 in Proposition 17 and p+ℓα>0p+\ell\alpha>0p+ℓα>0 in Lemma 27. Without them the printed ttt-integrals diverge and Γ\GammaΓ is evaluated at a pole or a negative argument, while the left sides are finite. Both follow from the printed hypotheses when θ≥0\theta\ge0θ≥0 (resp. ℓ≥0\ell\ge0ℓ≥0).

Trivializing encodings are ruled out: no law is written as an image measure of a possibly non-measurable map, no count uses Set.ncard, no limit uses limUnder, Cα,θC_{\alpha,\theta}Cα,θ​ is not defined as 1/E(Lθ/α)1/E(L^{\theta/\alpha})1/E(Lθ/α), and every Bochner integral in a statement is of an integrable function under the stated hypotheses, so no statement holds because of a junk value 000.

A complete development needs: infinite products of beta laws, the ranked rearrangement and its measurability, the Poisson-process representation of PD(α,0)\mathrm{PD}(\alpha,0)PD(α,0) (Proposition 10), and the change of measure of Proposition 14. These are reusable beyond this mission. Proofs of the general identity (86), of the gamma–independence milestone, and of Lemma 27 from its milestones are welcome independently.

Selected references

  • J. Pitman and M. Yor, The two-parameter Poisson–Dirichlet distribution derived from a stable subordinator, Ann. Probab. 25(2):855–900, 1997. https://doi.org/10.1214/aop/1024404422
  • M. Perman, J. Pitman and M. Yor, Size-biased sampling of Poisson point processes and excursions, Probab. Theory Related Fields 92:21–39, 1992. https://doi.org/10.1007/BF01205234
  • J. G. Wendel, Zero-free intervals of semi-stable Markov processes, Math. Scand. 14:21–34, 1964. https://doi.org/10.7146/math.scand.a-10703
  • J. F. C. Kingman, Random discrete distributions, J. Roy. Statist. Soc. Ser. B 37:1–22, 1975. https://doi.org/10.1111/j.2517-6161.1975.tb01024.x
10 thms2 active usersReviewed
AnalysisOperations ResearchStochastic Systems·Captain: mikedeng1

Implicit Renewal Theory and Tails of Solutions of Random Equations 3: Rate of Approach — t^κP(R > t) Equals C₊ Minus a Contour Integral Plus O(t^{−β/2})Research Paper

Motivation

Random equations of the form R=LΨ(R)R \overset{\mathcal L}{=} \Psi(R)R=LΨ(R), with Ψ\PsiΨ a random function independent of RRR, describe the stationary laws of many stochastic recursions: perpetuities in insurance and finance, the stationary law of ARCH-type volatility models, random difference equations R=Q+MRR = Q + MRR=Q+MR, and the stationary workload of certain queueing and storage models. When Ψ(t)\Psi(t)Ψ(t) acts like multiplication by a random variable MMM for large ∣t∣|t|∣t∣, and E∣M∣κ=1\mathbf E|M|^\kappa = 1E∣M∣κ=1 for some κ>0\kappa > 0κ>0, the solution has power-law tails: P(R>t)∼C+t−κP(R > t) \sim C_+ t^{-\kappa}P(R>t)∼C+​t−κ. This is the implicit renewal theorem of Goldie (Ann. Appl. Probab. 1991, Theorem 2.3), which recovers and extends Kesten's 1973 theorem on random difference equations.

A tail asymptotic alone says nothing about how fast tκP(R>t)t^\kappa P(R > t)tκP(R>t) approaches C+C_+C+​. For tail estimation, for the accuracy of extreme-quantile approximations used in risk management, and for second-order regular variation, the rate matters. Section 3 of the same paper answers this: under an exponential moment condition slightly beyond the Cramér condition, the error has an explicit second-order term determined by the zeros of 1−η^1 - \hat\eta1−η^​, where η\etaη is a tilted law of log⁡M\log MlogM, plus a remainder O(t−β/2)O(t^{-\beta/2})O(t−β/2).

Timeline: Kesten (1973) proved power tails for random difference equations; Grincevičius (1975) developed an implicit-renewal approach; Stone (1966) decomposed exponentially decaying renewal measures into an absolutely continuous part with explicit asymptotics and a finite part; Ganelius (1962) proved the Tauberian remainder theorem used to unsmooth; Goldie (1991) combined these into the rate result formalized here.

Setting

Let (Ω,A,P)(\Omega, \mathcal A, P)(Ω,A,P) be a probability space carrying independent real random variables M≥0M \ge 0M≥0 and RRR. Fix κ>0\kappa > 0κ>0 with EMκ=1\mathbf E M^\kappa = 1EMκ=1 (the Cramér condition, (2.3)) and β>0\beta > 0β>0 with EMκ+β<∞\mathbf E M^{\kappa+\beta} < \inftyEMκ+β<∞ (3.3).

The tilted law of MMM is the probability measure η(dx)=eκxP(log⁡M∈dx)\eta(dx) = e^{\kappa x} P(\log M \in dx)η(dx)=eκxP(logM∈dx) on R\mathbb RR, computed on {M>0}\{M > 0\}{M>0}. Its transforms are η~(β)=∫eβtη(dt)\tilde\eta(\beta) = \int e^{\beta t}\eta(dt)η~​(β)=∫eβtη(dt) for real β\betaβ and η^(θ)=∫eiθtη(dt)\hat\eta(\theta) = \int e^{i\theta t}\eta(dt)η^​(θ)=∫eiθtη(dt) for complex θ\thetaθ; for a function fff, f^(θ)=∫eiθtf(t) dt\hat f(\theta) = \int e^{i\theta t} f(t)\,dtf^​(θ)=∫eiθtf(t)dt. Convolution powers are η(0)=δ0\eta^{(0)} = \delta_0η(0)=δ0​, η(n+1)=η(n)∗η\eta^{(n+1)} = \eta^{(n)} * \etaη(n+1)=η(n)∗η, and the renewal measure is ν=∑n≥0η(n)\nu = \sum_{n \ge 0}\eta^{(n)}ν=∑n≥0​η(n). A law is spread out when some convolution power has a nonzero absolutely continuous component; (3.4) asks this of the conditional law of log⁡M\log MlogM given M≠0M \ne 0M=0.

Set m=EMκlog⁡Mm = \mathbf E M^\kappa \log Mm=EMκlogM and

g1(t)=eκt(P(R>et)−P(MR>et)),C+=1m∫0∞(P(R>t)−P(MR>t))tκ−1 dt,g_1(t) = e^{\kappa t}\big(P(R > e^t) - P(MR > e^t)\big), \qquad C_+ = \frac1m\int_0^\infty \big(P(R > t) - P(MR > t)\big) t^{\kappa - 1}\,dt,g1​(t)=eκt(P(R>et)−P(MR>et)),C+​=m1​∫0∞​(P(R>t)−P(MR>t))tκ−1dt,

with g−1g_{-1}g−1​ and C−C_-C−​ defined the same way for the lower tail. The strip is D={θ:−β<ℑθ<0}D = \{\theta : -\beta < \Im\theta < 0\}D={θ:−β<ℑθ<0}, and C\mathscr CC denotes a positively oriented closed contour in DDD enclosing every zero of 1−η^1 - \hat\eta1−η^​ in DDD.

Formalization targets

Goal: Theorem 3.2

If, in addition, η(n0)=(1−δ)φ0+δφ1\eta^{(n_0)} = (1 - \delta)\varphi_0 + \delta\varphi_1η(n0​)=(1−δ)φ0​+δφ1​ for some n0n_0n0​, with δ∈[0,1)\delta \in [0, 1)δ∈[0,1), φ0\varphi_0φ0​ absolutely continuous and δφ~1(β)<1\delta\tilde\varphi_1(\beta) < 1δφ~​1​(β)<1, and η^≠1\hat\eta \ne 1η^​=1 on ℑθ=−β\Im\theta = -\betaℑθ=−β, then ∫0∞∣P(R>t)−P(MR>t)∣ tκ+β−1dt<∞\int_0^\infty |P(R > t) - P(MR > t)|\,t^{\kappa+\beta-1}dt < \infty∫0∞​∣P(R>t)−P(MR>t)∣tκ+β−1dt<∞ implies

tκP(R>t)=C+−12π ℜ∮Ce−iθlog⁡t g^1(θ)1−η^(θ) dθ+O(t−β/2),t→∞,t^\kappa P(R > t) = C_+ - \frac1{2\pi}\,\Re\oint_{\mathscr C} e^{-i\theta\log t}\,\frac{\hat g_1(\theta)}{1 - \hat\eta(\theta)}\,d\theta + O(t^{-\beta/2}), \qquad t \to \infty,tκP(R>t)=C+​−2π1​ℜ∮C​e−iθlogt1−η^​(θ)g^​1​(θ)​dθ+O(t−β/2),t→∞,

with the analogous statement for P(R<−t)P(R < -t)P(R<−t); and if R=LΨ(R)R \overset{\mathcal L}{=} \Psi(R)R=LΨ(R) with RRR independent of (M,Ψ)(M, \Psi)(M,Ψ), the integrability hypotheses may be replaced by E∣(Ψ(R)±)κ+β−((MR)±)κ+β∣<∞\mathbf E|(\Psi(R)^\pm)^{\kappa+\beta} - ((MR)^\pm)^{\kappa+\beta}| < \inftyE∣(Ψ(R)±)κ+β−((MR)±)κ+β∣<∞. The theorem also asserts that η\etaη is a spread-out probability measure.

Milestones

  1. Lemma 9.5: Stone's inversion formula for the density of ∑nχ∗μ(n)\sum_n \chi * \mu^{(n)}∑n​χ∗μ(n).
  2. Theorem 3.1: the renewal measure splits as ν=ν0+ν1\nu = \nu_0 + \nu_1ν=ν0​+ν1​, ν1\nu_1ν1​ finite with ν~1(β)<∞\tilde\nu_1(\beta) < \inftyν~1​(β)<∞, ν0\nu_0ν0​ with continuous bounded density
p(t)=1m−12π∮Ce−iθtdθ1−η^(θ)+o(e−βt).p(t) = \frac1m - \frac1{2\pi}\oint_{\mathscr C} e^{-i\theta t}\frac{d\theta}{1 - \hat\eta(\theta)} + o(e^{-\beta t}).p(t)=m1​−2π1​∮C​e−iθt1−η^​(θ)dθ​+o(e−βt).
  1. (9.23) and (9.24): the smoothed identity and the smoothed rate K∗ℜr1(t)=o(e−βt)K * \Re r_1(t) = o(e^{-\beta t})K∗ℜr1​(t)=o(e−βt) for the kernel K(t)=be−bt1t>0K(t) = be^{-bt}\mathbf 1_{t>0}K(t)=be−bt1t>0​.
  2. Theorem 9.6: the Beurling–Ganelius Tauberian remainder theorem.

Significance

Theorem 3.2 turns the first-order tail asymptotic of the implicit renewal theorem into an expansion: the second-order terms are finitely many terms of the form (log⁡t)j−1tℑθl(\log t)^{j-1}t^{\Im\theta_l}(logt)j−1tℑθl​ times oscillating factors, one family for each zero θl\theta_lθl​ of 1−η^1 - \hat\eta1−η^​ with 0<−ℑθl≤β/20 < -\Im\theta_l \le \beta/20<−ℑθl​≤β/2, and their form does not depend on the unknown law of RRR. It applies to every random equation covered by the implicit renewal theorem once the stronger moment condition holds, including perpetuities and the random difference equation. Theorem 3.1 is of independent use: it is an explicit-rate version of Stone's decomposition of renewal measures with exponential moments.

The results are proved in the paper; none is formalized. Mathlib has the Fourier transform on the real line, convolution of measures, and rectangle Cauchy theorems, but no renewal theory, no Stone decomposition, and no Tauberian remainder theorem. Formalizing the mission produces a machine-checked renewal density expansion and a checked Beurling–Ganelius theorem, both reusable outside this paper.

Difficulty

The first-order theorem follows from the key renewal theorem applied to r(t)=eκtP(R>et)r(t) = e^{\kappa t}P(R > e^t)r(t)=eκtP(R>et). That route gives no rate: the key renewal theorem has no remainder, and the integrability hypothesis yields eβtg1∈L1e^{\beta t}g_1 \in L^1eβtg1​∈L1 but not eβtg1(t)=o(1)e^{\beta t}g_1(t) = o(1)eβtg1​(t)=o(1), so a remainder cannot be read off directly even with a spread-out step law. The proof therefore works with a smoothed version of rrr, where Stone's decomposition with the contour expansion of the renewal density gives an o(e−βt)o(e^{-\beta t})o(e−βt) remainder, and has to unsmooth. Unsmoothing is the Tauberian step: it requires a one-sided regularity condition on the unsmoothed function, verified for rrr and for the contour term, and costs half the exponent. The contour expansion itself requires showing that 1−η^1 - \hat\eta1−η^​ has finitely many zeros in the strip and handling their orders through residues.

Formalization scope

All objects live in the namespace GoldieRenewal.Rates. Random variables are measurable maps Ω→R\Omega \to \mathbb RΩ→R on a probability space; M≥0M \ge 0M≥0 almost surely; independence is IndepFun. Tail probabilities are real numbers P.real {ω | t < R ω}. Moments such as EMκ+β\mathbf E M^{\kappa+\beta}EMκ+β and μ~(β)\tilde\mu(\beta)μ~​(β) are lower Lebesgue integrals in [0,∞][0, \infty][0,∞]. The transforms μ^\hat\muμ^​ and f^\hat ff^​ are Bochner integrals at complex arguments with the +i+i+i sign of the paper. Asymptotic statements use Asymptotics.IsBigO and IsLittleO along atTop.

The contour. A contour C\mathscr CC is the positively oriented boundary of an axis-parallel rectangle whose closure lies in DDD and whose interior contains every zero of 1−η^1 - \hat\eta1−η^​ in DDD; the contour integral is the sum of the four edge integrals (RectangleIntegral, from the published ResidueCalcOnRectangles_defs). Expansions are stated for every such rectangle.

The variable in (3.8) and (3.10). The paper prints e−iθte^{-i\theta t}e−iθt in the contour term, but its proof establishes the expansion in the logarithmic variable s=log⁡ts = \log ts=logt. The targets are stated with e−iθlog⁡te^{-i\theta\log t}e−iθlogt, which is what the proof gives. With the printed e−iθte^{-i\theta t}e−iθt the contour term would decay exponentially and the statement would claim tκP(R>t)=C++O(t−β/2)t^\kappa P(R > t) = C_+ + O(t^{-\beta/2})tκP(R>t)=C+​+O(t−β/2), which is not what is proved. Hypothesis (3.7) is printed with P(R>−t)P(R > -t)P(R>−t) and is read with P(R>t)P(R > t)P(R>t).

Excluded trivializations. The contour term may not be dropped; the hypotheses do not exclude zeros of 1−η^1 - \hat\eta1−η^​ in DDD; and the contour must enclose all zeros in the strip, not a chosen subset.

Theorem 9.6 is stated for a complex-valued kernel and a finite strip width aaa; the application with a=∞a = \inftya=∞ follows by restricting to a finite strip. Lemma 9.5 carries an added hypothesis that the density of χ\chiχ has compact support, which the proof uses and the application provides.

Contributions welcome: renewal-measure infrastructure (convolution powers, Blackwell-type limits), Fourier analysis of measures at complex arguments, residue computations on rectangles, and Tauberian remainder theory. Each is reusable well beyond this paper.

Selected references

  • C. M. Goldie, Implicit renewal theory and tails of solutions of random equations, Ann. Appl. Probab. 1(1):126–166, 1991. https://doi.org/10.1214/aoap/1177005985
  • H. Kesten, Random difference equations and renewal theory for products of random matrices, Acta Math. 131:207–248, 1973. https://doi.org/10.1007/BF02392040
  • C. Stone, On absolutely continuous components and renewal theory, Ann. Math. Statist. 37(1):271–275, 1966. https://doi.org/10.1214/aoms/1177699617
  • T. H. Ganelius, The remainder in Wiener's Tauberian theorem, Acta Univ. Gothoburgensis, Mathematica Gothoburgensia 1, 1962 (cited in Goldie 1991).
  • A. K. Grincevičius, One limit distribution for a random walk on the line, Lithuanian Math. J. 15:580–589, 1975 (cited in Goldie 1991).
12 thms2 active usersReviewed
Control TheoryStochastic Systems·Captain: mikedeng1

Backward-Forward Stochastic Differential Equations 3: A Linear Backward-Forward System with Lipschitz Constant 1 Has No Solution on a Horizon T ≥ 1Research Paper

Motivation

A forward equation evolves from an initial random value, while a backward equation is constrained by a terminal random value. When the two unknown processes appear in both equations, these boundary conditions can be incompatible. Such coupled systems occur in stochastic control, where a state moves forward and a cost or adjoint variable is determined backward. Antonelli's 1993 paper studies existence and uniqueness for a class of backward–forward stochastic differential equations and gives explicit examples showing why its smallness assumption on the coefficients cannot be discarded (Antonelli 1993, §§1 and 3).

This mission formalizes the first of those examples. It is a deliberately small two-equation system: both integrators are ordinary time, the coefficients are deterministic, and the Lipschitz constant is one. Nevertheless, the system has no solution when the time horizon reaches one. The claim identifies a genuine boundary for the paper's existence result rather than a failure caused by exotic stochastic integration. Antonelli presents it immediately after the existence theorem to show what can go wrong beyond the theorem's coefficient bound (Antonelli 1993, Theorem 3.1 and Example 1).

Setting

Fix a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) and a filtration (Ft)t≥0(\mathcal F_t)_{t\ge0}(Ft​)t≥0​. The filtration satisfies the usual hypotheses: it is right-continuous, and F0\mathcal F_0F0​ contains every subset of every PPP-null set. Let T>0T>0T>0 be a deterministic horizon. The initial random variable J0J_0J0​ is F0\mathcal F_0F0​-measurable, and the terminal random variable YYY is FT\mathcal F_TFT​-measurable. Both are integrable and strictly positive almost surely. These choices specialize the filtered space and input assumptions of §3 to Example 1 (Antonelli 1993, pp. 777, 785, 790).

The unknowns are two real-valued stochastic processes U=(Ut)U=(U_t)U=(Ut​) and V=(Vt)V=(V_t)V=(Vt​). Their norm is

∥X∥L1(dt⊗P)=EP ⁣[∫0T∣Xt∣ dt].\|X\|_{L^1(dt\otimes P)}=E_P\!\left[\int_0^T |X_t|\,dt\right].∥X∥L1(dt⊗P)​=EP​[∫0T​∣Xt​∣dt].

Thus a solution is a pair in L1(dt⊗P)2L^1(dt\otimes P)^2L1(dt⊗P)2 of adapted processes satisfying a forward integral equation and a backward conditional-expectation equation almost surely at each time t≤Tt\le Tt≤T. Under the usual hypotheses every L1L^1L1-class solution has such a representative, so this is the paper's L1(μ)⊗L1(μ)L^1(\mu)\otimes L^1(\mu)L1(μ)⊗L1(μ) solution class. The system uses At=Ct=tA_t=C_t=tAt​=Ct​=t and the constant input process Jt=J0J_t=J_0Jt​=J0​. In this specialization, the measure μ\muμ used in the paper is dt⊗Pdt\otimes Pdt⊗P, and the variation control process is Dt=tD_t=tDt​=t (Antonelli 1993, (3.1)–(3.3), pp. 785–786).

The forward coefficient is f(u,v)=u+∣v∣f(u,v)=u+|v|f(u,v)=u+∣v∣ and the backward coefficient is g(u,v)=u+vg(u,v)=u+vg(u,v)=u+v. Each has Lipschitz constant one with respect to ∣u−u′∣+∣v−v′∣|u-u'|+|v-v'|∣u−u′∣+∣v−v′∣. The absolute value is part of the example: it appears in the forward equation and does not appear in the backward equation (Antonelli 1993, (3.6)–(3.7), p. 790).

Formalization targets

Main goal

For every horizon T≥1T\ge1T≥1 and all data satisfying the assumptions above, there is no pair (U,V)∈L1(dt⊗P)2(U,V)\in L^1(dt\otimes P)^2(U,V)∈L1(dt⊗P)2 satisfying

Ut=J0+∫0t(Us+∣Vs∣) ds,Vt=EP ⁣[∫tT(Us+Vs) ds+Y∣Ft].U_t=J_0+\int_0^t(U_s+|V_s|)\,ds,\qquad V_t=E_P\!\left[\int_t^T(U_s+V_s)\,ds+Y\mid\mathcal F_t\right].Ut​=J0​+∫0t​(Us​+∣Vs​∣)ds,Vt​=EP​[∫tT​(Us​+Vs​)ds+Y∣Ft​].

This is Example 1's conclusion, including the boundary case T=1T=1T=1 (Antonelli 1993, pp. 790–791).

Intermediate targets

The milestones follow the four statements written in the example: representations of UUU and VVV in terms of each other, positivity and passage to the linear system (3.8)–(3.9), the martingale identity for their sum, and the identity β(1−T)=EP[J0+Y]>0\beta(1-T)=E_P[J_0+Y]>0β(1−T)=EP​[J0​+Y]>0 for its constant mean β\betaβ. Their full text and page provenance are attached to the milestone list. The goal remains nonexistence for every T≥1T\ge1T≥1; it does not assert a particular formula for a solution.

Significance

The preceding existence theorem assumes a coefficient bound that becomes kT<1kT<1kT<1 in this time-integrator case. Example 1 has k=1k=1k=1 and shows that the system can fail to have a solution as soon as that strict inequality fails. At T=1T=1T=1, the obstruction is already present, so replacing T≥1T\ge1T≥1 by T>1T>1T>1 would lose part of the paper's conclusion (Antonelli 1993, p. 791).

A formalization would make the failure precise for the same L1L^1L1 solution class used by the paper. The current mission contains compile-checked Lean statements and definitions; the theorem proofs are still open. A complete development would also provide reusable statements about jointly measurable conditional-expectation versions, finite-horizon time integrals of processes, and martingales arising from coupled equations. These can support the paper's neighboring existence and nonsingular-example missions.

Difficulty

The main difficulty is the coupling between the two boundary conditions. The forward equation starts at J0J_0J0​, while the backward equation ends at YYY; neither equation can be treated as an independent ordinary differential equation. The absolute value in the forward coefficient also prevents the coupled system from being treated as a linear system at the outset. A second difficulty for Lean is that conditional expectation is defined only up to almost-sure equality at each fixed time, whereas the solution equations are equalities over time and probability together. The formal statement must connect these two kinds of almost-everywhere equality without strengthening the theorem to an identity at every time on every sample path.

Formalization scope

Time is represented by R≥0\mathbb R_{\ge0}R≥0​, with only (0,T](0,T](0,T] used in the L1L^1L1 norm. Time integration is Lebesgue integration on (s,t](s,t](s,t]; endpoints have zero dtdtdt mass. The norm is an extended nonnegative lintegral, so a nonintegrable process cannot be assigned the value zero by a real-valued integral's fallback convention. The random variable inside each conditional expectation is required to be integrable. The conditional-expectation process is a jointly measurable version whose value at each time agrees almost surely with the conditional expectation. The solution predicate asks, for each t≤Tt\le Tt≤T, that UtU_tUt​ and VtV_tVt​ be Ft\mathcal F_tFt​-measurable, that the two equations hold PPP-almost surely, and that the time integrands be integrable along almost every path. Any L1L^1L1-class solution can be replaced by such a representative, J0+∫0tf(Us,Vs) dsJ_0+\int_0^t f(U_s,V_s)\,dsJ0​+∫0t​f(Us​,Vs​)ds and the conditional-expectation version, so non-existence in this class is non-existence in the paper's class. For the Lipschitz coefficients in this example, finite L1(dt⊗P)L^1(dt\otimes P)L1(dt⊗P) norm gives pathwise integrability almost surely for the time integrals used in the equations.

The paper calls J0J_0J0​ and YYY “positive.” Here that means strictly positive almost surely. The weaker nonnegative reading would admit the zero pair when both data are zero and would falsify the target. Integrability of J0J_0J0​ makes explicit §3's standing bound on the constant input process. The completeness and right-continuity of the filtration are also explicit. The solution class and equations are defined for general T>0T>0T>0; the restriction T≥1T\ge1T≥1 belongs only to the nonexistence theorem. For example, on a one-point probability space with T=1/2T=1/2T=1/2, J0=Y=1J_0=Y=1J0​=Y=1, the deterministic pair Ut=1+4tU_t=1+4tUt​=1+4t, Vt=3−4tV_t=3-4tVt​=3−4t solves the equations on [0,1/2][0,1/2][0,1/2]. This rules out a definition that makes all solutions impossible by construction.

The development needs Mathlib's filtration, conditional expectation, probability measure, and integration APIs. Contributions proving the milestone statements or supplying reusable lemmas for their L1L^1L1 and martingale interfaces fit the mission. No semimartingale stochastic integral is required for this example.

Selected references

  • F. Antonelli, Backward-forward stochastic differential equations, Annals of Applied Probability 3(3), 777–793, 1993. DOI: 10.1214/aoap/1177005363.
8 thms2 active usersReviewed
Control TheoryOperations ResearchStochastic Systems·Captain: mikedeng1

Reflected Solutions of Backward SDE's, and Related Obstacle Problems for PDE's 2: With a Concave Coefficient, the Reflected BSDE Is the Value of a Minimax Optimal Stopping–Control ProblemResearch Paper

Motivation

A backward stochastic differential equation (BSDE) prescribes the terminal value of an adapted process instead of its initial value. Pardoux and Peng (1990) proved existence and uniqueness for Lipschitz coefficients, and BSDEs have since become a standard tool in stochastic control, mathematical finance and the probabilistic treatment of semilinear PDEs. El Karoui, Kapoudjian, Pardoux, Peng and Quenez (1997) introduced the reflected BSDE, whose solution is constrained to stay above a given obstacle process. Reflected BSDEs describe the price of American options in nonlinear markets (El Karoui, Pardoux and Quenez 1997), Dynkin games (Cvitanić and Karatzas 1996), and obstacle problems for parabolic PDEs.

In §7 of the 1997 paper the coefficient is assumed concave. Then the solution of the reflected BSDE is the value of a game: one player chooses a stopping time, the other chooses a control that sets the discount rate and the change of measure, and the value does not depend on which player moves first. This mission formalizes that statement (Theorem 7.2) and the results its proof uses.

Setting

Let (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) carry a ddd-dimensional standard Brownian motion BBB, fix a horizon T≥0T\ge0T≥0, and let Ft\mathcal F_tFt​ be the natural filtration of BBB augmented by the PPP-null sets. Write L2\mathbb L^2L2 for the square-integrable FT\mathcal F_TFT​-measurable random variables, H2\mathbb H^2H2 for the progressively measurable processes φ\varphiφ with E∫0T∣φt∣2dt<∞E\int_0^T|\varphi_t|^2dt<\inftyE∫0T​∣φt​∣2dt<∞, and S2\mathcal S^2S2 for those with Esup⁡t≤T∣φt∣2<∞E\sup_{t\le T}|\varphi_t|^2<\inftyEsupt≤T​∣φt​∣2<∞.

The data are a terminal value ξ∈L2\xi\in\mathbb L^2ξ∈L2; a coefficient f(ω,t,y,z)f(\omega,t,y,z)f(ω,t,y,z), y∈Ry\in\mathbb Ry∈R, z∈Rdz\in\mathbb R^dz∈Rd, with f(⋅,y,z)∈H2f(\cdot,y,z)\in\mathbb H^2f(⋅,y,z)∈H2 for every (y,z)(y,z)(y,z) and Lipschitz in (y,z)(y,z)(y,z) with a constant KKK; and a continuous progressively measurable obstacle SSS with Esup⁡t(St+)2<∞E\sup_t(S_t^+)^2<\inftyEsupt​(St+​)2<∞ and ST≤ξS_T\le\xiST​≤ξ. A solution of the reflected BSDE is a triple (Y,Z,K)(Y,Z,K)(Y,Z,K) of progressively measurable processes with Z∈H2Z\in\mathbb H^2Z∈H2, Y∈S2Y\in\mathcal S^2Y∈S2, KT∈L2K_T\in\mathbb L^2KT​∈L2, and

Yt=ξ+∫tTf(s,Ys,Zs) ds+KT−Kt−∫tT(Zs,dBs),Yt≥St,Y_t=\xi+\int_t^Tf(s,Y_s,Z_s)\,ds+K_T-K_t-\int_t^T(Z_s,dB_s),\qquad Y_t\ge S_t,Yt​=ξ+∫tT​f(s,Ys​,Zs​)ds+KT​−Kt​−∫tT​(Zs​,dBs​),Yt​≥St​,

where KKK is continuous, nondecreasing, K0=0K_0=0K0​=0 and ∫0T(Yt−St) dKt=0\int_0^T(Y_t-S_t)\,dK_t=0∫0T​(Yt​−St​)dKt​=0: KKK pushes YYY up only when YYY touches SSS.

For t≤Tt\le Tt≤T, Tt\mathcal T_tTt​ is the set of stopping times vvv with t≤v≤Tt\le v\le Tt≤v≤T. When f(ω,t,⋅,⋅)f(\omega,t,\cdot,\cdot)f(ω,t,⋅,⋅) is concave, its conjugate is

F(ω,t,β,γ)=sup⁡(y,z)[f(ω,t,y,z)−βy−⟨γ,z⟩]∈(−∞,+∞].F(\omega,t,\beta,\gamma)=\sup_{(y,z)}\big[f(\omega,t,y,z)-\beta y-\langle\gamma,z\rangle\big]\in(-\infty,+\infty].F(ω,t,β,γ)=(y,z)sup​[f(ω,t,y,z)−βy−⟨γ,z⟩]∈(−∞,+∞].

The admissible controls A\mathcal AA are the bounded progressively measurable (βt,γt)(\beta_t,\gamma_t)(βt​,γt​) with E∫0TF(t,βt,γt)2dt<∞E\int_0^TF(t,\beta_t,\gamma_t)^2dt<\inftyE∫0T​F(t,βt​,γt​)2dt<∞. Each (β,γ)∈A(\beta,\gamma)\in\mathcal A(β,γ)∈A gives the affine coefficient fβ,γ(t,y,z)=F(t,βt,γt)+βty+⟨γt,z⟩f^{\beta,\gamma}(t,y,z)=F(t,\beta_t,\gamma_t)+\beta_ty+\langle\gamma_t,z\ranglefβ,γ(t,y,z)=F(t,βt​,γt​)+βt​y+⟨γt​,z⟩, its reflected BSDE solution Yβ,γY^{\beta,\gamma}Yβ,γ, the process Γt,sβ,γ\Gamma^{\beta,\gamma}_{t,s}Γt,sβ,γ​ solving dΓt,s=Γt,s(βsds+(γs,dBs))d\Gamma_{t,s}=\Gamma_{t,s}(\beta_sds+(\gamma_s,dB_s))dΓt,s​=Γt,s​(βs​ds+(γs​,dBs​)), Γt,t=1\Gamma_{t,t}=1Γt,t​=1, and the payoff

Φ(t,v,β,γ)=Γt,vβ,γ[Sv1{v<T}+ξ1{v=T}]+∫tvΓt,sβ,γF(s,βs,γs) ds.\Phi(t,v,\beta,\gamma)=\Gamma^{\beta,\gamma}_{t,v}\big[S_v1_{\{v<T\}}+\xi1_{\{v=T\}}\big]+\int_t^v\Gamma^{\beta,\gamma}_{t,s}F(s,\beta_s,\gamma_s)\,ds.Φ(t,v,β,γ)=Γt,vβ,γ​[Sv​1{v<T}​+ξ1{v=T}​]+∫tv​Γt,sβ,γ​F(s,βs​,γs​)ds.

Formalization targets

Goal: Theorem 7.2 (p. 725)

For every t∈[0,T]t\in[0,T]t∈[0,T] and (β,γ)∈A(\beta,\gamma)\in\mathcal A(β,γ)∈A, Ytβ,γ=ess sup⁡v∈TtE[Φ(t,v,β,γ)∣Ft]Y^{\beta,\gamma}_t=\operatorname{ess\,sup}_{v\in\mathcal T_t}E[\Phi(t,v,\beta,\gamma)\mid\mathcal F_t]Ytβ,γ​=esssupv∈Tt​​E[Φ(t,v,β,γ)∣Ft​], and

Yt=ess inf⁡AYtβ,γ=ess inf⁡Aess sup⁡v∈TtE[Φ∣Ft]=ess sup⁡v∈Ttess inf⁡AE[Φ∣Ft].Y_t=\operatorname*{ess\,inf}_{\mathcal A}Y^{\beta,\gamma}_t=\operatorname*{ess\,inf}_{\mathcal A}\operatorname*{ess\,sup}_{v\in\mathcal T_t}E[\Phi\mid\mathcal F_t]=\operatorname*{ess\,sup}_{v\in\mathcal T_t}\operatorname*{ess\,inf}_{\mathcal A}E[\Phi\mid\mathcal F_t].Yt​=Aessinf​Ytβ,γ​=Aessinf​v∈Tt​esssup​E[Φ∣Ft​]=v∈Tt​esssup​Aessinf​E[Φ∣Ft​].

The last equality, the interchange of the two essential extrema, is the minimax content.

Milestones

  1. Theorem 4.1 (p. 712): comparison. If ξ≤ξ′\xi\le\xi'ξ≤ξ′, f≤f′f\le f'f≤f′ and S≤S′S\le S'S≤S′, and one of f,f′f,f'f,f′ is Lipschitz, then Y≤Y′Y\le Y'Y≤Y′.
  2. §7 conjugacy (p. 724): a concave Lipschitz fff equals min⁡(β,γ)∈DtF{F(t,β,γ)+βy+⟨γ,z⟩}\min_{(\beta,\gamma)\in D^F_t}\{F(t,\beta,\gamma)+\beta y+\langle\gamma,z\rangle\}min(β,γ)∈DtF​​{F(t,β,γ)+βy+⟨γ,z⟩}, the minimum is attained, and the domain DtFD^F_tDtF​ of FFF is a.s. bounded.
  3. Proposition 7.1 (p. 724): for an affine coefficient δt+βty+⟨γt,z⟩\delta_t+\beta_ty+\langle\gamma_t,z\rangleδt​+βt​y+⟨γt​,z⟩, ΓtYt=ess sup⁡v∈TtE[Γvξ1{v=T}+ΓvSv1{v<T}+∫tvΓsδsds∣Ft]\Gamma_tY_t=\operatorname{ess\,sup}_{v\in\mathcal T_t}E[\Gamma_v\xi1_{\{v=T\}}+\Gamma_vS_v1_{\{v<T\}}+\int_t^v\Gamma_s\delta_sds\mid\mathcal F_t]Γt​Yt​=esssupv∈Tt​​E[Γv​ξ1{v=T}​+Γv​Sv​1{v<T}​+∫tv​Γs​δs​ds∣Ft​].
  4. §7 optimal control (p. 725): some (β∗,γ∗)∈A(\beta^*,\gamma^*)\in\mathcal A(β∗,γ∗)∈A satisfies f(t,Yt,Zt)=F(t,βt∗,γt∗)+βt∗Yt+⟨γt∗,Zt⟩f(t,Y_t,Z_t)=F(t,\beta^*_t,\gamma^*_t)+\beta^*_tY_t+\langle\gamma^*_t,Z_t\ranglef(t,Yt​,Zt​)=F(t,βt∗​,γt∗​)+βt∗​Yt​+⟨γt∗​,Zt​⟩ dt×dPdt\times dPdt×dP-a.e., so (Y,Z,K)(Y,Z,K)(Y,Z,K) solves the reflected BSDE with coefficient fβ∗,γ∗f^{\beta^*,\gamma^*}fβ∗,γ∗.

Significance

Theorem 7.2 identifies the solution of a nonlinear reflected BSDE with the value of a zero-sum game between a stopper and a controller. In finance, with fff the driver of a pricing rule under constraints or ambiguity, it says that the nonlinear price of an American claim is the worst case, over a family of discount rates and changes of measure, of linear American prices; and the stopper may announce the stopping rule first without changing the value. Concave drivers include the hedging equations with different borrowing and lending rates. The representation reduces questions about the nonlinear equation to a family of linear ones, which is how monotonicity, convexity and stability properties of nonlinear American prices are usually derived.

All four results and the goal are proved in the paper, with references to standard convex analysis and a measurable section theorem for two steps. None of them has a machine-checked proof. Mathlib has Brownian motion, filtrations, stopping times and conditional expectation, but no stochastic integral; the mission uses the Itô integral of the published Peng1990.SMP.Stochastic layer. A formal proof would give, beyond the theorem, a reusable comparison theorem for reflected BSDEs, a Snell-envelope representation for linear reflected BSDEs, and a measurable selection of supergradients along a process.

Difficulty

The inequality Yt≤Ytβ,γY_t\le Y^{\beta,\gamma}_tYt​≤Ytβ,γ​ for each control is a direct consequence of comparison, since f≤fβ,γf\le f^{\beta,\gamma}f≤fβ,γ. The difficulty is the reverse inequality, which needs a single admissible control that attains the conjugate representation along the solution (Y,Z)(Y,Z)(Y,Z) for almost every (t,ω)(t,\omega)(t,ω). Choosing a supergradient pointwise is easy; choosing it progressively measurable, bounded, and with F(t,βt∗,γt∗)F(t,\beta^*_t,\gamma^*_t)F(t,βt∗​,γt∗​) square integrable is a measurable-selection problem. The interchange of ess inf and ess sup does not follow from a general minimax theorem: the family A\mathcal AA is not compact and the payoff is not convex–concave in any usable topology. It uses a specific stopping time, the first time YYY touches SSS, together with comparison on the random interval before it. Proposition 7.1 requires the linear change of variables ΓtYt\Gamma_tY_tΓt​Yt​, whose transformed equation lacks the square integrability of the original one, so the Snell-envelope argument has to be rerun with weaker moments.

Formalization scope

  • Time and spaces. Time is R≥0\mathbb R_{\ge0}R≥0​ with T:R≥0T:\mathbb R_{\ge0}T:R≥0​, and time integrals run over [t,T]⊂R[t,T]\subset\mathbb R[t,T]⊂R. H2\mathbb H^2H2 is the published L2F (progressive in place of predictable); S2\mathcal S^2S2 and the obstacle condition are lower Lebesgue integrals in [0,∞][0,\infty][0,∞].
  • Filtration. The natural filtration of BBB joined with the σ-algebra of PPP-null sets.
  • Norms. ∣z∣|z|∣z∣ is the Euclidean norm and ⟨γ,z⟩=∑jγjzj\langle\gamma,z\rangle=\sum_j\gamma_jz_j⟨γ,z⟩=∑j​γj​zj​.
  • Lipschitz condition. Read as: almost surely, for all t≤Tt\le Tt≤T and all y,y′,z,z′y,y',z,z'y,y′,z,z′.
  • Solutions. Solutions are in the square-integrable class (v)–(viii). YYY has continuous paths. Equation (vi) holds for each ttt almost surely, and Y≥SY\ge SY≥S holds almost surely for all ttt. KKK is continuous and nondecreasing on every path. ∫0T(Y−S) dK=0\int_0^T(Y-S)\,dK=0∫0T​(Y−S)dK=0 is taken against the Lebesgue–Stieltjes measure of the path of KKK.
  • Extended values. FFF takes values in the extended reals. F2F^2F2 in the definition of A\mathcal AA is taken in [0,∞][0,\infty][0,∞], so admissibility forces F<∞F<\inftyF<∞ almost everywhere along the control.
  • Stochastic exponential. Γt,sβ,γ\Gamma^{\beta,\gamma}_{t,s}Γt,sβ,γ​ is the Doléans-Dade exponential, built from Itô integrals of γ\gammaγ with continuous paths.
  • Essential extrema. They are predicates relative to Ft\mathcal F_tFt​, real valued: the essential infimum is the published MultiperiodRisk.Bellman.EssInf, and the essential supremum is its mirror image.
  • Added hypothesis. S∈S2S\in\mathcal S^2S∈S2 is assumed wherever a conditional expectation of the payoff appears (Remark 3.2: without loss of generality). Otherwise the payoff may fail to be integrable, and Lean's conditional expectation of a non-integrable function is 000.
  • Hypothesized families. The solutions Yβ,γY^{\beta,\gamma}Yβ,γ and the Itô integrals defining Γβ,γ\Gamma^{\beta,\gamma}Γβ,γ are hypotheses indexed by A\mathcal AA. They exist by the existence theorem of the first mission of this series and by continuity of Itô integrals.

Several formalizations of the goal would make it trivial, and each is ruled out. The conjugate is not a real-valued supremum, which takes a junk value when unbounded. The essential infimum over A\mathcal AA is not a pointwise infimum. The interchange of ess inf and ess sup is not dropped. The coefficient is a random field f(ω,t,y,z)f(\omega,t,y,z)f(ω,t,y,z), not a deterministic or Markovian one.

The closing gloss of Theorem 7.2, that the triple (β∗,γ∗,Dt)(\beta^*,\gamma^*,D_t)(β∗,γ∗,Dt​) is optimal, is not stated separately; milestone 4 is its control half. Contributions are welcome on a continuous version of the Itô integral, Itô's formula for products with Γ\GammaΓ, the Snell envelope in continuous time, and measurable selection of supergradients; all of these are reusable beyond this mission.

Selected references

  • N. El Karoui, C. Kapoudjian, É. Pardoux, S. Peng, M.-C. Quenez, Reflected solutions of backward SDE's, and related obstacle problems for PDE's, Ann. Probab. 25(2), 1997, 702–737. https://doi.org/10.1214/aop/1024404416
  • É. Pardoux, S. Peng, Adapted solution of a backward stochastic differential equation, Systems Control Lett. 14, 1990, 55–61. https://doi.org/10.1016/0167-6911(90)90082-6
  • N. El Karoui, S. Peng, M.-C. Quenez, Backward stochastic differential equations in finance, Math. Finance 7(1), 1997, 1–71. https://doi.org/10.1111/1467-9965.00022
  • J. Cvitanić, I. Karatzas, Backward stochastic differential equations with reflection and Dynkin games, Ann. Probab. 24(4), 1996, 2024–2056. https://doi.org/10.1214/aop/1041903216
  • S. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim. 28(4), 1990, 966–979. https://doi.org/10.1137/0328054
10 thms2 active usersReviewed
Functional AnalysisMarkov Chain·Captain: mikedeng1

Logarithmic Sobolev Inequalities for Finite Markov Chains 3: Lower Bound α ≥ (1 − 2/q)λ / 2(λt_q + log M_q + (q − 2)/q) from a Bound on ‖H_{t_q}‖_{2→q}Research Paper

Motivation

A finite Markov chain describes a system that changes state according to fixed transition probabilities. For a chain that settles toward an equilibrium distribution, a central question is how quickly the effect of its starting state disappears. The logarithmic Sobolev constant supplies quantitative control of this convergence and, through hypercontractive estimates, also governs how the continuous-time transition operator changes the size of functions measured in different norms. Diaconis and Saloff-Coste's 1996 paper develops these relations for finite chains and uses them to study mixing on graphs and product spaces.

The constant can be hard to calculate directly. Its definition is an infimum over all nonconstant functions, while a particular Markov semigroup may admit an accessible bound from ℓ2\ell^2ℓ2 to ℓq\ell^qℓq at one time. Theorem 3.9 turns such an operator estimate into a numerical lower bound for the log-Sobolev constant. This mission formalizes that result, including both finite qqq and the supremum-norm endpoint.

Setting

Let X\mathcal XX be a finite state space. A Markov kernel K(x,y)K(x,y)K(x,y) is nonnegative, with ∑yK(x,y)=1\sum_yK(x,y)=1∑y​K(x,y)=1 for every xxx. A strictly positive stationary distribution π\piπ satisfies ∑xπ(x)K(x,y)=π(y)\sum_x\pi(x)K(x,y)=\pi(y)∑x​π(x)K(x,y)=π(y) and ∑xπ(x)=1\sum_x\pi(x)=1∑x​π(x)=1. The chain is reversible when π(x)K(x,y)=π(y)K(y,x)\pi(x)K(x,y)=\pi(y)K(y,x)π(x)K(x,y)=π(y)K(y,x) for every pair of states. Its continuous-time heat semigroup is Ht=e−t(I−K)H_t=e^{-t(I-K)}Ht​=e−t(I−K), acting on a function fff by HtfH_tfHt​f. These conventions follow §§2.1–2.3 of the source paper.

For a real function on X\mathcal XX, write ∥f∥p=(∑x∣f(x)∣pπ(x))1/p\|f\|_p=(\sum_x|f(x)|^p\pi(x))^{1/p}∥f∥p​=(∑x​∣f(x)∣pπ(x))1/p when ppp is finite, and ∥f∥∞=max⁡x∣f(x)∣\|f\|_\infty=\max_x|f(x)|∥f∥∞​=maxx​∣f(x)∣. The Dirichlet form is E(f,g)=∑x(f(x)−Kf(x))g(x)π(x)\mathcal E(f,g)=\sum_x(f(x)-Kf(x))g(x)\pi(x)E(f,g)=∑x​(f(x)−Kf(x))g(x)π(x). The quadratic entropy functional is L(f)=∑x∣f(x)∣2log⁡(∣f(x)∣2/∥f∥22)π(x)\mathcal L(f)=\sum_x|f(x)|^2\log(|f(x)|^2/\|f\|_2^2)\pi(x)L(f)=∑x​∣f(x)∣2log(∣f(x)∣2/∥f∥22​)π(x), with a zero contribution where f(x)=0f(x)=0f(x)=0. Write Ef=∑xf(x)π(x)Ef=\sum_xf(x)\pi(x)Ef=∑x​f(x)π(x) and Var⁡π(f)=∥f−Ef∥22\operatorname{Var}_\pi(f)=\|f-Ef\|_2^2Varπ​(f)=∥f−Ef∥22​.

The spectral gap in this mission is the variational constant λ=inf⁡Var⁡π(f)≠0E(f,f)/Var⁡π(f)\lambda=\inf_{\operatorname{Var}_\pi(f)\ne0}\mathcal E(f,f)/\operatorname{Var}_\pi(f)λ=infVarπ​(f)=0​E(f,f)/Varπ​(f), as in (2.4). The log-Sobolev constant is α=inf⁡L(f)≠0E(f,f)/L(f)\alpha=\inf_{\mathcal L(f)\ne0}\mathcal E(f,f)/\mathcal L(f)α=infL(f)=0​E(f,f)/L(f), as in (3.1). These definitions specify the quantities that Theorem 3.9 relates; in particular, λ\lambdaλ is the paper's variational quantity, rather than an eigenvalue expression imported from a different convention.

Formalization targets

Theorem 3.9: a single heat-operator estimate bounds α\alphaα

Suppose 2<q<∞2<q<\infty2<q<∞, tq>0t_q>0tq​>0, and MqM_qMq​ satisfy ∥Htqf∥q≤Mq∥f∥2\|H_{t_q}f\|_q\le M_q\|f\|_2∥Htq​​f∥q​≤Mq​∥f∥2​ for every function fff. The paper's theorem asserts

α≥(1−2/q)λ2(λtq+log⁡Mq+(q−2)/q).\alpha\ge\frac{(1-2/q)\lambda}{2\left(\lambda t_q+\log M_q+(q-2)/q\right)}.α≥2(λtq​+logMq​+(q−2)/q)(1−2/q)λ​.

It also covers q=∞q=\inftyq=∞: the hypothesis then uses ∥Htqf∥∞\|H_{t_q}f\|_\infty∥Htq​​f∥∞​, and the two fractions involving qqq in the displayed bound become 111.

Companion results

Theorem 3.10 replaces HtqH_{t_q}Htq​​ in the norm hypothesis with Htq−EH_{t_q}-EHtq​​−E, where EEE sends a function to its constant mean. Corollary 3.11 relates α\alphaα to τ\tauτ, the first time at which every heat-kernel density htx(y)=Ht(x,y)/π(y)h_t^x(y)=H_t(x,y)/\pi(y)htx​(y)=Ht​(x,y)/π(y) is within 1/e1/e1/e of 111 in ℓ2(π)\ell^2(\pi)ℓ2(π):

12α≤τ≤4+log⁡log⁡(1/π∗)4α,π∗=min⁡xπ(x).\frac1{2\alpha}\le\tau\le\frac{4+\log\log(1/\pi_*)}{4\alpha}, \qquad \pi_*=\min_x\pi(x).2α1​≤τ≤4α4+loglog(1/π∗​)​,π∗​=xmin​π(x).

The three milestones reproduce the interpolation estimate (3.6), the resulting entropy inequality, and the centering inequality (3.7). Theorem 3.10's printed finite-qqq denominator contains (q−2)/2(q-2)/2(q−2)/2; its displayed proof and the q=∞q=\inftyq=∞ use in Corollary 3.11 require (q−2)/q(q-2)/q(q−2)/q. That proof also needs log⁡Mq+(q−2)/q≥0\log M_q+(q-2)/q\ge0logMq​+(q−2)/q≥0, which the page does not state and without which the printed statement fails on a four-state product chain. The formal companion records both corrections, while the main goal follows the printed Theorem 3.9 exactly.

Significance

Theorem 3.9 makes a norm bound at a chosen time useful beyond that time: it yields a bound on a functional inequality that holds for every function on the state space. Thus estimates obtained from an explicit heat kernel or another analytic method can be compared across chains using the same constant α\alphaα. The centered version and the bound for τ\tauτ connect this functional viewpoint back to convergence from a point mass, as the paper explains in §3.4.

The mathematical results are proved in the 1996 paper. Here the remaining work is to give their finite-state objects, norm hypotheses, and constants machine-checked meanings, then formalize the proofs. The definition layer and the centering inequality have use beyond this mission: they can support other statements about entropy decay and heat-kernel convergence in the same paper.

Difficulty

A bound for HtH_tHt​ in the same norm is too weak to recover the displayed lower bound: the information here is the change from an ℓ2\ell^2ℓ2 input to an ℓq\ell^qℓq output. The dependence of the exponent on time must retain the factors (1−2/q)(1-2/q)(1−2/q) and (q−2)/q(q-2)/q(q−2)/q exactly. The endpoint q=∞q=\inftyq=∞ also requires a separate norm statement, since a real exponent cannot represent infinity. The centering inequality (3.7) is another substantial step; the paper points to earlier proofs rather than treating it as immediate.

Formalization scope

The state space is a finite Lean type, the kernel a real matrix, and the invariant law a positive real-valued probability vector. Reversibility is detailed balance, and irreducibility is retained from the standing setting of §3.1. The heat semigroup uses the already published Poissonized heat kernel. Operator norms are represented by inequalities quantified over every real function. The finite-qqq and q=∞q=\inftyq=∞ conclusions are separate clauses of the goal. Time is real; tq>0t_q>0tq​>0 makes explicit the positive-time convention used in §3.4. Theorem 3.10 carries the condition Mq≥e−(q−2)/qM_q\ge e^{-(q-2)/q}Mq​≥e−(q−2)/q (and M∞≥e−1M_\infty\ge e^{-1}M∞​≥e−1) described above; Corollary 3.11 is stated without any extra condition.

The variational constants are real infima, the logarithms and real powers use Lean's total operations, and the supremum norm is a supremum over the finite state space. The stationary probability hypothesis rules out an empty state space; the operator hypothesis on the constant function forces Mq≥1M_q\ge1Mq​≥1 in Theorem 3.9. These facts prevent the bound from arising from a zero norm, an empty operator test, an invalid logarithm, or an eigenvalue convention different from (2.4). Useful contributions include finite-state entropy inequalities, interpolation machinery, estimates for the heat operator, and proofs of the three stated milestones.

Selected references

  • P. Diaconis and L. Saloff-Coste, Logarithmic Sobolev inequalities for finite Markov chains, Annals of Applied Probability 6 (1996), 695–750. DOI.
10 thms2 active usersReviewed
Complexity TheoryQuantum InformationTheoretical Computer Science·Captain: mikedeng1

Strengths and Weaknesses of Quantum Computing II: Relative to a Random Permutation, a Quantum Algorithm Needs Ω(2^{n/3}) Queries to Decide the First Bit of A⁻¹(1ⁿ)Research Paper

Motivation

An oracle lets an algorithm ask for the value of a function without giving it a description of that function. An oracle lower bound isolates how many questions are needed, even when computation between questions is unrestricted. Bennett, Bernstein, Brassard and Vazirani used this viewpoint to compare classical and quantum access to randomly chosen functions and permutations. Their Theorem 3.6 states an almost-sure separation: relative to a random permutation oracle, a quantum machine using time o(2n/3)o(2^{n/3})o(2n/3) cannot capture all of (NP∩coNP)A(\mathrm{NP}\cap\mathrm{coNP})^A(NP∩coNP)A BBBV, Theorem 3.6. The same paper notes that its exponent 1/31/31/3 may reflect the available argument rather than the true boundary BBBV, p. 12.

The finite statement behind that separation is a quantum query lower bound for a uniformly random permutation. It asks about one bit of the inverse image of a fixed string, rather than inversion of the whole permutation. This gives a sharply defined target with the paper's explicit query and error constants.

Setting

Let Σn={0,1}n\Sigma^n=\{0,1\}^nΣn={0,1}n, and let AAA be a permutation oracle of Σn\Sigma^nΣn. Its inverse image of the all-one string 1n1^n1n exists and is unique. Define the language LA\mathcal L_ALA​ by putting yyy in LA\mathcal L_ALA​ when the first bit of A−1(y)A^{-1}(y)A−1(y) is 111. The paper observes that access to AAA puts this language in both NPA\mathrm{NP}^ANPA and coNPA\mathrm{coNP}^AcoNPA: either possible bit of the inverse image can be witnessed by an input to the permutation BBBV, p. 10. This mission tests membership only at y=1ny=1^ny=1n.

A TTT-query quantum algorithm starts in a unit vector of a finite complex Hilbert space. A basis configuration records an optional length-nnn query string, an answer register, and finite workspace. On a querying configuration (x,z,w)(x,z,w)(x,z,w), an oracle operation replaces the answer register by z⊕A(x)z\oplus A(x)z⊕A(x); it leaves a nonquerying configuration unchanged. Each oracle operation is followed by an algorithm-chosen unitary. The final acceptance probability is the sum of the squared amplitudes of accepting basis configurations. A run decides a yes-or-no question if its acceptance probability is at least 2/32/32/3 on a yes instance and at most 1/31/31/3 on a no instance. These thresholds match the paper's bounded-error convention BBBV, §2 and §3.1.

For a state ϕ\phiϕ, the query magnitude qy(ϕ)q_y(\phi)qy​(ϕ) is the total squared amplitude of basis configurations querying string yyy. Thus 0≤qy(ϕ)≤10\le q_y(\phi)\le10≤qy​(ϕ)≤1 for a unit state, and the magnitudes over all strings sum to at most 111. This is Definition 3.2 of the paper BBBV, p. 7.

Formalization targets

The goal is the finite claim in the proof of Theorem 3.6. For every n≥1n\ge1n≥1, every finite-workspace algorithm MMM with TTT queries, and a uniform permutation AAA of Σn\Sigma^nΣn,

T≤2n/3100⟹Pr⁡A ⁣[M fails to decide whether the first bit of A−1(1n) is 1]≥18.T\le\frac{2^{n/3}}{100} \quad\Longrightarrow\quad \Pr_A\!\left[M\text{ fails to decide whether the first bit of }A^{-1}(1^n)\text{ is }1\right]\ge\frac18.T≤1002n/3​⟹APr​[M fails to decide whether the first bit of A−1(1n) is 1]≥81​.

The milestones follow the statements used in the paper: Theorem 3.1 relates Euclidean distance between final states to their observed distributions; Theorem 3.3 bounds the effect of changing answers at queried strings; and the proof of Theorem 3.6 establishes the uniform transposition chain, the 1/21/21/2 membership split, the expected query-magnitude estimate, and the 1/501/501/50 expected final-state distance BBBV, pp. 7–11. The source text of each milestone is recorded with its page in the mission's milestone list.

Significance

The result identifies a concrete task that cannot be decided reliably with too few quantum oracle calls for a positive fraction of length-nnn permutation oracles. The inverse image exists by definition, so the obstruction is the number of queries needed to learn its first bit. This is the quantitative part of the paper's relative separation for NP∩coNP\mathrm{NP}\cap\mathrm{coNP}NP∩coNP; the passage to an almost-sure statement over countably many machines is described in the paper but lies beyond this mission's formal goal BBBV, pp. 10–12.

The theorem is proved on paper and is not claimed here as an open mathematical problem. Formalizing it produces reusable finite-dimensional machinery for quantum queries: an XOR oracle as a unitary basis permutation, query magnitude, a time-dependent hybrid oracle, and counting-based probability over finite permutation spaces. The milestone statements remain open Lean proof obligations in this proposal.

Difficulty

A direct comparison of an algorithm's run under two nearby permutation oracles requires knowing that the algorithm seldom queries the locations where those oracles differ. The distinguished preimage A−1(1n)A^{-1}(1^n)A−1(1n) cannot simply be declared rarely queried: learning about it is exactly the task under study. The paper therefore studies a chain of random transpositions and a run whose oracle changes by step. The subtle point is that a string used in a later transposition is still uniform when the earlier query state is formed BBBV, pp. 10–11. The expected query-magnitude milestone states that point explicitly.

Formalization scope

The Lean carrier of strings is Fin(n)→Z/2Z\mathrm{Fin}(n)\to\mathbb Z/2\mathbb ZFin(n)→Z/2Z. Algorithms use finite configuration types and EuclideanSpace ℂ; the query register is optional, and none represents configurations that make no length-nnn query. An oracle answers with the full length-nnn value by XOR in the answer register. The paper describes a Boolean oracle, but one full-value query can be simulated with nnn Boolean queries and one Boolean query with two full-value queries. The latter direction transfers this lower bound to the paper's oracle at a changed constant. Answers at lengths other than nnn are fixed and absorbed into the inter-query unitaries, as in the paper's finite-length argument. The full oracle quantum Turing machine, complexity classes as Lean objects, and the almost-sure conclusion are outside the model.

Probabilities and expectations are finite counting fractions. The chain samples a uniform π0\pi_0π0​ and independent uniform x1,…,xT+1x_1,\ldots,x_{T+1}x1​,…,xT+1​, with x0=π0−1(1n)x_0=\pi_0^{-1}(1^n)x0​=π0−1​(1n); this has the same joint law as the paper's conditional sampling order. The recurrence πi+1=πi∘(xi xi+1)\pi_{i+1}=\pi_i\circ(x_i\ x_{i+1})πi+1​=πi​∘(xi​ xi+1​) uses the paper's composition direction. The first-bit test requires n≥1n\ge1n≥1, and any comparison to πT−1\pi_{T-1}πT−1​ requires T≥1T\ge1T≥1. The goal quantifies over every finite workspace and algorithm before sampling the permutation. A uniform function in place of a permutation, or a predetermined inverse image, would change the task and is excluded.

The paper's Theorem 3.3 prints a final-state bound ε\varepsilonε that fails for a one-query XOR example; the milestone states the valid 2ε2\varepsilon2ε bound. Its baseline oracle may vary by step because the proof of Theorem 3.6 uses the hybrid run. The explicit constants T≤2n/3/100T\le 2^{n/3}/100T≤2n/3/100, failure probability 1/81/81/8, and expected distance 1/501/501/50 remain as printed. General finite-dimensional unitary and probability lemmas, together with a proof of the time-dependent hybrid bound, are welcome contributions. The finite query model and transposition-chain definitions are reusable in other oracle lower bounds.

Selected references

  • C. H. Bennett, E. Bernstein, G. Brassard, and U. Vazirani, Strengths and weaknesses of quantum computing, SIAM Journal on Computing 26(5), 1997; arXiv:quant-ph/9701001v1.
10 thms2 active usersReviewed
Machine LearningStatistics·Captain: mikedeng1

Fast Rates for Support Vector Machines Using Gaussian Kernels 1: Under Tsybakov and Geometric Noise, Gaussian-Kernel SVMs Reach Excess Risk Cx²n^{−β+ε} with Probability 1 − e^{−x}Research Paper

Motivation

Support vector machines classify observations by choosing a real-valued function from a reproducing kernel Hilbert space and using its sign as the predicted label. The Gaussian kernel is widely used because it gives a flexible class of functions, but that flexibility alone does not explain how quickly classification error approaches the best possible error as the training sample grows. Steinwart and Scovel's 2007 paper identifies distributional conditions under which a Gaussian-kernel SVM achieves a polynomial, and sometimes nearly linear, excess-risk rate. The conditions describe both ambiguity in the labels and the location of data relative to the decision boundary.

The article's result is already proved mathematically. This mission asks for machine-checked statements and proofs of its finite-geometric-exponent, no-offset rate and selected supporting results. It uses arXiv:0708.1838v1, the electronic reprint of the Annals of Statistics article. Its printed page number equals its PDF page number throughout; all page references below use those numbers.

Setting

Let XXX be the closed unit ball of Rd\mathbb R^dRd, where d>0d>0d>0, and let the label set be Y={−1,1}Y=\{-1,1\}Y={−1,1}. A distribution PPP on X×YX\times YX×Y has input marginal μ=PX\mu=P_Xμ=PX​ and a measurable regression function η(x)=P(y=1∣x)\eta(x)=P(y=1\mid x)η(x)=P(y=1∣x). In the Lean representation, μ\muμ and one version of η\etaη are carried explicitly; the joint law gives conditional masses η(x)\eta(x)η(x) and 1−η(x)1-\eta(x)1−η(x) to the two labels. Classification predicts sign⁡f(x)\operatorname{sign}f(x)signf(x), with sign⁡(0)=1\operatorname{sign}(0)=1sign(0)=1. Write RP(f)R_P(f)RP​(f) for its error probability and RPR_PRP​ for the smallest such risk over measurable decision functions.

The hinge loss is ℓ(y,t)=max⁡{0,1−yt}\ell(y,t)=\max\{0,1-yt\}ℓ(y,t)=max{0,1−yt}. The Gaussian kernel with parameter σ>0\sigma>0σ>0 is kσ(x,x′)=exp⁡(−σ2∥x−x′∥2)k_\sigma(x,x')=\exp(-\sigma^2\|x-x'\|^2)kσ​(x,x′)=exp(−σ2∥x−x′∥2), and Hσ(X)H_\sigma(X)Hσ​(X) is its restricted RKHS. Given a sample TTT of size nnn, an SVM without offset minimizes λ∥f∥Hσ(X)2+Rℓ,T(f)\lambda\|f\|^2_{H_\sigma(X)}+R_{\ell,T}(f)λ∥f∥Hσ​(X)2​+Rℓ,T​(f) over that space. The approximation error aσ(λ)a_\sigma(\lambda)aσ​(λ) is the infimum of the corresponding population objective minus the unrestricted Bayes hinge risk; equation (6) uses that unrestricted baseline.

Two assumptions describe the distribution. It has Tsybakov noise exponent q∈[0,∞]q\in[0,\infty]q∈[0,∞] if, for sufficiently small t>0t>0t>0, μ{∣2η−1∣≤t}≤Ctq\mu\{|2\eta-1|\le t\}\le C t^qμ{∣2η−1∣≤t}≤Ctq for some C>0C>0C>0. To define geometric noise exponent α>0\alpha>0α>0, partition XXX according to whether η\etaη is below, above, or equal to 1/21/21/2. The distance τx\tau_xτx​ goes from a point in either strict class to the opposite strict class together with the equal-probability class. The geometric condition is

∫X∣2η(x)−1∣exp⁡(−τx2/t) dμ(x)≤Ctαd/2(t>0).\int_X |2\eta(x)-1|\exp(-\tau_x^2/t)\,d\mu(x) \le C t^{\alpha d/2}\qquad(t>0).∫X​∣2η(x)−1∣exp(−τx2​/t)dμ(x)≤Ctαd/2(t>0).

These are Definitions 2.2 and 2.3 and equation (7) of the paper.

Formalization targets

The goal is the finite-α\alphaα, no-offset clause of Theorem 2.8. With the paper's two-case exponent β=β(α,q)\beta=\beta(\alpha,q)β=β(α,q), set λn=n−(α+1)β/α\lambda_n=n^{-(\alpha+1)\beta/\alpha}λn​=n−(α+1)β/α and σn=nβ/(αd)\sigma_n=n^{\beta/(\alpha d)}σn​=nβ/(αd). For every ε>0\varepsilon>0ε>0, one constant C>0C>0C>0 works uniformly for x≥1x\ge1x≥1 and n≥1n\ge1n≥1:

Pr⁡∗ ⁣{T:RP(fT,λn)≤RP+Cx2n−β+ε}≥1−e−x.\Pr^*\!\left\{T:R_P(f_{T,\lambda_n}) \le R_P+C x^2n^{-\beta+\varepsilon}\right\}\ge1-e^{-x}.Pr∗{T:RP​(fT,λn​​)≤RP​+Cx2n−β+ε}≥1−e−x.

Here Pr⁡∗\Pr^*Pr∗ is outer probability, and the statement applies to every empirical minimizer. The formula for β\betaβ is α/(2α+1)\alpha/(2\alpha+1)α/(2α+1) in the first case, α≤(q+2)/(2q)\alpha\le(q+2)/(2q)α≤(q+2)/(2q), and 2α(q+1)/(2α(q+2)+3q+4)2\alpha(q+1)/(2\alpha(q+2)+3q+4)2α(q+1)/(2α(q+2)+3q+4) otherwise; the paper's limiting convention specifies q=∞q=\inftyq=∞.

Three milestones record results used on this path. Theorem 2.1 bounds empirical covering numbers of Gaussian RKHS balls, uniformly in σ\sigmaσ and the sample. Lemma 4.1 locates balls of radius τx\tau_xτx​ inside the corresponding enlarged decision class. Theorem 2.7 bounds the approximation error by

aσ(λ)≤cd(σdλ+C(2d)αd/2σ−αd),a_\sigma(\lambda)\le c_d\bigl(\sigma^d\lambda+C(2d)^{\alpha d/2}\sigma^{-\alpha d}\bigr),aσ​(λ)≤cd​(σdλ+C(2d)αd/2σ−αd),

where cdc_dcd​ depends only on dimension. Their exact source text and page positions appear in the milestone list.

Significance

Theorem 2.8 gives a quantitative guarantee for classification risk, rather than only convergence of the regularized hinge objective. The rate responds to both the label-noise exponent and the concentration of input mass near the decision boundary. In the regimes discussed after the theorem, the exponent can approach one; the paper's Remark 2.9 compares it with the n−1/2n^{-1/2}n−1/2 benchmark.

Formalizing this result adds a concrete Gaussian RKHS norm compatible with a kernel parameter that changes with nnn, an explicit binary-law model, extended-valued risks and covering numbers, and source-indexed bounds on approximation and complexity. Those objects can be reused in later SVM and kernel-learning statements. The paper's argument is a published proof; the Lean theorem files here are open proof obligations, while the definition files have compiled bodies. No claim of a machine-checked proof of the rate is made.

Difficulty

It is not enough to combine a general consistency theorem with the noise assumptions. The kernel parameter grows with sample size, so the relevant hypothesis class changes with nnn; a complexity estimate for one fixed class gives no uniform rate. Geometric noise controls approximation error, while Tsybakov noise controls a different fluctuation quantity, and neither by itself supplies the stated exponent. The probability statement also concerns an event defined by empirical minimizers, whose measurability the source deliberately avoids by using outer probability. These are the points at which a direct fixed-class or ordinary-probability statement would fail to match Theorem 2.8.

Formalization scope

Lean represents functions on all of Rd\mathbb R^dRd but uses only their restrictions to XXX. The joint distribution is built from a probability marginal and a fixed measurable η:Rd→[0,1]\eta:\mathbb R^d\to[0,1]η:Rd→[0,1]. This makes the paper's choice of regression-function version explicit. The Gaussian RKHS squared norm is the supremum over finite normalized kernel-section combinations; it is +∞+\infty+∞ outside the RKHS. A covering number is the least positive finite cardinality of a cover with centers in the ambient empirical function space, or +∞+\infty+∞ if there is no such cover. Hinge and classification risks are extended nonnegative integrals, and Bayes risks range over measurable functions.

The assumptions d>0d>0d>0 and n≥1n\ge1n≥1 give the divisions and powers their intended domains. For q=∞q=\inftyq=∞, the small-ttt noise bound uses zero on the right, as in the source convention. The paper leaves distance to an empty set unstated; this mission pins d(x,∅)=0d(x,\varnothing)=0d(x,∅)=0. With the infinite-distance convention, Lemma 4.1 and Theorem 2.7 fail for a one-class regression function. The proof display (25) has a volume-factor slip in high dimension; Theorem 2.7 is stated with its printed conclusion, and the issue is recorded in the moderation notes. The goal event includes existence of an empirical minimizer, a fact stated in the paper's setup, and quantifies over every minimizer. This excludes a vacuous SVM predicate. The constant CCC is chosen before xxx and nnn.

The clauses for α=∞\alpha=\inftyα=∞ and an SVM with offset are outside this mission. The separate series mission addresses the implication from an envelope assumption to geometric noise. Further contributions toward the §5 empirical-process estimates, §6 variance estimates, and §7 shrinking and general-rate theorems are welcome; they are not asserted as milestones in this draft.

Selected references

  • Ingo Steinwart and Clint Scovel, Fast Rates for Support Vector Machines Using Gaussian Kernels, Annals of Statistics 35(2), 2007, 575–607. arXiv:0708.1838v1, DOI:10.1214/009053606000001226.
11 thms2 active usersReviewed
Dynamic ProgrammingOperations ResearchOptimization·Captain: mikedeng1

Negative Dynamic Programming II: With Non-Positive Rewards on Borel Spaces, the Optimal Return Satisfies the Optimality EquationResearch Paper

Motivation

Negative dynamic programming is the study of infinite-horizon sequential decision problems in which every one-stage reward is non-positive and nothing is discounted. Equivalently, a non-negative cost accumulates forever and the controller minimizes its expected total. Stochastic shortest-path problems, optimal stopping with a cost per step, and inventory or replacement models without discounting all have this form. The total cost of a policy can be infinite, and none of the contraction arguments of discounted dynamic programming apply.

Blackwell settled the discounted case on Borel state and action spaces (Blackwell 1965). There the optimal return is Borel measurable and is the unique bounded solution of the optimality equation. Strauch's paper (Strauch 1966) treats the negative case on the same Borel model. One of its main results is that the optimal return still satisfies the optimality equation, even though it need not be Borel measurable.

Timeline. Blackwell (1965): discounted case, Borel spaces. Blackwell (1967, Positive dynamic programming): positive bounded case. Strauch (1966): negative case on Borel spaces. The optimal return is absolutely measurable, (p,ε)(p,\varepsilon)(p,ε)-optimal Markov policies exist, and the optimality equation holds. Bertsekas and Shreve (1978, Stochastic Optimal Control: The Discrete-Time Case) later recast the theory with universally measurable policies, a lower semianalytic optimal cost, and Bellman's equation J∗=T(J∗)J^* = T(J^*)J∗=T(J∗) under (P), (N) and (D).

Setting

The states SSS and actions AAA are non-empty Borel sets. A law of motion q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) is a probability kernel from S×AS\times AS×A to SSS. The return r(s,a,t)r(s,a,t)r(s,a,t) is a Borel function with −∞<r≤0-\infty < r \le 0−∞<r≤0 whose expectation ∫r(s,a,t) dq(t∣s,a)\int r(s,a,t)\,dq(t\mid s,a)∫r(s,a,t)dq(t∣s,a) is finite for every (s,a)(s,a)(s,a). A policy π=(π1,π2,… )\pi = (\pi_1,\pi_2,\dots)π=(π1​,π2​,…) draws the nnnth action from a kernel πn(⋅∣s1,a1,…,sn)\pi_n(\cdot\mid s_1,a_1,\dots,s_n)πn​(⋅∣s1​,a1​,…,sn​) that may depend on the whole history. A Markov policy (f1,f2,… )(f_1,f_2,\dots)(f1​,f2​,…) uses measurable maps fn:S→Af_n:S\to Afn​:S→A, and a stationary policy f(∞)f^{(\infty)}f(∞) uses one map at every stage. The expected return from the initial state sss is

I(π)(s)=∑n≥1Esπ r(sn,an,sn+1)∈[−∞,0],I(\pi)(s) = \sum_{n\ge1} E^\pi_s\, r(s_n,a_n,s_{n+1}) \in [-\infty,0],I(π)(s)=n≥1∑​Esπ​r(sn​,an​,sn+1​)∈[−∞,0],

and the optimal return is

v∗(s)=sup⁡πI(π)(s),v^*(s) = \sup_\pi I(\pi)(s),v∗(s)=πsup​I(π)(s),

the supremum over all policies. Write M(S)M(S)M(S) for the non-positive, extended real-valued Borel functions on SSS. For u∈M(S)u\in M(S)u∈M(S) and an action aaa,

Tau(s)=∫[r(s,a,t)+u(t)] dq(t∣s,a).T_a u(s) = \int \big[r(s,a,t) + u(t)\big]\,dq(t\mid s,a).Ta​u(s)=∫[r(s,a,t)+u(t)]dq(t∣s,a).

TTT denotes the same operator for a measurable rule fff in place of aaa, and U=sup⁡nTnU = \sup_n T_nU=supn​Tn​ for a Markov policy (f1,f2,… )(f_1,f_2,\dots)(f1​,f2​,…). A policy π∗\pi^*π∗ is (p,ε)(p,\varepsilon)(p,ε)-optimal, for a probability ppp on SSS, if p{I(π∗)≥v∗−ε}=1p\{I(\pi^*) \ge v^* - \varepsilon\} = 1p{I(π∗)≥v∗−ε}=1. The Lean development uses the same names: Problem, I, In, vstar, T, Ta, U, IsPEOptimal, Conserves.

Formalization targets

Goal: the optimality equation (Theorem 8.2, negative case)

v∗(s)=sup⁡a∈ATav∗(s)for all s∈S.v^*(s) = \sup_{a\in A} T_a v^*(s) \qquad\text{for all } s\in S.v∗(s)=a∈Asup​Ta​v∗(s)for all s∈S.

The equation involves no constants and no regularity hypotheses on v∗v^*v∗.

Milestones

  1. Theorem 5.2 (a)–(g): monotonicity, translation, sup-, limit- and selection properties of UUU.
  2. Theorem 6.1: if Uv≥vUv\ge vUv≥v for v∈M(S)v\in M(S)v∈M(S), some Markov policy generated from π^\hat\piπ^ has I(π)≥v−εI(\pi)\ge v-\varepsilonI(π)≥v−ε.
  3. Lemma 6.2: UUU conserves sup⁡nI(nπ)\sup_n I({}^n\pi)supn​I(nπ) and lim⁡nUnsup⁡nI(nπ)\lim_n U^n \sup_n I({}^n\pi)limn​Unsupn​I(nπ).
  4. Theorem 6.2: one Markov policy comes within ε\varepsilonε of the supremum of the returns of countably many Markov policies.
  5. Lemma 7.1, Lemma 7.2: measurability of (s,ν)↦∫u(s,x) dν(x)(s,\nu)\mapsto\int u(s,x)\,d\nu(x)(s,ν)↦∫u(s,x)dν(x), and Borel measurability of the set of pairs (s,eπ(s))(s, e_\pi(s))(s,eπ​(s)), where eπ(s)e_\pi(s)eπ​(s) is the law of the future under π\piπ.
  6. Theorem 7.1: v∗v^*v∗ is absolutely measurable.
  7. Theorem 8.1: for every ppp and ε>0\varepsilon>0ε>0 a (p,ε)(p,\varepsilon)(p,ε)-optimal Markov policy exists.

Optional extras: Corollary 6.1 and Theorems 6.3, 6.4, 6.5 and 8.4 (bounds and characterizations for Markov policies).

Significance

The result. The optimality equation is the entry point to every structural statement about optimal policies in the negative case. With it, a stationary policy whose rule attains the supremum in sup⁡aTav∗\sup_a T_a v^*supa​Ta​v∗ can be tested for optimality. Value iteration and policy improvement can be compared with v∗v^*v∗. The gap between the negative case and the discounted and positive cases can be located precisely: in the negative case v∗v^*v∗ satisfies the equation, but it need not be its unique or extremal solution. Along the way the paper proves that v∗v^*v∗ is absolutely measurable and that nearly optimal Markov policies exist for every initial distribution. These two facts are used repeatedly in later Borel-space dynamic programming.

Formalizing it. The results are proved; none is machine-checked. A formal development would contain the first Lean treatment of a total-reward Markov decision process on Borel spaces with possibly infinite returns. It would include the policy-dependent law of the future via Ionescu-Tulcea, the measurability of the optimal return over all randomized history-dependent policies, and the Bellman equation for a non-measurable value function. Bertsekas–Shreve's version of the optimality equation (universally measurable policies) appears on the platform as a separate open statement. It concerns a different policy class and is not the statement posed here.

Difficulty

Two steps of the obvious argument fail. First, the classical proof of the optimality equation picks, at each next state ttt, a policy that is ε\varepsilonε-optimal from ttt and concatenates. Without measurable selection this concatenation is not a policy. The set of ttt where a given policy is ε\varepsilonε-optimal need not be Borel, and v∗v^*v∗ itself need not be Borel measurable, so even ∫v∗ dq\int v^*\,dq∫v∗dq needs justification. Second, the contraction argument of the discounted case is unavailable. UUU does not contract, it conserves v+cv+cv+c along with vvv, and value iteration from 000 can converge to a function strictly above v∗v^*v∗. The paper's Example 6.1 shows that the limit of Un0U^n0Un0, the best return of generated Markov policies, and the best stationary return can all differ. Any argument has to work with policies that are only nearly optimal, and only outside sets of measure zero that depend on the initial distribution.

Formalization scope

  • States and actions are non-empty standard Borel types. Policies are the published Blackwell plans (DiscountedDP.Stationary.Plan): randomized and history-dependent, one Markov kernel per decision, with decisions numbered from 000 (Lean's π.κ n is the paper's πn+1\pi_{n+1}πn+1​). Markov policies are MarkovPlan; "π\piπ-generated" and G(π^)G(\hat\pi)G(π^) are the published IsGenerated and IsGeneratedPlan.
  • Only the negative case is formalized: r≤0r\le0r≤0 real-valued, qrqrqr integrable, β=1\beta=1β=1. The discounted and positive parts of Theorems 5.2, 7.1, 8.1 and 8.2, including the uniqueness and minimality clauses of Theorem 8.2, are not stated.
  • Returns take values in EReal and are computed as minus a lower Lebesgue integral (lintegral) of the non-negative loss. A Bochner integral is never used for a return: it would map −∞-\infty−∞ to 000 and make the goal false or vacuous.
  • v∗v^*v∗ is the supremum over all plans. It is not assumed measurable and is never replaced by a measurable modification. Tav∗T_a v^*Ta​v∗ is a lintegral of a possibly non-measurable function, which equals the completion integral because v∗v^*v∗ is absolutely measurable (Theorem 7.1).
  • Explicit readings of the page: the hypothesis u∈M(S)u\in M(S)u∈M(S) of each operator statement is IsNegM u. Theorem 5.2(b) assumes u+c∈M(S)u+c\in M(S)u+c∈M(S). "UUU conserves vvv" includes v∈M(S)v\in M(S)v∈M(S). Lemma 6.2 asserts that the limit defining vπv_\pivπ​ exists. Theorem 6.2 states ≥\ge≥ everywhere and >>> where sup⁡jI(πj)>−∞\sup_j I(\pi^j) > -\inftysupj​I(πj)>−∞ (the printed >>> fails where the supremum is −∞-\infty−∞). (p,ε)(p,\varepsilon)(p,ε)-optimality is "ppp-almost everywhere". Absolute measurability is NullMeasurable for every probability measure. P(X)P(X)P(X) carries the Giry σ-field. The extra Theorem 8.4 reads the printed "I(π)<uI(\pi) < uI(π)<u" as "≤\le≤" (the strict reading is false).
  • Reusable infrastructure: the negative model, the Ionescu-Tulcea law of the future (futureLaw), and the measurability lemmas for integrals against random measures. Contributions of measurable-selection and analytic-set results (projections of Borel sets are universally measurable; von Neumann selection) are welcome and needed.

Selected references

  • R. E. Strauch, Negative Dynamic Programming, Ann. Math. Statist. 37(4) (1966) 871–890. https://doi.org/10.1214/aoms/1177699369
  • D. Blackwell, Discounted Dynamic Programming, Ann. Math. Statist. 36(1) (1965) 226–235. https://doi.org/10.1214/aoms/1177700285
  • D. Blackwell, Positive Dynamic Programming, Proc. Fifth Berkeley Symp. Math. Statist. Probab. 1 (1967) 415–418. https://projecteuclid.org/euclid.bsmsp/1200512999
  • L. E. Dubins and L. J. Savage, How to Gamble If You Must, McGraw-Hill, 1965.
  • D. P. Bertsekas and S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978. https://web.mit.edu/dimitrib/www/soc.html
21 thms2 active usersReviewed
PreviousPage 7 of 38Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me