Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,210 missions · 1,098 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1112Completed1098All2210
Algorithmic Game TheoryConvex OptimizationOptimization·Captain: mikedeng1

Value of Information in Bayesian Routing Games II: Equilibrium Adoption Rates of Information Systems Are the Minimizers of the Equilibrium PotentialResearch Paper

Motivation

Traffic information systems (TIS) such as navigation apps send drivers private, noisy signals about the state of the road network: incidents, weather, closures. When several such systems coexist, their subscribers act on different information, and the congestion each population experiences depends on how all of them route. A question then arises for transport planners and for the information providers themselves: if travelers are free to choose which system to subscribe to, which market shares of the competing systems are stable?

Wu, Amin and Ozdaglar (Operations Research 69(1):148–163, 2021; preprint arXiv:1808.10590) model this situation as a Bayesian routing game with heterogeneous information and answer the question exactly: the equilibrium adoption rates are the minimizers of a convex function of the population sizes, the equilibrium value of a weighted potential. This mission formalizes that characterization (Theorem 4 of the paper) together with the results its proof rests on. A companion mission (Value of Information in Bayesian Routing Games I) formalizes the paper's other main result, the sign and monotonicity of the relative value of information between two populations.

Setting

A Bayesian routing game Γ(λ)\Gamma(\lambda)Γ(λ) has a single origin–destination pair, a finite set of edges E\mathcal EE and a finite nonempty set of routes R\mathcal RR (each route a set of edges), and a finite set of network states S\mathcal SS. Travelers of total demand D>0D>0D>0 are split into populations i∈Ii\in\mathcal Ii∈I, one per TIS; population iii has size λiD\lambda^iDλiD, where the size vector λ\lambdaλ lies in the simplex Δ={λ:λi≥0, ∑iλi=1}\Delta=\{\lambda:\lambda^i\ge0,\ \sum_i\lambda^i=1\}Δ={λ:λi≥0, ∑i​λi=1}. Each population receives a signal (its type) tit^iti from a finite set Ti\mathcal T^iTi; states and type profiles t=(ti)it=(t^i)_it=(ti)i​ are drawn from a common prior π∈Δ(S×T)\pi\in\Delta(\mathcal S\times\mathcal T)π∈Δ(S×T). Edge eee in state sss has cost ces(w)c^s_e(w)ces​(w) at load www, positive, strictly increasing and differentiable.

A strategy profile qqq assigns to each population and type a split qri(ti)≥0q^i_r(t^i)\ge0qri​(ti)≥0 of its demand over routes, with ∑rqri(ti)=λiD\sum_rq^i_r(t^i)=\lambda^iD∑r​qri​(ti)=λiD; these form the polytope Q(λ)\mathcal Q(\lambda)Q(λ). It induces route flows fr(t)=∑iqri(ti)f_r(t)=\sum_iq^i_r(t^i)fr​(t)=∑i​qri​(ti) and edge loads we(t)=∑r∋efr(t)w_e(t)=\sum_{r\ni e}f_r(t)we​(t)=∑r∋e​fr​(t). A traveler of population iii with signal tit^iti forms the belief βi(s,t−i∣ti)=π(s,ti,t−i)/Pr⁡(ti)\beta^i(s,t^{-i}\mid t^i)=\pi(s,t^i,t^{-i})/\Pr(t^i)βi(s,t−i∣ti)=π(s,ti,t−i)/Pr(ti) and evaluates the expected route cost E[cr(q)∣ti]=∑s,t−i∑e∈rβi(s,t−i∣ti) ces(we(t))\mathbb E[c_r(q)\mid t^i]=\sum_{s,t^{-i}}\sum_{e\in r}\beta^i(s,t^{-i}\mid t^i)\,c^s_e(w_e(t))E[cr​(q)∣ti]=∑s,t−i​∑e∈r​βi(s,t−i∣ti)ces​(we​(t)). A Bayesian Wardrop equilibrium (BWE) is a q∈Q(λ)q\in\mathcal Q(\lambda)q∈Q(λ) in which every type uses only routes of minimal expected cost. The equilibrium population cost is

Ci∗(λ)=∑ti∈TiPr⁡(ti)min⁡r∈RE[cr(q∗)∣ti].C^{i*}(\lambda)=\sum_{t^i\in\mathcal T^i}\Pr(t^i)\min_{r\in\mathcal R}\mathbb E[c_r(q^*)\mid t^i].Ci∗(λ)=ti∈Ti∑​Pr(ti)r∈Rmin​E[cr​(q∗)∣ti].

The weighted potential is Φ(q)=∑s,e,tπ(s,t)∫0we(t)ces(z) dz\Phi(q)=\sum_{s,e,t}\pi(s,t)\int_0^{w_e(t)}c^s_e(z)\,dzΦ(q)=∑s,e,t​π(s,t)∫0we​(t)​ces​(z)dz, and Ψ(λ)=min⁡q∈Q(λ)Φ(q)\Psi(\lambda)=\min_{q\in\mathcal Q(\lambda)}\Phi(q)Ψ(λ)=minq∈Q(λ)​Φ(q) is its equilibrium value. In route-flow form, Φ^(f)\widehat\Phi(f)Φ(f) is the same expression in terms of fff; route flows satisfy linear constraints (14a)–(14c) (a separability condition across populations, total demand DDD, nonnegativity) and one information impact constraint per population, J^i(f)≤λiD\widehat J^i(f)\le\lambda^iDJi(f)≤λiD, where J^i(f)=D−∑rmin⁡tifr(ti,t^−i)\widehat J^i(f)=D-\sum_r\min_{t^i}f_r(t^i,\widehat t^{-i})Ji(f)=D−∑r​minti​fr​(ti,t−i) measures how much of the demand reacts to population iii's signal. Let F†\mathcal F^\daggerF† be the set of minimizers of Φ^\widehat\PhiΦ subject to (14a)–(14c) only, and

Λ†={λ∈Δ: ∃f†∈F†, J^i(f†)≤λiD  ∀i}.\Lambda^\dagger=\{\lambda\in\Delta:\ \exists f^\dagger\in\mathcal F^\dagger,\ \widehat J^i(f^\dagger)\le\lambda^iD\ \ \forall i\}.Λ†={λ∈Δ: ∃f†∈F†, Ji(f†)≤λiD  ∀i}.

In the two-stage game, travelers first choose a TIS, inducing λ\lambdaλ, and then play Γ(λ)\Gamma(\lambda)Γ(λ). A size vector is a vector of equilibrium adoption rates if no traveler gains by switching TIS:

λi>0 ⟹ Ci∗(λ)=min⁡j∈ICj∗(λ)∀i∈I.(31)\lambda^i>0\ \Longrightarrow\ C^{i*}(\lambda)=\min_{j\in\mathcal I}C^{j*}(\lambda)\qquad\forall i\in\mathcal I.\tag{31}λi>0 ⟹ Ci∗(λ)=j∈Imin​Cj∗(λ)∀i∈I.(31)

Formalization targets

Goal: Theorem 4

For every λ∈Δ\lambda\in\Deltaλ∈Δ and every BWE of Γ(λ)\Gamma(\lambda)Γ(λ),

(31) holds  ⟺  λ∈Λ†.(31)\ \text{holds}\iff\lambda\in\Lambda^\dagger .(31) holds⟺λ∈Λ†.

With the existence of a BWE for every λ∈Δ\lambda\in\Deltaλ∈Δ, this is the paper's statement that the set of equilibrium adoption rates is Λ†\Lambda^\daggerΛ†.

Milestones

  1. Theorem 1. qqq is a BWE of Γ(λ)\Gamma(\lambda)Γ(λ) iff qqq minimizes Φ\PhiΦ over Q(λ)\mathcal Q(\lambda)Q(λ); the equilibrium edge load w∗(λ)w^*(\lambda)w∗(λ) is unique.
  2. Proposition 2. A route flow in the flow polytope F(λ)\mathcal F(\lambda)F(λ) ((14a)–(14c) plus all information impact constraints) is an equilibrium flow iff it minimizes Φ^\widehat\PhiΦ over F(λ)\mathcal F(\lambda)F(λ).
  3. Lemma 5. Ψ\PsiΨ is convex on Δ\DeltaΔ, and with zij=ei−ejz^{ij}=e_i-e_jzij=ei​−ej​ and Vij∗=Cj∗−Ci∗V^{ij*}=C^{j*}-C^{i*}Vij∗=Cj∗−Ci∗,
lim⁡ϵ→0+Ψ(λ+ϵzij)−Ψ(λ)ϵ=−D Vij∗(λ).\lim_{\epsilon\to0^+}\frac{\Psi(\lambda+\epsilon z^{ij})-\Psi(\lambda)}{\epsilon}=-D\,V^{ij*}(\lambda).ϵ→0+lim​ϵΨ(λ+ϵzij)−Ψ(λ)​=−DVij∗(λ).
  1. Proposition 5. Λ†\Lambda^\daggerΛ† is convex, Λ†=argmin⁡λ∈ΔΨ(λ)\Lambda^\dagger=\operatorname{argmin}_{\lambda\in\Delta}\Psi(\lambda)Λ†=argminλ∈Δ​Ψ(λ), and the equilibrium edge load equals the size-independent load w†w^\daggerw† of F†\mathcal F^\daggerF† iff λ∈Λ†\lambda\in\Lambda^\daggerλ∈Λ†.

A separate item states the existence of a BWE for every λ∈Δ\lambda\in\Deltaλ∈Δ.

Significance

The result. Theorem 4 reduces a question about a two-stage game with a continuum of travelers and private signals to the minimization of one convex function over a simplex. It shows that the stable market shares form a convex set, generally not a single point, so each system's equilibrium adoption rate ranges over an interval; and that this set is determined by the joint information environment of all systems, not by each system's signal alone. On ˆ\Lambda^\daggerˆ the equilibrium edge load does not depend on the shares at all, which identifies when changes in market shares leave congestion unchanged.

Formalizing it. The proofs of Theorem 1, Proposition 2 and Proposition 5 are in the paper's online e-companion, and Lemma 5 relies on sensitivity results for parametric convex programs cited from the literature. No part of this development has, to our knowledge, been machine-checked. A complete formalization would produce a verified potential-game characterization of Bayesian Wardrop equilibria with heterogeneous information and a verified directional-derivative formula for the optimal value of a parametric convex program; nothing comparable is currently on the platform (the existing Wardrop development covers complete information only).

Difficulty

The direction "λ∈Λ†\lambda\in\Lambda^\daggerλ∈Λ† implies (31)" is not a pointwise statement about costs: it follows from Λ†\Lambda^\daggerΛ† being the argmin of Ψ\PsiΨ together with the formula linking directional derivatives of Ψ\PsiΨ to cost differences. Both are hard. The derivative formula (26) is a statement about the optimal value of a convex program whose feasible set moves with λ\lambdaλ; its standard proofs pass through uniqueness of Lagrange multipliers, which fails exactly at the degenerate size vectors (λi=0\lambda^i=0λi=0) that Theorem 4 must cover, since an unused TIS is a legitimate outcome. The identity Λ†=argmin⁡Ψ\Lambda^\dagger=\operatorname{argmin}\PsiΛ†=argminΨ needs the route-flow reformulation (Proposition 2), in which the size vector enters only through the information impact constraints, and the uniqueness of the minimizing edge load. The natural first idea, comparing population costs directly at a given equilibrium, gives no handle on which size vectors make them equal.

Formalization scope

The Lean development lives in the namespace BayesRouting.Adoption. Populations, types, states, edges and routes are finite types; type spaces and the route set are nonempty; routes are edge sets. The game is a structure whose fields include the paper's standing assumptions: the prior is a probability distribution, D>0D>0D>0, and each cost is positive on nonnegative loads, strictly increasing and differentiable (on all of R\mathbb RR, which loses no generality). One assumption is added: every type profile has positive probability. Without it the equilibrium edge load need not be unique and the beliefs can be undefined; it excludes the paper's Example 2(i) (perfectly correlated signals).

Conventions: size vectors range over the probability simplex; Ψ\PsiΨ is the infimum of Φ\PhiΦ over Q(λ)\mathcal Q(\lambda)Q(λ) and is only compared at points of the simplex (outside it the feasible set can be empty and the value is a default); Ci∗C^{i*}Ci∗ is the last form of the paper's (7), well defined when λi=0\lambda^i=0λi=0; J^i\widehat J^iJi is the maximum over reference profiles, which equals the paper's value on flows satisfying (14a); equilibrium statements are made for every BWE rather than for "the" equilibrium; F†\mathcal F^\daggerF† and similar sets are argmin sets. Lemma 5 is stated for the directions zijz^{ij}zij with λj>0\lambda^j>0λj>0 (otherwise λ+ϵzij\lambda+\epsilon z^{ij}λ+ϵzij leaves the simplex); λi=0\lambda^i=0λi=0 is allowed.

A trivializing formalization is ruled out: the existence of a BWE is its own item, so "for every BWE" is not vacuous, and Λ†\Lambda^\daggerΛ† is defined by (30) from the flow problem (28), not as the argmin of Ψ\PsiΨ, so the goal is not a restatement of Proposition 5.

Infrastructure a complete development needs: KKT conditions for convex programs with linear constraints, convexity of integrals of increasing functions, compactness arguments for existence of minimizers, and one-sided directional derivatives of optimal-value functions. The last two are reusable well beyond this mission. Proofs of any item, and of auxiliary lemmas such as Proposition 1 of the paper (feasible route flows form the polytope F(λ)\mathcal F(\lambda)F(λ)), are welcome.

Selected references

  • M. Wu, S. Amin, A. E. Ozdaglar, Value of Information in Bayesian Routing Games, Operations Research 69(1):148–163, 2021. https://doi.org/10.1287/opre.2020.1999 (preprint: https://arxiv.org/abs/1808.10590)
  • W. H. Sandholm, Potential games with continuous player sets, Journal of Economic Theory 97(1):81–108, 2001. https://doi.org/10.1006/jeth.2000.2696
  • A. V. Fiacco, J. Kyparisis, Convexity and concavity properties of the optimal value function in parametric nonlinear programming, Journal of Optimization Theory and Applications 48(1):95–126, 1986. https://doi.org/10.1007/BF00938592
9 thms2 active usersReviewed
Dynamic ProgrammingMarkov ChainStochastic Systems·Captain: mikedeng1

Computing Optimal (s, S) Inventory Policies III: Selecting an (s, S) Policy That Is Optimal for Every Starting StockResearch Paper

Motivation

The periodic-review inventory model with a fixed ordering cost is one of the basic models of operations research. When every order incurs a set-up cost KKK in addition to holding and shortage costs, the optimal replenishment rule over an infinite horizon is, under standard convexity assumptions, a stationary (s,S)(s, S)(s,S) policy: whenever the stock falls below the reorder point sss, order up to the level SSS. Existence of such an optimal policy goes back to Scarf (1960) and Iglehart (1963). Knowing that an optimal (s,S)(s, S)(s,S) policy exists does not say how to find one, and the average cost of an (s,S)(s, S)(s,S) policy is neither convex nor unimodal in (s,S)(s, S)(s,S).

Veinott and Wagner (Management Science 11 (1965) 525–552) gave an exact algorithm. It proceeds in three steps: (i) compute integers s‾≤sˉ≤S‾≤Sˉ\underline{s} \le \bar{s} \le \underline{S} \le \bar{S}s​≤sˉ≤S​≤Sˉ bounding an optimal policy; (ii) find the set S\mathcal SS of all policies within those bounds that minimize the cost for starting stocks below s‾\underline{s}s​; (iii) choose from S\mathcal SS a policy that is optimal for every starting stock. This mission formalizes the theory behind Step iii. It is the third mission of a series on the paper: mission I treats the renewal closed form of the discounted cost, mission II the bounds of Step i.

Setting

Demands ξ1,ξ2,…\xi_1, \xi_2, \dotsξ1​,ξ2​,… are independent non-negative integer random variables with common distribution φ\varphiφ and finite mean. Following the paper's Eq. (2), the unit purchase cost and the holding and penalty costs are combined into a single function Gα:Z→RG_\alpha : \mathbb Z \to \mathbb RGα​:Z→R, assumed convex with Gα(y)→∞G_\alpha(y) \to \inftyGα​(y)→∞ as ∣y∣→∞|y| \to \infty∣y∣→∞; the set-up cost is K≥0K \ge 0K≥0 and α\alphaα is the discount factor.

A stationary (s,S)(s, S)(s,S) policy, with integers s≤Ss \le Ss≤S, sets the stock after ordering to

Yt=S if Xt<s,Yt=Xt if Xt≥s,Y_t = S \text{ if } X_t < s, \qquad Y_t = X_t \text{ if } X_t \ge s,Yt​=S if Xt​<s,Yt​=Xt​ if Xt​≥s,

and the stock evolves as Xt+1=Yt−ξtX_{t+1} = Y_t - \xi_tXt+1​=Yt​−ξt​ from X1=xX_1 = xX1​=x. Its discounted cost is

f(x∣s,S)=∑t≥1αt−1E[Kδ(Yt−Xt)+Gα(Yt)],f(x \mid s, S) = \sum_{t \ge 1} \alpha^{t-1} E\bigl[K\delta(Y_t - X_t) + G_\alpha(Y_t)\bigr],f(x∣s,S)=t≥1∑​αt−1E[Kδ(Yt​−Xt​)+Gα​(Yt​)],

where δ(z)=1\delta(z) = 1δ(z)=1 for z>0z > 0z>0 and δ(0)=0\delta(0) = 0δ(0)=0, and its equivalent average cost is aα(x∣s,S)=(1−α)f(x∣s,S)a_\alpha(x \mid s, S) = (1-\alpha) f(x \mid s, S)aα​(x∣s,S)=(1−α)f(x∣s,S).

A policy (s′,S′)(s', S')(s′,S′) is optimal for a set X\mathfrak XX of integers if, for each x∈Xx \in \mathfrak Xx∈X, it minimizes aα(x∣s,S)a_\alpha(x \mid s, S)aα​(x∣s,S) over all (s,S)(s, S)(s,S) policies; it is optimal if it is optimal for every integer xxx. Under a fixed policy, x′x'x′ is accessible from X1=xX_1 = xX1​=x if Pr⁡(Xt=x′∣X1=x)>0\Pr(X_t = x' \mid X_1 = x) > 0Pr(Xt​=x′∣X1​=x)>0 for some t>1t > 1t>1.

Below the reorder point the cost does not depend on the starting stock; its value is written Lα(S,D)\mathcal L_\alpha(S, D)Lα​(S,D) with D=S−sD = S - sD=S−s. The bounds are: S‾\underline{S}S​ the smallest minimizer of GαG_\alphaGα​; Sˉ\bar{S}Sˉ the smallest integer ≥S‾\ge \underline{S}≥S​ with Gα(Sˉ+1)≥Gα(S‾)+αKG_\alpha(\bar{S}+1) \ge G_\alpha(\underline{S}) + \alpha KGα​(Sˉ+1)≥Gα​(S​)+αK (21); s‾\underline{s}s​ the smallest integer with Gα(s‾)≤Gα(S‾)+KG_\alpha(\underline{s}) \le G_\alpha(\underline{S}) + KGα​(s​)≤Gα​(S​)+K (22); sˉ\bar{s}sˉ the smallest integer with Gα(sˉ)≤Gα(S‾)+(1−α)KG_\alpha(\bar{s}) \le G_\alpha(\underline{S}) + (1-\alpha)KGα​(sˉ)≤Gα​(S​)+(1−α)K (23). The candidate set S\mathcal SS consists of the policies with s‾≤s≤sˉ\underline{s} \le s \le \bar{s}s​≤s≤sˉ, S‾≤S≤Sˉ\underline{S} \le S \le \bar{S}S​≤S≤Sˉ that minimize Lα(S,S−s)\mathcal L_\alpha(S, S-s)Lα​(S,S−s) among such policies.

Formalization targets

Goal: Theorem 2 (p. 543)

For 0<α<10 < \alpha < 10<α<1 and (si,Si),(sj,Sj)∈S(s^i, S^i), (s^j, S^j) \in \mathcal S(si,Si),(sj,Sj)∈S: if (si,Si)(s^i, S^i)(si,Si) is optimal and every x′x'x′ with

min⁡(si,sj)≤x′<max⁡(si,sj)\min(s^i, s^j) \le x' < \max(s^i, s^j)min(si,sj)≤x′<max(si,sj)

is accessible from SjS^jSj under (sj,Sj)(s^j, S^j)(sj,Sj), then (sj,Sj)(s^j, S^j)(sj,Sj) is optimal.

Milestones

  1. §3, p. 533. For x<sx < sx<s, f(x∣s,S)=K+f(S∣s,S)f(x \mid s, S) = K + f(S \mid s, S)f(x∣s,S)=K+f(S∣s,S).
  2. Theorem 1, p. 542. For 0≤α<10 \le \alpha < 10≤α<1 and s≤s′s \le s's≤s′: if aα(x∣s,S)=aα(x∣s′,S′)a_\alpha(x \mid s, S) = a_\alpha(x \mid s', S')aα​(x∣s,S)=aα​(x∣s′,S′) for all x<s′x < s'x<s′, then equality holds for all xxx.
  3. Lemma 1, p. 543. For 0<α<10 < \alpha < 10<α<1: if (s,S)(s, S)(s,S) is optimal for X1=xX_1 = xX1​=x, it is optimal for every x′x'x′ accessible from xxx.

Significance

Theorem 2 turns the final selection step of the algorithm into a reachability check on the demand distribution: a policy of S\mathcal SS is certified optimal without comparing average costs at every starting stock. Its corollaries give checkable sufficient conditions; for example (Corollary 2.2) if φ(k)>0\varphi(k) > 0φ(k)>0 for k=1,…,sn−s1k = 1, \dots, s^n - s^1k=1,…,sn−s1, the policy of S\mathcal SS with the largest reorder point is optimal, which covers Poisson and negative binomial demand. Theorem 1 separately reduces the comparison of two policies to finitely many starting stocks.

The results are proved in the paper (Section 4 and Appendix §3). No machine-checked version is known: the platform has no discrete (s,S)(s, S)(s,S) inventory chain, no discounted cost of a stationary policy on Z\mathbb ZZ, and no accessibility notion for such a chain. The mission produces these objects together with the paper's selection theory on top of them.

Difficulty

Theorem 1 needs a renewal decomposition at the first passage of the stock below s′s's′, carried out for expectations over an unbounded integer state space with a discounted infinite sum. Lemma 1 is the delicate step. The paper's argument compares the (s,S)(s, S)(s,S) policy with a hybrid policy that follows (s,S)(s, S)(s,S) until the stock first reaches x′x'x′ and then switches to an optimal policy; the inequality "the hybrid cannot be better than the optimal policy" requires that some stationary (s,S)(s, S)(s,S) policy is optimal among all ordering policies, including non-stationary ones. That existence result is cited by the paper (Section 2), not proved there. A proof of Lemma 1 within the class of (s,S)(s, S)(s,S) policies alone does not go through, because the hybrid policy is not an (s,S)(s, S)(s,S) policy.

Formalization scope

All objects live in the namespace VeinottWagnerSS.Selection. The model is the structure Model: the demand distribution φ : PMF ℕ with finite mean, K ≥ 0, and G : ℤ → ℝ convex (non-decreasing forward differences) and tending to +∞+\infty+∞ at both ends. The unit cost ccc, the function LLL and the lead time λ\lambdaλ do not appear (the paper's own reduction, Eq. (2), p. 529). Stock levels are integers. stateLaw is the law of Xt+1X_{t+1}Xt+1​, obtained by iterated PMF.bind; fCost is the expected discounted cost of that chain as a real series, which converges absolutely for 0≤α<10 \le \alpha < 10≤α<1 because every YtY_tYt​ lies in [s,max⁡(x,S)][s, \max(x, S)][s,max(x,S)]. aCost is (1−α)(1-\alpha)(1−α) times fCost. Accessible uses the law of XtX_tXt​ with t>1t > 1t>1 strictly. Optimality is among (s,S)(s, S)(s,S) policies (p. 536); the class of general ordering policies is not formalized.

The bounds s‾,sˉ,S‾,Sˉ\underline{s}, \bar{s}, \underline{S}, \bar{S}s​,sˉ,S​,Sˉ are infima of sets of integers; under the standing assumptions and α<1\alpha < 1α<1 these sets are nonempty and bounded below, so each bound is the least integer the paper describes. Lα(S,D)\mathcal L_\alpha(S, D)Lα​(S,D) is defined as aα(S−D−1∣S−D,S)a_\alpha(S - D - 1 \mid S - D, S)aα​(S−D−1∣S−D,S), the cost at the starting stock just below sss; that this is the common value for every x<sx < sx<s is milestone 1.

The standing assumptions are kept in every statement, including Theorem 1 and milestone 1, which do not need them; Lemma 1 and Theorem 2 are true only because of them. No printed slip was found in the three results.

Trivializing formalizations are excluded: fff is the expected cost of the stock process, not a closed formula or a fixed point of a recursion, so milestone 1 is not definitional; the bounds are the least integers of (21)–(23), not arbitrary integers, so S\mathcal SS is determined by the data; the goal does not assume that (sj,Sj)(s^j, S^j)(sj,Sj) is optimal below max⁡(si,sj)\max(s^i, s^j)max(si,sj), and Lemma 1 assumes optimality only at the single starting stock xxx.

Useful contributions beyond the milestones: summability lemmas for fCost, the Markov (one-step) equation for fCost, the first-passage decomposition, and, for Lemma 1, a formalization of general ordering policies with the existence of an optimal stationary (s,S)(s, S)(s,S) policy. The chain and cost definitions are reusable for other (s,S)(s, S)(s,S) results of the paper (Theorem 3, Corollaries 2.1 and 2.2).

Selected references

  • A. F. Veinott, Jr. and H. M. Wagner, Computing Optimal (s, S) Inventory Policies, Management Science 11(5), 525–552, 1965. https://doi.org/10.1287/mnsc.11.5.525
  • H. Scarf, The Optimality of (S, s) Policies in the Dynamic Inventory Problem, in Mathematical Methods in the Social Sciences, Stanford University Press, 1960.
  • D. L. Iglehart, Optimality of (s, S) Policies in the Infinite Horizon Dynamic Inventory Problem, Management Science 9(2), 259–267, 1963. https://doi.org/10.1287/mnsc.9.2.259
6 thms2 active usersReviewed
CombinatoricsLinear OptimizationOptimization·Captain: mikedeng1

An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem I: ALGORITHM 1, Linear Grouping with LP Rounding, Is an Asymptotic Approximation SchemeResearch Paper

Motivation

One-dimensional bin packing asks for the fewest unit-capacity bins that hold a given list of items with sizes in (0,1)(0,1)(0,1). It is the model behind cutting stock (cutting rolls of paper or steel to ordered widths), memory and file allocation, and batch scheduling on identical machines, and it is NP-hard. Its algorithmic study is therefore about approximation: how close to the optimum a polynomial-time algorithm can guarantee to come.

  • 1961–1963: Gilmore and Gomory introduce the configuration linear program for cutting stock and solve it by column generation (Gilmore–Gomory 1961).
  • 1974: Johnson, Demers, Ullman, Garey and Graham analyse First Fit and related heuristics, with asymptotic ratio 17/1017/1017/10 and 11/911/911/9 (Johnson et al. 1974).
  • 1981: Fernandez de la Vega and Lueker give the first asymptotic approximation scheme, packing within (1+ε) OPT(I)+1(1+\varepsilon)\,OPT(I) + 1(1+ε)OPT(I)+1 bins in time linear in nnn for fixed ε\varepsilonε, using elimination of small pieces and linear grouping (Fernandez de la Vega–Lueker 1981).
  • 1982: Karmarkar and Karp replace the enumeration of configurations by an approximate solution of the configuration LP and a rounding step, obtaining an additive term polynomial in 1/ε1/\varepsilon1/ε (this mission), and, with geometric grouping, OPT(I)+O(log⁡2OPT(I))OPT(I) + O(\log^2 OPT(I))OPT(I)+O(log2OPT(I)) (Karmarkar–Karp 1982).
  • 2013–2017: Rothvoß and then Hoberg–Rothvoß improve the additive term to O(log⁡OPT⋅log⁡log⁡OPT)O(\log OPT \cdot \log\log OPT)O(logOPT⋅loglogOPT) and O(log⁡OPT)O(\log OPT)O(logOPT) (Hoberg–Rothvoß 2017).

Setting

An instance III is a finite multiset of piece sizes, each in the open interval (0,1)(0,1)(0,1). Write n(I)n(I)n(I) for the number of pieces, m(I)m(I)m(I) for the number of distinct sizes, and SIZE(I)SIZE(I)SIZE(I) for the sum of all sizes. A packing of III is a finite multiset of bins, each a multiset of sizes, whose union is exactly III and in which every bin has total size at most 111. Its cost is the number of bins, and OPT(I)OPT(I)OPT(I) is the minimum cost.

A configuration of III is a nonempty multiset of sizes occurring in III with total at most 111. With btb_tbt​ the number of pieces of size ttt and atca_{tc}atc​ the number of occurrences of ttt in configuration ccc, the fractional bin-packing problem is the linear program

min⁡ 1⋅xs.t.x≥0,∑catcxc≥bt  for every size t,\min\ \mathbf 1\cdot x\quad\text{s.t.}\quad x\ge 0,\qquad \sum_c a_{tc}x_c \ge b_t\ \ \text{for every size } t,min 1⋅xs.t.x≥0,c∑​atc​xc​≥bt​  for every size t,

whose optimal value is LIN(I)LIN(I)LIN(I). A basic feasible solution is an extreme point of its feasible region.

For instances I,JI,JI,J, write I≤JI\le JI≤J if there is a one-to-one map fff from the pieces of III into the pieces of JJJ with x≤f(x)x\le f(x)x≤f(x). Linear grouping with parameter kkk sorts III non-increasingly, cuts it into groups G1,…,GqG_1,\dots,G_qG1​,…,Gq​ of kkk consecutive pieces (the last possibly shorter), rounds every piece of GiG_iGi​ up to the largest size of GiG_iGi​ to get Gi′G_i'Gi′​, and outputs J=⋃i≥2Gi′J = \bigcup_{i\ge 2} G_i'J=⋃i≥2​Gi′​ and J′=G1J' = G_1J′=G1​.

ALGORITHM 1 takes III and ε>0\varepsilon>0ε>0: (1) discard the pieces of size ≤max⁡(1/n(I),ε/2)\le \max(1/n(I), \varepsilon/2)≤max(1/n(I),ε/2), leaving JJJ; (2) apply linear grouping to JJJ with k=⌈n(J)ε2⌉k = \lceil n(J)\varepsilon^2\rceilk=⌈n(J)ε2⌉, giving KKK and K′K'K′; (3) put each piece of K′K'K′ in its own bin; (4) obtain from a Fractional Bin-Packing subroutine a basic feasible solution xxx of the LP of KKK with 1⋅x≤LIN(K)+1\mathbf 1\cdot x\le LIN(K)+11⋅x≤LIN(K)+1; (5) round xxx to a packing of KKK with at most 1⋅x+(m(K)+1)/2\mathbf 1\cdot x + (m(K)+1)/21⋅x+(m(K)+1)/2 bins; (6) shrink the pieces back to obtain a packing of JJJ; (7) insert the discarded pieces, opening a new bin only when a piece fits nowhere. A(I)A(I)A(I) is the cost of the resulting packing.

Formalization targets

Goal: Theorem 3, as its proof establishes it

A(I)≤(1+2ε) OPT(I)+12ε2+3for every ε>0, every instance I, every run of ALGORITHM 1.A(I) \le (1+2\varepsilon)\,OPT(I) + \frac{1}{2\varepsilon^2} + 3 \qquad\text{for every } \varepsilon>0,\ \text{every instance } I,\ \text{every run of ALGORITHM 1.}A(I)≤(1+2ε)OPT(I)+2ε21​+3for every ε>0, every instance I, every run of ALGORITHM 1.

The additive term depends on ε\varepsilonε only, so ALGORITHM 1 is an asymptotic approximation scheme. The paper prints the factor 1+ε1+\varepsilon1+ε, which fails for ALGORITHM 1 as printed (see Formalization scope); running the algorithm with ε/2\varepsilon/2ε/2 gives the paper's main result (4), A(I)≤(1+ε)OPT(I)+O(ε−2)A(I)\le(1+\varepsilon)OPT(I)+O(\varepsilon^{-2})A(I)≤(1+ε)OPT(I)+O(ε−2), stated as a separate corollary with the explicit term 2/ε2+32/\varepsilon^2+32/ε2+3.

Milestones

  1. Lemma 1: OPT(I)≤2 SIZE(I)+1OPT(I)\le 2\,SIZE(I)+1OPT(I)≤2SIZE(I)+1.
  2. Lemma 2: SIZE(I)≤LIN(I)≤OPT(I)≤LIN(I)+m(I)+12SIZE(I)\le LIN(I)\le OPT(I)\le LIN(I)+\frac{m(I)+1}{2}SIZE(I)≤LIN(I)≤OPT(I)≤LIN(I)+2m(I)+1​.
  3. Corollary 1: every basic feasible solution xxx can be rounded to a packing of cost ≤1⋅x+m(I)+12\le \mathbf 1\cdot x + \frac{m(I)+1}{2}≤1⋅x+2m(I)+1​.
  4. Lemma 3: inserting pieces of size ≤g/2\le g/2≤g/2 last, with new bins only when necessary, costs at most max⁡(A,(1+g) OPT(I)+1)\max(A, (1+g)\,OPT(I)+1)max(A,(1+g)OPT(I)+1).
  5. Monotonicity: I≤JI\le JI≤J implies OPTOPTOPT, LINLINLIN and SIZESIZESIZE do not decrease.
  6. Lemma 4: linear grouping loses at most kkk in OPTOPTOPT, LINLINLIN and SIZESIZESIZE.
  7. Proof steps (ii)–(iii) (corrected): k≤2ε OPT(I)+1k\le 2\varepsilon\,OPT(I)+1k≤2εOPT(I)+1.
  8. Proof step (iv): m(K)≤1/ε2m(K)\le 1/\varepsilon^2m(K)≤1/ε2.
  9. Proof step (vii): 1⋅x≤OPT(I)+1\mathbf 1\cdot x\le OPT(I)+11⋅x≤OPT(I)+1.
  10. Proof step (viii) (corrected): the packing of Step 6 has at most (1+2ε)OPT(I)+12ε2+52(1+2\varepsilon)OPT(I)+\frac{1}{2\varepsilon^2}+\frac52(1+2ε)OPT(I)+2ε21​+25​ bins.

Significance

The result showed that the configuration LP, of exponential size in general, can be used for a guaranteed approximation: its value is within (m+1)/2(m+1)/2(m+1)/2 of the integer optimum, and grouping reduces mmm at small cost. The same template (eliminate small items, group, solve the configuration LP, round a basic solution, reinsert) underlies later schemes for bin packing, cutting stock, bin packing with cardinality constraints and scheduling, and the LP-based analysis is the starting point of the Rothvoß and Hoberg–Rothvoß improvements.

The theorems are proved in the literature; none of them has a machine-checked proof on the platform or, to our knowledge, in Mathlib. This mission produces a checked analysis of the algorithm, including a correction: the printed approximation factor is not valid for the algorithm as printed, and the checked statement records the factor its proof yields. The definitions (instances, packings, the configuration LP, basic solutions, the order I≤JI\le JI≤J, any-fit insertion) are reusable for the second mission of the series and for other bin-packing results.

Difficulty

The Lean statements are short, but several proofs need linear-programming structure that is not in Mathlib in this form. Lemma 2 and Corollary 1 use that an extreme point of {x≥0, Ax≥b}\{x\ge0,\ Ax\ge b\}{x≥0, Ax≥b} has at most as many nonzero coordinates as there are rows of AAA; the configuration LP is indexed by a finite but implicitly described set of multisets. Monotonicity of LINLINLIN under I≤JI\le JI≤J ("clearly" in the paper) requires transporting a fractional solution across a piece-to-piece matching whose images are types, not pieces. The existence of a run requires an optimal basic feasible solution of the configuration LP. Lemma 3 concerns an insertion process with unrestricted order and bin choice, so its bound has to hold for every execution, not for one greedy rule.

Formalization scope

  • Sizes are real numbers in the open interval (0,1)(0,1)(0,1); the paper says "a rational number between 0 and 1". Real sizes generalize rational ones; the open interval is what the paper's arguments use.
  • Instances are Multiset ℝ; packings are Multiset (Multiset ℝ) with join equal to the instance, bin loads at most 111, empty bins allowed and counted. OPTOPTOPT is a natural-number infimum over a set that is always nonempty.
  • LP solutions are Multiset ℝ →₀ ℝ supported on configurations. LINLINLIN is a real infimum over a set that is nonempty (singleton configurations) and bounded below by 000. "Basic" is the extreme-point property; the bound on the number of nonzero coordinates is a consequence, not the definition.
  • The Fractional Bin-Packing subroutine is modelled by its contract only (§5, p. 315): any basic feasible solution of cost at most LIN(K)+1LIN(K)+1LIN(K)+1. The ellipsoid method of §6 is not modelled.
  • ALGORITHM 1 is a relation Alg1Run ε I P: PPP is a possible output. Every open choice is quantified: the subroutine's output, the packing of Step 5 (any packing within the stated bound), the size reduction of Step 6 (bin by bin), and the insertion of Step 7 (any order, any fitting bin). The goal holds for every run, and a separate item states that a run exists, so the goal is not vacuous.
  • The paper's O(⋅)O(\cdot)O(⋅) in result (4) is replaced by the explicit 2/ε2+32/\varepsilon^2+32/ε2+3.
  • Corrected statements. The printed Theorem 3 bound (1+ε)OPT(I)+12ε2+3(1+\varepsilon)OPT(I)+\frac{1}{2\varepsilon^2}+3(1+ε)OPT(I)+2ε21​+3 fails: for ε=1/10\varepsilon=1/10ε=1/10 and 19 00019\,00019000 pieces of size 0.0510.0510.051, some run uses 118011801180 bins while the bound is 115311531153. The failing step is (ii), SIZE(J)≥ε n(J)SIZE(J)\ge\varepsilon\,n(J)SIZE(J)≥εn(J), since Step 1 discards only pieces ≤ε/2\le\varepsilon/2≤ε/2. Steps (ii)–(iii) and (viii) are stated with 2ε2\varepsilon2ε; step (iv) is stated as m(K)≤1/ε2m(K)\le 1/\varepsilon^2m(K)≤1/ε2 because its first link m(K)≤n(K)/km(K)\le n(K)/km(K)≤n(K)/k fails when the last group is short.
  • Running time (Theorem 3's first half, Corollary 1's time bound, the function TTT) is out of scope.
  • Trivializations are ruled out: "some packing has at most the bound" is not the goal; the goal constrains every output of the algorithm, and the packing property of that output is part of its conclusion.

Proofs of any item are welcome; Lemma 2, Corollary 1 and the monotonicity display are the most reusable.

Selected references

  • N. Karmarkar, R. M. Karp, An Efficient Approximation Scheme for the One-Dimensional Bin-Packing Problem, Proc. 23rd FOCS (SFCS 1982), IEEE, pp. 312–320. https://doi.org/10.1109/sfcs.1982.61
  • W. Fernandez de la Vega, G. S. Lueker, Bin packing can be solved within 1+ε in linear time, Combinatorica 1 (1981) 349–355. https://doi.org/10.1007/BF02579456
  • P. C. Gilmore, R. E. Gomory, A Linear Programming Approach to the Cutting-Stock Problem, Operations Research 9 (1961) 849–859. https://doi.org/10.1287/opre.9.6.849
  • D. S. Johnson, A. Demers, J. D. Ullman, M. R. Garey, R. L. Graham, Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms, SIAM J. Comput. 3 (1974) 299–325. https://doi.org/10.1137/0203025
  • R. Hoberg, T. Rothvoß, A Logarithmic Additive Integrality Gap for Bin Packing, Proc. SODA 2017, 2616–2625. https://doi.org/10.1137/1.9781611974782.172
16 thms2 active usersReviewed
Dynamic ProgrammingProbabilityStochastic Systems·Captain: mikedeng1

Exit Problems for Spectrally Negative Lévy Processes and Applications to (Canadized) Russian Options III: Optimal Stopping for the Canadized Russian OptionResearch Paper

Motivation

The Russian option of Shepp and Shiryaev pays its holder, at an exercise time of their choosing, the running maximum of the stock price, discounted, with no fixed maturity. It is the standard example of a perpetual lookback option, and its value is a model problem of optimal stopping for a two-dimensional Markov process (the price and its running maximum). Perpetual contracts are simple to analyse but economically unrealistic: every real contract ends. Canadization (Carr, Randomization and the American put, Rev. Financial Stud. 11, 1998, https://doi.org/10.1093/rfs/11.3.597) replaces a fixed maturity by an independent exponential time η(λ)\eta(\lambda)η(λ). The holder must exercise before η(λ)\eta(\lambda)η(λ); if they have not, they are paid the claim evaluated at η(λ)\eta(\lambda)η(λ). Because the exponential law is memoryless, the problem stays time-homogeneous and its value can be computed in closed form, while it approximates a contract of finite expected life 1/λ1/\lambda1/λ.

Avram, Kyprianou and Pistorius (AKP04) solved both the perpetual and the Canadized Russian problem when the log-price is a spectrally negative Lévy process: a process with stationary independent increments whose only jumps are downward. This covers Brownian motion with drift, the Black–Scholes model, and jump-diffusions with downward jumps (crashes). Their answer is written with the scale functions W(q)W^{(q)}W(q), Z(q)Z^{(q)}Z(q) of the process. This mission is the third of three drawn from that paper, and formalizes the Canadized problem (§7, Theorem 3).

Timeline. Shepp and Shiryaev (1993) solved the Russian option for geometric Brownian motion. Carr (1998) introduced Canadization for the American put. Kyprianou and Pistorius (Ann. Appl. Probab. 13, 2003) studied perpetual options through fluctuation theory; §7 of [AKP04] builds on their calculations. Avram, Kyprianou and Pistorius (2004) solved the perpetual and Canadized problems for general spectrally negative Lévy processes.

Setting

Let (Ω,F,F={Ft}t≥0,P)(\Omega,\mathcal F,\mathbf F=\{\mathcal F_t\}_{t\ge0},\mathbb P)(Ω,F,F={Ft​}t≥0​,P) be a filtered probability space with F\mathbf FF right-continuous, and let X={Xt}t≥0X=\{X_t\}_{t\ge0}X={Xt​}t≥0​ be a spectrally negative Lévy process adapted to F\mathbf FF: X0=0X_0=0X0​=0, paths càdlàg with no upward jumps and not monotone, increments Xs+t−XsX_{s+t}-X_sXs+t​−Xs​ stationary and independent of Fs\mathcal F_sFs​. The standing assumption is that XXX has unbounded variation, or bounded variation and a Lévy measure Λ(dx)≪dx\Lambda(dx)\ll dxΛ(dx)≪dx.

The Laplace exponent is ψ(θ)=log⁡E[eθX1]\psi(\theta)=\log\mathbb E[e^{\theta X_1}]ψ(θ)=logE[eθX1​]. Fix r≥0r\ge0r≥0 with ψ(1)=r\psi(1)=rψ(1)=r, and let P1\mathbb P^1P1 be the Esscher measure, dP1/dP∣Ft=eXt−rtd\mathbb P^1/d\mathbb P|_{\mathcal F_t}=e^{X_t-rt}dP1/dP∣Ft​​=eXt​−rt.

For q≥0q\ge0q≥0 the qqq-scale function W(q):R→[0,∞)W^{(q)}:\mathbb R\to[0,\infty)W(q):R→[0,∞) vanishes on (−∞,0](-\infty,0](−∞,0], is continuous on (0,∞)(0,\infty)(0,∞), and satisfies ∫0∞e−θxW(q)(x) dx=(ψ(θ)−q)−1\int_0^\infty e^{-\theta x}W^{(q)}(x)\,dx=(\psi(\theta)-q)^{-1}∫0∞​e−θxW(q)(x)dx=(ψ(θ)−q)−1 for θ>Φ(q)\theta>\Phi(q)θ>Φ(q), where Φ(q)\Phi(q)Φ(q) is the largest root of ψ(θ)=q\psi(\theta)=qψ(θ)=q. Further, Z(q)(x)=1+q∫−∞xW(q)(y) dyZ^{(q)}(x)=1+q\int_{-\infty}^xW^{(q)}(y)\,dyZ(q)(x)=1+q∫−∞x​W(q)(y)dy. All scale functions in this mission are those of (X,P)(X,\mathbb P)(X,P).

Starting from Y0=z≥0Y_0=z\ge0Y0​=z≥0 (the paper's P−z1\mathbb P^1_{-z}P−z1​), the reflected process is Yt=X‾t−XtY_t=\overline X_t-X_tYt​=Xt​−Xt​, where X‾t=max⁡{0,sup⁡u≤t(−z+Xu)}\overline X_t=\max\{0,\sup_{u\le t}(-z+X_u)\}Xt​=max{0,supu≤t​(−z+Xu​)} and the position is −z+Xt-z+X_t−z+Xt​. Its passage time above kkk is τk=inf⁡{t≥0:Yt∉[0,k)}\tau_k=\inf\{t\ge0:Y_t\notin[0,k)\}τk​=inf{t≥0:Yt​∈/[0,k)}.

Let α>0\alpha>0α>0, and let η(λ)\eta(\lambda)η(λ) be an exponential random variable of rate λ>0\lambda>0λ>0 which under P1\mathbb P^1P1 is independent of F∞\mathcal F_\inftyF∞​. The Canadized Russian problem (32) is

wCR(z)=sup⁡τ E−z1[e−α(τ∧η(λ))+Yτ∧η(λ)],w^{CR}(z)=\sup_\tau\ \mathbb E^1_{-z}\Big[e^{-\alpha(\tau\wedge\eta(\lambda))+Y_{\tau\wedge\eta(\lambda)}}\Big],wCR(z)=τsup​ E−z1​[e−α(τ∧η(λ))+Yτ∧η(λ)​],

over all P1\mathbb P^1P1-a.s. finite F\mathbf FF-stopping times τ\tauτ. Write p=α+λ+rp=\alpha+\lambda+rp=α+λ+r.

Formalization targets

Goal: Theorem 3

With

κ∗=inf⁡{x≥0: Z(p)(x)−pW(p)(x)≤−λ/(p−λ)},h(z)=(p−λ)ezZ(p)(κ∗−z)p+λezp,\kappa_*=\inf\{x\ge0:\ Z^{(p)}(x)-pW^{(p)}(x)\le-\lambda/(p-\lambda)\},\qquad h(z)=\frac{(p-\lambda)e^zZ^{(p)}(\kappa_*-z)}{p}+\frac{\lambda e^z}{p},κ∗​=inf{x≥0: Z(p)(x)−pW(p)(x)≤−λ/(p−λ)},h(z)=p(p−λ)ezZ(p)(κ∗​−z)​+pλez​,

for every z≥0z\ge0z≥0:

wCR(z)=h(z),w^{CR}(z)=h(z),wCR(z)=h(z),

and τκ∗\tau_{\kappa_*}τκ∗​​ is a P1\mathbb P^1P1-a.s. finite F\mathbf FF-stopping time attaining the supremum. The statement covers every variation regime at once.

Milestones

In attack order:

  1. Lemma 2 (i), which gives the monotonicity behind κ∗\kappa_*κ∗​.
  2. Corollary 1 (29), the value of stopping at τk\tau_kτk​ at discount rate α+λ\alpha+\lambdaα+λ.
  3. The elimination of η(λ)\eta(\lambda)η(λ) (display after (32)):
E−z1[e−α(τ∧η)+Yτ∧η]=E−z1[e−(α+λ)τ+Yτ+λ∫0τe−(α+λ)t+Ytdt].\mathbb E^1_{-z}\big[e^{-\alpha(\tau\wedge\eta)+Y_{\tau\wedge\eta}}\big]=\mathbb E^1_{-z}\Big[e^{-(\alpha+\lambda)\tau+Y_\tau}+\lambda\int_0^\tau e^{-(\alpha+\lambda)t+Y_t}dt\Big].E−z1​[e−α(τ∧η)+Yτ∧η​]=E−z1​[e−(α+λ)τ+Yτ​+λ∫0τ​e−(α+λ)t+Yt​dt].
  1. The Itô identity (34).
  2. The expected dX‾d\overline XdX-integral up to τk\tau_kτk​.
  3. Lemma 3 (33), the value of τk∧η(λ)\tau_k\wedge\eta(\lambda)τk​∧η(λ).
  4. Lemma 4, with two misprints corrected.
  5. The supermartingale property of Ut=e−(α+λ)th(Yt)+λ∫0te−(α+λ)u+YuduU_t=e^{-(\alpha+\lambda)t}h(Y_t)+\lambda\int_0^te^{-(\alpha+\lambda)u+Y_u}duUt​=e−(α+λ)th(Yt​)+λ∫0t​e−(α+λ)u+Yu​du.
  6. The identity h(z)=ez+(p−λ)ez∫0κ∗−zW(p)≥ezh(z)=e^z+(p-\lambda)e^z\int_0^{\kappa_*-z}W^{(p)}\ge e^zh(z)=ez+(p−λ)ez∫0κ∗​−z​W(p)≥ez.

Significance

The result. Theorem 3 gives the price and the optimal exercise rule of a Russian option with random (exponential) maturity, for every spectrally negative Lévy model at once. It makes three things explicit. The optimal rule is a threshold rule for the reflected process YYY. The threshold κ∗\kappa_*κ∗​ is the crossing point of one explicit function of the scale functions. Whenever W(p)(0+)≥(p−λ)−1W^{(p)}(0+)\ge(p-\lambda)^{-1}W(p)(0+)≥(p−λ)−1 (possible only with bounded variation), immediate exercise is optimal. Because scale functions are known in closed form for many models, including Brownian motion with drift and hyper-exponential jump-diffusions (§8 of the paper), the theorem produces explicit prices.

Formalizing it. The result is proved on paper. It is not formalized in any proof assistant, and none of its infrastructure is available in Lean. This mission produces:

  • a path-level definition of spectrally negative Lévy processes;
  • scale functions defined as definite descriptions;
  • the reflected process and its passage times;
  • the Esscher change of measure as data;
  • a continuous-time optimal stopping problem with an independent random horizon, valued in [0,∞][0,\infty][0,∞].

A machine-checked proof would also check the verification argument, which the paper states in detail only for the unbounded-variation case.

Difficulty

The obvious route is to compute the value of every threshold rule (Lemma 3) and optimize over kkk. That identifies the right candidate, but it does not show that no other stopping time does better. The verification step needs two things for all regimes of W(p)(0+)W^{(p)}(0+)W(p)(0+): that UUU is a supermartingale, and that UUU stopped at τκ∗\tau_{\kappa_*}τκ∗​​ is a martingale. For processes of bounded variation, hhh is only continuous, not C1C^1C1, at κ∗\kappa_*κ∗​, so a smooth Itô formula does not apply directly. Computing the expected dX‾d\overline XdX-integral up to τk\tau_kτk​ uses excursion theory of YYY away from 000, which Mathlib does not have. Eliminating η(λ)\eta(\lambda)η(λ) is easy only if η\etaη is independent of the whole filtration. If it is independent of XXX alone, a stopping time could depend on η\etaη.

Formalization scope

  • Conventions. Time is [0,∞)[0,\infty)[0,∞) (ℝ≥0) and values are real. Random times take values in WithTop ℝ≥0, and the payoff is 000 on {τ=∞}\{\tau=\infty\}{τ=∞}. Expectations of nonnegative payoffs are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], and wCRw^{CR}wCR is an extended-real supremum, so no expectation defaults to 000. Equalities with a real right-hand side also assert finiteness.
  • Readings of informal words.
    • "The usual conditions" means right-continuity of F\mathbf FF, without completeness. Completing F0\mathcal F_0F0​ with P\mathbb PP-null sets would contradict the Esscher relation, since P1\mathbb P^1P1 and P\mathbb PP are typically singular on F∞\mathcal F_\inftyF∞​.
    • "Unbounded variation" means "not almost surely of bounded variation on compacts". (AC) is stated through jumps.
    • "ψ(v) < ∞" means integrability of evX1e^{vX_1}evX1​.
    • "Decreases monotonically" means strictly decreasing, and "the unique root" means unique on [0,∞)[0,\infty)[0,∞).
    • W(p)(0+)W^{(p)}(0+)W(p)(0+) is the right limit.
    • "Almost surely finite" and the law and independence of η(λ)\eta(\lambda)η(λ) are all under P1\mathbb P^1P1, where independence is from F∞\mathcal F_\inftyF∞​. "Parameter λ\lambdaλ" is the rate.
    • Ps,x1\mathbb P^1_{s,x}Ps,x1​ is encoded pathwise through the reflected process with Y0=s−xY_0=s-xY0​=s−x.
    • The elimination of η\etaη is stated τ by τ, which implies the page's equality of suprema.
    • The supermartingale claim, derived on the page in the unbounded-variation case, is stated for all cases.
    • Corollary 1's discount rate is renamed aaa.
    • (34) is stated as pA+B=es−x+CpA+B=e^{s-x}+CpA+B=es−x+C with AAA, BBB, CCC finite.
  • Definition choices. Scale functions are defined by choice from their defining property, never as hypotheses on an arbitrary function. W(q)W^{(q)}W(q) for q<0q<0q<0 is the series (5), not the tilting formula of Remark 4. P1\mathbb P^1P1 is a measure given with the Esscher relation. dX‾td\overline X_tdXt​ is the Lebesgue–Stieltjes measure of the running-maximum path.
  • Corrected misprints. Lemma 4 is printed with p−1p^{-1}p−1 and −λ/p-\lambda/p−λ/p. The definition of κ∗\kappa_*κ∗​ (p. 233) and the proof of Theorem 3 (p. 235) require (p−λ)−1(p-\lambda)^{-1}(p−λ)−1 and −λ/(p−λ)-\lambda/(p-\lambda)−λ/(p−λ), and the printed version is false when p−1≤W(p)(0+)<(p−λ)−1p^{-1}\le W^{(p)}(0+)<(p-\lambda)^{-1}p−1≤W(p)(0+)<(p−λ)−1. The corrected statement is formalized.
  • Ruled out. A supremum over stopping times of a filtration containing σ(η)\sigma(\eta)σ(η), or a real-valued supremum or Bochner expectation that could be 000 by default, would trivialize the goal or change it. The admissible class is every P1\mathbb P^1P1-a.s. finite stopping time of the given filtration, of which η\etaη is independent. Replacing the goal by the η\etaη-free rewriting would state milestone 3 as if it were Theorem 3.
  • Needed and reusable. A complete development needs Lévy process theory, scale functions, fluctuation identities for the reflected process, optional stopping in continuous time, and Itô or change-of-variable formulas for semimartingales with jumps. The Lévy-process, scale-function and reflected-process definitions are shared with the other two missions of the series and are reusable in ruin theory and queueing. Proofs of any milestone, and sorry-free facts about the definitions, are welcome.

Selected references

  • F. Avram, A. E. Kyprianou, M. R. Pistorius, Exit problems for spectrally negative Lévy processes and applications to (Canadized) Russian options, Ann. Appl. Probab. 14(1), 215–238, 2004. https://doi.org/10.1214/aoap/1075828052
  • P. Carr, Randomization and the American put, Rev. Financial Stud. 11(3), 597–626, 1998. https://doi.org/10.1093/rfs/11.3.597
  • L. A. Shepp, A. N. Shiryaev, The Russian option: reduced regret, Ann. Appl. Probab. 3, 603–631, 1993. https://doi.org/10.1214/aoap/1177005715
  • A. E. Kyprianou, M. R. Pistorius, Perpetual options through fluctuation theory, Ann. Appl. Probab. 13, 1077–1098, 2003. https://doi.org/10.1214/aoap/1060202835
  • J. Bertoin, Lévy Processes, Cambridge University Press, 1996.
18 thms2 active usersReviewed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

Strategic Inventory and Supplier Encroachment: For Any Positive Holding Cost the Buyer Withholds Strategic Inventory When the Direct Selling Cost Is Just Below 5/6, at Total Holding Cost Below 11/72Research Paper

Motivation

Two strategic levers shape the balance of power between a manufacturer and the retailer that resells its product. The first is strategic inventory: a buyer that orders more than it sells today, and carries the surplus into the next period, weakens the supplier's leverage over tomorrow's wholesale price. Anand, Anupindi and Bassok (Management Science 2008) showed that in a two-period channel the buyer withholds inventory exactly when its unit holding cost is below α/4\alpha/4α/4. The second is supplier encroachment: a supplier that can sell directly to consumers competes with its own buyer. Arya, Mittendorf and Sappington (Marketing Science 2007) showed that the threat of encroachment can lower wholesale prices and benefit both parties.

Guan, Gurnani, Geng and Luo, Strategic Inventory and Supplier Encroachment (MSOM 2019), combine the two levers in one game. Their headline qualitative finding is Proposition 4.2. When the supplier's direct channel is costly, but not quite too costly to use, the buyer keeps withholding inventory at every finite holding cost. This contrasts with the α/4\alpha/4α/4 cutoff of Anand et al. This mission formalizes that proposition, together with the equilibrium characterizations of Appendix A on which it rests.

Setting

There is one supplier and one buyer, two periods, deterministic demand and complete information. In each period the market price is p=α−qp = \alpha - qp=α−q, where qqq is the total quantity sold in that period and α>0\alpha > 0α>0 is the demand intercept. The buyer pays a per-unit holding cost h≥0h \ge 0h≥0 on inventory carried into period 2. The supplier pays a per-unit direct selling cost s≥0s \ge 0s≥0. All other costs and the salvage value are zero. The moves are:

  1. The supplier quotes a wholesale price w1≥0w_1 \ge 0w1​≥0.
  2. The buyer orders Q1Q_1Q1​ and sells q1q_1q1​, with 0≤q1≤Q10 \le q_1 \le Q_10≤q1​≤Q1​. It carries the inventory I=Q1−q1I = Q_1 - q_1I=Q1​−q1​ into period 2.
  3. The supplier quotes w2≥0w_2 \ge 0w2​≥0.
  4. The buyer orders Q2≥0Q_2 \ge 0Q2​≥0 and sells q2q_2q2​, with 0≤q2≤I+Q20 \le q_2 \le I + Q_20≤q2​≤I+Q2​.
  5. Having observed everything, the supplier sells qs≥0q_s \ge 0qs​≥0 directly. The period-2 price is α−q2−qs\alpha - q_2 - q_sα−q2​−qs​.

The total profits are

Πb=(α−q1)q1−w1Q1−hI+(α−q2−qs)q2−w2Q2,Πs=w1Q1+w2Q2+(α−q2−qs−s)qs.\Pi_b = (\alpha - q_1)q_1 - w_1 Q_1 - hI + (\alpha - q_2 - q_s)q_2 - w_2 Q_2, \qquad \Pi_s = w_1 Q_1 + w_2 Q_2 + (\alpha - q_2 - q_s - s)q_s .Πb​=(α−q1​)q1​−w1​Q1​−hI+(α−q2​−qs​)q2​−w2​Q2​,Πs​=w1​Q1​+w2​Q2​+(α−q2​−qs​−s)qs​.

A strategy profile assigns an action to every history at which a player moves. It is a subgame perfect equilibrium (SPE) if, at every feasible history, the mover's prescribed action is feasible and no feasible alternative, followed by the profile afterwards, raises the mover's total profit. The equilibrium path is the outcome the profile generates; the equilibrium inventory is III on that path. Following the paper (§4), the goal theorem sets α=1\alpha = 1α=1.

Formalization targets

Goal: Proposition 4.2

With α=1\alpha = 1α=1,

∀h>0  ∃ϵ>0  ∀s∈(56−ϵ,56):an SPE exists, and every SPE has I>0 and hI<1172.\forall h > 0\ \ \exists \epsilon > 0\ \ \forall s \in \big(\tfrac56 - \epsilon, \tfrac56\big):\quad \text{an SPE exists, and every SPE has } I > 0 \text{ and } hI < \tfrac{11}{72}.∀h>0  ∃ϵ>0  ∀s∈(65​−ϵ,65​):an SPE exists, and every SPE has I>0 and hI<7211​.

Here ϵ\epsilonϵ may depend on hhh, and the bound 11/7211/7211/72 applies at the same (h,s)(h, s)(h,s).

Milestones, in attack order

  1. Stage-3 best response (§3.1.1): in every SPE, the supplier sells qs=(α−q2−s)+/2q_s = (\alpha - q_2 - s)^+/2qs​=(α−q2​−s)+/2 at every history.
  2. Eq. (1) (§3.1.1): with no inventory, the buyer's period-2 quantity is the four-branch function qb(w)q_b(w)qb​(w) of the period-2 wholesale price www.
  3. Proposition 4.1, existence half: an SPE exists for every h≥0h \ge 0h≥0 and s≥0s \ge 0s≥0.
  4. Region 8 (Tables A.1 and A.4): for h<h11h < h_{11}h<h11​ with s3≤s<5α/6s_3 \le s < 5\alpha/6s3​≤s<5α/6, or for h<α/4h < \alpha/4h<α/4 with 5α/6≤s<α5\alpha/6 \le s < \alpha5α/6≤s<α, every SPE has I=5(α−4h)/34I = 5(\alpha - 4h)/34I=5(α−4h)/34 and the path of Table A.4.
  5. Region 7, second part (Tables A.1 and A.3): for h11<h<h10h_{11} < h < h_{10}h11​<h<h10​ and s3≤s<5α/6s_3 \le s < 5\alpha/6s3​≤s<5α/6, every SPE has I=I∗=(2α−3s+x)/2I = I^* = (2\alpha - 3s + x)/2I=I∗=(2α−3s+x)/2 and the path of Table A.3.
  6. Region 10, second part (Tables A.1 and A.4): for h>h7h > h_7h>h7​ and 2α/3<s<5α/62\alpha/3 < s < 5\alpha/62α/3<s<5α/6, every SPE has I=0I = 0I=0.

The thresholds xxx, s3s_3s3​, h7h_7h7​, h10h_{10}h10​, h11h_{11}h11​ are explicit algebraic functions of sss, given in Appendix A.

Significance

Proposition 4.2 separates the combined model from the two models it merges. Without a direct channel, inventory disappears once h≥α/4h \ge \alpha/4h≥α/4. With a direct channel, a threat of encroachment that is only barely credible keeps inventory alive at every holding cost. The total holding cost nevertheless stays below a constant, because the inventory shrinks as hhh grows. Milestone 6 shows the flip side: for a fixed s<5α/6s < 5\alpha/6s<5α/6, a large enough hhh removes the inventory. This is why the window ϵ\epsilonϵ must depend on hhh.

The paper's proofs are in an online appendix that is not reproduced in the article. The article itself gives the equilibrium only as tables. A formal development would supply a checked backward-induction proof of those tables in the regions near s=5α/6s = 5\alpha/6s=5α/6. It would also give a machine-checked SPE framework for multi-stage pricing-and-quantity games in supply chains, which none of the following exists for: Stackelberg pricing, sequential quantity competition, or dual-channel encroachment. No part of this paper has been formalized before.

Difficulty

The equilibrium is found by backward induction through five stages. Each stage's value function is only piecewise smooth, because the supplier's direct-channel response (⋅)+(\cdot)^+(⋅)+ switches on and off. As a result the buyer's period-2 profit has kinks, the supplier's period-2 profit as a function of III has several local maxima, and the period-1 problems must compare branches whose boundaries are the irrational thresholds of Appendix A. The obvious approach, solving the first-order conditions stage by stage, fails at the kinks. At some region boundaries it also misses that the supplier is indifferent between two first-period prices, which makes the equilibrium path change discontinuously. Proposition 4.2 then needs uniform control of h7h_7h7​, h10h_{10}h10​ and h11h_{11}h11​ as s↑5/6s \uparrow 5/6s↑5/6, where the denominator 3s−2−x3s - 2 - x3s−2−x of h7h_7h7​ tends to 000.

Formalization scope

  • Representation. Strategies are functions of the full history, not Markov rules in III. IsSPE imposes optimality at every feasible history, including off-path ones. All actions are real numbers; wholesale prices and quantities are nonnegative, with q1≤Q1q_1 \le Q_1q1​≤Q1​ and q2≤I+Q2q_2 \le I + Q_2q2​≤I+Q2​.
  • Normalization. The goal instantiates α=1\alpha = 1α=1 as the paper does from §4 on. The milestones keep a general α>0\alpha > 0α>0.
  • Uniqueness is not stated. Proposition 4.1's uniqueness claim is false for strategy profiles: after the off-path price w2=0w_2 = 0w2​=0, every order Q2≥q2−IQ_2 \ge q_2 - IQ2​≥q2​−I is optimal. The goal and the region milestones therefore quantify over every SPE and carry existence as a separate conjunct.
  • Corrected hypotheses.
    • The printed s3=((37−365)/34+4/6)α≈1.28αs_3 = (\sqrt{(37 - 3\sqrt{65})/34} + 4/6)\alpha \approx 1.28\alphas3​=((37−365​)/34​+4/6)α≈1.28α is replaced by (37−365/34+4/6)α≈0.772α(\sqrt{37 - 3\sqrt{65}}/34 + 4/6)\alpha \approx 0.772\alpha(37−365​​/34+4/6)α≈0.772α, which matches the paper's "≈0.77".
    • Eq. (1) excludes the corner w=0w = 0w=0, s<α/3s < \alpha/3s<α/3, where its second branch is wrong.
    • Region 8 drops its boundary h=h11h = h_{11}h=h11​ and Region 7 drops h=h10h = h_{10}h=h10​, because the equilibrium path switches there and need not be unique.
  • Ruled-out trivialization. The inventory in the goal is the inventory on the path of an SPE of the game above. It is not the closed form 5(1−4h)/345(1 - 4h)/345(1−4h)/34 or I∗I^*I∗ from the tables, and the regional characterization is not a hypothesis. Otherwise the goal would reduce to algebra about the thresholds.
  • Infrastructure and contributions. The definitions Game, IsSPE and Thresholds are shared by every statement. Welcome contributions include:
    • lemmas on maximizing concave piecewise-quadratic functions on half-lines;
    • a reusable backward-induction lemma for finite-stage games with real action sets;
    • interval-arithmetic facts about xxx, h7h_7h7​, h10h_{10}h10​ and h11h_{11}h11​ near s=5/6s = 5/6s=5/6;
    • proofs of the paper's other regions.

Selected references

  • T. Guan, H. Gurnani, X. Geng, Y. Luo, Strategic Inventory and Supplier Encroachment, Manufacturing & Service Operations Management 21(3):536–555, 2019. https://doi.org/10.1287/msom.2018.0705
  • K. Anand, R. Anupindi, Y. Bassok, Strategic Inventories in Vertical Contracts, Management Science 54(10):1792–1804, 2008. https://doi.org/10.1287/mnsc.1080.0894
  • A. Arya, B. Mittendorf, D. Sappington, The Bright Side of Supplier Encroachment, Marketing Science 26(5):651–659, 2007. https://doi.org/10.1287/mksc.1070.0280
10 thms2 active usersReviewed
Algorithmic Game TheoryConvex OptimizationOptimization·Captain: mikedeng1

Existence of an Equilibrium for a Competitive Economy II: Equilibrium Exists When Every Consumer Can Supply Productive LaborResearch Paper

Motivation

A competitive equilibrium is a list of production plans, consumption plans and prices at which every firm maximizes profit, every consumer maximizes utility within the budget, and no market has excess demand. Whether such prices exist at all is the consistency question behind general equilibrium theory, the welfare theorems, and applied equilibrium models used in policy analysis. Arrow and Debreu gave the first proof of existence for a model with production, private ownership and general convex preferences (Econometrica 22, 1954), using Debreu's existence theorem for abstract economies (PNAS 38, 1952).

Their Theorem I assumes that every consumer initially holds a positive amount of every commodity (Assumption IV.a). The authors call this "clearly unrealistic" (p. 280): a household does not hold every good, and most households own little beyond their labor. Theorem II, the subject of this mission, removes that assumption. It only asks that every consumer be able to supply some type of labor that is always productive of a commodity everyone desires. This is the version of the existence theorem that allows a wage-earner economy.

Timeline. Wald (1935–36) proved existence for special production models. Nash (1950) proved existence of equilibrium points for finite games, and Debreu (1952) extended it to abstract economies, in which each player's feasible set depends on the others' choices. Arrow and Debreu (1954) proved Theorems I and II. McKenzie's independent existence proof was published the same year (Econometrica 22, 1954).

Setting

There are lll commodities, nnn producers and mmm consumers; vectors live in Rl\mathbb R^lRl and x≦yx\leqq yx≦y is componentwise. Producer jjj has a production set YjY_jYj​. Consumer iii has a consumption set XiX_iXi​, a utility uiu_iui​ on XiX_iXi​, an endowment ζi\zeta_iζi​ and profit shares αij\alpha_{ij}αij​. Write Y=∑jYjY=\sum_jY_jY=∑j​Yj​, X=∑iXiX=\sum_iX_iX=∑i​Xi​, ζ=∑iζi\zeta=\sum_i\zeta_iζ=∑i​ζi​, and let P={p≧0, ∑hph=1}P=\{p\geqq0,\ \sum_hp_h=1\}P={p≧0, ∑h​ph​=1} be the price simplex. A competitive equilibrium (x1∗,…,xm∗,y1∗,…,yn∗,p∗)(x_1^*,\dots,x_m^*,y_1^*,\dots,y_n^*,p^*)(x1∗​,…,xm∗​,y1∗​,…,yn∗​,p∗) satisfies four conditions. Each yj∗y_j^*yj∗​ maximizes p∗⋅yjp^*\cdot y_jp∗⋅yj​ on YjY_jYj​. Each xi∗x_i^*xi∗​ maximizes uiu_iui​ on {xi∈Xi:p∗⋅xi≤p∗⋅ζi+∑jαijp∗⋅yj∗}\{x_i\in X_i: p^*\cdot x_i\le p^*\cdot\zeta_i+\sum_j\alpha_{ij}p^*\cdot y_j^*\}{xi​∈Xi​:p∗⋅xi​≤p∗⋅ζi​+∑j​αij​p∗⋅yj∗​}. The price vector satisfies p∗∈Pp^*\in Pp∗∈P. Finally z∗=∑xi∗−∑yj∗−ζ≦0z^*=\sum x_i^*-\sum y_j^*-\zeta\leqq0z∗=∑xi∗​−∑yj∗​−ζ≦0 and p∗⋅z∗=0p^*\cdot z^*=0p∗⋅z∗=0.

The assumptions of Theorem II are as follows. I: production sets are closed, convex and contain 000; Y∩Ω={0}Y\cap\Omega=\{0\}Y∩Ω={0} (no output without input); Y∩(−Y)={0}Y\cap(-Y)=\{0\}Y∩(−Y)={0} (no reversible production). II: each XiX_iXi​ is closed, convex and bounded below. III: uiu_iui​ is continuous, has no satiation point, and satisfies ui(tx+(1−t)x′)>ui(x′)u_i(tx+(1-t)x')>u_i(x')ui​(tx+(1−t)x′)>ui​(x′) whenever ui(x)>ui(x′)u_i(x)>u_i(x')ui​(x)>ui​(x′) and 0<t<10<t<10<t<1. IV.b: shares are nonnegative and sum to one for each firm. Two sets of commodities are defined from the data. The set D\mathcal DD contains the commodities always desired by every consumer: from any xi∈Xix_i\in X_ixi​∈Xi​, adding some positive amount of the commodity stays in XiX_iXi​ and raises uiu_iui​. The set P\mathcal PP contains the types of productive labor: for every y∈Yy\in Yy∈Y, (a) yh≤0y_h\le0yh​≤0, and (b) some y′∈Yy'\in Yy′∈Y satisfies yh′′≥yh′y'_{h'}\ge y_{h'}yh′′​≥yh′​ for all h′≠hh'\ne hh′=h and yh′′′>yh′′y'_{h''}>y_{h''}yh′′′​>yh′′​ for some h′′∈Dh''\in\mathcal Dh′′∈D. The remaining assumptions are:

  • IV′.a: each consumer has some xi∈Xix_i\in X_ixi​∈Xi​ with xi≦ζix_i\leqq\zeta_ixi​≦ζi​ and xhi<ζhix_{hi}<\zeta_{hi}xhi​<ζhi​ for some h∈Ph\in\mathcal Ph∈P;
  • V: some x∈Xx\in Xx∈X and y∈Yy\in Yy∈Y satisfy xh<yh+ζhx_h<y_h+\zeta_hxh​<yh​+ζh​ for every hhh;
  • VI: D≠∅\mathcal D\ne\emptysetD=∅;
  • VII: P≠∅\mathcal P\ne\emptysetP=∅.

Formalization targets

Goal: Theorem II (§4.5, p. 281)

Assumptions I–III, IV′, V–VII ⟹ ∃ (x∗,y∗,p∗) satisfying Conditions 1–4.\text{Assumptions I–III, IV}',\ \text{V–VII}\ \Longrightarrow\ \exists\,(x^*,y^*,p^*)\ \text{satisfying Conditions 1–4.}Assumptions I–III, IV′, V–VII ⟹ ∃(x∗,y∗,p∗) satisfying Conditions 1–4.

Milestones (§5, pp. 282–287)

They follow the paper's proof. Let π=∣P∣\pi=|\mathcal P|π=∣P∣ and Pε={p∈P:ph≥ε ∀h∈P}P^\varepsilon=\{p\in P: p_h\ge\varepsilon\ \forall h\in\mathcal P\}Pε={p∈P:ph​≥ε ∀h∈P} for 0<ε≤1/(2π)0<\varepsilon\le1/(2\pi)0<ε≤1/(2π). Let EεE^\varepsilonEε be the abstract economy in which consumers maximize utility under budget constraints, producers maximize profit, and a market participant chooses p∈Pεp\in P^\varepsilonp∈Pε to maximize p⋅zp\cdot zp⋅z. The milestones are:

  1. §5.0 (1). On PεP^\varepsilonPε every consumer can spend strictly less than p⋅ζip\cdot\zeta_ip⋅ζi​.
  2. §5.1.1 (5). Equilibrium points of EεE^\varepsilonEε satisfy x∗−y∗≦ζ′x^*-y^*\leqq\zeta'x∗−y∗≦ζ′ for a vector ζ′\zeta'ζ′ independent of ε\varepsilonε.
  3. §5.2.0. The attainable sets relative to ζ′\zeta'ζ′ are bounded.
  4. §5.2.1. The truncated economy E~ε\tilde E^\varepsilonE~ε has an equilibrium point.
  5. §5.2.2 (3)–(5). An equilibrium point of E~ε\tilde E^\varepsilonE~ε is one of EεE^\varepsilonEε.
  6. §5.3.0 (2). If ph∗>εp^*_h>\varepsilonph∗​>ε for all h∈Ph\in\mathcal Ph∈P, the point is a competitive equilibrium.
  7. §5.3.2 (1). Limits of equilibrium points as ε→0\varepsilon\to0ε→0 are quasi-equilibria for consumers.
  8. §5.3.4 (3). If the floors bind, some desired commodity has limit price 000.
  9. §5.3.4 (6). If the floors bind, limit consumption minimizes expenditure over XiX_iXi​.
  10. §5.3.5. For some ε\varepsilonε the floor does not bind.

Significance

Theorem II is the existence theorem for a competitive economy in which consumers may own nothing but their labor. It shows that the survival assumption IV.a can be traded for conditions on labor, desirability and the possibility of an overall excess supply. Section 5.3.3 of the paper also isolates the quasi-equilibrium, in which utility maximization under the budget is replaced by cost minimization at a given utility level. That notion is used in later existence and welfare arguments.

The theorem has been proved since 1954; this mission does not reopen it. The work here is the machine-checked proof. The companion mission on Theorem I formalizes the shared model and Debreu's lemma. As of September 2026 neither theorem has a Lean formalization on the platform, and Mathlib contains no general equilibrium theory.

Difficulty

The obvious approach reuses the proof of Theorem I: build the abstract economy of consumers, producers and a price-choosing participant, and apply Debreu's lemma. That fails at the boundary of the price simplex. Without IV.a, a consumer's cheapest point in XiX_iXi​ can cost as much as the endowment at some prices, so the budget correspondence is not continuous there and the lemma does not apply. The paper therefore keeps prices of productive labor at least ε\varepsilonε and must then show that the floor does not bind for some ε\varepsilonε. That is a limit argument as ε→0\varepsilon\to0ε→0 which uses Assumptions V, VI and VII together, and each of the milestones 7–9 is a step of it. Debreu's lemma itself needs a Kakutani-type fixed point theorem for correspondences, which Mathlib does not provide.

Formalization scope

Commodity vectors are Fin l → ℝ. Consumers are indexed by Fin m and producers by Fin n. The inner product is ⬝ᵥ. The paper's x<yx<yx<y is strict in every component and is written componentwise, never as Lean's < on functions. D\mathcal DD and P\mathcal PP are computed from the economy, not supplied as parameters. Utilities are total functions, but every assumption on uiu_iui​ quantifies over XiX_iXi​ only. "Maximizes" is membership plus an inequality against every feasible alternative; no supremum is used. EEE, EεE^\varepsilonEε and E~ε\tilde E^\varepsilonE~ε are built by one constructor over the players Fin m ⊕ Fin n ⊕ Unit. The vector ζ′\zeta'ζ′ takes the lower bounds ξi\xi_iξi​ of Assumption II as an explicit argument. The milestones of §5.3 are stated for the limit of a sequence of equilibrium points, which is how the paper constructs them. Assumption V is dropped from every milestone except §5.3.5 and the goal. With V, the case assumption of §5.3.1 is contradictory and those milestones would hold vacuously.

A trivializing formalization is ruled out as follows. The assumptions are satisfiable with IV.a failing: a sorry-free check covers two goods, one consumer who owns nothing and can only supply labor, and one firm turning labor into the desired good. The goal therefore does not hold vacuously.

Needed infrastructure includes a Kakutani fixed point theorem or Debreu's lemma, compactness of truncated action sets, and sequential compactness arguments in Rl\mathbb R^lRl. AGT.brouwer_fixed_point is on the platform and can serve as a starting point. The lemma is reusable well beyond this mission. Contributions to any milestone, to the lemma, or to the boundedness results shared with Theorem I are welcome.

Selected references

  • K. J. Arrow and G. Debreu, Existence of an Equilibrium for a Competitive Economy, Econometrica 22(3), 265–290, 1954. https://doi.org/10.2307/1907353
  • G. Debreu, A Social Equilibrium Existence Theorem, Proceedings of the National Academy of Sciences 38(10), 886–893, 1952. https://doi.org/10.1073/pnas.38.10.886
  • L. W. McKenzie, On Equilibrium in Graham's Model of World Trade and Other Competitive Systems, Econometrica 22(2), 147–161, 1954. https://doi.org/10.2307/1907352
  • J. F. Nash, Equilibrium Points in n-Person Games, Proceedings of the National Academy of Sciences 36(1), 48–49, 1950. https://doi.org/10.1073/pnas.36.1.48
21 thms2 active usersReviewed
Convex OptimizationDiscrete GeometryOptimization·Captain: Shuze Chen

Discrete Convex Analysis XVII: Fenchel Duality and Linear-Programming IntegralityTextbook

Motivation

Duality is the organizing principle of convex optimization: a minimization problem's optimal value equals a maximization problem's optimal value, and this coincidence, rather than being a lucky accident, follows from a separating-hyperplane argument that applies whenever the two problems' feasible regions are shaped compatibly enough. Werner Fenchel formalized this in the 1950s for pairs of convex and concave functions related by the Legendre-Fenchel transform, and the resulting Fenchel duality theorem specializes, for linear objectives over polyhedral feasible regions, to linear programming duality — the fact, central to the entire theory of combinatorial optimization, that a linear program's optimal value can always be certified from above and below by a pair of primal and dual feasible solutions. Murota's Discrete Convex Analysis (SIAM, 2003) collects this classical machinery, together with the integrality theory that lets it produce combinatorial (integer-valued) certificates rather than merely real ones, as the technical foundation the rest of the book builds its discrete theory on top of.

Setting

For f:Rn→R∪{+∞}f : \mathbb R^n \to \mathbb R \cup \{+\infty\}f:Rn→R∪{+∞}, the epigraph is epi⁡f={(x,Y):Y≥f(x)}\operatorname{epi} f = \{(x,Y) : Y \ge f(x)\}epif={(x,Y):Y≥f(x)}, and fff is convex iff epi⁡f\operatorname{epi} fepif is a convex set; fff is proper if additionally its effective domain dom⁡f={x:f(x)<+∞}\operatorname{dom} f = \{x : f(x) < +\infty\}domf={x:f(x)<+∞} is nonempty, and closed if epi⁡f\operatorname{epi} fepif is topologically closed. A function h:Rn→R∪{−∞}h : \mathbb R^n \to \mathbb R \cup \{-\infty\}h:Rn→R∪{−∞} is concave, proper, closed analogously via its hypograph. The convex conjugate is f∙(p)=sup⁡x{⟨p,x⟩−f(x)}f^\bullet(p) = \sup_x\{\langle p,x\rangle - f(x)\}f∙(p)=supx​{⟨p,x⟩−f(x)}, and the concave conjugate h∘(p)=inf⁡x{⟨p,x⟩−h(x)}h^\circ(p) = \inf_x\{\langle p,x\rangle - h(x)\}h∘(p)=infx​{⟨p,x⟩−h(x)}. The relative interior ri⁡S\operatorname{ri} SriS of a set SSS is the interior of SSS relative to its affine hull. A function is polyhedral if its epigraph (or hypograph) is a finite intersection of half-spaces. Given an m×nm \times nm×n matrix AAA, b∈Rmb \in \mathbb R^mb∈Rm, c∈Rnc \in \mathbb R^nc∈Rn, the primal and dual linear programs are min⁡{c⊤x:Ax=b, x≥0}\min\{c^\top x : Ax=b,\ x\ge0\}min{c⊤x:Ax=b, x≥0} and max⁡{b⊤y:A⊤y≤c}\max\{b^\top y : A^\top y \le c\}max{b⊤y:A⊤y≤c}, with feasible regions PPP, DDD. A matrix is totally unimodular if every square submatrix has determinant 000, 111, or −1-1−1. A discrete set S⊆ZnS \subseteq \mathbb Z^nS⊆Zn is hole free if S=Sˉ∩ZnS = \bar S \cap \mathbb Z^nS=Sˉ∩Zn, where Sˉ\bar SSˉ is the convex hull of SSS's real embedding; the discrete Minkowski sum is S1+S2={x1+x2:x1∈S1,x2∈S2}S_1+S_2 = \{x_1+x_2 : x_1\in S_1, x_2\in S_2\}S1​+S2​={x1​+x2​:x1​∈S1​,x2​∈S2​}.

Formalization targets

Goal (Theorem 3.6, Fenchel duality). For proper convex fff and proper concave hhh satisfying at least one of four alternative conditions — a relative-interior condition on dom⁡f∩dom⁡h\operatorname{dom} f \cap \operatorname{dom} hdomf∩domh, a polyhedrality condition on the same, or the analogous pair of conditions on dom⁡f∙∩dom⁡h∘\operatorname{dom} f^\bullet \cap \operatorname{dom} h^\circdomf∙∩domh∘ together with closedness of fff, hhh —

inf⁡x{f(x)−h(x)}=sup⁡p{h∘(p)−f∙(p)},\inf_x\{f(x)-h(x)\} = \sup_p\{h^\circ(p)-f^\bullet(p)\},xinf​{f(x)−h(x)}=psup​{h∘(p)−f∙(p)},

with the extremum on the appropriate side attained whenever the common value is finite. This is the mission's capstone: the four alternative hypotheses make it the most broadly applicable statement of the four convex-duality results in this mission, each of the other three being either a special case in substance (Theorem 3.5, separation, which 3.6 is proved from) or a literal specialization to linear data (Theorem 3.10, LP duality).

Supporting milestones. Theorem 3.2 (biconjugation: f∙f^\bulletf∙ is always closed proper convex, and g∙∙=gg^{\bullet\bullet}=gg∙∙=g for closed proper convex ggg); Theorem 3.5 (the separation theorem for convex/concave functions, under two of Theorem 3.6's four hypotheses); Theorem 3.9 (the Farkas lemma, equality form); Theorem 3.10 (LP duality: weak duality, strong duality with attainment, and complementary slackness); Theorem 3.13 (total unimodularity of the constraint matrix guarantees an integral optimal solution whenever an optimal solution exists); Proposition 3.14 (an explicit potential function certifying a minimum-weight bipartite perfect matching, via the totally unimodular incidence-matrix LP); and Proposition 3.16 (for a translation-invariant family of hole-free discrete sets, the property that discrete disjointness implies closure disjointness is equivalent to the discrete Minkowski sum matching the integer points of the closures' Minkowski sum).

Significance

Fenchel duality is the single result from which the separation theorem, LP duality, and (via the totally-unimodular incidence matrix of a bipartite graph) the combinatorial duality underlying weighted bipartite matching all descend, in one unbroken chain of specialization; formalizing this chain in one mission exhibits that structure directly, rather than treating each result as an independent fact. Proposition 3.16 plays a different role: it is the chapter's warning that naive discrete analogues of convexity (hole-freeness) do not automatically inherit convexity's good closure properties under Minkowski sums, which is exactly the gap the book's later M-convexity and L-convexity machinery is built to close — this mission's Proposition 3.16 is therefore the motivating negative result for the rest of the book's positive theory, not a loose end. So far as a platform search shows, no existing formalization matches this chunk's specific combination of extended-valued (possibly ±∞\pm\infty±∞) functions, the four-alternative Fenchel duality hypothesis, or the bipartite-matching-via-total-unimodularity argument; the one related platform result (VectorSpaceOpt.fenchel_duality, from Luenberger) is for real-valued functions on general normed spaces under a single relative-interior-and-solidness hypothesis, a different generality from the extended-valued, four-hypothesis statement here.

Difficulty

The naive approach to Theorem 3.6 tries to prove the duality gap is zero directly from the definitions of the two conjugates, which only gives the easy inequality inf⁡≥sup⁡\inf \ge \supinf≥sup (a one-line computation, shown in the book's own proof in three lines); the substantive content is the reverse inequality, and it genuinely fails without a constraint-qualification hypothesis like (a1)-(b2) — Example 3.8 in the book exhibits a convex/concave pair with inf⁡=0≠−1=sup⁡\inf = 0 \ne -1 = \supinf=0=−1=sup when none of the four conditions hold. The book's actual route reduces Theorem 3.6 to the separation theorem (Theorem 3.5) applied to fff shifted down by the (assumed finite) infimum, which produces the separating affine function directly; this is why Theorem 3.5, although logically a special case in spirit, earns its own milestone rather than being subsumed silently.

Formalization scope

All convex and concave functions are represented uniformly as (V → ℝ) → EReal-valued (Fintype V), rather than mixing WithTop ℝ for convex and WithBot ℝ for concave functions, so that Theorem 3.2's biconjugate — whose properness is a conclusion, not an assumption — has a well-defined codomain without extra casts. Convexity is defined via the epigraph being a convex subset of the ordinary real vector space (V→R)×R(V\to\mathbb R)\times\mathbb R(V→R)×R (Mathlib's Convex ℝ), following the book's own equivalent characterization, rather than unfolding the direct inequality definition, which would require a extended-arithmetic scalar-multiplication convention (0\cdot(+\infty)=0) that Mathlib does not provide for EReal. The relative interior is defined directly from the book's own metric-ball-intersected-with-affine-hull description, since Mathlib has no relative-interior primitive at the pinned revision. Polyhedra are finite intersections of explicit half-spaces. A bipartite perfect matching is represented as a bijection between the two vertex sides restricted to the edge set — a faithful, not narrower, representation since every perfect matching between equal-size parts arises this way. The formalization does not trivialize: Theorem 3.6's four hypotheses are carried in full (not reduced to the easiest single case), and no result is stated only for finite-valued (never ±∞\pm\infty±∞) functions, which would discard the entire point of the extended-value convex-analysis framework this chapter sets up for the rest of the book. Infrastructure needed beyond Mathlib's Convex, Matrix, and EReal API: all epigraph/hypograph, conjugate, relative-interior, and polyhedral apparatus is defined fresh in DiscreteConvex.IntegralConvexityB; a contribution proving any of the seven milestones independently, or supplying Mathlib-quality relative-interior lemmas, would be a natural entry point.

Selected references

  • K. Murota, Discrete Convex Analysis, SIAM, 2003, DOI 10.1137/1.9780898718508, Chapter 3.
  • R. T. Rockafellar, Convex Analysis, Princeton University Press, 1970.
  • A. Schrijver, Theory of Linear and Integer Programming, Wiley, 1986.
37 thms2 active usersReviewed
Dynamic ProgrammingOptimizationProbability·Captain: Shuze Chen

Markov Decision Processes VII: Consumption-Investment Problems and Regime SwitchingTextbook

Motivation

Real investors do not merely accumulate wealth for a single terminal payoff; they consume along the way, and the market they invest in is rarely a single fixed statistical regime for years at a time — bull and bear markets, business cycles, and volatility regimes shift the distribution of returns. Bäuerle and Rieder's §4.3 extends the terminal-wealth theory of chunk 04a by adding a consumption choice at every stage (the Ramsey/Merton consumption-investment problem), and §4.4 extends it again by letting the return distribution itself depend on a hidden, Markov-modulated environment state. Both extensions are shown to be genuine instances of the same abstract finite-horizon Markov Decision Process machinery from Chapter 2 — the joint consumption-investment choice and the extra regime coordinate change the state and action spaces, but not the proof strategy, which is exactly the point.

Setting

The consumption-investment problem: state E:=dom UpE := \mathrm{dom}\,U_pE:=domUp​ (wealth), action R≥0×Rd\mathbb{R}_{\ge0}\times\mathbb{R}^dR≥0​×Rd (consumption ccc, amounts aaa invested), transition Tn(x,c,a,z)=(1+in+1)(x−c+a⋅z)T_n(x,c,a,z) = (1+i_{n+1})(x-c+a\cdot z)Tn​(x,c,a,z)=(1+in+1​)(x−c+a⋅z), reward rn(x,c,a):=Uc(c)r_n(x,c,a) := U_c(c)rn​(x,c,a):=Uc​(c), terminal reward gN:=Upg_N := U_pgN​:=Up​. Value functions Vn(x):=sup⁡πEn,xπ[∑k=nN−1Uc(ck(Xk))+Up(XN)]V_n(x) := \sup_\pi \mathbb{E}^\pi_{n,x}[\sum_{k=n}^{N-1} U_c(c_k(X_k)) + U_p(X_N)]Vn​(x):=supπ​En,xπ​[∑k=nN−1​Uc​(ck​(Xk​))+Up​(XN​)]. The one-period sub-problem: D(x):={(c,a):0≤c≤x, (1+i)(x−c+a⋅R)∈dom Up a.s.}D(x) := \{(c,a) : 0\le c\le x,\ (1+i)(x-c+a\cdot R)\in\mathrm{dom}\,U_p \text{ a.s.}\}D(x):={(c,a):0≤c≤x, (1+i)(x−c+a⋅R)∈domUp​ a.s.}, u(x,c,a):=Uc(c)+E[Up((1+i)(x−c+a⋅R))]u(x,c,a) := U_c(c) + \mathbb{E}[U_p((1+i)(x-c+a\cdot R))]u(x,c,a):=Uc​(c)+E[Up​((1+i)(x−c+a⋅R))], v(x):=sup⁡(c,a)∈D(x)u(x,c,a)v(x) := \sup_{(c,a)\in D(x)} u(x,c,a)v(x):=sup(c,a)∈D(x)​u(x,c,a).

The regime-switching extension (§4.4): an environment process (Yn)(Y_n)(Yn​), a finite-state Markov chain with transition probabilities pjkp_{jk}pjk​, modulates the risky-asset return law: given Yn=jY_n=jYn​=j, the next relative risk Rn+1R_{n+1}Rn+1​ has law QjQ_jQj​, and (Rn+1,Yn+1)(R_{n+1},Y_{n+1})(Rn+1​,Yn+1​) has joint law Qj(dz)pjkQ_j(dz)p_{jk}Qj​(dz)pjk​ given Yn=jY_n=jYn​=j, Yn+1=kY_{n+1}=kYn+1​=k. The augmented state is (x,j)∈[0,∞)×EY(x,j) \in [0,\infty)\times E_Y(x,j)∈[0,∞)×EY​; value functions Jn(x,j)J_n(x,j)Jn​(x,j) are defined analogously, with the recursion incorporating a finite sum over the next regime.

Formalization targets

Goal — Theorem 4.3.3

VN=Up,Vn(x)=sup⁡(c,a)∈Dn(x)[Uc(c)+E Vn+1((1+in+1)(x−c+a⋅Rn+1))],V_N = U_p, \qquad V_n(x) = \sup_{(c,a)\in D_n(x)} \bigl[U_c(c) + \mathbb{E}\,V_{n+1}\bigl((1+ i_{n+1})(x-c+a\cdot R_{n+1})\bigr)\bigr],VN​=Up​,Vn​(x)=(c,a)∈Dn​(x)sup​[Uc​(c)+EVn+1​((1+in+1​)(x−c+a⋅Rn+1​))],

with VnV_nVn​ strictly increasing, strictly concave, continuous, and an optimal strategy realized by per-stage maximizers. This is chunk 04a's Theorem 4.2.2 with consumption added, and every closed-form corollary below specializes it.

Eight milestones: the one-period existence/regularity theorem (Theorem 4.3.1); the zero-mean special case (Theorem 4.3.5); power- and logarithmic-utility closed forms (Theorems 4.3.6, 4.3.7); the regime-switching generalization of the goal itself (Theorem 4.4.1), its power-utility closed form (Theorem 4.4.2), and two comparative-statics results on how the optimal policy moves across regimes under a stochastic order (Theorems 4.4.4, 4.4.5).

Significance

Theorem 4.3.3's consumption-investment structure theorem is the basis for every result about optimal spending and saving under uncertainty; its power/log closed forms (Theorems 4.3.6/4.3.7) recover the classical facts that a power-utility investor consumes and invests constant fractions of current wealth (myopic, wealth-independent policy fractions) while a log-utility investor's optimal consumption fraction, 1/(N−n+1)1/(N-n+1)1/(N−n+1), is the textbook "consume your remaining horizon's worth" rule. The regime-switching extension (§4.4) is the discrete-time analogue of Hamilton's regime-switching models, now standard in empirical finance; Theorems 4.4.4-4.4.5 give a rigorous comparative-statics answer to "does a riskier regime call for more or less stock exposure," using the increasing-concave stochastic order rather than a first- moment heuristic — the mathematically correct notion of "regime kkk's returns dominate regime jjj's for every risk-averse (concave, monotone) preference," not merely "regime kkk has a higher mean."

No result of this chunk was found on the platform (searched "consumption investment", "regime switching", "stochastic order"). The proofs largely mirror chunk 04a's (the book itself says so explicitly for Theorems 4.3.1, 4.3.7, 4.4.2), so this mission's contribution is the precise joint-choice statement of each result and, for the comparative-statics theorems, the correct increasing-concave order (≤_icv, Definition B.3.9c) rather than the plain concave order (≤_cv) chunk 02c already needed for a different theorem — the two are genuinely different relations and must not be conflated.

Difficulty

The naive approach to the goal decouples the consumption and investment choices into two independent optimizations; the book's own proof shows they do separate at the level of the per-stage optimization (Theorem 4.3.6's proof: the transformed problem factors into a consumption fraction ζ\zetaζ and an investment fraction α\alphaα optimized independently once the wealth scale is normalized out), but the admissible sets remain jointly constrained (0≤c≤x0\le c\le x0≤c≤x interacts with the investable amount x−cx-cx−c), so treating them as literally independent unconstrained problems would silently solve an easier, different problem. For the regime-switching comparative statics (Theorem 4.4.5), the natural first attempt tries to prove monotonicity of dn(j)d_n(j)dn​(j) in jjj directly from Qj≤icvQkQ_j\le_{\mathrm{icv}}Q_kQj​≤icv​Qk​ alone; the book's own induction needs both hypotheses simultaneously (the environment chain's own stochastic monotonicity, governing how the regime itself evolves, and the return-distribution order, governing the one-period objective) — Theorem 4.4.4's monotonicity of α∗(j)\alpha^*(j)α∗(j) handles the second factor of the induction's product (Eq. (4.22)) while the chain's stochastic monotonicity handles the first; dropping either hypothesis breaks the induction step.

Formalization scope

The consumption-investment vocabulary (ConsumptionInvestmentMarket, its value function, the one-period sub-problem) mirrors chunk 04a's pure-investment TerminalWealthMarket pattern exactly, extended to a joint (c,a)(c,a)(c,a) action. The regime-switching model (RegimeSwitchingMarket) represents the finite regime set EYE_YEY​ abstractly (a Fintype with a row-stochastic transition matrix p : EY → EY → ℝ, not a PMF/product-measure construction on the joint disturbance): the book's own formula for JnπJ_n^\piJnπ​ is already a finite sum over the next regime of an integral against QjQ_jQj​, so this is the direct, faithful representation and needs no additional measure-theoretic machinery — Jpi/J are built via an accumulator recursing through this finite-sum-of-integrals at each step (the natural generalization of chunk 04a's EFromToAcc pattern to a kernel that depends on an evolving state coordinate, rather than an exogenous process). Theorem 4.4.4/4.4.5 introduce LEIncreasingConcaveOrder (Definition B.3.9c) fresh, since chunk 02c's stochastic-order triple (≤_st/≤_cv/≤_cx) does not include the increasing-concave order this chunk's theorems actually use — reusing one of those three would silently substitute a different hypothesis, exactly the trap the chunk brief warns against. IsStochasticallyMonotoneChain (Definition B.3.13) is likewise restated fresh for a finite chain given by its transition matrix.

No trivializing formalization: D_n(x) is a genuine joint constraint on (c,a) (not two independent unconstrained choices); the six closed-form theorems (4.3.6, 4.3.7, 4.4.2, plus the comparative-statics pair) each state their own explicit recursion for dnd_ndn​ — matching the brief's own note that the index-base convention is not uniform across them (Theorem 4.3.6 gives dNd_NdN​ and recurses backward; Theorem 4.4.2 gives d0(j)d_0(j)d0​(j) and recurses forward) — encoded exactly as each theorem states it, not standardized to one direction.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • J. D. Hamilton, "A new approach to the economic analysis of nonstationary time series and the business cycle", Econometrica, 1989 (the regime-switching framework §4.4 specializes to a portfolio-choice setting).
16 thms2 active usersReviewed
Dynamic ProgrammingOptimizationProbability·Captain: Shuze Chen

Markov Decision Processes VI: Multiperiod Terminal Wealth ProblemsTextbook

Motivation

An investor with a fixed planning horizon, an initial fortune, and a personal attitude toward risk (a utility function) wants to allocate wealth between a riskless bond and several risky assets, rebalancing at each of NNN periods, to maximize the expected utility of terminal wealth. This is the oldest and most basic problem of mathematical finance's dynamic-programming tradition, going back to Samuelson (1969) and Merton (1969, continuous time). Bäuerle and Rieder's Chapter 4 is where the abstract finite-horizon Markov Decision Process theory built up in Chapter 2 — the Bellman equation, existence of optimal policies under compactness and continuity, propagation of concavity through the value function — is first put to genuine financial work: the multiperiod terminal-wealth problem is shown to be exactly an instance of that general theory, and the reduction pays off immediately in six closed-form solutions for the standard families of utility functions used throughout the literature (power, HARA, logarithmic, exponential).

Setting

An investor with utility function U:dom U→RU : \mathrm{dom}\,U \to \mathbb{R}U:domU→R (Definition 3.4.1: strictly increasing, strictly concave, continuous) and wealth xxx invests in a bond (interest rate in+1i_{n+1}in+1​ on [n,n+1)[n,n+1)[n,n+1)) and ddd risky assets with relative risk Rn+1R_{n+1}Rn+1​ (Chapter 3). The one-period problem: admissible investments D(x):={a∈Rd:(1+i)(x+a⋅R)∈dom U a.s.}D(x) := \{a \in \mathbb{R}^d : (1+i)(x+a\cdot R) \in \mathrm{dom}\,U \text{ a.s.}\}D(x):={a∈Rd:(1+i)(x+a⋅R)∈domU a.s.}, u(x,a):=E[U((1+i)(x+a⋅R))]u(x,a) := \mathbb{E}[U((1+i)(x+a\cdot R))]u(x,a):=E[U((1+i)(x+a⋅R))], v(x):=sup⁡a∈D(x)u(x,a)v(x) := \sup_{a \in D(x)} u(x,a)v(x):=supa∈D(x)​u(x,a). The multiperiod problem is the NNN-stage Markov Decision Model with state space E:=dom UE := \mathrm{dom}\,UE:=domU (wealth), action space Rd\mathbb{R}^dRd, transition Tn(x,a,z)=(1+in+1)(x+a⋅z)T_n(x,a,z) = (1+i_{n+1})(x+a\cdot z)Tn​(x,a,z)=(1+in+1​)(x+a⋅z), zero one-stage reward, terminal reward gN:=Ug_N := UgN​:=U; its value functions are Vn(x):=sup⁡πEn,xπ[U(XN)]V_n(x) := \sup_\pi \mathbb{E}^\pi_{n,x}[U(X_N)]Vn​(x):=supπ​En,xπ​[U(XN​)] over Markov portfolio strategies π\piπ.

Formalization targets

Goal — Theorem 4.2.2

VN=U,Vn(x)=sup⁡a∈Dn(x)E[Vn+1((1+in+1)(x+a⋅Rn+1))],V_N = U, \qquad V_n(x) = \sup_{a \in D_n(x)} \mathbb{E}\bigl[V_{n+1}\bigl((1+i_{n+1})(x+a\cdot R_{n+1})\bigr)\bigr],VN​=U,Vn​(x)=a∈Dn​(x)sup​E[Vn+1​((1+in+1​)(x+a⋅Rn+1​))],

with VnV_nVn​ strictly increasing, strictly concave and continuous, and an optimal portfolio strategy (f0∗,…,fN−1∗)(f_0^*,\dots,f_{N-1}^*)(f0∗​,…,fN−1∗​) realized by maximizers of the recursion. This is the structural result every closed-form solution below specializes.

Eight milestones: the one-period existence/regularity theorem the induction step reduces to (Theorem 4.1.1); the upper bounding function that makes Chapter 2's existence machinery apply (Proposition 4.2.1); the zero-mean special case (Theorem 4.2.4); and four utility-specific closed forms plus the binomial-model comparative-statics lemma (Theorems 4.2.6, 4.2.11, 4.2.13, 4.2.15; Lemma 4.2.9).

Significance

Theorem 4.2.2 is the template for every dynamic portfolio problem in the rest of this book (consumption-investment in Chapter 4 §4.3-4.4, mean-variance and index tracking later in Chapter 4, and the partially-observed and jump-market analogues in Chapters 6 and 9): check a handful of structural conditions on the market data, and the existence, regularity, and recursive computability of the optimal policy follow automatically from Chapter 2's general theory rather than needing a bespoke argument each time. The six closed-form corollaries are the results practitioners actually use: the power/HARA/log/exponential-utility feedback rules are the standard textbook portfolio formulas (the logarithmic case is Kelly betting; the exponential case's wealth-independent optimal amount is the CARA-utility hallmark used throughout insurance and reinsurance mathematics), and Lemma 4.2.9's monotonicity result is the discrete-time analogue of the Merton ratio's dependence on the market's risk premium.

No result of this chunk was found on the platform (searched "terminal wealth", "portfolio optimization", "power utility", "HARA utility"). The proofs are complete in the book and mostly short (each utility-specific theorem reduces to checking the Structure Assumption via a transformation to a fraction-of-wealth variable); this mission's contribution is the precise formal statement of each closed form, with its own explicit recursion for dnd_ndn​, since the six theorems share a structure but genuinely differ in which one-period sub-problem and which scaling variable (xxx, x+bSn0/SN0x+bS^0_n/S^0_Nx+bSn0​/SN0​, or a wealth-independent constant) each uses.

Difficulty

The obvious shortcut for the goal is to prove existence of an optimal policy and its concavity/monotonicity properties by separate, ad hoc arguments at each stage; the actual content of Theorem 4.2.2 is that both reduce, via Theorem 4.1.1, to a single one-period fact applied identically at every stage — the induction step is exactly "if v∈I ⁣Mn+1v \in \mathrm{I\!M}_{n+1}v∈IMn+1​ [strictly increasing/concave/continuous with linear growth], then vvv is a utility function on EEE up to the growth bound, so Theorem 4.1.1 applies directly to TnvT_n vTn​v." Missing this reduction leads to reproving compactness/upper-semicontinuity arguments from Chapter 2 by hand at every stage instead of invoking Theorem 4.1.1 once per stage. For the six closed-form theorems, the shared trap is conflating the different one-period sub-problems: the power- and HARA-utility theorems solve the same sub-problem (4.7) after a wealth-shift transformation, while the exponential-utility theorem's sub-problem (4.13) has a fundamentally different scaling (the optimal amount, not fraction, is wealth-independent) — collapsing these into one "utility-agnostic" statement would hide exactly the distinction the book is making.

Formalization scope

The multiperiod value function V is defined as an explicit supremum over admissible Markov portfolio strategies (not the Bellman recursion itself, and not full history-dependent strategies), following the book's own citation of Theorem 2.2.3 to justify restricting to Markov strategies for this model; this keeps the goal's parts (b)/(c) genuine content rather than restatements of the value function's own definition. The one-period vocabulary (OnePeriodD/OnePeriodU/OnePeriodV, NoArbitrageOnePeriod) is a self-contained restatement matching §4.1's own notation (a single iii, RRR, no time index), independent of chunk 03's full market/portfolio apparatus, since Theorem 4.1.1's own content is exactly this one-period reduction. Proposition 4.2.1's proof cites two facts as already established elsewhere in the book (a concave function is dominated by an affine function; no-arbitrage bounds admissible actions linearly in wealth) — both are taken as explicit hypotheses of the Lean statement rather than re-derived, since re-deriving them is not this proposition's own content. HARA and power utility share one sub-problem definition (Afrac/vPower, Eq. (4.7)); logarithmic and exponential utility each need their own (AfracLog/vLog, vExp, Eqs. (4.11), (4.13)) since their admissibility sets and objective functions genuinely differ (a strict vs. non-strict inequality; a fraction vs. an absolute amount).

No trivializing formalization: each of the six closed-form theorems states its own explicit recursion for dnd_ndn​ (a finite product or sum over k=n,…,N−1k=n,\dots,N-1k=n,…,N−1 of genuinely different per-stage terms) rather than a shared abstract "some sequence dnd_ndn​ exists with Vn=dn⋅(shape)V_n = d_n \cdot (\text{shape})Vn​=dn​⋅(shape)" — the latter would hide exactly which recursion each utility function produces, the actual content the brief for this chunk flags as the point of having six near-identical theorems rather than one parametrized statement. Optimal strategies are stated in their exact feedback form (fn∗(x)=αn∗xf_n^*(x) = \alpha_n^* xfn∗​(x)=αn∗​x, or the HARA-specific affine shift, or the wealth-independent exponential-utility amount), not merely asserted to exist.

Selected references

  • N. Bäuerle and U. Rieder, Markov Decision Processes with Applications to Finance, Universitext, Springer, 2011. https://doi.org/10.1007/978-3-642-18324-9
  • R. C. Merton, "Lifetime portfolio selection under uncertainty: the continuous-time case", Review of Economics and Statistics, 1969 (the continuous-time analogue this discrete-time theory approximates, per Chapter 3's binomial-to-Black-Scholes convergence result).
15 thms2 active usersReviewed
CombinatoricsLinear OptimizationTheoretical Computer Science·Captain: mikedeng1

Santa Claus Schedules Jobs on Unrelated Machines: The Configuration LP Has Integrality Gap at Most 33/17Research Paper

Motivation

Scheduling jobs on unrelated machines so as to minimize the makespan (the time at which the last machine finishes) is one of the central problems of approximation algorithms. For the general problem, Lenstra, Shmoys and Tardos (1990) gave a 2-approximation and showed that no polynomial-time algorithm achieves a factor below 3/23/23/2 unless P = NP; closing the gap between 3/23/23/2 and 222 has been open since.

The restricted assignment problem is the special case in which every job jjj has a single size pjp_jpj​ and may only run on a given set Γ(j)\Gamma(j)Γ(j) of machines. The 3/23/23/2 hardness already holds here, and the best known algorithms were still 222-approximations. Every linear program previously used for the problem has integrality gap 222, so a better LP lower bound was the natural target.

Svensson (2011) showed that the configuration LP of Bansal and Sviridenko (2006), whose variables assign whole sets of jobs to machines, has integrality gap at most 33/17≈1.941233/17 \approx 1.941233/17≈1.9412. Its optimum therefore gives a polynomial-time estimate of the optimal makespan within a factor strictly better than 222.

  • 1990: Lenstra, Shmoys, Tardos, 2-approximation for unrelated machines, and 3/23/23/2 hardness already for restricted assignment.
  • 2006: Bansal and Sviridenko introduce the configuration LP for the max–min variant (the Santa Claus problem).
  • 2008: Feige shows the configuration LP has constant integrality gap for restricted Santa Claus, and Asadpour, Feige and Saberi (2008) give a local search proof of a factor-4 gap.
  • 2011: Svensson adapts that local search to makespan and proves the gap 33/1733/1733/17 for restricted assignment (arXiv:1011.1168).

Setting

An instance consists of finite sets JJJ (jobs) and MMM (machines), sizes pj≥0p_j \ge 0pj​≥0, and for each job a set Γ(j)⊆M\Gamma(j) \subseteq MΓ(j)⊆M. A schedule is a map σ:J→M\sigma : J \to Mσ:J→M with σ(j)∈Γ(j)\sigma(j) \in \Gamma(j)σ(j)∈Γ(j). The load of machine iii is ∑j:σ(j)=ipj\sum_{j : \sigma(j) = i} p_j∑j:σ(j)=i​pj​, and the makespan is the largest load. OPT\mathrm{OPT}OPT is the least makespan of a schedule.

For a target makespan TTT, a configuration for machine iii is a set C⊆JC \subseteq JC⊆J of jobs that may all run on iii (i∈Γ(j)i \in \Gamma(j)i∈Γ(j) for j∈Cj \in Cj∈C) with p(C)=∑j∈Cpj≤Tp(C) = \sum_{j \in C} p_j \le Tp(C)=∑j∈C​pj​≤T. Write C(i,T)\mathcal C(i,T)C(i,T) for the set of configurations. The configuration LP asks for xi,C≥0x_{i,C} \ge 0xi,C​≥0 with

[C-LP]∑C∈C(i,T)xi,C≤1(i∈M),∑i∈M ∑C∈C(i,T), C∋jxi,C≥1(j∈J).\text{[C-LP]}\qquad \sum_{C \in \mathcal C(i,T)} x_{i,C} \le 1 \quad (i \in M), \qquad \sum_{i \in M}\ \sum_{C \in \mathcal C(i,T),\ C \ni j} x_{i,C} \ge 1 \quad (j \in J).[C-LP]C∈C(i,T)∑​xi,C​≤1(i∈M),i∈M∑​ C∈C(i,T), C∋j∑​xi,C​≥1(j∈J).

Its dual has variables yi,zj≥0y_i, z_j \ge 0yi​,zj​≥0 and constraints yi≥∑j∈Czjy_i \ge \sum_{j \in C} z_jyi​≥∑j∈C​zj​ for all iii and C∈C(i,T)C \in \mathcal C(i,T)C∈C(i,T). OPTLP\mathrm{OPT}_{LP}OPTLP​ is the least TTT at which [C-LP] is feasible, and OPTLP≤OPT\mathrm{OPT}_{LP} \le \mathrm{OPT}OPTLP​≤OPT.

In the Lean development these are configs Γ p T i, CLPFeasible Γ p T, CLPDualFeasible Γ p T y z and schedLoad p σ i, in the namespace RestrictedAssignment.Svensson.

Formalization targets

Goal: Theorem 4.1

For every instance with p≥0p \ge 0p≥0 and every T≥0T \ge 0T≥0,

[C-LP] feasible at T ⟹ ∃ σ:J→M,  σ(j)∈Γ(j) ∀j,∑j:σ(j)=ipj≤3317 T  ∀i.\text{[C-LP] feasible at } T \ \Longrightarrow\ \exists\, \sigma : J \to M,\ \ \sigma(j) \in \Gamma(j)\ \forall j,\quad \sum_{j : \sigma(j) = i} p_j \le \tfrac{33}{17}\, T \ \ \forall i .[C-LP] feasible at T ⟹ ∃σ:J→M,  σ(j)∈Γ(j) ∀j,j:σ(j)=i∑​pj​≤1733​T  ∀i.

Equivalently OPT≤3317 OPTLP\mathrm{OPT} \le \tfrac{33}{17}\,\mathrm{OPT}_{LP}OPT≤1733​OPTLP​. The statement is scale-free and does not define OPTLP\mathrm{OPT}_{LP}OPTLP​.

Milestones

The milestones follow the paper's proof, which normalizes OPTLP=1\mathrm{OPT}_{LP} = 1OPTLP​=1 and sets R=16/17R = 16/17R=16/17:

  1. a dual solution with ∑iyi<∑jzj\sum_i y_i < \sum_j z_j∑i​yi​<∑j​zj​ makes [C-LP] infeasible;
  2. the local search, Algorithm 2 (ExtendSchedule), keeps its partial schedule valid (load at most 1+R1 + R1+R, at most one big job per machine);
  3. when the algorithm has no potential move, an explicit pair (y∗,z∗)(y^*, z^*)(y∗,z∗) is dual feasible (Claim 4.7) and has ∑y∗<∑z∗\sum y^* < \sum z^*∑y∗<∑z∗ (Claim 4.8);
  4. hence, if [C-LP] is feasible, a potential move always exists (Lemma 4.6);
  5. the algorithm has no infinite run (Lemma 4.9);
  6. [C-LP] feasible at T=1T = 1T=1 gives a schedule of makespan at most 1+16/171 + 16/171+16/17.

Three facts from Section 2 complete the list: normalization by scaling, OPTLP≤OPT\mathrm{OPT}_{LP} \le \mathrm{OPT}OPTLP​≤OPT, and monotonicity of feasibility in TTT.

Significance

The theorem shows that the configuration LP is a strictly stronger relaxation than those behind the factor-222 algorithms. With the known polynomial-time approximate solvability of the LP, it gives a polynomial-time algorithm that estimates the optimal makespan of restricted assignment within 33/17+ϵ33/17 + \epsilon33/17+ϵ. The local search in the proof finds a schedule of the same quality, but it is not known to run in polynomial time. Later work lowered the constant to 11/611/611/6 (Jansen and Rohwedder, 2017) along the same lines.

The result is proved on paper. As far as known, no part of it has a machine-checked proof. Formalizing it gives:

  • a reusable definition of the configuration LP and its dual certificate;
  • a precise, nondeterministic model of a local search whose termination rests on a lexicographic potential;
  • a check of a proof that has many cases. The formalization already exposed two edge cases:
    • Claim 4.8 fails when jnewj_{\mathrm{new}}jnew​ has size 000 and no admissible machine;
    • the termination proof needs positive job sizes. With a job of size 000, the algorithm can move it back and forth between two tied machines forever.

The milestones are stated with the corresponding hypotheses.

Difficulty

The obvious approach, rounding a fractional configuration solution, loses a factor 222. If each machine takes one configuration and the collisions of jobs chosen twice or not at all are repaired, the repair can double a load. This is where every earlier LP-based bound stalls.

The milestones along the paper's route are hard for two reasons. First, the dual pair (y∗,z∗)(y^*, z^*)(y∗,z∗) rounds job sizes down by class (big to 11/1711/1711/17, medium to 9/179/179/17). Proving ∑y∗<∑z∗\sum y^* < \sum z^*∑y∗<∑z∗ requires a case analysis over how each blocked machine came to be blocked. The two claims are therefore false for arbitrary states of the search and hold only for states the algorithm actually reaches, so the invariants of reachable states have to be formalized too. Second, the search both adds and removes blockers, so no simple quantity decreases at every step. Termination needs a potential defined on the whole history of the search.

Formalization scope

Jobs and machines are finite types with decidable equality, sizes are real numbers with pj≥0p_j \ge 0pj​≥0, and admissible machines are a Finset per job. Schedules are total maps J→MJ \to MJ→M with σ(j)∈Γ(j)\sigma(j) \in \Gamma(j)σ(j)∈Γ(j) stated explicitly. Partial schedules are maps J→J \toJ→ Option M. Constants are exact rationals in R\mathbb RR. Values of moves live in Lex (ℝ × ℝ).

Algorithm 2 is a step relation Step, not a function. The move of minimum lexicographic value is a hypothesis on the chosen pair, so every tie-breaking rule is covered. The blocker tree is stored as its list of blockers in insertion order. Claims 4.7, 4.8 and Lemma 4.6 quantify over states reachable from the initial state, as their proofs require. Lemma 4.9 asserts that no infinite run exists.

Three statements would trivialize the goal, and the formalization rules them out:

  • a schedule allowed to use machines outside Γ(j)\Gamma(j)Γ(j);
  • a target T<0T < 0T<0;
  • an LP missing either constraint row.

Theorem 1.1 (polynomial time), the separation oracle, and Section 3's two-size case are not part of the mission.

Useful contributions include:

  • the weak-duality certificate;
  • the scaling and monotonicity facts;
  • the invariants of reachable states (each job lies in at most one blocker, blockers on a machine are never reassigned while present);
  • the two claims and the termination argument.

The configuration LP definitions are reusable for the Santa Claus problem and for bin packing.

Selected references

  • O. Svensson, Santa Claus Schedules Jobs on Unrelated Machines, arXiv:1011.1168v2, 2011; SIAM J. Comput. 41(5), 2012. https://arxiv.org/abs/1011.1168
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Math. Programming 46, 1990. https://doi.org/10.1007/BF01585745
  • N. Bansal, M. Sviridenko, The Santa Claus problem, STOC 2006. https://doi.org/10.1145/1132516.1132522
  • A. Asadpour, U. Feige, A. Saberi, Santa Claus meets hypergraph matchings, APPROX 2008; ACM Trans. Algorithms 8(3), 2012. https://doi.org/10.1145/2229163.2229168
  • K. Jansen, L. Rohwedder, On the configuration-LP of the restricted assignment problem, SODA 2017. https://arxiv.org/abs/1611.01934
13 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks VII: Global Stability, Rings, and the Rybko–Stolyar BoundaryTextbook

Motivation

Mission VI showed that two structural families of queueing networks — feedforward routing, and any network under HLSPS control — are stable throughout their entire subcritical region: no extra condition beyond the standard load condition is ever needed. Until the early 1990s it was widely conjectured that this held for every queueing network. Rybko and Stolyar's 1992 example disproved it: a specific, entirely reasonable two-station network, still subcritical, whose buffer contents grow without bound under a particular non-idling policy. J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) devotes the third part of Chapter 8 to mapping the boundary this discovery opened up: which network structures still enjoy subcriticality-implies-stability (unidirectional rings), and, for a network that does not, exactly what extra condition restores it (the two-station, five-class re-entrant line, the book's own worked instance of the Rybko–Stolyar phenomenon).

Setting

A queueing network is globally stable (Definition 8.22) if it is Markov-chain stable under every simply structured, non-idling control policy — the strongest policy-independent notion of stability a network can have. At the fluid-model level (Definition 8.23, restricting to single-server stations, b≡1b \equiv 1b≡1), this becomes: every solution of the fluid equations (8.20)-(8.23) plus the non-idling condition (8.42) is driven to the origin, uniformly in its starting size. A unidirectional ring network routes each customer type through a fixed cyclic sequence of stations; a two-station, five-class re-entrant line (Figure 8.3) routes its single input stream through five classes in a fixed order, alternating between two stations.

Formalization targets

Goal: Theorem 8.25 — the Rybko–Stolyar-style boundary for a re-entrant line

The two-station, five-class re-entrant network's fluid model is globally stable if and only if

λ1(m1+m3+m5)<1,λ1(m2+m4)<1,λ1(m2+m5)<1.\lambda_1(m_1+m_3+m_5) < 1, \qquad \lambda_1(m_2+m_4) < 1, \qquad \lambda_1(m_2+m_5) < 1.λ1​(m1​+m3​+m5​)<1,λ1​(m2​+m4​)<1,λ1​(m2​+m5​)<1.

The first two conditions together are the standard load condition; the third is a genuinely new "virtual station condition," the direct analogue of the Rybko–Stolyar network's own extra requirement. This is the weakest possible target for the phenomenon it captures: a two-sided iff, so it cannot be strengthened by dropping either the necessity or the sufficiency direction, and it isolates the exact extra condition rather than a merely sufficient one.

Supporting milestones

Lemma 8.20 (restated from mission VI, since this chunk's page range overlaps mission VI's at page 164) is a general departure-rate extinction criterion. Theorem 8.21 proves stability of an "assembly with complementary side business" network via a first two-dimensional piecewise-linear Lyapunov function. Theorem 8.24 shows unidirectional ring networks are globally stable throughout their entire subcritical region — no extra condition needed, in sharp contrast to the goal theorem's network. Lemma 8.26 gives four algebraic sufficient conditions for the workload derivative inequalities the goal theorem's Lyapunov argument needs; Lemma 8.27 shows these conditions are simultaneously satisfiable exactly when (8.47)-(8.49) hold — the geometric core of the sufficiency direction.

Significance

The result itself. Theorem 8.25 is the book's own fully worked instance of the field's most cited stability-boundary phenomenon: it pins down, for a specific and analyzable network, exactly how much more than subcriticality is required, and shows the extra requirement (8.49) is not an artifact of the proof technique but a genuine necessary condition, via an explicit unstable sample path under the "extreme" priority policy that violates it. Theorem 8.24, by contrast, demonstrates that the ring topology is not automatically pathological in this way, delineating the boundary from the other side.

Formalizing it. Searches for "re-entrant line," "Rybko-Stolyar," and "virtual station" (q=re-entrant%20line, q=Rybko-Stolyar, q=virtual%20station) return no results specific to this material; this mission is a from-scratch formalization of global stability at both the Markov-chain and fluid-model tiers, unidirectional ring networks, the two-station five-class re-entrant line, and the assembly-with-side-business network.

Difficulty

Theorem 8.25's necessity direction needs an entirely different proof technique from its sufficiency direction: rather than a Lyapunov argument, it requires exhibiting an explicit unstable fluid model solution under a specific "extreme" static-buffer-priority policy — a sample-path construction, echoing the divergent-cycle construction mission III's own chapter (Section 6.2) gives for the original Rybko–Stolyar network, that the book itself says is "omitted" as analogous. A formalization that stated only the sufficiency direction (dropping the "only if") would misrepresent the theorem entirely, since sufficiency alone is not what makes this result the field's canonical boundary-of-stability statement. A second difficulty is genuinely geometric: Lemma 8.27's proof intersects a parallelogram of admissible (x2,x4)(x_2,x_4)(x2​,x4​) pairs with a wedge region, then separately solves an analogous system for (x1,x3,x5)(x_1,x_3,x_5)(x1​,x3​,x5​) — reducing a five-dimensional existence claim to two two-dimensional geometric arguments, each depending on (8.47)-(8.49) in a way that is not visible from the inequalities' surface form alone.

Formalization scope

Missions IV/VI's queueing-network model data, fluid-equation specialization, and workload operator are restated locally (drafts in this series do not import one another), as is mission VI's non-idling fluid model (renamed to track Definition 8.23's own name, FluidModelGloballyStable, even though defeq in shape). Definition 8.22 (network-level global stability) is stated abstractly over an uninterpreted policy type and two predicates, since the concrete "simply structured non-idling policy" and "positive recurrence under a policy" notions belong to mission I's apparatus, not a dependency of this chunk. The unidirectional ring network is characterized as a structural property of an ordinary flat-indexed queueing network (a partial successor function encoding the deterministic route) rather than by re-introducing the book's own two-index type/stage bookkeeping — a faithful re-encoding, since every ring network in the book's sense is representable this way. The re-entrant line's routing (station 1 serves classes 1,3,5; station 2 serves classes 2,4) was recovered from the explicit computations in Lemma 8.26's own proof, not read off Figure 8.3 directly, though the two are cross-checked as consistent. The assembly-with-side-business network, which needs a genuinely multi-input activity outside Chapter 2's "unitary network" vocabulary, is packaged directly via its already-derived fluid equations (8.36)-(8.39) rather than a general SPN activity structure. Theorem 8.25 is stated as a bare ↔, exposing neither the sufficiency direction's Lyapunov witnesses nor the necessity direction's instability construction — a formalization that dropped either direction of the iff, or that conflated the unidirectional ring's cyclic structure with an unrestricted deterministic routing graph, would each be an unfaithful weakening. IsGloballyStable, FluidModelGloballyStable, IsUnidirectionalRing, and the re-entrant line's Lyapunov ingredients (reentrantG1/reentrantG2/ reentrantH1/reentrantH2) are the primary reusable contributions; contributions completing the six by sorry proofs — Theorem 8.25's necessity direction in particular, which needs machinery this mission does not otherwise build — are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
  • J. G. Dai and J. H. Vande Vate, "The stability of two-station multitype fluid networks," Operations Research 48 (2000), 721–744.
13 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks IV: Fluid Equations for Non-Idling, Priority and FCFS ControlTextbook

Motivation

Mission III's Theorem 6.2 — "fluid limit stability implies SPN stability" — converts a probabilistic stability question into a real-analysis question, but it only supplies the generic fluid equations (6.1)-(6.6), which hold under any control policy and therefore say nothing policy-specific: (6.1)-(6.6) alone never force a fluid path to reach zero. To actually prove a concrete queueing network stable, one must first identify the extra fluid equation a specific policy forces on every fluid limit path, and prove that this extra equation genuinely holds — a task the book calls "justifying" the equation "through the same fluid limit procedure used in the proof of Theorem 6.5." J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' pre-publication draft, 2020-4-2, http://spnbook.org) carries out this derivation for four control-policy families in Chapter 7, laying the groundwork every later stability chapter of the book (feedforward networks, the Rybko–Stolyar boundary, back-pressure, proportional fairness, task allocation) builds on.

The first-come-first-served (FCFS) analysis traces to Rybko and Stolyar's 1992 fluid-scaling argument and was first stated in closed form as Eq. (2.6) of M. Bramson's 1996 paper on FCFS queueing networks; Bramson also showed by example (1994) that FCFS networks can be unstable even under the standard load condition, motivating the need for a precise fluid-equation characterization rather than an informal one.

Setting

A queueing network (Section 2.6) is an SPN with one activity per buffer: buffer/class iii is served by a unique pool p(i)p(i)p(i), and on completion a class-iii job becomes class jjj with probability PijP_{ij}Pij​ (the routing matrix). I(k)I(k)I(k) denotes the set of classes served by pool kkk. The fluid equations (6.1)-(6.6) specialize accordingly: consumption is the identity (D^=F^\hat D = \hat FD^=F^) and the output matrix is Γij=Pji\Gamma_{ij} = P_{ji}Γij​=Pji​.

Three control-policy families are studied. A policy is non-idling if no server sits idle while a job waits in one of its buffers. A static buffer priority (SBP) policy is non-idling and additionally orders same-pool classes by a fixed priority permutation σ\sigmaσ, always serving the highest-priority non-empty class first; it is non-preemptive if a job's service, once begun, is never interrupted by a later higher-priority arrival. Under FCFS, jobs at a pool are served strictly in arrival order — the workload-based analysis of Section 7.3. Section 7.4 studies a fourth, more general family: a unitary network (one service type per class) under a relaxed control policy β=h(z^)\beta = h(\hat z)β=h(z^), where z^\hat zz^ is the updated job-count vector and hhh is any capacity-respecting, degree-zero-homogeneous function (Assumption 7.6) — a family general enough to include non-idling and SBP policies as special cases, and to anticipate the proportionally fair allocation studied in Chapters 9-10.

Formalization targets

Goal: Theorem 7.5 — the FCFS fluid equation

For a queueing network under FCFS control, every fluid limit path (D^,F^,T^,Z^)(\hat D, \hat F, \hat T, \hat Z)(D^,F^,T^,Z^) satisfies (6.1)-(6.6) and

D^i(t+W^k(t))=G^i(t),t≥0, i∈I(k), k∈K,\hat D_i\big(t + \hat W_k(t)\big) = \hat G_i(t), \qquad t \ge 0,\ i \in I(k),\ k \in K,D^i​(t+W^k​(t))=G^i​(t),t≥0, i∈I(k), k∈K,

where G^i(t)=λit+∑jPjiD^j(t)\hat G_i(t) = \lambda_i t + \sum_j P_{ji}\hat D_j(t)G^i​(t)=λi​t+∑j​Pji​D^j​(t) is the fluid arrival rate into class iii and W^k(t)=∑i∈I(k)miZ^i(t)\hat W_k(t) = \sum_{i \in I(k)} m_i \hat Z_i(t)W^k​(t)=∑i∈I(k)​mi​Z^i​(t) is pool kkk's fluid-scaled immediate workload. This is the weakest natural target: an identity that pins down exactly the time-shift FCFS imposes, without asserting anything about how quickly or whether the fluid model reaches zero (that is left to the Lyapunov arguments of later chapters, once this equation is in hand).

Supporting milestones

Theorem 7.2 (non-idling): ∑i∈I(k)Z^i(t)>0\sum_{i\in I(k)} \hat Z_i(t) > 0∑i∈I(k)​Z^i​(t)>0 forces pool kkk's aggregate service rate to run at full capacity bkb_kbk​. Theorem 7.3 (non-preemptive SBP): the same conclusion with I(k)I(k)I(k) sharpened to the priority set H(j)H(j)H(j) (Eq. 7.5), for every buffer jjj. Theorem 7.8 (general relaxed control): under Assumption 7.6, Z^i(t)>0\hat Z_i(t) > 0Z^i​(t)>0 forces T^i\hat T_iT^i​'s derivative to equal hi(Z^(t))h_i(\hat Z(t))hi​(Z^(t)) exactly — the common generalization from which the non-idling and SBP fluid equations both follow as special cases of a suitable hhh.

Significance

The result itself. Theorem 7.5 is the precise bridge that lets FCFS-specific stability questions be attacked by the Lyapunov-function method Theorem 6.2 licenses: without a closed-form fluid equation, "does an FCFS network satisfy the standard load condition stably?" has no tractable deterministic reformulation. Bramson's 1994 example (an FCFS network unstable despite satisfying the standard load condition) shows the equation's content is not vacuous — FCFS fluid limits genuinely can misbehave, and this equation is precisely what any subsequent stability or instability argument for FCFS networks must reason about.

Formalizing it. No result about FCFS, non-idling, static-buffer-priority, or general relaxed control policies exists on Prove2Me (q=first-come-first-served, q=FCFS, q=priority policy all return zero hits, consistent with triage.json's record that none of this book's Chapters 6-14 machinery is on the platform). This mission is a from-scratch formalization of queueing networks, their three named control-policy families, and the four policy-specific fluid equations Chapter 7 derives for them.

Difficulty

The obvious shortcut for Theorem 7.3 — reuse Theorem 7.2's hypothesis and conclusion verbatim with I(k)I(k)I(k) replaced by H(j)H(j)H(j) — conflates the preemptive and non-preemptive SBP policies: Remark 7.4 explicitly notes the underlying pathwise identity (7.4) (used directly by Theorem 7.2) holds unconditionally under preemption but only asymptotically, via a vanishing-remainder argument bounding the leftover processing time of interrupted-but-continuing jobs, under non-preemption — the theorem actually being formalized is about the harder, non-preemptive case. For Theorem 7.5, the central difficulty is that FCFS's defining property is a genuinely time-shifted identity (departures at t+W^k(t)t + \hat W_k(t)t+W^k​(t) match arrivals at ttt), not a same-instant conditional statement like the non-idling and SBP equations — an approach that tried to state FCFS as a same-instant condition on T^\hat TT^ or D^\hat DD^ alone, without introducing the auxiliary workload process W^\hat WW^, could not express the theorem's actual content. A further subtlety Theorem 7.8's proof flags directly (Remark 7.9) is that the tempting converse — "Z^i(t)=0\hat Z_i(t) = 0Z^i​(t)=0 implies zero service rate" — is false in general (a corrected version appears only later, as Lemma 8.9); this mission's goal and milestone statements are careful to assert only the one-directional implication the book actually proves.

Formalization scope

Mission III's fluid-limit-path apparatus (Definition 6.6, u.o.c. convergence) is restated locally in this chapter's own namespace rather than imported, since drafts in this series do not import one another; the restatement is trimmed to the four raw processes (Dx,Fx,Tx,Zx)(D^x,F^x,T^x,Z^x)(Dx,Fx,Tx,Zx) this chapter's proofs need, omitting mission III's "delayed random walk" machinery. The non-idling and non-preemptive-SBP hypotheses are both formalized via one shared predicate, FullyUtilized, applied to different index sets (I(k)I(k)I(k) vs. H(j)H(j)H(j)) — the pathwise full-utilization identity (7.4) that each policy's proof establishes for its own priority classes, taken as a hypothesis rather than re-derived from a lower-level model of server scheduling (Chapter 2's construction of the service-starting mechanism is out of scope for this chapter, exactly as it was for mission III's SPNProcessFamily). Likewise, the FCFS goal theorem hypothesizes the raw identity (7.12) (rewritten via the material-balance equation to avoid needing the raw arrival process) and the fluid-scaled limit of the raw workload process (7.17), rather than re-deriving either from the "delayed random walk" VVV of Eq. (6.47). A formalization that dropped the workload shift W^k(t)\hat W_k(t)W^k​(t) from Theorem 7.5's conclusion, or that stated Theorem 7.8's converse implication (which Remark 7.9 explicitly disclaims), would each be an unfaithful trivialization or overstatement ruled out here. QueueingNetworkData, ProcessFamily, FullyUtilized, and SatisfiesAssumption76 are the primary reusable contributions of this mission; contributions completing the four by sorry proofs — each of which needs the u.o.c.-convergence and dominated-convergence arguments mission III's own proofs still lack — are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • M. Bramson, "Convergence to equilibria for fluid models of FIFO queueing networks," Queueing Systems 22 (1996), 5–45.
  • M. Bramson, "Instability of FIFO queueing networks," Annals of Applied Probability 4 (1994), 414–431.
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
9 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: Shuze Chen

Processing Networks I: The Equivalence of SPN StabilityTextbook

Motivation

A stochastic processing network (SPN) is the general model behind manufacturing lines, call centers, computer systems, communication networks and hospital wards: a collection of buffers holding waiting work, a collection of activities (servers) that consume items from buffers and produce items into others, and stochastic primitives — arrival processes and service requirements — that drive the whole system forward in continuous time. Before any control policy can be designed, evaluated, or proved to work, the modeler needs a single, unambiguous, checkable notion of what it means for such a system to be stable: to settle into statistical equilibrium rather than pile up work without bound.

The difficulty is that "stability" has several natural, superficially different candidate definitions — positive recurrence of the underlying Markov chain, existence of a unique stationary distribution, convergence in distribution of queue lengths — each convenient for a different purpose (positive recurrence for verifying via drift criteria, a stationary distribution for computing long-run averages, distributional convergence for interpreting simulation output). J. G. Dai and J. Michael Harrison's Processing Networks: Fluid Models and Stability (Cambridge University Press, forthcoming; cited here from the authors' own pre-publication draft, 2020-4-2, http://spnbook.org) opens its technical development by proving these candidates coincide, so that the rest of the book — and, in practice, most stability results for queueing networks published since Rybko and Stolyar's and Dai's foundational work in the 1990s — can speak of "SPN stability" as one well-posed property.

Setting

An SPN has III buffers, indexed 1,…,I1, \dots, I1,…,I, and JJJ activities (service types), indexed 1,…,J1, \dots, J1,…,J. External work arrives into buffer iii according to a counting process Ei(t)E_i(t)Ei​(t); activity jjj, whenever engaged, requires a service time and produces an output vector into the buffers on completion. The baseline stochastic assumptions (Assumption 2.1) specify these primitives precisely: the III external arrival processes are independent Poisson processes with rates λ1,…,λI≥0\lambda_1, \dots, \lambda_I \ge 0λ1​,…,λI​≥0 (no arrivals into a buffer with rate 000); for each activity jjj, the matched pairs of processing variables — service time and output vector, (vj(ℓ),φj(ℓ))ℓ≥1(v_j(\ell), \varphi_j(\ell))_{\ell \ge 1}(vj​(ℓ),φj​(ℓ))ℓ≥1​ — form an i.i.d. sequence with finite means mj=E[vj(1)]>0m_j = \mathbb{E}[v_j(1)] > 0mj​=E[vj​(1)]>0 and Γj=E[φj(1)]≥0\Gamma_j = \mathbb{E}[\varphi_j(1)] \ge 0Γj​=E[φj​(1)]≥0; each such pair has a joint phase-type distribution (realized as the absorption time and terminal mark of a finite-state continuous-time Markov chain, per Appendix D.9); and the initial processing variables, the arrival process, and the JJJ processing-variable sequences are, collectively, mutually independent.

Under a fixed control policy, the SPN generates two continuous-time processes: the service-count process N(t)∈Z+JN(t) \in \mathbb{Z}_+^JN(t)∈Z+J​ and the buffer-contents process Z(t)∈Z+IZ(t) \in \mathbb{Z}_+^IZ(t)∈Z+I​. Assumption 3.1 (Markov representation) requires these to be embeddable in a richer, irreducible Markov chain X={X(t),t≥0}X = \{X(t), t \ge 0\}X={X(t),t≥0} on a countable state space X\mathcal{X}X: a function f:X→Z+J×Z+If : \mathcal{X} \to \mathbb{Z}_+^J \times \mathbb{Z}_+^If:X→Z+J​×Z+I​ with (N(t),Z(t))=f(X(t))(N(t), Z(t)) = f(X(t))(N(t),Z(t))=f(X(t)) on every sample path, whose level sets B(z)={x:f(x)=(n,z) for some n}B(z) = \{x : f(x) = (n,z)\ \text{for some } n\}B(z)={x:f(x)=(n,z) for some n} are finite for every buffer-content vector zzz, and which has at least one empty state x∗x^\astx∗ with f(x∗)=(0,0)f(x^\ast) = (0,0)f(x∗)=(0,0).

Formalization targets

Goal: Proposition 3.5 — equivalent definitions of stability

X positive recurrent  ⟺  X has a unique stationary distribution π  ⟺  Z(t) converges in distribution to a non-defective limit,X \text{ positive recurrent} \iff X \text{ has a unique stationary distribution } \pi \iff Z(t) \text{ converges in distribution to a non-defective limit},X positive recurrent⟺X has a unique stationary distribution π⟺Z(t) converges in distribution to a non-defective limit,

and, when these hold, for every bounded h:X→Rh : \mathcal{X} \to \mathbb{R}h:X→R and every initial distribution of X(0)X(0)X(0),

Pr⁡{lim⁡t→∞1t∫0th(X(s)) ds=hˉ}=1,hˉ:=∑x∈Xπ(x) h(x).\Pr\left\{ \lim_{t \to \infty} \frac{1}{t} \int_0^t h(X(s))\, ds = \bar h \right\} = 1, \qquad \bar h := \sum_{x \in \mathcal{X}} \pi(x)\, h(x).Pr{t→∞lim​t1​∫0t​h(X(s))ds=hˉ}=1,hˉ:=x∈X∑​π(x)h(x).

Definition 3.6 then names an SPN stable exactly when these equivalent conditions hold — the weakest possible target, since it commits to no particular one of the three characterizations, only to their joint truth or falsity.

Supporting milestones

Two strong laws of large numbers for the primitive stochastic elements (Propositions 2.2 and 2.3) — the arrival counts Ei(t)/t→λiE_i(t)/t \to \lambda_iEi​(t)/t→λi​ and the processing-variable sample means 1n∑ℓ≤nvj(ℓ)→mj\frac{1}{n}\sum_{\ell \le n} v_j(\ell) \to m_jn1​∑ℓ≤n​vj​(ℓ)→mj​, 1n∑ℓ≤nφj(ℓ)→Γj\frac{1}{n}\sum_{\ell \le n} \varphi_j(\ell) \to \Gamma_jn1​∑ℓ≤n​φj​(ℓ)→Γj​ — and two structural results about the ambient chain: Lemma 3.7, a drift-type sufficient condition for positive recurrence that foreshadows the fluid-model methodology of later chapters, and Proposition 3.9, a sufficient condition (reachability of the empty state) for the irreducibility that Assumption 3.1 itself demands.

Significance

The result itself. Proposition 3.5 is what turns "is this queueing network stable?" into a single question rather than three potentially different ones, and it licenses every later chapter of the book (and a large fraction of the queueing-theory literature going back to the 1990s fluid-limit program of Rybko–Stolyar, Dai, and others) to prove stability via whichever characterization is most convenient — typically positive recurrence via a Lyapunov drift argument — while concluding all three, including the practically important long-run-average SLLN. Every one of the thirteen other missions in this series builds directly on Definition 3.6: their goal theorems all conclude "the SPN is stable," meaning exactly the three-way equivalence established here.

Formalizing it. No result in this mission or its milestones has a prior formal counterpart on Prove2Me: a search for "positive recurrent," "stationary distribution Markov chain," and "irreducible Markov chain" surfaced only MarkovMixing's PositiveRecurrent predicate, defined for a countable-state discrete-time chain — a different object from Assumption 3.1's continuous-time ambient chain, reused here only conceptually (as the pattern for a mean-return-time definition), not as a Lean dependency. This mission is a from-scratch formalization of the model (baseline stochastic assumptions, Markov representation) and of positive recurrence, stationary-distribution uniqueness, and distributional convergence for it.

Difficulty

The obvious first attempt — define XXX as an arbitrary countable-state Markov chain and directly import a Mathlib theorem relating its recurrence, its stationary distribution, and long-run convergence — fails because Mathlib currently has no general countable-state continuous-time Markov chain theory of the kind Appendix D of the book develops (its own finite-state CTMC stationary-distribution result is unproven substrate, not applicable to a countably infinite state space). The formalization instead works at the level of the chain's embedded discrete-time jump chain, which is where Lean's PMF-based machinery is available, and states the three equivalent conditions and the SLLN conclusion directly as hypotheses to be discharged, rather than inheriting them from a pre-existing continuous-time framework. A second difficulty is Assumption 2.1(d)'s independence clause, which is a genuine three-way mutual independence of σ\sigmaσ-algebras (initial processing variables, arrival process, and the collection of all JJJ processing-variable sequences), not the pairwise independence a careless reading might substitute — a weaker hypothesis here would silently make later derivations in the series unsound.

Formalization scope

The ambient chain's state space Xstate is an arbitrary countable type ([Countable Xstate], not Fintype) — no result may assume finiteness anywhere. The chain itself is represented by its one-step jump kernel jump : Xstate → PMF Xstate (stepIter gives nnn-step iteration, Irreducible requires every state to reach every other in finitely many jump-chain steps); positive recurrence is mean return time under jump, defined via the standard first-return-time renewal decomposition. IsStable is defined as positive recurrence of the jump chain — one of the three equivalent conditions — with the goal theorem itself certifying the equivalence, so the choice carries no loss of faithfulness. Buffer contents and service counts are Fin I → ℕ and Fin J → ℕ-valued, matching the book's Z+I\mathbb{Z}_+^IZ+I​, Z+J\mathbb{Z}_+^JZ+J​. A formalization that took IsStable to mean, say, only distributional convergence of ZZZ (dropping the chain-level characterizations) would be a strictly weaker, trivializing shortcut — ruled out here by proving all three equivalent and stating the SLLN as part of the same goal theorem. The definitions in this mission (BaselineAssumptions, MarkovRepresentation, IsStable) are the shared substrate every other mission of the series is built on, and are the primary reusable contribution; contributions completing the by sorry proofs, particularly of the goal theorem (which the book proves via appeal to general CTMC theory in its Appendix D, not reproduced here), are welcome.

Selected references

  • J. G. Dai and J. Michael Harrison, Processing Networks: Fluid Models and Stability, Cambridge University Press (forthcoming), pre-publication draft 2020-4-2. http://spnbook.org
  • A. N. Rybko and A. L. Stolyar, "Ergodicity of stochastic processes describing the operation of open queueing networks," Problemy Peredachi Informatsii 28 (1992), 3–26.
  • J. G. Dai, "On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models," Annals of Applied Probability 5 (1995), 49–77.
11 thms2 active usersReviewed
CombinatoricsGraph TheoryLinear Optimization·Captain: mikedeng1

Cones of Matrices and Set-Functions and 0–1 Optimization III: The Defect of a Stable Set Inequality Bounds Its N-IndexResearch Paper

Motivation

Many 0–1 optimization problems can be written as linear programs over the convex hull of the 0–1 points of a polytope, but that hull usually has no manageable description by inequalities. Lift-and-project methods approximate it by a sequence of convex sets. Each set comes from a linear or semidefinite system in more variables, followed by a projection. Lovász and Schrijver introduced the operator NNN in Cones of matrices and set-functions and 0–1 optimization (SIAM J. Optim. 1(2), 1991). For any polytope KKK in the unit cube, nnn rounds of NNN reach the 0–1 hull (their Theorem 1.4), and each round keeps linear optimization tractable.

The stable set problem is the paper's main test case, and the question is quantitative: how many rounds does a given valid inequality need? Section 2.c answers it with a single number read off a linear program. Later work on the rank of lift-and-project hierarchies uses this measure: Balas, Ceria and Cornuéjols's lift-and-project cuts (1993), the Sherali–Adams and Lasserre comparisons of Laurent (2003), and the rank lower bounds for stable set relaxations in the decades since.

Setting

Let G=(V,E)G = (V, E)G=(V,E) be a finite graph with no isolated nodes, which is the paper's standing assumption for Section 2. For A⊆VA \subseteq VA⊆V let χA∈RV\chi^A \in \mathbb R^VχA∈RV be its incidence vector.

  • The stable set polytope is STAB(G)=conv⁡{χA:A stable}\mathrm{STAB}(G) = \operatorname{conv}\{\chi^A : A \text{ stable}\}STAB(G)=conv{χA:A stable}.
  • The fractional stable set polytope FRAC(G)\mathrm{FRAC}(G)FRAC(G) is the solution set of xi≥0x_i \ge 0xi​≥0 (i∈Vi \in Vi∈V) and xi+xj≤1x_i + x_j \le 1xi​+xj​≤1 (ij∈Eij \in Eij∈E).

Homogenize with a new coordinate x0x_0x0​. Let Q⊆RV∪{0}Q \subseteq \mathbb R^{V \cup\{0\}}Q⊆RV∪{0} be the cone spanned by the 0–1 vectors with x0=1x_0 = 1x0​=1, and let FR(G)\mathrm{FR}(G)FR(G) be the cone given by xi≥0x_i \ge 0xi​≥0 and xi+xj≤x0x_i + x_j \le x_0xi​+xj​≤x0​. For a convex cone KKK with polar cone K∗={u:uTx≥0 ∀x∈K}K^* = \{u : u^{\mathsf T}x \ge 0 \ \forall x \in K\}K∗={u:uTx≥0 ∀x∈K}, the matrix cone M(K)M(K)M(K) is the set of symmetric matrices YYY that satisfy two conditions:

  • yii=y0iy_{ii} = y_{0i}yii​=y0i​ for every iii;
  • uTYv≥0u^{\mathsf T} Y v \ge 0uTYv≥0 for all u∈K∗u \in K^*u∈K∗ and v∈Q∗v \in Q^*v∈Q∗.

The operator is N(K)={Ye0:Y∈M(K)}N(K) = \{Y e_0 : Y \in M(K)\}N(K)={Ye0​:Y∈M(K)}. Its iterates are N0(K)=KN^0(K) = KN0(K)=K and Nt(K)=N(Nt−1(K))N^t(K) = N(N^{t-1}(K))Nt(K)=N(Nt−1(K)). On the graph side, Nt(G)={x:(1x)∈Nt(FR(G))}N^t(G) = \{x : \binom1x \in N^t(\mathrm{FR}(G))\}Nt(G)={x:(x1​)∈Nt(FR(G))}, so N0(G)=FRAC(G)N^0(G) = \mathrm{FRAC}(G)N0(G)=FRAC(G) and STAB(G)⊆Nt(G)\mathrm{STAB}(G) \subseteq N^t(G)STAB(G)⊆Nt(G) for every ttt.

Let aTx≤ba^{\mathsf T}x \le baTx≤b be valid for STAB(G)\mathrm{STAB}(G)STAB(G), with a∈Z+Va \in \mathbb Z_+^Va∈Z+V​ and b∈Z+b \in \mathbb Z_+b∈Z+​. Two numbers are attached to it:

  • its N-index kkk is the least ttt such that aTx≤ba^{\mathsf T}x \le baTx≤b is valid for Nt(G)N^t(G)Nt(G);
  • its defect is r=2max⁡{aTx−b:x∈FRAC(G)}r = 2\max\{a^{\mathsf T}x - b : x \in \mathrm{FRAC}(G)\}r=2max{aTx−b:x∈FRAC(G)}, which is an integer.

For a node vvv with neighbourhood Γ(v)\Gamma(v)Γ(v), the deletion of vvv zeroes ava_vav​. The contraction of vvv zeroes aaa on {v}∪Γ(v)\{v\}\cup\Gamma(v){v}∪Γ(v) and lowers the right-hand side to b−avb - a_vb−av​.

Formalization targets

Goal: Theorem 2.13

For every such inequality with defect r≥0r \ge 0r≥0 and N-index kkk,

rb  ≤  k  ≤  r,\frac{r}{b} \;\le\; k \;\le\; r,br​≤k≤r,

formalized as r≤k br \le k\,br≤kb and k≤rk \le rk≤r. The goal holds for every graph without isolated nodes and every valid inequality with nonnegative integer coefficients and nonnegative defect.

Milestones

  1. Lemma 2.11. Let a≥0a \ge 0a≥0 and max⁡STABaTx<max⁡FRACaTx\max_{\mathrm{STAB}} a^{\mathsf T}x < \max_{\mathrm{FRAC}} a^{\mathsf T}xmaxSTAB​aTx<maxFRAC​aTx. Then the edges ijijij with yi+yj=1y_i + y_j = 1yi​+yj​=1 at every FRAC-maximizer yyy form a nonbipartite graph.
  2. Lemma 2.12. Under the same hypothesis, some node iii has yi=12y_i = \tfrac12yi​=21​ at every FRAC-maximizer yyy.
  3. The defect-decrease claim (proof of Theorem 2.13). For such a node iii, the deletion and the contraction of iii both have defect smaller than rrr.
  4. Lemma 2.2. If the deletion and the contraction of some node are valid for KKK, where K⊆FR(G)K \subseteq \mathrm{FR}(G)K⊆FR(G) is a closed convex cone, then aTx≤ba^{\mathsf T}x \le baTx≤b is valid for N(K)N(K)N(K).
  5. Lemma 2.7. 1k+21∈Nk(G)\frac{1}{k+2}\mathbb 1 \in N^k(G)k+21​1∈Nk(G) for every k≥0k \ge 0k≥0.

Further result

Corollary 2.8. Let GGG have nnn nodes, stability number α\alphaα and graph N-index kkk. Then

nα−2≤k≤n−α−1.\frac n\alpha - 2 \le k \le n - \alpha - 1.αn​−2≤k≤n−α−1.

Significance

Theorem 2.13 turns the N-index, which is defined through an infinite family of matrix-cone projections, into a quantity computable by one linear program over FRAC(G)\mathrm{FRAC}(G)FRAC(G). Some consequences:

  • Odd hole constraints have defect 1 and hence N-index 1.
  • An odd antihole on 2k+12k+12k+1 nodes has index exactly kkk; the paper notes that the lower bound is tight for odd antihole constraints.
  • Inequalities of large defect relative to their right-hand side need many rounds. With Lemma 2.7 this yields Corollary 2.8 and the unboundedness of the N-index of line graphs, the stable set side of Yannakakis's matching-polytope question.

The result is proved in the paper; the mission's work is to formalize it. Nothing on Prove2Me or in Mathlib covers stable set polytopes, the Lovász–Schrijver operator or its index, and no machine-checked version of Theorem 2.13 is known. A formal proof would give the first verified rank bound for a lift-and-project hierarchy. It would also build a reusable library for STAB\mathrm{STAB}STAB, FRAC\mathrm{FRAC}FRAC, half-integrality of FRAC\mathrm{FRAC}FRAC vertices, and the NNN operator.

Difficulty

The upper bound is an induction on the defect, and it needs several facts about FRAC(G)\mathrm{FRAC}(G)FRAC(G):

  • its vertices are half-integral;
  • the defect is therefore an integer;
  • a node 12\tfrac1221​ at every optimum exists, which is a statement about the whole optimal face and not about one optimal vertex.

The last is the heart of Lemmas 2.11 and 2.12. The induction also climbs through Nt(FR(G))N^t(\mathrm{FR}(G))Nt(FR(G)) for every ttt, so Lemma 2.2 must hold for an arbitrary closed convex cone inside FR(G)\mathrm{FR}(G)FR(G), not only for polytopes given by inequalities.

The lower bound is where the obvious argument fails. The printed proof tests aTx≤ba^{\mathsf T}x \le baTx≤b at 1k+21\frac1{k+2}\mathbb 1k+21​1 and obtains k≥aT1/b−2k \ge a^{\mathsf T}\mathbb 1/b - 2k≥aT1/b−2. That equals r/br/br/b only when r=aT1−2br = a^{\mathsf T}\mathbb 1 - 2br=aT1−2b, which Lemma 2.10 gives for facets alone. For a general valid inequality rrr can exceed aT1−2ba^{\mathsf T}\mathbb 1 - 2baT1−2b, so the uniform vector does not suffice. The theorem is stated, as printed, for every valid inequality, and a complete proof must supply the missing step.

Formalization scope

  • Coordinates of RV∪{0}\mathbb R^{V\cup\{0\}}RV∪{0} are indexed by Option V, with none as x0x_0x0​. Graphs are finite SimpleGraphs with the hypothesis that every node has a neighbour.
  • FR(G)\mathrm{FR}(G)FR(G) is defined by its two constraint families. This equals the cone over FRAC(G)\mathrm{FRAC}(G)FRAC(G) because there are no isolated nodes.
  • MMM is defined by condition (iii) itself.
  • The defect and the N-index are never suprema or infima. They are values rrr, kkk with IsGreatest and IsLeast hypotheses, so no default value such as sup⁡∅=0\sup\emptyset = 0sup∅=0 can make a statement vacuous.
  • Coefficients are natural numbers cast to R\mathbb RR. Lemmas 2.11–2.12 take real a≥0a \ge 0a≥0, as printed.
  • Deletion and contraction are zero-extended coefficient vectors on the same graph GGG, with defects taken over FRAC(G)\mathrm{FRAC}(G)FRAC(G). Subgraphs with isolated nodes never arise.
  • The goal adds the hypothesis r≥0r \ge 0r≥0. Without it the upper bound is false: for x1≤2x_1 \le 2x1​≤2 on one edge, r=−2r = -2r=−2 but k=0k = 0k=0. The paper's proof presumes it.
  • The lower bound is stated as r≤kbr \le kbr≤kb, which avoids Lean's r/0=0r/0 = 0r/0=0 convention.
  • Lemma 2.2 is stated for a closed convex cone K⊆FR(G)K \subseteq \mathrm{FR}(G)K⊆FR(G). The paper tacitly takes KKK closed, and the Section 1 lemma it rests on is false for non-closed cones. Its hypothesis "KKK contains STAB(G)\mathrm{STAB}(G)STAB(G)" is dropped, which makes the lemma stronger.
  • Corollary 2.8 uses the least kkk with Nk(G)=STAB(G)N^k(G) = \mathrm{STAB}(G)Nk(G)=STAB(G). This is equivalent to the paper's "largest N-index of a facet" and avoids a facet notion.
  • The goal is the two-sided bound for all graphs and inequalities. A version for one fixed graph, a version with a facet hypothesis, or "valid for Nr(G)N^r(G)Nr(G)" alone would each be a different, weaker theorem.
  • Not formalized: Lemma 2.10 (facets), Corollaries 2.6 and 2.9 (graph index via facets), and the polynomial-time results.

The work needs half-integrality of FRAC(G)\mathrm{FRAC}(G)FRAC(G), Lemma 1.3 of the paper (N(K)⊆(K∩Hi)+(K∩Gi)N(K) \subseteq (K\cap H_i) + (K \cap G_i)N(K)⊆(K∩Hi​)+(K∩Gi​)) and monotonicity of NNN. Each of these is reusable and welcome as a separate contribution.

Selected references

  • L. Lovász, A. Schrijver, Cones of matrices and set-functions and 0–1 optimization, SIAM Journal on Optimization 1(2) (1991) 166–190. https://doi.org/10.1137/0801013
  • M. Grötschel, L. Lovász, A. Schrijver, Geometric Algorithms and Combinatorial Optimization, Springer, 1988. https://doi.org/10.1007/978-3-642-97881-4
  • E. Balas, S. Ceria, G. Cornuéjols, A lift-and-project cutting plane algorithm for mixed 0–1 programs, Mathematical Programming 58 (1993) 295–324. https://doi.org/10.1007/BF01581273
  • M. Laurent, A comparison of the Sherali–Adams, Lovász–Schrijver, and Lasserre relaxations for 0–1 programming, Mathematics of Operations Research 28(3) (2003) 470–496. https://doi.org/10.1287/moor.28.3.470.16391
  • M. Yannakakis, Expressing combinatorial optimization problems by linear programs, Journal of Computer and System Sciences 43 (1991) 441–466. https://doi.org/10.1016/0022-0000(91)90024-Y
10 thms2 active usersReviewed
Markov ChainStochastic Systems·Captain: mikedeng1

Jobshop-Like Queueing Systems: The Equilibrium Distribution with State-Dependent Arrival and Service RatesResearch Paper

Motivation

A jobshop is a factory in which each job visits a sequence of machine groups, the sequence differing from job to job. J. R. Jackson's 1963 paper Jobshop-Like Queueing Systems (Management Science 10(1), 131–142) models such a shop as a network of queues and computes its long-run distribution of queue lengths in closed form. It generalizes his 1957 paper Networks of Waiting Lines (Operations Research 5(4)), which treated Poisson arrivals and multi-server centers, to arrival rates that depend on the total number of customers present and service rates that depend arbitrarily on the local queue length. The resulting product-form equilibrium is the starting point of queueing-network theory, which is used in performance analysis of manufacturing systems, computer systems and communication networks.

Timeline:

  • 1957: Jackson, Networks of Waiting Lines, constant external Poisson arrivals and multi-channel exponential servers; product-form equilibrium.
  • 1963: Jackson, this paper: state-dependent total arrival rate λ(S(kˉ))\lambda(S(\bar k))λ(S(kˉ)), queue-length-dependent service rates μ(n,k)\mu(n, k)μ(n,k), routings with self-loops and empty routings; Theorem (4.5).
  • 1967: Gordon and Newell, Closed Queuing Systems with Exponential Servers, the closed-network analogue.
  • 1979: Kelly, Reversibility and Stochastic Networks, the general theory of migration processes and partial balance.

Setting

There are N≥1N \ge 1N≥1 service centers, Center 1,…,N1, \dots, N1,…,N. A state vector kˉ=(k1,…,kN)\bar k = (k_1, \dots, k_N)kˉ=(k1​,…,kN​) has non-negative integer components, knk_nkn​ being the number of customers at Center nnn, and S(kˉ)=k1+⋯+kNS(\bar k) = k_1 + \dots + k_NS(kˉ)=k1​+⋯+kN​. The system (N,L,M,R)(N, L, M, R)(N,L,M,R) is given by:

  1. arrival rates λ(K)\lambda(K)λ(K), K=0,1,2,…K = 0, 1, 2, \dotsK=0,1,2,…: in state kˉ\bar kkˉ a customer arrives at rate λ(S(kˉ))\lambda(S(\bar k))λ(S(kˉ));
  2. service rates μ(n,k)\mu(n, k)μ(n,k): a service at Center nnn completes at rate μ(n,kn)\mu(n, k_n)μ(n,kn​);
  3. routing probabilities r(m,n)r(m, n)r(m,n), m∈[0,N]m \in [0, N]m∈[0,N], n∈[1,N+1]n \in [1, N+1]n∈[1,N+1]: an arriving customer's first center is nnn with probability r(0,n)r(0, n)r(0,n), its routing is empty with probability r(0,N+1)r(0, N+1)r(0,N+1); after service at Center mmm it moves to Center nnn with probability r(m,n)r(m, n)r(m,n) (possibly n=mn = mn=m) or leaves with probability r(m,N+1)r(m, N+1)r(m,N+1).

The paper's standing Assumptions (2.1)–(2.4): (2.1) either all λ(K)>0\lambda(K) > 0λ(K)>0, or λ(K)>0\lambda(K) > 0λ(K)>0 exactly for K≤K0K \le K_0K≤K0​; (2.2) μ(n,0)=0\mu(n, 0) = 0μ(n,0)=0 and μ(n,k)>0\mu(n, k) > 0μ(n,k)>0 for k≥1k \ge 1k≥1; (2.3) each row {r(m,n)}n∈[1,N+1]\{r(m, n)\}_{n \in [1, N+1]}{r(m,n)}n∈[1,N+1]​ is a probability distribution; (2.4) the traffic equations

e(n)=r(0,n)+∑m=1Ne(m) r(m,n),n∈[1,N],(2.5)e(n) = r(0, n) + \sum_{m=1}^N e(m)\, r(m, n), \qquad n \in [1, N], \tag{2.5}e(n)=r(0,n)+m=1∑N​e(m)r(m,n),n∈[1,N],(2.5)

have a unique solution, and it is non-negative.

The process is defined by its transition probabilities over a short interval (p. 134), from which the paper derives the balance equations (3.1) for P(kˉ,t)P(\bar k, t)P(kˉ,t). An equilibrium state probability distribution is a probability distribution ppp on state vectors such that P(kˉ,t)≡p(kˉ)P(\bar k, t) \equiv p(\bar k)P(kˉ,t)≡p(kˉ) solves (3.1). With

W(K)=∏i=0K−1λ(i),w(kˉ)=∏n=1N∏i=1kne(n)μ(n,i),T(K)=∑S(kˉ)=Kw(kˉ),W(K) = \prod_{i=0}^{K-1}\lambda(i), \quad w(\bar k) = \prod_{n=1}^N\prod_{i=1}^{k_n}\frac{e(n)}{\mu(n, i)}, \quad T(K) = \sum_{S(\bar k) = K} w(\bar k),W(K)=i=0∏K−1​λ(i),w(kˉ)=n=1∏N​i=1∏kn​​μ(n,i)e(n)​,T(K)=S(kˉ)=K∑​w(kˉ),

the constant π\piπ is {∑K≥0W(K)T(K)}−1\{\sum_{K \ge 0} W(K) T(K)\}^{-1}{∑K≥0​W(K)T(K)}−1 when the series converges and 000 otherwise.

Formalization targets

Goal: Theorem (4.5)

If π>0\pi > 0π>0, then

p(kˉ)=π w(kˉ) W(S(kˉ))(4.6)p(\bar k) = \pi\, w(\bar k)\, W(S(\bar k)) \tag{4.6}p(kˉ)=πw(kˉ)W(S(kˉ))(4.6)

is an equilibrium state probability distribution; and if the arrival rates are bounded, it is the only one. The goal fixes no constants; the condition π>0\pi > 0π>0 is the paper's.

Milestones

  1. The series in (4.4) converges to a positive number or diverges to +∞+\infty+∞ (§4, p. 136).
  2. If π>0\pi > 0π>0, (4.6) is a probability distribution (first claim of the proof sentence, p. 136).
  3. (4.6) satisfies equations (3.1) at every state (second claim, p. 136).
  4. Under bounded arrival rates, an equilibrium distribution is unique (§4, p. 135).

Companion

Theorem (6.3) in its case K∗=0K^* = 0K∗=0, kn∗=+∞k_n^* = +\inftykn∗​=+∞: with constant arrival rate λ(K)≡λ(0)\lambda(K) \equiv \lambda(0)λ(K)≡λ(0) and pn(0)>0p_n(0) > 0pn​(0)>0 for every nnn, the equilibrium is p(kˉ)=∏npn(kn)p(\bar k) = \prod_n p_n(k_n)p(kˉ)=∏n​pn​(kn​), pnp_npn​ being the normalized wn(k)=∏i=1kλ(0)e(n)/μ(n,i)w_n(k) = \prod_{i=1}^k \lambda(0)e(n)/\mu(n, i)wn​(k)=∏i=1k​λ(0)e(n)/μ(n,i).

Significance

Theorem (4.5) states that the queue lengths of a whole network have an explicit stationary law, determined by the routing only through the visit ratios e(n)e(n)e(n), and that conditionally on the total S(kˉ)=KS(\bar k) = KS(kˉ)=K it does not depend on the arrival process. With constant arrival rate it factorizes into independent one-center laws (Theorem (6.3)), each that of a single queue fed at rate λ(0)e(n)\lambda(0)e(n)λ(0)e(n); this is the form in which Jackson networks enter textbooks. State-dependent arrivals cover systems with balking or finite capacity: taking λ(K)=0\lambda(K) = 0λ(K)=0 for K>K0K > K_0K>K0​ caps the population.

The result is classical and proved; it has no machine-checked proof on this platform. The platform has Kelly–Yudovina's open migration process (KellyStochasticNetworks.open_migration_equilibrium): constant external arrivals, no self-loops, a full-balance conclusion without uniqueness. It is the companion (6.3) in substance but not the general theorem: arrival rates depending on the total population are not in it. This mission contributes the state-dependent model, a stationary form of Jackson's own equations (3.1), and a uniqueness statement.

Difficulty

The balance equations are an infinite system in Z≥0N\mathbb{Z}_{\ge 0}^NZ≥0N​. Substituting (4.6) gives terms with shifted states, guarded by non-negativity of components, a double sum over ordered pairs of distinct centers, self-loops appearing only in the outflow factor 1−r(n,n)1 - r(n, n)1−r(n,n), and centers with e(n)=0e(n) = 0e(n)=0, where www vanishes. Checking each state term by term against the traffic equations requires the diagonal of (2.5), excluded in (3.1), to be handled exactly. Summing (4.6) to one requires regrouping a series over Z≥0N\mathbb{Z}_{\ge 0}^NZ≥0N​ by the finite fibres of SSS.

Uniqueness is the hard part. The paper gives no proof: footnote 5 refers to a limit theorem for Markov processes and to the communication structure of non-transient states. A solution of the algebraic balance equations need not be the stationary law of the process when the process can explode, and the model allows explosion with π>0\pi > 0π>0 (e.g. N=1N = 1N=1, λ(K)=4K\lambda(K) = 4^Kλ(K)=4K, μ(1,k)=2⋅4k−1\mu(1,k) = 2\cdot 4^{k-1}μ(1,k)=2⋅4k−1). Uniqueness therefore depends on non-explosion as well as on the communication structure of the states, and neither is addressed on the page.

Formalization scope

Centers are Fin N with N>0N > 0N>0; states are Fin N → ℕ; rates are real. The routing is one function r : Option (Fin N) → Option (Fin N) → ℝ, where none is the index 000 in the first argument and N+1N + 1N+1 in the second. A structure JobshopSystem N bundles λ,μ,r,e\lambda, \mu, r, eλ,μ,r,e with Assumptions (2.1)–(2.4) as fields; eee is a parameter satisfying (2.5), uniqueness and non-negativity, not a formula. Balance sys q k is the stationary equation (3.1) at k for an arbitrary q, and IsEquilibrium sys q is q≥0q \ge 0q≥0, HasSum q 1, and Balance at every state. π\piπ is defined with an explicit if Summable … then … else 0.

Explicit choices, each stated in the item where it applies:

  • Correction of (3.1). The paper prints the arrival outflow as λ(S(kˉ))\lambda(S(\bar k))λ(S(kˉ)):

    dP(kˉ,t)dt=−[λ(S(kˉ))+∑nμ(n,kn)(1−r(n,n))]P(kˉ,t)+…\dfrac{dP(\bar k, t)}{dt} = -[\lambda(S(\bar k)) + \sum_n \mu(n, k_n)(1 - r(n, n))]P(\bar k, t) + \dotsdtdP(kˉ,t)​=−[λ(S(kˉ))+∑n​μ(n,kn​)(1−r(n,n))]P(kˉ,t)+…

    Its transition probabilities (p. 134) give λ(S(kˉ))∑n=1Nr(0,n)\lambda(S(\bar k))\sum_{n=1}^N r(0, n)λ(S(kˉ))∑n=1N​r(0,n), since an arrival with an empty routing leaves the state unchanged. The two agree only when r(0,N+1)=0r(0, N+1) = 0r(0,N+1)=0, and with the printed coefficient Theorem (4.5) is false (N=1N = 1N=1, r(0,1)=r(0,2)=1/2r(0,1) = r(0,2) = 1/2r(0,1)=r(0,2)=1/2, r(1,2)=1r(1,2) = 1r(1,2)=1, constant rates, at kˉ=0\bar k = 0kˉ=0). The formalization uses the coefficient the transition probabilities give. It does not assume r(0,N+1)=0r(0, N+1) = 0r(0,N+1)=0: the paper allows empty routings.

  • Uniqueness under bounded arrival rates. Uniqueness (milestone 4 and the goal's second conjunct) assumes ∃Λ, ∀K, λ(K)≤Λ\exists \Lambda,\ \forall K,\ \lambda(K) \le \Lambda∃Λ, ∀K, λ(K)≤Λ. The paper asserts uniqueness without proof, citing a limit theorem for regular processes; bounded arrival rates make the process regular and hold for every example in the paper. Existence and the formula carry no added hypothesis.

  • Companion (6.3). System (N,L,M,R)∗(N, L, M, R)^*(N,L,M,R)∗ of §5 is not formalized in the paper and not here; only its case K∗=0K^* = 0K∗=0, kn∗=+∞k_n^* = +\inftykn∗​=+∞ is stated.

A trivializing formalization is ruled out: Balance and IsEquilibrium are stated for an arbitrary function on states and never mention www, WWW or π\piπ, and equilibrium is neither defined as (4.6) nor as detailed or partial balance.

Useful infrastructure: summation over Fin N → ℕ grouped by total (Finset.Nat.antidiagonalTuple), and a non-explosion and uniqueness theory for countable-state continuous-time chains, which is reusable beyond this mission. Not included: the limit lim⁡t→∞P(kˉ,t)=p(kˉ)\lim_{t\to\infty} P(\bar k, t) = p(\bar k)limt→∞​P(kˉ,t)=p(kˉ), which needs a construction of the process; the equivalence of (2.4) with finiteness of routings; Theorem (5.5) and (5.7)–(5.9).

Selected references

  • J. R. Jackson, Jobshop-Like Queueing Systems, Management Science 10(1), 131–142, 1963. https://doi.org/10.1287/mnsc.10.1.131
  • J. R. Jackson, Networks of Waiting Lines, Operations Research 5(4), 518–521, 1957. https://doi.org/10.1287/opre.5.4.518
  • W. J. Gordon and G. F. Newell, Closed Queuing Systems with Exponential Servers, Operations Research 15(2), 254–265, 1967. https://doi.org/10.1287/opre.15.2.254
  • F. P. Kelly, Reversibility and Stochastic Networks, Wiley, 1979. https://www.statslab.cam.ac.uk/~frank/BOOKS/book/whole.pdf
  • A. T. Bharucha-Reid, Elements of the Theory of Markov Processes and Their Applications, McGraw-Hill, 1960 (Theorem 2.9, p. 102, cited in footnote 5).
6 thms2 active usersReviewed
CombinatoricsProbability·Captain: mikedeng1

The Erdős Matching Conjecture and Concentration Inequalities: The Conjecture in a Linear RangeResearch Paper

Motivation

In 1965 Erdős asked how large a family of kkk-element subsets of an nnn-element set can be if it contains no s+1s+1s+1 pairwise disjoint members. The question, now called the Erdős Matching Conjecture (EMC), contains the Erdős–Ko–Rado theorem (the case s=1s=1s=1) and is one of the central open problems of extremal set theory. Beyond combinatorics it is tied to tail bounds for sums of random variables (generalizations of Markov's inequality, see Alon, Frankl, Huang, Rödl, Ruciński and Sudakov, JCTA 2012, as cited on p. 2 of the paper) and to Dirac-type thresholds for perfect matchings in hypergraphs.

Timeline.

  • 1965: Erdős proves the conjecture for n≥n0(k,s)n\ge n_0(k,s)n≥n0​(k,s).
  • 1959/1968: Erdős–Gallai settle k=2k=2k=2; Kleitman settles the case n=k(s+1)n=k(s+1)n=k(s+1) implicitly.
  • 1976: Bollobás, Daykin and Erdős prove it for n≥2k3sn\ge2k^3sn≥2k3s.
  • 2012: Huang, Loh and Sudakov prove it for n≥3k2sn\ge3k^2sn≥3k2s.
  • 2013: Frankl proves it for n≥(2s+1)k−sn\ge(2s+1)k-sn≥(2s+1)k−s (JCTA 120).
  • 2017: Frankl settles k=3k=3k=3 completely.
  • 2018–2022: Frankl and Kupavskii prove it for n≥53sk−23sn\ge\frac53sk-\frac23sn≥35​sk−32​s and all s≥s0s\ge s_0s≥s0​ (arXiv:1806.08855), the result of this mission.

Setting

Write [n]={1,…,n}[n]=\{1,\dots,n\}[n]={1,…,n} and ([n]k)\binom{[n]}{k}(k[n]​) for the set of its kkk-element subsets. For a family F⊆([n]k)\mathcal F\subseteq\binom{[n]}kF⊆(k[n]​), a matching is a subfamily of pairwise disjoint members, and the matching number ν(F)\nu(\mathcal F)ν(F) is the largest size of a matching. The Erdős matching function is

m(n,k,s)=max⁡{∣F∣:F⊆([n]k), ν(F)≤s}.m(n,k,s)=\max\Big\{|\mathcal F| : \mathcal F\subseteq\tbinom{[n]}{k},\ \nu(\mathcal F)\le s\Big\}.m(n,k,s)=max{∣F∣:F⊆(k[n]​), ν(F)≤s}.

Two families show the conjectured value. The family of all kkk-sets meeting [s][s][s] has (nk)−(n−sk)\binom nk-\binom{n-s}k(kn​)−(kn−s​) members; the family of all kkk-subsets of [k(s+1)−1][k(s+1)-1][k(s+1)−1] has (k(s+1)−1k)\binom{k(s+1)-1}k(kk(s+1)−1​) members. Both have ν≤s\nu\le sν≤s, and the EMC asserts m(n,k,s)m(n,k,s)m(n,k,s) is the larger of the two numbers. For n≥(k+1)sn\ge(k+1)sn≥(k+1)s the first is larger.

The proof uses the shifting order: for A={a1<⋯<ak}A=\{a_1<\dots<a_k\}A={a1​<⋯<ak​} and B={b1<⋯<bk}B=\{b_1<\dots<b_k\}B={b1​<⋯<bk​}, A≺BA\prec BA≺B if ai≤bia_i\le b_iai​≤bi​ for all iii and A≠BA\ne BA=B. A family is initial if it is closed downward under ≺\prec≺. For S⊆[s+1]S\subseteq[s+1]S⊆[s+1], F(S)={F∖S:F∈F, F∩[s+1]=S}\mathcal F(S)=\{F\setminus S: F\in\mathcal F,\ F\cap[s+1]=S\}F(S)={F∖S:F∈F, F∩[s+1]=S}, and ∂\partial∂ denotes the shadow. Families F1,…,Fs+1\mathcal F_1,\dots,\mathcal F_{s+1}F1​,…,Fs+1​ are cross-dependent if no choice Fi∈FiF_i\in\mathcal F_iFi​∈Fi​ is pairwise disjoint, and nested if F1⊇⋯⊇Fs+1\mathcal F_1\supseteq\dots\supseteq\mathcal F_{s+1}F1​⊇⋯⊇Fs+1​. A random ttt-matching is a uniformly random ordered ttt-tuple of pairwise disjoint lll-subsets of [m][m][m], and η=∣G∩B∣\eta=|\mathcal G\cap\mathcal B|η=∣G∩B∣ counts how many of its sets lie in a fixed family G\mathcal GG of density α=∣G∣/(ml)\alpha=|\mathcal G|/\binom mlα=∣G∣/(lm​).

Formalization targets

Goal: Theorem 1

There is an absolute constant s0s_0s0​ such that for all k≥1k\ge1k≥1, s≥s0s\ge s_0s≥s0​ and

n≥53sk−23swe havem(n,k,s)=(nk)−(n−sk).n\ge\tfrac53sk-\tfrac23s\qquad\text{we have}\qquad m(n,k,s)=\binom nk-\binom{n-s}k .n≥35​sk−32​swe havem(n,k,s)=(kn​)−(kn−s​).

The constant s0s_0s0​ is existential and uniform in nnn and kkk; no value is fixed, so any improvement of the proof keeps the statement valid.

Stronger form: Theorem 14

For every ε>0\varepsilon>0ε>0 there is s0(ε)s_0(\varepsilon)s0​(ε) such that the same equality holds for all s≥s0s\ge s_0s≥s0​, k≥1k\ge1k≥1 and n≥s+(1.666+ε)s(k−1)n\ge s+(1.666+\varepsilon)s(k-1)n≥s+(1.666+ε)s(k−1). Theorem 1 follows by taking ε<53−1.666\varepsilon<\frac53-1.666ε<35​−1.666.

Milestones

Following the paper's proof: Lemma 3 (shifting), Proposition 4, Lemma 5, Proposition 6, Corollary 7 and Lemma 8 (structure of initial families and their shadows); Proposition 11, Theorem 12 and Proposition 13 (concentration of η\etaη for random matchings); Lemma 18 and Lemma 15 (the weighted bound for cross-dependent nested families); Lemmas 16 and 17 (the induction step at n=s+(1.666+ε)s(k−1)n=s+(1.666+\varepsilon)s(k-1)n=s+(1.666+ε)s(k−1)); Theorem 14.

Significance

The theorem extends the range in which the EMC is known from n≥(2s+1)k−sn\ge(2s+1)k-sn≥(2s+1)k−s to n≥53sk−23sn\ge\frac53sk-\frac23sn≥35​sk−32​s for large sss, settling roughly a third of the remaining range. The paper uses it as a black box to derive a universal upper bound on m(n,k,s)m(n,k,s)m(n,k,s) below that range (its Theorem 2) and consequences for Dirac thresholds. The concentration inequality of Theorem 12, a Gaussian tail for the number of members of a fixed family hit by a random matching, is a tool of independent use and has since been applied to rainbow versions of the problem (Kupavskii, arXiv:2104.08083).

The result is proved on paper; this mission formalizes it. No part of the argument has a machine-checked proof: Mathlib has shadows and the Erdős–Ko–Rado theorem, and the platform has Erdős–Ko–Rado for s=1s=1s=1, but there is no formal theory of the matching number, shifted families, Kneser graph spectra, or martingale concentration for random matchings. A complete formalization would make the EMC in this range, and the concentration theorem, available for reuse.

Difficulty

Averaging over a random full partition of [n][n][n] into kkk-sets gives only m(n,k,s)≤s(n−1k−1)m(n,k,s)\le s\binom{n-1}{k-1}m(n,k,s)≤s(k−1n−1​), far from the truth: the expected number of partition classes in F\mathcal FF says nothing about how that number is distributed. The paper's step is to show the count is concentrated (Theorem 12) and to exploit the deterministic bound of Lemma 18, which penalizes matchings with many classes in Fs+1\mathcal F_{s+1}Fs+1​. Controlling the regime where the density α\alphaα is small needs the separate comparison of Proposition 13.

The second difficulty is Lemma 17, whose proof in the appendix is a delicate estimate on sums and products of binomial coefficients over all k≥4k\ge4k≥4, supported by numerical computations done in Mathematica. A formal proof needs certified numerics for these finite checks and a separate stability argument for k>2⋅104k>2\cdot10^4k>2⋅104. The case k=3k=3k=3 is an external base case (Frankl 2017), so the induction on kkk also needs that result or another route.

Formalization scope

Sets are finite sets of natural numbers; [n][n][n] is Finset.Icc 1 n, so the paper's indices such as [i(s+1)−1][i(s+1)-1][i(s+1)−1] and s+1,2(s+1),…s+1,2(s+1),\dotss+1,2(s+1),… appear unshifted. ν\nuν is a maximum over subfamilies (members are distinct), and m(n,k,s)m(n,k,s)m(n,k,s) is a finite maximum, always attained. Initial families are closed downward among kkk-subsets of [m][m][m] only. Random matchings are ordered tuples, and probabilities, expectations and covariances are uniform averages over the finite sample space. The constant 1.6661.6661.666 is the exact decimal, not 5/35/35/3. The paper omits integer parts at n=s+(c+ε)s(k−1)n=s+(c+\varepsilon)s(k-1)n=s+(c+ε)s(k−1); the formalization rounds nnn up. Where the paper leaves hypotheses implicit, they are binders: k≥2k\ge2k≥2 in Corollary 7, Lemma 8 and Lemma 16, k≥4k\ge4k≥4 and the induction hypothesis in Lemma 17, t≥1t\ge1t≥1 in Theorem 12, and q>0q>0q>0 (the division sx/qsx/qsx/q) in Lemma 15.

The goal is the equality m(n,k,s)=(nk)−(n−sk)m(n,k,s)=\binom nk-\binom{n-s}km(n,k,s)=(kn​)−(kn−s​); exhibiting the family of kkk-sets meeting [s][s][s] proves only the lower bound and does not close it.

Useful infrastructure, reusable beyond this mission: shifting and the compression argument (Lemma 3), the shadow bounds of Section 2, the expander mixing lemma and the second eigenvalue of Kneser graphs, and the Azuma–Hoeffding inequality for the exposure martingale of a random matching. Contributions of any of these, and of alternative proofs of the milestones, are welcome.

Selected references

  • P. Frankl, A. Kupavskii, The Erdős Matching Conjecture and concentration inequalities, J. Combin. Theory Ser. B (2022); arXiv:1806.08855v3. https://arxiv.org/abs/1806.08855, https://doi.org/10.1016/j.jctb.2022.08.002
  • P. Erdős, A problem on independent r-tuples, Ann. Univ. Sci. Budapest. Eötvös Sect. Math. 8 (1965), 93–95.
  • P. Frankl, Improved bounds for Erdős' Matching Conjecture, J. Combin. Theory Ser. A 120 (2013), 1068–1072. https://doi.org/10.1016/j.jcta.2013.01.008
  • P. Frankl, On the maximum number of edges in a hypergraph with given matching number, Discrete Appl. Math. 216 (2017), 562–581.
  • H. Huang, P.-S. Loh, B. Sudakov, The size of a hypergraph and its matching number, Combin. Probab. Comput. 21 (2012), 442–450.
  • N. Alon, F. Chung, Explicit construction of linear sized tolerant networks, Discrete Math. 72 (1988), 15–19. https://doi.org/10.1016/0012-365X(88)90189-6
  • L. Lovász, On the Shannon capacity of a graph, IEEE Trans. Inform. Theory 25 (1979), 1–7. https://doi.org/10.1109/TIT.1979.1055985
23 thms2 active usersReviewed
CombinatoricsGraph TheoryOptimization+1·Captain: mikedeng1

Linear-Time Approximation for Maximum Weight Matching: The Approximation Guarantee of the Scaling AlgorithmResearch Paper

Motivation

The maximum weight matching (MWM) problem asks, for a graph with edge weights, for a set of vertex-disjoint edges of largest total weight. It is a central problem of combinatorial optimization, with applications to transportation, assignment and scheduling, and as a subroutine for shortest paths, planar max cut, Chinese postman tours and metric TSP. Edmonds' blossom algorithm (1965) solves it on general graphs; the fastest implementation, due to Gabow, runs in O(mn+n2log⁡n)O(mn+n^2\log n)O(mn+n2logn) time, and the scaling algorithm of Gabow and Tarjan (1991) runs in O(mnlog⁡n log⁡(nN))O(m\sqrt{n\log n}\,\log(nN))O(mnlogn​log(nN)) time on graphs with nnn vertices, mmm edges and integer weights of magnitude at most NNN. Applications such as switch scheduling, graph clustering and sparse linear solvers accept a slightly suboptimal matching in exchange for speed. This motivates (1−ϵ)(1-\epsilon)(1−ϵ)-approximate maximum weight matchings: matchings whose weight is at least a 1−ϵ1-\epsilon1−ϵ fraction of the optimum.

Timeline of linear and near-linear time approximation for general graphs (Section 1.3 and Table IV of the paper; the entries below are as the paper attributes them):

  • Folklore: the greedy algorithm, which repeatedly takes the heaviest remaining edge, gives a 12\tfrac1221​-MWM in O(mlog⁡n)O(m\log n)O(mlogn) time.
  • Preis (STACS 1999): a 12\tfrac1221​-MWM in linear time; Drake and Hougardy (2003) gave a simpler one.
  • Drake and Hougardy (2003; journal version Vinkemeier and Hougardy, ACM Trans. Algorithms 2005): a (23−ϵ)(\tfrac23-\epsilon)(32​−ϵ)-MWM in O(mϵ−1)O(m\epsilon^{-1})O(mϵ−1) time; Pettie and Sanders (2004) improved this to O(mlog⁡ϵ−1)O(m\log\epsilon^{-1})O(mlogϵ−1).
  • Duan and Pettie (FOCS 2010) and Hanke and Hougardy (2010): a (34−ϵ)(\tfrac34-\epsilon)(43​−ϵ)-MWM in O(mlog⁡nlog⁡ϵ−1)O(m\log n\log\epsilon^{-1})O(mlognlogϵ−1) time.
  • Duan and Pettie (2014): a (1−ϵ)(1-\epsilon)(1−ϵ)-MWM in O(mϵ−1log⁡ϵ−1)O(m\epsilon^{-1}\log\epsilon^{-1})O(mϵ−1logϵ−1) time, which is linear for every fixed ϵ\epsilonϵ.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite simple graph with integer weights w:E→{1,…,N}w:E\to\{1,\dots,N\}w:E→{1,…,N}, N=2LN=2^LN=2L. A matching MMM is a set of vertex-disjoint edges, with weight w(M)=∑e∈Mw(e)w(M)=\sum_{e\in M}w(e)w(M)=∑e∈M​w(e); a vertex is free if no edge of MMM touches it. MMM is a ccc-MWM if c⋅w(M′)≤w(M)c\cdot w(M')\le w(M)c⋅w(M′)≤w(M) for every matching M′M'M′.

A blossom is built recursively: a single vertex {v}\{v\}{v} is a trivial blossom with E{v}=∅E_{\{v\}}=\emptysetE{v}​=∅; an odd number ≥3\ge3≥3 of disjoint blossoms A0,…,AℓA_0,\dots,A_\ellA0​,…,Aℓ​ joined in a cycle by edges ei∈Ai×Ai+1e_i\in A_i\times A_{i+1}ei​∈Ai​×Ai+1​ form the blossom B=⋃AiB=\bigcup A_iB=⋃Ai​ with edge set EB=⋃EAi∪{e0,…,eℓ}E_B=\bigcup E_{A_i}\cup\{e_0,\dots,e_\ell\}EB​=⋃EAi​​∪{e0​,…,eℓ​}. It is full if ∣M∩EB∣=(∣B∣−1)/2|M\cap E_B|=(|B|-1)/2∣M∩EB​∣=(∣B∣−1)/2. The algorithm keeps a laminar set Ω\OmegaΩ of full blossoms; a root blossom is a maximal one, and G/ΩG/\OmegaG/Ω contracts each root blossom to a single vertex.

Dual values y:V→Ry:V\to\mathbb Ry:V→R and zzz on odd vertex sets give each edge the value

yz(u,v)=y(u)+y(v)+∑B odd, u,v∈Bz(B).yz(u,v)=y(u)+y(v)+\sum_{B\ \text{odd},\ u,v\in B} z(B).yz(u,v)=y(u)+y(v)+B odd, u,v∈B∑​z(B).

The scaling algorithm (Figure 2 of the paper) has parameters NNN and ϵ′=2−g≤14\epsilon'=2^{-g}\le\tfrac14ϵ′=2−g≤41​. It runs scales i=0,…,Li=0,\dots,Li=0,…,L with granularity δi=ϵ′N/2i\delta_i=\epsilon'N/2^iδi​=ϵ′N/2i and truncated weights wi(e)=δi⌊w(e)/δi⌋w_i(e)=\delta_i\lfloor w(e)/\delta_i\rfloorwi​(e)=δi​⌊w(e)/δi​⌋. Each scale repeats four steps: augment along a maximal set of vertex-disjoint augmenting paths of the eligible graph GeligG_{\mathrm{elig}}Gelig​, shrink a maximal set of new blossoms, adjust the duals by ±δi/2\pm\delta_i/2±δi​/2, and dissolve root blossoms whose zzz-value has reached zero. It stops when the free vertices' yyy-values reach a scale-dependent value, which is 000 at scale LLL. Eligibility is given by Definition 3.2; the linear-time variant keeps the algorithm unchanged and uses Definition 3.10, which additionally ignores an edge eee in scales i>scale(e)+log⁡ϵ′−1i>\mathrm{scale}(e)+\log\epsilon'^{-1}i>scale(e)+logϵ′−1 unless it is a blossom edge.

Formalization targets

Goal: Theorem 3.12, approximation half

For every ϵ\epsilonϵ with ϵ′≤ϵ/7\epsilon'\le\epsilon/7ϵ′≤ϵ/7, the algorithm of Figure 2 with Definition 3.10 eligibility has a terminating run, and every terminating run returns a matching MMM with

w(M) ≥ (1−ϵ) w(M′)for every matching M′ of G.w(M)\ \ge\ (1-\epsilon)\,w(M')\qquad\text{for every matching } M' \text{ of } G .w(M) ≥ (1−ϵ)w(M′)for every matching M′ of G.

Milestones, in attack order

  • Lemma 2.3: approximate complementary slackness (yz(e)≥(1−ϵ0)w(e)yz(e)\ge(1-\epsilon_0)w(e)yz(e)≥(1−ϵ0​)w(e) everywhere, yz(e)≤(1+ϵ1)w(e)yz(e)\le(1+\epsilon_1)w(e)yz(e)≤(1+ϵ1​)w(e) on matched and blossom edges, zero free duals) gives a (1+ϵ1)−1(1−ϵ0)(1+\epsilon_1)^{-1}(1-\epsilon_0)(1+ϵ1​)−1(1−ϵ0​)-MWM.
  • Section 2 rescaling: rounding real weights to ⌊w/γr⌋\lfloor w/\gamma_r\rfloor⌊w/γr​⌋, γr=ϵwmax⁡/n\gamma_r=\epsilon w_{\max}/nγr​=ϵwmax​/n, loses at most a factor 1−ϵ/21-\epsilon/21−ϵ/2.
  • Lemma 3.5: with Definition 3.2 the algorithm preserves Property 3.1, which consists of granularity, active blossoms, near domination yz(e)≥wi(e)−δiyz(e)\ge w_i(e)-\delta_iyz(e)≥wi​(e)−δi​, near tightness yz(e)≤wi(e)+2(δj−δi)yz(e)\le w_i(e)+2(\delta_j-\delta_i)yz(e)≤wi​(e)+2(δj​−δi​) for type-jjj edges, and equal free duals.
  • Lemma 3.6: eligible edges searched up to scale iii weigh at least N/2i+1+δiN/2^{i+1}+\delta_iN/2i+1+δi​, and matched edges satisfy yz(e)≤(1+4ϵ′)w(e)yz(e)\le(1+4\epsilon')w(e)yz(e)≤(1+4ϵ′)w(e).
  • Lemma 3.7: the output under Definition 3.2 is a (1−5ϵ′)(1-5\epsilon')(1−5ϵ′)-MWM.
  • Theorem 3.8: the approximation half of Theorem 3.8, with ϵ′≤ϵ/5\epsilon'\le\epsilon/5ϵ′≤ϵ/5.
  • Lemma 3.11: the invariants under Definition 3.10, including yz(e)>(1−ϵ′)wi(e)yz(e)>(1-\epsilon')w_i(e)yz(e)>(1−ϵ′)wi​(e) and yz(e)<(1+6ϵ′)wi(e)yz(e)<(1+6\epsilon')w_i(e)yz(e)<(1+6ϵ′)wi​(e) once i>scale(e)+γi>\mathrm{scale}(e)+\gammai>scale(e)+γ.

Significance

The result. Theorem 3.12 gives the first algorithm for (1−ϵ)(1-\epsilon)(1−ϵ)-approximate maximum weight matching on general graphs that runs in linear time for every fixed ϵ\epsilonϵ; earlier linear-time algorithms achieved only 12\tfrac1221​ or 23−ϵ\tfrac23-\epsilon32​−ϵ. Its analysis is a relaxation of Edmonds' complementary slackness conditions that grows weaker over the scales, but not uniformly, and Lemma 2.3 certifies an approximate matching by approximately feasible duals.

Formalizing it. The result is proved in the paper. Mathlib (at the pinned revision) has matchings, alternating walks and Tutte's theorem, but no blossoms, contracted graphs or weighted matching algorithms. A complete development gives a Lean model of blossoms, contraction and augmenting paths through blossoms, a verified primal–dual invariant for a scaling algorithm, and a checked approximate-slackness certificate for matchings. Each of these can be reused to formalize Edmonds' exact algorithm or the Gabow–Tarjan scaling algorithm.

Difficulty

The two halves of the argument pull against each other. Lemma 2.3 needs near domination and near tightness as multiplicative bounds. The algorithm maintains only additive bounds whose slack for an edge of type jjj is 2(δj−δi)2(\delta_j-\delta_i)2(δj​−δi​), and this slack does not shrink as the scales advance. Converting it into a factor 1+O(ϵ′)1+O(\epsilon')1+O(ϵ′) requires a lower bound on the weight of every edge that ever became eligible, which in turn depends on the free vertices' duals following an exact schedule across scales.

For Definition 3.10 the obvious argument breaks down: an edge that is ignored after scale scale(e)+γ\mathrm{scale}(e)+\gammascale(e)+γ may violate near domination and near tightness by an amount that grows with every later dual adjustment. The claim is that the accumulated violation stays within an O(ϵ′)O(\epsilon')O(ϵ′) fraction of wi(e)w_i(e)wi​(e), and establishing this requires tracking every adjustment that can reach an ignored edge.

On the combinatorial side, the Augmentation and Blossom Shrinking steps work in the contracted graph G/ΩG/\OmegaG/Ω. Their correctness uses the classical facts that augmenting paths lift through full blossoms and that blossoms stay full after augmentation (Lemma 2.1), which have to be formalized from scratch.

Formalization scope

Graphs are SimpleGraph V on a Fintype V with decidable equality; edges are Sym2 V; matchings are Finset (Sym2 V) with pairwise vertex-disjoint edges of GGG; weights are w:Sym2 V→Nw:\mathrm{Sym2}\,V\to\mathbb Nw:Sym2V→N with 1≤w(e)≤2L1\le w(e)\le 2^L1≤w(e)≤2L on edges. Duals, δi\delta_iδi​ and wiw_iwi​ are real numbers. zzz is a function on all finite vertex sets and yzyzyz sums it over the odd sets that contain the edge, as on the page. N=2LN=2^LN=2L and ϵ′=2−g\epsilon'=2^{-g}ϵ′=2−g, g≥2g\ge2g≥2, are given through their exponents. scale(e)\mathrm{scale}(e)scale(e) uses the convention μ−1=+∞\mu_{-1}=+\inftyμ−1​=+∞. The paper's standing assumption N≤n2N\le n^2N≤n2 is used only for running time and is omitted.

The algorithm is a nondeterministic relation. A state holds MMM, Ω\OmegaΩ with its blossom edge sets, yyy, zzz, a ghost record of the scale in which each edge last entered M∪⋃B∈ΩEBM\cup\bigcup_{B\in\Omega}E_BM∪⋃B∈Ω​EB​, and the common free-vertex dual that drives the loop test. The maximal sets of augmenting paths and of new blossoms and the lifts of paths through blossoms are choices. Invariants are stated for states reachable by a run, and the goal asserts both that a terminating run exists and that every terminating run returns a (1−ϵ)(1-\epsilon)(1−ϵ)-MWM.

The running times O(mϵ−1log⁡N)O(m\epsilon^{-1}\log N)O(mϵ−1logN) of Theorem 3.8 and O(mϵ−1log⁡ϵ−1)O(m\epsilon^{-1}\log\epsilon^{-1})O(mϵ−1logϵ−1) of Theorem 3.12 are not formalized: the paper fixes no cost model, and its bounds rely on a modified depth-first search and on word-RAM table lookups. The explicit constants ϵ′≤ϵ/5\epsilon'\le\epsilon/5ϵ′≤ϵ/5 (Theorem 3.8) and ϵ′≤ϵ/7\epsilon'\le\epsilon/7ϵ′≤ϵ/7 (Theorem 3.12) are the ones the proofs supply.

The following trivializing formalizations are ruled out: a "matching" that may contain non-edges or repeated edges; a goal about a state only assumed to satisfy Property 3.1 rather than reached by the algorithm; a run relation with no terminating run, which the existence conjunct excludes; eligibility or blossoms chosen freely instead of by the page's rules; and comparison only against matchings of the contracted graph instead of all matchings of GGG.

Welcome contributions include a Lean treatment of blossoms and their contraction (Lemma 2.1, which is not a milestone here), the lift of augmenting paths, Lemmas 3.3 and 3.4 as auxiliary results, and proofs of the milestones in the order listed.

Selected references

  • R. Duan and S. Pettie, Linear-Time Approximation for Maximum Weight Matching, Journal of the ACM 61(1), Article 1, 2014. https://doi.org/10.1145/2529989
  • J. Edmonds, Maximum matching and a polyhedron with 0,1-vertices, Journal of Research of the National Bureau of Standards 69B, 125–130, 1965. https://doi.org/10.6028/jres.069B.013
  • H. N. Gabow and R. E. Tarjan, Faster scaling algorithms for general graph-matching problems, Journal of the ACM 38(4), 815–853, 1991. https://doi.org/10.1145/115234.115366
  • R. Preis, Linear time 1/2-approximation algorithm for maximum weighted matching in general graphs, STACS 1999, LNCS 1563, 259–269 (cited from the bibliography of Duan and Pettie 2014).
  • D. E. D. Vinkemeier and S. Hougardy, A linear-time approximation algorithm for weighted matchings in graphs, ACM Transactions on Algorithms 1(1), 107–122, 2005 (cited from the bibliography of Duan and Pettie 2014).
  • S. Pettie and P. Sanders, A simpler linear time 2/3 − ϵ approximation to maximum weight matching, Information Processing Letters 91(6), 271–276, 2004 (cited from the bibliography of Duan and Pettie 2014).
12 thms2 active usersReviewed
Functional AnalysisProbability·Captain: mikedeng1

Conditional and Dynamic Convex Risk Measures I: Robust Representation of Conditional Convex Risk MeasuresResearch Paper

Motivation

A convex risk measure assigns to a bounded financial position XXX (a random net payoff) a number ρ(X)\rho(X)ρ(X), interpreted as the capital that must be added to XXX to make it acceptable. The axiomatic theory began with coherent risk measures (Artzner, Delbaen, Eber and Heath, 1999) and was extended to convex ones by Föllmer and Schied (2002) and Frittelli and Rosazza Gianin (2002). Its central structural result is a robust representation: a convex risk measure that is continuous from above equals a worst case of expected losses over a family of probabilistic models, each penalized by how implausible it is.

Regulators and risk managers do not assess positions once and for all; they reassess them as information arrives. Detlefsen and Scandolo (2005) extend the representation to conditional risk measures, whose value ρ(X)\rho(X)ρ(X) is itself a random variable measurable with respect to the information available to the agent. This is the building block of dynamic (time-consistent) risk measurement, studied in later work on dynamic risk measures and backward stochastic differential equations.

Timeline. Artzner et al. (1999): coherent risk measures on finite Ω\OmegaΩ. Delbaen (2002): coherent risk measures on general probability spaces, Fatou property. Föllmer–Schied (2002) and Frittelli–Rosazza Gianin (2002): convex risk measures and their robust representation; Föllmer–Schied, Stochastic Finance, Theorem 4.26 (2002 edition) for L∞L^\inftyL∞ with continuity from above. Detlefsen–Scandolo (2005): the conditional version, Theorem 3.2 of the paper formalized here.

Setting

Fix a probability space (Ω,F,P)(\Omega,\mathcal F,P)(Ω,F,P) and a sub-σ\sigmaσ-algebra G⊆F\mathcal G\subseteq\mathcal FG⊆F describing the available information. L∞L^\inftyL∞ is the space of essentially bounded random variables and LG∞L^\infty_{\mathcal G}LG∞​ its G\mathcal GG-measurable part; every (in)equality between random variables holds PPP-almost surely.

A map ρ:L∞→LG∞\rho:L^\infty\to L^\infty_{\mathcal G}ρ:L∞→LG∞​ is a conditional convex risk measure if ρ(0)=0\rho(0)=0ρ(0)=0 and, for X,Y∈L∞X,Y\in L^\inftyX,Y∈L∞:

  • (conditional translation invariance) ρ(X+Z)=ρ(X)−Z\rho(X+Z)=\rho(X)-Zρ(X+Z)=ρ(X)−Z for every Z∈LG∞Z\in L^\infty_{\mathcal G}Z∈LG∞​;
  • (monotonicity) X≤YX\le YX≤Y implies ρ(X)≥ρ(Y)\rho(X)\ge\rho(Y)ρ(X)≥ρ(Y);
  • (conditional convexity) ρ(ΛX+(1−Λ)Y)≤Λρ(X)+(1−Λ)ρ(Y)\rho(\Lambda X+(1-\Lambda)Y)\le\Lambda\rho(X)+(1-\Lambda)\rho(Y)ρ(ΛX+(1−Λ)Y)≤Λρ(X)+(1−Λ)ρ(Y) for every Λ∈LG∞\Lambda\in L^\infty_{\mathcal G}Λ∈LG∞​ with 0≤Λ≤10\le\Lambda\le10≤Λ≤1.

The admissible models are

PG={Q probability on (Ω,F):Q≪P, Q(A)=P(A) for all A∈G}.\mathcal P_{\mathcal G}=\{Q \text{ probability on }(\Omega,\mathcal F): Q\ll P,\ Q(A)=P(A)\text{ for all }A\in\mathcal G\}.PG​={Q probability on (Ω,F):Q≪P, Q(A)=P(A) for all A∈G}.

For a family X\mathcal XX of [−∞,+∞][-\infty,+\infty][−∞,+∞]-valued random variables, the essential supremum ess.sup⁡X\operatorname{ess.sup}\mathcal Xess.supX is the PPP-a.s. smallest random variable that dominates every member PPP-a.s.; it replaces the pointwise supremum, which is not meaningful for uncountable families of equivalence classes.

A map ρ\rhoρ is representable if there is a penalty α:PG→LG0([0,+∞])\alpha:\mathcal P_{\mathcal G}\to L^0_{\mathcal G}([0,+\infty])α:PG​→LG0​([0,+∞]) with

ρ(X)=ess.sup⁡Q∈PG{−EQ(X∣G)−α(Q)},X∈L∞.\rho(X)=\operatorname*{ess.sup}_{Q\in\mathcal P_{\mathcal G}}\{-E_Q(X\mid\mathcal G)-\alpha(Q)\},\qquad X\in L^\infty .ρ(X)=Q∈PG​ess.sup​{−EQ​(X∣G)−α(Q)},X∈L∞.

The minimal penalty is α∗(Q)=ess.sup⁡X∈L∞{−EQ(X∣G)−ρ(X)}\alpha^*(Q)=\operatorname{ess.sup}_{X\in L^\infty}\{-E_Q(X\mid\mathcal G)-\rho(X)\}α∗(Q)=ess.supX∈L∞​{−EQ​(X∣G)−ρ(X)}. ρ\rhoρ is continuous from above if Xn↘XX_n\searrow XXn​↘X PPP-a.s. implies ρ(Xn)↗ρ(X)\rho(X_n)\nearrow\rho(X)ρ(Xn​)↗ρ(X) PPP-a.s.

Formalization targets

Goal: Theorem 3.2

For a conditional convex risk measure ρ\rhoρ, the following are equivalent:

(a) ρ continuous from above  ⟺  (b) ρ representable  ⟺  (c) ρ(X)=ess.sup⁡Q∈PG{−EQ(X∣G)−α∗(Q)}.\text{(a) } \rho \text{ continuous from above}\iff\text{(b) } \rho\text{ representable}\iff\text{(c) } \rho(X)=\operatorname*{ess.sup}_{Q\in\mathcal P_{\mathcal G}}\{-E_Q(X\mid\mathcal G)-\alpha^*(Q)\}.(a) ρ continuous from above⟺(b) ρ representable⟺(c) ρ(X)=Q∈PG​ess.sup​{−EQ​(X∣G)−α∗(Q)}.

Milestones

  • Theorem A.1: existence and a.s. uniqueness of the essential supremum; an increasing sequence converging to it for upward directed families.
  • Lemma A.2: EP(ess.sup⁡X)=sup⁡X∈XEPXE_P(\operatorname{ess.sup}\mathcal X)=\sup_{X\in\mathcal X}E_PXEP​(ess.supX)=supX∈X​EP​X for upward directed X\mathcal XX.
  • The easy inequality ρ(X)≥ess.sup⁡Q{−EQ(X∣G)−α∗(Q)}\rho(X)\ge\operatorname{ess.sup}_{Q}\{-E_Q(X\mid\mathcal G)-\alpha^*(Q)\}ρ(X)≥ess.supQ​{−EQ​(X∣G)−α∗(Q)}.
  • The unconditional representation (Föllmer–Schied, Theorem 4.26) of a convex risk measure ρ0:L∞→R\rho_0:L^\infty\to\mathbb Rρ0​:L∞→R continuous from above: ρ0(X)=sup⁡Q≪P{−EQX−α0∗(Q)}\rho_0(X)=\sup_{Q\ll P}\{-E_QX-\alpha^*_0(Q)\}ρ0​(X)=supQ≪P​{−EQ​X−α0∗​(Q)}.
  • For ρ0=EP[ρ(⋅)]\rho_0=E_P[\rho(\cdot)]ρ0​=EP​[ρ(⋅)]: α0∗(Q)<∞\alpha^*_0(Q)<\inftyα0∗​(Q)<∞ forces Q∈PGQ\in\mathcal P_{\mathcal G}Q∈PG​.
  • The family BQ={−EQ(X∣G)−ρ(X):X∈L∞}B_Q=\{-E_Q(X\mid\mathcal G)-\rho(X):X\in L^\infty\}BQ​={−EQ​(X∣G)−ρ(X):X∈L∞} is upward directed.
  • EP[α∗(Q)]=α0∗(Q)E_P[\alpha^*(Q)]=\alpha^*_0(Q)EP​[α∗(Q)]=α0∗​(Q) for Q∈PGQ\in\mathcal P_{\mathcal G}Q∈PG​.
  • Representable implies continuous from above.
  • Remark 3.3: α∗≤α\alpha^*\le\alphaα∗≤α for every penalty α\alphaα, and α∗(Q)=ess.sup⁡X∈Aρ{−EQ(X∣G)}\alpha^*(Q)=\operatorname{ess.sup}_{X\in\mathcal A_\rho}\{-E_Q(X\mid\mathcal G)\}α∗(Q)=ess.supX∈Aρ​​{−EQ​(X∣G)}.

Significance

The result. Theorem 3.2 shows that a conditional convex risk measure is determined by a random penalty on the models consistent with the available information, exactly when it satisfies a sequential continuity condition. The representation is the input for the paper's later sections: the conditional entropic risk measure, whose minimal penalty is the conditional relative entropy, and the consistency of dynamic risk measures via Lemma 3.4, which is expressed through the minimal penalty. The restriction to PG\mathcal P_{\mathcal G}PG​ has an interpretation: the more information, the fewer models can enter the worst case.

Formalizing it. The theorem has been proved in the literature since 2005; to our knowledge neither it nor its unconditional counterpart has a machine-checked proof. The mission produces an essential supremum of arbitrary families of extended random variables with its existence theorem, the exchange of expectation and essential supremum for directed families, and the unconditional Föllmer–Schied representation on L∞L^\inftyL∞. The last of these is the standard representation theorem of the theory of convex risk measures and is useful well beyond this paper.

Difficulty

The obvious route, applying the unconditional representation pathwise or ω\omegaω by ω\omegaω, fails: ρ(X)(ω)\rho(X)(\omega)ρ(X)(ω) is not a risk measure of anything, and conditional expectations are only defined up to null sets that depend on QQQ, of which there are uncountably many. The essential supremum is what turns an uncountable supremum of classes into a well-defined class, and passing expectations through it requires directedness. The unconditional step itself (continuity from above implies the dual representation) rests on a Krein–Šmulian / weak* closedness argument on L∞L^\inftyL∞, which is not available off the shelf.

Formalization scope

  • Payoffs are real functions Ω→R\Omega\to\mathbb RΩ→R with MemLp X ⊤ P; ρ\rhoρ is a map (Ω→R)→(Ω→R)(\Omega\to\mathbb R)\to(\Omega\to\mathbb R)(Ω→R)→(Ω→R) constrained only on L∞L^\inftyL∞. Because it acts on functions, ρ\rhoρ is required to respect PPP-a.s. equality, and ρ(X)\rho(X)ρ(X) is required to be G\mathcal GG-strongly measurable and essentially bounded; the paper's ρ\rhoρ acts on classes, so this adds nothing in substance. G\mathcal GG is a MeasurableSpace m with m ≤ mΩ.
  • Translation invariance and convexity quantify over G\mathcal GG-measurable ZZZ and Λ\LambdaΛ (not constants). PG\mathcal P_{\mathcal G}PG​ is the subtype of probability measures Q≪PQ\ll PQ≪P with Q(A)=P(A)Q(A)=P(A)Q(A)=P(A) for all A∈GA\in\mathcal GA∈G — equality on G\mathcal GG, not mutual absolute continuity.
  • EQ(X∣G)E_Q(X\mid\mathcal G)EQ​(X∣G) is Mathlib's Q[X | m]; it is G\mathcal GG-measurable, hence determined PPP-a.s. for Q∈PGQ\in\mathcal P_{\mathcal G}Q∈PG​.
  • Extended values live in EReal; penalties are ENNReal-valued and coerced, so only (real) −(+∞)=−∞-(+\infty)=-\infty−(+∞)=−∞ occurs, never +∞−(+∞)+\infty-(+\infty)+∞−(+∞).
  • The essential supremum is a predicate IsEssSup P F Z (a.e. upper bound of every member, a.e. below every a.e.-measurable a.e. upper bound). The minimal penalty is a predicate IsMinimalPenalty on a candidate; statement (c) of the goal asserts that a G\mathcal GG-measurable [0,+∞][0,+\infty][0,+∞]-valued essential supremum of BQB_QBQ​ is a penalty for ρ\rhoρ.
  • Continuity from above: Xn,X∈L∞X_n,X\in L^\inftyXn​,X∈L∞, (Xn)(X_n)(Xn​) a.s. non-increasing and a.s. convergent to XXX implies (ρ(Xn))(\rho(X_n))(ρ(Xn​)) a.s. non-decreasing and a.s. convergent to ρ(X)\rho(X)ρ(X). It is not norm or weak* continuity.
  • Lemma A.2's "provided the expectations exist" is pinned as: each member has an expectation in [−∞,+∞][-\infty,+\infty][−∞,+∞] and some member has integrable negative part (without the latter the lemma is false). Theorem A.1's directed part assumes a nonempty family. The acceptance set of Remark 3.3 is {X∈L∞:ρ(X)≤0}\{X\in L^\infty:\rho(X)\le0\}{X∈L∞:ρ(X)≤0} (the paper's LG∞L^\infty_{\mathcal G}LG∞​ on p. 4 is a misprint).
  • Ruled out: an essential supremum defined as a pointwise ⨆ over the family, or via Mathlib's essSup of a single function, and an index set equal to all Q≪PQ\ll PQ≪P or to the QQQ equivalent to PPP; each of these changes statement (b) or makes it vacuous.
  • Needed infrastructure: essential suprema of families, extended expectations with monotone convergence, conditional expectation under a change of measure agreeing on G\mathcal GG, and the L∞L^\inftyL∞–L1L^1L1 duality behind Föllmer–Schied 4.26. The essential-supremum layer and the unconditional representation are reusable in any mission on risk measures or robust optimization; contributions to either are welcome.

Selected references

  • K. Detlefsen, G. Scandolo, Conditional and Dynamic Convex Risk Measures, SFB 649 Discussion Paper 2005-006, Humboldt-Universität zu Berlin, 2005 (the version formalized here; journal version: Finance and Stochastics 9(4), 539–561, 2005, https://doi.org/10.1007/s00780-005-0159-6)
  • H. Föllmer, A. Schied, Stochastic Finance — An Introduction in Discrete Time, de Gruyter Studies in Mathematics 27, 2002. https://doi.org/10.1515/9783110198065
  • H. Föllmer, A. Schied, Convex measures of risk and trading constraints, Finance and Stochastics 6(4), 429–447, 2002. https://doi.org/10.1007/s007800200072
  • M. Frittelli, E. Rosazza Gianin, Putting order in risk measures, Journal of Banking and Finance 26, 1473–1486, 2002. https://doi.org/10.1016/S0378-4266(02)00270-4
  • P. Artzner, F. Delbaen, J.-M. Eber, D. Heath, Coherent measures of risk, Mathematical Finance 9(3), 203–228, 1999. https://doi.org/10.1111/1467-9965.00068
  • F. Delbaen, Coherent risk measures on general probability spaces, in Advances in Finance and Stochastics, Springer, 2002. https://doi.org/10.1007/978-3-662-04790-3_1
14 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Exit Problems for Spectrally Negative Lévy Processes and Applications to (Canadized) Russian Options I: Joint Laplace Transform of the Exit Time and Exit Position of the Reflected ProcessResearch Paper

Motivation

A spectrally negative Lévy process is a process with stationary independent increments whose jumps are all downward: Brownian motion with drift plus a compound Poisson or infinite-activity stream of negative jumps. It is the standard model for a risk reserve that earns premiums continuously and pays claims in lumps, for a storage level or a queue workload seen in reverse, and, in mathematical finance, for a log-price that can crash but not jump up. Exit problems (when and where such a process first leaves an interval) are the basic quantities in ruin theory, in dividend and barrier problems, and in the pricing of path-dependent options.

The reflected process Y=X‾−XY=\overline X-XY=X−X, the distance of XXX below its running maximum, is the drawdown of XXX. Its first passage above a level kkk is the time at which a drawdown of size kkk first occurs. Avram, Kyprianou and Pistorius (AKP 2004) computed the joint Laplace transform of this passage time and of the overshoot YτkY_{\tau_k}Yτk​​ in closed form, in terms of the scale functions of XXX. This is the first of three missions on that paper. The two others use this identity for the perpetual Russian option and its Canadized version.

Timeline. Bertoin gave the upward two-sided exit identity for spectrally negative Lévy processes in terms of scale functions (Bertoin 1996, Theorem VII.8) and the downward one (Bertoin 1997, Corollary 1). Avram, Kyprianou and Pistorius (2004) obtained the joint transform of (τk,Yτk)(\tau_k,Y_{\tau_k})(τk​,Yτk​​) for every spectrally negative Lévy process of unbounded variation, or of bounded variation with absolutely continuous Lévy measure.

Setting

Let X={Xt,t≥0}X=\{X_t,t\ge0\}X={Xt​,t≥0} be a spectrally negative Lévy process on (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P): it starts at 000, has independent and stationary increments, càdlàg paths, no positive jumps, and paths that are not monotone. Its Laplace exponent is ψ(θ)=log⁡E[eθX1]\psi(\theta)=\log\mathbb E[e^{\theta X_1}]ψ(θ)=logE[eθX1​], and "ψ(v)<∞\psi(v)<\inftyψ(v)<∞" means that evX1e^{vX_1}evX1​ is integrable. For such vvv, the tilted exponent is ψv(θ)=ψ(θ+v)−ψ(v)\psi_v(\theta)=\psi(\theta+v)-\psi(v)ψv​(θ)=ψ(θ+v)−ψ(v).

The paper assumes throughout that XXX has unbounded variation, or has bounded variation and a Lévy measure Λ\LambdaΛ with Λ(dx)≪dx\Lambda(dx)\ll dxΛ(dx)≪dx.

For q≥0q\ge0q≥0, Φ(q)\Phi(q)Φ(q) is the largest root of ψ(θ)=q\psi(\theta)=qψ(θ)=q. The qqq-scale function W(q):R→[0,∞)W^{(q)}:\mathbb R\to[0,\infty)W(q):R→[0,∞) is the unique function that vanishes on (−∞,0](-\infty,0](−∞,0], is continuous on (0,∞)(0,\infty)(0,∞), and satisfies

∫0∞e−θxW(q)(x) dx=1ψ(θ)−q,θ>Φ(q).\int_0^\infty e^{-\theta x}W^{(q)}(x)\,dx=\frac1{\psi(\theta)-q},\qquad\theta>\Phi(q).∫0∞​e−θxW(q)(x)dx=ψ(θ)−q1​,θ>Φ(q).

For q<0q<0q<0 it is defined by the series W(q)=∑k≥0qkW⋆(k+1)W^{(q)}=\sum_{k\ge0}q^kW^{\star(k+1)}W(q)=∑k≥0​qkW⋆(k+1), where W=W(0)W=W^{(0)}W=W(0) and ⋆\star⋆ is convolution on [0,∞)[0,\infty)[0,∞). Further, Z(q)(x)=1+q∫−∞xW(q)(z) dzZ^{(q)}(x)=1+q\int_{-\infty}^xW^{(q)}(z)\,dzZ(q)(x)=1+q∫−∞x​W(q)(z)dz. The functions Wv(p)W_v^{(p)}Wv(p)​ and Zv(p)Z_v^{(p)}Zv(p)​ are the same objects built from ψv\psi_vψv​ instead of ψ\psiψ.

Under Ps,x\mathbb P_{s,x}Ps,x​ the process starts at xxx with a prior maximum s≥xs\ge xs≥x. Its running maximum is X‾t=max⁡{s,sup⁡0≤u≤tXu}\overline X_t=\max\{s,\sup_{0\le u\le t}X_u\}Xt​=max{s,sup0≤u≤t​Xu​}, and the reflected process is Y=X‾−XY=\overline X-XY=X−X, which starts at z=s−xz=s-xz=s−x. For k>0k>0k>0,

τk=inf⁡{t≥0:Yt∉[0,k)}.\tau_k=\inf\{t\ge0:Y_t\notin[0,k)\}.τk​=inf{t≥0:Yt​∈/[0,k)}.

Formalization targets

Goal: Theorem 1

For u≥0u\ge0u≥0 and vvv with ψ(v)<∞\psi(v)<\inftyψ(v)<∞, with z=s−x≥0z=s-x\ge0z=s−x≥0 and p=u−ψ(v)p=u-\psi(v)p=u−ψ(v),

Es,x[e−uτk−vYτk]=e−vz(Zv(p)(k−z)−Wv(p)(k−z)pWv(p)(k)+vZv(p)(k)Wv(p)′(k)+vWv(p)(k)).\mathbb E_{s,x}\big[e^{-u\tau_k-vY_{\tau_k}}\big]=e^{-vz}\left(Z_v^{(p)}(k-z)-W_v^{(p)}(k-z)\frac{pW_v^{(p)}(k)+vZ_v^{(p)}(k)}{W_v^{(p)\prime}(k)+vW_v^{(p)}(k)}\right).Es,x​[e−uτk​−vYτk​​]=e−vz(Zv(p)​(k−z)−Wv(p)​(k−z)Wv(p)′​(k)+vWv(p)​(k)pWv(p)​(k)+vZv(p)​(k)​).

Here vvv may be negative, so ppp may be negative, which is where the series extension of WWW enters.

Milestones

  • (2) E[eθXt]=etψ(θ)\mathbb E[e^{\theta X_t}]=e^{t\psi(\theta)}E[eθXt​]=etψ(θ).
  • Remark 4: W(u)(x)=evxWv(u−ψ(v))(x)W^{(u)}(x)=e^{vx}W_v^{(u-\psi(v))}(x)W(u)(x)=evxWv(u−ψ(v))​(x) for every real uuu.
  • Proposition 1, (9) and (10): for x∈(a,b)x\in(a,b)x∈(a,b), the Laplace transforms of the exit time of XXX from (a,b)(a,b)(a,b) on the events of exit above and exit below.
  • (13): the splitting of the goal's expectation at the first zero of YYY.
  • (14)–(15) and (16): the two expectations of (13).
  • (22): the value CCC of the functional for YYY started at 000.
  • Remark 6, (23): the stopped process whose martingale property is equivalent to Theorem 1.

Items (13)–(22) are stated under the proof's restriction u≥ψ(v)∨0u\ge\psi(v)\vee0u≥ψ(v)∨0. The goal is not.

Significance

The identity gives, for every spectrally negative Lévy process, the law of the first drawdown of size kkk and of its overshoot. With v=0v=0v=0 it is the Laplace transform of the drawdown time. With u=0u=0u=0 it is the transform of the overshoot. The paper uses it, through its Corollary 1, to solve the perpetual Russian option and the Canadized Russian option in closed form. Identities of this form, written in scale functions, are the standard tool for drawdown and reflected-process problems for spectrally negative Lévy processes.

The theorem is proved. As far as the platform and Mathlib show, none of it is formalized: Mathlib has independent increments and cumulant generating functions but no Lévy process, no scale function and no excursion theory. This mission produces a formal statement of the paper's model and of the exit identities. A complete development would also give Mathlib its first fluctuation-theory results for Lévy processes.

Difficulty

The natural first idea is to treat YYY like XXX and read off its exit from [0,k)[0,k)[0,k) from the two-sided exit identities of Proposition 1. This works only until YYY first returns to 000. Up to that time YYY is a copy of −X-X−X. After it, YYY is reflected at 000, it is not a Lévy process, and no two-sided exit problem of XXX describes it. The whole content of the theorem is the constant CCC of (13), the value of the functional for YYY started at 000, where the reflection acts at every instant. A second difficulty is the range of (u,v)(u,v)(u,v). For v<0v<0v<0 the integrand e−vYτke^{-vY_{\tau_k}}e−vYτk​​ is unbounded, because YYY can jump far above kkk. Its finiteness is part of the claim. So is the passage from the region u≥ψ(v)∨0u\ge\psi(v)\vee0u≥ψ(v)∨0, where every scale function in (12) comes from Definition 2, to all u≥0u\ge0u≥0, where ppp can be negative.

Formalization scope

Time is [0,∞)[0,\infty)[0,∞) (ℝ≥0). XXX is a real process with X0=0X_0=0X0​=0. Px\mathbb P_xPx​ is encoded by the path x+Xx+Xx+X, and Ps,x\mathbb P_{s,x}Ps,x​ by that path together with the prior maximum sss. Random times take values in WithTop ℝ≥0, with ∞\infty∞ as "never". The functional e−uτk−vYτke^{-u\tau_k-vY_{\tau_k}}e−uτk​−vYτk​​ and discount factors e−qTe^{-qT}e−qT are set to 000 where the time is infinite. Every stated expectation carries its integrability as part of the conclusion.

Readings of the paper's informal words:

  • "Lévy process": the paths start at 000, are càdlàg and have no positive jumps for every ω\omegaω, not only almost surely.
  • "We exclude the case that X has monotone paths": the paths are neither almost surely nondecreasing nor almost surely nonincreasing.
  • "unbounded variation": not of bounded variation. The standing assumption is "bounded variation implies (AC)".
  • "Λ(dx)≪dx\Lambda(dx)\ll dxΛ(dx)≪dx": for every Lebesgue-null Borel AAA, almost surely no nonzero jump in (0,1](0,1](0,1] lands in AAA. The Lévy measure is not constructed.
  • "ψ(v)<∞\psi(v)<\inftyψ(v)<∞": evX1e^{vX_1}evX1​ is integrable.
  • "the largest root": the supremum of the nonnegative roots.
  • "the unique function": a definite description by choice.
  • "analytic extension": the series (5) for real negative index. Complex indices are out of scope.
  • "W′W'W′": the derivative at k>0k>0k>0.
  • "is a martingale" in (23): a martingale for the natural filtration of XXX.
  • Misprint: (23) prints vZv(q)(k)vZ_v^{(q)}(k)vZv(q)​(k), and the statement uses vZv(p)(k)vZ_v^{(p)}(k)vZv(p)​(k).

The scale functions are defined from the exponent ψ\psiψ of the given XXX. A formalization in which WWW is an arbitrary function satisfying a Laplace-transform hypothesis is ruled out. So is one in which Wv(p)W_v^{(p)}Wv(p)​ is defined as e−vxW(p+ψ(v))(x)e^{-vx}W^{(p+\psi(v))}(x)e−vxW(p+ψ(v))(x), which would make Remark 4 a tautology.

Infrastructure a complete development needs: Lévy processes and their Laplace exponent, the strong Markov property at stopping times, existence and regularity of scale functions (via Laplace inversion), and the Esscher change of measure. No statement of the mission mentions excursion theory. Contributions of reusable infrastructure for Lévy processes are welcome.

Selected references

  • F. Avram, A. E. Kyprianou, M. R. Pistorius, Exit problems for spectrally negative Lévy processes and applications to (Canadized) Russian options, Ann. Appl. Probab. 14(1), 215–238, 2004. https://doi.org/10.1214/aoap/1075828052
  • J. Bertoin, Lévy Processes, Cambridge University Press, 1996. https://www.cambridge.org/core/books/levy-processes/
  • J. Bertoin, Exponential decay and ergodicity of completely asymmetric Lévy processes in a finite interval, Ann. Appl. Probab. 7(1), 156–169, 1997. https://doi.org/10.1214/aoap/1034625254
16 thms2 active usersReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Subjectivity and Correlation in Randomized Strategies II: Subjective Events Let Both Zero-Sum Players Beat the ValueResearch Paper

Motivation

In a two-person zero-sum game with objective randomization, whatever one player gains the other loses: the value vvv of the game is the most player 1 can guarantee and the least player 2 can hold him to, and no arrangement between the players can give player 1 more than vvv and player 2 more than −v-v−v at the same time. Aumann's 1974 paper (doi:10.1016/0304-4068(74)90037-8) replaces objective coin flips by ordinary events of the world, about which players may hold different subjective probabilities and may be differently informed. Sect. 6 of the paper shows that this breaks the zero-sum logic: once the players disagree about the probability of events they can observe, a zero-sum game becomes, in expectation as each player computes it, a game in which both can gain.

The phenomenon is the game-theoretic form of betting between people who disagree: two players with different beliefs can each expect to profit from the same wager. Aumann's proposition identifies exactly what information structure makes such an agreement possible inside a given zero-sum game, and shows by an example that informing only one player of a subjective event is not enough. The same paper introduced correlated equilibrium; the companion mission of this series formalizes its two-person result on subjective mixed equilibria (Proposition 5.1).

Setting

A game has a finite set N={1,…,n}N=\{1,\dots,n\}N={1,…,n} of players, a finite set SiS_iSi​ of pure strategies for each player, a finite set XXX of outcomes and an outcome function ggg from S=×i∈NSiS=\times_{i\in N}S_iS=×i∈N​Si​ onto XXX. Player iii has a utility ui:X→Ru_i:X\to\mathbb Rui​:X→R; write hi(a)=ui(g(a))h_i(a)=u_i(g(a))hi​(a)=ui​(g(a)) for a∈Sa\in Sa∈S.

A randomizing structure consists of a set Ω\OmegaΩ of states of the world with a σ\sigmaσ-field B\mathcal BB of events, a sub-σ\sigmaσ-field Ji⊆B\mathcal J_i\subseteq\mathcal BJi​⊆B for each player (the events regarding which iii is informed), and a probability measure pip_ipi​ on B\mathcal BB for each player (the subjective probability of iii). A strategy of iii is a map si:Ω→Sis_i:\Omega\to S_isi​:Ω→Si​ whose level sets lie in Ji\mathcal J_iJi​. For a profile sss of strategies, player iii's payoff is computed under his own beliefs:

Hi(s)=∫Ωhi(s(ω)) dpi(ω).H_i(s)=\int_\Omega h_i\big(s(\omega)\big)\,dp_i(\omega).Hi​(s)=∫Ω​hi​(s(ω))dpi​(ω).

An event AAA is objective if all pi(A)p_i(A)pi​(A) coincide, and subjective otherwise. It is iii-secret if A∈JiA\in\mathcal J_iA∈Ji​ and every other player jjj regards AAA as independent of every event in the σ\sigmaσ-field generated by the Jk\mathcal J_kJk​, k≠ik\ne ik=i. It is public if it lies in every Ji\mathcal J_iJi​. A measure is non-atomic on a σ\sigmaσ-field R\mathcal RR if every event of R\mathcal RR of positive measure contains an event of R\mathcal RR of strictly smaller positive measure; a roulette is a sub-σ\sigmaσ-field of B\mathcal BB on which every pjp_jpj​ is non-atomic, and a public roulette is a roulette of public events. Throughout, Assumption II holds: every player iii has a σ\sigmaσ-field Ri\mathcal R_iRi​ of iii-secret events on which every pjp_jpj​ is non-atomic.

The game is two-person zero-sum if n=2n=2n=2 and u1(x)+u2(x)=0u_1(x)+u_2(x)=0u1​(x)+u2​(x)=0 for all x∈Xx\in Xx∈X. Its value vvv is player 1's payoff F1(σ)=∑a∈Sh1(a)σ1(a1)σ2(a2)F_1(\sigma)=\sum_{a\in S}h_1(a)\sigma_1(a_1)\sigma_2(a_2)F1​(σ)=∑a∈S​h1​(a)σ1​(a1​)σ2​(a2​) at a Nash equilibrium σ\sigmaσ of the classical mixed extension; by the minimax theorem all such equilibria give the payoff pair (v,−v)(v,-v)(v,−v).

Formalization targets

Goal: Proposition 6.1 (p. 80)

Let GGG be a two-person zero-sum game with value vvv, and assume

∃ x,y∈X: u1(x)>v>u1(y),(6.2)\exists\,x,y\in X:\ u_1(x)>v>u_1(y),\tag{6.2}∃x,y∈X: u1​(x)>v>u1​(y),(6.2) for each i∈{1,2} there is Bi∈Ji with p1(Bi)≠p2(Bi).(6.3)\text{for each } i\in\{1,2\} \text{ there is } B_i\in\mathcal J_i \text{ with } p_1(B_i)\ne p_2(B_i).\tag{6.3}for each i∈{1,2} there is Bi​∈Ji​ with p1​(Bi​)=p2​(Bi​).(6.3)

Then there is a pair s=(s1,s2)s=(s_1,s_2)s=(s1​,s2​) of strategies with

H1(s)>v,H2(s)>−v.(6.4)H_1(s)>v,\qquad H_2(s)>-v.\tag{6.4}H1​(s)>v,H2​(s)>−v.(6.4)

The pair is not an equilibrium: it is an agreement that each player, by his own beliefs, strictly prefers to playing the game.

Milestones

  1. Lemma 7.1 (p. 81): in a roulette R\mathcal RR there is, for every α∈[0,1]\alpha\in[0,1]α∈[0,1] and events B1,…,BlB^1,\dots,B^lB1,…,Bl, an objective event A∈RA\in\mathcal RA∈R with p(A)=αp(A)=\alphap(A)=α, independent of each BkB^kBk.
  2. Lemma 4.2 (p. 77): for every iii, event BBB and α∈[0,1]\alpha\in[0,1]α∈[0,1] there is an objective iii-secret event of probability α\alphaα independent of BBB.
  3. Lemma 4.4 (p. 77): if there is a public roulette, the same holds with "public" in place of "iii-secret".
  4. Remark after Proposition 6.1 (p. 80): the conclusion (6.4) under (6.2) and
there is a public subjective event B and there is a public roulette,(6.5)\text{there is a public subjective event } B \text{ and there is a public roulette,}\tag{6.5}there is a public subjective event B and there is a public roulette,(6.5)

a special case of the goal in which the players share both the subjective event and the correlating device.

Significance

The proposition shows that the value of a zero-sum game is a property of objective randomization, not of the game alone. With subjective randomization available to both players, the conflict of a zero-sum game can be resolved by agreement, so the classical prediction (each player receives his security level) is not robust to disagreement about probabilities. The counterexample on p. 81 (the game with matrix rows (1,1)(1,1)(1,1) and (2,0)(2,0)(2,0)) shows that hypothesis (6.3) is needed for both players, and the paper notes that in any specific game only one player need use a subjective strategy, though which one depends on the game.

Lemmas 4.2, 4.4 and 7.1 are the model's basic existence results for objective randomization: every probability can be realised by an event that is secret (or public) and independent of finitely many given events. They are used throughout the paper, including in the companion mission.

The paper's proofs are published and accepted; none of these statements has a machine-checked proof. This mission produces the formal statements and invites complete proofs; Lemma 7.1 requires Lyapunov's convexity theorem for finite-dimensional non-atomic vector measures, which is not in Mathlib.

Difficulty

The central difficulty for the goal is that (6.3) gives each player only some subjective event, of unknown size and in his own information field, while (6.4) requires strict gains for both players under two different measures at once. The obvious approach, betting on one subjective event, gives one player a strict gain but, when that event is not known to the other player, the other player cannot condition his choice on it; the example on p. 81 shows that one-sided information genuinely fails. Both inequalities must be arranged simultaneously, and the strategies must remain measurable with respect to each player's own information.

For Lemma 7.1, a non-atomic scalar measure takes every value in [0,p(Ω)][0,p(\Omega)][0,p(Ω)], but the lemma asks for one event with prescribed values under nnn measures and nlnlnl further measures simultaneously; this is the range of a vector measure, not of a scalar one.

Formalization scope

  • Players of the zero-sum game are 0, 1 : Fin 2 (the paper's 1, 2). S 0, S 1, X are finite types and g is surjective.
  • B\mathcal BB is the σ-field mΩ, an explicit parameter of RandomizingStructure; Ji\mathcal J_iJi​ are σ-fields below it, and each pip_ipi​ is a probability measure on B\mathcal BB. Probabilities are ℝ≥0∞-valued; "probability α\alphaα" is ENNReal.ofReal α with 0≤α≤10\le\alpha\le10≤α≤1.
  • Non-atomicity is the standard notion on a sub-σ-field, not Mathlib's NoAtoms, which would trivialize the roulette hypotheses.
  • HiH_iHi​ is a Bochner integral under pip_ipi​; for strategies with finitely many values it is the finite sum ∑api{s=a}hi(a)\sum_a p_i\{s=a\}h_i(a)∑a​pi​{s=a}hi​(a).
  • The value vvv is not a free real: IsValue u g v requires v=F1(σ)v=F_1(\sigma)v=F1​(σ) for a Nash equilibrium σ\sigmaσ of the mixed extension (AGT.IsMixedNash from the published definition agt_games). A free vvv would make the goal false. The minimax theorem is the published AGT.zero_sum_minimax.
  • Assumption II is a hypothesis of every theorem, including those whose proofs do not need it.
  • The conclusion of the goal and of the Remark asks for strategies, not for an equilibrium point, and does not require the strategies to be independent or objective.

Needed infrastructure: Lyapunov's theorem (or a direct argument for the finite-dimensional case), manipulation of σ-fields generated by families of sub-σ-fields, and computation of HiH_iHi​ for strategies with finitely many values. Lyapunov's theorem is reusable far beyond this mission. Contributions of any milestone are welcome.

Selected references

  • R. J. Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathematical Economics 1 (1974) 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • A. Lyapunov, Sur les fonctions-vecteurs complètement additives, Bull. Acad. Sci. URSS Sér. Math. 4 (1940) 465–478.
  • J. von Neumann, Zur Theorie der Gesellschaftsspiele, Mathematische Annalen 100 (1928) 295–320. https://doi.org/10.1007/BF01448847
  • J. Nash, Non-cooperative games, Annals of Mathematics 54 (1951) 286–295. https://doi.org/10.2307/1969529
9 thms2 active usersReviewed
Bandit AlgorithmsMachine LearningStatistics·Captain: mikedeng1

Online Decision Making with High-Dimensional Covariates: Regret Bound of the LASSO BanditResearch Paper

Motivation

Many sequential decisions are personalised: a physician chooses a drug dose for each arriving patient, a platform chooses which offer to show each arriving user. Each decision is made after observing a vector of covariates describing the individual, and its outcome is observed only for the option chosen. This is the contextual (covariate) bandit problem, studied in operations research and machine learning since Auer (JMLR 2002) and Goldenshluger and Zeevi (Stochastic Systems 2013).

In medical and e-commerce applications the covariate vector is often high-dimensional: the number of covariates ddd is comparable to or larger than the number of decisions that will ever be made, while the outcome of each option depends on a few of them. Low-dimensional bandit algorithms then incur regret that grows polynomially with ddd. Bastani and Bayati (Operations Research 2020) proposed the LASSO Bandit, which estimates each option's reward model with the LASSO, and proved a regret bound that grows only logarithmically in ddd. The paper evaluates the method on warfarin dosing data.

Timeline:

  • 2002–2003: Auer introduces linear-reward contextual bandits with confidence bounds.
  • 2013: Goldenshluger and Zeevi give a forced-sampling algorithm for two arms in low dimension with O(log⁡T)O(\log T)O(logT) regret under a margin condition and an arm-optimality condition, and an information-theoretic lower bound of the same order.
  • 2020: Bastani and Bayati extend the forced-sampling scheme to KKK arms and high-dimensional sparse parameters, with regret O(s02[log⁡T+log⁡d]2)O(s_0^2[\log T+\log d]^2)O(s02​[logT+logd]2).

Setting

There are KKK arms with unknown parameters β1,…,βK∈Rd\beta_1,\dots,\beta_K\in\mathbb R^dβ1​,…,βK​∈Rd. At each time t=1,2,…,Tt=1,2,\dots,Tt=1,2,…,T a covariate vector Xt∈RdX_t\in\mathbb R^dXt​∈Rd arrives; the XtX_tXt​ are i.i.d. with law PX\mathcal P_XPX​ and take values in a fixed set X\mathcal XX. If arm iii is pulled, the reward is Xt⊤βi+εi,tX_t^\top\beta_i+\varepsilon_{i,t}Xt⊤​βi​+εi,t​, where the noises εi,t\varepsilon_{i,t}εi,t​ are independent, σ\sigmaσ-subgaussian (E[esε]≤eσ2s2/2\mathbb E[e^{s\varepsilon}]\le e^{\sigma^2s^2/2}E[esε]≤eσ2s2/2 for all sss), and independent of the covariates. A policy chooses the arm πt\pi_tπt​ from XtX_tXt​ and the past covariates, arms and observed rewards. Its cumulative expected regret is

RT=∑t=1TE[max⁡jXt⊤βj−Xt⊤βπt].R_T=\sum_{t=1}^T\mathbb E\Big[\max_jX_t^\top\beta_j-X_t^\top\beta_{\pi_t}\Big].RT​=t=1∑T​E[jmax​Xt⊤​βj​−Xt⊤​βπt​​].

The sparsity s0s_0s0​ is the smallest integer s0≥1s_0\ge1s0​≥1 with ∥βi∥0≤s0\|\beta_i\|_0\le s_0∥βi​∥0​≤s0​ for all iii.

The four assumptions are: (1) ∥x∥∞≤xmax⁡\|x\|_\infty\le x_{\max}∥x∥∞​≤xmax​ on X\mathcal XX and ∥βi∥1≤b\|\beta_i\|_1\le b∥βi​∥1​≤b; (2) a margin condition Pr⁡[0<∣X⊤(βi−βj)∣≤κ]≤C0κ\Pr[0<|X^\top(\beta_i-\beta_j)|\le\kappa]\le C_0\kappaPr[0<∣X⊤(βi​−βj​)∣≤κ]≤C0​κ; (3) arm optimality: every arm is either suboptimal by a margin hhh at every covariate, or optimal by margin hhh on a region UiU_iUi​ of probability at least p∗p_*p∗​; (4) a compatibility condition: the conditional second-moment matrix Σi=E[XX⊤∣X∈Ui]\Sigma_i=\mathbb E[XX^\top\mid X\in U_i]Σi​=E[XX⊤∣X∈Ui​] of each optimal arm lies in the set C(supp(βi),ϕ0)\mathcal C(\mathrm{supp}(\beta_i),\phi_0)C(supp(βi​),ϕ0​) of matrices M⪰0M\succeq0M⪰0 with ∥vI∥12≤∣I∣ v⊤Mv/ϕ02\|v_I\|_1^2\le|I|\,v^\top Mv/\phi_0^2∥vI​∥12​≤∣I∣v⊤Mv/ϕ02​ whenever ∥vIc∥1≤3∥vI∥1\|v_{I^c}\|_1\le3\|v_I\|_1∥vIc​∥1​≤3∥vI​∥1​.

The LASSO estimator on nnn samples is any minimizer of ∥Y−Xβ′∥22/n+λ∥β′∥1\|Y-\mathbf X\beta'\|_2^2/n+\lambda\|\beta'\|_1∥Y−Xβ′∥22​/n+λ∥β′∥1​. The LASSO Bandit forces arm iii at the prescribed times Ti={(2n−1)Kq+j:n≥0, q(i−1)<j≤qi}\mathcal T_i=\{(2^n-1)Kq+j : n\ge0,\ q(i-1)<j\le qi\}Ti​={(2n−1)Kq+j:n≥0, q(i−1)<j≤qi}. At every other time it keeps the arms whose forced-sample estimate β^(Ti,t−1,λ1)\hat\beta(\mathcal T_{i,t-1},\lambda_1)β^​(Ti,t−1​,λ1​) is within h/2h/2h/2 of the best. Among them it plays the arm with the largest all-sample estimate β^(Si,t−1,λ2,t−1)\hat\beta(\mathcal S_{i,t-1},\lambda_{2,t-1})β^​(Si,t−1​,λ2,t−1​), trained on every past pull of the arm, with λ2,t=λ2,0(log⁡t+log⁡d)/t\lambda_{2,t}=\lambda_{2,0}\sqrt{(\log t+\log d)/t}λ2,t​=λ2,0​(logt+logd)/t​.

Formalization targets

Goal: Theorem 1 (regret of the LASSO Bandit)

For q≥4⌈q0⌉q\ge4\lceil q_0\rceilq≥4⌈q0​⌉, K≥2K\ge2K≥2, d>2d>2d>2, T≥C5T\ge C_5T≥C5​, λ1=ϕ02p∗h/(64s0xmax⁡)\lambda_1=\phi_0^2p_*h/(64s_0x_{\max})λ1​=ϕ02​p∗​h/(64s0​xmax​) and λ2,0=[ϕ02/(2s0)]1/(p∗C1)\lambda_{2,0}=[\phi_0^2/(2s_0)]\sqrt{1/(p_*C_1)}λ2,0​=[ϕ02​/(2s0​)]1/(p∗​C1​)​,

RT≤C3(log⁡T)2+[2Kbxmax⁡(6q+4)+C3log⁡d]log⁡T+(2bxmax⁡C5+2Kbxmax⁡+C4),R_T\le C_3(\log T)^2+\big[2Kbx_{\max}(6q+4)+C_3\log d\big]\log T+\big(2bx_{\max}C_5+2Kbx_{\max}+C_4\big),RT​≤C3​(logT)2+[2Kbxmax​(6q+4)+C3​logd]logT+(2bxmax​C5​+2Kbxmax​+C4​),

with the explicit constants C1,…,C5C_1,\dots,C_5C1​,…,C5​, q0q_0q0​ of the paper (p. 285).

Milestones

  1. Proposition 1: a LASSO tail inequality for adaptively collected rows with conditionally subgaussian noise.
  2. Lemma 1: a LASSO tail inequality when a constant fraction of the rows is i.i.d. with a compatible second-moment matrix.
  3. Proposition 2: the forced-sample estimator of an optimal arm is within h/(4xmax⁡)h/(4x_{\max})h/(4xmax​) of βi\beta_iβi​ except with probability 5/t45/t^45/t4.
  4. Proposition 3: the all-sample estimator of an optimal arm is within 16(log⁡t+log⁡d)/(p∗3C1t)16\sqrt{(\log t+\log d)/(p_*^3C_1t)}16(logt+logd)/(p∗3​C1​t)​ of βi\beta_iβi​ except with probability 2/t+2e−p∗2C22t/322/t+2e^{-p_*^2C_2^2t/32}2/t+2e−p∗2​C22​t/32.

Significance

The theorem shows that exploiting sparsity makes the regret depend on the ambient dimension only through log⁡d\log dlogd, while its dependence on the horizon is within one log⁡T\log TlogT factor of the Ω(log⁡T)\Omega(\log T)Ω(logT) lower bound known in low dimension. Proposition 1 is a LASSO oracle inequality for adapted designs, where each row may depend on earlier observations. It applies whenever a LASSO is fitted to data gathered by a feedback policy: adaptive experiments, dynamic pricing, sequential treatment assignment.

The results are proved in the paper and its online appendix; none of them has a machine-checked proof. This mission produces a formal model of the covariate bandit with a non-anticipating algorithm, a formal LASSO for adapted designs, and, when complete, a verified regret bound with every constant explicit. Proposition 1 and Lemma 1 are reusable beyond bandits.

Difficulty

The all-sample estimator is trained on the times at which the algorithm chose an arm, and those choices depend on earlier estimates. Its design rows are therefore neither independent nor identically distributed, and the standard LASSO analysis, which starts from i.i.d. rows and a restricted-eigenvalue bound on their population covariance, does not apply. The forced samples are i.i.d. but only O(log⁡t)O(\log t)O(logt) in number, too few for the log⁡t/t\sqrt{\log t/t}logt/t​ rate the regret bound needs. Controlling the compatibility constant of the adaptively selected sample covariance, and the martingale noise term, is where the naive argument breaks.

Formalization scope

Arms are Fin K (paper arm iii is i.val + 1), coordinates Fin d, times are natural numbers from 111. The model is a structure IsCovariateNoiseModel on a probability space: i.i.d. measurable covariates in a measurable set X\mathcal XX, independent subgaussian noises (Mathlib's HasSubgaussianMGF with parameter σ2\sigma^2σ2), noise independent of covariates. Assumptions 1–4 are separate predicates. ∥x∥∞\|x\|_\infty∥x∥∞​ is Mathlib's sup norm, logarithms are natural, and Σi\Sigma_iΣi​ is the uncentred conditional second moment.

The LASSO minimizer and the arg max need not be unique, so the algorithm takes a selection rule and a tie-breaking rule as parameters, and the theorems hold for all of them. Each round reads only the current covariate, the past covariates, the past arms and their observed rewards. The regret theorem and Proposition 3, whose data set Si,t\mathcal S_{i,t}Si,t​ is chosen by the algorithm, require both rules to be measurable. Otherwise the trajectory would not be a random variable, and the expectations in RTR_TRT​ could be integrals of non-measurable functions, which Lean evaluates to 000 and which would make the goal trivially true. For the same reason every assumption constant is required to be positive, and T≥C5T\ge C_5T≥C5​ is imposed on the horizon. Only the explicit inequality of Theorem 1 is stated, not the trailing O(s02[log⁡T+log⁡d]2)O(s_0^2[\log T+\log d]^2)O(s02​[logT+logd]2) or q0=O(s02log⁡d)q_0=O(s_0^2\log d)q0​=O(s02​logd). Proposition 2 is stated for optimal arms (see its note).

A complete development needs matrix concentration for bounded i.i.d. rows, the Azuma–Hoeffding inequality, and the deterministic LASSO basic inequality under a compatibility condition. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • H. Bastani and M. Bayati, Online Decision Making with High-Dimensional Covariates, Operations Research 68(1):276–294, 2020. https://doi.org/10.1287/opre.2019.1902
  • A. Goldenshluger and A. Zeevi, A Linear Response Bandit Problem, Stochastic Systems 3(1):230–261, 2013. https://doi.org/10.1287/11-SSY032
  • P. Auer, Using Confidence Bounds for Exploitation-Exploration Trade-offs, Journal of Machine Learning Research 3:397–422, 2002. https://www.jmlr.org/papers/v3/auer02a.html
  • P. Bühlmann and S. van de Geer, Statistics for High-Dimensional Data, Springer, 2011. https://doi.org/10.1007/978-3-642-20192-9
9 thms2 active usersReviewed
Algorithmic Game TheoryLinear OptimizationProbability·Captain: mikedeng1

A General Framework for the Study of Decentralized Distribution Systems: A Core Allocation Rule Whose Nash Equilibrium Is First-BestResearch Paper

Pooling inventory among independent retailers

Retailers that sell the same product can raise their joint profit by pooling: stock left over at one location is shipped to meet unmet demand at another, and stock can be held in shared warehouses until demand is known (Eppen 1979; Eppen and Schrage 1981). When the retailers are independent firms, pooling creates two questions at once. After demand is realized, the extra profit from shipping must be split in a way no group of retailers would reject. Before demand is realized, each retailer chooses its own stock, and that choice depends on how the split will be made. A split that is fair ex post may lead to stocking decisions that are poor for the system as a whole.

Anupindi, Bassok and Zemel (MSOM 2001) model the ex-post split as a cooperative game, the ex-ante stocking as a non-cooperative game, and ask whether a single allocation rule can serve both. Their framework is a standard reference for "coopetition" models in supply chains, where firms compete on stocking decisions and cooperate on redistribution.

Setting

There are retailers N={1,…,N}\mathcal N=\{1,\dots,N\}N={1,…,N} and warehouses W={1,…,W}\mathcal W=\{1,\dots,W\}W={1,…,W}. Retailer nnn has unit cost cnc_ncn​, revenue rnr_nrn​ and salvage value vnv_nvn​; warehouse www has purchasing cost cwc_wcw​ and salvage value vwv_wvw​. Shipping from location iii to retailer nnn costs ti,nt_{i,n}ti,n​ per unit, and a fraction βi,n∈[0,1]\beta_{i,n}\in[0,1]βi,n​∈[0,1] of the customers at nnn accept service from iii.

Before demand, retailer nnn chooses a position Z⃗n=(Xn,Y1,n,…,YW,n)\vec Z_n=(X_n,Y_{1,n},\dots,Y_{W,n})Zn​=(Xn​,Y1,n​,…,YW,n​): local stock XnX_nXn​ and claims Yw,nY_{w,n}Yw,n​ on warehouse stock, so warehouse www holds Yw=∑nYw,nY_w=\sum_nY_{w,n}Yw​=∑n​Yw,n​. A profile is [Z]=(Z⃗1,…,Z⃗N)[Z]=(\vec Z_1,\dots,\vec Z_N)[Z]=(Z1​,…,ZN​). Demand D⃗\vec DD is random with law μ\muμ. After demand, retailer nnn has local sales Sn=min⁡{Xn,Dn}S_n=\min\{X_n,D_n\}Sn​=min{Xn​,Dn​}, residual inventory Hn=max⁡{Xn−Dn,0}H_n=\max\{X_n-D_n,0\}Hn​=max{Xn​−Dn​,0} and residual demand En=max⁡{Dn−Xn,0}E_n=\max\{D_n-X_n,0\}En​=max{Dn​−Xn​,0}.

The snapshot allocation game SAG([Z],D⃗)([Z],\vec D)([Z],D) gives each coalition S⊆N\mathcal S\subseteq\mathcal NS⊆N the value WS∗([Z],D⃗)W^*_{\mathcal S}([Z],\vec D)WS∗​([Z],D): the optimal value of the linear program (6), which ships qi,nq_{i,n}qi,n​ units from i∈S∪Wi\in\mathcal S\cup\mathcal Wi∈S∪W to n∈Sn\in\mathcal Sn∈S at profit rn−vi−ti,nr_n-v_i-t_{i,n}rn​−vi​−ti,n​ per unit, subject to ∑nqi,n≤Hi\sum_nq_{i,n}\le H_i∑n​qi,n​≤Hi​, ∑nqw,n≤∑n∈SYw,n\sum_nq_{w,n}\le\sum_{n\in\mathcal S}Y_{w,n}∑n​qw,n​≤∑n∈S​Yw,n​ and ∑iqi,n/βi,n≤En\sum_iq_{i,n}/\beta_{i,n}\le E_n∑i​qi,n​/βi,n​≤En​. Its core is the set of allocations α\alphaα with ∑j∈Sαj≥WS∗\sum_{j\in\mathcal S}\alpha_j\ge W^*_{\mathcal S}∑j∈S​αj​≥WS∗​ for every S\mathcal SS and ∑j∈Nαj=WN∗\sum_{j\in\mathcal N}\alpha_j=W^*_{\mathcal N}∑j∈N​αj​=WN∗​ (7).

An allocation rule AR-mmm assigns surplus αnm([Z],D⃗)\alpha^m_n([Z],\vec D)αnm​([Z],D); retailer nnn earns

Pnm([Z],D⃗)=rnSn+vnHn−cnXn−∑w(cw−vw)Yw,n+αnm([Z],D⃗)(9)P^m_n([Z],\vec D)=r_nS_n+v_nH_n-c_nX_n-\sum_w(c_w-v_w)Y_{w,n}+\alpha^m_n([Z],\vec D)\qquad(9)Pnm​([Z],D)=rn​Sn​+vn​Hn​−cn​Xn​−w∑​(cw​−vw​)Yw,n​+αnm​([Z],D)(9)

and expects Jnm([Z])=ED⃗PnmJ^m_n([Z])=E_{\vec D}P^m_nJnm​([Z])=ED​Pnm​. A Nash equilibrium (10) is a profile at which no retailer gains by changing its own position. The first-best profile [Z]c∗[Z]^{c*}[Z]c∗ maximizes the expected centralized profit JNc([Z])=ED⃗PNc([Z],D⃗)J^c_{\mathcal N}([Z])=E_{\vec D}P^c_{\mathcal N}([Z],\vec D)JNc​([Z])=ED​PNc​([Z],D), where PNc=∑n[rnSn+vnHn−cnXn]−∑w(cw−vw)Yw+WN∗P^c_{\mathcal N}=\sum_n[r_nS_n+v_nH_n-c_nX_n]-\sum_w(c_w-v_w)Y_w+W^*_{\mathcal N}PNc​=∑n​[rn​Sn​+vn​Hn​−cn​Xn​]−∑w​(cw​−vw​)Yw​+WN∗​.

The fractional rule AR-f (11) pays αnf=θnPNc−[ rnSn+vnHn−cnXn−∑w(cw−vw)Yw,n]\alpha^f_n=\theta_nP^c_{\mathcal N}-[\,r_nS_n+v_nH_n-c_nX_n-\sum_w(c_w-v_w)Y_{w,n}]αnf​=θn​PNc​−[rn​Sn​+vn​Hn​−cn​Xn​−∑w​(cw​−vw​)Yw,n​] with fixed shares θn∈(0,1)\theta_n\in(0,1)θn​∈(0,1), ∑nθn=1\sum_n\theta_n=1∑n​θn​=1. The dual allocation (8) is αnd=νnHn+∑wγwYw,n+δnEn\alpha^d_n=\nu_nH_n+\sum_w\gamma_wY_{w,n}+\delta_nE_nαnd​=νn​Hn​+∑w​γw​Yw,n​+δn​En​ for optimal dual prices (ν,γ,δ)(\nu,\gamma,\delta)(ν,γ,δ) of (6) for N\mathcal NN. The modified rule AR-c is αnc([Z],D⃗)=αnf([Z],D⃗)+wn([Z]c∗,D⃗)\alpha^c_n([Z],\vec D)=\alpha^f_n([Z],\vec D)+w_n([Z]^{c*},\vec D)αnc​([Z],D)=αnf​([Z],D)+wn​([Z]c∗,D) with wn=αnd([Z]c∗,⋅)−αnf([Z]c∗,⋅)w_n=\alpha^d_n([Z]^{c*},\cdot)-\alpha^f_n([Z]^{c*},\cdot)wn​=αnd​([Z]c∗,⋅)−αnf​([Z]c∗,⋅).

Formalization targets

Goal: Corollary 5.1 (p. 361)

For a first-best profile [Z]c∗[Z]^{c*}[Z]c∗ and a measurable choice of dual prices at [Z]c∗[Z]^{c*}[Z]c∗,

[Z]c∗ is a pure Nash equilibrium under AR-c, and  αc([Z]c∗,D⃗)∈Core⁡(SAG([Z]c∗,D⃗))  ∀D⃗,[Z]^{c*}\ \text{is a pure Nash equilibrium under AR-c, and}\ \ \alpha^c([Z]^{c*},\vec D)\in\operatorname{Core}\big(\mathrm{SAG}([Z]^{c*},\vec D)\big)\ \ \forall\vec D,[Z]c∗ is a pure Nash equilibrium under AR-c, and  αc([Z]c∗,D)∈Core(SAG([Z]c∗,D))  ∀D,

with integrable side payments.

Milestones

  • Examples 1 and 2 (pp. 358–359): a transfer-price allocation outside the core; the dual allocation (8,8,8,0)(8,8,8,0)(8,8,8,0) and the non-dual core allocation (0,0,0,24)(0,0,0,24)(0,0,0,24).
  • Theorem 4.1 (p. 358): if all inventory is claimed, the core of SAG([Z],D⃗)([Z],\vec D)([Z],D) is nonempty and contains the dual allocation (8) for every optimal dual.
  • Theorem 5.2 (p. 361): under AR-f every first-best profile is a Nash equilibrium.
  • Theorem 5.1 (p. 361): for any rule and any of its equilibria [Z]m∗[Z]^{m*}[Z]m∗ there are integrable demand-dependent side payments that leave the set of equilibria unchanged and put the allocations at [Z]m∗[Z]^{m*}[Z]m∗ in the core for every D⃗\vec DD.

Significance

The goal answers the paper's central question positively: there is an allocation mechanism under which the centrally optimal stock levels are an equilibrium of the decentralized stocking game, while every ex-post split of the pooling surplus is stable against all coalitions. Theorem 4.1 is the ex-post half: shadow prices of the shipping LP give a stable split for every realization, independently of who owns which units. The paper also shows (Proposition 5.1, not included here) that the dual allocation alone does not induce first-best stocking, which is why the side payments of Theorem 5.1 are needed.

The results are proved in the paper; Theorem 4.1 is proved there only by reference to the LP-game literature (Owen 1975; Samet and Zemel 1984). None of them has a machine-checked proof. The mission would produce the first formal treatment on Prove2Me of a linear-production (LP) game and its core, and of a model combining a cooperative second stage with a non-cooperative first stage.

Difficulty

Theorem 4.1 is an instance of Owen's theorem on LP games, but the instance is not a standard linear production game: coalition LPs have variables only on arcs inside the coalition, warehouse capacity is limited to the coalition's own claims, and the acceptance constraint divides by βi,n\beta_{i,n}βi,n​, which may be zero, so the general theorem cannot be quoted as it stands. The paper leaves the dual of (6) unwritten, and Mathlib has no ready-made LP duality in this form.

The stochastic layer is the other obstacle. Expected payoffs are integrals, and the side payment is built from a choice of dual prices for each demand realization. Its integrability requires measurability of that choice and of the LP value as a function of demand; neither is given by the paper, which treats the side payments as "constants".

Formalization scope

Retailers are Fin N, warehouses Fin W, locations Fin N ⊕ Fin W; quantities, prices and demands are real numbers; demand is a probability measure on Fin N → ℝ; expectations are Bochner integrals. WS∗W^*_{\mathcal S}WS∗​ is the real supremum of (6a) over the feasible set, and profiles are required to be nonnegative, which makes the feasible set nonempty and bounded. Arcs with βi,n=0\beta_{i,n}=0βi,n​=0 carry no shipment. The core is the platform definition Supermodularity.Cooperative.Core. The dual of (6) is written out explicitly (the paper does not state it). The paper's continuous-CDF assumption is not used and is dropped.

Pinned readings:

  1. "Dual prices" means any optimal solution of the dual of (6) for N\mathcal NN; Theorem 4.1 is stated for every such solution.
  2. "Induces the same equilibrium inventory levels as the first-best" (Theorem 5.2) and "the NE using αc\alpha^cαc is first-best" (Corollary 5.1) are stated as "every first-best profile is a Nash equilibrium", the direction the proofs give.
  3. "[Z]m~∗=[Z]m∗[Z]^{\tilde m*}=[Z]^{m*}[Z]m~∗=[Z]m∗" (Theorem 5.1) is stated as equality of the two sets of equilibria; the continuity and unimodality assumptions, which only guarantee existence of an equilibrium, are dropped because the equilibrium is a hypothesis.
  4. "An appropriate way of breaking ties" is a measurable choice of optimal dual prices; demand is almost surely nonnegative; the rule's payoffs in Theorem 5.1 are integrable.
  5. The shares γn\gamma_nγn​ of Theorem 5.2 are written θn\theta_nθn​, and Eq. (11) is used with +vnHn+v_nH_n+vn​Hn​ in the bracket (printed −vnHn-v_nH_n−vn​Hn​), as the proof on p. 367 requires.

Not acceptable: a core without the efficiency equation (7b); a feasible set that lets qi,n/0=0q_{i,n}/0=0qi,n​/0=0 sell to customers who balk; an arbitrary side payment instead of the constructed one; or a Nash equilibrium evaluated through non-integrable payoffs, whose Bochner integral is 000 and makes every profile an equilibrium.

Useful infrastructure: finite-dimensional LP duality in inequality form, measurable selection of LP optimal solutions, and continuity of LP values in the right-hand side. All of it can be reused in other LP-game and two-stage stochastic programming missions.

Selected references

  • R. Anupindi, Y. Bassok, E. Zemel, A General Framework for the Study of Decentralized Distribution Systems, Manufacturing & Service Operations Management 3(4):349–368, 2001. https://doi.org/10.1287/msom.3.4.349.9973
  • G. Owen, On the core of linear production games, Mathematical Programming 9:358–370, 1975. https://doi.org/10.1007/BF01681356
  • D. Samet, E. Zemel, On the core and dual set of linear programming games, Mathematics of Operations Research 9(2):309–316, 1984. https://doi.org/10.1287/moor.9.2.309
  • G. D. Eppen, Effects of centralization on expected costs in a multi-location newsboy problem, Management Science 25(5):498–501, 1979. https://doi.org/10.1287/mnsc.25.5.498
10 thms2 active usersReviewed
Algorithmic Game TheoryLinear Optimization·Captain: mikedeng1

Market Equilibrium under Separable, Piecewise-Linear, Concave Utilities I: Fisher Markets with an Equilibrium Have Rational Equilibrium Prices of Polynomial Bit SizeResearch Paper

Motivation

A Fisher market is the simplest model of a market in which prices are set by supply and demand: buyers bring money, sellers bring goods, and a price vector is an equilibrium when every buyer, spending her money optimally at those prices, leaves every good exactly sold out. Computing equilibria is one of the central questions of algorithmic game theory, because a polynomial-time algorithm is what would make the equilibrium concept usable as a prediction or as a pricing mechanism.

For linear utilities an equilibrium always exists, is rational, and can be computed in polynomial time (Eisenberg and Gale 1959; Devanur, Papadimitriou, Saberi and Vazirani, J. ACM 2008, https://doi.org/10.1145/1411509.1411512). The next natural class, additively separable, piecewise-linear, concave utilities, captures diminishing marginal utility and is the class studied by Vazirani and Yannakakis (J. ACM 58(3), Article 10, 2011, https://doi.org/10.1145/1970392.1970394). Their paper shows that equilibria in this class are hard to compute (PPAD-complete) and that deciding whether one exists is NP-complete. Both results rest on a structural fact proved first: whenever such a market has an equilibrium at all, it has one whose prices are rational numbers of polynomial bit length. That fact is the subject of this mission.

Timeline:

  • 1959, Eisenberg and Gale: a convex program whose optimal solutions are the equilibria of linear Fisher markets; equilibrium prices are rational.
  • 2008, Devanur, Papadimitriou, Saberi and Vazirani: a combinatorial polynomial-time algorithm for linear Fisher markets, based on a max-flow test of candidate prices.
  • 2009, Chen, Dai, Du and Teng, and Chen and Teng (FOCS 2009; ISAAC 2009): PPAD-hardness for additively separable piecewise-linear concave utilities in Arrow–Debreu and Fisher markets.
  • 2011, Vazirani and Yannakakis: rationality of equilibria with polynomial bit size (Theorem 4.1 for Fisher markets, Theorem 5.1 for Arrow–Debreu markets), PPAD membership, and NP-completeness of existence.

Setting

There are nnn buyers B={1,…,n}B=\{1,\dots,n\}B={1,…,n} and ggg divisible goods G={1,…,g}G=\{1,\dots,g\}G={1,…,g}, one unit of each good. Buyer iii has a rational budget e(i)>0e(i)>0e(i)>0. For each buyer iii and good jjj a function fji:R+→R+f^i_j:\mathbb R_+\to\mathbb R_+fji​:R+​→R+​ gives the utility that iii derives from an amount of good jjj. It is piecewise linear and concave: it is given by a finite list of bounded segments (c1,a1),…,(cm,am)(c_1,a_1),\dots,(c_m,a_m)(c1​,a1​),…,(cm​,am​) with rational amounts ak>0a_k>0ak​>0, followed by a last, unbounded segment, with rational slopes c1≥c2≥⋯≥cm≥c∞≥0c_1\ge c_2\ge\dots\ge c_m\ge c_\infty\ge 0c1​≥c2​≥⋯≥cm​≥c∞​≥0. The function has slope ckc_kck​ on [a1+⋯+ak−1, a1+⋯+ak][a_1+\dots+a_{k-1},\,a_1+\dots+a_k][a1​+⋯+ak−1​,a1​+⋯+ak​] and slope c∞c_\inftyc∞​ afterwards. Buyer iii's utility for a bundle x=(x1,…,xg)x=(x_1,\dots,x_g)x=(x1​,…,xg​) is additively separable:

ui(x)=∑j∈Gfji(xj).u_i(x)=\sum_{j\in G}f^i_j(x_j).ui​(x)=j∈G∑​fji​(xj​).

Given prices p∈R≥0gp\in\mathbb R^g_{\ge0}p∈R≥0g​, a bundle x≥0x\ge0x≥0 is optimal for buyer iii if ∑jpjxj≤e(i)\sum_jp_jx_j\le e(i)∑j​pj​xj​≤e(i) and no bundle y≥0y\ge0y≥0 with ∑jpjyj≤e(i)\sum_jp_jy_j\le e(i)∑j​pj​yj​≤e(i) has ui(y)>ui(x)u_i(y)>u_i(x)ui​(y)>ui​(x). The prices ppp are equilibrium prices if there is an allocation (xij)(x_{ij})(xij​) that gives each buyer an optimal bundle and sells every good exactly: ∑ixij=1\sum_ix_{ij}=1∑i​xij​=1 for every jjj.

The bit size of a rational number a/ba/ba/b in lowest terms is the binary length of ∣a∣|a|∣a∣ plus that of bbb. The encoding size ∥M∥\|M\|∥M∥ of a market MMM is n+gn+gn+g plus the bit sizes of all budgets, slopes and amounts, plus the number of bounded segments.

For the intermediate results, fix positive prices ppp. The bang per buck of a segment sss of good jjj is slope(s)/pj\mathrm{slope}(s)/p_jslope(s)/pj​ and its value is amount(s)⋅pj\mathrm{amount}(s)\cdot p_jamount(s)⋅pj​ (infinite for an unbounded segment). Sorting buyer iii's segments by decreasing bang per buck into classes of equal bang per buck, the first class at which the cumulative value exceeds e(i)e(i)e(i) is her flexible class. Segments of strictly larger bang per buck are forced, the others undesirable. From these the paper defines spent(i)\mathrm{spent}(i)spent(i) (value of the forced segments), unspent(i)=e(i)−spent(i)\mathrm{unspent}(i)=e(i)-\mathrm{spent}(i)unspent(i)=e(i)−spent(i), unsold(j)\mathrm{unsold}(j)unsold(j) (the part of good jjj not taken by forced segments), and a network N(p)N(p)N(p) from a source through goods and buyers to a sink.

Formalization targets

Goal: Theorem 4.1 (p. 10:9)

There is a polynomial PPP such that for every Fisher market MMM as above,

M has equilibrium prices p∈Rg ⟹ M has equilibrium prices q∈Qg with ∑jbits⁡(qj)≤P(∥M∥).M\text{ has equilibrium prices }p\in\mathbb R^g\ \Longrightarrow\ M\text{ has equilibrium prices }q\in\mathbb Q^g\text{ with }\sum_{j}\operatorname{bits}(q_j)\le P(\|M\|).M has equilibrium prices p∈Rg ⟹ M has equilibrium prices q∈Qg with j∑​bits(qj​)≤P(∥M∥).

The polynomial is fixed before the market. Nothing beyond the existence of some real equilibrium is assumed.

Milestones

  1. Lemma 3.1 (p. 10:8). For positive prices with ∑jpj=∑ie(i)\sum_jp_j=\sum_ie(i)∑j​pj​=∑i​e(i), unspent≥0\mathrm{unspent}\ge0unspent≥0 and unsold≥0\mathrm{unsold}\ge0unsold≥0: ppp are equilibrium prices iff the max-flow value of N(p)N(p)N(p) is ∑iunspent(i)\sum_i\mathrm{unspent}(i)∑i​unspent(i).
  2. Proof of Theorem 4.1, first sentence (p. 10:9). From a positive equilibrium p′p'p′ with ∑jpj′=∑ie(i)\sum_jp'_j=\sum_ie(i)∑j​pj′​=∑i​e(i), build the linear program of §4, whose variables are prices and flows and whose combinatorial data are fixed by p′p'p′. Then p′p'p′, with a suitable flow, is an optimal solution of value ∑ie(i)\sum_ie(i)∑i​e(i).
  3. §4, second paragraph (p. 10:8). Every optimal solution of that LP with positive prices gives equilibrium prices.

Significance

The result is what makes the existence problem for these markets a problem in NP: a rational equilibrium of polynomial size is a certificate that can be checked, with Lemma 3.1, by one max-flow computation. The same rationality statement underlies the paper's PPAD-membership proof and its NP-completeness result for existence. It also marks the boundary with markets whose equilibria can be irrational, as happens for some non-separable utilities. In that sense it shows that separable piecewise-linear concave utilities keep the "linear" character of the problem even though computing an equilibrium becomes hard.

All three statements are proved in the source, and none of them has a machine-checked proof on the platform or, as far as is known, anywhere else. The mission produces the first formal account of piecewise-linear Fisher markets: the model, the forced/flexible/undesirable classification of segments, the max-flow test for equilibrium, and the linear program of §4. It also forces precision where the paper is informal. The §4 bang-per-buck inequalities are printed with their directions reversed, and the claim about optimal LP solutions needs positive prices. The formal statements record each of these choices.

Difficulty

The obvious argument is: "equilibria are solutions of a linear system, so a rational one exists". It fails as stated, because the set of equilibrium prices is not a polyhedron. Which segments a buyer buys depends on the prices themselves, through the ordering of the ratios slope/pj\mathrm{slope}/p_jslope/pj​, so the equilibrium conditions are a finite union of polyhedral pieces glued along the price-dependent ordering. The work is to freeze the combinatorial structure of one given equilibrium and to show that the resulting fixed linear program still certifies equilibrium at every one of its optimal points. That second step is what Lemma 3.1 is for. The polynomial bit bound then needs a quantitative bound on the vertices of a rational LP, uniform in the market's encoding.

Formalization scope

Buyers and goods are Fin n and Fin g. Budgets, slopes and amounts are rationals (ℚ). Prices and allocations are reals (ℝ), so that "admits rational prices" is a real conclusion: the goal returns q : Fin g → ℚ whose cast is an equilibrium. The committed conventions are:

  • each good has unit supply;
  • budgets are positive;
  • each fjif^i_jfji​ is a list of (slope, amount) pairs of bounded segments together with the slope of its last, unbounded segment ("the last (infinite) segment", §6), with nonnegative slopes, positive amounts and nonincreasing slopes, stored inside the market structure;
  • the unbounded segment has infinite value and, when flexible, gives its network edge infinite capacity; this is encoded logically (no upper bound on that edge);
  • equilibrium requires exact clearing of every good, which by the paper's footnote 3 gives the same equilibrium prices as leaving zero-price goods partly unsold;
  • the classes QlQ_lQl​ are represented by the bang per buck of the flexible class, not by an index;
  • parallel network edges are merged;
  • max-flow is the supremum of the values of feasible flows on the good–buyer edges.

Hypotheses added relative to the page, each disclosed in its statement:

  • positivity of the LP solution's prices (milestone 3).

The §2 condition on p. 10:7 is a sufficient condition for existence and is deliberately not a hypothesis of the goal, which assumes only that an equilibrium exists. Complexity-class statements ("in NP", "PPAD-complete") are out of scope. What is formalized is the explicit polynomial bit bound, with a polynomial chosen before the market. A goal with the polynomial chosen after the market, an encoding size that ignores the bits of the data, or an equilibrium notion without utility-maximizing bundles would be trivially satisfiable. The statements rule all three out.

Beyond this mission, a complete development needs LP theory with rational data: existence of optimal basic solutions and determinant bounds on their bit size. Existing platform results that may serve as substrate include SmaleNinth.exists_square_subsystem and SmaleNinth.abs_det_le_factorial_mul_pow. Contributions welcome: proofs of the milestones, a reusable bit-size theory for rational LP vertices, and the Arrow–Debreu analogue (Theorem 5.1).

Selected references

  • V. V. Vazirani and M. Yannakakis, Market Equilibrium under Separable, Piecewise-Linear, Concave Utilities, J. ACM 58(3), Article 10, 2011. https://doi.org/10.1145/1970392.1970394
  • N. R. Devanur, C. H. Papadimitriou, A. Saberi and V. V. Vazirani, Market Equilibrium via a Primal–Dual Algorithm for a Convex Program, J. ACM 55(5), 2008. https://doi.org/10.1145/1411509.1411512
  • E. Eisenberg and D. Gale, Consensus of Subjective Probabilities: The Pari-Mutuel Method, Ann. Math. Statist. 30(1), 1959. https://doi.org/10.1214/aoms/1177706369
  • X. Chen, D. Dai, Y. Du and S.-H. Teng, Settling the Complexity of Arrow–Debreu Equilibria in Markets with Additively Separable Utilities, FOCS 2009. https://doi.org/10.1109/FOCS.2009.29
  • W. C. Brainard and H. E. Scarf, How to Compute Equilibrium Prices in 1891, Cowles Foundation Discussion Paper 1272, 2000. https://cowles.yale.edu/research/cfdp-1272
8 thms2 active usersReviewed
OptimizationProbabilityStatistics+1·Captain: mikedeng1

Acceleration of Stochastic Approximation by Averaging: Almost-Sure Convergence and Asymptotic Normality of the Averaged IterateResearch Paper

Motivation

Stochastic approximation finds a root x∗x^*x∗ of an unknown map R:RN→RNR:\mathbb R^N\to\mathbb R^NR:RN→RN from noisy evaluations yt=R(xt−1)+ξty_t=R(x_{t-1})+\xi_tyt​=R(xt−1​)+ξt​, by the Robbins–Monro recursion xt=xt−1−γtytx_t=x_{t-1}-\gamma_ty_txt​=xt−1​−γt​yt​. It underlies stochastic gradient descent, recursive estimation in statistics, adaptive control and simulation-based optimization. The classical theory (Sacks 1958) shows that the fastest attainable rate, t(xt−x∗)⇒N(0,G−1S(G−1)T)\sqrt t(x_t-x^*)\Rightarrow N(0,G^{-1}S(G^{-1})^T)t​(xt​−x∗)⇒N(0,G−1S(G−1)T) with G=R′(x∗)G=R'(x^*)G=R′(x∗) and SSS the noise covariance, is achieved by the matrix step γt=t−1G−1\gamma_t=t^{-1}G^{-1}γt​=t−1G−1, which requires knowing GGG.

Polyak and Juditsky (SIAM J. Control Optim. 30 (1992) 838–855) proved that the same optimal covariance is attained without any knowledge of GGG: run the recursion with scalar steps that decrease more slowly than 1/t1/t1/t and output the running average xˉt\bar x_txˉt​ of the iterates. Ruppert (Cornell ORIE technical report, 1988) obtained the one-dimensional case independently. The method, known as Polyak–Ruppert averaging, is the standard device for variance reduction in stochastic approximation.

Timeline:

  • 1951, Robbins and Monro: the recursion and its convergence in probability.
  • 1958, Sacks: asymptotic normality of xtx_txt​ for γt=γ/t\gamma_t=\gamma/tγt​=γ/t.
  • 1988, Ruppert: averaging in one dimension, i.i.d.-type noise.
  • 1990–1992, Polyak; Polyak and Juditsky: averaging in RN\mathbb R^NRN for linear problems with martingale-difference noise (Theorem 1) and nonlinear problems (Theorem 2).

Setting

Let (Ω,F,(Ft)t≥0,P)(\Omega,\mathcal F,(\mathcal F_t)_{t\ge0},P)(Ω,F,(Ft​)t≥0​,P) be a filtered probability space and (ξt)t≥1(\xi_t)_{t\ge1}(ξt​)t≥1​ an adapted RN\mathbb R^NRN-valued noise process. Given a nonrandom x0∈RNx_0\in\mathbb R^Nx0​∈RN and step sizes γt>0\gamma_t>0γt​>0, algorithm (7) is

xt=xt−1−γt(R(xt−1)+ξt),xˉt=1t∑i=0t−1xi.x_t=x_{t-1}-\gamma_t\bigl(R(x_{t-1})+\xi_t\bigr),\qquad\bar x_t=\frac1t\sum_{i=0}^{t-1}x_i .xt​=xt−1​−γt​(R(xt−1​)+ξt​),xˉt​=t1​i=0∑t−1​xi​.

The error is Δt=xt−x∗\Delta_t=x_t-x^*Δt​=xt​−x∗ and the estimation error is Δˉt=xˉt−x∗\bar\Delta_t=\bar x_t-x^*Δˉt​=xˉt​−x∗.

The hypotheses are:

  • Assumption 3.1: a Lyapunov function VVV with V(x)≥α∣x∣2V(x)\ge\alpha|x|^2V(x)≥α∣x∣2, Lipschitz gradient, V(0)=0V(0)=0V(0)=0, ∇V(x−x∗)TR(x)>0\nabla V(x-x^*)^TR(x)>0∇V(x−x∗)TR(x)>0 for x≠x∗x\neq x^*x=x∗, and ∇V(x−x∗)TR(x)≥λ1V(x−x∗)\nabla V(x-x^*)^TR(x)\ge\lambda_1V(x-x^*)∇V(x−x∗)TR(x)≥λ1​V(x−x∗) near x∗x^*x∗.
  • Assumption 3.2: ∣R(x)−G(x−x∗)∣≤K1∣x−x∗∣1+λ|R(x)-G(x-x^*)|\le K_1|x-x^*|^{1+\lambda}∣R(x)−G(x−x∗)∣≤K1​∣x−x∗∣1+λ near x∗x^*x∗, with 0<λ≤10<\lambda\le10<λ≤1 and every eigenvalue of GGG having positive real part.
  • Assumption 3.3: ξt\xi_tξt​ is a martingale difference with E(∣ξt∣2∣Ft−1)+∣R(xt−1)∣2≤K2(1+∣xt−1∣2)E(|\xi_t|^2\mid\mathcal F_{t-1})+|R(x_{t-1})|^2\le K_2(1+|x_{t-1}|^2)E(∣ξt​∣2∣Ft−1​)+∣R(xt−1​)∣2≤K2​(1+∣xt−1​∣2). It splits as ξt=ξt(0)+ζt\xi_t=\xi_t(0)+\zeta_tξt​=ξt​(0)+ζt​, where ξt(0)\xi_t(0)ξt​(0) is a martingale difference whose conditional covariance tends to S≻0S\succ0S≻0 in probability and whose conditional second moments are uniformly integrable, and E(∣ζt∣2∣Ft−1)≤δ(xt−1−x∗)E(|\zeta_t|^2\mid\mathcal F_{t-1})\le\delta(x_{t-1}-x^*)E(∣ζt​∣2∣Ft−1​)≤δ(xt−1​−x∗) with δ(x)→0\delta(x)\to0δ(x)→0 as x→0x\to0x→0.
  • Assumption 3.4: (γt−γt+1)/γt=o(γt)(\gamma_t-\gamma_{t+1})/\gamma_t=o(\gamma_t)(γt​−γt+1​)/γt​=o(γt​), ∑tγt(1+λ)/2t−1/2<∞\sum_t\gamma_t^{(1+\lambda)/2}t^{-1/2}<\infty∑t​γt(1+λ)/2​t−1/2<∞, γt→0\gamma_t\to0γt​→0 and ∑tγt2<∞\sum_t\gamma_t^2<\infty∑t​γt2​<∞.

The linear case, algorithm (2), is R(x)=Ax−bR(x)=Ax-bR(x)=Ax−b with every eigenvalue of AAA having positive real part.

Formalization targets

Goal: Theorem 2

Under Assumptions 3.1–3.4,

xˉt→x∗ a.s.,t (xˉt−x∗)→DN(0,  G−1S(G−1)T).\bar x_t\to x^*\ \text{a.s.},\qquad\sqrt t\,(\bar x_t-x^*)\xrightarrow{D}N\bigl(0,\;G^{-1}S(G^{-1})^T\bigr).xˉt​→x∗ a.s.,t​(xˉt​−x∗)D​N(0,G−1S(G−1)T).

Milestones

  • Lemma 1, Part 2: under condition (4) on the steps, tγt→∞t\gamma_t\to\inftytγt​→∞.
  • Lemma 1: the matrices φjt=A−1−γj∑i=jt−1∏k=ji−1(I−γkA)\varphi_j^t=A^{-1}-\gamma_j\sum_{i=j}^{t-1}\prod_{k=j}^{i-1}(I-\gamma_kA)φjt​=A−1−γj​∑i=jt−1​∏k=ji−1​(I−γk​A) are uniformly bounded, and 1t∑j<t∥φjt∥→0\frac1t\sum_{j<t}\|\varphi_j^t\|\to0t1​∑j<t​∥φjt​∥→0.
  • Lemma 2: the representation (A9) of t Δˉt\sqrt t\,\bar\Delta_tt​Δˉt​ for the linear error recursion.
  • Theorem 1(a): the linear case, t(xˉt−x∗)⇒N(0,A−1S(A−1)T)\sqrt t(\bar x_t-x^*)\Rightarrow N(0,A^{-1}S(A^{-1})^T)t​(xˉt​−x∗)⇒N(0,A−1S(A−1)T).
  • Proof of Theorem 2, Part 1: V(Δt)V(\Delta_t)V(Δt​) converges almost surely to a finite limit.
  • Proof of Theorem 2, p. 850: xt→x∗x_t\to x^*xt​→x∗ almost surely.
  • Proof of Theorem 2, Part 4: the average of the linearised process Δt1=Δt−11−γt(GΔt−11+ξt)\Delta^1_t=\Delta^1_{t-1}-\gamma_t(G\Delta^1_{t-1}+\xi_t)Δt1​=Δt−11​−γt​(GΔt−11​+ξt​) satisfies t(Δˉt1−Δˉt)→0\sqrt t(\bar\Delta^1_t-\bar\Delta_t)\to0t​(Δˉt1​−Δˉt​)→0 almost surely.

Significance

Theorem 2 shows that averaging turns a robust, slowly-stepped recursion into an asymptotically efficient estimator. The covariance G−1S(G−1)TG^{-1}S(G^{-1})^TG−1S(G−1)T is the lower bound for this class of problems: for linear recursive estimates with independent noise it is the bound of [26] in the paper. Downstream, the result is what is invoked for the asymptotic efficiency of averaged stochastic gradient descent (Theorem 3 of the paper) and of recursive M-estimators in regression (Theorem 4).

The result is proved, with a published proof, but has no machine-checked version. As far as a search of the platform shows, no statement of Theorem 1 or Theorem 2 exists on Prove2Me. The platform does have a scalar martingale central limit theorem (Martingale.clt_of_mds, proved, with unconditional Lindeberg condition), which is usable through the Cramér–Wold device. Formalizing Theorem 2 also requires the Robbins–Siegmund almost-supermartingale theorem, a multivariate CLT for martingale differences under conditional Lindeberg and conditional covariance conditions, and the Kronecker lemma. Mathlib has none of these three in the required form, and each is reusable well beyond this mission. Non-asymptotic SGD rates already on the platform (the Bottou–Curtis–Nocedal and Lan missions) are different results.

Difficulty

The obvious approach analyses xtx_txt​ directly. It fails: with steps decreasing more slowly than 1/t1/t1/t, t(xt−x∗)\sqrt t(x_t-x^*)t​(xt​−x∗) diverges, and only the average has the t\sqrt tt​ rate. The average must be compared with the averaged noise through the matrix sums of Lemma 1, whose bounds are uniform in both indices. Those bounds rely on the step condition (γt−γt+1)/γt=o(γt)(\gamma_t-\gamma_{t+1})/\gamma_t=o(\gamma_t)(γt​−γt+1​)/γt​=o(γt​) in a quantitative way.

The nonlinear case adds a second difficulty. The iterates are first shown to converge almost surely, by a Lyapunov argument. The nonlinear error is then transferred to a linearised process at the t\sqrt tt​ scale, which needs a summability estimate on ∣Δi∣1+λi−1/2|\Delta_i|^{1+\lambda}i^{-1/2}∣Δi​∣1+λi−1/2 obtained through stopping times. A central limit theorem for the linear process alone does not give the result, because the linearisation error must vanish after multiplication by t\sqrt tt​.

Formalization scope

Points are in EuclideanSpace ℝ (Fin N) and matrices are Matrix (Fin N) (Fin N) ℝ, acting through Matrix.toEuclideanLin. Matrix norms are operator norms. Conditional expectations are MeasureTheory.condExp on a Filtration ℕ. "Given Ft−1\mathcal F_{t-1}Ft−1​" is written with shifted indices (ξt+1\xi_{t+1}ξt+1​ given Ft\mathcal F_tFt​). The algorithm is a recursive definition from (x0,γ,R,ξ)(x_0,\gamma,R,\xi)(x0​,γ,R,ξ), with γ0,ξ0\gamma_0,\xi_0γ0​,ξ0​ unused and xˉt\bar x_txˉt​ averaging x0,…,xt−1x_0,\dots,x_{t-1}x0​,…,xt−1​. Convergence in distribution is TendstoInDistribution to multivariateGaussian 0 V. Convergence of conditional covariances in probability is entrywise TendstoInMeasure. A limsup or supremum "tending to 0 in probability" is unfolded into its η\etaη–δ\deltaδ definition.

Corrections of the printed text, each used by the paper's own proof:

  1. Assumption 3.1 prints V(x∗)=0V(x^*)=0V(x∗)=0 and ≥λV(x)\ge\lambda V(x)≥λV(x). Stated as V(0)=0V(0)=0V(0)=0 and ≥λ1V(x−x∗)\ge\lambda_1V(x-x^*)≥λ1​V(x−x∗) (as printed they force x∗=0x^*=0x∗=0). The drift constant is renamed λ1\lambda_1λ1​, since the paper uses λ\lambdaλ also in Assumption 3.2.
  2. Eq. (10) is garbled as printed. It is stated as ∑γt(1+λ)/2t−1/2<∞\sum\gamma_t^{(1+\lambda)/2}t^{-1/2}<\infty∑γt(1+λ)/2​t−1/2<∞, the form of Assumptions 4.7 and 5.6 and of p. 851.
  3. Assumption 3.3's δ(xt−1)\delta(x_{t-1})δ(xt−1​) is stated as δ(xt−1−x∗)\delta(x_{t-1}-x^*)δ(xt−1​−x∗).
  4. γt→0\gamma_t\to0γt​→0 and ∑γt2<∞\sum\gamma_t^2<\infty∑γt2​<∞ are added to Assumption 3.4. The proof uses them (p. 849), and they do not follow from it.
  5. RRR is assumed continuous. The paper states no regularity of RRR, but its proof of almost sure convergence (pp. 849–850) needs ∇V(x−x∗)TR(x)\nabla V(x-x^*)^TR(x)∇V(x−x∗)TR(x) bounded away from 000 on annuli around x∗x^*x∗, which continuity and Assumption 3.1 provide.
  6. Lemma 1 and Theorem 1(a) are stated under condition (4) only. The constant-step condition (3) is false as printed (A=diag(1,10)A=\mathrm{diag}(1,10)A=diag(1,10), γ=1\gamma=1γ=1), and Theorem 2 does not use it.
  7. (A3) is stated with the norm inside, as its proof establishes.
  8. (A9) and the linearised process of Part 4 are stated with −γtξt-\gamma_t\xi_t−γt​ξt​ noise signs, and with Δ01=Δ0\Delta^1_0=\Delta_0Δ01​=Δ0​. The printed +++ signs contradict (A8) at t=2t=2t=2.

Several formalizations would make the goal trivial, and all are ruled out:

  • conditional expectations of non-integrable functions, which are 000 in Lean (every noise process is required to be in L2L^2L2);
  • a real supremum for the uniform integrability in Assumption 3.3, which is 000 on unbounded families;
  • an arbitrary process with a property in place of the recursion (7);
  • a degenerate Dirac target (the covariance G−1S(G−1)TG^{-1}S(G^{-1})^TG−1S(G−1)T is positive definite under the hypotheses).

Welcome contributions: the Robbins–Siegmund theorem, a vector martingale CLT under conditional Lindeberg conditions, the Kronecker lemma, and the matrix estimates of Lemma 1.

Selected references

  • B. T. Polyak, A. B. Juditsky, Acceleration of stochastic approximation by averaging, SIAM J. Control Optim. 30(4), 838–855, 1992. https://doi.org/10.1137/0330046
  • H. Robbins, S. Monro, A stochastic approximation method, Ann. Math. Statist. 22, 400–407, 1951. https://doi.org/10.1214/aoms/1177729586
  • J. Sacks, Asymptotic distribution of stochastic approximation procedures, Ann. Math. Statist. 29, 373–405, 1958. https://doi.org/10.1214/aoms/1177706619
  • D. Ruppert, Efficient estimations from a slowly convergent Robbins–Monro process, Cornell University ORIE Technical Report 781, 1988 (no stable online link located).
  • H. Robbins, D. Siegmund, A convergence theorem for non negative almost supermartingales and some applications, in Optimizing Methods in Statistics, Academic Press, 233–257, 1971. https://doi.org/10.1016/B978-0-12-604550-5.50015-8
10 thms2 active usersReviewed
Dynamic ProgrammingProbabilityStochastic Systems·Captain: mikedeng1

On the optimality equation for average cost Markov decision processes and its validity for inventory control: The Average-Cost Optimality Equation for Setup-Cost Inventory ControlResearch Paper

Motivation

Average-cost criteria are standard in inventory, queueing and maintenance models that run indefinitely. For a Markov decision process (MDP), the central object is the average-cost optimality equation (ACOE). It couples a constant www (the optimal long-run cost per period) with a relative value function u~\tilde uu~. A stationary policy that attains the minimum in the ACOE is average-cost optimal. When the state space is uncountable, the one-step cost is unbounded and the transition probability is only weakly continuous, the ACOE is not automatically available.

Feinberg, Kasyanov and Zadoianchuk (2012) proved that under their Assumptions W* and B the weaker average-cost optimality inequality (ACOI) holds. For setwise continuous transition probabilities, Hernández-Lerma and Lasserre (1996, Theorem 5.5.4) gave conditions for the ACOE via equicontinuity. Feinberg and Lewis (2015) established the ACOI and optimality of (s,S)(s,S)(s,S) policies for periodic-review inventory control with setup costs and general demand. Feinberg and Liang (2022, online 2017) extended the equicontinuity condition to weakly continuous transitions and used it to show that the inventory problem satisfies the full equation, not just the inequality.

Setting

An MDP has a state space X\mathbb XX and an action space A\mathbb AA (Borel subsets of Polish spaces). It has a one-step cost c:X×A→R∪{+∞}c:\mathbb X\times\mathbb A\to\mathbb R\cup\{+\infty\}c:X×A→R∪{+∞}, bounded below, and a transition probability q(dy∣x,a)q(dy\mid x,a)q(dy∣x,a). A policy chooses actions from the observed history, possibly at random. A stationary policy is a measurable map ϕ:X→A\phi:\mathbb X\to\mathbb Aϕ:X→A. For a discount factor α∈[0,1)\alpha\in[0,1)α∈[0,1):

  • vα(x)v_\alpha(x)vα​(x) is the infimum over all policies of the expected total discounted cost from xxx;
  • mα=inf⁡xvα(x)m_\alpha=\inf_x v_\alpha(x)mα​=infx​vα​(x);
  • uα=vα−mαu_\alpha=v_\alpha-m_\alphauα​=vα​−mα​ is the discounted relative value function.

The average cost of a policy is wπ(x)=lim sup⁡N1NExπ∑t<Nc(xt,at)w^\pi(x)=\limsup_N \frac1N\mathbb E^\pi_x\sum_{t<N}c(x_t,a_t)wπ(x)=limsupN​N1​Exπ​∑t<N​c(xt​,at​), and w(x)=inf⁡πwπ(x)w(x)=\inf_\pi w^\pi(x)w(x)=infπ​wπ(x). Set w‾=lim inf⁡α↑1(1−α)mα\underline w=\liminf_{\alpha\uparrow1}(1-\alpha)m_\alphaw​=liminfα↑1​(1−α)mα​. For a sequence αn↑1\alpha_n\uparrow1αn​↑1, define

u~(x)=lim inf⁡n→∞, y→xuαn(y).\tilde u(x)=\liminf_{n\to\infty,\ y\to x}u_{\alpha_n}(y).u~(x)=n→∞, y→xliminf​uαn​​(y).

Assumption EC for {αn}\{\alpha_n\}{αn​} has two parts:

  1. the family {uαn}\{u_{\alpha_n}\}{uαn​​} is equicontinuous;
  2. some measurable U≥uαnU\ge u_{\alpha_n}U≥uαn​​ has ∫U dq(⋅∣x,a)<∞\int U\,dq(\cdot\mid x,a)<\infty∫Udq(⋅∣x,a)<∞ for all x,ax,ax,a.

The inventory problem has inventory level x∈Rx\in\mathbb Rx∈R (negative means backlog) and order quantity a≥0a\ge0a≥0. Inventory evolves by xt+1=xt+at−Dt+1x_{t+1}=x_t+a_t-D_{t+1}xt+1​=xt​+at​−Dt+1​, with i.i.d. nonnegative demands DDD. The cost is

c(x,a)=K I{a>0}+cˉ a+E[h(x+a−D)],c(x,a)=K\,I_{\{a>0\}}+\bar c\,a+\mathbb E[h(x+a-D)],c(x,a)=KI{a>0}​+cˉa+E[h(x+a−D)],

with setup cost K≥0K\ge0K≥0, unit cost cˉ>0\bar c>0cˉ>0, and convex hhh with h(x)→∞h(x)\to\inftyh(x)→∞ as ∣x∣→∞|x|\to\infty∣x∣→∞. Let α∗=1+lim⁡x→−∞h(x)/(cˉx)\alpha^*=1+\lim_{x\to-\infty}h(x)/(\bar cx)α∗=1+limx→−∞​h(x)/(cˉx) and H(x)=cˉx+E[h(x−D)]+E[u~(x−D)]H(x)=\bar cx+\mathbb E[h(x-D)]+\mathbb E[\tilde u(x-D)]H(x)=cˉx+E[h(x−D)]+E[u~(x−D)]. A function fff is KKK-convex if f((1−λ)x+λy)≤(1−λ)f(x)+λf(y)+λKf((1-\lambda)x+\lambda y)\le(1-\lambda)f(x)+\lambda f(y)+\lambda Kf((1−λ)x+λy)≤(1−λ)f(x)+λf(y)+λK for x≤yx\le yx≤y and λ∈(0,1)\lambda\in(0,1)λ∈(0,1). An (s,S)(s,S)(s,S) policy orders up to SSS whenever the inventory is below sss.

Formalization targets

Goal: Theorem 4.5

For every sequence of nonnegative discount factors αn↑1\alpha_n\uparrow1αn​↑1 with α1>α∗\alpha_1>\alpha^*α1​>α∗, the inventory MDP satisfies Assumption EC. Along a subsequence, uαnk→u~u_{\alpha_{n_k}}\to\tilde uuαnk​​​→u~, and some stationary ϕ\phiϕ satisfies

w+u~(x)=KI{ϕ(x)>0}+H(x+ϕ(x))−cˉx=min⁡{min⁡a≥0[K+H(x+a)], H(x)}−cˉx.w+\tilde u(x)=K I_{\{\phi(x)>0\}}+H(x+\phi(x))-\bar cx=\min\Big\{\min_{a\ge0}[K+H(x+a)],\,H(x)\Big\}-\bar cx .w+u~(x)=KI{ϕ(x)>0}​+H(x+ϕ(x))−cˉx=min{a≥0min​[K+H(x+a)],H(x)}−cˉx.

Moreover:

  • u~\tilde uu~ and HHH are KKK-convex, continuous and inf-compact;
  • the (s,S)(s,S)(s,S) policy built from a minimizer of HHH satisfies the equation;
  • so do the limits (s∗,S∗)(s^*,S^*)(s∗,S∗) of discount-optimal thresholds.

Milestones

  1. Lemma 3.3: for equicontinuous families, the pointwise and joint lower limits coincide.
  2. Theorem 3.2: Assumptions W*, B and EC imply the ACOE for a general MDP.
  3. The cited facts used in §4:
    • Assumptions W* and B hold for the inventory problem;
    • the sets Xα\mathbb X_\alphaXα​ of minimizers of vαv_\alphavα​ lie in a bounded interval (4.4);
    • discount-optimal (sα,Sα)(s_\alpha,S_\alpha)(sα​,Sα​) policies (Theorem 4.3);
    • their average-cost limits (Theorem 4.4);
    • the renewal bounds (4.11)–(4.12).
  4. Lemma 4.6: an explicit dominating function UUU.
  5. Lemma 4.7: equicontinuity of {uαn}\{u_{\alpha_n}\}{uαn​​} for the inventory problem.

Significance

The ACOE is stronger than the ACOI. It identifies the optimal actions of an average-cost problem as the minimizers of a one-step lookahead with u~\tilde uu~, and it makes u~\tilde uu~ a genuine relative value function: u~\tilde uu~ is the pointwise limit of the discounted relative values along a subsequence. For inventory control, Theorem 4.5 gives three further conclusions:

  • the KKK-convexity and continuity of the average-cost relative value function;
  • that an optimal (s,S)(s,S)(s,S) policy can be computed from HHH by the same argmin rule that works for discounted costs;
  • that limits of discount-optimal thresholds solve the average-cost problem.

The results are proved in the paper, and in the cited works of Feinberg and coauthors for the cited milestones. None is formalized. There is no formal library of MDPs on Borel spaces with history-dependent randomized policies. This mission builds that layer (strategic measures via Ionescu Tulcea, discounted and average costs, Assumptions W*, B and EC) and states the general ACOE theorem on it. A proof of the goal would also require formal proofs of the cited inventory results of Feinberg–Lewis (2015) and Feinberg–Liang (2017a), which are milestones here.

Difficulty

One obvious route is to pass to the limit in the discounted optimality equation vα=min⁡a[c+α∫vα dq]v_\alpha=\min_a[c+\alpha\int v_\alpha\,dq]vα​=mina​[c+α∫vα​dq]. After subtracting mαm_\alphamα​, this needs two things: convergence of uαnu_{\alpha_n}uαn​​, and exchanging limit and integral. Pointwise lower limits give only the inequality (ACOI). The reverse inequality needs actual convergence of a subsequence and a dominating function. For weakly continuous qqq, convergence of ∫uαn dq\int u_{\alpha_n}\,dq∫uαn​​dq additionally requires uniform convergence on compacts, which is where equicontinuity enters.

For the inventory problem the hard step is equicontinuity itself. The functions uαu_\alphauα​ are not uniformly Lipschitz. It must be shown that costs from two nearby starting inventories stay close uniformly in α\alphaα. This comparison runs through the time until inventory falls below the reorder point, and it is controlled by renewal-theoretic bounds on the number of demand arrivals.

Formalization scope

The Lean development lives in the namespace FeinbergLiang.ACOE. It commits to the following conventions.

  • Spaces. X,A\mathbb X,\mathbb AX,A are separable metric spaces with standard Borel σ-algebras. This is the paper's "Borel subsets of Polish spaces", up to homeomorphism. The inventory case is X=R\mathbb X=\mathbb RX=R, A=R≥0\mathbb A=\mathbb R_{\ge0}A=R≥0​. The integer case X=Z\mathbb X=\mathbb ZX=Z, A=N0\mathbb A=\mathbb N_0A=N0​ is out of scope, as are Corollary 4.8 and Theorem 4.9.
  • Costs and infinities. The cost is stored as a real lower bound plus a [0,∞][0,\infty][0,∞]-valued part. Every value function (vαv_\alphavα​, mαm_\alphamα​, uαu_\alphauα​, www, w‾\underline ww​, u~\tilde uu~) is the [0,∞][0,\infty][0,∞]-valued part, with the explicit real shift described in the definitions. uαu_\alphauα​ equals vα−mαv_\alpha-m_\alphavα​−mα​ whenever mα<∞m_\alpha<\inftymα​<∞, which Assumption B guarantees. α∗\alpha^*α∗ is an extended real and may be −∞-\infty−∞. GαG_\alphaGα​ and HHH are extended-real valued, and each theorem using them concludes their finiteness. Likewise the ACOE conclusions include w‾<∞\underline w<\inftyw​<∞ and u~<∞\tilde u<\inftyu~<∞, so an equation of the form ∞=∞\infty=\infty∞=∞ can never satisfy them.
  • Policies. vαv_\alphavα​ and www are infima over all history-dependent randomized policies, with trajectory laws given by Mathlib's Ionescu Tulcea kernel Kernel.trajMeasure. They are never defined as solutions of an optimality equation.
  • Readings of informal words.
    1. "αn↑1\alpha_n\uparrow1αn​↑1" means values in [0,1)[0,1)[0,1), nondecreasing, with limit 111; "nonnegative discount factors" is the lower end of [0,1)[0,1)[0,1).
    2. The paper's α1\alpha_1α1​ is Lean's α 0.
    3. "Equicontinuous" is Mathlib's Equicontinuous, applied to the real values of uαnu_{\alpha_n}uαn​​ together with their finiteness.
    4. "lim inf⁡n→∞,y→x\liminf_{n\to\infty,y\to x}liminfn→∞,y→x​" is the lower limit along the product filter atTop ×ˢ 𝓝 x.
    5. "Uniform on each compact subset" is TendstoUniformlyOn on every compact set.
    6. "=min⁡=\min=min" in (3.3) and (4.10) means the middle term is attained and is a lower bound for all actions.
    7. "Assumption EC for the sequence" is a property of a given sequence.
    8. "Can be selected as an (s∗,S∗)(s^*,S^*)(s∗,S∗) policy" is stated for every limit of discount-optimal thresholds along a further subsequence, with u~\tilde uu~ that of Theorem 3.2(i).
    9. "Can be selected as an (s,S)(s,S)(s,S) policy" is stated for every minimizer SSS of HHH.
    10. Theorem 4.4's "optimality inequality (4.8)" is read as the ACOI (3.1) for the (s∗,S∗)(s^*,S^*)(s∗,S∗) policy.
  • Standing assumptions. The paper's "without loss of generality h≥0h\ge0h≥0 and h(0)=0h(0)=0h(0)=0" is a pair of hypotheses of the inventory model. This is the paper's normalization, not an addition.
  • Not trivializable. Defining vαv_\alphavα​ through its optimality equation, restricting policies to stationary ones, or dropping the finiteness conclusions would make the goal a different, weaker statement. The definitions rule each of these out.

Contributions welcome: proofs of the milestones, especially the general Theorem 3.2 and the renewal estimates behind Lemmas 4.6–4.7. The Borel-space MDP definitions are reusable by later average-cost and discounted MDP missions.

Selected references

  • E. A. Feinberg and Y. Liang, On the optimality equation for average cost Markov decision processes and its validity for inventory control, Annals of Operations Research 317 (2022) 569–586. https://doi.org/10.1007/s10479-017-2561-9
  • E. A. Feinberg, P. O. Kasyanov and N. V. Zadoianchuk, Average cost Markov decision processes with weakly continuous transition probability, Mathematics of Operations Research 37(4) (2012) 591–607. https://doi.org/10.1287/moor.1120.0555
  • E. A. Feinberg and M. E. Lewis, On the convergence of optimal actions for Markov decision processes and the optimality of (s, S) policies for inventory control, preprint arXiv:1507.05125, 2015. https://arxiv.org/abs/1507.05125
  • E. A. Feinberg and Y. Liang, Structure of optimal policies to periodic-review inventory models with convex costs and backorders for all values of discount factors, Annals of Operations Research (2017a). https://doi.org/10.1007/s10479-017-2548-6
  • O. Hernández-Lerma and J. B. Lasserre, Discrete-Time Markov Control Processes: Basic Optimality Criteria, Springer, 1996. https://doi.org/10.1007/978-1-4612-0729-0
12 thms2 active usersReviewed
PreviousPage 14 of 45Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me