Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,633 missions · 1,257 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1376Completed1257All2633
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Coopetition in Platform-Based Retailing: On the Platform’s Entry II: In the Protective Regime the Seller Underinvests to Deter Entry for Intermediate Product Base ValuesResearch Paper

Motivation

Online marketplaces such as Amazon are both the storefront of third-party sellers and a retailer in their own right. A platform that observes how well a seller's product sells can later launch a competing product in the same space, and empirical work finds that it does so selectively: Zhu and Liu (2018, Strategic Management Journal) report that Amazon is more likely to enter product spaces with high sales and ratings. A seller who anticipates this faces a strategic choice about how much to invest in her product before the platform decides.

Qi, Song and Xiao (Management Science, 2025) model this interaction as a two-stage game and ask how the seller's investment responds to the threat of entry. Their answer depends on whether the seller ultimately benefits from the platform's entry, which can happen through spillovers: the platform's own investment in the product space also raises the value of the seller's product. This mission formalizes the case in which the seller does not want the platform to enter, the protective regime, and the paper's characterization of her optimal effort there (Proposition 3).

Setting

The parameters are a degree of spillover δ∈[0,1]\delta\in[0,1]δ∈[0,1], a referral rate f∈[0,1)f\in[0,1)f∈[0,1) (the share of the seller's revenue paid to the platform), a competition intensity β∈[0,1]\beta\in[0,1]β∈[0,1], the seller's effort-cost coefficient cS>1/2c_S>1/2cS​>1/2, and the platform's fixed entry cost K>0K>0K>0. The platform's own cost coefficient is normalized to cP=1/2c_P=1/2cP​=1/2.

In the first stage the seller's product has base value aaa; she chooses an effort eSe_SeS​ at cost cSeS2c_Se_S^2cS​eS2​, raising the value to a+eSa+e_Sa+eS​, and sells a quantity q1q_1q1​ at price a+eS−q1a+e_S-q_1a+eS​−q1​, keeping the fraction 1−f1-f1−f of revenue. In the second stage the platform, having inferred a+eSa+e_Sa+eS​, decides whether to enter. If it does, it invests in the product space and the two compete in quantities.

The paper reduces the second stage to closed forms. Write N5N_5N5​ for the left side of condition (5),

N5=4(1+δ)−2β(2−δ+δ2)+β3(1+f)−β2(2+f+δf)>0,N_5=4(1+\delta)-2\beta(2-\delta+\delta^2)+\beta^3(1+f)-\beta^2(2+f+\delta f)>0,N5​=4(1+δ)−2β(2−δ+δ2)+β3(1+f)−β2(2+f+δf)>0,

which says that the seller stays in the market after entry and is assumed throughout. With an explicit polynomial denominator DDD, set H=N52/D2H=N_5^2/D^2H=N52​/D2 (equation (8)). The seller's two-stage profits under non-entry and entry are

ΠNS(eS)=(1−f)(a+eS)22−cSeS2,ΠES(eS)=(14+H)(1−f)(a+eS)2−cSeS2.\Pi^S_N(e_S)=\frac{(1-f)(a+e_S)^2}{2}-c_Se_S^2,\qquad \Pi^S_E(e_S)=\Big(\frac14+H\Big)(1-f)(a+e_S)^2-c_Se_S^2 .ΠNS​(eS​)=2(1−f)(a+eS​)2​−cS​eS2​,ΠES​(eS​)=(41​+H)(1−f)(a+eS​)2−cS​eS2​.

The platform enters iff the product value exceeds a threshold Δ=−4KD/EN\Delta=\sqrt{-4KD/E_N}Δ=−4KD/EN​​, where ENE_NEN​ is a second explicit polynomial in (δ,f,β)(\delta,f,\beta)(δ,f,β) (Proposition 1). Hence the seller's total profit is

ΠS(eS)={ΠNS(eS)eS+a≤Δ,ΠES(eS)eS+a>Δ.\Pi^S(e_S)=\begin{cases}\Pi^S_N(e_S)&e_S+a\le\Delta,\\ \Pi^S_E(e_S)&e_S+a>\Delta.\end{cases}ΠS(eS​)={ΠNS​(eS​)ΠES​(eS​)​eS​+a≤Δ,eS​+a>Δ.​

The protective regime is Ω‾={(δ,f,β):H≤1/4}\overline\Omega=\{(\delta,f,\beta): H\le 1/4\}Ω={(δ,f,β):H≤1/4}; there ΠNS≥ΠES\Pi^S_N\ge\Pi^S_EΠNS​≥ΠES​ for every effort. The benchmark efforts eNB(a)=(1−f)a/(f+2cS−1)e^B_N(a)=(1-f)a/(f+2c_S-1)eNB​(a)=(1−f)a/(f+2cS​−1) and eEB(a)=a(1−f)(1+4H)/(4cS−(1−f)(1+4H))e^B_E(a)=a(1-f)(1+4H)/(4c_S-(1-f)(1+4H))eEB​(a)=a(1−f)(1+4H)/(4cS​−(1−f)(1+4H)), equations (9)–(10), maximize ΠNS\Pi^S_NΠNS​ and ΠES\Pi^S_EΠES​ respectively.

Formalization targets

Goal: Proposition 3

In the protective regime, with a‾1\underline a_1a​1​ defined by a‾1+eNB(a‾1)=Δ\underline a_1+e^B_N(\underline a_1)=\Deltaa​1​+eNB​(a​1​)=Δ, there is aˉ1≥a‾1\bar a_1\ge\underline a_1aˉ1​≥a​1​ such that an optimal effort is

eS∗(a)={eNB(a)a≤a‾1,Δ−aa∈(a‾1,aˉ1),eEB(a)a≥aˉ1,e^*_S(a)=\begin{cases}e^B_N(a)&a\le\underline a_1,\\ \Delta-a&a\in(\underline a_1,\bar a_1),\\ e^B_E(a)&a\ge\bar a_1,\end{cases}eS∗​(a)=⎩⎨⎧​eNB​(a)Δ−aeEB​(a)​a≤a​1​,a∈(a​1​,aˉ1​),a≥aˉ1​,​

and the optimal first-stage quantity is q1∗=(a+eS∗(a))/2q_1^*=(a+e^*_S(a))/2q1∗​=(a+eS∗​(a))/2.

Milestones

  1. Proposition 1: under (5) and K>0K>0K>0, Δ>0\Delta>0Δ>0 and the platform's gain from entry is positive iff a+eS>Δa+e_S>\Deltaa+eS​>Δ.
  2. Equations (9)–(10): eNBe^B_NeNB​ and eEBe^B_EeEB​ are the unique unconstrained maximizers.
  3. eNB(a)≥eEB(a)e^B_N(a)\ge e^B_E(a)eNB​(a)≥eEB​(a) for a>0a>0a>0 when H≤1/4H\le 1/4H≤1/4.
  4. With M(a)=ΠNS(Δ−a)−ΠES(eEB(a))M(a)=\Pi^S_N(\Delta-a)-\Pi^S_E(e^B_E(a))M(a)=ΠNS​(Δ−a)−ΠES​(eEB​(a)): dM/da=2cS(Δ−a−eEB(a))dM/da=2c_S(\Delta-a-e^B_E(a))dM/da=2cS​(Δ−a−eEB​(a)).
  5. M(a‾1)≥0M(\underline a_1)\ge 0M(a​1​)≥0.
  6. Cases 1.1, 1.2 and 1.3 of the proof: optimality of each of the three efforts on its region.

Significance

The result identifies strategic underinvestment as the seller's response to an unwelcome entrant: for intermediate base values she chooses less effort than her first-best so that the product's value sits exactly at the entry threshold. For low base values no distortion is needed, and for high ones the required distortion costs more than entry does. This explains why a seller's investment may fall short of what her own costs and demand would justify, and it is the starting point of the paper's analysis of non-entry commitments (Proposition 5).

The result is proved in the paper; nothing here is open. No part of it is formalized. A machine-checked version adds a complete check of a proof that compresses several steps into "verifiable" remarks: the positivity of DDD and the sign of ENE_NEN​ under (5), and the single sign change of dM/dadM/dadM/da that defines aˉ1\bar a_1aˉ1​.

Difficulty

The seller's objective ΠS\Pi^SΠS is discontinuous at eS=Δ−ae_S=\Delta-aeS​=Δ−a, so the first-order condition alone does not locate the optimum: the candidates are the two unconstrained maximizers and the cutoff, and which one wins depends on aaa. The step that needs care is the existence of a single switching point aˉ1\bar a_1aˉ1​: it requires comparing the value of the constrained non-entry problem with the unconstrained entry optimum as a function of aaa, and showing that the comparison changes sign once. The polynomial sign facts behind Δ\DeltaΔ, namely D>0D>0D>0 and EN<0E_N<0EN​<0 on the parameter box under (5), are elementary but involve quartic polynomials in three variables.

Formalization scope

All quantities are real numbers. The standing ranges δ,β∈[0,1]\delta,\beta\in[0,1]δ,β∈[0,1], f∈[0,1)f\in[0,1)f∈[0,1), cS>1/2c_S>1/2cS​>1/2 are hypotheses, as are condition (5) (assumed by the paper from p. 12 on) and K>0K>0K>0 (not stated by the paper, but presupposed by its formula for Δ\DeltaΔ; with K≤0K\le 0K≤0 the threshold degenerates to 0). Only the branch of Δ\DeltaΔ and ΠE−NP\Pi^P_{E-N}ΠE−NP​ for which (5) holds is formalized; the paper's proof also covers the regime where (5) fails, with H=0H=0H=0.

The closed forms (6), (7), the entry gain ΠE−NP\Pi^P_{E-N}ΠE−NP​ and Δ\DeltaΔ are definitions taken from the paper. Their derivation from the second-stage Cournot game (Lemmas 1–2) is the subject of the companion mission On the Platform’s Entry I. The piecewise profit ΠS\Pi^SΠS is the printed one, with the tie eS+a=Δe_S+a=\DeltaeS​+a=Δ assigned to non-entry.

Efforts range over all of R\mathbb RR. This is the paper's implicit domain and it matters: the optimal effort Δ−a\Delta-aΔ−a is negative for some parameters (for instance δ=f=0\delta=f=0δ=f=0, β=1/2\beta=1/2β=1/2, cS=K=1c_S=K=1cS​=K=1 and aaa slightly above Δ\DeltaΔ), so a version restricted to eS≥0e_S\ge 0eS​≥0 would be false. "Optimal" means a global maximizer, with ties allowed; at a=aˉ1a=\bar a_1a=aˉ1​ two efforts are optimal and at H=1/4H=1/4H=1/4 the middle interval is empty.

Trivializing formalizations are ruled out: a‾1\underline a_1a​1​ is pinned by its defining equation rather than chosen, every hypothesis is satisfiable (at δ=f=0\delta=f=0δ=f=0, β=1/2\beta=1/2β=1/2 one has H=676/9409≤1/4H=676/9409\le 1/4H=676/9409≤1/4), and the sign conditions keep Δ\DeltaΔ from collapsing to a junk value of division or square root.

A complete development needs only real analysis of quadratics and polynomial inequalities on a box; contributions of reusable lemmas on maximizing concave quadratics under a threshold constraint are welcome.

Selected references

  • L. Qi, H. Song, W. Xiao, Coopetition in Platform-Based Retailing: On the Platform’s Entry, Management Science, 2025. https://doi.org/10.1287/mnsc.2023.00260
  • F. Zhu, Q. Liu, Competing with complementors: An empirical look at Amazon.com, Strategic Management Journal 39(10), 2018. https://doi.org/10.1002/smj.2932
11 thms1 active userReviewed
Optimization·Captain: mikedeng1

Simultaneous vs. Sequential: Optimal Assortment Recommendation in Multistore Retailing I: Under Simultaneous Recommendation, Offering the Single-Store Optimal Assortment in Every Store Is OptimalResearch Paper

Motivation

Retail chains increasingly run their physical stores and online channels as one network. A customer who walks into a store and finds nothing she wants can be shown products stocked in other stores of the chain, to be shipped or picked up later. This raises a basic assortment question: when every store can point its customers to the rest of the network, should the stores still carry the assortment each would choose on its own, or should they coordinate?

Liu, Chen, Liu and Wan (MSOM 2025, DOI 10.1287/msom.2024.0761) compare two ways of showing the network's products. Under simultaneous recommendation (SMR), a customer sees her store's products and the other stores' products at the same time. Under sequential recommendation (SQR), she sees the other stores' products only after declining everything in her own store. This mission formalizes the paper's result for SMR, Theorem 1, together with the lemmas of its proof and two consequences (Theorem 5(a) and Proposition 2). The single-store model it builds on is the multinomial logit (MNL) assortment problem of Talluri and van Ryzin (2004).

Setting

A seller operates mmm stores and sells nnn products, indexed 1,…,n1,\dots,n1,…,n, with revenues r1>r2>⋯>rn>0r_1>r_2>\dots>r_n>0r1​>r2​>⋯>rn​>0. Product kkk has attraction value vk=exp⁡(uk)>0v_k=\exp(u_k)>0vk​=exp(uk​)>0, where uku_kuk​ is its utility; the no-purchase option has attraction value 111. A fraction λi≥0\lambda_i\ge0λi​≥0 of customers first visits store iii, and ∑iλi=1\sum_i\lambda_i=1∑i​λi​=1.

An assortment profile S=(S1,…,Sm)\mathbf S=(S_1,\dots,S_m)S=(S1​,…,Sm​) lists the set Si⊆N={1,…,n}S_i\subseteq\mathcal N=\{1,\dots,n\}Si​⊆N={1,…,n} offered by each store. Write Sˉ=S1∪⋯∪Sm\bar S=S_1\cup\dots\cup S_mSˉ=S1​∪⋯∪Sm​ for the products offered somewhere. A customer of store iii who buys product kkk from store jjj suffers a utility discount cijk≥0c_{ij}^k\ge0cijk​≥0, with ciik=0c_{ii}^k=0ciik​=0. She buys from the cheapest store that offers kkk, so the effective discount is cik(S)=min⁡{cijk:k∈Sj}c_i^k(\mathbf S)=\min\{c_{ij}^k: k\in S_j\}cik​(S)=min{cijk​:k∈Sj​}, and cik(S)=∞c_i^k(\mathbf S)=\inftycik​(S)=∞ if no store offers kkk.

Under SMR, the customer of store iii chooses product kkk with the MNL probability

pikM(S)={vkDi(S),k∈Si,vke−cik(S)Di(S),k∈Sˉ∖Si,0,otherwise,Di(S)=1+∑l∈Sivl+∑l∈Sˉ∖Sivle−cil(S).p^M_{ik}(\mathbf S)=\begin{cases}\dfrac{v_k}{D_i(\mathbf S)},&k\in S_i,\\[2mm]\dfrac{v_ke^{-c_i^k(\mathbf S)}}{D_i(\mathbf S)},&k\in\bar S\setminus S_i,\\[2mm]0,&\text{otherwise},\end{cases}\qquad D_i(\mathbf S)=1+\sum_{l\in S_i}v_l+\sum_{l\in\bar S\setminus S_i}v_le^{-c_i^l(\mathbf S)}.pikM​(S)=⎩⎨⎧​Di​(S)vk​​,Di​(S)vk​e−cik​(S)​,0,​k∈Si​,k∈Sˉ∖Si​,otherwise,​Di​(S)=1+l∈Si​∑​vl​+l∈Sˉ∖Si​∑​vl​e−cil​(S).

The seller's problem is

max⁡S RM(S)=∑i=1mλi∑k=1nrk pikM(S).(SMR)\max_{\mathbf S}\ R_M(\mathbf S)=\sum_{i=1}^m\lambda_i\sum_{k=1}^nr_k\,p^M_{ik}(\mathbf S).\tag{SMR}Smax​ RM​(S)=i=1∑m​λi​k=1∑n​rk​pikM​(S).(SMR)

The single-store problem is

R∗=max⁡S⊆N∑k∈Srkvk1+∑k∈Svk.(3)R^*=\max_{S\subseteq\mathcal N}\frac{\sum_{k\in S}r_kv_k}{1+\sum_{k\in S}v_k}.\tag{3}R∗=S⊆Nmax​1+∑k∈S​vk​∑k∈S​rk​vk​​.(3)

An assortment is revenue-ordered if it is {1,…,k}\{1,\dots,k\}{1,…,k} for some k∈[n]k\in[n]k∈[n]. The paper writes S~\tilde SS~ for the smallest revenue-ordered optimal solution of (3).

Formalization targets

Goal: Theorem 1

RM(S) ≤ RM(S~,S~,…,S~)for every profile S.R_M(\mathbf S)\ \le\ R_M(\tilde S,\tilde S,\dots,\tilde S)\qquad\text{for every profile }\mathbf S.RM​(S) ≤ RM​(S~,S~,…,S~)for every profile S.

Offering the single-store optimal assortment in every store is optimal under SMR. The goal asserts optimality, not uniqueness: with ties, other profiles can be optimal too.

Milestones

  1. Existence of S~\tilde SS~ (p. 11): some revenue-ordered assortment is optimal for (3).
  2. Proposition A.1: in the two-store problem (A.1), store 1 offers products 1 through some threshold. A product belongs to the smallest revenue-ordered optimum if and only if its revenue exceeds the optimal value.
  3. Proposition A.2: the optimal value of (A.1) does not decrease when the discounts increase.
  4. The store-wise reduction: store iii's SMR revenue equals the objective of problem (A.2), the single-store problem with the other stores' products as discounted alternatives.
  5. The store-wise bound: every store earns at most R∗R^*R∗ under any profile, and exactly R∗R^*R∗ under (S~,…,S~)(\tilde S,\dots,\tilde S)(S~,…,S~).

Companions

  • Theorem 5(a): max⁡SRQ(S)≥max⁡SRM(S)\max_{\mathbf S}R_Q(\mathbf S)\ge\max_{\mathbf S}R_M(\mathbf S)maxS​RQ​(S)≥maxS​RM​(S), where RQR_QRQ​ is the SQR revenue built from the sequential choice probabilities (2).
  • Proposition 2: when store mmm is an online channel with Sm=NS_m=\mathcal NSm​=N, and cimk=ck>0c_{im}^k=c^k>0cimk​=ck>0 for every physical store iii, some optimal profile among those with Sm=NS_m=\mathcal NSm​=N offers one and the same revenue-ordered assortment S^⊇S~\hat S\supseteq\tilde SS^⊇S~ in every physical store.

Significance

Theorem 1 says that under simultaneous recommendation the network adds nothing for the seller: the revenue of independently run stores, R∗R^*R∗, is the best achievable. The paper calls this revenue the benchmark. Every later comparison is made against it. The sequential strategy beats it (Theorem 5(a)), and the paper's structural results on SQR and its ½-approximation are phrased relative to S~\tilde SS~ and R∗R^*R∗. Proposition 2 shows that adding an online channel enlarges the optimal assortments of the physical stores.

The results are proved in the paper, partly in an Additional Supplement. As far as is known, none of them has a machine-checked proof. The mission produces a reusable Lean model of multi-store MNL choice with cross-store discounts, the SQR choice probabilities, and checked proofs of the single-store threshold structure with discounted outside products (Propositions A.1 and A.2).

Difficulty

A store's SMR revenue depends on every other store's assortment, through both the denominator Di(S)D_i(\mathbf S)Di​(S) and the products of Sˉ∖Si\bar S\setminus S_iSˉ∖Si​. The objective does not separate across stores, so the obvious idea of optimizing each store on its own does not directly apply. Products of other stores enter at reduced weight e−cike^{-c_i^k}e−cik​, so the standard MNL result for (3) does not cover (A.1).

Proposition A.1's exchange argument has two cases, depending on whether the added product is already available elsewhere. In the second case the gain is weighted by 1−e−ck1-e^{-c^k}1−e−ck, which vanishes when ck=0c^k=0ck=0. Proposition A.2 compares optimal values across two discount vectors whose optimal assortments differ.

Formalization scope

Products are Fin n (the paper's product kkk is index k−1k-1k−1), stores are Fin m, and a profile is a function Fin m → Finset (Fin n). The attraction values vk>0v_k>0vk​>0 are the primitive parameters. The discount factor e−cik(S)e^{-c_i^k(\mathbf S)}e−cik​(S) is the largest e−cijke^{-c_{ij}^k}e−cijk​ over the offering stores, and 000 when none offers kkk. In (A.1) the discounts are encoded by the factors βk=e−ck∈[0,1]\beta_k=e^{-c^k}\in[0,1]βk​=e−ck∈[0,1], with βk=0\beta_k=0βk​=0 for ck=∞c^k=\inftyck=∞. S~\tilde SS~ and SM∗(c)S^*_M(\mathbf c)SM∗​(c) are predicates: revenue-ordered (hence nonempty), optimal, and of least cardinality among revenue-ordered optima. "Optimal" means a global maximizer, and comparisons of optimal values are written as "for every TTT there is an SSS with f(T)≤g(S)f(T)\le g(S)f(T)≤g(S)", with no maximum operator. The SMR and SQR objectives are written from the choice probabilities (1) and (2), exactly as the paper writes them.

The standing assumptions are explicit hypotheses: λi≥0\lambda_i\ge0λi​≥0, ∑iλi=1\sum_i\lambda_i=1∑i​λi​=1, rrr strictly decreasing, vk>0v_k>0vk​>0, cijk≥0c_{ij}^k\ge0cijk​≥0, ciik=0c_{ii}^k=0ciik​=0. Two hypotheses are pinned. The first is rk>0r_k>0rk​>0: revenues are prices, which the paper uses but never states as a sign condition. The second applies only to the second part of Proposition A.1: ck>0c^k>0ck>0, because its "if and only if" fails at ck=0c^k=0ck=0; the existence of a revenue-ordered optimum is stated for every c≥0\mathbf c\ge0c≥0. The goal and Proposition A.2 keep cijk≥0c_{ij}^k\ge0cijk​≥0, so zero cross-store discounts are allowed. The Gumbel derivation of (2) (Proposition 1, cited from Gao et al. 2021) is not formalized; (1) and (2) are the model.

The hypothesis on S~\tilde SS~ is satisfiable: its existence is the first milestone. A statement that assumed some optimal profile, or that defined R∗R^*R∗ through a junk-valued supremum, would be trivial or vacuous, and the formalization avoids both. Contributions are welcome on any milestone. Propositions A.1 and A.2 are reusable for other multi-store and omnichannel MNL problems.

Selected references

  • Y. Liu, X. A. Chen, Y. Liu, Z. Wan, Simultaneous vs. Sequential: Optimal Assortment Recommendation in Multistore Retailing, Manufacturing & Service Operations Management, 2025. https://doi.org/10.1287/msom.2024.0761 (cited from the authors' manuscript of 2024-09-17 with its Online and Additional Supplements)
  • K. Talluri, G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • P. Gao, Y. Ma, N. Chen, G. Gallego, A. Li, P. Rusmevichientong, H. Topaloglu, Assortment Optimization and Pricing Under the Multinomial Logit Model with Impatient Customers: Sequential Recommendation and Selection, Operations Research 69(5):1509–1532, 2021.
10 thms1 active userReviewed
Functional AnalysisOptimizationPartial Differential Equations+1·Captain: mikedeng1

Optimality Conditions in Control Problems with Random State Constraints in Probabilistic or Almost Sure Form III: Absolutely Continuous and Singular Multipliers for Almost Sure State ConstraintsResearch Paper

Motivation

Optimal control of partial differential equations under uncertainty asks for a single deterministic control uuu that performs well when the data of the PDE are random. When a constraint on the state must hold, the modeller has to decide how strictly: with high probability (a probabilistic constraint), for almost every realization (an almost-sure constraint), or for every realization in a support set (a robust constraint). C. Geiersbach and R. Henrion (arXiv:2306.03965v2, Math. Oper. Res. 2025) derive optimality conditions for all three forms on a common model problem. This mission covers §3.1 of that paper, the almost-sure case.

Almost-sure state constraints are the natural model when a bound (a temperature, a stress, a concentration) must never be violated, and they appear throughout risk-averse PDE-constrained optimization (Geiersbach and Wollner, SIAM J. Optim. 2021; Geiersbach and Hintermüller, ESAIM:COCV 2022). Their difficulty is functional-analytic: the constraint lives in LP∞(Ω,C(Dˉ))L^\infty_{\mathbb P}(\Omega,\mathcal C(\bar D))LP∞​(Ω,C(Dˉ)), a space whose dual is not a function space, so Lagrange multipliers are a priori only finitely additive objects.

Setting

Let D⊆RdD\subseteq\mathbb R^dD⊆Rd, d∈{1,2,3}d\in\{1,2,3\}d∈{1,2,3}, be open, bounded and of class S: there are γ∈(0,1)\gamma\in(0,1)γ∈(0,1) and r0>0r_0>0r0​>0 with meas⁡(Br(x)∖D)≥γmeas⁡(Br(x))\operatorname{meas}(B_r(x)\setminus D)\ge\gamma\operatorname{meas}(B_r(x))meas(Br​(x)∖D)≥γmeas(Br​(x)) for all x∈∂Dx\in\partial Dx∈∂D and 0<r<r00<r<r_00<r<r0​. For F∈L2(D)F\in L^2(D)F∈L2(D) the Dirichlet problem −Δy=F-\Delta y=F−Δy=F in DDD, y=0y=0y=0 on ∂D\partial D∂D has a unique weak solution y∈H01(D)∩C(Dˉ)y\in H^1_0(D)\cap\mathcal C(\bar D)y∈H01​(D)∩C(Dˉ); the solution map is a continuous linear operator A−1:L2(D)→C(Dˉ)A^{-1}:L^2(D)\to\mathcal C(\bar D)A−1:L2(D)→C(Dˉ).

Let (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) be a probability space and f~∈LP∞(Ω,L2(D))\tilde f\in L^\infty_{\mathbb P}(\Omega,L^2(D))f~​∈LP∞​(Ω,L2(D)) a random source. For a control u∈L2(D)u\in L^2(D)u∈L2(D) the random state y(⋅,ω)y(\cdot,\omega)y(⋅,ω) solves −Δy(⋅,ω)=u+f~(⋅,ω)-\Delta y(\cdot,\omega)=u+\tilde f(\cdot,\omega)−Δy(⋅,ω)=u+f~​(⋅,ω), y(⋅,ω)=0y(\cdot,\omega)=0y(⋅,ω)=0 on ∂D\partial D∂D. With B\mathcal BB the embedding of L2(D)L^2(D)L2(D) into constant elements of LP∞(Ω,L2(D))L^\infty_{\mathbb P}(\Omega,L^2(D))LP∞​(Ω,L2(D)) and [A−1y](ω)=A−1y(⋅,ω)[\mathcal A^{-1}y](\omega)=A^{-1}y(\cdot,\omega)[A−1y](ω)=A−1y(⋅,ω), the control-to-state operator is S(u)=A−1(Bu+f~)\mathcal S(u)=\mathcal A^{-1}(\mathcal Bu+\tilde f)S(u)=A−1(Bu+f~​) and the constraint map is G(u)=S(u)−α\mathcal G(u)=\mathcal S(u)-\boldsymbol\alphaG(u)=S(u)−α, where α\boldsymbol\alphaα is the constant function α∈R\alpha\in\mathbb Rα∈R. The problem is

min⁡u∈L2(D)F(u)s.t.G(u)∈K,(51)\min_{u\in L^2(D)}F(u)\quad\text{s.t.}\quad\mathcal G(u)\in\mathcal K,\qquad(51)u∈L2(D)min​F(u)s.t.G(u)∈K,(51)

with the cone K={y∈LP∞(Ω,C(Dˉ)):y(x,ω)≤0 on Dˉ, P-a.s.}\mathcal K=\{y\in L^\infty_{\mathbb P}(\Omega,\mathcal C(\bar D)):y(x,\omega)\le0\text{ on }\bar D,\ \mathbb P\text{-a.s.}\}K={y∈LP∞​(Ω,C(Dˉ)):y(x,ω)≤0 on Dˉ, P-a.s.} and its polar K−⊆(LP∞(Ω,C(Dˉ)))∗\mathcal K^-\subseteq(L^\infty_{\mathbb P}(\Omega,\mathcal C(\bar D)))^*K−⊆(LP∞​(Ω,C(Dˉ)))∗. The cost FFF is convex and continuously Fréchet differentiable.

For a separable Banach space XXX, a functional v∈(LP∞(Ω,X))∗v\in(L^\infty_{\mathbb P}(\Omega,X))^*v∈(LP∞​(Ω,X))∗ is absolutely continuous if ⟨v,x⟩=∫Ω⟨x∗(ω),x(ω)⟩ dP\langle v,x\rangle=\int_\Omega\langle x^*(\omega),x(\omega)\rangle\,d\mathbb P⟨v,x⟩=∫Ω​⟨x∗(ω),x(ω)⟩dP for a weakly measurable x∗:Ω→X∗x^*:\Omega\to X^*x∗:Ω→X∗ with ∫∥x∗∥ dP<∞\int\|x^*\|\,d\mathbb P<\infty∫∥x∗∥dP<∞ (the set Λ1(X∗)\Lambda_1(X^*)Λ1​(X∗) of such x∗x^*x∗), and singular if it vanishes on every xxx that vanishes on some FnF_nFn​, for a decreasing sequence of events with P(Fn)→0\mathbb P(F_n)\to0P(Fn​)→0 (the set Λ∘(X∗)\Lambda_\circ(X^*)Λ∘​(X∗)).

Formalization targets

Goal: Theorem 3.10

Under the constraint qualification 0∈int⁡{G(L2(D))−K}0\in\operatorname{int}\{\mathcal G(L^2(D))-\mathcal K\}0∈int{G(L2(D))−K}, u∗u^*u∗ solves (51) if and only if there are λ∈Λ1(C(Dˉ)∗)\lambda\in\Lambda_1(\mathcal C(\bar D)^*)λ∈Λ1​(C(Dˉ)∗), λ∘∈Λ∘(C(Dˉ)∗)\lambda^\circ\in\Lambda_\circ(\mathcal C(\bar D)^*)λ∘∈Λ∘​(C(Dˉ)∗) and a state y∗y^*y∗ with

DF(u∗)+E[A−∗λ]+B∗A−∗λ∘=0,Ay∗(⋅,ω)=u∗+f~(⋅,ω),DF(u^*)+\mathbb E[A^{-*}\lambda]+\mathcal B^*\mathcal A^{-*}\lambda^\circ=0,\qquad Ay^*(\cdot,\omega)=u^*+\tilde f(\cdot,\omega),DF(u∗)+E[A−∗λ]+B∗A−∗λ∘=0,Ay∗(⋅,ω)=u∗+f~​(⋅,ω), y∗(⋅,ω)≤α,λ(⋅,ω)≥0,⟨λ(⋅,ω),y∗(⋅,ω)−α⟩=0  P-a.s.,λ∘∈K−,⟨λ∘,y∗−α⟩=0.y^*(\cdot,\omega)\le\alpha,\quad\lambda(\cdot,\omega)\ge0,\quad\langle\lambda(\cdot,\omega),y^*(\cdot,\omega)-\boldsymbol\alpha\rangle=0\ \ \mathbb P\text{-a.s.},\qquad\lambda^\circ\in\mathcal K^-,\quad\langle\lambda^\circ,y^*-\boldsymbol\alpha\rangle=0.y∗(⋅,ω)≤α,λ(⋅,ω)≥0,⟨λ(⋅,ω),y∗(⋅,ω)−α⟩=0  P-a.s.,λ∘∈K−,⟨λ∘,y∗−α⟩=0.

Milestones

  1. Lemma 3.6: the random state exists, is a.s. unique, lies in LP∞(Ω,C(Dˉ))L^\infty_{\mathbb P}(\Omega,\mathcal C(\bar D))LP∞​(Ω,C(Dˉ)), and obeys the bound (52).
  2. Lemma 3.7: the abstract KKT system (53) with a multiplier λ∗∈(LP∞(Ω,C(Dˉ)))∗\lambda^*\in(L^\infty_{\mathbb P}(\Omega,\mathcal C(\bar D)))^*λ∗∈(LP∞​(Ω,C(Dˉ)))∗.
  3. Theorem 3.9 (Ioffe–Levin): every v∗∈(LP∞(Ω,X))∗v^*\in(L^\infty_{\mathbb P}(\Omega,X))^*v∗∈(LP∞​(Ω,X))∗ splits uniquely as va+v∘v^a+v^\circva+v∘ with ∥v∗∥=∥va∥+∥v∘∥\|v^*\|=\|v^a\|+\|v^\circ\|∥v∗∥=∥va∥+∥v∘∥.
  4. The splitting ⟨λ∗,A−1Bh⟩=E[⟨λ,A−1h⟩]+⟨λ∘,A−1Bh⟩\langle\lambda^*,\mathcal A^{-1}\mathcal Bh\rangle=\mathbb E[\langle\lambda,A^{-1}h\rangle]+\langle\lambda^\circ,\mathcal A^{-1}\mathcal Bh\rangle⟨λ∗,A−1Bh⟩=E[⟨λ,A−1h⟩]+⟨λ∘,A−1Bh⟩.
  5. (57): λ∗∈K−\lambda^*\in\mathcal K^-λ∗∈K− passes to both parts.
  6. (59) and pointwise complementarity: λ(ω)≥0\lambda(\omega)\ge0λ(ω)≥0 and ⟨λ(ω),y∗(ω)−α⟩=0\langle\lambda(\omega),y^*(\omega)-\boldsymbol\alpha\rangle=0⟨λ(ω),y∗(ω)−α⟩=0 almost surely.

Significance

The result. Lemma 3.7 gives a multiplier in the dual of L∞L^\inftyL∞, which cannot be evaluated scenario by scenario. Theorem 3.10 shows that, for this problem, the multiplier consists of an honest random variable λ(ω)∈C(Dˉ)∗\lambda(\omega)\in\mathcal C(\bar D)^*λ(ω)∈C(Dˉ)∗ (a random signed measure on Dˉ\bar DDˉ) satisfying sign and complementarity conditions for almost every realization, plus a singular remainder. This is the form needed to write adjoint equations and to design discretizations and algorithms (Proposition 3.12 of the paper). As Remark 3.11 notes, the derivation does not require reflexivity of the state space, unlike earlier work on LP∞(Ω,X)L^\infty_{\mathbb P}(\Omega,X)LP∞​(Ω,X)-constraints.

Formalizing it. The paper's argument is complete, but it rests on two cited results: the regularity theory behind Lemma 1.2/3.6 (Stampacchia-type continuity of weak solutions on class-S domains, Kinderlehrer–Stampacchia) and the Ioffe–Levin decomposition of (LP∞(Ω,X))∗(L^\infty_{\mathbb P}(\Omega,X))^*(LP∞​(Ω,X))∗ (Ioffe–Levin, Appendix 1, Theorem 3, and Levin 1974). Neither is in Mathlib. A formal development produces machine-checked versions of both, of a Robinson-type KKT theorem in Banach spaces, and of the multiplier refinement itself. None of these results has a machine-checked proof as far as the platform's catalog shows.

Difficulty

The obvious route is to apply the Riesz representation pointwise in ω\omegaω. It fails: (LP∞(Ω,C(Dˉ)))∗(L^\infty_{\mathbb P}(\Omega,\mathcal C(\bar D)))^*(LP∞​(Ω,C(Dˉ)))∗ contains purely finitely additive functionals that are not given by any integrand, so λ∗\lambda^*λ∗ has no density in general. The decomposition theorem isolates them, and the proof of Theorem 3.10 must then show that the sign condition λ∗∈K−\lambda^*\in\mathcal K^-λ∗∈K− and the complementarity condition pass to each part separately. The step from E[⟨λ,y⟩]≤0\mathbb E[\langle\lambda,y\rangle]\le0E[⟨λ,y⟩]≤0 for all y∈Ky\in\mathcal Ky∈K to "λ(ω)≥0\lambda(\omega)\ge0λ(ω)≥0 for almost every ω\omegaω, simultaneously for all nonnegative test functions" requires the separability of C(Dˉ)\mathcal C(\bar D)C(Dˉ); a version with a null set depending on the test function is weaker and is not the statement. Lemma 3.6 needs C(Dˉ)\mathcal C(\bar D)C(Dˉ)-regularity of weak solutions, which is where class S and d≤3d\le3d≤3 enter.

Formalization scope

Rd\mathbb R^dRd is EuclideanSpace ℝ (Fin d). L2(D)L^2(D)L2(D) is Lp ℝ 2 (volume.restrict D) and LP∞(Ω,X)L^\infty_{\mathbb P}(\Omega,X)LP∞​(Ω,X) is Lp X ⊤ P; their elements are a.e. classes, so every pointwise statement in ω\omegaω is stated P\mathbb PP-a.s. C(Dˉ)\mathcal C(\bar D)C(Dˉ) is C(closure D, ℝ) with [CompactSpace (closure D)] as an instance argument (implied by boundedness). Weak derivatives use the published HunterPDE.Shared.HasWeakDeriv; a weak solution in H01(D)∩C(Dˉ)H^1_0(D)\cap\mathcal C(\bar D)H01​(D)∩C(Dˉ) is encoded as continuity on Dˉ\bar DDˉ, zero boundary values, L2L^2L2 weak gradient and the weak form. A−1A^{-1}A−1 is a hypothesis: a continuous linear map L2(D)→C(Dˉ)L^2(D)\to\mathcal C(\bar D)L2(D)→C(Dˉ) whose values are weak solutions. "≤0\le0≤0 a.e. in DDD" for a function continuous on Dˉ\bar DDˉ is read as "≤0\le0≤0 on Dˉ\bar DDˉ"; "λ(⋅,ω)≥0\lambda(\cdot,\omega)\ge0λ(⋅,ω)≥0" as positivity of the functional. "Solution of (51)" is a global minimizer. (56a) is stated applied to every direction hhh.

Trivializing formalizations are ruled out: the state operator is tied to the PDE, not an arbitrary bounded operator; the multipliers carry their sign and complementarity conditions; absolutely continuous functionals require a weakly measurable, integrable density; singular functionals are concentrated on a decreasing sequence of events of vanishing probability, not merely "not absolutely continuous"; optimality is global.

Needed infrastructure: Lax–Milgram on H01(D)H^1_0(D)H01​(D) and continuity of weak solutions (Lemma 3.6); a KKT theorem under Robinson's constraint qualification (Lemma 3.7); the Yosida–Hewitt decomposition for finitely additive measures and a weak*-measurable representation of L1(Ω,X)∗L^1(\Omega,X)^*L1(Ω,X)∗ (Theorem 3.9). The decomposition theorem is reusable far beyond this mission; contributions toward any of these are welcome.

Selected references

  • C. Geiersbach, R. Henrion, Optimality conditions in control problems with random state constraints in probabilistic or almost-sure form, arXiv:2306.03965v2, 2024; Math. Oper. Res. 2025. https://arxiv.org/abs/2306.03965
  • A. D. Ioffe, V. L. Levin, Subdifferentials of convex functions, Trudy Moskov. Mat. Obshch. 26, 3–73, 1972 (Appendix 1, Theorem 3).
  • V. L. Levin, The Lebesgue decomposition for functionals on the vector-function space LX∞L^\infty_XLX∞​, Funct. Anal. Appl. 8(4), 314–317, 1974. https://doi.org/10.1007/bf01075488
  • K. Yosida, E. Hewitt, Finitely additive measures, Trans. Amer. Math. Soc. 72, 1952. https://doi.org/10.1090/S0002-9947-1952-0045194-X
  • J. F. Bonnans, A. Shapiro, Perturbation Analysis of Optimization Problems, Springer, 2000. https://doi.org/10.1007/978-1-4612-1394-9
  • C. Geiersbach, W. Wollner, Optimality conditions for convex stochastic optimization problems in Banach spaces with almost sure state constraints, SIAM J. Optim. 31(4), 2455–2480, 2021.
  • C. Geiersbach, M. Hintermüller, Optimality conditions and Moreau–Yosida regularization for almost sure state constraints, ESAIM: COCV 28, Paper No. 80, 2022. https://doi.org/10.1051/cocv/2022070
  • D. Kinderlehrer, G. Stampacchia, An Introduction to Variational Inequalities and Their Applications, Academic Press, 1980 (Chapter II, Appendices B and C). https://doi.org/10.1137/1.9780898719451
12 thms1 active userReviewed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Platform Financing vs. Trade Credit for Lending to Third-Party Sellers III: At Low Uncertainty the Platform's Optimal Loan Rate Is Below the Risk-Free Rate Exactly When Production Cost Is HighResearch Paper

Motivation

Small third-party sellers on e-commerce marketplaces often lack working capital to buy inventory. Two financing channels compete for them. Under trade credit, the supplier ships now and is paid after sales, bearing the seller's default risk. Under platform financing, the marketplace itself (Amazon Lending, Alibaba's microloans, JD's supply-chain finance) lends the seller the purchase cost at an interest rate it chooses, the supplier is paid upfront, and the platform bears the default risk. A platform that already earns a commission on every sale has a reason to lend that a bank does not: cheaper credit raises orders, and higher orders raise commission income.

R. Huang, G. Lai, X. Wang and W. Xiao study this in Platform Financing vs. Trade Credit for Lending to Third-Party Sellers (Management Science, 2024). Their §5 asks how a platform that can set its loan rate freely would set it. The answer at low demand uncertainty is a clean dichotomy in the production cost: the platform lends at exactly its own capital cost when cost is low, and strictly below its capital cost, subsidizing the loan, when cost is high. This mission formalizes that result, Proposition 8, together with the equilibrium analysis it rests on.

The source is the authors' manuscript on SSRN (abstract 4014045, titled Lending to Third-party Sellers with Platform Loan); every page and label below refers to that manuscript, not to the typeset journal article.

Setting

A seller with no capital buys q≥0q \ge 0q≥0 units from a supplier whose unit production cost is c>0c > 0c>0, and sells all of them on a platform at the market-clearing price p=a~−qp = \tilde a - qp=a~−q. The market size a~\tilde aa~ is uniform on [a−δ,a+δ][a - \delta, a + \delta][a−δ,a+δ] with 0<δ<a0 < \delta < a0<δ<a; δ\deltaδ measures demand uncertainty. The platform keeps a share φ∈[0,1)\varphi \in [0, 1)φ∈[0,1) of revenue and passes (1−φ)pq(1 - \varphi)pq(1−φ)pq to the seller. The supplier and the platform both have capital cost equal to the risk-free rate rf≥0r_f \ge 0rf​≥0, and selling is profitable in expectation: (1−φ)a>c(1+rf)(1 - \varphi)a > c(1 + r_f)(1−φ)a>c(1+rf​).

Under platform financing at loan rate r>−1r > -1r>−1, the game has two stages after rrr is fixed:

  1. the supplier sets an upfront wholesale price www and receives (w−c)q(1+rf)(w - c)q(1 + r_f)(w−c)q(1+rf​) in value;
  2. the seller, having seen www, borrows wqwqwq from the platform and chooses qqq to maximize E[((1−φ)(a~−q)q−wq(1+r))+]\mathbb E\big[((1 - \varphi)(\tilde a - q)q - wq(1 + r))^+\big]E[((1−φ)(a~−q)q−wq(1+r))+].

The seller has limited liability: if revenue (1−φ)(a~−q)q(1 - \varphi)(\tilde a - q)q(1−φ)(a~−q)q falls short of the debt wq(1+r)wq(1 + r)wq(1+r), she hands over all of it. The platform's profit is

ΠpP=E[φ(a~−q)q+min⁡{(1−φ)(a~−q)q, wq(1+r)}]−wq(1+rf).\Pi^P_p = \mathbb E\big[\varphi(\tilde a - q)q + \min\{(1 - \varphi)(\tilde a - q)q,\ wq(1 + r)\}\big] - wq(1 + r_f).ΠpP​=E[φ(a~−q)q+min{(1−φ)(a~−q)q, wq(1+r)}]−wq(1+rf​).

A subgame-perfect equilibrium at rate rrr is a price www and an order rule w′↦q(w′)w' \mapsto q(w')w′↦q(w′) such that the rule is a best response for the seller at every price, the supplier's price is optimal against the rule, and ties are broken as in the paper. The paper also defines a threshold rate r^1(δ)\hat r_1(\delta)r^1​(δ) (p. 15) below which the seller prefers platform financing to trade credit; the platform chooses rrr subject to the participation constraint r≤r^1(δ)r \le \hat r_1(\delta)r≤r^1​(δ). Write

δ2=(1−φ)a−c(1+rf)(2+6)(1−φ),cˉ=a(1−φ)21+rf.\delta_2 = \frac{(1 - \varphi)a - c(1 + r_f)}{(2 + \sqrt6)(1 - \varphi)}, \qquad \bar c = \frac{a(1 - \varphi)^2}{1 + r_f}.δ2​=(2+6​)(1−φ)(1−φ)a−c(1+rf​)​,cˉ=1+rf​a(1−φ)2​.

Formalization targets

Goal: Proposition 8 (p. 22)

Let ΠpP(r)\Pi^P_p(r)ΠpP​(r) be the platform's profit in a subgame-perfect equilibrium of the stage game at rate rrr, for an arbitrary choice of equilibrium at each feasible rate. If δ≤δ2\delta \le \delta_2δ≤δ2​, then

c≤cˉ  ⟹  r∗=rf is the unique maximizer of ΠpP on {−1<r≤r^1(δ)},c \le \bar c \implies r^* = r_f \text{ is the unique maximizer of } \Pi^P_p \text{ on } \{-1 < r \le \hat r_1(\delta)\},c≤cˉ⟹r∗=rf​ is the unique maximizer of ΠpP​ on {−1<r≤r^1​(δ)}, c>cˉ  ⟹  a maximizer exists, and every maximizer r∗ satisfies r∗<rf.c > \bar c \implies \text{a maximizer exists, and every maximizer } r^* \text{ satisfies } r^* < r_f.c>cˉ⟹a maximizer exists, and every maximizer r∗ satisfies r∗<rf​.

Milestones

  1. Lemma 2 (p. 13): the seller's unique best response to (w,r)(w, r)(w,r), with a no-default branch and a default branch.
  2. Proposition 2 (p. 13): the stage game has an equilibrium, and in every equilibrium wPw^PwP and qPq^PqP have the stated closed forms, switching at δr=a(1−φ)−c(1+r)(2+6)(1−φ)\delta_r = \frac{a(1-\varphi) - c(1+r)}{(2+\sqrt6)(1-\varphi)}δr​=(2+6​)(1−φ)a(1−φ)−c(1+r)​.
  3. (10) (pp. 35, 41): for δ≤δr\delta \le \delta_rδ≤δr​, the platform's equilibrium profit is an explicit rational function of rrr.
  4. The derivative (p. 43): ∂ΠpP(r)/∂r=G1(r)/(8(1−φ)2(1+r)2)\partial \Pi^P_p(r)/\partial r = G_1(r)/(8(1-\varphi)^2(1+r)^2)∂ΠpP​(r)/∂r=G1​(r)/(8(1−φ)2(1+r)2) with an explicit cubic G1G_1G1​.
  5. Case (a) (p. 43): c≤cˉc \le \bar cc≤cˉ implies G1≥0G_1 \ge 0G1​≥0 on (−1,rf](-1, r_f](−1,rf​].
  6. Case (b) (p. 43): c>cˉc > \bar cc>cˉ implies G1G_1G1​ is nonnegative up to some r7<rfr_7 < r_fr7​<rf​ and negative on (r7,rf](r_7, r_f](r7​,rf​].

Significance

The result separates two motives for platform lending. At low cost the platform gains nothing by undercutting its own capital cost, so the loan is priced at cost; at high cost the commission earned on the extra units ordered outweighs the interest forgone, so the platform subsidizes. The threshold cˉ\bar ccˉ is explicit and depends only on the mean market size, the commission share and the risk-free rate. Together with Proposition 7 of the same paper (whether the platform gains relative to trade credit), it is the paper's account of why marketplaces lend below market rates.

The proof in the paper is a chain of closed-form computations whose final steps are stated as "it can be verified". A formalization checks that chain end to end: the equilibrium of a limited-liability Stackelberg game with uniform demand, the reduction of the platform's objective to (10), and the sign analysis of G1G_1G1​. To our knowledge none of these steps has been machine-checked. The model file (uniform expectation, limited-liability payoffs, the equilibrium predicate with tie-breaks) is reusable for the two sister missions on the same paper and for other supply-chain-finance models with a uniform market-clearing price.

Difficulty

The objective is defined through an equilibrium, not a formula. The obvious approach, substituting the closed forms of Proposition 2 into the platform's profit, presupposes that every equilibrium has those closed forms; establishing this means solving the seller's piecewise problem (whose objective changes form where default becomes possible), then the supplier's problem over a piecewise best response, and handling the indifference point δ=δr\delta = \delta_rδ=δr​. Only then does the problem reduce to the one-variable function (10).

On that function, the low-cost case requires a polynomial inequality on a half-open interval in four parameters, and uniqueness needs strict monotonicity, not just a nonnegative derivative. The high-cost case requires both a single sign change of a cubic on (−1,rf](-1, r_f](−1,rf​] and the existence of a maximizer on a set that is open at −1-1−1, where the profit tends to −∞-\infty−∞.

Formalization scope

All objects live in the namespace PlatformFinance.EndogRate. Conventions committed to:

  • The expectation over a~\tilde aa~ is 12δ∫a−δa+δ\frac{1}{2\delta}\int_{a-\delta}^{a+\delta}2δ1​∫a−δa+δ​, an interval integral of a continuous integrand.
  • The standing assumptions are hypotheses: 0<δ0 < \delta0<δ, δ<a\delta < aδ<a (the reading of p. 8's "the smallest market size a−δa - \deltaa−δ is large enough so that the market clearing price is always positive"), 0≤φ<10 \le \varphi < 10≤φ<1 (the page allows φ=1\varphi = 1φ=1, which (1−φ)a>c(1+rf)(1 - \varphi)a > c(1 + r_f)(1−φ)a>c(1+rf​) excludes), c>0c > 0c>0, rf≥0r_f \ge 0rf​≥0, (1−φ)a>c(1+rf)(1 - \varphi)a > c(1 + r_f)(1−φ)a>c(1+rf​), and for platform financing r>−1r > -1r>−1 and c(1+r)<(a+δ)(1−φ)c(1 + r) < (a + \delta)(1 - \varphi)c(1+r)<(a+δ)(1−φ) (conditions (iii) and (ii), p. 36).
  • The equilibrium carries the paper's two tie-breaks: a seller who cannot earn a positive expected profit orders zero (proofs on pp. 31, 33), and the supplier's equilibrium price is the least optimal one (which puts δ=δr\delta = \delta_rδ=δr​ in Proposition 2's first branch).
  • The goal quantifies over an arbitrary family of equilibria, one per feasible rate; Proposition 2 shows such a family exists. The feasible set is {r:−1<r≤r^1(δ)}\{r : -1 < r \le \hat r_1(\delta)\}{r:−1<r≤r^1​(δ)} with r^1\hat r_1r^1​ the paper's closed form on p. 15.
  • Lemma 2 assumes w(1+r)<(1−φ)(a+δ)w(1 + r) < (1 - \varphi)(a + \delta)w(1+r)<(1−φ)(a+δ): above it every order earns zero and the maximizer is not unique; the paper's proof restricts to this range.

Corrections relative to the page: (10) is printed under the heading "the equilibrium profits under trade credit" on p. 35, a slip for platform financing; Proposition 8 states δ≤δ2\delta \le \delta_2δ≤δ2​ while its proof writes δ<δ2\delta < \delta_2δ<δ2​, and the statement follows Proposition 8.

A trivializing formalization is ruled out: the goal is stated about the platform's equilibrium profit, not about the closed form (10), and the high-cost clause asserts existence of a maximizer so that "every maximizer is below rfr_frf​" cannot hold vacuously.

Needed infrastructure: interval integrals of piecewise polynomials, optimization of one-variable piecewise functions, and real-polynomial sign arguments. Proofs of any milestone are welcome, as are alternative proofs of the cubic sign analysis.

Selected references

  • R. Huang, G. Lai, X. Wang, W. Xiao, Lending to Third-party Sellers with Platform Loan, SSRN manuscript 4014045. https://ssrn.com/abstract=4014045
  • R. Huang, G. Lai, X. Wang, W. Xiao, Platform Financing vs. Trade Credit for Lending to Third-Party Sellers, Management Science, 2024. https://doi.org/10.1287/mnsc.2022.00201
8 thms1 active userReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Stability of a Queue Fed by Scheduled Traffic at Critical Loading 1: The Critically Loaded S/D/1 Workload Converges to a Finite Limit If and Only If the Perturbations Are Bounded AboveResearch Paper

Motivation

Many service systems do not receive random, memoryless traffic: customers are given appointments. Outpatient clinics, airport runways, container terminals and delivery slots all schedule arrivals on a regular grid, and the actual arrival deviates from the appointment by a random lateness or earliness. A queue fed by such scheduled traffic is a basic model for these systems, going back to Winsten (1959) and Mercer (1960, 1973), and Chen and Zhao (1997) used it with deterministic service times to model aircraft landings, proving stability under bounded perturbations.

Classical queueing theory says that a single-server queue fed by stationary traffic is stable when the mean work brought per unit time is below the service rate, and unstable when it is above (Loynes 1962). The boundary case, critical loading, is unstable for renewal traffic with non-degenerate interarrival times: the workload grows like t\sqrt tt​. Araman and Glynn ask what happens at critical loading when the traffic is scheduled and every customer brings the same amount of work, and show that the answer depends only on the right tail of the arrival perturbations.

Timeline. Winsten (1959) and Mercer (1960, 1973) analysed queues with scheduled arrivals and obtained waiting-time distributions in implicit form. Loynes (1962) proved the stability dichotomy for stationary input. Kingman (1962) showed that the heavy-traffic limit of the S/G/1 queue coincides with that of D/G/1 when perturbations are positive with finite mean. Chen and Zhao (1997) studied the S/D/1 queue with bounded perturbations. Araman and Glynn (2012) obtained a fractional-Brownian functional limit for scheduled traffic with infinite-mean perturbations, and Araman, Chen, Glynn and Xia (2022) showed that S/D/1 queues with Pareto-like perturbations behave unlike D/D/1 and G/D/1 queues. The present note (arXiv 2022; Operations Research technical note, 2025) settles stability at critical loading.

Setting

Fix a probability space (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) and a scheduling interval h>0h>0h>0. Customer j∈Zj\in\mathbb Zj∈Z is scheduled at time jhjhjh. Its perturbation ξj\xi_jξj​ is a real random variable, and the ξj\xi_jξj​ are independent and identically distributed with E∣ξ0∣<∞\mathbb E|\xi_0|<\inftyE∣ξ0​∣<∞. A uniform shift UUU, uniform on [0,1][0,1][0,1] and independent of ξ=(ξj)j∈Z\xi=(\xi_j)_{j\in\mathbb Z}ξ=(ξj​)j∈Z​, makes the arrival process stationary. Customer jjj arrives at

Aj=jh+hU+ξj,A_j = jh + hU + \xi_j ,Aj​=jh+hU+ξj​,

and for t≥0t\ge0t≥0 the arrival count is N(t)=#{j:Aj∈(0,t]}N(t)=\#\{j : A_j\in(0,t]\}N(t)=#{j:Aj​∈(0,t]}, so N(0)=0N(0)=0N(0)=0.

A single server works at unit rate and every customer brings exactly hhh units of work (the S/D/1 queue; "D" for deterministic service Vj=hV_j=hVj​=h). Since one customer is scheduled per hhh time units, the queue is critically loaded. The system is empty at time 000, and the workload at time t≥0t\ge0t≥0 is

W(t)=sup⁡0≤s≤t(h(N(t)−N(s))−(t−s)).W(t)=\sup_{0\le s\le t}\Big(h\big(N(t)-N(s)\big)-(t-s)\Big).W(t)=0≤s≤tsup​(h(N(t)−N(s))−(t−s)).

The proof runs in reversed time. With reversed arrival times Rj=jh+Uh−ξjR_j = jh+Uh-\xi_jRj​=jh+Uh−ξj​, let

Λ(s)=h⋅#{j:Rj∈(0,s]},M(t)=sup⁡0≤s≤t(Λ(s)−s).\Lambda(s)=h\cdot\#\{j: R_j\in(0,s]\},\qquad M(t)=\sup_{0\le s\le t}\big(\Lambda(s)-s\big).Λ(s)=h⋅#{j:Rj​∈(0,s]},M(t)=0≤s≤tsup​(Λ(s)−s).

Write ξ0+=max⁡(ξ0,0)\xi_0^+=\max(\xi_0,0)ξ0+​=max(ξ0​,0). "ξ0+\xi_0^+ξ0+​ is a bounded random variable" means that ξ0≤c\xi_0\le cξ0​≤c almost surely for some constant ccc.

Formalization targets

Goal: Theorem 1

∃ W(∞) finite-valued with W(t)⇒W(∞) (t→∞)⟺∃c,  ξ0≤c a.s.\exists\,W(\infty)\ \text{finite-valued with}\ W(t)\Rightarrow W(\infty)\ (t\to\infty)\quad\Longleftrightarrow\quad \exists c,\ \ \xi_0\le c\ \text{a.s.}∃W(∞) finite-valued with W(t)⇒W(∞) (t→∞)⟺∃c,  ξ0​≤c a.s.

The statement makes no assumption beyond the standing model. In particular the left tail of ξ0\xi_0ξ0​ is arbitrary (only Eξ0−<∞\mathbb E\xi_0^-<\inftyEξ0−​<∞).

The steps of the published proof (milestones)

  1. Loynes representation: W(t)=DM(t)W(t)\overset{\mathcal D}{=}M(t)W(t)=DM(t) for each t≥0t\ge0t≥0.
  2. Early customers: β1(s)≤Γ1\beta_1(s)\le\Gamma_1β1​(s)≤Γ1​ for all sss and EΓ1<∞\mathbb E\Gamma_1<\inftyEΓ1​<∞.
  3. Upper decomposition: #{j:Rj∈(0,s]}≤β1(s)+⌊s/h⌋+1+β2(s)\#\{j : R_j\in(0,s]\}\le\beta_1(s)+\lfloor s/h\rfloor+1+\beta_2(s)#{j:Rj​∈(0,s]}≤β1​(s)+⌊s/h⌋+1+β2​(s).
  4. Late customers under bounded perturbations: if every ξj≤c\xi_j\le cξj​≤c, then β2(s)≤⌊c/h⌋+1\beta_2(s)\le\lfloor c/h\rfloor+1β2​(s)≤⌊c/h⌋+1.
  5. Sufficiency: if ξ0+\xi_0^+ξ0+​ is bounded, then sup⁡s≥0(Λ(s)−s)<∞\sup_{s\ge0}(\Lambda(s)-s)<\inftysups≥0​(Λ(s)−s)<∞ a.s.
  6. Yn<∞Y_n<\inftyYn​<∞ for all nnn and Γ2<∞\Gamma_2<\inftyΓ2​<∞, a.s.
  7. Lower decomposition: n+Y~n≤Λ(nh)/h+Yn+Γ2n+\tilde Y_n\le\Lambda(nh)/h+Y_n+\Gamma_2n+Y~n​≤Λ(nh)/h+Yn​+Γ2​.
  8. Ergodic recurrence: 1n∑j≤nI(Yj≤l)→P(Y0≤l)\frac1n\sum_{j\le n}I(Y_j\le l)\to\mathbb P(Y_0\le l)n1​∑j≤n​I(Yj​≤l)→P(Y0​≤l) a.s.
  9. If ξ0+\xi_0^+ξ0+​ is unbounded, then P(Y~0>r)>0\mathbb P(\tilde Y_0>r)>0P(Y~0​>r)>0 for every rrr.
  10. If ξ0+\xi_0^+ξ0+​ is unbounded and P(Y0≤l)>0\mathbb P(Y_0\le l)>0P(Y0​≤l)>0, then Yn≤lY_n\le lYn​≤l and Y~n>r\tilde Y_n>rY~n​>r for infinitely many nnn, a.s.
  11. Necessity: if ξ0+\xi_0^+ξ0+​ is unbounded, then sup⁡s≥0(Λ(s)−s)=∞\sup_{s\ge0}(\Lambda(s)-s)=\inftysups≥0​(Λ(s)−s)=∞ a.s.

Here β1,β2\beta_1,\beta_2β1​,β2​ count reversed arrivals in (0,s](0,s](0,s] of customers j≤−1j\le-1j≤−1 and j≥⌊s/h⌋+1j\ge\lfloor s/h\rfloor+1j≥⌊s/h⌋+1; Γ1,Γ2,Yn,Y~n\Gamma_1,\Gamma_2,Y_n,\tilde Y_nΓ1​,Γ2​,Yn​,Y~n​ are the counts ∑j≥1I(−ξ−j>(j−1)h)\sum_{j\ge1}I(-\xi_{-j}>(j-1)h)∑j≥1​I(−ξ−j​>(j−1)h), ∑j≥1I(ξj≥(j−1)h)\sum_{j\ge1}I(\xi_j\ge(j-1)h)∑j≥1​I(ξj​≥(j−1)h), ∑j≥1I(−ξn+1−j>(j−2)h)\sum_{j\ge1}I(-\xi_{n+1-j}>(j-2)h)∑j≥1​I(−ξn+1−j​>(j−2)h) and ∑j≥1I(ξn+j+≥(j+2)h)\sum_{j\ge1}I(\xi^+_{n+j}\ge(j+2)h)∑j≥1​I(ξn+j+​≥(j+2)h).

Significance

The result. Theorem 1 shows that, unlike renewal traffic, scheduled traffic can keep a critically loaded queue stable, and it identifies exactly when: only late arrivals (the right tail of ξ0\xi_0ξ0​) can destabilise the queue, while arbitrarily early arrivals cannot. For appointment systems this says that a server whose capacity exactly matches the schedule has a finite stationary backlog precisely when lateness is bounded, so tardiness, not earliness, determines whether waiting times stay bounded. It complements Corollary 1 of the same note, a diffusion limit t−1/2W(t)⇒σX(1)t^{-1/2}W(t)\Rightarrow\sigma X(1)t−1/2W(t)⇒σX(1) for random service times at critical loading.

Formalizing it. The theorem is proved in the paper, but its proof contains several misprints: an identity that omits a term and has an infinite summand, a bound with a wrong constant, a sign error in YYY, a false inequality β2(s)≥Y~k(s)\beta_2(s)\ge\tilde Y_{k(s)}β2​(s)≥Y~k(s)​, and a conditional Borel–Cantelli step applied to non-adapted events. The milestones of this mission state the corrected inequalities, each checked by hand on small instances. A machine-checked proof would settle the argument. No part of it is formalized anywhere at present.

Difficulty

The forward workload W(t)W(t)W(t) is not monotone in ttt, so its convergence cannot be read off from its paths; the proof needs the time reversal to a monotone running maximum M(t)M(t)M(t), and the reversal of a perturbed lattice requires its stationarity under the uniform shift. In the unstable direction the obvious first idea is to show that Λ(s)−s\Lambda(s)-sΛ(s)−s is large for a fixed large sss. That fails: for each fixed sss the overshoot is a tight random variable. Large values occur only along random times at which many customers just after sss are very late while few customers just before sss are very early, and producing infinitely many such times needs an ergodic or Borel–Cantelli argument over a dependent stationary sequence. Mathlib has no pointwise ergodic theorem and no conditional Borel–Cantelli lemma, so this step needs new infrastructure.

Formalization scope

All declarations live in the namespace ScheduledQueue.Stability. The standing model is a bundle ScheduledInput P ξ U (measurable, i.i.d. via iIndepFun and IdentDistrib, Integrable (ξ 0), HasLaw U uniform on [0,1][0,1][0,1], and independence of U from the whole sequence). Customers are indexed by ℤ, time by ℝ, and t→∞t\to\inftyt→∞ is the atTop filter on ℝ. Convergence in distribution is Mathlib's TendstoInDistribution, and the limit is a probability measure on R\mathbb RR.

Conventions that differ from the printed page:

  • the workload is sup⁡0≤s≤t(h(N(t)−N(s))−(t−s))\sup_{0\le s\le t}(h(N(t)-N(s))-(t-s))sup0≤s≤t​(h(N(t)−N(s))−(t−s)); the printed ∑i=N(s)N(t)Vi\sum_{i=N(s)}^{N(t)}V_i∑i=N(s)N(t)​Vi​ counts customer N(s)N(s)N(s) and would give W(0)=h≠0W(0)=h\ne0W(0)=h=0, contradicting the theorem's hypothesis W(0)=0W(0)=0W(0)=0;
  • NNN counts arrivals in half-open intervals (0,t](0,t](0,t] (the printed closed intervals are not additive; both agree a.s. at fixed times);
  • the proof's displays are corrected: the upper decomposition (the page's identity omits j=0j=0j=0 and its β4\beta_4β4​ is infinite, and "M(t)≤max⁡β1+max⁡β2M(t)\le\max\beta_1+\max\beta_2M(t)≤maxβ1​+maxβ2​" mixes units), the β2\beta_2β2​ bound (⌊c/h⌋+1\lfloor c/h\rfloor+1⌊c/h⌋+1 instead of the printed, false (⌊c⌋+1)/h(\lfloor c\rfloor+1)/h(⌊c⌋+1)/h), the sign and range of YnY_nYn​, and the lower decomposition (the printed β2(s)≥Y~k(s)\beta_2(s)\ge\tilde Y_{k(s)}β2​(s)≥Y~k(s)​ is false);
  • the Borel–Cantelli milestone states the conclusion ("infinitely many nnn") rather than the stopping times τi\tau_iτi​.

Every count used inside a pointwise inequality is an extended natural number (Set.encard), so that statements such as "Γ2<∞\Gamma_2<\inftyΓ2​<∞ a.s." are not satisfied by the junk value 000 of an infinite Set.ncard. The goal's limit is a probability measure on R\mathbb RR, not on the extended reals, because there "W(t)⇒∞W(t)\Rightarrow\inftyW(t)⇒∞" would also count as convergence. "Bounded" means bounded almost surely, not pointwise. Measurability of W(t)W(t)W(t) is part of the conclusion of the "if" direction, not a hypothesis.

A complete development needs the stationarity and time reversal of the perturbed lattice point process, tail-sum bounds ∑jP(X>(j−1)h)≤EX/h+1\sum_j\mathbb P(X>(j-1)h)\le\mathbb EX/h+1∑j​P(X>(j−1)h)≤EX/h+1, a pointwise ergodic theorem for i.i.d. shifts (or a Lévy-type Borel–Cantelli argument), and measurability of suprema over intervals. The ergodic theorem and the reversal lemma are reusable well beyond this mission. Proofs of individual milestones, in any order, are welcome.

Selected references

  • V. F. Araman and P. W. Glynn, Stability of a Queue Fed by Scheduled Traffic at Critical Loading, arXiv preprint, 2022; Operations Research (technical note), 2025. https://arxiv.org/abs/2212.04164v1
  • R. M. Loynes, The stability of a queue with non-independent inter-arrival and service times, Mathematical Proceedings of the Cambridge Philosophical Society 58(3), 497–520, 1962. https://doi.org/10.1017/S0305004100036781
  • H. Chen and Y. J. Zhao, A new queueing model for aircraft landing process, AIAA, 1997. https://doi.org/10.2514/6.1997-3737
  • V. F. Araman, H. Chen, P. W. Glynn and L. Xia, On a single server queue fed by scheduled traffic with Pareto perturbations, Queueing Systems 100, 61–91, 2022.
  • J. F. C. Kingman, On queues in heavy traffic, Journal of the Royal Statistical Society, Series B 24(2), 383–392, 1962. http://www.jstor.org/stable/2984229
  • A. Mercer, Queues with scheduled arrivals: a correction, simplification and extension, Journal of the Royal Statistical Society, Series B 35(1), 104–116, 1973.
  • J. L. Doob, Stochastic Processes, Wiley, 1953.
14 thms1 active userReviewed
Algorithmic Game TheoryGraph Theory·Captain: mikedeng1

Flow Allocation Games 1: Every Unit-Ranking Game Has a Strong Equilibrium That Maximizes the Total FlowResearch Paper

Motivation

Financial firms owe each other money. When some firms cannot meet their obligations, the payments that actually clear in the network are a fixed point: what a firm can pay depends on what it receives, which depends on what others can pay. Eisenberg and Noe (Management Science, 2001) introduced this clearing model under a fixed pro-rata payment rule. Later work asked what happens when firms choose how to pay their creditors, which turns the clearing problem into a game.

Bertschinger, Hoefer and Schmand (arXiv:1908.01714v3; Mathematics of Operations Research, 2025) study this game in an abstract form, the flow allocation game. Each node of a directed network receives a fixed external supply plus whatever flows in, and decides how to split its total supply among its outgoing edges, subject to edge capacities. Each node wants to maximize its own total outflow (its payments, which in the financial reading is what keeps it solvent). The paper's first main result is that, when strategies rank single units of flow, there is always a strong equilibrium, stable against every coalition, which is at the same time socially optimal for the total flow.

Timeline:

  • 2001: Eisenberg and Noe, clearing payments under pro-rata rules, existence of a greatest clearing vector.
  • 2018: Csóka and Herings (Management Science): decentralized clearing with integral monotone allocation rules; the feasible flows form a complete lattice (restated for all monotone profiles as Theorem 2 of the present paper).
  • 2019–2025: Bertschinger, Hoefer and Schmand, strategic allocation; existence of optimal strong equilibria for unit-ranking strategies (Theorem 9), strong price of anarchy bounded by the min-max cycle length (Theorem 16), hardness results for other welfare functions and for edge-ranking strategies.

Setting

A flow allocation game Γ=(G,(bv)v∈V,(ce)e∈E)\Gamma = (G, (b_v)_{v\in V}, (c_e)_{e\in E})Γ=(G,(bv​)v∈V​,(ce​)e∈E​) consists of a finite directed multigraph G=(V,E)G = (V, E)G=(V,E), a fixed supply bv∈N0b_v \in \mathbb N_0bv​∈N0​ at each node and a capacity ce∈N0c_e \in \mathbb N_0ce​∈N0​ on each edge. E+(v)E^+(v)E+(v) and E−(v)E^-(v)E−(v) are the outgoing and incoming edges of vvv, and cv+=∑e∈E+(v)cec^+_v = \sum_{e\in E^+(v)} c_ecv+​=∑e∈E+(v)​ce​.

Every node is a player. A strategy profile a=(ae)e∈E\mathbf a = (a_e)_{e\in E}a=(ae​)e∈E​ assigns to each edge an allocation function ae:N0→N0a_e : \mathbb N_0 \to \mathbb N_0ae​:N0​→N0​: when the tail of eee has total supply yyy, it forwards ae(y)a_e(y)ae​(y) units on eee. The profile is unit-ranking if for all yyy, eee, vvv: ae(y)≤cea_e(y) \le c_eae​(y)≤ce​ (1); ∑e∈E+(v)ae(y)≤y\sum_{e\in E^+(v)} a_e(y) \le y∑e∈E+(v)​ae​(y)≤y (2); ∑e∈E+(v)ae(y)=min⁡{cv+,y}\sum_{e\in E^+(v)} a_e(y) = \min\{c^+_v, y\}∑e∈E+(v)​ae​(y)=min{cv+​,y} (no fraud, (3)); and each aea_eae​ is non-decreasing (5). Equivalently, every node ranks the single units of its outgoing capacity.

A flow f∈N0E\mathbf f \in \mathbb N_0^Ef∈N0E​ gives node vvv the total supply fv=bv+∑e∈E−(v)fef_v = b_v + \sum_{e\in E^-(v)} f_efv​=bv​+∑e∈E−(v)​fe​, and is feasible for a\mathbf aa if f(v,w)=a(v,w)(fv)f_{(v,w)} = a_{(v,w)}(f_v)f(v,w)​=a(v,w)​(fv​) on every edge (4). The clearing state f^\hat{\mathbf f}f^ of a\mathbf aa is the coordinatewise supremum of the feasible flows. Player vvv's utility is uv(a)=∑e∈E+(v)f^eu_v(\mathbf a) = \sum_{e\in E^+(v)} \hat f_euv​(a)=∑e∈E+(v)​f^​e​, and the total flow is Flow(a)=∑e∈Ef^e\mathrm{Flow}(\mathbf a) = \sum_{e\in E} \hat f_eFlow(a)=∑e∈E​f^​e​.

A unit-ranking profile a\mathbf aa is a strong equilibrium if no non-empty coalition C⊆VC \subseteq VC⊆V has a joint deviation aC′\mathbf a'_CaC′​ such that (aC′,a−C)(\mathbf a'_C, \mathbf a_{-C})(aC′​,a−C​) is unit-ranking and uv(aC′,a−C)>uv(a)u_v(\mathbf a'_C, \mathbf a_{-C}) > u_v(\mathbf a)uv​(aC′​,a−C​)>uv​(a) for all v∈Cv \in Cv∈C.

The circulation network G′G'G′ adds a node sss, an uncapacitated edge (v,s)(v, s)(v,s) and an edge (s,v)(s, v)(s,v) of capacity bvb_vbv​ for every vvv. An optimal circulation f∗f^*f∗ maximizes the total flow over all edges of G′G'G′.

Formalization targets

Goal: Theorem 9 (first sentence)

∃ a:a is a strong equilibrium  and  Flow(a′)≤Flow(a) for every unit-ranking a′.\exists\, \mathbf a:\quad \mathbf a \text{ is a strong equilibrium} \ \text{ and } \ \mathrm{Flow}(\mathbf a') \le \mathrm{Flow}(\mathbf a) \text{ for every unit-ranking } \mathbf a'.∃a:a is a strong equilibrium  and  Flow(a′)≤Flow(a) for every unit-ranking a′.

Milestones (in the order of the proof)

  1. Theorem 2 (p. 12, integral version p. 13): for a monotone profile the feasible flows form a non-empty complete lattice; the clearing state is its greatest element.
  2. Proposition 5 (p. 17): a feasible flow, with the non-forwarded flow max⁡{0,fv−cv+}\max\{0, f_v - c^+_v\}max{0,fv​−cv+​} sent to sss, is a circulation of G′G'G′, and ∑vmax⁡{0,fv−cv+}=∑vbv\sum_v \max\{0, f_v - c^+_v\} = \sum_v b_v∑v​max{0,fv​−cv+​}=∑v​bv​.
  3. Proof of Theorem 9, p. 23, first display: an optimal circulation saturates every (s,v)(s, v)(s,v) and
∑e∈E′fe∗=2∑vbv+Flow(f∗)≥2∑vbv+Flow(a).\sum_{e\in E'} f^*_e = 2\sum_v b_v + \mathrm{Flow}(f^*) \ge 2\sum_v b_v + \mathrm{Flow}(\mathbf a).e∈E′∑​fe∗​=2v∑​bv​+Flow(f∗)≥2v∑​bv​+Flow(a).
  1. Proof of Theorem 9, p. 23: with thresholds τe=fe∗\tau_e = f^*_eτe​=fe∗​ and arbitrary rankings, the threshold-ranking profile a∗\mathbf a^*a∗ is unit-ranking and its clearing state is f∗f^*f∗.
  2. Proof of Theorem 9, pp. 23–24: a profitable coalitional deviation from a unit-ranking profile produces a cycle of GGG on which the new clearing state carries strictly more flow.

Companion: Corollary 12

For every flow-monotone QQQ (if f^>f^′\hat{\mathbf f} > \hat{\mathbf f}'f^>f^′ then Q(a)≥Q(a′)Q(\mathbf a) \ge Q(\mathbf a')Q(a)≥Q(a′)) there is a strong equilibrium maximizing QQQ over all unit-ranking profiles.

Significance

Strong equilibria rarely exist in network games, and when they do they are usually not efficient. Theorem 9 gives both at once: every unit-ranking game has a strong equilibrium, and one of them maximizes the total flow, so the price of stability for Flow\mathrm{Flow}Flow is 111. Corollary 12 extends this to every flow-monotone welfare function, including egalitarian welfare, Nash social welfare and the number of solvent firms. In the financial reading, a coalition of firms cannot jointly reorder its payments to make every member better off, and the stable payment pattern can be chosen to clear the largest possible volume of debt.

The results are proved in the paper and, to our knowledge, have no machine-checked proof. Formalizing them yields a reusable Lean development of clearing states (the Knaster–Tarski structure of feasible flows), the circulation representation of feasible flows, and integral maximum circulations with a cycle-augmentation argument. The second mission of this series (strong price of anarchy, Theorem 16) builds on the same model.

Difficulty

The obvious argument fails at the deviation step. After a coalition deviates, the clearing state of the new profile is an implicit object: the greatest fixed point of a map that mixes the deviators' new strategies with everyone else's old ones. Nothing ties it pointwise to the optimal circulation, and comparing utilities alone gives no contradiction, because a deviator's gain can be paid for by flow that appears elsewhere in the network. The increase of flow has to be traced through deviators and non-deviators alike, and the two kinds of node obey different constraints.

A second difficulty is that the threshold profile built from an optimal circulation f∗f^*f∗ has clearing state exactly f∗f^*f∗. The clearing state is a supremum over all feasible flows, so it is not enough that f∗f^*f∗ is feasible. The claim depends on optimality: for a circulation that is not optimal it is false, as a two-node cycle carrying one unit on edges of capacity two already shows.

Formalization scope

All data are natural numbers: supplies, capacities, strategies ae:N→Na_e : \mathbb N \to \mathbb Nae​:N→N and flows, as the paper prescribes for unit-ranking games (p. 13). The graph is a finite type of edges with tail and head maps, so multi-edges and self-loops are allowed. A profile is one function on edges. The clearing state is the coordinatewise sSup in N\mathbb NN; the definition does not assume that the supremum is a feasible flow, which is milestone 1. Optimal circulations are optimal among integral circulations, which the paper justifies by integrality of capacities (p. 23). Natural-number subtraction is used only where it is the page's max⁡{0,⋅}\max\{0,\cdot\}max{0,⋅}.

Coalitions are non-empty. With C=∅C = \emptysetC=∅ the condition "every member strictly gains" holds vacuously and no profile would be a strong equilibrium; the paper reads it the same way (Proposition 4, Proposition 17). Deviations must again be unit-ranking profiles; the broader deviations of Remark 10 are not formalized. The maximization in the goal ranges over all unit-ranking profiles, not over threshold-ranking ones. A goal maximizing only over threshold profiles, or one that drops the optimality conjunct, is a strictly weaker theorem and is ruled out.

Out of scope: the second sentence of Theorem 9 (polynomial-time computation and polynomial-space representation) and the polynomial-space sentence of Corollary 12. Both need a model of computation. The threshold representation behind them is milestone 4.

A complete development needs: Knaster–Tarski on a finite product of intervals (Mathlib's OrderHom fixed-point lattice), flow conservation bookkeeping on finite multigraphs, existence of integral optimal circulations, and extraction of a cycle from an infinite backward walk in a finite graph. The last two are reusable beyond this mission. Proofs of any milestone, and sorry-free lemmas about clearing states, are welcome.

Selected references

  • N. Bertschinger, M. Hoefer, D. Schmand, Flow Allocation Games, Mathematics of Operations Research, 2025. Preprint arXiv:1908.01714v3, 2023. https://arxiv.org/abs/1908.01714v3
  • L. Eisenberg, T. H. Noe, Systemic Risk in Financial Systems, Management Science 47(2), 236–249, 2001. https://doi.org/10.1287/mnsc.47.2.236.9835
  • P. Csóka, P. J.-J. Herings, Decentralized Clearing in Financial Networks, Management Science 64(10), 4681–4699, 2018. https://doi.org/10.1287/mnsc.2017.2847
  • A. Tarski, A lattice-theoretical fixpoint theorem and its applications, Pacific Journal of Mathematics 5(2), 285–309, 1955. https://doi.org/10.2140/pjm.1955.5.285
8 thms1 active userReviewed
Linear OptimizationProbability·Captain: mikedeng1

Reducing Marketplace Interference Bias Via Shadow Prices 3: The Scaled Expected Matching Value Converges to the Fluid LP Value Φ(λ, π)Research Paper

Why a fluid limit for matching markets

Two-sided platforms (ride hailing, delivery, freelancing, logistics) collect demand and supply requests over a matching cycle and then clear them with an optimization problem. When such a platform runs an experiment, treated and control units compete for the same supply, so the outcome of one unit depends on the treatment of others. Interference bias of this kind is the subject of Bright, Delarue and Lobel, Reducing Marketplace Interference Bias Via Shadow Prices (arXiv:2205.02274v4; Management Science, 2025). Their analysis of estimators, including the shadow-price estimator built from linear-programming duals, is carried out in a deterministic fluid limit. Theorem 1 of the paper justifies that step: as the market becomes dense, the expected matching value per unit of density converges to the optimal value of a deterministic linear program with the arrival rates as inputs.

The same kind of statement, the expected value of a random linear program converging to the value of the program at the mean data, is also used in network revenue management and in stochastic matching, where fluid linear programs serve as benchmarks.

Setting

Network. There are ndn_dnd​ demand types and nsn_sns​ supply types. A directed network has one demand node uidu^d_iuid​ per demand type (a sink), one supply node ujsu^s_jujs​ per supply type (a source) and a finite set U∗\mathcal U_*U∗​ of intermediate nodes. Every arc (u,w)(u,w)(u,w) carries a value vu,w∈Rv_{u,w}\in\mathbb Rvu,w​∈R and a capacity ku,w≥0k_{u,w}\ge 0ku,w​≥0.

Matching program. For a density τ\tauτ, demand vector ddd and supply vector sss, Φτ(d,s)\Phi_\tau(d,s)Φτ​(d,s) is the maximum of ∑(u,w)vu,wxu,w\sum_{(u,w)} v_{u,w}x_{u,w}∑(u,w)​vu,w​xu,w​ over flows xxx with inflow at most did_idi​ at uidu^d_iuid​, outflow at most sjs_jsj​ at ujsu^s_jujs​, flow balance at every intermediate node and 0≤xu,w≤τku,w0\le x_{u,w}\le\tau k_{u,w}0≤xu,w​≤τku,w​ (display (2), p. 7). Write Φ:=Φ1\Phi:=\Phi_1Φ:=Φ1​. Without intermediate nodes this is a capacitated bipartite transportation problem.

Random counts. Demand units of type iii arrive at rate λi≥0\lambda_i\ge 0λi​≥0 and supply units of type jjj at rate πj≥0\pi_j\ge 0πj​≥0. At density τ\tauτ the numbers of units collected in one cycle are independent Poisson counts

Diτ,λ∼Poisson(λiτ),Sjτ∼Poisson(πjτ).D^{\tau,\lambda}_i\sim\mathrm{Poisson}(\lambda_i\tau),\qquad S^\tau_j\sim\mathrm{Poisson}(\pi_j\tau).Diτ,λ​∼Poisson(λi​τ),Sjτ​∼Poisson(πj​τ).

Treatment effect. If a treatment changes the demand rates from λ\lambdaλ to λ+β\lambda+\betaλ+β (with λ+β≥0\lambda+\beta\ge 0λ+β≥0), the global treatment effect at density τ\tauτ is Δτ=1τE[Φτ(Dτ,λ+β,Sτ)−Φτ(Dτ,λ,Sτ)]\Delta^\tau=\frac1\tau\mathbb E[\Phi_\tau(D^{\tau,\lambda+\beta},S^\tau)-\Phi_\tau(D^{\tau,\lambda},S^\tau)]Δτ=τ1​E[Φτ​(Dτ,λ+β,Sτ)−Φτ​(Dτ,λ,Sτ)] (Definition 1, p. 8).

Formalization targets

Goal: Theorem 1, display (7), p. 12

lim⁡τ→∞E[1τ Φτ(Dτ,λ,Sτ)]=Φ(λ,π),\lim_{\tau\to\infty}\mathbb E\Big[\frac1\tau\,\Phi_\tau\big(D^{\tau,\lambda},S^\tau\big)\Big]=\Phi(\lambda,\pi),τ→∞lim​E[τ1​Φτ​(Dτ,λ,Sτ)]=Φ(λ,π),

for every network, every λ≥0\lambda\ge 0λ≥0 and every π≥0\pi\ge 0π≥0, along integer densities τ\tauτ. No rate of convergence and no constant is fixed.

Milestones

  1. Lemma 1 (p. 37), scaling. For integer d,s≥0d,s\ge 0d,s≥0 and τ>0\tau>0τ>0, 1τΦτ(d,s)=Φ(1τd,1τs)\frac1\tau\Phi_\tau(d,s)=\Phi(\frac1\tau d,\frac1\tau s)τ1​Φτ​(d,s)=Φ(τ1​d,τ1​s), and xxx is optimal on the right if and only if τx\tau xτx is optimal on the left.
  2. Poisson tail bound (proof of Lemma 2, p. 38). For V∼Poisson(λ0)V\sim\mathrm{Poisson}(\lambda_0)V∼Poisson(λ0​), P(V≥t)≤e−t\mathbb P(V\ge t)\le e^{-t}P(V≥t)≤e−t for every t≥7λ0t\ge 7\lambda_0t≥7λ0​ (Janson, Łuczak and Ruciński 2000, Corollary 2.4).
  3. Lemma 2 (p. 38). If Xn∼Poisson(λn)X_n\sim\mathrm{Poisson}(\lambda n)Xn​∼Poisson(λn) for n≥1n\ge 1n≥1, then Z=sup⁡n≥1Xn/nZ=\sup_{n\ge1}X_n/nZ=supn≥1​Xn​/n has finite mean, whatever the joint law of the XnX_nXn​.

Companion: Corollary 1, display (8), p. 13

lim⁡τ→∞Δτ=Φ(λ+β,π)−Φ(λ,π).\lim_{\tau\to\infty}\Delta^\tau=\Phi(\lambda+\beta,\pi)-\Phi(\lambda,\pi).τ→∞lim​Δτ=Φ(λ+β,π)−Φ(λ,π).

Significance

Theorem 1 is the bridge between the paper's stochastic model and its deterministic analysis. Corollary 1 follows from it and identifies the estimand Δ=Φ(λ+β,π)−Φ(λ,π)\Delta=\Phi(\lambda+\beta,\pi)-\Phi(\lambda,\pi)Δ=Φ(λ+β,π)−Φ(λ,π). Every fluid-limit result of the paper is stated about this deterministic quantity: that the RCT estimator overestimates the treatment effect (Theorem 2), and that in a symmetric experiment the shadow-price estimator is no more biased than the RCT estimator (Theorem 4). Without Theorem 1 those results describe a linear program, not the experiment.

The result is proved in the paper (Appendix C.1, pp. 37–39). As far as a search of the Prove2Me catalogue shows, it has not been formalized: the catalogue has fluid limits of queueing networks and several Poisson concentration bounds, but no law of large numbers for the value of a random network-flow program. A formal development would provide a reusable definition of the capacitated network-flow program with supply and demand bounds, its scaling identity, and an integrability tool for suprema of scaled Poisson counts. The two other missions of this series, on the shadow-price estimator in the fluid limit and in finite samples, use the same network program.

Difficulty

The obvious argument is: 1τDτ→λ\frac1\tau D^\tau\to\lambdaτ1​Dτ→λ and 1τSτ→π\frac1\tau S^\tau\to\piτ1​Sτ→π, Φ\PhiΦ is continuous, so the expectations converge. Each step needs care.

  • The counts at different densities are defined only through their laws. A pathwise limit needs a coupling of the counts across τ\tauτ, which is not part of the statement.
  • Continuity of Φ\PhiΦ in its right-hand side, including at data where some λi\lambda_iλi​ or πj\pi_jπj​ is zero, is a statement about the value function of a parametric linear program. Mathlib has no theory of LP value functions.
  • Passing the limit inside the expectation needs a dominating function. The paper builds one from the supremum of scaled Poisson counts (Lemma 2), whose integrability rests on the Poisson tail bound. That bound is not in Mathlib either.

Formalization scope

Representation.

  • Demand types are Fin nd and supply types Fin ns; Lean index iii is the paper's type i+1i+1i+1.
  • A network is a structure with arc type E and intermediate-node type I. Each arc's tail is a supply or intermediate node and its head is a demand or intermediate node, which builds in the source/sink structure. Values are real and capacities nonnegative.
  • Φτ(d,s)\Phi_\tau(d,s)Φτ​(d,s) is the supremum of the objective over the feasible set of (2). For nonnegative data this set contains 000 and lies in the box [0,τk][0,\tau k][0,τk], so the supremum is a maximum.

Probability.

  • The count law at density τ\tauτ is the product of independent Poisson laws on Nnd×Nns\mathbb N^{n_d}\times\mathbb N^{n_s}Nnd​×Nns​. Independence across types and between demand and supply is the paper's reading of a Poisson process per type; it is used by the proofs but not written out.
  • Expectations are Bochner integrals. The integrand of the goal is bounded by ∑∣vu,w∣ku,w\sum|v_{u,w}|k_{u,w}∑∣vu,w​∣ku,w​, and every function on the countable count space is measurable, so the expectation is genuine and not the junk value 000.
  • The limit is taken along integer τ→∞\tau\to\inftyτ→∞, as on p. 12.
  • In Lemma 2, max⁡n≥1\max_{n\ge1}maxn≥1​ is read as a supremum in [0,∞][0,\infty][0,∞], and "finite mean" as a finite lower Lebesgue integral.

Ruled out. A trivializing formalization is excluded: the expectation is taken against the Poisson laws with means λiτ\lambda_i\tauλi​τ and πjτ\pi_j\tauπj​τ, with the factor 1/τ1/\tau1/τ inside the expectation, not against point masses at the rates or in the rescaled form E[Φ(1τDτ,1τSτ)]\mathbb E[\Phi(\frac1\tau D^\tau,\frac1\tau S^\tau)]E[Φ(τ1​Dτ,τ1​Sτ)]. No hypothesis beyond λ,π≥0\lambda,\pi\ge 0λ,π≥0 is imposed.

Not stated.

  • The second sentence of Theorem 1, the almost-sure convergence of optimal primal and dual solutions. It assumes unique optima only inside its proof and needs a coupling across τ\tauτ that the paper does not construct.
  • Lemma 1's "z∗=τx∗z^*=\tau x^*z∗=τx∗" presupposes unique optima. It is stated as the equivalence "xxx is optimal for Φ(1τd,1τs)\Phi(\frac1\tau d,\frac1\tau s)Φ(τ1​d,τ1​s) if and only if τx\tau xτx is optimal for Φτ(d,s)\Phi_\tau(d,s)Φτ​(d,s)".

The statements follow arXiv:2205.02274v4. Its printed slips are corrected as disclosed in each item's Formalization Note.

Infrastructure needed.

  • Monotonicity and continuity of the value of a capacitated linear program in its right-hand side.
  • The Poisson Chernoff bound.
  • Convergence in probability of scaled Poisson counts.

The network-program definition and the Poisson tail bound are reusable beyond this mission. Contributions toward any of these are welcome.

Selected references

  • I. Bright, A. Delarue, I. Lobel, Reducing Marketplace Interference Bias Via Shadow Prices, arXiv preprint, v4, 2024; Management Science, 2025. https://arxiv.org/abs/2205.02274v4
  • S. Janson, T. Łuczak, A. Ruciński, Random Graphs, Wiley, 2000, Corollary 2.4. https://doi.org/10.1002/9781118032718
6 thms1 active userReviewed
Optimal TransportProbability·Captain: mikedeng1

Global Sensitivity Analysis via Optimal Transport 1: An OT-Based Sensitivity Measure Is Maximal Exactly When the Output Is a Function of the InputResearch Paper

Motivation

Global sensitivity analysis asks how much of the uncertainty in the output YYY of a model, a simulator or a learned predictor is attributable to an input XXX. A standard way to answer is to compare the law of YYY with its law after XXX is revealed, and to average that discrepancy over XXX. Variance-based indices (Sobol' 1993; Wagner 1995) compare conditional and unconditional means. Density-based and distribution-based indices compare whole distributions. Rényi's postulates for measures of dependence ask, among other things, that such an index vanish exactly under independence (zero-independence) and reach its maximum exactly when YYY is a function of XXX (max-functionality, Postulate E). Variance-based indices fail the first postulate, because the conditional mean can be constant while the conditional law moves.

Borgonovo, Figalli, Plischke and Savaré (Management Science, 2025) propose indices in which the discrepancy is an optimal transport cost. The squared 2-Wasserstein case is the numerator of the Wasserstein correlation coefficient of Wiesel (2022), whose Theorem 2.2 gives max-functionality for that coefficient. The paper extends max-functionality to general continuous costs, through a strict-convexity property of the transport cost on Dirac masses (Lemma 4). This mission formalizes that result, Theorem 5, together with the zero-independence property, Proposition 3.

Setting

Let (Ω,B,P)(\Omega,\mathcal B,P)(Ω,B,P) be a probability space and X\mathsf XX, Y\mathsf YY Polish spaces with their Borel σ\sigmaσ-algebras. The input X:Ω→XX:\Omega\to\mathsf XX:Ω→X and the output Y:Ω→YY:\Omega\to\mathsf YY:Ω→Y are measurable, with laws μ\muμ and ν\nuν.

A cost is a continuous function k:Y×Y→[0,+∞]k:\mathsf Y\times\mathsf Y\to[0,+\infty]k:Y×Y→[0,+∞] with k(y,y′)=0k(y,y')=0k(y,y′)=0 if and only if y=y′y=y'y=y′. It need not be symmetric, a metric, or finite. For probability measures ν,ν′\nu,\nu'ν,ν′ on Y\mathsf YY, a coupling is a probability measure π\piπ on Y×Y\mathsf Y\times\mathsf YY×Y with marginals ν\nuν and ν′\nu'ν′, and the optimal transport cost is

K(ν,ν′)=inf⁡π∈Π(ν,ν′)∬k(y,y′) dπ(y,y′).K(\nu,\nu')=\inf_{\pi\in\Pi(\nu,\nu')}\iint k(y,y')\,d\pi(y,y').K(ν,ν′)=π∈Π(ν,ν′)inf​∬k(y,y′)dπ(y,y′).

For a sub-σ\sigmaσ-algebra F\mathcal FF of the Borel sets of X\mathsf XX, a version of the conditional distribution of YYY given (X,F)(X,\mathcal F)(X,F) is a Markov kernel x↦νxFx\mapsto\nu^{\mathcal F}_xx↦νxF​ that is F\mathcal FF-measurable in xxx and satisfies P(X∈A, Y∈B)=∫AνxF(B) dμ(x)P(X\in A,\,Y\in B)=\int_A\nu^{\mathcal F}_x(B)\,d\mu(x)P(X∈A,Y∈B)=∫A​νxF​(B)dμ(x) for A∈FA\in\mathcal FA∈F and Borel BBB. The OT-based sensitivity measure of Definition 1 is

ξK(Y,X∣F)=∫XK(ν,νxF) dμ(x),\xi^K(Y,X\mid\mathcal F)=\int_{\mathsf X}K(\nu,\nu^{\mathcal F}_x)\,d\mu(x),ξK(Y,X∣F)=∫X​K(ν,νxF​)dμ(x),

written ξK(Y,X)\xi^K(Y,X)ξK(Y,X) when F\mathcal FF is the full Borel σ\sigmaσ-algebra. The candidate maximum is

MK[Y]=E[k(Y,Y′)]=∬k(y,y′) dν(y) dν(y′),\mathbb M^K[Y]=\mathbb E[k(Y,Y')]=\iint k(y,y')\,d\nu(y)\,d\nu(y'),MK[Y]=E[k(Y,Y′)]=∬k(y,y′)dν(y)dν(y′),

with Y′Y'Y′ an independent copy of YYY; for k(y,y′)=∥y−y′∥22k(y,y')=\|y-y'\|_2^2k(y,y′)=∥y−y′∥22​ it equals twice the total variance of YYY.

Formalization targets

Goal: Theorem 5 (max-functionality)

If MK[Y]<+∞\mathbb M^K[Y]<+\inftyMK[Y]<+∞, then for every sub-σ\sigmaσ-algebra F\mathcal FF and every version of the conditional distribution,

ξK(Y,X∣F)≤MK[Y],\xi^K(Y,X\mid\mathcal F)\le\mathbb M^K[Y],ξK(Y,X∣F)≤MK[Y],

and

ξK(Y,X∣F)=MK[Y]  ⟺  Y=f(X) P-a.s. for some F-measurable f:X→Y.\xi^K(Y,X\mid\mathcal F)=\mathbb M^K[Y]\iff Y=f(X)\ P\text{-a.s. for some }\mathcal F\text{-measurable }f:\mathsf X\to\mathsf Y.ξK(Y,X∣F)=MK[Y]⟺Y=f(X) P-a.s. for some F-measurable f:X→Y.

Milestones

The steps of the paper's proof, in order:

  1. (57): K(ν,ν′)≤∬k dν dν′K(\nu,\nu')\le\iint k\,d\nu\,d\nu'K(ν,ν′)≤∬kdνdν′.
  2. K(ν,δy′)=∫k(y,y′) dν(y)K(\nu,\delta_{y'})=\int k(y,y')\,d\nu(y)K(ν,δy′​)=∫k(y,y′)dν(y).
  3. Lemma 4: for y1≠y2y_1\ne y_2y1​=y2​ in supp⁡ν\operatorname{supp}\nusuppν and t∈(0,1)t\in(0,1)t∈(0,1),
K(ν,(1−t)δy1+tδy2)<(1−t)K(ν,δy1)+tK(ν,δy2).K\big(\nu,(1-t)\delta_{y_1}+t\delta_{y_2}\big)<(1-t)K(\nu,\delta_{y_1})+tK(\nu,\delta_{y_2}).K(ν,(1−t)δy1​​+tδy2​​)<(1−t)K(ν,δy1​​)+tK(ν,δy2​​).
  1. (62): the disintegration ∫K(ν,δy) dν(y)=∫X∫K(ν,δy) dνxF(y) dμ(x)\int K(\nu,\delta_y)\,d\nu(y)=\int_{\mathsf X}\int K(\nu,\delta_y)\,d\nu^{\mathcal F}_x(y)\,d\mu(x)∫K(ν,δy​)dν(y)=∫X​∫K(ν,δy​)dνxF​(y)dμ(x).
  2. The bound K(ν,ν′)≤∫K(ν,δy) dν′(y)K(\nu,\nu')\le\int K(\nu,\delta_y)\,d\nu'(y)K(ν,ν′)≤∫K(ν,δy​)dν′(y).
  3. (63): at the maximum, that bound is an equality for μ\muμ-a.e. xxx.
  4. (65): Jensen's inequality for K(ν,⋅)K(\nu,\cdot)K(ν,⋅) over the representation (64) of a mixture.

Companion: Proposition 3 (zero-independence)

ξK(Y,X)=0  ⟺  X and Y are independent.\xi^K(Y,X)=0\iff X\text{ and }Y\text{ are independent}.ξK(Y,X)=0⟺X and Y are independent.

Significance

The result. Together, Proposition 3 and Theorem 5 place ξK\xi^KξK on a scale from 000 (no information about YYY in XXX) to MK[Y]\mathbb M^K[Y]MK[Y] (complete information), so the ratio ξK(Y,X∣F)/MK[Y]\xi^K(Y,X\mid\mathcal F)/\mathbb M^K[Y]ξK(Y,X∣F)/MK[Y] is a normalized measure of association. This normalization is what lets practitioners rank inputs of a simulator or features of a model on a common scale. The result covers all continuous costs vanishing exactly on the diagonal, including the powers of a metric that give the Wasserstein indices, and arbitrary sub-σ\sigmaσ-algebras F\mathcal FF, which model partial information about XXX (for example the information carried by a function g(X)g(X)g(X)).

Formalizing it. The theorem is proved in the paper; the work here is to formalize the known proof. As far as is known, no machine-checked version of this result or of Wiesel's Wasserstein-correlation theorem exists. Along the way the development needs facts about optimal transport with extended-real costs that are not in Mathlib: the product-coupling bound, the transport cost to a Dirac mass, convexity and lower semicontinuity of K(ν,⋅)K(\nu,\cdot)K(ν,⋅), and cyclical monotonicity of optimal plans.

Difficulty

The inequality and the "functional dependence ⇒ equality" direction are direct computations with the product coupling and with Dirac conditional laws. The converse is the hard direction. Equality of the integrals gives only the pointwise equality (63) almost everywhere, and the step from there to "νxF\nu^{\mathcal F}_xνxF​ is a Dirac mass" needs strict convexity of K(ν,⋅)K(\nu,\cdot)K(ν,⋅). Strict convexity fails for general measures: K(ν,⋅)K(\nu,\cdot)K(ν,⋅) is affine along many segments. It holds only between Dirac masses at distinct points of supp⁡ν\operatorname{supp}\nusuppν (Lemma 4), and even there it fails when the costs involved are infinite. A non-Dirac conditional law is not a two-point mixture, so the strict inequality must be carried over to general measures with an integrand that takes values in [0,+∞][0,+\infty][0,+∞]. The last step, building an F\mathcal FF-measurable fff from the conditional laws, is measure-theoretic bookkeeping that is easy to get wrong.

Formalization scope

  • Spaces and values. X\mathsf XX and Y\mathsf YY are Polish with their Borel σ\sigmaσ-algebras; the paper's supports in RnX\mathbb R^{n_X}RnX​, RnY\mathbb R^{n_Y}RnY​ are such spaces. All of kkk, KKK, MK\mathbb M^KMK and ξK\xi^KξK take values in [0,+∞][0,+\infty][0,+∞] (ℝ≥0∞), so +∞+\infty+∞ is allowed as on the page, and integrals are lower Lebesgue integrals.
  • Transport cost. KKK is the published definition RWPI.SqrtLasso.transportCost. Its first argument is the marginal ν\nuν, and the cost is evaluated as k(y,y′)k(y,y')k(y,y′) with y∼νy\sim\nuy∼ν.
  • Conditional laws. The conditional distribution is not a chosen object. Any Markov kernel satisfying the defining property IsCondDistrib is admissible, and every theorem quantifies over all versions and over all sub-σ\sigmaσ-algebras F\mathcal FF.
  • Ruled-out encodings. The goal must not fix F\mathcal FF to the Borel σ\sigmaσ-algebra or fix a version of the kernel. Its conclusion must not be replaced by "νxF\nu^{\mathcal F}_xνxF​ is a Dirac mass for μ\muμ-a.e. xxx", which is an intermediate step of the proof, not the theorem.
  • Disclosed correction. Lemma 4 carries the extra hypotheses K(ν,δy1),K(ν,δy2)<+∞K(\nu,\delta_{y_1}),K(\nu,\delta_{y_2})<+\inftyK(ν,δy1​​),K(ν,δy2​​)<+∞. As printed, both sides of (19) can be +∞+\infty+∞ under the lemma's assumptions. Theorem 5 is stated as printed.
  • Not posed. The cyclical monotonicity of optimal plans, cited from Villani (2008, Ch. 5), and the existence of optimal plans used in Proposition 3 are standard optimal-transport facts. They are not milestones but are welcome as supporting lemmas.

Selected references

  • E. Borgonovo, A. Figalli, E. Plischke, G. Savaré, Global Sensitivity Analysis via Optimal Transport, Management Science, 2025 (authors' manuscript of 7 March 2024 used here). https://doi.org/10.1287/mnsc.2023.01796
  • J. Wiesel, Measuring Association with Wasserstein Distances, Bernoulli 28(4):2816–2832, 2022. https://doi.org/10.3150/21-BEJ1438
  • C. Villani, Optimal Transport: Old and New, Springer, 2008. https://doi.org/10.1007/978-3-540-71050-9
  • A. Rényi, On Measures of Dependence, Acta Mathematica Academiae Scientiarum Hungaricae 10:441–451, 1959. https://doi.org/10.1007/BF02024507
  • I. M. Sobol', Sensitivity Estimates for Nonlinear Mathematical Models, Mathematical Modelling and Computational Experiments 1:407–414, 1993.
  • H. M. Wagner, Global Sensitivity Analysis, Operations Research 43(6):948–969, 1995. https://doi.org/10.1287/opre.43.6.948
11 thms1 active userReviewed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Retention or Acquisition? Behavior-Based Quality Disclosure II: Behavior-Based Disclosure Raises Total Two-Period Profits Exactly When the Disclosure Cost Exceeds a CutoffResearch Paper

Motivation

Firms that sell to the same customers over time learn who bought from whom. Behavior-based pricing (BBP) — charging a firm's own past customers one price and the rival's past customers another — has been studied since Fudenberg and Tirole (2000) and Villas-Boas (1999). A second instrument is the disclosure of product quality: free samples, demonstrations and trial versions reveal the quality of a new product, at a cost per customer reached. With purchase histories, a firm can disclose differently to its own customers and to the rival's: behavior-based disclosure (BBD). The classical disclosure model is Jovanovic (1982), in which costly disclosure leads a firm to reveal quality only above a threshold.

Zhang and Li (2025) combine the two instruments in a two-period Hotelling duopoly and compare BBD with uniform disclosure. Their Proposition 1 shows that BBD always raises second-period profits; this mission is about the whole game, where the answer depends on the disclosure cost.

Setting

A unit mass of customers is uniformly distributed on [0,1][0,1][0,1]; firm A is at 000, firm B at 111, the transportation cost is 111, marginal costs are 000 and the market is fully covered.

Period 1. The firms charge prices pa1,pb1≥0p_{a1},p_{b1}\ge 0pa1​,pb1​≥0. The first-period purchase splits the line at x1x_1x1​: A's old customers are [0,x1][0,x_1][0,x1​] (A's turf), B's are [x1,1][x_1,1][x1​,1] (B's turf).

Period 2. Each firm iii launches a new product of quality qiq_iqi​, with qa,qbq_a,q_bqa​,qb​ independent and uniform on [0,1][0,1][0,1]. A firm discloses its quality to a segment iff it exceeds a disclosure threshold q^\hat qq^​; disclosing costs ccc per customer reached. A segment that sees no disclosure believes the quality is q^/2\hat q/2q^​/2. Under uniform disclosure each firm has one threshold q^i\hat q_iq^​i​ for the whole line; under BBD it has q^io\hat q_{io}q^​io​ for its own customers and q^in\hat q_{in}q^​in​ for the rival's. On each turf the two firms then play a price game (A charges paop_{ao}pao​ and B charges pbnp_{bn}pbn​ on A's turf; panp_{an}pan​ and pbop_{bo}pbo​ on B's turf), and customers stay or switch according to their beliefs and prices.

Forward-looking customers. The share x1x_1x1​ is the location of the marginal consumer, who compares the two first-period options including the expected second-period surplus of staying or switching ((6) for uniform disclosure, (15) for BBD):

−x1−pa1+max⁡{−(1−x1)+E(q~bn−pbn∗), −x1+E(q~ao−pao∗)}=−(1−x1)−pb1+max⁡{−x1+E(q~an−pan∗), −(1−x1)+E(q~bo−pbo∗)}.-x_1-p_{a1}+\max\{-(1-x_1)+E(\tilde q_{bn}-p^*_{bn}),\,-x_1+E(\tilde q_{ao}-p^*_{ao})\}=-(1-x_1)-p_{b1}+\max\{-x_1+E(\tilde q_{an}-p^*_{an}),\,-(1-x_1)+E(\tilde q_{bo}-p^*_{bo})\}.−x1​−pa1​+max{−(1−x1​)+E(q~​bn​−pbn∗​),−x1​+E(q~​ao​−pao∗​)}=−(1−x1​)−pb1​+max{−x1​+E(q~​an​−pan∗​),−(1−x1​)+E(q~​bo​−pbo∗​)}.

Two-period profits (8) are Πa=pa1x1+E(πa2)\Pi_a=p_{a1}x_1+E(\pi_{a2})Πa​=pa1​x1​+E(πa2​) and Πb=pb1(1−x1)+E(πb2)\Pi_b=p_{b1}(1-x_1)+E(\pi_{b2})Πb​=pb1​(1−x1​)+E(πb2​), with E(πi2)E(\pi_{i2})E(πi2​) the ex ante second-period profit at share x1x_1x1​. A symmetric subgame-perfect equilibrium is a common first-period price p∗p^*p∗ together with a second-period equilibrium at every share and a consistent share at every price pair, such that neither firm gains from any other nonnegative first-period price. Its total profits are Πa∗,Πb∗\Pi^*_a,\Pi^*_bΠa∗​,Πb∗​.

The standing assumption is 0<c<5/360<c<5/360<c<5/36 (p. 8515).

Formalization targets

Goal: Proposition 3(a)

There is a cutoff cl∈(0,5/36)c_l\in(0,5/36)cl​∈(0,5/36) such that for every c∈(0,5/36)c\in(0,5/36)c∈(0,5/36), symmetric subgame-perfect equilibria exist under both regimes and, for any two of them,

c>cl  ⇒  Πi∗,U<Πi∗,BBD,c<cl  ⇒  Πi∗,BBD<Πi∗,U(i=a,b).c>c_l\;\Rightarrow\;\Pi^{*,U}_i<\Pi^{*,BBD}_i,\qquad c<c_l\;\Rightarrow\;\Pi^{*,BBD}_i<\Pi^{*,U}_i\qquad (i=a,b).c>cl​⇒Πi∗,U​<Πi∗,BBD​,c<cl​⇒Πi∗,BBD​<Πi∗,U​(i=a,b).

The value of clc_lcl​ is left unfixed, as in the paper.

Milestones

  1. (5) and (14): the ex ante second-period profit as a function of x1x_1x1​ and the equilibrium thresholds, in region 1, e.g. under BBD
E(πa2)=(1+2x1)2+(3−4x1)218+4−q^ao3−q^an3−q^bo3−q^bn3216−c [1−x1q^ao−(1−x1)q^an].E(\pi_{a2})=\tfrac{(1+2x_1)^2+(3-4x_1)^2}{18}+\tfrac{4-\hat q_{ao}^3-\hat q_{an}^3-\hat q_{bo}^3-\hat q_{bn}^3}{216}-c\,[1-x_1\hat q_{ao}-(1-x_1)\hat q_{an}].E(πa2​)=18(1+2x1​)2+(3−4x1​)2​+2164−q^​ao3​−q^​an3​−q^​bo3​−q^​bn3​​−c[1−x1​q^​ao​−(1−x1​)q^​an​].
  1. (7) and (16): in region 1 the first-period share is x1=12+38(pb1−pa1)x_1=\tfrac12+\tfrac38(p_{b1}-p_{a1})x1​=21​+83​(pb1​−pa1​) under both regimes.
  2. (9) and (17): existence of symmetric equilibria, and their prices
p∗,U=23(2−c+c1+27c),p∗,BBD=43−c(5+54c)31+12c+c(5+162c)31+108c,p^{*,U}=\tfrac23\big(2-c+\tfrac{c}{\sqrt{1+27c}}\big),\qquad p^{*,BBD}=\tfrac43-\tfrac{c(5+54c)}{3\sqrt{1+12c}}+\tfrac{c(5+162c)}{3\sqrt{1+108c}},p∗,U=32​(2−c+1+27c​c​),p∗,BBD=34​−31+12c​c(5+54c)​+31+108c​c(5+162c)​,

with share x1∗=12x_1^*=\tfrac12x1∗​=21​. 4. Table 1, total profits, both regimes, in closed form. 5. Proposition 2: a cutoff ch∈(0,5/36)c_h\in(0,5/36)ch​∈(0,5/36) across which the comparison of first-period prices and profits reverses.

Significance

Proposition 3(a) is the paper's answer to the managerial question in its title. BBD lets a firm disclose to its own customers more often than to the rival's (retention-focused disclosure), which improves the efficiency of disclosure and raises second-period profits. In the first period, however, BBD changes how hard firms compete for customers, and when disclosure is cheap the first-period loss dominates. The result locates the sign change of the total effect at a single cutoff, and together with Proposition 2 (cl<chc_l<c_hcl​<ch​) it separates three regimes of ccc: total profits fall, total profits rise despite lower first-period profits, and both rise.

None of these results is formalized anywhere. The paper's proofs are in an Online Appendix and its displayed formulas are the end points of long computations. A complete development would produce:

  • a machine-checked solution of a two-period Hotelling model with behavior-based pricing, including corner regions of the second-period price game;
  • a costly-disclosure equilibrium in the Jovanovic style;
  • a verified single-crossing analysis of algebraic functions of ccc.

Difficulty

The model nests three equilibrium notions: a clamped price game on each turf, threshold disclosure as a best response to the rival and to the induced beliefs, and first-period pricing with forward-looking customers. The first-order condition behind (9) and (17) involves the derivative of E(πa2)E(\pi_{a2})E(πa2​) in x1x_1x1​, and every threshold, including the rival's, moves with x1x_1x1​; treating the rival's thresholds as fixed gives a wrong price.

The symmetric first-order condition alone does not settle the equilibrium. A deviation in first-period price can push the share outside the region where all second-period prices are interior, into the corner regions 2 and 3 of Lemma 1/2, where the second-period profit has a different form. The paper checks these deviations only in its Online Appendix.

The final comparison is a sign analysis of an expression with three different square roots on (0,5/36)(0,5/36)(0,5/36). The difference of total profits is small throughout: for example, about −5⋅10−4-5\cdot10^{-4}−5⋅10−4 at c=0.01c=0.01c=0.01 and 3.5⋅10−33.5\cdot10^{-3}3.5⋅10−3 at c=0.1c=0.1c=0.1.

Formalization scope

  • Representation. Qualities are integrated by iterated interval integrals over [0,1][0,1][0,1]. The base value vvv cancels and is omitted; full coverage is built in. Prices are nonnegative, turf shares are clamped to the turf, and the nondisclosure belief stays q^/2\hat q/2q^​/2 when a firm considers a deviation.
  • Equilibria, not formulas. Second-period prices are Nash equilibria of the clamped turf games for every belief pair in [0,1]2[0,1]^2[0,1]2. Thresholds are best responses ("disclose iff q>q^q>\hat qq>q^​" is optimal), never roots of the indifference equation. The share satisfies (6)/(15) as printed, a maximum of two expectations, with corner shares x1∈{0,1}x_1\in\{0,1\}x1​∈{0,1} read through nearby interior shares (at an endpoint one turf is empty and its second-period prices are not pinned down, so (6)/(15) is not evaluated there). First-period deviations range over all nonnegative prices, and the second-period profile is an equilibrium at every share, including shares reached only after a deviation.
  • Readings. "In region 1" for (5), (7), (14), (16) means that every belief pair on the support is in region 1: 12−q^bn/8<x1<12+q^an/8\tfrac12-\hat q_{bn}/8<x_1<\tfrac12+\hat q_{an}/821​−q^​bn​/8<x1​<21​+q^​an​/8 (BBD), 12−q^b/8<x1<12+q^a/8\tfrac12-\hat q_b/8<x_1<\tfrac12+\hat q_a/821​−q^​b​/8<x1​<21​+q^​a​/8 (uniform). Table 1's uniform total profit is used; the sentence on p. 8517 prints 1+72c\sqrt{1+72c}1+72c​ for 1+27c\sqrt{1+27c}1+27c​.
  • Ruled out. Hard-wiring x1=12x_1=\tfrac12x1​=21​, defining thresholds or prices by their closed forms, or stating the goal on the Table 1 formulas alone would each trivialize the mission; the cutoff is quantified before ccc and lies strictly inside (0,5/36)(0,5/36)(0,5/36), and existence of equilibria is part of the goal.
  • Not posed. Proposition 3(b), (c) (consumer surplus and welfare are defined in the paper only by their Table 1 values) and Proposition 4.
  • Needed. Piecewise-quadratic integrals over the belief support; Nash equilibria of clamped linear-demand games; existence of a consistent first-period share (an intermediate-value argument on a suitable equilibrium selection); and sign analysis with square roots. The second-period model is the same as in the companion mission on Proposition 1, and lemmas about it are reusable there. Contributions of any of the milestones, of Lemma 1/2 in all regions, or of the corner-region versions of (4), (5), (13), (14) are welcome.

Selected references

  • J. Zhang and K. J. Li, Retention or Acquisition? Behavior-Based Quality Disclosure, Management Science 71(10), 8510–8525, 2025. https://doi.org/10.1287/mnsc.2022.01081
  • D. Fudenberg and J. Tirole, Customer Poaching and Brand Switching (cited in Zhang and Li as "Customer poaching and firm switching"), RAND Journal of Economics 31(4), 634–657, 2000.
  • J. M. Villas-Boas, Dynamic Competition with Customer Recognition, RAND Journal of Economics 30(4), 604–631, 1999.
  • B. Jovanovic, Truthful Disclosure of Information, Bell Journal of Economics 13(1), 36–44, 1982.
12 thms1 active userReviewed
Linear algebraStochastic Systems·Captain: mikedeng1

A Hierarchical Approach to Robust Stability of Multiclass Queueing Networks: Chen-S at Every Static-Priority Corner Implies Chen-S for Every Queue-Ratio PolicyResearch Paper

Motivation

A multiclass queueing network routes jobs of several classes through shared stations. Whether such a network is stable depends on the scheduling policy and not only on the load: the Lu–Kumar and Rybko–Stolyar examples are unstable under a static-priority policy with every station loaded below capacity (Bramson, Stability of Queueing Networks, 2008). A network operator who does not control, or does not know, the policy in use therefore wants robust stability: stability under every policy of a given family.

Zhao, Gurvich and Hasenbein (arXiv:2303.17746v3) study robust stability over the family of queue-ratio policies, which steer each station's workload towards fixed proportions across its classes and contain the static-priority and quadratic max-weight policies as special cases. Their analysis is hierarchical. Under a queue-ratio policy the fluid model first reaches state-space collapse and then follows a linear Skorohod problem. This mission formalizes the second layer: a purely algebraic sufficient condition for stability of that Skorohod problem holds for every queue-ratio policy as soon as it holds at the finitely many static-priority "corners".

Timeline. Dai (1995) reduced stability of the queueing network to stability of its fluid model. Delgado (2010) related fluid stability under state-space collapse to stability of a Skorohod problem. Chen (1996) gave the Chen-S\mathcal SS sufficient condition for stability of a linear Skorohod problem. Zhao, Gurvich and Hasenbein (preprint 2023, Operations Research 2025) proved that Chen-S\mathcal SS is inherited from the static-priority corners (their Theorem 4).

Setting

Fix an open network with JJJ stations and KKK classes. Class kkk is served at station s(k)s(k)s(k), and the J×KJ\times KJ×K constituency matrix CCC has Cjk=1C_{jk}=1Cjk​=1 if s(k)=js(k)=js(k)=j and 000 otherwise. M=diag⁡(m1,…,mK)M=\operatorname{diag}(m_1,\dots,m_K)M=diag(m1​,…,mK​) holds the mean service times mk>0m_k>0mk​>0. PPP is the substochastic routing matrix, and α≥0\alpha\ge 0α≥0 the vector of exogenous arrival rates. The network is open: I+P+P2+⋯I+P+P^2+\cdotsI+P+P2+⋯ converges and I−P⊤I-P^\topI−P⊤ is invertible. Then Q=(I−P⊤)−1Q=(I-P^\top)^{-1}Q=(I−P⊤)−1, λ=Qα\lambda=Q\alphaλ=Qα and the traffic intensities are ρ=CMλ\rho=CM\lambdaρ=CMλ.

A ratio matrix is a K×JK\times JK×J matrix Δ\DeltaΔ with Δkj=δk≥0\Delta_{kj}=\delta_k\ge 0Δkj​=δk​≥0 if s(k)=js(k)=js(k)=j and Δkj=0\Delta_{kj}=0Δkj​=0 otherwise, normalized by

CMΔ=I.CM\Delta=I.CMΔ=I.

It is static-priority if at each station jjj exactly one class kkk with s(k)=js(k)=js(k)=j has Δkj=1/mk\Delta_{kj}=1/m_kΔkj​=1/mk​ and all others have Δlj=0\Delta_{lj}=0Δlj​=0. For a ratio matrix with CMQΔCMQ\DeltaCMQΔ invertible, the reflection matrix and drift are

RΔ=(CMQΔ)−1,θΔ=RΔ(ρ−e).R_\Delta=(CMQ\Delta)^{-1},\qquad \theta_\Delta=R_\Delta(\rho-e).RΔ​=(CMQΔ)−1,θΔ​=RΔ​(ρ−e).

A square matrix RRR is an S-matrix if Ru>0Ru>0Ru>0 for some u>0u>0u>0, and completely-S\mathcal SS if every principal sub-matrix is an S-matrix. The pair (R,θ)(R,\theta)(R,θ) is Chen-S\mathcal SS if RRR is completely-S\mathcal SS and some h>0h>0h>0 satisfies ha⊤[θa+Rabu]<0h_a^\top[\theta_a+R_{ab}u]<0ha⊤​[θa​+Rab​u]<0 for every partition (a,b)(a,b)(a,b) of the stations with a≠∅a\neq\emptyseta=∅ and every u≥0u\ge 0u≥0 with θb+Rbu=0\theta_b+R_bu=0θb​+Rb​u=0. Ratio matrices are neighbors if they differ in at most one column.

Formalization targets

Goal: Theorem 4

If for every static-priority Δ\DeltaΔ the matrix CMQΔCMQ\DeltaCMQΔ is invertible and (RΔ,θΔ)(R_\Delta,\theta_\Delta)(RΔ​,θΔ​) is Chen-S\mathcal SS, and all det⁡(CMQΔ)\det(CMQ\Delta)det(CMQΔ) over static-priority Δ\DeltaΔ have one sign, then

∀ Δ ratio matrix:CMQΔ invertible and (RΔ,θΔ) Chen-S.\forall\,\Delta\ \text{ratio matrix}:\quad CMQ\Delta\ \text{invertible and}\ (R_\Delta,\theta_\Delta)\ \text{Chen-}\mathcal S.∀Δ ratio matrix:CMQΔ invertible and (RΔ​,θΔ​) Chen-S.

The network is arbitrary: any JJJ, KKK, routing and service times.

Milestones

For neighbors Δ1,Δ2\Delta_1,\Delta_2Δ1​,Δ2​ and Δ3=λΔ1+(1−λ)Δ2\Delta_3=\lambda\Delta_1+(1-\lambda)\Delta_2Δ3​=λΔ1​+(1−λ)Δ2​ with λ∈(0,1)\lambda\in(0,1)λ∈(0,1):

  • Lemma 4. The kkkth rows of RΔ1R_{\Delta_1}RΔ1​​ and RΔ2R_{\Delta_2}RΔ2​​ are proportional with ratio det⁡(CMQΔ2)/det⁡(CMQΔ1)\det(CMQ\Delta_2)/\det(CMQ\Delta_1)det(CMQΔ2​)/det(CMQΔ1​), and RΔ3R_{\Delta_3}RΔ3​​ is a rank-one update of either.
  • Theorem 6. RΔ3=βRΔ1+(1−β)RΔ2R_{\Delta_3}=\beta R_{\Delta_1}+(1-\beta)R_{\Delta_2}RΔ3​​=βRΔ1​​+(1−β)RΔ2​​, with β=λdet⁡RΔ2/(λdet⁡RΔ2+(1−λ)det⁡RΔ1)\beta=\lambda\det R_{\Delta_2}/(\lambda\det R_{\Delta_2}+(1-\lambda)\det R_{\Delta_1})β=λdetRΔ2​​/(λdetRΔ2​​+(1−λ)detRΔ1​​).
  • Lemma 3. Invertibility of CMQΔ3CMQ\Delta_3CMQΔ3​ when the determinants of CMQΔ1CMQ\Delta_1CMQΔ1​ and CMQΔ2CMQ\Delta_2CMQΔ2​ share a sign.
  • Theorem 5(i), (ii). Completely-S\mathcal SS, and Chen-S\mathcal SS of (RΔ,θΔ)(R_\Delta,\theta_\Delta)(RΔ​,θΔ​), pass from Δ1,Δ2\Delta_1,\Delta_2Δ1​,Δ2​ to Δ3\Delta_3Δ3​.
  • Theorem 3. The completely-S\mathcal SS analogue of the goal.

Significance

By Chen's theorem, Chen-S\mathcal SS of (RΔ,θΔ)(R_\Delta,\theta_\Delta)(RΔ​,θΔ​) makes the Skorohod problem of the policy Δ\DeltaΔ stable. Theorem 4 reduces this requirement over a continuum of policies to a finite check, one per static-priority policy, and the paper combines it with a state-space-collapse result to certify robust queue-ratio stability of the DHV, push-started Lu–Kumar and Lu–Kumar networks. The orthogonal convexity of Theorem 5 is of independent interest: the Chen-S\mathcal SS region of ratio matrices is in general not convex, yet it is convex along every axis-parallel segment.

The results are proved on paper and nothing in this mission has been machine-checked. A formal development checks the matrix algebra (adjugate and Sherman–Morrison identities, determinant-sign arguments) and settles the details the paper leaves out. The proof of Theorem 5(ii) is given there only as "an identical argument" to that of part (i). Theorem 6's claim β∈(0,1)\beta\in(0,1)β∈(0,1) needs a same-sign hypothesis that the page omits (see below).

Difficulty

The obvious argument fails because the convexity is only orthogonal. The set of ratio matrices is a product of simplices. A convex combination of two arbitrary Chen-S\mathcal SS ratio matrices need not be Chen-S\mathcal SS, and the inverse RΔ=(CMQΔ)−1R_\Delta=(CMQ\Delta)^{-1}RΔ​=(CMQΔ)−1 is not affine in Δ\DeltaΔ. Two pieces of structure must be found and exploited instead. Moving one column of Δ\DeltaΔ changes CMQΔCMQ\DeltaCMQΔ in one column, which makes RΔR_\DeltaRΔ​ move along a line in a reparametrized coordinate β\betaβ. Then completely-S\mathcal SS and Chen-S\mathcal SS, whose definitions quantify over all partitions and over the solution sets {u≥0:θb+Rbu=0}\{u\ge 0:\theta_b+R_bu=0\}{u≥0:θb​+Rb​u=0}, must be shown to survive that line. The latter sets move with β\betaβ in a way that does not follow from convexity of either endpoint's set. Passing from neighbors to all ratio matrices needs a column-by-column descent through faces of the product of simplices. Invertibility must be maintained along the way, which is where the common determinant sign at the corners enters.

Formalization scope

  • Stations are Fin J, classes Fin K; the paper's index iii is Lean's i−1i-1i−1. The network is a structure Network J K with fields sss, mmm, PPP, α\alphaα and the hypotheses m>0m>0m>0, P≥0P\ge 0P≥0, row sums of PPP at most one, α≥0\alpha\ge 0α≥0, summability of PnP^nPn, and invertibility of I−P⊤I-P^\topI−P⊤. The remark K>JK>JK>J and the renewal arrivals are not used.
  • CCC, M=diag⁡(m)M=\operatorname{diag}(m)M=diag(m), Q=(I−P⊤)−1Q=(I-P^\top)^{-1}Q=(I−P⊤)−1, λ=Qα\lambda=Q\alphaλ=Qα, ρ=CMλ\rho=CM\lambdaρ=CMλ are definitions computed from the network. RΔR_\DeltaRΔ​ and θΔ\theta_\DeltaθΔ​ are definitions computed from Δ\DeltaΔ; θΔ\theta_\DeltaθΔ​ is never a free vector.
  • Ratio matrices include δ≥0\delta\ge 0δ≥0. Without it the goal would assert extrapolation outside the polytope of ratio matrices.
  • Lean's matrix inverse is 000 on singular matrices. Every hypothesis on a corner and the goal's conclusion state invertibility of CMQΔCMQ\DeltaCMQΔ explicitly.
  • Partitions are a : Finset (Fin J) with b=acb=a^{\mathrm c}b=ac; sub-matrices are indexed by the subtypes. Chen-S\mathcal SS quantifies over a≠∅a\neq\emptyseta=∅ (for a=∅a=\emptyseta=∅ the condition reads 0<00<00<0 and would make Chen-S\mathcal SS unsatisfiable and the goal vacuous); b=∅b=\emptysetb=∅ is allowed. Principal sub-matrices in completely-S\mathcal SS are those of nonempty index sets.
  • "All determinants have the same sign" is a single sign for all corners: either all are positive or all are negative.
  • The "Then, Δ1,Δ2,Δ3\Delta_1,\Delta_2,\Delta_3Δ1​,Δ2​,Δ3​ are ratio-matrix neighbors" sentence of Lemmas 3, 4 and Theorems 5, 6 is kept as a first conjunct.
  • Deviation. Theorem 6 asserts β∈(0,1)\beta\in(0,1)β∈(0,1) under invertibility alone, which fails when det⁡RΔ1\det R_{\Delta_1}detRΔ1​​ and det⁡RΔ2\det R_{\Delta_2}detRΔ2​​ have opposite signs. That clause is stated under det⁡RΔ1det⁡RΔ2>0\det R_{\Delta_1}\det R_{\Delta_2}>0detRΔ1​​detRΔ2​​>0; the two identities are stated unconditionally.

A complete development needs the adjugate and determinant identities for matrices differing in one column, a Sherman–Morrison formula for rank-one updates, and a decomposition of ratio matrices along faces of a product of simplices. The definitions of S-matrices, completely-S\mathcal SS and Chen-S\mathcal SS are reusable for other work on reflected processes. Proofs of the milestones, alternative proofs of Theorem 5 that avoid linear-programming duality, and counterexamples showing a hypothesis cannot be dropped are all welcome.

Selected references

  • Y. Zhao, I. Gurvich, J. Hasenbein, A Hierarchical Approach to Robust Stability of Multiclass Queueing Networks, arXiv:2303.17746v3, 2024. https://arxiv.org/abs/2303.17746
  • H. Chen, A sufficient condition for the positive recurrence of a semimartingale reflecting Brownian motion in an orthant, Annals of Applied Probability 6(3):758–765, 1996 (reference [5] of the source).
  • J. G. Dai, On positive Harris recurrence of multiclass queueing networks: a unified approach via fluid limit models, Annals of Applied Probability 5(1):49–77, 1995 (reference [10] of the source).
  • R. Delgado, State space collapse and stability of queueing networks, Mathematical Methods of Operations Research 72(3):477–499, 2010 (reference [16] of the source).
  • M. Bramson, Stability of Queueing Networks, Lecture Notes in Mathematics 1950, Springer, 2008. https://doi.org/10.1007/978-3-540-68896-9
10 thms1 active userReviewed
Bandit AlgorithmsMachine LearningProbability·Captain: mikedeng1

Thompson Sampling with Information Relaxation Penalties III: As T → ∞ the Action Laws of IRS.FH and IRS.V-Zero Converge to That of Thompson SamplingResearch Paper

Motivation

Thompson sampling (TS) is the standard randomized heuristic for the Bayesian multi-armed bandit: at each decision it samples a parameter vector from the current posterior and pulls the arm that would be best if the sample were true. It ignores the remaining horizon. Min, Maglaras and Moallemi (arXiv:1902.04251, Management Science, 2025) obtain horizon-aware generalizations of TS from the information relaxation duality of Brown, Smith and Sun (Oper. Res. 2010). Each penalty function yields an upper bound on the Bayes-optimal value and an IRS policy. Such a policy samples a whole future outcome and plays the first action of the penalized clairvoyant optimum. With the zero-information penalty it is exactly TS.

Two of these policies, IRS.FH and IRS.V-Zero, are designed to interpolate between TS and the myopic rule. When one period remains they pull the arm with the highest predictive mean (Remark 5 of the paper). This mission formalizes the other end, Proposition 1: when many periods remain, they randomize exactly as Thompson sampling does. The paper presents this as the sense in which IRS policies "behave like TS during the initial decision epochs" and shift smoothly from exploration to exploitation without a tuning parameter.

Setting

There are K≥1K \ge 1K≥1 arms A={1,…,K}\mathcal A = \{1,\dots,K\}A={1,…,K}. Arm aaa has an unknown parameter θa\theta_aθa​. Given θa\theta_aθa​, its rewards Ra,1,Ra,2,…R_{a,1}, R_{a,2}, \dotsRa,1​,Ra,2​,… are i.i.d. with law Ra(θa)\mathcal R_a(\theta_a)Ra​(θa​). The prior of θa\theta_aθa​ is Pa(ya)\mathcal P_a(y_a)Pa​(ya​), a member of a conjugate family indexed by a belief yay_aya​. A Bayesian update Ua\mathcal U_aUa​ maps (ya,r)(y_a, r)(ya​,r) to the posterior belief after a reward rrr. The arms are independent. Throughout, rewards are integrable: Eya∣Ra,1∣<∞\mathbb E_{y_a}|R_{a,1}| < \inftyEya​​∣Ra,1​∣<∞ for every belief (display (3)).

  • The conditional mean reward is μa(θa)=E[Ra,n∣θa]\mu_a(\theta_a) = \mathbb E[R_{a,n} \mid \theta_a]μa​(θa​)=E[Ra,n​∣θa​], and the predictive mean is μˉa(ya)=Eya[μa(θa)]\bar\mu_a(y_a) = \mathbb E_{y_a}[\mu_a(\theta_a)]μˉ​a​(ya​)=Eya​​[μa​(θa​)].
  • The outcome ω=(θ,(Ra,n)a,n)\omega = (\theta, (R_{a,n})_{a,n})ω=(θ,(Ra,n​)a,n​) has law I(y)\mathcal I(y)I(y).
  • The posterior predictive mean after the first nnn rewards of arm aaa is μ^a,n(ω;ya)=Eya[μa(θa)∣Ra,1,…,Ra,n]\hat\mu_{a,n}(\omega; y_a) = \mathbb E_{y_a}[\mu_a(\theta_a) \mid R_{a,1},\dots,R_{a,n}]μ^​a,n​(ω;ya​)=Eya​​[μa​(θa​)∣Ra,1​,…,Ra,n​].

At remaining horizon TTT and belief yyy, the three policies act as follows:

  1. TS samples θ~∼P(y)\tilde\theta \sim \mathcal P(y)θ~∼P(y) and plays ATS(y)=argmax⁡aμa(θ~a)A^{TS}(y) = \operatorname{argmax}_a \mu_a(\tilde\theta_a)ATS(y)=argmaxa​μa​(θ~a​).
  2. IRS.FH samples ω~∼I(y)\tilde\omega \sim \mathcal I(y)ω~∼I(y) and plays AIRS.FH(T,y)=argmax⁡aμ^a,T−1(ω~)A^{IRS.FH}(T,y) = \operatorname{argmax}_a \hat\mu_{a,T-1}(\tilde\omega)AIRS.FH(T,y)=argmaxa​μ^​a,T−1​(ω~), the arm with the best posterior mean after T−1T-1T−1 sampled rewards of every arm.
  3. IRS.V-Zero samples ω~∼I(y)\tilde\omega \sim \mathcal I(y)ω~∼I(y) and solves the allocation problem
max⁡n∈NT∑a=1K∑i=1naμ^a,i−1(ω~),NT={n∈N0K:∑ana=T}.\max_{n \in \mathcal N_T} \sum_{a=1}^K \sum_{i=1}^{n_a} \hat\mu_{a,i-1}(\tilde\omega), \qquad \mathcal N_T = \Big\{n \in \mathbb N_0^K : \sum_a n_a = T\Big\}.n∈NT​max​a=1∑K​i=1∑na​​μ^​a,i−1​(ω~),NT​={n∈N0K​:a∑​na​=T}.

It then plays the arm AIRS.V-Zero(T,y)=argmax⁡an~a∗A^{IRS.V\text{-}Zero}(T,y) = \operatorname{argmax}_a \tilde n^*_aAIRS.V-Zero(T,y)=argmaxa​n~a∗​ to which the optimal allocation n~∗\tilde n^*n~∗ assigns the most pulls.

Each action is a random variable driven by the policy's own sample.

Formalization targets

Goal: Proposition 1 (p. 25)

Assume μi(θi)≠μj(θj)\mu_i(\theta_i) \ne \mu_j(\theta_j)μi​(θi​)=μj​(θj​) almost surely under P(y)\mathcal P(y)P(y), for all i≠ji \ne ji=j. Then for every arm aaa,

lim⁡T→∞P[AIRS.FH(T,y)=a]=P[ATS(y)=a],lim⁡T→∞P[AIRS.V-Zero(T,y)=a]=P[ATS(y)=a].\lim_{T\to\infty} \mathbb P[A^{IRS.FH}(T,y) = a] = \mathbb P[A^{TS}(y) = a], \qquad \lim_{T\to\infty} \mathbb P[A^{IRS.V\text{-}Zero}(T,y) = a] = \mathbb P[A^{TS}(y) = a].T→∞lim​P[AIRS.FH(T,y)=a]=P[ATS(y)=a],T→∞lim​P[AIRS.V-Zero(T,y)=a]=P[ATS(y)=a].

This holds for every choice of the tie-breaking rules in the argmaxes and in the allocation problem.

Milestones

  1. Proposition 4 (p. 53): μa(θa)\mu_a(\theta_a)μa​(θa​) and max⁡aμa(θa)\max_a \mu_a(\theta_a)maxa​μa​(θa​) are integrable under the prior.
  2. Proposition 5 (p. 54): μ^a,n\hat\mu_{a,n}μ^​a,n​ and the sample mean 1n∑i≤nRa,i\frac1n\sum_{i\le n} R_{a,i}n1​∑i≤n​Ra,i​ converge almost surely to μa(θa)\mu_a(\theta_a)μa​(θa​).
  3. Display (109) (p. 54): if a sequence of vectors converges to a vector with distinct entries, every argmax rule eventually selects the argmax of the limit.
  4. The allocation argument (113)–(123) (pp. 54–56): if the payoff rows converge to distinct limits, then for large TTT every optimal allocation gives its largest share only to the arm with the largest limit.
  5. Display (55) alone: the IRS.FH half of the goal.

Significance

Proposition 1 identifies the long-horizon behaviour of the two IRS policies with that of Thompson sampling. Together with Remark 5 it pins down both ends of the horizon. It explains why their simulated regret curves track TS early and the myopic policy late (§5 of the paper). It also shows that the design choice "play the arm with the largest allocation" in IRS.V-Zero is the one that recovers TS. Other selection rules, such as any arm with a positive allocation, need not.

The paper gives a complete proof in Appendix D.1–D.2. A machine-checked version adds three things. It fixes the probabilistic model of a conjugate Bayesian bandit with infinite reward sequences in Lean, which the companion missions on the same paper also need. It makes the role of tie-breaking explicit. And it repairs a step of the printed proof: the bound n∘(AT∘)≥⌊T/2⌋n^\circ(A^\circ_T) \ge \lfloor T/2 \rfloorn∘(AT∘​)≥⌊T/2⌋ in §D.2 holds only for two arms, and the general case needs ⌈T/K⌉\lceil T/K \rceil⌈T/K⌉ and a threshold growing with KKK. No formalization of this result is known on Prove2Me or in Mathlib.

Difficulty

The IRS.FH half reduces to almost-sure convergence of posterior means, which is a martingale argument (Lévy's upward theorem). That argument needs μa(θa)\mu_a(\theta_a)μa​(θa​) to be measurable with respect to the limit σ\sigmaσ-algebra of the reward sequence, a fact supplied by the strong law of large numbers. Building the outcome law, a mixture over θ\thetaθ of infinite product measures, and identifying the conjugate update with conditional expectation are where the measure theory lies.

The IRS.V-Zero half does not follow from convergence of the posterior means alone. The selected arm is a function of an optimal allocation of a combinatorial problem whose size grows with TTT. The naive expectation that the arm with the best limit receives "most" pulls has to be proved by an exchange argument that handles the finitely many early terms, where the posterior means can still be badly ordered. The printed version of this argument is correct only for K=2K = 2K=2.

Formalization scope

  • Arms are Fin K with NeZero K; the reward sequence of an arm is ℕ → ℝ, 0-based.
  • One parameter type and one belief type serve all arms; reward laws and priors are Markov kernels.
  • Conjugacy is stated as Bayes' rule on rectangles for every belief. The update is assumed jointly measurable, and the standing integrability (3) is assumed for every belief.
  • The outcome law I(y)\mathcal I(y)I(y) is a product over arms of mixtures ∫δθ⊗Ra(θ)⊗N Pa(ya)(dθ)\int \delta_\theta \otimes \mathcal R_a(\theta)^{\otimes \mathbb N}\, \mathcal P_a(y_a)(d\theta)∫δθ​⊗Ra​(θ)⊗NPa​(ya​)(dθ).
  • μ^a,n\hat\mu_{a,n}μ^​a,n​ is the pathwise conjugate version μˉa(ya,n)\bar\mu_a(y_{a,n})μˉ​a​(ya,n​) of the conditional expectation (10), defined at every outcome so that it can sit inside an argmax.
  • P[A=a]\mathbb P[A = a]P[A=a] is the mass of {a}\{a\}{a} under the pushforward of the policy's sampling law. All tie-breaking rules are required to be measurable; otherwise the pushforward would be the zero measure.
  • The assumption of the proposition is required almost surely under the prior, not as injectivity of μ\muμ.
  • A formalization in which the selectors were non-measurable, the outcome law degenerate, or the distinctness hypothesis unsatisfiable would make the goal vacuous. The definitions rule out the first two, and a deterministic two-arm instance shows the hypotheses are satisfiable.

The development needs Lévy's upward theorem (MeasureTheory.tendsto_ae_condExp in Mathlib) and the strong law of large numbers (ProbabilityTheory.strong_law_ae). It also needs a lemma identifying iterated conjugate updates with the posterior given finitely many rewards, and the measurability of θ↦Ra(θ)⊗N\theta \mapsto \mathcal R_a(\theta)^{\otimes\mathbb N}θ↦Ra​(θ)⊗N. These last two are reusable for any Bayesian bandit or sequential-estimation development. Contributions of the two deterministic milestones are self-contained and welcome first.

Selected references

  • S. Min, C. Maglaras, C. C. Moallemi, Thompson Sampling with Information Relaxation Penalties, Management Science, 2025; preprint arXiv:1902.04251v2, 2021. https://arxiv.org/abs/1902.04251
  • D. B. Brown, J. E. Smith, P. Sun, Information Relaxations and Duality in Stochastic Dynamic Programs, Operations Research 58(4), 2010. https://doi.org/10.1287/opre.1090.0796
  • W. R. Thompson, On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two Samples, Biometrika 25(3/4), 1933. https://doi.org/10.2307/2332286
  • D. Russo, B. Van Roy, Learning to Optimize via Posterior Sampling, Mathematics of Operations Research 39(4), 2014. https://doi.org/10.1287/moor.2014.0650
9 thms1 active userReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Simple and Explicit Bounds for Multiserver Queues with 1/(1−ρ) Scaling: With More Than 2.5 Finite Service Moments, GI/GI/n Steady-State Queue Tails and Delay Probability Obey Explicit BoundsResearch Paper

Motivation

Multi-server queues model call centres, hospital wards, cloud server pools and any system in which nnn identical servers work through one first-come-first-served (FCFS) line. Capacity planning for such systems needs bounds on the steady-state queue length and on the probability of delay (the chance that an arriving job finds every server busy) that are explicit, hold for every nnn, and stay informative as the load approaches capacity.

For a single server, Kingman's bound (Kingman 1962, ref. [89] of the paper) gives exactly this: the mean wait is at most a multiple of 1/(1−ρ)1/(1-\rho)1/(1−ρ) that depends only on the first two moments of the inter-arrival and service times. For nnn servers with general distributions (the GI/GI/n queue), no comparable explicit bound was known.

Timeline.

  • 1962: Kingman's single-server bound.
  • 1981: Halfin and Whitt identify the heavy-traffic regime n(1−ρ)→β\sqrt n(1-\rho)\to\betan​(1−ρ)→β in which the probability of delay is nondegenerate (Halfin and Whitt 1981).
  • 2013: Gamarnik and Goldberg prove (for the GI/G/n queue) that the steady-state number waiting is stochastically dominated by the supremum of a process built from independent renewal processes (Gamarnik and Goldberg 2013). Their bound is not explicit and needs more than two service moments.
  • 2017–2025: Li and Goldberg derive explicit bounds with 1/(1−ρ)1/(1-\rho)1/(1−ρ) scaling under E[A2]<∞\mathbb E[A^2]<\inftyE[A2]<∞ and E[S2+ϵ]<∞\mathbb E[S^{2+\epsilon}]<\inftyE[S2+ϵ]<∞ (arXiv:1706.04628, Mathematics of Operations Research 2025).

Setting

A GI/GI/n queue has n≥1n\ge1n≥1 identical servers and one FCFS line. Jobs arrive with i.i.d. inter-arrival times distributed as a nonnegative random variable AAA. Each job needs an i.i.d. service time distributed as a nonnegative random variable SSS, independent of the arrivals. An arriving job starts service at the first server to become free, in order of arrival.

Write μA=1/E[A]\mu_A=1/\mathbb E[A]μA​=1/E[A] and μS=1/E[S]\mu_S=1/\mathbb E[S]μS​=1/E[S] for the arrival and service rates, and ρ=μA/(nμS)\rho=\mu_A/(n\mu_S)ρ=μA​/(nμS​) for the traffic intensity. The moment index is

r∗=sup⁡{r:E[Sr]<∞},r^*=\sup\{r:\mathbb E[S^r]<\infty\},r∗=sup{r:E[Sr]<∞},

which may be +∞+\infty+∞. Normalised moments are E[(AμA)2]\mathbb E[(A\mu_A)^2]E[(AμA​)2] and E[(SμS)r]\mathbb E[(S\mu_S)^r]E[(SμS​)r].

Q(t)Q(t)Q(t) is the number of jobs in the system (in service and waiting) at time ttt. "Q(∞)Q(\infty)Q(∞) exists" means that, whatever the initial condition, Q(t)Q(t)Q(t) converges in distribution as t→∞t\to\inftyt→∞ to a random variable Q(∞)Q(\infty)Q(∞). The steady-state number waiting is L(∞)=max⁡(0,Q(∞)−n)L(\infty)=\max(0,Q(\infty)-n)L(∞)=max(0,Q(∞)−n), and the steady-state probability of delay is P(Q(∞)≥n)\mathbb P(Q(\infty)\ge n)P(Q(∞)≥n).

The milestones also use equilibrium renewal processes. For a nonnegative XXX with finite mean, its equilibrium law R(X)R(X)R(X) satisfies P(R>y)=1E[X]∫y∞P(X>z) dz\mathbb P(R>y)=\frac1{\mathbb E[X]}\int_y^\infty\mathbb P(X>z)\,dzP(R>y)=E[X]1​∫y∞​P(X>z)dz. An equilibrium renewal process with renewals distributed as XXX has its first renewal interval distributed as R(X)R(X)R(X) and the later ones distributed as XXX.

Ae(t)A_e(t)Ae​(t) counts the renewals in [0,t][0,t][0,t] of such a process for AAA. Ne,1(t),…,Ne,n(t)N_{e,1}(t),\dots,N_{e,n}(t)Ne,1​(t),…,Ne,n​(t) count those of nnn independent such processes for SSS, also independent of AeA_eAe​.

Formalization targets

Goal: Theorem 2 (pp. 9–10)

Assume

  • E[A2]<∞\mathbb E[A^2]<\inftyE[A2]<∞;
  • r∗>2.5r^*>2.5r∗>2.5;
  • μA<nμS\mu_A<n\mu_SμA​<nμS​;
  • Q(∞)Q(\infty)Q(∞) exists.

Then for all x>0x>0x>0 and all r∈[2.5,r∗)r\in[2.5,r^*)r∈[2.5,r∗),

P(L(∞)≥x1−ρ)≤2⋅104 E[(SμS)2] (106)r(E[(SμS)2]r−1r2.5r+r1.5rE[(SμS)r])x−r2+1.1 e−.0225 E[(AμA)2]−1x,\mathbb P\Big(L(\infty)\ge\frac x{1-\rho}\Big)\le 2\cdot10^4\,\mathbb E[(S\mu_S)^2]\,(10^6)^r\Big(\mathbb E[(S\mu_S)^2]^{r-1}r^{2.5r}+r^{1.5r}\mathbb E[(S\mu_S)^r]\Big)x^{-\frac r2}+1.1\,e^{-.0225\,\mathbb E[(A\mu_A)^2]^{-1}x},P(L(∞)≥1−ρx​)≤2⋅104E[(SμS​)2](106)r(E[(SμS​)2]r−1r2.5r+r1.5rE[(SμS​)r])x−2r​+1.1e−.0225E[(AμA​)2]−1x, P(Q(∞)≥n)≤2⋅104 E[(SμS)2] (107)r(E[(SμS)2]r−1r2.5r+r1.5rE[(SμS)r])(n(1−ρ)2)−r2+1.1 e−.0028 E[(AμA)2]−1n(1−ρ)2.\mathbb P\big(Q(\infty)\ge n\big)\le 2\cdot10^4\,\mathbb E[(S\mu_S)^2]\,(10^7)^r\Big(\mathbb E[(S\mu_S)^2]^{r-1}r^{2.5r}+r^{1.5r}\mathbb E[(S\mu_S)^r]\Big)\big(n(1-\rho)^2\big)^{-\frac r2}+1.1\,e^{-.0028\,\mathbb E[(A\mu_A)^2]^{-1}n(1-\rho)^2}.P(Q(∞)≥n)≤2⋅104E[(SμS​)2](107)r(E[(SμS​)2]r−1r2.5r+r1.5rE[(SμS​)r])(n(1−ρ)2)−2r​+1.1e−.0028E[(AμA​)2]−1n(1−ρ)2.

The paper states the infimum over rrr. With rrr universally quantified the statement is equivalent, because the exponential term does not depend on rrr.

Milestones

They follow the paper's proof, in attack order:

  • Lemma 1, the Gamarnik–Goldberg comparison P(L(∞)≥x)≤P(sup⁡t≥0(Ae(t)−∑i=1nNe,i(t))≥x)\mathbb P(L(\infty)\ge x)\le\mathbb P(\sup_{t\ge0}(A_e(t)-\sum_{i=1}^nN_{e,i}(t))\ge x)P(L(∞)≥x)≤P(supt≥0​(Ae​(t)−∑i=1n​Ne,i​(t))≥x);
  • Lemma 2, which splits that supremum into an arrival part and a service part;
  • Lemmas 8, 9 and 10, which reduce the arrival part to Kingman's bound with an explicit exponent;
  • Lemma 3, the exponential bound for the arrival part;
  • Lemma 4 and Theorem 10, conditional bounds from central moments of the pooled process ∑iNe,i(t)\sum_iN_{e,i}(t)∑i​Ne,i​(t);
  • Lemmas 5 and 6, those central-moment bounds;
  • the explicit bound for r∈(2.5,r∗)r\in(2.5,r^*)r∈(2.5,r∗) displayed on p. 28;
  • Lemma 14, a transient comparison for a queue started with all servers busy;
  • Lemma 7 and Corollary 5, comparisons with fewer servers that make the bound informative at the level Q(∞)≥nQ(\infty)\ge nQ(∞)≥n.

Significance

The result. The bounds hold for every nnn and every load with ρ<1\rho<1ρ<1, and they depend on the distributions only through a few normalised moments. In the Halfin–Whitt regime, n(1−ρ)2n(1-\rho)^2n(1−ρ)2 stays bounded away from zero, so the delay bound stays informative. As ρ→1\rho\to1ρ→1 with nnn fixed, the queue tail decays at the Kingman scale 1/(1−ρ)1/(1-\rho)1/(1−ρ). These are the first such bounds for general GI/GI/n queues; earlier explicit results needed Poisson arrivals or exponential service. The paper derives from Theorem 2 bounds at a fixed rrr (Corollaries 1–2), a refinement beyond 1/(1−ρ)1/(1-\rho)1/(1−ρ) scaling when n(1−ρ)2n(1-\rho)^2n(1−ρ)2 is large (Corollary 3), and optimised bounds under growth conditions on E[(SμS)r]\mathbb E[(S\mu_S)^r]E[(SμS​)r] (Theorem 3).

Formalization. The theorem is proved in the paper, partly in a supplemental appendix, and none of it is formalized; there are no machine-checked results for multi-server queues with general distributions anywhere. A complete development would add to the platform the first FCFS multi-server queue with general distributions, its steady state, equilibrium renewal processes, and the Gamarnik–Goldberg comparison chain. Each is reusable for later work on many-server queues.

Difficulty

The obvious route is to compare the nnn-server queue with a single-server one, or to apply a heavy-traffic limit. The first loses a factor of nnn; the second gives limits but no bounds at a fixed nnn.

The paper's route needs two hard ingredients:

  • Comparison with renewal processes. The stochastic comparison of Lemmas 1 and 14 is a theorem about the sample-path dynamics of FCFS service, not a calculation.
  • Uniform moment bounds. Explicit control of E∣∑i=1nNe,i(t)−nt∣r\mathbb E|\sum_{i=1}^nN_{e,i}(t)-nt|^rE∣∑i=1n​Ne,i​(t)−nt∣r at the scale (nt)r/2(nt)^{r/2}(nt)r/2, uniformly in nnn and ttt, is required. Classical renewal moment bounds are either asymptotic in ttt or lose the dependence on nnn.

For the probability of delay, Lemma 1 at level 000 gives only the trivial bound 111. A second comparison across server counts (Lemma 7) is needed.

Formalization scope

Laws. AAA and SSS are represented by their laws μA,μS\mu_A,\mu_SμA​,μS​: probability measures on R\mathbb RR carried by [0,∞)[0,\infty)[0,∞), integrable, with positive mean. Positivity of the means is implicit in the paper, which needs μX=1/E[X]\mu_X=1/\mathbb E[X]μX​=1/E[X] finite; it is stated explicitly. E[(XμX)r]\mathbb E[(X\mu_X)^r]E[(XμX​)r] is a real integral and is used only where it is finite: r<r∗r<r^*r<r∗ for SSS, and r=2r=2r=2 with E[A2]<∞\mathbb E[A^2]<\inftyE[A2]<∞ for AAA. r∗r^*r∗ is an extended real.

The queue.

  • The queue is the Kiefer–Wolfowitz workload recursion, driven by an initial condition and i.i.d. pairs of inter-arrival and service times.
  • An initial condition gives the first-arrival time and the residual service time at each server. No job waits at time 000.
  • "Q(∞)Q(\infty)Q(∞) exists with law π\piπ" quantifies over every initial law of that kind, independent of the inputs. This class is narrower than the paper's, so the hypothesis is weaker and the stated theorem is stronger. The paper's proof uses only such initial conditions (Lemma 7 through Lemma 14).
  • L(∞)L(\infty)L(∞) is the truncated difference max⁡(0,Q(∞)−n)\max(0,Q(\infty)-n)max(0,Q(∞)−n).

Renewal processes.

  • Counts are natural numbers, computed pathwise from the renewal intervals.
  • Bounding families are arbitrary probability spaces carrying mutually independent intervals with the prescribed laws.
  • Suprema of processes are taken in the extended reals.

Ruled out. None of the following trivializing formalizations is used:

  • a steady-state hypothesis that no queue satisfies, or one restricted to an initial-condition class that drops what Lemma 7 needs;
  • a real-valued supremum or infimum, which collapses to 000 on unbounded families;
  • a Bochner moment of a non-integrable function, which is 000 in Lean.

The infimum over rrr is stated as a universal quantifier.

Needed infrastructure. Equilibrium distributions and renewal counting processes, moment and maximal inequalities for sums of independent renewal processes, Kingman's exponential martingale bound, and the sample-path comparison of FCFS multi-server queues. Contributions on any of these are welcome: the renewal and random-walk results (Lemmas 5, 6, 8–10) are independent of queueing.

Selected references

  • Y. Li and D. A. Goldberg, Simple and explicit bounds for multi-server queues with 1/(1−ρ) scaling, Mathematics of Operations Research, 2025; arXiv:1706.04628v3. https://arxiv.org/abs/1706.04628
  • D. Gamarnik and D. A. Goldberg, Steady-state GI/G/n queue in the Halfin–Whitt regime, Annals of Applied Probability 23(6), 2382–2419, 2013. https://doi.org/10.1214/12-AAP905
  • S. Halfin and W. Whitt, Heavy-traffic limits for queues with many exponential servers, Operations Research 29(3), 1981. https://doi.org/10.1287/opre.29.3.567
  • J. F. C. Kingman, On queues in heavy traffic, Journal of the Royal Statistical Society B 24, 383–392, 1962 (ref. [89] of Li–Goldberg).
  • J. F. C. Kingman, A martingale inequality in the theory of queues, Mathematical Proceedings of the Cambridge Philosophical Society 60(2), 359–361, 1964 (ref. [90] of Li–Goldberg; the source of Lemma 9).
16 thms1 active userReviewed
Bandit AlgorithmsHarmonic AnalysisMachine Learning+1·Captain: mikedeng1

Learning and Optimization with Seasonal Patterns 1: Regret Upper Bound for the Two-Stage Period-Estimation and Confidence-Bound PolicyResearch Paper

Motivation

Many demand, traffic and click-through series are seasonal: their mean repeats after a fixed number of periods (a week of days, a year of months), while the length of that cycle is not known in advance. A retailer choosing among KKK promotions, or a platform choosing among KKK recommendations, then faces a multi-armed bandit whose arms have time-varying but periodic mean rewards. Standard stochastic bandit algorithms assume stationary means and fail here, and fully adversarial or arbitrarily drifting models give up the structure that periodicity offers.

N. Chen, C. Wang and L. Wang (arXiv:2005.08088, Operations Research, 2025) propose a two-stage policy for this problem: a spectral first stage that estimates every arm's period from a short exploration phase, and a confidence-bound second stage that learns and exploits the resulting "effective arms". Their main upper bound, Theorem 1, shows that the policy's regret grows like T∑kTk\sqrt{T\sum_k T_k}T∑k​Tk​​ up to logarithmic factors. This mission formalizes that theorem and the chain of lemmas behind it. The matching lower bound (Theorem 3 of the paper) is the subject of a separate mission of this series.

Setting

At each epoch t=1,…,Tt=1,\dots,Tt=1,…,T a decision maker pulls one of KKK arms. Pulling arm kkk at epoch ttt yields the reward Yk,t=μk,t+ϵtY_{k,t}=\mu_{k,t}+\epsilon_tYk,t​=μk,t​+ϵt​. The mean μk,t\mu_{k,t}μk,t​ has a minimum period Tk≥1T_k\ge1Tk​≥1: μk,t+Tk=μk,t\mu_{k,t+T_k}=\mu_{k,t}μk,t+Tk​​=μk,t​ for all t≥1t\ge1t≥1, and no smaller positive shift has this property. The standing assumptions are:

  • Assumption 1: μk,t∈[0,1]\mu_{k,t}\in[0,1]μk,t​∈[0,1].
  • Assumption 2: the noises ϵt\epsilon_tϵt​ are independent and sub-Gaussian with parameter σ\sigmaσ, i.e. E[eλϵt]≤eσ2λ2/2\mathbb E[e^{\lambda\epsilon_t}]\le e^{\sigma^2\lambda^2/2}E[eλϵt​]≤eσ2λ2/2 for all real λ\lambdaλ and P(∣ϵt∣>x)≤2e−x2/(2σ2)\mathbb P(|\epsilon_t|>x)\le2e^{-x^2/(2\sigma^2)}P(∣ϵt​∣>x)≤2e−x2/(2σ2).

The pseudo-regret of an arm sequence π\piπ is RTπ=∑t=1T(max⁡kμk,t−μπt,t)R^\pi_T=\sum_{t=1}^T(\max_k\mu_{k,t}-\mu_{\pi_t,t})RTπ​=∑t=1T​(maxk​μk,t​−μπt​,t​), and the number of effective arms is d=∑k=1KTkd=\sum_{k=1}^KT_kd=∑k=1K​Tk​: arm kkk at phase t mod Tkt \bmod T_ktmodTk​ is one effective arm.

Stage one (Algorithm 1). Each arm is pulled nnn times in a row. From its nnn rewards the policy computes the periodogram ∣y~k(v)∣|\tilde y_k(v)|∣y~​k​(v)∣, the modulus of the discrete Fourier transform y~k(v)=1n∑sYk,se−2πivs\tilde y_k(v)=\frac1n\sum_sY_{k,s}e^{-2\pi ivs}y~​k​(v)=n1​∑s​Yk,s​e−2πivs, on v∈[0,1/2]v\in[0,1/2]v∈[0,1/2]. A data-driven threshold τk\tau_kτk​ is computed from the constants U1,U2U_1,U_2U1​,U2​ (sums of sinc-type maxima), ϵˉv=2σH1−π/24log⁡(n)/n\bar\epsilon_v=\frac{2\sigma H}{1-\pi/24}\sqrt{\log(n)/n}ϵˉv​=1−π/242σH​log(n)/n​ and sup⁡v∣y~k(v)∣\sup_v|\tilde y_k(v)|supv​∣y~​k​(v)∣. The algorithm repeatedly takes the highest peak above τk\tau_kτk​ in [g/n,1/2][g/n,1/2][g/n,1/2], snaps it to the nearest fraction j1/j2j_1/j_2j1​/j2​ with j2<n/(2g)j_2<n/(2g)j2​<n/(2g), and removes a 2g/n2g/n2g/n-neighbourhood. The period estimate T^k\hat T_kT^k​ is the least common multiple of the selected reciprocals.

Stage two (Algorithm 2). At every later epoch an SSS-round screening tournament, S=⌊log⁡2T⌋S=\lfloor\log_2T\rfloorS=⌊log2​T⌋, compares the arms at their current phases modulo T^k\hat T_kT^k​. It uses estimated means mk,t(s)m^{(s)}_{k,t}mk,t(s)​ and widths wk,t(s)w^{(s)}_{k,t}wk,t(s)​ pooled from the stage-one samples and from round-specific index sets Ψ(s)(t)\Psi^{(s)}(t)Ψ(s)(t). The weak oracle runs the same policy with the true periods in place of T^k\hat T_kT^k​.

The parameters are fixed by (7): n=⌊T/K⌋n=\lfloor\sqrt{T/K}\rfloorn=⌊T/K​⌋, g=⌈n⌉g=\lceil\sqrt n\rceilg=⌈n​⌉, H=1+log⁡nH=\sqrt{1+\log n}H=1+logn​. Assumption 3 asks T>4KT>4KT>4K, g≥max⁡{2,n}g\ge\max\{2,\sqrt n\}g≥max{2,n​} and Tk<n/(2g)T_k<n/(2g)Tk​<n/(2g). Assumption 4 asks the smallest present Fourier coefficient bkb_kbk​ of each arm to dominate a combination of ϵˉv\bar\epsilon_vϵˉv​ and the largest coefficient BkB_kBk​.

Formalization targets

Goal: Theorem 1

Under Assumptions 1–4 and (7), the two-stage policy satisfies

E[RTπ]≤CT d log⁡2(T) log⁡(T/d),\mathbb E\big[R^\pi_T\big]\le C\sqrt{T\,d\,\log^2(T)\,\log(T/d)} ,E[RTπ​]≤CTdlog2(T)log(T/d)​,

with CCC depending only on σ\sigmaσ and KKK, and with Algorithm 2 run at δ=8/T\delta=8/Tδ=8/T.

Stage one: correct period identification

  • Lemma 1: uniform noise bound for the periodogram, 48nexp⁡(−(nδ2/4σ2)(1−π/24)2)48n\exp(-(n\delta^2/4\sigma^2)(1-\pi/24)^2)48nexp(−(nδ2/4σ2)(1−π/24)2).
  • Lemmas 2–3: leakage bounds πBkU1\pi B_kU_1πBk​U1​, πBkU2\pi B_kU_2πBk​U2​, and Bk≤(sup⁡∣ϵ~k∣+sup⁡∣y~k∣)/(1−πU2)B_k\le(\sup|\tilde\epsilon_k|+\sup|\tilde y_k|)/(1-\pi U_2)Bk​≤(sup∣ϵ~k​∣+sup∣y~​k​∣)/(1−πU2​).
  • Lemmas 4–5: the threshold separates the neighbourhoods of the present frequencies from the rest, with probability 1−48/nH2−11-48/n^{H^2-1}1−48/nH2−1.
  • Lemmas 6–7: the sharper noise bound near possible present frequencies, and the location of the peaks within 1/n1/n1/n of them.
  • Theorem 2: P(Λ)≥1−48K/nH2−1−200K/n0.867H2−1−200K/n0.6934H2−1\mathbb P(\Lambda)\ge1-48K/n^{H^2-1}-200K/n^{0.867H^2-1}-200K/n^{0.6934H^2-1}P(Λ)≥1−48K/nH2−1−200K/n0.867H2−1−200K/n0.6934H2−1.

Stage two: the oracle's regret

  • Lemma 15: an anytime sub-Gaussian deviation bound.
  • Lemma 9: the confidence event E\mathcal EE has probability at least 1−δS1-\delta S1−δS.
  • Lemma 10: on E\mathcal EE the optimal arm survives screening, and each epoch's gap is at most 111, 8σ/2s8\sigma/2^s8σ/2s or 2σ/T2\sigma/\sqrt T2σ/T​.
  • Lemma 16: the summed widths of a round are at most 4σ∣Ψ(s)(T)∣ dlog⁡(8T/δ)log⁡(T/d)4\sigma\sqrt{|\Psi^{(s)}(T)|\,d\log(8T/\delta)\log(T/d)}4σ∣Ψ(s)(T)∣dlog(8T/δ)log(T/d)​.
  • Lemma 11: the oracle's expected regret is at most CTdlog⁡2(T)log⁡(T/d)C\sqrt{Td\log^2(T)\log(T/d)}CTdlog2(T)log(T/d)​ with CCC depending only on σ\sigmaσ.

Significance

The theorem shows that unknown seasonality costs only the factor d=∑kTk\sqrt{d}=\sqrt{\sum_kT_k}d​=∑k​Tk​​ that would be paid if every phase of every arm were a separate stationary arm. Up to logarithmic factors this matches the TK\sqrt{TK}TK​ rate of the classical stationary bandit with ddd arms in place of KKK. Together with the paper's lower bound Ω(Tmax⁡kTk)\Omega(\sqrt{T\max_kT_k})Ω(Tmaxk​Tk​​) it locates the minimax regret of periodic bandits within a factor K\sqrt KK​. Stage one is a non-asymptotic, finite-sample period-identification guarantee for a thresholded periodogram, which is of independent use in spectral estimation.

The paper proves these results; none of them is machine-checked. A complete development yields a verified finite-sample periodogram theory (noise bounds for random trigonometric polynomials, Dirichlet-kernel leakage estimates), a verified anytime sub-Gaussian inequality, and a verified analysis of a nested elimination algorithm with data reuse. The formalization also pins down several points the printed text leaves open: the constant 0.2330.2330.233 of Lemma 6 and the exponent 0.6940.6940.694 of Lemma 7 and Theorem 2 are slightly stronger than what the proofs give, and the printed claim that Theorem 1's constant is independent of KKK is not established by the printed argument.

Difficulty

Two steps resist the obvious approach. In stage one, the periodogram has to be controlled at uncountably many frequencies at once. A union bound over vvv is unavailable, and the leakage of each present frequency spreads over the whole spectrum, so both the noise and the signal must be bounded uniformly in vvv with explicit constants. In stage two, the samples used to estimate an effective arm are selected with the estimated periods, which were computed from the same stage-one data, so the usual independence behind confidence bounds fails. Lemmas 9–11 are therefore stated for the weak oracle, whose sample selection does not depend on the data; on the event Λ\LambdaΛ the definitions make the oracle's run and the policy's run the same function of the noise path.

Formalization scope

Epochs are natural numbers t≥1t\ge1t≥1; arms are Fin K (the paper's arm kkk is index k−1k-1k−1), and K≥1K\ge1K≥1. The noise is a sequence ϵ:N→Ω→R\epsilon:\mathbb N\to\Omega\to\mathbb Rϵ:N→Ω→R on a probability space, independent, with Mathlib's HasSubgaussianMGF at variance proxy σ2\sigma^2σ2, plus the printed tail clause. Both algorithms are defined in full, as deterministic functions of the noise path, with canonical tie-breaking: smallest maximizer, smallest closest candidate, smallest arm index. Algorithm 1's loop runs at most nnn passes, and LCM(v^i−1)\mathrm{LCM}(\hat v_i^{-1})LCM(v^i−1​) is the least common multiple of the reduced denominators of the selected frequencies. Algorithm 2 takes its period vector as an argument; the two-stage policy and the oracle are its two instances. Expected regret is an outer expectation: an integrable majorant of the regret whose integral obeys the bound. Probability bounds bound the outer measure of the bad event. Every DFT uses the absolute stage-one epochs, as in Step 8 of Algorithm 1.

Disclosed deviations: Theorem 1's constant depends on σ\sigmaσ and KKK (the printed proof does not give uniformity in KKK), and δ=8/T\delta=8/Tδ=8/T is fixed as in the proof of Lemma 11. Lemma 6 uses 0.23280.23280.2328 for the printed 0.2330.2330.233; Lemma 7 and Theorem 2 use 0.69340.69340.6934 for the printed 0.6940.6940.694. Lemma 7 covers the nonzero present frequencies. Lemma 11 states the standing Assumption 3 and the parameters (7) as hypotheses, as its proof uses them.

The algorithm is the object of the theorem. Replacing Algorithm 1 by "any estimator that is correct with high probability", or Algorithm 2 by "any policy with the oracle's regret", would make the goal a different and much weaker statement. So would placing the constant after the horizon or the instance, since the regret is at most TTT, or using a bare Lebesgue integral of a possibly non-measurable regret.

A complete development needs discrete Fourier analysis of finite sequences, Bernstein's inequality for complex polynomials on the unit disc (Lemma 14 of the paper, from Nagy and Totik), sinc-function estimates, anytime concentration for sub-Gaussian sums, and a bookkeeping layer for the nested index sets of Algorithm 2. The concentration and polynomial-inequality parts are reusable beyond this mission. Proofs of individual lemmas, helper lemmas such as the closed form (6) of the frequency components, and alternative arguments are welcome.

Selected references

  • N. Chen, C. Wang, L. Wang, Learning and Optimization with Seasonal Patterns, arXiv:2005.08088v4, 2021; Operations Research, 2025. https://arxiv.org/abs/2005.08088
  • P. Auer, Using Confidence Bounds for Exploitation-Exploration Trade-offs, Journal of Machine Learning Research 3, 397–422, 2002. https://www.jmlr.org/papers/v3/auer02a.html
  • L. Li, Y. Lu, D. Zhou, Provably Optimal Algorithms for Generalized Linear Contextual Bandits, ICML 2017. https://arxiv.org/abs/1703.00048
  • B. Nagy, V. Totik, Bernstein's Inequality for Algebraic Polynomials on Circular Arcs, Constructive Approximation 37, 223–232, 2013.
17 thms1 active userReviewed
EconomicsOptimization·Captain: mikedeng1

Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration 1: A Pure Human-Driver Market Has a Unique Maximal Stable Equilibrium, Increasing in Market SizeResearch Paper

Motivation

Ride-hailing platforms match riders with drivers who choose for themselves whether to work. Autonomous vehicles (AVs) would replace part of this self-scheduling labor with capital whose fleet size the platform chooses. Lian and van Ryzin study when, and under which market configuration, the cost savings of AVs reach riders. Their comparison needs a benchmark: the market served by human drivers (HVs) alone. This mission formalizes that benchmark, Proposition 1 of the paper, together with the lemmas on minimal supply and utilization that the rest of the paper uses.

Two economic forces drive the benchmark. The first is the density effect: in a denser market an idle car is closer to the next rider, so pickups are shorter and each driver spends more of the hour on paid trips. The second is the supply effect of labor: a larger fleet requires higher hourly earnings to attract the marginal driver. Proposition 1 describes how the equilibrium demand, fleet size, utilization and price respond to market size when both forces are present.

The source is the authors' 2023 SSRN working paper (abstract 3716491, version of 23 August 2023); all theorem, lemma and equation numbers refer to that version, not to the 2025 Management Science article.

Setting

A market has an ETA function t1(s)=as−rt_1(s) = a s^{-r}t1​(s)=as−r with a>0a > 0a>0 and 0≤r<10 \le r < 10≤r<1, the expected pickup time when sss cars are open (idle); rrr is the ETA elasticity, and r>0r > 0r>0 means a density effect. A trip lasts t2>0t_2 > 0t2​>0 hours. Rider values for a ride hour are uniform on [0,V][0, V][0,V], V>0V > 0V>0. HVs have the supply curve w(n)=w0+αnw(n) = w_0 + \alpha nw(n)=w0​+αn, w0>0w_0 > 0w0​>0, α≥0\alpha \ge 0α≥0: a fleet of nnn drivers participates when hourly earnings are w(n)w(n)w(n).

There are III demand scenarios with potential demand masses 0<m1<⋯<mI0 < m_1 < \dots < m_I0<m1​<⋯<mI​. In scenario iii, the inverse demand at demand rate d∈[0,mi]d \in [0, m_i]d∈[0,mi​] is pi(d)=V(1−d/mi)p_i(d) = V(1 - d/m_i)pi​(d)=V(1−d/mi​), and the market revenue per hour is ri(d)=d pi(d) t2r_i(d) = d\,p_i(d)\,t_2ri​(d)=dpi​(d)t2​.

To serve demand ddd with sss open cars, Little's law requires s+d(t1(s)+t2)s + d(t_1(s) + t_2)s+d(t1​(s)+t2​) cars. The minimal supply level is

n‾(d)=a~ d1r+1+t2d,a~=r1r+1a1r+1+r−rr+1a1r+1,\underline{n}(d) = \tilde a\, d^{\frac{1}{r+1}} + t_2 d, \qquad \tilde a = r^{\frac{1}{r+1}} a^{\frac{1}{r+1}} + r^{-\frac{r}{r+1}} a^{\frac{1}{r+1}},n​(d)=a~dr+11​+t2​d,a~=rr+11​ar+11​+r−r+1r​ar+11​,

and the maximal utilization is uˉ(d)=dt2/n‾(d)\bar u(d) = d t_2/\underline{n}(d)uˉ(d)=dt2​/n​(d). A demand rate d∈[0,mi]d \in [0, m_i]d∈[0,mi​] is an equilibrium when revenue covers exactly the minimal driver cost,

ri(d)=w(n‾(d)) n‾(d).(13)r_i(d) = w(\underline{n}(d))\,\underline{n}(d). \qquad (13)ri​(d)=w(n​(d))n​(d).(13)

It is stable (Definition 1) if there is no ϵ>0\epsilon > 0ϵ>0 with ri(d−ϵ)<w(n‾(d−ϵ))n‾(d−ϵ)r_i(d-\epsilon) < w(\underline{n}(d-\epsilon))\underline{n}(d-\epsilon)ri​(d−ϵ)<w(n​(d−ϵ))n​(d−ϵ) and ri(d+ϵ)>w(n‾(d+ϵ))n‾(d+ϵ)r_i(d+\epsilon) > w(\underline{n}(d+\epsilon))\underline{n}(d+\epsilon)ri​(d+ϵ)>w(n​(d+ϵ))n​(d+ϵ). The maximal stable equilibrium dHV,i∗d^*_{HV,i}dHV,i∗​ is the greatest stable equilibrium; then nHV,i∗=n‾(dHV,i∗)n^*_{HV,i} = \underline{n}(d^*_{HV,i})nHV,i∗​=n​(dHV,i∗​), uHV,i∗=uˉ(dHV,i∗)u^*_{HV,i} = \bar u(d^*_{HV,i})uHV,i∗​=uˉ(dHV,i∗​) and pHV,i∗=pi(dHV,i∗)p^*_{HV,i} = p_i(d^*_{HV,i})pHV,i∗​=pi​(dHV,i∗​). The loose labor market condition of scenario iii is

ri(mi/2)>w(n‾(mi/2)) n‾(mi/2),(33)r_i(m_i/2) > w(\underline{n}(m_i/2))\,\underline{n}(m_i/2), \qquad (33)ri​(mi​/2)>w(n​(mi​/2))n​(mi​/2),(33)

the paper's restatement of its Assumption 2: the revenue curve meets the cost curve on its decreasing branch.

In Lean the parameters form the structure MarketParams, and the objects above are aTilde, nMin, uBar, priceFn, revenue, wage, hvCost, IsEquilibrium, IsStable, IsMaxStableEq and LooseMarket, in the namespace AVRideHail.PureHV.

Formalization targets

Goal: Proposition 1 (p. 14)

Under the standing parameter assumptions and (33) in every scenario, each scenario has a unique maximal stable equilibrium, and for the family dHV,i∗d^*_{HV,i}dHV,i∗​:

dHV,i∗>0,ri(dHV,i∗)=w(nHV,i∗) nHV,i∗,pHV,i∗=w(nHV,i∗)uHV,i∗,d^*_{HV,i} > 0,\quad r_i(d^*_{HV,i}) = w(n^*_{HV,i})\, n^*_{HV,i}, \quad p^*_{HV,i} = \frac{w(n^*_{HV,i})}{u^*_{HV,i}},dHV,i∗​>0,ri​(dHV,i∗​)=w(nHV,i∗​)nHV,i∗​,pHV,i∗​=uHV,i∗​w(nHV,i∗​)​, dHV,i∗ and nHV,i∗ strictly increasing in i,uHV,i∗ {strictly increasing in i,r>0,constant in i,r=0.d^*_{HV,i}\ \text{and}\ n^*_{HV,i}\ \text{strictly increasing in } i, \qquad u^*_{HV,i}\ \begin{cases}\text{strictly increasing in } i, & r > 0,\\ \text{constant in } i, & r = 0.\end{cases}dHV,i∗​ and nHV,i∗​ strictly increasing in i,uHV,i∗​ {strictly increasing in i,constant in i,​r>0,r=0.​

Milestones

  1. Lemma 1 Item 1 (p. 38, with (26)): n‾(d)\underline{n}(d)n​(d) is the minimum of s+d(as−r+t2)s + d(as^{-r} + t_2)s+d(as−r+t2​) over s>0s > 0s>0, attained only at s=(ra)1/(r+1)d1/(r+1)s = (ra)^{1/(r+1)} d^{1/(r+1)}s=(ra)1/(r+1)d1/(r+1).
  2. Lemma 1 Item 2 (p. 38): n‾\underline{n}n​ is a strictly increasing bijection of [0,∞)[0,\infty)[0,∞), so its inverse dˉ(n)\bar d(n)dˉ(n) exists.
  3. Lemma 2 (p. 39): uˉ\bar uuˉ is strictly increasing and strictly concave, uˉ(0)=0\bar u(0) = 0uˉ(0)=0 and uˉ(d)→1\bar u(d) \to 1uˉ(d)→1.
  4. App. B.1.1 (p. 42): under (33), (13) has exactly one root in [mi/2,mi][m_i/2, m_i][mi​/2,mi​], and it is the maximal stable equilibrium.
  5. App. B.1.3 (p. 43): dHV,i∗d^*_{HV,i}dHV,i∗​ is strictly increasing in mim_imi​.
  6. App. B.1.6 (pp. 45–46): pHV,i∗p^*_{HV,i}pHV,i∗​ is strictly increasing in mim_imi​ when r=0r = 0r=0, α>0\alpha > 0α>0, and strictly decreasing when r>0r > 0r>0, α=0\alpha = 0α=0.

Significance

Proposition 1 is the reference point for every comparison in the paper: the AV markets of Sections 5–6 (common platform, independent platforms, monopoly AV supplier) are judged by how far their prices and served demand move from pHV,i∗p^*_{HV,i}pHV,i∗​ and dHV,i∗d^*_{HV,i}dHV,i∗​. Its Item 3 isolates the density effect as the source of rising utilization, and the special cases of Item 5 show that the HV price can rise or fall with market size, so neither direction can be assumed in the AV analysis. Lemmas 1 and 2 are used throughout the appendices.

The paper proves these results by hand; to our knowledge none of them has a machine-checked proof. The mission produces a checked version of the benchmark and of the two technical lemmas, with every boundary case (r=0r = 0r=0, α=0\alpha = 0α=0, d=0d = 0d=0) stated explicitly.

Difficulty

The equation (13) always has the root d=0d = 0d=0, and it can have a second, unstable positive root below the stable one; the naive reading "the equilibrium is the root of (13)" therefore picks the wrong point. The work is to show that the greatest stable root exists, lies on the decreasing branch of the revenue curve, and moves monotonically with mim_imi​. This requires strict monotonicity of the cost curve w(n‾(d))n‾(d)w(\underline{n}(d))\underline{n}(d)w(n​(d))n​(d), which combines a real power d1/(r+1)d^{1/(r+1)}d1/(r+1) with the linear supply curve, and continuity on [mi/2,mi][m_i/2, m_i][mi​/2,mi​]. Lemma 2 needs strict concavity of a quotient of real powers on a closed half-line including 000, where the function is defined by its limit.

Formalization scope

All quantities are real numbers; fleet sizes and demands are continuous, as in the paper. Powers are Real.rpow. Scenarios are indexed by Fin I, 0-based. The maximal stable equilibrium is never chosen by Classical.choose: statements take a family dstar with IsMaxStableEq in each scenario.

Committed conventions and pinned hypotheses:

  • a,t2,V,w0>0a, t_2, V, w_0 > 0a,t2​,V,w0​>0 and 0≤r<10 \le r < 10≤r<1, α≥0\alpha \ge 0α≥0 are explicit binders. Lemma 1 Item 1 and Lemma 2 add r>0r > 0r>0, which the page leaves implicit and without which they fail.
  • The loose-market condition (33) is a hypothesis of the goal in every scenario. Proposition 1's printed statement omits it, but its proof uses it, and without it a thin scenario has dHV,i∗=0d^*_{HV,i} = 0dHV,i∗​=0.
  • In Definition 1, ϵ\epsilonϵ ranges over 0<ϵ≤d0 < \epsilon \le d0<ϵ≤d with d+ϵ≤mid + \epsilon \le m_id+ϵ≤mi​, keeping d±ϵd \pm \epsilond±ϵ in the domain [0,mi][0, m_i][0,mi​] of pip_ipi​.
  • At r=0r = 0r=0, Real.rpow gives a~=a\tilde a = aa~=a and n‾(d)=(a+t2)d\underline{n}(d) = (a + t_2)dn​(d)=(a+t2​)d; uˉ(0)=0/0=0\bar u(0) = 0/0 = 0uˉ(0)=0/0=0 agrees with Lemma 2.
  • "Increasing" means strictly increasing.
  • The uniqueness in "unique maximal stable equilibrium" is automatic for a greatest element; the content of the first conjunct is existence.

Encoding the equilibrium as "the root of (13) in [mi/2,mi][m_i/2, m_i][mi​/2,mi​]" would make the goal follow from its own hypotheses; the goal instead quantifies over greatest stable equilibria, and that root is the conclusion of a milestone.

A complete development needs the intermediate value theorem on [mi/2,mi][m_i/2, m_i][mi​/2,mi​], strict monotonicity and concavity facts for real powers, and limits at infinity. The minimal-supply and utilization lemmas are reusable in any model with a pickup-time function as−ra s^{-r}as−r. Proofs of any milestone are welcome, as are proofs of the remark of Item 5 in other parameter regimes.

Selected references

  • Z. Lian and G. van Ryzin, Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration, SSRN working paper 3716491, version of 23 August 2023. https://ssrn.com/abstract=3716491
  • Z. Lian and G. van Ryzin, Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration, Management Science, 2025. https://doi.org/10.1287/mnsc.2020.03112
8 thms1 active userReviewed
OptimizationProbability·Captain: mikedeng1

Optimality Conditions in Control Problems with Random State Constraints in Probabilistic or Almost Sure Form I: Necessary and Sufficient Optimality Conditions for a Gaussian Probabilistic ConstraintResearch Paper

Motivation

Probabilistic (chance) constraints require that a decision keeps a random constraint satisfied with probability at least ppp. They are the standard way to model reliability requirements in engineering design, energy networks and the control of systems driven by uncertain data, and they are increasingly imposed on infinite-dimensional decisions such as the control of a partial differential equation. Geiersbach and Henrion (arXiv:2306.03965v2) derive first-order optimality conditions for such problems. This mission formalizes the general part of their paper (§2.1): a necessary and sufficient multiplier rule for a convex objective under a Gaussian probabilistic constraint on a Banach space.

The difficulty with chance constraints is that the probability function φ(u)=P(g(u,ξ)≤0)\varphi(u)=\mathbb P(g(u,\xi)\le0)φ(u)=P(g(u,ξ)≤0) is given only implicitly and is in general neither smooth nor convex. Prékopa's theory of log-concave measures (Prékopa 1995) shows that log⁡φ\log\varphilogφ is concave under joint convexity, and Farshbaf-Shaker, Henrion and Hömberg (2018) carried this to infinite dimensions. For Gaussian data, van Ackooij and Henrion (2014) gave gradient formulae via the spherical-radial decomposition, and Hantoute, Henrion and Pérez-Aros (2019) proved local Lipschitz continuity of φ\varphiφ and an estimate of its Clarke subdifferential under a moderate growth condition. The paper combines the two lines into an optimality system.

Setting

Let UUU be a reflexive separable Banach space with dual U∗U^*U∗, let F:U→RF:U\to\mathbb RF:U→R be convex and Fréchet differentiable with derivative DF(u)∈U∗DF(u)\in U^*DF(u)∈U∗, and let ξ\xiξ be an mmm-dimensional centered Gaussian random vector with nondegenerate covariance matrix Σ\SigmaΣ. A constraint function g:U×Rm→Rg:U\times\mathbb R^m\to\mathbb Rg:U×Rm→R is locally Lipschitzian with g(u,⋅)g(u,\cdot)g(u,⋅) convex for every uuu (Assumption 2.1). For p∈(0,1]p\in(0,1]p∈(0,1] the problem is

min⁡u∈UF(u)s.t.φ(u):=P(ω∣g(u,ξ(ω))≤0)≥p.(9)\min_{u\in U}F(u)\quad\text{s.t.}\quad\varphi(u):=\mathbb P(\omega\mid g(u,\xi(\omega))\le0)\ge p. \tag{9}u∈Umin​F(u)s.t.φ(u):=P(ω∣g(u,ξ(ω))≤0)≥p.(9)

The Clarke directional derivative of a locally Lipschitzian f:U→Rf:U\to\mathbb Rf:U→R is f∘(u;h)=lim sup⁡u′→u, t↓0(f(u′+th)−f(u′))/tf^\circ(u;h)=\limsup_{u'\to u,\,t\downarrow0}(f(u'+th)-f(u'))/tf∘(u;h)=limsupu′→u,t↓0​(f(u′+th)−f(u′))/t, and its Clarke subdifferential is ∂Cf(u)={x∗∈U∗∣⟨x∗,h⟩≤f∘(u;h) ∀h}\partial^Cf(u)=\{x^*\in U^*\mid\langle x^*,h\rangle\le f^\circ(u;h)\ \forall h\}∂Cf(u)={x∗∈U∗∣⟨x∗,h⟩≤f∘(u;h) ∀h}. At a point u∗u^*u∗ the paper assumes g(u∗,0)<0g(u^*,0)<0g(u∗,0)<0 (10) and either the moderate growth condition (12) or boundedness of M={z∣g(u∗,z)≤0}M=\{z\mid g(u^*,z)\le0\}M={z∣g(u∗,z)≤0} (11).

The radial probability function is e(u,v)=μη{r≥0∣g(u,rΣ1/2v)≤0}e(u,v)=\mu_\eta\{r\ge0\mid g(u,r\Sigma^{1/2}v)\le0\}e(u,v)=μη​{r≥0∣g(u,rΣ1/2v)≤0} for vvv on the unit sphere Sm−1\mathbb S^{m-1}Sm−1, where μη\mu_\etaμη​ is the chi distribution with mmm degrees of freedom; with μζ\mu_\zetaμζ​ the uniform distribution on Sm−1\mathbb S^{m-1}Sm−1, φ(u)=∫Sm−1e(u,v) dμζ(v)\varphi(u)=\int_{\mathbb S^{m-1}}e(u,v)\,d\mu_\zeta(v)φ(u)=∫Sm−1​e(u,v)dμζ​(v) (14). Integrals of set-valued maps are taken in the sense of Aumann.

Formalization targets

Goal: Proposition 2.6, statement (21)

If ggg is jointly convex, there is a generalized Slater point u^\hat uu^ with φ(u^)>p\varphi(\hat u)>pφ(u^)>p, and u∗u^*u∗ is feasible with (10) and either (12) or MMM bounded, then u∗u^*u∗ is a global minimizer of (9) if and only if, for some λ≥0\lambda\ge0λ≥0,

DF(u∗)∈λ ∂Cφ(u∗),φ(u∗)≥p,λ(φ(u∗)−p)=0.(21)DF(u^*)\in\lambda\,\partial^C\varphi(u^*),\qquad\varphi(u^*)\ge p,\qquad\lambda(\varphi(u^*)-p)=0. \tag{21}DF(u∗)∈λ∂Cφ(u∗),φ(u∗)≥p,λ(φ(u∗)−p)=0.(21)

Milestones

  1. Theorem 2.2, Lipschitz part: e(⋅,v)e(\cdot,v)e(⋅,v) is uniformly locally Lipschitzian and φ\varphiφ is locally Lipschitzian around uˉ\bar uuˉ.
  2. Prékopa's statement (p. 7): joint quasi-convexity of ggg and a log-concave density give a log-concave φ\varphiφ.
  3. Lemma 2.5: φ~=−log⁡φ+log⁡p\tilde\varphi=-\log\varphi+\log pφ~​=−logφ+logp is convex and lower semicontinuous, and (9) is equivalent to min⁡{F∣φ~≤0}\min\{F\mid\tilde\varphi\le0\}min{F∣φ~​≤0} (20).
  4. The convex multiplier rule for (20): −DF(u∗)∈λ∂φ~(u∗)-DF(u^*)\in\lambda\partial\tilde\varphi(u^*)−DF(u∗)∈λ∂φ~​(u∗), λφ~(u∗)=0\lambda\tilde\varphi(u^*)=0λφ~​(u∗)=0.
  5. Convex and Clarke subdifferentials agree for locally Lipschitz convex functions.
  6. The chain rule ∂Cφ~(u∗)=−φ(u∗)−1∂Cφ(u∗)\partial^C\tilde\varphi(u^*)=-\varphi(u^*)^{-1}\partial^C\varphi(u^*)∂Cφ~​(u∗)=−φ(u∗)−1∂Cφ(u∗).

Companion targets

The spherical-radial representation (14); the inclusion (15) ∂Cφ(uˉ)⊆∫Sm−1∂uCe(uˉ,v) dμζ(v)\partial^C\varphi(\bar u)\subseteq\int_{\mathbb S^{m-1}}\partial^C_ue(\bar u,v)\,d\mu_\zeta(v)∂Cφ(uˉ)⊆∫Sm−1​∂uC​e(uˉ,v)dμζ​(v) with equality under (16); the radius representation (17)–(19); Lemma 2.3 (Clarke regularity of −e(⋅,v)-e(\cdot,v)−e(⋅,v)); Theorem 2.4 (equality in (15) when MMM is bounded); and Proposition 2.6's second statement (22), where ∂Cφ(u∗)\partial^C\varphi(u^*)∂Cφ(u∗) is replaced by the spherical integral.

Significance

Statement (21) is a complete first-order characterization of optimality for a nonconvex, nonsmooth constraint in infinite dimensions: the constraint function is neither differentiable nor convex in general, yet the multiplier rule is both necessary and sufficient. The companion formula (22), with the exact subdifferential of Theorem 2.4, makes the system computable from the explicit radial function eee; the paper's later sections evaluate it for an elliptic PDE with a random source and derive explicit optimality conditions for a probabilistic state constraint.

The results of §2.1 are proved on paper, partly by citation. None of them has a machine-checked proof in Mathlib or on Prove2Me. Formalizing them requires a Clarke calculus on Banach spaces, Prékopa-type log-concavity for Gaussian measures, the spherical-radial decomposition of a Gaussian vector, and a convex multiplier rule with an extended-valued constraint. Each of these is reusable well beyond chance constraints.

Difficulty

The direct route fails because φ\varphiφ is not convex: probability functions bounded between 0 and 1 are essentially never concave, and the Clarke subdifferential of a nonconvex function supports only necessary conditions. The paper's argument needs the convex reformulation through −log⁡φ-\log\varphi−logφ, which is extended-valued where φ=0\varphi=0φ=0. It then needs three facts that do not come for free in a Banach space: local Lipschitz continuity of φ\varphiφ (which fails for merely locally Lipschitz ggg without (12) or a bounded MMM), the identification of the convex and Clarke subdifferentials, and a chain rule through the logarithm. The companion formula (22) needs Clarke's theorem on subdifferentials of integral functionals, whose equality case requires a regularity that the radial function only has after a sign change (Lemma 2.3).

Formalization scope

Rm\mathbb R^mRm is EuclideanSpace ℝ (Fin m) with m≥1m\ge1m≥1. The law of ξ\xiξ is Mathlib's multivariateGaussian 0 Sigma with Sigma.PosDef, and Σ1/2\Sigma^{1/2}Σ1/2 is the positive semidefinite square root used there. φ(u)\varphi(u)φ(u) is the real number P({g(u,ξ)≤0})\mathbb P(\{g(u,\xi)\le0\})P({g(u,ξ)≤0}). Reflexivity is surjectivity of the canonical map into the bidual. The Clarke directional derivative is the limsup over u′→uu'\to uu′→u, t↓0t\downarrow0t↓0 with denominator ttt (the page prints hhh, a misprint). Clarke regularity includes local Lipschitz continuity. φ~\tilde\varphiφ~​ is valued in EReal with −log⁡0=+∞-\log0=+\infty−log0=+∞, and its convexity is convexity of its epigraph. A solution is a global minimizer over the feasible set. "DF(u∗)∈λSDF(u^*)\in\lambda SDF(u∗)∈λS" is encoded as "DF(u∗)=λx∗DF(u^*)=\lambda x^*DF(u∗)=λx∗ for some x∗∈Sx^*\in Sx∗∈S", which is unambiguous at λ=0\lambda=0λ=0. The ball in (12) is open. The Aumann integral uses selections whose scalar components v↦⟨x^v∗,h⟩v\mapsto\langle\hat x^*_v,h\ranglev↦⟨x^v∗​,h⟩ are integrable.

The convex multiplier rule (milestone 4) carries one disclosed addition: the extended-valued constraint is finite and continuous near u∗u^*u∗. The paper cites [39, Theorem 3.66] without spelling out a qualification condition, and in the application this property follows from milestone 1. Prékopa's statement is formalized with log⁡0=−∞\log0=-\inftylog0=−∞ (the page prints +∞+\infty+∞), as the multiplicative inequality φ(u)tφ(w)1−t≤φ(tu+(1−t)w)\varphi(u)^t\varphi(w)^{1-t}\le\varphi(tu+(1-t)w)φ(u)tφ(w)1−t≤φ(tu+(1−t)w).

A formalization that makes any of these statements trivial is ruled out: the Clarke limsup is only used with a local Lipschitz hypothesis, so the junk value of an unbounded limsup never enters; the Aumann integral demands integrable selections; the multiplier carries its sign and complementarity condition; and optimality is global, not stationarity.

Contributions are welcome at every level: a Clarke calculus on normed spaces (subdifferential nonemptiness, sum and chain rules), log-concavity of Gaussian measures and Prékopa's theorem, polar coordinates for Gaussian vectors, and a Slater-type multiplier rule for extended-valued convex constraints.

Selected references

  • C. Geiersbach and R. Henrion, Optimality conditions in control problems with random state constraints in probabilistic or almost-sure form, arXiv:2306.03965v2, 2024 (Math. Oper. Res., 2025). https://arxiv.org/abs/2306.03965
  • A. Hantoute, R. Henrion and P. Pérez-Aros, Subdifferential characterization of probability functions under Gaussian distribution, Math. Program. 174, 167–194, 2019. https://doi.org/10.1007/s10107-018-1237-9
  • W. van Ackooij and R. Henrion, Gradient formulae for nonlinear probabilistic constraints with Gaussian and Gaussian-like distributions, SIAM J. Optim. 24(4), 1864–1889, 2014. https://doi.org/10.1137/130922689
  • M. H. Farshbaf-Shaker, R. Henrion and D. Hömberg, Properties of chance constraints in infinite dimensions with an application to PDE constrained optimization, Set-Valued Var. Anal. 26, 821–841, 2018. https://doi.org/10.1007/s11228-017-0452-5
  • A. Prékopa, Stochastic Programming, Kluwer, 1995. https://doi.org/10.1007/978-94-017-3087-7
  • F. H. Clarke, Optimization and Nonsmooth Analysis, Wiley, 1983. https://doi.org/10.1137/1.9781611971309
  • J. Peypouquet, Convex Optimization in Normed Spaces: Theory, Methods and Examples, SpringerBriefs in Optimization, Springer, 2015.
15 thms1 active userReviewed
OptimizationPartial Differential EquationsProbability·Captain: mikedeng1

Optimality Conditions in Control Problems with Random State Constraints in Probabilistic or Almost Sure Form II: Explicit Optimality Conditions for Probabilistic Elliptic PDE State ConstraintsResearch Paper

Motivation

Optimal control of partial differential equations under uncertainty arises whenever a physical system is steered by a control while its sources, coefficients or loads are only known in distribution. A typical requirement is a state constraint: the state (a temperature, a concentration, a displacement) must stay below a threshold everywhere in the domain. When the source term is random, demanding this for every realization is often impossible or too conservative, and the natural relaxation is a probabilistic (chance) constraint: the state must stay below the threshold uniformly on the domain with probability at least ppp.

Probabilistic constraints are classical in operations research (Prékopa, Stochastic Programming, 1995), but in a PDE setting the constraint is an infinite family of random inequalities, one per point of the domain, and the probability function is not differentiable in general. C. Geiersbach and R. Henrion (arXiv:2306.03965v2, Math. Oper. Res. 2025) derive optimality conditions for such problems in terms of the Clarke subdifferential, building on the spherical-radial decomposition of Gaussian vectors developed by Hantoute, Henrion and Pérez-Aros (Math. Program. 2019) and van Ackooij and Henrion. This mission formalizes the PDE half of §2 of that paper: explicit formulas for the subdifferential of the probability function and the resulting optimality conditions.

Setting

Let D⊆RdD\subseteq\mathbb R^dD⊆Rd, d∈{1,2,3}d\in\{1,2,3\}d∈{1,2,3}, be a nonempty, open, bounded set of class S: there are γ∈(0,1)\gamma\in(0,1)γ∈(0,1) and r0>0r_0>0r0​>0 with meas⁡(Br(x)∖D)≥γmeas⁡(Br(x))\operatorname{meas}(B_r(x)\setminus D)\ge\gamma\operatorname{meas}(B_r(x))meas(Br​(x)∖D)≥γmeas(Br​(x)) for all x∈∂Dx\in\partial Dx∈∂D and 0<r<r00<r<r_00<r<r0​. For F∈L2(D)F\in L^2(D)F∈L2(D) the Dirichlet problem −Δy=F-\Delta y=F−Δy=F in DDD, y=0y=0y=0 on ∂D\partial D∂D has a unique weak solution in H01(D)∩C(Dˉ)H^1_0(D)\cap C(\bar D)H01​(D)∩C(Dˉ); the solution operator A−1:L2(D)→C(Dˉ)A^{-1}:L^2(D)\to C(\bar D)A−1:L2(D)→C(Dˉ) is linear and continuous.

Fix f0,φ1,…,φm∈L2(D)f_0,\varphi_1,\dots,\varphi_m\in L^2(D)f0​,φ1​,…,φm​∈L2(D) and a threshold α∈R\alpha\in\mathbb Rα∈R. The control-to-state operator is

S(u,z)=A−1(u+f0+∑i=1mziφi)=P(u,z)+y0,P(u,z)=A−1u+∑iziA−1φi, y0=A−1f0.S(u,z)=A^{-1}\Big(u+f_0+\sum_{i=1}^m z_i\varphi_i\Big)=P(u,z)+y_0,\qquad P(u,z)=A^{-1}u+\sum_i z_iA^{-1}\varphi_i,\ y_0=A^{-1}f_0.S(u,z)=A−1(u+f0​+i=1∑m​zi​φi​)=P(u,z)+y0​,P(u,z)=A−1u+i∑​zi​A−1φi​, y0​=A−1f0​.

The random vector ξ\xiξ on a probability space (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) is Gaussian N(0,Σ)\mathcal N(0,\Sigma)N(0,Σ) with Σ\SigmaΣ positive definite, and y(⋅,ω)=S(u,ξ(ω))y(\cdot,\omega)=S(u,\xi(\omega))y(⋅,ω)=S(u,ξ(ω)) is the random state. With g(u,z)=max⁡x∈Dˉ[S(u,z)](x)−αg(u,z)=\max_{x\in\bar D}[S(u,z)](x)-\alphag(u,z)=maxx∈Dˉ​[S(u,z)](x)−α and the probability function φ(u)=P(ω∣g(u,ξ(ω))≤0)\varphi(u)=\mathbb P(\omega\mid g(u,\xi(\omega))\le0)φ(u)=P(ω∣g(u,ξ(ω))≤0), the problem is

min⁡u∈L2(D)F(u)s.t.φ(u)=P(y(x,ω)≤α  ∀x∈D)≥p,(24)\min_{u\in L^2(D)}F(u)\quad\text{s.t.}\quad \varphi(u)=\mathbb P\big(y(x,\omega)\le\alpha\ \ \forall x\in D\big)\ge p,\tag{24}u∈L2(D)min​F(u)s.t.φ(u)=P(y(x,ω)≤α  ∀x∈D)≥p,(24)

with FFF convex and Fréchet differentiable and p∈(0,1]p\in(0,1]p∈(0,1].

The analysis uses the spherical-radial decomposition. Let μζ\mu_\zetaμζ​ be the uniform distribution on the unit sphere Sm−1\mathbb S^{m-1}Sm−1, μη\mu_\etaμη​ the chi distribution with mmm degrees of freedom and density χ(t)=Ktm−1e−t2/2\chi(t)=Kt^{m-1}e^{-t^2/2}χ(t)=Ktm−1e−t2/2, Σ1/2\Sigma^{1/2}Σ1/2 the square root of Σ\SigmaΣ. The radial probability function is e(u,v)=μη{r≥0∣g(u,rΣ1/2v)≤0}e(u,v)=\mu_\eta\{r\ge0\mid g(u,r\Sigma^{1/2}v)\le0\}e(u,v)=μη​{r≥0∣g(u,rΣ1/2v)≤0} and the radius function ρ(u,v)∈[0,∞]\rho(u,v)\in[0,\infty]ρ(u,v)∈[0,∞] is the supremum of that set. For x∈Dˉx\in\bar Dx∈Dˉ, ux∈L2(D)u_x\in L^2(D)ux​∈L2(D) is defined by (ux,h)L2(D)=(A−1h)(x)(u_x,h)_{L^2(D)}=(A^{-1}h)(x)(ux​,h)L2(D)​=(A−1h)(x), and

M∗(uˉ,v)={x∈Dˉ∣[P(0,Σ1/2v)](x)>0, yˉ(x)+ρ(uˉ,v)[P(0,Σ1/2v)](x)=α},yˉ=S(uˉ,0).M^*(\bar u,v)=\{x\in\bar D\mid[P(0,\Sigma^{1/2}v)](x)>0,\ \bar y(x)+\rho(\bar u,v)[P(0,\Sigma^{1/2}v)](x)=\alpha\},\qquad \bar y=S(\bar u,0).M∗(uˉ,v)={x∈Dˉ∣[P(0,Σ1/2v)](x)>0, yˉ​(x)+ρ(uˉ,v)[P(0,Σ1/2v)](x)=α},yˉ​=S(uˉ,0).

∂C\partial^C∂C is the Clarke subdifferential, with L2(D)∗L^2(D)^*L2(D)∗ identified with L2(D)L^2(D)L2(D), and integrals of set-valued maps are Aumann integrals.

Formalization targets

Goal: Theorem 2.16

Assume a control u^\hat uu^ with φ(u^)>p\varphi(\hat u)>pφ(u^)>p (41), and let u∗u^*u∗ be feasible with expected state y~=S(u∗,0)\tilde y=S(u^*,0)y~​=S(u∗,0) satisfying y~(x)<α\tilde y(x)<\alphay~​(x)<α on Dˉ\bar DDˉ (42). If u∗u^*u∗ solves (24), there is λ≥0\lambda\ge0λ≥0 with

DF(u∗)∈−λ∫{v∣ρ(u∗,v)<∞}χ(ρ(u∗,v))⋅clco⁡{ux[P(0,Σ1/2v)](x) ∣ x∈M∗(u∗,v)} dμζ(v),DF(u^*)\in-\lambda\int_{\{v\mid\rho(u^*,v)<\infty\}}\chi(\rho(u^*,v))\cdot\operatorname{clco}\Big\{\frac{u_x}{[P(0,\Sigma^{1/2}v)](x)}\ \Big|\ x\in M^*(u^*,v)\Big\}\,d\mu_\zeta(v),DF(u∗)∈−λ∫{v∣ρ(u∗,v)<∞}​χ(ρ(u∗,v))⋅clco{[P(0,Σ1/2v)](x)ux​​ ​ x∈M∗(u∗,v)}dμζ​(v), λ(P(y∗(x,ω)≤α ∀x∈D)−p)=0,\lambda\big(\mathbb P(y^*(x,\omega)\le\alpha\ \forall x\in D)-p\big)=0,λ(P(y∗(x,ω)≤α ∀x∈D)−p)=0,

and these conditions are sufficient when M∗(u∗,v)M^*(u^*,v)M∗(u∗,v) is a singleton for μζ\mu_\zetaμζ​-a.e. vvv with ρ(u∗,v)<∞\rho(u^*,v)<\inftyρ(u∗,v)<∞, or the set {z∣g(u∗,z)≤0}\{z\mid g(u^*,z)\le0\}{z∣g(u∗,z)≤0} is bounded. The goal has no hard-coded constants; it asserts the form of the optimality system.

Milestones

In attack order: well-posedness of the state equation with the bound ∥y^∥C(Dˉ)≤C(∥z∥2+∥u+f0∥L2(D))\|\hat y\|_{C(\bar D)}\le C(\|z\|_2+\|u+f_0\|_{L^2(D)})∥y^​∥C(Dˉ)​≤C(∥z∥2​+∥u+f0​∥L2(D)​) (Lemma 1.2); measurability of the random state (Lemma 1.4); convexity and global Lipschitz continuity of ggg (Lemma 2.9); moderate growth (Lemma 2.10); the Lipschitz and subdifferential conclusions of the general theory under (26) (Corollary 2.11); the optimality conditions (21), (22) for (24) (Corollary 2.12); ∂uCe(uˉ,v)={0}\partial^C_ue(\bar u,v)=\{0\}∂uC​e(uˉ,v)={0} when ρ(uˉ,v)=∞\rho(\bar u,v)=\inftyρ(uˉ,v)=∞ (Lemma 2.13); the explicit formula ∂uCe(uˉ,v)=−χ(ρ(uˉ,v))⋅clco⁡{ux/[P(0,Σ1/2v)](x)∣x∈M∗(uˉ,v)}\partial^C_ue(\bar u,v)=-\chi(\rho(\bar u,v))\cdot\operatorname{clco}\{u_x/[P(0,\Sigma^{1/2}v)](x)\mid x\in M^*(\bar u,v)\}∂uC​e(uˉ,v)=−χ(ρ(uˉ,v))⋅clco{ux​/[P(0,Σ1/2v)](x)∣x∈M∗(uˉ,v)} when ρ(uˉ,v)<∞\rho(\bar u,v)<\inftyρ(uˉ,v)<∞ (Lemma 2.14); and the upper estimate (40) of ∂Cφ(uˉ)\partial^C\varphi(\bar u)∂Cφ(uˉ) with its equality cases (Theorem 2.15).

Significance

The result turns an abstract statement — DF(u∗)DF(u^*)DF(u∗) lies in a multiple of the Clarke subdifferential of a probability function that has no closed form — into a condition written in the problem data: Green-type functions uxu_xux​, the expected state, and the radius function along each direction of the sphere. This is what makes the conditions usable for checking candidate controls and for designing algorithms, and Example 2.18 of the paper computes a solution this way. The sufficiency half identifies when the nonconvex chance-constrained problem behaves like a convex one.

The paper's proofs are on paper only; to our knowledge none of these results, nor the spherical-radial decomposition, Clarke calculus in Hilbert spaces, or Aumann integrals in L2L^2L2, has a machine-checked proof. Formalizing Theorem 2.16 requires connecting elliptic regularity, Gaussian measure theory and nonsmooth analysis, and the milestones are reusable on their own: Lemma 1.2 is a regularity statement for the Poisson equation, and Lemmas 2.13 and 2.14 are max-function subdifferential formulas in an infinite-dimensional space.

Difficulty

The obvious route — differentiate φ\varphiφ and use a Lagrange multiplier — fails because φ\varphiφ is generally not differentiable even for smooth data (Example 2.17 of the paper), and because ggg is only Lipschitz, being a maximum over Dˉ\bar DDˉ. The general subdifferential estimate (Theorem 2.2, from Hantoute–Henrion–Pérez-Aros) needs a growth condition and only gives an inclusion, since the radial probability function is not Clarke regular; the radius function ρ(⋅,v)\rho(\cdot,v)ρ(⋅,v) is an infimum over the open set where P(0,Σ1/2v)>0P(0,\Sigma^{1/2}v)>0P(0,Σ1/2v)>0, which is neither compact nor independent of uuu, so standard max-function formulas do not apply directly. Directions with ρ=∞\rho=\inftyρ=∞ require a separate limiting argument through the Mordukhovich subdifferential (Lemma 2.13). The regularity input, continuity of solutions on Dˉ\bar DDˉ for class-S domains (Kinderlehrer–Stampacchia 1980), is not in Mathlib.

Formalization scope

All declarations are in the namespace ChanceStateCtrl.PDE. Rd\mathbb R^dRd and Rm\mathbb R^mRm are EuclideanSpace ℝ (Fin d) and EuclideanSpace ℝ (Fin m), indices are Fin m, L2(D)L^2(D)L2(D) is Lp ℝ 2 (volume.restrict D). Weak derivatives are the published HunterPDE.Shared.HasWeakDeriv; a weak solution is a function continuous on Dˉ\bar DDˉ, zero on ∂D\partial D∂D, in L2(D)L^2(D)L2(D) with weak first derivatives in L2(D)L^2(D)L2(D), satisfying the weak form against Cc∞(D)C_c^\infty(D)Cc∞​(D).

Standing hypotheses on every theorem: DDD open, bounded and nonempty, d∈{1,2,3}d\in\{1,2,3\}d∈{1,2,3}, class S, and CompactSpace (closure D) (a consequence of boundedness). Nonemptiness of DDD is the one added hypothesis: Lean's supremum over an empty domain is 000, not −∞-\infty−∞, and Lemma 2.9's identification of events fails for D=∅D=\emptysetD=∅. A−1A^{-1}A−1 is a continuous linear map to C(Dˉ)C(\bar D)C(Dˉ) together with the hypothesis that it returns the weak solution; it is never an arbitrary operator. m≥1m\ge1m≥1, as the uniform distribution on Sm−1\mathbb S^{m-1}Sm−1 requires. Σ1/2\Sigma^{1/2}Σ1/2 is the positive semidefinite root; ∥Σ1/2∥\|\Sigma^{1/2}\|∥Σ1/2∥ is its operator norm. The Clarke directional derivative is lim sup⁡u′→u,t↓0(f(u′+th)−f(u′))/t\limsup_{u'\to u,t\downarrow0}(f(u'+th)-f(u'))/tlimsupu′→u,t↓0​(f(u′+th)−f(u′))/t (the page's denominator hhh is a misprint). ρ\rhoρ takes values in [0,∞][0,\infty][0,∞]. clco is the norm closure of the convex hull. The integral in (40)/(43) is over the restriction of μζ\mu_\zetaμζ​ to {ρ<∞}\{\rho<\infty\}{ρ<∞}, not a renormalization. A solution is a global minimizer over {u∣φ(u)≥p}\{u\mid\varphi(u)\ge p\}{u∣φ(u)≥p}; the page's "solution to (9)" refers to this instance of the abstract problem (9).

Trivializing formalizations are ruled out: every Clarke subdifferential is taken at a point where the function is locally Lipschitz (proved in Corollary 2.11 and Theorem 2.15), the state operator is tied to the PDE, the multiplier carries its sign and complementarity, Aumann selections must be scalarly integrable, and optimality is global.

Needed infrastructure: elliptic regularity in C(Dˉ)C(\bar D)C(Dˉ) for class-S domains; the spherical-radial decomposition of N(0,Σ)\mathcal N(0,\Sigma)N(0,Σ); Clarke calculus (chain rule, max functions) on Hilbert spaces; Clarke's theorem on subdifferentials of integral functionals. Contributions of any of these as stand-alone theorems are welcome.

Selected references

  • C. Geiersbach, R. Henrion, Optimality conditions in control problems with random state constraints in probabilistic or almost-sure form, arXiv:2306.03965v2, 2024; Math. Oper. Res., 2025. https://arxiv.org/abs/2306.03965
  • A. Hantoute, R. Henrion, P. Pérez-Aros, Subdifferential characterization of probability functions under Gaussian distribution, Math. Program. 174 (2019), 167–194. https://doi.org/10.1007/s10107-018-1237-9
  • F. H. Clarke, Optimization and Nonsmooth Analysis, Wiley, 1983; SIAM reprint 1990. https://doi.org/10.1137/1.9781611971309
  • D. Kinderlehrer, G. Stampacchia, An Introduction to Variational Inequalities and Their Applications, Academic Press, 1980; SIAM reprint 2000. https://doi.org/10.1137/1.9780898719451
  • A. Prékopa, Stochastic Programming, Kluwer, 1995. https://doi.org/10.1007/978-94-017-3087-7
14 thms1 active userReviewed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Correlated Equilibria for Mean Field Games with Progressive Strategies: Correlated MFG Solutions Yield ε_N-Correlated Equilibria of the N-Player Game Against Progressive Deviations, ε_N → 0Research Paper

Motivation

A correlated equilibrium (Aumann, 1974) is an equilibrium of a game with a mediator: the mediator draws a profile of recommendations from a known distribution and tells each player privately what to play. The distribution is an equilibrium if no player gains by deviating from the recommendation they receive. Correlated equilibria can give higher payoffs than Nash equilibria, they are cheaper to compute, and many adaptive learning procedures converge to them.

Mean field games describe symmetric games with many players, each of whom interacts with the others only through the empirical distribution of their states. The standard justification of a mean field model is an approximation theorem: a solution of the limit game induces approximate equilibria of the games with NNN players, with an error that vanishes as N→∞N\to\inftyN→∞.

Correlated solutions of discrete-time mean field games were introduced by Campi and Fischer (arXiv:2004.07936) for restricted strategies, in which both the recommendations and the deviations are Markov in the player's own state. Bonesini, Campi and Fischer (arXiv:2212.01656) keep restricted recommendations but allow the deviating player to use progressive strategies, which see the whole history of the system, together with a private randomization device. This mission formalizes their main approximation result, Theorem 6.2.

Setting

Time runs over [ ⁣[0,T] ⁣][\![0,T]\!][[0,T]]. States lie in a finite set X\mathcal XX and actions in a finite set Γ\GammaΓ. Noise variables are uniform on Z=[0,1]\mathcal Z=[0,1]Z=[0,1]; their law is ν\nuν. The set P(X)\mathcal P(\mathcal X)P(X) of probability measures on X\mathcal XX carries the metric dist(μ,μ~)=12∑x∣μ(x)−μ~(x)∣\mathrm{dist}(\mu,\tilde\mu)=\frac12\sum_x|\mu(x)-\tilde\mu(x)|dist(μ,μ~​)=21​∑x​∣μ(x)−μ~​(x)∣. A player's state moves by

Xt+1=Ψ(t,Xt,μt,ut,ξt+1),X_{t+1}=\Psi(t,X_t,\mu_t,u_t,\xi_{t+1}),Xt+1​=Ψ(t,Xt​,μt​,ut​,ξt+1​),

where μt\mu_tμt​ is the distribution of the other players' states, ut∈Γu_t\in\Gammaut​∈Γ is the player's action and ξt+1∼ν\xi_{t+1}\sim\nuξt+1​∼ν is idiosyncratic noise. The player pays a running cost f(t,Xt,μt,ut)f(t,X_t,\mu_t,u_t)f(t,Xt​,μt​,ut​) and a terminal cost F(XT,μT)F(X_T,\mu_T)F(XT​,μT​).

A restricted strategy φ∈R\varphi\in\mathcal Rφ∈R is a map (t,x)↦φ(t,x)∈Γ(t,x)\mapsto\varphi(t,x)\in\Gamma(t,x)↦φ(t,x)∈Γ. A progressive strategy φ∈R^\varphi\in\widehat{\mathcal R}φ∈R chooses the action at time ttt as a Borel function of the player's state history x(t)x^{(t)}x(t) and the history m(t)m^{(t)}m(t) of the measure flow.

NNN-player game. The mediator draws (Φ1,…,ΦN)(\Phi_1,\dots,\Phi_N)(Φ1​,…,ΦN​) from a correlated suggestion γN\gamma^NγN. Every player jjj applies Φj\Phi_jΦj​ to their own state path and to the empirical measure μj,N\mu^{j,N}μj,N of the other N−1N-1N−1 players. A strategy modification of player iii replaces Φi\Phi_iΦi​ by a progressive strategy Φ~i\tilde\Phi_iΦ~i​. At time ttt the component Φ~i(t,⋅)\tilde\Phi_i(t,\cdot)Φ~i​(t,⋅) may depend on Φi\Phi_iΦi​ and on an independent uniform variable ϑt\vartheta_tϑt​; the set of joint laws of (Φi,Φ~i)(\Phi_i,\tilde\Phi_i)(Φi​,Φ~i​) obtained this way is NγiNN\mathcal N^N_{\gamma^N_i}NγiN​N​. Player iii's expected cost is JiN(mN,γN,γ~)J^N_i(\mathfrak m^N,\gamma^N,\tilde\gamma)JiN​(mN,γN,γ~​). The suggestion γN\gamma^NγN is an ε\varepsilonε-correlated equilibrium if no player gains more than ε\varepsilonε by any modification.

Mean field game. The mediator draws a pair (Φ,μ)(\Phi,\mu)(Φ,μ) from ρ∈P(R×P(X)T+1)\rho\in\mathcal P(\mathcal R\times\mathcal P(\mathcal X)^{T+1})ρ∈P(R×P(X)T+1): a restricted recommendation and a random flow of measures. The representative player may deviate through any map w:R→R^w:\mathcal R\to\widehat{\mathcal R}w:R→R. The pair ρ\rhoρ is a correlated solution if following the recommendation is optimal (Opt), and if, in that case, μt\mu_tμt​ is the conditional law of XtX_tXt​ given the whole flow μ\muμ (Con).

Formalization targets

Goal: Theorem 6.2

Assume (A1)–(A3), and let ρ\rhoρ be a correlated solution with initial law m0\mathfrak m_0m0​ satisfying (R1)–(R2). Write ρ(dφ,dm)=ρ1(dφ∣m)ρ2(dm)\rho(d\varphi,dm)=\rho_1(d\varphi|m)\rho_2(dm)ρ(dφ,dm)=ρ1​(dφ∣m)ρ2​(dm). Then there are εN≥0\varepsilon_N\ge0εN​≥0 with εN→0\varepsilon_N\to0εN​→0 such that, for every N≥2N\ge2N≥2,

γN(C1×⋯×CN)=∫∏j=1Nρ1(Cj∣m) ρ2(dm)\gamma^N(C_1\times\cdots\times C_N)=\int\prod_{j=1}^N\rho_1(C_j|m)\,\rho_2(dm)γN(C1​×⋯×CN​)=∫j=1∏N​ρ1​(Cj​∣m)ρ2​(dm)

is an εN\varepsilon_NεN​-correlated equilibrium with initial law m0⊗N\mathfrak m_0^{\otimes N}m0⊗N​.

Milestones

The milestones follow the proof:

  • the identification of γN\gamma^NγN (Remark 6.3) and the two disintegrations (6.4), (6.5);
  • convergence of the cost when nobody deviates, (6.2);
  • the conditional dynamic programming principle for the value function VφV_\varphiVφ​ of a player who received the suggestion φ\varphiφ (Proposition 5.5), and the equivalence of closed-loop and open-loop solutions (Proposition 5.6);
  • three limits in the coupling of the deviation argument, (6.20), Claim 6.4 and (6.34);
  • the lower bound for a deviating player, (6.3).

An additional milestone, (4.3), states that the cost does not depend on the realization.

Significance

The theorem justifies correlated mean field solutions as models of large games with a mediator. It applies when the mediator's recommendations and the population flow are genuinely random, and when deviators may use the full history of the system. The paper's Section 7 gives an explicit example satisfying all its hypotheses. In that example the flow of measures is non-deterministic, so the correlated solution is not a mixture of Nash solutions.

No part of this result has a machine-checked proof. Formalizing it requires:

  • a complete account of correlated equilibria for dynamic games in Lean: suggestions, randomized strategy modifications, realizations;
  • a conditional law of large numbers for empirical measures;
  • the open-loop/closed-loop equivalence of Section 5.

These components are reusable beyond this paper.

Difficulty

When the flow μ\muμ is deterministic, the usual propagation-of-chaos argument for Nash approximation applies. Here it does not, for three reasons.

  • The flow is random, and every player's recommendation is correlated with it. Convergence must therefore be proved conditionally on the flow, and the disintegrations (6.4)–(6.5) are needed for this.
  • The deviating player sees the empirical measures of the others and may use extra randomness. The limit of their behaviour is not a closed-loop strategy of the mean field game. Optimality against it requires the open-loop formulation, Proposition 5.6, whose proof uses a conditional dynamic programming principle under (R1).
  • The empirical measure seen by the deviator is perturbed by the deviation itself. Claim 6.4 and (6.34) control this perturbation through the continuity assumption (A2).

Formalization scope

Lean conventions:

  • Spaces. X\mathcal XX and Γ\GammaΓ are Fintypes with the discrete σ-algebra. P(X)\mathcal P(\mathcal X)P(X) is stdSimplex ℝ X with its subspace topology and Borel σ-algebra. ν\nuν is volume on unitInterval.
  • Indexing. States and flows are indexed by Fin (T+1), and actions and noises by Fin T; the noise ξt+1\xi_{t+1}ξt+1​ has index ttt. Players are Fin N, and the paper's player 1 is index 0.
  • Strategies. Progressive strategies are non-anticipative, measurable functions of full paths. NNN-player strategies read empirical measures of N−1N-1N−1 points, so R^N\widehat{\mathcal R}_NRN​ is finite and carries the discrete σ-algebra.
  • The private coin. Condition v) of Definition 3.1 says that Φ~i(t,⋅)\tilde\Phi_i(t,\cdot)Φ~i​(t,⋅) is σ(Φi,ϑt)\sigma(\Phi_i,\vartheta_t)σ(Φi​,ϑt​)-measurable. It is stated literally. NγN\mathcal N^N_\gammaNγN​ is defined from kernels as in (3.1).
  • Realizations. A realization is a structure on a probability space Ω : Type. Conditions i)–iv) form a single product-law identity, and the dynamics hold almost surely. Completeness of the spaces and filtrations is dropped. Costs are the expected costs of realizations, and every inequality or limit between costs is required for every realization (or sequence of realizations) of each side.
  • Equilibrium. In the εN\varepsilon_NεN​-equilibrium, one εN\varepsilon_NεN​ serves every player and every modification. All NNN-player statements assume N≥2N\ge2N≥2, and sequences run along N=n+2N=n+2N=n+2.
  • (Con) conditions on σ(μ)\sigma(\mu)σ(μ) of the whole flow, via Lean's condExp.
  • (R2) is read in distribution (Remark 6.1). ρ1\rho_1ρ1​ is any kernel that disintegrates ρ\rhoρ along its second marginal.
  • Implicit hypotheses made explicit. Joint measurability of Ψ\PsiΨ is added. (A3) is stated as Lipschitz continuity in the measure argument with one constant.
  • VφV_\varphiVφ​ (Proposition 5.5) is defined through the explicit representation (5.10) of the conditional cost, a sum over flows weighted by Pφ(μ=m′∣μ(t)=m(t))\mathbb P_\varphi(\mu=m'\mid\mu^{(t)}=m^{(t)})Pφ​(μ=m′∣μ(t)=m(t)), rather than by conditioning on events. The proposition is stated with Vφ(t+1,… )V_\varphi(t+1,\dots)Vφ​(t+1,…) on the right, as in its proof; the printed statement has ttt.
  • (6.3) is stated for every sequence of modifications, which is equivalent to the paper's near-minimizing sequence. A lim inf⁡\liminfliminf bound is written as "for every δ>0\delta>0δ>0, eventually".

Ruled out: none of the following is a faithful formalization of this mission:

  • a deterministic flow (a Dirac ρ2\rho_2ρ2​);
  • deviations without the private coin, or restricted to R\mathcal RR;
  • (Con) conditioned on μ(t)\mu^{(t)}μ(t) only;
  • an arbitrary kernel in place of the disintegration ρ1\rho_1ρ1​.

Sorry-free checks in the workspace show that realizations of both games and the coupling exist, so the realization predicates are not vacuous.

Needed infrastructure, and welcome contributions:

  • conditional laws of large numbers for empirical measures of finite-state particles;
  • propagation of chaos in the sense of Kac–Sznitman;
  • disintegration lemmas for finite product kernels.

Selected references

  • O. Bonesini, L. Campi, M. Fischer, Correlated Equilibria for Mean Field Games with Progressive Strategies, arXiv preprint, 2022. https://arxiv.org/abs/2212.01656
  • L. Campi, M. Fischer, Correlated equilibria and mean field games: a simple model, Mathematics of Operations Research 47(3):2240–2259, 2022. https://arxiv.org/abs/2004.07936
  • R. J. Aumann, Subjectivity and correlation in randomized strategies, Journal of Mathematical Economics 1(1), 1974. https://doi.org/10.1016/0304-4068(74)90037-8
  • A. D. Gottlieb, Markov Transitions and the Propagation of Chaos, PhD thesis, University of California, Berkeley, 1998 (the chaos theorem cited as Theorem A.1). https://arxiv.org/abs/math/0001076
18 thms1 active userReviewed
Linear OptimizationStatistics·Captain: mikedeng1

Reducing Marketplace Interference Bias Via Shadow Prices 1: In a Symmetric Experiment the Shadow-Price Estimator Is No More Biased Than the RCT Estimator in the Fluid LimitResearch Paper

Motivation

Online marketplaces (ride hailing, delivery, freelancing, retail supply chains) test changes to their product with randomized controlled trials: a fraction ρ\rhoρ of the arriving customers is treated, the rest is kept as control, and the difference in outcomes is scaled up to estimate what would happen if everybody were treated. In a market with limited supply this estimate is biased. Treated and control customers compete for the same drivers or the same inventory, so the outcome of one group depends on the size of the other. This effect is called marketplace interference, and it makes the standard estimator overstate the effect of a treatment.

Bright, Delarue and Lobel (arXiv:2205.02274v4) model the platform's matching decision as a linear program and propose to estimate the treatment effect from the shadow prices of that program, which measure the marginal value of one more unit of demand of each type. This mission formalizes their fluid-limit comparison between the standard RCT estimator and the shadow-price estimator: in a symmetric experiment, the shadow-price estimator is never more biased.

Setting

A matching network is a finite directed graph with one demand node uidu^d_iuid​ for each demand type i∈[nd]i\in[n_d]i∈[nd​] (only incoming arcs), one supply node ujsu^s_jujs​ for each supply type j∈[ns]j\in[n_s]j∈[ns​] (only outgoing arcs), and intermediate nodes. Each arc (u,w)(u,w)(u,w) has a value vu,w∈Rv_{u,w}\in\mathbb Rvu,w​∈R per unit of flow and a capacity ku,w≥0k_{u,w}\ge0ku,w​≥0. Given a demand vector ddd and a supply vector sss, the platform solves the LP (2)

Φ(d,s)=max⁡∑(u,w)vu,wxu,w\Phi(d,s)=\max\sum_{(u,w)}v_{u,w}x_{u,w}Φ(d,s)=max(u,w)∑​vu,w​xu,w​

over arc flows xxx with 0≤x≤k0\le x\le k0≤x≤k, flow into each uidu^d_iuid​ at most did_idi​, flow out of each ujsu^s_jujs​ at most sjs_jsj​, and flow balance at each intermediate node. Its dual (5) has a nonnegative price aia_iai​ for each demand constraint, a price bjb_jbj​ for each supply constraint, a price ξu,w\xi_{u,w}ξu,w​ for each capacity and a free potential at each intermediate node. The price aia_iai​ is the shadow price of demand type iii.

Demand arrives at rate λ≥0\lambda\ge0λ≥0 under global control and at rate λ+β≥0\lambda+\beta\ge0λ+β≥0 under global treatment; supply arrives at rate π≥0\pi\ge0π≥0. An experiment treats a fraction ρ∈(0,1)\rho\in(0,1)ρ∈(0,1) of demand, so the platform observes the market at the intermediate rate λ+ρβ\lambda+\rho\betaλ+ρβ. The partial-treatment value function is Ψ(η)=Φ(λ+ηβ,π)\Psi(\eta)=\Phi(\lambda+\eta\beta,\pi)Ψ(η)=Φ(λ+ηβ,π) for η∈[0,1]\eta\in[0,1]η∈[0,1], and the global treatment effect in the fluid limit is

Δ=Ψ(1)−Ψ(0)=Φ(λ+β,π)−Φ(λ,π).\Delta=\Psi(1)-\Psi(0)=\Phi(\lambda+\beta,\pi)-\Phi(\lambda,\pi).Δ=Ψ(1)−Ψ(0)=Φ(λ+β,π)−Φ(λ,π).

Two estimators are computed from the experiment state alone. The RCT estimator is Δ^RCT=vˉ∗⋅β\hat\Delta_{\mathrm{RCT}}=\bar v^*\cdot\betaΔ^RCT​=vˉ∗⋅β, where vˉi∗\bar v^*_ivˉi∗​ is the average value per unit of type-iii demand in the optimal flow of Φ(λ+ρβ,π)\Phi(\lambda+\rho\beta,\pi)Φ(λ+ρβ,π), computed along the supply-to-demand paths that carry it ((9)–(10)). The shadow-price estimator is Δ^SP=aρ⋅β\hat\Delta_{\mathrm{SP}}=a^\rho\cdot\betaΔ^SP​=aρ⋅β, where aρa^\rhoaρ is the demand part of the optimal dual solution of Φ(λ+ρβ,π)\Phi(\lambda+\rho\beta,\pi)Φ(λ+ρβ,π) ((11)). Two assumptions stand throughout: the optimal primal and dual solutions of Φ(λ+ρβ,π)\Phi(\lambda+\rho\beta,\pi)Φ(λ+ρβ,π) are unique (Assumption 2), and β\betaβ is sign-consistent, β≥0\beta\ge0β≥0 or β≤0\beta\le0β≤0 componentwise (Assumption 3).

Formalization targets

Goal: Theorem 4 (p. 21)

In a symmetric experiment, ρ=12\rho=\tfrac12ρ=21​,

∣Δ^SP−Δ∣ ≤ ∣Δ^RCT−Δ∣.\bigl|\hat\Delta_{\mathrm{SP}}-\Delta\bigr|\ \le\ \bigl|\hat\Delta_{\mathrm{RCT}}-\Delta\bigr|.​Δ^SP​−Δ​ ≤ ​Δ^RCT​−Δ​.

The statement fixes no constant other than the symmetric design. It holds for every network, every admissible rate vector and every path decomposition of the optimal flow.

Milestones

  • Proposition 1 (p. 13): Ψ\PsiΨ is concave and piecewise linear with finitely many pieces on [0,1][0,1][0,1].
  • Theorem 2 (p. 14): if β≥0\beta\ge0β≥0, then vˉ∗⋅(λ+β)≥Ψ(1)\bar v^*\cdot(\lambda+\beta)\ge\Psi(1)vˉ∗⋅(λ+β)≥Ψ(1) and vˉ∗⋅λ≤Ψ(0)\bar v^*\cdot\lambda\le\Psi(0)vˉ∗⋅λ≤Ψ(0), with the reverse inequalities if β≤0\beta\le0β≤0. Consequently ∣Δ^RCT∣≥∣Δ∣|\hat\Delta_{\mathrm{RCT}}|\ge|\Delta|∣Δ^RCT​∣≥∣Δ∣.
  • Proposition 6 (p. 21): Ψ′(η)=aη⋅β\Psi'(\eta)=a^\eta\cdot\betaΨ′(η)=aη⋅β off finitely many points, and Δ=∫01aη⋅β dη\Delta=\int_0^1a^\eta\cdot\beta\,d\etaΔ=∫01​aη⋅βdη.

Companion results

  • Theorem 9 (p. 27): for ρ<12\rho<\tfrac12ρ<21​ and β≤0\beta\le0β≤0, the estimator Δ^SP+=(1−2ρ)Δ^RCT+2ρΔ^SP\hat\Delta_{\mathrm{SP+}}=(1-2\rho)\hat\Delta_{\mathrm{RCT}}+2\rho\hat\Delta_{\mathrm{SP}}Δ^SP+​=(1−2ρ)Δ^RCT​+2ρΔ^SP​ is no more biased than Δ^RCT\hat\Delta_{\mathrm{RCT}}Δ^RCT​.
  • Theorem 10 (p. 27): for any ρ\rhoρ, if (vˉ∗−a0)⋅β≥(a0−a1)⋅β(\bar v^*-a^0)\cdot\beta\ge(a^0-a^1)\cdot\beta(vˉ∗−a0)⋅β≥(a0−a1)⋅β, then BiasSP≤BiasRCT\mathrm{Bias}_{\mathrm{SP}}\le\mathrm{Bias}_{\mathrm{RCT}}BiasSP​≤BiasRCT​; if (a0−a1)⋅β=0(a^0-a^1)\cdot\beta=0(a0−a1)⋅β=0, then BiasSP=0\mathrm{Bias}_{\mathrm{SP}}=0BiasSP​=0.

Significance

Theorem 4 says that a platform running a 50/50 experiment never does worse by replacing the average value vˉ∗\bar v^*vˉ∗ with the marginal value aρa^\rhoaρ. The comparison does not depend on the network, on the capacities, or on how strongly treatment and control interfere. Theorem 2 shows that the standard estimator is biased in a known direction, and Theorem 4 shows that a different use of the same experiment data reduces that bias. The SP estimator needs only the dual solution of an LP the platform already solves.

All results of this mission are proved in the paper (Appendix C), and none has a machine-checked proof. The milestones are statements about parametric linear programs: concavity and piecewise linearity of the optimal value in the right-hand side, and the identification of its derivative with the optimal dual. These hold well beyond this paper and are absent from the platform.

Difficulty

Two steps resist the naive argument. The bound vˉ∗⋅λ≤Ψ(0)\bar v^*\cdot\lambda\le\Psi(0)vˉ∗⋅λ≤Ψ(0) needs a feasible flow for the control market built from the experiment's optimal flow. Scaling the arc flow does not give one, because types share arcs. The flow has to be scaled path by path and type by type, which is why vˉ∗\bar v^*vˉ∗ is defined through paths. The identification Ψ′(η)=aη⋅β\Psi'(\eta)=a^\eta\cdot\betaΨ′(η)=aη⋅β needs LP sensitivity analysis in a parametric right-hand side: strong duality at every η\etaη, and the fact that dual optima are supergradients of Ψ\PsiΨ. Because Ψ\PsiΨ has kinks, the identification holds only off finitely many points. Finally, a pointwise comparison of aρa^\rhoaρ with vˉ∗\bar v^*vˉ∗ does not give Theorem 4. The proof compares integrals of aη⋅βa^\eta\cdot\betaaη⋅β over [0,ρ][0,\rho][0,ρ] and [ρ,1][\rho,1][ρ,1], and the symmetric design is what balances the two sides.

Formalization scope

Everything is defined in MarketInterference.FluidBias. The network is a structure with arcs E and intermediate nodes I, both finite. An arc's tail is a supply node or an intermediate node, and its head is a demand node or an intermediate node, so the sink and source convention holds by construction. Demand types are Fin nd, and Lean index iii is the paper's type i+1i+1i+1. Φ\PhiΦ is the supremum of the objective over the feasible set. For d,s≥0d,s\ge0d,s≥0 that set contains 000 and lies in the box [0,k][0,k][0,k], so the supremum is a maximum. The dual (5) is encoded arc by arc, and the four printed constraint families (5b)–(5e) are its four tail/head cases. Optimality of a primal or dual solution is stated explicitly. Strong duality is not assumed.

The estimators are the right-hand sides of (9)–(11). They are computed from an optimal primal flow, one of its path decompositions, and an optimal dual solution of the experiment LP. Neither is defined from Ψ\PsiΨ or from its derivative. A formalization that defined Δ^SP\hat\Delta_{\mathrm{SP}}Δ^SP​ as Ψ′(ρ)\Psi'(\rho)Ψ′(ρ), or Δ^RCT\hat\Delta_{\mathrm{RCT}}Δ^RCT​ through Ψ\PsiΨ, would trivialize the goal and is ruled out. With intermediate nodes, the decomposition of the optimal flow into paths, which (10) treats as given, is not unique. The theorems therefore hold for every decomposition. Paths are lists of distinct arcs. In (10), a type with λi+ρβi=0\lambda_i+\rho\beta_i=0λi​+ρβi​=0 has βi=0\beta_i=0βi​=0, and Lean's x/0=0x/0=0x/0=0 makes its term vanish. Assumption 2 is stated as uniqueness of the whole optimal primal flow and of the whole dual solution (a,b,m,ξ)(a,b,m,\xi)(a,b,m,ξ), as printed. Assumption 3 is a disjunction of the two sign conditions. Assumption 1 (random tie-breaking) concerns only the finite random market and is not added. The limits in Corollary 1 and Propositions 2 and 5 are not needed here: Δ\DeltaΔ, Δ^RCT\hat\Delta_{\mathrm{RCT}}Δ^RCT​ and Δ^SP\hat\Delta_{\mathrm{SP}}Δ^SP​ are defined directly in the fluid model. Proposition 6's derivative is stated with HasDerivAt off a finite set, and its dual selection η↦aη\eta\mapsto a^\etaη↦aη is arbitrary. The statements follow arXiv:2205.02274v4. Its printed slips are corrected as disclosed: the ill-defined y∗y^*y∗ of (10) is read as any path decomposition, and "uisu^s_iuis​" on p. 9 is read as uidu^d_iuid​.

A complete development needs LP strong duality and complementary slackness for this network LP, parametric-LP results (concavity and piecewise linearity of the optimal value along a ray, and dual optima as supergradients), path decompositions of flows, and the fundamental theorem of calculus for piecewise linear functions. The parametric-LP layer can be reused for any LP-based value function. Proofs of any milestone are welcome, as are general lemmas on network LPs.

Selected references

  • I. Bright, A. Delarue, I. Lobel, Reducing Marketplace Interference Bias Via Shadow Prices, arXiv:2205.02274v4, 2024; Management Science, 2025. https://arxiv.org/abs/2205.02274
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, Chapter 5 (sensitivity analysis; Theorem 5.1).
  • R. Johari, H. Li, I. Liskovich, G. Y. Weintraub, Experimental Design in Two-Sided Platforms: An Analysis of Bias, Management Science, 2022 (cited by the paper as [Johari et al. 2022]). https://arxiv.org/abs/2002.11142
8 thms1 active userReviewed
EconomicsOptimization·Captain: mikedeng1

The Bright Side of the GDPR: Welfare-Improving Privacy Management II: A Firm with Small Data-Based Revenue Earns More Profit After the GDPRResearch Paper

Motivation

The European Union's General Data Protection Regulation (GDPR, 2018) requires a firm to obtain a consumer's explicit consent before it collects personal data. The common expectation, in policy debate and in much of the empirical literature, is that consent requirements cost firms money: they shrink the pool of consumer data that can be monetized through advertising, personalization or resale. Choe, Matsushima and Shekhar (ISER Discussion Paper No. 1246, 2024; published as Management Science, 2025) build a monopoly pricing model in which consent creates a new purchase option. A consumer who would not have bought the service under compulsory data sharing can now buy it without sharing. They then ask how the firm's equilibrium price, profit and consumer surplus change.

This mission formalizes the paper's analytic profit result. If the firm's revenue is mostly usage based, meaning its revenue per unit of collected data is small, then the firm earns strictly more in equilibrium after the GDPR than before. The result is the source of the paper's title. Regulation that is usually read as a cost to firms raises the profit of one well-defined class of firms.

Setting

A monopolist sells an online service at zero marginal cost and sets a price p∈Rp\in\mathbb Rp∈R. Negative prices are allowed: they pay consumers to use the service. A consumer type is a pair (v,c)∈[0,1]2(v,c)\in[0,1]^2(v,c)∈[0,1]2, where vvv is the valuation of the service and ccc the privacy cost of sharing data. Types are independent and uniform on the unit square, so the mass of a set of consumers is its area. A consumer who shares data receives an opt-in benefit x∈(0,1)x\in(0,1)x∈(0,1). The utilities of opt-in purchase (buy and share) and opt-out purchase (buy without sharing) are

US(v,c)=v+(x−c)−p,UN(v,c)=v−p.U_S(v,c)=v+(x-c)-p,\qquad U_N(v,c)=v-p .US​(v,c)=v+(x−c)−p,UN​(v,c)=v−p.

The firm earns data revenue α≥0\alpha\ge0α≥0 per unit of collected data. Its profit is Π=pD+αDS\Pi=pD+\alpha D_SΠ=pD+αDS​, where DDD is total demand and DSD_SDS​ the mass of consumers who share data.

  • Before the GDPR opt-out purchase is unavailable. A consumer buys, and shares, iff US≥0U_S\ge0US​≥0. The demand D^(p)\widehat D(p)D(p) is the area of {(v,c)∈[0,1]2:US≥0}\{(v,c)\in[0,1]^2: U_S\ge 0\}{(v,c)∈[0,1]2:US​≥0}, and the profit is Π^(p)=(p+α)D^(p)\widehat\Pi(p)=(p+\alpha)\widehat D(p)Π(p)=(p+α)D(p).
  • After the GDPR the opt-in buyers are {(v,c)∈[0,1]2:c≤v+x−p, c≤x}\{(v,c)\in[0,1]^2 : c\le v+x-p,\ c\le x\}{(v,c)∈[0,1]2:c≤v+x−p, c≤x} and the opt-out buyers are {(v,c)∈[0,1]2:v≥p, c>x}\{(v,c)\in[0,1]^2: v\ge p,\ c>x\}{(v,c)∈[0,1]2:v≥p, c>x}. Their areas are D~S(p)\widetilde D_S(p)DS​(p) and D~N(p)\widetilde D_N(p)DN​(p), and the profit is Π~(p)=p(D~S(p)+D~N(p))+αD~S(p)\widetilde\Pi(p)=p(\widetilde D_S(p)+\widetilde D_N(p))+\alpha\widetilde D_S(p)Π(p)=p(DS​(p)+DN​(p))+αDS​(p).

An equilibrium price is a global maximizer of the profit over p∈Rp\in\mathbb Rp∈R: the firm moves first and consumers respond. The paper's thresholds are

α1(x)=max⁡{1−2x2,0},α2(x)=max⁡{2−4x+x22x,0}.\alpha_1(x)=\max\Big\{\frac{1-2x}{2},0\Big\},\qquad \alpha_2(x)=\max\Big\{\frac{2-4x+x^2}{2x},0\Big\}.α1​(x)=max{21−2x​,0},α2​(x)=max{2x2−4x+x2​,0}.

"Case 1a" (before) and "case 2a" (after) are the equilibria with x<p⋆<1+xx<p^\star<1+xx<p⋆<1+x, in which low-valuation consumers stay out of the market.

Formalization targets

Goal: Proposition A3, first bullet (p. 34)

If α<α1(x)\alpha<\alpha_1(x)α<α1​(x), both profit functions attain their maxima over R\mathbb RR, and

max⁡p∈RΠ~(p)  >  max⁡p∈RΠ^(p),\max_{p\in\mathbb R}\widetilde\Pi(p)\;>\;\max_{p\in\mathbb R}\widehat\Pi(p),p∈Rmax​Π(p)>p∈Rmax​Π(p),

that is, Π~2a⋆>Π^1a⋆\widetilde\Pi^\star_{2a}>\widehat\Pi^\star_{1a}Π2a⋆​>Π1a⋆​. The hypothesis forces x<1/2x<1/2x<1/2, because α≥0\alpha\ge0α≥0.

Milestones

  1. Lemma A3, first bullet (p. 33): for x≤1/2x\le 1/2x≤1/2 and α<α1(x)\alpha<\alpha_1(x)α<α1​(x), every equilibrium price before the GDPR lies in (x,1+x)(x,1+x)(x,1+x) (case 1a), and so does every equilibrium price after it (case 2a).
  2. Equilibrium profit before the GDPR (p. 31): for α<α1(x)\alpha<\alpha_1(x)α<α1​(x), Π^⋆=2(1+x+α)3/27\widehat\Pi^\star=2(1+x+\alpha)^3/27Π⋆=2(1+x+α)3/27.
  3. Equilibrium profit after the GDPR (p. 32): for α<α2(x)\alpha<\alpha_2(x)α<α2​(x), Π~⋆=(4+4x(x+2α+2αx)+x2(x−2α)2)/16\widetilde\Pi^\star=\big(4+4x(x+2\alpha+2\alpha x)+x^2(x-2\alpha)^2\big)/16Π⋆=(4+4x(x+2α+2αx)+x2(x−2α)2)/16.
  4. Online Appendix §F, first display (OA p. 9): for α<α1(x)\alpha<\alpha_1(x)α<α1​(x), Π~⋆−Π^⋆=J(x,α)/432\widetilde\Pi^\star-\widehat\Pi^\star=J(x,\alpha)/432Π⋆−Π⋆=J(x,α)/432, with JJJ the explicit quartic polynomial printed there.
  5. Online Appendix §F, conclusion (OA p. 9): J(x,α)>0J(x,\alpha)>0J(x,α)>0 whenever 0<x<1/20<x<1/20<x<1/2 and 0≤α<(1−2x)/20\le\alpha<(1-2x)/20≤α<(1−2x)/2.

Significance

The result. Proposition A3 separates firms by revenue model. A firm whose revenue is mostly usage based gains from the GDPR. The opt-out option brings in consumers with high privacy costs who did not buy before, and this extra demand lets the firm both raise its price and sell to more consumers. Together these outweigh the lost data revenue. The other two bullets of Proposition A3 treat firms with larger α\alphaα, for which the comparison can go either way. Their thresholds α5(x)\alpha_5(x)α5​(x) and α6(x)\alpha_6(x)α6​(x) are defined only as "the value of α\alphaα that solves" an equation, with existence and uniqueness shown in plots, so they are not posed here. The paper's Propositions 1–4 are its main-text results at x=1/4x=1/4x=1/4. The price comparison (Proposition 1) is the x=1/4x=1/4x=1/4 instance of the general Proposition A1, the subject of the sibling mission in this series. Propositions 2–4, A2, A3 (bullets 2–3) and A4 rest on numerically located thresholds and are not posed.

Formalizing it. The paper's proof is in print, but no part of it has been machine-checked. The model is fully explicit (a uniform distribution, two areas, two profit functions on R\mathbb RR), so a complete formal proof would certify every link from the primitives to the inequality. That covers the computation of the polygon areas, the global maximization of a piecewise polynomial over all real prices, and the final polynomial inequality. The printed proof of the last step contains a slip: the value it gives for "J(x,α1(x))J(x,\alpha_1(x))J(x,α1​(x))" is the value of J/432J/432J/432. A formalization fixes such details for good.

Difficulty

The closed forms are easy to verify once the equilibrium is known to be interior to case 1a and case 2a. The work lies elsewhere. Computing the demands requires the Lebesgue area of a family of polygons whose shape changes with ppp. Over all of R\mathbb RR each demand is piecewise polynomial with several pieces, and the profits are piecewise cubic. Identifying the global maximizer means checking every piece, including negative prices before the GDPR and the corner pieces where demand saturates at 000 or 111. A first-order condition on one piece gives only a candidate. The comparison of the two maximal values then reduces to a two-variable quartic inequality on a triangle, which holds strictly on the open region but becomes tight at its corner x→0x\to0x→0, α→1/2\alpha\to1/2α→1/2, where J(0,1/2)=0J(0,1/2)=0J(0,1/2)=0.

Formalization scope

  • Model. One definitions file, GDPRPrivacy.PriceRise.Model, shared with the sibling mission on the equilibrium price. A type is q : ℝ × ℝ with q.1 = v and q.2 = c. Demands are (volume S).toReal for the explicit sets S⊆[0,1]2S\subseteq[0,1]^2S⊆[0,1]2 above, with the opt-in and opt-out sets of p. 13 copied literally. Ties are assigned to opt-in, which changes only null sets. The file also defines α1,α2,β,Γ\alpha_1,\alpha_2,\beta,\Gammaα1​,α2​,β,Γ.
  • Standing assumptions. Every theorem assumes 0<x<10<x<10<x<1 and α≥0\alpha\ge0α≥0 (§3, pp. 7–8). No other hypothesis is added. Milestone 1 keeps the paper's x≤1/2x\le 1/2x≤1/2, and milestone 5 keeps its printed region α<(1−2x)/2\alpha<(1-2x)/2α<(1−2x)/2, x<1/2x<1/2x<1/2.
  • Equilibria. An equilibrium price is any p with IsMaxOn (profitBefore x α) Set.univ p (respectively profitAfter). Every statement asserts that a maximizer exists and then quantifies over all maximizers.
  • Ruled-out trivializations. The goal compares the maximal values of the two model profit functions. It does not compare the closed forms 2(1+x+α)3/272(1+x+\alpha)^3/272(1+x+α)3/27 and Π~2a⋆\widetilde\Pi^\star_{2a}Π2a⋆​ (that is milestones 4–5 alone), it does not compare the profits at a common price, and it does not restrict the price range. The existence conjuncts prevent a vacuous "for every maximizer".
  • Needed infrastructure. Areas of polygons in R2\mathbb R^2R2 via MeasureTheory.volume (Fubini or regionBetween), maximization of piecewise polynomials on R\mathbb RR, and polynomial inequalities. Lemmas computing the area of {(v,c)∈[0,1]2:c≤v+t}\{(v,c)\in[0,1]^2: c\le v+t\}{(v,c)∈[0,1]2:c≤v+t} as a function of ttt are reusable for other uniform-type screening and pricing models. Contributions of such lemmas, and of the explicit demand formulas (4)–(6) of the paper, are welcome.

Selected references

  • C. Choe, N. Matsushima and S. Shekhar, The Bright Side of the GDPR: Welfare-Improving Privacy Management, ISER Discussion Paper No. 1246, Osaka University, June 2024. The artifact formalized here; theorem and page numbers refer to it.
  • C. Choe, N. Matsushima and S. Shekhar, The Bright Side of the GDPR: Welfare-Improving Privacy Management, Management Science, 2025. https://doi.org/10.1287/mnsc.2024.06653
  • S. P. Anderson and J. S. Gans, Platform Siphoning: Ad-Avoidance and Media Content, American Economic Journal: Microeconomics 3(4), 2011. https://doi.org/10.1257/mic.3.4.1
  • Regulation (EU) 2016/679 (General Data Protection Regulation), Official Journal of the European Union L 119, 2016. https://eur-lex.europa.eu/eli/reg/2016/679/oj
7 thms1 active userReviewed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

The Value of Information Design in Supply Chain Management III: With Overlapping Supports, the Optimal Policy Goes from Partial to No to Full Disclosure as the Critical Ratio RisesResearch Paper

Motivation

A retailer often knows more about her own demand than the supplier who must produce for her. In a decentralized supply chain the supplier sets a production quantity before demand is realized, and an under-informed supplier produces too little or too much. The retailer can shape what the supplier believes by committing in advance to a disclosure policy, a rule that maps what she knows to messages she sends. This is the Bayesian persuasion or information design framework of Kamenica and Gentzkow (2011), applied by Candogan and Gurkan (2024) to a newsvendor supplier.

The natural expectation is that the retailer either tells the supplier everything or nothing. The paper shows the answer depends on the supplier's critical ratio, and that it can be non-monotone. For nested demand supports (the setting of the first missions in this series) partial disclosure appears for low critical ratios. This mission formalizes the paper's §4 extension to supports that overlap without being nested. There, under an explicit condition on the supports, the optimal policy moves from partial disclosure to no disclosure to full disclosure as the critical ratio rises.

Setting

The state is ω∈{0,1}\omega\in\{0,1\}ω∈{0,1} with prior p0=P(ω=0)∈[0,1]p_0=\mathbb P(\omega=0)\in[0,1]p0​=P(ω=0)∈[0,1]. In state ω\omegaω the retailer's demand DωD_\omegaDω​ is uniform on [aω,bω][a_\omega,b_\omega][aω​,bω​]. The supports intersect:

b0>b1>a0>a1≥0.b_0>b_1>a_0>a_1\ge 0 .b0​>b1​>a0​>a1​≥0.

Write δu=b0−b1\delta_u=b_0-b_1δu​=b0​−b1​, δd=a0−a1\delta_d=a_0-a_1δd​=a0​−a1​, δIS=b1−a0\delta_{\mathsf{IS}}=b_1-a_0δIS​=b1​−a0​; all three are positive.

The supplier holds a belief p=P(ω=0)p=\mathbb P(\omega=0)p=P(ω=0) and chooses a quantity Q≥0Q\ge 0Q≥0 that minimizes the newsvendor cost (2),

p E[ξ(D0−Q)++(1−ξ)(Q−D0)+]+(1−p) E[ξ(D1−Q)++(1−ξ)(Q−D1)+],p\,\mathbb E\big[\xi(D_0-Q)^+ + (1-\xi)(Q-D_0)^+\big]+(1-p)\,\mathbb E\big[\xi(D_1-Q)^+ + (1-\xi)(Q-D_1)^+\big],pE[ξ(D0​−Q)++(1−ξ)(Q−D0​)+]+(1−p)E[ξ(D1​−Q)++(1−ξ)(Q−D1​)+],

where ξ=Cs/(Cs+Ce)∈(0,1)\xi=C_s/(C_s+C_e)\in(0,1)ξ=Cs​/(Cs​+Ce​)∈(0,1) is the critical ratio of the shortage cost CsC_sCs​ and the excess cost CeC_eCe​. A best-response profile Q∗Q^*Q∗ assigns an optimal quantity Qp∗Q^*_pQp∗​ to every belief p∈[0,1]p\in[0,1]p∈[0,1].

A policy Γ=(M,π)\Gamma=(\mathcal M,\pi)Γ=(M,π) consists of a finite message space M\mathcal MM and probabilities π(m∣ω)\pi(m\mid\omega)π(m∣ω). After message mmm the supplier's belief is the Bayes posterior (1),

pm=π(m∣0) p0π(m∣0) p0+π(m∣1)(1−p0).p_m=\frac{\pi(m\mid 0)\,p_0}{\pi(m\mid 0)\,p_0+\pi(m\mid 1)(1-p_0)} .pm​=π(m∣0)p0​+π(m∣1)(1−p0​)π(m∣0)p0​​.

The retailer orders the realized demand and bears only the shortage. Her design problem (3) minimizes, over policies Γ\GammaΓ and best-response profiles Q∗Q^*Q∗, the expected shortage

E[p(D0−Qp∗)++(1−p)(D1−Qp∗)+ ∣ Γ],\mathbb E\Big[p(D_0-Q^*_p)^+ + (1-p)(D_1-Q^*_p)^+\ \Big|\ \Gamma\Big],E[p(D0​−Qp∗​)++(1−p)(D1​−Qp∗​)+ ​ Γ],

where ppp is the induced posterior. Full disclosure reveals ω\omegaω. No disclosure sends one uninformative message. The function

KIS(p)=p E[(D0−Qp∗)+]+(1−p) E[(D1−Qp∗)+]K_{\mathsf{IS}}(p)=p\,\mathbb E[(D_0-Q^*_p)^+]+(1-p)\,\mathbb E[(D_1-Q^*_p)^+]KIS​(p)=pE[(D0​−Qp∗​)+]+(1−p)E[(D1​−Qp∗​)+]

of (B.1) is the retailer's cost when the posterior is ppp, and κIS\kappa_{\mathsf{IS}}κIS​ denotes its lower convex envelope on [0,1][0,1][0,1].

Formalization targets

Goal: Proposition 3 (p. 15)

Assume δd>2δu\delta_d>2\delta_uδd​>2δu​ and δIS>max⁡(δd−2δu, δdδu/(δd−2δu))\delta_{\mathsf{IS}}>\max\big(\delta_d-2\delta_u,\ \delta_d\delta_u/(\delta_d-2\delta_u)\big)δIS​>max(δd​−2δu​, δd​δu​/(δd​−2δu​)). Let ξ˘=(δd−2δu)/(δd−δu)\breve\xi=(\delta_d-2\delta_u)/(\delta_d-\delta_u)ξ˘​=(δd​−2δu​)/(δd​−δu​) and τ‾IS(p)=(1−p)(a0−a1)/(b1−a1)\underline\tau_{\mathsf{IS}}(p)=(1-p)(a_0-a_1)/(b_1-a_1)τ​IS​(p)=(1−p)(a0​−a1​)/(b1​−a1​). Then:

ξ∈[ξ˘,1)  ⟹  full disclosure is optimal,ξ∈[τ‾IS(p0),ξ˘)  ⟹  no disclosure is optimal,ξ∈(0,τ‾IS(p0))  ⟹  ΓIS∗ of (7) is optimal,\begin{aligned} \xi\in[\breve\xi,1) &\implies \text{full disclosure is optimal},\\ \xi\in[\underline\tau_{\mathsf{IS}}(p_0),\breve\xi) &\implies \text{no disclosure is optimal},\\ \xi\in(0,\underline\tau_{\mathsf{IS}}(p_0)) &\implies \Gamma^*_{\mathsf{IS}} \text{ of (7) is optimal}, \end{aligned}ξ∈[ξ˘​,1)ξ∈[τ​IS​(p0​),ξ˘​)ξ∈(0,τ​IS​(p0​))​⟹full disclosure is optimal,⟹no disclosure is optimal,⟹ΓIS∗​ of (7) is optimal,​

where ΓIS∗\Gamma^*_{\mathsf{IS}}ΓIS∗​ has two messages, sends m0m_0m0​ in state 000 with probability 1, and sends m0m_0m0​ in state 111 with probability ξ(b1−a1)(a0−a1)−ξ(b1−a1)⋅p01−p0\frac{\xi(b_1-a_1)}{(a_0-a_1)-\xi(b_1-a_1)}\cdot\frac{p_0}{1-p_0}(a0​−a1​)−ξ(b1​−a1​)ξ(b1​−a1​)​⋅1−p0​p0​​.

Milestones (the paper's proof, App. C.1)

  1. Proposition 2 (p. 15): the supplier's optimal quantity Qp∗Q^*_pQp∗​ is unique and given by the three-branch formula (6), with thresholds τ‾IS(p)≤τˉIS(p)=1−p(b0−b1)/(b0−a0)\underline\tau_{\mathsf{IS}}(p)\le\bar\tau_{\mathsf{IS}}(p)=1-p(b_0-b_1)/(b_0-a_0)τ​IS​(p)≤τˉIS​(p)=1−p(b0​−b1​)/(b0​−a0​).
  2. (B.2) (p. 25): the optimal value of (3) is κIS(p0)\kappa_{\mathsf{IS}}(p_0)κIS​(p0​), the Kamenica–Gentzkow reduction.
  3. Equivalence of hypotheses (p. 32): the hypotheses of Proposition 3 hold if and only if τˉIS(1)>ξ˘>τ‾IS(0)\bar\tau_{\mathsf{IS}}(1)>\breve\xi>\underline\tau_{\mathsf{IS}}(0)τˉIS​(1)>ξ˘​>τ​IS​(0).
  4. KISK_{\mathsf{IS}}KIS​ in closed form (pp. 32–33), in the three regimes of (6).
  5. Lemma 2 (p. 31): κIS\kappa_{\mathsf{IS}}κIS​ is the chord (1−p)KIS(0)+pKIS(1)(1-p)K_{\mathsf{IS}}(0)+pK_{\mathsf{IS}}(1)(1−p)KIS​(0)+pKIS​(1) for ξ≥ξ˘\xi\ge\breve\xiξ≥ξ˘​; it is KISK_{\mathsf{IS}}KIS​ itself for ξ∈[τ‾IS(0),ξ˘)\xi\in[\underline\tau_{\mathsf{IS}}(0),\breve\xi)ξ∈[τ​IS​(0),ξ˘​); and for smaller ξ\xiξ it is KISK_{\mathsf{IS}}KIS​ above p˘=1−ξ(b1−a1)/(a0−a1)\breve p=1-\xi(b_1-a_1)/(a_0-a_1)p˘​=1−ξ(b1​−a1​)/(a0​−a1​) and the chord from 000 to p˘\breve pp˘​ below.
  6. The posteriors of ΓIS∗\Gamma^*_{\mathsf{IS}}ΓIS∗​ (p. 32): m0m_0m0​ has probability p0/p˘p_0/\breve pp0​/p˘​ and induces posterior p˘\breve pp˘​, while m1m_1m1​ induces posterior 000.

Significance

The result. With nested supports, more information can only hurt the retailer at low critical ratios. With overlapping supports, Proposition 3 shows the regimes of full, no and partial disclosure can occur in a different order. It also gives a sufficient condition on the shape of the supports for that pattern. Together with the paper's Theorem 1 (nested) and Theorem 3 (disjoint), it gives the optimal policy for the main configurations of two uniform supports. The explicit thresholds tell a practitioner which disclosure regime applies from four interval endpoints and a cost ratio.

Formalizing it. The paper's argument is in its Online Appendix (C.1, pp. 30–35). It cites Kamenica–Gentzkow for the value of the design problem and proves the envelope lemma through second-derivative sign computations. None of this is machine-checked. A complete development yields a formal concavification theorem for a finite-state persuasion problem over all finite message spaces, which is reusable well beyond this paper. It also yields a checked closed form for the newsvendor quantile under a two-uniform mixture. The goal and every milestone are open on the platform; only the published convex-envelope definition is reused.

Difficulty

The obvious argument compares full disclosure, no disclosure and one candidate partial policy, and picks the best of the three. That proves nothing, because optimality is claimed against every policy on every finite message space. The reduction to the convex envelope (milestone 2) is what makes the comparison finite, and it is itself a theorem about splitting a prior into posteriors.

The envelope of KISK_{\mathsf{IS}}KIS​ is the second obstacle. KISK_{\mathsf{IS}}KIS​ is piecewise rational in ppp, with two regime boundaries that move with ppp. Its curvature changes sign across the boundaries, and the sign of its second derivative depends on ξ\xiξ relative to ξ˘\breve\xiξ˘​. Verifying that the claimed κIS\kappa_{\mathsf{IS}}κIS​ is convex at the kink p˘\breve pp˘​ requires a one-sided slope inequality whose sign rests on the hypotheses on δd,δu,δIS\delta_d,\delta_u,\delta_{\mathsf{IS}}δd​,δu​,δIS​. The equivalence of milestone 3 is where those hypotheses enter.

Formalization scope

All objects live in the namespace SCInfoDesign.Intersecting. States are Fin 2; ω=0\omega=0ω=0 is the state with demand on [a0,b0][a_0,b_0][a0​,b0​], and beliefs are always P(ω=0)\mathbb P(\omega=0)P(ω=0). The uniform expectation is 1b−a∫ab\frac{1}{b-a}\int_a^bb−a1​∫ab​. Policies are stochastic maps from Fin 2 to any finite type; the paper does not bound the message space, and finite spaces are the standard Kamenica–Gentzkow setting. The supplier's cost is normalized by Cs+CeC_s+C_eCs​+Ce​, which leaves its minimizers unchanged, so ξ∈(0,1)\xi\in(0,1)ξ∈(0,1) is the only cost parameter. A message of probability zero carries the default posterior 000 and weight 000. No disclosure is the one-message policy. KISK_{\mathsf{IS}}KIS​ uses the largest optimal quantity, which is the unique one here. The envelope is the published BiconvexProg.BranchBound.convexEnvelope on [0,1][0,1][0,1].

Standing assumptions, added and disclosed because the paper uses them implicitly: 0<ξ<10<\xi<10<ξ<1; a1≥0a_1\ge 0a1​≥0 (nonnegative demand, so the constraint Q≥0Q\ge 0Q≥0 never binds); p0∈[0,1]p_0\in[0,1]p0​∈[0,1]. Nondegeneracy aω<bωa_\omega<b_\omegaaω​<bω​ follows from the support ordering. Two printed slips are corrected in the statements and quoted as printed in the milestones: bhb_hbh​ for b0b_0b0​ in the KISK_{\mathsf{IS}}KIS​ display, and the label m1m_1m1​ for m0m_0m0​ on p. 32. The overlapping indicators of (C.2) at p=p˘p=\breve pp=p˘​ are read piecewise.

Trivializing encodings are excluded. Optimality is over all finite policies and all best-response profiles, not over the three named policies. The supplier's response is an argmin of (2), never the closed form (6), which is a milestone. Each named policy is also asserted to be a policy.

Contributions are welcome on any milestone. The concavification theorem (milestone 2) and the uniform-mixture newsvendor quantile (milestone 1) are the reusable pieces. Proposition 5 (shift case) and the second-derivative display (C.3) are not posed here.

Selected references

  • O. Candogan, H. Gurkan, The Value of Information Design in Supply Chain Management, Management Science, 2024. https://doi.org/10.1287/mnsc.2023.03004 (statements cited from the SSRN preprint, abstract 4378997, https://ssrn.com/abstract=4378997)
  • E. Kamenica, M. Gentzkow, Bayesian Persuasion, American Economic Review 101(6), 2590–2615, 2011. https://doi.org/10.1257/aer.101.6.2590
  • F. A. Al-Khayyal, J. E. Falk, Jointly Constrained Biconvex Programming, Mathematics of Operations Research 8(2), 273–286, 1983 (source of the published convex-envelope definition). https://doi.org/10.1287/moor.8.2.273
10 thms1 active userReviewed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

The Value of Information Design in Supply Chain Management IV: With Disjoint Supports, Full Disclosure Is Optimal When 2(b₀ − a₀) ≥ b₁ − a₁, Else No Disclosure at p₀ ≥ p̃ and Partial BelowResearch Paper

Motivation

A retailer usually knows more about her future demand than the supplier who has to produce for her. If the supplier must commit to a production quantity before the order arrives, the retailer bears the cost of every unit he fails to produce. She cannot pay him or contract on quantities, but she can decide how much of her demand information to share, and she can commit to that disclosure rule in advance. Which information should she share?

Candogan and Gurkan (Management Science, 2024; preprint SSRN 4378997) answer this question in a two-state model with uniform demand, using the Bayesian persuasion framework of Kamenica and Gentzkow (2011). Their main text treats nested demand supports. This mission formalizes their extension to disjoint supports, where the high-demand state's support lies entirely above the low-demand state's (Theorem 3). It is the fourth of four missions on the paper; the others cover nested supports (Theorem 1), the value of information (Theorem 2) and intersecting supports (Proposition 3).

Setting

There are two states ω∈{0,1}\omega\in\{0,1\}ω∈{0,1} with prior p0=P(ω=0)∈[0,1]p_0=\mathbb P(\omega=0)\in[0,1]p0​=P(ω=0)∈[0,1]. In state iii the retailer's demand is Di∼U[ai,bi]D_i\sim U[a_i,b_i]Di​∼U[ai​,bi​] with ai<bia_i<b_iai​<bi​ and ai≥0a_i\ge0ai​≥0. Here the supports are disjoint, b1<a0b_1<a_0b1​<a0​, so state 000 is the high-demand state.

A disclosure policy Γ=(π,M)\Gamma=(\pi,\mathcal M)Γ=(π,M) is a finite message space M\mathcal MM and, for each state ω\omegaω, a probability distribution π(⋅∣ω)\pi(\cdot\mid\omega)π(⋅∣ω) on M\mathcal MM. The retailer commits to Γ\GammaΓ, observes ω\omegaω, and sends a message m∼π(⋅∣ω)m\sim\pi(\cdot\mid\omega)m∼π(⋅∣ω). Message mmm has probability P(m)=p0π(m∣0)+(1−p0)π(m∣1)\mathbb P(m)=p_0\pi(m\mid0)+(1-p_0)\pi(m\mid1)P(m)=p0​π(m∣0)+(1−p0​)π(m∣1), and the supplier's posterior is given by Bayes' rule (1):

pm=p0 π(m∣0)P(m).p_m=\frac{p_0\,\pi(m\mid0)}{\mathbb P(m)}.pm​=P(m)p0​π(m∣0)​.

The supplier has unit shortage cost Cs>0C_s>0Cs​>0 and unit excess cost Ce>0C_e>0Ce​>0, with critical ratio ξ=Cs/(Cs+Ce)∈(0,1)\xi=C_s/(C_s+C_e)\in(0,1)ξ=Cs​/(Cs​+Ce​)∈(0,1). At belief ppp he solves the newsvendor problem (2), here normalized by Cs+CeC_s+C_eCs​+Ce​:

min⁡Q≥0 p E[ξ(D0−Q)++(1−ξ)(Q−D0)+]+(1−p) E[ξ(D1−Q)++(1−ξ)(Q−D1)+].\min_{Q\ge0}\ p\,\mathbb E\big[\xi(D_0-Q)^++(1-\xi)(Q-D_0)^+\big]+(1-p)\,\mathbb E\big[\xi(D_1-Q)^++(1-\xi)(Q-D_1)^+\big].Q≥0min​ pE[ξ(D0​−Q)++(1−ξ)(Q−D0​)+]+(1−p)E[ξ(D1​−Q)++(1−ξ)(Q−D1​)+].

A best-response profile Q∗Q^*Q∗ assigns to every belief p∈[0,1]p\in[0,1]p∈[0,1] an optimal quantity Qp∗Q^*_pQp∗​; the set of them is B(Γ)\mathcal B(\Gamma)B(Γ).

The retailer's cost at belief ppp and quantity QQQ is her expected shortage R(p,Q)=p E[(D0−Q)+]+(1−p) E[(D1−Q)+]R(p,Q)=p\,\mathbb E[(D_0-Q)^+]+(1-p)\,\mathbb E[(D_1-Q)^+]R(p,Q)=pE[(D0​−Q)+]+(1−p)E[(D1​−Q)+]. Her design problem (3) is

min⁡Γ, Q∗∈B(Γ) ∑m∈MP(m) R(pm,Qpm∗).\min_{\Gamma,\ Q^*\in\mathcal B(\Gamma)}\ \sum_{m\in\mathcal M}\mathbb P(m)\,R\big(p_m,Q^*_{p_m}\big).Γ, Q∗∈B(Γ)min​ m∈M∑​P(m)R(pm​,Qpm​∗​).

A policy is optimal if, paired with some best-response profile, it attains this minimum against every finite-message policy and every best-response profile. Full disclosure sends mim_imi​ exactly in state iii; no disclosure sends one message. The retailer's cost function (B.1) is KDS(p)=R(p,Qˉp)K_{DS}(p)=R(p,\bar Q_p)KDS​(p)=R(p,Qˉ​p​), where Qˉp\bar Q_pQˉ​p​ is the largest optimal quantity at ppp, and κDS\kappa_{DS}κDS​ is its lower convex envelope on [0,1][0,1][0,1], the greatest convex function on [0,1][0,1][0,1] below KDSK_{DS}KDS​.

Formalization targets

Goal: Theorem 3 (p. 16)

Let p~=max⁡(1−ξ, 2(b0−a0)/(b1−a1))\tilde p=\max\big(1-\xi,\ 2(b_0-a_0)/(b_1-a_1)\big)p~​=max(1−ξ, 2(b0​−a0​)/(b1​−a1​)). For every p0∈[0,1]p_0\in[0,1]p0​∈[0,1]:

2(b0−a0)≥b1−a1 ⟹ full disclosure is optimal;2(b_0-a_0)\ge b_1-a_1\ \Longrightarrow\ \text{full disclosure is optimal;}2(b0​−a0​)≥b1​−a1​ ⟹ full disclosure is optimal; b1−a1>2(b0−a0) ⟹ {no disclosure is optimal,p0≥p~,ΓDS∗ is optimal,p0<p~,b_1-a_1>2(b_0-a_0)\ \Longrightarrow\ \begin{cases}\text{no disclosure is optimal}, & p_0\ge\tilde p,\\ \Gamma^*_{DS}\text{ is optimal}, & p_0<\tilde p,\end{cases}b1​−a1​>2(b0​−a0​) ⟹ {no disclosure is optimal,ΓDS∗​ is optimal,​p0​≥p~​,p0​<p~​,​

where ΓDS∗\Gamma^*_{DS}ΓDS∗​ has messages m0,m1m_0,m_1m0​,m1​ with πDS∗(m0∣ω=0)=1\pi^*_{DS}(m_0\mid\omega=0)=1πDS∗​(m0​∣ω=0)=1 and πDS∗(m0∣ω=1)=1−p~p~p01−p0\pi^*_{DS}(m_0\mid\omega=1)=\frac{1-\tilde p}{\tilde p}\frac{p_0}{1-p_0}πDS∗​(m0​∣ω=1)=p~​1−p~​​1−p0​p0​​ (8). The paper writes "there exists p~\tilde pp~​" and then gives its value; the goal states the value.

Milestones (App. C.2 and App. B)

  1. Proposition 6 (p. 37): the supplier's optimal quantity, Qp∗=ξ(b1−a1)/(1−p)+a1Q^*_p=\xi(b_1-a_1)/(1-p)+a_1Qp∗​=ξ(b1​−a1​)/(1−p)+a1​ for p<1−ξp<1-\xip<1−ξ and (ξ−1+p)(b0−a0)/p+a0(\xi-1+p)(b_0-a_0)/p+a_0(ξ−1+p)(b0​−a0​)/p+a0​ for p>1−ξp>1-\xip>1−ξ; at p=1−ξp=1-\xip=1−ξ every Q∈[b1,a0]Q\in[b_1,a_0]Q∈[b1​,a0​] is optimal.
  2. The value claim after (B.2) (p. 25): the optimal value of (3) is κDS(p0)\kappa_{DS}(p_0)κDS​(p0​).
  3. (C.9) (p. 38): KDSK_{DS}KDS​ in closed form.
  4. (C.13) (p. 39): lim⁡x→(1−ξ)−KDS(x)−KDS(1−ξ)=(1−ξ)(a0−b1)>0\lim_{x\to(1-\xi)^-}K_{DS}(x)-K_{DS}(1-\xi)=(1-\xi)(a_0-b_1)>0limx→(1−ξ)−​KDS​(x)−KDS​(1−ξ)=(1−ξ)(a0​−b1​)>0.
  5. Lemma 3 (p. 38): κDS\kappa_{DS}κDS​ is the chord pKDS(1)+(1−p)KDS(0)pK_{DS}(1)+(1-p)K_{DS}(0)pKDS​(1)+(1−p)KDS​(0) when 2(b0−a0)/(b1−a1)≥12(b_0-a_0)/(b_1-a_1)\ge12(b0​−a0​)/(b1​−a1​)≥1, and otherwise the chord from (0,KDS(0))(0,K_{DS}(0))(0,KDS​(0)) to (p~,KDS(p~))(\tilde p,K_{DS}(\tilde p))(p~​,KDS​(p~​)) followed by KDSK_{DS}KDS​ itself on [p~,1][\tilde p,1][p~​,1].

Significance

The result shows that the shape of the optimal disclosure policy is decided by the relative width of the two supports and, below a threshold, by the prior alone: when the high-demand support is at least half as wide as the low-demand one, the retailer reveals everything, whatever the supplier's cost structure. Otherwise the critical ratio enters only through p~\tilde pp~​, and the optimal partial policy pools the high state with part of the low state so that the supplier's posterior lands exactly at p~\tilde pp~​. Together with the nested and intersecting cases, it shows that the non-monotone dependence of informativeness on ξ\xiξ found under nested supports is not universal.

The paper proves the result in its Online Appendix (App. C.2, pp. 37–40), by citation of Kamenica–Gentzkow for the reduction to a convex envelope and by a case analysis for the envelope. To our knowledge none of it is machine-checked. This mission produces a formal model of persuasion with a newsvendor receiver, a formal proof of the concavification step for finite message spaces, and the envelope computation. Formalization also pins down a boundary case the printed proof leaves implicit (see Formalization scope).

Difficulty

The reduction to the envelope is cited from Kamenica and Gentzkow in the paper, so it has to be established from scratch for this model, with its joint choice of policy and best response and its finite message spaces. The envelope itself requires handling a function that is concave on [0,1−ξ)[0,1-\xi)[0,1−ξ), convex on (1−ξ,1](1-\xi,1](1−ξ,1] and discontinuous at 1−ξ1-\xi1−ξ, where it jumps down. The obvious argument — treat KDSK_{DS}KDS​ as continuous and compare one-sided derivatives — fails at that point, and the jump is what makes the chord to p~=1−ξ\tilde p=1-\xip~​=1−ξ admissible.

The newsvendor step is not just the critical-fractile formula: at p=1−ξp=1-\xip=1−ξ the mixture c.d.f. is flat at level ξ\xiξ on [b1,a0][b_1,a_0][b1​,a0​], so the supplier's best response is not unique there.

Formalization scope

The Lean development lives in the namespace SCInfoDesign.Disjoint. Conventions:

  • States are Fin 2, beliefs are P(ω=0)\mathbb P(\omega=0)P(ω=0), and uniform expectations are interval integrals divided by the interval length.
  • The supplier's cost (2) is divided by Cs+CeC_s+C_eCs​+Ce​, so ξ∈(0,1)\xi\in(0,1)ξ∈(0,1) is the parameter; this does not change his optimal quantities.
  • Message spaces are finite types; optimality is over all finite policies and all best-response profiles. The paper does not bound M\mathcal MM; binary messages already attain the optimum.
  • No disclosure is the one-message policy; every uninformative policy has the same cost.
  • A message of probability 000 gets posterior 000 and weight 000 in (3).
  • Standing hypotheses, implicit in the paper and stated in every item: a0<b0a_0<b_0a0​<b0​, a1<b1a_1<b_1a1​<b1​, 0≤a00\le a_00≤a0​, 0≤a10\le a_10≤a1​, 0<ξ<10<\xi<10<ξ<1, b1<a0b_1<a_0b1​<a0​, p0∈[0,1]p_0\in[0,1]p0​∈[0,1].
  • The boundary p=1−ξp=1-\xip=1−ξ. Proposition 6 and (C.9) print the quantity b1b_1b1​ there. The paper's own design problem (3) and its footnote 9 let the retailer select the supplier's best response, and she prefers the largest one, a0a_0a0​. KDSK_{DS}KDS​ is defined with the largest optimal quantity; with b1b_1b1​, (C.13) and Lemma 3 are false whenever p~=1−ξ\tilde p=1-\xip~​=1−ξ. Proposition 6 is therefore stated with the optimal set [b1,a0][b_1,a_0][b1​,a0​] at the boundary.

The formalization is not trivial by construction: the supplier's response is an argmin of (2), not the closed form of Proposition 6, and optimality quantifies over every finite policy with every best response, not over the three named policies.

Infrastructure needed: interval integrals of piecewise-linear functions, the convex envelope (the published BiconvexProg.BranchBound.convexEnvelope), and a Jensen/splitting argument for Bayes-plausible posteriors. The concavification step and the newsvendor argmin for uniform mixtures are reusable beyond this mission, by the three sibling missions in particular. Proofs of any milestone are welcome.

Selected references

  • O. Candogan, H. Gurkan, The Value of Information Design in Supply Chain Management, Management Science, 2024. https://doi.org/10.1287/mnsc.2023.03004 (preprint: https://ssrn.com/abstract=4378997)
  • E. Kamenica, M. Gentzkow, Bayesian Persuasion, American Economic Review 101(6), 2011. https://doi.org/10.1257/aer.101.6.2590
  • R. Levi, G. Perakis, J. Uichanco, The data-driven newsvendor problem: new bounds and insights, Operations Research 63(6), 2015. https://doi.org/10.1287/opre.2015.1422
  • S. Boyd, L. Vandenberghe, Convex Optimization, Cambridge University Press, 2004. https://doi.org/10.1017/CBO9780511804441
9 thms1 active userReviewed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Revenue Sharing at Music Streaming Platforms I: Homogeneity and Additivity Characterize Weighted Indices; Adding Equal Individual or Global Impact of Users Gives Pro-Rata or User-CentricResearch Paper

Motivation

Music streaming platforms collect a subscription fee from each user and pay part of the revenue to the artists whose content was played. The industry standard is the pro-rata method: the revenue pool is divided in proportion to each artist's total number of streams across all users. A competing method, the user-centric method, divides each user's own payment among the artists that user played, in proportion to that user's streams. SoundCloud adopted it in 2021 and Deezer has campaigned for it; the debate between the two methods is documented in the literature the paper cites, among others Dimont (2017), Haampland et al. (2022), Page and Safir (2018) and Meyn et al. (2023), listed below.

Bergantiños and Moreno-Ternero (arXiv:2310.11861, published in Management Science, 2025) put the debate on an axiomatic footing. Their Theorem 1 identifies the two basic principles every reasonable method in a large family satisfies, and isolates pro-rata and user-centric inside that family by one further principle each. This mission formalizes that theorem and the steps of its proof.

Setting

There are nnn artists NNN and a finite set MMM of users, m=∣M∣m=|M|m=∣M∣. A streaming problem (N,M,t)(N,M,t)(N,M,t) records, for every artist iii and user jjj, the number tij∈Nt_{ij}\in\mathbb Ntij​∈N of times jjj streamed content of iii. Each user pays 111, so the amount to share is mmm. Write

  • Ti=∑j∈MtijT_i=\sum_{j\in M}t_{ij}Ti​=∑j∈M​tij​, the streams of artist iii;
  • Tj=∑i∈NtijT^j=\sum_{i\in N}t_{ij}Tj=∑i∈N​tij​, the streams of user jjj;
  • Lj={i∈N:tij>0}L^j=\{i\in N : t_{ij}>0\}Lj={i∈N:tij​>0}, the artists user jjj played, assumed nonempty for every user;
  • t⋅j=(tij)i∈Nt_{\cdot j}=(t_{ij})_{i\in N}t⋅j​=(tij​)i∈N​, the profile of user jjj, and t−jt_{-j}t−j​ the table without user jjj.

A popularity index III assigns to every problem a vector I(N,M,t)∈R≥0NI(N,M,t)\in\mathbb R^N_{\ge 0}I(N,M,t)∈R≥0N​ with positive sum, and artist iii is paid the reward

RiI(N,M,t)=Ii(N,M,t)∑i′∈NIi′(N,M,t) m.R^I_i(N,M,t)=\frac{I_i(N,M,t)}{\sum_{i'\in N}I_{i'}(N,M,t)}\,m .RiI​(N,M,t)=∑i′∈N​Ii′​(N,M,t)Ii​(N,M,t)​m.

Since RcI=RIR^{cI}=R^IRcI=RI for every c>0c>0c>0, an index is identified with its positive multiples. The pro-rata index is Pi=TiP_i=T_iPi​=Ti​ and the user-centric index is Ui=∑j∈Mtij/TjU_i=\sum_{j\in M}t_{ij}/T^jUi​=∑j∈M​tij​/Tj. A weight system assigns a weight ω(j,x)>0\omega(j,x)>0ω(j,x)>0 to every user jjj and every profile x∈NNx\in\mathbb N^Nx∈NN; its weighted index is Iiω=∑j∈Mω(j,t⋅j) tijI^\omega_i=\sum_{j\in M}\omega(j,t_{\cdot j})\,t_{ij}Iiω​=∑j∈M​ω(j,t⋅j​)tij​. Pro-rata is ω≡1\omega\equiv 1ω≡1 and user-centric is ω(j,x)=1/∑ixi\omega(j,x)=1/\sum_i x_iω(j,x)=1/∑i​xi​.

The axioms are:

  • Homogeneity: if tij=λti′jt_{ij}=\lambda t_{i'j}tij​=λti′j​ for all j∈Mj\in Mj∈M, with λ≥0\lambda\ge 0λ≥0, then Ii=λIi′I_i=\lambda I_{i'}Ii​=λIi′​.
  • Additivity: if MMM splits into disjoint M1,M2M^1,M^2M1,M2, then I(N,M,t)=I(N,M1,t1)+I(N,M2,t2)I(N,M,t)=I(N,M^1,t^1)+I(N,M^2,t^2)I(N,M,t)=I(N,M1,t1)+I(N,M2,t2).
  • Equal individual impact of similar users: if tij=tij′t_{ij}=t_{ij'}tij​=tij′​, then Ii(N,M∖{j},t−j)=Ii(N,M∖{j′},t−j′)I_i(N,M\setminus\{j\},t_{-j})=I_i(N,M\setminus\{j'\},t_{-j'})Ii​(N,M∖{j},t−j​)=Ii​(N,M∖{j′},t−j′​).
  • Equal global impact of users: ∑iIi(N,M∖{j},t−j)=∑iIi(N,M∖{j′},t−j′)\sum_i I_i(N,M\setminus\{j\},t_{-j})=\sum_i I_i(N,M\setminus\{j'\},t_{-j'})∑i​Ii​(N,M∖{j},t−j​)=∑i​Ii​(N,M∖{j′},t−j′​) for all j,j′∈Mj,j'\in Mj,j′∈M.

Two further axioms of §3 compare the methods: reasonable lower bound (the artists played by a group CCC of users receive at least ∣C∣|C|∣C∣) and click-fraud-proofness (changing one user's streams moves no artist's reward by more than 111).

Formalization targets

Goal: Theorem 1 (p. 12)

For every popularity index III:

(a)I satisfies homogeneity and additivity  ⟺  ∃ ω>0: I=Iω;\text{(a)}\quad I \text{ satisfies homogeneity and additivity} \iff \exists\,\omega>0:\ I=I^\omega ;(a)I satisfies homogeneity and additivity⟺∃ω>0: I=Iω; (b)(n≥2)homogeneity, additivity, equal individual impact  ⟺  ∃ c>0: I=c P;\text{(b)}\quad (n\ge 2)\quad \text{homogeneity, additivity, equal individual impact} \iff \exists\,c>0:\ I=c\,P ;(b)(n≥2)homogeneity, additivity, equal individual impact⟺∃c>0: I=cP; (c)homogeneity, additivity, equal global impact  ⟺  ∃ c>0: I=c U.\text{(c)}\quad \text{homogeneity, additivity, equal global impact} \iff \exists\,c>0:\ I=c\,U .(c)homogeneity, additivity, equal global impact⟺∃c>0: I=cU.

Milestones (the proof, Appendix pp. 18–20)

  1. Every weighted index satisfies homogeneity and additivity (p. 18).
  2. An additive index decomposes as Ii(N,M,t)=∑j∈MIi(N,{j},t⋅j)I_i(N,M,t)=\sum_{j\in M}I_i(N,\{j\},t_{\cdot j})Ii​(N,M,t)=∑j∈M​Ii​(N,{j},t⋅j​) (p. 18).
  3. On a one-user problem a homogeneous index is Ii(N,{j},x)=∑i′Ii′(N,{j},x)Tj xiI_i(N,\{j\},x)=\frac{\sum_{i'}I_{i'}(N,\{j\},x)}{T^j}\,x_iIi​(N,{j},x)=Tj∑i′​Ii′​(N,{j},x)​xi​ (pp. 18–19).
  4. Theorem 1(a) as a statement on its own (p. 12).
  5. Pro-rata satisfies the three axioms of (b) (p. 19).
  6. Under the axioms of (b), any representing weight ω(j,x)\omega(j,x)ω(j,x) is the same at every nonzero profile (pp. 19–20).
  7. ∑iUi(N,M∖{j},t−j)=m−1\sum_i U_i(N,M\setminus\{j\},t_{-j})=m-1∑i​Ui​(N,M∖{j},t−j​)=m−1, and user-centric satisfies the axioms of (c) (p. 20).
  8. Under equal global impact, ∑iIi(N,{j},x)\sum_i I_i(N,\{j\},x)∑i​Ii​(N,{j},x) is the same for every user and nonzero profile (p. 20).

Companions (§3, p. 13; Appendix, pp. 21–22): user-centric satisfies reasonable lower bound and click-fraud-proofness; with at least two artists, pro-rata satisfies neither.

Significance

Theorem 1 says that the choice between the two methods used in practice is a choice between two principles, and nothing else, once homogeneity and additivity are accepted: equal individual impact of similar users ("all streams count the same") gives pro-rata, and equal global impact of users ("all users count the same") gives user-centric. Part (a) describes the whole family of methods that respect the two basic axioms, which includes capped and hybrid schemes proposed in the industry (p. 10). The companion results show that the further axioms of §3 separate the two methods in favour of user-centric. The paper's further results, the core of the associated cooperative game (Theorem 2) and the core-selection characterization (Theorem 3), are separate missions of this series.

The result is proved in the paper; its proofs are in the appendix (pp. 18–22). No machine-checked version is known. A formalization fixes the model precisely, including the conventions the paper leaves implicit (the disjointness in additivity, nonempty user lists, the identification of indices up to a positive factor), and records exactly where two artists are needed.

Difficulty

The "if" directions are direct computations. The "only if" directions are a functional equation on indices: additivity reduces an index to its values on one-user problems, and homogeneity forces those values to be proportional to the profile, so the remaining freedom is one weight per user and profile. The work in (b) and (c) is to show that this weight is constant, using the extra axiom only on small auxiliary problems that contain users outside the given problem. The constant must be one number for all problems: a constant depending on the problem would make (b) and (c) much weaker, and is not what the paper proves.

Formalization scope

Artists are Fin n, indexed from 000. Users are natural numbers, an infinite universe, and a problem is a finitely supported table ℕ →₀ (Fin n → ℕ) whose support is the user set MMM; every user of a problem therefore has a nonzero profile, which is the paper's standing assumption Lj≠∅L^j\neq\varnothingLj=∅, and an index can only read the columns of users in MMM. Streams are natural numbers. An index is a function from problems to Fin n → ℝ; it is a popularity index when it is nonnegative with positive sum on every problem with at least one user. The empty problem has nothing to share, and no positivity is demanded there; additivity forces the index to vanish on it. Additivity is stated for disjoint user sets: the printed axiom only says M=M1∪M2M=M^1\cup M^2M=M1∪M2, which with M1=M2=MM^1=M^2=MM1=M2=M would force I=2II=2II=2I and leave no index at all. "Is the pro-rata (user-centric) index" means "is a positive multiple of it, with one constant for all problems". Part (b) assumes at least two artists: with one artist the user-centric index satisfies its axioms and is not a multiple of pro-rata (every index then pays the whole mmm to the single artist, so (b) holds at the level of rewards). Weights at the zero profile never enter a weighted index and are only required to be positive.

A formalization in which the positivity requirement applies to the empty problem, additivity allows overlapping user sets, or the constant in (b) or (c) depends on the problem is trivial or empty and is ruled out.

All objects are defined in one module, MusicStreaming.Axioms.Setting, on top of Mathlib's Finsupp and finite sums; nothing else is needed. Proofs of the milestones, alternative proofs of Theorem 1, and the verification that the definitions compute the paper's Example 1 are welcome.

Selected references

  • G. Bergantiños and J. D. Moreno-Ternero, Revenue sharing at music streaming platforms, Management Science, 2025; preprint arXiv:2310.11861v1, 2023. https://arxiv.org/abs/2310.11861 (the source of every statement in this mission; Theorem 1 on p. 12, proofs on pp. 18–22).
  • J. Meyn, M. Kandziora, S. Albers, M. Clement, Consequences of platforms' remuneration models for digital content: initial evidence and a research agenda for streaming services, Journal of the Academy of Marketing Science 51, 114–131, 2023 (reference [39] of the paper).
  • J. Dimont, Royalty inequity: Why music streaming services should switch to a per-subscriber model, Hastings Law Journal 69, 675, 2017 (reference [22] of the paper).
  • W. Page and D. Safir, Money in, money out: Lessons from CMOs in allocating and distributing licensing revenue, technical report, 2018 (reference [45] of the paper).
  • O. Haampland, R. Johannessen, F. Moreau, P. Wikström, Fairness and royalty payment systems on music streaming platforms, mimeo, 2022 (reference [29] of the paper).
12 thms1 active userReviewed
Machine LearningStatistics·Captain: mikedeng1

Multitask Learning and Bandits via Robust Statistics: High-Probability ℓ1 Error Bound for the Robust Multitask (Trimmed Mean + LASSO) Estimator under Sparse HeterogeneityResearch Paper

Learning many related regressions at once

Service providers such as hospitals or retail stores each fit a predictive model on their own data, and many of them have few observations. The models of different providers are usually similar but not identical: most coefficients agree, while each provider deviates from the common model in a few features of its own. Multitask learning asks how data from all providers can be pooled to estimate every provider's model better than it could estimate alone, without being misled by the providers that differ.

Xu and Bastani (arXiv:2112.14233v5) model this with sparse heterogeneity: every task parameter is a shared vector plus a sparse deviation. They propose the robust multitask estimator (RMEstimator), which combines per-task least-squares estimates by a coordinatewise trimmed mean and then corrects each task by a LASSO regression centred at that shared estimate. Their main fixed-design guarantee, Proposition 5, is a high-probability bound on the ℓ1\ell_1ℓ1​ estimation error of each task. The same estimator drives the paper's multitask contextual bandit algorithm (§5), whose regret analysis rests on this bound. The approach builds on transfer learning with a single proxy model (Bastani 2021) and on the robustness of the trimmed mean to corrupted samples (Lugosi and Mendelson 2021).

The model and the estimator

There are NNN tasks. Task j∈[N]j\in[N]j∈[N] has nj≥1n_j\ge1nj​≥1 observations, a fixed design matrix Xj∈Rnj×dX^j\in\mathbb R^{n_j\times d}Xj∈Rnj​×d whose columns satisfy the normalization 1nj∥X(⋅,i)j∥22=1\frac1{n_j}\|X^j_{(\cdot,i)}\|_2^2=1nj​1​∥X(⋅,i)j​∥22​=1 (equation (1)), and responses

Yj=Xjβj+ϵj,βj=β†+δj,∥δj∥0≤s.Y^j=X^j\beta^j+\epsilon^j,\qquad \beta^j=\beta^\dagger+\delta^j,\qquad \|\delta^j\|_0\le s .Yj=Xjβj+ϵj,βj=β†+δj,∥δj∥0​≤s.

The noise terms ϵkj\epsilon^j_kϵkj​ are mutually independent across all tasks and observations, and each is σj\sigma_jσj​-subgaussian with mean zero: E[eλϵkj]≤eσj2λ2/2\mathbb E[e^{\lambda\epsilon^j_k}]\le e^{\sigma_j^2\lambda^2/2}E[eλϵkj​]≤eσj2​λ2/2 for all λ∈R\lambda\in\mathbb Rλ∈R. Assumption 1 asks that the sample covariance matrices Σ^j=Xj⊤Xj/nj\widehat\Sigma^j=X^{j\top}X^j/n_jΣj=Xj⊤Xj/nj​ satisfy λmin⁡(Σ^j)≥ψ>0\lambda_{\min}(\widehat\Sigma^j)\ge\psi>0λmin​(Σj)≥ψ>0.

Given a trimming level ω\omegaω and regularization levels λj\lambda_jλj​, Algorithm 1 computes:

  1. the OLS estimates β^indj=(Xj⊤Xj)−1Xj⊤Yj\widehat\beta^j_{\mathrm{ind}}=(X^{j\top}X^j)^{-1}X^{j\top}Y^jβ​indj​=(Xj⊤Xj)−1Xj⊤Yj;
  2. the shared estimate β^RM,(i)†=TrimmedMean({β^ind,(i)j}j∈[N],ω)\widehat\beta^\dagger_{\mathrm{RM},(i)}=\mathrm{TrimmedMean}(\{\widehat\beta^j_{\mathrm{ind},(i)}\}_{j\in[N]},\omega)β​RM,(i)†​=TrimmedMean({β​ind,(i)j​}j∈[N]​,ω) for each coordinate iii, where the trimmed mean sorts the NNN values, discards the NωN\omegaNω smallest and the NωN\omegaNω largest, and averages the rest;
  3. for each task, β^RMj∈arg⁡min⁡β{1nj∥Xjβ−Yj∥22+λj∥β−β^RM†∥1}\widehat\beta^j_{\mathrm{RM}}\in\arg\min_\beta\big\{\frac1{n_j}\|X^j\beta-Y^j\|_2^2+\lambda_j\|\beta-\widehat\beta^\dagger_{\mathrm{RM}}\|_1\big\}β​RMj​∈argminβ​{nj​1​∥Xjβ−Yj∥22​+λj​∥β−β​RM†​∥1​}.

A coordinate iii is ζ\zetaζ-poorly-aligned, i∈Ipoorζi\in\mathcal I^\zeta_{\mathrm{poor}}i∈Ipoorζ​, if fewer than a fraction ζ\zetaζ of the tasks satisfy β(i)j≠β(i)†\beta^j_{(i)}\neq\beta^\dagger_{(i)}β(i)j​=β(i)†​; otherwise it is ζ\zetaζ-well-aligned (Definition 2).

Formalization targets

Goal: Proposition 5

For every constant C0>2C_0>2C0​>2, every 0<ζ<1/20<\zeta<1/20<ζ<1/2, every 0<η≤1/2−1/C0−ζ0<\eta\le 1/2-1/C_0-\zeta0<η≤1/2−1/C0​−ζ, every task jjj and every λj>0\lambda_j>0λj​>0, every output of Algorithm 1 with ω=ζ+η\omega=\zeta+\etaω=ζ+η satisfies

∥β^RMj−βj∥1≤6λjsζψ+4C0 d (3ζ+4η)max⁡i∈[N]σi2niψlog⁡3η\|\widehat\beta^j_{\mathrm{RM}}-\beta^j\|_1\le\frac{6\lambda_js}{\zeta\psi}+4C_0\,d\,(3\zeta+4\eta)\max_{i\in[N]}\sqrt{\frac{\sigma_i^2}{n_i\psi}\log\frac3\eta}∥β​RMj​−βj∥1​≤ζψ6λj​s​+4C0​d(3ζ+4η)i∈[N]max​ni​ψσi2​​logη3​​

with probability at least 1−(3d e−Nη2/9+2d e−λj2nj/(32σj2))1-\big(3d\,e^{-N\eta^2/9}+2d\,e^{-\lambda_j^2n_j/(32\sigma_j^2)}\big)1−(3de−Nη2/9+2de−λj2​nj​/(32σj2​)).

The printed Proposition 5 (p. 17) has C0C_0C0​ where this statement has 4C04C_04C0​. The proof on pp. 41–43 ends with ∥β^RMj−βj∥1≤6sλj/(ζψ)+4∥(β^RM†−β†)Ipoor∥1\|\widehat\beta^j_{\mathrm{RM}}-\beta^j\|_1\le 6s\lambda_j/(\zeta\psi)+4\|(\widehat\beta^\dagger_{\mathrm{RM}}-\beta^\dagger)_{\mathcal I_{\mathrm{poor}}}\|_1∥β​RMj​−βj∥1​≤6sλj​/(ζψ)+4∥(β​RM†​−β†)Ipoor​​∥1​ and combines it with (16), whose coefficient is C0C_0C0​, so it establishes the bound with 4C04C_04C0​. The goal is the bound the proof supports.

Milestones, in proof order

  1. (6): ∣Iwellζ∣≤s/ζ|\mathcal I^\zeta_{\mathrm{well}}|\le s/\zeta∣Iwellζ​∣≤s/ζ.
  2. Proposition 4: the trimmed mean of NNN samples, fewer than ζN\zeta NζN of them arbitrarily corrupted and the rest independent and subgaussian, has P[∣μ^−μ∣≥C0max⁡j∈Jcσj(3ζ+4η)log⁡(3/η)]≤3e−Nη2/9\mathbb P[|\widehat\mu-\mu|\ge C_0\max_{j\in\mathcal J^c}\sigma_j(3\zeta+4\eta)\sqrt{\log(3/\eta)}]\le 3e^{-N\eta^2/9}P[∣μ​−μ∣≥C0​maxj∈Jc​σj​(3ζ+4η)log(3/η)​]≤3e−Nη2/9.
  3. Lemma 1: P[2nj∥Xj⊤ϵj∥∞≤λj/2]≥1−2d e−λj2nj/(32σj2)\mathbb P[\tfrac2{n_j}\|X^{j\top}\epsilon^j\|_\infty\le\lambda_j/2]\ge1-2d\,e^{-\lambda_j^2n_j/(32\sigma_j^2)}P[nj​2​∥Xj⊤ϵj∥∞​≤λj​/2]≥1−2de−λj2​nj​/(32σj2​).
  4. OLS subgaussianity (p. 41): each β^ind,(i)j\widehat\beta^j_{\mathrm{ind},(i)}β​ind,(i)j​ is σj2/(njψ)\sqrt{\sigma_j^2/(n_j\psi)}σj2​/(nj​ψ)​-subgaussian with mean β(i)j\beta^j_{(i)}β(i)j​.
  5. (16): the shared estimate is accurate on Ipoor\mathcal I_{\mathrm{poor}}Ipoor​ with probability 1−3d e−Nη2/91-3d\,e^{-N\eta^2/9}1−3de−Nη2/9.
  6. (19): the LASSO cone inequality on the event of Lemma 1.
  7. Final display of p. 43: ∥β^RMj−βj∥1≤6sλj/(ζψ)+4∥(β^RM†−β†)Ipoor∥1\|\widehat\beta^j_{\mathrm{RM}}-\beta^j\|_1\le 6s\lambda_j/(\zeta\psi)+4\|(\widehat\beta^\dagger_{\mathrm{RM}}-\beta^\dagger)_{\mathcal I_{\mathrm{poor}}}\|_1∥β​RMj​−βj∥1​≤6sλj​/(ζψ)+4∥(β​RM†​−β†)Ipoor​​∥1​ on that event.

Significance

Proposition 5 separates two error sources: a LASSO term of order sλjs\lambda_jsλj​, which depends only on the task's own sample size, and a trimmed-mean term that shrinks with the number of tasks through max⁡iσi2/ni\max_i\sqrt{\sigma_i^2/n_i}maxi​σi2​/ni​​. With the hyperparameters of Appendix A.2 it yields Theorem 1, an error of order sd/nj+d/Nnj\sqrt{sd/n_j}+d/\sqrt{Nn_j}sd/nj​​+d/Nnj​​ up to logarithmic factors, against d/njd/\sqrt{n_j}d/nj​​ for a single task alone. The same decomposition underlies the paper's data-poor guarantee (Proposition 8) and the regret bounds of its multitask bandit algorithm.

The result is proved on paper; none of it has been machine-checked. A formal development checks the constant bookkeeping, including the factor 4 that the printed statement omits, and the use of the trimmed mean for samples that are independent but not identically distributed, which is where this paper departs from the classical i.i.d. robust-statistics results. Proposition 4 and Lemma 1 are reusable on their own: a corruption-robust concentration bound for the trimmed mean and a noise bound for fixed-design LASSO.

Difficulty

The obvious estimator of the shared parameter, the average of the per-task estimates, converges to the average of the βj\beta^jβj, which differs from β†\beta^\daggerβ† in up to min⁡{Ns,d}\min\{Ns,d\}min{Ns,d} coordinates, so the LASSO correction would have to undo a dense bias. The trimmed mean avoids this only on poorly-aligned coordinates, and only with high probability. The proof of Proposition 4 must control the samples that survive trimming even though they are not identically distributed and trimming biases the conditional means; that step needs a moment bound for subgaussian variables and a Hoeffding argument on a random index set. The LASSO step needs the cone inequality with a support Iˉj=Iwell∪Ij\bar{\mathcal I}_j=\mathcal I_{\mathrm{well}}\cup\mathcal I_jIˉj​=Iwell​∪Ij​ that is not the support of βj−β†\beta^j-\beta^\daggerβj−β†, and the counting bound (6) to control its size.

Formalization scope

  • Tasks, coordinates and observations are Fin N, Fin d, Fin (n j); paper index iii is Lean i − 1. Designs are deterministic matrices; only the noise is random.
  • Definition 1 with mean zero is Mathlib's HasSubgaussianMGF with variance proxy σj2\sigma_j^2σj2​, σj>0\sigma_j>0σj​>0. Independence of all noise terms is iIndepFun over the pairs (j,k)(j,k)(j,k).
  • Sparsity is ∥βj−β†∥0≤s\|\beta^j-\beta^\dagger\|_0\le s∥βj−β†∥0​≤s with δj=βj−β†\delta^j=\beta^j-\beta^\daggerδj=βj−β†. The model requires nj≥1n_j\ge1nj​≥1.
  • λmin⁡(Σ^j)≥ψ\lambda_{\min}(\widehat\Sigma^j)\ge\psiλmin​(Σj)≥ψ is written v⊤Σ^jv≥ψ∥v∥22v^\top\widehat\Sigma^jv\ge\psi\|v\|_2^2v⊤Σjv≥ψ∥v∥22​ for all vvv.
  • ∥⋅∥1\|\cdot\|_1∥⋅∥1​, ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​, ∥⋅∥0\|\cdot\|_0∥⋅∥0​ and βI\beta_IβI​ are explicit finite sums, suprema, counts and restrictions. log⁡\loglog is the natural logarithm.
  • The trimmed mean removes ⌊Nω⌋\lfloor N\omega\rfloor⌊Nω⌋ values from each end and divides by the number kept; this is the paper's formula whenever Nω∈NN\omega\in\mathbb NNω∈N.
  • The LASSO step is the predicate "is a global minimizer", never a choice function, and λj\lambda_jλj​ is the parameter (the initialization λj=λ/nj\lambda_j=\lambda/\sqrt{n_j}λj​=λ/nj​​ is not imposed). The OLS inverse is Lean's matrix inverse, which Assumption 1 makes a genuine inverse.
  • "With probability at least 1−p1-p1−p" is: the outer probability of the failure event is at most ppp. The constant C0>2C_0>2C0​>2 is universally quantified, and the trimming level is ω=ζ+η\omega=\zeta+\etaω=ζ+η wherever the paper fixes it.
  • The deterministic milestones (19) and the final display of p. 43 are stated for an arbitrary centre bbb in place of β^RM†\widehat\beta^\dagger_{\mathrm{RM}}β​RM†​; their proofs use no property of it.

A formalization that drops Assumption 1 (making the OLS inverse a junk zero), lets the corrupted samples of Proposition 4 be independent or well-behaved, fixes a single C0C_0C0​ existentially, or reads a junk minimizer from Classical.choose, does not state the paper's result.

The development needs least-squares algebra for fixed designs, a Hoeffding bound for independent bounded variables, moment bounds for subgaussian variables, and the LASSO basic inequality. Proofs of any milestone are welcome, and so are alternative arguments for Proposition 4 with better constants.

Selected references

  • K. Xu and H. Bastani, Multitask Learning and Bandits via Robust Statistics, arXiv preprint, v5, 2024. https://arxiv.org/abs/2112.14233
  • G. Lugosi and S. Mendelson, Robust multivariate mean estimation: the optimality of trimmed mean, Annals of Statistics, 2021. https://arxiv.org/abs/1907.11391
  • H. Bastani, Predicting with Proxies: Transfer Learning in High Dimension, Management Science, 2021. https://arxiv.org/abs/1812.11097
  • P. Bühlmann and S. van de Geer, Statistics for High-Dimensional Data, Springer, 2011. https://doi.org/10.1007/978-3-642-20192-9
  • R. Tibshirani, Regression Shrinkage and Selection via the Lasso, Journal of the Royal Statistical Society B, 1996. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
13 thms1 active userReviewed
Bandit AlgorithmsMachine LearningStatistics·Captain: mikedeng1

Online Learning and Decision-Making under Generalized Linear Model with High-Dimensional Data: The G-MCP-Bandit Algorithm Has Expected Cumulative Regret at Most Rmax(T0 + |K|) + C log(T + 1)Research Paper

Motivation

Personalized decisions — which drug to prescribe, which product to recommend, which price to quote — are made one user at a time, from user features observed on arrival, and the effect of each decision is learned only from the users it was applied to. This is the contextual (covariate) bandit. In electronic records and online platforms the feature vector is high-dimensional, often with more coordinates than there will ever be users, while the outcome is binary or count-valued, so a linear reward model is a poor fit. Wang, Wei and Yao (arXiv:1812.02962, published in Management Science, 2025) combine three ingredients: a generalized linear model (GLM) for rewards, sparsity of the parameter vectors, and the minimax concave penalty (MCP) of Zhang (2010) for estimation.

Timeline. Goldenshluger and Zeevi (2013) obtained O(log⁡T)O(\log T)O(logT) regret for a two-armed linear bandit with low-dimensional covariates, under a margin condition, and showed it is the right order. Bastani and Bayati (2020) extended the setting to high-dimensional sparse linear rewards with the LASSO, obtaining O(s02log⁡2T)O(s_0^2\log^2 T)O(s02​log2T) regret. Wang, Wei and Yao (2018 preprint) treat GLM rewards with the MCP and claim O(∣K∣s2(s+log⁡d)log⁡T)O(|\mathcal K|s^2(s+\log d)\log T)O(∣K∣s2(s+logd)logT), recovering the log⁡T\log TlogT order in the high-dimensional setting.

Setting

At each time t=1,2,…t=1,2,\dotst=1,2,… a user with covariate vector xt∈X⊆Rdx_t\in\mathcal X\subseteq\mathbb R^dxt​∈X⊆Rd arrives; the xtx_txt​ are i.i.d. with an unknown law Px\mathcal P_xPx​. The decision-maker chooses a decision πt∈K={1,…,K}\pi_t\in\mathcal K=\{1,\dots,K\}πt​∈K={1,…,K}, K≥2K\ge2K≥2, and observes only the reward of that decision.

The reward of decision kkk at covariate xxx has law g(r∣x⊤βk) ν(dr)g(r\mid x^\top\beta_k)\,\nu(dr)g(r∣x⊤βk​)ν(dr), where ν\nuν is a known base measure on [−Rmax⁡,Rmax⁡][-R_{\max},R_{\max}][−Rmax​,Rmax​], g(⋅∣η)g(\cdot\mid\eta)g(⋅∣η) a known density, and βk∈Rd\beta_k\in\mathbb R^dβk​∈Rd an unknown sparse parameter: its support Sk\mathcal S_kSk​ has at most sss elements. Write f(r∣η)=−log⁡g(r∣η)f(r\mid\eta)=-\log g(r\mid\eta)f(r∣η)=−logg(r∣η) and μ(η)=∫r g(r∣η) dν(r)\mu(\eta)=\int r\,g(r\mid\eta)\,d\nu(r)μ(η)=∫rg(r∣η)dν(r), so the expected reward is μ(x⊤βk)\mu(x^\top\beta_k)μ(x⊤βk​). The Bernoulli–logistic model is ν=δ0+δ1\nu=\delta_0+\delta_1ν=δ0​+δ1​, μ(η)=1/(1+e−η)\mu(\eta)=1/(1+e^{-\eta})μ(η)=1/(1+e−η).

The cumulative regret compares the decisions with the oracle that knows every βk\beta_kβk​:

RC(T)=∑t=1TE[max⁡kμ(xt⊤βk)−μ(xt⊤βπt)].R^C(T)=\sum_{t=1}^T\mathbb E\Big[\max_k\mu(x_t^\top\beta_k)-\mu(x_t^\top\beta_{\pi_t})\Big].RC(T)=t=1∑T​E[kmax​μ(xt⊤​βk​)−μ(xt⊤​βπt​​)].

The G-MCP-Bandit algorithm has inputs t0,h,λ1,0,λ2,0,at_0,h,\lambda_{1,0},\lambda_{2,0},at0​,h,λ1,0​,λ2,0​,a. At time ttt, with probability min⁡{1,t0/t}\min\{1,t_0/t\}min{1,t0​/t} it explores: it plays a uniformly random decision (ε-decay random sampling). Otherwise it forms a shortlist Πt\Pi_tΠt​ of the decisions whose estimated mean reward, under the random-sample estimates βkrandom\beta^{random}_kβkrandom​ (trained on exploration data only), is within h/2h/2h/2 of the best; it then plays the decision of Πt\Pi_tΠt​ with the largest estimated mean under the whole-sample estimates βkwhole\beta^{whole}_kβkwhole​ (trained on all data of kkk). Both estimates are computed by the 2-step weighted Lasso (2sWL): an ℓ1\ell_1ℓ1​-penalized maximum likelihood fit with weights λ\lambdaλ, then a refit whose weights wj=max⁡(0,λ−∣β1,j∣/a)w_j=\max(0,\lambda-|\beta_{1,j}|/a)wj​=max(0,λ−∣β1,j​∣/a) are the MCP derivatives at the first fit, both over the ball ∥β∥1≤b\|\beta\|_1\le b∥β∥1​≤b, with the anytime schedules λ1(t)=λ1,01+log⁡d/log⁡(t+1)\lambda_1(t)=\lambda_{1,0}\sqrt{1+\log d/\log(t+1)}λ1​(t)=λ1,0​1+logd/log(t+1)​ and λ2(t)=λ2,0(log⁡(t+1)+log⁡d)/(t+1)\lambda_2(t)=\lambda_{2,0}\sqrt{(\log(t+1)+\log d)/(t+1)}λ2​(t)=λ2,0​(log(t+1)+logd)/(t+1)​.

The paper assumes A.1 (bounded covariates, rewards and parameters; βmin⁡\beta_{\min}βmin​ lower-bounds the nonzero coefficients), A.2 (margin: P(0<∣μ(x⊤βi)−μ(x⊤βj)∣≤γ)≤CRmax⁡γ\mathbb P(0<|\mu(x^\top\beta_i)-\mu(x^\top\beta_j)|\le\gamma)\le CR_{\max}\gammaP(0<∣μ(x⊤βi​)−μ(x⊤βj​)∣≤γ)≤CRmax​γ), A.3 (every decision is either hhh-suboptimal everywhere or hhh-optimal on a region UkU_kUk​ of probability at least p∗p^*p∗), A.4 (a restricted eigenvalue condition with constant κ\kappaκ for samples in UkU_kUk​) and A.5 (smoothness and convexity of fff with derivative bounds σ,σ2,σ3\sigma,\sigma_2,\sigma_3σ,σ2​,σ3​).

Formalization targets

Goal: Theorem 1 (p. 15)

For every a≥2304s/(κp∗)a\ge2304s/(\kappa p^*)a≥2304s/(κp∗) there are constants C0≥10C_0\ge10C0​≥10 and C4,C5,T0,Cβ>0C_4,C_5,T_0,C_\beta>0C4​,C5​,T0​,Cβ​>0, independent of TTT, such that with t0=2C0∣K∣t_0=2C_0|\mathcal K|t0​=2C0​∣K∣, λ1,0=C5\lambda_{1,0}=C_5λ1,0​=C5​, λ2,0=C4\lambda_{2,0}=C_4λ2,0​=C4​, for every T≥T0T\ge T_0T≥T0​,

RC(T)≤Rmax⁡(T0+∣K∣)+(6Rmax⁡∣K∣C0+41Rmax⁡∣K∣+2e4σ2xmax⁡bCRmax⁡3∣K∣xmax⁡2Cβs3)log⁡(T+1).R^C(T)\le R_{\max}(T_0+|\mathcal K|)+\Big(6R_{\max}|\mathcal K|C_0+41R_{\max}|\mathcal K|+2e^{4\sigma_2x_{\max}b}CR_{\max}^3|\mathcal K|x_{\max}^2C_\beta s^3\Big)\log(T+1).RC(T)≤Rmax​(T0​+∣K∣)+(6Rmax​∣K∣C0​+41Rmax​∣K∣+2e4σ2​xmax​bCRmax3​∣K∣xmax2​Cβ​s3)log(T+1).

The goal keeps every explicit coefficient of the page and leaves the constants the paper calls "independent of TTT" existential.

Milestones

In the order the proof of Theorem 1 (pp. ec5–ec8) uses them:

  1. Proposition 2 (p. 13): the exploration count nkn_knk​ is between C0(1+log⁡(T+1)−log⁡(t0+1))C_0(1+\log(T+1)-\log(t_0+1))C0​(1+log(T+1)−log(t0​+1)) and 3C0(1+log⁡T−log⁡t0)3C_0(1+\log T-\log t_0)3C0​(1+logT−logt0​) with probability ≥1−2/(T+1)\ge1-2/(T+1)≥1−2/(T+1).
  2. Lemma EC.8, statements 2 and 3 (p. ec16): enough exploration samples of an optimal decision fall in its region UkU_kUk​.
  3. Proposition 4 (p. 18): ∥βkrandom(T)−βk∥1≤min⁡{1/(σ2xmax⁡),h/(4eσ2Rmax⁡xmax⁡)}\|\beta^{random}_k(T)-\beta_k\|_1\le\min\{1/(\sigma_2x_{\max}),h/(4e\sigma_2R_{\max}x_{\max})\}∥βkrandom​(T)−βk​∥1​≤min{1/(σ2​xmax​),h/(4eσ2​Rmax​xmax​)} with probability ≥1−15/(T+1)\ge1-15/(T+1)≥1−15/(T+1).
  4. Lemma EC.10 (p. ec20): a Lipschitz bound for μ\muμ, and the h/2h/2h/2 separation it implies on UiU_iUi​.
  5. Proposition 6 (p. 19): ∥βkwhole(T)−βk∥2≤Cβs2/(T+1)\|\beta^{whole}_k(T)-\beta_k\|_2\le\sqrt{C_\beta s^2/(T+1)}∥βkwhole​(T)−βk​∥2​≤Cβ​s2/(T+1)​ with probability ≥1−13/(T+1)\ge1-13/(T+1)≥1−13/(T+1).

Significance

Theorem 1 says that, under the stated assumptions, learning with high-dimensional GLM rewards costs regret logarithmic in the horizon, the order known to be unavoidable already for low-dimensional linear bandits. It improves the log⁡2T\log^2Tlog2T of the LASSO bandit and shows how a non-convex penalty, computed by two convex weighted-Lasso solves, can be analysed under the non-i.i.d. sampling that a bandit induces. Propositions 4 and 6 are estimation results of independent interest: tail bounds for an MCP estimator trained on random and on adaptively collected samples.

The result is proved on paper; it is not formalized anywhere. The mission produces a machine-checked statement of the full algorithm and its regret, and the milestones isolate reusable facts: an exploration-count bound for ε-decay sampling, a Lipschitz bound for GLM means, and the estimator tail bounds. Alternative arguments and sharper constants are welcome as separate theorems.

Difficulty

The whole-sample data are not i.i.d.: which samples decision kkk receives depends on the past estimates. Standard high-dimensional estimation results (restricted eigenvalue arguments for the Lasso or MCP) assume i.i.d. designs, and so does the analysis of the oracle estimator. The obvious argument — apply the i.i.d. result to βwhole\beta^{whole}βwhole — fails at this step. The paper instead extracts an i.i.d. subsample, the exploration samples in UkU_kUk​, and controls the rest through a martingale count. A second difficulty is that the MCP objective is non-convex; the 2sWL estimate must be shown to coincide with the oracle estimator, which requires a minimum signal strength βmin⁡\beta_{\min}βmin​ and a sufficiently large aaa.

Formalization scope

Covariates are Fin d → ℝ with d≥1d\ge1d≥1, decisions are Fin K with K≥2K\ge2K≥2 (the paper's decision kkk is k.val + 1), times are t≥1t\ge1t≥1. Norms are explicit sums. Pinned readings, all disclosed in the items:

  • The reward family is a base measure ν\nuν concentrated on [−Rmax⁡,Rmax⁡][-R_{\max},R_{\max}][−Rmax​,Rmax​] with a jointly measurable, positive, normalized density ggg; E[Rk∣x,β]=μ(x⊤β)\mathbb E[R_k\mid x,\beta]=\mu(x^\top\beta)E[Rk​∣x,β]=μ(x⊤β).
  • A.5's derivatives are in the linear predictor η\etaη, bounded for ∣η∣≤bxmax⁡|\eta|\le bx_{\max}∣η∣≤bxmax​; smoothness is ContDiff ℝ ∞.
  • Both weighted-Lasso steps minimize over Bb={∥β∥1≤b}B_b=\{\|\beta\|_1\le b\}Bb​={∥β∥1​≤b} (A.1's "all feasible β").
  • A.3's "every xxx" means every x∈Xx\in\mathcal Xx∈X; A.4 is required for k∈Kok\in\mathcal K_ok∈Ko​ only.
  • Exploration is driven by exogenous coins Vt∼Unif[0,1]V_t\sim\mathrm{Unif}[0,1]Vt​∼Unif[0,1] and uniform draws AtA_tAt​, independent of the covariates and rewards. The rewards of different decisions at the same time may be dependent.
  • The algorithm uses the box's anytime λ1(t),λ2(t)\lambda_1(t),\lambda_2(t)λ1​(t),λ2​(t), with λ1,0=C5\lambda_{1,0}=C_5λ1,0​=C5​, λ2,0=C4\lambda_{2,0}=C_4λ2,0​=C4​.
  • Propositions 4 and 6 are stated for k∈Kok\in\mathcal K_ok∈Ko​, with the algorithm parameters and the threshold on TTT that Lemma EC.9 supplies. Lemma EC.10 adds the bound ∣f′∣≤σ2|f'|\le\sigma_2∣f′∣≤σ2​ its proof uses.

Trivializing formalizations are ruled out: the estimates are minimizers of the stated objective over BbB_bBb​ (not arbitrary functions), the selection and tie-breaking rules are measurable (otherwise every expectation would be the junk value 000), and every existential constant comes before the probability space, the rules and TTT, so that CβC_\betaCβ​ and T0T_0T0​ cannot depend on the horizon. The trailing O(∣K∣s2(s+log⁡d)log⁡T)O(|\mathcal K|s^2(s+\log d)\log T)O(∣K∣s2(s+logd)logT) and the explicit lower bound on T0T_0T0​ are not formalized.

A complete development needs a measurable argmin selection over a compact ball, Chernoff bounds for sums of independent non-identical Bernoulli variables, differentiation under the integral for GLM means, a restricted-eigenvalue oracle inequality for the weighted Lasso with GLM loss, and a martingale concentration bound. The first three are reusable beyond this mission. Contributions on any milestone are welcome.

Selected references

  • X. Wang, M. M. Wei and T. Yao, Online Learning and Decision-Making under Generalized Linear Model with High-Dimensional Data, arXiv preprint, 2018 (Management Science, 2025). https://arxiv.org/abs/1812.02962
  • H. Bastani and M. Bayati, Online Decision Making with High-Dimensional Covariates, Operations Research 68(1), 2020. https://doi.org/10.1287/opre.2019.1902
  • A. Goldenshluger and A. Zeevi, A Linear Response Bandit Problem, Stochastic Systems 3(1), 2013. https://doi.org/10.1287/11-SSY032
  • C.-H. Zhang, Nearly Unbiased Variable Selection under Minimax Concave Penalty, Annals of Statistics 38(2), 2010. https://doi.org/10.1214/09-AOS729
10 thms1 active userReviewed
Algorithmic Game TheoryEconomics·Captain: mikedeng1

Retention or Acquisition? Behavior-Based Quality Disclosure I: Retention-Focused Disclosure Thresholds and Higher Second-Period Profits under Behavior-Based DisclosureResearch Paper

Motivation

Firms that hold purchase-history data can treat past customers and a rival's customers differently. The economics of behavior-based pricing (BBP), charging different prices to the two groups, is well developed: in a symmetric duopoly, poaching the rival's customers with discounts intensifies competition and usually lowers profits (Fudenberg and Tirole 2000; Villas-Boas 1999). The same data can also target information. A firm launching a new product of uncertain quality can disclose that quality (free samples, demonstrations, trials) at a cost per customer reached, and it may disclose to one segment and not the other. This is behavior-based quality disclosure (BBD).

Zhang and Li (Management Science 71(10), 2025) combine costly voluntary disclosure in the style of Jovanovic (1982) with BBP in a two-period Hotelling duopoly. Their Proposition 1 answers two questions about the second period: to which segment should a firm disclose more readily, and does the option to target disclosure help or hurt profits? This mission formalizes that proposition and the displayed formulas from which it is derived.

Setting

Two firms, A at 000 and B at 111, face a unit mass of consumers spread uniformly over [0,1][0,1][0,1], with unit transportation cost and a base value high enough that every consumer buys in every period. The first-period purchase splits the line at a share x1x_1x1​: A's turf [0,x1][0,x_1][0,x1​] consists of A's old customers, B's turf [x1,1][x_1,1][x1​,1] of B's.

In period 2 firm i∈{a,b}i\in\{a,b\}i∈{a,b} launches a product of quality qiq_iqi​; qaq_aqa​ and qbq_bqb​ are independent and uniform on [0,1][0,1][0,1], and consumers do not observe them. Disclosing to the consumers in an interval of length ℓ\ellℓ costs ℓc\ell cℓc, where ccc is the unit disclosure cost. A firm discloses to a segment exactly when its quality exceeds a disclosure threshold q^\hat qq^​; consumers who see no disclosure infer q≤q^q\le\hat qq≤q^​ and hold the belief q^/2\hat q/2q^​/2. The updated belief is therefore bel⁡(q^,q)=q\operatorname{bel}(\hat q,q)=qbel(q^​,q)=q if q>q^q>\hat qq>q^​ and q^/2\hat q/2q^​/2 otherwise.

  • Under uniform disclosure each firm has one threshold, q^a\hat q_aq^​a​ or q^b\hat q_bq^​b​, for the whole line, at cost ccc.
  • Under BBD firm A has a threshold q^ao\hat q_{ao}q^​ao​ for its own customers (cost x1cx_1cx1​c) and q^an\hat q_{an}q^​an​ for B's customers (cost (1−x1)c(1-x_1)c(1−x1​)c); B has q^bo\hat q_{bo}q^​bo​ and q^bn\hat q_{bn}q^​bn​ likewise.

In both regimes firms then set four prices: pao,pbnp_{ao},p_{bn}pao​,pbn​ on A's turf and pan,pbop_{an},p_{bo}pan​,pbo​ on B's turf. On A's turf, with beliefs q~ao,q~bn\tilde q_{ao},\tilde q_{bn}q~​ao​,q~​bn​, the consumers who stay with A are [0,xa][0,x_a][0,xa​] with xa=(1+pbn−pao+q~ao−q~bn)/2x_a=(1+p_{bn}-p_{ao}+\tilde q_{ao}-\tilde q_{bn})/2xa​=(1+pbn​−pao​+q~​ao​−q~​bn​)/2, clamped to the turf; B's turf is symmetric. A second-period equilibrium is a profile of thresholds and turf price strategies such that, for every belief pair, the turf prices are a Nash equilibrium among nonnegative prices, and every threshold is a best response: disclosing is optimal above it and withholding below it. The ex ante second-period profit E(πa2)E(\pi_{a2})E(πa2​) is A's expected revenue minus expected disclosure cost, over (qa,qb)(q_a,q_b)(qa​,qb​).

Formalization targets

Goal: Proposition 1 (a)–(c), at x1=1/2x_1=1/2x1​=1/2

For 0<c<5/360<c<5/360<c<5/36, at the symmetric first-period share x1=1/2x_1=1/2x1​=1/2: equilibria exist under both regimes; in every BBD equilibrium

q^ao<q^an,q^bo<q^bn;\hat q_{ao}<\hat q_{an},\qquad \hat q_{bo}<\hat q_{bn};q^​ao​<q^​an​,q^​bo​<q^​bn​;

in every BBD equilibrium and for every realization (qa,qb)∈[0,1]2(q_a,q_b)\in[0,1]^2(qa​,qb​)∈[0,1]2, at the induced beliefs, each firm charges the rival's customers less than its own,

pan<pao,pbn<pbo;p_{an}<p_{ao},\qquad p_{bn}<p_{bo};pan​<pao​,pbn​<pbo​;

and for every BBD equilibrium and every uniform-disclosure equilibrium, each firm's ex ante second-period profit is strictly higher under BBD:

E(πi2)U<E(πi2)BBD,i∈{a,b}.E(\pi_{i2})^{\mathrm U}<E(\pi_{i2})^{\mathrm{BBD}},\qquad i\in\{a,b\}.E(πi2​)U<E(πi2​)BBD,i∈{a,b}.

The goal asserts the shape of the result (an order of thresholds, of prices and of profits) and no closed form.

Milestones

  1. Lemma 2, region 1: in region 1 the turf games have the unique equilibria pao∗=(1+2x1+q~ao−q~bn)/3p^*_{ao}=(1+2x_1+\tilde q_{ao}-\tilde q_{bn})/3pao∗​=(1+2x1​+q~​ao​−q~​bn​)/3, pbn∗=(4x1−1+q~bn−q~ao)/3p^*_{bn}=(4x_1-1+\tilde q_{bn}-\tilde q_{ao})/3pbn∗​=(4x1​−1+q~​bn​−q~​ao​)/3, and the mirror formulas on B's turf.
  2. (4): the uniform threshold q^a∗=(108c+(3−2x1)2+2x1−3)/3\hat q^*_a=(\sqrt{108c+(3-2x_1)^2}+2x_1-3)/3q^​a∗​=(108c+(3−2x1​)2​+2x1​−3)/3.
  3. (5): the uniform ex ante profit.
  4. Uniform equilibrium thresholds: q^a∗=q^b∗=2(1+27c−1)/3\hat q^*_a=\hat q^*_b=2(\sqrt{1+27c}-1)/3q^​a∗​=q^​b∗​=2(1+27c​−1)/3 at x1=1/2x_1=1/2x1​=1/2.
  5. (13): the own-customer threshold q^ao∗=(216x1c+(1+4x1)2−4x1−1)/3\hat q^*_{ao}=(\sqrt{216x_1c+(1+4x_1)^2}-4x_1-1)/3q^​ao∗​=(216x1​c+(1+4x1​)2​−4x1​−1)/3.
  6. (14): the BBD ex ante profit.
  7. BBD equilibrium thresholds: q^ao∗=q^bo∗=1+12c−1\hat q^*_{ao}=\hat q^*_{bo}=\sqrt{1+12c}-1q^​ao∗​=q^​bo∗​=1+12c​−1 and q^an∗=q^bn∗=(1+108c−1)/3\hat q^*_{an}=\hat q^*_{bn}=(\sqrt{1+108c}-1)/3q^​an∗​=q^​bn∗​=(1+108c​−1)/3 at x1=1/2x_1=1/2x1​=1/2.
  8. Table 1, second-period profit row: closed forms of E(πa2∗)E(\pi^*_{a2})E(πa2∗​) in both regimes.

Significance

The result. Part (a) says that disclosure should be retention focused: a firm reveals quality to its own customers over a wider range of qualities than to the rival's. This is the opposite of the acquisition focus BBP prescribes for prices, so the two instruments built on the same data pull in different directions. Part (b) records that prices stay acquisition focused: the rival's customers get the lower price. Part (c) says that targeted disclosure raises second-period profits, in contrast with the classical finding that targeted pricing lowers them. Under uniform disclosure a single threshold over-discloses to the rival's customers and under-discloses to one's own; BBD separates the two, and the paper locates the gain in the expected disclosure cost c(1−q^a)c(1-\hat q_a)c(1−q^​a​) in (5) against c[1−x1q^ao−(1−x1)q^an]c[1-x_1\hat q_{ao}-(1-x_1)\hat q_{an}]c[1−x1​q^​ao​−(1−x1​)q^​an​] in (14).

Formalizing it. The paper's proofs are in an Online Appendix; the main text shows the displayed formulas only. A formal proof checks the whole chain from the clamped price games, through the best-response conditions, to the closed forms of Table 1 and the final comparison. The comparison in (c) is delicate: the profit difference is positive on all of (0,5/36)(0,5/36)(0,5/36) but tends to 000 as c→0c\to0c→0 (about 3⋅10−103\cdot10^{-10}3⋅10−10 at c=10−5c=10^{-5}c=10−5), so a numerical check does not settle it. The mission also gives the platform its first Hotelling duopoly, its first behavior-based pricing model and its first costly-disclosure model.

Difficulty

There are three nested equilibrium notions: Nash prices in each turf for every belief pair, best-response thresholds given those prices, and expectations of piecewise-defined profits over the belief support. Lemma 2's prices solve first-order conditions only in the interior; uniqueness among nonnegative prices requires ruling out the corners where one firm sells nothing on a turf. Each threshold is characterized by a best-response condition rather than an equation, so obtaining (4) or (13) requires showing that the disclosure gain is monotone in quality and crosses the cost exactly once inside (0,1)(0,1)(0,1). The expected profits integrate squares of linear functions of beliefs that switch at the thresholds. Finally, (c) is a sign statement about a difference of algebraic functions of ccc with three different square roots that vanishes at c=0c=0c=0; plugging in endpoints or bounding term by term loses the sign near 000.

Formalization scope

The Lean development lives in the namespace BBDisclosure.Stage2. Conventions:

  • Transportation cost t=1t=1t=1, zero marginal cost, discount factor 111; the base value vvv cancels and is omitted, and full coverage is built in (every consumer buys from exactly one firm).
  • The standing assumption 0<c<5/360<c<5/360<c<5/36 (p. 8515; c>0c>0c>0 is implicit in a unit cost and needed for the strict inequality in (c)).
  • Expectations are iterated interval integrals ∫01∫01\int_0^1\int_0^1∫01​∫01​; no probability space is introduced and no integrability hypothesis is added.
  • Prices are nonnegative; shares are clamped to their turf.
  • Thresholds are defined by the best-response property, with the nondisclosure belief q^/2\hat q/2q^​/2 fixed under deviation. They are never defined as roots of the indifference equation or by their closed forms; prices are never defined by Lemma 2's formulas.
  • Proposition 1 and the equilibrium-threshold milestones are stated at x1=1/2x_1=1/2x1​=1/2, the symmetric first-period equilibrium share of Table 1. The first period is the subject of the companion mission (II).
  • "In region 1" for (4), (5), (13), (14) is read as: every belief pair on the support lies in Lemma 2's region 1, i.e. 1/2−q^bn/8<x1<1/2+q^an/81/2-\hat q_{bn}/8<x_1<1/2+\hat q_{an}/81/2−q^​bn​/8<x1​<1/2+q^​an​/8 under BBD and 1/2−q^b/8<x1<1/2+q^a/81/2-\hat q_b/8<x_1<1/2+\hat q_a/81/2−q^​b​/8<x1​<1/2+q^​a​/8 under uniform disclosure.
  • Part (b) of Proposition 1, on prices, is stated for every realization (qa,qb)∈[0,1]2(q_a,q_b)\in[0,1]^2(qa​,qb​)∈[0,1]2, comparing the turf price strategies at the beliefs that realization induces (both beliefs about a firm come from the same realized quality).

A formalization in which thresholds or prices are pinned to their closed forms, or in which the equilibrium predicate is unsatisfiable, would make the goal trivial; the goal therefore quantifies over equilibria of the game itself and includes existence of an equilibrium in both regimes. "Firms'" is stated for both A and B rather than assumed by symmetry.

Needed infrastructure: piecewise-quadratic optimization on a half-line (the clamped turf games), interval integrals of piecewise polynomials, and sign analysis of algebraic expressions in 1+12c\sqrt{1+12c}1+12c​, 1+27c\sqrt{1+27c}1+27c​, 1+108c\sqrt{1+108c}1+108c​. The turf-game analysis is reusable for any Hotelling model with behavior-based pricing. Contributions to any milestone, or to intermediate statements such as the conditional profits (3) and (12), are welcome.

Selected references

  • J. Zhang and K. J. Li, Retention or Acquisition? Behavior-Based Quality Disclosure, Management Science 71(10), 8510–8525, 2025. https://doi.org/10.1287/mnsc.2022.01081
  • D. Fudenberg and J. Tirole, Customer Poaching and Brand Switching, RAND Journal of Economics 31(4), 634–657, 2000. https://doi.org/10.2307/2696352
  • J. M. Villas-Boas, Dynamic Competition with Customer Recognition, RAND Journal of Economics 30(4), 604–631, 1999. https://doi.org/10.2307/2556067
  • B. Jovanovic, Truthful Disclosure of Information, Bell Journal of Economics 13(1), 36–44, 1982. https://doi.org/10.2307/3003428
10 thms1 active userReviewed
PreviousPage 85 of 106Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me