Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,525 missions · 1,174 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1351Completed1174All2525
Economics·Captain: mikedeng1

Outcome-Based Pricing for New Pharmaceuticals via Rebates: A Firm-to-Payer Transfer Makes Outcome-Based Pricing Better for Both Firm and Payer if and only if the Drug Is High-RiskResearch Paper

Motivation

New brand-name drugs, in particular biologics, are expensive. Their benefit is also uncertain: a given patient cannot know in advance whether the treatment will work for her. Outcome-based pricing (also called performance-based or risk-sharing agreements) responds to this. The manufacturer is paid only when the treatment reaches a pre-specified goal and rebates the price otherwise. Agreements of this kind between manufacturers and payers have been signed for cholesterol, diabetes and oncology drugs. Carlson et al. (2010) give a taxonomy. Whether such a contract actually helps the parties that must agree to it is a question about incentives. It cannot be settled by noting that the patient bears less risk.

E. Adida (Management Science, 2021; accepted manuscript at eScholarship) studies it in a three-stage game between a monopolist firm, a payer and risk-sensitive patients. The patients follow prospect theory (Kahneman and Tversky 1979; Tversky and Kahneman 1992). The paper's headline result is that, in the region where the payer covers the drug under both systems, the firm and the payer typically disagree about outcome-based pricing. A side payment from the firm to the payer can make both strictly better off, but only for high-risk drugs. This mission formalizes that result and the chain of equilibrium computations that leads to it.

Setting

There are n>0n > 0n>0 patients with values V∼U[0,vˉ]V \sim \mathrm U[0,\bar v]V∼U[0,vˉ], vˉ>0\bar v > 0vˉ>0, a unit cost c>0c > 0c>0, a co-insurance rate β∈(0,1/2]\beta \in (0, 1/2]β∈(0,1/2] and a success probability q∈(0,1)q \in (0,1)q∈(0,1). On success the payer gains a fixed surplus v′≥0v' \ge 0v′≥0. The game has three stages.

  1. The firm announces a price p≥0p \ge 0p≥0.
  2. The payer decides whether to cover the drug. With coverage a buyer pays the share βˉ=β\bar\beta = \betaβˉ​=β of the price and the payer pays 1−β1-\beta1−β; without coverage βˉ=1\bar\beta = 1βˉ​=1.
  3. Each patient observes her value vvv and buys iff her expected prospect-theory welfare is non-negative. Her value function is u(x)=xαu(x) = x^\alphau(x)=xα for x≥0x \ge 0x≥0 and u(x)=−λ(−x)αu(x) = -\lambda(-x)^\alphau(x)=−λ(−x)α for x<0x < 0x<0, with 0<α<10 < \alpha < 10<α<1 and λ≥1\lambda \ge 1λ≥1.

Under uniform pricing the price is paid on every purchase, and the buyer's welfare is q u(v−βˉp)+(1−q) u(−βˉp)q\,u(v-\bar\beta p) + (1-q)\,u(-\bar\beta p)qu(v−βˉ​p)+(1−q)u(−βˉ​p). Under outcome-based pricing it is paid only on success, and the welfare is q u(v−βˉp)q\,u(v-\bar\beta p)qu(v−βˉ​p). Demand is n/vˉn/\bar vn/vˉ times the measure of buyers in [0,vˉ][0,\bar v][0,vˉ]. The firm earns p−cp - cp−c per buyer under uniform pricing and qp−cqp - cqp−c under outcome-based pricing. The payer's objective WpayerW_{\text{payer}}Wpayer​ is its own expected payoff plus the patients' total expected (risk-neutral) payoff. It covers iff its objective with coverage is at least its objective without. An equilibrium price maximizes the firm's realized profit, with the payer's coverage response, over all p≥0p \ge 0p≥0.

Let

z=1+(λ1−qq)1/α,q0=11+λ−1/(1−α).z = 1 + \Big(\lambda\frac{1-q}{q}\Big)^{1/\alpha},\qquad q_0 = \frac{1}{1+\lambda^{-1/(1-\alpha)}} .z=1+(λq1−q​)1/α,q0​=1+λ−1/(1−α)1​.

A drug is high-risk if q<q0q < q_0q<q0​ and low-risk if q>q0q > q_0q>q0​; the risk premium qz−1qz - 1qz−1 is positive exactly for high-risk drugs. Assumption 1 is βc/vˉ<min⁡{q,1/z}\beta c/\bar v < \min\{q, 1/z\}βc/vˉ<min{q,1/z}. Assumption 2 is

v′≥p~∗(1−β/2)−vˉ/2and(q≤q1 or v′≥p∗(1/q−zβ/2)−vˉ/2),v' \ge \tilde p^*(1-\beta/2) - \bar v/2 \quad\text{and}\quad \big(q \le q_1 \ \text{or}\ v' \ge p^*(1/q - z\beta/2) - \bar v/2\big),v′≥p~​∗(1−β/2)−vˉ/2and(q≤q1​ or v′≥p∗(1/q−zβ/2)−vˉ/2),

with p∗=c/2+vˉ/(2βz)p^* = c/2 + \bar v/(2\beta z)p∗=c/2+vˉ/(2βz), p~∗=c/(2q)+vˉ/(2β)\tilde p^* = c/(2q) + \bar v/(2\beta)p~​∗=c/(2q)+vˉ/(2β), and q1q_1q1​ the solution of zq=2/βzq = 2/\betazq=2/β. It is the region of large payer benefit, in which both systems end in coverage. Finally,

M′=vˉ2(vˉzβ2c−1)+βc (2/β−1−zq)4q.M' = \frac{\bar v}{2}\Big(\frac{\bar v}{z\beta^2c} - 1\Big) + \frac{\beta c\,(2/\beta - 1 - zq)}{4q}.M′=2vˉ​(zβ2cvˉ​−1)+4qβc(2/β−1−zq)​.

Formalization targets

Goal: Proposition 4

Under Assumptions 1 and 2, let pUp^UpU and pOp^OpO be equilibrium prices, and write ΔΠ=ΠfirmO(pO)−ΠfirmU(pU)\Delta\Pi = \Pi^O_{\text{firm}}(p^O) - \Pi^U_{\text{firm}}(p^U)ΔΠ=ΠfirmO​(pO)−ΠfirmU​(pU) and ΔW=WpayerO(pO)−WpayerU(pU)\Delta W = W^O_{\text{payer}}(p^O) - W^U_{\text{payer}}(p^U)ΔW=WpayerO​(pO)−WpayerU​(pU). Then

v′>M′ ⟹ (ΔΠ>0  ⟺  ΔW>0) ∧ (ΔΠ<0  ⟺  ΔW<0),v' > M' \ \Longrightarrow\ \big(\Delta\Pi > 0 \iff \Delta W > 0\big)\ \wedge\ \big(\Delta\Pi < 0 \iff \Delta W < 0\big),v′>M′ ⟹ (ΔΠ>0⟺ΔW>0) ∧ (ΔΠ<0⟺ΔW<0), v′<M′ ⟹ (∃ τ: ΠfirmU<ΠfirmO−τ ∧ WpayerU<WpayerO+τ)  ⟺  q<q0,v' < M' \ \Longrightarrow\ \Big(\exists\,\tau:\ \Pi^U_{\text{firm}} < \Pi^O_{\text{firm}} - \tau\ \wedge\ W^U_{\text{payer}} < W^O_{\text{payer}} + \tau\Big) \iff q < q_0,v′<M′ ⟹ (∃τ: ΠfirmU​<ΠfirmO​−τ ∧ WpayerU​<WpayerO​+τ)⟺q<q0​,

and, if v′<M′v' < M'v′<M′ and q<q0q < q_0q<q0​, 0<−ΔW<ΔΠ0 < -\Delta W < \Delta\Pi0<−ΔW<ΔΠ: every transfer strictly between the two amounts, which runs from the firm to the payer, works.

Milestones

In attack order:

  • the purchase rules (v≥βˉpzv \ge \bar\beta pzv≥βˉ​pz, resp. v≥βˉpv \ge \bar\beta pv≥βˉ​p) and the closed forms of demand and payer objective;
  • Lemma 1 (1/z>q  ⟺  q>q01/z > q \iff q > q_01/z>q⟺q>q0​ away from q0q_0q0​ and 111) and the shape of q↦zqq \mapsto zqq↦zq;
  • the coverage rules, Propositions 1 and 2;
  • the equilibrium prices, Theorem 1 part 1 (p∗p^*p∗) and Theorem 2 part 1 (p~∗\tilde p^*p~​∗), and their combination under Assumption 2;
  • the firm and payer comparisons, Proposition 3 parts 3 and 6, with the identities ΔΠ=n4vˉβ(qz−1)(vˉ2z−c2β2q)\Delta\Pi = \frac{n}{4\bar v\beta}(qz-1)\big(\frac{\bar v^2}{z} - \frac{c^2\beta^2}{q}\big)ΔΠ=4vˉβn​(qz−1)(zvˉ2​−qc2β2​) and ΔW=nβc2vˉ(qz−1)(v′−M′)\Delta W = \frac{n\beta c}{2\bar v}(qz-1)(v'-M')ΔW=2vˉnβc​(qz−1)(v′−M′);
  • the joint-surplus identity of the proof of Proposition 4 and the positivity of its bracket.

Significance

Proposition 4 says that for a high-risk drug outcome-based pricing raises total firm-plus-payer surplus, even where it hurts the payer. A negotiated side payment therefore always exists that makes both parties prefer it. For a low-risk drug no such payment exists, because the payer's gain is smaller than the firm's loss. The result locates where outcome-based contracts can be self-enforcing and identifies the risk premium qz−1qz - 1qz−1 as the quantity that decides it. In this model the patients' loss aversion λ\lambdaλ and risk sensitivity 1−α1-\alpha1−α act on the comparison only through zzz and q0q_0q0​.

The paper proves the result with explicit algebra once the equilibrium is pinned down. The formalization adds two things. First, the equilibrium layer is checked, not assumed: the statements quantify over the backward-induction equilibrium prices, with an explicit payer coverage rule and an integral model of demand. The closed forms and the unique optima p∗p^*p∗, p~∗\tilde p^*p~​∗ become theorems. Second, the formalization makes the small hypotheses explicit (positivity of ccc, non-negativity of v′v'v′, strict versus weak improvement), which the published proof uses without listing. As far as is known, none of these results has a machine-checked proof.

Difficulty

The algebra of Propositions 3 and 4 is short once pU=p∗p^U = p^*pU=p∗ and pO=p~∗p^O = \tilde p^*pO=p~​∗ with coverage are established. The work is in establishing them. The firm's realized profit is a discontinuous function of the price, because the payer's coverage decision switches at the thresholds p1p_1p1​, p2p_2p2​, pˉ1\bar p_1pˉ​1​, pˉ2\bar p_2pˉ​2​, which depend on the regime of qqq. Showing that p∗p^*p∗ is the unique global maximizer requires comparing the covered and uncovered profit curves on every piece. It uses Assumption 1, the bound β≤1/2\beta \le 1/2β≤1/2 (which places p∗p^*p∗ above vˉ/z\bar v/zvˉ/z and p~∗\tilde p^*p~​∗ above vˉ\bar vvˉ), and the monotonicity of zqzqzq through the root q1q_1q1​ of zq=2/βzq = 2/\betazq=2/β. Reading the closed forms off the paper's formulas is not enough: they must be derived from the purchase rule, which itself rests on the prospect-theory inequality (v−βˉp)α≥λ1−qq(βˉp)α(v - \bar\beta p)^\alpha \ge \lambda\frac{1-q}{q}(\bar\beta p)^\alpha(v−βˉ​p)α≥λq1−q​(βˉ​p)α. A natural shortcut is to state Proposition 4 at p∗p^*p∗ and p~∗\tilde p^*p~​∗ directly. That deletes the equilibrium content and is not the goal.

Formalization scope

All quantities are real numbers in one structure Params with a Standing predicate: n,vˉ,c>0n, \bar v, c > 0n,vˉ,c>0, 0<β≤1/20 < \beta \le 1/20<β≤1/2, 0<q<10 < q < 10<q<1, 0<α<10 < \alpha < 10<α<1, λ≥1\lambda \ge 1λ≥1, v′≥0v' \ge 0v′≥0. Two of these are added to the page's assumptions: c>0c > 0c>0 (M′M'M′ divides by ccc) and v′≥0v' \ge 0v′≥0 (used in the proof of Theorem 1).

Powers are Real.rpow on non-negative bases only. The roots q1q_1q1​ (of zq=2/βzq = 2/\betazq=2/β), qˉ1\bar q_1qˉ​1​ (of zq=1/βzq = 1/\betazq=1/β) and q2q_2q2​ (of zq=2/(1+β)zq = 2/(1+\beta)zq=2/(1+β)) are passed as numbers together with their defining equation on (0,1)(0,1)(0,1); uniqueness is a milestone. Demand and patient payoff are a Lebesgue measure and a set integral over the buyers in [0,vˉ][0,\bar v][0,vˉ]. Ties follow the paper: an indifferent patient buys, and an indifferent payer covers. "The firm prices at p∗p^*p∗" is read as "p∗p^*p∗ is the unique equilibrium price". "Better for both parties" is read as strict improvement, and the paper's closed range of transfers is replaced by the open range, because at its endpoints one party is only indifferent. The payer's side of every comparison is its objective WpayerW_{\text{payer}}Wpayer​.

A formalization that fixes pU=p∗p^U = p^*pU=p∗ and pO=p~∗p^O = \tilde p^*pO=p~​∗ by hypothesis, or takes the closed forms as definitions, would make the goal an algebraic identity. The goal here quantifies over all equilibrium prices of the integral model.

A complete development needs elementary real analysis (convexity and monotonicity of q↦zqq \mapsto zqq↦zq, rpow manipulations), Lebesgue measure and integrals over intervals, and piecewise maximization of concave quadratics. The prospect-theory value function and the threshold purchase rule are reusable for other behavioral pricing models. Proofs of any milestone are welcome, as are proofs of the omitted parts of Theorems 1 and 2 (the constrained prices p1p_1p1​, p2p_2p2​, pˉ1\bar p_1pˉ​1​, pˉ2\bar p_2pˉ​2​).

Selected references

  • E. Adida, Outcome-based pricing for new pharmaceuticals via rebates, Management Science 67(2), 2021. https://doi.org/10.1287/mnsc.2019.3574 (accepted manuscript: https://escholarship.org/uc/item/0702h9wp)
  • D. Kahneman, A. Tversky, Prospect theory: An analysis of decision under risk, Econometrica 47(2), 1979. https://doi.org/10.2307/1914185
  • A. Tversky, D. Kahneman, Advances in prospect theory: Cumulative representation of uncertainty, Journal of Risk and Uncertainty 5(4), 1992. https://doi.org/10.1007/BF00122574
  • J.J. Carlson, S.D. Sullivan, L.P. Garrison, P.J. Neumann, D.L. Veenstra, Linking payment to health outcomes: A taxonomy and examination of performance-based reimbursement schemes between healthcare payers and manufacturers, Health Policy 96(3), 2010. https://doi.org/10.1016/j.healthpol.2010.02.005
  • G.P. Cachon, M.A. Lariviere, Supply chain coordination with revenue-sharing contracts: Strengths and limitations, Management Science 51(1), 2005. https://doi.org/10.1287/mnsc.1040.0215
17 thms1 active userReviewed
Economics·Captain: mikedeng1

Leasing, Modularity, and the Circular Economy: Optimal Joint Choice of Business Model and Architecture — Lease Modular at Low Cost, Else Sell Modular/Integral (γ ≤ 1) or Lease Integral (γ > 1)Research Paper

Motivation

The circular economy movement argues that manufacturers should keep control of their products after use (by leasing instead of selling) and design them so that worn parts can be replaced individually (a modular architecture). Each of the two levers has a long literature in operations management and economics. Leasing versus selling durable goods is studied in models of durable goods with secondary markets (Desai & Purohit 1998; Agrawal, Ferguson, Toktay & Thomas 2012), and modularity in the product-design literature, where its value lies in replacing modules independently. Agrawal, Atasu and Ülkü (Management Science) ask whether the two levers reinforce each other: when is leasing a modular product strictly the most profitable of the four combinations of business model and architecture? Their answer (Proposition 3) is a closed-form partition of the parameter space by cost thresholds, and it shows that the combination is optimal only under limited conditions.

Setting

A monopolist offers a durable product made of two modules, each with a useful life of two periods; module 1 is the more durable one. A customer of type θ\thetaθ, uniform on [0,1][0,1][0,1], values a new product at θ\thetaθ per period. Under selling, a used module kkk retains a fraction δk\delta_kδk​ of its value; under leasing, off-lease modules retain δkl=γδk\delta_{kl}=\gamma\delta_kδkl​=γδk​, where γ>0\gamma>0γ>0 is the relative return condition (γ<1\gamma<1γ<1: off-lease products are in worse shape than previously sold ones; γ>1\gamma>1γ>1: in better shape). Each module costs ccc to produce. The standing assumptions are

0<δ2<δ1<1,γδ1<1,0<c<1−δ22,c<1−γδ22.0<\delta_2<\delta_1<1,\qquad \gamma\delta_1<1,\qquad 0<c<\tfrac{1-\delta_2}{2},\qquad c<\tfrac{1-\gamma\delta_2}{2}.0<δ2​<δ1​<1,γδ1​<1,0<c<21−δ2​​,c<21−γδ2​​.

In steady state the firm solves one of four quadratic problems, each written in quantities through inverse demand functions derived from customer self-selection and secondary-market clearing:

  • SI (sell integral): choose Sn≥0S_n\ge0Sn​≥0 new products, profit ΠSI=(pn(Sn)−2c)Sn\Pi_{SI}=(p_n(S_n)-2c)S_nΠSI​=(pn​(Sn​)−2c)Sn​.
  • SM (sell modular): choose 0≤Sn1≤Sn20\le S_{n1}\le S_{n2}0≤Sn1​≤Sn2​ new first and second modules; Sn2−Sn1S_{n2}-S_{n1}Sn2​−Sn1​ is the UN segment of customers who keep a used first module and buy a new second one.
  • LI (lease integral): choose 0≤Lu≤Ln0\le L_u\le L_n0≤Lu​≤Ln​ used and new leases.
  • LM (lease modular): choose Lnn,Lun,Luu≥0L_{nn},L_{un},L_{uu}\ge0Lnn​,Lun​,Luu​≥0 new, blended and used leases, with the supply constraint Luu+Lun≤LnnL_{uu}+L_{un}\le L_{nn}Luu​+Lun​≤Lnn​.

The optimal profits ΠSI∗,ΠSM∗,ΠLI∗,ΠLM∗\Pi^*_{SI},\Pi^*_{SM},\Pi^*_{LI},\Pi^*_{LM}ΠSI∗​,ΠSM∗​,ΠLI∗​,ΠLM∗​ are the attained maxima of these problems. The paper's thresholds are explicit functions of (δ1,δ2,γ)(\delta_1,\delta_2,\gamma)(δ1​,δ2​,γ):

CSM=(1−δ2)(δ1+δ2)3δ1+5δ2,CLM2=(1−γδ2)(δ1+δ2)3δ1+5δ2,C_{SM}=\frac{(1-\delta_2)(\delta_1+\delta_2)}{3\delta_1+5\delta_2},\qquad C_{LM2}=\frac{(1-\gamma\delta_2)(\delta_1+\delta_2)}{3\delta_1+5\delta_2},CSM​=3δ1​+5δ2​(1−δ2​)(δ1​+δ2​)​,CLM2​=3δ1​+5δ2​(1−γδ2​)(δ1​+δ2​)​,

together with CLIC_{LI}CLI​, CLM1C_{LM1}CLM1​, and the square-root expressions CIC_ICI​, CMC_MCM​ of the Appendix.

Formalization targets

Goal: Proposition 3

With ties between architectures broken towards the integral one (footnote 13 of the paper):

  • if γ≤1\gamma\le1γ≤1: the firm leases a modular product for c<CMc<C_Mc<CM​, sells a modular product for CM≤c<CSMC_M\le c<C_{SM}CM​≤c<CSM​, and sells an integral product for c≥CSMc\ge C_{SM}c≥CSM​;
  • if γ>1\gamma>1γ>1: the firm leases a modular product for c<CLM2c<C_{LM2}c<CLM2​ and leases an integral product otherwise.

In each region the chosen option's optimal profit strictly exceeds the others, except at exact ties of the model. These are ΠSM∗=ΠSI∗\Pi^*_{SM}=\Pi^*_{SI}ΠSM∗​=ΠSI∗​ for c≥CSMc\ge C_{SM}c≥CSM​, ΠLM∗=ΠLI∗\Pi^*_{LM}=\Pi^*_{LI}ΠLM∗​=ΠLI∗​ for γ>1\gamma>1γ>1, c≥CLM2c\ge C_{LM2}c≥CLM2​, and at γ=1\gamma=1γ=1 further ties between leasing and selling. The goal states these as equalities or weak inequalities and restores strictness for γ<1\gamma<1γ<1.

Milestones

  1. The closed forms of ΠSI∗\Pi^*_{SI}ΠSI∗​, ΠSM∗\Pi^*_{SM}ΠSM∗​, ΠLI∗\Pi^*_{LI}ΠLI∗​ and ΠLM∗\Pi^*_{LM}ΠLM∗​, the last in three cost regimes.
  2. Lemma 1: under selling, modularity strictly pays (and a UN segment is served) iff c<CSMc<C_{SM}c<CSM​, equivalently δ2<DS(δ1,c)\delta_2<D_S(\delta_1,c)δ2​<DS​(δ1​,c).
  3. Lemma 2: under leasing, modularity strictly pays (and blended products are leased) iff c<CLM2c<C_{LM2}c<CLM2​, equivalently δ2<DL(δ1,γ,c)\delta_2<D_L(\delta_1,\gamma,c)δ2​<DL​(δ1​,γ,c); and CLM1<CLI<CLM2C_{LM1}<C_{LI}<C_{LM2}CLM1​<CLI​<CLM2​.
  4. Lemma 3 and its converse: under architecture j∈{I,M}j\in\{I,M\}j∈{I,M}, leasing beats selling if γ>1\gamma>1γ>1 or c<Cjc<C_jc<Cj​, and for γ<1\gamma<1γ<1 selling beats leasing iff c>Cjc>C_jc>Cj​.
  5. Proposition 2, CM<CIC_M<C_ICM​<CI​ for γ<1\gamma<1γ<1, and the threshold ordering CM<CI<CSM≤CLM2C_M<C_I<C_{SM}\le C_{LM2}CM​<CI​<CSM​≤CLM2​ for γ≤1\gamma\le1γ≤1.
  6. The comparative statics of Proposition 3: CMC_MCM​ increases in γ\gammaγ; CSMC_{SM}CSM​ and CLM2C_{LM2}CLM2​ increase in δ1\delta_1δ1​ and decrease in δ2\delta_2δ2​; CLM2C_{LM2}CLM2​ decreases in γ\gammaγ.

Significance

The result gives a complete description of the firm's joint choice in a standard durable-goods model with a secondary market, and it qualifies a common claim. Leasing a modular product is strictly optimal only at low production cost. For γ<1\gamma<1γ<1 modularity can even push a leasing firm to selling (Proposition 2), and for γ>1\gamma>1γ>1 the firm never sells. The thresholds feed the paper's later environmental and consumer-surplus comparisons.

The paper's proofs are pencil-and-paper KKT computations reported in compressed form, and nothing in the paper is machine-checked. A formalization would certify the four closed-form optima, every threshold comparison, and the case split of Proposition 3. It would also settle two printing errors found while preparing this mission (see below), one of which changes the statement of Lemma 2 and Proposition 3.

Difficulty

Each firm problem is a strictly concave quadratic program over a polyhedral cone, so existence of the optimum is routine. The difficulty is everything after that. The optimum changes face as ccc moves: LM alone has four KKT cases, and each must be shown to be optimal exactly on its cost interval. The profit comparisons then reduce to sign conditions on rational functions of four parameters. Some involve the square roots in CIC_ICI​ and CMC_MCM​, which are only meaningful for γ≤1\gamma\le1γ≤1 and are defined as roots of quadratics in ccc, so the comparisons must be placed relative to them. The ordering CM<CI<CSM≤CLM2C_M<C_I<C_{SM}\le C_{LM2}CM​<CI​<CSM​≤CLM2​ is an inequality between such expressions on the whole parameter region. It is not a symbolic identity, and checking it at sample points proves nothing.

Formalization scope

  • Parameters are a record (δ1,δ2,γ,c)(\delta_1,\delta_2,\gamma,c)(δ1​,δ2​,γ,c) of reals with the standing assumptions as a predicate. The positivity of ccc is made explicit: at c=0c=0c=0, ΠLM∗=ΠLI∗\Pi^*_{LM}=\Pi^*_{LI}ΠLM∗​=ΠLI∗​ and the lease-modular region degenerates. α=1/2\alpha=1/2α=1/2, c1=c2=cc_1=c_2=cc1​=c2​=c and the discount factor ρ=1\rho=1ρ=1 are fixed, as in the paper's main model.
  • The four problems use the inverse demand functions and feasible sets of §4 and the Appendix. The SM feasible set 0≤Sn1≤Sn20\le S_{n1}\le S_{n2}0≤Sn1​≤Sn2​ covers both regimes of the Appendix (on the diagonal the profit is the no-UN profit). The LM problem is the three-product problem of §4.4, with the NU product already excluded.
  • An optimal profit is a value vvv with IsGreatest (profit '' feasible) v, never a supremum without attainment. Statements about the optimizer ("the UN segment exists", "Lun>0L_{un}>0Lun​>0") quantify over every optimal decision.
  • Thresholds are the printed closed forms, with Real.sqrt for CIC_ICI​, CMC_MCM​, DSD_SDS​, DLD_LDL​. CIC_ICI​ and CMC_MCM​ are used only for γ≤1\gamma\le1γ≤1, where their radicands are nonnegative.
  • Corrections. (i) The Appendix prints CLM2C_{LM2}CLM2​ with an extra factor γ\gammaγ in the denominator. The mission uses (1−γδ2)(δ1+δ2)/(3δ1+5δ2)(1-\gamma\delta_2)(\delta_1+\delta_2)/(3\delta_1+5\delta_2)(1−γδ2​)(δ1​+δ2​)/(3δ1​+5δ2​), which the paper's own Case 4 multiplier, its printed difference CLI−CLM2C_{LI}-C_{LM2}CLI​−CLM2​ and its DLD_LDL​ all require. With the printed form Lemma 2 and Proposition 3 are false for γ≠1\gamma\ne1γ=1. (ii) The SI inverse demand on p. 31 prints −2Sn(1+δ1+δ2)-2S_n(1+\delta_1+\delta_2)−2Sn​(1+δ1​+δ2​); the printed optimum belongs to −2Sn(δ1+δ2)-2S_n(\delta_1+\delta_2)−2Sn​(δ1​+δ2​), which is used. (iii) "if and only if γ>1\gamma>1γ>1" in the summary of the proof of Lemma 3 is read as γ<1\gamma<1γ<1, the case the proof treats.
  • Defining the optimal profits as their closed forms, or the thresholds as the crossing points of the profits, would make the goal and the lemmas hold by definition. The mission rules out both: profits are optima of the stated problems, and thresholds are explicit formulas.
  • Needed infrastructure: maximization of concave quadratics on polyhedral cones (KKT for linear constraints), and real-algebraic sign arguments with square roots. Lemmas for the four optima and for the threshold inequalities are reusable across the milestones and welcome as separate contributions.

Selected references

  • V. V. Agrawal, A. Atasu, S. Ülkü, Leasing, Modularity, and the Circular Economy, Management Science, 2021 (author manuscript of 2020-08-23 used here). https://doi.org/10.1287/mnsc.2020.3829
  • P. Desai, D. Purohit, Leasing and Selling: Optimal Marketing Strategies for a Durable Goods Firm, Management Science 44(11), S19–S34, 1998. https://doi.org/10.1287/mnsc.44.11.S19
  • V. V. Agrawal, M. Ferguson, L. B. Toktay, V. M. Thomas, Is Leasing Greener Than Selling?, Management Science 58(3), 523–533, 2012. https://doi.org/10.1287/mnsc.1110.1428
13 thms1 active userReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Shipment Policies for Products with Fixed Shelf Lives: Impact on Profits and Waste: Shipping Oldest First Minimizes the Long-Run Average Warehouse Waste and the Total WasteResearch Paper

Motivation

Manufacturers of products with fixed shelf lives must decide both how much to send from a warehouse to a store and which age cohorts to send. A shipment can reduce expiry at the warehouse while changing the age mix seen by shoppers at the store. In the two-echelon system studied by Akkaş and Honhon, the store does not control which items each shopper takes: some shoppers select older items first and the remainder select newer items first. The resulting waste at the warehouse and store can move in different directions when the manufacturer changes a shipment. The paper uses this setting to ask whether ship oldest first (SOF), a simple age-selection rule, minimizes waste over an infinite horizon. Akkaş and Honhon, SSRN manuscript.

The paper reports an inventory-age audit of a consumer packaged goods supplier and then studies the shipment decision analytically. Its Theorem 1 separates warehouse waste from the sum of warehouse and store waste. The former has a specified SOF policy that ships in full; the latter has an SOF age-selection rule but allows the shipped quantity to vary with the state. This mission formalizes those two claims, with a correction to one printed clause described below. Akkaş and Honhon, §3 and Theorem 1.

Setting

A unit remains saleable for NNN periods, where N≥1N\ge1N≥1. At the start of a period the warehouse holds xix_ixi​ units of age iii, and the store holds yiy_iyi​ units of that age, for i=1,…,N−1i=1,\ldots,N-1i=1,…,N−1. Both age-zero entries are zero before replenishment. A plant then delivers fresh units so the warehouse's total post-replenishment stock reaches the exogenous order-up-to level SWS^WSW. Thus its age-zero stock is x0post=SW−∑i=1N−1xix^{\mathrm{post}}_0=S^W-\sum_{i=1}^{N-1}x_ix0post​=SW−∑i=1N−1​xi​. The manufacturer sends qiq_iqi​ units of age iii from the warehouse to the store, subject to warehouse availability and the store's shelf capacity LLL. In particular, qi≤xipostq_i\le x^{\mathrm{post}}_iqi​≤xipost​ and ∑iqi+∑iyi≤L\sum_iq_i+\sum_i y_i\le L∑i​qi​+∑i​yi​≤L. Akkaş and Honhon, §4.1, pp. 10–13, and §4.2, p. 15.

The period's shopper population is λ\lambdaλ. A fraction γ∈[0,1]\gamma\in[0,1]γ∈[0,1] selects inventory first in, first out (FIFO), meaning older units first; the remaining shoppers select it last in, first out (LIFO), meaning newer units first. The discrete FIFO population is ⌈γλ⌉\lceil\gamma\lambda\rceil⌈γλ⌉. If zi=yi+qiz_i=y_i+q_izi​=yi​+qi​ is the store stock after delivery, the paper's age-specific demand is

Di(z,λ;γ)=(⌈γλ⌉−∑j>izj)++(λ−⌈γλ⌉−∑j<izj)+.D_i(z,\lambda;\gamma)=\left(\lceil\gamma\lambda\rceil-\sum_{j>i}z_j\right)^+ +\left(\lambda-\lceil\gamma\lambda\rceil-\sum_{j<i}z_j\right)^+.Di​(z,λ;γ)=(⌈γλ⌉−j>i∑​zj​)++(λ−⌈γλ⌉−j<i∑​zj​)+.

Here u+=max⁡(u,0)u^+=\max(u,0)u+=max(u,0). Only units of age N−1N-1N−1 expire at the end of the period. Warehouse waste is WW=xN−1post−qN−1W^W=x^{\mathrm{post}}_{N-1}-q_{N-1}WW=xN−1post​−qN−1​, store waste is WR=(zN−1−DN−1)+W^R=(z_{N-1}-D_{N-1})^+WR=(zN−1​−DN−1​)+, and total waste is W=WW+WRW=W^W+W^RW=WW+WR. The remaining units advance one age before the next period. An SOF shipment uses a younger unit only when every older available unit has been shipped. An SOF shipment in full fills the remaining store space or ships the entire available warehouse stock. Akkaş and Honhon, §4.1, pp. 11–12, and §4.2.1, p. 15.

Formalization targets

Warehouse waste

Let W‾W,+\overline W^{W,+}WW,+ and W‾W,−\overline W^{W,-}WW,− denote the upper and lower limits of expected Cesàro averages of warehouse waste. The first sentence of Theorem 1 is the mission's sole milestone:

W‾W,+(SOF-full;s0)≤W‾W,−(σ;s0)for every feasible initial state s0 and every admissible policy σ.\overline W^{W,+}(\mathrm{SOF\text{-}full};s_0) \le \overline W^{W,-}(\sigma;s_0) \quad\text{for every feasible initial state }s_0\text{ and every admissible policy }\sigma.WW,+(SOF-full;s0​)≤WW,−(σ;s0​)for every feasible initial state s0​ and every admissible policy σ.

Total waste and mission goal

The full goal also asserts that one stationary, feasible SOF policy fff minimizes total waste from every feasible initial state:

∃f  stationary and SOF,W‾+(f;s0)≤W‾−(σ;s0)for all feasible s0 and admissible σ.\exists f\;\text{stationary and SOF},\qquad \overline W^+(f;s_0)\le\overline W^-(\sigma;s_0) \quad\text{for all feasible }s_0\text{ and admissible }\sigma.∃fstationary and SOF,W+(f;s0​)≤W−(σ;s0​)for all feasible s0​ and admissible σ.

The policy fff chooses its shipping quantity from the current state; the theorem does not prescribe shipping in full for this second objective. These are waste objectives, independent of the paper's separate revenue, labor, and expiration-cost parameters. Akkaş and Honhon, Theorem 1, p. 15.

Significance

The warehouse result identifies a fixed, implementable shipment rule for minimizing waste at that location across the paper's whole FIFO/LIFO range. The total-waste result says that optimal age selection can remain SOF even when the quantity decision must respond to the store inventory and shopper behavior. Together they distinguish the two decisions in a setting where moving an expiring unit out of the warehouse can merely move the expiry to the store. The paper later uses its waste comparison in the analysis of profit policies under additional cost assumptions. Akkaş and Honhon, Appendix A.2–A.3.

The theorem is a published paper result, but this mission starts with open Lean statements rather than a machine-checked proof. A complete development would provide a reusable formal model of age-structured two-echelon inventory, stochastic shopper depletion, feasible shipment policies, and long-run waste criteria. The general controlled-process and Cesàro-average definitions can also support other finite inventory models.

Difficulty

An age-selection decision changes the stock carried into future periods, and a quantity decision changes the next warehouse replenishment. A comparison of immediate waste therefore does not by itself compare long-run averages. In particular, simply reordering each shipment to send older units first while keeping its quantity fixed can increase later warehouse waste for some policies; it cannot serve as an unrestricted policy-level argument. The store's FIFO/LIFO mixture introduces another intertemporal effect because a shipped younger unit can be sold ahead of an older one. Akkaş and Honhon, Appendix A.1, Appendix p. 1.

Formalization scope

Lean uses finite age vectors indexed by Fin N, natural-number stocks and shipments, a real γ\gammaγ constrained to [0,1][0,1][0,1], and an arbitrary probability mass function for shopper population. The standing condition N≥1N\ge1N≥1 makes the final age cohort defined; SW=0S^W=0SW=0 and L=0L=0L=0 remain allowed. Demand samples are independent and identically distributed across periods, as in the stationary transition model of §4.2. Policies are time-dependent deterministic Markov rules: at period ttt they choose a shipment from the current inventory state. This is the finite-state class used by the paper's dynamic program. The comparison includes every feasible rule in that class, every feasible initial state, and a common stationary SOF witness for total waste; it does not restrict competitors to SOF or full shipments. Standard finite-MDP results explain why stationary deterministic optimal policies suffice among broader history-dependent randomized classes. Puterman, Markov Decision Processes, Theorem 9.1.8.

Costs and expectations live in [0,∞][0,\infty][0,∞], and long-run criteria use upper and lower limits of expected Cesàro averages. The paper prints a plain limit without specifying what happens when a policy's average fails to converge. The upper-versus-lower comparison states the stronger optimality claim without relying on that convergence. Lean time starts at zero. Natural-number subtraction implements the paper's positive-part operation, and the post-replenishment stock formula is used only for feasible states. The model follows the printed balance equations when discarding the final-age store stock, despite a tension with the narrative timing of expired-unit pickup.

Three transcription corrections are explicit. The demand formula's sums use zjz_jzj​, the running index, where the page prints ziz_izi​; the action sum runs through age N−1N-1N−1; and the waste objectives are minimized despite a printed “max” in §4.2.1. More consequentially, Theorem 1's last clause says shipping is in full under pure FIFO. This is false and is omitted: for γ=1\gamma=1γ=1, N=2N=2N=2, SW=1S^W=1SW=1, L=2L=2L=2, and a Bernoulli(1/2)(1/2)(1/2) shopper population, SOF in full has average total waste 1/21/21/2 while an SOF policy that holds stock back attains 1/41/41/4. The formal goal neither assumes this clause nor asserts its negation. Its feasible-policy and feasible-initial-state quantifiers rule out vacuous or artificially easy readings.

A complete proof may need finite-state inventory invariants, admissibility of the SOF-in-full rule, comparisons of age profiles over time, and results about average costs of controlled chains. Contributions establishing those reusable facts, or the stated warehouse and total-waste targets, are within scope. The separate profit theorems and numerical studies of the paper are outside this mission.

Selected references

  • Akkaş, A., and D. Honhon. Shipment Policies for Products with Fixed Shelf Lives: Impact on Profits and Waste. Authors' SSRN manuscript 3247290, 2021; published in Manufacturing & Service Operations Management. SSRN manuscript; journal DOI.
  • Puterman, M. L. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, 1994. DOI.
4 thms1 active userReviewed
EconomicsProbability·Captain: mikedeng1

Information Inundation on Platforms and Implications: Under Unknown Post Accuracy, Screening for the Largest Expected Variance Reduction Selects the Post Closest to the BeliefResearch Paper

Why consumers read the posts that agree with them

Online platforms show a reader many short signals about the same question (posts, headlines, tweets), more than the reader can absorb. The reader screens the menu and consumes only a few items. Allon, Drakopoulos and Manshadi (Information Inundation on Platforms and Implications, SSRN 3385627; Operations Research, 2021, doi:10.1287/opre.2021.2119) ask what a purely information-seeking reader picks when the accuracy of each post is unknown. Their answer, Proposition 1, is that she picks the post closest to her current belief, the effect the paper calls screening bias. It is the mechanism behind the paper's later results on slow learning and polarization, and it explains a pattern resembling confirmation bias without assuming any bias in how beliefs are updated. Confirmation bias was documented empirically by Lord, Ross and Lepper (1979) and modelled through source reputation by Gentzkow and Shapiro (2006) and Suen (2004). In those models the bias comes from repeated interaction with strategic sources; here it comes from a single screening decision by a Bayesian reader.

The screening model

An unknown fact is a real number θ\thetaθ. A post is a noisy observation

Z=θ+Σ ϵ,Z=\theta+\Sigma\,\epsilon,Z=θ+Σϵ,

where ϵ∼N(0,1)\epsilon\sim\mathcal N(0,1)ϵ∼N(0,1) and the accuracy Σ\SigmaΣ (a standard deviation) is drawn independently from a publicly known law G\mathbb GG. The paper assumes throughout (§3, p. 8) that G\mathbb GG is a probability law whose support lies in an interval [σ‾,σ‾][\underline\sigma,\overline\sigma][σ​,σ] with 0<σ‾≤σ‾0<\underline\sigma\le\overline\sigma0<σ​≤σ.

A consumer holds a normal belief N(μ,s2)\mathcal N(\mu,s^2)N(μ,s2) about θ\thetaθ, with s>0s>0s>0. From her point of view, a post of accuracy σ\sigmaσ is distributed N(μ,σ2+s2)\mathcal N(\mu,\sigma^2+s^2)N(μ,σ2+s2), so its likelihood is

P(Z∣σ;μ,s)=ψ((Z−μ)2,2(σ2+s2)),ψ(x,y)=1π ye−x/y2.(5)P(Z\mid\sigma;\mu,s)=\psi\big((Z-\mu)^2,\sqrt{2(\sigma^2+s^2)}\big),\qquad\psi(x,y)=\frac{1}{\sqrt\pi\,y}e^{-x/y^2}.\tag{5}P(Z∣σ;μ,s)=ψ((Z−μ)2,2(σ2+s2)​),ψ(x,y)=π​y1​e−x/y2.(5)

By Bayes rule (4), her posterior on the accuracy after seeing the post value ZZZ has density proportional to P(Z∣σ;μ,s)P(Z\mid\sigma;\mu,s)P(Z∣σ;μ,s) with respect to G\mathbb GG; write E[ ⋅∣Z;μ,s]\mathbb E[\,\cdot\mid Z;\mu,s]E[⋅∣Z;μ,s] for the posterior expectation.

If she reads a post and learns its accuracy σ\sigmaσ (ex-post known accuracy), her belief becomes normal with standard deviation s′(σ)=s2σ2/(s2+σ2)s'(\sigma)=\sqrt{s^2\sigma^2/(s^2+\sigma^2)}s′(σ)=s2σ2/(s2+σ2)​ (Belief Updating Equations). Before reading, she scores each post by the expected reduction of her uncertainty. The Screening Equation prints the score as

Ssd(Z)=s−E[s′(Σ)∣Z;μ,s],S_{\mathrm{sd}}(Z)=s-\mathbb E\big[s'(\Sigma)\mid Z;\mu,s\big],Ssd​(Z)=s−E[s′(Σ)∣Z;μ,s],

while the text calls it the expected decrease in posterior variance, Svar(Z)=s2−E[s′(Σ)2∣Z;μ,s]S_{\mathrm{var}}(Z)=s^2-\mathbb E[s'(\Sigma)^2\mid Z;\mu,s]Svar​(Z)=s2−E[s′(Σ)2∣Z;μ,s]. A menu is a finite list Z1,…,ZKZ_1,\dots,Z_KZ1​,…,ZK​ of post values, and she picks a post in the argmax of the score.

In Lean the model lives in InfoInundation.Screening.Model: AccuracyLaw G (the standing assumption), psi, likelihood, postExp (the Bayes ratio), nextSd, sdScore, varScore, argmaxMenu, closestPosts, and the auxiliary moments auxMoment/auxExp used in the proof.

Formalization targets

Goal: Proposition 1 (p. 10)

For every accuracy law G\mathbb GG satisfying the standing assumption, every belief (μ,s)(\mu,s)(μ,s) with s>0s>0s>0 and every menu Z1,…,ZKZ_1,\dots,Z_KZ1​,…,ZK​:

(a) if G\mathbb GG is not a point mass,

arg max⁡iS(Zi)=arg min⁡i(Zi−μ)2for S=Ssd and for S=Svar;\operatorname*{arg\,max}_{i}S(Z_i)=\operatorname*{arg\,min}_{i}(Z_i-\mu)^2\quad\text{for }S=S_{\mathrm{sd}}\text{ and for }S=S_{\mathrm{var}};iargmax​S(Zi​)=iargmin​(Zi​−μ)2for S=Ssd​ and for S=Svar​;

(b) if G=δσ\mathbb G=\delta_\sigmaG=δσ​ with σ>0\sigma>0σ>0, the argmax of both scores is the whole menu.

Milestones

The proof on pp. 10–11 has no numbered lemmas; the milestones are its labelled steps:

  1. (5): given Σ=σ\Sigma=\sigmaΣ=σ, the post is N(μ,σ2+s2)\mathcal N(\mu,\sigma^2+s^2)N(μ,σ2+s2) and its density is the ψ\psiψ expression.
  2. (4): in the joint model (θ,Σ,ϵ)(\theta,\Sigma,\epsilon)(θ,Σ,ϵ), the Bayes ratio is a version of E[h(Σ)∣Z]\mathbb E[h(\Sigma)\mid Z]E[h(Σ)∣Z].
  3. (3): Svar(Z)=s4 E[(s2+Σ2)−1∣Z]S_{\mathrm{var}}(Z)=s^4\,\mathbb E[(s^2+\Sigma^2)^{-1}\mid Z]Svar​(Z)=s4E[(s2+Σ2)−1∣Z].
  4. Auxiliary density (p. 11): E[(Σ2+s2)−1∣Z]=Eg[(Σ2+s2)−3/2]/Eg[(Σ2+s2)−1/2]\mathbb E[(\Sigma^2+s^2)^{-1}\mid Z]=\mathbb E_g[(\Sigma^2+s^2)^{-3/2}]/\mathbb E_g[(\Sigma^2+s^2)^{-1/2}]E[(Σ2+s2)−1∣Z]=Eg​[(Σ2+s2)−3/2]/Eg​[(Σ2+s2)−1/2], with g∝dG(σ) e−(Z−μ)2/(2(σ2+s2))g\propto d\mathbb G(\sigma)\,e^{-(Z-\mu)^2/(2(\sigma^2+s^2))}g∝dG(σ)e−(Z−μ)2/(2(σ2+s2)).
  5. Cauchy–Schwarz (p. 11): Eg[w3/2]2≤Eg[w5/2] Eg[w1/2]\mathbb E_g[w^{3/2}]^2\le\mathbb E_g[w^{5/2}]\,\mathbb E_g[w^{1/2}]Eg​[w3/2]2≤Eg​[w5/2]Eg​[w1/2] with w=(Σ2+s2)−1w=(\Sigma^2+s^2)^{-1}w=(Σ2+s2)−1, strict when G\mathbb GG is not a point mass.
  6. Derivative display (p. 11): the derivative in r=(Z−μ)2r=(Z-\mu)^2r=(Z−μ)2 of the ratio in 4, and its sign.
  7. Monotonicity (p. 10): E[(s2+Σ2)−1∣Z]\mathbb E[(s^2+\Sigma^2)^{-1}\mid Z]E[(s2+Σ2)−1∣Z] is non-increasing in (Z−μ)2(Z-\mu)^2(Z−μ)2, strictly decreasing when G\mathbb GG is not a point mass.
  8. Part (b) (p. 10): for G=δσ\mathbb G=\delta_\sigmaG=δσ​ both scores are constant in ZZZ.

Significance

Proposition 1 turns a modelling choice (each reader maximizes expected information) into a behavioural prediction (each reader consumes the post nearest her belief). Every later result of the paper is built on it: the slow-learning theorem, in which the speed of learning decreases with menu size, and the multimodal belief distribution, both come from feeding the closest post back into the belief dynamics. Part (b) is the benchmark: with known equal accuracy there is no screening bias, and learning is fast.

The result is proved in the paper; it has no machine-checked proof. The mission produces one, and with it a small reusable library on posteriors over a Gaussian scale mixture: the predictive density of a normal belief under a known noise scale (milestone 1), a measure-theoretic Bayes rule for the noise scale given one observation (milestone 2), and moment inequalities under exponentially tilted mixing laws (milestones 5–6). The formalization also settles two points that the printed proof leaves open (see Difficulty): which of the two scores the conclusion holds for, and why the conclusion is an equality of sets rather than an inclusion.

Difficulty

The proof covers the variance score. Reducing it to the monotonicity of r↦E[(Σ2+s2)−1∣Z]r\mapsto\mathbb E[(\Sigma^2+s^2)^{-1}\mid Z]r↦E[(Σ2+s2)−1∣Z] in r=(Z−μ)2r=(Z-\mu)^2r=(Z−μ)2 is algebra. The monotonicity itself requires differentiating a ratio of G\mathbb GG-integrals under the integral sign, for an arbitrary law G\mathbb GG, which in turn needs the boundedness of the support to dominate the integrands.

Three places need more than the printed argument:

  • Strictness. The page shows the derivative is ≤0\le0≤0. That gives only "the closest posts are among the maximizers"; the claimed equality of argmax and argmin needs strict decrease, hence the equality case of Cauchy–Schwarz, which uses that the support of G\mathbb GG lies in (0,∞)(0,\infty)(0,∞). Without that standing bound, G=12δ−1+12δ1\mathbb G=\tfrac12\delta_{-1}+\tfrac12\delta_1G=21​δ−1​+21​δ1​ is not a point mass yet every post has the same score.
  • The printed score. The standard-deviation score SsdS_{\mathrm{sd}}Ssd​ is not an affine function of E[(s2+Σ2)−1∣Z]\mathbb E[(s^2+\Sigma^2)^{-1}\mid Z]E[(s2+Σ2)−1∣Z], so steps (3)–(7) do not cover it. It needs the posterior expectation of the increasing function σ↦s′(σ)\sigma\mapsto s'(\sigma)σ↦s′(σ) to increase strictly in (Z−μ)2(Z-\mu)^2(Z−μ)2, a statement the paper does not prove.
  • The derivative display omits a factor 12\tfrac1221​; the sign is unaffected.

Formalization scope

  • All quantities are real; G\mathbb GG is a Measure ℝ with AccuracyLaw G: a probability measure with G([σ‾,σ‾]c)=0\mathbb G([\underline\sigma,\overline\sigma]^{\mathrm c})=0G([σ​,σ]c)=0 for some 0<σ‾≤σ‾0<\underline\sigma\le\overline\sigma0<σ​≤σ. "Supp(G\mathbb GG) includes at least two distinct values" is ∀ σ, G ≠ Measure.dirac σ; "Supp(G\mathbb GG) = {σ}" is G = Measure.dirac σ with σ>0\sigma>0σ>0.
  • "For any consumer xxx and time ttt" is any μ∈R\mu\in\mathbb Rμ∈R and s>0s>0s>0. Reachable states have s∈(0,1]s\in(0,1]s∈(0,1], so this is a mild generalization.
  • Accuracy is ex-post known (σ^=Σ\hat\sigma=\Sigmaσ^=Σ inside the expectation), which is the case the proof treats. The paper's remark that the conclusion also holds for ex-post unknown accuracy is not formalized.
  • The menu is Z : Fin K → ℝ; argmax and argmin are Finset (Fin K), so posts of equal value are distinct posts, and "=Kx(t)=K_x(t)=Kx​(t)" is Finset.univ.
  • The goal states the conclusion for both SsdS_{\mathrm{sd}}Ssd​ (as printed) and SvarS_{\mathrm{var}}Svar​ (as described and as proved).
  • Added relative to the page, and disclosed in each item: the strict forms of milestones 5 and 7, and the factor 12\tfrac1221​ in milestone 6.
  • No trivialization. The posterior is the Bayes ratio (4) with the Gaussian likelihood (5) for an arbitrary G\mathbb GG; neither score is defined through (Z−μ)2(Z-\mu)^2(Z−μ)2, and a statement in which the score is replaced by a closed form, the menu by two posts, or the set equality by an inclusion is not this goal.

Needed infrastructure: dominated differentiation of parameter-dependent integrals against a finite measure on a bounded set (Mathlib's hasDerivAt_integral_of_dominated_loc_of_deriv_le), the equality case of Cauchy–Schwarz in L2(g)L^2(g)L2(g), Gaussian convolution (gaussianReal_add_gaussianReal_of_indepFun) and conditional expectation via densities for milestone 2. Contributions of a covariance or likelihood-ratio ordering lemma for the standard-deviation conjunct are welcome as supporting theorems.

Selected references

  • G. Allon, K. Drakopoulos, V. Manshadi, Information Inundation on Platforms and Implications, SSRN 3385627, version of 2020-04-05. https://ssrn.com/abstract=3385627 ; Operations Research, 2021. https://doi.org/10.1287/opre.2021.2119
  • M. Gentzkow, J. M. Shapiro, Media Bias and Reputation, Journal of Political Economy 114(2), 2006. https://doi.org/10.1086/499414
  • W. Suen, The Self-Perpetuation of Biased Beliefs, The Economic Journal 114(495), 2004. https://doi.org/10.1111/j.1468-0297.2004.00213.x
  • C. G. Lord, L. Ross, M. R. Lepper, Biased Assimilation and Attitude Polarization, Journal of Personality and Social Psychology 37(11), 1979. https://doi.org/10.1037/0022-3514.37.11.2098
10 thms1 active userReviewed
EconomicsProbability·Captain: mikedeng1

Enabling Entrepreneurial Choice: A Strategy-Biased Test (λ_s = 1) Is Preferred to an Idea-Biased Test (λ_v = 1) if (1 − p₀)e₀(1 − λ_s)C > (1 − λ_v)p₀(1 − e₀)(e₀v − C)Research Paper

Motivation

A new venture rarely knows two things at once: whether its core idea is worth anything, and whether the particular way it has chosen to bring the idea to market — its strategy — will work. A failed pilot, a disappointing A/B test or a lukewarm customer experiment can mean either, and the founder cannot tell which. Work on entrepreneurial experimentation (Kerr, Nanda and Rhodes-Kropf, Journal of Economic Perspectives, 2014, doi:10.1257/jep.28.3.25; Gans, Stern and Wu, Strategic Management Journal, 2019, doi:10.1002/smj.3010) treats testing as the main tool founders have to resolve uncertainty before they commit resources.

Agrawal, Gans and Stern (NBER Working Paper 27379, 2020; published in Management Science, 2021, doi:10.1287/mnsc.2020.3920) give a two-period model in which a single test produces a conflated signal about the idea and the strategy together. Two consequences come out of it. A signal that the strategy is good can still lead the entrepreneur to abandon the venture. And when a mentor can sharpen a test, the better direction to sharpen it depends on the founder's prior beliefs. This mission formalizes the model and its two propositions.

Setting

The idea is worth v>0v>0v>0 (state hhh) with prior probability p0p_0p0​, or 000 (state lll). Value is realized only if the strategy used is effective (state ggg, against ineffective bbb). Every strategy is effective with prior probability e0e_0e0​, independently of every other strategy and of the idea, and there are several strategies to choose from. Implementing a strategy costs CCC and testing one costs ccc. The standing assumptions are

0<p0<1,0<e0<1,V0:=e0p0v−C=0,c<C,0<p_0<1,\qquad 0<e_0<1,\qquad V_0 := e_0p_0v - C = 0,\qquad c<C,0<p0​<1,0<e0​<1,V0​:=e0​p0​v−C=0,c<C,

where V0=0V_0=0V0​=0 means that launching a randomly chosen strategy without testing exactly breaks even.

A test of the selected strategy has precisions (λv,λs)∈[0,1]2(\lambda_v,\lambda_s)\in[0,1]^2(λv​,λs​)∈[0,1]2 and emits one of four signals, (H,G)(H,G)(H,G), (H,B)(H,B)(H,B), (L,G)(L,G)(L,G) or (L,B)(L,B)(L,B):

hhhlll
ggg(H,G)(H,G)(H,G) w.p. 111(L,G)(L,G)(L,G) w.p. λs\lambda_sλs​, (H,B)(H,B)(H,B) w.p. 1−λs1-\lambda_s1−λs​
bbb(H,B)(H,B)(H,B) w.p. λv\lambda_vλv​, (L,G)(L,G)(L,G) w.p. 1−λv1-\lambda_v1−λv​(L,B)(L,B)(L,B) w.p. 111

Write p1(σ)p_1(\sigma)p1​(σ) and e1(σ)e_1(\sigma)e1​(σ) for the posterior probabilities that the idea is high-value and that the tested strategy is effective, given signal σ\sigmaσ. Assumption (A1), that tests are weakly informative, requires

p1(H,B)≥p0,p1(L,G)≤p0,e1(H,B)≤e0,e1(L,G)≥e0.p_1(H,B)\ge p_0,\quad p_1(L,G)\le p_0,\quad e_1(H,B)\le e_0,\quad e_1(L,G)\ge e_0 .p1​(H,B)≥p0​,p1​(L,G)≤p0​,e1​(H,B)≤e0​,e1​(L,G)≥e0​.

After the signal the entrepreneur picks one of three period-1 actions:

  • implement the tested strategy, which pays v−Cv-Cv−C in state (h,g)(h,g)(h,g) and −C-C−C otherwise;
  • implement another randomly chosen strategy, which pays e0v−Ce_0v-Ce0​v−C in expectation when the idea is high-value and −C-C−C when it is not;
  • abandon the venture, which pays 000.

V1(σ)V_1(\sigma)V1​(σ) is the best of these three conditional values. The value of testing is

V0(λv,λs)=∑σPr⁡(σ) V1(σ)−c.V_0(\lambda_v,\lambda_s)=\sum_{\sigma}\Pr(\sigma)\,V_1(\sigma)-c .V0​(λv​,λs​)=σ∑​Pr(σ)V1​(σ)−c.

The strategy-biased test is (λv,1)(\lambda_v,1)(λv​,1) and the idea-biased test is (1,λs)(1,\lambda_s)(1,λs​), where (λv,λs)(\lambda_v,\lambda_s)(λv​,λs​) is the baseline test.

Formalization targets

Goal: Proposition 2 (p. 17)

For baseline precisions λv,λs∈[0,1]\lambda_v,\lambda_s\in[0,1]λv​,λs​∈[0,1], if both precise tests satisfy (A1) and

(1−p0)e0(1−λs)C>(1−λv)p0(1−e0)(e0v−C),(1-p_0)e_0(1-\lambda_s)C>(1-\lambda_v)p_0(1-e_0)(e_0v-C),(1−p0​)e0​(1−λs​)C>(1−λv​)p0​(1−e0​)(e0​v−C),

then

V0(1,λs)<V0(λv,1).V_0(1,\lambda_s)<V_0(\lambda_v,1).V0​(1,λs​)<V0​(λv​,1).

The statement leaves p0,e0,v,cp_0,e_0,v,cp0​,e0​,v,c and the baseline precisions free, subject only to the standing assumptions.

Milestones

  1. Bayes posteriors (§3.1, p. 9): closed forms of p1p_1p1​ and e1e_1e1​ after (H,B)(H,B)(H,B) and (L,G)(L,G)(L,G).
  2. (A1) in ratio form (p. 9): for 0<λv,λs<10<\lambda_v,\lambda_s<10<λv​,λs​<1, each posterior clause is equivalent to a ratio condition such as λv/(1−λs)≥e0/(1−e0)\lambda_v/(1-\lambda_s)\ge e_0/(1-e_0)λv​/(1−λs​)≥e0​/(1−e0​).
  3. Case 3 (p. 11): after (H,B)(H,B)(H,B), switching to another strategy is optimal, and V1(H,B)=e0p1(H,B)v−CV_1(H,B)=e_0p_1(H,B)v-CV1​(H,B)=e0​p1​(H,B)v−C.
  4. Case 4 (p. 11): after (L,G)(L,G)(L,G), abandoning is optimal and V1(L,G)=0V_1(L,G)=0V1​(L,G)=0.
  5. Proposition 1 (p. 12): the tested strategy is implemented only after (H,G)(H,G)(H,G); after (H,B)(H,B)(H,B) and (L,G)(L,G)(L,G), switching beats implementing the tested strategy; after (L,B)(L,B)(L,B), and after (L,G)(L,G)(L,G) when V0=0V_0=0V0​=0, the venture is abandoned.
  6. The V0V_0V0​ display, first line (p. 12): for every (A1) test,
V0(λv,λs)=p0e0(v−C)+(p0(1−e0)λv+(1−p0)e0(1−λs))V1(H,B)−c.V_0(\lambda_v,\lambda_s)=p_0e_0(v-C)+\bigl(p_0(1-e_0)\lambda_v+(1-p_0)e_0(1-\lambda_s)\bigr)V_1(H,B)-c .V0​(λv​,λs​)=p0​e0​(v−C)+(p0​(1−e0​)λv​+(1−p0​)e0​(1−λs​))V1​(H,B)−c.

Significance

Proposition 2 answers the question a mentor faces when it can make a test more precise in one direction only. A test with high λs\lambda_sλs​ makes abandoning a poor idea more efficient. A test with high λv\lambda_vλv​ makes it more efficient to continue the idea with a different strategy. The condition weighs these two benefits, and it shows that the choice is driven by the prior (p0,e0)(p_0,e_0)(p0​,e0​). Proposition 1 shows why: the idea is the same in every test while the strategy can change, so switching strategies after an ambiguous signal is how the entrepreneur learns about the idea. The paper's later sections (differing priors between mentor and entrepreneur, §5.2) start from these two results.

The results are proved in the paper by hand-calculation, and Proposition 2 has no printed proof. No part of the model has been machine-checked before. The formalization produces an explicit, reusable encoding of a two-dimensional Bayesian test with a conflated signal, together with machine-checked versions of the case analysis that Proposition 1 summarizes. It also gives a checked replacement for the printed V0V_0V0​ display: the second line of that display does not follow from the first.

Difficulty

The obvious argument reads the paper's prose, takes V1(L,G)=0V_1(L,G)=0V1​(L,G)=0 and V1(H,B)=e0p1(H,B)v−CV_1(H,B)=e_0p_1(H,B)v-CV1​(H,B)=e0​p1​(H,B)v−C as given, and subtracts. In the formal model these values are optima over three actions, computed from the signal table, and each one needs an argument.

  • The (L,G)(L,G)(L,G) case is not what intuition suggests. The posterior on the tested strategy rises, yet implementing it is never profitable, because a good strategy produces (L,G)(L,G)(L,G) only when the idea is worthless.
  • At the precise tests some signals have probability zero. For example, (H,B)(H,B)(H,B) never occurs at (0,1)(0,1)(0,1), and the posterior p1(H,B)p_1(H,B)p1​(H,B) is undefined there. The comparison has to stay valid on that boundary.
  • (A1) is weak, so several of the paper's strict inequalities hold only with equality allowed. The case analysis has to be done without them.

Formalization scope

The model lives in the namespace EntrepChoice.TestChoice. Params holds p0,e0,v,C,cp_0,e_0,v,C,cp0​,e0​,v,C,c. Standing collects the standing assumptions, with V0=0V_0=0V0​=0 kept as the hypothesis e0p0v−C=0e_0p_0v-C=0e0​p0​v−C=0 rather than substituted. Test holds (λv,λs)(\lambda_v,\lambda_s)(λv​,λs​), and Test.Valid bounds both in [0,1][0,1][0,1]. The states, signals and actions are small inductive types, and sums over them are written out explicitly.

Action values are unnormalized: Pr⁡(σ)\Pr(\sigma)Pr(σ) times the conditional expected payoff. With this choice V0(λv,λs)V_0(\lambda_v,\lambda_s)V0​(λv​,λs​) (testValue) needs no division. (A1) is stated cross-multiplied by Pr⁡(σ)\Pr(\sigma)Pr(σ). It agrees with the posterior form whenever Pr⁡(σ)>0\Pr(\sigma)>0Pr(σ)>0 and is harmless when Pr⁡(σ)=0\Pr(\sigma)=0Pr(σ)=0. The posteriors p1 and e1 are real quotients, equal to 000 on a probability-zero signal.

Several conventions are disclosed readings of the paper:

  • Proposition 1's second sentence is missing its verb; it is read as "is strictly better than".
  • The strict inequalities that weak (A1) cannot support are stated weakly.
  • Proposition 1 is posed for the baseline range 0<λv,λs<10<\lambda_v,\lambda_s<10<λv​,λs​<1 of p. 7.
  • The goal assumes (A1) for the two precise tests. (A1) at the baseline test implies this.
  • The second printed line of the V0V_0V0​ display is not stated.

testValue is the maximum over the three period-1 actions, built from the signal table. It is never defined by the closed form of milestone 6, and neither Standing nor A1 mentions it, so the goal cannot be closed by unfolding a definition.

Contributions are welcome on every milestone. Further results of the paper — testing order under irreversibility (§4.1), heterogeneous strategy priors (§4.2) and the mentor–entrepreneur game with differing priors (§5.2) — are natural follow-on missions on the same definitions.

Selected references

  • A. K. Agrawal, J. S. Gans, S. Stern, Enabling Entrepreneurial Choice, NBER Working Paper 27379, June 2020. https://www.nber.org/papers/w27379 — published in Management Science, 2021. https://doi.org/10.1287/mnsc.2020.3920
  • J. S. Gans, S. Stern, J. Wu, Foundations of Entrepreneurial Strategy, Strategic Management Journal 40(5), 2019. https://doi.org/10.1002/smj.3010
  • W. R. Kerr, R. Nanda, M. Rhodes-Kropf, Entrepreneurship as Experimentation, Journal of Economic Perspectives 28(3), 2014. https://doi.org/10.1257/jep.28.3.25
8 thms1 active userReviewed
CombinatoricsMachine Learning·Captain: mikedeng1

Private Sequential Learning: The Query Complexity of an (ϵ, δ, L)-Private Learner Lies Between max{log(1/ϵ), log(δ/ϵ) + 2L − 4} and log(1/(Lϵ)) + 2LResearch Paper

Motivation

A learner wants to locate an unknown number, the true value v∗∈[0,1)v^* \in [0,1)v∗∈[0,1), by asking threshold questions of a database: each query qqq is answered by the single bit I(v∗≥q)\mathbb I(v^* \ge q)I(v∗≥q). Bisection finds v∗v^*v∗ to within ϵ/2\epsilon/2ϵ/2 with ⌈log⁡2(1/ϵ)⌉\lceil \log_2(1/\epsilon) \rceil⌈log2​(1/ϵ)⌉ queries, and no strategy does better (Waeber, Frazier and Henderson, 2013). Bisection, however, reveals everything: each query is a function of the previous answers, so anyone who sees the queries can reconstruct the answers and hence v∗v^*v∗.

Tsitsiklis, Xu and Xu study a learner whose queries, but not the answers, are watched by an adversary. Their motivating examples (pp. 2–3) are a firm testing prices whose surveys a competitor can observe, a consumer browsing products on a platform that sees what is browsed, and an optimizer whose test points are visible to the database it queries. The question is how many queries the learner needs if she must find v∗v^*v∗ accurately while keeping the adversary uncertain about it.

The model is from the authors' COLT 2018 extended abstract and Z. Xu's master's thesis (MIT, 2017); the journal version appeared in Operations Research (2021). This mission formalizes arXiv version 3 (26 Feb 2020), and all page and theorem numbers refer to it.

Setting

The learner submits NNN queries one at a time. A random seed YYY, uniform on {1,…,Yˉ}\{1, \dots, \bar Y\}{1,…,Yˉ}, lets her randomize. A learner strategy ϕ\phiϕ of length NNN consists of query maps ϕk\phi_kϕk​ and an estimation map ϕE\phi^EϕE (§2.1, p. 8): the kkk-th query is qk=ϕk(r1,…,rk−1,Y)∈[0,1)q_k = \phi_k(r_1, \dots, r_{k-1}, Y) \in [0,1)qk​=ϕk​(r1​,…,rk−1​,Y)∈[0,1), where ri=I(v∗≥qi)r_i = \mathbb I(v^* \ge q_i)ri​=I(v∗≥qi​) are the responses so far, and the estimate is x^=ϕE(r1,…,rN,Y)∈[0,1)\hat x = \phi^E(r_1, \dots, r_N, Y) \in [0,1)x^=ϕE(r1​,…,rN​,Y)∈[0,1). The class ΦN\Phi_NΦN​ consists of the strategies of length NNN that submit pairwise distinct queries. Write qˉ(x,y)\bar q(x,y)qˉ​(x,y) for the queries and x^(x,y)\hat x(x,y)x^(x,y) for the estimate when v∗=xv^* = xv∗=x and Y=yY = yY=y.

The adversary knows ϕ\phiϕ and sees qˉ\bar qqˉ​. The set of query sequences that can occur when v∗=xv^* = xv∗=x is Q(x)={qˉ(x,y):y}\mathcal Q(x) = \{\bar q(x,y) : y\}Q(x)={qˉ​(x,y):y} (eq. (1)), and the adversary's information set is

I(qˉ)={x∈[0,1):qˉ∈Q(x)}(Definition 3.1, p. 9).\mathcal I(\bar q) = \{x \in [0,1) : \bar q \in \mathcal Q(x)\} \qquad \text{(Definition 3.1, p. 9).}I(qˉ​)={x∈[0,1):qˉ​∈Q(x)}(Definition 3.1, p. 9).

Its size is measured by the δ\deltaδ-cover number Cδ(E)C_\delta(E)Cδ​(E), the least number of closed intervals of length at most δ\deltaδ whose union contains EEE (Definition 3.2, p. 10). A strategy is (ϵ,δ,L)(\epsilon, \delta, L)(ϵ,δ,L)-private (Definition 3.3, p. 10) if

  1. it is accurate: ∣x^(x,y)−x∣≤ϵ/2|\hat x(x,y) - x| \le \epsilon/2∣x^(x,y)−x∣≤ϵ/2 for every x∈[0,1)x \in [0,1)x∈[0,1) and every seed yyy; and
  2. it is private: Cδ(I(qˉ))≥LC_\delta(\mathcal I(\bar q)) \ge LCδ​(I(qˉ​))≥L for every x∈[0,1)x \in [0,1)x∈[0,1) and every qˉ∈Q(x)\bar q \in \mathcal Q(x)qˉ​∈Q(x).

The query complexity is N∗(ϵ,δ,L)=min⁡{N:ΦN contains an (ϵ,δ,L)-private strategy}N^*(\epsilon, \delta, L) = \min\{N : \Phi_N \text{ contains an } (\epsilon,\delta,L)\text{-private strategy}\}N∗(ϵ,δ,L)=min{N:ΦN​ contains an (ϵ,δ,L)-private strategy} (eq. (5), p. 11). All logarithms are base 2 and are rounded up (footnote 1, p. 4).

Formalization targets

Goal: Theorem 4.1 (p. 12)

For ϵ>0\epsilon > 0ϵ>0, δ>0\delta > 0δ>0 and an integer L≥2L \ge 2L≥2 with 2ϵ<δ≤1/L2\epsilon < \delta \le 1/L2ϵ<δ≤1/L,

max⁡{⌈log⁡21ϵ⌉, ⌈log⁡2δϵ⌉+2L−4}≤N∗(ϵ,δ,L)≤⌈log⁡21Lϵ⌉+2L.\max\left\{ \left\lceil \log_2 \tfrac1\epsilon \right\rceil,\ \left\lceil \log_2 \tfrac\delta\epsilon \right\rceil + 2L - 4 \right\} \le N^*(\epsilon,\delta,L) \le \left\lceil \log_2 \tfrac{1}{L\epsilon} \right\rceil + 2L.max{⌈log2​ϵ1​⌉, ⌈log2​ϵδ​⌉+2L−4}≤N∗(ϵ,δ,L)≤⌈log2​Lϵ1​⌉+2L.

Upper bound (§6)

The Opportunistic Bisection (OB) strategy first places LLL "guesses" [i/L,i/L+ϵ)[i/L, i/L+\epsilon)[i/L,i/L+ϵ) with 2L2L2L fixed queries, and then runs a bisection of ⌈log⁡2(1/(ϵL))⌉\lceil \log_2(1/(\epsilon L)) \rceil⌈log2​(1/(ϵL))⌉ steps in one of the gaps. The bisection is truthful if no guess caught v∗v^*v∗, and driven by the seed otherwise. The milestones are: OB is accurate; the union of guesses G\mathcal GG has Cδ(G)≥LC_\delta(\mathcal G) \ge LCδ​(G)≥L (Claim 6.3); G⊆I(qˉ)\mathcal G \subseteq \mathcal I(\bar q)G⊆I(qˉ​) for every observable qˉ\bar qqˉ​ (Claim 6.4); the cover number is monotone; and OB is (ϵ,δ,L)(\epsilon,\delta,L)(ϵ,δ,L)-private (Proposition 6.2).

Lower bound (§7)

For an accurate strategy, the final interval between consecutive sorted queries (with q0=0q_0 = 0q0​=0, qN+1=1q_{N+1} = 1qN+1​=1) has length at most ϵ\epsilonϵ (§7.1), so I(qˉ)⊆Iˉ(qˉ)\mathcal I(\bar q) \subseteq \bar{\mathcal I}(\bar q)I(qˉ​)⊆Iˉ(qˉ​), the union of special intervals (display (20)). Lemma 7.1 puts ⌈log⁡2(δ/ϵ)⌉\lceil \log_2(\delta/\epsilon) \rceil⌈log2​(δ/ϵ)⌉ queries in (0,δ)(0,\delta)(0,δ) for some true value, and accuracy alone gives N≥⌈log⁡2(1/ϵ)⌉N \ge \lceil \log_2(1/\epsilon) \rceilN≥⌈log2​(1/ϵ)⌉. A covering bound gives Cδ(Iˉ(qˉ))≤(K+3)/2C_\delta(\bar{\mathcal I}(\bar q)) \le (K+3)/2Cδ​(Iˉ(qˉ​))≤(K+3)/2, with KKK the number of special queries in [δ,1][\delta, 1][δ,1] (p. 21). Together these give N≥⌈log⁡2(δ/ϵ)⌉+2L−4N \ge \lceil \log_2(\delta/\epsilon) \rceil + 2L - 4N≥⌈log2​(δ/ϵ)⌉+2L−4 for every private strategy.

Corollary 4.2 (the case δ=1/L\delta = 1/Lδ=1/L) is Theorem 4.1 specialized and is not posed separately.

Significance

The result. The theorem gives the cost of privacy in this model up to an additive constant. At δ=1/L\delta = 1/Lδ=1/L the two bounds differ by at most 4 (Corollary 4.2), and the extra cost over plain bisection is at most an additive 2L2L2L. That is much less than the non-adaptive ϵ\epsilonϵ-dense strategy, which is always private but needs about 1/ϵ1/\epsilon1/ϵ queries (§5). The lower bound also shows that the 2L2L2L obfuscating queries cannot be shared with the queries that locate v∗v^*v∗ (§7, p. 19).

Formalizing it. The result is proved on paper, but Lemma 7.1 is given only an intuitive argument: the paper calls its proof "fairly standard" and omits it (p. 20). The covering step on p. 21 is argued component by component, with an exceptional component straddling δ\deltaδ. A formal development supplies both and checks the bookkeeping behind the constants −4-4−4, +3+3+3 and 2L−32L - 32L−3. To our knowledge, no machine-checked proof of this theorem or of the bisection lower bound in this form exists.

Difficulty

The upper bound is a construction. Its delicate point is Claim 6.4. For every point ggg of every guess one must exhibit a seed under which ggg produces exactly the observed queries, and that seed differs according to whether the observed run was truthful or fictitious.

The lower bound is harder. Counting queries is not enough by itself, because the obvious argument conflates query values with query indices. Lemma 7.1 counts indices along a single run (a fixed true value and seed). The covering bound counts distinct values in [δ,1][\delta,1][δ,1], one of which may be the artificial point 111. The natural first idea, a direct counting bound on N∗N^*N∗, is unavailable: N∗N^*N∗ is a minimum, so a lower bound must be proved for every private strategy of every length. Only the goal speaks about N∗N^*N∗, where the upper bound shows the set being minimized is nonempty.

Formalization scope

Everything lives in the namespace PrivSeqLearn.QueryComplexity, built on Mathlib with no measure theory in any statement. Conventions:

  • The seed space is Fin Ybar with 0 < Ybar. "Positive probability" is read as "for some seed" and "probability one" as "for every seed", which is exact for a uniform seed on a finite set.
  • Response histories are List Bool, and the response to qqq at true value xxx is decide (q ≤ x). Queries are 0-indexed (Fin N).
  • ΦN\Phi_NΦN​ (InPhi) requires query values on every history of length <N< N<N and estimate values on every history of length NNN to lie in [0,1)[0,1)[0,1), and the queries to be pairwise distinct for every x∈[0,1)x \in [0,1)x∈[0,1) and seed.
  • Covers are Fin L-indexed families of closed intervals Set.Icc. CδC_\deltaCδ​ and N∗N^*N∗ are sInf over N\mathbb NN, which equals the minimum when the set is nonempty.
  • Every logarithm term is ⌈Real.logb 2 ·⌉ computed in Z\mathbb ZZ, so 2L−42L - 42L−4 never truncates. In the regime, all log arguments exceed 1.
  • The OB seed is {0,…,L⋅2M−1}\{0, \dots, L \cdot 2^M - 1\}{0,…,L⋅2M−1}, decoded as the gap J~\tilde{\mathcal J}J~​ and the bits Z1,…,ZMZ_1, \dots, Z_MZ1​,…,ZM​. The OB estimate, specified in the paper only inside the proof of Proposition 6.2, is the guess mid-point or the mid-point of the final bisection interval.
  • Disclosed deviations from the page:
    • Lemma 7.1 assumes δ≤1\delta \le 1δ≤1.
    • The lower-bound milestones do not assume distinct queries, which is a strengthening.
    • The OB-only milestones use 2ϵ<1/L2\epsilon < 1/L2ϵ<1/L in place of 2ϵ<δ≤1/L2\epsilon < \delta \le 1/L2ϵ<δ≤1/L.
    • Cover-number monotonicity assumes a bounded superset.

Trivializing encodings are ruled out:

  • an empty seed space is excluded by 0 < Ybar;
  • information sets range over [0,1)[0,1)[0,1) only;
  • privacy is required for every true value and every observable query sequence;
  • OB is the constructed strategy, not "some strategy".

Contributions are welcome on any milestone. The bisection lower bounds (Lemma 7.1 and the log⁡2(1/ϵ)\log_2(1/\epsilon)log2​(1/ϵ) bound) and the interval-covering facts are reusable beyond this mission.

Selected references

  • J. N. Tsitsiklis, K. Xu, Z. Xu, Private Sequential Learning, arXiv:1805.02136v3, 2020; Operations Research, 2021. https://arxiv.org/abs/1805.02136
  • R. Waeber, P. I. Frazier, S. G. Henderson, Bisection search with noisy responses, SIAM Journal on Control and Optimization 51(3):2261–2279, 2013. https://doi.org/10.1137/120861898
  • M. Horstein, Sequential transmission using noiseless feedback, IEEE Transactions on Information Theory 9(3):136–143, 1963. https://doi.org/10.1109/TIT.1963.1057832
  • Z. Xu, Private sequential search and optimization, Master's thesis, MIT, 2017. http://hdl.handle.net/1721.1/112054
15 thms1 active userReviewed
Algorithmic Game TheoryEconomicsProbability·Captain: mikedeng1

Information Provision and Farmer Welfare in Developing Economies: Giving the Public Signal to One Farmer or to None Maximizes Total Farmer WelfareResearch Paper

Motivation

Farmers who sell the same crop can benefit from better forecasts of the market price, but their production decisions also affect one another through the price. A forecast sent to one farmer may improve that farmer’s decision; a forecast sent to many farmers can make their output responses move together. A planner choosing who receives a common forecast therefore faces a question that differs from asking whether the forecast is accurate. Zhou, Fan, Chen and Tang study this question for a public signal about the uncertain intercept of a Cournot market’s inverse demand curve in Information Provision and Farmer Welfare in Developing Economies (SSRN preprint dated June 27, 2019, §§3–4).

The paper’s base model concerns a publicly funded information service. The planner can send the same signal to any number of farmers without charging them, and its objective is the sum of farmers’ expected profits. The target here is the paper’s Proposition 2, which says that the planner should inform either exactly one farmer or none, according to the sign of an explicit polynomial in the model’s signal precisions and number of farmers. The statement is about equilibrium production choices and the resulting profits, rather than about forecast quality alone (Zhou et al., pp. 11, 14).

Setting

There are n≥4n\geq4n≥4 farmers producing the same good with deterministic yield. Farmer iii chooses a quantity qiq_iqi​ and pays cqicq_icqi​. The total harvest is Q=∑iqiQ=\sum_iq_iQ=∑i​qi​, and the inverse demand at sale is P(Q)=a−bQ+uP(Q)=a-bQ+uP(Q)=a−bQ+u, where a>0a>0a>0 is market potential, b>0b>0b>0 measures price sensitivity, and uuu is a centered Gaussian demand shock. Farmer iii earns (P(Q)−c)qi(P(Q)-c)q_i(P(Q)−c)qi​. The quantities in this formalization are real valued, as required by the paper’s affine equilibrium formula; this interpretation is explained below (Zhou et al., p. 8, (1); p. 10, (2)–(3)).

Each farmer sees a private signal xi=u+ϵix_i=u+\epsilon_ixi​=u+ϵi​. The ϵi\epsilon_iϵi​ are independent centered Gaussian noises of common precision γ>0\gamma>0γ>0; the shock uuu has precision α>0\alpha>0α>0. Thus their variances are 1/γ1/\gamma1/γ and 1/α1/\alpha1/α. A planner also observes a public signal y=u+ϵry=u+\epsilon_ry=u+ϵr​, where the independent Gaussian noise ϵr\epsilon_rϵr​ has precision β>0\beta>0β>0 and variance 1/β1/\beta1/β. The planner chooses an informed set III of farmers who may see yyy; every farmer sees only its own xix_ixi​, and an uninformed farmer cannot use yyy. Write n1=∣I∣n_1=|I|n1​=∣I∣, so n1n_1n1​ is an integer from zero through nnn (Zhou et al., pp. 8–9).

A farmer’s strategy is a measurable function of the information available to that farmer. The realized quantity must be square-integrable under the joint Gaussian law. A Bayesian Nash equilibrium is a profile of such strategies in which no farmer can increase ex-ante expected profit by changing only its own admissible strategy. Write welfare⁡(I,σ)\operatorname{welfare}(I,\sigma)welfare(I,σ) for the sum of the expected profits of all farmers at a profile σ\sigmaσ. Proposition 1 gives a linear equilibrium and its almost-sure uniqueness. Lemma 2 gives the ex-ante profit of each informed and uninformed farmer at that equilibrium (Zhou et al., pp. 12, 14, 34).

Formalization targets

The goal is the equilibrium welfare conclusion of Proposition 2. Let V(n,β;γ)V(n,\beta;\gamma)V(n,β;γ) be the explicit polynomial displayed in that proposition, with α\alphaα also fixed by the model. For every informed set, an equilibrium exists. When V>0V>0V>0, every one-farmer informed set strictly outperforms all sets of another size. When V≤0V\leq0V≤0, the empty informed set is optimal; for V<0V<0V<0 it strictly outperforms every nonempty set:

n1∗=1if V(n,β;γ)>0,n1∗=0if V(n,β;γ)≤0.n_1^*=1\quad\text{if }V(n,\beta;\gamma)>0,\qquad n_1^*=0\quad\text{if }V(n,\beta;\gamma)\leq0.n1∗​=1if V(n,β;γ)>0,n1∗​=0if V(n,β;γ)≤0.

At V=0V=0V=0, informing zero and one farmer gives the same welfare, so the second case asserts that zero is an optimal choice rather than the unique choice. The goal compares welfare⁡(I,σ)\operatorname{welfare}(I,\sigma)welfare(I,σ) for every Bayesian Nash equilibrium of each informed set, allowing any subset of the prescribed size (Zhou et al., p. 14, Proposition 2; p. 36).

The milestone statements follow the claims used for that result: Lemma 1’s two Gaussian posterior identities; Proposition 1’s equilibrium existence and almost-sure uniqueness; Lemma 2’s profit formulas and advantage for informed farmers; and the Appendix A claims that welfare declines after two recipients, one recipient beats two, and the sign of W(1)−W(0)W(1)-W(0)W(1)−W(0) is controlled by VVV (Zhou et al., pp. 10, 12, 14, 35–36). Here W(t)W(t)W(t) is the paper’s closed-form welfare expression for the linear equilibrium, extended from integer n1n_1n1​ to real ttt only for the paper’s continuous analysis.

Significance

The result identifies the welfare-optimal reach of a common forecast in a competitive production market. Under the stated model, informing more farmers does not necessarily raise their aggregate expected profit. The threshold VVV decides whether the planner should send the signal to one farmer or withhold it. Proposition 1 and Lemma 2 are needed to connect that policy claim to farmers’ actual equilibrium decisions, rather than to a free-standing polynomial comparison (Zhou et al., pp. 12–14).

The paper proves the result mathematically. This mission asks for a machine-checked development of the Gaussian signal model, the equilibrium result, the profit identities, and the final optimization statement. The Gaussian posterior and square-integrable game infrastructure can be reused in other information provision models. The proposal statements compile, but their proofs are open; no machine-checked proof of these mission claims is asserted here.

Difficulty

The planner can compare policies only after accounting for how all farmers change production when the public signal is shared. Informed farmers use both their private observation and the common signal, while uninformed farmers use only their private observation; the same signal changes both the informed farmers’ expected profit and the Cournot price faced by everyone. The linear equilibrium formula alone does not justify restricting all possible strategies to linear ones. The proof must establish that it is an equilibrium against every admissible deviation and that any equilibrium gives the same realized quantities almost surely. The integer policy choice must then be related to the paper’s real extension W(t)W(t)W(t) without allowing noninteger informed sets (Zhou et al., pp. 32–36).

Formalization scope

Lean represents the uncertainty by a product of independent Gaussian measures for uuu, the nnn private noises, and the public noise. The variances are the reciprocals of the positive precisions α\alphaα, γ\gammaγ, and β\betaβ. Informed sets are finite subsets of Fin n, including the empty and full sets. The observation map gives (xi,y)(x_i,y)(xi​,y) to a member of III and (xi,0)(x_i,0)(xi​,0) to a farmer outside III, so neither type sees another farmer’s private signal. Strategies are measurable functions with square-integrable realized quantities, and both equilibria and deviations satisfy that condition. Welfare is the sum of integrals of realized Cournot profit. The goal quantifies over all equilibria and does not replace their welfare by the closed-form function WWW.

The base game assumes n≥4n\geq4n≥4, a>0a>0a>0, b>0b>0b>0, and positive α,β,γ\alpha,\beta,\gammaα,β,γ; no sign condition is imposed on ccc. The paper mentions γ=0\gamma=0γ=0 as an unavailable-private-signal limiting case, but a Gaussian noise with variance 1/γ1/\gamma1/γ is undefined there, so that separate regime is outside this mission. The positive public precision likewise excludes the degenerate β=0\beta=0β=0 case. Equations (2)–(3) print qi≥0q_i\geq0qi​≥0, but the claimed affine equilibrium takes negative values with positive Gaussian probability; the formalization uses unrestricted real quantities, which is the game solved by the paper’s displayed first-order calculations. All of these choices are explicit in the statements and should be checked against the source’s intended reading (Zhou et al., pp. 8–10, 12).

The coefficient definitions kI,mI,kJ,Ψ,A0,A1,A2,B0,B1k_I,m_I,k_J,\Psi,A_0,A_1,A_2,B_0,B_1kI​,mI​,kJ​,Ψ,A0​,A1​,A2​,B0​,B1​, the linear profile, the two type-specific expected profits, and VVV are fixed to the source displays. The useful contributions are proofs of the posterior identities, unrestricted equilibrium existence and uniqueness, expected-profit identities, and the welfare inequalities. Neither an arbitrarily chosen equilibrium nor an affine-only strategy class would establish the target.

Selected references

  • J. Zhou, X. Fan, Y.-J. Chen and C. S. Tang, Information Provision and Farmer Welfare in Developing Economies, SSRN preprint dated June 27, 2019, SSRN 3369334; published in Manufacturing & Service Operations Management (2019), DOI 10.1287/msom.2019.0831. All page and result references above use the dated SSRN preprint.
10 thms1 active userReviewed
Dynamic ProgrammingOptimization·Captain: mikedeng1

Social Responsibility Auditing in Supply Chain Networks: An Optimal Auditing Policy First Audits and Drops Suppliers, Then Rectifies All Remaining Ones or Proceeds to ProductionResearch Paper

Motivation

A buyer may be liable for social responsibility violations among suppliers that remain in its production network. Auditing can prevent a later penalty, but the buyer must pay for each audit and then choose what to do with a supplier that fails. Dropping a supplier can also remove other firms that depend on it, changing the buyer's eventual production profit. Zhang, Aydin, and Parker study this decision in a three-tier supply network and establish a structural rule for an optimal auditing policy in Theorem 3. The rule tells the buyer how dropping and rectification can be ordered without specifying which supplier to audit first.

Setting

There is one buyer in tier 0 and two possible tier-1 firms, aaa and bbb. The tier-2 suppliers are divided into three disjoint sets: SaS_aSa​, whose members supply only aaa; SbS_bSb​, whose members supply only bbb; and SabS_{ab}Sab​, whose members supply both. A network is g=(S(1),Sa,Sb,Sab)g=(S^{(1)},S_a,S_b,S_{ab})g=(S(1),Sa​,Sb​,Sab​), where S(1)⊆{a,b}S^{(1)}\subseteq\{a,b\}S(1)⊆{a,b} is the set of tier-1 firms still present. Its supplier set SgS_gSg​ contains those tier-1 firms and the members of the three tier-2 sets. The set Dg(i)D_g(i)Dg​(i) of dependents of supplier iii includes iii itself. For a tier-1 firm, it includes its exclusive tier-2 suppliers. For a tier-2 supplier, it also includes a tier-1 firm if that supplier is the firm's sole remaining tier-2 source.

An auditing state γ=(g,Uγ)\gamma=(g,U_\gamma)γ=(g,Uγ​) records the current network and its finite set of unaudited suppliers, Uγ⊆SgU_\gamma\subseteq S_gUγ​⊆Sg​. The state is terminal when Uγ=∅U_\gamma=\varnothingUγ​=∅. The operator γ⊕i\gamma\oplus iγ⊕i vets an unaudited supplier without changing the network. The operator γ⊖i\gamma\ominus iγ⊖i drops iii and Dg(i)D_g(i)Dg​(i). If a tier-1 firm is dropped, its formerly shared tier-2 suppliers become exclusive to the other tier-1 firm. These transitions are the paper's footnotes 3 and 4 on page 10.

At a state, the buyer can proceed to production (pppppp), audit and rectify an unaudited supplier (ar(i)ar(i)ar(i)), or audit and drop one if it fails (ad(i)ad(i)ad(i)). An auditing policy ξ\xiξ chooses an admissible action at every state. Let a≥0a\geq0a≥0 be the audit cost, r≥0r\geq0r≥0 the rectification cost, u∈(0,1)u\in(0,1)u∈(0,1) the chance that a supplier is noncompliant, w∈(0,1]w\in(0,1]w∈(0,1] the chance that an uncorrected violation is exposed, and z≥0z\geq0z≥0 the penalty for an exposed violation. If the buyer proceeds to production, it receives production profit π(g)\pi(g)π(g) less the expected penalty ζ(γ)=∣Uγ∣uwz\zeta(\gamma)=|U_\gamma|uwzζ(γ)=∣Uγ​∣uwz.

The optimal value V∗(γ)V^*(\gamma)V∗(γ) is the maximum of the values of the admissible actions at γ\gammaγ, using the finite recursion (1)–(5) of §3.2. An optimal policy chooses a maximizing action at every state. The appendix also defines the value V(ξ,γ)V(\xi,\gamma)V(ξ,γ) of a fixed policy and the restricted value Var(γ)V_{ar}(\gamma)Var​(γ) when only pppppp and ararar are available.

Formalization targets

The main target is Theorem 3, page 19: some optimal policy first audits and drops any number of suppliers, perhaps none, and then enters a second subphase. In that second subphase it either rectifies all remaining unaudited suppliers, in any order, or proceeds directly to production. The choice is governed by the comparison

a+ur≤uwz(rectify all),a+ur≥uwz(proceed to production).a+ur\leq uwz\quad\text{(rectify all)},\qquad a+ur\geq uwz\quad\text{(proceed to production)}.a+ur≤uwz(rectify all),a+ur≥uwz(proceed to production).

The inequalities are non-strict: both choices are permitted at equality. The statement applies at every state of the auditing process. Once the policy rectifies a supplier, it rectifies another at the successor state whenever unaudited suppliers remain; no later audit-and-drop action follows. Every available rectification action is optimal during this subphase.

Two appendix results are the milestones. Proposition D.1, OA-11 says that, for each starting state, a buyer can postpone rectification actions until after dropping actions without lowering its value at that state. Proposition D.2, OA-13 identifies the optimal value and actions in the restricted rectify-or-produce problem. With crp=min⁡{uwz,a+ur}c_{rp}=\min\{uwz,a+ur\}crp​=min{uwz,a+ur}, its value formula is

Var(γ)=π(g)−crp∣Uγ∣.V_{ar}(\gamma)=\pi(g)-c_{rp}|U_\gamma|.Var​(γ)=π(g)−crp​∣Uγ​∣.

Significance

Theorem 3 reduces the form of policies that need consideration: rectification need not be interleaved with later dropping, and the final choice between rectification and accepting exposure risk depends on one comparison of per-supplier costs. It does not resolve which suppliers to audit and drop, or when to leave that first subphase. Those decisions can still depend on the network and audit outcomes, as §5.1 explains.

The paper proves the structural result and its two appendix propositions. This mission asks for machine-checked proofs of those known statements, together with a reusable finite representation of network dependents, transitions, and Bellman values. The present draft statements compile with proof placeholders; they are not machine-checked proofs of the claims. The definitions also permit later work on other auditing rules over the same state space.

Difficulty

An audit-and-drop action can change the network and therefore production profit. Comparing it with an audit-and-rectify action is more involved than comparing their immediate costs: a dropped supplier can remove its dependents, and those losses affect all later decisions. The obvious choice of rectifying whenever a+ur≤uwza+ur\leq uwza+ur≤uwz ignores the possibility that a later drop removes the rectified supplier anyway. The structural theorem must account for both successor states of an audit and still produce one policy that is optimal at every state.

Formalization scope

Tier-2 suppliers carry labels in an arbitrary type, while every individual network and unaudited set is finite. The tier-2 components of a network are pairwise disjoint. The Lean parameters explicitly require a,r,z≥0a,r,z\geq0a,r,z≥0, 0<u<10<u<10<u<1, and 0<w≤10<w\leq10<w≤1. The paper derives ζ\zetaζ from independent supplier outcomes; the formalization uses that derived formula, and its Bellman recursions already take the audit outcomes' expectations. The profit π\piπ is any real-valued function of the current network. This is a disclosed generalization of the Cournot profit used earlier in the paper: §6.1 says the two-subphase result does not depend on the mode of competition, and (D.27) uses only that vetting leaves the network unchanged.

The value functions are defined by recursion on the number of unaudited suppliers. Their maxima are taken over exactly the admissible finite action set, and optimality is checked at every state. Transition functions are total, but the theorems use them only for unaudited suppliers. The action-value functions return zero for inadmissible supplier actions; the fixed-policy recursion returns the production value there. These values have no role for admissible policies. The formulation excludes an unattained policy supremum, a policy that is optimal only at a chosen initial state, or a special production-profit function. Contributions that establish the appendix propositions, the main structural theorem, or useful lemmas about the finite transitions and recursions fit this scope.

Selected references

  • H. Zhang, G. Aydin, and R. P. Parker, Social Responsibility Auditing in Supply Chain Networks, Management Science, 2021, authors' accepted manuscript dated 26 February 2021, pp. 8–11, 19, OA-11–OA-13. DOI: 10.1287/mnsc.2020.3950.
4 thms1 active userReviewed
Optimization·Captain: mikedeng1

Variational Analysis of Composite Models with Applications to Continuous Optimization: Fully Subamenable Functions Are Properly Twice Epi-Differentiable, with a Second Subderivative FormulaResearch Paper

Motivation

A constrained optimization problem often has an objective of the form φ(x)=ϑ(f(x))\varphi(x)=\vartheta(f(x))φ(x)=ϑ(f(x)): a smooth map fff describes the model, while an extended-real function ϑ\varthetaϑ gives the cost and can assign +∞+\infty+∞ to infeasible outputs. Such a description covers polyhedral constraints, quadratic penalties on pieces, and many nonsmooth composite objectives. Solvers need to know how the local first and second order behavior of φ\varphiφ depends on the two parts of the model. The usual chain rules in Rockafellar and Wets, Variational Analysis use qualification conditions stronger than an error bound at the point of interest. Mohammadi, Mordukhovich, and Sarabi develop chain rules under a metric subregularity qualification condition (MSQC), including the second order result targeted here.

The paper was circulated as arXiv:1905.08837v2 in 2019 and published in Mathematics of Operations Research in 2022. This mission follows the pinned arXiv version, whose theorem and page numbering is used throughout. The result is known in mathematics; the open task here is its formalization in Lean. The paper also derives optimality conditions and statements about KKT systems from its second order analysis, but those later applications are outside this mission's target. Source: §§1, 5, 6, 8.

Setting

Fix finite dimensional Euclidean spaces Rn\mathbb R^nRn and Rm\mathbb R^mRm. An extended-real function φ:Rn→(−∞,+∞]\varphi:\mathbb R^n\to(-\infty,+\infty]φ:Rn→(−∞,+∞] has finite domain dom⁡φ={x:φ(x)<+∞}\operatorname{dom}\varphi=\{x:\varphi(x)<+\infty\}domφ={x:φ(x)<+∞}. Assigning +∞+\infty+∞ outside a feasible set lets an ordinary function and a constraint be treated together. A convex piecewise linear-quadratic function (PWLQ) ϑ\varthetaϑ has a finite collection of polyhedral convex pieces Ωi\Omega_iΩi​ whose union is its domain. On each piece its value is 12⟨Aiy,y⟩+⟨ai,y⟩+αi\tfrac12\langle A_i y,y\rangle+\langle a_i,y\rangle+\alpha_i21​⟨Ai​y,y⟩+⟨ai​,y⟩+αi​, where AiA_iAi​ is symmetric. The separate formulas must agree where pieces meet, because all describe the same function. Source: (2.9), p. 5.

A function φ\varphiφ is fully subamenable at xˉ\bar xxˉ when it agrees with ϑ∘f\vartheta\circ fϑ∘f on a neighborhood of xˉ\bar xxˉ, with fff twice differentiable at xˉ\bar xxˉ, ϑ\varthetaϑ convex PWLQ, and MSQC satisfied there. Write Ω={x:f(x)∈dom⁡ϑ}\Omega=\{x:f(x)\in\operatorname{dom}\vartheta\}Ω={x:f(x)∈domϑ}. MSQC says that for some κ≥0\kappa\ge0κ≥0 and all xxx near xˉ\bar xxˉ, dist⁡(x,Ω)≤κdist⁡(f(x),dom⁡ϑ)\operatorname{dist}(x,\Omega)\le\kappa\operatorname{dist}(f(x),\operatorname{dom}\vartheta)dist(x,Ω)≤κdist(f(x),domϑ). This controls how far a nearby point is from feasibility through its residual in the outer domain. It is the paper's condition (3.5), not metric regularity. Source: Definition 3.2 and (3.5), pp. 9–10; Definition 4.2, p. 16.

The subderivative dφ(xˉ)(w)d\varphi(\bar x)(w)dφ(xˉ)(w) is a lower limit of first order difference quotients as positive time tends to zero and the direction tends to www. Given a limiting subgradient vˉ∈∂φ(xˉ)\bar v\in\partial\varphi(\bar x)vˉ∈∂φ(xˉ), the second subderivative d2φ(xˉ,vˉ)(w)d^2\varphi(\bar x,\bar v)(w)d2φ(xˉ,vˉ)(w) uses the quotient after subtracting the linear term t⟨vˉ,w⟩t\langle\bar v,w\ranglet⟨vˉ,w⟩ and dividing by 12t2\tfrac12t^221​t2. Proper twice epi-differentiability means these quotients epi-converge to a second subderivative that never equals −∞-\infty−∞ and is finite somewhere. The paper gives an equivalent test using recovery directions for every positive null sequence; that test is used in Lean. Source: (2.11), (2.15), (2.16), pp. 6–7.

Formalization targets

Main theorem

For every vˉ∈∂φ(xˉ)\bar v\in\partial\varphi(\bar x)vˉ∈∂φ(xˉ), a fully subamenable φ\varphiφ is properly twice epi-differentiable at xˉ\bar xxˉ for vˉ\bar vvˉ. With

Λ(xˉ,vˉ)={λ∈∂ϑ(f(xˉ)):∇f(xˉ)∗λ=vˉ},\Lambda(\bar x,\bar v)=\{\lambda\in\partial\vartheta(f(\bar x)):\nabla f(\bar x)^*\lambda=\bar v\},Λ(xˉ,vˉ)={λ∈∂ϑ(f(xˉ)):∇f(xˉ)∗λ=vˉ},

its second subderivative satisfies, for every w∈Rnw\in\mathbb R^nw∈Rn,

d2φ(xˉ,vˉ)(w)=max⁡λ∈Λ(xˉ,vˉ){d2ϑ(f(xˉ),λ)(∇f(xˉ)w)+⟨λ,∇2f(xˉ)(w,w)⟩}.d^2\varphi(\bar x,\bar v)(w)=\max_{\lambda\in\Lambda(\bar x,\bar v)}\bigl\{d^2\vartheta(f(\bar x),\lambda)(\nabla f(\bar x)w)+\langle\lambda,\nabla^2f(\bar x)(w,w)\rangle\bigr\}.d2φ(xˉ,vˉ)(w)=λ∈Λ(xˉ,vˉ)max​{d2ϑ(f(xˉ),λ)(∇f(xˉ)w)+⟨λ,∇2f(xˉ)(w,w)⟩}.

The maximum is attained; a supremum alone is a weaker claim. This is Theorem 5.2 and (5.3), p. 22.

Supporting statements

The milestones are the paper's equality rules for first order subderivatives and subgradients (Theorems 3.4 and 3.6), its identification of critical directions with the finite domain of the second subderivative (Theorem 4.4), the PWLQ outer-function formula (4.8), the lower bound (4.10), and the parabolic limit formula (Lemma 5.1). Each names a separate mathematical claim needed to connect the composite model to the goal. Source: §§3–5.

Significance

Theorem 5.2 gives a data-level way to evaluate the second order behavior of a nonsmooth composite: the outer function contributes its own second subderivative, the inner map contributes its Hessian, and multipliers connect the two. Its properness and epi-differentiability clauses make the formula suitable for the paper's later no-gap second order optimality conditions and parametric analysis. Without those clauses, an equality of extended-real expressions alone would not establish the stability of the difference quotients. Source: Theorem 5.2 and §6.

A formal development of this result would add reusable definitions and lemmas for extended-real difference quotients, second-order tangent geometry, PWLQ functions, and local composite error bounds. The present draft contains statements and definitions that compile; it does not yet contain proofs of the open theorem items. The published limiting-subdifferential definition is reused, while the paper-specific local representation and multiplier set are defined here.

Difficulty

A first order expansion of fff does not settle the second order claim. Near a polyhedral boundary, the direction www may be tangent while a fixed straight path xˉ+tw\bar x+twxˉ+tw leaves the domain; the second-order correction and the outer function's active piece matter. MSQC controls distance to feasibility but does not itself identify a feasible second-order path or a maximizing multiplier. The source therefore needs separate results about critical directions, PWLQ second subderivatives, parabolic limits, and dual attainment before the full formula can be stated with a maximum. Source: §§4–5, especially pp. 17–23.

Formalization scope

Lean uses EuclideanSpace ℝ (Fin n) and EReal. The paper's codomain excludes −∞-\infty−∞; the relevant hypotheses enforce that exclusion, while the subderivatives themselves may take either infinite value. The finite domain is defined by exclusion of +∞+\infty+∞. A PWLQ representation records finite closed half-space intersections, symmetric operators, and the exact 12\tfrac1221​ quadratic coefficient. Twice differentiability includes differentiability near the base point and differentiability of the derivative at the point. The composite identity holds on a neighborhood rather than globally. MSQC uses the paper's local distance estimate with κ≥0\kappa\ge0κ≥0. Positive null sequences represent t↓0t\downarrow0t↓0; a filter lower limit represents the varying direction. The second quotient retains the paper's 12t2\tfrac12t^221​t2 denominator.

The subdifferentials are the published analytic regular and limiting subdifferentials. Their use matches the paper's geometric subdifferentials at the lower semicontinuous functions in these statements. The goal computes the second subderivative from the lower-limit definition, rather than defining it by (5.3). Full subamenability retains MSQC and a genuine PWLQ representation; it is neither an empty-domain case nor a stronger metric-regularity special case. Contributions toward proofs of the milestone theorems, their needed tangent-set geometry, and the goal are in scope.

Selected references

  • A. Mohammadi, B. S. Mordukhovich, M. E. Sarabi, Variational Analysis of Composite Models with Applications to Continuous Optimization, arXiv:1905.08837v2, 2019; published in Mathematics of Operations Research, 2022. https://arxiv.org/abs/1905.08837v2
  • R. T. Rockafellar and R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
12 thms1 active userReviewed
Algorithmic Game TheoryControl TheoryStochastic Systems·Captain: mikedeng1

Game of Variable Contributions to the Common Good Under Uncertainty: The Symmetric Game Has a Regular Control Markov Perfect EquilibriumResearch Paper

Motivation

Many shared assets deteriorate unless someone pays to maintain them: a public infrastructure stock, a jointly used ecosystem, a joint venture's capital, a common research base. When several parties benefit from the same stock and each pays for its own contributions, every party is tempted to wait for the others to pay. Kwon (arXiv:1904.00500, published in Operations Research, 2022) models this as a two-player stochastic differential game in continuous time, in which each player may raise the stock at any rate, and studies the Markov perfect equilibria of the game.

The single-player version is a classical monotone follower problem of singular stochastic control (Alvarez 2001; Øksendal and Sulem 2005; Lon and Zervos 2011): the optimal policy reflects the stock upward at a threshold. In the game, a natural first guess is that free riding lowers that threshold, or that the players take turns reflecting. The paper shows instead that, in the symmetric game, there is an equilibrium in which both players contribute gradually, at a finite rate, below the same threshold as the single decision maker. The equilibrium is a continuous-state analogue of the mixed-strategy delay equilibrium of the war of attrition.

Setting

The stock ZtZ_tZt​ lives in an interval I=(a,b)⊆RI=(a,b)\subseteq\mathbb RI=(a,b)⊆R (a=−∞a=-\inftya=−∞ or b=∞b=\inftyb=∞ allowed) and satisfies

dZt=μ(Zt) dt+σ(Zt) dWt+dξ1t+dξ2t,dZ_t=\mu(Z_t)\,dt+\sigma(Z_t)\,dW_t+d\xi_{1t}+d\xi_{2t},dZt​=μ(Zt​)dt+σ(Zt​)dWt​+dξ1t​+dξ2t​,

on a filtered probability space satisfying the usual conditions, where WWW is a Wiener process, μ<0\mu<0μ<0 (the stock deteriorates) and σ>0\sigma>0σ>0. Player iii's control ξi\xi_iξi​ is any adapted, nondecreasing, right-continuous process: its cumulative contribution. A control may jump, including at time 000. Player iii's payoff from the initial stock xxx is

Vi(x;ξ)=Ex[∫0∞e−rtπ(Zt) dt−∫0∞e−rtk dξit],V_i(x;\xi)=\mathbb E^x\Big[\int_0^\infty e^{-rt}\pi(Z_t)\,dt-\int_0^\infty e^{-rt}k\,d\xi_{it}\Big],Vi​(x;ξ)=Ex[∫0∞​e−rtπ(Zt​)dt−∫0∞​e−rtkdξit​],

where π\piπ is an increasing, bounded-above flow profit, k>0k>0k>0 the unit cost and r>0r>0r>0 the discount rate. In the symmetric game both players have the same π\piπ and kkk.

The analysis uses:

  1. the uncontrolled process XxX^xXx, solving dX=μ(X)dt+σ(X)dWdX=\mu(X)dt+\sigma(X)dWdX=μ(X)dt+σ(X)dW, X0=xX_0=xX0​=x;
  2. the resolvent (Rg)(x)=E[∫0∞e−rtg(Xtx) dt](Rg)(x)=\mathbb E[\int_0^\infty e^{-rt}g(X^x_t)\,dt](Rg)(x)=E[∫0∞​e−rtg(Xtx​)dt];
  3. the generator A=12σ(x)2∂x2+μ(x)∂x−r\mathcal A=\tfrac12\sigma(x)^2\partial_x^2+\mu(x)\partial_x-rA=21​σ(x)2∂x2​+μ(x)∂x​−r;
  4. the increasing and decreasing fundamental solutions ψ,φ\psi,\varphiψ,φ of Aψ=Aφ=0\mathcal A\psi=\mathcal A\varphi=0Aψ=Aφ=0;
  5. the function q(x)=π(x)+[μ(x)−rx]kq(x)=\pi(x)+[\mu(x)-rx]kq(x)=π(x)+[μ(x)−rx]k.

Assumptions 1–3 of the paper require Lipschitz coefficients with linear growth, a uniform integrability condition on e−rτ(Xτ)−e^{-r\tau}(X_\tau)^-e−rτ(Xτ​)−, integrability of e−rtπ(Xt)e^{-rt}\pi(X_t)e−rtπ(Xt​), and boundary behaviour of RπR\piRπ and qqq at aaa and bbb; in particular qqq increases below a point x∗x^*x∗ and decreases above it.

The single decision maker's value is

V(x)={k(x−θ)+V(θ)x<θ,(Rπ)(x)+Aφ(x)x≥θ,(4)V(x)=\begin{cases}k(x-\theta)+V(\theta) & x<\theta,\\ (R\pi)(x)+A\varphi(x) & x\ge\theta,\end{cases}\tag{4}V(x)={k(x−θ)+V(θ)(Rπ)(x)+Aφ(x)​x<θ,x≥θ,​(4)

for a threshold θ∈I\theta\in Iθ∈I and a coefficient AAA that make VVV twice continuously differentiable (Lemma 1). The candidate equilibrium rate is

u(x)={−1k(AV(x)+π(x))x<θ,0x≥θ.(6)u(x)=\begin{cases}-\tfrac1k\big(\mathcal AV(x)+\pi(x)\big) & x<\theta,\\ 0 & x\ge\theta.\end{cases}\tag{6}u(x)={−k1​(AV(x)+π(x))0​x<θ,x≥θ.​(6)

Formalization targets

Goal: Theorem 2 (pp. 15–16)

If uuu of (6) is Lipschitz on III with linear growth, then the profile in which both players contribute at the regular rate dξit=u(Zt) dtd\xi_{it}=u(Z_t)\,dtdξit​=u(Zt​)dt is a Markov perfect equilibrium, and

V1(x;ξ)=V2(x;ξ)=V(x)for all x∈I.V_1(x;\xi)=V_2(x;\xi)=V(x)\qquad\text{for all }x\in I.V1​(x;ξ)=V2​(x;ξ)=V(x)for all x∈I.

The equilibrium is against all adapted deviations, from every initial state, with the opponent keeping its feedback rule uuu.

Milestones

  1. Proof of Lemma 1, part (i) (pp. 33–34): for VVV of (4) in C2(I)C^2(I)C2(I), AV+π=0\mathcal AV+\pi=0AV+π=0 on [θ,b)[\theta,b)[θ,b), AV+π<0\mathcal AV+\pi<0AV+π<0 on (a,θ)(a,\theta)(a,θ), V′=kV'=kV′=k on (a,θ](a,\theta](a,θ] and V′<kV'<kV′<k on (θ,b)(\theta,b)(θ,b).
  2. Lemma 1 (p. 10): such θ\thetaθ and AAA exist, and VVV is the single decision maker's optimal value, attained by reflection at θ\thetaθ.
  3. Theorem 1 (pp. 14–15), in the instance where both the opponent and the candidate contribute at regular feedback rates: a C2C^2C2, nondecreasing, bounded-above UUU satisfying conditions (iii)–(iv) is the candidate's payoff and dominates every deviation in the class Σi\Sigma_iΣi​.
  4. The optimality condition of §2.2 (p. 10), for VVV of the form (4) and the operator Aξj=12σ2∂x2+[μ+uj]∂x−r\mathcal A^{\xi_j}=\tfrac12\sigma^2\partial_x^2+[\mu+u_j]\partial_x-rAξj​=21​σ2∂x2​+[μ+uj​]∂x​−r of an opponent playing a regular rate uju_juj​ (as applied on p. 38): conditions (i)–(ii) make VVV the optimal value over all controls.

Significance

Theorem 2 says that the free-rider problem in this game does not shift the threshold below which the stock is maintained; it changes how the stock is maintained, from instantaneous reflection by one party to gradual, rate-limited contribution by both. The equilibrium value equals the single decision maker's value, so the players lose nothing relative to a single owner who pays for everything, although each pays only part. This contrasts with the asymmetric case, where the paper's Theorem 3 rules out a regular-control equilibrium with smooth payoffs. The result is one of the few explicit equilibria of a nonzero-sum singular-control game with linear costs.

The paper's proofs are on paper only. A formalization requires machine-checked versions of a verification theorem for one-dimensional singular control (the optimality condition), of the analysis of the free-boundary point θ\thetaθ through the fundamental solutions, and of the passage from best response within a restricted class Σi\Sigma_iΣi​ to best response among all adapted controls. The verification steps for a controlled diffusion with jumps, Itô's formula for semimartingales with a nondecreasing part, and the comparison Z≥XZ\ge XZ≥X with the uncontrolled process are reusable for other singular-control and monotone-follower problems on the platform.

Difficulty

The obvious route, Itô's formula applied to e−rtV(Zt)e^{-rt}V(Z_t)e−rtV(Zt​) along an arbitrary deviation, requires the transversality limit E[e−rtV(Zt)]→0\mathbb E[e^{-rt}V(Z_t)]\to0E[e−rtV(Zt​)]→0 and uniform integrability of the localised terms. VVV is unbounded below when a=−∞a=-\inftya=−∞, and the deviation is arbitrary, so this needs the comparison of every controlled state with the uncontrolled process and Assumption 1(ii). The proof also passes through a best-response theorem for the restricted class Σi\Sigma_iΣi​ (Theorem 1), whose conclusion is weaker than a Nash equilibrium; the upgrade to all of Ξi\Xi_iΞi​ is a separate argument. Finally, the identification of θ\thetaθ uses the boundary behaviour of ψ\psiψ, φ\varphiφ and the scale density at the ends of III, which Mathlib does not provide for general diffusions.

Formalization scope

Time is [0,∞)[0,\infty)[0,∞). The probabilistic data (measure, filtration, Wiener process, the uncontrolled family XxX^xXx, ψ\psiψ, φ\varphiφ) form one structure, and the standing assumptions of §2.1 together with Assumptions 1–3 form one predicate, a hypothesis of every theorem. The Itô integral of the state equation is the published relation EthierKurtz.HasBrownianItoIntegral; Mathlib supplies Brownian motion, stopping times, uniform integrability and Stieltjes measures.

Conventions the formalization commits to:

  1. The initial value xxx is the pre-jump value Z0−Z_{0-}Z0−​; the discounted cost is a Lebesgue–Stieltjes integral that counts the jump at time 000.
  2. Statements hold for every solution of the relevant state equation; existence and uniqueness of strong solutions (the paper's appeal to SDE theory) is not posed.
  3. Payoffs are compared only for admissible controls: finite expected discounted cost and integrable discounted running profit. Since π\piπ is bounded above, every other control has payoff −∞-\infty−∞, so no deviation is lost.
  4. Markov perfection is the best-response property from every initial state against the opponent's feedback rule, among all adapted controls.
  5. The fundamental solutions are pinned by the Laplace transforms of hitting times, E[e−rτy]=ψ(x)/ψ(y)\mathbb E[e^{-r\tau_y}]=\psi(x)/\psi(y)E[e−rτy​]=ψ(x)/ψ(y) for x≤yx\le yx≤y and φ(x)/φ(y)\varphi(x)/\varphi(y)φ(x)/φ(y) for y≤xy\le xy≤x (Borodin and Salminen).
  6. The scale density of Assumption 3(iii) uses a base point x0∈Ix_0\in Ix0​∈I in place of the printed 000, and the limits of Assumption 3 that may be infinite are limits in the extended reals.
  7. Added, and disclosed: e−rtq(Xtx)e^{-rt}q(X^x_t)e−rtq(Xtx​) is integrable, so that (Rq)(Rq)(Rq) of (3) exists, as the paper presupposes.
  8. The optimality condition is stated for VVV of the form (4) only: for an arbitrary C2C^2C2 function it is false (an affine V=kx+cV=kx+cV=kx+c with large ccc satisfies its conditions on I=RI=\mathbb RI=R but is unbounded).
  9. The class U\mathcal UU in Theorem 2 is its state-only version (Lipschitz on III with linear growth).

The threshold θ\thetaθ and coefficient AAA are not chosen by the formalization: the goal holds for every pair making VVV twice continuously differentiable on III, and smoothness at θ\thetaθ determines the pair. The rate uuu is computed from VVV through the generator, not supplied as a free function, and its nonnegativity is part of the conclusion. A payoff is never a Bochner integral of a non-integrable function, so no junk value can enter an equilibrium comparison.

Contributions welcome: proofs of the milestones, and reusable infrastructure for Itô's formula with nondecreasing càdlàg integrators, comparison theorems for one-dimensional SDEs, and the boundary classification of one-dimensional diffusions.

Selected references

  • H. Dharma Kwon, Game of Variable Contributions to the Common Good under Uncertainty, arXiv preprint, 2019 (published in Operations Research, 2022). https://arxiv.org/abs/1904.00500v1
  • A. N. Borodin and P. Salminen, Handbook of Brownian Motion — Facts and Formulae, Birkhäuser, 1996. https://doi.org/10.1007/978-3-0348-7652-0
  • L. H. R. Alvarez, Singular stochastic control, linear diffusions, and optimal stopping: A class of solvable problems, SIAM Journal on Control and Optimization 39(6), 1697–1710, 2001. https://doi.org/10.1137/S0363012900367825
  • L. H. R. Alvarez, On the properties of r-excessive mappings for a class of diffusions, Annals of Applied Probability 13, 1517–1533, 2003. https://doi.org/10.1214/aoap/1069786505
  • B. Øksendal and A. Sulem, Applied Stochastic Control of Jump Diffusions, 2nd ed., Springer (cited by the paper as 2005). https://doi.org/10.1007/978-3-540-69826-5
  • P. C. Lon and M. Zervos, A model for optimally advertising and launching a product, Mathematics of Operations Research 36(2), 363–376, 2011. https://doi.org/10.1287/moor.1110.0493
9 thms1 active userReviewed
Control TheoryEconomicsOptimization·Captain: mikedeng1

Optimal Growth in Two-Sided Markets: The Optimal Market Balance Depends Only on Market Size and Moves Monotonically Between the Output- and Durability-Maximizing BalancesResearch Paper

Motivation

A two-sided platform (a ride-hailing service, a marketplace, a payment network) earns money only when its two sides transact, so its value depends on the stock of participants on both sides. A young platform has to decide not only how fast to grow but also which side to grow, and it does so through the prices it sets on each side. Whether to subsidize drivers or riders, sellers or buyers, is a recurring operational decision, and the economics literature on two-sided markets (Rochet and Tirole, 2003; Armstrong, 2006) studies it mostly in static models.

Lian and van Ryzin (SSRN 3310559, later published in Management Science, 2021, doi:10.1287/mnsc.2020.3832) pose the question dynamically: supply and demand stocks grow with the surplus each side receives and decay at their own attrition rates, and the platform chooses prices over time to maximize discounted profit. Their first main result, Theorem 1, says that the optimal mix of the two sides at any moment depends only on the current size of the market, and it describes exactly how that mix moves as the market grows. This mission formalizes Theorem 1 and the lemmas its proof rests on.

Setting

A supply stock sss and a demand stock ddd generate g(s,d)g(s,d)g(s,d) transactions per unit time, where the output function ggg is homogeneous of degree α>0\alpha>0α>0: g(ks,kd)=kαg(s,d)g(ks,kd)=k^{\alpha}g(s,d)g(ks,kd)=kαg(s,d) for k>0k>0k>0. The returns to scale are decreasing if α<1\alpha<1α<1 and increasing if α>1\alpha>1α>1. Buyers value a transaction at vvv, sellers incur cost c<vc<vc<v. Supply and demand decay at attrition rates β0s,β0d>0\beta^s_0,\beta^d_0>0β0s​,β0d​>0 and grow with adoption coefficients β1s,β1d>0\beta^s_1,\beta^d_1>0β1s​,β1d​>0; the platform discounts at rate ρ>0\rho>0ρ>0.

When prices are unconstrained, the two stocks reduce to one market size xxx and a balance γ∈[0,1]\gamma\in[0,1]γ∈[0,1], the share of the size held by supply. With h(γ)=g(β1sγ,β1d(1−γ))h(\gamma)=g(\beta^s_1\gamma,\beta^d_1(1-\gamma))h(γ)=g(β1s​γ,β1d​(1−γ)) the output is g(γ,x)=xαh(γ)g(\gamma,x)=x^{\alpha}h(\gamma)g(γ,x)=xαh(γ), and the size evolves by

x˙=−(β0sγ+β0d(1−γ))x+(v−c−π) g(γ,x),\dot x=-\bigl(\beta^s_0\gamma+\beta^d_0(1-\gamma)\bigr)x+(v-c-\pi)\,g(\gamma,x),x˙=−(β0s​γ+β0d​(1−γ))x+(v−c−π)g(γ,x),

where π\piπ is the platform's per-transaction margin. The platform maximizes ∫0∞e−ρtπ g(γ,x) dt\int_0^\infty e^{-\rho t}\pi\,g(\gamma,x)\,dt∫0∞​e−ρtπg(γ,x)dt over balance and margin paths (problem (13)). The net welfare rate is

G(γ,x)=(v−c) g(γ,x)−(ρ+β0sγ+β0d(1−γ))x.G(\gamma,x)=(v-c)\,g(\gamma,x)-\bigl(\rho+\beta^s_0\gamma+\beta^d_0(1-\gamma)\bigr)x .G(γ,x)=(v−c)g(γ,x)−(ρ+β0s​γ+β0d​(1−γ))x.

The paper assumes (Assumptions 1–4) that hhh is twice differentiable and positive on (0,1)(0,1)(0,1), nonnegative at 000 and 111, strictly concave (h′′<0h''<0h′′<0), that h′h'h′ has a unique zero γo∈(0,1)\gamma_o\in(0,1)γo​∈(0,1), the output-maximizing balance, and, when α<1\alpha<1α<1, that (1−α)h′2<−αhh′′(1-\alpha)h'^2<-\alpha h h''(1−α)h′2<−αhh′′.

In Lean the primitives are the fields of TwoSidedGrowth.Balance.Model (with ASCII names bs0 bd0 bs1 bd1 for the four β\betaβ's), the assumptions are the structure Model.Standing, and h, out, G, kappa, IsBalance, Admissible, profit are the objects above.

Formalization targets

Goal: Theorem 1 (p. 19)

Write κ(x)=(β0s−β0d)x1−α/(v−c)\kappa(x)=(\beta^s_0-\beta^d_0)x^{1-\alpha}/(v-c)κ(x)=(β0s​−β0d​)x1−α/(v−c). For every market size x>0x>0x>0 the optimal balance is

γ∗(x)=max⁡{min⁡{(h′)−1(κ(x)),1},0},(14)\gamma^*(x)=\max\Bigl\{\min\bigl\{(h')^{-1}(\kappa(x)),1\bigr\},0\Bigr\},\tag{14}γ∗(x)=max{min{(h′)−1(κ(x)),1},0},(14)

in the sense that exactly one balance satisfies (14); it is the unique maximizer of G(⋅,x)G(\cdot,x)G(⋅,x) on [0,1][0,1][0,1]; and along any size path the balance path γ∗(x(t))\gamma^*(x(t))γ∗(x(t)) yields at least the discounted profit of every other admissible balance path on every finite horizon. Moreover, as xxx grows from 000 to ∞\infty∞, γ∗(x)\gamma^*(x)γ∗(x) moves monotonically:

α>1\alpha>1α>1α<1\alpha<1α<1
β0s>β0d\beta^s_0>\beta^d_0β0s​>β0d​0→γo0\to\gamma_o0→γo​γo→0\gamma_o\to 0γo​→0
β0s<β0d\beta^s_0<\beta^d_0β0s​<β0d​1→γo1\to\gamma_o1→γo​γo→1\gamma_o\to 1γo​→1

The balances 000 and 111 are the durability-maximizing balances: all of the market on the side that attrites more slowly.

Milestones

  1. Lemma 5 (p. 41): along an admissible path, ∫0Te−ρtπg dt=∫0Te−ρtG dt−e−ρTx(T)+x(0)\int_0^T e^{-\rho t}\pi g\,dt=\int_0^T e^{-\rho t}G\,dt-e^{-\rho T}x(T)+x(0)∫0T​e−ρtπgdt=∫0T​e−ρtGdt−e−ρTx(T)+x(0).
  2. Lemma 6, first sentence (p. 42): G(⋅,x)G(\cdot,x)G(⋅,x) is strictly concave on [0,1][0,1][0,1].
  3. (33) (p. 43): the clamp formula is well defined and is exactly the argmax of G(⋅,x)G(\cdot,x)G(⋅,x) on [0,1][0,1][0,1].
  4. (34) (p. 43): where γ∗(x)\gamma^*(x)γ∗(x) is interior,
dγ∗dx=(β0s−β0d)(1−α)(v−c)h′′(γ∗(x))xα,sgn⁡dγ∗dx=sgn⁡((α−1)(β0s−β0d)).\frac{d\gamma^*}{dx}=\frac{(\beta^s_0-\beta^d_0)(1-\alpha)}{(v-c)h''(\gamma^*(x))x^{\alpha}},\qquad \operatorname{sgn}\frac{d\gamma^*}{dx}=\operatorname{sgn}\bigl((\alpha-1)(\beta^s_0-\beta^d_0)\bigr).dxdγ∗​=(v−c)h′′(γ∗(x))xα(β0s​−β0d​)(1−α)​,sgndxdγ∗​=sgn((α−1)(β0s​−β0d​)).

Significance

Theorem 1 separates the two controls of the growth problem: the balance is chosen myopically from the current size, and only the margin, which determines how fast the size moves, remains a dynamic decision. Every later result of the paper (the stationary size of Theorem 2, the subsidy and growth policies of §4) analyses a one-dimensional problem in xxx because of this reduction. The table also has a direct managerial reading: a small market with decreasing returns should be balanced for output, a large one for durability, and with increasing returns the order is reversed.

The result is proved in the paper, partly in prose ("the other three cases can be checked similarly"). No machine-checked version of it is known. The formal development adds a precise reading of (14) when h′h'h′ is unbounded at the ends (as it is for the paper's own Cobb–Douglas example, where the printed claim that h′h'h′ is bounded by h′(0)h'(0)h′(0) and h′(1)h'(1)h′(1) fails), explicit monotonicity and limit statements for all four cases, and a machine-checked version of the profit identity that underlies the reduction.

Difficulty

The identity of Lemma 5 is an integration by parts, and the argmax of a strictly concave function is unique. The work lies elsewhere. The first obstacle is that h′h'h′ need not be bounded on (0,1)(0,1)(0,1), so (h′)−1(h')^{-1}(h′)−1 has to be read as an extended inverse with three regimes, and the argmax characterization must handle the boundary cases where G(⋅,x)G(\cdot,x)G(⋅,x) is monotone on (0,1)(0,1)(0,1) and its maximum sits at an endpoint where hhh has no derivative. The second is the monotonicity: the naive argument differentiates γ∗\gamma^*γ∗ everywhere, but γ∗\gamma^*γ∗ is constant at 000 or 111 on whole intervals of sizes when h′h'h′ is bounded at an end, and it is not differentiable where it reaches the boundary; monotonicity has to be proved for the clamped function directly, and the derivative formula (34) only on the open set of interior balances, through the inverse function theorem. The limits require continuity of the extended inverse at κ=0\kappa=0κ=0 and the divergence of κ\kappaκ at the other end of the size range.

Formalization scope

  • Everything lives in the namespace TwoSidedGrowth.Balance; the single definition file Setting holds the model and all derived objects.
  • Added, disclosed standing assumptions: α>0\alpha>0α>0; c<vc<vc<v; continuity of hhh on [0,1][0,1][0,1]. Positivity of the β\betaβ's and of ρ\rhoρ is printed. Homogeneity is posed for k>0k>0k>0 and s,d≥0s,d\ge 0s,d≥0. Assumption 3, printed "on [0,1]", is posed as a unique zero of h′h'h′ in (0,1)(0,1)(0,1); derivatives of hhh are never evaluated at 000 or 111.
  • (14) is the predicate IsBalance: an interior root of h′(γ)=κ(x)h'(\gamma)=\kappa(x)h′(γ)=κ(x), or 000 when h′≤κ(x)h'\le\kappa(x)h′≤κ(x) on (0,1)(0,1)(0,1), or 111 when κ(x)≤h′\kappa(x)\le h'κ(x)≤h′ on (0,1)(0,1)(0,1). It is not defined as an argmax of GGG, and the profit of (13) is the integral of e−ρtπge^{-\rho t}\pi ge−ρtπg, not the right-hand side of Lemma 5; either shortcut would make the main conjuncts definitional and is ruled out.
  • Problem (13) is posed on every finite horizon [0,T][0,T][0,T], over admissible triples: x>0x>0x>0 continuously differentiable and obeying the state equation, γ∈[0,1]\gamma\in[0,1]γ∈[0,1] and π\piπ continuous. The comparison holds the size path fixed, following §3.5. The impulse (Dirac) controls of §3.6 are outside the mission.
  • "Decreasing/increasing" is monotone on (0,∞)(0,\infty)(0,∞) and strict on the set of interior balances; "from aaa to bbb" are the limits at 0+0^+0+ and +∞+\infty+∞. The case α=1\alpha=1α=1 is not claimed.
  • The source is the SSRN working-paper version of 2020-01-16; labels and pages refer to it. Not in scope: Lemma 1 (CES examples), Proposition 1, Theorem 2, the growth-policy results (Theorems 3–6, Propositions 2–16), and the second sentence of Lemma 6.
  • Contributions welcome: proofs of the milestones, and reusable facts about extended inverses of strictly monotone continuous functions and the interval-integral integration by parts with exponential discounting.

Selected references

  • Z. Lian, G. van Ryzin, Optimal Growth in Two-Sided Markets, SSRN working paper 3310559, version of 2020-01-16. https://ssrn.com/abstract=3310559 — published in Management Science, 2021. https://doi.org/10.1287/mnsc.2020.3832
  • J.-C. Rochet, J. Tirole, Platform Competition in Two-Sided Markets, Journal of the European Economic Association 1(4), 2003. https://doi.org/10.1162/154247603322493212
  • M. Armstrong, Competition in Two-Sided Markets, RAND Journal of Economics 37(3), 2006. https://doi.org/10.1111/j.1756-2171.2006.tb00037.x
6 thms1 active userReviewed
Machine LearningStatistics·Captain: mikedeng1

Minimax-Optimal Policy Learning Under Unobserved Confounding: Minimizing the Worst-Case Empirical Regret Attains the Population Minimax Regret up to an Explicit n^(-1/2) TermResearch Paper

Motivation

Personalized decisions in medicine, marketing and public policy are increasingly learned from observational data: records of who received which treatment and how it turned out. Standard policy-learning methods assume unconfoundedness, that treatment assignment depends only on observed covariates. When an unobserved factor influences both the treatment and the outcome, these methods can return a policy that is worse than the status quo, and nothing in the data reveals it.

Kallus and Zhou (arXiv:1805.08593, published in Management Science 2021 as Minimax-Optimal Policy Learning Under Unobserved Confounding) take the robust route. They fix a bound Γ≥1\Gamma \ge 1Γ≥1 on how far the unobserved confounding may distort the propensity scores, in the marginal sensitivity model of Tan (2006), and learn the policy that minimizes the worst-case regret against a baseline policy π0\pi_0π0​ over every distortion the model allows. The paper proves two guarantees for this policy: it never does worse than the baseline up to vanishing terms (Theorem 2), and it is asymptotically minimax-optimal (Corollary 7). This mission is about the second.

Setting

Data are iid triples (X,T,Y)(X, T, Y)(X,T,Y): covariates X∈XX \in \mathcal XX∈X, one of m≥2m \ge 2m≥2 treatments T∈{0,…,m−1}T \in \{0, \dots, m-1\}T∈{0,…,m−1}, and a real outcome YYY, read as a loss. The nominal propensity is e~t(x)=P(T=t∣X=x)\tilde e_t(x) = P(T = t \mid X = x)e~t​(x)=P(T=t∣X=x). A policy π\piπ assigns to each xxx a probability vector π(⋅∣x)\pi(\cdot \mid x)π(⋅∣x) over treatments; Π\PiΠ is a class of policies and π0\pi_0π0​ a baseline.

Inverse propensity weights W(t,x,y)W(t,x,y)W(t,x,y) are unknown under confounding. The marginal sensitivity model with parameter Γ\GammaΓ confines them to the weight box

atΓ(x)≤W(t,x,y)≤btΓ(x),atΓ(x)=1+Γ−1(1e~t(x)−1),btΓ(x)=1+Γ(1e~t(x)−1).a^\Gamma_t(x) \le W(t,x,y) \le b^\Gamma_t(x), \qquad a^\Gamma_t(x) = 1 + \Gamma^{-1}\big(\tfrac{1}{\tilde e_t(x)} - 1\big), \quad b^\Gamma_t(x) = 1 + \Gamma\big(\tfrac{1}{\tilde e_t(x)} - 1\big).atΓ​(x)≤W(t,x,y)≤btΓ​(x),atΓ​(x)=1+Γ−1(e~t​(x)1​−1),btΓ​(x)=1+Γ(e~t​(x)1​−1).

The set of such weight functions is WΓ\mathcal W^\GammaWΓ, and its restriction to a sample of size nnn is the box WnΓ⊆Rn\mathcal W^\Gamma_n \subseteq \mathbb R^nWnΓ​⊆Rn.

For weights WWW, the Hájek regret of π\piπ against π0\pi_0π0​ is Rπ0(π;W)=∑t=0m−1Rπ0(t)(π;W)R_{\pi_0}(\pi; W) = \sum_{t=0}^{m-1} R^{(t)}_{\pi_0}(\pi; W)Rπ0​​(π;W)=∑t=0m−1​Rπ0​(t)​(π;W) with

Rπ0(t)(π;W)=E[I[T=t] (π(t∣X)−π0(t∣X)) W(T,X,Y) Y]E[I[T=t] W(T,X,Y)],R^{(t)}_{\pi_0}(\pi; W) = \frac{\mathbb E\big[\mathbb I[T=t]\,(\pi(t\mid X) - \pi_0(t\mid X))\, W(T,X,Y)\, Y\big]}{\mathbb E\big[\mathbb I[T=t]\, W(T,X,Y)\big]},Rπ0​(t)​(π;W)=E[I[T=t]W(T,X,Y)]E[I[T=t](π(t∣X)−π0​(t∣X))W(T,X,Y)Y]​,

and R^π0(π;W)\hat R_{\pi_0}(\pi; W)R^π0​​(π;W) is the same expression with E\mathbb EE replaced by the sample average En\mathbb E_nEn​. The worst-case regrets are

Rˉπ0(π;WΓ)=sup⁡W∈WΓRπ0(π;W),Rˉ^π0(π;WnΓ)=sup⁡W∈WnΓR^π0(π;W).\bar R_{\pi_0}(\pi; \mathcal W^\Gamma) = \sup_{W \in \mathcal W^\Gamma} R_{\pi_0}(\pi; W), \qquad \hat{\bar R}_{\pi_0}(\pi; \mathcal W^\Gamma_n) = \sup_{W \in \mathcal W^\Gamma_n} \hat R_{\pi_0}(\pi; W).Rˉπ0​​(π;WΓ)=W∈WΓsup​Rπ0​​(π;W),Rˉ^π0​​(π;WnΓ​)=W∈WnΓ​sup​R^π0​​(π;W).

The learned policy πˉ^\hat{\bar\pi}πˉ^ minimizes Rˉ^π0(⋅ ;WnΓ)\hat{\bar R}_{\pi_0}(\cdot\,; \mathcal W^\Gamma_n)Rˉ^π0​​(⋅;WnΓ​) over Π\PiΠ; the population minimax regret is inf⁡π∈ΠRˉπ0(π;WΓ)\inf_{\pi\in\Pi} \bar R_{\pi_0}(\pi; \mathcal W^\Gamma)infπ∈Π​Rˉπ0​​(π;WΓ).

The complexity of Π\PiΠ is measured by its VC-major dimension (Definition 1): the largest vvv such that some vvv points (tj,xj)(t_j, x_j)(tj​,xj​) have all 2v2^v2v subsets cut out by superlevel sets {(t,x):π(t∣x)>θ}\{(t,x) : \pi(t\mid x) > \theta\}{(t,x):π(t∣x)>θ}, π∈Π\pi \in \Piπ∈Π, θ∈R\theta \in \mathbb Rθ∈R. The standing assumptions are bounded outcomes ∣Y∣≤B|Y| \le B∣Y∣≤B (Assumption 1), overlap with constant ν>0\nu > 0ν>0 (Assumption 2), and VC-major dimension of Π\PiΠ at most vvv (Assumption 3).

Formalization targets

Goal: Corollary 7 (p. 15)

There is a constant KKK depending only on vvv such that, with probability at least 1−δ1-\delta1−δ,

Rˉπ0(πˉ^;WΓ)≤inf⁡π∈ΠRˉπ0(π;WΓ)+36(12+ν−1)(BK+ν−1(Γ−Γ−1)(K+B+m))log⁡(15m/δ)n.\bar R_{\pi_0}(\hat{\bar\pi}; \mathcal W^\Gamma) \le \inf_{\pi \in \Pi} \bar R_{\pi_0}(\pi; \mathcal W^\Gamma) + 36(12 + \nu^{-1})\big(BK + \nu^{-1}(\Gamma - \Gamma^{-1})(K + B + m)\big)\sqrt{\frac{\log(15m/\delta)}{n}}.Rˉπ0​​(πˉ^;WΓ)≤π∈Πinf​Rˉπ0​​(π;WΓ)+36(12+ν−1)(BK+ν−1(Γ−Γ−1)(K+B+m))nlog(15m/δ)​​.

Milestones

  1. Proposition 3 and Corollary 4: each treatment's worst case over the box is attained among monotone weights atΓ(x)+u(y(π(t∣x)−π0(t∣x)))(btΓ(x)−atΓ(x))a^\Gamma_t(x) + u\big(y(\pi(t\mid x) - \pi_0(t\mid x))\big)(b^\Gamma_t(x) - a^\Gamma_t(x))atΓ​(x)+u(y(π(t∣x)−π0​(t∣x)))(btΓ​(x)−atΓ​(x)), uuu nondecreasing into [0,1][0,1][0,1], in the population and in every sample.
  2. Lemma 5: sup⁡h−sup⁡g≤sup⁡(h−g)\sup h - \sup g \le \sup (h - g)suph−supg≤sup(h−g).
  3. Lemma 2: uniform deviation of (π(T∣X)−1/m)Y(\pi(T\mid X) - 1/m)Y(π(T∣X)−1/m)Y over Π\PiΠ, at rate 92CK(v+2)log⁡(5/δ)/n\tfrac92 C\sqrt K (v+2)\sqrt{\log(5/\delta)/n}29​CK​(v+2)log(5/δ)/n​.
  4. Lemma 3 and Corollary 15: for a fixed policy, uniform deviation over monotone uuu, at rate 92πlog⁡(1/p)/n9\sqrt{2\pi\log(1/p)/n}92πlog(1/p)/n​, overall and per treatment.
  5. Lemma 4: the same jointly over Π\PiΠ and uuu, given the VC-major dimension of the composition class.
  6. Theorem 6 (as proved): with probability at least 1−δ1-\delta1−δ, sup⁡π∈Π∣Rˉ^π0(π;WnΓ)−Rˉπ0(π;WΓ)∣\sup_{\pi\in\Pi} |\hat{\bar R}_{\pi_0}(\pi; \mathcal W^\Gamma_n) - \bar R_{\pi_0}(\pi; \mathcal W^\Gamma)|supπ∈Π​∣Rˉ^π0​​(π;WnΓ​)−Rˉπ0​​(π;WΓ)∣ is at most the goal's rate with 181818 in place of 363636.

Significance

The result. Corollary 7 says that the confounding-robust policy loses at most O(n−1/2)O(n^{-1/2})O(n−1/2) against the best possible worst-case guarantee in its class. The worst-case regret Rˉπ0(π;WΓ)\bar R_{\pi_0}(\pi; \mathcal W^\Gamma)Rˉπ0​​(π;WΓ) cannot be identified from data. It is the regret the decision maker must budget for when the confounding is only known to lie within Γ\GammaΓ. With Theorem 2, it makes the procedure both safe and asymptotically optimal among safe procedures, for randomized and multi-treatment policy classes of finite VC-major dimension.

Formalizing it. The paper's proof of the dimension-only dependence of KKK is incomplete. Its Proposition 5, which states that the monotone weight class WˉΓ=⋃π∈ΠWˉΓ(π)\bar{\mathcal W}^\Gamma = \bigcup_{\pi\in\Pi} \bar{\mathcal W}^\Gamma(\pi)WˉΓ=⋃π∈Π​WˉΓ(π) has finite VC-major dimension under Assumption 3, is false as printed. A class of monotone policies on [0,1][0,1][0,1] with VC-major dimension at most 222 gives a WˉΓ\bar{\mathcal W}^\GammaWˉΓ that shatters arbitrarily large grids. The printed proof of Theorem 6 runs through Proposition 5 and Lemma 4, so Theorem 6 and Corollary 7 are believed true but are not established by the paper. A formal proof would settle the claim. None of the statements has a machine-checked proof.

Difficulty

The worst case over WΓ\mathcal W^\GammaWΓ is a supremum over an essentially arbitrary bounded function class, which is far too large for a uniform law of large numbers. Proposition 3 reduces it to monotone transformations of the score y(π(t∣x)−π0(t∣x))y(\pi(t\mid x) - \pi_0(t\mid x))y(π(t∣x)−π0​(t∣x)). This is a linear-fractional program whose population version lives in a function space. The natural next step is to apply a uniform law over the pairs (π,u)(\pi, u)(π,u). That step needs a complexity bound on the composition u∘scoreπu \circ \text{score}_\piu∘scoreπ​ in terms of the dimension of Π\PiΠ alone, and this is exactly where the printed argument fails. A different route is needed. One candidate exploits the Lipschitz dependence of the worst-case Hájek value on the scores. The Hájek ratios also need denominators bounded away from zero uniformly. The paper's decomposition (p. 42) uses E[W I[T=t]]=1\mathbb E[W\,\mathbb I[T=t]] = 1E[WI[T=t]]=1, which holds for the true weights only.

Formalization scope

All statements live in the namespace ConfoundRobust.Minimax, with one definitions file Setting.

  • Data and sampling. An observation is a point of 𝒳 × Fin m × ℝ, with treatments 0-indexed as on the page. The population is a probability measure μ, and a sample is ω : Fin n → Obs 𝒳 m under Measure.pi. En\mathbb E_nEn​ is (1/n)∑i(1/n)\sum_i(1/n)∑i​.
  • Policies and propensity. A policy is π : 𝒳 → Fin m → ℝ, with π x t =π(t∣x)= \pi(t \mid x)=π(t∣x), measurable and simplex-valued. The nominal propensity is a measurable version of P(T=t∣X=x)P(T = t \mid X = x)P(T=t∣X=x), given by its defining integral identity, with ν≤e~≤1\nu \le \tilde e \le 1ν≤e~≤1.
  • Assumptions. Assumption 1 is ∣Y∣≤B|Y| \le B∣Y∣≤B almost surely. Assumption 2 enters only through its observable consequence e~t(x)≥ν\tilde e_t(x) \ge \nue~t​(x)≥ν; this is a weaker hypothesis, so the statements are at least as strong. Assumption 3 is the predicate "VC-major dimension at most vvv" on the functions (t,x)↦π(t∣x)(t,x) \mapsto \pi(t\mid x)(t,x)↦π(t∣x).
  • Weights and suprema. Weight functions in WΓ\mathcal W^\GammaWΓ are measurable. Suprema and infima are real sSup/sInf; the weight sets are nonempty (they contain 1/e~1/\tilde e1/e~) and the regrets are bounded, so these are true extrema. An empty treatment group gives a Hájek ratio 0/0=00/0 = 00/0=0.
  • Probability statements. "With probability at least 1−δ1-\delta1−δ" means a measurable event of that product measure on which the bound holds for every policy. πˉ^\hat{\bar\pi}πˉ^ is any sample minimizer.
  • Constants. In the goal, Theorem 6, Lemma 2 and Lemma 4 the constant KKK is quantified as ∀ v, ∃ K, ∀ (everything else). Letting KKK depend on Π\PiΠ, μ\muμ, nnn or δ\deltaδ would trivialize the bound and is ruled out.
  • Disclosed readings.
    • Lemmas 3, 4 and Corollary 15 are posed for p≤1/2p \le 1/2p≤1/2: as printed (every ppp) they are false for ppp near 111.
    • The clipped bounds of Corollary 15 and Lemma 4 (PDF p. 41) are reconstructed.
    • Lemma 2 drops "for nnn large enough", which its proof does not use.
    • Lemma 2, Theorem 6 and the goal assume Π\PiΠ is pointwise separable (a countable subclass approximates every policy pointwise), and Lemma 4 assumes the same of its composition class. This is the measurability condition of the empirical-process tools the proofs use. Without it the uniform statements fail (initial segments of ω1\omega_1ω1​ under the countable–cocountable measure).
    • Theorem 6 uses 181818, the constant its proof ends with. The goal's 363636 follows from it, but not from the printed Theorem 6.
    • The printed proof of Theorem 6 passes through Proposition 5, which is false as printed. Do not expect that route to work. Lemma 4 is kept as a statement about the composition class's own dimension.

A complete development needs: linear-fractional optimization over function boxes; Dudley-type entropy bounds for VC-major and VC-hull classes; the Dvoretzky–Kiefer–Wolfowitz inequality with Massart's constant (posed separately on the platform as MassartDKW.Tight.corollary_1); and a uniform bound for Hájek ratios. The empirical-process pieces (VC-major classes, monotone classes) are reusable well beyond this mission. Contributions to any milestone, and alternative routes to Theorem 6 that avoid Proposition 5, are welcome.

Selected references

  • N. Kallus and A. Zhou, Confounding-Robust Policy Improvement, arXiv:1805.08593v3, 2019; published as Minimax-Optimal Policy Learning Under Unobserved Confounding, Management Science, 2021. https://arxiv.org/abs/1805.08593v3
  • Z. Tan, A distributional approach for causal inference using propensity scores, Journal of the American Statistical Association 101(476), 2006. https://doi.org/10.1198/016214506000000023
  • P. Massart, The tight constant in the Dvoretzky–Kiefer–Wolfowitz inequality, Annals of Probability 18(3), 1990. https://doi.org/10.1214/aop/1176990746
  • A. W. van der Vaart and J. A. Wellner, Weak Convergence and Empirical Processes, Springer, 1996. https://doi.org/10.1007/978-1-4757-2545-2
10 thms1 active userReviewed
EconomicsProbability·Captain: mikedeng1

Demand Pooling in Omnichannel Operations: When the Online Waiting Cost Is Relatively Low and the Store Visiting Cost Even Lower, Buy-Online-Pickup-at-Store Benefits the RetailerResearch Paper

Motivation

Retailers that sell both through physical stores and online increasingly offer buy-online-pickup-at-store (BOPS): a customer reserves an item online against the store's inventory and collects it in the store. Whether this helps the retailer is not obvious. BOPS changes which customers draw on the store inventory, and therefore how much stock the store should carry and how often a visiting customer finds the item. Gao and Su (Management Science, 2017) modelled BOPS with customers who respond to store inventory availability and found that it need not be profitable for every product; Hu, Xu, Xue and Yang (Management Science 68(2), 2022; accepted manuscript SSRN 3214047) ask when it helps, through the inventory side. They identify two opposing effects: demand pooling, where BOPS moves online demand onto the store inventory, and demand depooling, where BOPS splits off customers who used to buy in the store. This mission formalizes their first effect, Proposition 3: in a stated region of costs, BOPS benefits the retailer.

Setting

A retailer owns one brick-and-mortar store and an online channel fulfilled from a distribution centre. On a probability space (Ω,F,P)(\Omega,\mathcal F,\mathbb P)(Ω,F,P) there are two customer segments with random market sizes: Ds≥0D_s\ge 0Ds​≥0 store-only customers, who buy only in the store, and Dm≥0D_m\ge0Dm​≥0 omni-customers, who may buy in the store or online. The store sells at price pbp_bpb​ with unit cost cbc_bcb​; the online channel sells at pop_opo​ with unit cost co≤cbc_o\le c_bco​≤cb​. A store visit costs a customer k>0k>0k>0, waiting for an online delivery costs ttt. The base surpluses are uo=vo−pou_o=v_o-p_ouo​=vo​−po​ online and ub=vb−pbu_b=v_b-p_bub​=vb​−pb​ in the store, and Assumption (U) uo≥max⁡(t,ub)u_o\ge\max(t,u_b)uo​≥max(t,ub​) holds throughout.

The retailer chooses a store order quantity q≥0q\ge0q≥0 before demand is realized. A customer who visits the store finds the item with probability equal to the store's fill rate E[min⁡(D,q)]/E[D]\mathbb E[\min(D,q)]/\mathbb E[D]E[min(D,q)]/E[D], where DDD is the demand facing the store (Deneckere and Peck). Customers decide on the basis of a belief ζ^\hat\zetaζ^​ about the fill rate; the retailer orders on the basis of beliefs ϕ^s,ϕ^m\hat\phi_s,\hat\phi_mϕ^​s​,ϕ^​m​ about the fractions of each segment that shop in the store.

  • BASE (independent channels). A store visit is worth ζ^ub−k\hat\zeta u_b-kζ^​ub​−k, an online purchase uo−tu_o-tuo​−t. Store-only customers buy if ζ^ub−k≥0\hat\zeta u_b-k\ge0ζ^​ub​−k≥0; omni-customers go to the store if ζ^ub−k≥uo−t\hat\zeta u_b-k\ge u_o-tζ^​ub​−k≥uo​−t and buy online otherwise. The retailer's expected profit is
πB(q)=pbE[min⁡(ϕ^mDm+ϕ^sDs,q)]−cbq+(po−co)E[(1−ϕ^m)Dm].\pi_B(q)=p_b\mathbb E[\min(\hat\phi_mD_m+\hat\phi_sD_s,q)]-c_bq+(p_o-c_o)\mathbb E[(1-\hat\phi_m)D_m].πB​(q)=pb​E[min(ϕ^​m​Dm​+ϕ^​s​Ds​,q)]−cb​q+(po​−co​)E[(1−ϕ^​m​)Dm​].
  • BOPS. Omni-customers reserve against the store inventory when k≤tk\le tk≤t; store-only customers are served first; an omni-customer who meets a stockout buys online instead. The expected profit is
πP(q)=pbE[min⁡(ϕ^sDs,q)]+poE[min⁡(1{k≤t}Dm,(q−ϕ^sDs)+)]−cbq+(po−co)E[1{k>t}Dm+(1{k≤t}Dm−(q−ϕ^sDs)+)+].\pi_P(q)=p_b\mathbb E[\min(\hat\phi_sD_s,q)]+p_o\mathbb E[\min(\mathbf 1_{\{k\le t\}}D_m,(q-\hat\phi_sD_s)^+)]-c_bq+(p_o-c_o)\mathbb E[\mathbf 1_{\{k>t\}}D_m+(\mathbf 1_{\{k\le t\}}D_m-(q-\hat\phi_sD_s)^+)^+].πP​(q)=pb​E[min(ϕ^​s​Ds​,q)]+po​E[min(1{k≤t}​Dm​,(q−ϕ^​s​Ds​)+)]−cb​q+(po​−co​)E[1{k>t}​Dm​+(1{k≤t}​Dm​−(q−ϕ^​s​Ds​)+)+].

A rational-expectations (RE) equilibrium is a profile in which customers' choices are optimal for the believed fill rate, the order quantity is optimal for the believed choices, and both beliefs are correct. When several exist, the paper selects the Pareto-dominant one. The optimal order quantities qsq_sqs​, qsmq_{sm}qsm​ (BASE, with only store-only customers, respectively both segments, in the store) and qpq_pqp​ (BOPS, store-only customers in the store) define fill rates ζs,ζsm,ζp\zeta_s,\zeta_{sm},\zeta_pζs​,ζsm​,ζp​.

Formalization targets

Goal: Proposition 3 (demand pooling effect)

If

ζsmub−uo+t<k≤min⁡(t,ζpub),\zeta_{sm}u_b-u_o+t<k\le\min(t,\zeta_pu_b),ζsm​ub​−uo​+t<k≤min(t,ζp​ub​),

then Pareto-dominant RE equilibria exist under BASE and under BOPS, and at any such pair the retailer's expected profits satisfy

ΠB≤ΠP.\Pi_B\le\Pi_P .ΠB​≤ΠP​.

Milestones

  • Lemma 2: qsm≥qp≥qsq_{sm}\ge q_p\ge q_sqsm​≥qp​≥qs​ and ζp≥ζs\zeta_p\ge\zeta_sζp​≥ζs​ (when k≤tk\le tk≤t).
  • Proposition 1(ii): if ζsmub−(uo−t)<k≤ζsub\zeta_{sm}u_b-(u_o-t)<k\le\zeta_su_bζsm​ub​−(uo​−t)<k≤ζs​ub​ (and ζs≤ζsm\zeta_s\le\zeta_{sm}ζs​≤ζsm​), the BASE equilibrium is qB=qsq^B=q_sqB=qs​, (ϕsB,ϕmB)=(1,0)(\phi^B_s,\phi^B_m)=(1,0)(ϕsB​,ϕmB​)=(1,0).
  • Proposition 1(iii): if k>max⁡(ζsub,ζsmub−(uo−t))k>\max(\zeta_su_b,\zeta_{sm}u_b-(u_o-t))k>max(ζs​ub​,ζsm​ub​−(uo​−t)), the BASE equilibrium is qB=0q^B=0qB=0, (ϕsB,ϕmB)=(0,0)(\phi^B_s,\phi^B_m)=(0,0)(ϕsB​,ϕmB​)=(0,0).
  • Proposition 2(i): if k≤min⁡(t,ζpub)k\le\min(t,\zeta_pu_b)k≤min(t,ζp​ub​), the BOPS equilibrium is qP=qpq^P=q_pqP=qp​, ϕsP=1\phi^P_s=1ϕsP​=1, with omni-customers choosing BOPS.
  • Areas (I-2) and (I-3) of the proof of Proposition 3: the optimal BASE profit with beliefs (1,0)(1,0)(1,0), and the BASE profit with beliefs (0,0)(0,0)(0,0), are at most the optimal BOPS profit.

Significance

Proposition 3 is one half of the paper's comparison of BOPS with independent channels (Figure 3 of the paper): together with the depooling effect (Proposition 4) it partitions the cost region below the diagonal k<tk<tk<t into areas where BOPS helps, hurts, or is neutral. It isolates a mechanism that does not appear in models with exogenous store demand: the fill rate, and hence customers' channel choices, respond to the inventory decision.

The paper's proof is short once the equilibria are characterized, but it is a proof in the paper's normal-demand model, where the statement does not hold (see below). The mission produces a corrected, machine-checked version: an explicit equilibrium model with rational expectations and Pareto selection, the characterization of the equilibria that the comparison needs, and the comparison itself. None of these results has a machine-checked proof.

Difficulty

The comparison of profits is easy once one knows which equilibrium each strategy selects; the work lies in the equilibrium analysis. Equilibria are fixed points of a map that couples a newsvendor problem with a discrete choice through the fill rate, and the fill rate is a ratio of expectations of the optimizer. Showing that a candidate profile is consistent, that the remaining profiles are not, and that the selected one Pareto-dominates every other, requires comparing optimal values of different newsvendor objectives and monotonicity of optimizers between them (Lemma 2), without closed forms. The obvious shortcut, reading off the equilibria from the paper's case tables, is not available: the tables are the theorems to be proved.

Formalization scope

All objects live in the namespace OmniPool.BOPS; a single definitions file encodes the profits (2) and (4) term by term, the fill rates, the choice rules in utility form, and the RE equilibria of Definitions A1 and A2 as fixed points.

  • Corrected demand model. The paper assumes jointly normal market sizes with equal coefficients of variation. Normal market sizes are negative with positive probability; the expected BOPS sales term can then be negative, and the step "Clearly, ΠB≤ΠP\Pi_B\le\Pi_PΠB​≤ΠP​" fails (a numerical counterexample is recorded with the mission). Here Ds,DmD_s,D_mDs​,Dm​ are arbitrary nonnegative integrable random variables with positive means. Assumption (M), the correlation and the coefficient-of-variation condition are not used.
  • Order quantities range over q≥0q\ge0q≥0; qs,qsm,qpq_s,q_{sm},q_pqs​,qsm​,qp​ are the unique maximizers over [0,∞)[0,\infty)[0,∞) of the respective profits.
  • Beliefs are real numbers that the choice rules set to 000 or 111; each equilibrium carries one copy of ζ\zetaζ and ϕ\phiϕ, so beliefs equal realizations by construction. The fill rate is defined as 000 when nobody shops in the store.
  • Pareto dominance under BASE compares the retailer, store-only customers and omni-customers; under BOPS, where the paper defines no omni-customer payoff, the retailer and store-only customers.
  • Lemma 1 (ζsm≥ζs\zeta_{sm}\ge\zeta_sζsm​≥ζs​) is a normal-model fact; it is a hypothesis of Proposition 1(ii) and is not used by the goal.
  • "Benefits the retailer" is the weak inequality ΠB≤ΠP\Pi_B\le\Pi_PΠB​≤ΠP​ of the proof.

The goal asserts existence of Pareto-dominant equilibria under both strategies; without these conjuncts the universally quantified comparison could hold vacuously. Defining ΠB,ΠP\Pi_B,\Pi_PΠB​,ΠP​ by the paper's region tables instead of through equilibria would make the goal a tautology and is ruled out.

Infrastructure needed: integrability of truncated demands, monotone comparative statics for maximizers of functions with increasing differences, and pointwise identities between the profit expressions. The equilibrium definitions are reusable for the paper's other results (Propositions 4 and 5) and for RE models of omnichannel retail. Proofs of the milestones, and formalizations of Propositions 1(i) and 2(ii)–(iii), are welcome.

Selected references

  • M. Hu, X. Xu, W. Xue, Y. Yang, Demand Pooling in Omnichannel Operations, Management Science 68(2):883–894, 2022. https://doi.org/10.1287/mnsc.2021.3964 (accepted manuscript: https://ssrn.com/abstract=3214047)
  • F. Gao, X. Su, Omnichannel Retail Operations with Buy-Online-and-Pick-up-in-Store, Management Science 63(8):2478–2492, 2017. https://doi.org/10.1287/mnsc.2016.2473
  • R. Deneckere, J. Peck, Competition over Price and Service Rate when Demand is Stochastic: A Strategic Analysis, RAND Journal of Economics 26(1):148–162, 1995. https://doi.org/10.2307/2556040
  • X. Su, F. Zhang, Strategic Customer Behavior, Commitment, and Supply Chain Performance, Management Science 54(10):1759–1773, 2008. https://doi.org/10.1287/mnsc.1080.0886
  • G. P. Cachon, R. Swinney, Purchasing, Pricing, and Quick Response in the Presence of Strategic Consumers, Management Science 55(3):497–511, 2009. https://doi.org/10.1287/mnsc.1080.0948
8 thms1 active userReviewed
Control TheoryProbabilityStochastic Systems·Captain: mikedeng1

A Dynamic Mean-Variance Analysis for Log Returns: In a Complete Market, Holding the Constant Fraction (μ − r)/((1 + γ)σ²) of Wealth in Stock Is an Equilibrium StrategyResearch Paper

Motivation

Mean-variance analysis, the trade-off between the expected value and the variance of a portfolio's outcome, is the most widely used criterion for portfolio choice in practice. In continuous time it has two well-known defects when applied to terminal wealth: the criterion is time-inconsistent (a strategy that is optimal today is no longer optimal tomorrow), and the resulting equilibrium strategies of Basak and Chabakauri (2010) and Björk, Murgoci and Zhou (2014) prescribe a dollar amount in the stock that does not scale with wealth, which is at odds with how investors and advisers think in terms of portfolio fractions.

Dai, Jin, Kou and Xu apply the mean-variance criterion to the log-return of the portfolio instead of to wealth. They show that, in the classical complete market with constant coefficients, the resulting equilibrium strategy is a constant fraction of wealth, that it coincides with the classical optimal strategy of Merton (1969) for a CRRA investor with relative risk aversion 1+γ1+\gamma1+γ, and that the investor's preference parameter γ\gammaγ is in one-to-one correspondence with a target annual return. The last fact is what the paper uses to elicit γ\gammaγ from an investor's stated target return.

Setting

A bond pays the constant interest rate rrr. One stock has price dSt=μSt dt+σSt dBtdS_t=\mu S_t\,dt+\sigma S_t\,dB_tdSt​=μSt​dt+σSt​dBt​ with constant drift μ\muμ, volatility σ>0\sigma>0σ>0, and BBB a standard Brownian motion on a probability space. An investor with horizon T>0T>0T>0 holds the fraction πt\pi_tπt​ of wealth WtW_tWt​ in the stock. A feedback strategy is a function π(τ,y)\pi(\tau,y)π(τ,y) of time and current log-wealth yyy. The log-wealth Rt=ln⁡WtR_t=\ln W_tRt​=lnWt​ then solves the stochastic differential equation (6)

dRs=[r+(μ−r)πs−12σ2πs2]ds+σπs dBs.dR_s=\Big[r+(\mu-r)\pi_s-\tfrac12\sigma^2\pi_s^2\Big]ds+\sigma\pi_s\,dB_s .dRs​=[r+(μ−r)πs​−21​σ2πs2​]ds+σπs​dBs​.

For a time t∈[0,T)t\in[0,T)t∈[0,T) and a log-wealth yyy, the investor evaluates a strategy through the reward function

J(t,y;π)=Et[RTπ]−γ2 Vart[RTπ],J(t,y;\pi)=\mathbb E_t\big[R^\pi_T\big]-\frac\gamma2\,\mathrm{Var}_t\big[R^\pi_T\big],J(t,y;π)=Et​[RTπ​]−2γ​Vart​[RTπ​],

the mean minus γ/2\gamma/2γ/2 times the variance of terminal log-wealth for the process started at Rt=yR_t=yRt​=y. Here γ>0\gamma>0γ>0 is a constant (Assumption A). A strategy is admissible if Et∫tT∣σπs∣2ds<∞\mathbb E_t\int_t^T|\sigma\pi_s|^2ds<\inftyEt​∫tT​∣σπs​∣2ds<∞.

Because JJJ is time-inconsistent, optimality is replaced by an equilibrium, following Björk, Khapko and Murgoci (2017). For h>0h>0h>0 and v∈Rv\in\mathbb Rv∈R, the perturbation πh,v\pi^{h,v}πh,v holds the constant fraction vvv on [t,t+h)[t,t+h)[t,t+h) and follows π^\hat\piπ^ afterwards. An admissible π^\hat\piπ^ is an equilibrium strategy (Definition 1) if, at every t∈[0,T)t\in[0,T)t∈[0,T), every yyy and every vvv,

lim inf⁡h→0+J(t,y;π^)−J(t,y;πh,v)h ≥ 0.\liminf_{h\to0^+}\frac{J(t,y;\hat\pi)-J(t,y;\pi^{h,v})}{h}\ \ge\ 0 .h→0+liminf​hJ(t,y;π^)−J(t,y;πh,v)​ ≥ 0.

With θ=(μ−r)/σ\theta=(\mu-r)/\sigmaθ=(μ−r)/σ the market price of risk, the mission's two named quantities are

π^=μ−r(1+γ)σ2,a^=r+(11+γ−12⋅1(1+γ)2)θ2.\hat\pi=\frac{\mu-r}{(1+\gamma)\sigma^2},\qquad \hat a=r+\Big(\frac1{1+\gamma}-\frac12\cdot\frac1{(1+\gamma)^2}\Big)\theta^2 .π^=(1+γ)σ2μ−r​,a^=r+(1+γ1​−21​⋅(1+γ)21​)θ2.

In Lean these are piHat M and aHat M for a market M : Market with fields μ r σ γ T; the SDE is IsLogReturn, admissibility Admissible, the reward J, the perturbation spike and Definition 1 IsEquilibrium.

Formalization targets

Goal: Theorem 2 (pp. 11–12)

  1. The constant strategy π^\hat\piπ^ and every perturbation πh,v\pi^{h,v}πh,v of it are admissible, and π^\hat\piπ^ is an equilibrium strategy.
  2. For every t∈[0,T)t\in[0,T)t∈[0,T), every yyy and every solution R^\hat RR^ of (6) under π^\hat\piπ^ started at R^t=y\hat R_t=yR^t​=y,
1T−t Et[R^T−R^t]=a^.\frac1{T-t}\,\mathbb E_t\big[\hat R_T-\hat R_t\big]=\hat a .T−t1​Et​[R^T​−R^t​]=a^.
  1. If μ≠r\mu\neq rμ=r, then a^∈(r, r+12θ2)\hat a\in(r,\,r+\tfrac12\theta^2)a^∈(r,r+21​θ2).

Milestones (Appendix C.2 and Theorem 2(ii))

  • Moments under a deterministic policy (p. O–10): for πs=p(s)\pi_s=p(s)πs​=p(s) deterministic, RT∈L2R_T\in L^2RT​∈L2, Et[RT]=Rt+∫tT(r+p(s)(μ−r)−12p(s)2σ2)ds\mathbb E_t[R_T]=R_t+\int_t^T\big(r+p(s)(\mu-r)-\tfrac12p(s)^2\sigma^2\big)dsEt​[RT​]=Rt​+∫tT​(r+p(s)(μ−r)−21​p(s)2σ2)ds and Vart(RT)=∫tTp(s)2σ2ds\mathrm{Var}_t(R_T)=\int_t^Tp(s)^2\sigma^2dsVart​(RT​)=∫tT​p(s)2σ2ds.
  • Spike decomposition (p. O–11): J(πh,v)=J(π^)+∫tt+h([v(μ−r)−1+γ2v2σ2]−[π^s(μ−r)−1+γ2π^s2σ2])dsJ(\pi^{h,v})=J(\hat\pi)+\int_t^{t+h}\big([v(\mu-r)-\tfrac{1+\gamma}2v^2\sigma^2]-[\hat\pi_s(\mu-r)-\tfrac{1+\gamma}2\hat\pi_s^2\sigma^2]\big)dsJ(πh,v)=J(π^)+∫tt+h​([v(μ−r)−21+γ​v2σ2]−[π^s​(μ−r)−21+γ​π^s2​σ2])ds for a deterministic π^\hat\piπ^.
  • Pointwise maximizer (p. O–11): π^=argmax⁡v∈R{v(μ−r)−1+γ2v2σ2}\hat\pi=\operatorname{argmax}_{v\in\mathbb R}\{v(\mu-r)-\tfrac{1+\gamma}2v^2\sigma^2\}π^=argmaxv∈R​{v(μ−r)−21+γ​v2σ2}.
  • No perturbation helps (p. O–11): J(t,y;πh,v)≤J(t,y;π^)J(t,y;\pi^{h,v})\le J(t,y;\hat\pi)J(t,y;πh,v)≤J(t,y;π^) for every h>0h>0h>0 and vvv.
  • Range of the target return (p. 12): r<a^<r+12θ2r<\hat a<r+\tfrac12\theta^2r<a^<r+21​θ2 when μ≠r\mu\ne rμ=r.

A supporting item (not a milestone) states the reward of an admissible deterministic policy, J(t,y;π)=y+∫tT(r+p(s)(μ−r)−1+γ2p(s)2σ2)dsJ(t,y;\pi)=y+\int_t^T\big(r+p(s)(\mu-r)-\tfrac{1+\gamma}2p(s)^2\sigma^2\big)dsJ(t,y;π)=y+∫tT​(r+p(s)(μ−r)−21+γ​p(s)2σ2)ds (p. O–10); another states that π^\hat\piπ^ and all its perturbations are admissible.

Significance

Part (i) shows that the dynamic mean-variance criterion on log-returns and CRRA expected utility of terminal wealth share the same optimal strategy in a complete market, although the first is time-inconsistent and the second is not. Part (ii) gives a closed-form, strictly increasing link between the target annual return and 1/(1+γ)1/(1+\gamma)1/(1+γ), which is the basis of the paper's procedure for eliciting the risk parameter (Corollary 1) and of its comparisons with terminal-wealth mean-variance strategies.

The result is proved on paper; nothing in it has a machine-checked proof. Formalizing it requires a working account of the Itô integral of deterministic integrands against Brownian motion (Gaussianity of the integral, its mean and variance, and uniqueness of solutions of an SDE with deterministic coefficients) in the form of the published step-sum relation EthierKurtz.HasBrownianItoIntegral. That account is reusable by any mission that computes moments of linear SDEs.

Difficulty

The paper's proof is three displays long because it takes the moment formulas for granted. Mathlib has Brownian motion (IsBrownianReal) but no Itô integral, no Itô isometry and no existence theory for SDEs, so each of the following is real work:

  • Existence. Every perturbation is a two-step deterministic strategy; one must exhibit, from every start (t,y)(t,y)(t,y), a solution of (6) whose stochastic integral satisfies the step-sum relation, i.e. control the in-probability convergence of the Itô sums using the continuity of Brownian paths.
  • Uniqueness. JJJ is defined on an arbitrary solution of (6); uniqueness (almost surely, on the whole interval) of the in-probability limit is what makes JJJ independent of the choice and lets the moment milestone speak about every solution.
  • Moments. The Itô integral of a deterministic square-integrable integrand is centred Gaussian with variance σ2∫p2\sigma^2\int p^2σ2∫p2. For step integrands this follows from independent increments; for a general deterministic integrand it needs an L2L^2L2-approximation argument.

The equilibrium inequality itself is pointwise algebra once the reward is known.

Formalization scope

  • Markovian reading. Et\mathbb E_tEt​ and Vart\mathrm{Var}_tVart​ are the mean and variance of the process started at (t,y)(t,y)(t,y), driven by the increments Bt+u−BtB_{t+u}-B_tBt+u​−Bt​ and adapted to their natural filtration. They are not conditional expectations given a filtration.
  • No state variable. The complete market has no factor XXX; strategies are functions π(τ,y)\pi(\tau,y)π(τ,y).
  • Itô integral. The stochastic integral is the published relation EthierKurtz.HasBrownianItoIntegral, in elapsed time from ttt, with the integrand set to 000 after the horizon.
  • Admissibility adds three conditions to the printed one: existence of a solution, almost-sure uniqueness on [t,T][t,T][t,T], and RT∈L2R_T\in L^2RT​∈L2. Without them JJJ is not a real number.
  • Reward. JJJ evaluates one chosen solution (Classical.epsilon); under admissibility the choice is immaterial.
  • Equilibrium. The lim inf⁡≥0\liminf\ge0liminf≥0 is written in ε\varepsilonε-form, and the perturbation is defined for every h>0h>0h>0, half-open at t+ht+ht+h as printed.
  • Constants. σ>0\sigma>0σ>0, γ>0\gamma>0γ>0 (Assumption A) and T>0T>0T>0 are the predicate Market.Standing. The coordinates of BBB are assumed measurable.
  • Printed slip. The interval claim a^∈(r,r+12θ2)\hat a\in(r,r+\tfrac12\theta^2)a^∈(r,r+21​θ2) is false for μ=r\mu=rμ=r (a^=r\hat a=ra^=r), so it is stated under μ≠r\mu\ne rμ=r. Part (i) and identity (10) are stated for every μ\muμ.

Trivializing encodings are ruled out: JJJ is defined from the SDE and never by the closed form of Appendix C.2, and the goal's conclusion (not its hypotheses) asserts admissibility of π^\hat\piπ^ and of every perturbation, so the equilibrium claim cannot hold vacuously. The moment milestone concludes RT∈L2R_T\in L^2RT​∈L2, because Lean's integral and variance are 000 on non-integrable inputs.

Welcome contributions: the Gaussian law of ∫p dB\int p\,dB∫pdB for deterministic ppp under the step-sum relation; existence and uniqueness for (6) with deterministic coefficients; and the algebraic milestones, which are independent of the stochastic layer.

Selected references

  • M. Dai, H. Jin, S. Kou, Y. Xu, A Dynamic Mean-Variance Analysis for Log Returns, SSRN working paper 3437268, version of Aug 2019; published in Management Science 67(2), 2021. https://ssrn.com/abstract=3437268, https://doi.org/10.1287/mnsc.2019.3493
  • T. Björk, M. Khapko, A. Murgoci, On time-inconsistent stochastic control in continuous time, Finance and Stochastics 21(2), 331–360, 2017. https://doi.org/10.1007/s00780-017-0327-5
  • T. Björk, A. Murgoci, X. Y. Zhou, Mean-variance portfolio optimization with state-dependent risk aversion, Mathematical Finance 24(1), 1–24, 2014. https://doi.org/10.1111/j.1467-9965.2011.00515.x
  • S. Basak, G. Chabakauri, Dynamic mean-variance asset allocation, Review of Financial Studies 23(8), 2970–3016, 2010. https://doi.org/10.1093/rfs/hhq028
  • R. C. Merton, Lifetime portfolio selection under uncertainty: the continuous-time case, Review of Economics and Statistics 51(3), 247–257, 1969. https://doi.org/10.2307/1926560
11 thms1 active userReviewed
Linear OptimizationOptimizationProbability·Captain: mikedeng1

Technical Note—Two-Stage Sample Robust Optimization: The Multi-Policy Approximation with Linear Decision Rules Is Asymptotically Optimal for Two-Stage Stochastic Linear OptimizationResearch Paper

Motivation

Two-stage stochastic linear optimization is the standard model for decisions taken before uncertainty is revealed and corrected after it: capacity before demand, inventory before transport capacities, generation commitments before load. In practice the probability distribution of the uncertainty is unknown and only historical samples are available, so the stochastic problem has to be replaced by a data-driven one. The sample average approximation (SAA) is consistent but can overfit badly on small samples; distributionally robust formulations hedge against this, but for two-stage problems they are typically intractable.

Bertsimas, Shtern and Sturt (arXiv:1907.07142v4, published as a Technical Note in Operations Research, 2022) study sample robust optimization (SRO): each sample is perturbed adversarially within a small ball intersected with a known support polyhedron. SRO is equivalent to two-stage distributionally robust optimization over a type-∞ Wasserstein ball (Bertsimas, Shtern, Sturt 2018, Proposition 3, as cited on p. 7), and evaluating its objective is NP-hard even for one sample. The paper proposes a tractable multi-policy approximation (MP), with one linear decision rule per sample, and proves that it recovers the optimal value and the optimal decisions of the underlying stochastic problem as the data grow, without assuming relatively complete recourse.

Setting

The data are c∈Rnc\in\mathbb R^nc∈Rn, q∈Rrq\in\mathbb R^rq∈Rr, T∈Rm×nT\in\mathbb R^{m\times n}T∈Rm×n, W∈Rm×rW\in\mathbb R^{m\times r}W∈Rm×r and an affine right-hand side h(ζ)=h0+Hζh(\zeta)=h^0+H\zetah(ζ)=h0+Hζ. The second-stage cost of a first-stage decision xxx under the realization ζ∈Rd\zeta\in\mathbb R^dζ∈Rd is

Q(x,ζ)=inf⁡y∈Rr{q⊤y: Tx+Wy≥h(ζ)},Q(x,\zeta)=\inf_{y\in\mathbb R^r}\{q^\top y:\ Tx+Wy\ge h(\zeta)\},Q(x,ζ)=y∈Rrinf​{q⊤y: Tx+Wy≥h(ζ)},

equal to +∞+\infty+∞ when no recourse yyy is feasible. With ξ\xiξ a random vector of law μ\muμ, the stochastic problem is

v∗=inf⁡x∈RnV∗(x),V∗(x)=c⊤x+E[Q(x,ξ)].(OPT)v^*=\inf_{x\in\mathbb R^n}V^*(x),\qquad V^*(x)=c^\top x+\mathbb E[Q(x,\xi)].\tag{OPT}v∗=x∈Rninf​V∗(x),V∗(x)=c⊤x+E[Q(x,ξ)].(OPT)

The support of ξ\xiξ lies in a known polyhedron Ξ={ζ:Gζ≥g0}\Xi=\{\zeta: G\zeta\ge g^0\}Ξ={ζ:Gζ≥g0}. Given i.i.d. samples ξ1,…,ξN\xi^1,\dots,\xi^Nξ1,…,ξN, a radius ϵN≥0\epsilon_N\ge0ϵN​≥0 and an ℓp\ell_pℓp​-norm, the uncertainty sets are UNi={ζ∈Ξ:∥ζ−ξi∥≤ϵN}U^i_N=\{\zeta\in\Xi:\|\zeta-\xi^i\|\le\epsilon_N\}UNi​={ζ∈Ξ:∥ζ−ξi∥≤ϵN​} and

v^NSRO=inf⁡x{c⊤x+1N∑i=1Nsup⁡ζ∈UNiQ(x,ζ)}.\hat v^{SRO}_N=\inf_x\Big\{c^\top x+\frac1N\sum_{i=1}^N\sup_{\zeta\in U^i_N}Q(x,\zeta)\Big\}.v^NSRO​=xinf​{c⊤x+N1​i=1∑N​ζ∈UNi​sup​Q(x,ζ)}.

A linear decision rule is a policy y(ζ)=y0+Yζy(\zeta)=y^0+Y\zetay(ζ)=y0+Yζ; the set of them is L\mathcal LL. The multi-policy approximation chooses, besides xxx, one rule yi∈Ly^i\in\mathcal Lyi∈L per sample, feasible on its own set:

v^NMP=inf⁡x, y1,…,yN∈L{c⊤x+1N∑i=1Nsup⁡ζ∈UNiq⊤yi(ζ) : Tx+Wyi(ζ)≥h(ζ) ∀ζ∈UNi, i∈[N]}.\hat v^{MP}_N=\inf_{x,\ y^1,\dots,y^N\in\mathcal L}\Big\{c^\top x+\frac1N\sum_{i=1}^N\sup_{\zeta\in U^i_N}q^\top y^i(\zeta)\ :\ Tx+Wy^i(\zeta)\ge h(\zeta)\ \forall\zeta\in U^i_N,\ i\in[N]\Big\}.v^NMP​=x, y1,…,yN∈Linf​{c⊤x+N1​i=1∑N​ζ∈UNi​sup​q⊤yi(ζ) : Tx+Wyi(ζ)≥h(ζ) ∀ζ∈UNi​, i∈[N]}.

The single-policy approximation (SP) uses one shared rule for all iii.

Formalization targets

Goal: Theorem 2 (p. 12)

Assume [A1] ϵN→0\epsilon_N\to0ϵN​→0; [A2] v∗v^*v∗ is finite and E∥ξ∥<∞\mathbb E\|\xi\|<\inftyE∥ξ∥<∞; [A3] the optimal set of (OPT) is nonempty and bounded; [A4] there are xxx and ϵ>0\epsilon>0ϵ>0 such that around every ζ^∈Ξ\hat\zeta\in\Xiζ^​∈Ξ some linear decision rule is feasible on B(ζ^,ϵ)∩ΞB(\hat\zeta,\epsilon)\cap\XiB(ζ^​,ϵ)∩Ξ. Then

lim⁡N→∞v^NSRO=lim⁡N→∞v^NMP=v∗a.s.,\lim_{N\to\infty}\hat v^{SRO}_N=\lim_{N\to\infty}\hat v^{MP}_N=v^*\quad\text{a.s.},N→∞lim​v^NSRO​=N→∞lim​v^NMP​=v∗a.s.,

and almost surely every accumulation point of optimal first-stage decisions of (SRO) or (MP) is optimal for (OPT).

Milestones

  1. SAA value consistency, cited in the proof of Theorem 2 (p. 20): v^NSAA→v∗\hat v^{SAA}_N\to v^*v^NSAA​→v∗ a.s. under [A2]–[A3].
  2. Theorem 1 (p. 10): v^NSRO≤v^NMP≤v^NSP\hat v^{SRO}_N\le\hat v^{MP}_N\le\hat v^{SP}_Nv^NSRO​≤v^NMP​≤v^NSP​, pointwise in xxx as well, for any policy class.
  3. Lemma 5 (p. 34) and Lemma 9 (p. 40): below the radius ΔΞ\Delta_\XiΔΞ​ of a point, B(ζ^,ϵ)∩ΞB(\hat\zeta,\epsilon)\cap\XiB(ζ^​,ϵ)∩Ξ scales about ζ^\hat\zetaζ^​ and translates along the relative interior of a face.
  4. Lemma 1 (p. 14): [A4] is equivalent to a condition on minimal faces ([A5]) and to feasibility with finitely many recourse matrices ([A6]).
  5. Display (3) (p. 16) and Lemma 2 (p. 16): feasibility of rules with matrices in a set C\mathcal CC moves to decisions λx∗+(1−λ)x\lambda x^*+(1-\lambda)xλx∗+(1−λ)x near x∗x^*x∗, with a uniform smaller radius.
  6. Lemma 3 (p. 17): QϵC(x,ζ)≤Q(x∗,ζ)+ϵηC+L∥x−x∗∥∗Q^{\mathcal C}_\epsilon(x,\zeta)\le Q(x^*,\zeta)+\epsilon\eta^{\mathcal C}+L\|x-x^*\|_*QϵC​(x,ζ)≤Q(x∗,ζ)+ϵηC+L∥x−x∗∥∗​ on the set Ξ∗\Xi^*Ξ∗ of realizations feasible for x∗x^*x∗.
  7. SAA argmin consistency, cited on p. 22: accumulation points of near-optimal SAA solutions are a.s. optimal.

Significance

Theorem 2 says that a linear or second-order cone program with O(N)O(N)O(N) variables and constraints (Proposition 1) is a consistent estimator of the optimal value and decisions of a two-stage stochastic linear program, under assumptions comparable to those for SAA, for unbounded Ξ\XiΞ and without relatively complete recourse. Theorem 1 adds that (MP) is always a valid upper approximation of (SRO), so the same limit holds for the intractable SRO problem.

The result is proved in the paper; nothing here is open. No part of it has been machine-checked. A complete development would give a verified model of two-stage linear programs with extended-valued recourse, a verified sample-robust and multi-policy layer, and the polyhedral lemmas on balls intersected with polyhedra (Lemmas 5, 9 and display (3)), which are reusable for other robust and distributionally robust convergence results. The two cited consistency statements (milestones 1 and 7) would be the first formal consistency results for SAA with extended-valued convex integrands.

Difficulty

The upper bound lim sup⁡v^NMP≤v∗\limsup\hat v^{MP}_N\le v^*limsupv^NMP​≤v∗ cannot be obtained by plugging an optimal x∗x^*x∗ into (MP): x∗x^*x∗ need not admit any linear decision rule feasible on a neighbourhood of a sample, and without relatively complete recourse a sample near the boundary of the feasible region may admit none at all. The proof perturbs x∗x^*x∗ towards the point given by [A4], which requires the uniform radius of display (3), obtained from an induction over the faces of Ξ∗\Xi^*Ξ∗ in Appendix C. Lemma 1's direction [A4] ⇒\Rightarrow⇒ [A6] is a second induction over face dimension (Appendix B).

The lower bound reduces to SAA, but the SAA consistency it needs is for an extended-valued, merely lower semicontinuous convex integrand (King and Wets 1991), for which Mathlib has no epi-convergence theory and no law of large numbers for random lower semicontinuous functions. A uniform law of large numbers on a compact set does not apply: the feasible region need not be bounded and QQQ is +∞+\infty+∞ off a polyhedron.

Formalization scope

Vectors are Fin k → ℝ; the ℓp\ell_pℓp​-norm is that of PiLp p for an arbitrary p : ℝ≥0∞ with 1 ≤ p, the dual norm is sup⁡{u⊤v:∥u∥≤1}\sup\{u^\top v:\|u\|\le1\}sup{u⊤v:∥u∥≤1}, and the same p is used on Rn\mathbb R^nRn in Lemma 3. Every optimal value (QQQ, V∗V^*V∗, v∗v^*v∗, the SAA, SRO, SP and MP values, QϵCQ^{\mathcal C}_\epsilonQϵC​, ηC\eta^{\mathcal C}ηC, ΔΞ\Delta_\XiΔΞ​) is an infimum or supremum in EReal: "min" and "max" are read as inf and sup, attainment is never assumed, infeasibility gives +∞+\infty+∞, and the factor 1/N1/N1/N is the real N−1N^{-1}N−1. The expectation is the platform definition DupacovaWets.Consistency.expect (+∞+\infty+∞ when ∫Q+=∞\int Q^+=\infty∫Q+=∞, else ∫Q+−∫Q−\int Q^+-\int Q^-∫Q+−∫Q−), which agrees with the usual expectation whenever v∗v^*v∗ is finite. Samples are ξ 0, ξ 1, …, independent with law μ\muμ and μ(Ξc)=0\mu(\Xi^c)=0μ(Ξc)=0; the paper's ξ1,…,ξN\xi^1,\dots,\xi^Nξ1,…,ξN are the first NNN. The radii ϵN≥0\epsilon_N\ge0ϵN​≥0 are deterministic. (MP) is stated as printed with NNN policies. Faces of Ξ\XiΞ are nonempty sets {ζ∈Ξ:GIζ=gI0}\{\zeta\in\Xi: G_I\zeta=g^0_I\}{ζ∈Ξ:GI​ζ=gI0​}, and the relative interior is intrinsicInterior.

Trivializing encodings are ruled out: QQQ is not real-valued with a junk value for infeasibility, the expectation is not a Bochner integral of a real truncation, optimal values are not real sInfs, [A4] is the printed local condition and not the global single-rule condition of Proposition 2, and the accumulation-point clauses quantify over sequences that are optimal for all large NNN (requiring optimality at N=0N=0N=0 would make them vacuous).

Disclosed readings: the accumulation-point clauses of Theorem 2 hold on one almost-sure event for every eventually-optimal sequence; Lemmas 2 and 3 and display (3) carry §4.2's standing [A2]–[A3], the support condition, and optimality of x∗x^*x∗; Lemmas 5 and 9 assume the appendix's normalization ∥gi∥∗=1\|g_i\|_*=1∥gi​∥∗​=1 but not minimality of the representation; display (3)'s set-builder, which omits its bound variable, is read as in Theorem 3; Lemma 2 is stated as printed with λx∗+(1−λ)x\lambda x^*+(1-\lambda)xλx∗+(1−λ)x, although its proof derives the equivalent form with λ\lambdaλ and 1−λ1-\lambda1−λ swapped.

Contributions welcome: proofs of any milestone, in particular LP strong duality in this inequality form for Lemma 3, the polyhedral Lemmas 5 and 9, and the SAA consistency results, which are reusable beyond this mission.

Selected references

  • D. Bertsimas, S. Shtern, B. Sturt, Two-Stage Sample Robust Optimization, arXiv:1907.07142v4, 3 Nov 2020 (the version formalized; later a Technical Note in Operations Research, 2022). https://arxiv.org/abs/1907.07142v4
  • D. Bertsimas, S. Shtern, B. Sturt, A data-driven approach to multi-stage stochastic linear optimization, preprint, 2018. http://www.optimization-online.org/DB_HTML/2018/11/6907.html
  • A. J. King, R. J.-B. Wets, Epi-consistency of convex stochastic programs, Stochastics and Stochastic Reports 34(1–2):83–92, 1991.
  • S. M. Robinson, Analysis of sample-path optimization, Mathematics of Operations Research 21(3):513–528, 1996. https://doi.org/10.1287/moor.21.3.513
  • M. Conforti, G. Cornuéjols, G. Zambelli, Integer Programming, Springer, 2014. https://doi.org/10.1007/978-3-319-11008-0
14 thms1 active userReviewed
AnalysisControl TheoryEconomics·Captain: mikedeng1

Knowledge Accumulation, Privacy, and Growth in a Data Economy: The Decentralized Economy Grows at the Socially Optimal Rate on the Balanced Growth PathResearch Paper

Motivation

Data have become an input to innovation: firms use consumer data, together with research labor, to develop new products. Data differ from labor and capital in two ways. They are a by-product of consumption, so their supply is endogenous, and selling them costs consumers privacy. Cong, Xie and Zhang (arXiv:2109.10028, published in Management Science) put both features into a continuous-time semi-endogenous growth model in the tradition of Romer (1990) and Jones (1995). They then ask whether a decentralized market economy with data trading grows at the rate a social planner would choose.

The paper's headline has two halves. The first, which this mission formalizes, is analytical: on the balanced growth path the decentralized economy and the social planner grow at the same rates (Proposition 3). The second, that the market economy underemploys R&D labor and overuses data, is shown only numerically (§3.3, Figure 1) and is not part of the mission.

Setting

Time is continuous. The population is L(t)=L0entL(t)=L_0e^{nt}L(t)=L0​ent with n>0n>0n>0. Parameters: discount rate ρ>0\rho>0ρ>0; inverse elasticity of intertemporal substitution γ>0\gamma>0γ>0, γ≠1\gamma\neq1γ=1; privacy-disutility curvature σ>1\sigma>1σ>1; labor elasticity 0<β<10<\beta<10<β<1; marginal cost ψ>0\psi>0ψ>0 of intermediate goods; innovation efficiency η>0\eta>0η>0; data share 0<ξ<10<\xi<10<ξ<1; knowledge spillover 0<ζ<10<\zeta<10<ζ<1.

Varieties of intermediate goods N(t)N(t)N(t) accumulate through the innovation possibility frontier

N˙(t)=ηN(t)ζϕ(t)ξlR(t)1−ξL(t),\dot N(t)=\eta N(t)^\zeta\phi(t)^\xi l_R(t)^{1-\xi}L(t),N˙(t)=ηN(t)ζϕ(t)ξlR​(t)1−ξL(t),

where ϕ(t)\phi(t)ϕ(t) is the data each consumer sells and lR(t)l_R(t)lR​(t), lE(t)=1−lR(t)l_E(t)=1-l_R(t)lE​(t)=1−lR​(t) are the labor shares of R&D and final-good production.

The decentralized economy (§2). Per-capita consumption ccc obeys the Euler equation c˙/c=(r−ρ)/γ\dot c/c=(r-\rho)/\gammac˙/c=(r−ρ)/γ. The data price pϕp_\phipϕ​ obeys p˙ϕ/pϕ−(σ−1)ϕ˙/ϕ=r−ρ\dot p_\phi/p_\phi-(\sigma-1)\dot\phi/\phi=r-\rhop˙​ϕ​/pϕ​−(σ−1)ϕ˙​/ϕ=r−ρ. Data are bounded by consumption: ϕ˙/ϕ≤c˙/c\dot\phi/\phi\le\dot c/cϕ˙​/ϕ≤c˙/c. Monopolistic intermediate producers earn the profit π=KπlEL\pi=K_\pi l_ELπ=Kπ​lE​L and pay the wage w=KwNw=K_wNw=Kw​N. A patent is worth the present value

V(t)=∫t∞exp⁡(−∫tsr(τ) dτ)π(s) ds.V(t)=\int_t^\infty \exp\Big(-\int_t^s r(\tau)\,d\tau\Big)\pi(s)\,ds .V(t)=∫t∞​exp(−∫ts​r(τ)dτ)π(s)ds.

Free entry equates the marginal value of data and of labor in R&D with their prices: ηξNζϕξ−1lR1−ξV=pϕ\eta\xi N^\zeta\phi^{\xi-1}l_R^{1-\xi}V=p_\phiηξNζϕξ−1lR1−ξ​V=pϕ​ and η(1−ξ)NζϕξlR−ξV=w\eta(1-\xi)N^\zeta\phi^\xi l_R^{-\xi}V=wη(1−ξ)NζϕξlR−ξ​V=w.

The social planner (§3.2) maximizes the consumer's utility subject to the frontier, the resource constraint c=AβNlEc=A\beta Nl_Ec=AβNlE​ with A=(ψ/(1−β))1−1/βA=(\psi/(1-\beta))^{1-1/\beta}A=(ψ/(1−β))1−1/β, and lR+lE=1l_R+l_E=1lR​+lE​=1. The paper solves this problem through the necessary conditions of the current-value Hamiltonian, with shadow prices λ\lambdaλ and μ\muμ ((A.7)–(A.10)).

A balanced growth path (BGP) is a path on which every variable grows at a constant rate of its own, and the interest rate is a constant r∗r^*r∗. With D=(1−ζ)σ−ξ(1−γ)D=(1-\zeta)\sigma-\xi(1-\gamma)D=(1−ζ)σ−ξ(1−γ), write

g∗=σnD,gϕ∗=(1−γ)nD.g^*=\frac{\sigma n}{D},\qquad g^*_\phi=\frac{(1-\gamma)n}{D}.g∗=Dσn​,gϕ∗​=D(1−γ)n​.

Formalization targets

Goal: Proposition 3 (p. 11)

With γ>1\gamma>1γ>1, for a balanced growth path of the decentralized economy and one of the planner's system with the same parameters,

gcS=gc,gNS=gN,gϕS=gϕ,glRS=glR,glES=glE,g^S_c=g_c,\quad g^S_N=g_N,\quad g^S_\phi=g_\phi,\quad g^S_{l_R}=g_{l_R},\quad g^S_{l_E}=g_{l_E},gcS​=gc​,gNS​=gN​,gϕS​=gϕ​,glR​S​=glR​​,glE​S​=glE​​,

and the planner's per-capita output ANlEAN l_EANlE​ grows at gcg_cgc​. The goal states equality of rates, not their closed form.

Milestones

  1. Lemma A.1 (PDF p. 24): two positive shares with constant growth rates that sum to one have rate zero.
  2. (A.2) (PDF p. 24): on a decentralized BGP, V=π/(r∗−n)V=\pi/(r^*-n)V=π/(r∗−n) and V˙/V=n\dot V/V=nV˙/V=n.
  3. (A.3) and (A.5) (PDF p. 25): (ζ−1)gN+ξgϕ+n=0(\zeta-1)g_N+\xi g_\phi+n=0(ζ−1)gN​+ξgϕ​+n=0 and (ζ−γ)gN+(ξ−σ)gϕ+n=0(\zeta-\gamma)g_N+(\xi-\sigma)g_\phi+n=0(ζ−γ)gN​+(ξ−σ)gϕ​+n=0.
  4. Proposition 1 (p. 9): decentralized rates gc=gN=g∗g_c=g_N=g^*gc​=gN​=g∗, gϕ=gϕ∗g_\phi=g^*_\phigϕ​=gϕ∗​; the data constraint never binds; gϕ<0g_\phi<0gϕ​<0 when γ>1\gamma>1γ>1.
  5. (A.11) and (A.13) (PDF p. 27): on a planner BGP, gc=1γ(gN−σgϕ)g_c=\frac1\gamma(g_N-\sigma g_\phi)gc​=γ1​(gN​−σgϕ​) and (ζ−1)gN+ξgϕ+n=0(\zeta-1)g_N+\xi g_\phi+n=0(ζ−1)gN​+ξgϕ​+n=0.
  6. (A.15) (PDF p. 28): planner rates gc=gN=g∗g_c=g_N=g^*gc​=gN​=g∗, gϕ=gϕ∗g_\phi=g^*_\phigϕ​=gϕ∗​.

Significance

The result. The equilibrium is inefficient: monopoly pricing and the knowledge spillover drive a wedge between private and social returns to R&D. Proposition 3 says that this wedge acts on levels (the R&D labor share and data intensity), not on long-run growth rates. Those rates are pinned by population growth, preferences and the frontier's returns to scale, and are free of scale effects. This puts the paper in the semi-endogenous growth family and isolates where data policy can matter. Privacy regulation and data ownership change allocations, not the long-run growth rate.

Formalizing it. The proofs in the paper are short and use growth-form identities freely. The mission makes the model precise: what a balanced growth path is, which equations hold in levels, and where integrability and positivity enter. The definition layer (constant-growth paths, present values of profit streams, Hamiltonian necessary-condition systems for growth models) does not exist on the platform and is reusable for other continuous-time growth models. None of these results has been machine-checked before.

Difficulty

The individual steps are short, but each has a gap the paper leaves open:

  • The decentralized patent value is an improper integral. The identity V=π/(r∗−n)V=\pi/(r^*-n)V=π/(r∗−n) needs r∗>nr^*>nr∗>n, which the paper does not state at that point and which must be derived from convergence of (9).
  • Growth-form identities come from differentiating products of real powers of positive functions; "a product of powers is constant" must be turned into "its growth rate vanishes".
  • Lemma A.1 needs a genuine argument: a positive function with a nonzero constant growth rate leaves (0,1)(0,1)(0,1).
  • Proposition 1 solves a 2×22\times22×2 linear system. Its determinant is DDD; the BGP hypotheses must rule out D≤0D\le0D≤0.

The tempting shortcut is to work with the growth rates directly. That skips the content: the rates of a balanced growth path are not given numbers, they are derived from the level equations.

Formalization scope

  • Paths and time. All paths are functions R→R\mathbb R\to\mathbb RR→R; every condition is imposed for t>0t>0t>0 (the paper's [0,∞)[0,\infty)[0,∞); the endpoint does not affect growth rates). Constant growth means x(t)>0x(t)>0x(t)>0 and x˙(t)=g x(t)\dot x(t)=g\,x(t)x˙(t)=gx(t) for t>0t>0t>0.
  • Decentralized economy. Encoded by its equilibrium conditions in level form: (4), (5), (3) with s=0s=0s=0, (9) with integrability of the integrand, (13), (15), (17)–(19), positivity, and lE+lR=1l_E+l_R=1lE​+lR​=1. The consumer's and producers' optimization problems are not formalized; the paper itself uses only these first-order conditions and closed forms. Data processing cost θ=0\theta=0θ=0 (baseline).
  • Planner. Encoded by the Hamiltonian necessary conditions (25)–(27), (A.7)–(A.10). The optimal control problem (24) is not formalized (no Pontryagin principle in Mathlib); the planner's BGP is a BGP of this system.
  • Disclosed readings of the text.
    • The BGP is read as "each variable at its own constant rate", although p. 9 says "the same constant rate"; Proposition 1 itself has gϕ∗≠g∗g^*_\phi\ne g^*gϕ∗​=g∗.
    • "Consumption grows with output" (PDF p. 25) is part of the decentralized BGP definition, since the paper never derives it.
    • Labor-market clearing is the equality used in every proof, not the inequality of p. 7.
    • The sign gϕ∗<0g^*_\phi<0gϕ∗​<0 in (21) is stated only under γ>1\gamma>1γ>1; for 0<γ<10<\gamma<10<γ<1 it is positive.
    • γ>1\gamma>1γ>1 is kept in Proposition 3 as printed, though the rate comparison does not use it.
  • Ruled-out trivialization. A formalization in which a BGP is a tuple of numbers satisfying (A.3), (A.5), (A.11), (A.13) would make the goal a linear-algebra exercise. Here the hypotheses are the level equations with derivatives. Positivity and integrability are part of the definitions, so junk values of Real.rpow and of the Bochner integral are excluded. Both BGP notions were checked to be inhabited at the paper's Table 2 calibration.
  • Welcome contributions. Lemmas on products of real powers of constant-growth functions, present values of exponentially growing streams, and proofs of the milestones in order.

Selected references

  • L. W. Cong, D. Xie, L. Zhang, Knowledge Accumulation, Privacy, and Growth in a Data Economy, arXiv:2109.10028v1, 2021; later published in Management Science. https://arxiv.org/abs/2109.10028
  • P. M. Romer, Endogenous Technological Change, Journal of Political Economy 98(5), S71–S102, 1990. https://doi.org/10.1086/261725
  • C. I. Jones, R&D-Based Models of Economic Growth, Journal of Political Economy 103(4), 759–784, 1995. https://doi.org/10.1086/262002
  • C. I. Jones, C. Tonetti, Nonrivalry and the Economics of Data, American Economic Review 110(9), 2819–2858, 2020. https://doi.org/10.1257/aer.20191330
12 thms1 active userReviewed
CombinatoricsProbability·Captain: mikedeng1

Mallows-Smoothed Distribution over Rankings Approach for Modeling Choice: A Dynamic Program Computes the Exact Choice Probabilities of the Mallows ModelResearch Paper

Motivation

An assortment decision determines which products a customer can buy, but its expected revenue depends on the probability that the customer chooses each offered product. A distribution over complete rankings gives a direct model: sample a customer's ranking, then take the highest-ranked product in the assortment. The resulting choice probabilities are easy to define and expensive to evaluate by direct enumeration, because a universe of nnn products has n!n!n! rankings. Désir, Goyal, Jagabathula and Segev study this issue for distributions built from Mallows models and use the resulting probabilities in assortment optimization and a case study (manuscript, §§2–5). This mission isolates their exact dynamic program for a single Mallows model, Theorem 1 of the manuscript.

Setting

Let the product universe be {a1,…,an}\{a_1,\ldots,a_n\}{a1​,…,an​}, with n≥1n\ge1n≥1. A ranking σ\sigmaσ assigns each product a distinct position from 111 to nnn; a smaller position means higher preference. The modal ranking is ω=a1⋯an\omega=a_1\cdots a_nω=a1​⋯an​, meaning that aia_iai​ has position iii. This choice follows the manuscript's relabelling of the products in §4.1. It fixes a reference order without restricting which ranking a customer may draw.

The Kendall–Tau distance d(σ,ω)d(\sigma,\omega)d(σ,ω) counts pairs of products whose order in σ\sigmaσ disagrees with their order in ω\omegaω. For a concentration parameter θ≥0\theta\ge0θ≥0, the Mallows distribution assigns probability

λθ(σ)=exp⁡(−θd(σ,ω))ψn(θ),ψn(θ)=∑τexp⁡(−θd(τ,ω)).\lambda_\theta(\sigma)=\frac{\exp(-\theta d(\sigma,\omega))}{\psi_n(\theta)}, \qquad \psi_n(\theta)=\sum_{\tau}\exp(-\theta d(\tau,\omega)).λθ​(σ)=ψn​(θ)exp(−θd(σ,ω))​,ψn​(θ)=τ∑​exp(−θd(τ,ω)).

The normalizer sums over all n!n!n! rankings. At θ=0\theta=0θ=0 they are equally likely; larger θ\thetaθ gives less weight to rankings with more pairwise disagreements. Every summand in ψn(θ)\psi_n(\theta)ψn​(θ) is positive, so the distribution is well-defined (manuscript, §2.1, p. 7).

An offer set SSS is a subset of the products. For an offered product ai∈Sa_i\in Sai​∈S, its choice probability is the Mallows weight of rankings that place aia_iai​ before every other member of SSS:

P(ai∣S)=∑σλθ(σ)1 ⁣[σ(ai)<σ(b) for every b∈S∖{ai}].P(a_i\mid S)=\sum_{\sigma}\lambda_\theta(\sigma) \mathbf 1\!\left[\sigma(a_i)<\sigma(b) \text{ for every }b\in S\setminus\{a_i\}\right].P(ai​∣S)=σ∑​λθ​(σ)1[σ(ai​)<σ(b) for every b∈S∖{ai​}].

This is equation (1) of the manuscript for one Mallows component (§2.2, p. 8). The formula is an exact definition, but its sum ranges over every ranking.

Algorithm 1 is the repeated insertion method. It starts with a1a_1a1​ and inserts each next product aia_iai​ at a position s∈{1,…,i}s\in\{1,\ldots,i\}s∈{1,…,i} with probability

αs,i=e−θ(i−s)∑k=0i−1e−θk.\alpha_{s,i}=\frac{e^{-\theta(i-s)}}{\sum_{k=0}^{i-1}e^{-\theta k}}.αs,i​=∑k=0i−1​e−θke−θ(i−s)​.

Write γs,m=∑ℓ=1sαℓ,m\gamma_{s,m}=\sum_{\ell=1}^{s}\alpha_{\ell,m}γs,m​=∑ℓ=1s​αℓ,m​. After step mmm, let π(i,s,m)\pi(i,s,m)π(i,s,m) denote the probability that aia_iai​ is first among the offered products inserted so far and occupies position sss. The manuscript's Algorithm 2 computes a separate table, πDP(i,s,m)\pi_{\mathrm{DP}}(i,s,m)πDP​(i,s,m), by its initial condition and recursions (3)–(4), without enumerating rankings (§4.1, pp. 16–18).

Formalization targets

Exact choice probabilities

For a1∈Sa_1\in Sa1​∈S, the mission's goal is Theorem 1: Algorithm 2 returns the Mallows choice probability of each offered product.

P(ai∣S)=∑s=1nπDP(i,s,n)for every ai∈S.P(a_i\mid S)=\sum_{s=1}^{n}\pi_{\mathrm{DP}}(i,s,n) \qquad\text{for every }a_i\in S.P(ai​∣S)=s=1∑n​πDP​(i,s,n)for every ai​∈S.

The table also returns zero for every product outside SSS. The milestone list follows the source's intermediate claims: the repeated insertion law is Mallows; choice probability decomposes by final position; and the probabilities obey the two cases of the insertion transition (Lemma 1 and §4.1, pp. 17–18).

Significance

The result replaces an n!n!n!-term probability sum with the manuscript's O(n3)O(n^3)O(n3) dynamic program for all offered products at once. Those probabilities are inputs to its later assortment optimization model and permit computations on product universes where direct ranking enumeration is impractical (manuscript, pp. 16, 18–21). This mission targets the exact identity, not a numerical approximation or the later mixed-integer formulation.

The result is already proved in the cited manuscript; the goal here is a machine-checked Lean proof. A completed development would provide reusable finite-ranking definitions, a formal repeated insertion law, and verified transitions between a probabilistic model and an explicit recurrence. The definitions and theorem statements in this proposal compile locally; the theorem proofs remain open.

Difficulty

At a single insertion, the chosen offered product can keep its position, move down one position, or be displaced by the new product. Which outcome matters depends on whether the newly inserted product is offered and on where the previous best offered product stood. A naive table recording only each product's total choice probability loses the position information needed for the next insertion. Algorithm 2 retains that information in π(i,s,m)\pi(i,s,m)π(i,s,m), so a proof must connect its state and boundary values to the distribution over complete rankings (manuscript, §4.1, pp. 17–18).

Formalization scope

Products and ranks are represented by Fin n and rankings by permutations of Fin n, interpreted as product-to-rank maps. Lean's indices begin at zero; the paper's aia_iai​, insertion position sss, and table indices begin at one. The modal ranking is identity after the paper's relabelling. Offer sets are finite subsets of Fin n, and n≥1n\ge1n≥1 wherever a1a_1a1​ is named. The concentration parameter satisfies θ≥0\theta\ge0θ≥0. The Mallows normalizer is the finite sum displayed above, rather than the manuscript's printed product formula.

Algorithm 2 says “without loss of generality” that a1∈Sa_1\in Sa1​∈S. The printed recurrence actually needs that condition, so the goal and the new-product transition state it explicitly. Equation (1), read literally for ai∉Sa_i\notin Sai​∈/S, can be positive because its indicator does not test membership. The main equality is therefore about ai∈Sa_i\in Sai​∈S; the table's zero output for unoffered products is stated separately. Outside the paper's index ranges, α\alphaα, the probabilistic π\piπ, and the dynamic-program table have explicit zero values. In particular, γ0,m=0\gamma_{0,m}=0γ0,m​=0 and π(i,0,m)=0\pi(i,0,m)=0π(i,0,m)=0 settle the boundary in recursion (3).

The left side of the goal is the weighted sum over every ranking; the right side is the table computed from recursions (3)–(4) and never examines a ranking. A proof needs finite permutation reasoning, normalization of the insertion probabilities, and a link between the insertion law and the table's meaning. Lemmas about these pieces, as well as proofs of the listed milestones, are welcome contributions.

Selected references

  • A. Désir, V. Goyal, S. Jagabathula and D. Segev, Mallows-Smoothed Distribution over Rankings Approach for Modeling Choice, manuscript submitted to Operations Research, OPRE-2018-04-176, version of 2019-09-25; published in Operations Research, 2021. SSRN 3172997; DOI 10.1287/opre.2020.2085.
7 thms1 active userReviewed
Economics·Captain: mikedeng1

The Strategic Benefit of Request for Proposal/Quotation: Sequential Bargaining with an Iterative RFx Stage Gives the Buyer at Least Her Most Favorable Bargaining ProfitResearch Paper

Procurement negotiations with a quotation stage

Industrial buyers rarely negotiate with suppliers from scratch. A common practice is to issue a request for proposal/quotation (RFx): suppliers first submit quotations, and the buyer then negotiates contracts with them one after another, possibly using the quotations as fallback options. Chu, Rong and Zheng (SSRN 3200030; Operations Research, doi:10.1287/opre.2019.1964) ask whether this extra stage helps the buyer when the actual terms are settled by bilateral bargaining anyway. Their answer is that it does: the buyer's equilibrium profit with an iterative tendering stage is at least her profit at the most favorable outcome of bargaining without one. The paper builds on the literature of bilateral bargaining in supply chains with competing suppliers, where the buyer's outside options are endogenous and the order of negotiations matters.

Setting

A monopoly buyer (player 0) procures from two suppliers (players 1 and 2) of substitutable products. Write {i,j}={1,2}\{i,j\}=\{1,2\}{i,j}={1,2} and (x)+=max⁡{x,0}(x)^+=\max\{x,0\}(x)+=max{x,0}. The model is described by the following scalars:

  • Π\PiΠ, the maximum supply chain profit;
  • Π−i\Pi^{-i}Π−i, the maximum chain profit when supplier iii does not participate;
  • Π−i(qjo)\Pi^{-i}(q_j^o)Π−i(qjo​), the chain profit when supplier iii does not participate and supplier jjj supplies his first-best quantity qjoq_j^oqjo​;
  • θi∈(0,1)\theta_i\in(0,1)θi​∈(0,1), supplier iii's bargaining power.

The paper's Assumptions 1–2 (a unique interior maximizer of the chain profit, and submodularity) imply Π>Π−i>Π−i(qjo)>0\Pi>\Pi^{-i}>\Pi^{-i}(q_j^o)>0Π>Π−i>Π−i(qjo​)>0 and Π<Π−2(q1o)+Π−1(q2o)\Pi<\Pi^{-2}(q_1^o)+\Pi^{-1}(q_2^o)Π<Π−2(q1o​)+Π−1(q2o​). Each bilateral negotiation is an asymmetric Nash bargaining problem: maximize (π−D)θ(π0−D0)1−θ(\pi-D)^{\theta}(\pi_0-D_0)^{1-\theta}(π−D)θ(π0​−D0​)1−θ, where π\piπ and π0\pi_0π0​ are the supplier's and the buyer's profits and DDD, D0D_0D0​ their reservation utilities.

Without an RFx (simultaneous bargaining). Supplier iii's dual-sourcing profit πi\pi_iπi​ maximizes πiθi(Π−πi−πj−π0−i)1−θi\pi_i^{\theta_i}(\Pi-\pi_i-\pi_j-\pi_0^{-i})^{1-\theta_i}πiθi​​(Π−πi​−πj​−π0−i​)1−θi​ subject to πi≥0\pi_i\ge 0πi​≥0 and Π−πi−πj≥π0−i\Pi-\pi_i-\pi_j\ge\pi_0^{-i}Π−πi​−πj​≥π0−i​. Here π0−i=Π−i−πj−i\pi_0^{-i}=\Pi^{-i}-\pi_j^{-i}π0−i​=Π−i−πj−i​ is the buyer's profit when she sources from jjj alone, and πj−i≥0\pi_j^{-i}\ge 0πj−i​≥0 is jjj's profit as exclusive supplier. The most favorable bargaining outcome πF=(π1F,π2F)\pi^F=(\pi^F_1,\pi^F_2)πF=(π1F​,π2F​) is the unique solution of

πi=θi(Π−πj−Π−i)+,{i,j}={1,2}.\pi_i=\theta_i\big(\Pi-\pi_j-\Pi^{-i}\big)^+ ,\qquad \{i,j\}=\{1,2\}.πi​=θi​(Π−πj​−Π−i)+,{i,j}={1,2}.

With an RFx. Suppliers quote offers π~1,π~2≥0\tilde\pi_1,\tilde\pi_2\ge 0π~1​,π~2​≥0, the profits they demand. The buyer then negotiates with a leader iii, accepting or rejecting his offer, and afterwards with the follower jjj. Accepting an offer turns it into a reservation utility, so the leader's program [RFx-i] maximizes

(π−Di)θi(Π−π−min⁡{π~j,θj(Π−π−π′)}−D0)1−θi(\pi-D_i)^{\theta_i}\big(\Pi-\pi-\min\{\tilde\pi_j,\theta_j(\Pi-\pi-\pi')\}-D_0\big)^{1-\theta_i}(π−Di​)θi​(Π−π−min{π~j​,θj​(Π−π−π′)}−D0​)1−θi​

over π\piπ and the buyer's single-sourcing profit π′≤Π−j\pi'\le\Pi^{-j}π′≤Π−j. The reservation utilities DiD_iDi​, D0D_0D0​ are given explicitly on p. 18 for each accept/reject choice. The buyer accepts both offers when no choice of leader, accept/reject decision or negotiated solution gives her more than Π−π~1−π~2\Pi-\tilde\pi_1-\tilde\pi_2Π−π~1​−π~2​.

Formalization targets

Goal: Theorem 5

For every pair of nonnegative offers at which the buyer accepts both offers,

Π−π1F−π2F ≤ Π−π~1−π~2,\Pi-\pi^F_1-\pi^F_2\ \le\ \Pi-\tilde\pi_1-\tilde\pi_2 ,Π−π1F​−π2F​ ≤ Π−π~1​−π~2​,

and the right-hand side also dominates the buyer's profit at every dual-sourcing equilibrium of simultaneous bargaining.

Milestones

  1. Lemma 1: after rejecting jjj's offer, the follower contract is πj=θj(Π−πi−π0−j)\pi_j=\theta_j(\Pi-\pi_i-\pi_0^{-j})πj​=θj​(Π−πi​−π0−j​), or jjj is excluded.
  2. Lemma 4: when the leader's offer is accepted at optimality, the buyer accepts π~j\tilde\pi_jπ~j​ iff π~j≤θj(Π−π~i−Π−j)+\tilde\pi_j\le\theta_j(\Pi-\tilde\pi_i-\Pi^{-j})^+π~j​≤θj​(Π−π~i​−Π−j)+, with the resulting profits.
  3. Lemma 5: when the leader's offer is rejected at optimality, πi>θi(Π−Π−i)\pi_i>\theta_i(\Pi-\Pi^{-i})πi​>θi​(Π−Π−i).
  4. Lemma 2: the buyer accepts both offers iff π~j≤θj(Π−π~i−Π−j)+\tilde\pi_j\le\theta_j(\Pi-\tilde\pi_i-\Pi^{-j})^+π~j​≤θj​(Π−π~i​−Π−j)+ for {i,j}={1,2}\{i,j\}=\{1,2\}{i,j}={1,2}, and the region is closed under lowering offers.
  5. Proposition 1: πF\pi^FπF is unique and Π−π1F−π2F\Pi-\pi^F_1-\pi^F_2Π−π1F​−π2F​ is the buyer's maximum profit over dual-sourcing equilibria.
  6. [Q] step of the proof of Theorem 5: πF\pi^FπF is the unique minimizer of Π−π1−π2\Pi-\pi_1-\pi_2Π−π1​−π2​ over 0≤πi≤θi(Π−πj−Π−i)+0\le\pi_i\le\theta_i(\Pi-\pi_j-\Pi^{-i})^+0≤πi​≤θi​(Π−πj​−Π−i)+.

Significance

Theorem 5 is a robustness statement for an everyday procurement practice. Without an RFx, simultaneous bargaining has many equilibria, and πF\pi^FπF is the best of them for the buyer. The theorem says the tendering stage secures at least this best case, whatever the bargaining powers and the substitutability of the suppliers. In the paper's Appendix A instance (θ=(3/4,1/4)\theta=(3/4,1/4)θ=(3/4,1/4), Π=1\Pi=1Π=1, Π−i=7/10\Pi^{-i}=7/10Π−i=7/10, Π−i(qjo)=3/5\Pi^{-i}(q_j^o)=3/5Π−i(qjo​)=3/5) the gain is strict: the most favorable outcome gives the buyer 10/1310/1310/13, the RFx equilibrium 35/4435/4435/44. Lemmas 2, 4 and 5 describe how a buyer responds to quotations in a Nash bargaining framework, and that description is reusable for other sequential-negotiation models.

The paper's results are proved in its e-companion. As far as is known, none of them has a machine-checked proof. Formalizing them checks a case analysis over Nash bargaining programs with piecewise-linear reservation utilities and zero-surplus corner cases, which is where informal arguments are easiest to get wrong.

Difficulty

The obvious argument works offer by offer: compute the follower's split, plug it into the leader's program and compare closed forms. It breaks down in two places. First, the buyer's profit in [RFx-i] contains min⁡{π~j,πj(π,π′)}\min\{\tilde\pi_j,\pi_j(\pi,\pi')\}min{π~j​,πj​(π,π′)}, so the leader's objective is neither concave nor smooth, and its maximizers move between regimes with the offers. Second, accepting an offer can leave zero bargaining surplus. Then every feasible point maximizes the Nash product, and the accept-both characterization has to hold for all of them, not for a convenient one. Comparing with πF\pi^FπF needs a separate argument as well: πF\pi^FπF is defined by a fixed-point system with positive parts, and [Q] has to be shown to have it as its unique optimum.

Formalization scope

  • Reduced model. The model is reduced to the scalars Π\PiΠ, Π−i\Pi^{-i}Π−i, Π−i(qjo)\Pi^{-i}(q_j^o)Π−i(qjo​), θi\theta_iθi​, as the paper itself does after Theorems 2–3 (p. 11). The primitive profit function, the contracts and Theorems 1–3 are not modelled. The standing hypotheses are the printed consequences of Assumptions 1–2 (p. 10), not the assumptions themselves. Assumption 3 enters as the constraint π′≤Π−j\pi'\le\Pi^{-j}π′≤Π−j and as πk−l≥0\pi_k^{-l}\ge 0πk−l​≥0.
  • Suppliers and offers. Suppliers are Fin 2 and offers are nonnegative reals.
  • Nash solutions. Nash solutions are argmax sets of the printed Nash products over the printed feasible sets. Every property at a solution is required of every maximizer. The free variable πi−j\pi_i^{-j}πi−j​ of [Simu-i] is omitted.
  • Theorem 4 as a bridge. The iterative tendering game is not formalized: the paper allows "any iterative tendering procedure", and its tie-breaking rules are constructed inside the proof of Theorem 4. Theorem 4 says that the equilibrium outcome lies in the accept-both class. The goal quantifies over the whole class, which contains the equilibrium outcome, exactly as the printed proof argues.
  • Ruling out trivial readings. "Accepts both offers" is defined from the Nash programs (8)–(12), not from Lemma 2's closed-form region. Defining it by the region would turn the goal into the linear program [Q]. The class is nonempty, since it contains (0,0)(0,0)(0,0), and it excludes large offers, so the goal is not vacuous.
  • Not stated. The piecewise closed forms and continuity claims of Lemmas 4–5 are not formalized. Neither is Lemma 5's clause "the buyer rejects π~j\tilde\pi_jπ~j​", which depends on the paper's tie-breaking.
  • Infrastructure. A complete development needs weighted AM–GM (Real.geom_mean_le_arith_mean2_weighted) for the Nash split, and a case analysis over piecewise-linear constraints. Contributions are welcome in both. A general lemma on asymmetric Nash splits, arg⁡max⁡xxθ(S−x)1−θ=θS\arg\max_x x^{\theta}(S-x)^{1-\theta}=\theta Sargmaxx​xθ(S−x)1−θ=θS on [0,S][0,S][0,S], would be reusable beyond this mission.

Selected references

  • L. Y. Chu, Y. Rong, H. Zheng, The Strategic Benefit of Request for Proposal/Quotation, SSRN 3200030 (2019 preprint); Operations Research, 2020. https://ssrn.com/abstract=3200030, https://doi.org/10.1287/opre.2019.1964
  • J. F. Nash, The Bargaining Problem, Econometrica 18(2), 1950. https://doi.org/10.2307/1907266
  • L. M. Marx, G. Shaffer, Rent Shifting and the Order of Negotiations, International Journal of Industrial Organization 25(5), 2007. https://doi.org/10.1016/j.ijindorg.2006.11.002
8 thms1 active userReviewed
Mechanism DesignProbability·Captain: mikedeng1

Large-Scale Bundle-Size Pricing: A Theoretical Analysis: With Identical Marginal Costs, Optimal Bundle-Size Pricing Asymptotically Achieves Perfect Price DiscriminationResearch Paper

Motivation

Firms that sell large catalogues of digital goods (streaming titles, cable channels, software features) rarely price every subset of products separately: with NNN products there are 2N2^N2N bundles. A common simplification is bundle-size pricing (BSP), where the price depends only on how many items the customer takes and the customer picks which items go into the bundle. BSP sits between pure bundling (one price for everything) and full mixed bundling, and its menu has only NNN prices.

Bakos and Brynjolfsson (Management Science, 1999) showed that for many products a pure bundle extracts almost all surplus under suitable concentration. Armstrong (Review of Economic Studies, 1999) showed that a cost-based two-part tariff asymptotically achieves the perfect-price-discrimination profit. Chu, Leslie and Sorensen (American Economic Review, 2011) computed optimal BSP menus numerically for up to five goods. Abdallah, Asadpour and Reed (Operations Research, 2021) develop an asymptotic theory of BSP as N→∞N \to \inftyN→∞. This mission formalizes their homogeneous-cost result: with identical marginal costs, optimal BSP asymptotically earns the perfect-price-discrimination profit.

Setting

A firm sells NNN products to one customer with valuations X1,…,XN≥0X_1, \dots, X_N \ge 0X1​,…,XN​≥0, additive over bundles. Let X(1)≤⋯≤X(N)X_{(1)} \le \dots \le X_{(N)}X(1)​≤⋯≤X(N)​ be the order statistics. A bundle of size nnn is worth VN(n)=∑k=0n−1X(N−k)V_N(n) = \sum_{k=0}^{n-1} X_{(N-k)}VN​(n)=∑k=0n−1​X(N−k)​ to the customer, the sum of her nnn largest valuations, with VN(0)=0V_N(0) = 0VN​(0)=0. The firm incurs a marginal cost cn≥0c_n \ge 0cn​≥0 for item nnn, so a bundle of size nnn costs cN(n)=∑k=0n−1cτ(N−k)c_N(n) = \sum_{k=0}^{n-1} c_{\tau(N-k)}cN​(n)=∑k=0n−1​cτ(N−k)​, where τ\tauτ lists the items by valuation and ties go to the lowest index.

A BSP menu is p=(p(1),…,p(N))p = (p(1), \dots, p(N))p=(p(1),…,p(N)) with p(n)∈R+∪{+∞}p(n) \in \mathbb R_+ \cup \{+\infty\}p(n)∈R+​∪{+∞}, where +∞+\infty+∞ means size nnn is not offered. The customer buys a size ζ(X,p)∈arg⁡max⁡0≤n≤N(VN(n)−p(n))\zeta(X,p) \in \arg\max_{0 \le n \le N} (V_N(n) - p(n))ζ(X,p)∈argmax0≤n≤N​(VN​(n)−p(n)), with n=0n = 0n=0 the free no-purchase option. The firm's profit is π(p)=∑n=1N(p(n)−cN(n)) 1{ζ(X,p)=n}\pi(p) = \sum_{n=1}^N (p(n) - c_N(n))\,\mathbf 1\{\zeta(X,p) = n\}π(p)=∑n=1N​(p(n)−cN​(n))1{ζ(X,p)=n}, and the BSP problem is E[π(pN⋆)]=sup⁡pE[π(p)]\mathbb E[\pi(p^\star_N)] = \sup_p \mathbb E[\pi(p)]E[π(pN⋆​)]=supp​E[π(p)]. The benchmark is perfect price discrimination, PPD=∑n=1NE[(Xn−cn)+]\mathrm{PPD} = \sum_{n=1}^N \mathbb E[(X_n - c_n)^+]PPD=∑n=1N​E[(Xn​−cn​)+], the most any selling mechanism can earn.

The large-offering regime describes the valuations as one random sequence X1,X2,…X_1, X_2, \dotsX1​,X2​,…:

  • (Assumption 1) the empirical distribution function FX,N(x)=1N∑n≤N1{Xn≤x}\mathbb F_{X,N}(x) = \frac1N\sum_{n \le N}\mathbf 1\{X_n \le x\}FX,N​(x)=N1​∑n≤N​1{Xn​≤x} converges in probability to FX(x)F_X(x)FX​(x) for each x≥0x \ge 0x≥0, where FXF_XFX​ is the distribution function of a nonnegative variable with finite mean μ\muμ;
  • (Assumption 2) {Xn}\{X_n\}{Xn​} is uniformly integrable and 1N∑n≤NXn→μ\frac1N\sum_{n\le N} X_n \to \muN1​∑n≤N​Xn​→μ in probability;
  • (Assumption 3) the costs are bounded and their empirical distribution converges.

The normalized curves are VˉN(t)=1NVN(⌊Nt⌋)\bar V_N(t) = \frac1N V_N(\lfloor Nt\rfloor)VˉN​(t)=N1​VN​(⌊Nt⌋) and cˉN(t)=1NcN(⌊Nt⌋)\bar c_N(t) = \frac1N c_N(\lfloor Nt\rfloor)cˉN​(t)=N1​cN​(⌊Nt⌋) for t∈[0,1]t \in [0,1]t∈[0,1]. The quantile function is FX−1(s)=inf⁡{x≥0:FX(x)≥s}F_X^{-1}(s) = \inf\{x \ge 0 : F_X(x) \ge s\}FX−1​(s)=inf{x≥0:FX​(x)≥s}.

Formalization targets

Goal: Theorem 2

With identical costs cn=c≥0c_n = c \ge 0cn​=c≥0, for every t∈[0,1]t \in [0,1]t∈[0,1],

VˉN(t)⇒Vˉ(t)=∫0tFX−1(1−s) ds,cˉN(t)⇒tc.\bar V_N(t) \Rightarrow \bar V(t) = \int_0^t F_X^{-1}(1-s)\,ds, \qquad \bar c_N(t) \Rightarrow t c.VˉN​(t)⇒Vˉ(t)=∫0t​FX−1​(1−s)ds,cˉN​(t)⇒tc.

The size fraction t⋆=sup⁡{s:FX−1(1−s)≥c}t^\star = \sup\{s : F_X^{-1}(1-s) \ge c\}t⋆=sup{s:FX−1​(1−s)≥c} maximizes Vˉ(t)−tc\bar V(t) - tcVˉ(t)−tc over [0,1][0,1][0,1], and t⋆=1−FX(c)t^\star = 1 - F_X(c)t⋆=1−FX​(c) when ccc is a continuity point of FXF_XFX​. If FX(c)<1F_X(c) < 1FX​(c)<1,

lim⁡N→∞E[π(pN⋆)]PPD=1.\lim_{N\to\infty}\frac{\mathbb E[\pi(p^\star_N)]}{\mathrm{PPD}} = 1.N→∞lim​PPDE[π(pN⋆​)]​=1.

Theorem 1 and the steps of the proofs

Theorem 1 is the general principle behind the goal. Suppose VˉN⇒Vˉ\bar V_N \Rightarrow \bar VVˉN​⇒Vˉ and cˉN⇒cˉ\bar c_N \Rightarrow \bar ccˉN​⇒cˉ pointwise, with nondecreasing continuous limits, and t⋆∈arg⁡max⁡Vˉ−cˉt^\star \in \arg\max \bar V - \bar ct⋆∈argmaxVˉ−cˉ. Offer the single size ⌊Nt⋆⌋\lfloor Nt^\star\rfloor⌊Nt⋆⌋ at price NVˉ(t⋆)−g(N)N\bar V(t^\star) - g(N)NVˉ(t⋆)−g(N), where g(N)g(N)g(N) grows faster than E[(VN(⌊Nt⋆⌋)−NVˉ(t⋆))2]\sqrt{\mathbb E[(V_N(\lfloor Nt^\star\rfloor) - N\bar V(t^\star))^2]}E[(VN​(⌊Nt⋆⌋)−NVˉ(t⋆))2]​ but is o(N)o(N)o(N). Then

E[π(pN)]E[π(pN⋆)]→1,E[π(pN)]N(Vˉ(t⋆)−cˉ(t⋆))→1.\frac{\mathbb E[\pi(p_N)]}{\mathbb E[\pi(p^\star_N)]} \to 1, \qquad \frac{\mathbb E[\pi(p_N)]}{N(\bar V(t^\star) - \bar c(t^\star))} \to 1.E[π(pN⋆​)]E[π(pN​)]​→1,N(Vˉ(t⋆)−cˉ(t⋆))E[π(pN​)]​→1.

The milestones follow the appendix proofs in order:

  1. the pathwise bound π(p)/N≤sup⁡tVˉN(t)−cˉN(t)\pi(p)/N \le \sup_t \bar V_N(t) - \bar c_N(t)π(p)/N≤supt​VˉN​(t)−cˉN​(t);
  2. the upper limit (A1);
  3. the purchase probability (A4);
  4. the lower limit (A5);
  5. Theorem 1;
  6. (A6), with μ=∫01FX−1(1−s) ds\mu = \int_0^1 F_X^{-1}(1-s)\,dsμ=∫01​FX−1​(1−s)ds;
  7. the identity between VˉN\bar V_NVˉN​ at grid points and integrals of the empirical quantile function;
  8. convergence of empirical quantiles at continuity points;
  9. (A7);
  10. PPD/N→Vˉ(t⋆)−t⋆c\mathrm{PPD}/N \to \bar V(t^\star) - t^\star cPPD/N→Vˉ(t⋆)−t⋆c;
  11. ∫01(FX−1(1−s)−c)+ds=Vˉ(t⋆)−t⋆c\int_0^1 (F_X^{-1}(1-s) - c)^+ds = \bar V(t^\star) - t^\star c∫01​(FX−1​(1−s)−c)+ds=Vˉ(t⋆)−t⋆c.

Significance

Theorem 2 says that, with identical marginal costs and enough statistical concentration across products, a menu of NNN size prices earns, to first order, everything a seller who knew each valuation could earn. Theorem 1 says more: one well-chosen bundle size, sold at a price slightly below its fluid value, is asymptotically as good as the optimal BSP menu. The paper's later results on heterogeneous costs (Theorems 3–4), clustered BSP and unknown budgets reuse this framework: Theorem 1 reduces each of them to computing the limit curves Vˉ\bar VVˉ and cˉ\bar ccˉ.

The results are proved in the paper and have no machine-checked version. This mission formalizes them under a weak-convergence hypothesis on the empirical distribution, with no independence assumption. The formal statements also fix points the page leaves implicit: the tie-breaking rules, the value of the BSP problem as a supremum, and the case FX(c)=1F_X(c) = 1FX​(c)=1, where the goal's ratio degenerates.

Difficulty

The obvious route to Theorem 2 goes through Theorem 1, as the paper does. That needs a g(N)g(N)g(N) dominating the L2L^2L2 fluctuation of VN(⌊Nt⋆⌋)V_N(\lfloor Nt^\star\rfloor)VN​(⌊Nt⋆⌋), and Assumptions 1–2 give no second moments. A proof of the goal must therefore avoid Theorem 1's g(N)g(N)g(N) condition or replace it with a weaker device.

The convergence VˉN(t)⇒Vˉ(t)\bar V_N(t) \Rightarrow \bar V(t)VˉN​(t)⇒Vˉ(t) is a statement about sums of top order statistics of a dependent sequence. Pointwise convergence of the empirical cdf does not by itself control the upper tail, which carries the mass of VNV_NVN​. The weak law and uniform integrability have to supply that control.

The upper bound (A1) requires exchanging a supremum over ttt with a limit in probability, which uses monotonicity of VˉN,cˉN\bar V_N, \bar c_NVˉN​,cˉN​ in ttt and continuity of the limits. The step "VˉN(t)=∫0tFX,N−1(1−s) ds\bar V_N(t) = \int_0^t \mathbb F^{-1}_{X,N}(1-s)\,dsVˉN​(t)=∫0t​FX,N−1​(1−s)ds for 0≤t≤10 \le t \le 10≤t≤1" holds only at grid points t=n/Nt = n/Nt=n/N, so the off-grid error must be bounded separately.

Formalization scope

Everything lives in the namespace LargeBSP.Homog. Items are 0-indexed: coordinate n < N is the paper's item n+1n+1n+1. The valuations are one sequence X : ℕ → Ω → ℝ on a probability space, measurable and nonnegative; the NNN-product model uses its first NNN terms. FXF_XFX​ is cdf ν for a probability measure ν on R\mathbb RR with ν(−∞,0)=0\nu(-\infty,0) = 0ν(−∞,0)=0 and finite mean. "⇒\Rightarrow⇒" toward a constant is convergence in probability (TendstoInMeasure); deterministic sequences use Tendsto.

Menus are ℕ → WithTop ℝ, with ⊤ meaning "not offered". Within a bundle size, items are ranked by valuation with ties to the lowest index, as on the page. Among sizes, the customer picks the smallest maximizer of surplus, a disclosed tie-break, so an indifferent customer does not buy. E[π(pN⋆)]\mathbb E[\pi(p^\star_N)]E[π(pN⋆​)] is the real supremum of the expected profit over all menus with prices in R+∪{∞}\mathbb R_+\cup\{\infty\}R+​∪{∞}. It is bounded by E∑n≤NXn\mathbb E\sum_{n\le N}X_nE∑n≤N​Xn​, so it is never the junk value of an unbounded supremum.

The quantile is inf⁡{y≥0:F(y)≥s}\inf\{y \ge 0 : F(y) \ge s\}inf{y≥0:F(y)≥s}. Its set is empty only outside (0,1)(0,1)(0,1), where Lean returns 000; every use is at s∈(0,1)s\in(0,1)s∈(0,1) or inside an integral. The set defining t⋆t^\start⋆ is taken over (0,1)(0,1)(0,1).

Disclosed readings:

  • the hypothesis FX(c)<1F_X(c) < 1FX​(c)<1 on the goal's ratio claim (otherwise PPD/N→0\mathrm{PPD}/N \to 0PPD/N→0 and the ratio is undetermined);
  • in Theorem 1, continuity of Vˉ,cˉ\bar V, \bar cVˉ,cˉ (stated where the theorem is introduced and used in its proof) and Vˉ(t⋆)>cˉ(t⋆)\bar V(t^\star) > \bar c(t^\star)Vˉ(t⋆)>cˉ(t⋆) (the second ratio's denominator);
  • ω+\omega_+ω+​ and o(⋅)o(\cdot)o(⋅) encoded as E[⋅2]/g2→0\mathbb E[\cdot^2]/g^2 \to 0E[⋅2]/g2→0 and g/N→0g/N \to 0g/N→0 with ggg eventually positive;
  • the grid-point form of the VˉN\bar V_NVˉN​–quantile identity.

The tail condition (6) of the paper is not assumed: neither proof uses it.

The goal cannot be satisfied trivially. E[π(pN⋆)]\mathbb E[\pi(p^\star_N)]E[π(pN⋆​)] is the value of the BSP problem over all menus, not a chosen menu. PPD is the sum of the per-item expectations. The instance Xn≡1X_n \equiv 1Xn​≡1, c=1/2c = 1/2c=1/2 satisfies every hypothesis with PPD=N/2>0\mathrm{PPD} = N/2 > 0PPD=N/2>0, Vˉ(t)=t\bar V(t) = tVˉ(t)=t and t⋆=1t^\star = 1t⋆=1. So the ratio is neither 0/00/00/0 nor fixed by a degenerate menu.

Needed infrastructure: order statistics of a finite family through a rank function, empirical distribution and quantile functions, the identity "mean = integral of the quantile function", convergence of quantiles under weak convergence (van der Vaart, Lemma 21.2), and uniform integrability of averages. These parts are reusable well beyond pricing. Contributions are welcome on any milestone, and on proofs of the goal that bypass Theorem 1's second-moment condition.

Selected references

  • T. Abdallah, A. Asadpour, J. Reed, Large-Scale Bundle-Size Pricing: A Theoretical Analysis, Operations Research 69(4), 2021 (author's manuscript used). https://doi.org/10.1287/opre.2020.2097
  • Y. Bakos, E. Brynjolfsson, Bundling Information Goods: Pricing, Profits, and Efficiency, Management Science 45(12), 1999. https://doi.org/10.1287/mnsc.45.12.1613
  • M. Armstrong, Price Discrimination by a Many-Product Firm, Review of Economic Studies 66(1), 1999. https://doi.org/10.1111/1467-937X.00079
  • C. S. Chu, P. Leslie, A. Sorensen, Bundle-Size Pricing as an Approximation to Mixed Bundling, American Economic Review 101(1), 2011. https://doi.org/10.1257/aer.101.1.263
  • A. W. van der Vaart, Asymptotic Statistics, Cambridge University Press, 2000, Chapter 21. https://doi.org/10.1017/CBO9780511802256
14 thms1 active userReviewed
Dynamic ProgrammingProbabilityStochastic Systems·Captain: mikedeng1

Online Allocation and Pricing: Constant Regret via Bellman Inequalities: Regret Is at Most the Information Loss Plus the Bellman LossResearch Paper

Motivation

An online allocator must commit to an action after each arrival, although later arrivals can change which actions would have been best. Revenue management and online resource allocation use regret to measure the expected reward lost against a benchmark. If the benchmark sees too much future information, this gap can grow with the horizon even when the online controller behaves optimally. Vera, Banerjee, and Gurvich use a benchmark whose extra information can be chosen for the application, and relate regret to two quantities that can be studied separately: how often the online action disagrees with an informed action, and how accurately a proposed value function satisfies a Bellman equation (Vera–Banerjee–Gurvich, 2020, §§2–3).

The paper proves constant-regret application results for online probing, dynamic pricing, and learning by combining this framework with estimates particular to each model. This mission isolates the framework's Theorem 5 and the displayed statements leading to it. Its result is known on paper; the work here is to give the model, the conditional expectations, and the regret bound machine-checkable statements.

Setting

There are TTT decision periods, indexed by time to go t=T,T−1,…,1t=T,T-1,\ldots,1t=T,T−1,…,1. At the start of period ttt the controller is in state St∈SS^t\in\mathcal SSt∈S and observes an input ξt∈Ξ\xi^t\in\Xiξt∈Ξ. It selects an action uuu from a nonempty feasible set U(St,ξt)\mathcal U(S^t,\xi^t)U(St,ξt), collects real reward R(St,ξt,u)R(S^t,\xi^t,u)R(St,ξt,u), and moves to St−1=T(St,ξt,u)S^{t-1}=\mathcal T(S^t,\xi^t,u)St−1=T(St,ξt,u). The initial state is the fixed state ST=s0S^T=s_0ST=s0​.

The observed filtration Ft\mathcal F_tFt​ is generated by the arrivals ξt,…,ξT\xi^t,\ldots,\xi^Tξt,…,ξT. A non-anticipative policy chooses an Ft\mathcal F_tFt​-measurable action from the current state. Offline has the augmented filtration Gt=Ft∨H\mathcal G_t=\mathcal F_t\vee\mathcal HGt​=Ft​∨H, where H\mathcal HH is a fixed sigma-algebra carrying extra information. Offline's value V(t,s)V(t,s)V(t,s) is the feasible-action maximum in the conditional Bellman equation (2), with V(0,s)=0V(0,s)=0V(0,s)=0. Its expected initial value is the benchmark for the online policy's expected reward. Regret is their difference.

A relaxed value ϕ(t,s)\phi(t,s)ϕ(t,s) and a Bellman loss LB(t,s)L_B(t,s)LB​(t,s) obey the Bellman inequalities if ϕ\phiϕ initially bounds the conditional Offline value, ends at zero, and at each state is at most one feasible action's immediate reward plus its expected relaxed continuation and LBL_BLB​. An action meeting this inequality is satisfying. A maximum-loss bound rrr controls the shortfall of every feasible action. For a policy with action U^t\widehat U^tUt on its actual trajectory, QtQ_tQt​ is the event that U^t\widehat U^tUt is not satisfying under this same ϕ\phiϕ and LBL_BLB​.

Formalization targets

Satisfying actions under augmented information

Proposition 1 concerns a feasible Gt\mathcal G_tGt​-adapted policy that always takes satisfying actions. It bounds its shortfall from Offline by the expected accumulated Bellman loss:

E[V(T,s0)]−E ⁣[∑t=1TR(St,ξt,Ut)]≤E ⁣[∑t=1TLB(t,St)].\mathbb E[V(T,s_0)]-\mathbb E\!\left[\sum_{t=1}^T R(S^t,\xi^t,U^t)\right]\le\mathbb E\!\left[\sum_{t=1}^T L_B(t,S^t)\right].E[V(T,s0​)]−E[t=1∑T​R(St,ξt,Ut)]≤E[t=1∑T​LB​(t,St)].

The proposal also states the one-step displayed inequality from its proof, where a conditional continuation at a fixed state and action becomes the conditional continuation of the policy's random trajectory.

Regret decomposition

Theorem 5 concerns a feasible non-anticipative policy. It states the pathwise-compensation expectation bound and, when LBL_BLB​ is nonnegative, the paper's two-term bound:

E[Regret]≤E ⁣[∑t=1T(r1Qt+1QtcLB(t,St))]≤∑t=1T(r P(Qt)+E[LB(t,St)]).\mathbb E[\mathrm{Regret}]\le\mathbb E\!\left[\sum_{t=1}^T\left(r\mathbf1_{Q_t}+\mathbf1_{Q_t^c}L_B(t,S^t)\right)\right]\le\sum_{t=1}^T\left(r\,\mathbb P(Q_t)+\mathbb E[L_B(t,S^t)]\right).E[Regret]≤E[t=1∑T​(r1Qt​​+1Qtc​​LB​(t,St))]≤t=1∑T​(rP(Qt​)+E[LB​(t,St)]).

The milestones include the paper's maximum-loss, compensated one-step, and iterated displays on the route to this target. The first inequality is also stated for signed LBL_BLB​; only the second requires LB≥0L_B\ge0LB​≥0.

Significance

The theorem turns a regret analysis into two concrete estimates. An application can count or bound the periods when the online action fails the informed satisfying-action test, and can separately quantify the error in its chosen relaxed value. Neither quantity alone certifies small regret; the theorem supplies the inequality connecting both to the benchmark's actual reward gap. The paper's constant-regret claims use application-specific bounds on these terms (Vera–Banerjee–Gurvich, 2020, §§4–6).

A complete formalization would establish the conditional-expectation and measurability infrastructure needed to apply this template to other finite-horizon allocation models. The paper gives a proof of Theorem 5, but the theorem and its applications have no machine-checked proofs in this mission. The proposal records the open Lean statements and a statement-only non-vacuity check for the exact Bellman value with zero loss.

Difficulty

Definition 5 describes a satisfying action for a fixed state and action, while Theorem 5 evaluates it at a random state and a policy's random action. The conditional expectation in that definition cannot simply be substituted syntactically for the conditional expectation of the ensuing trajectory. Countable states and finite actions make the substitution meaningful, but measurability of the selected state and action still has to be established. The same issue appears in the maximum-loss display. Time runs backward, so the information at t−1t-1t−1 contains the information at ttt; a forward-indexed filtration would change the conditional expectation in the paper's formulas.

The second displayed inequality presents a separate statement issue: removing 1Qtc\mathbf1_{Q_t^c}1Qtc​​ from LBL_BLB​ is valid only for nonnegative LBL_BLB​. The paper allows signed Bellman losses elsewhere, so nonnegativity is attached to that inequality rather than to the definition of Bellman inequalities.

Formalization scope

The Lean model uses a countable state type, a finite nonempty action type, real rewards, and an explicit nonempty feasible-action set. The probability space carries a probability measure, measurable arrivals, and an auxiliary sub-sigma-algebra H\mathcal HH. The observed and augmented information families are plain sigma-algebra families because their order decreases with time to go. The index t=0t=0t=0 is terminal; decision sums and hypotheses use exactly t∈{1,…,T}t\in\{1,\ldots,T\}t∈{1,…,T}. Offline's value is defined by the feasible-action Bellman recursion and is never a free benchmark variable.

The source bounds the maximum reward above. This formalization additionally bounds feasible rewards, ϕ\phiϕ, and LBL_BLB​ in absolute value over the finite horizon, and requires measurable reward, transition, and feasibility data. These assumptions ensure the real integrals and conditional expectations have their intended values. Definition 4 is an almost-sure real upper bound rrr rather than a supremum that could take a default value. The feasible-action maximum in the Bellman inequality is represented by a feasible witness. The source's family GΘG_\ThetaGΘ​ is represented by the single sigma-algebra it generates, H\mathcal HH.

The goal covers every feasible Ft\mathcal F_tFt​-adapted state-feedback policy; RABBI is in this class. Proposition 1 retains its distinct Gt\mathcal G_tGt​-adapted policy class. The disagreement event uses the same LBL_BLB​ as the Bellman inequalities. The maximum-loss display follows Definition 4's parentheses and sign, correcting a printed slip on p. 14. The nonnegative-loss condition corrects the second inequality of the printed Theorem 5. A complete development needs reusable lemmas on finite feasible maxima, measurable state-feedback trajectories, conditional expectations under decreasing information, and integration of finite sums. Contributions to those lemmas and to the five stated milestones are in scope.

Selected references

  • Alberto Vera, Siddhartha Banerjee, and Itai Gurvich, Online Allocation and Pricing: Constant Regret via Bellman Inequalities, arXiv preprint arXiv:1906.06361v2, 2020. arXiv.
9 thms1 active userReviewed
Algorithmic Game TheoryMechanism Design·Captain: mikedeng1

Procurement Mechanisms for Assortments of Differentiated Products: In the Hotelling Model, Decentralized Linear Pricing Achieves the Optimal Centralized Consumer SurplusResearch Paper

Motivation

Public buyers of medicines, school meals, computers and similar goods often run a framework agreement. A central agency selects an assortment of products through an auction and fixes their unit prices. Public offices then buy from that menu as needed, each choosing what suits it. The European Union awarded €80 billion through framework agreements in 2010, 17% of all public procurement by value. Chile's ChileCompra bought US$3 billion this way in 2018, 22% of the country's public procurement (figures as cited in the paper's introduction). Two decisions are bundled in such a mechanism: which differentiated products to put in the assortment, and at what prices. A larger assortment serves heterogeneous users better; a smaller one lets the buyer extract lower prices from the suppliers, whose costs are private.

Saban and Weintraub (Operations Research, 2021; author version SSRN 3453144) model this trade-off as a mechanism-design problem and ask a structural question: how much does the buyer lose by being restricted to linear prices, where users pick quantities from the posted menu and every supplier is paid its unit price times the quantity sold, compared with a centralized planner who could dictate allocations and arbitrary transfers? Their answer for the Hotelling model of horizontal differentiation, Theorem 4.1, is the goal of this mission.

Setting

There are n≥2n \ge 2n≥2 suppliers i∈N={1,…,n}i \in N = \{1,\dots,n\}i∈N={1,…,n}. Supplier iii has a private unit cost θi\theta_iθi​ in a finite set Θi\Theta_iΘi​ of positive reals, drawn independently with probability mass function fi>0f_i > 0fi​>0 and cdf FiF_iFi​. A profile is θ=(θ1,…,θn)∈Θ=∏iΘi\theta = (\theta_1,\dots,\theta_n) \in \Theta = \prod_i \Theta_iθ=(θ1​,…,θn​)∈Θ=∏i​Θi​.

A unit mass of consumers sits uniformly on [0,1][0,1][0,1]; supplier iii is located at ℓi\ell_iℓi​, with 0≤ℓ1<⋯<ℓn≤10 \le \ell_1 < \dots < \ell_n \le 10≤ℓ1​<⋯<ℓn​≤1. A consumer at uuu buying from iii at price pip_ipi​ has utility −(δ∣ℓi−u∣+pi)-(\delta|\ell_i - u| + p_i)−(δ∣ℓi​−u∣+pi​), with transportation cost δ>0\delta > 0δ>0. Allocations x∈X={x≥0:∑ixi=1}x \in \mathcal X = \{x \ge 0 : \sum_i x_i = 1\}x∈X={x≥0:∑i​xi​=1} (no outside option) give gross consumer surplus GCS(x)GCS(x)GCS(x), minus δ\deltaδ times the total transportation cost, and consumer surplus CS(x,p)=GCS(x)−∑ipixiCS(x,p) = GCS(x) - \sum_i p_i x_iCS(x,p)=GCS(x)−∑i​pi​xi​. The demand d(Q,p)d(Q,p)d(Q,p) for an assortment Q⊆NQ \subseteq NQ⊆N and prices ppp is a maximizer of CS(⋅,p)CS(\cdot, p)CS(⋅,p) over x∈Xx \in \mathcal Xx∈X with xi=0x_i = 0xi​=0 for i∉Qi \notin Qi∈/Q.

The virtual cost of type θi\theta_iθi​ is

vi(θi)=θi+Fi(ρi(θi))fi(θi)(θi−ρi(θi)),v_i(\theta_i) = \theta_i + \frac{F_i(\rho_i(\theta_i))}{f_i(\theta_i)}\big(\theta_i - \rho_i(\theta_i)\big),vi​(θi​)=θi​+fi​(θi​)Fi​(ρi​(θi​))​(θi​−ρi​(θi​)),

where ρi(θi)\rho_i(\theta_i)ρi​(θi​) is the predecessor of θi\theta_iθi​ in Θi\Theta_iΘi​ (itself for the lowest type). Virtual costs are assumed strictly increasing (Assumption 3.1).

In a direct mechanism with allocation x(θ)x(\theta)x(θ) and transfers t(θ)t(\theta)t(θ), supplier iii of type θi\theta_iθi​ reporting θi′\theta_i'θi′​ gets interim utility Ui(θi′∣θi)=∑θ−if−i(θ−i)(ti(θi′,θ−i)−θixi(θi′,θ−i))U_i(\theta_i' \mid \theta_i) = \sum_{\theta_{-i}} f_{-i}(\theta_{-i})\big(t_i(\theta_i',\theta_{-i}) - \theta_i x_i(\theta_i',\theta_{-i})\big)Ui​(θi′​∣θi​)=∑θ−i​​f−i​(θ−i​)(ti​(θi′​,θ−i​)−θi​xi​(θi′​,θ−i​)). The two problems are:

  • Cent: maximize Eθ[GCS(x(θ))−∑iti(θ)]\mathbb E_\theta[GCS(x(\theta)) - \sum_i t_i(\theta)]Eθ​[GCS(x(θ))−∑i​ti​(θ)] subject to incentive compatibility (IC), individual rationality (IR) and x(θ)∈Xx(\theta) \in \mathcal Xx(θ)∈X;
  • DecLin: choose an assortment q(θ)q(\theta)q(θ), unit prices p(θ)p(\theta)p(θ) and an allocation x(θ)x(\theta)x(θ) to maximize Eθ[CS(x(θ),p(θ))]\mathbb E_\theta[CS(x(\theta),p(\theta))]Eθ​[CS(x(θ),p(θ))] subject to (IC), (IR) with transfers ti=pixit_i = p_i x_iti​=pi​xi​, x(θ)∈Xx(\theta) \in \mathcal Xx(θ)∈X, and (Demand) x(θ)=d(q(θ),p(θ))x(\theta) = d(q(\theta), p(\theta))x(θ)=d(q(θ),p(θ)).

OPT(⋅)OPT(\cdot)OPT(⋅) denotes the optimal value. Every DecLin mechanism is a Cent mechanism with the same value, so OPT(DecLin)≤OPT(Cent)OPT(DecLin) \le OPT(Cent)OPT(DecLin)≤OPT(Cent) always.

Formalization targets

Goal: Theorem 4.1

Let c∗=min⁡1≤i≤n−1(ℓi+1−ℓi)c^* = \min_{1 \le i \le n-1}(\ell_{i+1} - \ell_i)c∗=min1≤i≤n−1​(ℓi+1​−ℓi​). If (1) some profile has ∣vi+1(θi+1)−vi(θi)∣≤δ(ℓi+1−ℓi)/4|v_{i+1}(\theta_{i+1}) - v_i(\theta_i)| \le \delta(\ell_{i+1}-\ell_i)/4∣vi+1​(θi+1​)−vi​(θi​)∣≤δ(ℓi+1​−ℓi​)/4 for all iii, and (2) every ∣Θi∣≥3|\Theta_i| \ge 3∣Θi​∣≥3 and consecutive virtual costs differ by at most δc∗/8\delta c^*/8δc∗/8, then

OPT(DecLin)=OPT(Cent).OPT(DecLin) = OPT(Cent).OPT(DecLin)=OPT(Cent).

Milestones

The proof runs through the following statements, in attack order:

  1. Proposition 3.1: an allocation maximizing CS(⋅,v(θ))CS(\cdot, v(\theta))CS(⋅,v(θ)) with decreasing interim allocations and transfers given by the discrete envelope formula (7) is optimal for Cent.
  2. The explicit Hotelling demand (active set Q(p)Q(p)Q(p), neighbours split the segment between them) maximizes consumer surplus.
  3. Proposition 3.2 (parts 1–2) for the general Hotelling model: the Hotelling demand at virtual costs, with the transfers of Appendix B, is feasible, meets Proposition 3.1's conditions, and is ex-post individually rational.
  4. Corollary 4.1: prices that reproduce the optimal allocation (10) and the optimal interim transfers (11) give OPT(DecLin)=OPT(Cent)OPT(DecLin) = OPT(Cent)OPT(DecLin)=OPT(Cent).
  5. For the Hotelling model, (10) is the linear system A(θ)p(θ)=A(θ)v(θ)A(\theta)p(\theta) = A(\theta)v(\theta)A(θ)p(θ)=A(θ)v(θ) of (Mi(θ))(M_i(\theta))(Mi​(θ)) and (13).
  6. Lemma F.1, the finite Fredholm alternative.
  7. Lemma F.2: an all-active box of profiles, and paths of profiles that change one active cost at a time.
  8. Lemma F.3: a dependency (14) among the rows forces ∑i∈Q(θ)gi(θi)xi(θ)=0\sum_{i \in Q(\theta)} g_i(\theta_i)x_i(\theta) = 0∑i∈Q(θ)​gi​(θi​)xi​(θ)=0.
  9. Step 1 of the proof: (14) forces every transfer-row coefficient with a nonzero row to vanish.
  10. Step 2 of the proof: with those coefficients zero, (15) holds.

Significance

The theorem identifies a regime where linear pricing, the format actually used in framework agreements, loses nothing relative to the best mechanism with arbitrary transfers. In general it does lose: the paper's Example 4.1 has OPT(Cent)>OPT(DecLin)OPT(Cent) > OPT(DecLin)OPT(Cent)>OPT(DecLin) (values −2.0638-2.0638−2.0638 and −2.0645-2.0645−2.0645). The conditions say that virtual costs are close relative to the transportation cost, so that every supplier is in the optimal assortment for some profile and costs can be moved one supplier at a time without leaving the assortment. This gives a design guideline: when products are differentiated enough relative to cost uncertainty, posting unit prices suffices. The companion result for two-part tariffs (Proposition 4.1) and the affine-demand analogue (Theorem 4.2) are outside this mission.

The theorem has a complete proof in the paper (Appendix F and the electronic companion), but no machine-checked version exists. A formal proof would check the discrete-type envelope argument (Proposition 3.1), the explicit Hotelling demand as an optimal-transport maximizer, and the linear-algebraic consistency argument, which has gaps at ties (see Formalization scope). Each of these is reusable: the discrete Myerson characterization applies to any procurement or auction model with finite type spaces, and the Hotelling demand result applies to any model of spatial competition on a segment.

Difficulty

The obvious argument is: solve Cent by Proposition 3.1, then pick prices equal to virtual costs, which induce the right demand. This fails because prices must do two jobs at once. They must reproduce the centralized allocation through consumer choice, which pins down price differences among active suppliers profile by profile, and they must reproduce the interim transfers (11), which pins down averages of pixip_i x_ipi​xi​ across profiles. Prices equal to virtual costs satisfy the first and generally violate the second. The question becomes whether one linear system in all prices of all profiles is consistent.

Lemma F.1 converts consistency into the statement that every dependency among the rows is also a dependency of the right-hand side. Proving that requires showing that the coefficients on transfer rows vanish (Step 1), and this is where Theorem 4.1's conditions enter: Lemma F.2's all-active box and connecting paths propagate gi=0g_i = 0gi​=0 from one profile to its neighbours. Without such connectivity the profiles split into classes whose transfer constraints conflict, which is exactly what happens in Example 4.1.

Formalization scope

The Lean development lives in the namespace ProcureAssort.Hotelling, with one definition item (Setting) and eleven theorem items. Conventions:

  • Suppliers are Fin n, 0-indexed, ordered by location; n≥2n \ge 2n≥2 is assumed because c∗c^*c∗ needs two suppliers. Types are a Finset ℝ per supplier; "consecutive types" means no element strictly between. Profiles are dependent functions; all expectations are finite sums.
  • fi>0f_i > 0fi​>0 on Θi\Theta_iΘi​ and ∑fi=1\sum f_i = 1∑fi​=1; Θi\Theta_iΘi​ positive; Assumption 3.1 is a hypothesis of every Hotelling statement. In the model-free Proposition 3.1, consumption vectors are assumed nonnegative, as the paper's proof uses.
  • GCS(x)=−δ∑i∫x1+⋯+xi−1x1+⋯+xi∣u−ℓi∣ duGCS(x) = -\delta \sum_i \int_{x_1+\dots+x_{i-1}}^{x_1+\dots+x_i}|u - \ell_i|\,duGCS(x)=−δ∑i​∫x1​+⋯+xi−1​x1​+⋯+xi​​∣u−ℓi​∣du: suppliers serve consecutive blocks of consumers in location order, which is the cost-minimizing assignment. For n=2n = 2n=2, ℓ=(0,1)\ell = (0,1)ℓ=(0,1) it equals Example 2.1's −δ2(x12+x22)-\frac\delta2(x_1^2+x_2^2)−2δ​(x12​+x22​).
  • (Demand) is consumer optimality, the defining property (2) of ddd. OPTOPTOPT is a real supremum; both value sets are nonempty and bounded above by 000 in the Hotelling instance.
  • Q(p)Q(p)Q(p) is defined with ≤\le≤ as printed. At ties a supplier can be in Q(p)Q(p)Q(p) with zero demand. For this reason, Proposition 3.2's uniqueness clause and Corollary 4.1's "only if" are not stated. Step 1 is stated for the transfer rows with a nonzero coefficient, the only rows the paper's argument uses. Lemma F.2's second property is stated in the existential form its proof establishes.

The goal cannot be satisfied trivially. DecLin ranges only over mechanisms whose allocation is consumer-optimal for the posted assortment and prices, and whose payments are price times quantity. DecLin therefore cannot choose allocations freely or pay lump sums, and an equality with OPT(Cent) is a substantive claim. The hypotheses are satisfiable, for example with two suppliers at 000 and 111, δ=16\delta = 16δ=16 and Θi={1,2,3}\Theta_i = \{1,2,3\}Θi​={1,2,3} uniform.

A complete development needs: finite-type mechanism-design bookkeeping (interim sums, the envelope formula), the Hotelling demand as a maximizer (a one-dimensional transport argument), finite-dimensional linear algebra for Lemma F.1, and the combinatorics of Lemma F.2. Contributions to any milestone are welcome, as are proofs of the Fredholm alternative and of the discrete Myerson lemma in general form.

Selected references

  • D. Saban, G. Y. Weintraub, Procurement Mechanisms for Assortments of Differentiated Products, Operations Research, 2021. https://doi.org/10.1287/opre.2020.2053 (author version: https://ssrn.com/abstract=3453144)
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • R. V. Vohra, Mechanism Design: A Linear Programming Approach, Cambridge University Press, 2011. https://doi.org/10.1017/CBO9780511835216
  • H. Hotelling, Stability in Competition, The Economic Journal 39(153), 1929. https://doi.org/10.2307/2224214
12 thms1 active userReviewed
Linear algebraProbability·Captain: mikedeng1

When Is Society Susceptible to Manipulation?: Under Any Principal Interference, Beliefs in a Mixed DeGroot–Bayesian Network Converge Almost Surely to (I − W)⁻¹(BU∞ ⊙ θ)Research Paper

Motivation

Misinformation campaigns target specific people in a social network and rely on the network to spread what they plant. Whether such a campaign can succeed depends on how people combine what they see themselves with what their neighbours believe. Mostagir, Ozdaglar and Siderius (SSRN 3474643; Management Science, 2022, doi:10.1287/mnsc.2021.4265) model a network in which a strategic principal injects slanted news into chosen agents. Some agents are Bayesian and know the truth; the rest are DeGroot agents who average their own news-based opinion with their neighbours' beliefs.

The paper asks when society as a whole can be manipulated. Every later result in it — which agents the principal targets, which networks resist manipulation, how the answer depends on the network's density — is a statement about the agents' long-run beliefs. Its Theorem 2 supplies those beliefs in closed form, and that closed form is the subject of this mission.

DeGroot updating (DeGroot, 1974) and its combination with personal Bayesian updates (Jadbabaie, Molavi, Sandroni and Tahbaz-Salehi, 2012) are standard models of non-Bayesian social learning. Stubborn agents in averaging dynamics were studied by Acemoglu, Como, Fagnani and Ozdaglar (2013). The present model adds a principal who corrupts the signals of targeted agents.

Setting

There are nnn agents and a binary state y∈{S,R}y\in\{S,R\}y∈{S,R} with prior q=P(y=S)∈(0,1)q=\mathbb P(y=S)\in(0,1)q=P(y=S)∈(0,1). Agent iii has a signal quality pi∈[1/2,1)p_i\in[1/2,1)pi​∈[1/2,1). At each time τ=1,2,…\tau=1,2,\dotsτ=1,2,… agent iii receives a signal si,τ∈{S,R}s_{i,\tau}\in\{S,R\}si,τ​∈{S,R}:

  • Organic news equals the state with probability pip_ipi​: P(si,τ=S∣y=S)=P(si,τ=R∣y=R)=pi\mathbb P(s_{i,\tau}=S\mid y=S)=\mathbb P(s_{i,\tau}=R\mid y=R)=p_iP(si,τ​=S∣y=S)=P(si,τ​=R∣y=R)=pi​.
  • The principal fixes an influence state y^\hat yy^​ and an influence strategy x=(x1,…,xn)∈{0,1}n\mathbf x=(x_1,\dots,x_n)\in\{0,1\}^nx=(x1​,…,xn​)∈{0,1}n. A targeted agent (xi=1x_i=1xi​=1) receives the principal's message y^\hat yy^​ with probability λ∗/(λ+λ∗)\lambda^*/(\lambda+\lambda^*)λ∗/(λ+λ∗) and organic news with probability λ/(λ+λ∗)\lambda/(\lambda+\lambda^*)λ/(λ+λ∗). Here λ>0\lambda>0λ>0 and λ∗>0\lambda^*>0λ∗>0 are the intensities of the organic and the principal's news. An untargeted agent receives only organic news.

Agent iii's signals are independent over time. Its personal experience is the posterior it would compute taking every signal at face value. With zi,tS,zi,tRz^S_{i,t},z^R_{i,t}zi,tS​,zi,tR​ the numbers of SSS and RRR signals among si,1,…,si,ts_{i,1},\dots,s_{i,t}si,1​,…,si,t​,

BUi(S∣hi,t)=pizi,tS(1−pi)zi,tRqpizi,tS(1−pi)zi,tRq+pizi,tR(1−pi)zi,tS(1−q),\mathrm{BU}_i(S\mid h_{i,t})=\frac{p_i^{z^S_{i,t}}(1-p_i)^{z^R_{i,t}}q}{p_i^{z^S_{i,t}}(1-p_i)^{z^R_{i,t}}q+p_i^{z^R_{i,t}}(1-p_i)^{z^S_{i,t}}(1-q)},BUi​(S∣hi,t​)=pizi,tS​​(1−pi​)zi,tR​q+pizi,tR​​(1−pi​)zi,tS​(1−q)pizi,tS​​(1−pi​)zi,tR​q​,

and BUi(R∣hi,t)=1−BUi(S∣hi,t)\mathrm{BU}_i(R\mid h_{i,t})=1-\mathrm{BU}_i(S\mid h_{i,t})BUi​(R∣hi,t​)=1−BUi​(S∣hi,t​).

A set BBB of agents is Bayesian. A Bayesian agent knows yyy and always believes it. Each DeGroot agent i∉Bi\notin Bi∈/B has weights θi≥0\theta_i\ge0θi​≥0 and αij≥0\alpha_{ij}\ge0αij​≥0 with θi+∑jαij=1\theta_i+\sum_j\alpha_{ij}=1θi​+∑j​αij​=1. For a state y′y'y′, its belief πi,t(y′∣y)\pi_{i,t}(y'\mid y)πi,t​(y′∣y) follows the DeGroot update

πi,t+1=θi BUi(y′∣hi,t+1)+∑j=1nαij πj,t.\pi_{i,t+1}=\theta_i\,\mathrm{BU}_i(y'\mid h_{i,t+1})+\sum_{j=1}^n\alpha_{ij}\,\pi_{j,t}.πi,t+1​=θi​BUi​(y′∣hi,t+1​)+j=1∑n​αij​πj,t​.

The influence matrix W\mathbf WW has zero rows for Bayesian agents and row (αij)j(\alpha_{ij})_j(αij​)j​ for DeGroot agents. The vector θ=(1B,θm+1,…,θn)\boldsymbol\theta=(\mathbf 1_B,\theta_{m+1},\dots,\theta_n)θ=(1B​,θm+1​,…,θn​) has entry 111 on Bayesians. The unweighted graph G∗G^*G∗ has a link i→ji\to ji→j when iii listens to jjj; for a DeGroot agent this means αij>0\alpha_{ij}>0αij​>0.

Assumption 1 (pp. 10–11):

  • (i) pi<(λ∗+λ)/(2λ)p_i<(\lambda^*+\lambda)/(2\lambda)pi​<(λ∗+λ)/(2λ) for every agent;
  • (ii) G∗G^*G∗ is strongly connected;
  • (iii) a DeGroot agent has θi>0\theta_i>0θi​>0 exactly when pi>1/2p_i>1/2pi​>1/2;
  • (iv) some agent has pi>1/2p_i>1/2pi​>1/2.

Formalization targets

Goal: Theorem 2 (p. 11)

Under Assumption 1, for every principal action x∗\mathbf x^*x∗, each DeGroot agent's personal experience converges almost surely to a constant BUi(hi,∞(x∗))(y′∣y)\mathrm{BU}_i(h_{i,\infty}(\mathbf x^*))(y'\mid y)BUi​(hi,∞​(x∗))(y′∣y), and

πt(y′∣y)→a.s.(I−W)−1(BU(h∞(x∗))(y′∣y)⊙θ),\boldsymbol\pi_t(y'\mid y)\xrightarrow{\text{a.s.}}(\mathbf I-\mathbf W)^{-1}\big(\mathrm{BU}(\mathbf h_\infty(\mathbf x^*))(y'\mid y)\odot\boldsymbol\theta\big),πt​(y′∣y)a.s.​(I−W)−1(BU(h∞​(x∗))(y′∣y)⊙θ),

where the Bayesian entries of the vector BU(h∞(x∗))\mathrm{BU}(\mathbf h_\infty(\mathbf x^*))BU(h∞​(x∗)) are the correct belief. The goal does not fix the constants: the paper computes them only later (display (2), p. 12).

Milestones

  1. Lemma 3 (p. 45): the spectral radius of W\mathbf WW is strictly less than 111.
  2. Proof of Theorem 2 (p. 47): I−W\mathbf I-\mathbf WI−W and its DeGroot block I−ADD\mathbf I-\mathbf A_{DD}I−ADD​ are invertible.
  3. §3.2 (p. 11): BUi(hi,t)\mathrm{BU}_i(h_{i,t})BUi​(hi,t​) converges almost surely to a constant.
  4. Proof of Theorem 2 (p. 47): if ut→u∞\mathbf u_t\to\mathbf u_\inftyut​→u∞​ and πt+1=ut+1+Wπt\boldsymbol\pi_{t+1}=\mathbf u_{t+1}+\mathbf W\boldsymbol\pi_tπt+1​=ut+1​+Wπt​, then πt→π∞=(I−W)−1u∞\boldsymbol\pi_t\to\boldsymbol\pi_\infty=(\mathbf I-\mathbf W)^{-1}\mathbf u_\inftyπt​→π∞​=(I−W)−1u∞​, the solution of π∞=u∞+Wπ∞\boldsymbol\pi_\infty=\mathbf u_\infty+\mathbf W\boldsymbol\pi_\inftyπ∞​=u∞​+Wπ∞​.

Significance

Theorem 2 reduces the paper's manipulation question to linear algebra. A DeGroot agent ends up believing the wrong state exactly when the corresponding entry of (I−W)−1(BU∞⊙θ)(\mathbf I-\mathbf W)^{-1}(\mathrm{BU}_\infty\odot\boldsymbol\theta)(I−W)−1(BU∞​⊙θ) crosses a threshold. The principal's targeting problem then becomes a combinatorial problem over x∗\mathbf x^*x∗ in which the network enters only through (I−W)−1(\mathbf I-\mathbf W)^{-1}(I−W)−1. The paper's DeGroot centrality (Proposition 2) and its results on dense and sparse networks all start from this formula.

On formalization: the paper proves Theorem 2, but no machine-checked version exists. The mission's statements also record two places where the written argument needs repair. The text attributes the almost-sure convergence of BUi\mathrm{BU}_iBUi​ to the martingale convergence theorem, but BUi\mathrm{BU}_iBUi​ is a face-value posterior and not a martingale under the corrupted signal law. The proof's step from small increments of πt\boldsymbol\pi_tπt​ to convergence of πt\boldsymbol\pi_tπt​ is also not valid as written. Both claims are true under Assumption 1, and a complete development supplies correct arguments. The supporting results — spectral radius below one for a substochastic matrix with leakage reachable from every row, and convergence of linear recursions with convergent input — are reusable beyond this paper.

Difficulty

Two steps resist the obvious arguments.

First, BUi(S∣hi,t)\mathrm{BU}_i(S\mid h_{i,t})BUi​(S∣hi,t​) is a function of the drift zi,tS−zi,tRz^S_{i,t}-z^R_{i,t}zi,tS​−zi,tR​ of a random walk. Its limit exists only if the walk is transient or pi=1/2p_i=1/2pi​=1/2. For a targeted agent the walk's step law mixes the principal's message with organic news. For one boundary value of pip_ipi​ the step has mean zero, the walk is recurrent and BUi\mathrm{BU}_iBUi​ oscillates forever. Assumption 1(i) excludes exactly that value. A proof must use it; a martingale argument does not apply.

Second, W\mathbf WW is substochastic but not strictly so: a DeGroot row sums to 1−θi1-\theta_i1−θi​, which equals 111 whenever pi=1/2p_i=1/2pi​=1/2. A row-sum bound alone gives ρ(W)≤1\rho(\mathbf W)\le1ρ(W)≤1, not <1<1<1. Strict inequality needs every DeGroot agent to reach, in the weighted graph, an agent that leaks weight — a Bayesian or a DeGroot agent with θi>0\theta_i>0θi​>0. This uses the interaction of Assumption 1 (ii), (iii) and (iv), with Bayesian agents' outgoing links playing no role in W\mathbf WW.

Formalization scope

Agents are Fin n and the Bayesian set is a Finset. Time is discrete, and the history at time ttt is the signals at times 1,…,t1,\dots,t1,…,t. The state space is a two-element inductive type. The signals are random variables on a probability space (Ω,P)(\Omega,P)(Ω,P). Each agent's sequence is independent over time with the law above; signals of different agents may be dependent. This is deliberate: in the paper all targeted agents receive the same principal stream, so cross-agent independence would exclude the paper's own model. The principal's action is pure (x∗∈{0,1}n\mathbf x^*\in\{0,1\}^nx∗∈{0,1}n), as §3.2 allows without loss of generality. The DeGroot initial belief can be any value in [0,1][0,1][0,1], and the conclusion holds for every such initial belief on one almost-sure event. "Spectral radius" is Mathlib's spectralRadius ℂ of the complexified matrix. (I−W)−1(\mathbf I-\mathbf W)^{-1}(I−W)−1 is Mathlib's matrix inverse; no invertibility hypothesis is added, because Assumption 1 implies it. In the graph G∗G^*G∗, a DeGroot agent's links are exactly its positive weights; Bayesian agents' links are free.

The personal experience is the explicit face-value posterior of the given signal process, and the conclusion of the goal includes its almost-sure convergence to the constants used in the limit. The goal therefore cannot be met by an abstract learning rule or a free limit vector.

A complete development needs:

  • the strong law of large numbers (available in Mathlib) applied to the signal counts;
  • a Perron–Frobenius-type spectral bound for substochastic matrices on a strongly connected graph;
  • convergence of πt+1=ut+1+Wπt\boldsymbol\pi_{t+1}=\mathbf u_{t+1}+\mathbf W\boldsymbol\pi_tπt+1​=ut+1​+Wπt​ when ρ(W)<1\rho(\mathbf W)<1ρ(W)<1.

Contributions of any of these, as standalone lemmas, are welcome.

Selected references

  • M. Mostagir, A. Ozdaglar, J. Siderius, When Is Society Susceptible to Manipulation?, SSRN preprint 3474643 (version of 2020-06-08); Management Science 68(10), 2022. https://ssrn.com/abstract=3474643, https://doi.org/10.1287/mnsc.2021.4265
  • M. H. DeGroot, Reaching a Consensus, Journal of the American Statistical Association 69(345), 1974. https://doi.org/10.1080/01621459.1974.10480137
  • A. Jadbabaie, P. Molavi, A. Sandroni, A. Tahbaz-Salehi, Non-Bayesian Social Learning, Games and Economic Behavior 76(1), 2012. https://doi.org/10.1016/j.geb.2012.06.001
  • D. Acemoglu, G. Como, F. Fagnani, A. Ozdaglar, Opinion Fluctuations and Disagreement in Social Networks, Mathematics of Operations Research 38(1), 2013. https://doi.org/10.1287/moor.1120.0570
6 thms1 active userReviewed
StatisticsStochastic Systems·Captain: mikedeng1

Experimental Design in Two-Sided Platforms: An Analysis of Bias: In Demand-Constrained Markets the Naive Customer-Side Estimator Is Unbiased and the Listing-Side Estimator Is Generically BiasedResearch Paper

Motivation

Online marketplaces such as lodging, ride-hailing and freelancing platforms test changes to their product (a new ranking, a new fee display, a new photo layout) with randomized experiments. In a two-sided marketplace these experiments are subject to interference: treated and control units compete for the same scarce supply or demand, so the outcome of one unit depends on the treatment of others, and the stable-unit assumption behind the textbook difference-in-means estimator fails. The resulting bias can be as large as the effect being measured, and platforms routinely choose between randomizing customers (customer-side randomization, CR) and randomizing listings (listing-side randomization, LR) without a principled guide.

Johari, Li, Liskovich and Weintraub (arXiv:2002.05670, Management Science 2022) introduced a tractable model in which this question can be answered. Their analysis shows that which side to randomize depends on market balance, the ratio of the rate of demand to the rate at which supply is replenished. This mission formalizes the demand-constrained half of that answer.

Setting

There are finitely many listing types θ∈Θ\theta\in\Thetaθ∈Θ and customer types γ∈Γ\gamma\in\Gammaγ∈Γ. Listings of type θ\thetaθ form a mass ρ(θ)>0\rho(\theta)>0ρ(θ)>0, with ∑θρ(θ)=1\sum_\theta\rho(\theta)=1∑θ​ρ(θ)=1. Customers arrive at total rate λ>0\lambda>0λ>0, a share ϕγ>0\phi_\gamma>0ϕγ​>0 of them of type γ\gammaγ (∑γϕγ=1\sum_\gamma\phi_\gamma=1∑γ​ϕγ​=1). A state s=(s(θ))θs=(s(\theta))_\thetas=(s(θ))θ​ records the mass of available listings of each type, and lies in S={s:0≤s(θ)≤ρ(θ)}\mathcal S=\{s:0\le s(\theta)\le\rho(\theta)\}S={s:0≤s(θ)≤ρ(θ)}.

An arriving type-γ\gammaγ customer includes each available type-θ\thetaθ listing in its consideration set with probability αγ(θ)∈(0,1]\alpha_\gamma(\theta)\in(0,1]αγ​(θ)∈(0,1], has utility vγ(θ)>0v_\gamma(\theta)>0vγ​(θ)>0 for it and an outside option of value ϵγ>0\epsilon_\gamma>0ϵγ​>0, and books by multinomial logit. In the mean-field limit the probability that it books a type-θ\thetaθ listing is

pγ(θ∣s)=αγ(θ)vγ(θ)s(θ)ϵγ+∑θ′αγ(θ′)vγ(θ′)s(θ′).p_\gamma(\theta\mid s)=\frac{\alpha_\gamma(\theta)v_\gamma(\theta)s(\theta)}{\epsilon_\gamma+\sum_{\theta'}\alpha_\gamma(\theta')v_\gamma(\theta')s(\theta')}.pγ​(θ∣s)=ϵγ​+∑θ′​αγ​(θ′)vγ​(θ′)s(θ′)αγ​(θ)vγ​(θ)s(θ)​.

A booked type-θ\thetaθ listing stays occupied for an exponential time of rate τν(θ)\tau\nu(\theta)τν(θ), with τ>0\tau>0τ>0 and ν(θ)>0\nu(\theta)>0ν(θ)>0. A steady state is a state s∗∈Ss^*\in\mathcal Ss∗∈S balancing the flows:

(ρ(θ)−s∗(θ)) τν(θ)=λ∑γϕγ pγ(θ∣s∗)(θ∈Θ).(\rho(\theta)-s^*(\theta))\,\tau\nu(\theta)=\lambda\sum_\gamma\phi_\gamma\,p_\gamma(\theta\mid s^*)\qquad(\theta\in\Theta).(ρ(θ)−s∗(θ))τν(θ)=λγ∑​ϕγ​pγ​(θ∣s∗)(θ∈Θ).

A two-sided randomization (TSR) design treats a fraction aCa_CaC​ of customers and a fraction aLa_LaL​ of listings. The intervention replaces (α,v)(\alpha,v)(α,v) by (α~,v~)(\tilde\alpha,\tilde v)(α~,v~), both positive, only when a treated customer meets a treated listing. The experimental system is the same mean-field model on the types (γ,i)(\gamma,i)(γ,i) and (θ,j)(\theta,j)(θ,j), i,j∈{0,1}i,j\in\{0,1\}i,j∈{0,1} (0 = control, 1 = treatment), with ϕγ,1=aCϕγ\phi_{\gamma,1}=a_C\phi_\gammaϕγ,1​=aC​ϕγ​, ϕγ,0=(1−aC)ϕγ\phi_{\gamma,0}=(1-a_C)\phi_\gammaϕγ,0​=(1−aC​)ϕγ​, ρ(θ,1)=aLρ(θ)\rho(\theta,1)=a_L\rho(\theta)ρ(θ,1)=aL​ρ(θ) and ρ(θ,0)=(1−aL)ρ(θ)\rho(\theta,0)=(1-a_L)\rho(\theta)ρ(θ,0)=(1−aL​)ρ(θ). The mass vector is written ρ(aL)\rho(a_L)ρ(aL​). At its steady state s∗(aC,aL)s^*(a_C,a_L)s∗(aC​,aL​), the rate at which condition-iii customers book condition-jjj listings is

Qij(∞∣aC,aL)=λ∑θ∑γϕγ,i pγ,i(θ,j∣s∗(aC,aL)).Q_{ij}(\infty\mid a_C,a_L)=\lambda\sum_\theta\sum_\gamma\phi_{\gamma,i}\,p_{\gamma,i}(\theta,j\mid s^*(a_C,a_L)).Qij​(∞∣aC​,aL​)=λθ∑​γ∑​ϕγ,i​pγ,i​(θ,j∣s∗(aC​,aL​)).

The global treatment effect is GTE=Q11(∞∣1,1)−Q00(∞∣0,0)\mathrm{GTE}=Q_{11}(\infty\mid1,1)-Q_{00}(\infty\mid0,0)GTE=Q11​(∞∣1,1)−Q00​(∞∣0,0). The naive estimators are

GTE^CR(∞∣aC)=Q11(∞∣aC,1)aC−Q01(∞∣aC,1)1−aC,GTE^LR(∞∣aL)=Q11(∞∣1,aL)aL−Q10(∞∣1,aL)1−aL.\widehat{\mathrm{GTE}}^{\mathrm{CR}}(\infty\mid a_C)=\frac{Q_{11}(\infty\mid a_C,1)}{a_C}-\frac{Q_{01}(\infty\mid a_C,1)}{1-a_C},\qquad\widehat{\mathrm{GTE}}^{\mathrm{LR}}(\infty\mid a_L)=\frac{Q_{11}(\infty\mid1,a_L)}{a_L}-\frac{Q_{10}(\infty\mid1,a_L)}{1-a_L}.GTECR(∞∣aC​)=aC​Q11​(∞∣aC​,1)​−1−aC​Q01​(∞∣aC​,1)​,GTELR(∞∣aL​)=aL​Q11​(∞∣1,aL​)​−1−aL​Q10​(∞∣1,aL​)​.

Formalization targets

Goal: Theorem 3

Fix every parameter except λ\lambdaλ and τ\tauτ, and consider sequences with λ/τ→0\lambda/\tau\to0λ/τ→0 (a demand-constrained market). Then for every aC∈(0,1)a_C\in(0,1)aC​∈(0,1)

GTE^CR(∞∣aC)λ−GTEλ⟶0,\frac{\widehat{\mathrm{GTE}}^{\mathrm{CR}}(\infty\mid a_C)}{\lambda}-\frac{\mathrm{GTE}}{\lambda}\longrightarrow0,λGTECR(∞∣aC​)​−λGTE​⟶0,

and for every aL∈(0,1)a_L\in(0,1)aL​∈(0,1) and Lebesgue-almost every treatment utility v~\tilde vv~ in the positive orthant, there is L≠0L\neq0L=0 such that along every such sequence

GTE^LR(∞∣aL)λ−GTEλ⟶L.\frac{\widehat{\mathrm{GTE}}^{\mathrm{LR}}(\infty\mid a_L)}{\lambda}-\frac{\mathrm{GTE}}{\lambda}\longrightarrow L.λGTELR(∞∣aL​)​−λGTE​⟶L.

Milestones

  1. Theorem 1 (p. 12): the steady state of the base system exists, is unique, and is interior, 0<s∗(θ)<ρ(θ)0<s^*(\theta)<\rho(\theta)0<s∗(θ)<ρ(θ). Its second part characterizes s∗s^*s∗ as the unique minimizer of the objective WWW of (10).
  2. §5.1 (p. 16): every design (aC,aL)∈[0,1]2(a_C,a_L)\in[0,1]^2(aC​,aL​)∈[0,1]2 has a unique steady state.
  3. Proposition 2 (p. 19), with Step 1 of its proof: as λ/τ→0\lambda/\tau\to0λ/τ→0, s∗(θ,j)→ρ(θ,j)s^*(\theta,j)\to\rho(\theta,j)s∗(θ,j)→ρ(θ,j) and Qij(∞∣aC,aL)/λ→∑θ∑γϕγ,ipγ,i(θ,j∣ρ)Q_{ij}(\infty\mid a_C,a_L)/\lambda\to\sum_\theta\sum_\gamma\phi_{\gamma,i}p_{\gamma,i}(\theta,j\mid\rho)Qij​(∞∣aC​,aL​)/λ→∑θ​∑γ​ϕγ,i​pγ,i​(θ,j∣ρ).
  4. From the proof of Theorem 3 (p. A7): the limit (46) of GTE/λ\mathrm{GTE}/\lambdaGTE/λ, the limits of the scaled CR and LR estimators, and the identity pγ,0(θ,1∣ρ(1))=pγ,0(θ,0∣ρ(0))p_{\gamma,0}(\theta,1\mid\rho(1))=p_{\gamma,0}(\theta,0\mid\rho(0))pγ,0​(θ,1∣ρ(1))=pγ,0​(θ,0∣ρ(0)).

Significance

Theorem 3, together with its supply-constrained mirror (Theorem 4 of the paper, not part of this mission), is the paper's main structural finding. Each naive design is unbiased in one extreme of market balance and biased in the other. When demand is scarce, customers do not compete for listings, so randomizing customers creates no interference, while randomizing listings makes treated and control listings compete for the same customers. This finding motivates the paper's TSR designs, which interpolate between CR and LR according to market balance.

The result is proved in the paper; nothing here is open. To the best of the curators' knowledge, no part of it has a machine-checked proof. The mission produces a formal account of the mean-field model and its steady state, which other models of matching markets with MNL choice and occupancy can reuse. It also makes the informal "generically biased" claim precise: the paper argues it only by saying that the limit "in general" differs from the GTE.

Difficulty

The central step is Theorem 1. The steady-state equation is a nonlinear fixed point, and the objective WWW whose minimizer it is fails to be convex in sss. Existence and uniqueness therefore need a change of variables under which WWW becomes strictly convex and coercive, followed by a boundary argument. The limit statements then follow from a quantitative bound on ρ−s∗\rho-s^*ρ−s∗ and the continuity of the choice probability, but they must hold at boundary designs (aCa_CaC​ or aL∈{0,1}a_L\in\{0,1\}aL​∈{0,1}), where some types have zero mass.

The LR half carries a second difficulty. Showing that the LR estimator is biased for one parameter value is easy; the claim is that the bias vanishes only on a Lebesgue-null set of treatment utilities. That requires the zero set of a nonzero rational function on an open orthant to be null, a fact Mathlib does not state in ready form.

Formalization scope

Everything lives in the namespace TwoSidedExp.DemandLimit. Types are Fintype; treatment conditions are Fin 2. A mean-field system MFSystem Γ Θ carries ρ,ϕ,α,v,ϵ\rho,\phi,\alpha,v,\epsilonρ,ϕ,α,v,ϵ (eps) and ν\nuν. A Model adds α~,v~\tilde\alpha,\tilde vα~,v~, and Model.expt aC aL is the experimental system. λ\lambdaλ and τ\tauτ are arguments, and a sequence of systems is a pair of positive real sequences with λn/τn→0\lambda_n/\tau_n\to0λn​/τn​→0.

Conventions the formalization commits to:

  • Standing assumptions, all hypotheses of every theorem: ρ>0\rho>0ρ>0, ∑ρ=1\sum\rho=1∑ρ=1, ϕ>0\phi>0ϕ>0, ∑ϕ=1\sum\phi=1∑ϕ=1, α,α~∈(0,1]\alpha,\tilde\alpha\in(0,1]α,α~∈(0,1], v,v~>0v,\tilde v>0v,v~>0, ϵ>0\epsilon>0ϵ>0. The positivity ν>0\nu>0ν>0 and the bounds α,α~≤1\alpha,\tilde\alpha\le1α,α~≤1 are implicit in the paper (an exponential rate and probabilities) and are made explicit.
  • Qij(∞)Q_{ij}(\infty)Qij​(∞) is the right side of (18) evaluated at a given state, and every theorem feeds it a steady state. The paper's definition as a long-run time average, and the ODE dynamics, Proposition 1, the stability part of Theorem 1 and the Markov-chain convergence of Theorem 2, are out of scope. The mission is stated on the mean-field steady state.
  • Steady states are quantified over, never chosen. The §5.1 milestone is what makes these hypotheses satisfiable.
  • Theorem 1's variational part is posed on 0<s≤ρ0<s\le\rho0<s≤ρ, since Lean's Real.log 0 = 0. In (10) the printed τ(θ)\tau(\theta)τ(θ) is read inside the sums, as in (30).
  • "Generically" (footnote 7) is read as: all other parameters fixed, for almost every v~\tilde vv~ in (0,∞)Γ×Θ(0,\infty)^{\Gamma\times\Theta}(0,∞)Γ×Θ. The literal footnote is ill-posed, because ρ\rhoρ and ϕ\phiϕ range over Lebesgue-null simplices. The printed GTE^LR(∞∣aC)\widehat{\mathrm{GTE}}^{\mathrm{LR}}(\infty\mid a_C)GTELR(∞∣aC​) is read with aLa_LaL​.

Trivializing formalizations are ruled out explicitly. QijQ_{ij}Qij​ is never evaluated at ρ\rhoρ instead of the steady state. GTE is built from the experimental system's Q11(∞∣1,1)Q_{11}(\infty\mid1,1)Q11​(∞∣1,1) and Q00(∞∣0,0)Q_{00}(\infty\mid0,0)Q00​(∞∣0,0), not from a separate formula. The LR half is an almost-everywhere statement with a sequence-independent L≠0L\neq0L=0, not an existential.

Infrastructure that is reusable beyond this mission: strict convexity and coercivity of log-sum-exp-type objectives, and the Lebesgue-nullity of zero sets of nonzero polynomials on Rn\mathbb R^nRn. Proofs of any milestone are welcome. So are alternative routes to Theorem 1, for example via a monotone fixed-point argument.

Selected references

  • R. Johari, H. Li, I. Liskovich, G. Y. Weintraub, Experimental Design in Two-Sided Platforms: An Analysis of Bias, arXiv:2002.05670v5, 2021; Management Science 68(10), 2022. https://arxiv.org/abs/2002.05670
  • T. G. Kurtz, Solutions of ordinary differential equations as limits of pure jump Markov processes, Journal of Applied Probability 7(1), 1970. https://doi.org/10.2307/3212147
  • R. W. R. Darling, Fluid limits of pure jump Markov processes: a practical guide, arXiv:math/0210109, 2002. https://arxiv.org/abs/math/0210109
  • D. Holtz, S. Aral, Limiting bias from test-control interference in online marketplace experiments, arXiv:2004.12162, 2020. https://arxiv.org/abs/2004.12162
11 thms1 active userReviewed
Algorithmic Game TheoryEconomicsMechanism Design·Captain: mikedeng1

Persuading Customers to Buy Early: The Value of Personalized Information Provisioning: The Personalized Buy/Wait/No Mechanism Is Optimal and Strictly Beats Public SignalingResearch Paper

Motivation

A seller who sells over two periods, at a full price now and a discount later, loses revenue to strategic customers who wait for the discount. Waiting is costly to the customer only through availability risk: if inventory is scarce, the product may be gone by the second period. Inventory is usually known to the firm and not to its customers, so the firm can try to shape how scarce the product looks. Drakopoulos, Jain and Randhawa (SSRN 3191629, version of April 17, 2020) study this as a problem of Bayesian persuasion (Kamenica and Gentzkow, AER 2011) with many receivers: the firm commits to prices and to a signaling policy before it learns its inventory, and then sends each customer a recommendation.

Their two main results separate public from private information. Theorem 1 (p. 15): with a public signal, seen by all customers, the firm earns no more than with prices alone. Theorem 2 (p. 17): with personalized signals, which may depend on each customer's valuation and be randomized independently across customers, a simple Buy/Wait/No mechanism is optimal and strictly beats every public mechanism when the low inventory level is small. Personalized recommendations are the kind of information online retailers and travel platforms send (low-stock alerts, buy-now prompts).

Setting

There is a unit mass of customers with valuations distributed on V=[0,b]V=[0,b]V=[0,b] with density fff and complementary distribution Fˉ(v)=∫vbf\bar F(v)=\int_v^b fFˉ(v)=∫vb​f; the hazard rate f/Fˉf/\bar Ff/Fˉ is non-decreasing. The firm's inventory QQQ is high, qH=1q_H=1qH​=1 (enough for everyone), with probability P(H)∈(0,1)P(H)\in(0,1)P(H)∈(0,1), and low, qL∈(0,1]q_L\in(0,1]qL​∈(0,1], with probability P(L)=1−P(H)P(L)=1-P(H)P(L)=1−P(H). The monopoly price is pm=arg⁡max⁡ppFˉ(p)p^m=\arg\max_p p\bar F(p)pm=argmaxp​pFˉ(p), and Fˉ−1(q)\bar F^{-1}(q)Fˉ−1(q) is the valuation at which a mass qqq of customers lies above.

A straightforward mechanism fixes prices p1,p2≥0p_1,p_2\ge0p1​,p2​≥0 and, after seeing QQQ, draws a latent index kkk from a finite set with a state-dependent law; given (Q,k)(Q,k)(Q,k), each vvv-customer is independently told Buy (in period 1), Wait (buy in period 2) or No. A customer who requests the product in a period with sss units left and demand of mass DDD from the others gets it with probability avail(s,D)\mathrm{avail}(s,D)avail(s,D): 000 if s≤0s\le0s≤0, 111 if D≤sD\le sD≤s, s/Ds/Ds/D otherwise (random rationing). The mechanism is obedient if every customer (for almost every vvv) weakly prefers to follow her recommendation, given the availabilities she can expect conditional on it: (Buy-1)–(No), p. 40. The firm's revenue is the expected value of rationed sales p1min⁡{D1,Q}+p2min⁡{D2,(Q−D1)+}p_1\min\{D_1,Q\}+p_2\min\{D_2,(Q-D_1)^+\}p1​min{D1​,Q}+p2​min{D2​,(Q−D1​)+}. A mechanism is public when the recommendations depend only on (k,v)(k,v)(k,v) and obedience holds for each realized kkk.

The personalized mechanism (PS1)–(PS2), p. 17, sets p1=Fˉ−1(qL)p_1=\bar F^{-1}(q_L)p1​=Fˉ−1(qL​). In state LLL it tells customers with v≥p1v\ge p_1v≥p1​ to buy and the rest No; in state HHH it tells v≥p1v\ge p_1v≥p1​ to buy with probability

σH(v)=min⁡{P(L)P(H)v−p1p1−p2,1}(13)\sigma_H(v)=\min\Big\{\frac{P(L)}{P(H)}\frac{v-p_1}{p_1-p_2},1\Big\}\tag{13}σH​(v)=min{P(H)P(L)​p1​−p2​v−p1​​,1}(13)

and to wait otherwise, tells p2≤v<p1p_2\le v<p_1p2​≤v<p1​ to wait, and v<p2v<p_2v<p2​ No. The price p2p_2p2​ solves Fˉ(p2)−p2f(p2)=Fˉ(vˉ)\bar F(p_2)-p_2f(p_2)=\bar F(\bar v)Fˉ(p2​)−p2​f(p2​)=Fˉ(vˉ) (14) with vˉ=sup⁡{v:σH(v)<1}\bar v=\sup\{v:\sigma_H(v)<1\}vˉ=sup{v:σH​(v)<1} (15).

Formalization targets

Goal: Theorem 2

If qL≤Fˉ(pm)q_L\le\bar F(p^m)qL​≤Fˉ(pm), then (14) has a root p2∈(0,p1)p_2\in(0,p_1)p2​∈(0,p1​), and for every such root the mechanism (PS2) is obedient, its revenue RprivateR_{private}Rprivate​ is at least that of every obedient mechanism at any prices, and

Rprivate>Rϕ∗=P(L) pˉ1Fˉ(pˉ1)+P(H) pmFˉ(pm),pˉ1=max⁡{Fˉ−1(qL),pm}.(11)R_{private}>R^*_\phi=P(L)\,\bar p_1\bar F(\bar p_1)+P(H)\,p^m\bar F(p^m),\qquad \bar p_1=\max\{\bar F^{-1}(q_L),p^m\}.\tag{11}Rprivate​>Rϕ∗​=P(L)pˉ​1​Fˉ(pˉ​1​)+P(H)pmFˉ(pm),pˉ​1​=max{Fˉ−1(qL​),pm}.(11)

Milestones

  1. Lemma 2 (p. 35): the L-state profit ϕ(t,p)\phi(t,p)ϕ(t,p) of a public threshold ttt satisfies ϕ(t,p)≤max⁡{(Fˉ−1(qL)−p)qL,0}\phi(t,p)\le\max\{(\bar F^{-1}(q_L)-p)q_L,0\}ϕ(t,p)≤max{(Fˉ−1(qL​)−p)qL​,0}, and for qL<Fˉ(p)q_L<\bar F(p)qL​<Fˉ(p) its unique maximizer is Fˉ−1(qL)\bar F^{-1}(q_L)Fˉ−1(qL​).
  2. Theorem 1 (c) (p. 15): Rϕ∗R^*_\phiRϕ∗​ is the largest revenue of a public mechanism.
  3. Lemma 3 (p. 44): at fixed prices p1>p2p_1>p_2p1​>p2​, the (t∗,p1,p2)(t^*,p_1,p_2)(t∗,p1​,p2​)-mechanism built from an optimal threshold t∗t^*t∗ of the one-parameter program (A.16) is obedient, earns its value Dˉ(p1,p2)\bar D(p_1,p_2)Dˉ(p1​,p2​), and is optimal among obedient mechanisms with those prices.
  4. Lemma 4 (p. 44, corrected reading): if Fˉ(p2)>qL\bar F(p_2)>q_LFˉ(p2​)>qL​, then Dˉ(p1,p2)≤Dˉ(Fˉ−1(qL),p2)\bar D(p_1,p_2)\le\bar D(\bar F^{-1}(q_L),p_2)Dˉ(p1​,p2​)≤Dˉ(Fˉ−1(qL​),p2​).
  5. (16) (p. 17): (PS2) is obedient and earns
Rprivate=P(H)p2Fˉ(p2)+P(H)(p1−p2)Fˉ(vˉ)+P(L)∫p1vˉ(v−p1) dF(v)+P(L)p1qL.R_{private}=P(H)p_2\bar F(p_2)+P(H)(p_1-p_2)\bar F(\bar v)+P(L)\int_{p_1}^{\bar v}(v-p_1)\,dF(v)+P(L)p_1q_L.Rprivate​=P(H)p2​Fˉ(p2​)+P(H)(p1​−p2​)Fˉ(vˉ)+P(L)∫p1​vˉ​(v−p1​)dF(v)+P(L)p1​qL​.

Significance

The result says that the value of information in this market lies entirely in its personalization: public information is worthless (Theorem 1), and private recommendations strictly raise revenue whenever low inventory is scarce relative to the monopoly market. The optimal mechanism is explicit and has a simple form, with the low-type firm selling out exactly in period 1 and the high-type firm mimicking it as far as incentive compatibility allows; in the paper's uniform example (qL=P(H)=1/2q_L=P(H)=1/2qL​=P(H)=1/2) revenue rises from 1/41/41/4 to 13/4813/4813/48. The proof technique, a relaxation to a linear program over signal profiles followed by a dual reduction to a single threshold, is a template for many-receiver persuasion problems with congestion.

The theorems are proved in the paper; none of them has a machine-checked proof. The mission produces a formal model of strategic customers under rationing and personalized signaling, and the formal versions of the five steps. Two printed steps need correction to be true and are stated in corrected form (Lemma 4's tie case, the location of the root of (14)); formal proofs settle that the corrections suffice.

Difficulty

The obvious argument is a pointwise one: for each valuation, the Buy incentive constraint caps the high-state Buy probability given the low-state one, so set every cap tight. It fails because the availabilities in the constraints depend on the aggregate masses that the recommendations themselves create, so the constraints for different valuations are coupled; the paper resorts to an infinite-dimensional linear program and asserts strong duality without proof (p. 41). Lemma 4 is the algebraically heavy step (pp. 46–50): an envelope argument over the threshold combined with the hazard-rate monotonicity. Theorem 2 then needs a one-dimensional optimization in p2p_2p2​, the existence of a root of (14) (a fixed-point equation, since vˉ\bar vvˉ depends on p2p_2p2​), and the case p2>p1p_2>p_1p2​>p1​, which the paper never treats.

Formalization scope

The paper's game (Definitions 1–2: a continuum of customers, Bayesian Nash equilibrium, sender-preferred selection) is re-expressed as the class its proofs reduce to by the revelation principle (p. 39, footnote 5): obedient straightforward mechanisms with aggregate masses. Revenue optimality over this class is what Theorem 2 asserts after that reduction. The latent index is finite (Fin n, for every n); it carries the correlation between customers' signals that public signals need. Obedience is required for almost every valuation, as in Definition 1.

Committed conventions: V=[0,b]V=[0,b]V=[0,b], b>0b>0b>0, fff continuous on [0,b][0,b][0,b] and positive on [0,b)[0,b)[0,b); 0<P(H)<10<P(H)<10<P(H)<1, 0<qL≤10<q_L\le10<qL​≤1; qH=1q_H=1qH​=1 and customer mass 111. Availability is avail above; at zero demand it is 111 with stock left and 000 without. (14) is written Fˉ(p2)−p2f(p2)=Fˉ(vˉ)\bar F(p_2)-p_2f(p_2)=\bar F(\bar v)Fˉ(p2​)−p2​f(p2​)=Fˉ(vˉ). In (PS2)(a) "v>p1v>p_1v>p1​" is taken as v≥p1v\ge p_1v≥p1​ (a null set). (B) is read with min⁡{⋅,1}\min\{\cdot,1\}min{⋅,1}. The program (A.16) keeps the no-Buy mechanism (Fˉ(t)=0\bar F(t)=0Fˉ(t)=0), which the printed version drops. "The optimal mechanism" is stated as "an optimal mechanism" (ties exist). Lemmas 3–4 take p2<p1p_2<p_1p2​<p1​, implicit in the paper's divisions; the goal ranges over all prices p1,p2≥0p_1,p_2\ge0p1​,p2​≥0, including p2>p1p_2>p_1p2​>p1​ (p. 8). Milestone (16) is stated at the prices of (PS1): p1=Fˉ−1(qL)p_1=\bar F^{-1}(q_L)p1​=Fˉ−1(qL​) and p2∈[0,p1)p_2\in[0,p_1)p2​∈[0,p1​) a root of (14).

Trivializing formalizations are ruled out: revenue counts rationed sales, not p1D1+p2D2p_1D_1+p_2D_2p1​D1​+p2​D2​; obedience is the printed conditional constraint multiplied by the probability of the recommendation, never divided by a possibly zero probability; availability never uses Lean's x/0=0x/0=0x/0=0; the goal carries the existence of a root of (14), so "for every root" is not vacuous; the mechanism class contains public and correlated mechanisms; and RprivateR_{private}Rprivate​ is the revenue of the mechanism (PS2), tied to the formula (16) by a milestone.

A complete development needs: the density measure on [0,b][0,b][0,b] and its tail function Fˉ\bar FFˉ, monotonicity and continuity of Fˉ\bar FFˉ and its inverse, the quasi-concavity of pFˉ(p)p\bar F(p)pFˉ(p) under a non-decreasing hazard rate, and bounds for the rationing function. The hazard-rate and Fˉ−1\bar F^{-1}Fˉ−1 lemmas are reusable for other pricing models. Contributions of helper lemmas, of a primal proof of Lemma 3 avoiding the duality argument, and of the case p2>p1p_2>p_1p2​>p1​ are welcome.

Selected references

  • K. Drakopoulos, S. Jain, R. S. Randhawa, Persuading Customers to Buy Early: The Value of Personalized Information Provisioning, SSRN working paper 3191629, version of April 17, 2020. https://ssrn.com/abstract=3191629
  • E. Kamenica, M. Gentzkow, Bayesian Persuasion, American Economic Review 101(6):2590–2615, 2011. https://doi.org/10.1257/aer.101.6.2590
  • D. Bergemann, S. Morris, Information Design: A Unified Perspective, Journal of Economic Literature 57(1):44–95, 2019. https://doi.org/10.1257/jel.20181489
11 thms1 active userReviewed
OptimizationStatistics·Captain: mikedeng1

Calibration of Distributionally Robust Empirical Optimization Models: The Worst-Case Sensitivity of the Expected Reward Equals Its Variance Divided by φ''(1)Research Paper

Motivation

Distributionally robust optimization (DRO) guards a data-driven decision against misspecification of the model that generated the data. In its penalized form, the decision maker replaces the sample-average problem max⁡xEPn[f(x,Y)]\max_x \mathbb E_{\mathbb P_n}[f(x,Y)]maxx​EPn​​[f(x,Y)], where Pn\mathbb P_nPn​ is the empirical distribution of the data Y1,…,YnY_1,\dots,Y_nY1​,…,Yn​, by

max⁡x min⁡Q{EQ[f(x,Y)]+1δ Hϕ(Q ∣ Pn)},\max_x\ \min_{\mathbb Q}\Big\{\mathbb E_{\mathbb Q}[f(x,Y)]+\frac1\delta\,\mathcal H_\phi(\mathbb Q\,|\,\mathbb P_n)\Big\},xmax​ Qmin​{EQ​[f(x,Y)]+δ1​Hϕ​(Q∣Pn​)},

where Hϕ\mathcal H_\phiHϕ​ is a ϕ\phiϕ-divergence and δ≥0\delta\ge0δ≥0 controls how far an adversary may move the distribution. Such models are used in operations research, statistics and machine learning (Ben-Tal et al. 2013; Lam 2016; Duchi and Namkoong 2019), and a practitioner must choose δ\deltaδ. Gotoh, Kim and Lim (arXiv:1711.06565, Operations Research 2021) study this calibration problem. Their first contribution, on which the rest of the paper builds, is an exact description of what the robust model penalizes for small δ\deltaδ: the worst-case loss of expected reward is, to first order, the variance of the reward divided by the curvature ϕ′′(1)\phi''(1)ϕ′′(1) of the divergence. This mission formalizes that theorem (Theorem 2.2) together with its proof chain in Appendix F.

Setting

A decision xxx is fixed throughout, so the data enter only through the reward vector f=(f1,…,fn)f=(f_1,\dots,f_n)f=(f1​,…,fn​) with fi=f(x,Yi)f_i=f(x,Y_i)fi​=f(x,Yi​). The nominal distribution is a probability vector Pn=(p1,…,pn)\mathbb P_n=(p_1,\dots,p_n)Pn​=(p1​,…,pn​) with every pi>0p_i>0pi​>0; the empirical distribution of distinct data points is pi=1/np_i=1/npi​=1/n. Write

EPn[f]=∑i=1npifi,VPn[f]=∑i=1npi(fi−EPn[f])2.\mathbb E_{\mathbb P_n}[f]=\sum_{i=1}^n p_if_i,\qquad \mathbb V_{\mathbb P_n}[f]=\sum_{i=1}^n p_i\big(f_i-\mathbb E_{\mathbb P_n}[f]\big)^2 .EPn​​[f]=i=1∑n​pi​fi​,VPn​​[f]=i=1∑n​pi​(fi​−EPn​​[f])2.

The divergence generator is a function ϕ:R→R∪{+∞}\phi:\mathbb R\to\mathbb R\cup\{+\infty\}ϕ:R→R∪{+∞} satisfying Assumption 2.1: ϕ\phiϕ is closed (lower semicontinuous) and convex, ϕ(z)≥ϕ(1)=0\phi(z)\ge\phi(1)=0ϕ(z)≥ϕ(1)=0 for z≥0z\ge0z≥0, ϕ(z)=+∞\phi(z)=+\inftyϕ(z)=+∞ for z<0z<0z<0, and ϕ\phiϕ is twice continuously differentiable on a neighbourhood of z=1z=1z=1 with ϕ′′(1)>0\phi''(1)>0ϕ′′(1)>0. Kullback–Leibler (zlog⁡z−z+1z\log z-z+1zlogz−z+1), modified χ2\chi^2χ2 ((z−1)2(z-1)^2(z−1)2) and Burg (−log⁡z+z−1-\log z+z-1−logz+z−1) generators all qualify.

For δ>0\delta>0δ>0, the worst-case measures Q(δ)\mathbb Q(\delta)Q(δ) of (2.7) are the minimizers, over probability vectors q=(q1,…,qn)q=(q_1,\dots,q_n)q=(q1​,…,qn​), of

Jδ(q)=∑i=1nqifi+1δ∑i=1npi ϕ(qipi),J_\delta(q)=\sum_{i=1}^n q_if_i+\frac1\delta\sum_{i=1}^n p_i\,\phi\Big(\frac{q_i}{p_i}\Big),Jδ​(q)=i=1∑n​qi​fi​+δ1​i=1∑n​pi​ϕ(pi​qi​​),

and Q(0)=Pn\mathbb Q(0)=\mathbb P_nQ(0)=Pn​. The worst-case sensitivity (2.8) of the expected reward is

SPn(f)=−lim⁡δ↓0EQ(δ)[f]−EPn[f]δ.\mathcal S_{\mathbb P_n}(f)=-\lim_{\delta\downarrow0}\frac{\mathbb E_{\mathbb Q(\delta)}[f]-\mathbb E_{\mathbb P_n}[f]}{\delta}.SPn​​(f)=−δ↓0lim​δEQ(δ)​[f]−EPn​​[f]​.

The proof uses the convex conjugate ϕ∗(ζ)=sup⁡z{ζz−ϕ(z)}\phi^*(\zeta)=\sup_z\{\zeta z-\phi(z)\}ϕ∗(ζ)=supz​{ζz−ϕ(z)} (F.5) and a Lagrange multiplier c⋆(δ)c^\star(\delta)c⋆(δ) for the constraint ∑iqi=1\sum_iq_i=1∑i​qi​=1.

Formalization targets

Goal: Theorem 2.2 (p. 8)

For every ϕ\phiϕ satisfying Assumption 2.1, every Pn\mathbb P_nPn​ with positive weights and every fff, worst-case measures exist for each δ>0\delta>0δ>0, and for every choice of them

SPn(f)=1ϕ′′(1) VPn[f].\mathcal S_{\mathbb P_n}(f)=\frac{1}{\phi''(1)}\,\mathbb V_{\mathbb P_n}[f].SPn​​(f)=ϕ′′(1)1​VPn​​[f].

Milestones (Appendix F, in proof order)

  1. (F.4), p. 48. ϕ′\phi'ϕ′ has a continuously differentiable local inverse near ζ=0\zeta=0ζ=0, with [ϕ′]−1(0)=1[\phi']^{-1}(0)=1[ϕ′]−1(0)=1 and [ϕ′]−1(ζ)=1+ζ/ϕ′′(1)+o(ζ)[\phi']^{-1}(\zeta)=1+\zeta/\phi''(1)+o(\zeta)[ϕ′]−1(ζ)=1+ζ/ϕ′′(1)+o(ζ).
  2. p. 49. ϕ∗\phi^*ϕ∗ is finite and twice continuously differentiable near 000, [ϕ∗]′=[ϕ′]−1[\phi^*]'=[\phi']^{-1}[ϕ∗]′=[ϕ′]−1 there, [ϕ∗]′(0)=1[\phi^*]'(0)=1[ϕ∗]′(0)=1 and [ϕ∗]′′(0)=1/ϕ′′(1)[\phi^*]''(0)=1/\phi''(1)[ϕ∗]′′(0)=1/ϕ′′(1).
  3. (F.7)–(F.8), p. 49. For small δ>0\delta>0δ>0 the first-order condition ∑ipi[ϕ∗]′(δ(−fi−c))=1\sum_ip_i[\phi^*]'(\delta(-f_i-c))=1∑i​pi​[ϕ∗]′(δ(−fi​−c))=1 has a unique solution c⋆(δ)c^\star(\delta)c⋆(δ) near −EPn[f]-\mathbb E_{\mathbb P_n}[f]−EPn​​[f], and c⋆(δ)→−EPn[f]c^\star(\delta)\to-\mathbb E_{\mathbb P_n}[f]c⋆(δ)→−EPn​​[f] as δ↓0\delta\downarrow0δ↓0.
  4. Proposition F.1, (F.1)–(F.2), p. 47. For small δ>0\delta>0δ>0 the worst-case measure is unique, qi∗(δ)=pi[ϕ′]−1(δ(−fi−c⋆(δ)))q^*_i(\delta)=p_i[\phi']^{-1}(\delta(-f_i-c^\star(\delta)))qi∗​(δ)=pi​[ϕ′]−1(δ(−fi​−c⋆(δ))), and c⋆(δ)c^\star(\delta)c⋆(δ) maximizes the dual function −1δ∑ipiϕ∗(δ(−fi−c))−c-\frac1\delta\sum_ip_i\phi^*(\delta(-f_i-c))-c−δ1​∑i​pi​ϕ∗(δ(−fi​−c))−c.
  5. Proposition F.1, (F.3), p. 47. qi∗(δ)=pi{1−δ(fi−EPn[f])/ϕ′′(1)}+o(δ)q^*_i(\delta)=p_i\{1-\delta(f_i-\mathbb E_{\mathbb P_n}[f])/\phi''(1)\}+o(\delta)qi∗​(δ)=pi​{1−δ(fi​−EPn​​[f])/ϕ′′(1)}+o(δ).

Significance

Theorem 2.2 identifies penalized DRO, for small δ\deltaδ, with a mean–variance trade-off: the robust objective is (by the expansion (2.6), which the paper cites) EPn[f]−δ2ϕ′′(1)VPn[f]+o(δ)\mathbb E_{\mathbb P_n}[f]-\frac{\delta}{2\phi''(1)}\mathbb V_{\mathbb P_n}[f]+o(\delta)EPn​​[f]−2ϕ′′(1)δ​VPn​​[f]+o(δ), and the theorem gives the derivative of the worst-case mean that underlies that expansion. The paper's calibration method (§§4–6) rests on this: since in-sample robustness acts by penalizing variance, δ\deltaδ is chosen by trading an out-of-sample reduction in variance against a loss in mean.

The result is proved in the paper; to the best of current searches it has no machine-checked proof. The mission produces a complete formal proof of Theorem 2.2 under the paper's own assumption, a formal treatment of the conjugate duality for penalized ϕ\phiϕ-divergence problems on finite supports, and corrected versions of three steps of the printed argument (see Formalization scope).

Difficulty

The theorem is a first-order expansion of an argmin, and the obvious route is to differentiate the optimality conditions at δ=0\delta=0δ=0 by the implicit function theorem. That step fails under Assumption 2.1: the system defining the multiplier c⋆(δ)c^\star(\delta)c⋆(δ) involves [ϕ∗]′[\phi^*]'[ϕ∗]′ evaluated at δ(−fi−c)\delta(-f_i-c)δ(−fi​−c), and its partial derivative in δ\deltaδ at δ=0\delta=0δ=0 requires a third derivative of ϕ\phiϕ, which is not assumed. For ϕ(z)=(z−1)2+∣z−1∣5/2\phi(z)=(z-1)^2+|z-1|^{5/2}ϕ(z)=(z−1)2+∣z−1∣5/2 the multiplier satisfies c⋆(δ)+EPn[f]≈0.036δc^\star(\delta)+\mathbb E_{\mathbb P_n}[f]\approx0.036\sqrt\deltac⋆(δ)+EPn​​[f]≈0.036δ​, so it is not differentiable at 000, although Theorem 2.2 still holds. A proof therefore has to extract the first-order behaviour of Q(δ)\mathbb Q(\delta)Q(δ) from continuity of c⋆c^\starc⋆ at 000 alone. Further work lies in showing that the minimizer is interior and unique for small δ\deltaδ when ϕ\phiϕ is only locally smooth, and in handling extended-real values of ϕ\phiϕ and ϕ∗\phi^*ϕ∗.

Formalization scope

  • ϕ\phiϕ is a function ℝ → EReal satisfying Assumption21: lower semicontinuity, pointwise convexity on R\mathbb RR (with 0⋅(+∞)=00\cdot(+\infty)=00⋅(+∞)=0), 0≤ϕ(z)0\le\phi(z)0≤ϕ(z) for z≥0z\ge0z≥0, ϕ(1)=0\phi(1)=0ϕ(1)=0, ϕ(z)=⊤\phi(z)=\topϕ(z)=⊤ for z<0z<0z<0, finiteness and C2C^2C2 smoothness of the real part on an open interval around 111, and ϕ′′(1)>0\phi''(1)>0ϕ′′(1)>0. Assumption 2.1 is the only hypothesis on ϕ\phiϕ: no third derivative, no finiteness on (0,∞)(0,\infty)(0,∞), and no separate ϕ′(1)=0\phi'(1)=0ϕ′(1)=0 (it follows from the assumption).
  • Derivatives of ϕ\phiϕ and ϕ∗\phi^*ϕ∗ are those of their real parts (EReal.toReal); every statement that differentiates also asserts or implies finiteness where it differentiates.
  • The data are indexed by Fin n. The weights are general, pi>0p_i>0pi​>0 and ∑ipi=1\sum_ip_i=1∑i​pi​=1; the paper's empirical distribution is pi=1/np_i=1/npi​=1/n, and its variance 1n∑i(fi−EPn[f])2\frac1n\sum_i(f_i-\mathbb E_{\mathbb P_n}[f])^2n1​∑i​(fi​−EPn​​[f])2 is the special case. The paper's (2.4) also allows zero weights; these are excluded.
  • Q(δ)\mathbb Q(\delta)Q(δ) ranges over the minimizers of JδJ_\deltaJδ​ on Mathlib's stdSimplex. The goal asserts that minimizers exist for every δ>0\delta>0δ>0 and that the limit holds for every selection of minimizers; it is not a statement about an arbitrary function constrained by hypotheses, and the existence clause rules out a vacuous reading.
  • The sensitivity (2.8) is stated as a one-sided limit along δ↓0\delta\downarrow0δ↓0, so the branch Q(0)=Pn\mathbb Q(0)=\mathbb P_nQ(0)=Pn​ is not needed.
  • Corrected readings: (F.4) prints ϕ−1\phi^{-1}ϕ−1 and ϕ′′(0)\phi''(0)ϕ′′(0) for [ϕ′]−1[\phi']^{-1}[ϕ′]−1 and ϕ′′(1)\phi''(1)ϕ′′(1); p. 49 prints [ϕ∗]′′(0)=1/ϕ′′(0)[\phi^*]''(0)=1/\phi''(0)[ϕ∗]′′(0)=1/ϕ′′(0) for 1/ϕ′′(1)1/\phi''(1)1/ϕ′′(1); the claim that c⋆c^\starc⋆ is continuously differentiable at δ=0\delta=0δ=0 is false under Assumption 2.1, and milestone 3 states continuity at 000 instead. The clause "Q(δ)\mathbb Q(\delta)Q(δ) is continuously differentiable near δ=0\delta=0δ=0" of Proposition F.1 is not stated; (F.3) is.
  • Out of scope: the asymptotic out-of-sample analysis of §§3–5 (Proposition 3.2, Theorem 3.3, Propositions 4.1, 4.2, 5.2, Theorem 5.3), the bootstrap calibration algorithm of §6 and the experiments of §7. Those results either apply cited limit theorems, or expand moments of quantities known only in distribution without the integrability that would justify it.
  • Everything beyond the local definitions is in Mathlib: EReal, LowerSemicontinuous, stdSimplex, deriv, ContDiffOn, HasDerivAt, Filter.Tendsto. A reusable by-product is the local theory of the convex conjugate of a C2C^2C2 convex function near a point of positive curvature. Contributions of proofs of any milestone are welcome.

Selected references

  • J. Gotoh, M. J. Kim, A. E. B. Lim, Calibration of Distributionally Robust Empirical Optimization Models, Operations Research, 2021; read as arXiv:1711.06565v2, 2020. https://arxiv.org/abs/1711.06565
  • A. Ben-Tal, D. den Hertog, A. De Waegenaere, B. Melenberg, G. Rennen, Robust Solutions of Optimization Problems Affected by Uncertain Probabilities, Management Science 59(2), 2013. https://doi.org/10.1287/mnsc.1120.1641
  • H. Lam, Robust Sensitivity Analysis for Stochastic Systems, Mathematics of Operations Research 41(4), 2016. https://doi.org/10.1287/moor.2015.0776
  • J. C. Duchi, H. Namkoong, Variance-based Regularization with Convex Objectives, Journal of Machine Learning Research 20, 2019. https://arxiv.org/abs/1610.02581
7 thms1 active userReviewed
PreviousPage 72 of 101Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me