Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,210 missions · 1,107 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1103Completed1107All2210
🏆Completed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

Cross-licensing in a Supply Chain with Asymmetric Manufacturers I: Ex Post, Enforcing Cross-Licensing Never Lowers the Supplier's Profit at Any Wholesale PriceResearch Paper

Why the final licensing choice matters

A component supplier can influence a product market through both the wholesale price it charges and the technology its customers may share. Wang, Huang and Lee study a supply chain with one upstream supplier and two downstream manufacturers that invest in product quality and then compete in quantities. A cross-licensing policy lets each manufacturer use some of the other's innovation. The supplier may promise a policy before the investments, or leave the decision until after the investments and wholesale price are fixed. The latter choice creates a precise comparison: at that final stage, does permitting cross-licensing reduce the supplier's revenue? The authors answer it in Proposition 1 of their SSRN manuscript, version of 2023-04-27. Its proof is in the attached appendix, p. A.1.

This mission concerns that final-stage comparison. It is one part of the paper's broader study of how a supplier's licensing commitment affects manufacturers' innovation incentives and downstream market structure. The later innovation and initial-contract comparisons are separate questions. Here, investments and wholesale price are fixed, so the result isolates the direct quantity-market effect of licensing at the moment the supplier chooses its policy.

The downstream quantity game

Manufacturers M1M_1M1​ and M2M_2M2​ have already selected nonnegative innovation levels T1T_1T1​ and T2T_2T2​, with T1≤T2T_1\le T_2T1​≤T2​ in the presentation of equations (2) and (3). Each chooses a nonnegative production quantity qiq_iqi​. The wholesale price rrr is the amount each manufacturer pays the common supplier for one unit. The market-size intercept is normalized to one and per-unit manufacturing cost to zero. If licensing effectiveness is β∈[0,1]\beta\in[0,1]β∈[0,1], manufacturer iii receives a quality improvement Ti+βTjT_i+\beta T_jTi​+βTj​; β=0\beta=0β=0 represents no cross-licensing. Its inverse demand is 1+Ti+βTj−q1−q21+T_i+\beta T_j-q_1-q_21+Ti​+βTj​−q1​−q2​. These are the model's conventions on pp. 9–10.

At fixed T1,T2,β,rT_1,T_2,\beta,rT1​,T2​,β,r, the manufacturers play a simultaneous quantity game. Their respective profits are

Π1(q1;q2)=(1+T1+βT2−q1−q2−r)q1,Π2(q2;q1)=(1+T2+βT1−q1−q2−r)q2.\Pi_1(q_1;q_2)=(1+T_1+\beta T_2-q_1-q_2-r)q_1, \qquad \Pi_2(q_2;q_1)=(1+T_2+\beta T_1-q_1-q_2-r)q_2.Π1​(q1​;q2​)=(1+T1​+βT2​−q1​−q2​−r)q1​,Π2​(q2​;q1​)=(1+T2​+βT1​−q1​−q2​−r)q2​.

A Nash equilibrium is a pair (q1,q2)∈[0,∞)2(q_1,q_2)\in[0,\infty)^2(q1​,q2​)∈[0,∞)2 for which neither manufacturer increases its profit by changing its own nonnegative quantity while the other's quantity stays fixed. The supplier's profit at a quantity profile is r(q1+q2)r(q_1+q_2)r(q1​+q2​). The supplier's comparison must therefore account for the manufacturers' responses under each licensing policy; it cannot compare profit at an arbitrary fixed quantity pair.

Formalization targets

The first milestone gives the exact equilibrium quantities of equation (2). Write r1=1+T1(2−β)−T2(1−2β)r_1=1+T_1(2-\beta)-T_2(1-2\beta)r1​=1+T1​(2−β)−T2​(1−2β) and r2=1+βT1+T2r_2=1+\beta T_1+T_2r2​=1+βT1​+T2​. For r≤r1r\le r_1r≤r1​ both manufacturers can sell; for r1<r≤r2r_1<r\le r_2r1​<r≤r2​ only M2M_2M2​ sells; above r2r_2r2​ neither sells. The statement characterizes every equilibrium and thereby gives existence and uniqueness across the two threshold boundaries, including the cases where a manufacturer's equilibrium quantity is zero.

The second milestone identifies the supplier's revenue at an equilibrium with the piecewise expression πscl(r)\pi_s^{\mathrm{cl}}(r)πscl​(r) in equation (3). Setting β=0\beta=0β=0 in that expression gives the paper's no-licensing expression πsn(r)\pi_s^{\mathrm n}(r)πsn​(r) in equation (4). This milestone links the paper's algebraic profit comparison to the strategic quantity game, while keeping the equilibrium property as the premise.

The goal is the supplier's ex-post preference in Proposition 1. If qclq^{\mathrm{cl}}qcl is any equilibrium with licensing effectiveness β\betaβ and qnq^{\mathrm n}qn is any equilibrium at β=0\beta=0β=0, then both equilibria exist and

r(q1n+q2n)≤r(q1cl+q2cl)(0≤β≤1,  0≤T1≤T2,  r≥0).r\bigl(q^{\mathrm n}_1+q^{\mathrm n}_2\bigr) \le r\bigl(q^{\mathrm{cl}}_1+q^{\mathrm{cl}}_2\bigr) \qquad(0\le\beta\le1,\;0\le T_1\le T_2,\;r\ge0).r(q1n​+q2n​)≤r(q1cl​+q2cl​)(0≤β≤1,0≤T1​≤T2​,r≥0).

This weak inequality is intentional. At β=0\beta=0β=0 the two games coincide, and there are other parameter values at which the profits tie. The comparison holds at the same innovation levels and the same wholesale price; it is not a comparison after re-optimizing the supplier's price or the manufacturers' investment decisions.

What the result establishes

For fixed investments and price, the supplier need not lose revenue by enforcing cross-licensing after observing the manufacturers' innovation. This gives mathematical content to the paper's claim that, without an initial commitment, the supplier will choose to enforce licensing at the final contract stage. The model does not specify a separate final-contract bargaining game, so the formal goal is the profit comparison that supports that interpretation. The result does not settle whether committing to licensing before innovation is preferable: changing the initial policy can change the innovation levels themselves, which the ex-post comparison holds fixed.

The authors prove Proposition 1 by comparing the supplier-profit expressions (3) and (4) in the manuscript's appendix. A machine-checked development would additionally secure the connection from the manufacturers' Nash conditions to those expressions, including the monopoly and zero-sales regimes. These statements are currently posed as open formalization targets; a Lean file with sorry only checks that the statements are well formed, not that the paper's argument has been verified by Lean. The general two-player Nash definition can be reused for other real-strategy games; the payoff and threshold definitions are specific to this supply chain.

Where the argument has to account for cases

The quantity equilibrium changes form as the wholesale price crosses r1r_1r1​ and r2r_2r2​. An argument confined to the two-selling-firms region misses cases in which M1M_1M1​ sells nothing, or neither manufacturer sells. Comparing only the duopoly formulas cannot establish an inequality at every nonnegative price. The first milestone therefore covers all three regimes, and the goal compares the profits of actual equilibria. The fact that T2≥T1T_2\ge T_1T2​≥T1​ orders the possible monopoly toward M2M_2M2​ under the paper's chosen labels; a formulation that silently assumes both equilibrium quantities are strictly positive would lose part of Proposition 1.

Formalization scope

All parameters and quantities are real. The permitted quantity strategies and wholesale prices are nonnegative. The paper treats rrr as a wholesale price without writing a bound in Proposition 1; r≥0r\ge0r≥0 is made explicit because a negative price can reverse the supplier-profit inequality. The innovation ordering 0≤T1≤T20\le T_1\le T_20≤T1​≤T2​ is the convention immediately preceding equation (2). Licensing effectiveness lies in [0,1][0,1][0,1]. Innovation costs kiTi2k_iT_i^2ki​Ti2​ and the paper's bound k2>49/144k_2>49/144k2​>49/144 are unnecessary once innovation levels are fixed, so they do not enter this mission's statements.

The formalization uses an explicit pair (q1,q2)(q_1,q_2)(q1​,q2​), with the first coordinate for M1M_1M1​. The quantity-game equilibrium is defined by unilateral payoff comparisons over [0,∞)[0,\infty)[0,∞), and it is not defined by equation (2). Equation (2) is instead a theorem characterizing the equilibrium. The supplier's profit is defined as r(q1+q2)r(q_1+q_2)r(q1​+q2​) for any pair, independently of equation (3). These choices prevent the goal from becoming an inequality between two expressions whose connection to the game has merely been assumed. Equation (2)'s missing closing parenthesis in the manuscript is interpreted as the displayed first quantity divided by three. No division in the model's displayed formulas has a variable denominator.

Selected references

  • J. Wang, T. Huang and J. Lee, Cross-licensing in a Supply Chain with Asymmetric Manufacturers, SSRN manuscript 3053682, version of 2023-04-27, pp. 9–11 and Appendix p. A.1; published in Manufacturing & Service Operations Management, 2023. Manuscript; DOI.
5 thms2 active usersReviewed
🏆Completed
Convex OptimizationEconomics·Captain: mikedeng1

Aggregating Distributed Energy Resources: Efficiency and Market Power I: A Profit-Seeking Aggregator with Two-Part Pricing Attains the Benchmark Welfare, Dispatch and PricesResearch Paper

Motivation

Distributed energy resources (DERs) — rooftop solar, home batteries, electric vehicles — turn electricity consumers into prosumers who can both buy and sell power. Their individual capacities are far too small to bid in a wholesale electricity market directly, so regulators have opened these markets to DER aggregators, intermediaries that pool many small resources and trade on their behalf (FERC Order 2222, 2020). An aggregator is a monopolist toward the prosumers it serves, and a profit-seeking monopolist between a market and its suppliers ordinarily distorts quantities: with a single unit price, the aggregator buys less than the efficient amount, and social welfare falls (Alshehri, Ndrio, Bose, Başar 2019, 2020).

Gao, Alshehri and Birge ask whether this loss can be avoided without regulating the aggregator. Their answer is that it can, provided the aggregator uses two-part pricing: a participation fee plus a per-unit price. This mission formalizes that efficiency result.

Setting

A power network has a finite set KKK of nodes and a finite set LLL of transmission lines. The ISO chooses nodal net injections h∈RKh\in\mathbb R^Kh∈RK; the DC approximation of the AC network gives a matrix BBB and line capacities fff, and the network constraints are (5b): 1⊤h=0\mathbf 1^\top h=01⊤h=0 and Bh≤fBh\le fBh≤f.

A finite set III of prosumers sits at the nodes. Prosumer iii owns a DER capacity Ci≥0C_i\ge0Ci​≥0 and has a utility of consumption uiu_iui​ on [0,Z][0,Z][0,Z], Z>CiZ>C_iZ>Ci​. Assumption 1: uiu_iui​ is increasing, strictly concave and continuous on [0,Z][0,Z][0,Z], differentiable on (0,Z)(0,Z)(0,Z), with ui′(z)→∞u_i'(z)\to\inftyui′​(z)→∞ as z→0+z\to0^+z→0+ and ui′(z)→0u_i'(z)\to0ui′​(z)→0 as z→Z−z\to Z^-z→Z−. A finite set JJJ of conventional generators sits at the nodes; generator jjj produces yj∈[y‾j,y‾j]y_j\in[\underline y_j,\overline y_j]yj​∈[y​j​,y​j​] at cost cj(yj)c_j(y_j)cj​(yj​). Assumption 2: cjc_jcj​ is increasing, strictly convex and continuous on its interval, differentiable inside, with cj′→0c_j'\to0cj′​→0 at the lower end and cj′→∞c_j'\to\inftycj′​→∞ at the upper end.

Benchmark (direct participation). Prosumer iii sells xix_ixi​ and buys did_idi​ directly in the market at the locational price; only the net sale zi=xi−diz_i=x_i-d_izi​=xi​−di​ matters. Writing XkX^kXk, DkD^kDk, YkY^kYk for the nodal totals of sales, purchases and generation, the ISO solves the economic dispatch problem (9):

max⁡ WB=∑iui(Ci−zi)−∑jcj(yj)s.t. (5a) h=D−Y−X, (5b), (6) C−Z≤z≤C, y‾≤y≤y‾.\max\ \mathcal W_B=\sum_i u_i(C_i-z_i)-\sum_j c_j(y_j)\quad\text{s.t. (5a) } h=D-Y-X,\ \text{(5b)},\ \text{(6) } C-Z\le z\le C,\ \underline y\le y\le\overline y .max WB​=i∑​ui​(Ci​−zi​)−j∑​cj​(yj​)s.t. (5a) h=D−Y−X, (5b), (6) C−Z≤z≤C, y​≤y≤y​.

The wholesale prices λ∈RK\lambda\in\mathbb R^Kλ∈RK are the optimal Lagrange multipliers of the nodal balance constraints (5a).

Unregulated aggregation. Each prosumer sells only to the aggregator A\mathcal AA, which offers her a fee PiP_iPi​ and a unit price pip_ipi​. At wholesale price λ\lambdaλ she maximizes the payoff (10), pixi−Pi+ui(di+Ci−xi)−λdip_ix_i-P_i+u_i(d_i+C_i-x_i)-\lambda d_ipi​xi​−Pi​+ui​(di​+Ci​−xi​)−λdi​ if she sells xi>0x_i>0xi​>0 and ui(di+Ci)−λdiu_i(d_i+C_i)-\lambda d_iui​(di​+Ci​)−λdi​ otherwise, over xi∈[0,Ci]x_i\in[0,C_i]xi​∈[0,Ci​], di∈[0,Z−Ci+xi]d_i\in[0,Z-C_i+x_i]di​∈[0,Z−Ci​+xi​] (11). The aggregator earns (13) Pi1{xi>0}+(λ−pi)xiP_i\mathbf 1\{x_i>0\}+(\lambda-p_i)x_iPi​1{xi​>0}+(λ−pi​)xi​ and chooses nonnegative offers anticipating the responses: a Stackelberg game G(λ)\mathcal G(\lambda)G(λ) (Definition 1). The ISO now dispatches xxx and ddd separately, solving (21): maximize WA=∑iui(di+Ci−xi)−∑jcj(yj)\mathcal W_A=\sum_i u_i(d_i+C_i-x_i)-\sum_j c_j(y_j)WA​=∑i​ui​(di​+Ci​−xi​)−∑j​cj​(yj​) subject to (5a), (5b) and (18) 0≤x≤C0\le x\le C0≤x≤C, 0≤d≤Z−C+x0\le d\le Z-C+x0≤d≤Z−C+x, y‾≤y≤y‾\underline y\le y\le\overline yy​≤y≤y​; its wholesale prices are again the multipliers of (5a).

Formalization targets

Goal: Theorem 1 (p. 14)

Under Assumptions 1–3 (Assumption 3: (9) is feasible), with (h∗,z∗,y∗)(h^*,z^*,y^*)(h∗,z∗,y∗) the optimal solution of (9),

WA∗=WB∗,\mathcal W_A^*=\mathcal W_B^*,WA∗​=WB∗​,

every optimal solution of (21) has x−d=z∗x-d=z^*x−d=z∗, y=y∗y=y^*y=y∗, h=h∗h=h^*h=h∗, the split ([z∗]+,[−z∗]+)([z^*]^+,[-z^*]^+)([z∗]+,[−z∗]+) is optimal for (21), and a price vector is a multiplier of (5a) for (21) if and only if it is one for (9).

Milestones

  1. Lemmas 1 and 2 (pp. 5–6): a price-taking prosumer's problem (1) and generator's problem (3) have unique optima, characterized by u′(C−z∗)=λu'(C-z^*)=\lambdau′(C−z∗)=λ (2) and c′(y∗)=λc'(y^*)=\lambdac′(y∗)=λ (4).
  2. Proposition 1 (p. 8): (9) has a unique optimum, and at every multiplier vector of (5a) it is a competitive equilibrium.
  3. Lemma 3 (p. 10): the prosumer's optimal response to a two-part offer, in terms of u′(z1)=λu'(z_1)=\lambdau′(z1​)=λ, u′(z2)=pu'(z_2)=pu′(z2​)=p.
  4. Lemma 4 (p. 11): the aggregator's optimal offer is
p∗=λ,P∗=λ(C−z1)+u(z1)−u(C).p^*=\lambda,\qquad P^*=\lambda(C-z_1)+u(z_1)-u(C).p∗=λ,P∗=λ(C−z1​)+u(z1​)−u(C).
  1. Proposition 2 (p. 12): these offers form a Stackelberg equilibrium of G(λ)\mathcal G(\lambda)G(λ).
  2. Proposition 3 (p. 14): (21) has an optimum consistent with Lemmas 3, 4 and (4) at its multipliers.

Significance

The result. Theorem 1 shows that the efficiency loss attributed to profit-seeking aggregators is a consequence of one-part pricing, not of aggregation itself. With two-part pricing the aggregator passes the locational marginal price through as its unit price and extracts its profit only through participation fees, so welfare, dispatch and locational prices are exactly those of direct participation. The paper builds on this to analyse a regulated aggregator (§4) and the interaction of prosumer participation with generators' market power (§5, the companion mission of this series).

Formalizing it. The result is proved on paper, in a short argument relying on unstated conventions; no machine-checked version exists. A formal proof must make precise what "optimal Lagrange multiplier" means for a nonsmooth-at-the-boundary concave program on a network, handle the indicator in the prosumer's payoff (10) and the ties it creates, and settle the edge cases (nonpositive locational prices, capacity below the efficient consumption level) that the printed statements pass over.

Difficulty

The welfare identity is the easy part: the objective (20) and the balance (5a) of (21) depend on (x,d)(x,d)(x,d) only through x−dx-dx−d, and the box (18) projects onto the box (6). The work lies elsewhere. Price equality requires an argument about saddle points of the Lagrangian on two different domains, not just optimal values. The prosumer's two-part problem (11) is discontinuous at x=0x=0x=0 because of the fee, so its optimal responses must be found by comparing branches, and the aggregator's optimality in Lemma 4 must hold against every nonnegative offer — including unit prices above the wholesale price — and every optimal response to it, not a selected one. The first-order conditions (2) and (4) require interior optima, which follow from the derivative limits in Assumptions 1–2 but only at positive prices.

Formalization scope

Everything lives in the namespace DERAggregation.Unregulated, in one definition file Setting. Nodes, prosumers, generators and lines are finite types; the node of prosumer iii is loc i. All quantities are real. Optimality is "feasible and at least as good as every feasible point", never a supremum. A multiplier vector of (5a) is a saddle point of the partial Lagrangian: (5a) and (5b) are dualized (with ν≥0\nu\ge0ν≥0 and complementary slackness for Bh≤fBh\le fBh≤f), the participant box is kept as the domain, and hhh is free. Prices are never free variables and never defined by a closed form.

Assumptions 1–2 read "differentiable" as differentiable on the open interval and continuous on the closed one, since the derivative limits rule out differentiability at the endpoints; 0≤Ci0\le C_i0≤Ci​ and y‾j<y‾j\underline y_j<\overline y_jy​j​<y​j​ are added. Theorem 1 names no assumptions; it is stated under Assumptions 1–3. Problem (21) determines only x−dx-dx−d, so "the same x∗,d∗x^*,d^*x∗,d∗" is stated as equality of x−dx-dx−d plus optimality of the canonical split. The first-order conditions are stated at nodes with positive price, Lemma 3 adds P≥0P\ge0P≥0 and 0<p≤λ0<p\le\lambda0<p≤λ, and Lemma 4's second part adds the standing restriction p≤λp\le\lambdap≤λ; each addition is disclosed in its item. Problem (21) is written in the separate variables xxx and ddd with the constraint d≤Z−C+xd\le Z-C+xd≤Z−C+x exactly as printed: a formalization through z=x−dz=x-dz=x−d would make Theorem 1 true by unfolding and is ruled out.

The source is the authors' SSRN working paper (abstract 3931052, PDF of September 26, 2021); the published version in Manufacturing & Service Operations Management (2024) may number or state results differently. Useful contributions include the one-dimensional lemmas (unique maximizers of strictly concave functions with derivative limits at the endpoints), which are reusable well beyond this mission, and a general saddle-point lemma for separable concave programs with linear coupling constraints.

Selected references

  • Z. Gao, K. Alshehri, J. R. Birge, Aggregating Distributed Energy Resources: Efficiency and Market Power, working paper, SSRN abstract 3931052, 2021. https://ssrn.com/abstract=3931052 ; published in Manufacturing & Service Operations Management, 2024, https://doi.org/10.1287/msom.2021.0539
  • K. Alshehri, M. Ndrio, S. Bose, T. Başar, The impact of aggregating distributed energy resources on electricity market efficiency, 53rd Annual Conference on Information Sciences and Systems (CISS), IEEE, 2019, pp. 1–6.
  • K. Alshehri, M. Ndrio, S. Bose, T. Başar, Quantifying market efficiency impacts of aggregated distributed energy resources, IEEE Transactions on Power Systems 35(5), 2020, pp. 4067–4077.
  • Federal Energy Regulatory Commission, Participation of Distributed Energy Resource Aggregations in Markets Operated by Regional Transmission Organizations and Independent System Operators, Order No. 2222, 2020.
9 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization II: On Low-Moreishness, Near-Constant-Value Manifolds, Engagement Maximization Is Near-OptimalResearch Paper

Motivation

Recommender systems on online platforms are usually trained to maximize engagement: time spent, items consumed, sessions returned. The implicit justification is revealed preference: a user who consumes more must value the content more. Behavioural economics questions that inference when a person's choices are driven by two conflicting processes, a deliberate one that weighs long-run utility and an impulsive one that reacts to the item in front of it.

Kleinberg, Mullainathan and Raghavan (2023) build a minimal model of such a user and ask when engagement is a good proxy for utility. Their first characterization (Theorem 4.1, a separate mission) says that the engagement-maximizing content differs from the utility-maximizing content only through higher moreishness, or higher span with lower value. This mission formalizes the complementary positive result, Theorem 4.2: on a content manifold where no content is very moreish and all content has roughly equal value (a "salad"-like manifold), maximizing engagement loses only a small, explicitly bounded amount of user utility.

Setting

A content distribution is a triple ω=(p,q,vˉ)\omega=(p,q,\bar v)ω=(p,q,vˉ) in the parameter space

Ω=[0,1)×[0,1)×R+.\Omega=[0,1)\times[0,1)\times\mathbb R_+ .Ω=[0,1)×[0,1)×R+​.

The user consumes items one at a time. System 2, the deliberate agent, collects utility with mean vˉ\bar vvˉ per item while it is still interested, and pays an outside option W>0W>0W>0 per step spent on the platform. After each item system 2 stays interested with probability qqq, the span. System 1, the impulsive agent, is hooked by each item with probability ppp, the moreishness, and then consumes the next item without consulting system 2. Define

gS(ω)=vˉ−W1−q−pW1−p,gT(ω)=11−q+p1−p.g_S(\omega)=\frac{\bar v-W}{1-q}-\frac{pW}{1-p},\qquad g_T(\omega)=\frac{1}{1-q}+\frac{p}{1-p}.gS​(ω)=1−qvˉ−W​−1−ppW​,gT​(ω)=1−q1​+1−pp​.

System 2 visits the platform only if this is worthwhile, so its expected utility is equation (1),

E[S(ω)]=max⁡(gS(ω),0),\mathbb E[S(\omega)]=\max\bigl(g_S(\omega),0\bigr),E[S(ω)]=max(gS​(ω),0),

and the session length TTT is 000 when the user does not visit (gS(ω)<0g_S(\omega)<0gS​(ω)<0) and otherwise has expectation E[T(ω)]=gT(ω)\mathbb E[T(\omega)]=g_T(\omega)E[T(ω)]=gT​(ω), equation (2).

A platform chooses content from a content manifold M⊆Ω\mathcal M\subseteq\OmegaM⊆Ω, which the paper assumes contains a point with E[S]>0\mathbb E[S]>0E[S]>0. The utility maximizer ωS=(pS,qS,vˉS)\omega_S=(p_S,q_S,\bar v_S)ωS​=(pS​,qS​,vˉS​) maximizes gSg_SgS​ over M\mathcal MM (3). The engagement maximizer ωT=(pT,qT,vˉT)\omega_T=(p_T,q_T,\bar v_T)ωT​=(pT​,qT​,vˉT​) maximizes gTg_TgT​ over the points of M\mathcal MM at which the user participates, {ω∈M:gS(ω)≥0}\{\omega\in\mathcal M:g_S(\omega)\ge0\}{ω∈M:gS​(ω)≥0} (4). The proof uses ai=11−pia_i=\frac{1}{1-p_i}ai​=1−pi​1​ and bi=11−qib_i=\frac{1}{1-q_i}bi​=1−qi​1​ for i∈{S,T}i\in\{S,T\}i∈{S,T}, so that E[T(ωS)]=aS+bS−1\mathbb E[T(\omega_S)]=a_S+b_S-1E[T(ωS​)]=aS​+bS​−1.

Formalization targets

Goal: Theorem 4.2 (p. 17)

Suppose p≤α<1p\le\alpha<1p≤α<1 for every (p,q,vˉ)∈M(p,q,\bar v)\in\mathcal M(p,q,vˉ)∈M, and ∣vˉ−v0∣<β|\bar v-v_0|<\beta∣vˉ−v0​∣<β for every (p,q,vˉ)∈M(p,q,\bar v)\in\mathcal M(p,q,vˉ)∈M, for some v0v_0v0​. Then

E[S(ωT)] ≥ E[S(ωS)]−2β E[T(ωS)]−α(v0+β)1−α.\mathbb E[S(\omega_T)]\ \ge\ \mathbb E[S(\omega_S)]-2\beta\,\mathbb E[T(\omega_S)]-\frac{\alpha(v_0+\beta)}{1-\alpha}.E[S(ωT​)] ≥ E[S(ωS​)]−2βE[T(ωS​)]−1−αα(v0​+β)​.

Milestones (p. 18)

  1. Inequality (5): if gT(ωT)≥gT(ωS)g_T(\omega_T)\ge g_T(\omega_S)gT​(ωT​)≥gT​(ωS​), then bS−bT≤aT−aSb_S-b_T\le a_T-a_SbS​−bT​≤aT​−aS​.
  2. Inequality (7): if 0≤pi≤α<10\le p_i\le\alpha<10≤pi​≤α<1, then 1≤ai≤11−α1\le a_i\le\frac{1}{1-\alpha}1≤ai​≤1−α1​.
  3. The gap identity: when gS≥0g_S\ge0gS​≥0 at both points,
E[S(ωS)]−E[S(ωT)]=bS(vˉS−vˉT)+(bS−bT)(vˉT−W)+W(aT−aS).\mathbb E[S(\omega_S)]-\mathbb E[S(\omega_T)]=b_S(\bar v_S-\bar v_T)+(b_S-b_T)(\bar v_T-W)+W(a_T-a_S).E[S(ωS​)]−E[S(ωT​)]=bS​(vˉS​−vˉT​)+(bS​−bT​)(vˉT​−W)+W(aT​−aS​).

A supporting statement, implicit in the proof, is that participation gS(ω)≥0g_S(\omega)\ge0gS​(ω)≥0 at a point of Ω\OmegaΩ forces vˉ≥W\bar v\ge Wvˉ≥W.

Significance

The theorem is the paper's sufficient condition for engagement optimization to be benign. It is quantitative: the utility loss is linear in the value spread β\betaβ, scaled by the engagement E[T(ωS)]\mathbb E[T(\omega_S)]E[T(ωS​)] of the utility-optimal content, plus a term that vanishes as the moreishness bound α\alphaα goes to 000. The paper notes that the linear dependence on engagement is unavoidable, since a user can lose a constant utility per step when vˉT<vˉS\bar v_T<\bar v_SvˉT​<vˉS​. Together with Theorem 4.1 it delimits when a platform that observes only engagement can safely optimize it, and it motivates the paper's §5, on how a platform might learn which kind of manifold it is on.

The result is proved in the paper, with a short proof. As far as is known, neither the model nor the theorem has been machine-checked. The formalization fixes the participation convention for E[T]\mathbb E[T]E[T], the feasibility of ωS\omega_SωS​ in the engagement problem, and the implicit hypotheses listed below, which the printed proof uses without stating.

Difficulty

The algebra is elementary once the denominators are known to be positive. The difficulty lies in the bookkeeping the printed proof leaves implicit. Inequality (5) is derived from "E[T(ωT)]>E[T(ωS)]\mathbb E[T(\omega_T)]>\mathbb E[T(\omega_S)]E[T(ωT​)]>E[T(ωS​)]", but (4) only gives ≥\ge≥, and only once ωS\omega_SωS​ is shown feasible for (4), which needs gS(ωS)>0g_S(\omega_S)>0gS​(ωS​)>0, i.e. the standing assumption on M\mathcal MM. Multiplying (5) by vˉT−W\bar v_T-WvˉT​−W needs vˉT≥W\bar v_T\ge WvˉT​≥W, which follows from gS(ωT)≥0g_S(\omega_T)\ge0gS​(ωT​)≥0 and W>0W>0W>0. The bound on (aT−aS)vˉT(a_T-a_S)\bar v_T(aT​−aS​)vˉT​ splits on the sign of aT−aSa_T-a_SaT​−aS​, and uses α≥0\alpha\ge0α≥0 (from M≠∅\mathcal M\neq\emptysetM=∅) and v0+β>vˉT≥0v_0+\beta>\bar v_T\ge0v0​+β>vˉT​≥0. Finally, E[T(ωS)]\mathbb E[T(\omega_S)]E[T(ωS​)] must be identified with aS+bS−1a_S+b_S-1aS​+bS​−1 through participation at ωS\omega_SωS​. Using gTg_TgT​ in place of E[T]\mathbb E[T]E[T], or dropping the participation constraint from (4), changes the theorem.

Formalization scope

The Lean development lives in the namespace EngagementOpt.Salad and imports the frozen shared model in EngagementOpt.Misalign. There, a content distribution is a structure Params with real fields p, q, v; InOmega ω states 0≤p<10\le p<10≤p<1, 0≤q<10\le q<10≤q<1, 0≤vˉ0\le\bar v0≤vˉ. The shared functions gS W, gT and this chunk's ES W, ET W, aCoef, bCoef are as above, with ET W ω = if gS W ω < 0 then 0 else gT ω. The shared maximizer predicates IsUtilityMaximizer W M ωS (membership and IsMaxOn (gS W) M ωS) and IsEngagementMaximizer W M ωT (membership, 0 ≤ gS W ωT, and IsMaxOn gT {ω ∈ M | 0 ≤ gS W ω} ωT) hold for every maximizer, so the theorem holds for any tie-breaking rule. Closedness of M\mathcal MM only guarantees that maximizers exist and is not assumed. The goal's hypotheses are: W>0W>0W>0; M⊆Ω\mathcal M\subseteq\OmegaM⊆Ω; a point of M\mathcal MM with gS>0g_S>0gS​>0; the two maximizer predicates; α<1\alpha<1α<1 and p≤αp\le\alphap≤α on M\mathcal MM; and ∣vˉ−v0∣<β|\bar v-v_0|<\beta∣vˉ−v0​∣<β on M\mathcal MM for a given v0v_0v0​.

Three of these are implicit in the paper and are disclosed: W>0W>0W>0 (§2.1 normalizes W=1W=1W=1); α<1\alpha<1α<1, without which condition 1 is vacuous on Ω\OmegaΩ and the bound fails (Lean's x/0=0x/0=0x/0=0 would turn α=1\alpha=1α=1 into a false statement); and the standing assumption of p. 16. Neither 0≤α0\le\alpha0≤α nor 0<β0<\beta0<β is assumed; both follow from the hypotheses. Inequality (5) is posed with ≤\le≤ rather than the printed <<<, because only ≥\ge≥ is available from (4). The hypotheses are satisfiable: with W=1W=1W=1, M={(0,12,3),(12,12,3)}\mathcal M=\{(0,\tfrac12,3),(\tfrac12,\tfrac12,3)\}M={(0,21​,3),(21​,21​,3)}, α=12\alpha=\tfrac12α=21​, v0=3v_0=3v0​=3, β=0.1\beta=0.1β=0.1, the maximizers are ωS=(0,12,3)\omega_S=(0,\tfrac12,3)ωS​=(0,21​,3) and ωT=(12,12,3)\omega_T=(\tfrac12,\tfrac12,3)ωT​=(21​,21​,3), and the bound reads 3≥0.53\ge0.53≥0.5.

Everything needed is in Mathlib (real arithmetic, max, |·|, IsMaxOn). Proofs of the milestones and the goal are welcome; the base model module is shared with the Theorem 4.1 mission of the same paper.

Selected references

  • J. Kleinberg, S. Mullainathan, M. Raghavan, The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization, Management Science, 2023. DOI 10.1287/mnsc.2022.03683; read as arXiv:2202.11776v3.
  • G. S. Becker, K. M. Murphy, A Theory of Rational Addiction, Journal of Political Economy 96(4), 1988. DOI 10.1086/261558.
6 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Improving Access to Rare Disease Treatments: Subsidy, Pricing, and Payment Schemes I: With Manufacturer Pricing, Subsidize Only the Manufacturer; Outcome-Based Pay Raises the Price iff B < k − 1/8Research Paper

Motivation

Treatments for rare diseases can require substantial research and development spending while reaching a small patient population. A public subsidy can cover part of the manufacturer's development cost, part of the patient's price, or both. Which recipient should receive the subsidy depends on how the manufacturer responds. A further design choice is whether the manufacturer is paid when a drug is sold or only when treatment succeeds. Olsder, Martagan, and Tang formulate these choices as a sequential game between the government, a manufacturer, and patients in their SSRN working paper, §§3–4. This mission concerns their results for the case in which the manufacturer sets the price.

The paper reports that a manufacturer subsidy alone is optimal under either payment scheme and that the relative prices under the two schemes change with the government budget. The price comparison is useful because a payment contract intended to protect patients can change the price set by the manufacturer. The mission uses the working paper dated 2019-11-13. Its page and equation numbers are those of that version, which precedes the published article.

Setting

The government first chooses two subsidy shares: α∈[0,1)\alpha\in[0,1)α∈[0,1) covers the fraction α\alphaα of research cost and β∈[0,1)\beta\in[0,1)β∈[0,1) covers the fraction β\betaβ of the unit price paid on a patient's behalf. The manufacturer then chooses a nonnegative unit price ppp and a positive target efficacy eee. Research cost is ke2ke^2ke2, with k>0k>0k>0, so the manufacturer's effective cost is (1−α)ke2(1-\alpha)ke^2(1−α)ke2. The government has a budget B>0B>0B>0. The market size is one, and patient valuations are uniform on [0,1][0,1][0,1]; these conventions are given in §3.1–§3.2.

In Setting (1A) the manufacturer receives the price for every sale. Its profit is πA=p(1−(1−β)p/e)−(1−α)ke2\pi_A=p(1-(1-\beta)p/e)-(1-\alpha)ke^2πA​=p(1−(1−β)p/e)−(1−α)ke2. At price and efficacy (p,e)(p,e)(p,e), patient welfare is WA=(e−(1−β)p)2/(2e)W_A=(e-(1-\beta)p)^2/(2e)WA​=(e−(1−β)p)2/(2e), while government spending is MA=αke2+βp(1−(1−β)p/e)M_A=\alpha ke^2+\beta p(1-(1-\beta)p/e)MA​=αke2+βp(1−(1−β)p/e). These are the paper's equations (2), (3), and (5). In Setting (1B) payment occurs only if treatment succeeds. The corresponding expressions are πB=ep(1−(1−β)p)−(1−α)ke2\pi_B=ep(1-(1-\beta)p)-(1-\alpha)ke^2πB​=ep(1−(1−β)p)−(1−α)ke2, WB=e(1−(1−β)p)2/2W_B=e(1-(1-\beta)p)^2/2WB​=e(1−(1−β)p)2/2, and MB=αke2+eβp(1−(1−β)p)M_B=\alpha ke^2+e\beta p(1-(1-\beta)p)MB​=αke2+eβp(1−(1−β)p), from equations (7), (8), and (10) of the same source.

For each scheme, a manufacturer best response is a pair (p,e)(p,e)(p,e) maximizing that scheme's profit over all p≥0p\ge0p≥0, e>0e>0e>0. A government policy is optimal when it has a best response at which spending does not exceed BBB, and its patient welfare is at least the welfare of every feasible policy evaluated at every manufacturer best response. This expresses the government's leader role and the manufacturer's follower role in the game's sequence of events, rather than assigning the closed forms of §§4.1–4.2 to either player by definition.

Formalization targets

Government policy under each payment scheme

Proposition 1 of the working paper, p. 12, gives the unique optimal policy under sales-based payment. The paragraph after (16) on p. 13 says the same policy is optimal under outcome-based payment:

(α,β)=(α∗,0),α∗=1+128Bk−256Bk+1128Bk.(\alpha,\beta)=(\alpha^*,0),\qquad \alpha^*=\frac{1+128Bk-\sqrt{256Bk+1}}{128Bk}.(α,β)=(α∗,0),α∗=128Bk1+128Bk−256Bk+1​​.

The budget binds at this policy. In both settings the optimal patient welfare and the manufacturer's profit equal 2B/(256Bk+1−1)2B/(\sqrt{256Bk+1}-1)2B/(256Bk+1​−1). These policy claims, the two best-response formulas, and the two welfare and spending reductions form the six milestones.

Price comparison

Corollary 1 on p. 13 compares the manufacturer's optimal price in the two payment schemes. If pAp_ApA​ and pBp_BpB​ denote prices at optimal policies and best responses, the goal is the three-way statement

B<k−18⇒pA<pB,B=k−18⇒pA=pB,B>k−18⇒pA>pB.B<k-\tfrac18\Rightarrow p_A<p_B,\qquad B=k-\tfrac18\Rightarrow p_A=p_B,\qquad B>k-\tfrac18\Rightarrow p_A>p_B.B<k−81​⇒pA​<pB​,B=k−81​⇒pA​=pB​,B>k−81​⇒pA​>pB​.

The printed second clause uses B≥k−1/8B\ge k-1/8B≥k−1/8 and says “higher”; equality of the two prices at the threshold is a boundary slip. The formal target records equality separately and preserves the strict high-budget comparison.

Significance

The policy result identifies which subsidy reaches patients most effectively within this model: when the manufacturer sets the price, the government uses its entire budget on the manufacturer's development cost, regardless of whether payment is per sale or contingent on treatment success. The price result adds a distinct comparison. Equal optimal subsidies and equal patient welfare do not imply equal prices; the sign of the price difference depends on BBB relative to k−1/8k-1/8k−1/8. This distinction appears explicitly in the paper's discussion following Corollary 1, pp. 13–14.

The working paper proves these results mathematically. The mission's remaining work is to give machine-checked proofs for the game definitions, both best-response results, both welfare and spending reductions, the unique optimum, and the final price comparison. It does not assert that those proofs have already been formalized. The definitions of attained best response and government optimality can also support later analyses of different subsidy or payment rules.

Difficulty

The government cannot compare the two schemes by holding the manufacturer's choices fixed. The manufacturer optimizes both price and efficacy after observing the subsidy policy, and the two profit functions have different price terms. Even after determining each manufacturer's response, identical formulas for government welfare and spending do not themselves establish an attained and unique optimum on the continuous half-open policy region [0,1)2[0,1)^2[0,1)2. The price comparison then concerns the actual best-response prices at that optimum, including the threshold where the two prices coincide. These dependencies explain why the reduced expressions alone cannot serve as the definition of the game.

Formalization scope

Lean represents all parameters, policies, prices, efficacies, profit, welfare, and spending in R\mathbb RR. The policy predicate requires α,β∈[0,1)\alpha,\beta\in[0,1)α,β∈[0,1). Every theorem assumes k>0k>0k>0; the budget results also assume B>0B>0B>0. These positivity conditions make the paper's denominators meaningful and state its implicit economic regime. Prices chosen by the manufacturer satisfy p≥0p\ge0p≥0. Its efficacy choice satisfies e>0e>0e>0 and has no imposed upper bound of one: equations (3) and (8) maximize over eee, and in the high-budget part of Corollary 1 their optimizer can exceed one. This is a convention of the paper's algebraic model, even though efficacy is introduced as a probability.

The demand expressions used in the paper's equations are left unclipped. At the stated best responses, they lie in the relevant nonnegative range. Best responses are represented as sets of all maximizers, and the goal compares every response at every optimal policy. Government optimality requires a feasible best response and comparison with every feasible competing policy and response, so neither existence nor uniqueness is obtained from an empty set. In particular, the reduced welfare and budget formulas (13) and (16) are milestone conclusions, not definitions of government choice. Reusable contributions include real optimization arguments for joint price and efficacy maximization and for attained welfare maxima over subsidy policies.

Selected references

  • W. Olsder, T. Martagan, and C. S. Tang, Improving Access to Rare Disease Treatments: Optimal Subsidies, Pricing, and Payment, SSRN working paper 3481150, version of 2019-11-13, §§3–4, pp. 8–14. SSRN.
  • W. Olsder, T. Martagan, and C. S. Tang, Improving Access to Rare Disease Treatments: Subsidy, Pricing, and Payment Schemes, Management Science, 2023. DOI: 10.1287/mnsc.2022.4634.
8 thms2 active usersReviewed
🏆Completed
OptimizationStatistics·Captain: mikedeng1

The Risk of Expected Utility Under Parameter Uncertainty II: The Robust Shrinkage Intensity Lies Between the Variance-Minimizing and Mean-Maximizing Intensities and Tends to OneResearch Paper

Why parameter uncertainty changes portfolio choice

An investor selecting a portfolio from estimated returns faces two distinct outcomes: the average utility the chosen rule delivers across possible historical samples, and the variation of that utility from one sample to another. A portfolio rule can perform well on average while being sensitive to the particular observations used to estimate it. Lassance, Martín-Utrera, and Simaan quantify this sensitivity for portfolios estimated from Gaussian returns and propose a mean-risk criterion that penalizes the standard deviation of out-of-sample utility (OOSU). This mission concerns the shrinkage intensity that maximizes that criterion. Its source is the authors' SSRN manuscript dated August 18, 2023, including the Internet Appendix; page labels IA1–IA45 refer to that appendix.

The paper's Proposition 1 provides an exact finite-sample variance for OOSU, and Proposition IA.1 restates a closed-form OOSU mean from Kan, Wang, and Zhou. Those formulas make it possible to compare choices that maximize average utility, minimize utility variance, or balance the two. Proposition 4 characterizes the balancing choice without fixing the risk weight to a particular numerical calibration. Lassance, Martín-Utrera, and Simaan, §§4–5 and Internet Appendix IA.1.

The market and the shrinkage rule

There are NNN risky stocks. Their excess-return vector has population mean μ\muμ and positive-definite covariance matrix Σ\SigmaΣ. An investor with risk-aversion coefficient γ>0\gamma>0γ>0 holds weights www summing to one and evaluates their mean-variance utility as U(w)=w⊤μ−(γ/2)w⊤ΣwU(w)=w^\top\mu-(\gamma/2)w^\top\Sigma wU(w)=w⊤μ−(γ/2)w⊤Σw. The population global-minimum-variance portfolio has mean μg\mu_gμg​ and variance σg2>0\sigma_g^2>0σg2​>0. The zero-cost portfolio that accounts for mean-return opportunities has return variance ψ2≥0\psi^2\geq0ψ2≥0. These constants are defined from μ\muμ and Σ\SigmaΣ in equations (5)–(7). Source, §3.1.

From TTT independent Gaussian observations, the investor estimates the mean and covariance, using a 1/T1/T1/T factor in the sample covariance. The sample mean-variance portfolio and sample global-minimum-variance portfolio are mixed using an intensity κ∈[0,1]\kappa\in[0,1]κ∈[0,1]: κ=0\kappa=0κ=0 selects the latter and κ=1\kappa=1κ=1 the former. Because the data are random, this portfolio's OOSU is random. Let ET(κ)E_T(\kappa)ET​(κ) and VT(κ)V_T(\kappa)VT​(κ) denote its OOSU mean and variance. In this mission they are the exact analytic expressions in (IA1)–(IA2) and (13)–(19), respectively. The formulas depend on N,T,γ,μg,σg2,ψ2N,T,\gamma,\mu_g,\sigma_g^2,\psi^2N,T,γ,μg​,σg2​,ψ2, and κ\kappaκ; the variance formula is a fourth-degree polynomial in κ\kappaκ. Source, §§3.2–4.1 and Appendix IA.1.

For a fixed robustness weight λ≥0\lambda\geq0λ≥0, the mean-risk OOSU is

RT(κ)=ET(κ)−λVT(κ).R_T(\kappa)=E_T(\kappa)-\lambda\sqrt{V_T(\kappa)}.RT​(κ)=ET​(κ)−λVT​(κ)​.

The robust intensity κR\kappa_RκR​ maximizes RTR_TRT​ on [0,1][0,1][0,1]. A variance-minimizing intensity is denoted κV\kappa_VκV​, while κE(T)\kappa_E(T)κE​(T) maximizes ETE_TET​ and has the explicit form (IA3). The sample-size condition throughout finite-sample claims is N≥2N\geq2N≥2 and T>N+7T>N+7T>N+7. Source, Assumption 1 and equations (20)–(21).

Formalization targets

The main target is Proposition 4. For every finite sample size allowed by Assumption 1, maximizers of RTR_TRT​ and minimizers of VTV_TVT​ exist, and every such pair obeys

κV≤κR≤κE(T).\kappa_V\leq\kappa_R\leq\kappa_E(T).κV​≤κR​≤κE​(T).

When ψ2>0\psi^2>0ψ2>0, every sequence of robust maximizers for increasing TTT also obeys

lim⁡T→∞κR(T)=1.\lim_{T\to\infty}\kappa_R(T)=1.T→∞lim​κR​(T)=1.

The ordered milestones establish that κE(T)\kappa_E(T)κE​(T) is the OOSU mean maximizer and lies in [0,1][0,1][0,1]; that it tends to one for ψ2>0\psi^2>0ψ2>0; that OOSU variance decreases with sample size and tends to zero for each fixed admissible κ\kappaκ; and that variance is nondecreasing as κ\kappaκ rises from κE(T)\kappa_E(T)κE​(T) to one. The last milestone isolates the shrinkage-intensity clause of Proposition 2(2). Source, Proposition IA.1, Proposition 2, and Proposition 4.

What the result supplies

The inequality puts the risk-balanced choice on a single interval with two interpretable endpoints. A user of the model can compare robust allocations with the mean-optimal and variance-optimal portfolios without solving an unconstrained optimization problem over all intensities. The asymptotic statement says that, for fixed market parameters and positive ψ2\psi^2ψ2, any robust choice approaches the sample mean-variance endpoint as the historical sample grows. The theorem itself is proved in the manuscript; this mission asks for machine-checked statements and proofs of that known result, not for a new mathematical claim. Source, §5.2 and proof of Proposition 4, pp. IA44–IA45.

Formalizing the closed-form analysis also produces reusable tools for optimizing a polynomial mean and a polynomial variance under a square-root risk penalty on a compact interval. The supporting items separate the paper's exact formulas from the statements about their extrema and limits. The probabilistic derivation of the variance is the target of the separate Proposition 1 mission; the closed-form identities here let this mission focus on the optimizer comparison. No proof of this mission's goal is claimed to be machine checked yet.

The central difficulty

The mean has a transparent quadratic maximum, but the variance is a fourth-degree expression whose coefficients are rational functions of T,N,γ,σg2,T,N,\gamma,\sigma_g^2,T,N,γ,σg2​, and ψ2\psi^2ψ2. A direct comparison of objective values at arbitrary intensities does not expose the ordering of all possible extrema. Moreover, the risk penalty uses VT\sqrt{V_T}VT​​, so its behavior cannot be inferred from the mean and variance formulas by treating the penalty as VTV_TVT​ itself. The sample-size limit concerns every sequence of optimizers, while the variance milestone gives a pointwise limit for each fixed κ\kappaκ; relating the two requires control over the entire admissible interval. Source, Proposition 1 and proof of Proposition 4.

Formalization scope

Lean stores NNN and TTT as natural numbers and casts them to real numbers before every subtraction in the rational formulas. A fixed parameter structure holds N,γ,σg2,ψ2,μg,N,\gamma,\sigma_g^2,\psi^2,\mu_g,N,γ,σg2​,ψ2,μg​, and λ\lambdaλ; TTT remains an argument so that limits as T→∞T\to\inftyT→∞ keep the other parameters fixed. The standing predicate requires N≥2N\geq2N≥2, γ>0\gamma>0γ>0, σg2>0\sigma_g^2>0σg2​>0, ψ2≥0\psi^2\geq0ψ2≥0, and λ≥0\lambda\geq0λ≥0. Individual finite-sample statements require T>N+7T>N+7T>N+7. The positivity and nonnegativity of the population variances come from positive definiteness of Σ\SigmaΣ; the Gaussian sampling model is what identifies the closed forms as actual OOSU moments in Proposition 1 and Proposition IA.1.

The variance function is the exact sum of (14) and the polynomial (15) with coefficients (16)–(19), including the displayed polynomial C(T,N,ψ2)C(T,N,\psi^2)C(T,N,ψ2). The mean function is (IA1)–(IA2); κE(T)\kappa_E(T)κE​(T) is (IA3); and the robustness function uses Real.sqrt of the variance, exactly as (20) requires. Extrema are taken on Set.Icc 0 1, with explicit existence and quantification over every optimizer. The goal does not choose a convenient maximizer or rely on a potentially empty optimizer set. The added ψ2>0\psi^2>0ψ2>0 condition appears only in the two limit statements, since at ψ2=0\psi^2=0ψ2=0 the printed limits fail. The manuscript's claim that the underlying estimated portfolio is consistent is outside this closed-form model, which does not contain that random portfolio.

The complete development needs real polynomial and rational inequalities, continuity and extrema on compact intervals, and limits of the coefficient functions. These tools can serve other mean-risk optimization problems. Contributions that close the four cited milestones or supply reusable analytic lemmas for them fit this mission. The paper's monotonicity claim in the stock count NNN is excluded because it is false for some admissible parameters; its variance and zero-cost-variance clauses are outside the focused milestone list. Source, Proposition 2(2) and proof, pp. 16 and IA39–IA44.

Selected references

  • N. Lassance, A. Martín-Utrera, and M. Simaan, The Risk of Expected Utility under Parameter Uncertainty, authors' SSRN manuscript dated August 18, 2023, later published in Management Science (2024). SSRN 3855546; DOI 10.1287/mnsc.2023.00178.
  • R. Kan, X. Wang, and G. Zhou, Optimal Portfolio Choice with Estimation Risk: No Risk-Free Asset Case, Management Science 68(3), 2047–2068 (2022). DOI 10.1287/mnsc.2021.3989.
6 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization I: Engagement Beats Utility Only Through Higher Moreishness, or Higher Span with Lower ValueResearch Paper

Why engagement is not utility

Online platforms rank content by what they can measure: clicks, watch time, session length. The implicit justification is revealed preference: if users stay longer, they must like what they see. Kleinberg, Mullainathan and Raghavan (arXiv:2202.11776v3, Management Science 2023, doi:10.1287/mnsc.2022.03683) question this justification with a model of a user whose preferences are internally inconsistent, in the tradition of dual-process models of choice. Within the model, an engagement-maximizing platform can serve content that lowers the user's welfare, and the paper asks exactly when this happens. This mission formalizes its first characterization result, Theorem 4.1 (p. 16).

The model

A user consumes a stream of items t=0,1,2,…t=0,1,2,\dotst=0,1,2,… and is a composite of two agents (§2.1, pp. 5–8).

  • System 2 is forward-looking. Each consumed item gives it a random value with mean vˉ\bar vvˉ, while leaving the platform gives an outside option WWW per step. After each item, system 2 still wants to continue with probability qqq, and otherwise it is "done" for the rest of the session.
  • System 1 is impulsive. With probability ppp it is hooked by the current item and consumes the next one without consulting system 2.

A content distribution is the triple ω=(p,q,vˉ)\omega=(p,q,\bar v)ω=(p,q,vˉ), read as moreishness ppp, span qqq and value vˉ\bar vvˉ. The parameter space is (p. 15)

Ω=[0,1)×[0,1)×R+.\Omega=[0,1)\times[0,1)\times\mathbb R_+ .Ω=[0,1)×[0,1)×R+​.

The content a platform can offer forms a content manifold M⊆Ω\mathcal M\subseteq\OmegaM⊆Ω.

Summing system 2's utility over the two phases of a session (before and after system 2 is done) gives, when the user participates,

gS(ω)=vˉ−W1−q−pW1−p,gT(ω)=11−q+p1−pg_S(\omega)=\frac{\bar v-W}{1-q}-\frac{pW}{1-p},\qquad g_T(\omega)=\frac{1}{1-q}+\frac{p}{1-p}gS​(ω)=1−qvˉ−W​−1−ppW​,gT​(ω)=1−q1​+1−pp​

(p. 16). Here gSg_SgS​ is system 2's expected utility E[S]=max⁡(gS,0)\mathbb E[S]=\max(g_S,0)E[S]=max(gS​,0) (equation (1), p. 7) and gTg_TgT​ is the expected session length E[T]\mathbb E[T]E[T] (equation (2), p. 8). The user stays away when gS(ω)<0g_S(\omega)<0gS​(ω)<0, and then T=0T=0T=0.

Write ωS=(pS,qS,vˉS)\omega_S=(p_S,q_S,\bar v_S)ωS​=(pS​,qS​,vˉS​) and ωT=(pT,qT,vˉT)\omega_T=(p_T,q_T,\bar v_T)ωT​=(pT​,qT​,vˉT​) for the utility and engagement maximizers (p. 16):

ωS∈arg⁡max⁡ω∈MgS(ω)(3),ωT∈arg⁡max⁡ω∈M, gS(ω)≥0gT(ω)(4).\omega_S\in\arg\max_{\omega\in\mathcal M} g_S(\omega)\quad(3),\qquad \omega_T\in\arg\max_{\omega\in\mathcal M,\ g_S(\omega)\ge0} g_T(\omega)\quad(4).ωS​∈argω∈Mmax​gS​(ω)(3),ωT​∈argω∈M, gS​(ω)≥0max​gT​(ω)(4).

The platform observes only engagement, so it serves ωT\omega_TωT​, and only among content the user is willing to consume. The paper assumes that M\mathcal MM contains at least one point with gS>0g_S>0gS​>0.

Formalization targets

Goal: Theorem 4.1 (p. 16)

Suppose ωS≠ωT\omega_S\neq\omega_TωS​=ωT​ and the disagreement is strict, gS(ωS)>gS(ωT)g_S(\omega_S)>g_S(\omega_T)gS​(ωS​)>gS​(ωT​) and gT(ωT)>gT(ωS)g_T(\omega_T)>g_T(\omega_S)gT​(ωT​)>gT​(ωS​). Then

pT>pSor(qT>qS  and  vˉT<vˉS).p_T>p_S\qquad\text{or}\qquad\bigl(q_T>q_S\ \text{ and }\ \bar v_T<\bar v_S\bigr).pT​>pS​or(qT​>qS​  and  vˉT​<vˉS​).

Milestones (the two steps of the printed proof)

  1. Proof of Theorem 4.1, p. 16: for ωS,ωT∈Ω\omega_S,\omega_T\in\OmegaωS​,ωT​∈Ω, if pT≤pSp_T\le p_SpT​≤pS​ and gT(ωT)>gT(ωS)g_T(\omega_T)>g_T(\omega_S)gT​(ωT​)>gT​(ωS​), then qT>qSq_T>q_SqT​>qS​.
  2. Proof of Theorem 4.1, p. 17: for ωS,ωT∈Ω\omega_S,\omega_T\in\OmegaωS​,ωT​∈Ω and W>0W>0W>0, if pT≤pSp_T\le p_SpT​≤pS​, qT>qSq_T>q_SqT​>qS​, gS(ωS)>gS(ωT)g_S(\omega_S)>g_S(\omega_T)gS​(ωS​)>gS​(ωT​) and gS(ωT)≥0g_S(\omega_T)\ge0gS​(ωT​)≥0, then vˉT<vˉS\bar v_T<\bar v_SvˉT​<vˉS​.

A supporting item, not a milestone: for ω∈Ω\omega\in\Omegaω∈Ω and W>0W>0W>0, gS(ω)≥0g_S(\omega)\ge0gS​(ω)≥0 implies vˉ≥W\bar v\ge Wvˉ≥W.

Significance

The theorem names the only two ways an engagement maximizer can do worse for the user than a utility maximizer. Either the content is more habit-forming (it raises system 1's grip), or it keeps system 2 interested for longer while delivering less per item, as when a long series of instructional videos replaces a short one. A platform that wants to diagnose misalignment therefore needs to look at moreishness and at the span–value trade-off, and at nothing else. The companion result of the paper (Theorem 4.2, a separate mission) turns this around: when moreishness is small and value nearly constant across M\mathcal MM, engagement maximization is near-optimal.

The result is proved in the paper by a few lines of algebra. No machine-checked version of it was found on Prove2Me or in Mathlib. Formalizing it pins down what the printed proof leaves implicit: the step from vˉT−W1−qT\frac{\bar v_T-W}{1-q_T}1−qT​vˉT​−W​ to vˉT−W1−qS\frac{\bar v_T-W}{1-q_S}1−qS​vˉT​−W​ on p. 17 is valid only because vˉT≥W\bar v_T\ge WvˉT​≥W, which follows from the participation constraint of (4). The mission also provides a reusable encoding of the paper's model (Ω, gSg_SgS​, gTg_TgT​, (3), (4)).

Difficulty

The mathematics is elementary. What makes the statement delicate is its hypotheses. If the participation constraint gS(ωT)≥0g_S(\omega_T)\ge0gS​(ωT​)≥0 is dropped from (4) together with the standing assumption that M\mathcal MM contains a point with gS>0g_S>0gS​>0, the theorem is false. With W=1W=1W=1 and M={(0,0,12),(0,12,12)}\mathcal M=\{(0,0,\tfrac12),(0,\tfrac12,\tfrac12)\}M={(0,0,21​),(0,21​,21​)}, the first point maximizes gSg_SgS​ and the second maximizes gTg_TgT​, the disagreement is strict, yet pT=pSp_T=p_SpT​=pS​ and vˉT=vˉS\bar v_T=\bar v_SvˉT​=vˉS​. The obvious reading of the second step, "a larger qqq shrinks the denominator", fails when vˉT<W\bar v_T<WvˉT​<W, because the numerator is then negative.

Formalization scope

  • A content distribution is a structure Params with three real fields p, q, v (for vˉ\bar vvˉ). Membership in Ω\OmegaΩ is the predicate InOmega: 0≤p<10\le p<10≤p<1, 0≤q<10\le q<10≤q<1, 0≤vˉ0\le\bar v0≤vˉ. Every theorem requires it of the points it uses, because Lean's division gives x/0=0x/0=0x/0=0 and gSg_SgS​, gTg_TgT​ would take junk values at p=1p=1p=1 or q=1q=1q=1.
  • The outside option WWW is a real parameter with the added hypothesis W>0W>0W>0. The paper sets W=1W=1W=1 "without loss of generality" (p. 5) but keeps WWW in its formulas, and the proof uses W>0W>0W>0.
  • (3) and (4) are the predicates IsUtilityMaximizer and IsEngagementMaximizer, built from Mathlib's IsMaxOn. ωS\omega_SωS​ maximizes over all of M\mathcal MM; ωT\omega_TωT​ lies in M\mathcal MM, satisfies gS(ωT)≥0g_S(\omega_T)\ge0gS​(ωT​)≥0, and maximizes gTg_TgT​ over {ω∈M:gS(ω)≥0}\{\omega\in\mathcal M:g_S(\omega)\ge0\}{ω∈M:gS​(ω)≥0}. The theorem holds for every pair of maximizers, which is stronger than the paper's "ties broken consistently" and needs no tie-breaking rule.
  • The paper's closedness of M\mathcal MM only guarantees that the maximizers exist. Since the theorem assumes them, closedness is not required.
  • The standing assumption "M\mathcal MM contains at least one point with strictly positive E[S]\mathbb E[S]E[S]" is kept as a hypothesis, as printed, although the proof does not need it once gS(ωT)≥0g_S(\omega_T)\ge0gS​(ωT​)≥0 is part of (4).
  • "One of the following conditions must hold" is an inclusive or.
  • A trivializing formalization would drop the participation constraint from (4) (the statement is then false), or replace (4) by maximization over a set that may be empty; both are ruled out by IsEngagementMaximizer, which requires ωT\omega_TωT​ itself to be feasible.
  • No library beyond Mathlib's real arithmetic is needed. Proofs of the milestones and the goal are welcome; the definitions are shared in spirit with mission II of this series, which keeps its own copy.

Selected references

  • J. Kleinberg, S. Mullainathan, M. Raghavan, The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization, arXiv:2202.11776v3, 2023. https://arxiv.org/abs/2202.11776
  • Same paper, Management Science, 2023. https://doi.org/10.1287/mnsc.2022.03683
4 thms2 active usersReviewed
🏆Completed
AnalysisStochastic Systems·Captain: mikedeng1

Provably Good Region Partitioning for On-Time Last-Mile Delivery II: An ε-Equitable Partition Keeps Each Subregion's Delivery Time Within 4η/(1−η)² of OptimalResearch Paper

Motivation

A delivery company can assign each driver a permanent district instead of allowing every driver to serve the whole city. This makes dispatching simpler, but it raises a service question: if the districts receive almost equal shares of demand and travel workload, how different can their expected delivery times be? Carlsson, Liu, Salari and Yu study this question for a region partitioning policy in which one vehicle serves each district. Their Proposition 3 gives an explicit error bound for a partition whose shares are accurate within a tolerance ε. The proposition complements their exact equitability result, Theorem 6, by quantifying the effect of a partition that can only be computed approximately.

Setting

The service region R is a compact convex subset of the Euclidean plane, with depot x₀ ∈ R. Orders arrive at a rate λ and have locations distributed with density f on R. The density is nonnegative, Lipschitz on R, and normalized by ∫_R f(x) dx = 1. There are m ≥ 1 identical vehicles, each with speed v > 0 and capacity q ≥ 1. An order requires a mean on site service time s̄ ≥ 0. The positive constant β is the geometric constant in the paper's heavy traffic delivery time expression. A partition R₁, …, R_m covers R, with districts disjoint up to area zero; vehicle i serves R_i.

For a measurable district S, let p(S) = ∫_S f(x) dx be its share of demand. Its arrival rate is λ_S = λp(S), and its conditional density is f_S(x) = f(x)/p(S) when p(S) > 0. The paper uses two partition measures:

μ1(S)=∫Sf(x) dx,μ2(S)=∫S(sˉvq+2∥x−x0∥)f(x) dx.\mu_1(S)=\int_S\sqrt{f(x)}\,dx,\qquad \mu_2(S)=\int_S(\bar s vq+2\lVert x-x_0\rVert)f(x)\,dx.μ1​(S)=∫S​f(x)​dx,μ2​(S)=∫S​(sˉvq+2∥x−x0​∥)f(x)dx.

The first controls the leading travel term. The second combines service time and radial travel from the depot. A partition is ε equitable when, for every district i and each j ∈ {1,2}, the difference between μ_j(R_i) and μ_j(R)/m has absolute value at most ε.

For vehicle count k, arrival rate a, region S, and density g, write the workload factor as

W(k,a,S,g)=asˉk+2akvq∫S∥x−x0∥g(x) dx.W(k,a,S,g)=\frac{a\bar s}{k} +\frac{2a}{kvq}\int_S\lVert x-x_0\rVert g(x)\,dx.W(k,a,S,g)=kasˉ​+kvq2a​∫S​∥x−x0​∥g(x)dx.

The heavy traffic expression from the paper's Theorem 3 is

L(k,a,S,g)=β2a(1−1/q)2[∫Sg(x) dx]22k2v2(1−W(k,a,S,g))2.L(k,a,S,g)=\frac{\beta^2a(1-1/q)^2 \left[\int_S\sqrt{g(x)}\,dx\right]^2} {2k^2v^2(1-W(k,a,S,g))^2}.L(k,a,S,g)=2k2v2(1−W(k,a,S,g))2β2a(1−1/q)2[∫S​g(x)​dx]2​.

The comparison value is L* = L(m,λ,R,f). For district i, the value L_i = L(1,λ_{R_i},R_i,f_{R_i}) uses that district's own arrival rate, density, and workload factor.

Formalization targets

Proposition 3: approximate districts

For λ > 0 with W(m,λ,R,f) < 1, ε ≥ 0, and an ε equitable partition, define the corrected tolerance factor

η=εmin⁡{μ1(R)/m,  vqλ(1−λμ2(R)mvq)}.\eta=\frac{\varepsilon}{ \min\left\{\mu_1(R)/m,\; \frac{vq}{\lambda}\left(1-\frac{\lambda\mu_2(R)}{mvq}\right) \right\}}.η=min{μ1​(R)/m,λvq​(1−mvqλμ2​(R)​)}ε​.

When η < 1, the target is the two sided estimate

∣Li−L∗∣≤4η(1−η)2L∗for every i.\lvert L_i-L^*\rvert\le \frac{4\eta}{(1-\eta)^2}L^* \qquad\text{for every }i.∣Li​−L∗∣≤(1−η)24η​L∗for every i.

The first milestone rewrites each district's Theorem 3 expression using μ₁(R_i) and μ₂(R_i). The next two milestones give upper and lower comparisons with L*. The final algebraic milestone evaluates the larger of the two relative deviations. These are the displayed steps on the paper's e companion pages ec6 and ec12–ec13.

The printed Proposition 3 uses max in the denominator defining η. Its proof requires min: when the two entries are 1 and 100 and ε = 0.1, a district can have L_i/L* = (1.1/0.999)² ≈ 1.212, while the printed η = 0.001 permits a deviation of only about 0.004. The correction is recorded in the theorem statements and audit notes.

Significance

The bound makes partition accuracy interpretable as a service guarantee. Once both shares are close enough that η < 1, every district's leading delivery time lies in a controlled interval around the flexible policy's benchmark. It states a guarantee for each district, rather than just for a demand weighted average, so it addresses unequal service across the region.

The authors prove the displayed comparison in their accepted manuscript. This mission formalizes the comparison between explicit heavy traffic expressions; it does not claim a new queueing theorem or a machine checked proof of the stochastic model. The reusable output is a precise Lean interface for spatial demand integrals, workload, conditional district densities, and perturbation bounds involving both numerator and denominator errors. The theorem items are proof targets.

Difficulty

The denominator responds to the μ₂ error in the opposite direction from the numerator's response to the μ₁ error. Bounding their ratio requires both the district workload and the lower numerator estimate to stay in their proper sign ranges. Simply squaring the ε share inequalities is invalid until those signs are known. The condition η < 1 supplies the required room; it also rules out a zero probability district under the other hypotheses. The printed choice of max for η fails to control the error in whichever of the two scales is smaller.

Formalization scope

Lean uses EuclideanSpace ℝ (Fin 2), Lebesgue set integrals, and real valued leading terms. The density, region, depot, fleet parameters, and positive β are fixed while λ and ε vary. The source's compactness, convexity, Lipschitz density, normalization, positive vehicle count, speed, and capacity, and nonnegative mean service time are included in a single standing predicate. A partition has null measurable pieces, pairwise disjoint almost everywhere, and exact union R; shared district boundaries have area zero. The goal also states λ > 0, global workload < 1, ε ≥ 0, and η < 1, matching the stable regime and the proof's small ε condition. Capacity q = 1 remains admitted: both leading terms then vanish and the inequality still holds.

The stochastic renewal arrivals, routing policy, and queueing process are outside this development. Theorem 3 supplies the paper's leading expression, applied separately to the full region and each district. Thus L_i and L* here are leading expressions at one fixed λ, not the underlying expected delivery time functions. A fixed positive ε makes η grow near the heavy traffic boundary, so the page's parenthetical “in heavy traffic” is read through the leading expressions used by its proof. The district value is formed from λ_{R_i} and f_{R_i}; it is not defined from the global benchmark or from the right hand side of the first milestone.

A complete proof will need standard facts about set integrals and square roots, the normalization of a conditional density, and inequalities for positive real denominators. The setting definitions can support other region partition comparisons. Contributions establishing these identities and the upper and lower estimates are welcome.

Selected references

  • J. G. Carlsson, S. Liu, N. Salari, and H. Yu, Provably Good Region Partitioning for On-Time Last-Mile Delivery, accepted manuscript, SSRN 3915544; published in Operations Research 72(1), 91–109 (2024), DOI: 10.1287/opre.2021.0588. Proposition 3, printed p. 21; proofs on pp. ec6 and ec12–ec13.
  • D. J. Bertsimas and G. J. van Ryzin, Stochastic and Dynamic Vehicle Routing with General Demand and Interarrival Time Distributions, Advances in Applied Probability 25(4), 947–978 (1993), DOI: 10.2307/1427801. Source of the heavy traffic expression cited as Theorem 3 in the Carlsson et al. manuscript.
7 thms2 active usersReviewed
🏆Completed
AnalysisEconomicsProbability·Captain: mikedeng1

The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization III: Whether Utility Rises with Session Length Is Decided by Span Versus MoreishnessResearch Paper

Motivation

Platforms that rank content by engagement (time spent, items consumed) implicitly assume revealed preference: a user who stays longer is a user who is better off. Kleinberg, Mullainathan and Raghavan (arXiv:2202.11776, Management Science 2023, doi:10.1287/mnsc.2022.03683) model a user with inconsistent preferences, a forward-looking system 2 and an impulsive system 1, and show that engagement and utility can come apart. Because utility cannot be read off behavioural data, platforms also run post-session surveys. Section 5.1 of the paper asks what such surveys can reveal: if a survey gives an estimate of the utility SSS of a session, does E[S∣T=t]\mathbb E[S\mid T=t]E[S∣T=t] rise or fall with the session length ttt, and what does that say about the content? Theorem 5.1 answers this in terms of two content parameters, the span qqq and the moreishness ppp.

Setting

A session proceeds in two phases (§2.1, pp. 5–7).

  • Span. After each item, system 2 remains interested with probability qqq. The number of items it enjoys, TqT_qTq​, has the geometric law on {1,2,… }\{1,2,\dots\}{1,2,…}: Pr⁡[Tq=τ]=qτ−1(1−q)\Pr[T_q=\tau]=q^{\tau-1}(1-q)Pr[Tq​=τ]=qτ−1(1−q).
  • Moreishness. Once system 2 is done, system 1 keeps the user on: with probability ppp at each step, the first one included, it consumes one more item. With Tp:=T−Tq+1T_p:=T-T_q+1Tp​:=T−Tq​+1, Pr⁡[Tp=k]=pk−1(1−p)\Pr[T_p=k]=p^{k-1}(1-p)Pr[Tp​=k]=pk−1(1−p) for k≥1k\ge1k≥1.
  • TqT_qTq​ and TpT_pTp​ are independent, and the session length is T=Tq+Tp−1∈{1,2,… }T=T_q+T_p-1\in\{1,2,\dots\}T=Tq​+Tp​−1∈{1,2,…}. For 1≤τ≤t1\le\tau\le t1≤τ≤t,
Pr⁡[Tq=τ∩Tp=t−τ+1]=qτ−1(1−q) pt−τ(1−p).\Pr[T_q=\tau\cap T_p=t-\tau+1]=q^{\tau-1}(1-q)\,p^{t-\tau}(1-p).Pr[Tq​=τ∩Tp​=t−τ+1]=qτ−1(1−q)pt−τ(1−p).
  • Utility. Each item system 2 enjoys has value of mean vˉ\bar vvˉ; every step costs the outside option WWW. The paper's equations (8)–(9) give
E[S∣T=t]=vˉ E[Tq∣T=t]−Wt,E[Tq∣T=t]=∑τ=1tτPr⁡[Tq=τ∩Tp=t−τ+1]∑τ′=1tPr⁡[Tq=τ′∩Tp=t−τ′+1].\mathbb E[S\mid T=t]=\bar v\,\mathbb E[T_q\mid T=t]-Wt,\qquad \mathbb E[T_q\mid T=t]=\frac{\sum_{\tau=1}^{t}\tau\Pr[T_q=\tau\cap T_p=t-\tau+1]}{\sum_{\tau'=1}^{t}\Pr[T_q=\tau'\cap T_p=t-\tau'+1]}.E[S∣T=t]=vˉE[Tq​∣T=t]−Wt,E[Tq​∣T=t]=∑τ′=1t​Pr[Tq​=τ′∩Tp​=t−τ′+1]∑τ=1t​τPr[Tq​=τ∩Tp​=t−τ+1]​.

The Lean development names these objects geomLaw (the law gr(k)=rk−1(1−r)g_r(k)=r^{k-1}(1-r)gr​(k)=rk−1(1−r), k≥1k\ge1k≥1), jointMass, condMeanTq (9) and condUtility (8), all in the namespace EngagementOpt.Survey. Write f(t)=E[S∣T=t]f(t)=\mathbb E[S\mid T=t]f(t)=E[S∣T=t] and

φ(x)=x+1x(1−ln⁡(x+1)x)\varphi(x)=\frac{x+1}{x}\left(1-\frac{\ln(x+1)}{x}\right)φ(x)=xx+1​(1−xln(x+1)​)

(phi), the function of the paper's (11) and Lemma D.1.

Formalization targets

Goal: Theorem 5.1 (p. 19)

Assume 0<p<10<p<10<p<1, 0<q<10<q<10<q<1, vˉ≥0\bar v\ge0vˉ≥0 and W>0W>0W>0. For integer session lengths t≥1t\ge1t≥1:

  1. q=pq=pq=p:   (∀t≥1, f(t)<f(t+1))  ⟺  vˉ>2W\;\bigl(\forall t\ge1,\ f(t)<f(t+1)\bigr)\iff \bar v>2W(∀t≥1, f(t)<f(t+1))⟺vˉ>2W.
  2. q>pq>pq>p: (a) if vˉ>2W\bar v>2Wvˉ>2W then f(t)<f(t+1)f(t)<f(t+1)f(t)<f(t+1) for all t≥1t\ge1t≥1; (b) if vˉ>W\bar v>Wvˉ>W there is t∗t^*t∗ with f(t)<f(t+1)f(t)<f(t+1)f(t)<f(t+1) for all t>t∗t>t^*t>t∗.
  3. q<pq<pq<p: (a) if vˉ<2W\bar v<2Wvˉ<2W then f(t+1)<f(t)f(t+1)<f(t)f(t+1)<f(t) for all t≥1t\ge1t≥1; (b) there is t∗t^*t∗ with f(t+1)<f(t)f(t+1)<f(t)f(t+1)<f(t) for all t>t∗t>t^*t>t∗.

The goal is the conjunction of the five claims.

Milestones, in proof order

  • (9) with p=qp=qp=q (p. 20): E[Tq∣Tq+Tp=t+1]=t+12\mathbb E[T_q\mid T_q+T_p=t+1]=\frac{t+1}{2}E[Tq​∣Tq​+Tp​=t+1]=2t+1​.
  • (10) (p. 21): f(t)=vˉt+12−Wtf(t)=\bar v\frac{t+1}{2}-Wtf(t)=vˉ2t+1​−Wt if p=qp=qp=q, and f(t)=vˉ(tβtβt−1−1β−1)−Wtf(t)=\bar v\bigl(\frac{t\beta^t}{\beta^t-1}-\frac1{\beta-1}\bigr)-Wtf(t)=vˉ(βt−1tβt​−β−11​)−Wt with β=q/p\beta=q/pβ=q/p if p≠qp\ne qp=q.
  • (11) (p. 21): extending (10) to real s>0s>0s>0, its derivative at ttt is vˉ φ(βt−1)−W\bar v\,\varphi(\beta^t-1)-Wvˉφ(βt−1)−W.
  • Proof of Lemma D.1 (pp. 40–41): φ(x)→12\varphi(x)\to\frac12φ(x)→21​ as x→0x\to0x→0; (x+2)ln⁡(x+1)−2x(x+2)\ln(x+1)-2x(x+2)ln(x+1)−2x is ≥0\ge0≥0 for x>0x>0x>0 and ≤0\le0≤0 on (−1,0)(-1,0)(−1,0).
  • Lemma D.1 (p. 40): φ(x)≥12\varphi(x)\ge\frac12φ(x)≥21​ for x>0x>0x>0 and φ(x)≤12\varphi(x)\le\frac12φ(x)≤21​ for −1<x<0-1<x<0−1<x<0.
  • Proof of Theorem 5.1 (p. 22): φ(x)→1\varphi(x)\to1φ(x)→1 as x→∞x\to\inftyx→∞ and φ(x)→0\varphi(x)\to0φ(x)→0 as x→−1+x\to-1^+x→−1+.

Significance

The theorem describes how span and moreishness affect the relation between survey utility and session length. When q>pq>pq>p and vˉ>W\bar v>Wvˉ>W, utility eventually increases; when q<pq<pq<p, it eventually decreases. In the symmetric case q=pq=pq=p, the sign is decided by vˉ\bar vvˉ against 2W2W2W alone. These are conditional predictions for survey data, rather than a converse that identifies qqq and ppp from the sign by itself.

The result is proved in the paper; it has no machine-checked proof. Formalizing it checks the Bayes computation (9)–(10), including an arithmetico-geometric sum and a printed exponent slip on p. 20 (pt+1p^{t+1}pt+1 for pt−1p^{t-1}pt−1, harmless because it cancels), and the real-analytic Lemma D.1. It also makes explicit one hypothesis the printed theorem omits (below).

Difficulty

The closed form (10) needs the sum ∑τ=1tτβτ\sum_{\tau=1}^t\tau\beta^{\tau}∑τ=1t​τβτ and care with βt−1\beta^t-1βt−1 in denominators. The main obstacle is that monotonicity is a statement about integer ttt, while the natural tool, the derivative φ(βt−1)\varphi(\beta^t-1)φ(βt−1) of the real extension, lives on real ttt; the integer statement must be recovered from bounds on φ\varphiφ over whole intervals, not at single points. Lemma D.1 is a two-level sign analysis of a function with a removable singularity at 000, and the two limits at ∞\infty∞ and at −1+-1^+−1+ are of L'Hôpital type. The obvious argument for 2(b), "φ→1>W/vˉ\varphi\to1>W/\bar vφ→1>W/vˉ", silently uses vˉ>W\bar v>Wvˉ>W; without it, since φ<1\varphi<1φ<1 on (0,∞)(0,\infty)(0,∞), the claim fails.

Formalization scope

  • Explicit discrete model. (8) and (9) are taken as the definitions of E[S∣T=t]\mathbb E[S\mid T=t]E[S∣T=t] and E[Tq∣T=t]\mathbb E[T_q\mid T=t]E[Tq​∣T=t]; no measure-theoretic conditioning is involved. Independence of TqT_qTq​ and TpT_pTp​ is the product form of jointMass.
  • Integer time in the goal. t∈Nt\in\mathbb Nt∈N, t≥1t\ge1t≥1 (the support of TTT). "Increases with ttt" is f(t)<f(t+1)f(t)<f(t+1)f(t)<f(t+1), strictly; "for t>t∗t>t^*t>t∗" is ∃t0∈N, ∀t>t0\exists t_0\in\mathbb N,\ \forall t>t_0∃t0​∈N, ∀t>t0​. Real ttt and the real power βt\beta^tβt appear only in the milestone (11).
  • Hypotheses. 0<p<10<p<10<p<1 and 0<q<10<q<10<q<1 are the paper's standing assumptions; they exclude the degenerate p=q=0p=q=0p=q=0, where T=1T=1T=1 almost surely and Lean's x/0=0x/0=0x/0=0 would make claim 1 false. The paper's parameter space has vˉ≥0\bar v\ge0vˉ≥0 (p. 15). W>0W>0W>0 is implicit (§2.1 normalizes W=1W=1W=1). vˉ>W\bar v>Wvˉ>W in 2(b) is added: the proof uses it on p. 22 ("since vˉ>W\bar v>Wvˉ>W by assumption") and 2(b) is false without it.
  • Domain of φ\varphiφ. Every statement about φ\varphiφ restricts xxx to x>0x>0x>0, −1<x<0-1<x<0−1<x<0, a punctured neighbourhood of 000, the right neighbourhood of −1-1−1, or x→∞x\to\inftyx→∞, so the junk values at x=0x=0x=0 and x≤−1x\le-1x≤−1 never enter.
  • Ruled out. Stating the goal for real ttt, dropping p,q>0p,q>0p,q>0, or reading 1 as a one-way implication all give a different theorem.
  • Infrastructure. Mathlib's Real.log, Real.rpow, HasDerivAt, Filter.Tendsto and finite sums suffice. The inequality ln⁡(1+x)≥2x/(x+2)\ln(1+x)\ge 2x/(x+2)ln(1+x)≥2x/(x+2) for x≥0x\ge0x≥0 is in Mathlib (Real.le_log_one_add_of_nonneg). Contributions of any milestone, of alternative discrete proofs of monotonicity that avoid the real extension, and of the full goal are welcome.

Selected references

  • J. Kleinberg, S. Mullainathan, M. Raghavan, The Challenge of Understanding What Users Want: Inconsistent Preferences and Engagement Optimization, Management Science, 2023. arXiv:2202.11776v3 (cited version): https://arxiv.org/abs/2202.11776 ; https://doi.org/10.1287/mnsc.2022.03683
  • G. S. Becker, K. M. Murphy, A Theory of Rational Addiction, Journal of Political Economy 96(4), 1988. https://doi.org/10.1086/261558
14 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Tokenomics: When Tokens Beat Equity III: The Break-Even Token Pre-Sale Strictly Increases in the Set-Up Cost and the Marginal Cost and Strictly Decreases in Expected DemandResearch Paper

Motivation

Firms can raise money before production by selling claims on future output. In the model of Malinova and Park, these claims are tokens: a buyer prepays for a quantity of the good, and the final contract also gives token holders a share of tokens issued after demand becomes known. The firm must choose how many tokens to pre-sell. A larger pre-sale brings in more finance but changes the allocation of later sales revenue. The paper identifies contract terms that preserve the firm's monopoly output choice and determines the pre-sale quantity by investors' break-even condition (Proposition 3, p. 24). Proposition 4 asks how that quantity responds when financing need, production cost, or expected demand changes. These comparative statics make the contract's financing response explicit rather than leaving the break-even equation as an isolated root.

Setting

An entrepreneur pays a set-up cost C0>0C_0>0C0​>0 to launch production and then incurs a marginal cost c>0c>0c>0 per unit. After financing, a demand intercept xxx is drawn uniformly from (0,θ)(0,\theta)(0,θ), where c<θc<\thetac<θ. At output qqq, the inverse demand price is x−qx-qx−q. Without financing distortions, the monopoly quantity is qm(x)=max⁡{(x−c)/2,0}q^m(x)=\max\{(x-c)/2,0\}qm(x)=max{(x−c)/2,0} and its profit is πm(x)=max⁡{x−c,0}2/4\pi^m(x)=\max\{x-c,0\}^2/4πm(x)=max{x−c,0}2/4. For a realized payoff g(x)g(x)g(x), expectation means the average Eθ[g]=θ−1∫0θg(x) dxE_\theta[g]=\theta^{-1}\int_0^\theta g(x)\,dxEθ​[g]=θ−1∫0θ​g(x)dx. The venture's net present value is Eθ[πm]−C0E_\theta[\pi^m]-C_0Eθ​[πm]−C0​, equal in this domain to (θ−c)3/(12θ)−C0(\theta-c)^3/(12\theta)-C_0(θ−c)3/(12θ)−C0​ (equation (3), p. 14).

Under the optimal token contract of Proposition 3, investors buy ttt tokens at time zero, and token holders receive the fraction αt=t/(t+c)\alpha_t=t/(t+c)αt​=t/(t+c) of new tokens issued when output exceeds the pre-sale. A refund rule applies when output falls below the pre-sale. The resulting positive break-even pre-sale size is determined by equation (16):

cc+t23θ(θ−c2−t)3=(θ−c)312θ−C0.\frac{c}{c+t}\frac{2}{3\theta}\left(\frac{\theta-c}{2}-t\right)^3 =\frac{(\theta-c)^3}{12\theta}-C_0.c+tc​3θ2​(2θ−c​−t)3=12θ(θ−c)3​−C0​.

For a positive-NPV venture, this equation has one positive root, in (0,(θ−c)/2)(0,(\theta-c)/2)(0,(θ−c)/2) (Appendix A, pp. 40–41). The mission treats the root as a solution of the equation, so statements about the optimal quantity apply to every value satisfying it.

Formalization targets

The comparative-statics goal

Proposition 4, p. 25, asserts three strict directions. If t(c,C0,θ)t(c,C_0,\theta)t(c,C0​,θ) denotes the unique positive root of (16), then, while both endpoint ventures have positive NPV,

C0<C0′ ⟹ t(c,C0,θ)<t(c,C0′,θ),C_0<C_0'\ \Longrightarrow\ t(c,C_0,\theta)<t(c,C_0',\theta),C0​<C0′​ ⟹ t(c,C0​,θ)<t(c,C0′​,θ), c<c′ ⟹ t(c,C0,θ)<t(c′,C0,θ),c<c'\ \Longrightarrow\ t(c,C_0,\theta)<t(c',C_0,\theta),c<c′ ⟹ t(c,C0​,θ)<t(c′,C0​,θ), θ<θ′ ⟹ t(c,C0,θ′)<t(c,C0,θ).\theta<\theta'\ \Longrightarrow\ t(c,C_0,\theta')<t(c,C_0,\theta).θ<θ′ ⟹ t(c,C0​,θ′)<t(c,C0​,θ).

Thus a larger set-up cost or marginal cost requires more pre-sold tokens, while a higher demand level requires fewer. The Lean goal compares arbitrary positive roots directly. It places the NPV condition at the higher cost in the second comparison and at the lower demand level in the third; these are the restrictive endpoints. The first comparison places it at the higher set-up cost.

Source milestones

The milestone list follows the Appendix A proof: existence and uniqueness of the root of (41); the negative ttt derivative (42); the positive ccc derivative (45); the negative θ\thetaθ derivative (46); and the derivative in ttt of the expression in (46), equation (47). These are source claims, with their displayed constants retained. Equation (42) and equation (45) contain printing errors in the SSRN copy; the formal statements use the actual derivatives and the milestone quotes retain the printed text.

Significance

Proposition 3 establishes that the chosen token contract can finance a positive-NPV venture while keeping the efficient monopoly output. Proposition 4 then describes the contract's response to the model's three principal parameters. Its strict inequalities distinguish an actual response from a weak monotonicity claim that could allow the pre-sale to remain unchanged. The demand comparative static is economically specific: a higher θ\thetaθ raises the demand intercept on average, but the quantity of tokens needed to finance the same set-up cost falls.

The paper proves these results analytically. This mission seeks machine-checked proofs of the root comparison and its stated derivative milestones. A completed development would provide reusable results about parameter-dependent roots of rational functions, especially when the root is specified by a break-even condition rather than by an explicit formula. The current Lean files are compiled statements with proof placeholders; compilation does not establish the mathematical results.

Difficulty

Equation (16) is cubic in a quantity that also occurs in a denominator, so the root does not offer a convenient closed expression for direct comparison. The endpoint restrictions matter: the meaningful root lies strictly between zero and (θ−c)/2(\theta-c)/2(θ−c)/2, and derivatives that have the desired sign in that interval need not keep the same sign outside it. In particular, the ttt derivative in (42) reaches zero at the upper boundary. The demand derivative in (46) also vanishes at t=0t=0t=0, making its strict sign in the interior a separate claim. A literal transcription of two printed derivatives would give incorrect equalities even though their intended sign conclusions survive. The formal development therefore needs both careful domain control and the corrected expressions.

Formalization scope

The namespace TokenFinance.Statics represents all quantities as real functions. Uniform expectation is the interval integral divided by θ\thetaθ. Monopoly output and profit use max to encode zero production below cost. The common Setting definition file also records the equity and debt payoffs and the token contract's case split, following the series-wide model. The break-even condition is exactly the closed-form equation (16), while NPV remains the integral of realized monopoly profit minus C0C_0C0​. The goal assumes the paper's standing c>0c>0c>0, C0>0C_0>0C0​>0, c<θc<\thetac<θ, and positive NPV, written as C0<(θ−c)3/(12θ)C_0<(\theta-c)^3/(12\theta)C0​<(θ−c)3/(12θ) using equation (3). Derivative statements state their own regions and nonzero-denominator conditions. The token size is quantified over positive roots rather than chosen by an arbitrary selection function.

The root cannot be defined to have the claimed monotonicity, and the derivative signs cannot be inserted as hypotheses of the goal. The missing work includes real-variable derivative calculations, root existence and uniqueness on the economic interval, and the strict parameter comparisons. The secondary token market, redemption mechanics beyond the contract payoffs, bankruptcy costs, consumer welfare, and the paper's institutional discussion are outside this mission's scope.

Selected references

  • Katya Malinova and Andreas Park, Tokenomics: When Tokens Beat Equity, SSRN 3286825, version of June 1, 2023, pp. 14, 24–25, 40–42. SSRN preprint.
  • Katya Malinova and Andreas Park, Tokenomics: When Tokens Beat Equity, Management Science, 2023. DOI:10.1287/mnsc.2023.4882. The mission's equation and page references follow the SSRN version above.
7 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Output-Oriented Agricultural Subsidy Design I: Under a Combined Subsidy, More Dispersed Farmer Productivity Gives More Dispersed Outputs and ProfitsResearch Paper

Why the distribution of subsidies matters

Agricultural subsidies can raise total crop supply while changing which farmers produce it. A payment tied to planted input gives a larger reward per unit of harvested output to a farmer who needs more input for that output. A payment tied to harvested output gives the same reward per unit of output to every farmer. These differences matter when a government cares about the distribution of production and income across farms as well as total supply. Fan et al. (2023) study these effects in a finite market where farmers choose quantities and compete through a common market price.

This mission isolates the paper's distribution result for a combined subsidy, which pays on both planted input and harvested output. It asks how a difference in the dispersion of farmers' input-to-output ratios between two otherwise identical markets affects their equilibrium output and profit. The result is Proposition 4 of the SSRN version. The paper proves it in Online Appendix A, p. 4. The result is mathematically stated and proved in the paper; the machine-checked formalization of its statement and proof is the work here.

Market and order

There are N≥1N\ge1N≥1 farmers, indexed in the paper by j=1,…,Nj=1,\ldots,Nj=1,…,N. Farmer jjj must plant zjqjz_jq_jzj​qj​ units of input to harvest qjq_jqj​ units of output. Thus zj>0z_j>0zj​>0 is an input-to-output ratio; a smaller ratio means more output per unit of input. The ratios are listed in nondecreasing order. Planting costs cPc_PcP​ per unit of input, harvesting costs cHc_HcH​ per unit of output, and total harvested output is Q=∑jqjQ=\sum_jq_jQ=∑j​qj​. The market-clearing price is p=α−βQp=\alpha-\beta Qp=α−βQ, where α,β>0\alpha,\beta>0α,β>0.

Under a combined subsidy (sP,sH)(s_P,s_H)(sP​,sH​), farmer jjj receives zjsP+sHz_js_P+s_Hzj​sP​+sH​ per unit of output. The first part is payment for planted input and the second for harvested output. A farmer choosing qj≥0q_j\ge0qj​≥0 while the other farmers' outputs stay fixed has profit

πj(q,sP,sH)=(α−zj(cP−sP)−(cH−sH)−β∑iqi)qj.\pi_j(q,s_P,s_H)=\left(\alpha-z_j(c_P-s_P)-(c_H-s_H)-\beta\sum_iq_i\right)q_j.πj​(q,sP​,sH​)=(α−zj​(cP​−sP​)−(cH​−sH​)−βi∑​qi​)qj​.

An equilibrium is a nonnegative output vector at which no farmer gains by changing its own nonnegative output. Costs and subsidies are real-valued: the paper permits a subsidy larger than its associated cost and also permits a negative subsidy, or tax. The formulas in this mission concern equilibria at which every farmer produces a positive quantity.

To compare dispersion, let Tk(u)T_k(u)Tk​(u) be the sum of the kkk largest entries of a vector uuu. A vector uuu majorizes vvv, written u≥mvu\ge^m vu≥mv, when Tk(u)≥Tk(v)T_k(u)\ge T_k(v)Tk​(u)≥Tk​(v) for every k=1,…,Nk=1,\ldots,Nk=1,…,N and their total sums agree. The weak sub-majorization relation u≥wmvu\ge_{wm}vu≥wm​v keeps the top-sum inequalities and drops equal totals. With this direction, u≥mvu\ge^m vu≥mv says that uuu is more dispersed. These are the orders of Definition 1 in Fan et al..

Formalization targets

Active combined-subsidy equilibrium

The first milestone formalizes Proposition 3's active branch. Write zˉ=N−1∑jzj\bar z=N^{-1}\sum_jz_jzˉ=N−1∑j​zj​ and aˉ(sP,sH)=α−zˉ(cP−sP)−(cH−sH)\bar a(s_P,s_H)=\alpha-\bar z(c_P-s_P)-(c_H-s_H)aˉ(sP​,sH​)=α−zˉ(cP​−sP​)−(cH​−sH​). At an equilibrium with every farmer active, it states

qj=1β(aˉ(sP,sH)N+1−(zj−zˉ)(cP−sP)),πj=βqj2.q_j=\frac1\beta\left(\frac{\bar a(s_P,s_H)}{N+1}-(z_j-\bar z)(c_P-s_P)\right),\qquad \pi_j=\beta q_j^2.qj​=β1​(N+1aˉ(sP​,sH​)​−(zj​−zˉ)(cP​−sP​)),πj​=βqj2​.

The remaining milestones formalize the increment identities written in the proof of Corollary 1 and the two order properties invoked in the proof of Proposition 2: majorization under an affine map, and weak sub-majorization under an increasing convex map. These are the results used to interpret the change in each farmer's output and profit when a subsidy changes.

Proposition 4: productivity dispersion

Consider markets AAA and BBB with the same N,α,β,cP,cHN,\alpha,\beta,c_P,c_HN,α,β,cP​,cH​, but with ratio vectors zA≥mzBz_A\ge^m z_BzA​≥mzB​. Give them the same subsidy (sP,sH)(s_P,s_H)(sP​,sH​) and let δ>0\delta>0δ>0. For a vector of equilibrium outputs, ΔsPq\Delta_{s_P}qΔsP​​q is the difference between outputs at (sP+δ,sH)(s_P+\delta,s_H)(sP​+δ,sH​) and (sP,sH)(s_P,s_H)(sP​,sH​); ΔsHq\Delta_{s_H}qΔsH​​q is defined using (sP,sH+δ)(s_P,s_H+\delta)(sP​,sH​+δ). Profit increments use the corresponding profits at those equilibria. Proposition 4 asserts

qA≥mqB,ΔsPqA≥mΔsPqB,ΔsHqA=mΔsHqB,q_A\ge^m q_B,\quad \Delta_{s_P}q_A\ge^m\Delta_{s_P}q_B,\quad \Delta_{s_H}q_A=^m\Delta_{s_H}q_B,qA​≥mqB​,ΔsP​​qA​≥mΔsP​​qB​,ΔsH​​qA​=mΔsH​​qB​, πA≥wmπB,ΔsHπA≥mΔsHπB.\pi_A\ge_{wm}\pi_B,\quad \Delta_{s_H}\pi_A\ge^m\Delta_{s_H}\pi_B.πA​≥wm​πB​,ΔsH​​πA​≥mΔsH​​πB​.

The equality =m=^m=m means majorization in both directions. These comparisons form one goal theorem so every part of Proposition 4 remains present. Proposition 4, p. 13 is the source for the target.

What the result supplies

The first output comparison says that greater dispersion in input-to-output ratios leads to greater dispersion in equilibrium production under the same combined subsidy, while the total output stays equal. The increment comparisons identify which changes preserve or distinguish that dispersion when planting and harvesting payments increase. The profit statements give the corresponding order for farmer earnings. They make the distributional effect of a subsidy explicit rather than reducing it to a claim about aggregate crop supply.

A formal development supplies reusable definitions for finite majorization, this Cournot market, and best-response equilibrium. It also separates the paper's claimed order relations from the algebraic equilibrium formula. Proofs of the paper's known results remain to be checked in Lean. The mission makes no claim that Proposition 4 is an open research problem.

Why the comparison is delicate

Directly comparing farmer jjj in the two markets cannot establish majorization: the order compares sums of the largest coordinates, which need not belong to the same farmers in each market. The sign of cP−sPc_P-s_PcP​−sP​ can change because planting payments are unrestricted, so the ordering of farmers by output can reverse. Profit is quadratic in output, and the profit comparison is weak sub-majorization rather than equality of totals. Subsidy increments introduce additional equilibria; an increase in the planting payment can also alter which farmers are active. These features must be accounted for in a statement that retains every clause of Proposition 4.

Formalization scope

Lean represents the paper's NNN farmers by Fin N, so paper farmer jjj has Lean index j−1j-1j−1. The shared parameter record contains α,β,cP,cH\alpha,\beta,c_P,c_Hα,β,cP​,cH​; each market supplies its own sorted vector zzz. A standing predicate records N>0N>0N>0, α,β>0\alpha,\beta>0α,β>0, the ordering of zzz, and zj>0z_j>0zj​>0. The positive-ratio condition makes explicit that each ratio is formed from positive physical quantities. The two markets have the same parameter record, and no sign restriction is imposed on costs or subsidies.

The combined payment is a per-unit-output vector tj=zjsP+sHt_j=z_js_P+s_Htj​=zj​sP​+sH​. Equilibrium is a best-response condition over nonnegative output, not a definition by Proposition 3's formula. The top-sum order uses all subsets of kkk farmers, with equal total sums required for majorization. Averages range over all NNN farmers because the theorems work in the all-active regime. This rules out treating a formula-defined output vector or a weakened order as the market result.

The goal explicitly assumes positive output at the baseline and at both shifted subsidies. Positivity at the planting-shifted subsidy is needed for the paper's fixed-active-set increment formula but is unstated in Proposition 4. Positivity at the harvesting-shifted subsidy is implied by this market model; it is kept explicit without assuming an equilibrium-uniqueness theorem. The supporting increment milestone also includes an active equilibrium at the midpoint harvesting subsidy. The majorization lemmas can be reused for other finite-vector models, and the equilibrium characterization can support later analyses of this paper's subsidy programs.

Selected references

  • T. Fan, Q. Feng, Y. Li, J. G. Shanthikumar, and Y. Wu, Output-Oriented Agricultural Subsidy Design, SSRN preprint 4378693, version of March 18, 2023; forthcoming in Management Science. SSRN copy, journal DOI.
7 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Tokenomics: When Tokens Beat Equity I: Debt Financing Has a Unique Break-Even Repayment Between the Set-Up Cost and the Maximal Monopoly Profit, and the Entrepreneur Earns the Venture's NPVResearch Paper

Motivation

Since 2017, billions of dollars have been raised through the issuance of crypto-assets, many of them tokens: digital claims on a future product or service, issued before the product exists. Malinova and Park, Tokenomics: When Tokens Beat Equity (SSRN 3286825; Management Science, 2023, doi:10.1287/mnsc.2023.4882), ask when such a pre-sale is a better way to finance a venture than the two classical instruments, equity and debt. To answer, they first work out how equity and debt perform in a simple monopoly model in which demand is uncertain when the money is raised. This mission formalizes the debt half of that benchmark (Proposition 2), together with the equity half (Proposition 1). The other three missions of the series treat the optimal token contract (Proposition 3), its comparative statics (Proposition 4) and financing under moral hazard (Proposition 8); all of them compare against the benchmark proved here.

Setting

An entrepreneur must pay a set-up cost C0>0C_0 > 0C0​>0 before she learns demand. Afterwards she is a monopolist with constant marginal cost ccc, facing the linear inverse demand

p(q)=x−q,p(q) = x - q,p(q)=x−q,

where the demand intercept xxx is uniformly distributed on (0,θ)(0,\theta)(0,θ), with 0<c<θ0 < c < \theta0<c<θ. Investors require a zero expected return. For a payoff ggg of the demand realization write

Eθ[g]=1θ∫0θg(x) dx.\mathsf E_\theta[g] = \frac1\theta \int_0^\theta g(x)\,dx .Eθ​[g]=θ1​∫0θ​g(x)dx.

At demand xxx the monopolist produces qm(x)=max⁡{(x−c)/2,0}q^m(x) = \max\{(x-c)/2, 0\}qm(x)=max{(x−c)/2,0} and earns the monopoly profit

πm(x)=max⁡{x−c, 0}2/4,\pi^m(x) = \max\{x-c,\,0\}^2/4 ,πm(x)=max{x−c,0}2/4,

that is (x−c)2/4(x-c)^2/4(x−c)2/4 if x≥cx \ge cx≥c and 000 otherwise. The project's net present value is NPV=Eθ[πm]−C0\mathrm{NPV} = \mathsf E_\theta[\pi^m] - C_0NPV=Eθ​[πm]−C0​.

Under equity, investors receive a fraction αs\alpha_sαs​ of profits; break-even is αs Eθ[πm]=C0\alpha_s\,\mathsf E_\theta[\pi^m] = C_0αs​Eθ​[πm]=C0​ (5). Under debt with promised repayment D≥0D \ge 0D≥0, investors receive min⁡{πm(x),D}\min\{\pi^m(x), D\}min{πm(x),D}: the full DDD when the venture is solvent (x>c+2Dx > c + 2\sqrt Dx>c+2D​), the whole monopoly profit under the debtor-in-possession arrangement when c≤x≤c+2Dc \le x \le c + 2\sqrt Dc≤x≤c+2D​, and nothing when x<cx < cx<c. The entrepreneur keeps max⁡{πm(x)−D,0}\max\{\pi^m(x) - D, 0\}max{πm(x)−D,0}. The repayment breaks even when

Eθ[min⁡{πm(x),D}]=C0.(7)\mathsf E_\theta\big[\min\{\pi^m(x), D\}\big] = C_0. \qquad (7)Eθ​[min{πm(x),D}]=C0​.(7)

In Lean these are expect, pim, npv, equityShare, debtInv and debtEnt in the namespace TokenFinance.Debt.

Formalization targets

Goal: Proposition 2 (Debt Financing)

If NPV>0\mathrm{NPV} > 0NPV>0, then

∃! D≥0: Eθ[min⁡{πm,D}]=C0,\exists!\, D \ge 0:\ \mathsf E_\theta\big[\min\{\pi^m, D\}\big] = C_0,∃!D≥0: Eθ​[min{πm,D}]=C0​,

and every such DDD satisfies

C0<D<(θ−c)24,Eθ[max⁡{πm−D,0}]=NPV.C_0 < D < \frac{(\theta-c)^2}{4}, \qquad \mathsf E_\theta\big[\max\{\pi^m - D, 0\}\big] = \mathrm{NPV}.C0​<D<4(θ−c)2​,Eθ​[max{πm−D,0}]=NPV.

Uniqueness is asserted among all nonnegative repayments, which implies the paper's uniqueness in (C0,(θ−c)2/4)(C_0, (\theta-c)^2/4)(C0​,(θ−c)2/4).

Milestones

  1. (3): NPV=(θ−c)3/(12θ)−C0\mathrm{NPV} = (\theta-c)^3/(12\theta) - C_0NPV=(θ−c)3/(12θ)−C0​.
  2. (32)–(33): with D=(θ−c)2δ2/4D = (\theta-c)^2\delta^2/4D=(θ−c)2δ2/4 and 0≤δ≤10 \le \delta \le 10≤δ≤1, the left side of (7) minus C0C_0C0​ equals the split integral (32) and the cubic (θ−c)312θ(−2δ3+3δ2)−C0\frac{(\theta-c)^3}{12\theta}(-2\delta^3 + 3\delta^2) - C_012θ(θ−c)3​(−2δ3+3δ2)−C0​ of (33).
  3. Monotonicity of (33): the cubic is −C0-C_0−C0​ at δ=0\delta = 0δ=0, equals NPV at δ=1\delta = 1δ=1, has positive derivative and is strictly increasing on [0,1][0,1][0,1]; it has a unique root in (0,1)(0,1)(0,1) when NPV >0> 0>0.
  4. (34): at a root δ∈(0,1)\delta \in (0,1)δ∈(0,1), D=C0⋅θθ−c⋅33−2δ>C0D = C_0 \cdot \frac{\theta}{\theta-c}\cdot\frac{3}{3-2\delta} > C_0D=C0​⋅θ−cθ​⋅3−2δ3​>C0​.
  5. (8): at any break-even D≥0D \ge 0D≥0 the entrepreneur's expected payoff is the NPV.
  6. Proposition 1 (Equity Financing): if NPV >0> 0>0, then αs=12θC0/(θ−c)3∈(0,1)\alpha_s = 12\theta C_0/(\theta-c)^3 \in (0,1)αs​=12θC0​/(θ−c)3∈(0,1), investors break even and the entrepreneur earns (1−αs)Eθ[πm]=NPV(1-\alpha_s)\mathsf E_\theta[\pi^m] = \mathrm{NPV}(1−αs​)Eθ​[πm]=NPV.

Significance

Propositions 1 and 2 establish that, absent agency problems, equity and debt finance exactly the positive-NPV projects and leave the entrepreneur the entire surplus. This is the benchmark of the paper: Proposition 3 shows that a carefully designed token pre-sale matches it, while naive token contracts (revenue sharing, plain output pre-sales) distort output and fail to finance some profitable projects. Corollary 1 of the paper is the conjunction of Propositions 1–3. The debt repayment characterized here also reappears in the moral-hazard analysis (§IV), where the ranking of debt, tokens and equity depends on the size of DDD relative to the low-demand state.

On the formal side, the results are proved in the paper with short calculus arguments, and nothing about them is machine-checked. The mission produces a checked model of uniform-demand monopoly financing in which expectations are genuine integrals of realized payoffs, the cubic reduction of the break-even condition, and the uniqueness argument for the repayment. These are the pieces the token missions of the series build on.

Difficulty

The central step is the passage from (7) to the cubic (33). The investors' payoff min⁡{πm(x),D}\min\{\pi^m(x), D\}min{πm(x),D} changes form at x=cx = cx=c and at the solvency threshold c+2Dc + 2\sqrt Dc+2D​, so the expectation must be split at points that depend on DDD and may fall outside (0,θ)(0,\theta)(0,θ) for large DDD; only for D≤(θ−c)2/4D \le (\theta-c)^2/4D≤(θ−c)2/4 does the threshold stay inside the demand range. Uniqueness over all D≥0D \ge 0D≥0 also needs the regime D≥(θ−c)2/4D \ge (\theta-c)^2/4D≥(θ−c)2/4, where the investors receive the whole profit and the break-even condition reduces to NPV=0\mathrm{NPV} = 0NPV=0. A naive argument that solves the cubic in δ\deltaδ and stops gives uniqueness only inside [0,1][0,1][0,1].

Formalization scope

All objects are plain functions of real parameters; there is no probability space. Demand enters only through Eθ[g]=1θ∫0θg\mathsf E_\theta[g] = \frac1\theta\int_0^\theta gEθ​[g]=θ1​∫0θ​g, the expectation under U(0,θ)U(0,\theta)U(0,θ) (open or closed endpoints make no difference). Case distinctions of the paper are encoded with max⁡\maxmax and min⁡\minmin, so the break-even condition (7) is a single integral of the realized repayment rather than the paper's split integral with D\sqrt DD​ limits; the split form is a theorem (milestones 2 and 5). The standing assumptions are 0<c<θ0 < c < \theta0<c<θ and C0>0C_0 > 0C0​>0; 0<c0 < c0<c is the paper's "positive marginal cost" (p. 22) and is kept throughout the series although Proposition 2 itself needs only c≥0c \ge 0c≥0. "All positive NPV projects" is the hypothesis 0<NPV0 < \mathrm{NPV}0<NPV on the integral-defined NPV.

A trivializing formalization is ruled out: the NPV, the investors' break-even condition and the entrepreneur's payoff are expectations of realized payoffs, never their closed forms, so neither (3) nor the reduction to (33) is true by definition.

The definitions file also declares the token objects of Proposition 3 (the revenue share t/(t+c)t/(t+c)t/(t+c), the realized token payoffs and condition (16)), identical across the four missions of this series so that they can be merged later; they are not used here. Out of scope: the secondary token market, bankruptcy costs, consumer welfare and the institutional discussion of the paper. Useful infrastructure includes lemmas for integrals of piecewise polynomials on intervals and a reusable "strictly increasing continuous function with a sign change has a unique root" argument.

Selected references

  • K. Malinova and A. Park, Tokenomics: When Tokens Beat Equity, SSRN 3286825, version of June 1, 2023. https://ssrn.com/abstract=3286825
  • K. Malinova and A. Park, Tokenomics: When Tokens Beat Equity, Management Science, 2023. https://doi.org/10.1287/mnsc.2023.4882
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsMechanism Design·Captain: mikedeng1

The Voice of Customers in Customization I: Under A-Learning, Truthful Cheap-Talk Communication Is an Equilibrium If and Only If θH/θL ≥ ΔResearch Paper

Motivation

Sellers often ask customers what they want before designing a product or service. The answer can affect both the quality delivered and the price paid. Because a customer can send a costless, unverifiable message, the seller cannot assume that a stated preference is true. Guo's customization model asks when the customer's own incentives make truthful communication sustainable. This matters for products with substantial presale effort, such as prototypes, proposals, and sales assistance: the seller incurs that effort before the final transaction price is set. The paper distinguishes this selling cost from the cost of producing the eventual product. This mission concerns the paper's A-Learning game, in which the seller learns through a customer's message before choosing quality.

Setting

Each buyer wants one unit of a product with quality q≥0q\geq0q≥0. A buyer with preference θ\thetaθ values it at θq\theta qθq and can decline to trade. The preference is private and has two possible values, θH>θL>0\theta_H>\theta_L>0θH​>θL​>0. The high type has prior share α∈(0,1)\alpha\in(0,1)α∈(0,1). Producing quality qqq costs kq2kq^2kq2 and selling it costs sq2sq^2sq2, with k,s>0k,s>0k,s>0. The selling cost is incurred at the design stage. In the final price-setting stage, the seller makes a take-it-or-leave-it offer with probability γ∈(0,1)\gamma\in(0,1)γ∈(0,1); the buyer makes the offer with probability 1−γ1-\gamma1−γ. These are the assumptions of §2, pp. 5–9.

Under A-Learning, the buyer sends one of two costless messages before the seller chooses quality. A separating message rule sends different messages for the high and low types. On receiving message mmm, the seller believes the type is θ^(m)∈{θH,θL}\hat\theta(m)\in\{\theta_H,\theta_L\}θ^(m)∈{θH​,θL​}. If its belief is θ^\hat\thetaθ^, the seller's expected payoff from offering quality qqq is

v(q,θ^)=γ(θ^q−kq2)−sq2.v(q,\hat\theta)=\gamma(\hat\theta q-kq^2)-sq^2.v(q,θ^)=γ(θ^q−kq2)−sq2.

At a given quality, a buyer whose actual type is θ\thetaθ receives

uA(θ,θ^,q)=γmax⁡{θq−θ^q,0}+(1−γ)max⁡{θq−kq2,0}.u_A(\theta,\hat\theta,q)=\gamma\max\{\theta q-\hat\theta q,0\}+(1-\gamma)\max\{\theta q-kq^2,0\}.uA​(θ,θ^,q)=γmax{θq−θ^q,0}+(1−γ)max{θq−kq2,0}.

The maxima preserve the buyer's option not to purchase. In the paper's perfect Bayesian equilibrium, the seller's beliefs agree with the types that send the observed messages, the seller chooses a nonnegative quality maximizing vvv for each message, and each type chooses a message maximizing its own payoff. With two distinct messages and a separating rule, both messages occur on the equilibrium path. These payoff and equilibrium conditions are stated in §3.2, pp. 11–12, equations (4)–(7).

Formalization targets

The seller's printed optimal design for belief θ^\hat\thetaθ^ is

q(θ^)=γθ^2s+2γk.q(\hat\theta)=\frac{\gamma\hat\theta}{2s+2\gamma k}.q(θ^)=2s+2γkγθ^​.

With u(θ,θ^)=uA(θ,θ^,q(θ^))u(\theta,\hat\theta)=u_A(\theta,\hat\theta,q(\hat\theta))u(θ,θ^)=uA​(θ,θ^,q(θ^)), the two incentive compatibility conditions are u(θH,θH)≥u(θH,θL)u(\theta_H,\theta_H)\geq u(\theta_H,\theta_L)u(θH​,θH​)≥u(θH​,θL​) and u(θL,θL)≥u(θL,θH)u(\theta_L,\theta_L)\geq u(\theta_L,\theta_H)u(θL​,θL​)≥u(θL​,θH​). The supporting targets identify the seller's optimal design, characterize informative equilibrium by these two conditions, and express each condition as a threshold on type heterogeneity. They follow §3.2, pp. 12–13.

The goal is Proposition 1: an informative A-Learning equilibrium exists exactly when

θHθL≥Δ:=max⁡{ΔH,ΔL},ΔH=γ[2s+(1+γ)k](1−γ)(2s+γk),ΔL=2s+γkγk.\frac{\theta_H}{\theta_L}\geq\Delta:=\max\left\{\Delta_H,\Delta_L\right\},\qquad \Delta_H=\frac{\gamma[2s+(1+\gamma)k]}{(1-\gamma)(2s+\gamma k)},\qquad \Delta_L=\frac{2s+\gamma k}{\gamma k}.θL​θH​​≥Δ:=max{ΔH​,ΔL​},ΔH​=(1−γ)(2s+γk)γ[2s+(1+γ)k]​,ΔL​=γk2s+γk​.

The weak inequality includes the boundary at which a buyer is indifferent between messages. The Appendix's proof uses strict inequalities in a corresponding line; the statement on p. 13 and Proposition 1 use weak ones. The milestone list retains the source's optimal-design sentence, equations (6)–(7), and the two threshold sentences in their order in the SSRN author copy.

Significance

The theorem gives a precise answer to whether costless buyer communication can transmit preference information before a seller customizes a product. The condition separates the two possible failures of truthful reporting: a high type may prefer the design induced by the low message, and a low type may prefer the design induced by the high message. It also shows why the relevant threshold depends on bargaining power and both cost coefficients, while the prior share α\alphaα does not enter this particular equilibrium-existence condition. The result is a theorem of the paper; the mission seeks its machine-checked formulation and proof.

The formal development makes the equilibrium claim more than a comparison of two algebraic payoffs. It must connect an actual separating message strategy, beliefs, a seller optimum, and buyer best responses to the two incentive conditions. The model's payoff definitions and equilibrium predicate are reusable for other statements about A-Learning in the paper, including comparisons of equilibrium quality and payoffs. The threshold lemmas can also be reused when comparing A-Learning with O-Learning.

Difficulty

Costless messages alone impose no truthful-reporting discipline. A seller's belief changes both the design chosen after a message and the price a buyer might face. The high and low types therefore face different deviation incentives. A comparison that ignores the seller's design decision misses the equilibrium requirement; a comparison that treats every buyer as purchasing misses the low type's option to refuse an overpriced high-quality product. The second issue is visible in the max⁡{⋅,0}\max\{\cdot,0\}max{⋅,0} terms of equation (5). The equilibrium result has to hold at equality in the thresholds as well as above them.

Formalization scope

The Lean model uses real parameters θH,θL,α,γ,k,s\theta_H,\theta_L,\alpha,\gamma,k,sθH​,θL​,α,γ,k,s and a two-constructor type for buyer types. Its standing assumptions are exactly θH>θL>0\theta_H>\theta_L>0θH​>θL​>0, 0<α<10<\alpha<10<α<1, 0<γ<10<\gamma<10<γ<1, k>0k>0k>0, and s>0s>0s>0. A separate two-constructor type represents the two possible messages. Quality is real and every seller optimization ranges over q≥0q\geq0q≥0; optimality means that the chosen design attains the maximum. Buyer deviations range over both messages. Beliefs identify the types on the equilibrium path. The type's purchase option is kept in both maximum terms of the buyer payoff.

The price-setting stage is represented by the paper's reduced-form payoffs (4) and (5), without a separate bargaining game. The prior share α\alphaα is retained among the standing primitives even though it cancels from Proposition 1. The closed-form design is used in u(θ,θ^)u(\theta,\hat\theta)u(θ,θ^) and the incentive conditions, while an equilibrium requires actual seller maximization. An equilibrium is not defined as the conjunction of incentive conditions, and Δ\DeltaΔ is the printed maximum of the two explicit fractions. Separation rules out a one-message or pooling interpretation. The supporting statements require real arithmetic, optimization on a nonnegative domain, and finite case analysis for the two types and two messages. Contributions that preserve these definitions and the paper's weak boundary are welcome. The known proofs behind the milestones are in the Appendix of the SSRN version, pp. 27–28.

Selected references

  • Liang Guo, The Voice of Customers in Customization, SSRN working paper 3994319, author-copy version of 2023-11-29. SSRN abstract and paper. Published as a Management Science article, DOI 10.1287/mnsc.2021.04025.
6 thms2 active usersReviewed
🏆Completed
OptimizationProbabilityStochastic Systems·Captain: mikedeng1

Courier Dispatch in On-Demand Delivery I: With Exogenous Demand, Dedicated Delivery Has the Shorter Wait Exactly Below One Threshold in Demand Rate and in Service RadiusResearch Paper

Motivation

On-demand delivery platforms for meals and groceries promise delivery within minutes, and the main operational lever they control is how a courier is dispatched. A courier can carry each order as soon as it is ready (dedicated delivery), or wait until two orders are available and deliver them in one trip (batch delivery). Batching saves travel per order but makes the first customer wait for a second order to arrive. Which mode gives the shorter wait, and hence the higher revenue, is a question practitioners face daily; it is the subject of M. Chen and M. Hu, Courier Dispatch in On-Demand Delivery (SSRN 3675063; published in Management Science, DOI 10.1287/mnsc.2023.4858).

The paper answers the question in closed form for a stylized disk model. This mission formalizes its first headline result, for the case in which the demand rate is fixed exogenously (for example by a growth target or by kitchen capacity), as stated in Propositions 1 and 2 of the authors' version dated 2022-09-21.

Setting

A vendor sits at the centre of a disk of radius r>0r>0r>0 and employs one courier with unit travel speed, so travel time equals travel distance. Customer orders arrive as a Poisson process of rate λ>0\lambda>0λ>0, the demand rate, and each customer's location is independent and uniformly distributed on the disk.

Under dedicated delivery each trip is a round trip to one customer, of length XD=2∥U∥X_D=2\|U\|XD​=2∥U∥ with UUU uniform on the disk. Its moments are E[XD]=43r\mathbb E[X_D]=\tfrac43 rE[XD​]=34​r and E[XD2]=2r2\mathbb E[X_D^2]=2r^2E[XD2​]=2r2, so the courier is an M/G/1 server with

μD=34r,CD=98,\mu_D=\frac{3}{4r},\qquad C_D=\frac98 ,μD​=4r3​,CD​=89​,

where μD\mu_DμD​ is the service rate and CDC_DCD​ the summed coefficients of variation. The paper defines the expected wait under dedicated delivery as the M/G/1 in-line delay

WD(λ,μ,C)=λμ(μ−λ)⋅C2.W_D(\lambda,\mu,C)=\frac{\lambda}{\mu(\mu-\lambda)}\cdot\frac C2 .WD​(λ,μ,C)=μ(μ−λ)λ​⋅2C​.

Under batch delivery the courier leaves only with two orders and visits both, so a trip has length XB=∥U∥+∥U−U′∥+∥U′∥X_B=\|U\|+\|U-U'\|+\|U'\|XB​=∥U∥+∥U−U′∥+∥U′∥ for two independent uniform points, with E[XB]=(12845π+43)r\mathbb E[X_B]=\big(\tfrac{128}{45\pi}+\tfrac43\big)rE[XB​]=(45π128​+34​)r. This gives

μB=45π4r(32+15π),\mu_B=\frac{45\pi}{4r(32+15\pi)},μB​=4r(32+15π)45π​,

and a variability coefficient CB≈0.583C_B\approx 0.583CB​≈0.583 that the paper obtains by numerical integration. The paper defines the batch wait as the time for a second order to arrive, plus Kingman's approximation of the E2_22​/G/1 in-line delay, plus the expected delay of being second in a batch:

WB(λ,μ,C)=12λ+λμ(2μ−λ)⋅C2+r3.W_B(\lambda,\mu,C)=\frac1{2\lambda}+\frac{\lambda}{\mu(2\mu-\lambda)}\cdot\frac C2+\frac r3 .WB​(λ,μ,C)=2λ1​+μ(2μ−λ)λ​⋅2C​+3r​.

Customers have valuations with c.d.f. FFF on [0,1][0,1][0,1] and a wait cost c>0c>0c>0 per unit time; at price ppp the potential arrival rate Λr2\Lambda r^2Λr2 thins to λ\lambdaλ. The vendor's revenue rate at demand rate λ\lambdaλ and expected wait www is

V(λ,w)=λ[F−1(1−λΛr2)−c w].V(\lambda,w)=\lambda\Big[F^{-1}\Big(1-\frac{\lambda}{\Lambda r^2}\Big)-c\,w\Big].V(λ,w)=λ[F−1(1−Λr2λ​)−cw].

Dedicated delivery is stable exactly when λr<34\lambda r<\tfrac34λr<43​; batch delivery when λr<T2=45π2(32+15π)≈0.893\lambda r<T_2=\frac{45\pi}{2(32+15\pi)}\approx0.893λr<T2​=2(32+15π)45π​≈0.893.

Formalization targets

Goal: one threshold in λr\lambda rλr (Propositions 1 and 2)

For every CB∈[0.58,0.59]C_B\in[0.58,0.59]CB​∈[0.58,0.59] there is a constant a1∈(0,34)a_1\in(0,\tfrac34)a1​∈(0,43​) such that for all r>0r>0r>0, λ>0\lambda>0λ>0 with λr<34\lambda r<\tfrac34λr<43​,

WD(λ,μD,CD)<WB(λ,μB,CB)  ⟺  λr<a1,WB(λ,μB,CB)<WD(λ,μD,CD)  ⟺  λr>a1,W_D(\lambda,\mu_D,C_D)<W_B(\lambda,\mu_B,C_B)\iff \lambda r<a_1,\qquad W_B(\lambda,\mu_B,C_B)<W_D(\lambda,\mu_D,C_D)\iff \lambda r>a_1,WD​(λ,μD​,CD​)<WB​(λ,μB​,CB​)⟺λr<a1​,WB​(λ,μB​,CB​)<WD​(λ,μD​,CD​)⟺λr>a1​,

and the same two equivalences hold for the revenues V(λ,WD)V(\lambda,W_D)V(λ,WD​) and V(λ,WB)V(\lambda,W_B)V(λ,WB​), for every F−1F^{-1}F−1, every Λ>0\Lambda>0Λ>0 with λ≤Λr2\lambda\le\Lambda r^2λ≤Λr2, and every c>0c>0c>0. The paper reports a1≈0.5689a_1\approx0.5689a1​≈0.5689; the goal asserts only the existence and the location in (0,34)(0,\tfrac34)(0,43​).

Milestones

  1. The dedicated trip moments E[XD]=43r\mathbb E[X_D]=\tfrac43rE[XD​]=34​r, E[XD2]=2r2\mathbb E[X_D^2]=2r^2E[XD2​]=2r2, and the resulting μD\mu_DμD​, CDC_DCD​ (display (3)).
  2. The mean batch trip E[XB]=(12845π+43)r\mathbb E[X_B]=(\tfrac{128}{45\pi}+\tfrac43)rE[XB​]=(45π128​+34​)r and the resulting μB\mu_BμB​ (display (8), first moment).
  3. The reduction (A.1): WD(λ,μD,CD)−WB(λ,μB,CB)=fA(λr)/λW_D(\lambda,\mu_D,C_D)-W_B(\lambda,\mu_B,C_B)=f_A(\lambda r)/\lambdaWD​(λ,μD​,CD​)−WB​(λ,μB​,CB​)=fA​(λr)/λ for an explicit rational function fAf_AfA​ of one variable.
  4. The single crossing: fAf_AfA​ has exactly one zero a1a_1a1​ on (0,34)(0,\tfrac34)(0,43​), negative before and positive after, with 0.56<a1<0.580.56<a_1<0.580.56<a1​<0.58.
  5. Proposition 1: for each rrr, a threshold λex∈(0,μD)\lambda_{ex}\in(0,\mu_D)λex​∈(0,μD​) in the demand rate.
  6. Proposition 2: for each λ\lambdaλ, a threshold rex∈(0,34λ)r_{ex}\in(0,\tfrac3{4\lambda})rex​∈(0,4λ3​) in the radius.

Significance

The result says that, with demand fixed, the choice between dedicated and batch delivery depends on the market only through the product λr\lambda rλr: dedicated delivery is better when demand is low or the area small, batching when demand is high or the area large. The threshold is a single universal number, independent of the valuation distribution and of the wait-cost rate, because at a fixed demand rate the strategy with the shorter wait always earns more. This is the efficiency-driven benchmark against which the paper's second main result (endogenous demand in a crowded market, where the order reverses) is contrasted.

To our knowledge none of this has been machine-checked. The mission produces a checked version of the paper's closed-form comparison and, in milestones 1–2, checked computations of classical geometric-probability moments of the disk (the mean distance 128r/(45π)128r/(45\pi)128r/(45π) between two uniform points). The paper's own argument for the single crossing is numerical ("solved using standard methods"); a formal proof must replace it by an exact argument with rigorous bounds on π\piπ.

Difficulty

The reduction to one variable is algebra. The difficulty is the sign analysis of fAf_AfA​ on (0,34)(0,\tfrac34)(0,43​): it is a difference of two rational functions with poles at 34\tfrac3443​ and T2≈0.893T_2\approx0.893T2​≈0.893, involving π\piπ, and clearing denominators gives a cubic whose roots the paper only reports numerically. The natural first idea, showing fAf_AfA​ is monotone on the whole interval, does not apply directly, since fAf_AfA​ starts at −12-\tfrac12−21​, first decreases, and only later rises to +∞+\infty+∞; a proof must establish that it crosses zero exactly once. A further point is that CBC_BCB​ is not a closed-form number, so the crossing must be shown uniformly over an interval of values.

The moment milestones need integration in polar coordinates on the plane; the mean distance between two uniform points of a disk is a classical but nontrivial four-dimensional integral.

Formalization scope

All objects live in the namespace CourierDispatch.Exogenous. Real numbers are ℝ, λ\lambdaλ is lam, Λ\LambdaΛ is Lam, and F−1F^{-1}F−1 is an arbitrary function Q : ℝ → ℝ (no property of it is needed, since at equal λ\lambdaλ the price terms cancel). The plane is EuclideanSpace ℝ (Fin 2) and the uniform law on the disk is Lebesgue measure conditioned on the closed ball.

Committed conventions:

  • The expected waits are the paper's closed-form formulas (5) and (12): the M/G/1 in-line delay for dedicated delivery and Kingman's approximation for the E2_22​/G/1 batch queue. The paper introduces them as definitions (":=:=:="), and the mission does not formalize the queues behind them; no statement here is about the true stationary delay of an E2_22​/G/1 queue.
  • CBC_BCB​ is a real parameter with the standing hypothesis 0.58≤CB≤0.590.58\le C_B\le 0.590.58≤CB​≤0.59, which contains the paper's value 0.5830.5830.583 and a Monte-Carlo estimate 0.582970.582970.58297.
  • Every comparison is restricted to r>0r>0r>0, λ>0\lambda>0λ>0, λr<34\lambda r<\tfrac34λr<43​, the range where both queues are stable; above it only batch delivery is defined and the paper makes no comparison. This also keeps every formula away from Lean's junk values for division by zero.
  • Revenue comparisons additionally require Λ>0\Lambda>0Λ>0 and λ≤Λr2\lambda\le\Lambda r^2λ≤Λr2, the effective-demand range in §3, p. 8. The arbitrary function Q stands for F−1F^{-1}F−1; its properties cancel when the two strategies are compared at the same demand rate.
  • Both directions of each threshold are stated as strict equivalences, so equality at λr=a1\lambda r=a_1λr=a1​ follows.

The threshold a1a_1a1​ (and λex\lambda_{ex}λex​, rexr_{ex}rex​) is existential in every statement; it is never a definition and never an infimum of a sign set, and WDW_DWD​, WBW_BWB​ are never defined through fAf_AfA​, so the goal cannot be made true by construction.

Needed infrastructure: polar-coordinate integration on the plane (Mathlib's integral_comp_polarCoord_symm), and rigorous rational bounds on π\piπ (Real.pi_gt_d6, Real.pi_lt_d6). The goal does not depend on the moment milestones 1–2, which ground the constants μD\mu_DμD​, CDC_DCD​, μB\mu_BμB​ in the geometry of the disk and are welcome as separate contributions.

Selected references

  • M. Chen, M. Hu, Courier Dispatch in On-Demand Delivery, SSRN 3675063, version of 2022-09-21; Management Science, 2023. https://ssrn.com/abstract=3675063, https://doi.org/10.1287/mnsc.2023.4858
  • J. F. C. Kingman, On queues in heavy traffic, Journal of the Royal Statistical Society B 24 (1962). https://doi.org/10.1111/j.2517-6161.1962.tb00465.x
  • H. Solomon, Geometric Probability, SIAM CBMS-NSF Regional Conference Series 28, 1978. https://doi.org/10.1137/1.9781611970418
  • D. Gross, J. F. Shortle, J. M. Thompson, C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008. https://doi.org/10.1002/9781118625651
9 thms2 active usersReviewed
🏆Completed
OptimizationStatistics·Captain: mikedeng1

Subset Selection with Shrinkage: Sparse Linear Modeling When the SNR Is Low I: The Discrete First-Order Algorithm Is a Descent Method Whose Successive Steps Shrink at Rate O(1/M)Research Paper

Motivation

Best subset selection fits a linear model y≈Xβy\approx X\betay≈Xβ using at most kkk of the ppp available features: it minimizes the residual sum of squares subject to the sparsity constraint ∥β∥0≤k\|\beta\|_0\le k∥β∥0​≤k, where ∥β∥0\|\beta\|_0∥β∥0​ counts the nonzero coordinates of β\betaβ. Mazumder, Radchenko and Dedieu (arXiv:1708.03288v4; Operations Research, 2023) show that best subsets overfits when the signal-to-noise ratio is low, and propose adding a shrinkage penalty λ∥β∥q\lambda\|\beta\|_qλ∥β∥q​ with q∈{1,2}q\in\{1,2\}q∈{1,2} to the same constrained problem. Their statistical results (oracle inequalities, a lower bound for best subsets, a BIC-type choice of kkk) are the subject of the companion missions II–VI of this series.

The estimator is a mixed-integer program. To compute it in practice, and to warm-start the mixed-integer solver that certifies optimality, the paper uses a discrete first-order (DFO) method: a proximal-gradient iteration in which the proximal step is a projection-like operation onto the set of kkk-sparse vectors with a norm penalty. The method descends from iterative hard thresholding (Blumensath & Davies, 2009), from proximal gradient methods for composite problems (Nesterov, 2013), and from the discrete first-order algorithms of Bertsimas, King and Mazumder (Annals of Statistics, 2016). This mission formalizes the paper's convergence guarantee for it, Proposition 2.

Setting

Vectors live in Rp\mathbb R^pRp with the Euclidean inner product ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ and norm ∥⋅∥2\|\cdot\|_2∥⋅∥2​. Write ∥β∥0\|\beta\|_0∥β∥0​ for the number of nonzero coordinates and ∥β∥1=∑i∣βi∣\|\beta\|_1=\sum_i|\beta_i|∥β∥1​=∑i​∣βi​∣. For q∈{1,2}q\in\{1,2\}q∈{1,2} the penalty is the norm ∥β∥q\|\beta\|_q∥β∥q​ itself, not its qqq-th power.

Let f:Rp→Rf:\mathbb R^p\to\mathbb Rf:Rp→R be a differentiable convex function whose gradient is L0L_0L0​-Lipschitz:

∥∇f(β)−∇f(α)∥2≤L0∥β−α∥2∀ β,α.\|\nabla f(\beta)-\nabla f(\alpha)\|_2\le L_0\|\beta-\alpha\|_2\qquad\forall\,\beta,\alpha .∥∇f(β)−∇f(α)∥2​≤L0​∥β−α∥2​∀β,α.

The motivating case is f(β)=12∥y−Xβ∥22f(\beta)=\tfrac12\|y-X\beta\|_2^2f(β)=21​∥y−Xβ∥22​ with L0=σmax⁡(X)2L_0=\sigma_{\max}(X)^2L0​=σmax​(X)2. The composite problem (7) is

minimizeF(β):=f(β)+λ∥β∥qs.t.∥β∥0≤k.\text{minimize}\quad F(\beta):=f(\beta)+\lambda\|\beta\|_q\quad\text{s.t.}\quad\|\beta\|_0\le k .minimizeF(β):=f(β)+λ∥β∥q​s.t.∥β∥0​≤k.

For L∈RL\in\mathbb RL∈R the quadratic model of fff around α\alphaα is

QL(β;α)=f(α)+⟨∇f(α),β−α⟩+L2∥β−α∥22,Q_L(\beta;\alpha)=f(\alpha)+\langle\nabla f(\alpha),\beta-\alpha\rangle+\tfrac L2\|\beta-\alpha\|_2^2 ,QL​(β;α)=f(α)+⟨∇f(α),β−α⟩+2L​∥β−α∥22​,

and the thresholding operator is the set of minimizers

S(u;k;μℓq)=arg min⁡∥b∥0≤k 12∥b−u∥22+μ∥b∥q,\mathrm S(u;k;\mu\ell_q)=\operatorname*{arg\,min}_{\|b\|_0\le k}\ \tfrac12\|b-u\|_2^2+\mu\|b\|_q ,S(u;k;μℓq​)=∥b∥0​≤kargmin​ 21​∥b−u∥22​+μ∥b∥q​,

which can contain several points when the ∣uj∣|u_j|∣uj​∣ have ties. A DFO sequence with constant L>0L>0L>0 starts at a kkk-sparse β(1)\beta^{(1)}β(1) and, for m≥1m\ge1m≥1, picks any

β(m+1)∈S(β(m)−1L∇f(β(m)); k; λLℓq).\beta^{(m+1)}\in\mathrm S\Big(\beta^{(m)}-\tfrac1L\nabla f(\beta^{(m)});\,k;\,\tfrac\lambda L\ell_q\Big).β(m+1)∈S(β(m)−L1​∇f(β(m));k;Lλ​ℓq​).

Formalization targets

Goal: Proposition 2 (p. 10)

Assume in addition f≥0f\ge0f≥0 and λ≥0\lambda\ge0λ≥0. For every DFO sequence:

(a) if L≥L0L\ge L_0L≥L0​, then F(β(m))F(\beta^{(m)})F(β(m)) is non-increasing in m≥1m\ge1m≥1 and converges to some F∗≥0F^*\ge0F∗≥0;

(b) if L>L0L>L_0L>L0​, then for every M≥1M\ge1M≥1

min⁡1≤m≤M∥β(m+1)−β(m)∥22≤2(F(β(1))−F∗)M(L−L0).\min_{1\le m\le M}\|\beta^{(m+1)}-\beta^{(m)}\|_2^2\le\frac{2\big(F(\beta^{(1)})-F^*\big)}{M(L-L_0)} .1≤m≤Mmin​∥β(m+1)−β(m)∥22​≤M(L−L0​)2(F(β(1))−F∗)​.

The statement holds for any fff of the stated class and any choice in the set-valued operator; nothing about least squares is assumed.

Milestones (proof in Supplement A.1, p. 35)

  1. (9), p. 8: f(β)≤QL(β;α)f(\beta)\le Q_L(\beta;\alpha)f(β)≤QL​(β;α) for all α,β\alpha,\betaα,β and every L≥L0L\ge L_0L≥L0​, the bound the paper takes from Nesterov (2004).
  2. (20)–(21), p. 35: completing the square, QL(η,β)+λ∥η∥q=L2∥η−(β−1L∇f(β))∥22−12L∥∇f(β)∥22+f(β)+λ∥η∥qQ_L(\eta,\beta)+\lambda\|\eta\|_q=\tfrac L2\|\eta-(\beta-\tfrac1L\nabla f(\beta))\|_2^2-\tfrac1{2L}\|\nabla f(\beta)\|_2^2+f(\beta)+\lambda\|\eta\|_qQL​(η,β)+λ∥η∥q​=2L​∥η−(β−L1​∇f(β))∥22​−2L1​∥∇f(β)∥22​+f(β)+λ∥η∥q​. Hence the minimizers of QL(⋅,β)+λ∥⋅∥qQ_L(\cdot,\beta)+\lambda\|\cdot\|_qQL​(⋅,β)+λ∥⋅∥q​ over ∥η∥0≤k\|\eta\|_0\le k∥η∥0​≤k are exactly S(β−1L∇f(β);k;λLℓq)\mathrm S(\beta-\tfrac1L\nabla f(\beta);k;\tfrac\lambda L\ell_q)S(β−L1​∇f(β);k;Lλ​ℓq​).
  3. (22), p. 35: for ∥β∥0≤k\|\beta\|_0\le k∥β∥0​≤k and η^\hat\etaη^​ in that set, F(β)≥L−L02∥η^−β∥22+F(η^)F(\beta)\ge\tfrac{L-L_0}2\|\hat\eta-\beta\|_2^2+F(\hat\eta)F(β)≥2L−L0​​∥η^​−β∥22​+F(η^​).
  4. (23) and the next display, p. 35: summed over m=1,…,Mm=1,\dots,Mm=1,…,M,
F(β(1))−F(β(M+1))≥M(L−L0)2min⁡m≤M∥β(m+1)−β(m)∥22.F(\beta^{(1)})-F(\beta^{(M+1)})\ge\tfrac{M(L-L_0)}2\min_{m\le M}\|\beta^{(m+1)}-\beta^{(m)}\|_2^2 .F(β(1))−F(β(M+1))≥2M(L−L0​)​m≤Mmin​∥β(m+1)−β(m)∥22​.
  1. Proposition 1, p. 9 (companion, not used by the goal): every β^∈S(u;k;λℓq)\hat\beta\in\mathrm S(u;k;\lambda\ell_q)β^​∈S(u;k;λℓq​) keeps the kkk largest entries of uuu in magnitude, for some ordering of ties. For q=1q=1q=1 it soft-thresholds them coordinatewise, and for q=2q=2q=2 it shrinks them as a group by max⁡{τu−λ,0}/τu\max\{\tau_u-\lambda,0\}/\tau_umax{τu​−λ,0}/τu​, with τu\tau_uτu​ the norm of those kkk entries.

Significance

Proposition 2 is what makes the DFO method a sound component of the paper's computational pipeline. The objective values never increase, so every iterate is a feasible point at least as good as the warm start. Part (b) says that the step length ∥β(m+1)−β(m)∥22\|\beta^{(m+1)}-\beta^{(m)}\|_2^2∥β(m+1)−β(m)∥22​ is small after O(1/ϵ)O(1/\epsilon)O(1/ϵ) iterations. A point whose step vanishes is a fixed point of the update, which the paper calls a first-order stationary point (Definition 1). The stopping rule of the algorithm (∥β(m+1)−β(m)∥22≤τ\|\beta^{(m+1)}-\beta^{(m)}\|_2^2\le\tau∥β(m+1)−β(m)∥22​≤τ) is therefore reached in at most ⌈2(F(β(1))−F∗)/(τ(L−L0))⌉\lceil 2(F(\beta^{(1)})-F^*)/(\tau(L-L_0))\rceil⌈2(F(β(1))−F∗)/(τ(L−L0​))⌉ steps.

The result is proved in the paper, in half a page that defers its central inequality (22) to Proposition 6 of Bertsimas, King & Mazumder (2016). It has not been formalized. A machine-checked version produces three reusable pieces: a descent lemma for functions with Lipschitz gradient on Rp\mathbb R^pRp, the variational characterization of the sparse proximal step, and a sufficient-decrease-to-rate argument for any descent method. These are the same pieces that iterative hard thresholding, proximal gradient, and block-coordinate methods for ℓ0\ell_0ℓ0​ problems need.

Difficulty

The difficulty is moderate, and it lies in the infrastructure rather than in any single step. The descent lemma (9) needs the fundamental theorem of calculus along a segment for a function on a Euclidean space, combined with the Lipschitz bound on the gradient. The feasible set {∥β∥0≤k}\{\|\beta\|_0\le k\}{∥β∥0​≤k} is not convex, so no convex-analysis argument (subgradient optimality, firm nonexpansiveness of a proximal map) applies to the thresholding step. Inequality (22) must instead be obtained by comparing the minimizer η^\hat\etaη^​ with the feasible competitor β\betaβ itself, which is why the hypothesis ∥β∥0≤k\|\beta\|_0\le k∥β∥0​≤k appears. Part (a) also needs a lower bound on FFF for its limit to exist and be nonnegative, which the general class of fff does not provide on its own.

Formalization scope

Rp\mathbb R^pRp is EuclideanSpace ℝ (Fin p), the gradient is Mathlib's gradient f, and coordinates are 000-based. Membership in S(u;k;μℓq)\mathrm S(u;k;\mu\ell_q)S(u;k;μℓq​) is a predicate: feasibility plus minimality against every kkk-sparse competitor. No selection from the set is fixed, and existence of minimizers is not assumed. A DFO sequence is any β : ℕ → ℝᵖ satisfying the update for every m≥1m\ge1m≥1, indexed from 111 as printed. The stopping rule and the support-restricted polishing Step 2 are not part of it. The penalty is ∥⋅∥1\|\cdot\|_1∥⋅∥1​ for q=1q=1q=1 and the Euclidean norm for q=2q=2q=2, and every theorem assumes q∈{1,2}q\in\{1,2\}q∈{1,2} and k≥1k\ge1k≥1. The minimum over 1≤m≤M1\le m\le M1≤m≤M is a finite infimum over a nonempty index set.

Three hypotheses are added to Proposition 2 as printed, each disclosed in the item. The proof's claim "F(β)≥0F(\beta)\ge0F(β)≥0" is false for a general convex fff with Lipschitz gradient (f(β)=−β1f(\beta)=-\beta_1f(β)=−β1​ sends FFF to −∞-\infty−∞), so f≥0f\ge0f≥0 and λ≥0\lambda\ge0λ≥0 are assumed. The update divides by LLL, and L≥L0L\ge L_0L≥L0​ allows L=0L=0L=0, so L>0L>0L>0 is assumed. "Decreasing" is read as non-increasing. Convexity of fff is kept as in the paper's setting (7)–(8), though only the gradient bound is used. Proposition 1 is stated with an existential ordering: for a fixed sorting permutation the printed claim fails under ties.

The statement cannot be trivialized by restricting fff or the run. The goal quantifies over every fff of the class and every sequence obeying the update, the limit F∗F^*F∗ in (b) is the actual limit of the objective values, and the rate holds for every M≥1M\ge1M≥1. Not formalized here: the mixed-integer formulations, the continuation and local-search heuristics of §2.4, Definition 1, and the paper's statistical results (missions II–VI). Contributions of reusable infrastructure, such as a general descent lemma or a lemma turning summed decrease into a 1/M1/M1/M rate, are welcome as separate theorems.

Selected references

  • R. Mazumder, P. Radchenko, A. Dedieu, Subset Selection with Shrinkage: Sparse Linear Modeling When the SNR Is Low, arXiv:1708.03288v4, 2022; Operations Research 71(1), 2023. https://arxiv.org/abs/1708.03288v4
  • D. Bertsimas, A. King, R. Mazumder, Best Subset Selection via a Modern Optimization Lens, Annals of Statistics 44(2), 2016. https://doi.org/10.1214/15-AOS1388
  • Y. Nesterov, Gradient Methods for Minimizing Composite Functions, Mathematical Programming 140, 2013. https://doi.org/10.1007/s10107-012-0629-5
  • Y. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Kluwer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
  • T. Blumensath, M. E. Davies, Iterative Hard Thresholding for Compressed Sensing, Applied and Computational Harmonic Analysis 27(3), 2009. https://doi.org/10.1016/j.acha.2009.04.002
7 thms2 active usersReviewed
🏆Completed
EconomicsInformation TheoryOptimization·Captain: mikedeng1

Human and Machine: The Impact of Machine Input on Decision-Making Under Cognitive Limitations I: The Rationally Inattentive Decision-Maker's Optimal Choice Probability in Closed FormResearch Paper

Motivation

A person using a machine's advice may decide more accurately, but attention is costly. Before asking what a machine changes, the baseline decision has to be understood: how often would the person choose the action associated with a good state without machine input? Boyacı, Canyakmaz, and de Véricourt study this question in a model of a decision maker who can acquire information about an unknown binary state and pays for the expected reduction in uncertainty. Their working paper derives a closed form for the decision maker's choice probability. That baseline is used later in the paper to compare decisions with and without machine input.

The information cost follows the rational inattention approach: a decision maker chooses how much information to process while considering its effect on the final action. In the discrete choice setting, Matějka and McKay (2015) characterize optimal conditional choice probabilities. The paper adopts their equivalent choice probability representation in §4. This mission isolates the first consequence of that representation, Theorem 1, before the paper introduces the machine.

Setting

The unknown state is good, ggg, with prior probability μ\muμ, and bad, bbb, with probability 1−μ1-\mu1−μ. The decision maker selects either yyy (declare good) or nnn (declare bad). A correct action earns one unit, and an incorrect action earns zero. Write pgp_gpg​ for the probability of choosing yyy when the state is ggg, and pbp_bpb​ for the probability of choosing yyy when the state is bbb. A strategy is any pair (pg,pb)∈[0,1]2(p_g,p_b)\in[0,1]^2(pg​,pb​)∈[0,1]2; the pair may lie on the no-information diagonal or on the boundary of the square.

The unconditional choice probability is p=μpg+(1−μ)pbp=\mu p_g+(1-\mu)p_bp=μpg​+(1−μ)pb​. The accuracy is A=μpg+(1−μ)(1−pb)A=\mu p_g+(1-\mu)(1-p_b)A=μpg​+(1−μ)(1−pb​). Binary entropy, measured with the natural logarithm, is H(t)=−tlog⁡t−(1−t)log⁡(1−t)H(t)=-t\log t-(1-t)\log(1-t)H(t)=−tlogt−(1−t)log(1−t), with H(0)=H(1)=0H(0)=H(1)=0H(0)=H(1)=0. Given an information-cost parameter λ>0\lambda>0λ>0, the cognitive cost in the paper's choice probability representation is

C=λ[H(p)−(1−μ)H(pb)−μH(pg)].C=\lambda\bigl[H(p)-(1-\mu)H(p_b)-\mu H(p_g)\bigr].C=λ[H(p)−(1−μ)H(pb​)−μH(pg​)].

The decision maker maximizes net value V=A−CV=A-CV=A−C over the whole square. An optimal pair is one whose value is at least that of every feasible pair. The source originally introduces a general distribution of information signals and a Bayes consistency condition in problem (2). Section 4 and footnote 8 adopt the equivalent conditional choice probability representation used here. The equivalence itself is an input from Matějka and McKay (2015), rather than a claim of this mission.

Formalization targets

Optimal choice probability

For 0<μ<10<\mu<10<μ<1 and λ>0\lambda>0λ>0, define the thresholds

μ‾(λ)=1e1/λ+1,μ‾(λ)=e1/λe1/λ+1.\underline\mu(\lambda)=\frac{1}{e^{1/\lambda}+1},\qquad \overline\mu(\lambda)=\frac{e^{1/\lambda}}{e^{1/\lambda}+1}.μ​(λ)=e1/λ+11​,μ​(λ)=e1/λ+1e1/λ​.

The goal is the paper's Theorem 1: every optimal pair has the same unconditional choice probability,

p⋆(μ)={0,μ≤μ‾,μ1−e−1/λ−1−μe1/λ−1,μ‾<μ<μ‾,1,μ≥μ‾.p^\star(\mu)= \begin{cases} 0,&\mu\le\underline\mu,\\ \displaystyle\frac{\mu}{1-e^{-1/\lambda}}-\frac{1-\mu}{e^{1/\lambda}-1},&\underline\mu<\mu<\overline\mu,\\ 1,&\mu\ge\overline\mu. \end{cases}p⋆(μ)=⎩⎨⎧​0,1−e−1/λμ​−e1/λ−11−μ​,1,​μ≤μ​,μ​<μ<μ​,μ≥μ​.​

The same theorem states μ‾<1/2<μ‾\underline\mu<1/2<\overline\muμ​<1/2<μ​, that p⋆p^\starp⋆ is non-decreasing in the prior, and that the lower threshold increases while the upper threshold decreases as λ\lambdaλ increases. This mission includes all these clauses in its single goal. The intermediate milestones formalize the paper's conditional choice equations, the algebraic interior candidate, its threshold crossings, and its slope and threshold derivatives.

Significance

The formula partitions prior beliefs into three regimes. With a sufficiently low prior, the decision maker always chooses nnn; with a sufficiently high prior, the decision maker always chooses yyy. Between the thresholds, the probability of choosing yyy changes continuously with the prior. The threshold movements describe how a higher information cost changes the region in which information processing affects the choice. In the paper, these probabilities feed into accuracy, error rate, effort, and machine input comparisons.

The paper proves the result mathematically. The statements here are open Lean targets, so compilation of their declarations does not amount to machine-checked proofs. A complete development would verify the optimality characterization and the closed form, then provide reusable binary entropy and constrained optimization lemmas. It would also expose a precise baseline that subsequent missions can import after publication.

Difficulty

Equations (4)–(6) alone do not select the optimum: both p=0p=0p=0 and p=1p=1p=1 satisfy them for every prior. The printed uniqueness phrase in Lemma 1 therefore cannot be carried into a theorem about all solutions of those equations. The formal target says instead that every maximizing strategy satisfies the conditional choice equations, and Theorem 1 identifies the probability selected by maximization. The endpoint strategies, where entropy is evaluated at zero or one, must remain in the feasible set. One must also distinguish the algebraic interior root from the optimizer when that root leaves [0,1][0,1][0,1].

Formalization scope

Lean represents probabilities and costs as real numbers. The strategy space is the full closed square [0,1]2[0,1]^2[0,1]2, and IsOptimal compares net value against every point in that square. The prior in the goal and Lemma 1 lies strictly between zero and one, as in the paper's §4 setting; λ\lambdaλ is strictly positive. Boolean state and action types are unnecessary in this first mission because the paper's §4 representation is already the pair of conditional probabilities. The general-signal distribution of problem (2) is not encoded here.

The entropy function is Mathlib's Real.binEntropy, with natural logarithms and the endpoint values used by the paper. The threshold definitions reproduce Theorem 1 exactly. pBar is the interior algebraic expression from Appendix A, and pClosed is only the right-hand side of equation (11). Neither defines the optimizer. In particular, defining the starred optimal probability by the closed form would remove the theorem's main claim. The goal quantifies over every optimal pair and asserts that its computed choice probability equals that expression.

Contributions to the proof will need results about binary entropy at the boundary, derivatives of the objective in the interior, existence and characterization of maximizers on a compact square, and elementary inequalities for the exponential thresholds. The entropy and compact optimization infrastructure can support later formalizations beyond this paper. The four listed milestones follow the authors' Appendix A argument; alternative proofs of the same faithful statements are welcome.

Selected references

  • Tamer Boyacı, Caner Canyakmaz, and Francis de Véricourt, Human and Machine: The Impact of Machine Input on Decision-Making Under Cognitive Limitations, ESMT Working Paper 20-02, November 30, 2020, §§3–4 and Appendix A. Working paper record.
  • Filip Matějka and Alisdair McKay, Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model, American Economic Review 105(1), 2015, pp. 272–298. DOI.
6 thms2 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

Selection and Ordering Policies for Hiring Pipelines via Linear Programming 4: For Every τ ∈ (0, 1) Some τ-Bounded Instance Gives No Value-Ordered Policy More Than (β^τ_k + ε) Times the OptimumResearch Paper

Why offer sets with overbooking matter

A firm with kkk open positions often cannot interview and offer sequentially: hiring seasons are short, and offers go out in one batch. Some recipients decline, so the firm overbooks, sending more offers than it has positions, and pays for every hire beyond capacity. The same trade-off appears in airline and hotel overbooking and in university admissions. Epstein and Ma (arXiv:2210.04059v3, Operations Research 2024) study this Simultaneous Offering problem as one of three hiring-pipeline models, and analyse the natural class of value-ordered policies, which offer to the best candidates first. Their Theorem 3 shows that a value-ordered policy built from a linear-programming relaxation guarantees a fraction αkτ\alpha^\tau_kαkτ​ of the optimum when every value is at least τ\tauτ. This mission formalizes the converse, Theorem 4: no value-ordered policy can guarantee more than βkτ\beta^\tau_kβkτ​.

Setting

An instance has k≥1k \ge 1k≥1 positions and n≥kn \ge kn≥k candidates. Candidate iii accepts an offer with probability pi∈[0,1]p_i \in [0,1]pi​∈[0,1], independently of the others, and then adds value vi≥0v_i \ge 0vi​≥0. The firm chooses a set SSS of candidates and sends all offers at once. If A⊆SA \subseteq SA⊆S is the random set of acceptances, the reward is

∑i∈Avi−[ ∣A∣−k ]+,\sum_{i \in A} v_i - [\,|A| - k\,]^+,i∈A∑​vi​−[∣A∣−k]+,

so each hire beyond capacity costs 111 (the paper rescales values so that this cost is 111). Write R(I,S)R(I, S)R(I,S) for the expected reward of offering to SSS, and OPTsim(I)=max⁡SR(I,S)\mathrm{OPT}_{\mathrm{sim}}(I) = \max_S R(I, S)OPTsim​(I)=maxS​R(I,S) for the best expected reward; randomizing over offer sets cannot do better.

Candidates are labelled so that v1≥v2≥⋯≥vnv_1 \ge v_2 \ge \cdots \ge v_nv1​≥v2​≥⋯≥vn​. A value-ordered policy with parameter m∈[n]m \in [n]m∈[n] offers to {1,…,m}\{1, \dots, m\}{1,…,m}. An instance is τ\tauτ-bounded, I∈IsimτI \in \mathcal{I}^\tau_{\mathrm{sim}}I∈Isimτ​, if vi≥τv_i \ge \tauvi​≥τ for all iii. Without such a bound value-ordered policies can be arbitrarily poor (§6.1); τ\tauτ measures how soft the capacity is, from nearly hard (τ\tauτ close to 000) to nearly compensated by any hire (τ\tauτ close to 111), and both theorems take τ∈(0,1)\tau \in (0,1)τ∈(0,1).

For λ≥0\lambda \ge 0λ≥0 let E[min⁡{Pois(λ),k}]\mathbb{E}[\min\{\mathrm{Pois}(\lambda), k\}]E[min{Pois(λ),k}] be the mean of a Poisson variable truncated at kkk, and

fk,τ(s)=s−sτ+E[min⁡{Pois(sk),k}]τk,αkτ=sup⁡0≤s≤1fk,τ(s),βkτ=sup⁡s≥0fk,τ(s).f_{k,\tau}(s) = s - \frac{s}{\tau} + \frac{\mathbb{E}[\min\{\mathrm{Pois}(sk), k\}]}{\tau k}, \qquad \alpha^\tau_k = \sup_{0 \le s \le 1} f_{k,\tau}(s), \qquad \beta^\tau_k = \sup_{s \ge 0} f_{k,\tau}(s).fk,τ​(s)=s−τs​+τkE[min{Pois(sk),k}]​,αkτ​=0≤s≤1sup​fk,τ​(s),βkτ​=s≥0sup​fk,τ​(s).

In Lean these are SimInstance, reward, OPTsim, valueOrdered, TauBounded, expMinPois, ratioObj, alpha and beta in the namespace HiringLP.SimUpper.

Formalization targets

Goal: Theorem 4 (p. 30)

For every k≥1k \ge 1k≥1, ε>0\varepsilon > 0ε>0 and τ∈(0,1)\tau \in (0,1)τ∈(0,1) there is a valid, sorted instance I∈IsimτI \in \mathcal{I}^\tau_{\mathrm{sim}}I∈Isimτ​ with kkk positions such that

R(I,{1,…,m})≤(βkτ+ε) OPTsim(I)for every m∈[n].R(I, \{1, \dots, m\}) \le (\beta^\tau_k + \varepsilon)\,\mathrm{OPT}_{\mathrm{sim}}(I) \quad \text{for every } m \in [n].R(I,{1,…,m})≤(βkτ​+ε)OPTsim​(I)for every m∈[n].

Milestones on the hard instance (App. D.7)

The instance has j2j^2j2 type-1 candidates with pi=k/jp_i = k/jpi​=k/j, vi=τ+δv_i = \tau + \deltavi​=τ+δ, δ=ετ/j\delta = \varepsilon\tau/jδ=ετ/j, and kkk type-2 candidates with pi=1p_i = 1pi​=1, vi=τv_i = \tauvi​=τ. With B∼Bin(m,k/j)B \sim \mathrm{Bin}(m, k/j)B∼Bin(m,k/j) and 0≤m≤j20 \le m \le j^20≤m≤j2:

OPTsim(I)≥kτ,\mathrm{OPT}_{\mathrm{sim}}(I) \ge k\tau,OPTsim​(I)≥kτ, R(I,{1,…,m})=(τ+δ)kmj+E[min⁡{0,k−B}]≤k+kmj(τ+δ−Pr⁡[B>k])(EC.15),R(I, \{1,\dots,m\}) = (\tau + \delta)\frac{km}{j} + \mathbb{E}[\min\{0, k - B\}] \le k + \frac{km}{j}\bigl(\tau + \delta - \Pr[B > k]\bigr) \quad \text{(EC.15)},R(I,{1,…,m})=(τ+δ)jkm​+E[min{0,k−B}]≤k+jkm​(τ+δ−Pr[B>k])(EC.15), R(I,{1,…,m})≤εkτ+kmj(τ−1)+E[min⁡{k,B}](EC.18).R(I, \{1,\dots,m\}) \le \varepsilon k \tau + \frac{km}{j}(\tau - 1) + \mathbb{E}[\min\{k, B\}] \quad \text{(EC.18)}.R(I,{1,…,m})≤εkτ+jkm​(τ−1)+E[min{k,B}](EC.18).

Companions: the maximisers (App. D.8)

Proposition EC.5: optimal sα∗s^*_\alphasα∗​, sβ∗s^*_\betasβ∗​ exist, sα∗=min⁡{sβ∗,1}s^*_\alpha = \min\{s^*_\beta, 1\}sα∗​=min{sβ∗​,1}, and τ=1−e−sβ∗k∑j<k(sβ∗k)j/j!\tau = 1 - e^{-s^*_\beta k}\sum_{j<k} (s^*_\beta k)^j/j!τ=1−e−sβ∗​k∑j<k​(sβ∗​k)j/j!. Proposition EC.6: sα∗=sβ∗s^*_\alpha = s^*_\betasα∗​=sβ∗​ if and only if τ≤1−e−k∑j<kkj/j!\tau \le 1 - e^{-k}\sum_{j<k} k^j/j!τ≤1−e−k∑j<k​kj/j!, which holds whenever τ≤1/2\tau \le 1/2τ≤1/2.

Significance

Theorem 4 bounds what any value-ordered policy can guarantee on τ\tauτ-bounded instances, against the true optimum rather than an LP relaxation. With Theorem 3 it brackets the best guarantee of the class between αkτ\alpha^\tau_kαkτ​ and βkτ\beta^\tau_kβkτ​, and by Proposition EC.6 the two coincide when τ≤Pr⁡[Pois(k)≥k]\tau \le \Pr[\mathrm{Pois}(k) \ge k]τ≤Pr[Pois(k)≥k], in particular for all kkk when τ≤1/2\tau \le 1/2τ≤1/2. In that region the paper's truncated-LP policy is the best value-ordered policy in the worst case. The instance also shows why the restriction to value-ordered policies costs something: the optimum offers to the reliable type-2 candidates, while a value-ordered policy must first exhaust the slightly more valuable unreliable ones.

The results are proved in the paper. None of them has a machine-checked proof; this mission produces a formal version of Theorem 4 and the finite-jjj estimates on which its proof rests, together with a reusable finite-sum encoding of independent acceptances, truncated Poisson and Binomial expectations, and the constants αkτ\alpha^\tau_kαkτ​, βkτ\beta^\tau_kβkτ​.

Difficulty

The milestones are exact identities and inequalities at a fixed jjj; the hard part is the passage to the limit. The page's proof lets j→∞j \to \inftyj→∞ with mj/j→sm_j/j \to smj​/j→s and replaces Bin(mj,k/j)\mathrm{Bin}(m_j, k/j)Bin(mj​,k/j) by Pois(sk)\mathrm{Pois}(sk)Pois(sk). The goal, however, asks for one finite instance on which the bound holds for every mmm simultaneously, including mmm of order j2j^2j2 and the values m>j2m > j^2m>j2 that also offer to type-2 candidates. A pointwise limit for each fixed sss does not give this; the Binomial–Poisson error has to be controlled uniformly in mmm, and the error must fit inside the slack ε\varepsilonε, part of which the term δ\deltaδ already uses. Note also that the comparison runs the wrong way for the obvious argument: min⁡{⋅,k}\min\{\cdot, k\}min{⋅,k} is concave and the Binomial is less spread than the Poisson, so E[min⁡{k,B}]\mathbb{E}[\min\{k, B\}]E[min{k,B}] is at least its Poisson counterpart and a one-sided comparison cannot replace an approximation bound.

Formalization scope

All randomness is finite. The expected reward is an explicit sum over the 2n2^n2n accepting sets with product probabilities; the Binomial pmf, its truncated mean and its tail are finite sums written by hand. The truncated Poisson mean is the series with the Poisson pmf. All quantities are real. Candidates are Fin n, so the paper's candidate iii is index i−1i - 1i−1; sortedness is the hypothesis Antitone v in Valid, which also contains 1≤k≤n1 \le k \le n1≤k≤n, p∈[0,1]np \in [0,1]^np∈[0,1]n and v≥0v \ge 0v≥0. OPTsim\mathrm{OPT}_{\mathrm{sim}}OPTsim​ is the maximum over all offer sets, never over value-ordered ones. βkτ\beta^\tau_kβkτ​ is the supremum over [0,∞)[0, \infty)[0,∞) and αkτ\alpha^\tau_kαkτ​ over [0,1][0, 1][0,1]. The page leaves kkk implicit in βkτ\beta^\tau_kβkτ​; the goal quantifies over every k≥1k \ge 1k≥1 and requires the instance to have exactly kkk positions. The quantifiers are "for all k,ε,τk, \varepsilon, \tauk,ε,τ, there is an instance, for all mmm".

The goal does not fix the hard instance: any instance proves it. A formalization in which the comparison is with the best value-ordered policy, in which βkτ\beta^\tau_kβkτ​ is a free parameter, or in which the reward is defined by the proof's Binomial formula would be a different statement and is ruled out by the definitions above. The definitions are not specialized to the hard instance, which appears only as a separate definition used by the milestones.

A complete development needs: finite sums over subsets with product weights and the reduction to a Binomial count for identical candidates; summability and continuity of the truncated Poisson mean; a Binomial–Poisson approximation bound uniform in the number of trials; concavity of fk,τf_{k,\tau}fk,τ​ in sss. The Poisson and Binomial infrastructure is reusable well beyond this mission. Proofs of the milestones, of the companions, and of auxiliary approximation lemmas are all welcome.

Selected references

  • B. Epstein, W. Ma, Selection and Ordering Policies for Hiring Pipelines via Linear Programming, arXiv:2210.04059v3, 2023; Operations Research, 2024. https://arxiv.org/abs/2210.04059
  • M. Mitzenmacher, E. Upfal, Probability and Computing, 2nd ed., Cambridge University Press, 2017 (Exercise 5.14, cited for Pr⁡[Pois(k)≥k]≥1/2\Pr[\mathrm{Pois}(k) \ge k] \ge 1/2Pr[Pois(k)≥k]≥1/2). https://doi.org/10.1017/9781316651124
  • A. D. Barbour, P. Hall, On the rate of Poisson convergence, Mathematical Proceedings of the Cambridge Philosophical Society 95, 1984. https://doi.org/10.1017/S0305004100061402
11 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Designing Approximately Optimal Search on Matching Platforms 2: Every Set of Assortments Has a Unique Profile of Thresholds Equal to Expected UtilitiesResearch Paper

Motivation

Online matching platforms for dating, freelancing or ride sharing do not match agents themselves. They decide whom each agent gets to see and how often, and the agents then accept or reject. Immorlica, Lucier, Manshadi and Wei (arXiv:2102.09017, Management Science 2023) model this as directed search. The platform designs assortments, which are rates at which types of agents meet, and the agents play an equilibrium of the induced search game. The platform's design problem only makes sense if every choice of assortments leads to a single, well-defined equilibrium outcome. Otherwise "the welfare of an assortment" is not a function of the assortment. This is not automatic: even for simple asymmetric preferences under random meetings, multiple stationary equilibria can arise (Burdett and Coles 1997).

This mission formalizes that well-posedness result, Proposition 3.1(1) of the paper, together with the fixed-point and iteration lemmas of Appendix A.3 and Appendix B.3 on which its proof rests. It is the companion of the mission on the paper's quarter-approximation theorem (Theorem 4.1), which uses the same model.

The source is the arXiv v2 preprint (18 Aug 2021). The Management Science version may number results differently.

Setting

There are finitely many agent types on each side of the market, a set M\mathcal MM and a set W\mathcal WW, with Θ=M∪W\Theta=\mathcal M\cup\mathcal WΘ=M∪W. Agents of every type leave the market unmatched at a life-event rate δ>0\delta>0δ>0, and type θ\thetaθ arrives at rate αθ>0\alpha_\theta>0αθ​>0. When an agent of type mmm meets an agent of type www, the pair draws one utility u∼Fmwu\sim F_{mw}u∼Fmw​. Valuations are symmetric: both agents receive uuu if they match, and Fwm:=FmwF_{wm}:=F_{mw}Fwm​:=Fmw​. Each FmwF_{mw}Fmw​ is a probability law on R\mathbb RR with no atoms (a "continuous distribution").

An assortment for type θ\thetaθ is a family of rates λθ(θ′)≥0\lambda_\theta(\theta')\ge0λθ​(θ′)≥0 at which type-θ\thetaθ agents meet type-θ′\theta'θ′ agents on the opposite side. Under a threshold strategy with threshold τθ\tau_\thetaτθ​, a type-θ\thetaθ agent accepts a meeting if and only if u≥τθu\ge\tau_\thetau≥τθ​. A meeting turns into a match when both agents accept, i.e. when u≥max⁡(τθ,τθ′)u\ge\max(\tau_\theta,\tau_{\theta'})u≥max(τθ​,τθ′​). If every type plays a threshold strategy, the expected utility of a type-θ\thetaθ agent is (equation (5))

uˉθ(τ)=∑θ′λθ(θ′)∫max⁡(τθ,τθ′)∞u dFθθ′δ+∑θ′λθ(θ′)∫max⁡(τθ,τθ′)∞dFθθ′.\bar u_\theta(\tau)=\frac{\sum_{\theta'}\lambda_\theta(\theta')\int_{\max(\tau_\theta,\tau_{\theta'})}^\infty u\,dF_{\theta\theta'}}{\delta+\sum_{\theta'}\lambda_\theta(\theta')\int_{\max(\tau_\theta,\tau_{\theta'})}^\infty dF_{\theta\theta'}} .uˉθ​(τ)=δ+∑θ′​λθ​(θ′)∫max(τθ​,τθ′​)∞​dFθθ′​∑θ′​λθ​(θ′)∫max(τθ​,τθ′​)∞​udFθθ′​​.

A type's own threshold enters its own utility through max⁡(τθ,τθ′)\max(\tau_\theta,\tau_{\theta'})max(τθ​,τθ′​).

One type's equation. Fix the thresholds τi\tau_iτi​ of the opposite types. Write B(t)B(t)B(t) for the right-hand side of (5) with τθ\tau_\thetaτθ​ replaced by ttt. Lemma A.3 states that t=B(t)t=B(t)t=B(t) has exactly one solution. The best-response map of Appendix A.3 sends a profile τ\tauτ to the profile in which each type's new threshold is that solution, computed against the opposite side's thresholds in τ\tauτ. A best-response sequence starts at the all-zero profile and applies this map repeatedly.

Formalization targets

Goal: Proposition 3.1, item 1 (fixed-point form)

For any fixed assortments there is exactly one threshold profile τ∈RM×RW\tau\in\mathbb R^{\mathcal M}\times\mathbb R^{\mathcal W}τ∈RM×RW with

τθ=uˉθ(τ)for every θ∈Θ.\tau_\theta=\bar u_\theta(\tau)\qquad\text{for every }\theta\in\Theta .τθ​=uˉθ​(τ)for every θ∈Θ.

Uniqueness ranges over all real profiles.

Milestones

  1. Lemma B.1 (p. 40). With λi>0\lambda_i>0λi​>0 and τi≥0\tau_i\ge0τi​≥0, ρ=max⁡t≥0B(t)\rho=\max_{t\ge0}B(t)ρ=maxt≥0​B(t) is attained and satisfies B(ρ)=ρB(\rho)=\rhoB(ρ)=ρ. BBB is weakly increasing on (−∞,ρ](-\infty,\rho](−∞,ρ] and weakly decreasing on [ρ,∞)[\rho,\infty)[ρ,∞).
  2. Lemma A.3 (p. 35). With λi≥0\lambda_i\ge0λi​≥0 and arbitrary τi\tau_iτi​, the equation t=B(t)t=B(t)t=B(t) has exactly one real solution.
  3. §A.3, p. 37, first claim. Along a best-response sequence τ(0)≡0,τ(1),…\tau^{(0)}\equiv0,\tau^{(1)},\dotsτ(0)≡0,τ(1),…, the odd iterates are weakly decreasing and the even iterates are weakly increasing, componentwise.
  4. §A.3, p. 37, second claim. Every odd iterate dominates every even iterate: τ(2j)≤τ(2i+1)\tau^{(2j)}\le\tau^{(2i+1)}τ(2j)≤τ(2i+1).
  5. Proposition A.4 (p. 36). There is a universal CCC such that τ(C∣Θ∣)\tau^{(C|\Theta|)}τ(C∣Θ∣) is a fixed point of the best-response map, and the sequence is constant from that index on.

Significance

Proposition 3.1 is what makes the platform's problem OptimalDirectedSearch well defined. Assortments determine a unique threshold profile. That profile determines the matching rates (Lemma 3.2) and, through stationarity, the population masses. Welfare is then a function of the assortments, and the program (6) used for Theorem 4.1 encodes exactly this fixed point as its incentive constraint (6e). The constructive proof also yields an algorithm: iterate best responses from zero, and the iteration stops after O(∣Θ∣)O(|\Theta|)O(∣Θ∣) rounds.

Formalizing it adds three things beyond the paper. First, a checked version of an argument the paper gives informally, including the odd/even sandwich of the iteration, which the paper proves in a few lines. Second, a reusable fixed-point and unimodality lemma for ratios of tail integrals, B(t)=∫t∞u dG / (δ+∫t∞dG)B(t)=\int_t^\infty u\,dG\,/\,(\delta+\int_t^\infty dG)B(t)=∫t∞​udG/(δ+∫t∞​dG), which recurs in reservation-value arguments in search theory. Third, an exact accounting of the hypotheses: integrable utilities and the reading of the best-response map. To our knowledge none of these results has been machine-checked.

Difficulty

The obvious route to uniqueness, a contraction argument for the map τ↦uˉ(τ)\tau\mapsto\bar u(\tau)τ↦uˉ(τ), fails. That map is neither monotone nor contractive in general, since raising a type's own threshold can raise or lower its utility. Existence by Brouwer's fixed-point theorem gives no uniqueness and no algorithm. The best-response iteration does not converge monotonically either: its odd and even iterates move in opposite directions, so convergence in finitely many rounds is a combinatorial statement about the order of the thresholds, not a limit argument. A formal proof also needs continuity and monotonicity of tail integrals of atomless laws, which Mathlib provides only in pieces.

Formalization scope

The two sides are separate finite types M and W. A threshold profile is a pair of functions (M → ℝ) × (W → ℝ), ordered componentwise. A market records δ\deltaδ, α\alphaα and the laws F m w : Measure ℝ. The standing assumptions are:

  • δ>0\delta>0δ>0;
  • αθ>0\alpha_\theta>0αθ​>0, which is implicit in the paper and stated explicitly;
  • each FmwF_{mw}Fmw​ is a probability measure with no atoms (NullSingletonClass);
  • each FmwF_{mw}Fmw​ has an integrable identity. This is implicit in the paper, which uses ∫u dF\int u\,dF∫udF as a real number, and is stated explicitly.

Tails are ∫a∞dF=F([a,∞))\int_a^\infty dF=F([a,\infty))∫a∞​dF=F([a,∞)) and ∫a∞u dF=∫[a,∞)u dF\int_a^\infty u\,dF=\int_{[a,\infty)}u\,dF∫a∞​udF=∫[a,∞)​udF. Capacity (2), flow balance (3) and stationarity (1) are not hypotheses, because Proposition 3.1 holds for any fixed assortments.

The best-response map is encoded as a relation: each new threshold solves its own equation t=B(t)t=B(t)t=B(t) against the opposite side's input thresholds. This is the paper's reading ("This map is a best response by Lemma A.3"). Evaluating (5) at the old profile, own old threshold included, would be a different map. Under that reading finite convergence and the p. 37 claims are false: with one type per side, λ≡1\lambda\equiv1λ≡1, δ=1\delta=1δ=1 and FFF uniform on [0,1][0,1][0,1], its iterates are rational and converge only in the limit to 2−32-\sqrt32−3​.

Two formalizations would trivialize the goal, and both are ruled out. Uniqueness is over all real profiles, not only nonnegative ones or those reached by the iteration. The tail integrals are not allowed to vanish by default for non-integrable laws, because integrability is a hypothesis. O(∣Θ∣)O(|\Theta|)O(∣Θ∣) is encoded with a constant chosen before the market.

Not formalized: the agents' Markov decision process of Appendix A.1. Consequently "this strategy profile is a Nash equilibrium", item 2 of Proposition 3.1, Lemmas A.1–A.2 and the best-response sentences of Lemma A.3 and Proposition A.4 are out of scope.

Contributions welcome: continuity and monotonicity lemmas for a↦∫[a,∞)u dFa\mapsto\int_{[a,\infty)}u\,dFa↦∫[a,∞)​udF and a↦F([a,∞))a\mapsto F([a,\infty))a↦F([a,∞)) for atomless integrable laws, which are reusable well beyond this mission, and proofs of the milestones in any order.

Selected references

  • N. Immorlica, B. Lucier, V. Manshadi, A. Wei, Designing Approximately Optimal Search on Matching Platforms, Management Science, 2023; preprint arXiv:2102.09017v2, 2021. https://arxiv.org/abs/2102.09017
  • K. Burdett, M. G. Coles, Marriage and Class, Quarterly Journal of Economics 112(1), 1997. https://doi.org/10.1162/003355397555127
8 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatoricsMechanism Design·Captain: mikedeng1

Combinatorial Auctions with Interdependent Valuations: SOS to the Rescue 3: The k-HL Mechanism Is Ex-Post IC-IR and a (k+3)-Approximation to Welfare with k Signal ValuesResearch Paper

Motivation

In many auctions a bidder's value for what she wins depends on information held by others. The value of an oil lease, a spectrum licence or a piece of art to one bidder depends on survey data, market forecasts or expert opinions that other bidders hold privately. The model of interdependent values (Milgrom and Weber, 1982) captures this: each agent iii holds a private signal sis_isi​, and every agent's value is a publicly known function of the whole signal profile s=(s1,…,sn)\mathbf s=(s_1,\dots,s_n)s=(s1​,…,sn​).

With interdependent values, maximizing welfare in ex-post equilibrium is impossible unless the valuations satisfy the single-crossing condition (Maskin, 1992; Dasgupta and Maskin, 2000), and even single crossing does not suffice beyond single-item auctions with single-dimensional signals. Without any condition, there are valuations for which no deterministic mechanism achieves a bounded approximation ratio and no randomized mechanism does better than a factor nnn (Eden, Feldman, Fiat and Goldner, ACM EC 2018; Examples 1.2–1.3 of the source). Eden, Feldman, Fiat, Goldner and Karlin (arXiv:1903.08384v2, 2019) introduce submodularity over signals (SOS): raising one signal increases a value by less when the other signals are higher. They show that SOS valuations admit constant-factor, or signal-space-dependent, approximations in settings where single crossing fails, including combinatorial auctions. This mission formalizes their Theorem 6.1, the case of combinatorial auctions with single-dimensional signals taking kkk values.

Timeline. Milgrom–Weber (1982) introduce the interdependent values model. Maskin (1992) and Dasgupta–Maskin (2000) show that single crossing makes efficient auctions truthful. Jehiel–Moldovanu (2001) show that efficient implementation fails generically with multidimensional signals. Eden–Feldman–Fiat–Goldner (2018) give approximations under a relaxed, ccc-single-crossing condition, with ratios depending on ccc and nnn. Eden–Feldman–Fiat–Goldner–Karlin (2019; Mathematics of Operations Research, 2024) introduce SOS and prove Theorems 4.1, 5.1, 6.1 and 6.5.

Setting

There are nnn agents and mmm items, and k≥1k\ge1k≥1 signal values. Each agent iii has a signal si∈{0,1,…,k−1}s_i\in\{0,1,\dots,k-1\}si​∈{0,1,…,k−1}, and {0,…,k−1}n\{0,\dots,k-1\}^n{0,…,k−1}n is the grid. Agent iii's value for a bundle T⊆[m]T\subseteq[m]T⊆[m] at the profile s\mathbf ss is viT(s)≥0v_{iT}(\mathbf s)\ge0viT​(s)≥0; the empty bundle is worth 000, and for nonempty TTT, viTv_{iT}viT​ is weakly increasing in every signal and strictly increasing in sis_isi​. We write (s−i,xi)(\mathbf s_{-i},x_i)(s−i​,xi​) for the profile with agent iii's signal replaced by xxx, and (sA,0B)(\mathbf s_A,\mathbf 0_B)(sA​,0B​) for the profile that keeps the signals of the agents in AAA and sets those in BBB to 000.

A function www of the profile is SOS if for every coordinate jjj, all x,δ≥0x,\delta\ge0x,δ≥0 with x+δ≤k−1x+\delta\le k-1x+δ≤k−1, and grid profiles with s−j′≤s−j\mathbf s'_{-j}\le\mathbf s_{-j}s−j′​≤s−j​ coordinatewise,

w(s−j,x+δ)−w(s−j,x)  ≤  w(s−j′,x+δ)−w(s−j′,x).w(\mathbf s_{-j},x+\delta)-w(\mathbf s_{-j},x)\;\le\;w(\mathbf s'_{-j},x+\delta)-w(\mathbf s'_{-j},x).w(s−j​,x+δ)−w(s−j​,x)≤w(s−j′​,x+δ)−w(s−j′​,x).

The setting is SOS when every viTv_{iT}viT​ is.

A feasible allocation gives disjoint bundles T1,…,TnT_1,\dots,T_nT1​,…,Tn​; its welfare at s\mathbf ss is ∑iviTi(s)\sum_i v_{iT_i}(\mathbf s)∑i​viTi​​(s). A deterministic mechanism maps reported profiles to an allocation and payments. Agent iii's utility is her value, at the true profile, for the bundle she receives at the reported profile, minus her payment. The mechanism is ex-post IC if truthful reporting maximizes each agent's utility whenever the others report truthfully, and ex-post IR if that utility is nonnegative. A randomized mechanism is universally ex-post IC-IR if every deterministic mechanism in its support is.

The mechanism k-HL runs, with probability pRT=k−1k+3p_{RT}=\frac{k-1}{k+3}pRT​=k+3k−1​, Random Threshold: choose ℓ\ellℓ uniformly in {1,…,k−1}\{1,\dots,k-1\}{1,…,k−1}, call N≥ℓ={i:si≥ℓ}N_{\ge\ell}=\{i:s_i\ge\ell\}N≥ℓ​={i:si​≥ℓ} the high agents, allocate to them a feasible allocation maximizing ∑i∈N≥ℓviSi(sN<ℓ,ℓN≥ℓ)\sum_{i\in N_{\ge\ell}}v_{iS_i}(\mathbf s_{N_{<\ell}},\ell_{N_{\ge\ell}})∑i∈N≥ℓ​​viSi​​(sN<ℓ​​,ℓN≥ℓ​​), and charge agent iii receiving Tˉi\bar T_iTˉi​ the price viTˉi(s−i,si=ℓ−1)v_{i\bar T_i}(\mathbf s_{-i},s_i=\ell-1)viTˉi​​(s−i​,si​=ℓ−1). Otherwise it runs Random Sampling: split the agents uniformly at random into AAA and BBB, allocate to BBB a feasible allocation maximizing ∑i∈BviSi(sA,0B)\sum_{i\in B}v_{iS_i}(\mathbf s_A,\mathbf 0_B)∑i∈B​viSi​​(sA​,0B​), and charge nothing. In the Lean development (namespace InterdepSOS.KHL) these are rtAlloc, rtPay, rsAlloc and khlWelfare.

Formalization targets

Goal: Theorem 6.1 (p. 20)

For SOS valuations with kkk signal values, every Random Threshold component and every Random Sampling component is ex-post IC and IR, and for every grid profile s\mathbf ss and every feasible allocation T∗T^*T∗,

∑iviTi∗(s)  ≤  (k+3) E[welfare of k-HL at s],\sum_i v_{iT^*_i}(\mathbf s)\;\le\;(k+3)\,\mathbb E\bigl[\text{welfare of k-HL at }\mathbf s\bigr],i∑​viTi∗​​(s)≤(k+3)E[welfare of k-HL at s],

where the expectation is over ℓ\ellℓ, over (A,B)(A,B)(A,B) and over the coin choosing between the two mechanisms, and welfare is measured with true values at the truthful profile.

Milestones

  1. Displays (6)–(7): the welfare of any allocation is at most OTHER+SELF\mathsf{OTHER}+\mathsf{SELF}OTHER+SELF, where OTHER=∑iviTi(s−i,0i)\mathsf{OTHER}=\sum_i v_{iT_i}(\mathbf s_{-i},0_i)OTHER=∑i​viTi​​(s−i​,0i​) and SELF=∑ℓ=1k−1∑i:si=ℓviTi(0−i,si)\mathsf{SELF}=\sum_{\ell=1}^{k-1}\sum_{i:s_i=\ell}v_{iT_i}(\mathbf 0_{-i},s_i)SELF=∑ℓ=1k−1​∑i:si​=ℓ​viTi​​(0−i​,si​).
  2. Random Sampling is ex-post IC-IR for every partition.
  3. Random Threshold is ex-post IC-IR for every threshold.
  4. Lemma 6.2: SELF≤(k−1) E[welfare of Random Threshold]\mathsf{SELF}\le(k-1)\,\mathbb E[\text{welfare of Random Threshold}]SELF≤(k−1)E[welfare of Random Threshold].
  5. Lemma 6.3: OTHER≤4 E[welfare of Random Sampling]\mathsf{OTHER}\le4\,\mathbb E[\text{welfare of Random Sampling}]OTHER≤4E[welfare of Random Sampling].

Significance

Theorem 6.1 is the paper's answer for general combinatorial auctions with single-dimensional signals and arbitrary bundle valuations, a setting where single crossing gives nothing and where the random-sampling technique of the single-parameter case (Theorem 4.1) is not enough on its own: Random Sampling alone covers only the contribution of the other agents' signals. The ratio k+3k+3k+3 depends on the size of the signal space but not on the number of agents or items. The same decomposition, with Random Threshold replaced by a bucketing mechanism, yields the (2log⁡2k+4)(2\log_2k+4)(2log2​k+4)-approximation for strong-SOS valuations (Theorem 6.5), so milestones 1 and 5 are shared by both results.

The result is proved in the paper; no machine-checked version is known to exist. A formalization fixes the incentive argument precisely (which data the allocation may depend on, how ties are broken) and makes the uniform averages over thresholds and partitions explicit. The development reuses the Key Lemma 3.1 of the paper, which is posed in a sibling mission of this series.

Difficulty

Two points resist a direct argument. First, incentive compatibility of Random Threshold requires that a high agent who changes her report within {ℓ,…,k−1}\{\ell,\dots,k-1\}{ℓ,…,k−1} leaves the allocation unchanged, and this is true only if the argmax rule sees the reports through the proxy data (sN<ℓ,ℓN≥ℓ)(\mathbf s_{N_{<\ell}},\ell_{N_{\ge\ell}})(sN<ℓ​​,ℓN≥ℓ​​) alone: an argmax rule that breaks ties using the full report profile can make a high agent's bundle, and hence her utility, depend on her report. The formalization must therefore state precisely what the allocation rule may depend on. Second, the welfare bound for Random Sampling rests on the Key Lemma 3.1 (zeroing a uniformly random half of the other signals keeps, in expectation, half of an SOS value), which here has to hold on the discrete grid {0,…,k−1}n\{0,\dots,k-1\}^n{0,…,k−1}n, with SOS assumed only there; the expectations over partitions and thresholds are finite averages whose bookkeeping (agents in AAA receive nothing, agents outside N≥ℓN_{\ge\ell}N≥ℓ​ receive nothing) must match the mechanism exactly.

Formalization scope

Agents are Fin n, items Fin m, bundles Finset (Fin m), signals natural numbers with the grid condition InGrid k s. All hypotheses on valuations (nonnegativity, monotonicity, strict monotonicity in the own signal, SOS) are imposed on grid profiles only, with the shifted coordinate staying below kkk; a condition on all of Nn\mathbb N^nNn would be stronger than the paper's. The empty bundle is worth 000 and the monotonicity clauses concern nonempty bundles. Allocations are maps Fin n → Finset (Fin m) with pairwise disjoint values; agents outside the eligible set receive ∅\emptyset∅.

The argmax allocations are produced by arbitrary selectors, functions of the threshold (or of BBB) and of the proxy profile, required to return a feasible maximizer of the proxy welfare; the theorems quantify over all such selectors. Expectations are finite uniform averages, 1k−1∑ℓ=1k−1\frac1{k-1}\sum_{\ell=1}^{k-1}k−11​∑ℓ=1k−1​ and 2−n∑B⊆[n]2^{-n}\sum_{B\subseteq[n]}2−n∑B⊆[n]​, never an existential or universal quantifier over ℓ\ellℓ or BBB. The ratio is stated against every feasible allocation, with welfare at true values, never with proxy values and never through a supremum. IC and IR are stated for every component of the mixture, with the paper's explicit payments. Random Sampling zeroes the signals of all of BBB, the agent's own included (the page's "vij(sA,0B)v_{ij}(\mathbf s_A,\mathbf 0_B)vij​(sA​,0B​)" is read as viT(sA,0B)v_{iT}(\mathbf s_A,\mathbf 0_B)viT​(sA​,0B​)). For k=1k=1k=1, pRT=0p_{RT}=0pRT​=0 and the threshold average is the empty sum.

Lemmas 6.2 and 6.3 and displays (6)–(7) are stated for every feasible allocation (every assignment, for (6)–(7)), which is stronger than the paper's statements for a welfare-maximizing T∗T^*T∗.

Needed infrastructure: the Key Lemma 3.1 on the discrete grid, finite averages over subsets, and a lemma that a maximizer over a subfamily of allocations dominates any restriction of a feasible allocation. Contributions of proofs of the milestones in any order are welcome; the IC-IR milestones are independent of the welfare milestones.

The source is the arXiv preprint arXiv:1903.08384v2; the Mathematics of Operations Research (2024) version is not the cited source, and its numbering may differ.

Selected references

  • A. Eden, M. Feldman, A. Fiat, K. Goldner, A. R. Karlin, Combinatorial Auctions with Interdependent Valuations: SOS to the Rescue, arXiv:1903.08384v2, 2019. https://arxiv.org/abs/1903.08384v2
  • A. Eden, M. Feldman, A. Fiat, K. Goldner, Interdependent Values without Single-Crossing, ACM EC 2018 (cited as [Eden et al., 2018] in the source).
  • E. Maskin, Auctions and Privatization, in H. Siebert (ed.), Privatization, 1992 (cited as [Maskin, 1992] in the source).
  • P. Milgrom, R. Weber, A Theory of Auctions and Competitive Bidding, Econometrica 50(5), 1982. https://doi.org/10.2307/1911865
  • P. Dasgupta, E. Maskin, Efficient Auctions, Quarterly Journal of Economics 115(2), 2000. https://doi.org/10.1162/003355300554737
  • P. Jehiel, B. Moldovanu, Efficient Design with Interdependent Valuations, Econometrica 69(5), 2001. https://doi.org/10.1111/1468-0262.00248
9 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Climate Impact Investing 2: With Poisson Climate Uncertainty λ, If the Green Portfolio Is Green Then y*_λ Rises to 1 in λ, So Equilibrium Emissions Rise as Uncertainty GrowsResearch Paper

Motivation

Climate impact investing refers to investors who tilt their portfolios away from companies with large greenhouse-gas emissions. Its stated aim goes beyond aligning portfolios with values: by raising the cost of capital of polluting companies, it is meant to change what those companies do. De Angelis, Tankov and Zerbib (SSRN 3562534, published in Management Science, 2022, doi:10.1287/mnsc.2022.4472) build an equilibrium model in which this mechanism can be computed. Green investors penalize the expected climate externalities of companies. Companies choose emission schedules to maximize their market value net of abatement costs. Prices, portfolios and emissions are determined jointly.

Section 4 of the paper asks what happens when the green investors are uncertain about future climate externalities, for instance because news on climate risk or regulation arrives in rare large shocks. Its answer is that, in the most common market configuration, more uncertainty makes green investors hedge by holding more brown assets, which weakens the incentive to abate, so that equilibrium emissions rise as climate uncertainty grows. This mission formalizes that result and the chain of statements behind it.

Setting

Fix a date ttt in a horizon [0,T][0,T][0,T]; every object below is evaluated at that date, and its subscript is dropped where harmless. There are nnn companies, indexed by iii, with asset covariance matrix Σt\Sigma_tΣt​ (positive definite). Green investors hold wealth share α∈(0,1)\alpha\in(0,1)α∈(0,1), regular investors the rest, with risk aversions γg,γr>0\gamma^g,\gamma^r>0γg,γr>0.

Company iii emits at rate ψti≥0\psi^i_t\ge 0ψti​≥0 and pays the marginal abatement cost cti≥0c^i_t\ge 0cti​≥0. The green investors attach to company iii the climate externality θti(ψ)=κ0,t−κt2ψ2\theta^i_t(\psi)=\kappa_{0,t}-\frac{\kappa_t}{2}\psi^2θti​(ψ)=κ0,t​−2κt​​ψ2, the companies use θtc,i(ψ)=κ0,tc−κtc2ψ2\theta^{c,i}_t(\psi)=\kappa^c_{0,t}-\frac{\kappa^c_t}{2}\psi^2θtc,i​(ψ)=κ0,tc​−2κtc​​ψ2, and all κ\kappaκ's are positive. With a rate of time preference ρ>0\rho>0ρ>0, the time factors are βtc=(e−ρt−e−ρT)/(1−e−ρT)\beta^c_t=(e^{-\rho t}-e^{-\rho T})/(1-e^{-\rho T})βtc​=(e−ρt−e−ρT)/(1−e−ρT) and βt=(1−e−ρt)/(1−e−ρT)\beta_t=(1-e^{-\rho t})/(1-e^{-\rho T})βt​=(1−e−ρt)/(1−e−ρT).

Climate uncertainty is a Poisson process of intensity λ>0\lambda>0λ>0: a smaller λ\lambdaλ means rarer, larger shocks, i.e. more uncertainty. For a fixed externality vector θ\thetaθ, the equilibrium of Proposition 5 is described by a scalar yλ>0y_\lambda>0yλ​>0 solving

yλ=exp⁡{−αγgλ(1⊤θ+yλγrθ⊤Σt−1θ)},y_\lambda=\exp\Big\{-\frac{\alpha\gamma^g}{\lambda}\Big(\mathbf 1^\top\theta+\frac{y_\lambda}{\gamma^r}\theta^\top\Sigma_t^{-1}\theta\Big)\Big\},yλ​=exp{−λαγg​(1⊤θ+γryλ​​θ⊤Σt−1​θ)},

and the green portfolio is Ng,λ=α(1+yλγrΣt−1θ)N^{g,\lambda}=\alpha(\mathbf 1+\frac{y_\lambda}{\gamma^r}\Sigma_t^{-1}\theta)Ng,λ=α(1+γryλ​​Σt−1​θ). Without uncertainty, y=1y=1y=1 and the portfolio is NgN^gNg. When the companies take yyy as given (the large-market assumption), company iii's optimal emission rate is

ψti(y)=ctiαβtκt y+βtcκtc,\psi^i_t(y)=\frac{c^i_t}{\alpha\beta_t\kappa_t\,y+\beta^c_t\kappa^c_t},ψti​(y)=αβt​κt​y+βtc​κtc​cti​​,

and yyy itself must then solve the fixed-point equation y=exp⁡{−αγgλg∗(y)}y=\exp\{-\frac{\alpha\gamma^g}{\lambda}g^*(y)\}y=exp{−λαγg​g∗(y)}, where

g∗(y)=1⊤θt(ψt(y))+yγrθt(ψt(y))⊤Σt−1θt(ψt(y)).g^*(y)=\mathbf 1^\top\theta_t(\psi_t(y))+\frac{y}{\gamma^r}\theta_t(\psi_t(y))^\top\Sigma_t^{-1}\theta_t(\psi_t(y)).g∗(y)=1⊤θt​(ψt​(y))+γry​θt​(ψt​(y))⊤Σt−1​θt​(ψt​(y)).

Its solution is yλ∗y^*_\lambdayλ∗​. Finally, ψt∗,0=ψt(1)\psi^{*,0}_t=\psi_t(1)ψt∗,0​=ψt​(1) is the schedule without uncertainty.

Formalization targets

Goal: Proposition 8(iii)

Assume condition (24) at the date ttt: ∑j(Σt−1)ij y θtj(ψtj(y))≥−γr/2\sum_j(\Sigma_t^{-1})_{ij}\,y\,\theta^j_t(\psi^j_t(y))\ge-\gamma^r/2∑j​(Σt−1​)ij​yθtj​(ψtj​(y))≥−γr/2 for all iii and all y>0y>0y>0. Let λ↦yλ∗\lambda\mapsto y^*_\lambdaλ↦yλ∗​ solve the fixed-point equation. Then the sign of the green portfolio's externality without uncertainty decides the direction of the response:

θt(ψt∗,0)⊤Ntg>0 ⟹ yλ∗↑1 strictly in λ,λ↦ψt∗,i nonincreasing,\theta_t(\psi^{*,0}_t)^\top N^g_t>0\ \Longrightarrow\ y^*_\lambda\uparrow 1\ \text{strictly in }\lambda,\quad \lambda\mapsto\psi^{*,i}_t\ \text{nonincreasing},θt​(ψt∗,0​)⊤Ntg​>0 ⟹ yλ∗​↑1 strictly in λ,λ↦ψt∗,i​ nonincreasing,

the opposite if θt(ψt∗,0)⊤Ntg<0\theta_t(\psi^{*,0}_t)^\top N^g_t<0θt​(ψt∗,0​)⊤Ntg​<0, and yλ∗≡1y^*_\lambda\equiv 1yλ∗​≡1 with unchanged emissions if it is 000.

Milestones

In the order of the attack:

  1. Proposition 7: for fixed y>0y>0y>0, ψti(y)\psi^i_t(y)ψti​(y) is the unique maximizer of the company's pointwise objective.
  2. Proposition 8(i): the fixed-point equation has a positive solution for every λ>0\lambda>0λ>0.
  3. Under (24), g∗g^*g∗ is increasing.
  4. Proposition 8(ii): under (24), the solution is unique.
  5. ψt∗(1)=ψt∗,0\psi^*_t(1)=\psi^{*,0}_tψt∗​(1)=ψt∗,0​, and αg∗(1)=θt(ψt∗,0)⊤Ntg\alpha g^*(1)=\theta_t(\psi^{*,0}_t)^\top N^g_tαg∗(1)=θt​(ψt∗,0​)⊤Ntg​.
  6. Equation (20) has exactly one positive solution yλy_\lambdayλ​.
  7. Proposition 6(ii)–(iv): the same three-way comparative static at a fixed schedule, for yλy_\lambdayλ​, the green portfolio and the expected returns.

Companion statements cover Proposition 6(i) (the green portfolio's market risk increases in λ\lambdaλ), Lemma 1, and the algebraic core of Proposition 5.

Significance

The result. Proposition 8(iii) is the paper's headline claim about uncertainty, and it is quoted in its abstract: uncertainty about future climate externalities, by making green investors hedge, can push companies to increase their emissions. The paper's Lemma 1 shows that the positive case, a green portfolio with positive climate externality, is the common one. The sign condition is therefore not a curiosity. It separates markets where uncertainty undermines impact investing from markets where it strengthens it.

Formalizing it. The proofs in the appendix are short and leave several steps implicit, and in two places the printed formulas do not match their own derivation (see the scope section). A machine-checked version settles the precise hypotheses under which the comparative statics hold. It also provides reusable statements about scalar fixed-point equations of the form −λlog⁡y=G(y)-\lambda\log y=G(y)−λlogy=G(y) with nondecreasing GGG. No part of this paper has been formalized before.

Difficulty

At a fixed schedule, everything follows from the fact that ggg is affine and nondecreasing in yyy. Once the schedule is endogenous, g∗g^*g∗ is nonlinear and in general not monotone, so neither uniqueness nor monotonicity in λ\lambdaλ comes for free. The work lies in turning condition (24) into monotonicity of g∗g^*g∗. That requires differentiating the quadratic form θ(ψ(y))⊤Σ−1θ(ψ(y))\theta(\psi(y))^\top\Sigma^{-1}\theta(\psi(y))θ(ψ(y))⊤Σ−1θ(ψ(y)) through the schedule and controlling its sign company by company. The limit yλ∗→1y^*_\lambda\to 1yλ∗​→1 as λ→∞\lambda\to\inftyλ→∞ needs bounds on g∗g^*g∗ along the solution path rather than the formal Taylor expansion in 1/λ1/\lambda1/λ the paper gives for (20).

Formalization scope

The stochastic layer is not formalized: Brownian cash-flow news, subjective measures built by Girsanov's theorem, CARA utility maximization, the Poisson process of climate shocks, and Propositions 1 and 5 as equilibrium statements. The statements start from the objects the proofs start from: the first-order and market-clearing system (45), and equations (20), (22) and (23). Everything is stated at one fixed date ttt, with vectors in Rn\mathbb R^nRn indexed by Fin n, Σt\Sigma_tΣt​ positive definite and Σt−1\Sigma_t^{-1}Σt−1​ Mathlib's matrix inverse.

The standing assumptions are hypotheses of the statements:

  • ρ,T>0\rho,T>0ρ,T>0 and t∈[0,T]t\in[0,T]t∈[0,T];
  • 0<α<10<\alpha<10<α<1;
  • γr,γg>0\gamma^r,\gamma^g>0γr,γg>0;
  • all κ\kappaκ's positive;
  • cti≥0c^i_t\ge0cti​≥0.

The relation α=γr/(γr+γg)\alpha=\gamma^r/(\gamma^r+\gamma^g)α=γr/(γr+γg) is assumed only where it is used, in the core of Proposition 5. The solution maps λ↦yλ\lambda\mapsto y_\lambdaλ↦yλ​ and λ↦yλ∗\lambda\mapsto y^*_\lambdaλ↦yλ∗​ enter only through the hypothesis that each value solves its equation. A theorem that assumed monotonicity of g∗g^*g∗, uniqueness, or the sign of g∗(1)g^*(1)g∗(1) would trivialize the goal; the goal assumes only condition (24).

Disclosed corrections of the printed text:

  • (23) and g∗g^*g∗. The page prints a factor αy/γr\alpha y/\gamma^rαy/γr in the quadratic term. Footnote 25 derives (23) from (20), which has y/γry/\gamma^ry/γr, and only that version makes the sign test of (iii) agree with the sign of g∗(1)g^*(1)g∗(1). The formalization uses y/γry/\gamma^ry/γr.
  • (24). The derivative of the quadratic form on p. 72 omits the factor 2 that the symmetry of Σ−1\Sigma^{-1}Σ−1 produces. With the corrected g∗g^*g∗, the argument needs the bound −γr/2-\gamma^r/2−γr/2, not −γr/α-\gamma^r/\alpha−γr/α. Whether uniqueness holds under the printed bound is not claimed.
  • Existence at t=Tt=Tt=T. The proof of (i) uses βtc>0\beta^c_t>0βtc​>0, so existence is stated for t∈[0,T)t\in[0,T)t∈[0,T).
  • Asymptotic uniqueness. The last sentence of (ii), uniqueness as λ→∞\lambda\to\inftyλ→∞, has no proof in the paper and is not stated.

Two readings are fixed. "Monotonically increasing" for yλy_\lambdayλ​ is strict. The emission response is weak, because at t=0t=0t=0 the schedule does not depend on yyy. "Reallocate towards brown assets" means that the green portfolio's climate externality θ⊤Ng,λ\theta^\top N^{g,\lambda}θ⊤Ng,λ falls as λ\lambdaλ falls.

The development needs elementary real analysis: the intermediate value theorem on (0,∞)(0,\infty)(0,∞), monotonicity from derivatives, and limits at infinity. It also needs finite-dimensional linear algebra for positive definite matrices. The lemmas about −λlog⁡y=G(y)-\lambda\log y=G(y)−λlogy=G(y) are reusable beyond this mission. Proofs of the companion statements, which are algebraic, are welcome as warm-ups.

Selected references

  • T. De Angelis, P. Tankov, O. D. Zerbib, Climate Impact Investing, SSRN 3562534, version of June 25, 2021. https://ssrn.com/abstract=3562534
  • T. De Angelis, P. Tankov, O. D. Zerbib, Climate Impact Investing, Management Science, 2022. https://doi.org/10.1287/mnsc.2022.4472
  • L. Pástor, R. F. Stambaugh, L. A. Taylor, Sustainable investing in equilibrium, Journal of Financial Economics 142(2), 2021. https://doi.org/10.1016/j.jfineco.2020.12.011
13 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationReinforcement Learning·Captain: mikedeng1

A First-Order Approach to Accelerated Value Iteration 4: Safe Accelerated Value Iteration Converges to v* at Rate O(λ′^s) for Every λ′ ∈ [λ, 1)Research Paper

Motivation

Value iteration (VI) is the standard method for computing the optimal value function of a discounted Markov decision process (MDP). It applies the Bellman operator repeatedly, and because that operator is a λ\lambdaλ-contraction in the sup norm, the error after sss steps is at most λs\lambda^sλs times the initial error. When the discount factor λ\lambdaλ is close to 111, as in long-horizon planning, this rate is slow.

Goyal and Grand-Clément (arXiv:1905.09963, Operations Research 2023) read value iteration as a gradient-type method and transfer momentum schemes from convex optimization (Nesterov acceleration, heavy-ball momentum) to the Bellman operator. On reversible policy chains these accelerated schemes provably converge faster than VI. On general MDPs, however, the accelerated iterates need not converge at all: the paper exhibits instances on which Accelerated Value Iteration (A-VI) oscillates or diverges. Section 7 of the paper resolves this tension with Safe Accelerated Value Iteration (S-AVI, Algorithm 1), which tries an accelerated step at every period and keeps it only when it makes enough progress on the Bellman equation v=T(v)v = T(v)v=T(v). This mission formalizes the convergence guarantee of S-AVI, Theorem 7.1.

Setting

Let S\mathbb SS be a finite set of states and A\mathbb AA a nonempty finite set of actions. A discounted MDP is given by a transition kernel PPP, with Piaj≥0P_{iaj}\ge 0Piaj​≥0 the probability of moving from state iii to state jjj under action aaa and ∑jPiaj=1\sum_j P_{iaj} = 1∑j​Piaj​=1; a reward ria∈Rr_{ia}\in\mathbb Rria​∈R for each state-action pair; and a discount factor λ∈(0,1)\lambda \in (0,1)λ∈(0,1). The Bellman operator T:RS→RST : \mathbb R^{\mathbb S} \to \mathbb R^{\mathbb S}T:RS→RS is

T(v)i=max⁡a∈A{ria+λ∑jPiaj vj}.T(v)_i = \max_{a\in\mathbb A}\Big\{ r_{ia} + \lambda \sum_{j} P_{iaj}\, v_j \Big\}.T(v)i​=a∈Amax​{ria​+λj∑​Piaj​vj​}.

The sup norm is ∥v∥∞=max⁡i∣vi∣\|v\|_\infty = \max_i |v_i|∥v∥∞​=maxi​∣vi​∣. The optimal value function v∗v^*v∗ is the unique fixed point of TTT. For a vector vvv, the quantity ∥v−T(v)∥∞\|v - T(v)\|_\infty∥v−T(v)∥∞​ is its Bellman residual.

S-AVI (Algorithm 1) takes a scalar λ′∈[λ,1)\lambda' \in [\lambda, 1)λ′∈[λ,1), step sizes α,γ>0\alpha, \gamma > 0α,γ>0 and any starting vector v0v_0v0​. It sets v1=T(v0)v_1 = T(v_0)v1​=T(v0​), and at each period s≥1s \ge 1s≥1 forms

hs=vs+γ (vs−vs−1),vs+1/2=hs−α (hs−T(hs)).h_s = v_s + \gamma\,(v_s - v_{s-1}), \qquad v_{s+1/2} = h_s - \alpha\,\big(h_s - T(h_s)\big).hs​=vs​+γ(vs​−vs−1​),vs+1/2​=hs​−α(hs​−T(hs​)).

If ∥vs+1/2−T(vs+1/2)∥∞≤λ′ s+1 ∥v0−T(v0)∥∞\|v_{s+1/2} - T(v_{s+1/2})\|_\infty \le \lambda'^{\,s+1}\,\|v_0 - T(v_0)\|_\infty∥vs+1/2​−T(vs+1/2​)∥∞​≤λ′s+1∥v0​−T(v0​)∥∞​, the accelerated candidate is accepted, vs+1=vs+1/2v_{s+1} = v_{s+1/2}vs+1​=vs+1/2​; otherwise the algorithm takes a value-iteration step, vs+1=T(vs)v_{s+1} = T(v_s)vs+1​=T(vs​). In the Lean development the MDP is AccelVI.SafeAVI.MDP with validity predicate MDP.Valid, the operator is bellman M, and the iterates are savi M lam' α γ v0 : ℕ → (S → ℝ).

Formalization targets

Goal: Theorem 7.1

For a valid MDP, any λ′∈[λ,1)\lambda' \in [\lambda, 1)λ′∈[λ,1), any α,γ>0\alpha, \gamma > 0α,γ>0 and any v0v_0v0​, the S-AVI iterates converge to v∗v^*v∗, and

vs=v∗+O(λ′ s),∀s≥0,v_s = v^* + O(\lambda'^{\,s}), \quad \forall s \ge 0,vs​=v∗+O(λ′s),∀s≥0,

that is, there is a constant CCC with ∥vs−v∗∥∞≤C λ′ s\|v_s - v^*\|_\infty \le C\,\lambda'^{\,s}∥vs​−v∗∥∞​≤Cλ′s for every s≥0s \ge 0s≥0. The constant is left unspecified, as in the paper.

Milestones

  1. TTT is a λ\lambdaλ-contraction: ∥T(v)−T(w)∥∞≤λ∥v−w∥∞\|T(v) - T(w)\|_\infty \le \lambda\|v - w\|_\infty∥T(v)−T(w)∥∞​≤λ∥v−w∥∞​ (§2, p. 3).
  2. The first period: ∥v1−T(v1)∥∞≤λ∥v0−T(v0)∥∞≤λ′∥v0−T(v0)∥∞\|v_1 - T(v_1)\|_\infty \le \lambda\|v_0 - T(v_0)\|_\infty \le \lambda'\|v_0 - T(v_0)\|_\infty∥v1​−T(v1​)∥∞​≤λ∥v0​−T(v0​)∥∞​≤λ′∥v0​−T(v0​)∥∞​ (p. 13).
  3. Geometric decay of the residual: ∥vs−T(vs)∥∞≤λ′ s∥v0−T(v0)∥∞\|v_s - T(v_s)\|_\infty \le \lambda'^{\,s}\|v_0 - T(v_0)\|_\infty∥vs​−T(vs​)∥∞​≤λ′s∥v0​−T(v0​)∥∞​ for all sss (p. 14).
  4. The residual controls the error: ∥v−v∗∥∞≤(1−λ)−1∥v−T(v)∥∞\|v - v^*\|_\infty \le (1-\lambda)^{-1}\|v - T(v)\|_\infty∥v−v∗∥∞​≤(1−λ)−1∥v−T(v)∥∞​ for every vvv (p. 14).

Significance

The result. Theorem 7.1 says that the safeguard costs nothing in the worst case: S-AVI converges on every MDP at rate λ′\lambda'λ′, and with λ′=λ\lambda' = \lambdaλ′=λ it matches the rate of value iteration, which Theorem 6.3 of the same paper shows cannot be beaten by any first-order method uniformly over MDPs. At the same time it accepts accelerated steps whenever they reduce the residual fast enough, so it keeps the empirical speed-ups of A-VI. Remark 7.2 of the paper describes the role of λ′\lambda'λ′: values closer to 111 admit more accelerated steps. The guarantee also gives a computable stopping rule, since the residual bounds the distance to v∗v^*v∗.

Formalizing it. The result is proved in the paper; to our knowledge it has not been machine-checked. This mission produces a Lean statement of the finite discounted MDP layer, the Bellman operator and Algorithm 1 itself (including its two-step recursion and its data-dependent branch), and a formal proof that the safeguarded iteration converges. The contraction property of TTT and the residual-to-error bound are reusable for any later value-iteration development on the platform. Three sibling missions of this series pose the paper's other main results: the rate of Accelerated Value Computation on reversible chains (Theorem 5.1), the rate of Momentum Value Computation (Theorem 5.5), and the first-order lower bound (Theorem 6.3).

Difficulty

The accelerated candidate vs+1/2v_{s+1/2}vs+1/2​ is built from two past iterates through a momentum step, and on a general MDP nothing controls it: A-VI is not a descent method, and its iterates may diverge. The natural first attempt, proving that A-VI steps contract the error, therefore fails. The difficulty in the formal setting lies elsewhere: the iterates are defined by a two-step recursion with a branch on a real inequality, so any argument must handle both branches at every period and keep the paper's indexing straight (the threshold at period sss is λ′ s+1\lambda'^{\,s+1}λ′s+1 and it compares with the residual of v0v_0v0​, not of vsv_svs​). Existence and uniqueness of v∗v^*v∗ and the contraction property of a max of affine maps also need to be established for the specific operator, from the stochasticity of PPP.

Formalization scope

States and actions are finite types, [Fintype S], [Fintype A], and [Nonempty A] so that the maximum in TTT exists. Vectors are functions S → ℝ with Mathlib's sup norm, which is ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​. Rewards are arbitrary reals. The discount factor is M.lam with 0<λ<10 < \lambda < 10<λ<1 inside MDP.Valid; the initial distribution p0p_0p0​ of the paper's tuple is omitted because no statement uses it. The optimal value function enters each statement as a vector vstar with bellman M vstar = vstar; this is not vacuous, since a valid MDP has exactly one such vector. The scalar λ′\lambda'λ′ ranges over the closed interval [λ,1)[\lambda, 1)[λ,1), and α,γ>0\alpha, \gamma > 0α,γ>0 as in Algorithm 1, although the convergence argument does not need the step sizes to be positive. The sequence savi is indexed as the paper's vsv_svs​: its recursive case s + 2 is the paper's period s+1s+1s+1, with threshold lam' ^ (s + 2). "vs=v∗+O(λ′s)v_s = v^* + O(\lambda'^s)vs​=v∗+O(λ′s) for all s≥0s \ge 0s≥0" is encoded as a single constant valid for every sss, which is stronger than an eventual big-O.

A formalization that replaced the test by the per-step condition (7.2) of Remark 7.3, used the residual of vsv_svs​ instead of v0v_0v0​, fell back to T(vs+1/2)T(v_{s+1/2})T(vs+1/2​), or allowed λ≥1\lambda \ge 1λ≥1 would be a different theorem; none of these is posed. Remark 7.4's extension to arbitrary contractions is not posed either.

The development needs the contraction property of TTT, the Banach fixed-point bound relating error and residual, and an induction over the iterates. Proofs of the milestones as separate lemmas are welcome, as are general statements about safeguarded fixed-point iterations for λ\lambdaλ-contractions that specialize to this one.

Selected references

  • V. Goyal and J. Grand-Clément, A First-Order Approach to Accelerated Value Iteration, Operations Research, 2023; preprint arXiv:1905.09963v7, 2021. https://arxiv.org/abs/1905.09963
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994, reprinted 2014 (Chapter 6.3, value iteration). https://doi.org/10.1002/9780470316887
  • Y. Nesterov, A method for solving the convex programming problem with convergence rate O(1/k²), Soviet Mathematics Doklady 27, 1983.
8 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOptimizationReinforcement Learning·Captain: mikedeng1

A First-Order Approach to Accelerated Value Iteration 3: On the n-State Chain MDP, Every First-Order Method Has ‖v_s − v*‖∞ ≥ λ^s/(1+λ) for s = 1, …, n − 1Research Paper

Motivation

Value iteration (VI) is the basic algorithm for computing the optimal value function of a discounted Markov decision process (MDP). Its error contracts by the discount factor λ\lambdaλ per step, so it needs on the order of (1−λ)−1log⁡(1/ϵ)(1-\lambda)^{-1}\log(1/\epsilon)(1−λ)−1log(1/ϵ) iterations, which is slow when λ\lambdaλ is close to 111, the regime of interest in long-horizon planning and reinforcement learning. Goyal and Grand-Clément (arXiv:1905.09963, Operations Research 2023) read VI as gradient descent on the residual map v↦v−T(v)v \mapsto v - T(v)v↦v−T(v) and import Nesterov's acceleration and heavy-ball momentum from convex optimization. In convex optimization the corresponding lower bounds of Nesterov (2004/2013) show that acceleration is optimal among first-order methods. The question this mission formalizes is the MDP counterpart: can any method that only combines past iterates and their Bellman images beat the rate λ\lambdaλ of plain VI on every MDP? Theorem 6.3 of the paper answers no.

Setting

A finite MDP consists of a state set SSS with ∣S∣=n|S| = n∣S∣=n, a finite nonempty action set AAA, transition probabilities Piaj≥0P_{iaj} \ge 0Piaj​≥0 with ∑jPiaj=1\sum_j P_{iaj} = 1∑j​Piaj​=1, rewards ria∈Rr_{ia} \in \mathbb{R}ria​∈R, and a discount factor λ∈(0,1)\lambda \in (0,1)λ∈(0,1). Its Bellman operator T:Rn→RnT : \mathbb{R}^n \to \mathbb{R}^nT:Rn→Rn is

T(v)i=max⁡a∈A{ria+λ∑jPiajvj},i∈S,T(v)_i = \max_{a \in A}\Big\{ r_{ia} + \lambda \sum_{j} P_{iaj} v_j \Big\}, \qquad i \in S,T(v)i​=a∈Amax​{ria​+λj∑​Piaj​vj​},i∈S,

a λ\lambdaλ-contraction for the sup norm ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​. Its unique fixed point v∗v^*v∗ is the optimal value function.

A sequence (vs)s≥0(v_s)_{s \ge 0}(vs​)s≥0​ in Rn\mathbb{R}^nRn is a first-order sequence for TTT if

v0=0,vs+1∈span⁡{v0,…,vs,T(v0),…,T(vs)},s≥0.v_0 = 0, \qquad v_{s+1} \in \operatorname{span}\{v_0, \dots, v_s, T(v_0), \dots, T(v_s)\}, \quad s \ge 0 .v0​=0,vs+1​∈span{v0​,…,vs​,T(v0​),…,T(vs​)},s≥0.

VI from v0=0v_0 = 0v0​=0 (vs+1=T(vs)v_{s+1} = T(v_s)vs+1​=T(vs​)) and relaxed VI (vs+1=vs−αs(vs−T(vs))v_{s+1} = v_s - \alpha_s(v_s - T(v_s))vs+1​=vs​−αs​(vs​−T(vs​))) from 000 produce such sequences.

The chain MDP of Figure 1 has nnn states and a single action. State 111 is absorbing with reward r1=1r_1 = 1r1​=1; every state i≥2i \ge 2i≥2 moves deterministically to i−1i - 1i−1 and earns nothing. In Lean (namespace AccelVI.LowerBound) the MDP is MDP, validity is MDP.Valid, TTT is bellman, the chain is chainMDP n lam, and the first-order condition is IsFirstOrder T v.

Formalization targets

Goal: Theorem 6.3 (p. 12)

For every nnn, every λ∈(0,1)\lambda \in (0,1)λ∈(0,1), the fixed point v∗v^*v∗ of the Bellman operator TTT of the nnn-state chain, every first-order sequence (vs)(v_s)(vs​) for TTT, and every s∈{1,…,n−1}s \in \{1, \dots, n-1\}s∈{1,…,n−1},

∥vs−v∗∥∞≥λs1+λ.\|v_s - v^*\|_\infty \ge \frac{\lambda^s}{1+\lambda}.∥vs​−v∗∥∞​≥1+λλs​.

Milestones

  1. TTT is a λ\lambdaλ-contraction: ∥T(v)−T(w)∥∞≤λ∥v−w∥∞\|T(v) - T(w)\|_\infty \le \lambda\|v - w\|_\infty∥T(v)−T(w)∥∞​≤λ∥v−w∥∞​ (§2, p. 3).
  2. (3.5): (1−λ)∥v−w∥∞≤∥(I−T)(v)−(I−T)(w)∥∞(1-\lambda)\|v - w\|_\infty \le \|(I-T)(v) - (I-T)(w)\|_\infty(1−λ)∥v−w∥∞​≤∥(I−T)(v)−(I−T)(w)∥∞​ (p. 6).
  3. (3.6): ∥(I−T)(v)−(I−T)(w)∥∞≤(1+λ)∥v−w∥∞\|(I-T)(v) - (I-T)(w)\|_\infty \le (1+\lambda)\|v - w\|_\infty∥(I−T)(v)−(I−T)(w)∥∞​≤(1+λ)∥v−w∥∞​ (p. 6).
  4. On the chain, the value function is vi∗=λi−1/(1−λ)v^*_i = \lambda^{i-1}/(1-\lambda)vi∗​=λi−1/(1−λ), and it is the only fixed point of TTT (p. 12).
  5. On the chain, every first-order sequence satisfies vs,i=0v_{s,i} = 0vs,i​=0 for i≥s+1i \ge s+1i≥s+1 (p. 12).
  6. (6.2)–(6.4): on the chain, ∥vs−T(vs)∥∞≥λs\|v_s - T(v_s)\|_\infty \ge \lambda^s∥vs​−T(vs​)∥∞​≥λs for 1≤s≤n−11 \le s \le n-11≤s≤n−1 (p. 12).

Significance

The result. Theorem 6.3 shows that, measured by the number of Bellman evaluations, no first-order method improves on the worst-case rate λ\lambdaλ of value iteration uniformly over MDPs, as long as the number of steps is below the number of states. In convex optimization the analogous class admits acceleration from 1−μ/L1 - \mu/L1−μ/L to 1−μ/L1 - \sqrt{\mu/L}1−μ/L​; with μ=1−λ\mu = 1-\lambdaμ=1−λ, L=1+λL = 1+\lambdaL=1+λ, the analogue for MDPs would be a rate of about 1−1−λ1 - \sqrt{1-\lambda}1−1−λ​, and this theorem rules it out. It is the reason the paper's accelerated schemes are analysed under extra structure, such as reversible policy-evaluation chains, or are safeguarded.

Formalizing it. The result is proved in the paper; no machine-checked version exists. The mission produces a checked lower bound for fixed-point iterations of Bellman operators, the contraction inequalities (3.5)–(3.6) for a general finite MDP, and an explicit value function for a hard instance. The paper's other main results, Theorems 5.1, 5.5 and 7.1, are posed as the sibling missions 1, 2 and 4.

Difficulty

The obvious argument that the error is at least the contribution of states never reached fails without control of the span: the first-order class allows arbitrary real coefficients, including ones that change with sss and depend on all past iterates, so one has to show that no such combination puts mass on states beyond index sss. The support claim has to be carried through the nonlinear max in TTT, which is benign here only because the chain has a single action. The second ingredient converts a bound on a few coordinates of vs−v∗v_s - v^*vs​−v∗ into a bound in sup norm with the exact constant 1/(1+λ)1/(1+\lambda)1/(1+λ), which requires the two-sided inequalities (3.5)–(3.6) for I−TI - TI−T and the explicit value vs+1∗=λs/(1−λ)v^*_{s+1} = \lambda^s/(1-\lambda)vs+1∗​=λs/(1−λ).

Formalization scope

  • States are Fin n and are 0-based: the paper's state iii is index i−1i - 1i−1, so vi∗=λi−1/(1−λ)v^*_i = \lambda^{i-1}/(1-\lambda)vi∗​=λi−1/(1−λ) is lam ^ k / (1 - lam) at index kkk and "i≥s+1i \ge s+1i≥s+1" is s≤ks \le ks≤k. The action set of the chain is Unit.
  • ∥⋅∥∞\|\cdot\|_\infty∥⋅∥∞​ is Mathlib's sup norm on Fin n → ℝ. "span" is the real linear span Submodule.span ℝ, with both lists running to index sss inclusive.
  • v∗v^*v∗ enters the goal through its defining equation T(v∗)=v∗T(v^*) = v^*T(v∗)=v∗; it is not replaced by the explicit vector. The initial distribution p0p_0p0​ of the paper's MDP tuple is omitted, since no result here uses it.
  • Pinned quantifiers. As printed, Theorem 6.3 asserts that there exists an MDP instance, with nnn its own number of states; read literally, an instance with n=1n = 1n=1 has no admissible sss. The proof fixes an arbitrary nnn and λ∈(0,1)\lambda \in (0,1)λ∈(0,1) and uses the chain. The goal states that claim for every nnn and λ\lambdaλ on the explicit chain, which implies the printed form.
  • n−1n - 1n−1 is natural-number subtraction, so the goal has content exactly when n≥2n \ge 2n≥2.
  • The goal's constant is λs/(1+λ)\lambda^s/(1+\lambda)λs/(1+λ) as printed; the sharper bound λs/(1−λ)\lambda^s/(1-\lambda)λs/(1−λ), which the proof's chain also gives, is not the target.
  • The Bellman operator and the kernel condition are the published platform definitions FoundationsML_ReinforcementLearning_BellmanOperator and FoundationsML_ReinforcementLearning_IsTransitionKernel.
  • A trivializing formalization would take an unsatisfiable fixed-point hypothesis or an empty first-order class. Both are satisfiable: the explicit vector is a fixed point (milestone 4), and VI from 000 is first-order.

Contributions welcome: proofs of the contraction inequalities for general finite MDPs (reusable by every Bellman-operator mission), of the support recursion, and of the final chain of inequalities.

Selected references

  • V. Goyal and J. Grand-Clément, A First-Order Approach to Accelerated Value Iteration, Operations Research 71(2), 2023; preprint arXiv:1905.09963v7, 2021. https://arxiv.org/abs/1905.09963
  • Yu. Nesterov, Introductory Lectures on Convex Optimization: A Basic Course, Springer, 2004. https://doi.org/10.1007/978-1-4419-8853-9
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994/2014. https://doi.org/10.1002/9780470316887
10 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Marketplace Leakage 4: The Marketplace Prefers Not to Impose a Price-Parity Clause If and Only If q < 1/2 and μ > (v − c)/2Research Paper

Motivation

Online marketplaces (Amazon, Booking.com, Airbnb, Upwork) charge sellers a fee on every transaction they intermediate. Once a buyer has found a seller on the marketplace, both have an incentive to complete the sale off the platform and split the fee they save. This is leakage (also called disintermediation or showrooming), and it limits the fees a marketplace can sustain. Hagiu and Wright, Marketplace Leakage (Management Science, 2023, doi:10.1287/mnsc.2023.4757), build a minimal model of leakage and compare the strategies a marketplace can use against it.

One of these strategies is contractual: a price-parity clause (PPC), under which the seller must not charge less in its direct channel than on the marketplace, on pain of being delisted. The paper notes that such clauses have been used by hotel-booking platforms, price-comparison platforms and Amazon (p. 22). The paper's Proposition 4 asks when a marketplace that cannot observe how easily buyers switch actually wants such a clause. This mission formalizes that proposition and the profit formulas behind it.

Setting

A marketplace MMM, a seller SSS and a unit mass of buyers with unit demand. Every buyer values SSS's product at vvv; SSS's marginal cost is c<vc<vc<v; the outside option is worth 000. SSS sells on MMM at price pmp_mpm​, paying MMM a fee fff per transaction, or directly at price pdp_dpd​ with no fee. A buyer who buys directly bears a switching cost sss. In the baseline state switching costs are uniform on [0,μ][0,\mu][0,μ], μ>0\mu>0μ>0, with clamped distribution function G(s)=min⁡{max⁡{s/μ,0},1}G(s)=\min\{\max\{s/\mu,0\},1\}G(s)=min{max{s/μ,0},1}. In the no-switching state switching costs are infinite and nobody buys directly. The baseline state occurs with probability qqq. SSS knows the state when it decides; MMM does not when it sets fff.

Without a PPC, SSS always lists, sets pm=vp_m=vpm​=v, and in the baseline state picks pd≤vp_d\le vpd​≤v to maximize

π(f,pd)=(pd−c)G(v−pd)+(v−c−f)(1−G(v−pd)).\pi(f,p_d)=(p_d-c)G(v-p_d)+(v-c-f)\big(1-G(v-p_d)\big).π(f,pd​)=(pd​−c)G(v−pd​)+(v−c−f)(1−G(v−pd​)).

A maximizer is a seller-optimal price pd∗(f)p_d^*(f)pd∗​(f). MMM's value is

Π∗=max⁡f≤v−cf(1−q G(v−pd∗(f))).\Pi^*=\max_{f\le v-c} f\big(1-q\,G(v-p_d^*(f))\big).Π∗=f≤v−cmax​f(1−qG(v−pd∗​(f))).

With a PPC, a listed seller must set pd=pm=vp_d=p_m=vpd​=pm​=v and earns v−c−fv-c-fv−c−f. A seller that delists earns max⁡c≤pd≤v(pd−c)G(v−pd)\max_{c\le p_d\le v}(p_d-c)G(v-p_d)maxc≤pd​≤v​(pd​−c)G(v−pd​) in the baseline state and 000 in the no-switching state. It accepts MMM's offer when listing pays at least as much, so MMM's value ΠPPC∗\Pi^*_{PPC}ΠPPC∗​ is the largest expected revenue f⋅Pr⁡[accept]f\cdot\Pr[\text{accept}]f⋅Pr[accept] over all fees fff.

Formalization targets

Goal: Proposition 4 (p. 23)

For c<vc<vc<v, μ>0\mu>0μ>0 and 0<q≤10<q\le 10<q≤1, both values exist, and

Π∗>ΠPPC∗  ⟺  q<12  and  μ>v−c2,otherwiseΠPPC∗≥Π∗.\Pi^*>\Pi^*_{PPC}\iff q<\tfrac12\ \text{ and }\ \mu>\tfrac{v-c}{2},\qquad\text{otherwise}\quad \Pi^*_{PPC}\ge\Pi^* .Π∗>ΠPPC∗​⟺q<21​  and  μ>2v−c​,otherwiseΠPPC∗​≥Π∗.

The goal states the comparison for any values satisfying the optimality predicates, so it is insensitive to how either value is later computed.

Milestones

  1. ΠPPC∗=max⁡{v−c−D, (1−q)(v−c)}\Pi^*_{PPC}=\max\{v-c-D,\ (1-q)(v-c)\}ΠPPC∗​=max{v−c−D, (1−q)(v−c)}, where D=max⁡c≤pd≤v(pd−c)G(v−pd)D=\max_{c\le p_d\le v}(p_d-c)G(v-p_d)D=maxc≤pd​≤v​(pd​−c)G(v−pd​) (p. 23).
  2. D=(v−c)24μD=\dfrac{(v-c)^2}{4\mu}D=4μ(v−c)2​ if μ≥v−c2\mu\ge\frac{v-c}{2}μ≥2v−c​ and D=v−c−μD=v-c-\muD=v−c−μ otherwise, so ΠPPC∗\Pi^*_{PPC}ΠPPC∗​ has a closed form (p. 39).
  3. For q<12q<\tfrac12q<21​: Π∗=(v−c)(1−qmin⁡{v−c2μ,1})\displaystyle\Pi^*=(v-c)\Big(1-q\min\Big\{\frac{v-c}{2\mu},1\Big\}\Big)Π∗=(v−c)(1−qmin{2μv−c​,1}) (p. 39).

Significance

Proposition 4 identifies a trade-off. A PPC removes leakage entirely, but it also takes away the seller's ability to divert some buyers when the fee turns out to be too high, so the seller may refuse to participate. When the baseline state is unlikely and switching costs in it are high, the marketplace earns more by tolerating leakage and charging the full surplus v−cv-cv−c. In every other case the clause pays. This makes the welfare and competition-policy debate about parity clauses explicit in a two-parameter region. It also contrasts with the case without uncertainty, where a PPC is always better for the marketplace.

The paper's proof (§8.5, pp. 39–40) is a short case comparison between closed forms. It has not been machine-checked. The printed formula for Π∗\Pi^*Π∗ when q≥1/2q\ge 1/2q≥1/2 omits the corner fee f=v−cf=v-cf=v−c and is wrong for small μ\muμ. The conclusion ΠPPC∗≥Π∗\Pi^*_{PPC}\ge\Pi^*ΠPPC∗​≥Π∗ still holds there, but by a different comparison. A formal proof pins down which steps survive.

Difficulty

Two optimizations are nested. The seller's optimal direct price changes regime at f=2μf=2\muf=2μ, where the uniform distribution's kink binds. The marketplace's revenue without a PPC is therefore piecewise in fff, with an interior candidate μ/q\mu/qμ/q that is feasible only when q≥1/2q\ge 1/2q≥1/2. Under a PPC, revenue is discontinuous in fff because acceptance switches on and off. Its maximum is attained only because acceptance is weak. Comparing the two values requires a case split over q≷12q\gtrless\tfrac12q≷21​ and μ\muμ against (v−c)/2(v-c)/2(v−c)/2 and q(v−c)q(v-c)q(v−c), and the boundary cases include genuine ties (Π∗=ΠPPC∗\Pi^*=\Pi^*_{PPC}Π∗=ΠPPC∗​ for q<12q<\tfrac12q<21​, μ≤v−c2\mu\le\frac{v-c}{2}μ≤2v−c​). Reading off a single printed closed form for Π∗\Pi^*Π∗ fails in part of the q≥1/2q\ge 1/2q≥1/2 region.

Formalization scope

All objects are in one definitions file in namespace MarketplaceLeakage.Parity. The parameters are real numbers v c μ q, with standing hypotheses c < v, 0 < μ, 0 < q, q ≤ 1 on every theorem. The paper states v>cv>cv>c (p. 5) and μ>0\mu>0μ>0 (p. 9). q∈(0,1]q\in(0,1]q∈(0,1] is added: qqq is a probability, and at q=0q=0q=0 both values equal v−cv-cv−c, so the "if" direction of the goal fails. q=1q=1q=1 is allowed. The statements use the reduced seller problem (1), as the paper does after its Lemma 1 (p. 7), with pm=vp_m=vpm​=v. Lemma 1 itself is not posed.

Committed conventions:

  • GGG is the clamped uniform CDF.
  • Seller-optimality is a predicate (IsSOpt), not a formula.
  • ΠPPC∗\Pi^*_{PPC}ΠPPC∗​ (IsPPCValue) is the attained maximum of f⋅(q 1[acceptB]+(1−q) 1[acceptN])f\cdot(q\,\mathbf 1[\text{accept}_B]+(1-q)\,\mathbf 1[\text{accept}_N])f⋅(q1[acceptB​]+(1−q)1[acceptN​]) over all f∈Rf\in\mathbb Rf∈R. Acceptance is weak and is stated against every delisting price c≤pd≤vc\le p_d\le vc≤pd​≤v.
  • Π∗\Pi^*Π∗ (IsNoPPCValue) is the attained maximum of f(1−qG(v−pd))f(1-qG(v-p_d))f(1−qG(v−pd​)) over f≤v−cf\le v-cf≤v−c and seller-optimal pdp_dpd​.
  • "Prefers not to impose" is strict; "otherwise prefers to impose" is weak.

These choices rule out the trivializing formalizations. Neither value is defined by its printed max-expression, which would make the milestones definitional. Strict acceptance would leave the PPC optimum unattained. A value given by sSup would be meaningless off its domain. Reading "prefers to impose" strictly would make the statement false at the ties.

No published platform definitions are reused. A complete development needs only elementary real analysis: maximizing piecewise-quadratic functions, attainment on compact intervals, and case analysis over min/max. The lemmas on the seller's best response under the uniform GGG are reusable in the companion missions on Propositions 1–3 of the same paper. Proofs of any milestone are welcome independently.

Selected references

  • A. Hagiu, J. Wright, Marketplace Leakage, Management Science, 2023 (authors' manuscript dated March 2023). https://doi.org/10.1287/mnsc.2023.4757
6 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsOptimization·Captain: mikedeng1

Marketplace Leakage 1: With Uniform Switching Costs the Equilibrium Fee Is min{μ, v − c}, Leakage Is Positive but Partial, and the Marketplace's Profit Increases in μResearch Paper

Motivation

Online marketplaces such as Airbnb, Amazon, eBay, Preply or Upwork earn most of their revenue from transaction fees: a seller who sells through the marketplace pays a fee on every sale. Many of these sellers also run their own sales channel, and a buyer who discovers a seller on the marketplace can often complete the purchase directly with that seller, avoiding the fee. This is marketplace leakage (also called disintermediation or showrooming of the platform). Marketplaces respond with measures the paper lists on its first pages: bundling transaction-related services, restricting buyer–seller communication before a transaction, and penalizing sellers caught taking clients off the platform.

Hagiu and Wright (Marketplace Leakage, Management Science, 2023) build a minimal model of this tension. Their baseline analysis answers the first question any of the later strategies depends on: if the marketplace can only choose its fee, what fee does it set, how much leakage remains in equilibrium, and how do these respond when buying directly becomes more costly for buyers? This mission formalizes that baseline result, Proposition 1 of the paper, for uniformly distributed switching costs.

Setting

There is one marketplace MMM, one seller SSS and a unit mass of buyers, each wanting one unit of SSS's product. Every buyer values the product at vvv; SSS's marginal cost is ccc, with c<vc<vc<v; the outside option is worth 000.

SSS can sell through MMM, paying MMM a fee fff per transaction, or through its direct channel, which carries no fee. It sets a price pmp_mpm​ on MMM and a direct price pdp_dpd​. A buyer who buys directly bears a switching cost sss; in this mission sss is uniformly distributed on [0,μ][0,\mu][0,μ] with μ>0\mu>0μ>0, so its CDF is

G(s)=min⁡{max⁡{sμ,0},1}.G(s)=\min\Bigl\{\max\Bigl\{\frac s\mu,0\Bigr\},1\Bigr\}.G(s)=min{max{μs​,0},1}.

The timing is: MMM sets fff; observing fff, SSS sets its prices; buyers then choose. The paper's Lemma 1 lets one fix pm=vp_m=vpm​=v, so SSS only chooses pd≤vp_d\le vpd​≤v. A buyer buys directly iff s≤v−pds\le v-p_ds≤v−pd​, so a share G(v−pd)G(v-p_d)G(v−pd​) of buyers — the leakage — buys directly. SSS's profit at fee fff is

πf(pd)=(pd−c) G(v−pd)+(v−c−f) (1−G(v−pd)),\pi_f(p_d)=(p_d-c)\,G(v-p_d)+(v-c-f)\,\bigl(1-G(v-p_d)\bigr),πf​(pd​)=(pd​−c)G(v−pd​)+(v−c−f)(1−G(v−pd​)),

and MMM earns Π=f (1−G(v−pd))\Pi=f\,(1-G(v-p_d))Π=f(1−G(v−pd​)). A direct price is seller-optimal at fff if it maximizes πf\pi_fπf​ over pd≤vp_d\le vpd​≤v. An equilibrium outcome is a pair (f,pd)(f,p_d)(f,pd​) with f≤v−cf\le v-cf≤v−c, pdp_dpd​ seller-optimal at fff, such that no other fee f′≤v−cf'\le v-cf′≤v−c, followed by a seller-optimal response, gives MMM more.

Formalization targets

Goal: Proposition 1

For every μ>0\mu>0μ>0 an equilibrium outcome exists, and every equilibrium outcome (f∗,pd∗)(f^*,p_d^*)(f∗,pd∗​) satisfies

f∗(μ)=min⁡{μ,v−c},pd∗(μ)=v−min⁡{μ2,v−c2},Π∗(μ)={μ/2μ≤v−c,(v−c)(1−v−c2μ)μ≥v−c,f^*(\mu)=\min\{\mu,v-c\},\qquad p_d^*(\mu)=v-\min\Bigl\{\frac\mu2,\frac{v-c}2\Bigr\},\qquad \Pi^*(\mu)=\begin{cases}\mu/2 & \mu\le v-c,\\ (v-c)\bigl(1-\frac{v-c}{2\mu}\bigr) & \mu\ge v-c,\end{cases}f∗(μ)=min{μ,v−c},pd∗​(μ)=v−min{2μ​,2v−c​},Π∗(μ)={μ/2(v−c)(1−2μv−c​)​μ≤v−c,μ≥v−c,​

with leakage G(v−pd∗)=1μ(v−pd∗)∈(0,1)G(v-p_d^*)=\frac1\mu(v-p_d^*)\in(0,1)G(v−pd∗​)=μ1​(v−pd∗​)∈(0,1). As μ\muμ increases, the fee weakly increases, the direct price and the leakage weakly decrease, and the marketplace's profit strictly increases.

Milestones

  1. (4): for every fee f≥0f\ge0f≥0 the seller's optimal direct price is unique and equals v−f/2v-f/2v−f/2 if f≤2μf\le2\muf≤2μ and v−μv-\muv−μ if f≥2μf\ge2\muf≥2μ.
  2. (5): at such a response the marketplace earns f(1−f/(2μ))f(1-f/(2\mu))f(1−f/(2μ)) if f≤2μf\le 2\muf≤2μ and 000 if f≥2μf\ge2\muf≥2μ.
  3. The optimal fee (proof of Proposition 1): (f,pd)(f,p_d)(f,pd​) is an equilibrium outcome iff f=min⁡{μ,v−c}f=\min\{\mu,v-c\}f=min{μ,v−c} and pdp_dpd​ is seller-optimal at fff.
  4. Equilibrium leakage (proof of Proposition 1): G(v−pd∗)=f∗/(2μ)=min⁡{1/2,(v−c)/(2μ)}G(v-p_d^*)=f^*/(2\mu)=\min\{1/2,(v-c)/(2\mu)\}G(v−pd∗​)=f∗/(2μ)=min{1/2,(v−c)/(2μ)}.

Significance

Proposition 1 is the baseline against which the paper measures every anti-leakage strategy: investment in transaction benefits, communication bans, referral fees and price-parity clauses are each compared with the fee-only outcome Π∗(μ)\Pi^*(\mu)Π∗(μ), and Proposition 3 of the paper uses the closed form (6) directly. The result also has a substantive message: a fee-setting marketplace never eliminates leakage, but never lets it become total, and it gains from higher switching costs even though its own fee response offsets part of their effect on leakage.

The proposition is proved in the paper by elementary calculus. To our knowledge it has no machine-checked proof. Formalizing it produces a checked version of the baseline game, a verified statement of the seller's best response and the marketplace's value as functions of the fee, and a template that the companion missions on this paper reuse.

Difficulty

The seller's problem is not a smooth concave program: the clamped distribution GGG creates a kink at v−pd=μv-p_d=\muv−pd​=μ, below which every buyer switches and the profit is linear in pdp_dpd​. The first-order condition pd=v−f/2p_d=v-f/2pd​=v−f/2 is the optimum only while f≤2μf\le2\muf≤2μ; above that the optimum sits at the kink. The marketplace's objective inherits a kink at f=2μf=2\muf=2μ, and its feasible set f≤v−cf\le v-cf≤v−c adds a corner that binds exactly when μ>v−c\mu>v-cμ>v−c. Negative fees are feasible and must be ruled out. The comparative statics compare equilibrium objects across two parameter values that may lie in different regimes, so the statement cannot be read off one formula.

Formalization scope

All parameters are real numbers, with the standing assumptions c<vc<vc<v and μ>0\mu>0μ>0 as explicit hypotheses. GGG is the clamped uniform CDF above. The statements use the reduced seller problem (1) with pm=vp_m=vpm​=v, as the paper does after Lemma 1; Lemma 1 itself, which concerns the full game in which SSS also chooses pmp_mpm​, is not posed. Seller-optimality is an optimality predicate over pd≤vp_d\le vpd​≤v, and the equilibrium is an optimality predicate over feasible fees f≤v−cf\le v-cf≤v−c (negative fees included); "max" is attained, not a supremum. The displays (4) and (5) are stated for f≥0f\ge0f≥0, which is what they require; the paper's preface "Assuming f≤v−cf\le v-cf≤v−c" is not needed and does not exclude f<0f<0f<0.

Trivializing formalizations are ruled out: the seller's response and the marketplace's profit are not defined by the closed forms (4)–(5), the marketplace's value is not an unattained sSup, the equilibrium fee is not selected by Classical.choose, and the comparative statics are stated about equilibrium outcomes at two values of μ\muμ, not about the formulas alone.

The development needs only Mathlib's real arithmetic, min/max and order lemmas. A proof of the seller's best response for a clamped uniform distribution is reusable in the companion missions on transaction benefits, communication bans and price parity, which restate the same model. Proofs of any milestone are welcome independently.

Selected references

  • A. Hagiu and J. Wright, Marketplace Leakage, Management Science, 2023. https://doi.org/10.1287/mnsc.2023.4757 (formalized from the authors' manuscript dated March 2023; Proposition 1 on pp. 9–10, proof in §8.2, p. 34).
6 thms2 active usersReviewed
🏆Completed
EconomicsOptimization·Captain: mikedeng1

Digital Privacy II: Against the Social Optimum, a Business Never Under-Collects While Over-Protecting Data, and a Purely Usage-Driven One Under-Collects and Under-ProtectsResearch Paper

Motivation

Digital businesses (search engines, social networks, marketplaces) record what their users do and decide how well to protect what they record. Both choices affect users: stored data can improve the service, and it can also be accessed by adversaries such as hackers, fraudsters or data brokers, whose activity harms users. Regulation of data collection and data protection (the GDPR, the CCPA, liability rules for breaches) presupposes an answer to a basic question: in which direction does a profit-maximizing business's data strategy deviate from the one a benevolent planner would choose?

I. P. Fainmesser, A. Galeotti and R. Momot, Digital Privacy (Management Science 69(6), 2023; author manuscript SSRN 3459274), answer it in a model where users, adversaries and the business all respond to each other. Their Theorem 2 shows that the deviation is not arbitrary: one combination of errors never occurs, and the sign of the error is pinned down completely for a business whose revenue depends only on usage. This mission formalizes those two claims.

Setting

A data strategy is a pair (ξ,C)(\xi, C)(ξ,C): the share ξ∈[0,1]\xi \in [0,1]ξ∈[0,1] of each user's activity that the business stores, and a protection level C≥0C \ge 0C≥0, which costs ψC\psi CψC. The parameters are real numbers: a network effect β∈[0,1)\beta \in [0,1)β∈[0,1), the users' marginal benefit from stored data ρ∈[0,1)\rho \in [0,1)ρ∈[0,1), the cost ψ\psiψ, the revenue model P∈[0,1]P \in [0,1]P∈[0,1], and the planner's weight α∈[0,1]\alpha \in [0,1]α∈[0,1].

Given (ξ,C)(\xi, C)(ξ,C), a unit mass of identical users choose activity levels and a large population of adversaries decide whether to access the stored data. The resulting equilibrium (Proposition 1 of the paper, display (3)) has average user activity

aˉ∗(ξ,C)=C(1+ρξ)C(1−β)+ξ2,aˉ∗(0,C)=11−β.\bar a^*(\xi, C) = \frac{C(1+\rho\xi)}{C(1-\beta)+\xi^2}, \qquad \bar a^*(0, C) = \frac{1}{1-\beta}.aˉ∗(ξ,C)=C(1−β)+ξ2C(1+ρξ)​,aˉ∗(0,C)=1−β1​.

The value at ξ=0\xi = 0ξ=0 is the activity when nothing is stored, the value the paper uses where (3) reads 0/00/00/0. From aˉ∗\bar a^*aˉ∗ one builds the consumer surplus (4), the business's profit (2) and the planner's objective (7):

CS(ξ,C)=12aˉ∗(ξ,C)2,Π(ξ,C)=(1−P) aˉ∗(ξ,C)+P ξ aˉ∗(ξ,C)−ψC,W(ξ,C)=α CS(ξ,C)+(1−α) Π(ξ,C).\mathrm{CS}(\xi,C) = \tfrac12 \bar a^*(\xi,C)^2, \qquad \Pi(\xi,C) = (1-P)\,\bar a^*(\xi,C) + P\,\xi\,\bar a^*(\xi,C) - \psi C, \qquad W(\xi,C) = \alpha\,\mathrm{CS}(\xi,C) + (1-\alpha)\,\Pi(\xi,C).CS(ξ,C)=21​aˉ∗(ξ,C)2,Π(ξ,C)=(1−P)aˉ∗(ξ,C)+Pξaˉ∗(ξ,C)−ψC,W(ξ,C)=αCS(ξ,C)+(1−α)Π(ξ,C).

The revenue model PPP interpolates between a purely usage-driven business (P=0P = 0P=0, revenue proportional to activity) and a purely data-driven one (P=1P = 1P=1, revenue proportional to stored data ξaˉ∗\xi \bar a^*ξaˉ∗). A business optimum (ξ∗,C∗)(\xi^*, C^*)(ξ∗,C∗) maximizes Π\PiΠ over the feasible set [0,1]×[0,∞)[0,1] \times [0,\infty)[0,1]×[0,∞); a social optimum (ξW,CW)(\xi^W, C^W)(ξW,CW) maximizes WWW over the same set. The business under-collects if ξ∗≤ξW\xi^* \le \xi^Wξ∗≤ξW and over-protects if C∗≥CWC^* \ge C^WC∗≥CW, and so on.

Formalization targets

Goal: Theorem 2, first two sentences

The paper's Theorem 2 (p. 13) reads:

Relative to the socially optimal strategy, the equilibrium data strategy of a purely usage-driven business (P = 0) prescribes under-collection and under-protection of users' data, i.e., ξ* ≤ ξ^W and C* ≤ C^W. The equilibrium data strategy of a business with any data-driven component in its revenue model (P > 0) never prescribes under-collection and over-protection of users' data i.e., it is never the case that ξ* ≤ ξ^W and C* ≥ C^W with at least one of the inequalities being strict. Any other direction in which the optimal business's data strategy deviates from the socially optimal strategy is the outcome for some specification of the business's revenue model and values of other model parameters.

The goal is its first two sentences, for every business optimum and every social optimum:

P=0  ⟹  ξ∗≤ξW and C∗≤CW,P = 0 \;\Longrightarrow\; \xi^* \le \xi^W \text{ and } C^* \le C^W,P=0⟹ξ∗≤ξW and C∗≤CW, P>0  ⟹  ¬(ξ∗≤ξW, C∗≥CW, at least one strict).P > 0 \;\Longrightarrow\; \neg\bigl(\xi^* \le \xi^W,\ C^* \ge C^W,\ \text{at least one strict}\bigr).P>0⟹¬(ξ∗≤ξW, C∗≥CW, at least one strict).

The third sentence is established numerically in the paper (Figure 3) and is not a target.

Milestones

  1. Display (11), p. 34: under ξ∗≤ξW\xi^* \le \xi^Wξ∗≤ξW and C∗≥CWC^* \ge C^WC∗≥CW, the social optimum has weakly higher activity, aˉ∗(ξW,CW)≥aˉ∗(ξ∗,C∗)\bar a^*(\xi^W, C^W) \ge \bar a^*(\xi^*, C^*)aˉ∗(ξW,CW)≥aˉ∗(ξ∗,C∗).
  2. Display (12), p. 34: under the same assumptions, aˉ∗(ξW,CW) ξW≥aˉ∗(ξ∗,C∗) ξ∗\bar a^*(\xi^W,C^W)\,\xi^W \ge \bar a^*(\xi^*,C^*)\,\xi^*aˉ∗(ξW,CW)ξW≥aˉ∗(ξ∗,C∗)ξ∗.
  3. Proposition 5(i), first claim (Online App. p. 8): for fixed CCC and P=0P = 0P=0, a collection level maximizes Π(⋅,C)\Pi(\cdot, C)Π(⋅,C) on [0,1][0,1][0,1] if and only if it maximizes W(⋅,C)W(\cdot, C)W(⋅,C).
  4. The P=0P = 0P=0 step of the proof (App. A.4, p. 34): if P=0P = 0P=0 and ξ∗>ξW\xi^* > \xi^Wξ∗>ξW, then C∗>CWC^* > C^WC∗>CW.

Significance

The result. Theorem 2 identifies the one inefficiency that no revenue model produces: a business never stores too little data while protecting it too much. All other combinations occur for some parameters, so a regulator cannot infer the direction of a business's error without knowing its revenue model; but for a purely usage-driven business the direction is known, and it is too little protection. This underlies the paper's discussion of policy in §6, where the instruments considered (liability for data breaches, taxes on data) are compared by how they move (ξ∗,C∗)(\xi^*, C^*)(ξ∗,C∗) towards (ξW,CW)(\xi^W, C^W)(ξW,CW).

The formalization. The result is proved in the paper (App. A.4, with Proposition 5 in Online App. C.5); it has not been machine-checked. The paper's argument for the purely usage-driven case refers to first-order conditions and does not treat the boundary strategies (ξ=0\xi = 0ξ=0, C=0C = 0C=0) or parameter corners (ρ=0\rho = 0ρ=0) separately; a formal proof has to handle them. A complete development also yields reusable facts about the equilibrium activity aˉ∗\bar a^*aˉ∗: its sign, its behaviour in ξ\xiξ for fixed CCC, and the monotonicity in CCC of the activity-maximizing collection level.

Difficulty

Both optima are defined only implicitly, as maximizers over a non-compact feasible set of a non-concave objective, and neither has a closed form that this mission may use. The comparison must therefore work from the optimality inequalities alone. The tempting approach, comparing first-order conditions, does not give a global statement: Π\PiΠ and WWW may have several local maxima, the maximizers need not be unique (both optima are (0,0)(0,0)(0,0) in a whole region of parameters), and the constraint ξ≤1\xi \le 1ξ≤1 binds for large protection. In the purely usage-driven case the profit and welfare share their maximizers in ξ\xiξ for each fixed CCC, but turning that into a comparison of C∗C^*C∗ with CWC^WCW requires control of how the maximizing ξ\xiξ moves with CCC, including at C=0C = 0C=0.

Formalization scope

All objects are real-valued functions of explicit real parameters β,ρ,ψ,P,α\beta, \rho, \psi, P, \alphaβ,ρ,ψ,P,α and of the strategy (ξ,C)(\xi, C)(ξ,C), in the namespace DigitalPrivacy.Welfare, which imports aˉ∗\bar a^*aˉ∗, CS, the feasible set and the business optimum from the shared module DigitalPrivacy.Strategy.Setting. The equilibrium activity takes the value 1/(1−β)1/(1-\beta)1/(1−β) at ξ=0\xi = 0ξ=0 for every CCC, as in the paper; Lean's default 0/0=00/0 = 00/0=0 is not used. Optima are predicates (IsBusinessOpt, IsSocialOpt): a feasible point at which the objective is at least its value at every feasible point. Theorem 2 quantifies over every pair of optima and asserts neither existence nor uniqueness. The P > 0 clause keeps the "at least one strict" condition; without it the clause is false, because both optima coincide at (0,0)(0,0)(0,0) in part of the parameter space.

The standing assumptions are the paper's ranges 0≤β<10 \le \beta < 10≤β<1, 0≤ρ<10 \le \rho < 10≤ρ<1, 0≤P≤10 \le P \le 10≤P≤1, α≤1\alpha \le 1α≤1, with two disclosed strengthenings: ψ>0\psi > 0ψ>0 (with ψ=0\psi = 0ψ=0, ρ=0\rho = 0ρ=0, P=0P = 0P=0, every (0,C)(0, C)(0,C) is both a business and a social optimum and the P=0P = 0P=0 sentence fails) and α>0\alpha > 0α>0 (with α=0\alpha = 0α=0 the planner's problem is the business's, and step (11) does not hold). Proposition 5(i) is stated with the printed ranges, α=0\alpha = 0α=0 included. No other hypothesis is added, so the hypotheses on the optima cannot be made vacuous by the encoding; a sanity check exhibits parameters at which (0,0)(0,0)(0,0) is both a business and a social optimum.

A complete development needs elementary real analysis of the rational function aˉ∗\bar a^*aˉ∗ on [0,1]×[0,∞)[0,1] \times [0,\infty)[0,1]×[0,∞) and nothing beyond Mathlib. Proofs of the milestones, of lemmas about aˉ∗\bar a^*aˉ∗, and alternative arguments for the goal are all welcome. The paper's proofs are in App. A.4 (pp. 33–35) and Online App. C.5 (Online pp. 8–9).

Selected references

  • I. P. Fainmesser, A. Galeotti, R. Momot, Digital Privacy, Management Science 69(6):3157–3173, 2023. https://doi.org/10.1287/mnsc.2022.4513. Author manuscript, This Draft: April 2022, https://ssrn.com/abstract=3459274 (the version cited for all page and display numbers).
7 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryEconomicsMechanism Design·Captain: mikedeng1

Improving Dispute Resolution in Two-Sided Platforms: The Case of Review Blackmail I: Under Centralized Dispute Resolution the Equilibrium Ransom Is Not Monotonically Decreasing in Efficiency γδResearch Paper

Review blackmail on online platforms

Online marketplaces depend on consumer reviews, and a single negative review can move a seller's future sales. Review blackmail exploits this: a consumer buys a product, posts a negative review, and offers to remove it in exchange for a payment. Platforms such as Amazon, eBay, Taobao and TripAdvisor respond with dispute resolution mechanisms that let sellers contest reviews. Papanastasiou, Yang and Zhang (Management Science 69(10), 2023) build a game-theoretic model of the seller, the blackmailer and the market's belief about product quality, and ask how the design of such a mechanism changes the blackmailer's leverage. Their first finding concerns a centralized mechanism, where the seller reports the review and the platform judges it: making the platform faster or more accurate does not always lower the ransom the blackmailer can extract. This mission formalizes that result together with the equilibrium analysis it rests on.

The model

A monopolist sells a product of unobservable quality q∈{l,h}q\in\{l,h\}q∈{l,h}; the market's prior that quality is high is a∈(0,1)a\in(0,1)a∈(0,1). A buyer of a high-quality product has gross utility vjv_jvj​ with probability θ∈(0,1)\theta\in(0,1)θ∈(0,1) and 000 otherwise, with vjv_jvj​ standard uniform; a low-quality product always gives 000. One consumer arrives.

  • With probability β∈(0,1)\beta\in(0,1)β∈(0,1) he is malicious: he buys, posts a negative review NNN, and demands a ransom rrr for removing it.
  • Otherwise he is regular: at price ppp he buys iff aθvj−p≥0a\theta v_j-p\ge0aθvj​−p≥0, which happens with probability ρ=1−p/(aθ)\rho=1-p/(a\theta)ρ=1−p/(aθ), and posts a truthful review, positive (PPP) or negative (NNN). No purchase means no review, written R=0R=0R=0.

The market sees the review R∈{N,0,P}R\in\{N,0,P\}R∈{N,0,P}, updates its belief to a posterior a′a'a′ by Bayes' rule, and the seller then earns a continuation payoff π(a′)\pi(a')π(a′), with π\piπ nonnegative, convex and strictly increasing on [0,1][0,1][0,1].

Facing a ransom demand the seller can settle (sss: pay rrr, the review disappears), do nothing (nnn: the review stays), or report (ccc) the review to the platform's centralized mechanism at a hassle cost c≥0c\ge0c≥0. The platform investigates immediately with probability γ∈[0,1]\gamma\in[0,1]γ∈[0,1] (timeliness) and identifies a malicious review correctly with probability δ∈[0,1]\delta\in[0,1]δ∈[0,1] (accuracy); the review is removed with probability γδ\gamma\deltaγδ, the mechanism efficiency.

The market cannot observe the seller's interaction with the blackmailer. It holds a belief i∈{s,n,c}i\in\{s,n,c\}i∈{s,n,c} about the seller's response, and this belief determines the posteriors: under belief iii a malicious review stays visible with probability ms=0m_s=0ms​=0, mn=1m_n=1mn​=1 or mc=1−γδm_c=1-\gamma\deltamc​=1−γδ, and aRia^i_RaRi​ is the Bayes posterior computed from the resulting review likelihoods. When the market believes iii and the seller plays jjj, his payoff is π(a0i)−r\pi(a^i_0)-rπ(a0i​)−r (j=sj=sj=s), π(aNi)\pi(a^i_N)π(aNi​) (j=nj=nj=n), or γδ π(a0i)+(1−γδ)π(aNi)−c\gamma\delta\,\pi(a^i_0)+(1-\gamma\delta)\pi(a^i_N)-cγδπ(a0i​)+(1−γδ)π(aNi​)−c (j=cj=cj=c). A response iii is an equilibrium if it is a best response to the belief iii; among several equilibria, the seller-preferred one prevails. The malicious consumer buys iff some ransom r>pr>pr>p is accepted in the prevailing equilibrium, and the equilibrium ransom r∗r^*r∗ is the greatest ransom at which settling prevails.

Formalization targets

Goal: Corollary 1 (p. 14)

If c>0c>0c>0 and p<π(a)−π(aNn)−cp<\pi(a)-\pi(a^n_N)-cp<π(a)−π(aNn​)−c, there are efficiencies 0≤e1<e2≤10\le e_1<e_2\le10≤e1​<e2​≤1 at both of which the malicious consumer purchases, with

r∗(e1)<r∗(e2).r^*(e_1)<r^*(e_2).r∗(e1​)<r∗(e2​).

The equilibrium ransom is not monotonically decreasing in the efficiency γδ\gamma\deltaγδ.

Milestones

  1. Lemma 2 (p. 11): aPi=1a^i_P=1aPi​=1, a0i=aa^i_0=aa0i​=a, aNi∈[0,a]a^i_N\in[0,a]aNi​∈[0,a], and closed forms of aNna^n_NaNn​, aNca^c_NaNc​, aNsa^s_NaNs​.
  2. Ordering (§4.1, p. 11): aNs<aNc<aNna^s_N<a^c_N<a^n_NaNs​<aNc​<aNn​ for 0<γδ<10<\gamma\delta<10<γδ<1.
  3. Proposition 1(1)–(3) (p. 13): the exact conditions under which nnn, sss and ccc are equilibria, e.g.
i=n is an equilibrium  ⟺  π(aNn)≥max⁡{π(a)−r, π(a)−c/γδ}.i=n\ \text{is an equilibrium}\iff \pi(a^n_N)\ge\max\{\pi(a)-r,\ \pi(a)-c/\gamma\delta\}.i=n is an equilibrium⟺π(aNn​)≥max{π(a)−r, π(a)−c/γδ}.
  1. Proposition 2(1)–(2) (p. 13): the equilibrium ransom
r∗={π(a)−π(aNn),c≥γδ(π(a)−π(aNn)),(1−γδ)[π(a)−π(aNc)]+c,c<γδ(π(a)−π(aNn)),r^*=\begin{cases}\pi(a)-\pi(a^n_N), & c\ge\gamma\delta(\pi(a)-\pi(a^n_N)),\\ (1-\gamma\delta)[\pi(a)-\pi(a^c_N)]+c, & c<\gamma\delta(\pi(a)-\pi(a^n_N)),\end{cases}r∗={π(a)−π(aNn​),(1−γδ)[π(a)−π(aNc​)]+c,​c≥γδ(π(a)−π(aNn​)),c<γδ(π(a)−π(aNn​)),​

and the malicious consumer purchases iff p<r∗p<r^*p<r∗.

Significance

Corollary 1 is the paper's headline message about centralized dispute resolution: improving the mechanism's timeliness or accuracy can raise the ransom. Below an efficiency threshold the mechanism is never used and the ransom equals the seller's loss from a visible negative review; just above it, the market expects the seller to report blackmail, which softens how it reads a negative review, and the blackmailer can ask for more. This is the motivation for the paper's second design, semi-decentralized dispute resolution, analysed in a companion mission. Proposition 2 is the complete characterization of the blackmailer's equilibrium behaviour under the centralized mechanism and is used again in the paper's pricing analysis (§4.4).

The results are proved in the paper (Appendix C). No machine-checked version exists. This mission produces Lean statements of the model, of the Bayes posteriors, of the equilibrium conditions, of the seller-preferred selection and of the ransom characterization, all derived from the primitive game rather than from the paper's closed forms.

Difficulty

Each step is elementary, but the chain is long and sign-sensitive. The equilibrium conditions require handling a belief-dependent payoff (the posterior depends on what the market believes, not on what the seller does), so a deviation changes the action without changing the posteriors. The ransom characterization needs a three-way comparison of equilibria and the tie-breaking in favour of settling at the boundary, where two equilibria give the same payoff. The corollary needs the jump at the threshold efficiency c/(π(a)−π(aNn))c/(\pi(a)-\pi(a^n_N))c/(π(a)−π(aNn​)) to be strictly positive and to survive a small increase of the efficiency: the posterior aNca^c_NaNc​ moves with the efficiency, so a continuity argument for π\piπ composed with the posterior is required, and π\piπ is only assumed convex and strictly increasing on [0,1][0,1][0,1]. The natural first idea, comparing the two closed forms of Proposition 2 at a single point, does not suffice, since at the threshold itself the two regimes coincide in value.

Formalization scope

  • Representation. One structure Model with fields a,θ,β,p,ca,\theta,\beta,p,ca,θ,β,p,c and π:R→R\pi:\mathbb R\to\mathbb Rπ:R→R; inductive types for quality, reviews (NNN, Z for R=0R=0R=0, PPP) and responses. The posterior post m R is Bayes' rule over the likelihood table with visibility probability mmm of a malicious review; aRia^i_RaRi​ is post (keep (γ*δ) i) R.
  • Standing assumptions (Standing): a,θ,β∈(0,1)a,\theta,\beta\in(0,1)a,θ,β∈(0,1); π≥0\pi\ge0π≥0, convex and strictly increasing on [0,1][0,1][0,1]; c≥0c\ge0c≥0; and 0<p<aθ0<p<a\theta0<p<aθ. The last is implicit in the paper: it makes the purchase probability 1−p/(aθ)1-p/(a\theta)1−p/(aθ) that of a standard uniform valuation and keeps the event R=0R=0R=0 of positive probability. Every theorem also assumes γ,δ∈[0,1]\gamma,\delta\in[0,1]γ,δ∈[0,1].
  • Added hypotheses. 0<γδ<10<\gamma\delta<10<γδ<1 in the ordering (strictness) and in Proposition 1 (the page divides by γδ\gamma\deltaγδ and 1−γδ1-\gamma\delta1−γδ). c>0c>0c>0 in Corollary 1: at c=0c=0c=0 the corollary is false. Corollary 1's hypothesis, printed with a varying γδ\gamma\deltaγδ, is assumed at the threshold efficiency and required at both exhibited efficiencies.
  • Conventions. "Settling prevails" means settling is an equilibrium and no equilibrium pays the seller strictly more (ties go to settling, as in the paper's proof). r∗r^*r∗ is stated with IsGreatest of the set of ransoms at which settling prevails; purchase means some such ransom exceeds ppp. "Not monotonically decreasing" means not nonincreasing.
  • Ruled out. Defining the posteriors by Lemma 2's closed forms, or r∗r^*r∗ by Proposition 2's formulas, would make the milestones definitional; both are defined from the game instead.
  • Infrastructure. Only Mathlib (ConvexOn, StrictMonoOn, IsGreatest). Proofs of the milestones in order, and reusable lemmas on the monotonicity of the posterior in the visibility probability, are welcome.

Selected references

  • Y. Papanastasiou, S. A. Yang, A. H. Zhang, Improving Dispute Resolution in Two-Sided Platforms: The Case of Review Blackmail, Management Science 69(10):6021–6037, 2023. https://doi.org/10.1287/mnsc.2022.4655 (accepted manuscript: LBS Research Online, eprint 1988, https://lbsresearch.london.edu/id/eprint/1988/)
9 thms2 active usersReviewed
PreviousPage 24 of 45Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me