Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Optimization

1,666 missions · 908 completed

Missions

Open758Completed908All1666
Graph TheoryQuantum Information·Captain: mikedeng1

A Quantum Approximate Optimization Algorithm I: At p = 1 the QAOA Expected Cut Is at Least 0.6924 Times the Maximum Cut on Every Connected 3-Regular GraphResearch Paper

Motivation

The quantum approximate optimization algorithm (QAOA) of Farhi, Goldstone and Gutmann (arXiv:1411.4028, 2014) is a family of shallow quantum circuits, indexed by an integer depth p≥1p \ge 1p≥1, that prepare states whose computational-basis measurements are biased toward good solutions of a combinatorial optimization problem. It became the standard candidate for optimization on near-term quantum hardware, and its performance on MaxCut is the benchmark against which later analyses and experiments are measured.

The original paper proves one concrete performance guarantee: at depth p=1p = 1p=1, on 3-regular graphs, the algorithm achieves an approximation ratio of at least 0.69240.69240.6924. Short timeline:

  • 2014, Farhi–Goldstone–Gutmann: the p=1p = 1p=1 bound 0.69240.69240.6924 on 3-regular graphs, by reducing the expected cut to three subgraph functions and a numerical minimization (arXiv:1411.4028).
  • 2018, Wang, Hadfield, Jiang and Rieffel: closed-form expressions for the p=1p = 1p=1 MaxCut expectation on arbitrary graphs (arXiv:1706.02998, Phys. Rev. A 97, 022304).
  • Classically, Goemans and Williamson's semidefinite rounding achieves 0.8780.8780.878 on all graphs (J. ACM 42, 1995), so the p=1p = 1p=1 guarantee is, as the paper itself notes, below the best classical algorithms.

Setting

A graph GGG has vertex set {0,…,n−1}\{0, \dots, n-1\}{0,…,n−1}, and 3-regular means every vertex has exactly three neighbours. Each vertex carries a qubit; a computational basis state is a bit string z=z0⋯zn−1z = z_0 \cdots z_{n-1}z=z0​⋯zn−1​. For an edge ⟨jk⟩\langle jk\rangle⟨jk⟩ the clause C⟨jk⟩(z)C_{\langle jk\rangle}(z)C⟨jk⟩​(z) is 111 if zj≠zkz_j \neq z_kzj​=zk​ and 000 otherwise, and the cut objective is

C(z)=∑⟨jk⟩C⟨jk⟩(z),C(z) = \sum_{\langle jk\rangle} C_{\langle jk\rangle}(z),C(z)=⟨jk⟩∑​C⟨jk⟩​(z),

the number of edges cut by the bipartition zzz defines. As an operator, CCC is diagonal in the computational basis.

Let B=∑jσjxB = \sum_j \sigma^x_jB=∑j​σjx​ and let ∣s⟩=2−n/2∑z∣z⟩|s\rangle = 2^{-n/2}\sum_z |z\rangle∣s⟩=2−n/2∑z​∣z⟩. For angles γ,β∈R\gamma, \beta \in \mathbb Rγ,β∈R, the depth-one QAOA state and its expected cut are

∣γ,β⟩=e−iβB e−iγC ∣s⟩,F1(γ,β)=⟨γ,β∣ C ∣γ,β⟩=∑z∣⟨z∣γ,β⟩∣2 C(z).|\gamma,\beta\rangle = e^{-i\beta B}\, e^{-i\gamma C}\, |s\rangle, \qquad F_1(\gamma,\beta) = \langle\gamma,\beta|\,C\,|\gamma,\beta\rangle = \sum_z |\langle z|\gamma,\beta\rangle|^2\, C(z).∣γ,β⟩=e−iβBe−iγC∣s⟩,F1​(γ,β)=⟨γ,β∣C∣γ,β⟩=z∑​∣⟨z∣γ,β⟩∣2C(z).

The angles may be restricted to γ∈[0,2π]\gamma \in [0, 2\pi]γ∈[0,2π], β∈[0,π]\beta \in [0, \pi]β∈[0,π] by periodicity.

Two kinds of small subgraphs govern the analysis. A crossed square is a set of four vertices spanning exactly five edges (a 4-cycle with one diagonal). An isolated triangle is a triangle whose three outgoing edges end on three distinct vertices. SSS and TTT denote their numbers in GGG. Finally, for an edge ⟨jk⟩\langle jk\rangle⟨jk⟩ the subgraph type is the shape of the edge together with its adjacent edges; in a 3-regular graph there are three types g4,g5,g6g_4, g_5, g_6g4​,g5​,g6​, according as jjj and kkk have two, one or no common neighbours. Each type ggg defines a function fg(γ,β)f_g(\gamma, \beta)fg​(γ,β), the expectation of the clause of the central edge in the depth-one QAOA state of the subgraph ggg alone.

Formalization targets

Goal: the depth-one ratio on cubic graphs

For every connected 3-regular graph GGG there are angles γ∈[0,2π]\gamma \in [0, 2\pi]γ∈[0,2π], β∈[0,π]\beta \in [0, \pi]β∈[0,π] with

F1(γ,β)  ≥  0.6924⋅C(z)for every bit string z,F_1(\gamma, \beta) \;\ge\; 0.6924 \cdot C(z) \qquad \text{for every bit string } z,F1​(γ,β)≥0.6924⋅C(z)for every bit string z,

that is, M1=max⁡γ,βF1≥0.6924⋅max⁡zC(z)M_1 = \max_{\gamma,\beta} F_1 \ge 0.6924 \cdot \max_z C(z)M1​=maxγ,β​F1​≥0.6924⋅maxz​C(z). The constant is exactly the paper's 0.69240.69240.6924, and K4K_4K4​ is included.

Milestones

The paper's argument passes through the following claims, each a milestone:

  1. At p=1p = 1p=1 each edge term of a 3-regular graph equals fg4f_{g_4}fg4​​, fg5f_{g_5}fg5​​ or fg6f_{g_6}fg6​​ according to its subgraph type (p. 5).
  2. In a connected 3-regular graph other than K4K_4K4​, there are SSS edges of type g4g_4g4​ and 4S+3T4S + 3T4S+3T of type g5g_5g5​ (pp. 8–9).
  3. Equation (32): F1=Sfg4+(4S+3T)fg5+(3n/2−5S−3T)fg6F_1 = S f_{g_4} + (4S + 3T) f_{g_5} + (3n/2 - 5S - 3T) f_{g_6}F1​=Sfg4​​+(4S+3T)fg5​​+(3n/2−5S−3T)fg6​​ (p. 9).
  4. 3T+4S≤n3T + 4S \le n3T+4S≤n (p. 8).
  5. Every cut has at most 3n/2−S−T3n/2 - S - T3n/2−S−T edges (p. 9).
  6. For s,t≥0s, t \ge 0s,t≥0 with 4s+3t≤14s + 3t \le 14s+3t≤1, the scaled ratio (35) M1(1,s,t)/(3/2−s−t)M_1(1, s, t)/(3/2 - s - t)M1​(1,s,t)/(3/2−s−t) is at least 0.69240.69240.6924 (p. 9).
  7. On K4K_4K4​ the depth-one ratio exceeds 0.69240.69240.6924 (p. 8).

Significance

The result is the first rigorous worst-case guarantee for the QAOA, and the method behind it (the expected objective is a sum of local terms, each depending only on a bounded neighbourhood of an edge) is the template for every later analysis of fixed-depth QAOA on bounded-degree graphs. It shows that a depth-one circuit, of depth independent of nnn, achieves a constant approximation ratio uniformly over an infinite class of graphs.

The paper's proof is complete apart from one numerical step: the minimization of (35) is reported as a numerical evaluation. No machine-checked version of the result exists. A formal proof requires an exact evaluation of the three subgraph functions at suitable angles, an exact combinatorial count of edge types, and a certified inequality in place of the numerical minimization. The margin is small: the exact minimum is 12+133≈0.692450\tfrac12 + \tfrac{1}{3\sqrt 3} \approx 0.69245021​+33​1​≈0.692450, about 5⋅10−55 \cdot 10^{-5}5⋅10−5 above the paper's constant.

Difficulty

The light-cone reduction (milestone 1) is the conceptual step: one must show that conjugating a two-qubit clause by e−iγCe^{-i\gamma C}e−iγC and e−iβBe^{-i\beta B}e−iβB leaves an operator that involves only the qubits adjacent to the edge, and that the remaining qubits contribute a factor of one. In matrix form on 2n2^n2n-dimensional space this is a statement about tensor-product structure that the definitions do not make visible. The combinatorial count (milestones 2–4) needs a careful case analysis of how triangles sit in a cubic graph, including the exceptional graph K4K_4K4​, where the count fails. The final inequality (milestone 6) has a margin of order 10−410^{-4}10−4, so crude bounds on the trigonometric functions fgf_{g}fg​ do not suffice.

Formalization scope

  • Representation. Bit strings are Qubits n = Fin n → Bool from the published QAlgorithms layer, with true the bit 111. States are vectors in EuclideanSpace ℂ (Qubits n); ∣s⟩|s\rangle∣s⟩, CCC as a diagonal operator, BBB and the QAOA unitary are the published definitions uniformState, problemHamiltonian, qaoaMixer, qaoaUnitary. The latter takes mixer angles before phase angles.
  • Conventions. Graphs are SimpleGraph (Fin n) with decidable adjacency; "3-regular" is IsRegularOfDegree 3. The cut counts each edge once. F1F_1F1​ is defined as ∑zPr⁡[z] C(z)\sum_z \Pr[z]\,C(z)∑z​Pr[z]C(z), which equals ⟨γ,β∣C∣γ,β⟩\langle\gamma,\beta|C|\gamma,\beta\rangle⟨γ,β∣C∣γ,β⟩ because CCC is diagonal. The constant 0.69240.69240.6924 is the exact rational 1731/25001731/25001731/2500.
  • Added hypotheses. Milestones 2 and 3 assume GGG connected and n≠4n \ne 4n=4, which excludes K4K_4K4​, the case the paper sets aside on p. 8. No other hypothesis is added.
  • Out of scope. The goal concerns the expected cut at good angles, which is what the paper's analysis bounds. Measuring the state, repeating, and the claim that a cut of that size is then found with high probability are not formalized; nor are running time, circuit depth, or the search for optimal angles.
  • Ruled-out trivializations. A cut objective counting each edge twice, or an unnormalized state, would leave the ratio statement formally intact but about the wrong objects; the setting counts each edge once and uses the normalized uniform superposition. The goal quantifies over all bit strings, so it cannot be satisfied by bounding a particular cut.
  • Contributions welcome. Reusable lemmas on the light-cone locality of conjugated Pauli operators, closed forms of the depth-one MaxCut expectation, and counting lemmas for triangles in cubic graphs all serve beyond this mission.

Selected references

  • E. Farhi, J. Goldstone, S. Gutmann, A Quantum Approximate Optimization Algorithm, arXiv preprint, 2014. https://arxiv.org/abs/1411.4028
  • Z. Wang, S. Hadfield, Z. Jiang, E. G. Rieffel, Quantum approximate optimization algorithm for MaxCut: A fermionic view, Phys. Rev. A 97, 022304, 2018. https://arxiv.org/abs/1706.02998
  • M. X. Goemans, D. P. Williamson, Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming, J. ACM 42(6), 1995. https://doi.org/10.1145/227683.227684
14 thms2 active usersReviewed
EconomicsOperations ResearchProbability·Captain: mikedeng1

Gathering Information before Negotiation I: The Buyer's Optimal Information Acquisition Increases with Its Bargaining Power and First Increases, Then Decreases with the Seller's CostResearch Paper

Motivation

Many transactions are priced by negotiation rather than posted prices: business-to-business procurement, used cars, real estate, the purchase of a company. Before negotiating, a buyer can often spend effort finding out how much the object is actually worth to it, through inspections, trials, consultants or market research. That information serves two purposes. It improves the joint decision of whether to trade at all, and it changes how the surplus of trade is split. Liang Guo's Gathering Information before Negotiation (SSRN 3930651; Management Science, doi:10.1287/mnsc.2022.4360) studies how a buyer's endogenous information acquisition interacts with the two primitives of bargaining: the parties' bargaining powers and the seller's cost.

The first finding of the paper, Proposition 1, concerns how much information the buyer gathers. Its comparative statics in the seller's cost are non-monotone, and this non-monotonicity drives the later results of the paper, in which a seller can be worse off with more bargaining power or a lower cost. This mission formalizes Proposition 1 in its general form, for an arbitrary prior. A companion mission (Gathering Information before Negotiation II) formalizes the payoff reversals under a uniform prior and a linear information cost.

Setting

A seller can supply one unit of a product at cost ccc. A buyer's true value uuu of the unit is unknown to both parties; the common prior law of uuu is FFF, with a finite mean u^>0\hat u>0u^>0.

Before negotiating, the buyer acquires a truth-or-noise signal www: with probability α\alphaα the signal equals uuu, and with probability 1−α1-\alpha1−α it is an independent draw from FFF. Because the parties are risk neutral, only the buyer's posterior mean

v≡αw+(1−α)u^v\equiv\alpha w+(1-\alpha)\hat uv≡αw+(1−α)u^

matters. Ex ante, vvv has the distribution function

G(v,α)≡F ⁣(v−(1−α)u^α).G(v,\alpha)\equiv F\!\left(\frac{v-(1-\alpha)\hat u}{\alpha}\right).G(v,α)≡F(αv−(1−α)u^​).

The buyer chooses the informativeness α\alphaα in an interval [α‾,αˉ]⊆(0,1)[\underline\alpha,\bar\alpha]\subseteq(0,1)[α​,αˉ]⊆(0,1) at a cost k(α)k(\alpha)k(α) that is increasing, with k(α‾)=0k(\underline\alpha)=0k(α​)=0 and k(αˉ)>0k(\bar\alpha)>0k(αˉ)>0.

After observing vvv, the parties trade exactly when v>cv>cv>c and split the net surplus v−cv-cv−c according to their bargaining powers θs,θb∈(0,1)\theta_s,\theta_b\in(0,1)θs​,θb​∈(0,1), θs+θb=1\theta_s+\theta_b=1θs​+θb​=1. Anticipating this, the buyer chooses α\alphaα to solve

max⁡α∈[α‾,αˉ] Ub(α)=θb A(α,c)−k(α),A(α,c)=∫cvˉ(v−c) dG(v,α),(6)\max_{\alpha\in[\underline\alpha,\bar\alpha]}\ U_b(\alpha)=\theta_b\,A(\alpha,c)-k(\alpha),\qquad A(\alpha,c)=\int_c^{\bar v}(v-c)\,dG(v,\alpha),\tag{6}α∈[α​,αˉ]max​ Ub​(α)=θb​A(α,c)−k(α),A(α,c)=∫cvˉ​(v−c)dG(v,α),(6)

where A(α,c)A(\alpha,c)A(α,c) is the total ex ante surplus (7). A solution of (6) is written α∗\alpha^*α∗; in general there may be several, and A∗(θb,c)\mathcal A^*(\theta_b,c)A∗(θb​,c) denotes the set of all of them.

Two sets S,T⊆RS,T\subseteq\mathbb RS,T⊆R are compared in the induced set order S⊑TS\sqsubseteq TS⊑T when min⁡(s,t)∈S\min(s,t)\in Smin(s,t)∈S and max⁡(s,t)∈T\max(s,t)\in Tmax(s,t)∈T for all s∈Ss\in Ss∈S, t∈Tt\in Tt∈T.

Formalization targets

Goal: Proposition 1 (p. 10)

Whenever the optimal sets compared are nonempty,

θb≤θb′ ⟹ A∗(θb,c)⊑A∗(θb′,c),\theta_b\le\theta_b'\ \Longrightarrow\ \mathcal A^*(\theta_b,c)\sqsubseteq\mathcal A^*(\theta_b',c),θb​≤θb′​ ⟹ A∗(θb​,c)⊑A∗(θb′​,c), c≤c′≤u^ ⟹ A∗(θb,c)⊑A∗(θb,c′),u^≤c≤c′ ⟹ A∗(θb,c′)⊑A∗(θb,c).c\le c'\le\hat u\ \Longrightarrow\ \mathcal A^*(\theta_b,c)\sqsubseteq\mathcal A^*(\theta_b,c'),\qquad \hat u\le c\le c'\ \Longrightarrow\ \mathcal A^*(\theta_b,c')\sqsubseteq\mathcal A^*(\theta_b,c).c≤c′≤u^ ⟹ A∗(θb​,c)⊑A∗(θb​,c′),u^≤c≤c′ ⟹ A∗(θb​,c′)⊑A∗(θb​,c).

The buyer's optimal information acquisition increases with its bargaining power, and first increases and then decreases with the seller's cost, turning at the prior mean u^\hat uu^.

Milestones

  1. Display (1), p. 7. G(v,α)G(v,\alpha)G(v,α) is nondecreasing in α\alphaα for v<u^v<\hat uv<u^ and nonincreasing for v>u^v>\hat uv>u^: the family rotates about u^\hat uu^.
  2. Display (2) and footnote 7, p. 8. The mean of vvv is u^\hat uu^ for every α\alphaα, and α↦A(α,c)\alpha\mapsto A(\alpha,c)α↦A(α,c) is nondecreasing.
  3. Proof of Proposition 1, p. 30. Integration by parts: Ub(α)=θb∫c∞[1−G(v,α)] dv−k(α)U_b(\alpha)=\theta_b\int_c^{\infty}[1-G(v,\alpha)]\,dv-k(\alpha)Ub​(α)=θb​∫c∞​[1−G(v,α)]dv−k(α).
  4. Proof of Proposition 1, p. 30. UbU_bUb​ has increasing differences in (α,θb)(\alpha,\theta_b)(α,θb​).
  5. Proof of Proposition 1, p. 30. UbU_bUb​ has increasing differences in (α,c)(\alpha,c)(α,c) for c≤u^c\le\hat uc≤u^ and decreasing differences for c≥u^c\ge\hat uc≥u^.
  6. Topkis's theorem (Topkis 1998, Theorem 2.8.1), already proved on the platform and referenced.

Significance

The result. The first part of Proposition 1 says that a buyer with more bargaining power gathers more information, because it captures a larger share of the surplus that information creates. The second part is the less expected one: a higher seller cost shrinks the gains from trade, yet it raises the buyer's incentive to become informed as long as the cost is below the prior mean u^\hat uu^, and lowers it only beyond. Information is most valuable when trade is a close call. The paper's later results (Corollary 1, Propositions 2 and 3) build on this: since information acquisition responds to θb\theta_bθb​ and ccc, the seller's equilibrium payoff need not increase in its own bargaining power or decrease in its cost. The paper also notes (p. 11) that the monotonicity in θb\theta_bθb​ needs only that a higher α\alphaα is a mean-preserving spread, which is why the statement is posed here for every prior with finite mean.

Formalizing it. The proposition is proved in the paper, in a short appendix argument that differentiates under the integral and appeals to Topkis's theorem. To our knowledge it has not been machine-checked. The mission produces a density-free formalization: the rotation property and the mean-preserving-spread property of the truth-or-noise family, the integration-by-parts identity for the expected positive part, and the two increasing-differences statements, which together with the already formalized Topkis theorem give the goal.

Difficulty

The paper's argument is first-order: it computes cross-partial derivatives such as ∂2Ub/∂c ∂α=θb ∂G(c,α)/∂α\partial^2U_b/\partial c\,\partial\alpha=\theta_b\,\partial G(c,\alpha)/\partial\alpha∂2Ub​/∂c∂α=θb​∂G(c,α)/∂α and reads off their signs. Without a density these derivatives need not exist, and the information cost kkk is assumed only increasing, so UbU_bUb​ need not be differentiable, concave or even continuous in α\alphaα. The statements here are therefore in difference form, and the cross effects must be established as inequalities between integrals over different distributions of vvv.

The second obstacle is the shape of the comparative statics. Topkis's theorem gives a monotone optimal set in the induced set order on a parameter range where increasing differences hold, but the cost ccc has increasing differences only on (−∞,u^](-\infty,\hat u](−∞,u^] and decreasing differences on [u^,∞)[\hat u,\infty)[u^,∞). The referenced platform theorem, by contrast, asks for increasing differences on the whole product of the decision and parameter spaces, so it does not apply to UbU_bUb​ as it stands.

The obvious shortcut of picking a selection from the optimal set and proving it monotone does not work: the cross differences are only weakly positive (they vanish when ccc lies outside the support of vvv), so the strict version of Topkis's theorem does not apply, and two different maximizers need not be ordered.

Formalization scope

The prior is a probability measure μ\muμ on R\mathbb RR with integrable identity and positive mean u^=∫w dμ\hat u=\int w\,d\muu^=∫wdμ. The paper's additional assumptions on FFF (continuous and differentiable, strictly positive density on a bounded support [u‾,uˉ][\underline u,\bar u][u​,uˉ]) and c∈(u‾,uˉ)c\in(\underline u,\bar u)c∈(u​,uˉ) are dropped: every statement is posed for all priors with finite mean and all real ccc, which implies the paper's case. FFF is ProbabilityTheory.cdf μ, and GGG is defined from it by the page's formula. The interval [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ] satisfies 0<α‾<αˉ<10<\underline\alpha<\bar\alpha<10<α​<αˉ<1; kkk is monotone on it with k(α‾)=0<k(αˉ)k(\underline\alpha)=0<k(\bar\alpha)k(α​)=0<k(αˉ); θb∈(0,1)\theta_b\in(0,1)θb​∈(0,1) in every statement.

The total ex ante surplus is defined as A(α,c)=∫max⁡(αw+(1−α)u^−c,0) dμ(w)A(\alpha,c)=\int\max(\alpha w+(1-\alpha)\hat u-c,0)\,d\mu(w)A(α,c)=∫max(αw+(1−α)u^−c,0)dμ(w), which is (7) after the change of variables v=αw+(1−α)u^v=\alpha w+(1-\alpha)\hat uv=αw+(1−α)u^. The bargaining stage is not modelled; the paper's reduction to (6) is built into UbU_bUb​. The optimal level α∗\alpha^*α∗ is the set of maximizers of UbU_bUb​ over [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ] (optSet), never a chosen element. "Increases" is the induced set order, and every comparison assumes both optimal sets nonempty, which is the paper's presumption that (6) has a solution.

Trivializing formalizations are ruled out: AAA is never given by a closed form or by the integration-by-parts expression (that identity is a milestone), α∗\alpha^*α∗ is never defined by a formula or a threshold rule, and the nonemptiness hypotheses prevent the induced set order from holding vacuously on an empty optimal set.

The development reuses the platform definitions Supermodularity.Lattices.InducedSetOrder and Supermodularity.Monotonicity.IncreasingDifferencesOn and the proved theorem Supermodularity.Monotonicity.argmax_increasing_of_increasing_differences. The rotation and mean-preserving-spread lemmas for truth-or-noise signals, and the tail-integral identity E[(X−c)+]=∫c∞P(X>x) dx\mathbb E[(X-c)^+]=\int_c^\infty P(X>x)\,dxE[(X−c)+]=∫c∞​P(X>x)dx for integrable XXX, are reusable beyond this mission. Contributions of any of the milestones, of alternative proofs that avoid the integration by parts, and of the strict versions under the paper's density assumption are welcome.

Not posed in this mission: the benchmark (3)–(5), Corollary 1, Propositions 2–7, and the extensions of §4–§5.

Selected references

  • L. Guo, Gathering Information before Negotiation, author's manuscript of 15 Feb 2022, SSRN 3930651. https://ssrn.com/abstract=3930651 ; published in Management Science (2022), https://doi.org/10.1287/mnsc.2022.4360
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. https://doi.org/10.1515/9781400822539
  • J. P. Johnson and D. P. Myatt, On the Simple Economics of Advertising, Marketing, and Product Design, American Economic Review 96(3), 756–784, 2006. https://doi.org/10.1257/aer.96.3.756
10 thms2 active usersReviewed
Machine LearningOperations Research·Captain: mikedeng1

Contextual Inverse Optimization: Offline and Online Learning 3: EllipsoidalCones Has Worst-Case Regret O(d² ln(T tan α(C₀))) from a Pointed Initial Knowledge SetResearch Paper

Motivation

In inverse optimization one observes the decisions of an expert who solves an optimization problem and tries to recover the expert's objective. The contextual version of Besbes, Fonseca and Lobel (arXiv:2106.14015; Operations Research, 2025) asks a sharper question: not how well the cost can be estimated, but how well a decision-maker who imitates the expert performs, measured by regret against the expert. Settings of this kind arise whenever a firm wants to reproduce the routine choices of an experienced planner, for example routing, assortment or scheduling decisions, without being told the planner's cost trade-offs.

The online setting is adversarial. Nature fixes an unknown cost vector and then presents a sequence of problems; after each decision it reveals the expert's optimal action, which cuts the set of costs still consistent with the observations. A companion mission of this series shows that the natural greedy policy, which plays the center of this consistent set, can incur regret linear in the horizon. This mission formalizes the paper's first positive answer: an algorithm, EllipsoidalCones, with regret logarithmic in the horizon when the initial set of costs lies inside a pointed cone.

Setting

Costs lie on the unit sphere SdS^dSd of Rd\mathbb R^dRd, d=m+1≥2d=m+1\ge2d=m+1≥2. In period ttt nature presents a feasible set Xt⊆Rn\mathcal X_t\subseteq\mathbb R^nXt​⊆Rn, compact, nonempty and of diameter at most 111, and a 111-Lipschitz context ft:Rn→Rdf_t:\mathbb R^n\to\mathbb R^dft​:Rn→Rd. The forward problem with cost ccc has solution set ψ(c,Xt,ft)=argmin⁡x∈Xtft(x)′c\psi(c,\mathcal X_t,f_t)=\operatorname{argmin}_{x\in\mathcal X_t}f_t(x)'cψ(c,Xt​,ft​)=argminx∈Xt​​ft​(x)′c. The decision-maker plays some xtπx^\pi_txtπ​, nature reveals an expert action xt⋆∈ψ(c⋆,Xt,ft)x^\star_t\in\psi(c^\star,\mathcal X_t,f_t)xt⋆​∈ψ(c⋆,Xt​,ft​) for the true cost c⋆c^\starc⋆, and the regret over TTT periods is

RTπ=∑t=1T(ft(xtπ)−ft(xt⋆))′c⋆.\mathcal R^\pi_T=\sum_{t=1}^T\big(f_t(x^\pi_t)-f_t(x^\star_t)\big)'c^\star .RTπ​=t=1∑T​(ft​(xtπ​)−ft​(xt⋆​))′c⋆.

The knowledge set C(It)C(\mathcal I_t)C(It​) is the set of costs in the initial set C0⊆SdC_0\subseteq S^dC0​⊆Sd under which every expert action seen so far was optimal.

The angle between nonzero vectors is θ(c,c^)=arccos⁡(c′c^/∥c∥∥c^∥)\theta(c,\hat c)=\arccos(c'\hat c/\|c\|\|\hat c\|)θ(c,c^)=arccos(c′c^/∥c∥∥c^∥), and the uncertainty angle of a set CCC is α(C)=inf⁡c^∈Sdsup⁡c∈Cθ(c,c^)\alpha(C)=\inf_{\hat c\in S^d}\sup_{c\in C}\theta(c,\hat c)α(C)=infc^∈Sd​supc∈C​θ(c,c^); a minimizing c^\hat cc^ is a circumcenter. The initial set is pointed when α(C0)<π/2\alpha(C_0)<\pi/2α(C0​)<π/2.

For a positive diagonal W=diag⁡(w1,…,wm)W=\operatorname{diag}(w_1,\dots,w_m)W=diag(w1​,…,wm​) and an orthonormal UUU, the ellipsoidal cone is

E(W,U)={c: c~[1]≥0, c~[2:d]′W−1c~[2:d]≤c~[1]2},c~=U−1c,E(W,U)=\{c:\ \tilde c_{[1]}\ge0,\ \tilde c_{[2:d]}'W^{-1}\tilde c_{[2:d]}\le\tilde c_{[1]}^2\},\qquad \tilde c=U^{-1}c ,E(W,U)={c: c~[1]​≥0, c~[2:d]′​W−1c~[2:d]​≤c~[1]2​},c~=U−1c,

a cone with axis Ue1Ue_1Ue1​ and elliptical cross-section. The effective difference of period ttt is δtπ=(ft(xtπ)−ft(xt⋆))/∥ft(xtπ)−ft(xt⋆)∥\delta^\pi_t=(f_t(x^\pi_t)-f_t(x^\star_t))/\|f_t(x^\pi_t)-f_t(x^\star_t)\|δtπ​=(ft​(xtπ​)−ft​(xt⋆​))/∥ft​(xtπ​)−ft​(xt⋆​)∥ (and 000 if the difference vanishes).

EllipsoidalCones with parameter ϵ\epsilonϵ starts from the circular cone W1=tan⁡2α(C0)IW_1=\tan^2\alpha(C_0)IW1​=tan2α(C0​)I, U1e1U_1e_1U1​e1​ a circumcenter of C0C_0C0​, and plays the axis Ute1U_te_1Ut​e1​ as proxy cost. With δˉ=Ut−1δtπ\bar\delta=U_t^{-1}\delta^\pi_tδˉ=Ut−1​δtπ​ it keeps the cone if

δˉ[2:d]′Wtδˉ[2:d]≤ϵ2(12)\bar\delta_{[2:d]}'W_t\bar\delta_{[2:d]}\le\epsilon^2 \qquad (12)δˉ[2:d]′​Wt​δˉ[2:d]​≤ϵ2(12)

and otherwise replaces it by the output of ConeUpdate, which performs one central-cut step of the ellipsoid method on the cone's cross-section and re-centres the result by a spectral decomposition.

Formalization targets

Goal: Theorem 3 (p. 20)

With ϵ=d/T\epsilon=d/Tϵ=d/T there is an absolute constant KKK such that for every d≥2d\ge2d≥2, T≥1T\ge1T≥1, closed pointed C0C_0C0​ with α(C0)>0\alpha(C_0)>0α(C0​)>0, c⋆∈C0c^\star\in C_0c⋆∈C0​, admissible instances and run,

RTπ≤K d2ln⁡(Ttan⁡α(C0))  if α(C0)>arctan⁡(d/T),RTπ≤K d  otherwise.\mathcal R^\pi_T\le K\,d^2\ln\big(T\tan\alpha(C_0)\big)\ \text{ if }\alpha(C_0)>\arctan(d/T),\qquad \mathcal R^\pi_T\le K\,d\ \text{ otherwise.}RTπ​≤Kd2ln(Ttanα(C0​))  if α(C0​)>arctan(d/T),RTπ​≤Kd  otherwise.

The constant is left unfixed: the shape d2ln⁡(Ttan⁡α(C0))d^2\ln(T\tan\alpha(C_0))d2ln(Ttanα(C0​)) is the claim, and the proof's explicit constant rests on a step that fails at d=2d=2d=2.

Milestones

  1. Proposition 1: α(E(W,U))=arctan⁡λmax⁡(W)\alpha(E(W,U))=\arctan\sqrt{\lambda_{\max}(W)}α(E(W,U))=arctanλmax​(W)​.
  2. Lemma 4: if C(It)⊆E(Wt,Ut)C(\mathcal I_t)\subseteq E(W_t,U_t)C(It​)⊆E(Wt​,Ut​) and (12) holds, the period's regret is at most ϵ\epsilonϵ.
  3. Lemma B-1 (η=0\eta=0η=0): ConeUpdate's output contains E(W,U)∩{δ′c≥0}E(W,U)\cap\{\delta'c\ge0\}E(W,U)∩{δ′c≥0} and ∏λi\prod\lambda_i∏λi​ shrinks by e−1/(2(d−1))e^{-1/(2(d-1))}e−1/(2(d−1)).
  4. Lemma 3: C(It+1)⊆E(Wt,Ut)∩{δtπ′c≥0}⊆E(Wt+1,Ut+1)C(\mathcal I_{t+1})\subseteq E(W_t,U_t)\cap\{\delta^{\pi\prime}_tc\ge0\}\subseteq E(W_{t+1},U_{t+1})C(It+1​)⊆E(Wt​,Ut​)∩{δtπ′​c≥0}⊆E(Wt+1​,Ut+1​), and for d≥3d\ge3d≥3 ∏λi\prod\lambda_i∏λi​ shrinks by e−1/(d−1)e^{-1/(d-1)}e−1/(d−1).
  5. Cohen et al. (2020), Lemmas 3 and 4 (already posed on the platform, referenced): an ellipsoid-method step shrinks the smallest eigenvalue by at most (d−1)2/d2(d-1)^2/d^2(d−1)2/d2, and does not shrink it at all below the threshold (ϵ/(10(d−1)))2(\epsilon/(10(d-1)))^2(ϵ/(10(d−1)))2 when the cut is long.
  6. Lemma 5: for d≥3d\ge3d≥3, λmax⁡(Wt)≤(10d/ϵ)2(d−2)λmax⁡(W1)d−1e−Itπ/(d−1)\lambda_{\max}(W_t)\le(10d/\epsilon)^{2(d-2)}\lambda_{\max}(W_1)^{d-1}e^{-I^\pi_t/(d-1)}λmax​(Wt​)≤(10d/ϵ)2(d−2)λmax​(W1​)d−1e−Itπ​/(d−1), or no update ever happens.

Significance

The theorem shows that in contextual inverse optimization the decision-maker can force nature to reveal information: a cone update happens only after a large mistake, and each such mistake shrinks the cone geometrically, so large mistakes are logarithmically rare. It is the building block of the paper's general-case algorithm, which restarts the same construction in growing subspaces, and it isolates why the greedy policy fails: it never trades instantaneous regret for information.

The paper proves the result; nothing in it is machine-checked. The mission produces a checked version of the pointed-case analysis, an ellipsoidal-cone layer on top of the platform's ellipsoid-method definitions, and corrected statements where the printed ones are imprecise: the dimension restriction d≥3d\ge3d≥3 for the rate of Lemma 3 and the first part of Lemma 5, the column order of the spectral decomposition in ConeUpdate, and the η=0\eta=0η=0 case of Lemma B-1.

Difficulty

Two steps resist the obvious argument. First, ConeUpdate is not the ellipsoid method: the minimum-volume ellipsoid of the cut cross-section has the right volume but its cone is no longer centred, and the new cone's axis is an eigenvector of an indefinite bordered matrix. Showing that this re-centred cone still contains the cut cone requires matching the eigenvalues of the bordered matrix with those of the ellipsoid matrix in the right order. Second, a volume decrease alone does not bound the regret: by Proposition 1 the uncertainty angle is governed by the largest eigenvalue, and the ellipsoid method can make that eigenvalue grow. The lazy test (12) and the smallest-eigenvalue lemmas of Cohen et al. are what keep the cones from becoming long and thin; without them the product of eigenvalues falls while the angle does not.

Formalization scope

Costs live in EuclideanSpace ℝ (Fin (m+1)) with d=m+1d=m+1d=m+1, actions in EuclideanSpace ℝ (Fin n), so all norms are Euclidean. WWW is stored as its diagonal www, UUU as a real orthogonal matrix, and U−1U^{-1}U−1 is written U⊤U^\topU⊤. Lean periods are 000-based: Lean period ttt is the paper's period t+1t+1t+1. This text is the arXiv v3 preprint (1 July 2023), not the published 2025 article; all numbering is the preprint's.

Standing assumptions carried by the statements: d≥2d\ge2d≥2, n≥1n\ge1n≥1, feasible sets nonempty, compact and of diameter at most 111, contexts 111-Lipschitz, C0C_0C0​ a closed subset of SdS^dSd, ϵ>0\epsilon>0ϵ>0. Pinned and disclosed choices:

  • ConeUpdate is a relation, not a function. The printed U−1Bδ[2:p]U^{-1}B\delta_{[2:p]}U−1Bδ[2:p]​ is read as (U−1δ)[2:p](U^{-1}\delta)_{[2:p]}(U−1δ)[2:p]​. The first column of VVV is the eigenvector of the positive eigenvalue of MMM with positive first entry, and larger ∣μ∣|\mu|∣μ∣ is paired with larger eigenvalues of NNN. The page leaves this order open, and Algorithm 1 and Lemma B-1 disagree on it.
  • The printed "U1←Id−1U_1\leftarrow I_{d-1}U1​←Id−1​" is read as: U1U_1U1​ orthonormal with a circumcenter of C0C_0C0​ as its first column.
  • α(C0)>0\alpha(C_0)>0α(C0​)>0 on the goal. At α(C0)=0\alpha(C_0)=0α(C0​)=0 the algorithm's W1=0W_1=0W1​=0 is not positive definite.
  • The rate of Lemma 3 and the first part of Lemma 5 are stated for d≥3d\ge3d≥3 only; the rest of both lemmas for every d≥2d\ge2d≥2. At d=2d=2d=2 ConeUpdate halves WWW, and 1/2>e−11/2>e^{-1}1/2>e−1.
  • Lemma B-1 is stated only for η=0\eta=0η=0. Its η>0\eta>0η>0 inclusion is false as printed.
  • The worst-case regret is stated as a bound for every true cost, every adaptive instance sequence and every run, not as a real supremum. The polynomial running-time claim is not formalized.

The run predicate is satisfiable: a circumcenter of a closed nonempty C0C_0C0​ exists, the bordered matrix has exactly one positive eigenvalue, and a cone update is required only when the tail of δˉ\bar\deltaδˉ is nonzero. A formalization in which no run exists, or in which KKK may depend on ddd or TTT, does not state Theorem 3.

A complete development needs the angle and uncertainty-angle layer, ellipsoidal cones and their cross-sections, the published ellipsoid-method update (LinearOptimization_EllipsoidMethod) with its volume and eigenvalue facts, Cauchy–Schwarz over ellipsoids, and eigenvalue interlacing for bordered matrices. The ellipsoidal-cone layer and the cone-update lemma can be reused in the paper's general case and in other cone-based learning algorithms. Proofs of any milestone, and of the referenced Cohen et al. lemmas, are welcome.

Selected references

  • O. Besbes, Y. Fonseca, I. Lobel, Contextual Inverse Optimization: Offline and Online Learning, arXiv:2106.14015v3, 2023; Operations Research, 2025. https://arxiv.org/abs/2106.14015
  • M. C. Cohen, I. Lobel, R. Paes Leme, Feature-Based Dynamic Pricing, Management Science 66(11), 2020. https://doi.org/10.1287/mnsc.2019.3485
  • M. Grötschel, L. Lovász, A. Schrijver, Geometric Algorithms and Combinatorial Optimization, 2nd ed., Springer, 1993. https://doi.org/10.1007/978-3-642-78240-4
  • D. Bertsimas, J. N. Tsitsiklis, Introduction to Linear Optimization, Athena Scientific, 1997, Chapter 8.
16 thms2 active usersReviewed
Convex OptimizationOperations Research·Captain: mikedeng1

Contextual Inverse Optimization: Offline and Online Learning 4: The Polyhedral Cone of η-Separated Effective Differences Has Uncertainty Angle at Most arccos(η^(d−1)/d^(3/2))Research Paper

Motivation

In contextual inverse optimization a decision-maker repeatedly faces linear problems min⁡x∈Xtft(x)′c⋆\min_{x\in\mathcal X_t} f_t(x)'c^\starminx∈Xt​​ft​(x)′c⋆ whose cost vector c⋆∈Sdc^\star\in S^dc⋆∈Sd is unknown. After each period it observes an action that an expert who knows c⋆c^\starc⋆ would have taken. Every observation is a set of linear inequalities on c⋆c^\starc⋆, so the costs consistent with the data form a cone, the knowledge set. Besbes, Fonseca and Lobel (arXiv:2106.14015, published in Operations Research, 2025) measure the residual ignorance of such a set by its uncertainty angle, the half-aperture of the narrowest revolution cone containing it, and show that offline regret is governed exactly by this angle.

Online, their algorithms are efficient only when the knowledge set is pointed, i.e. has uncertainty angle below π/2\pi/2π/2. When it is not, the general algorithm of §5 (ProjectedCones) works inside a growing subspace Δt\Delta_tΔt​ spanned by the observations that were sufficiently new. Each time the subspace grows, the algorithm replaces the knowledge set by a polyhedral cone KtK_tKt​ and needs a bound on the uncertainty angle of KtK_tKt​ that depends only on the separation parameter η\etaη and the dimension. Lemma 10 of the paper provides that bound. This mission formalizes it, together with the chain of lemmas in Appendix B on which its proof rests.

Setting

Let Rd\mathbb R^dRd carry the Euclidean inner product c′xc'xc′x and norm ∥⋅∥\|\cdot\|∥⋅∥, and let SdS^dSd be its unit sphere. The angle between ccc and c^\hat cc^ is θ(c,c^)=arccos⁡(c′c^/(∥c∥∥c^∥))\theta(c,\hat c)=\arccos\big(c'\hat c/(\|c\|\|\hat c\|)\big)θ(c,c^)=arccos(c′c^/(∥c∥∥c^∥)), with θ=0\theta=0θ=0 when either vector is 000. The uncertainty angle of a set C⊆RdC\subseteq\mathbb R^dC⊆Rd is

α(C)=inf⁡c^∈Sd sup⁡c∈Cθ(c,c^),\alpha(C)=\inf_{\hat c\in S^d}\ \sup_{c\in C}\theta(c,\hat c),α(C)=c^∈Sdinf​ c∈Csup​θ(c,c^),

and a minimizer c^\hat cc^ is a circumcenter of CCC. The circumradius of a cone is μ(K)=sin⁡α(K)\mu(K)=\sin\alpha(K)μ(K)=sinα(K).

For vectors g1,…,gpg_1,\dots,g_pg1​,…,gp​, write Πg1,…,gi−1\Pi_{g_1,\dots,g_{i-1}}Πg1​,…,gi−1​​ for the orthogonal projection onto their span and g−i={gj:j≠i}g_{-i}=\{g_j:j\ne i\}g−i​={gj​:j=i}. The vector gi−ΠS(gi)g_i-\Pi_S(g_i)gi​−ΠS​(gi​) is the residual of regressing gig_igi​ on SSS.

The algorithm's effective differences are unit vectors δ1,δ2,⋯∈Rd\delta_1,\delta_2,\dots\in\mathbb R^dδ1​,δ2​,⋯∈Rd. A difference triggers a subspace update when its residual against the current subspace exceeds η\etaη. The differences δ1,…,δp\delta_1,\dots,\delta_pδ1​,…,δp​ that triggered updates, in order of arrival, therefore satisfy

∥δi−Πδ1,…,δi−1(δi)∥ ≥ η,i=2,…,p.\|\delta_i-\Pi_{\delta_1,\dots,\delta_{i-1}}(\delta_i)\|\ \ge\ \eta,\qquad i=2,\dots,p .∥δi​−Πδ1​,…,δi−1​​(δi​)∥ ≥ η,i=2,…,p.

They span the subspace Δ={∑iγiδi:γi∈R}\Delta=\{\sum_i\gamma_i\delta_i:\gamma_i\in\mathbb R\}Δ={∑i​γi​δi​:γi​∈R}, and the polyhedral cone of (14) is

K={c∈Δ: c′δi≥0, i=1,…,p}.K=\{c\in\Delta:\ c'\delta_i\ge0,\ i=1,\dots,p\}.K={c∈Δ: c′δi​≥0, i=1,…,p}.

Two further cone quantities appear. The simplicial cone of linearly independent g1,…,gp∈Rpg_1,\dots,g_p\in\mathbb R^pg1​,…,gp​∈Rp is cone⁡(g)={∑iαigi:αi≥0}\operatorname{cone}(g)=\{\sum_i\alpha_ig_i:\alpha_i\ge0\}cone(g)={∑i​αi​gi​:αi​≥0}. The inradius of a cone K⊆RpK\subseteq\mathbb R^pK⊆Rp is ρ(K)=max⁡x∈Sp∩Kmin⁡y∈∂K∥x−y∥\rho(K)=\max_{x\in S^p\cap K}\min_{y\in\partial K}\|x-y\|ρ(K)=maxx∈Sp∩K​miny∈∂K​∥x−y∥, and the dual cone is K⋆={c:c′x≥0 ∀x∈K}K^\star=\{c:c'x\ge0\ \forall x\in K\}K⋆={c:c′x≥0 ∀x∈K}. With GGG the matrix of columns gig_igi​, λmin⁡(G′G)\lambda_{\min}(G'G)λmin​(G′G) and λmax⁡(G′G)\lambda_{\max}(G'G)λmax​(G′G) are the extreme eigenvalues of the Gram matrix.

Formalization targets

Goal: Lemma 10, angle bound (p. 25)

For 0<η≤10<\eta\le10<η≤1, d≥2d\ge2d≥2 and unit vectors δ1,…,δp∈Rd\delta_1,\dots,\delta_p\in\mathbb R^dδ1​,…,δp​∈Rd obeying the separation rule,

α(K) ≤ arccos⁡ ⁣(ηd−1d3/2).\alpha(K)\ \le\ \arccos\!\Big(\frac{\eta^{d-1}}{d^{3/2}}\Big).α(K) ≤ arccos(d3/2ηd−1​).

The bound depends on η\etaη and ddd only, not on the number p≤dp\le dp≤d of vectors or their configuration.

Milestones (Appendix B)

  1. Lemma B-4 (App-28). Backward separation implies two-sided separation:
∥gi−Πg−i(gi)∥2 ≥ η2(p−i)(η2)1{i>1},i=1,…,p.\|g_i-\Pi_{g_{-i}}(g_i)\|^2\ \ge\ \eta^{2(p-i)}(\eta^2)^{\mathbf 1\{i>1\}},\qquad i=1,\dots,p.∥gi​−Πg−i​​(gi​)∥2 ≥ η2(p−i)(η2)1{i>1},i=1,…,p.
  1. Lemma B-3 (App-27). With φ=min⁡i∥gi−Πg−i(gi)∥\varphi=\min_i\|g_i-\Pi_{g_{-i}}(g_i)\|φ=mini​∥gi​−Πg−i​​(gi​)∥,
λmax⁡(G′G)λmin⁡(G′G)≤(pφ)2.\frac{\lambda_{\max}(G'G)}{\lambda_{\min}(G'G)}\le\Big(\frac p\varphi\Big)^2 .λmin​(G′G)λmax​(G′G)​≤(φp​)2.
  1. Lemma B-2 (App-25). ρ(cone⁡(g)) ≥ 1pλmin⁡(G′G)λmax⁡(G′G)\displaystyle\rho(\operatorname{cone}(g))\ \ge\ \frac1{\sqrt p}\sqrt{\frac{\lambda_{\min}(G'G)}{\lambda_{\max}(G'G)}}ρ(cone(g)) ≥ p​1​λmax​(G′G)λmin​(G′G)​​.
  2. (B-9) (App-20). μ2(K)+ρ2(K⋆)=1\mu^2(K)+\rho^2(K^\star)=1μ2(K)+ρ2(K⋆)=1, for every closed convex pointed cone K≠{0}K\ne\{0\}K={0}.
  3. (B-8) (App-19). For K={c∈Rp:c′gi≥0}K=\{c\in\mathbb R^p:c'g_i\ge0\}K={c∈Rp:c′gi​≥0} with separated unit gig_igi​,
μ(K)≤1−η2(p−1)/p3.\mu(K)\le\sqrt{1-\eta^{2(p-1)}/p^3}.μ(K)≤1−η2(p−1)/p3​.

Significance

The bound is what makes the subspace stage of ProjectedCones restartable. After each update the algorithm discards its previous ellipsoidal cone and starts afresh from a revolution cone of aperture arccos⁡(ηd−1/d3/2)\arccos(\eta^{d-1}/d^{3/2})arccos(ηd−1/d3/2) around the circumcenter of KtK_tKt​. Lemma 10 guarantees that this cone contains KtK_tKt​, and with it the projected knowledge set, and that it is pointed. The number of later ellipsoid steps grows with the logarithm of the tangent of this aperture, so the shape of the bound enters the paper's regret analysis directly. The lemmas behind it are statements about general vector families: a residual inequality of Frisch–Waugh–Lovell type, a condition-number bound for correlation matrices, an inradius bound for simplicial cones, and the circumradius–inradius duality of Henrion and Seeger. Each is usable outside this paper.

The result is proved on paper; no part of it is formalized. The mission asks for machine-checked proofs of Lemma 10's angle bound and of the five appendix statements. Henrion–Seeger duality is cited, not proved, in the source. Its formalization would be new.

Difficulty

The separation rule controls each new vector only against the earlier ones. A bound on the cone's aperture needs control of each vector against all the others, and later vectors can lie close to the span of an earlier vector together with the remaining ones. The loss compounds, which is where the exponential factor ηd−1\eta^{d-1}ηd−1 comes from. A direct estimate of the circumcenter of KKK is not available in closed form: the circumcenter is the solution of a quadratic program. The natural first attempt, bounding the angle between the circumcenter candidate ∑iδi/∥∑iδi∥\sum_i\delta_i/\|\sum_i\delta_i\|∑i​δi​/∥∑i​δi​∥ and the extreme rays of KKK, requires the extreme rays of KKK, which are the columns of a dual basis whose norms are not controlled by the separation rule alone.

A second difficulty is dimensional. KKK lives in the subspace Δ\DeltaΔ, possibly of dimension p<dp<dp<d, while the uncertainty angle is measured on the sphere of Rd\mathbb R^dRd. The appendix statements are posed in Rp\mathbb R^pRp, in coordinates of Δ\DeltaΔ. Transferring them requires an isometry onto Δ\DeltaΔ that preserves the cone, the angles and the projections.

Formalization scope

Vectors live in EuclideanSpace ℝ (Fin d); families are indexed by Fin p, so all indices are 0-based and Lean's iii is the paper's i+1i+1i+1. Projections are Submodule.starProjection onto Submodule.span. The uncertainty angle is a real infimum of real suprema of angles in [0,π][0,\pi][0,π]. The angle at the zero vector is 000, as in the paper, not Mathlib's π/2\pi/2π/2. The inradius is a real supremum of Metric.infDist to the frontier. It equals the paper's maximum on every cone of this mission. The dual cone is the platform's ConvexOptimization.dualCone. Eigenvalue ratios are stated without spectra: Lemma B-3 in the Rayleigh form ∥Gu∥2∥v∥2≤(p/φ)2∥Gv∥2∥u∥2\|Gu\|^2\|v\|^2\le(p/\varphi)^2\|Gv\|^2\|u\|^2∥Gu∥2∥v∥2≤(p/φ)2∥Gv∥2∥u∥2, and Lemma B-2 with arbitrary bracket constants ℓmin⁡∥u∥2≤∥Gu∥2≤ℓmax⁡∥u∥2\ell_{\min}\|u\|^2\le\|Gu\|^2\le\ell_{\max}\|u\|^2ℓmin​∥u∥2≤∥Gu∥2≤ℓmax​∥u∥2. Both forms are equivalent to the printed ones.

Conventions and pins:

  • The separation rule is "residual ≥η\ge\eta≥η", the form of (B-14). The algorithm's strict ">η>\eta>η" is a special case, so the goal is stronger than the page needs. The first vector carries no condition.
  • Lemma 10's inclusion ΠΔt(C(It))⊆Kt\Pi_{\Delta_t}(C(\mathcal I_t))\subseteq K_tΠΔt​​(C(It​))⊆Kt​ is not posed: it concerns the algorithm's run. The polynomial-time computation of the circumcenter is not posed either: it is a complexity claim. "For every period ttt" becomes "for every family δ\deltaδ obeying the separation rule"; p=0p=0p=0 is the first period, with K={0}K=\{0\}K={0}.
  • d≥2d\ge2d≥2 is the paper's standing assumption (§2), and d3/2d^{3/2}d3/2 is the real power.
  • Lemma B-3 as printed takes φ\varphiφ as the minimum over i=2,…,pi=2,\dots,pi=2,…,p only. With that minimum the bound is false. The printed proof bounds every i=1,…,pi=1,\dots,pi=1,…,p, and the proof of Lemma 10 applies it so. The minimum over all iii is stated.
  • (B-9) is stated on the page for every closed convex cone. It is posed for every closed convex pointed cone K≠{0}K\ne\{0\}K={0} in Rp\mathbb R^pRp: App-19 defines μ(K)=sin⁡α(K)\mu(K)=\sin\alpha(K)μ(K)=sinα(K) for pointed cones, and K={0}K=\{0\}K={0} is excluded because its dual Rp\mathbb R^pRp has empty boundary.
  • Lemmas B-3 and B-4 are posed in Rm\mathbb R^mRm for every mmm, which is equivalent to the page's Rp\mathbb R^pRp. Lemma B-4 assumes no range for η\etaη, since only η2\eta^2η2 and even powers occur.

The cone in the goal is intersected with Δ\DeltaΔ. A formalization of KKK as {c∈Rd:c′δi≥0}\{c\in\mathbb R^d:c'\delta_i\ge0\}{c∈Rd:c′δi​≥0} would be false for p<dp<dp<d (that set contains a line, so α≥π/2\alpha\ge\pi/2α≥π/2). A separation hypothesis that does not exclude nearly collinear vectors would make the bound unobtainable, and one that is never satisfiable would make it empty. The sanity check in the drafting workspace exhibits the hypotheses at p=d=2p=d=2p=d=2, η=1\eta=1η=1.

Contributions welcome: proofs of any milestone; the passage from Rp\mathbb R^pRp to the subspace Δ⊆Rd\Delta\subseteq\mathbb R^dΔ⊆Rd (an isometry lemma for cones and angles); Gram-matrix facts (the inverse correlation matrix diagonal aii=1/(1−Ri2)a_{ii}=1/(1-R_i^2)aii​=1/(1−Ri2​)) as reusable lemmas.

Selected references

  • O. Besbes, Y. Fonseca, I. Lobel, Contextual Inverse Optimization: Offline and Online Learning, arXiv:2106.14015v3, 2023 (the version formalized; published in Operations Research, 2025). https://arxiv.org/abs/2106.14015
  • R. Henrion, A. Seeger, Inradius and circumradius of various convex cones arising in applications, Set-Valued and Variational Analysis 18, 483–511, 2010. https://doi.org/10.1007/s11228-010-0150-z
  • M. C. Lovell, A simple proof of the FWL theorem, Journal of Economic Education 39(1), 88–91, 2008. https://doi.org/10.3200/JECE.39.1.88-91
9 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Monetary Easing, Leveraged Payouts, and Lack of Investment I: With Unregulated Leverage the Optimal Date-0 Rate Is at Most R and Date-0 Investment Falls Strictly Short of the First-BestResearch Paper

Monetary easing when firms can pay out borrowed funds

Low policy rates are meant to stimulate corporate investment. Acharya and Plantin document that in the low-rate decade after the 2008 crisis, U.S. firms used much of their new borrowing for share buybacks and dividends rather than for investment: leveraged payouts. Their paper (SSRN 3484935; Management Science, 2025, doi:10.1287/mnsc.2022.01440) builds a model in which this is a rational response to cheap funding and in which it limits what monetary easing can achieve. When the market rate is below the shareholders' own discount rate, a firm borrows against its future output to pay its owners today. The owners then keep a smaller stake in the firm's success and exert less effort. A central bank that cuts rates to raise employment therefore also lowers the productivity of the firms it is trying to help.

This mission formalizes the paper's Proposition 11: when leverage is not regulated, no choice of date-0 interest rate reaches the efficient allocation, and the best rate leaves investment strictly below its first-best level.

The date-0 economy

There is one consumption good. Entrepreneurs discount date-1 consumption at a rate R>1R>1R>1. An entrepreneur who hires lll units of labour at date 0 obtains f(l)f(l)f(l) units at date 1 with probability eee and nothing otherwise. The effort eee costs her e2f(l)/(2Rπ)e^2 f(l)/(2R\pi)e2f(l)/(2Rπ) privately, where π∈(0,1)\pi\in(0,1)π∈(0,1) is an effort-cost parameter (not the circle constant). Workers own a technology that turns yyy units of labour into g(y)g(y)g(y) units of the good at once; each young worker supplies one unit of labour. Both fff and ggg satisfy the Inada conditions: they vanish at 000, are strictly increasing and strictly concave, with marginal products going from +∞+\infty+∞ at 0+0^+0+ to 000 at +∞+\infty+∞; fff is twice continuously differentiable.

In the laissez-faire steady state, labour l∗l^*l∗ in the capital-good sector and the wage w∗w^*w∗ solve

π2Rf′(l∗)=g′(1−l∗)=w∗.(20)\frac{\pi}{2R}f'(l^*)=g'(1-l^*)=w^*. \qquad (20)2Rπ​f′(l∗)=g′(1−l∗)=w∗.(20)

At date 0 the workers' technology is hit by a shock ρ∈(0,1)\rho\in(0,1)ρ∈(0,1) and becomes ρg\rho gρg. The efficient date-0 labour lρl_\rholρ​ then solves πf′(lρ)/(2R)=ρ g′(1−lρ)\pi f'(l_\rho)/(2R)=\rho\,g'(1-l_\rho)πf′(lρ​)/(2R)=ρg′(1−lρ​), and lρ>l∗l_\rho>l^*lρ​>l∗. The wage, however, is downward rigid: it cannot fall below w∗w^*w∗ at date 0.

The central bank sets the date-0 rate r>0r>0r>0. An entrepreneur facing rrr retains a stake xxx in her output, and her effort is e=πxe=\pi xe=πx. Writing rˉ(r)=min⁡{r;R}\bar r(r)=\min\{r;R\}rˉ(r)=min{r;R}, she chooses

x=R2R−rˉ(r),e(r)=πR2R−rˉ(r),πRf′(l(r))2(2R−rˉ(r))=r w∗,x=\frac{R}{2R-\bar r(r)},\qquad e(r)=\frac{\pi R}{2R-\bar r(r)},\qquad \frac{\pi R f'(l(r))}{2(2R-\bar r(r))}=r\,w^*,x=2R−rˉ(r)R​,e(r)=2R−rˉ(r)πR​,2(2R−rˉ(r))πRf′(l(r))​=rw∗,

so that for r<Rr<Rr<R she pays out part of her future output (x<1x<1x<1) and her effort falls below π\piπ. The date-0 social surplus is

Σρ(r)=(e(r)−e(r)22π)f(l(r))R+ρ g(1−l(r)).(59)\Sigma_\rho(r)=\Big(e(r)-\frac{e(r)^2}{2\pi}\Big)\frac{f(l(r))}{R}+\rho\,g(1-l(r)). \qquad (59)Σρ​(r)=(e(r)−2πe(r)2​)Rf(l(r))​+ρg(1−l(r)).(59)

A rate rur_uru​ is optimal if it maximizes Σρ\Sigma_\rhoΣρ​ over all rates r>0r>0r>0 at which the labour demand l(r)≤1l(r)\le 1l(r)≤1 is feasible.

Formalization targets

Goal: Proposition 11, points 1–2

An optimal date-0 rate exists, and every optimal rate rur_uru​ with labour lul_ulu​ satisfies

ru≤R,lu<lρ,Σρ(ru)<πf(lρ)2R+ρ g(1−lρ).r_u\le R,\qquad l_u<l_\rho,\qquad \Sigma_\rho(r_u)<\frac{\pi f(l_\rho)}{2R}+\rho\,g(1-l_\rho).ru​≤R,lu​<lρ​,Σρ​(ru​)<2Rπf(lρ​)​+ρg(1−lρ​).

The right-hand side is the first-best date-0 surplus, which regulated leverage attains (Proposition 10 of the paper).

Milestones

  1. The incentive constraint e=arg⁡max⁡y{xy−y2/(2π)}e=\arg\max_y\{xy-y^2/(2\pi)\}e=argmaxy​{xy−y2/(2π)} holds exactly when e=πxe=\pi xe=πx.
  2. Proposition 2: the firm's choice of xxx, eee and investment in the partial-equilibrium model, for every r>0r>0r>0.
  3. (33)–(35): the unregulated date-0 entrepreneur's choice for r0<Rr_0<Rr0​<R.
  4. e(r)e(r)e(r) is increasing and l(r)l(r)l(r) is decreasing in rrr.
  5. lρ>l∗l_\rho>l^*lρ​>l∗, and the flexible wage ρg′(1−lρ)\rho g'(1-l_\rho)ρg′(1−lρ​) is below w∗w^*w∗.
  6. At lρl_\rholρ​, the marginal social value of labour is negative when e<πe<\pie<π.
  7. (60): Σρ′(r^)>0\Sigma_\rho'(\hat r)>0Σρ′​(r^)>0 at the rate r^\hat rr^ with l(r^)=lρl(\hat r)=l_\rhol(r^)=lρ​.

Significance

Proposition 11 is the paper's central negative result. With a rigid wage and a productivity shock, a lower rate raises employment, which is what the central bank wants, but with unregulated leverage it also lowers effort through leveraged payouts. The proposition shows that the second effect always binds before employment reaches its efficient level, so the welfare loss from the shock cannot be undone by monetary policy alone. Prudential regulation of leverage is the missing instrument (Proposition 10). Proposition 12, the subject of a companion mission, builds on the same model to show that small shocks call for no rate cut at all.

The result is proved in the paper, in a short argument in Appendix B. As far as we know it has no machine-checked proof. The formalization makes the existence of an optimal rate, which the paper takes for granted, an explicit claim, and it settles the planner's choice over all rates, including rates above RRR.

Difficulty

The obvious argument differentiates Σρ\Sigma_\rhoΣρ​ at the rate where l(r)=lρl(r)=l_\rhol(r)=lρ​ and reads off the sign. That shows only that Σρ\Sigma_\rhoΣρ​ is increasing at one point. To conclude that every optimum has lu<lρl_u<l_\rholu​<lρ​, the sign of the derivative must hold on the whole range of rates where l(r)≥lρl(r)\ge l_\rhol(r)≥lρ​, including the lower end, where labour reaches the endowment bound l=1l=1l=1 and g′(1−l)g'(1-l)g′(1−l) blows up. Existence of an optimum needs continuity of the labour response, which is defined only implicitly through the inverse of f′f'f′, and control of the surplus for rates above RRR, where the firm's behaviour changes regime.

Formalization scope

All objects live in LeveragedPayouts.Unregulated. The economy is a structure Economy with fields R,π,f,g,l∗,w∗R,\pi,f,g,l^*,w^*R,π,f,g,l∗,w∗, the conditions R>1R>1R>1, π∈(0,1)\pi\in(0,1)π∈(0,1), the Inada conditions for fff (with C2C^2C2 and f′′<0f''<0f′′<0) and for ggg (C1C^1C1, g′g'g′ strictly decreasing), l∗∈(0,1)l^*\in(0,1)l∗∈(0,1) and (20). The first-best labour lρl_\rholρ​ is a parameter with its defining equation and 0<lρ<10<l_\rho<10<lρ​<1; these determine it uniquely. Derivatives are Mathlib's deriv, used only where the Inada conditions give differentiability.

Conventions committed to:

  • The rate ranges over all r>0r>0r>0. For r≥Rr\ge Rr≥R the firm's response is Proposition 2 with rˉ(r)=R\bar r(r)=Rrˉ(r)=R, so ru≤Rr_u\le Rru​≤R is a conclusion, not an assumption. The paper's proof restricts to "r≤1r\le 1r≤1", a misprint for r≤Rr\le Rr≤R.
  • Labour demand requires 0<l≤10<l\le 10<l≤1 (the endowment of the young workers).
  • Optimality is global, over every feasible pair (r,l)(r,l)(r,l); existence of an optimum is part of the goal, so the statement is not vacuous.
  • "Welfare is strictly lower than when leverage is regulated" is stated against the first-best date-0 surplus; other dates are not modelled.
  • The page prints (34) with rrr where r0r_0r0​ is meant; the Lean uses r0r_0r0​.

A formalization that restricted the planner to r≤Rr\le Rr≤R, used only local optimality, or left l∗l^*l∗, w∗w^*w∗, lρl_\rholρ​ free of their defining equations would make the goal trivial or false; none of these is used.

Out of scope: the full overlapping-generations dynamics of §3.1–3.4 beyond the date-0 problem (59), the bond market, fiscal transfers, the dates t≠0t\neq 0t=0 (point 1's "r∗=Rr^*=Rr∗=R at all dates other than 0"), and point 3 of Proposition 11, which rests on an additional assumption on the size of transfers.

Needed infrastructure: implicit-function and inverse-function arguments for f′f'f′ on (0,∞)(0,\infty)(0,∞), one-variable calculus for (60), and compactness for existence. Contributions on the monotone and continuous dependence of the labour response on the rate are reusable in the companion mission.

Selected references

  • V. V. Acharya and G. Plantin, Monetary Easing, Leveraged Payouts, and Lack of Investment, SSRN 3484935, version of May 23, 2023. https://ssrn.com/abstract=3484935
  • V. V. Acharya and G. Plantin, Monetary Easing, Leveraged Payouts, and Lack of Investment, Management Science, 2025. https://doi.org/10.1287/mnsc.2022.01440
10 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimal Transport·Captain: mikedeng1

Robustifying Conditional Portfolio Decisions via Optimal Transport 1: With a Singleton Fiber and Only Positive Fiber Mass Required, the Worst-Case Conditional Expected Loss Collapses to sup_y ℓ(y)Research Paper

Conditioning on a covariate under distributional ambiguity

A portfolio manager who observes side information (a covariate XXX, such as a market indicator) before choosing a portfolio wants to control the loss of the asset returns YYY conditional on the observed covariate value x0x_0x0​. The conditional law of YYY given X=x0X=x_0X=x0​ is unknown and must be learned from NNN historical pairs (x^i,y^i)(\widehat x_i,\widehat y_i)(xi​,y​i​). When x0x_0x0​ itself was never observed, the empirical conditional law is undefined, and kernel or nearest-neighbour estimates are fragile. Nguyen, Zhang, Wang, Blanchet, Delage and Ye (arXiv:2103.16451v3, Operations Research, 2025) robustify the conditional decision with an optimal transport ambiguity set: the decision maker hedges against every joint law Q\mathbb QQ of (X,Y)(X,Y)(X,Y) within transport distance ρ\rhoρ of the empirical law. The resulting objective is a ratio of two linear functionals of Q\mathbb QQ, so the standard Wasserstein distributionally robust duality (Blanchet and Murthy, 2019; Gao and Kleywegt, 2023) does not apply directly.

The paper settles every regime of the three parameters (ball radius ρ\rhoρ, fiber radius γ\gammaγ, minimum fiber mass ε\varepsilonε). This mission formalizes the simplest regime, γ=ε=0\gamma=\varepsilon=0γ=ε=0, where the answer is negative: the worst case does not depend on the data at all.

Setting

The covariate space X\mathcal XX and the return space Y\mathcal YY are Polish spaces with their Borel σ\sigmaσ-algebras. Two ground costs DX\mathbb D_{\mathcal X}DX​ and DY\mathbb D_{\mathcal Y}DY​ combine into the separable cost D((x,y),(x′,y′))=DX(x,x′)+DY(y,y′)\mathbb D((x,y),(x',y'))=\mathbb D_{\mathcal X}(x,x')+\mathbb D_{\mathcal Y}(y,y')D((x,y),(x′,y′))=DX​(x,x′)+DY​(y,y′). The data define the empirical measure P^=1N∑i∈[N]δ(x^i,y^i)\widehat{\mathbb P}=\frac1N\sum_{i\in[N]}\delta_{(\widehat x_i,\widehat y_i)}P=N1​∑i∈[N]​δ(xi​,y​i​)​.

The optimal transport cost between two probability measures Q1,Q2\mathbb Q_1,\mathbb Q_2Q1​,Q2​ on X×Y\mathcal X\times\mathcal YX×Y is

W(Q1,Q2)=inf⁡{Eπ[D(ξ1,ξ2)]:π∈Π(Q1,Q2)},W(\mathbb Q_1,\mathbb Q_2)=\inf\{\mathbb E_\pi[\mathbb D(\xi_1,\xi_2)]:\pi\in\Pi(\mathbb Q_1,\mathbb Q_2)\},W(Q1​,Q2​)=inf{Eπ​[D(ξ1​,ξ2​)]:π∈Π(Q1​,Q2​)},

the infimum over couplings π\piπ with marginals Q1\mathbb Q_1Q1​ and Q2\mathbb Q_2Q2​. The ambiguity set is the ball Bρ={Q:W(Q,P^)≤ρ}\mathbb B_\rho=\{\mathbb Q:W(\mathbb Q,\widehat{\mathbb P})\le\rho\}Bρ​={Q:W(Q,P)≤ρ}.

Given a covariate value x0x_0x0​ and a radius γ≥0\gamma\ge0γ≥0, the neighbourhood is Nγ(x0)={x:DX(x,x0)≤γ}\mathcal N_\gamma(x_0)=\{x:\mathbb D_{\mathcal X}(x,x_0)\le\gamma\}Nγ​(x0​)={x:DX​(x,x0​)≤γ}, and Nγ(x0)×Y\mathcal N_\gamma(x_0)\times\mathcal YNγ​(x0​)×Y is the fiber set. For a loss ℓ(y)=ℓ(y,α,β)\ell(y)=\ell(y,\alpha,\beta)ℓ(y)=ℓ(y,α,β) at a fixed decision (α,β)(\alpha,\beta)(α,β) and a law Q\mathbb QQ with positive fiber mass, the conditional expected loss is

EQ[ℓ(Y)∣X∈Nγ(x0)]=EQ[ℓ(Y)1Nγ(x0)(X)]Q(X∈Nγ(x0)).\mathbb E_{\mathbb Q}[\ell(Y)\mid X\in\mathcal N_\gamma(x_0)]=\frac{\mathbb E_{\mathbb Q}[\ell(Y)\mathbb 1_{\mathcal N_\gamma(x_0)}(X)]}{\mathbb Q(X\in\mathcal N_\gamma(x_0))}.EQ​[ℓ(Y)∣X∈Nγ​(x0​)]=Q(X∈Nγ​(x0​))EQ​[ℓ(Y)1Nγ​(x0​)​(X)]​.

The paper's standing Assumption 2.4 requires: (i) DX\mathbb D_{\mathcal X}DX​ and DY\mathbb D_{\mathcal Y}DY​ are symmetric, non-negative and continuous, and D\mathbb DD vanishes exactly on the diagonal; (ii) every x^i\widehat x_ixi​ has a unique projection onto Nγ(x0)\mathcal N_\gamma(x_0)Nγ​(x0​); (iii) every boundary point of Nγ(x0)\mathcal N_\gamma(x_0)Nγ​(x0​) has points outside Nγ(x0)\mathcal N_\gamma(x_0)Nγ​(x0​) at arbitrarily small cost.

With γ=0\gamma=0γ=0 the fiber is {x0}×Y\{x_0\}\times\mathcal Y{x0​}×Y. With ε=0\varepsilon=0ε=0 the fiber-mass constraint is taken as the strict inequality Q(X=x0)>0\mathbb Q(X=x_0)>0Q(X=x0​)>0, so that the conditioning event is never null.

Formalization targets

Goal: Proposition 3.1 (p. 14)

For every x0∈Xx_0\in\mathcal Xx0​∈X, every ρ>0\rho>0ρ>0 and every loss ℓ:Y→R\ell:\mathcal Y\to\mathbb Rℓ:Y→R,

sup⁡Q∈Bρ, Q(X=x0)>0EQ[ℓ(Y)∣X=x0]=sup⁡y∈Yℓ(y),\sup_{\mathbb Q\in\mathbb B_\rho,\ \mathbb Q(X=x_0)>0}\mathbb E_{\mathbb Q}[\ell(Y)\mid X=x_0]=\sup_{y\in\mathcal Y}\ell(y),Q∈Bρ​, Q(X=x0​)>0sup​EQ​[ℓ(Y)∣X=x0​]=y∈Ysup​ℓ(y),

both sides in [−∞,+∞][-\infty,+\infty][−∞,+∞].

Milestones (in the order of the proof, pp. 40–41)

  1. Representation of the ball (p. 40, the same set as display (24), p. 47): Q∈Bρ\mathbb Q\in\mathbb B_\rhoQ∈Bρ​ if and only if Q=1N∑iπi\mathbb Q=\frac1N\sum_i\pi_iQ=N1​∑i​πi​ for probability measures πi\pi_iπi​ with 1N∑iEπi[D(⋅,(x^i,y^i))]≤ρ\frac1N\sum_i\mathbb E_{\pi_i}[\mathbb D(\cdot,(\widehat x_i,\widehat y_i))]\le\rhoN1​∑i​Eπi​​[D(⋅,(xi​,y​i​))]≤ρ.
  2. Lower bound (pp. 40–41): for every y0∈Yy_0\in\mathcal Yy0​∈Y some Q′∈Bρ\mathbb Q'\in\mathbb B_\rhoQ′∈Bρ​ has Q′(X=x0)>0\mathbb Q'(X=x_0)>0Q′(X=x0​)>0 and EQ′[ℓ(Y)∣X=x0]=ℓ(y0)\mathbb E_{\mathbb Q'}[\ell(Y)\mid X=x_0]=\ell(y_0)EQ′​[ℓ(Y)∣X=x0​]=ℓ(y0​).
  3. Upper bound (p. 41): EQ[ℓ(Y)∣(X,Y)∈S]≤sup⁡yℓ(y)\mathbb E_{\mathbb Q}[\ell(Y)\mid (X,Y)\in S]\le\sup_y\ell(y)EQ​[ℓ(Y)∣(X,Y)∈S]≤supy​ℓ(y) whenever Q(S)>0\mathbb Q(S)>0Q(S)>0.

Significance

The proposition shows that conditioning on a single covariate value with an optimal transport ball is uninformative: the worst-case conditional loss equals the robust optimization value sup⁡y∈Yℓ(y,α,β)\sup_{y\in\mathcal Y}\ell(y,\alpha,\beta)supy∈Y​ℓ(y,α,β) for every data set. This is what motivates the rest of the paper: either a minimum fiber mass ε>0\varepsilon>0ε>0 (Theorem 3.2) or a fiber of positive radius γ>0\gamma>0γ>0 (Section 4) is needed for the data to matter. The paper contrasts this with the type-∞\infty∞ Wasserstein ball, for which it points to existing results to compute the worst case.

For the platform, the mission sets up the shared model of the series: the separable ground cost, the empirical measure, the fiber, the conditional expectation as an extended-real ratio, and the paper's Assumption 2.4. The ball representation (milestone 1) is used by every other mission of the series; it rests on the existence of optimal couplings on Polish spaces, which Mathlib does not yet have. The result is proved in the paper; no machine-checked proof is known to exist.

Difficulty

The statement is an equality of two suprema over very different index sets, and neither inequality reduces to the other. The natural first idea, that the worst case is attained by a small perturbation of the empirical measure, fails: the empirical measure may put no mass on the fiber {x0}×Y\{x_0\}\times\mathcal Y{x0​}×Y, or put its mass there at returns far from where ℓ\ellℓ is large, and the value must be reached for every data set. Points of the data sitting exactly at x0x_0x0​ are the delicate case, since the transport budget charges for every displacement of mass. The ball representation (milestone 1) is the hard infrastructure step in its "only if" direction: it needs an optimal coupling, i.e. attainment of the transport infimum on Polish spaces, which is absent from Mathlib.

Formalization scope

Samples are indexed by Fin N with N≥1N\ge1N≥1. The ground cost is max⁡(DX+DY,0)\max(\mathbb D_{\mathcal X}+\mathbb D_{\mathcal Y},0)max(DX​+DY​,0) as a [0,∞][0,\infty][0,∞]-valued function. The transport cost reuses the published RWPI.SqrtLasso.transportCost, an infimum over couplings whose first marginal is Q\mathbb QQ and second marginal is P^\widehat{\mathbb P}P; the paper's "min" is not built into the definition. The radius enters as ENNReal.ofReal ρ, and the goal assumes ρ>0\rho>0ρ>0 as on the page (ρ∈R++\rho\in\mathbb R_{++}ρ∈R++​). Expectations use the published ModelRiskOT.Duality.extIntegral, ∫ℓ+−∫ℓ−\int\ell^+-\int\ell^-∫ℓ+−∫ℓ− in [−∞,+∞][-\infty,+\infty][−∞,+∞], so the loss ℓ:Y→R\ell:\mathcal Y\to\mathbb Rℓ:Y→R is arbitrary: no measurability, boundedness or integrability. The loss stands for ℓ(⋅,α,β)\ell(\cdot,\alpha,\beta)ℓ(⋅,α,β) at an arbitrary fixed decision, which is how "for any feasible (α,β)(\alpha,\beta)(α,β)" is read. The fiber at γ=0\gamma=0γ=0 is {x:DX(x,x0)≤0}×Y\{x:\mathbb D_{\mathcal X}(x,x_0)\le0\}\times\mathcal Y{x:DX​(x,x0​)≤0}×Y; that it equals {x0}×Y\{x_0\}\times\mathcal Y{x0​}×Y follows from Assumption 2.4(i). The boundary in Assumption 2.4(iii) is the topological frontier in X\mathcal XX.

One hypothesis is added to the paper and disclosed: x0x_0x0​ is not isolated for DX\mathbb D_{\mathcal X}DX​ (for every r>0r>0r>0 some x≠x0x\neq x_0x=x0​ has DX(x,x0)≤r\mathbb D_{\mathcal X}(x,x_0)\le rDX​(x,x0​)≤r). This is Assumption 2.4(iii) at γ=0\gamma=0γ=0 when the boundary of {x0}\{x_0\}{x0​} is read in an ambient Euclidean space, as the paper's remark on p. 11 does; the proof uses it, and without it the statement fails at an isolated x0x_0x0​ that is also a sample point.

Trivializing encodings are excluded: the supremum ranges only over probability measures in the ball with strictly positive fiber mass, so the conditional expectation is never evaluated at a null fiber; no Bochner integral (which is 000 for a non-integrable loss) is used; ρ<0\rho<0ρ<0 cannot enter through ofReal; and the feasible set is exactly Bρ\mathbb B_\rhoBρ​ intersected with the positive-mass constraint.

Contributions welcome: the existence of optimal couplings for lower semicontinuous costs on Polish spaces (reusable far beyond this mission), the decomposition of couplings with a finitely supported marginal, and the two halves of the goal.

Selected references

  • V. A. Nguyen, F. Zhang, S. Wang, J. Blanchet, E. Delage, Y. Ye, Robustifying conditional portfolio decisions via optimal transport, arXiv:2103.16451v3, 2024; Operations Research, 2025. https://arxiv.org/abs/2103.16451
  • C. Villani, Optimal Transport: Old and New, Grundlehren 338, Springer, 2009 (Theorem 4.1, existence of optimal couplings). https://doi.org/10.1007/978-3-540-71050-9
  • J. Blanchet, K. Murthy, Quantifying distributional model risk via optimal transport, Mathematics of Operations Research 44(2), 2019. https://doi.org/10.1287/moor.2018.0936
  • R. Gao, A. Kleywegt, Distributionally robust stochastic optimization with Wasserstein distance, Mathematics of Operations Research 48(2), 2023. https://doi.org/10.1287/moor.2022.1275
7 thms2 active usersReviewed
🏆Completed
EconomicsOperations Research·Captain: mikedeng1

Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration 3: A Monopoly AV Supplier on a Common Platform Chooses a Newsvendor-Fractile CapacityResearch Paper

Motivation

Ride-hailing platforms are expected to add autonomous vehicles (AVs) to fleets that today consist of human drivers. AVs have a cost advantage: a human driver must earn a reservation wage for every hour on the platform, while an AV owner pays a fixed capital cost per calendar hour and a smaller variable cost per operating hour. Whether that advantage reaches riders as lower prices depends on how the market is organized: who owns the AVs, and whether AVs and human drivers are dispatched on the same platform.

Z. Lian and G. van Ryzin study this question in Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration (Management Science, 2025). This mission formalizes one of their central results: when a single AV supplier (a monopoly) shares a common platform with perfectly elastic human-driver supply, its choice of AV capacity is a newsvendor problem, and the optimal capacity is the pure human-driver fleet size of the scenario at a critical fractile of the demand distribution. The version formalized here is the authors' 2023 SSRN working paper (abstract 3716491, version of 23 August 2023); all theorem and equation numbers refer to it, not to the published article.

Setting

Vehicles and demand. Riders' values for a ride-hour are uniform on [0,V][0, V][0,V]. In a scenario with potential demand mass m>0m > 0m>0, serving the demand rate d∈[0,m]d \in [0, m]d∈[0,m] requires the price p(d)=V(1−d/m)p(d) = V(1 - d/m)p(d)=V(1−d/m), and generates the revenue r(d)=d p(d) t2r(d) = d\,p(d)\,t_2r(d)=dp(d)t2​, where t2>0t_2 > 0t2​>0 is the trip time. Pickup times depend on the number sss of open vehicles through t1(s)=as−rt_1(s) = a s^{-r}t1​(s)=as−r with a>0a > 0a>0 and 0<r<10 < r < 10<r<1. Minimizing s+d(t1(s)+t2)s + d(t_1(s) + t_2)s+d(t1​(s)+t2​) over sss gives the minimal fleet needed to serve ddd,

n‾(d)=a~ d1/(r+1)+t2d,a~=r1/(r+1)a1/(r+1)+r−r/(r+1)a1/(r+1),\underline{n}(d) = \tilde a\, d^{1/(r+1)} + t_2 d, \qquad \tilde a = r^{1/(r+1)} a^{1/(r+1)} + r^{-r/(r+1)} a^{1/(r+1)},n​(d)=a~d1/(r+1)+t2​d,a~=r1/(r+1)a1/(r+1)+r−r/(r+1)a1/(r+1),

and the maximal utilization uˉ(d)=dt2/n‾(d)\bar u(d) = d t_2/\underline{n}(d)uˉ(d)=dt2​/n​(d). The function n‾\underline{n}n​ is a strictly increasing bijection of [0,∞)[0, \infty)[0,∞); its inverse dˉ(n)\bar d(n)dˉ(n) is the largest demand that nnn vehicles can serve.

Human drivers (HVs). In this mission HV supply is perfectly elastic at reservation earnings w0w_0w0​ per hour (the paper's α=0\alpha = 0α=0). A demand rate ddd is a pure-HV equilibrium when revenue covers the minimal HV cost, r(d)=w0 n‾(d)r(d) = w_0\,\underline{n}(d)r(d)=w0​n​(d); among stable equilibria the paper selects the largest, the maximal stable equilibrium d∗d^*d∗, with fleet size nHV∗=n‾(d∗)n^*_{HV} = \underline{n}(d^*)nHV∗​=n​(d∗). The market is loose when r(m/2)>w0 n‾(m/2)r(m/2) > w_0\,\underline{n}(m/2)r(m/2)>w0​n​(m/2).

AVs. AVs cost cv>0c_v > 0cv​>0 per operating hour and cf>0c_f > 0cf​>0 per calendar hour, and cv+cf<w0c_v + c_f < w_0cv​+cf​<w0​ (Assumption 1). On a common platform, the paper shows (Proposition 6) that the variable profit per AV at fleet size nAVn_{AV}nAV​ is

πC(nAV)={w0−cv,nAV<nHV∗,p(dˉ(nAV)) uˉ(dˉ(nAV))−cv,nAV≥nHV∗.\pi^C(n_{AV}) = \begin{cases} w_0 - c_v, & n_{AV} < n^*_{HV},\\ p(\bar d(n_{AV}))\,\bar u(\bar d(n_{AV})) - c_v, & n_{AV} \ge n^*_{HV}.\end{cases}πC(nAV​)={w0​−cv​,p(dˉ(nAV​))uˉ(dˉ(nAV​))−cv​,​nAV​<nHV∗​,nAV​≥nHV∗​.​

Scenarios and the monopoly problem. Demand has III scenarios with masses m1<⋯<mIm_1 < \dots < m_Im1​<⋯<mI​ and probabilities P(mi)P(m_i)P(mi​). The monopoly chooses a capacity NNN, then a fleet nAV,i≤Nn_{AV,i} \le NnAV,i​≤N in each scenario:

max⁡N  ∑i=1IP(mi){max⁡nAV,i≤NπiC(nAV,i) nAV,i}−cfN.(5)\max_{N} \; \sum_{i=1}^{I} P(m_i)\Big\{\max_{n_{AV,i} \le N} \pi^C_i(n_{AV,i})\, n_{AV,i}\Big\} - c_f N. \tag{5}Nmax​i=1∑I​P(mi​){nAV,i​≤Nmax​πiC​(nAV,i​)nAV,i​}−cf​N.(5)

Formalization targets

Goal: Proposition 8

Let KKK be the smallest index iii with ∑j=i+1IP(mj)<cf/(w0−cv)\sum_{j=i+1}^{I} P(m_j) < c_f/(w_0 - c_v)∑j=i+1I​P(mj​)<cf​/(w0​−cv​). In a loose market,

N∗=nHV,K∗N^* = n^*_{HV,K}N∗=nHV,K∗​

is an optimal capacity for (5).

Milestones

  1. Lemma 1, Item 2. n‾\underline{n}n​ is strictly increasing and a bijection of [0,∞)[0,\infty)[0,∞), so dˉ\bar ddˉ is well defined.
  2. Lemma 4. Beyond nHV,i∗n^*_{HV,i}nHV,i∗​ the AV-only total variable profit pi(dAV)dAVt2−cvnAVp_i(d_{AV}) d_{AV} t_2 - c_v n_{AV}pi​(dAV​)dAV​t2​−cv​nAV​, with dAV=dˉ(nAV)d_{AV} = \bar d(n_{AV})dAV​=dˉ(nAV​), is strictly decreasing.
  3. Proposition 7. For a capacity N≥0N \ge 0N≥0, the unique optimal fleet in scenario iii is min⁡{N,nHV,i∗}\min\{N, n^*_{HV,i}\}min{N,nHV,i∗​}.
  4. Equation (20). For N≥0N \ge 0N≥0, the objective (5) equals (w0−cv)∑iP(mi)min⁡{N,nHV,i∗}−cfN(w_0 - c_v)\sum_i P(m_i)\min\{N, n^*_{HV,i}\} - c_f N(w0​−cv​)∑i​P(mi​)min{N,nHV,i∗​}−cf​N.
  5. Equation (268). For consecutive breakpoints, Π(nK+1)−Π(nK)=(∑i≥K+1P(mi)(w0−cv)−cf)(nK+1−nK)\Pi(n_{K+1}) - \Pi(n_K) = \big(\sum_{i \ge K+1} P(m_i)(w_0 - c_v) - c_f\big)(n_{K+1} - n_K)Π(nK+1​)−Π(nK​)=(∑i≥K+1​P(mi​)(w0​−cv​)−cf​)(nK+1​−nK​).
  6. Equation (271). For 0<c<10 < c < 10<c<1 there is exactly one KKK with ∑i>KP(mi)<c≤∑i≥KP(mi)\sum_{i>K} P(m_i) < c \le \sum_{i\ge K} P(m_i)∑i>K​P(mi​)<c≤∑i≥K​P(mi​), and the smallest iii with ∑j>iP(mj)<c\sum_{j>i} P(m_j) < c∑j>i​P(mj​)<c is that KKK.

Significance

The result. Proposition 8 says that, on a common platform with elastic human-driver supply, a monopoly AV supplier never undercuts the human drivers' price: in every scenario it deploys at most the pure-HV fleet size, so riders pay the pure-HV price, and the whole cost advantage w0−cv−cfw_0 - c_v - c_fw0​−cv​−cf​ is retained by the supplier. Its capacity is set by the classical newsvendor trade-off between the margin w0−cvw_0 - c_vw0​−cv​ of a used AV and the fixed cost cfc_fcf​ of an idle one. With a cheap fixed cost the supplier covers the peak scenario; with an expensive one it covers only the lowest scenario and lets human drivers serve the rest. These conclusions drive the paper's policy comparison of market configurations.

Formalizing it. The result is proved in the paper; nothing here is open. No machine-checked version exists. A complete development requires the analysis of n‾\underline{n}n​ (real powers with exponent 1/(r+1)1/(r+1)1/(r+1)), the identification of the maximal stable equilibrium under the loose-market condition, a monotonicity argument for the AV-only profit along the inverse dˉ\bar ddˉ, and the discrete newsvendor argument over a piecewise-linear concave objective. The last part is reusable for any discrete-scenario capacity problem.

Difficulty

The newsvendor step is elementary once the objective is in the form (20). The work lies in reaching (20) from (5). That requires, in each scenario, showing that the maximum over [0,N][0, N][0,N] of πiC(n) n\pi^C_i(n)\,nπiC​(n)n is attained at min⁡{N,nHV,i∗}\min\{N, n^*_{HV,i}\}min{N,nHV,i∗​}. Below nHV,i∗n^*_{HV,i}nHV,i∗​ this is linear growth; above it, the profit is a function of dˉ(n)\bar d(n)dˉ(n), an inverse of a sum of a fractional power and a linear term with no closed form, and its decrease rests on the loose-market condition placing dHV,i∗d^*_{HV,i}dHV,i∗​ beyond the revenue-maximizing demand mi/2m_i/2mi​/2. Without the loose-market condition the claim fails: in a thin market the only equilibrium is d∗=0d^* = 0d∗=0, and the supplier's AV-only profit need not decrease past it. The continuity of πiC\pi^C_iπiC​ at nHV,i∗n^*_{HV,i}nHV,i∗​ uses the equilibrium identity p(d∗)uˉ(d∗)=w0p(d^*)\bar u(d^*) = w_0p(d∗)uˉ(d∗)=w0​, which itself depends on identifying the maximal stable equilibrium.

Formalization scope

  • Model. All quantities are real. Scenarios are indexed by Fin I (0-based): the paper's scenario iii is index i−1i - 1i−1, ∑K+1I\sum_{K+1}^{I}∑K+1I​ is a sum over indices strictly above KKK, and "the smallest iii" is IsLeast.
  • Standing assumptions, written as explicit hypotheses: a,t2,V>0a, t_2, V > 0a,t2​,V>0; 0<r<10 < r < 10<r<1 (§6.2 uses the density effect r>0r > 0r>0; Lemma 1 Item 2 is stated for 0≤r<10 \le r < 10≤r<1); α=0\alpha = 0α=0 (§6.2); cv,cf>0c_v, c_f > 0cv​,cf​>0 and cv+cf<w0c_v + c_f < w_0cv​+cf​<w0​ (Assumption 1); 0<m1<⋯<mI0 < m_1 < \dots < m_I0<m1​<⋯<mI​; P(mi)≥0P(m_i) \ge 0P(mi​)≥0 with ∑iP(mi)=1\sum_i P(m_i) = 1∑i​P(mi​)=1; I≥1I \ge 1I≥1.
  • Pinned hypotheses. "Loose market" is condition (33), ri(mi/2)>w0 n‾(mi/2)r_i(m_i/2) > w_0\,\underline{n}(m_i/2)ri​(mi​/2)>w0​n​(mi​/2), the paper's restatement of Assumption 2, in every scenario. Definition 1's ε\varepsilonε is restricted so that d±ε∈[0,m]d \pm \varepsilon \in [0, m]d±ε∈[0,m], the domain of the inverse demand. The pure-HV equilibrium is a hypothesis IsMaxStableEq on given numbers dHV,i∗d^*_{HV,i}dHV,i∗​, not a choice function.
  • Proposition 6 is a definition. The common-platform equilibrium for an exogenous AV fleet is taken in the paper's summary form (251) as the definition of πiC\pi^C_iπiC​; it is not re-derived.
  • The inner maximum of (5) is a real supremum over nAV∈[0,N]n_{AV} \in [0, N]nAV​∈[0,N]. The capacity ranges over N≥0N \ge 0N≥0; for N<0N < 0N<0 the interval is empty and Lean's supremum of the empty set is 000, which is why negative capacities are excluded.
  • Optimal, not unique. The goal asserts that nHV,K∗n^*_{HV,K}nHV,K∗​ maximizes (5); when the tail probability equals the critical fractile exactly, two capacities tie.
  • No shortcut. The definition of (5) must not contain min⁡{N,nHV,i∗}\min\{N, n^*_{HV,i}\}min{N,nHV,i∗​}: Proposition 7 and (20) are milestones, and writing them into the objective would make the goal a statement about (20) alone.
  • Contributions welcome: proofs of any milestone, in particular Lemma 1 Item 2 and Lemma 4, whose real-analysis content is shared with the sibling missions of this series.

Selected references

  • Z. Lian, G. van Ryzin, Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration, SSRN working paper 3716491, version of 23 August 2023. https://ssrn.com/abstract=3716491
  • Z. Lian, G. van Ryzin, Capturing the Benefits of Autonomous Vehicles in Ride-Hailing: The Role of Market Configuration, Management Science, 2025. https://doi.org/10.1287/mnsc.2020.03112
  • P. Kolesar, A Model for Predicting Average Fire Engine Travel Times, Operations Research 23(4), 1975. https://doi.org/10.1287/opre.23.4.603
9 thms2 active usersReviewed
EconomicsMechanism DesignOperations Research+1·Captain: mikedeng1

Selling Data to Marketers 3: Under the Rotation Order, Marketing Lists Serve Low-Cost Marketers Efficiently and Over- (Under-) Supply High-Cost Ones Below (Above) the Rotation PointResearch Paper

Motivation

Data brokers sell two kinds of products to marketers. A marketing list supplies the contacts a marketer needs in order to act at all; a data append enriches a list the marketer already holds. In both cases the broker can also choose how informative its accompanying analytics are, and it can price a menu of plans of different informativeness to marketers whose costs of acting it cannot observe. Liang Guo's Selling Data to Marketers (Management Science, doi:10.1287/mnsc.2023.01350) studies how such a seller should design this menu, and in particular when it should sell more or less information than would be efficient.

The paper first works with a two-point value distribution (Sections 2–3) and then, in Section 4, with a general information structure in which informativeness is ordered by the rotation order of the distribution of the posterior mean (Johnson and Myatt 2006). This mission formalizes the marketing-list result of Section 4.1: Proposition 4 (comparative statics of the efficient informativeness) and Proposition 5 (the optimal screening menu). It is the third mission of a four-mission series on the paper; the first two treat the two-point model, the fourth treats data appends under the rotation order.

Setting

A marketer's value uuu from targeting a consumer is unknown. The seller supplies a signal of informativeness α∈[α‾,αˉ]⊂(0,1)\alpha\in[\underline\alpha,\bar\alpha]\subset(0,1)α∈[α​,αˉ]⊂(0,1). The marketer's posterior mean v=E[u∣w]v=E[u\mid w]v=E[u∣w] has cumulative distribution function H(v,α)H(v,\alpha)H(v,α) on a support [v‾,vˉ][\underline v,\bar v][v​,vˉ], with a strictly positive density h(v,α)h(v,\alpha)h(v,α). Bayesian updating keeps the mean fixed: ∫v‾vˉv h(v,α) dv=u^\int_{\underline v}^{\bar v} v\,h(v,\alpha)\,dv=\hat u∫v​vˉ​vh(v,α)dv=u^ for every α\alphaα, where u^\hat uu^ is the prior mean. The rotation order (9) requires a point v+∈(v‾,vˉ)v^+\in(\underline v,\bar v)v+∈(v​,vˉ) such that

∂H(v,α)∂α>0 for v<v+,∂H(v,α)∂α<0 for v>v+.\frac{\partial H(v,\alpha)}{\partial\alpha}>0\ \text{for } v<v^+,\qquad \frac{\partial H(v,\alpha)}{\partial\alpha}<0\ \text{for } v>v^+ .∂α∂H(v,α)​>0 for v<v+,∂α∂H(v,α)​<0 for v>v+.

Raising α\alphaα moves probability mass from the middle of the distribution to its tails.

The seller incurs a selling cost k(α)k(\alpha)k(α), increasing, with k(α‾)=0k(\underline\alpha)=0k(α​)=0. A marketer's targeting cost is cHc_HcH​ with probability θ∈(0,1)\theta\in(0,1)θ∈(0,1) and cLc_LcL​ with probability 1−θ1-\theta1−θ, with cH>cL>0c_H>c_L>0cH​>cL​>0. A marketer with cost ccc targets exactly when v>cv>cv>c, so informativeness α\alphaα is worth

P(α,c)=∫cvˉ(v−c) dH(v,α).P(\alpha,c)=\int_c^{\bar v}(v-c)\,dH(v,\alpha).P(α,c)=∫cvˉ​(v−c)dH(v,α).

With observable costs (the benchmark), the seller sells to type iii the informativeness maximizing (12), Πi=θi [P(α,ci)−k(α)]\Pi_i=\theta_i\,[P(\alpha,c_i)-k(\alpha)]Πi​=θi​[P(α,ci​)−k(α)]; a maximizer is an efficient level αie\alpha^e_iαie​. With private costs, the seller offers a menu of plans (TH,αH)(T_H,\alpha_H)(TH​,αH​), (TL,αL)(T_L,\alpha_L)(TL​,αL​), with fees Tj≥0T_j\ge0Tj​≥0. A type-iii marketer choosing plan jjj gets Uij=−Tj+P(αj,ci)U_{ij}=-T_j+P(\alpha_j,c_i)Uij​=−Tj​+P(αj​,ci​) (13). The seller maximizes Π=θ[TH−k(αH)]+(1−θ)[TL−k(αL)]\Pi=\theta[T_H-k(\alpha_H)]+(1-\theta)[T_L-k(\alpha_L)]Π=θ[TH​−k(αH​)]+(1−θ)[TL​−k(αL​)] subject to individual rationality Uii≥0U_{ii}\ge0Uii​≥0 and incentive compatibility Uii≥Uii′U_{ii}\ge U_{ii'}Uii​≥Uii′​ (problem (6)). Its solutions are written αH∗,αL∗\alpha^*_H,\alpha^*_LαH∗​,αL∗​.

Formalization targets

Goal: Proposition 5

In general αL∗=αLe\alpha^*_L=\alpha^e_LαL∗​=αLe​, and if cL<cH<v+c_L<c_H<v^+cL​<cH​<v+ (resp. v+<cL<cHv^+<c_L<c_Hv+<cL​<cH​), then

αH∗>αHe(resp. αH∗<αHe).\alpha^*_H>\alpha^e_H\quad(\text{resp. } \alpha^*_H<\alpha^e_H).αH∗​>αHe​(resp. αH∗​<αHe​).

The first identity says that the low-cost marketer, the "high type" of the screening problem, receives the efficient informativeness. The second says that the high-cost marketer's informativeness is distorted, upward when both costs lie below the rotation point and downward when both lie above it. Both are stated for every optimal menu and every efficient level.

Milestones

  1. Integration by parts: P(α,c)=∫cvˉ[1−H(v,α)] dvP(\alpha,c)=\int_c^{\bar v}[1-H(v,\alpha)]\,dvP(α,c)=∫cvˉ​[1−H(v,α)]dv (proof of Proposition 4).
  2. The cross derivative ∂2Πi/∂αi∂ci=θi ∂H(ci,αi)/∂αi\partial^2\Pi_i/\partial\alpha_i\partial c_i=\theta_i\,\partial H(c_i,\alpha_i)/\partial\alpha_i∂2Πi​/∂αi​∂ci​=θi​∂H(ci​,αi​)/∂αi​ and its sign on either side of v+v^+v+.
  3. Proposition 4: αie\alpha^e_iαie​ first increases and then decreases with cic_ici​, with the turning point at v+v^+v+.
  4. The reduction of (6) to the two-variable problem (14) by the binding constraints IRHIR_HIRH​ and ICL,HIC_{L,H}ICL,H​.
  5. (14) integrated by parts, with the high type's rent R(αH)=∫cLcH[1−H(v,αH)] dvR(\alpha_H)=\int_{c_L}^{c_H}[1-H(v,\alpha_H)]\,dvR(αH​)=∫cL​cH​​[1−H(v,αH​)]dv, and its separation, which gives αL∗=αLe\alpha^*_L=\alpha^e_LαL∗​=αLe​ for (14).
  6. The derivative ∂Π/∂αH\partial\Pi/\partial\alpha_H∂Π/∂αH​ of (14) compared with the benchmark derivative.

Significance

Proposition 4 states that the value of information to a marketer is non-monotone in the cost of acting: it is largest for costs near the rotation point v+v^+v+, where the targeting decision is hardest. Proposition 5 turns this into a pricing rule. In the two-point model the direction of the distortion depends only on the prior (Proposition 2, φ<1/2\varphi<1/2φ<1/2 or φ>1/2\varphi>1/2φ>1/2). Under the rotation order it depends on where the costs lie relative to v+v^+v+, so a seller facing marketers with low costs over-supplies information to its less profitable segment, and one facing high costs under-supplies it. The comparison with the two-point model (pp. 17–18 of the manuscript) connects the two settings through the single-crossing point of the posterior-mean distributions.

The results are proved in the paper, through integration by parts, signs of derivatives and Topkis's monotonicity theorem. None of them is formalized. Formalizing them checks the reduction of the screening problem, which the paper performs by analogy with the two-point model, including the constraints it drops without comment. It also produces a reusable treatment of rotation-ordered distribution families on an interval. Topkis's Theorem 2.8.4 is already proved on the platform and is part of this mission as a reference.

Difficulty

The obvious argument has two gaps. The first is the reduction (14). The paper substitutes the binding IRHIR_HIRH​ and ICL,HIC_{L,H}ICL,H​ constraints and drops IRLIR_LIRL​, ICH,LIC_{H,L}ICH,L​ and Tj≥0T_j\ge0Tj​≥0. That the dropped constraints hold at a solution of (14) is not shown in the paper. The second gap is strictness: Topkis's theorem compares maximizers weakly. The strict inequalities αH∗≷αHe\alpha^*_H\gtrless\alpha^e_HαH∗​≷αHe​ require showing that efficient levels are interior and that the first-order conditions differ there. This uses the footnote-5 behaviour of kkk at the endpoints and the mean-preserving property (10), which follows from (9) and the constancy of the mean.

Formalization scope

The model is one Lean structure, SellingData.ListsRotation.Model, with real parameters and its standing assumptions as fields. The committed conventions are:

  • The support [v‾,vˉ][\underline v,\bar v][v​,vˉ] is a bounded real interval; the paper allows an unbounded one.
  • H(⋅,α)H(\cdot,\alpha)H(⋅,α) is continuous on the support, with H(v‾,α)=0H(\underline v,\alpha)=0H(v​,α)=0, H(vˉ,α)=1H(\bar v,\alpha)=1H(vˉ,α)=1 and a strictly positive continuous density h(⋅,α)h(\cdot,\alpha)h(⋅,α). The derivative ∂H/∂α\partial H/\partial\alpha∂H/∂α exists on the support, for α∈(0,1)\alpha\in(0,1)α∈(0,1).
  • dH(v,α)dH(v,\alpha)dH(v,α) is h(v,α) dvh(v,\alpha)\,dvh(v,α)dv, so P(α,c)=∫cvˉ(v−c) h(v,α) dvP(\alpha,c)=\int_c^{\bar v}(v-c)\,h(v,\alpha)\,dvP(α,c)=∫cvˉ​(v−c)h(v,α)dv.
  • The rotation order (9) is imposed on the open support. The mean property is a field of the model; (10) is not assumed, since it follows.
  • The costs satisfy v‾<cL<cH<vˉ\underline v<c_L<c_H<\bar vv​<cL​<cH​<vˉ.
  • kkk is monotone on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ] with k(α‾)=0k(\underline\alpha)=0k(α​)=0.

Two further hypotheses are pinned, and only on the statements that need strictness or differentiation under the integral sign:

  • the footnote-5 conditions on kkk: continuity on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ], differentiability inside, k′(α‾)=0k'(\underline\alpha)=0k′(α​)=0 from the right and k′(α)→+∞k'(\alpha)\to+\inftyk′(α)→+∞ as α→αˉ−\alpha\to\bar\alpha^-α→αˉ−; convexity and twice differentiability are not assumed;
  • joint continuity of ∂H/∂α\partial H/\partial\alpha∂H/∂α on [v‾,vˉ]×(0,1)[\underline v,\bar v]\times(0,1)[v​,vˉ]×(0,1).

Optimal menus and efficient levels are sets of maximizers, not chosen maximizers, because kkk need not be convex. "αL∗=αLe\alpha^*_L=\alpha^e_LαL∗​=αLe​" is the equality of the set of low-cost plans of optimal menus with the set of efficient levels. The goal is stated for the screening problem (6) itself, with all four constraints and nonnegative fees. Defining the optimal menu through (14), or efficient levels through a first-order condition, would make half of the goal a restatement of a milestone, and is ruled out. As on the page, αL∗=αLe\alpha^*_L=\alpha^e_LαL∗​=αLe​ is stated with no condition on the position of the costs relative to v+v^+v+; only the comparison of αH∗\alpha^*_HαH∗​ with αHe\alpha^e_HαHe​ carries the two cost ranges. A sorry-free instance shows that the model's hypotheses are jointly satisfiable: [v‾,vˉ]=[0,1][\underline v,\bar v]=[0,1][v​,vˉ]=[0,1], H(v,α)=v+α2v(1−v)(1−2v)H(v,\alpha)=v+\tfrac{\alpha}{2}v(1-v)(1-2v)H(v,α)=v+2α​v(1−v)(1−2v), v+=u^=1/2v^+=\hat u=1/2v+=u^=1/2.

Contributions are welcome on the integration-by-parts and differentiation-under-the-integral lemmas for families of distributions on an interval, which are reusable beyond this paper, and on any milestone in any order.

Selected references

  • Liang Guo, Selling Data to Marketers, Management Science, 2025, author's manuscript. https://doi.org/10.1287/mnsc.2023.01350
  • Justin P. Johnson and David P. Myatt, On the Simple Economics of Advertising, Marketing, and Product Design, American Economic Review 96(3), 2006. https://doi.org/10.1257/aer.96.3.756
  • Donald M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998 (Theorem 2.8.4). https://doi.org/10.1515/9781400822539
10 thms2 active usersReviewed
🏆Completed
EconomicsOperations Research·Captain: mikedeng1

Common Ownership, Competition, and Corporate Governance: Equilibrium Common Ownership Decreases in Managers' Ability to Divert Profits and Increases in the Cost of MonitoringResearch Paper

Common ownership and corporate governance

Large asset managers now hold significant stakes in many competing firms at once. When the same investor owns shares in rival firms, managers who weigh that investor's interests have an incentive to compete less hard, which raises industry profits at consumers' expense. This "softening of competition" effect is the subject of a large empirical and antitrust literature (see Azar, Schmalz and Tecu, Journal of Finance, 2018, and the review of Schmalz, Antitrust Bulletin, 2021). A natural question is then why common ownership is not complete: if buying stakes in rivals raises profits, why does an investor not buy the firms outright?

Denicolò and Panunzi (ECGI Finance Working Paper 927/2023; Management Science, 2025, doi:10.1287/mnsc.2023.03467) answer this with a corporate-governance cost. Common ownership is acquired from blockholders who monitor management; as a blockholder sells, his residual stake shrinks and so does his incentive to monitor, so managers appropriate more of the profit. The equilibrium level of common ownership trades off softer competition against weaker monitoring. The mission formalizes the paper's comparative statics of that trade-off with respect to the two corporate-governance parameters.

Setting

Two symmetric firms each have a blockholder owning a fraction β∈(0,1]\beta\in(0,1]β∈(0,1] of the shares; dispersed shareholders own the rest. A financial investor buys the same stake s∈[0,β]s\in[0,\beta]s∈[0,β] from each blockholder, who keeps the residual stake t=β−st=\beta-st=β−s.

Each firm's manager diverts a fraction ξ∈(0,1)\xi\in(0,1)ξ∈(0,1) of the firm's profit unless monitored. A blockholder's monitoring m∈[0,1]m\in[0,1]m∈[0,1] cuts the diversion to ξ(1−m)\xi(1-m)ξ(1−m) at a private cost C(m)C(m)C(m) per unit of profit, with C(0)=0C(0)=0C(0)=0, C′(0)=0C'(0)=0C′(0)=0, C′(1)>ξC'(1)>\xiC′(1)>ξ. Given ttt, the blockholder chooses mmm to maximize

t [1−ξ(1−m)]−C(m),t\,[1-\xi(1-m)]-C(m),t[1−ξ(1−m)]−C(m),

and an optimal monitoring rule m∗(t)m^*(t)m∗(t) is a maximizer over m∈[0,1]m\in[0,1]m∈[0,1] for every t∈[0,β]t\in[0,\beta]t∈[0,β]. In the specification studied here the cost is quadratic, C(m)=12γm2C(m)=\tfrac12\gamma m^2C(m)=21​γm2 with γ>ξ\gamma>\xiγ>ξ.

Managers maximize their own firm's profit plus a weight λ\lambdaλ on the rival's profit, where the common-ownership weight is

λ(s)=θs2(β−s)2+θs2,\lambda(s)=\frac{\theta s^2}{(\beta-s)^2+\theta s^2},λ(s)=(β−s)2+θs2θs2​,

and θ∈(0,1]\theta\in(0,1]θ∈(0,1] measures the investor's influence on managers. Equilibrium industry profit is Π∗(s)=P(λ(s))\Pi^*(s)=P(\lambda(s))Π∗(s)=P(λ(s)) for a function PPP of λ\lambdaλ determined by the product market.

The large shareholders' payoff per unit of profit is

ν∗(s)=β{1−ξ[1−m∗(β−s)]}−C[m∗(β−s)],\nu^*(s)=\beta\{1-\xi[1-m^*(\beta-s)]\}-C[m^*(\beta-s)],ν∗(s)=β{1−ξ[1−m∗(β−s)]}−C[m∗(β−s)],

and their joint surplus is S(s)=ν∗(s) Π∗(s)S(s)=\nu^*(s)\,\Pi^*(s)S(s)=ν∗(s)Π∗(s). An equilibrium level of common ownership is a stake s∗∈[0,β]s^*\in[0,\beta]s∗∈[0,β] that maximizes SSS over [0,β][0,\beta][0,β].

Formalization targets

Goal: Proposition 3

With the quadratic cost, the equilibrium level of common ownership is monotonically decreasing in ξ\xiξ and monotonically increasing in γ\gammaγ:

ξ1<ξ2 ⇒ s∗(ξ2,γ)≤s∗(ξ1,γ),γ1<γ2 ⇒ s∗(ξ,γ1)≤s∗(ξ,γ2),\xi_1<\xi_2\ \Rightarrow\ s^*(\xi_2,\gamma)\le s^*(\xi_1,\gamma),\qquad \gamma_1<\gamma_2\ \Rightarrow\ s^*(\xi,\gamma_1)\le s^*(\xi,\gamma_2),ξ1​<ξ2​ ⇒ s∗(ξ2​,γ)≤s∗(ξ1​,γ),γ1​<γ2​ ⇒ s∗(ξ,γ1​)≤s∗(ξ,γ2​),

for every equilibrium at each parameter value. The statement fixes no product-market model: it holds for every positive industry-profit function PPP of λ\lambdaλ.

Milestones

  1. The blockholder's optimal monitoring under the quadratic cost is m∗=ξ(β−s)/γm^*=\xi(\beta-s)/\gammam∗=ξ(β−s)/γ (21).
  2. The derivative of the common-ownership weight, ∂λ/∂s=2θsβ(β−s)/[(β−s)2+θs2]2\partial\lambda/\partial s=2\theta s\beta(\beta-s)/[(\beta-s)^2+\theta s^2]^2∂λ/∂s=2θsβ(β−s)/[(β−s)2+θs2]2 (18).
  3. The last step of Lemma 1: industry profit is nondecreasing in sss, strictly between 000 and β\betaβ, with a zero derivative at both ends, given the sign of ∂Π∗/∂λ\partial\Pi^*/\partial\lambda∂Π∗/∂λ.
  4. Proposition 2: for a general monitoring cost, common ownership is always partial, 0≤s∗<β0\le s^*<\beta0≤s∗<β.
  5. The marginal surplus (A2)–(A3): ∂S/∂s=(ξ2/γ)HΠ∗\partial S/\partial s=(\xi^2/\gamma)H\Pi^*∂S/∂s=(ξ2/γ)HΠ∗.
  6. The signs ∂H/∂ξ<0\partial H/\partial\xi<0∂H/∂ξ<0 and ∂H/∂γ>0\partial H/\partial\gamma>0∂H/∂γ>0.
  7. The surplus jump (A4)–(A5) between an interior stake s+s^+s+ and s=0s=0s=0, in terms of KKK.
  8. The signs ∂K/∂ξ<0\partial K/\partial\xi<0∂K/∂ξ<0 and ∂K/∂γ>0\partial K/\partial\gamma>0∂K/∂γ>0.

A companion pair covers the §7.1 variant in which the blockholder himself diverts profits at a quadratic deadweight loss 12φa2\tfrac12\varphi a^221​φa2: the optimal diversion (46) and Proposition 9, which states that equilibrium common ownership is increasing in φ\varphiφ.

Significance

Both ξ\xiξ and γ\gammaγ measure the quality of corporate-governance institutions: lower values mean fewer opportunities to divert profits and cheaper monitoring. Proposition 3 shows that the two act in opposite directions on common ownership. Stronger legal protection of shareholders (lower ξ\xiξ) raises common ownership, while cheaper monitoring (lower γ\gammaγ) lowers it. The paper uses this to argue that improvements in governance may have contributed to the rise of common ownership, and that policy aimed at governance has consequences for product-market competition. Proposition 2 gives the bound that makes the comparative statics meaningful: the investor never acquires the blockholders' entire stakes.

The results are proved in the paper by a first-order argument on an interior optimum together with a separate argument for jumps between interior and corner equilibria. No machine-checked version exists. A formalization makes the statement precise in two respects the paper leaves implicit: it holds for every equilibrium, including ties between an interior and a corner maximizer, and for every positive industry-profit function, independent of the product-market model. Along the way it records a slip in (A4), where the constant is ξ2/(2γ)\xi^2/(2\gamma)ξ2/(2γ) rather than the printed ξ2/γ\xi^2/\gammaξ2/γ; the paper uses only its sign.

Difficulty

The paper's argument differentiates the first-order condition H=0H=0H=0 of an interior optimum and treats jumps of the equilibrium separately through the sign of KKK. Implicit differentiation alone does not give the result: the surplus is not concave in sss (it can have two local maxima, one at s=0s=0s=0), the equilibrium need not be unique, and it jumps. A proof for every equilibrium therefore has to compare global maximizers at two parameter values directly rather than follow a differentiable selection.

A second difficulty is that the surplus is built from the optimal monitoring rule as a maximizer, not from its closed form: the step from the optimality predicate to the formula (21) must be proved before any algebra on ν∗\nu^*ν∗ is available. For Proposition 2 with a general cost, the optimal rule is only implicitly defined, and the comparison near s=βs=\betas=β involves a first-order gain in monitoring against a second-order loss in industry profit.

Formalization scope

All objects are real-valued. Stakes range over [0,β][0,\beta][0,β] and monitoring over [0,1][0,1][0,1]; an optimal monitoring rule is a function R→R\mathbb R\to\mathbb RR→R constrained only on residual stakes t∈[0,β]t\in[0,\beta]t∈[0,β]. An equilibrium is a maximizer of the joint surplus on [0,β][0,\beta][0,β], ties allowed, and monotonicity is weak and asserted for every pair of equilibria. Derivatives are stated with HasDerivAt, except in the sign milestones, where deriv appears only inside strict inequalities.

Standing assumptions, all explicit hypotheses: 0<θ≤10<\theta\le10<θ≤1 and 0<β≤10<\beta\le10<β≤1 (pp. 7–8); 0<ξ<10<\xi<10<ξ<1 (ξ\xiξ is a fraction; ξ<1\xi<1ξ<1 is a disclosed pin, needed for the γ\gammaγ part); γ>ξ\gamma>\xiγ>ξ (footnote 19's form of C′(1)>ξC'(1)>\xiC′(1)>ξ); P(λ)>0P(\lambda)>0P(λ)>0 on [0,1][0,1][0,1], one PPP for both parameter values (industry profit does not depend on ξ\xiξ and γ\gammaγ). Proposition 2 assumes CCC twice continuously differentiable with C′′>0C''>0C′′>0 on [0,1][0,1][0,1] (the paper says convex but divides by C′′C''C′′), and PPP differentiable at λ=1\lambda=1λ=1 with P(1)>0P(1)>0P(1)>0. The companion assumes φ≥1\varphi\ge1φ≥1, which keeps the optimal diversion inside [0,1][0,1][0,1].

The model is the weight (17), the monitoring stage of §3.2.1, ν∗\nu^*ν∗ and SSS of (13)–(14), and the industry-profit function PPP. Proposition 1 (the bargaining reduction from the investor's offers to the maximization of the joint surplus) and the product-market game itself are not formalized: equilibrium ownership is defined, as in §4.2, as a maximizer of the symmetric surplus, and PPP is arbitrary, so the theorem covers every product-market model of §3.1.3. The paper's derivation of ∂Π∗/∂λ≥0\partial\Pi^*/\partial\lambda\ge0∂Π∗/∂λ≥0 from the product-market conditions is not posed; in milestone 3 that sign is a hypothesis. §4.2's remark on the concavity of the joint payoff is not assumed.

Two trivializing formalizations are ruled out: the surplus is never typed with the closed form of ν∗\nu^*ν∗ (monitoring is any optimal rule, and milestone 1 is the bridge), and industry profit is required to be positive, since P≡0P\equiv0P≡0 would make every stake an equilibrium.

The development needs only elementary real analysis: one-variable optimization on intervals, derivatives of rational functions, and a comparison of maximizers at two parameter values. A general monotone-selection lemma for functions with strictly increasing differences on an interval would be reusable beyond this mission. Proofs of any milestone, and alternative arguments for the goal that avoid the interior/corner case split, are welcome.

Selected references

  • V. Denicolò and F. Panunzi, Common Ownership, Competition, and Corporate Governance, ECGI Finance Working Paper 927/2023, July 24, 2023. https://ssrn.com/abstract=4523644 ; Management Science, 2025. https://doi.org/10.1287/mnsc.2023.03467
  • J. Azar, M. C. Schmalz and I. Tecu, Anticompetitive Effects of Common Ownership, Journal of Finance 73(4), 1513–1565, 2018. https://doi.org/10.1111/jofi.12698
  • M. C. Schmalz, Recent Studies on Common Ownership, Firm Behavior, and Market Outcomes, Antitrust Bulletin 66(1), 12–38, 2021. https://doi.org/10.1177/0003603X20985804
13 thms2 active usersReviewed
EconomicsMechanism DesignOperations Research·Captain: mikedeng1

Selling Data to Marketers 2: In Selling Data Appends with Costs Below the Prior Mean, the High-Cost Plan Is Efficient and the Low-Cost Plan Carries Less Information If φ < 1/2 and More If φ > 1/2Research Paper

Motivation

Data brokers sell information about consumers to firms that decide whom to target: a lender deciding whom to offer credit, a retailer deciding whom to mail. Two products dominate this market. A marketing list sells contact information together with an analysis, so that a firm cannot reach the consumer at all without buying. A data append adds information about consumers the firm already knows, so that the firm can act even without buying. Liang Guo's Selling Data to Marketers (Management Science, doi:10.1287/mnsc.2023.01350) studies how a monopoly data seller should design a menu of data products when the buyers' targeting costs are private, and shows that the answer differs sharply between the two products.

This mission formalizes the data-append result in the paper's base model with a binary targeting value: Proposition 3 (p. 13 of the author's manuscript). The companion missions of the series cover marketing lists and the general model with a rotation-ordered family of posterior distributions.

Setting

A marketer can take an action at cost c>0c>0c>0. The action yields a value u∈{u‾,uˉ}u\in\{\underline u,\bar u\}u∈{u​,uˉ}, with u=uˉu=\bar uu=uˉ with prior probability φ∈(0,1)\varphi\in(0,1)φ∈(0,1), so the prior mean is u^=φuˉ+(1−φ)u‾\hat u=\varphi\bar u+(1-\varphi)\underline uu^=φuˉ+(1−φ)u​. Not acting yields 000.

The seller can produce a signal w∈{wh,wl}w\in\{w_h,w_l\}w∈{wh​,wl​} with Pr⁡(wh∣uˉ)=Pr⁡(wl∣u‾)=α\Pr(w_h\mid\bar u)=\Pr(w_l\mid\underline u)=\alphaPr(wh​∣uˉ)=Pr(wl​∣u​)=α, where the informativeness α\alphaα is chosen from [α‾,αˉ]⊂(1/2,1)[\underline\alpha,\bar\alpha]\subset(1/2,1)[α​,αˉ]⊂(1/2,1). The signal probabilities are σh(α)=φα+(1−φ)(1−α)\sigma_h(\alpha)=\varphi\alpha+(1-\varphi)(1-\alpha)σh​(α)=φα+(1−φ)(1−α) and σl(α)=1−σh(α)\sigma_l(\alpha)=1-\sigma_h(\alpha)σl​(α)=1−σh​(α), and the posterior means after whw_hwh​ and wlw_lwl​ are vh(α)v_h(\alpha)vh​(α) and vl(α)v_l(\alpha)vl​(α), computed by Bayes' rule. The standing assumption vl(α‾)<c<vh(α‾)v_l(\underline\alpha)<c<v_h(\underline\alpha)vl​(α​)<c<vh​(α​) makes acting worthwhile exactly after the high signal, so a marketer of cost ccc values information α\alphaα at σh(α)[vh(α)−c]\sigma_h(\alpha)[v_h(\alpha)-c]σh​(α)[vh​(α)−c]. Serving a marketer with informativeness α\alphaα costs the seller k(α)k(\alpha)k(α), with k(α‾)=0k(\underline\alpha)=0k(α​)=0 and kkk increasing.

Marketers have cost cHc_HcH​ with probability θ\thetaθ and cL<cHc_L<c_HcL​<cH​ with probability 1−θ1-\theta1−θ, privately known. The seller offers a menu of two plans (TH,αH)(T_H,\alpha_H)(TH​,αH​) and (TL,αL)(T_L,\alpha_L)(TL​,αL​) with fees Tj≥0T_j\ge0Tj​≥0. Type iii's payoff from plan jjj is

Uij=−Tj+σh(αj)[vh(αj)−ci].U_{ij}=-T_j+\sigma_h(\alpha_j)[v_h(\alpha_j)-c_i].Uij​=−Tj​+σh​(αj​)[vh​(αj​)−ci​].

With data appends, a marketer who buys nothing can still act on the prior, so its outside option is Ui0=max⁡{u^−ci,0}U_{i0}=\max\{\hat u-c_i,0\}Ui0​=max{u^−ci​,0}. The seller maximizes Π=∑iθi[Ti−k(αi)]\Pi=\sum_i\theta_i[T_i-k(\alpha_i)]Π=∑i​θi​[Ti​−k(αi​)] subject to Uii≥Ui0U_{ii}\ge U_{i0}Uii​≥Ui0​ (IRiIR_iIRi​) and Uii≥Uii′U_{ii}\ge U_{ii'}Uii​≥Uii′​ (ICi,i′IC_{i,i'}ICi,i′​). An optimal menu solves this problem; its informativeness levels are αH∗,αL∗\alpha_H^*,\alpha_L^*αH∗​,αL∗​.

The benchmark is the seller's problem when costs are observable: for each type it maximizes Πi=θi[σh(α)[vh(α)−ci]−k(α)]\Pi_i=\theta_i[\sigma_h(\alpha)[v_h(\alpha)-c_i]-k(\alpha)]Πi​=θi​[σh​(α)[vh​(α)−ci​]−k(α)] over [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ]. Any maximizer is an efficient informativeness αie\alpha_i^eαie​.

Formalization targets

Goal: Proposition 3 (p. 13)

When cL<cH<u^c_L<c_H<\hat ucL​<cH​<u^:

{αH∗}={αHe},φ<12 ⇒ αL∗<αLe,φ>12 ⇒ αL∗>αLe.\{\alpha_H^*\}=\{\alpha_H^e\},\qquad \varphi<\tfrac12\ \Rightarrow\ \alpha_L^*<\alpha_L^e,\qquad \varphi>\tfrac12\ \Rightarrow\ \alpha_L^*>\alpha_L^e .{αH∗​}={αHe​},φ<21​ ⇒ αL∗​<αLe​,φ>21​ ⇒ αL∗​>αLe​.

The first claim is an equality of sets: the high-cost informativeness levels of optimal menus are exactly the efficient ones at cHc_HcH​. The inequalities hold for every optimal menu and every efficient αLe\alpha_L^eαLe​.

Milestones

  1. Willingness to pay (§3.2, p. 13): for cL<cH<u^c_L<c_H<\hat ucL​<cH​<u^, Uij−Ui0=−Tj+σl(αj)[ci−vl(αj)]U_{ij}-U_{i0}=-T_j+\sigma_l(\alpha_j)[c_i-v_l(\alpha_j)]Uij​−Ui0​=−Tj​+σl​(αj​)[ci​−vl​(αj​)], which is increasing in cic_ici​.
  2. Reduction (8) (p. 13): with IRLIR_LIRL​ and ICH,LIC_{H,L}ICH,L​ binding, the problem becomes the maximization over (αH,αL)(\alpha_H,\alpha_L)(αH​,αL​) of
θ[σh(αH)[vh(αH)−cH]−σh(αL)(cL−cH)−k(αH)]+(1−θ)[σh(αL)[vh(αL)−cL]−k(αL)]−u^+cL.\theta\big[\sigma_h(\alpha_H)[v_h(\alpha_H)-c_H]-\sigma_h(\alpha_L)(c_L-c_H)-k(\alpha_H)\big]+(1-\theta)\big[\sigma_h(\alpha_L)[v_h(\alpha_L)-c_L]-k(\alpha_L)\big]-\hat u+c_L .θ[σh​(αH​)[vh​(αH​)−cH​]−σh​(αL​)(cL​−cH​)−k(αH​)]+(1−θ)[σh​(αL​)[vh​(αL​)−cL​]−k(αL​)]−u^+cL​.
  1. The αL\alpha_LαL​-derivatives (proof of Proposition 3, p. 32): the benchmark derivative (1−θ)[φ(uˉ−cL)−(1−φ)(u‾−cL)−k′(αL)](1-\theta)[\varphi(\bar u-c_L)-(1-\varphi)(\underline u-c_L)-k'(\alpha_L)](1−θ)[φ(uˉ−cL​)−(1−φ)(u​−cL​)−k′(αL​)] and the derivative of (8), which adds θ(1−2φ)(cL−cH)\theta(1-2\varphi)(c_L-c_H)θ(1−2φ)(cL​−cH​).

Significance

The result says that a data seller's distortion depends on the product's form. With marketing lists the low-cost marketers are the high type, their plan is efficient, and the high-cost plan is distorted (Proposition 2, p. 11). With data appends and costs below the prior mean, the outside option u^−ci\hat u-c_iu^−ci​ falls with cic_ici​ faster than the value of information does, so high-cost marketers have the larger willingness to pay. The roles of the types switch, the low-cost plan is distorted, and the direction of the distortion is reversed, giving the paper's "double mirror image" (p. 13). The direction is set by the skewness of the prior through the sign of 1−2φ1-2\varphi1−2φ, not by an assumed single-crossing condition.

The result is proved in the paper, in an appendix argument of a few lines that invokes Topkis's monotonicity theorem. To our knowledge it has no machine-checked proof. Formalizing it makes explicit what the printed proof leaves to the reader: that the constraints dropped in (8) hold at its optimum, that the efficient and optimal informativeness need not be unique, and which regularity of kkk the strict inequalities need.

Difficulty

The obvious argument substitutes the binding constraints, compares first-order conditions, and invokes Topkis's theorem. Three steps of it are not automatic. First, the reduction drops IRHIR_HIRH​, ICL,HIC_{L,H}ICL,H​ and the nonnegativity of fees; these must be shown to hold at every maximizer of (8), and ICL,HIC_{L,H}ICL,H​ holds only because the maximizers of (8) are ordered in the right direction, which is itself a comparative-statics fact. Second, the reduction identifies the optimal menus only if (8) attains its maximum. Third, Topkis's theorem yields only weak inequalities, αL∗≤αLe\alpha_L^*\le\alpha_L^eαL∗​≤αLe​; strictness needs the efficient informativeness to be interior and kkk to be differentiable there, which footnote 5 (p. 7) supplies. Without it, both optima can sit at the same corner α‾\underline\alphaα​ or αˉ\bar\alphaαˉ.

Formalization scope

Everything is stated over R\mathbb RR in the sub-namespace SellingData.AppendsBinary. The two types form an inductive type CostType with constructors H and L. A Model structure holds u‾<uˉ\underline u<\bar uu​<uˉ, φ∈(0,1)\varphi\in(0,1)φ∈(0,1), 1/2<α‾<αˉ<11/2<\underline\alpha<\bar\alpha<11/2<α​<αˉ<1, θ∈(0,1)\theta\in(0,1)θ∈(0,1), 0<cL<cH0<c_L<c_H0<cL​<cH​, k(α‾)=0k(\underline\alpha)=0k(α​)=0, kkk weakly increasing on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ], and the standing assumption vl(α‾)<ci<vh(α‾)v_l(\underline\alpha)<c_i<v_h(\underline\alpha)vl​(α​)<ci​<vh​(α​) for both costs. The posteriors are defined with the divisions of the paper's (2). The outside option is the printed max⁡{u^−ci,0}\max\{\hat u-c_i,0\}max{u^−ci​,0}.

Optimality and efficiency are predicates on maximizers, never a chosen maximizer. The optimal menu is defined from the data-append screening problem itself; defining it through (8) would make the first claim of the goal trivial and is ruled out. The goal additionally assumes the part of footnote 5 that the strict inequalities need: kkk continuous on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ], differentiable on (α‾,αˉ)(\underline\alpha,\bar\alpha)(α​,αˉ), right derivative 000 at α‾\underline\alphaα​, and k′(α)→+∞k'(\alpha)\to+\inftyk′(α)→+∞ as α→αˉ−\alpha\to\bar\alpha^-α→αˉ−. Convexity and twice differentiability, which the footnote also lists, are not assumed. The milestones carry only what they need: none for the willingness to pay, continuity of kkk for one part of the reduction, and differentiability at the point for the derivative.

A complete development needs Bayes posteriors for a symmetric binary signal, elementary calculus (derivatives, the mean value theorem, extrema on compact intervals), and Topkis's monotonicity theorem, which is on the platform (Theorem 2.8.4) and is referenced by this mission. Proofs of the milestones and of the goal are welcome. Lemmas on the binary-signal posteriors (for instance the identity σh(α)vh(α)+σl(α)vl(α)=u^\sigma_h(\alpha)v_h(\alpha)+\sigma_l(\alpha)v_l(\alpha)=\hat uσh​(α)vh​(α)+σl​(α)vl​(α)=u^) are reusable by the companion mission on marketing lists.

Selected references

  • Liang Guo, Selling Data to Marketers, Management Science, 2025, author's manuscript. doi:10.1287/mnsc.2023.01350
  • Donald M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. doi:10.1515/9781400822539
7 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Third-Degree Price Discrimination in Two-Sided Markets: Seller-Side Discrimination Raises Platform Profit, Buyer and Low-Type Seller Surplus and Total Welfare; High-Type Sellers Gain iff b > b̂Research Paper

Price discrimination when demand has network effects

Third-degree price discrimination means charging different prices to identifiable groups of customers. Its welfare effects are a classical question in industrial organization. With linear demands and every market served under uniform pricing, discrimination leaves total output unchanged and lowers total welfare (Pigou 1920). More generally, welfare can rise only if total output rises (Schmalensee 1981; Varian 1985).

Many current markets are two-sided platforms: marketplaces, app stores and payment networks that charge sellers participation fees and differentiate those fees by seller category (for instance, app stores charging games and non-games differently). On such a platform, a seller's presence is worth something to the buyers on the other side. De Cornière, Mantovani and Shekhar (Management Science 71(4), 2025) show that this cross-side benefit overturns the classical conclusion: discriminating between seller types raises seller participation, which attracts more buyers, which raises seller participation further. In their linear model, total welfare rises, and for large enough cross-side benefits every group gains.

The baseline model

A monopoly platform serves a mass one of buyers and two categories of sellers, LLL and HHH, each of mass one.

  • A buyer obtains a stand-alone value vvv from the platform and a benefit bbb for each seller on it.
  • A seller of type j∈{L,H}j\in\{L,H\}j∈{L,H} earns θj\theta_jθj​ per buyer on the platform, with θH>θL>0\theta_H>\theta_L>0θH​>θL​>0.
  • All agents have outside options uniform on [0,1][0,1][0,1]. With NBN_BNB​ buyers, the type-jjj seller demand at fee fjf_jfj​ is θjNB−fj\theta_jN_B-f_jθj​NB​−fj​. With NSN_SNS​ sellers, the buyer demand at price ppp is v+bNS−pv+bN_S-pv+bNS​−p.

The platform chooses participation levels, and the fees follow from the inverse demands.

Uniform pricing (fL=fHf_L=f_HfL​=fH​). The platform chooses (NB,NS)(N_B,N_S)(NB​,NS​) to maximize

ΠU(NB,NS)=NB (v+bNS−NB)+NS (θL+θH)NB−NS2.\Pi^U(N_B,N_S)=N_B\,(v+bN_S-N_B)+N_S\,\frac{(\theta_L+\theta_H)N_B-N_S}{2}.ΠU(NB​,NS​)=NB​(v+bNS​−NB​)+NS​2(θL​+θH​)NB​−NS​​.

At the common fee fUf^UfU, type-jjj participation is NjU=θjNB−fUN^U_j=\theta_jN_B-f^UNjU​=θj​NB​−fU.

Price discrimination. The platform chooses (NB,NL,NH)(N_B,N_L,N_H)(NB​,NL​,NH​) to maximize

ΠD(NB,NL,NH)=NB(v+b(NL+NH)−NB)+NL(θLNB−NL)+NH(θHNB−NH).\Pi^D(N_B,N_L,N_H)=N_B\big(v+b(N_L+N_H)-N_B\big)+N_L(\theta_LN_B-N_L)+N_H(\theta_HN_B-N_H).ΠD(NB​,NL​,NH​)=NB​(v+b(NL​+NH​)−NB​)+NL​(θL​NB​−NL​)+NH​(θH​NB​−NH​).

The participant with outside option kkk joins when its net value exceeds kkk. Buyer surplus CSCSCS and type-jjj seller surplus DSjDS_jDSj​ are therefore integrals over kkk from 000 to the participation level of (net value − k-\,k−k). Total welfare is SW=CS+Π+DSL+DSHSW=CS+\Pi+DS_L+DS_HSW=CS+Π+DSL​+DSH​.

Assumption 1 (p. 3343) restricts the parameters: (i) 0<v<4−(b+θL)2−(b+θH)20<v<4-(b+\theta_L)^2-(b+\theta_H)^20<v<4−(b+θL​)2−(b+θH​)2; (ii) (θH−3θL)/2<b(\theta_H-3\theta_L)/2<b(θH​−3θL​)/2<b.

Two denominators recur: U=8−(2b+θH+θL)2U=8-(2b+\theta_H+\theta_L)^2U=8−(2b+θH​+θL​)2 and D=4−2b2−θH2−θL2−2b(θH+θL)D=4-2b^2-\theta_H^2-\theta_L^2-2b(\theta_H+\theta_L)D=4−2b2−θH2​−θL2​−2b(θH​+θL​).

Formalization targets

Goal: Proposition 2 (p. 3346)

Under θH>θL>0\theta_H>\theta_L>0θH​>θL​>0, b>0b>0b>0 and Assumption 1, both optimization problems have a solution, and for every uniform optimum and every discrimination optimum:

ΠU<ΠD,CSU<CSD,DSLU<DSLD,SWU<SWD,\Pi^U<\Pi^D,\qquad CS^U<CS^D,\qquad DS^U_L<DS^D_L,\qquad SW^U<SW^D,ΠU<ΠD,CSU<CSD,DSLU​<DSLD​,SWU<SWD, DSHU<DSHD  ⟺  b>b^(θH,θL)=32−7(θH−θL)2−3θH−θL4.DS^U_H<DS^D_H\iff b>\hat b(\theta_H,\theta_L)=\frac{\sqrt{32-7(\theta_H-\theta_L)^2}-3\theta_H-\theta_L}{4}.DSHU​<DSHD​⟺b>b^(θH​,θL​)=432−7(θH​−θL​)2​−3θH​−θL​​.

When b>b^b>\hat bb>b^, all four groups (platform, buyers, low-type sellers and high-type sellers) are strictly better off: a strict Pareto improvement.

Milestones

  1. The uniform optimum, display (12): NBU=4v/UN^U_B=4v/UNBU​=4v/U, NSU=2v(2b+θH+θL)/UN^U_S=2v(2b+\theta_H+\theta_L)/UNSU​=2v(2b+θH​+θL​)/U, ΠU=2v2/U\Pi^U=2v^2/UΠU=2v2/U, with the fees and, from footnote 14, NjUN^U_jNjU​.
  2. The discrimination optimum, (13)–(15): NBD=2v/DN^D_B=2v/DNBD​=2v/D, NjD=v(b+θj)/DN^D_j=v(b+\theta_j)/DNjD​=v(b+θj​)/D, ΠD=v2/D\Pi^D=v^2/DΠD=v2/D, with the fees.
  3. Proposition 1: NBU<NBDN^U_B<N^D_BNBU​<NBD​ and NSU<NLD+NHDN^U_S<N^D_L+N^D_HNSU​<NLD​+NHD​.
  4. The surpluses and welfare at the uniform optimum (A.2.1).
  5. The surpluses and welfare at the discrimination optimum, (A.6)–(A.8).
  6. ΠD−ΠU=v2(θH−θL)2/(DU)>0\Pi^D-\Pi^U=v^2(\theta_H-\theta_L)^2/(DU)>0ΠD−ΠU=v2(θH​−θL​)2/(DU)>0.
  7. DSLD−DSLU>0DS^D_L-DS^U_L>0DSLD​−DSLU​>0.
  8. SWD−SWU=v2(θH−θL)2λ/(2D2U2)SW^D-SW^U=v^2(\theta_H-\theta_L)^2\lambda/(2D^2U^2)SWD−SWU=v2(θH​−θL​)2λ/(2D2U2) for an explicit quartic λ(b,θH,θL)\lambda(b,\theta_H,\theta_L)λ(b,θH​,θL​).
  9. λ>0\lambda>0λ>0 on the parameter region.
  10. DSHD−DSHU>0  ⟺  b>b^DS^D_H-DS^U_H>0\iff b>\hat bDSHD​−DSHU​>0⟺b>b^.

Significance

The result. Proposition 2 is a counterpoint to the Pigouvian benchmark. In a two-sided market with linear demands, seller-side discrimination can be a strict Pareto improvement, so a blanket presumption against fee differentiation by platforms is not justified on welfare grounds. The comparison also isolates the mechanism. The low-type sellers gain even though the platform could already serve them, and the high types gain only when the buyer-side benefit bbb is large enough. The paper's extensions in §5 (seller-type-dependent buyer benefits, ad valorem fees, competition) start from this baseline.

Formalizing it. The paper proves Proposition 2 by explicit algebra in Appendix A.2. Most of that algebra is printed, but the positivity of λ\lambdaλ is argued only through claims about the roots of a quartic in bbb, which are asserted rather than shown. No part of the argument is machine-checked. A formalization would give:

  • a certified positivity proof for λ\lambdaλ;
  • verified closed forms for both optima, with existence and uniqueness of the maximizers;
  • corrected versions of several printed displays (see the scope section).

The model is a small, self-contained template for platform pricing with linear demands, and the same definitions can serve later comparisons (fees, prices, exclusion).

Difficulty

The optimization steps are routine: both objectives are concave quadratics, strictly concave exactly when U>0U>0U>0 and D>0D>0D>0, and Assumption 1(i) gives D>v>0D>v>0D>v>0. The integrals have affine integrands. The comparison steps are where the work is.

  • λ>0\lambda>0λ>0. λ\lambdaλ is a quartic in three variables that must be shown positive on a region cut out by D>0D>0D>0, b>0b>0b>0, 0<θL<θH0<\theta_L<\theta_H0<θL​<θH​ and condition (ii). Its minimum over the region is small (numerically about 0.020.020.02, approached near the boundary D=0D=0D=0), so crude bounds fail. The paper's argument ("only one positive root bsolb^{sol}bsol", "bsolb^{sol}bsol greater than bˉ\bar bbˉ") is not a proof.
  • The b^\hat bb^ equivalence. It compares two rational functions with different denominators D2D^2D2 and U2U^2U2. It reduces to the sign of (b+θH)U−(2b+3θH−θL)D(b+\theta_H)U-(2b+3\theta_H-\theta_L)D(b+θH​)U−(2b+3θH​−θL​)D on the region, which must be tied to the root b^\hat bb^ of a quadratic.
  • Proposition 1 is a comparison of explicit rational functions under the same region constraints. The paper argues it through best-response curves instead (App. A.1).

Formalization scope

  • Representation. Parameters are real numbers v,b,θH,θLv,b,\theta_H,\theta_Lv,b,θH​,θL​. A uniform allocation is (NB,NS)∈R2(N_B,N_S)\in\mathbb R^2(NB​,NS​)∈R2, a discriminatory one (NB,NL,NH)∈R3(N_B,N_L,N_H)\in\mathbb R^3(NB​,NL​,NH​)∈R3 (low type before high type).
  • Equilibrium means a global maximizer of ΠU\Pi^UΠU (resp. ΠD\Pi^DΠD) over all real participation levels, the object the first-order conditions (7)–(11) solve. No [0,1][0,1][0,1] box is imposed.
  • Surpluses are Lean interval integrals at an arbitrary allocation. Uniform-regime seller participation by type is the demand at the common fee.
  • Standing assumptions and pins.
    • θH>θL>0\theta_H>\theta_L>0θH​>θL​>0 is §3.1's assumption.
    • b>0b>0b>0 is the standing assumption of §3.2 and footnote 10.
    • Assumption 1 is used as printed. The paper's bound bˉ\bar bbˉ (p. 3344) corresponds to 2v<4−(b+θL)2−(b+θH)22v<4-(b+\theta_L)^2-(b+\theta_H)^22v<4−(b+θL​)2−(b+θH​)2, the condition for interior buyer participation NBD=2v/D<1N^D_B=2v/D<1NBD​=2v/D<1. Under the printed v<…v<\dotsv<…, participation can exceed one, so the mission does not pose §3.4's claim that all participation levels are interior. Every comparison in the goal holds over the printed region.
  • Printed slips, corrected in the Lean and disclosed.
    • The ΠD−ΠU\Pi^D-\Pi^UΠD−ΠU denominator prints 2b(θH−θL)2b(\theta_H-\theta_L)2b(θH​−θL​) where DDD has 2b(θH+θL)2b(\theta_H+\theta_L)2b(θH​+θL​).
    • The SWD−SWUSW^D-SW^USWD−SWU denominator prints θl\theta_lθl​ for θL\theta_LθL​.
    • The DSLDS_LDSL​ and DSHDS_HDSH​ difference displays swap their two fractions.
    • "∑i=1,2DSj\sum_{i=1,2}DS_j∑i=1,2​DSj​" means DSL+DSHDS_L+DS_HDSL​+DSH​.
  • Ruled-out formalizations. The optima are not defined by their closed forms, the surpluses are not defined by their final expressions, and the goal and the equilibrium milestones assert existence of the maximizers, so the universally quantified comparisons are not vacuous. Uniform-regime seller participation is split by demand, never as NS/2N_S/2NS​/2.
  • Not posed. Propositions 3–9, Lemma 1, §4.4 and §5 are not part of this mission. Propositions 3–5 need box-constrained or corner models, and the proofs for §5 are in an Online Appendix.
  • Infrastructure. Maximizers of strictly concave quadratics on Rn\mathbb R^nRn, integrals of affine functions, and polynomial positivity certificates (SOS or case splits) on semialgebraic regions. A clean lemma that a negative-definite quadratic form plus a linear term has a unique maximizer given by its first-order conditions would be reusable well beyond this mission. Contributions toward any milestone, and alternative proofs of λ>0\lambda>0λ>0, are welcome.

Selected references

  • A. de Cornière, A. Mantovani, S. Shekhar, Third-Degree Price Discrimination in Two-Sided Markets, Management Science 71(4):3340–3356, 2025. doi:10.1287/mnsc.2023.02788
  • A. C. Pigou, The Economics of Welfare, Macmillan, London, 1920.
  • R. Schmalensee, Output and Welfare Implications of Monopolistic Third-Degree Price Discrimination, American Economic Review 71(1):242–247, 1981.
  • H. R. Varian, Price Discrimination and Social Welfare, American Economic Review 75(4):870–875, 1985.
  • M. Armstrong, Competition in Two-Sided Markets, RAND Journal of Economics 37(3):668–691, 2006. doi:10.1111/j.1756-2171.2006.tb00037.x
12 thms2 active usersReviewed
EconomicsMechanism DesignOperations Research·Captain: mikedeng1

Selling Data to Marketers 1: In Selling Marketing Lists, the Low-Cost Plan Is Efficient and the High-Cost Plan Carries More Information Than the Benchmark If φ < 1/2 and Less If φ > 1/2Research Paper

Why sell information to marketers

Data brokers such as Acxiom, Nielsen and Oracle, and data generators such as Google and Facebook, sell processed consumer data to firms that use it to decide whom to target, whom to lend to, or which market to enter. The U.S. Federal Trade Commission's 2014 report on data brokers distinguishes two products: a marketing list, which carries contact information without which the buyer cannot act at all, and a data append, which enriches data the buyer already holds. Liang Guo's Selling Data to Marketers (Management Science, doi:10.1287/mnsc.2023.01350) asks how a seller should design a menu of data products of different informativeness when buyers differ in a privately known cost of acting.

The question belongs to the theory of optimal screening (Mussa and Rosen 1978; Maskin and Riley 1984), but with a twist: the buyer's marginal value of information is not a primitive. It is derived from the buyer's decision problem, so the direction of the single-crossing condition is itself an outcome of the model. This mission formalizes the paper's analysis of marketing lists in the base model with a binary value.

Setting

A marketer can take an action (target a consumer) at cost c>0c>0c>0. The action's value uuu is uˉ\bar uuˉ with prior probability ϕ∈(0,1)\phi\in(0,1)ϕ∈(0,1) and u‾<uˉ\underline u<\bar uu​<uˉ otherwise. The seller can provide a binary signal w∈{wh,wl}w\in\{w_h,w_l\}w∈{wh​,wl​} with Pr⁡(wh∣uˉ)=Pr⁡(wl∣u‾)=α\Pr(w_h\mid\bar u)=\Pr(w_l\mid\underline u)=\alphaPr(wh​∣uˉ)=Pr(wl​∣u​)=α, where the informativeness α\alphaα lies in an interval [α‾,αˉ]⊂(1/2,1)[\underline\alpha,\bar\alpha]\subset(1/2,1)[α​,αˉ]⊂(1/2,1). The probability of the optimistic signal is σh(α)=ϕα+(1−ϕ)(1−α)\sigma_h(\alpha)=\phi\alpha+(1-\phi)(1-\alpha)σh​(α)=ϕα+(1−ϕ)(1−α), the posterior probability of uˉ\bar uuˉ after it is ϕh(α)=ϕα/σh(α)\phi_h(\alpha)=\phi\alpha/\sigma_h(\alpha)ϕh​(α)=ϕα/σh​(α), and the posterior mean is vh(α)=ϕh(α)uˉ+[1−ϕh(α)]u‾v_h(\alpha)=\phi_h(\alpha)\bar u+[1-\phi_h(\alpha)]\underline uvh​(α)=ϕh​(α)uˉ+[1−ϕh​(α)]u​; σl,ϕl,vl\sigma_l,\phi_l,v_lσl​,ϕl​,vl​ are defined symmetrically. The paper assumes vl(α‾)<c<vh(α‾)v_l(\underline\alpha)<c<v_h(\underline\alpha)vl​(α​)<c<vh​(α​), so a marketer acts exactly after whw_hwh​, and a marketer with cost ccc who pays TTT for a signal of informativeness α\alphaα gets

U=−T+σh(α)[vh(α)−c].U=-T+\sigma_h(\alpha)[v_h(\alpha)-c].U=−T+σh​(α)[vh​(α)−c].

Serving a marketer at informativeness α\alphaα costs the seller k(α)k(\alpha)k(α), with k(α‾)=0k(\underline\alpha)=0k(α​)=0 and kkk increasing.

There are two cost types, cH>cL>0c_H>c_L>0cH​>cL​>0, with Pr⁡(H)=θ∈(0,1)\Pr(H)=\theta\in(0,1)Pr(H)=θ∈(0,1); write θH=θ\theta_H=\thetaθH​=θ, θL=1−θ\theta_L=1-\thetaθL​=1−θ. Under the benchmark with observable cost, the seller extracts all surplus and chooses α\alphaα to maximize

Πi(α)=θi[σh(α)[vh(α)−ci]−k(α)],\Pi_i(\alpha)=\theta_i\big[\sigma_h(\alpha)[v_h(\alpha)-c_i]-k(\alpha)\big],Πi​(α)=θi​[σh​(α)[vh​(α)−ci​]−k(α)],

whose maximizers are the efficient levels αie\alpha^e_iαie​. With private costs the seller offers a menu (TH,αH),(TL,αL)(T_H,\alpha_H),(T_L,\alpha_L)(TH​,αH​),(TL​,αL​) with Tj≥0T_j\ge0Tj​≥0 and maximizes Π=∑iθi[Ti−k(αi)]\Pi=\sum_i\theta_i[T_i-k(\alpha_i)]Π=∑i​θi​[Ti​−k(αi​)] subject to individual rationality Uii≥0U_{ii}\ge0Uii​≥0 and incentive compatibility Uii≥Uii′U_{ii}\ge U_{ii'}Uii​≥Uii′​, where Uij=−Tj+σh(αj)[vh(αj)−ci]U_{ij}=-T_j+\sigma_h(\alpha_j)[v_h(\alpha_j)-c_i]Uij​=−Tj​+σh​(αj​)[vh​(αj​)−ci​]. This is problem (6); its solutions are the optimal menus, with informativeness levels αH∗,αL∗\alpha^*_H,\alpha^*_LαH∗​,αL∗​.

Formalization targets

Goal: Proposition 2

Under the regularity of kkk described below,

αL∗=αLe,αH∗>αHe  if ϕ<12,αH∗<αHe  if ϕ>12.\alpha^*_L=\alpha^e_L,\qquad \alpha^*_H>\alpha^e_H\ \text{ if }\phi<\tfrac12,\qquad \alpha^*_H<\alpha^e_H\ \text{ if }\phi>\tfrac12.αL∗​=αLe​,αH∗​>αHe​  if ϕ<21​,αH∗​<αHe​  if ϕ>21​.

The first claim is an equality of sets of maximizers; the inequalities compare every optimal menu with every efficient level.

Milestones

  1. The derivative of the benchmark profit: ∂Πi/∂αi=θi[ϕ(uˉ−ci)−(1−ϕ)(u‾−ci)−k′(αi)]\partial\Pi_i/\partial\alpha_i=\theta_i[\phi(\bar u-c_i)-(1-\phi)(\underline u-c_i)-k'(\alpha_i)]∂Πi​/∂αi​=θi​[ϕ(uˉ−ci​)−(1−ϕ)(u​−ci​)−k′(αi​)].
  2. The cross derivative ∂2Πi/∂αi∂ci=θi(1−2ϕ)\partial^2\Pi_i/\partial\alpha_i\partial c_i=\theta_i(1-2\phi)∂2Πi​/∂αi​∂ci​=θi​(1−2ϕ), stated as a mixed second difference.
  3. Proposition 1: αie\alpha^e_iαie​ increases with cic_ici​ if ϕ<1/2\phi<1/2ϕ<1/2 and decreases if ϕ>1/2\phi>1/2ϕ>1/2.
  4. The reduction of (6) to the problem in (αH,αL)(\alpha_H,\alpha_L)(αH​,αL​) alone,
max⁡αH,αL θ[σh(αH)[vh(αH)−cH]−k(αH)]+(1−θ)[σh(αL)[vh(αL)−cL]−σh(αH)(cH−cL)−k(αL)],(7)\max_{\alpha_H,\alpha_L}\ \theta\big[\sigma_h(\alpha_H)[v_h(\alpha_H)-c_H]-k(\alpha_H)\big]+(1-\theta)\big[\sigma_h(\alpha_L)[v_h(\alpha_L)-c_L]-\sigma_h(\alpha_H)(c_H-c_L)-k(\alpha_L)\big],\qquad(7)αH​,αL​max​ θ[σh​(αH​)[vh​(αH​)−cH​]−k(αH​)]+(1−θ)[σh​(αL​)[vh​(αL​)−cL​]−σh​(αH​)(cH​−cL​)−k(αL​)],(7)

obtained by making IRH_HH​ and ICL,H_{L,H}L,H​ bind. 5. The derivative of (7) in αH\alpha_HαH​: θ[ϕ(uˉ−cH)−(1−ϕ)(u‾−cH)−k′(αH)]+(1−θ)(1−2ϕ)(cH−cL)\theta[\phi(\bar u-c_H)-(1-\phi)(\underline u-c_H)-k'(\alpha_H)]+(1-\theta)(1-2\phi)(c_H-c_L)θ[ϕ(uˉ−cH​)−(1−ϕ)(u​−cH​)−k′(αH​)]+(1−θ)(1−2ϕ)(cH​−cL​).

Significance

In textbook screening the low type's allocation is distorted downward to reduce the high type's rent. Here the low type of the screening problem is the high-cost marketer, and its information can be distorted in either direction: the rent σh(αH)(cH−cL)\sigma_h(\alpha_H)(c_H-c_L)σh​(αH​)(cH​−cL​) conceded to low-cost marketers falls with αH\alpha_HαH​ when ϕ<1/2\phi<1/2ϕ<1/2 and rises when ϕ>1/2\phi>1/2ϕ>1/2. Proposition 2 therefore says that a seller of marketing lists may supply socially excessive information to some buyers, a possibility absent from the data-appends literature the paper compares against, where provision can only be insufficient. Proposition 1 isolates the mechanism: the prior decides whether information mainly prevents wasteful targeting or restores profitable targeting, and the cost of acting amplifies one or the other.

The result is proved in the paper; nothing in it has been machine-checked. The mission produces a checked version of the two-type screening reduction (including the verification that the constraints dropped in (7) hold at its solutions, which the paper asserts as standard) and of the comparative statics with set-valued optima, since kkk is not assumed convex and optima need not be unique.

Difficulty

The derivative computations are routine once σh(α)vh(α)\sigma_h(\alpha)v_h(\alpha)σh​(α)vh​(α) is simplified to ϕαuˉ+(1−ϕ)(1−α)u‾\phi\alpha\bar u+(1-\phi)(1-\alpha)\underline uϕαuˉ+(1−ϕ)(1−α)u​. The work lies elsewhere. First, the reduction: "IR binds for the high-cost type and IC binds for the low-cost type" is the standard heuristic, but at a solution of (7) one still has to check the dropped constraint ICH,L_{H,L}H,L​ and the nonnegativity TL≥0T_L\ge0TL​≥0; both depend on the ordering of αH\alpha_HαH​ and αL\alpha_LαL​ at the optimum, which in turn depends on the sign of 1−2ϕ1-2\phi1−2ϕ. Second, strictness: comparative statics through increasing differences give only weak inequalities between maximizer sets. Upgrading αH∗≥αHe\alpha^*_H\ge\alpha^e_HαH∗​≥αHe​ to αH∗>αHe\alpha^*_H>\alpha^e_HαH∗​>αHe​ requires ruling out a common maximizer, which needs the optimum to be interior and kkk differentiable there; the naive argument by first-order conditions fails at the corners α‾,αˉ\underline\alpha,\bar\alphaα​,αˉ. Third, αL∗=αLe\alpha^*_L=\alpha^e_LαL∗​=αLe​ as sets requires existence of optimal menus, hence attainment of the maximum of (7).

Formalization scope

Everything is over R\mathbb RR. The model is a structure Model (values, prior, informativeness interval, selling cost) extended by Screening (type probability and the two costs); the standing assumptions u‾<uˉ\underline u<\bar uu​<uˉ, 0<ϕ<10<\phi<10<ϕ<1, 1/2<α‾<αˉ<11/2<\underline\alpha<\bar\alpha<11/2<α​<αˉ<1, k(α‾)=0k(\underline\alpha)=0k(α​)=0, kkk increasing on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ] (weakly), 0<θ<10<\theta<10<θ<1, 0<cL<cH0<c_L<c_H0<cL​<cH​, and vl(α‾)<ci<vh(α‾)v_l(\underline\alpha)<c_i<v_h(\underline\alpha)vl​(α​)<ci​<vh​(α​) for both types are fields. The posteriors are defined with the divisions printed in (2). Efficient levels and optimal menus are sets of maximizers, never chosen by Classical.choose or a first-order condition. Menus include Tj≥0T_j\ge0Tj​≥0.

The goal additionally assumes the part of footnote 5 (p. 7) that makes optima interior: kkk continuous on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ], differentiable on (α‾,αˉ)(\underline\alpha,\bar\alpha)(α​,αˉ), with right derivative k′(α‾)=0k'(\underline\alpha)=0k′(α​)=0 and k′(α)→+∞k'(\alpha)\to+\inftyk′(α)→+∞ as α→αˉ−\alpha\to\bar\alpha^-α→αˉ−. Convexity and twice differentiability, also in the footnote, are not assumed. The milestones carry no regularity beyond differentiability at the point considered (milestones 1, 5) and continuity for the optimality characterization in milestone 4.

The optimal menu is a maximizer of (6) under all four constraints, not a maximizer of (7): defining it through (7) would make half of the goal immediate and skip the reduction.

The development needs the algebra of the binary posterior, the two-type screening reduction, and a strict version of monotone comparative statics; Topkis's theorem on strictly increasing differences (Theorem 2.8.4) is already proved on the platform and referenced. Proofs of any milestone, and alternative arguments for the strict inequalities, are welcome.

Selected references

  • L. Guo, Selling Data to Marketers, Management Science, 2025 (author's manuscript). https://doi.org/10.1287/mnsc.2023.01350
  • D. M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. https://doi.org/10.1515/9781400822539
  • M. Mussa and S. Rosen, Monopoly and Product Quality, Journal of Economic Theory 18(2), 1978. https://doi.org/10.1016/0022-0531(78)90085-6
  • E. Maskin and J. Riley, Monopoly with Incomplete Information, RAND Journal of Economics 15(2), 1984. https://doi.org/10.2307/2555674
  • Federal Trade Commission, Data Brokers: A Call for Transparency and Accountability, 2014. https://www.ftc.gov/reports/data-brokers-call-transparency-accountability-report-federal-trade-commission-may-2014
8 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

The Bright Side of the GDPR: Welfare-Improving Privacy Management I: The Equilibrium Price Is Higher After the GDPR for Every Opt-in Benefit and Data RevenueResearch Paper

Motivation

The European Union's General Data Protection Regulation (GDPR, in force since 2018) requires a firm to obtain a consumer's explicit opt-in consent before it collects her personal data. Most of the economic literature reads such consent rules as a cost to data-driven firms. Choe, Matsushima and Shekhar (ISER Discussion Paper No. 1246, Osaka University, June 2024; published in Management Science, 2025, doi:10.1287/mnsc.2024.06653) ask what happens to the price of a digital service when consumers gain the right to buy it without sharing data. Their model is a monopoly with two-dimensional consumer heterogeneity, simple enough to be solved in closed form, and it lets the answer be stated for every value of the firm's opt-in benefit and every mix of usage-based and data-based revenue.

This mission formalizes the paper's general price comparison, Proposition A1: the equilibrium price is higher after the GDPR.

Setting

A monopolist sells an online service at zero marginal cost and price p∈Rp \in \mathbb{R}p∈R. A consumer has a type (v,c)∈[0,1]2(v, c) \in [0,1]^2(v,c)∈[0,1]2, where vvv is her valuation for the service and ccc her privacy cost of sharing data; types are independent and uniform on [0,1]2[0,1]^2[0,1]2, so the mass of a set of consumers is its area. A consumer who shares data receives an opt-in benefit x∈(0,1)x \in (0, 1)x∈(0,1), and the firm earns an exogenous data revenue α≥0\alpha \ge 0α≥0 per unit of shared data.

The utilities of opt-in purchase (buy and share) and opt-out purchase (buy without sharing) are

US(v,c)=v+(x−c)−p,UN(v,c)=v−p.U_S(v,c) = v + (x - c) - p, \qquad U_N(v,c) = v - p.US​(v,c)=v+(x−c)−p,UN​(v,c)=v−p.
  • Before the GDPR opt-out purchase is unavailable. A consumer buys, and shares data, iff US≥0U_S \ge 0US​≥0. The demand D^(p)\widehat D(p)D(p) is the area of {(v,c)∈[0,1]2:c≤v+x−p}\{(v,c) \in [0,1]^2 : c \le v + x - p\}{(v,c)∈[0,1]2:c≤v+x−p}, and the profit is Π^(p)=(p+α)D^(p)\widehat\Pi(p) = (p + \alpha)\widehat D(p)Π(p)=(p+α)D(p).
  • After the GDPR a consumer opts in iff US≥max⁡{UN,0}U_S \ge \max\{U_N, 0\}US​≥max{UN​,0} and opts out iff UN≥max⁡{US,0}U_N \ge \max\{U_S, 0\}UN​≥max{US​,0}. The opt-in set is {c≤v+x−p, c≤x}\{c \le v + x - p,\ c \le x\}{c≤v+x−p, c≤x}, the opt-out set is {v≥p, c>x}\{v \ge p,\ c > x\}{v≥p, c>x}, their areas are D~S(p)\widetilde D_S(p)DS​(p) and D~N(p)\widetilde D_N(p)DN​(p), and the profit is Π~(p)=p (D~S(p)+D~N(p))+α D~S(p)\widetilde\Pi(p) = p\,(\widetilde D_S(p) + \widetilde D_N(p)) + \alpha\,\widetilde D_S(p)Π(p)=p(DS​(p)+DN​(p))+αDS​(p).

The firm chooses the price first and consumers respond, so the equilibrium price in each regime is a maximizer over R\mathbb{R}R of the corresponding profit: p^⋆\hat p^\starp^​⋆ for Π^\widehat\PiΠ and p~⋆\tilde p^\starp~​⋆ for Π~\widetilde\PiΠ. The paper's appendix expresses them through the thresholds

α1(x)=max⁡{1−2x2,0},α2(x)=max⁡{2−4x+x22x,0}\alpha_1(x) = \max\Big\{\tfrac{1-2x}{2}, 0\Big\}, \qquad \alpha_2(x) = \max\Big\{\tfrac{2-4x+x^2}{2x}, 0\Big\}α1​(x)=max{21−2x​,0},α2​(x)=max{2x2−4x+x2​,0}

and the radicals β=6+(x+α−1)2\beta = \sqrt{6 + (x+\alpha-1)^2}β=6+(x+α−1)2​, Γ=6+(2−2x+α)2\Gamma = \sqrt{6 + (2-2x+\alpha)^2}Γ=6+(2−2x+α)2​.

Formalization targets

Goal: Proposition A1 (p. 34)

For every 0<x<10 < x < 10<x<1 and α≥0\alpha \ge 0α≥0, both profits attain a global maximum on R\mathbb{R}R, and every pair of maximizers satisfies

p~⋆>p^⋆.\tilde p^\star > \hat p^\star.p~​⋆>p^​⋆.

Milestones

  1. Display (4) (p. 11): D^(p)=(1+x−p)2/2\widehat D(p) = (1+x-p)^2/2D(p)=(1+x−p)2/2 for x<p<1+xx < p < 1+xx<p<1+x, and 1−(1−x+p)2/21 - (1-x+p)^2/21−(1−x+p)2/2 for x−1≤p≤xx-1 \le p \le xx−1≤p≤x.
  2. Display (5) (p. 14): D~S(p)\widetilde D_S(p)DS​(p) equals (1+x−p)2/2(1+x-p)^2/2(1+x−p)2/2, x2/2+x(1−p)x^2/2 + x(1-p)x2/2+x(1−p) or x−p2/2x - p^2/2x−p2/2 on (1,1+x)(1, 1+x)(1,1+x), (x,1](x, 1](x,1], [0,x][0, x][0,x].
  3. Display (6) (p. 14): D~N(p)=(1−x)(1−p)\widetilde D_N(p) = (1-x)(1-p)DN​(p)=(1−x)(1−p) for 0≤p≤10 \le p \le 10≤p≤1, and 000 for 1<p<1+x1 < p < 1 + x1<p<1+x.
  4. Online Appendix A.1 (OA p. 2): p^\hat pp^​ maximizes Π^\widehat\PiΠ iff p^=(1+x−2α)/3\hat p = (1+x-2\alpha)/3p^​=(1+x−2α)/3 when α<α1(x)\alpha < \alpha_1(x)α<α1​(x) and p^=(2(x−1)−α+β)/3\hat p = (2(x-1) - \alpha + \beta)/3p^​=(2(x−1)−α+β)/3 otherwise.
  5. Online Appendix A.2 (OA p. 4): p~\tilde pp~​ maximizes Π~\widetilde\PiΠ iff p~=(2(1−αx)+x2)/4\tilde p = (2(1-\alpha x) + x^2)/4p~​=(2(1−αx)+x2)/4 when α<α2(x)\alpha < \alpha_2(x)α<α2​(x) and p~=(Γ−(2−2x+α))/3\tilde p = (\Gamma - (2 - 2x + \alpha))/3p~​=(Γ−(2−2x+α))/3 otherwise.
  6. p. 14: α1(x)≤α2(x)\alpha_1(x) \le \alpha_2(x)α1​(x)≤α2​(x) for all x∈(0,1)x \in (0,1)x∈(0,1).
  7. Lemma A3 (pp. 33–34): the three possible pairs of equilibrium regimes (case 1a/2a, 1b/2a, 1b/2b), located by price intervals.
  8. Online Appendix D, first display (OA p. 7): the closed form of p~⋆−p^⋆\tilde p^\star - \hat p^\starp~​⋆−p^​⋆ in each of the three regions.

Significance

The result. Proposition A1 says the price rise is robust: it holds for every opt-in benefit and every revenue model, from a firm that earns nothing from data (α=0\alpha = 0α=0) to one whose data revenue dominates. The paper's welfare results (on demand, profit and consumer surplus) are comparisons of the same two equilibria, and the price comparison is the one among them that holds uniformly; the others change sign with (x,α)(x, \alpha)(x,α) and are established in the paper only numerically. The main text's Proposition 1 is the instance x=1/4x = 1/4x=1/4.

Formalizing it. The paper's proof is a chain of closed-form computations spread over the appendix and online appendix: areas of polygons, the maximization of piecewise cubic profits over all of R\mathbb{R}R, and a sign argument with nested square roots. Several steps are stated as "one can verify", and the online appendix contains printed slips (a derivative written with respect to the wrong variable in §D, a pair of cases listed incorrectly on p. 14). A machine-checked proof turns the chain into a verified one. The milestones isolate the parts that are reusable on their own: the demand formulas (4)–(6) and the closed-form equilibria, on which the paper's companion profit comparison (Proposition A3) also rests. None of these results has been formalized before.

Difficulty

The obvious route, solving the first-order condition on each demand piece, gives candidates, not maximizers. The profits are only piecewise smooth, the pieces meet at p=xp = xp=x and p=1p = 1p=1, and the price ranges over all of R\mathbb{R}R, including negative prices before the GDPR. Showing that the candidate is the unique global maximizer requires comparing values across pieces and controlling the profit outside the paper's displayed price ranges. The comparison step is the second difficulty: in the middle region α1(x)≤α<α2(x)\alpha_1(x) \le \alpha < \alpha_2(x)α1​(x)≤α<α2​(x) the gap (14+4α+3x2−8x−6xα−4β)/12(14 + 4\alpha + 3x^2 - 8x - 6x\alpha - 4\beta)/12(14+4α+3x2−8x−6xα−4β)/12 mixes a polynomial with a square root, and its positivity is not a one-line estimate. The gap tends to 000 as x→1x \to 1x→1, so no uniform margin is available.

Formalization scope

  • Types are pairs q : ℝ × ℝ with q.1 = v, q.2 = c; the type square is Set.Icc 0 1 ×ˢ Set.Icc 0 1, and every demand is (volume S).toReal for the Lebesgue measure on ℝ × ℝ.
  • The after-GDPR sets are copied from p. 13; they send the tie US=UN≥0U_S = U_N \ge 0US​=UN​≥0 to opt-in, which changes only a null set.
  • Profits are functions ℝ → ℝ of the price, and an equilibrium price is IsMaxOn profit Set.univ p. The price is never restricted to the paper's case ranges, and p~⋆≥0\tilde p^\star \ge 0p~​⋆≥0 is a consequence, not an assumption.
  • Standing assumptions on every theorem: 0<x0 < x0<x, x<1x < 1x<1, α≥0\alpha \ge 0α≥0 (pp. 7–8). The data revenue is written α in Lean.
  • "Case 1a/1b/2a/2b equilibrium" means the maximizer lies in (x,1+x)(x, 1+x)(x,1+x), [x−1,x][x-1, x][x−1,x], (x,1+x)(x, 1+x)(x,1+x), [0,x][0, x][0,x] respectively.
  • The thresholds α1,α2\alpha_1, \alpha_2α1​,α2​ and radicals β,Γ\beta, \Gammaβ,Γ are plain definitions with the paper's formulas.

A formalization that compares the two closed-form prices instead of maximizers of the modelled profits, that asserts a property of "every maximizer" without proving one exists, or that restricts prices to a bounded interval, would not state Proposition A1; the goal and the milestones rule all three out. Results of the paper established only numerically (Propositions 2–4, A2, the second and third bullets of A3, A4) are not posed, and neither are the comparative statics of Lemmas A1–A2.

A complete development needs areas of polygons under the Lebesgue measure on R2\mathbb{R}^2R2 (via MeasureTheory.volume_regionBetween or Fubini), elementary calculus on piecewise polynomials, and inequalities with square roots. The demand computations and the global-maximization arguments are reusable for the companion mission on the paper's profit comparison. Contributions of any milestone, or of further intermediate lemmas such as the continuity of the demands in the price, are welcome.

Selected references

  • C. Choe, N. Matsushima, S. Shekhar, The Bright Side of the GDPR: Welfare-Improving Privacy Management, ISER Discussion Paper No. 1246, Osaka University, June 2024 (the version formalized; theorem and page numbers refer to it).
  • C. Choe, N. Matsushima, S. Shekhar, The Bright Side of the GDPR: Welfare-Improving Privacy Management, Management Science, 2025. https://doi.org/10.1287/mnsc.2024.06653
  • Regulation (EU) 2016/679 (General Data Protection Regulation), Official Journal of the European Union L 119, 2016. https://eur-lex.europa.eu/eli/reg/2016/679/oj
10 thms2 active usersReviewed
EconomicsMechanism DesignOperations Research+1·Captain: mikedeng1

Selling Data to Marketers 4: Under the Rotation Order, Data Appends with Costs Below the Prior Mean Serve High-Cost Marketers Efficiently and Under- (Over-) Supply Low-Cost Ones Below (Above) v⁺Research Paper

Motivation

Data brokers sell consumer data to firms that use it to decide whom to target, whom to lend to, or where to open a store. Two kinds of products are common: a marketing list, which supplies contact information without which the buyer cannot act at all, and a data append, which enriches information about consumers the buyer can already reach (Federal Trade Commission, Data Brokers, 2014). A seller who does not know a buyer's cost of acting must screen buyers with a menu of plans that differ in price and in how informative the data are.

Liang Guo's paper Selling Data to Marketers (Management Science, doi:10.1287/mnsc.2023.01350) characterizes the optimal menu, first for a binary-value model (§3) and then for a general information structure ordered by rotation (§4), following Johnson and Myatt (2006). This mission formalizes Proposition 7: data appends under the rotation order. It is the fourth mission of a series built from the same manuscript; the first three cover marketing lists and data appends in the binary model and marketing lists under the rotation order.

Setting

A marketer can take an action (target a consumer) at cost ccc; the action's value uuu is uncertain with prior mean u^\hat uu^. A data service of informativeness α∈[α‾,αˉ]⊂(0,1)\alpha\in[\underline\alpha,\bar\alpha]\subset(0,1)α∈[α​,αˉ]⊂(0,1) produces a signal, and its information is summarized by the posterior mean vvv. For each α\alphaα, vvv has cumulative distribution function H(v,α)H(v,\alpha)H(v,α) on a support [v‾,vˉ][\underline v,\bar v][v​,vˉ], with a strictly positive density h(v,α)h(v,\alpha)h(v,α) and mean u^\hat uu^ for every α\alphaα. The family is rotation ordered: there is a point v+∈(v‾,vˉ)v^+\in(\underline v,\bar v)v+∈(v​,vˉ) with

∂H(v,α)∂α>0 (v<v+),∂H(v,α)∂α<0 (v>v+).\frac{\partial H(v,\alpha)}{\partial\alpha}>0 \ (v<v^+),\qquad \frac{\partial H(v,\alpha)}{\partial\alpha}<0 \ (v>v^+).∂α∂H(v,α)​>0 (v<v+),∂α∂H(v,α)​<0 (v>v+).

A more informative service spreads the posterior mean away from u^\hat uu^.

A service plan (T,α)(T,\alpha)(T,α) charges a fixed fee T≥0T\ge0T≥0. Serving a marketer with informativeness α\alphaα costs the seller k(α)k(\alpha)k(α), with k(α‾)=0k(\underline\alpha)=0k(α​)=0 and kkk increasing. A marketer targets exactly when v>cv>cv>c, so a marketer with cost cic_ici​ who buys (Tj,αj)(T_j,\alpha_j)(Tj​,αj​) earns

Uij=−Tj+∫civˉ(v−ci) dH(v,αj).U_{ij}=-T_j+\int_{c_i}^{\bar v}(v-c_i)\,dH(v,\alpha_j).Uij​=−Tj​+∫ci​vˉ​(v−ci​)dH(v,αj​).

Costs are cHc_HcH​ with probability θ∈(0,1)\theta\in(0,1)θ∈(0,1) and cLc_LcL​ with probability 1−θ1-\theta1−θ, 0<cL<cH0<c_L<c_H0<cL​<cH​. A data-append buyer can act without the data, so its outside option is Ui0=max⁡{u^−ci,0}U_{i0}=\max\{\hat u-c_i,0\}Ui0​=max{u^−ci​,0}.

The seller offers a menu (TH,αH),(TL,αL)(T_H,\alpha_H),(T_L,\alpha_L)(TH​,αH​),(TL​,αL​) and maximizes Π=θ[TH−k(αH)]+(1−θ)[TL−k(αL)]\Pi=\theta[T_H-k(\alpha_H)]+(1-\theta)[T_L-k(\alpha_L)]Π=θ[TH​−k(αH​)]+(1−θ)[TL​−k(αL​)] subject to individual rationality Uii≥Ui0U_{ii}\ge U_{i0}Uii​≥Ui0​ and incentive compatibility Uii≥Uii′U_{ii}\ge U_{ii'}Uii​≥Uii′​ for both types. Call any maximizer an optimal menu, with levels αH∗,αL∗\alpha^*_H,\alpha^*_LαH∗​,αL∗​. The benchmark with observable costs is

max⁡α∈[α‾,αˉ] θi[∫civˉ(v−ci) dH(v,α)−k(α)],\max_{\alpha\in[\underline\alpha,\bar\alpha]}\ \theta_i\Big[\int_{c_i}^{\bar v}(v-c_i)\,dH(v,\alpha)-k(\alpha)\Big],α∈[α​,αˉ]max​ θi​[∫ci​vˉ​(v−ci​)dH(v,α)−k(α)],

and its maximizers are the efficient levels αie\alpha^e_iαie​.

Formalization targets

Goal: Proposition 7

Assume cL<cH<u^c_L<c_H<\hat ucL​<cH​<u^. If cL<cH<v+c_L<c_H<v^+cL​<cH​<v+, then

αH∗=αHe,αL∗<αLe,\alpha^*_H=\alpha^e_H,\qquad \alpha^*_L<\alpha^e_L ,αH∗​=αHe​,αL∗​<αLe​,

and if v+<cL<cHv^+<c_L<c_Hv+<cL​<cH​, then

αH∗=αHe,αL∗>αLe.\alpha^*_H=\alpha^e_H,\qquad \alpha^*_L>\alpha^e_L .αH∗​=αHe​,αL∗​>αLe​.

Here αH∗=αHe\alpha^*_H=\alpha^e_HαH∗​=αHe​ means that the set of αH\alpha_HαH​-levels of optimal menus equals the set of efficient levels, and each strict inequality holds for every optimal menu and every efficient level.

Milestones

  1. The willingness to pay for a data append (p. 20): for c≤u^c\le\hat uc≤u^, Uij−Ui0=−Tj+∫v‾ci(ci−v) dH(v,αj)U_{ij}-U_{i0}=-T_j+\int_{\underline v}^{c_i}(c_i-v)\,dH(v,\alpha_j)Uij​−Ui0​=−Tj​+∫v​ci​​(ci​−v)dH(v,αj​), which is increasing in cic_ici​.
  2. Its integrated form (proof of Proposition 8, p. 33): Uij−Ui0=−Tj+∫v‾ciH(v,αj) dvU_{ij}-U_{i0}=-T_j+\int_{\underline v}^{c_i}H(v,\alpha_j)\,dvUij​−Ui0​=−Tj​+∫v​ci​​H(v,αj​)dv.
  3. The reduction (15) (p. 20): substituting the binding IRLIR_LIRL​ and ICH,LIC_{H,L}ICH,L​ turns the screening problem into a maximization over (αH,αL)(\alpha_H,\alpha_L)(αH​,αL​).
  4. (15) integrated by parts, and αH∗=αHe\alpha^*_H=\alpha^e_HαH∗​=αHe​ for it (p. 33).
  5. The derivative ∂Π/∂αL\partial\Pi/\partial\alpha_L∂Π/∂αL​ of (15) compared with the benchmark's (p. 33).

Significance

Proposition 7 is the general-distribution form of a "double reversal". With marketing lists the low-cost marketers are the high type: they get efficient information, and the high-cost marketers' information is distorted (Proposition 5 of the paper). With data appends and costs below the prior mean, the outside option makes the high-cost marketers value data more. The roles of the types swap, and the direction of the distortion flips with the position of the costs relative to the rotation point. The result tells a data seller which customers to under- or over-supply, and shows that the answer depends on whether its data enable an action or only refine it.

The paper proves the result on a few pages, partly by phrases such as "it can be readily verified". No machine-checked version exists. A formalization makes explicit what the printed argument leaves implicit: that the dropped constraints hold at the reduced optimum, which regularity of kkk and HHH the strict inequalities need, and that statements about "the" optimum hold for every optimum when maximizers are not unique.

Difficulty

The obvious approach substitutes the binding constraints and compares first-order conditions. Two steps of it fail as stated. First, the reduction to (15) drops IRHIR_HIRH​ and ICL,HIC_{L,H}ICL,H​; ICL,HIC_{L,H}ICL,H​ holds at a maximizer of (15) only when the two informativeness levels are ordered as the rotation order dictates. That ordering is available only when both costs lie on the same side of v+v^+v+. Second, first-order conditions say nothing at a corner of [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ]. The strict comparison αL∗≠αLe\alpha^*_L\ne\alpha^e_LαL∗​=αLe​ needs the efficient level to be interior, where the derivative of kkk exists. That comes from the conditions of footnote 5 together with the mean-preserving property of the family. The selling cost need not be convex, so maximizers can be non-unique, and every comparison must hold for every pair of maximizers.

Formalization scope

  • Information structure. A structure RotationFamily with a bounded support v‾<vˉ\underline v<\bar vv​<vˉ (the paper allows an unbounded one). H(⋅,α)H(\cdot,\alpha)H(⋅,α) is continuous on [v‾,vˉ][\underline v,\bar v][v​,vˉ] with H(v‾,α)=0H(\underline v,\alpha)=0H(v​,α)=0, H(vˉ,α)=1H(\bar v,\alpha)=1H(vˉ,α)=1 and derivative h(⋅,α)>0h(\cdot,\alpha)>0h(⋅,α)>0, continuous on the closed support. ∂H/∂α\partial H/\partial\alpha∂H/∂α exists on the closed support. The rotation order (9) holds on the open support, and the mean is u^\hat uu^ for every α∈(0,1)\alpha\in(0,1)α∈(0,1). Condition (10) is not assumed; it follows.
  • Model. Model extends it with 0<α‾<αˉ<10<\underline\alpha<\bar\alpha<10<α​<αˉ<1, θ∈(0,1)\theta\in(0,1)θ∈(0,1), and 0<cL<cH0<c_L<c_H0<cL​<cH​ with both costs in (v‾,vˉ)(\underline v,\bar v)(v​,vˉ) (a pin: the integrals ∫civˉ\int_{c_i}^{\bar v}∫ci​vˉ​ presume it). It also fixes k(α‾)=0k(\underline\alpha)=0k(α​)=0 with kkk monotone on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ]. dHdHdH is written as h dvh\,dvhdv.
  • Objects of the goal. Optimal menus are maximizers of the full problem: fees T≥0T\ge0T≥0, levels in [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ], IRiIR_iIRi​ with outside option max⁡{u^−ci,0}\max\{\hat u-c_i,0\}max{u^−ci​,0}, and both IC constraints. Efficient levels are maximizers of the benchmark (12). Neither is defined through (15) or a first-order condition. That would make the first half of the goal a restatement of milestone 4, and writing the outside option as u^−c\hat u-cu^−c instead of the maximum would change the model.
  • Pinned hypotheses. On the goal only: the part of footnote 5 the strict results use (kkk continuous on [α‾,αˉ][\underline\alpha,\bar\alpha][α​,αˉ], differentiable inside, k′(α‾)=0k'(\underline\alpha)=0k′(α​)=0 from the right, k′(α)→+∞k'(\alpha)\to+\inftyk′(α)→+∞ as α→αˉ−\alpha\to\bar\alpha^-α→αˉ−) and joint continuity of ∂H/∂α\partial H/\partial\alpha∂H/∂α on [v‾,vˉ]×(0,1)[\underline v,\bar v]\times(0,1)[v​,vˉ]×(0,1). The derivative milestone uses only the latter. Convexity of kkk is not assumed.
  • Range restriction. The first sentence of Proposition 7 (αH∗=αHe\alpha^*_H=\alpha^e_HαH∗​=αHe​) is posed on the full problem only within the two ranges cH<v+c_H<v^+cH​<v+ and v+<cLv^+<c_Lv+<cL​. For (15) it is posed without restriction in milestone 4. The branch v+<cL<cH<u^v^+<c_L<c_H<\hat uv+<cL​<cH​<u^ is empty when v+≥u^v^+\ge\hat uv+≥u^, for example for symmetric structures; non-symmetric rotation families with v+<u^v^+<\hat uv+<u^ inhabit it.
  • Reuse. Topkis's monotonicity theorem (Theorem 2.8.4) is on the platform and is the tool the paper invokes. The integration-by-parts facts for distribution functions on a bounded support, and differentiation of ∫cvˉH(v,α) dv\int_c^{\bar v}H(v,\alpha)\,dv∫cvˉ​H(v,α)dv in α\alphaα, are reusable beyond this mission. Proofs of the milestones in any order are welcome.

Selected references

  • Liang Guo, Selling Data to Marketers, Management Science, 2025 (author's manuscript used here). https://doi.org/10.1287/mnsc.2023.01350
  • Justin P. Johnson and David P. Myatt, On the Simple Economics of Advertising, Marketing, and Product Design, American Economic Review 96(3), 2006. https://doi.org/10.1257/000282806777211946
  • Donald M. Topkis, Supermodularity and Complementarity, Princeton University Press, 1998. https://doi.org/10.1515/9781400822539
  • Federal Trade Commission, Data Brokers: A Call for Transparency and Accountability, 2014. https://www.ftc.gov/reports/data-brokers-call-transparency-accountability-report-federal-trade-commission-may-2014
9 thms2 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

Asset Pricing with Costly Short Sales 2: With One Risky Asset the Equilibrium Shorting Cost and Lending Yield Are Explicit, Increasing and Convex in the Belief GapResearch Paper

Motivation

Short selling is never free. To sell a share short, an investor borrows it from a holder and pays that holder a lending fee, and the size of these fees has been documented empirically for decades (D'Avolio 2002; Duffie, Gârleanu and Pedersen 2002). Most equilibrium models of asset pricing either forbid short sales or take the fee as exogenous. Evgeniou, Hugonnier and Prieto build a continuous-time general-equilibrium economy where the fee is determined jointly with prices: investors disagree about expected dividend growth, the pessimist wants to short, the optimist owns the shares, and the cost of shorting clears the securities lending market. The paper uses the model to explain how a positive shorting cost can coexist with apparent mispricing, as in the 3Com/Palm spin-off.

In the special case of a single risky asset (the market portfolio), the equilibrium reduces to a pair of algebraic equations for the shorting cost and the lending yield at each state, and the paper solves them in closed form (Proposition 3). This mission formalizes that closed form and its comparative statics in the belief gap.

Setting

At a fixed state of the economy, three numbers describe the environment:

  • σ>0\sigma>0σ>0, the volatility of aggregate consumption, which in the one-asset case is also the volatility of the risky asset;
  • δ=σΔ=μ(o)−μ(p)≥0\delta=\sigma\Delta=\mu^{(o)}-\mu^{(p)}\ge 0δ=σΔ=μ(o)−μ(p)≥0, the unscaled difference in beliefs: the gap between the expected dividend growth rates perceived by the optimist ooo and the pessimist ppp (Δ\DeltaΔ is the same gap per unit of volatility);
  • s∈(0,1)s\in(0,1)s∈(0,1), the consumption share of the optimist.

Short selling is active only when the optimist holds a large enough share of consumption, namely on the shorting region s>s∗s>s^*s>s∗, where

s∗=min⁡{1,σΔ}=min⁡{1,σ2δ}.s^*=\min\Big\{1,\frac{\sigma}{\Delta}\Big\}=\min\Big\{1,\frac{\sigma^2}{\delta}\Big\}.s∗=min{1,Δσ​}=min{1,δσ2​}.

Two unknowns are determined in equilibrium: the shorting cost Φ\PhiΦ, the flow rate a short seller pays per unit of position, and the lending yield Γ\GammaΓ, the flow rate a lender receives per unit of shares held. The paper shows (p. 27) that with one risky asset they satisfy

Φ=1{s>s∗}(δ+Γ)s−σ21+s,Γ=1{s>s∗}(1−s)(sδ−Γ−σ2)((δ+Γ)s−σ2)σ2(1+s)2.(29–30)\Phi=\mathbb 1_{\{s>s^*\}}\frac{(\delta+\Gamma)s-\sigma^2}{1+s},\qquad \Gamma=\mathbb 1_{\{s>s^*\}}\frac{(1-s)(s\delta-\Gamma-\sigma^2)\big((\delta+\Gamma)s-\sigma^2\big)}{\sigma^2(1+s)^2}. \tag{29–30}Φ=1{s>s∗}​1+s(δ+Γ)s−σ2​,Γ=1{s>s∗}​σ2(1+s)2(1−s)(sδ−Γ−σ2)((δ+Γ)s−σ2)​.(29–30)

The proof of Proposition 3 works with the per-volatility yield γ=Γ/σ\gamma=\Gamma/\sigmaγ=Γ/σ and the quadratic

g(γ)=(1−s)(sΔ−γ−σ)((γ+Δ)s−σ)−γσ(1+s)2.g(\gamma)=(1-s)(s\Delta-\gamma-\sigma)\big((\gamma+\Delta)s-\sigma\big)-\gamma\sigma(1+s)^2 .g(γ)=(1−s)(sΔ−γ−σ)((γ+Δ)s−σ)−γσ(1+s)2.

In Lean these objects are costOne σ δ s, yieldOne σ δ s, IsOneAssetSystem σ δ s Φ Γ and gQuad σ Δ s γ, all in the namespace CostlyShort.OneAsset.

Formalization targets

Goal: Proposition 3

For σ>0\sigma>0σ>0 and s∈(0,1)s\in(0,1)s∈(0,1): for every δ≥0\delta\ge 0δ≥0 and every Γ≥0\Gamma\ge 0Γ≥0, the pair (Φ,Γ)(\Phi,\Gamma)(Φ,Γ) solves (29)–(30) if and only if

Φ=1{s>s∗}s(1−s)δ−2σ2+s2(1−s)2δ2+4σ4s2(1−s),(31)\Phi=\mathbb 1_{\{s>s^*\}}\frac{s(1-s)\delta-2\sigma^2+\sqrt{s^2(1-s)^2\delta^2+4\sigma^4 s}}{2(1-s)}, \tag{31}Φ=1{s>s∗}​2(1−s)s(1−s)δ−2σ2+s2(1−s)2δ2+4σ4s​​,(31) Γ=1{s>s∗}−s((1−s)2δ+4σ2)+(1+s)s2(1−s)2δ2+4σ4s2s(1−s),(32)\Gamma=\mathbb 1_{\{s>s^*\}}\frac{-s\big((1-s)^2\delta+4\sigma^2\big)+(1+s)\sqrt{s^2(1-s)^2\delta^2+4\sigma^4 s}}{2s(1-s)}, \tag{32}Γ=1{s>s∗}​2s(1−s)−s((1−s)2δ+4σ2)+(1+s)s2(1−s)2δ2+4σ4s​​,(32)

and both (31) and (32), as functions of δ\deltaδ, are non-decreasing and convex on [0,∞)[0,\infty)[0,∞) and strictly increasing for δ>σ2/s\delta>\sigma^2/sδ>σ2/s.

Milestones

  1. On the shorting region, (30) is equivalent to g(γ)=0g(\gamma)=0g(γ)=0 (proof of Proposition 3, p. 50).
  2. g(0)=(1−s)(sΔ−σ)2>0g(0)=(1-s)(s\Delta-\sigma)^2>0g(0)=(1−s)(sΔ−σ)2>0, g′(0)<0g'(0)<0g′(0)<0, g′′≡−2s(1−s)<0g''\equiv-2s(1-s)<0g′′≡−2s(1−s)<0 and g(γ)→−∞g(\gamma)\to-\inftyg(γ)→−∞ (p. 50).
  3. For s>s∗s>s^*s>s∗, ggg has a unique strictly positive root (p. 50).
  4. The closed form (32) is strictly positive and solves (30) on the region (p. 50).
  5. Substituting (32) into (29) gives (31) (p. 50).
  6. The market-clearing identity (33) with the utilization (34): Γ=ΦΥ/(1+Υ)\Gamma=\Phi\Upsilon/(1+\Upsilon)Γ=ΦΥ/(1+Υ), Υ=1−sσ2Φ\Upsilon=\frac{1-s}{\sigma^2}\PhiΥ=σ21−s​Φ (p. 28).
  7. Φ\PhiΦ is non-decreasing and convex in δ\deltaδ on [0,∞)[0,\infty)[0,∞), strictly increasing on the region (Proposition 3, p. 28).

A companion statement, not a milestone, formalizes the limits on p. 29: as s↑1s\uparrow 1s↑1, Φ→(1−s∗)δ/2\Phi\to(1-s^*)\delta/2Φ→(1−s∗)δ/2 and Γ→0\Gamma\to 0Γ→0.

Significance

Proposition 3 is the only fully explicit equilibrium of the paper. It gives the level of the shorting cost and of the lending yield as functions of disagreement and of the wealth distribution, and its monotonicity in δ\deltaδ is the model's prediction that short interest and lending fees rise with the dispersion of beliefs, which the paper checks against analysts' forecast dispersion (Table 1). Convexity says the effect accelerates with disagreement. The two-asset case of §4.2 has no closed form and is solved numerically; the one-asset formulas are its benchmark.

The result is proved in the paper, but the proof of the comparative statics is omitted ("We omit the details", p. 50), and the selection of the positive root is asserted ("it is clear"). A formal development supplies the omitted differentiation argument, including convexity across the kink at the boundary δ=σ2/s\delta=\sigma^2/sδ=σ2/s of the shorting region, and checks the paper's algebra. No part of this paper has a machine-checked proof.

Difficulty

The algebra of milestones 1, 4 and 5 is mechanical but involves a square root and several divisions, whose signs must be tracked throughout. The substantive step is the comparative statics. Monotonicity and convexity of Φ\PhiΦ in δ\deltaδ need the derivative of a square-root expression on the open region, and then a separate argument at the kink: both functions vanish identically for δ≤σ2/s\delta\le\sigma^2/sδ≤σ2/s, so convexity on [0,∞)[0,\infty)[0,∞) requires the one-sided derivative at σ2/s\sigma^2/sσ2/s to be non-negative, which is a computation rather than a consequence of convexity on each piece. For Γ\GammaΓ the paper's route is indirect: Γ=h(Φ)\Gamma=h(\Phi)Γ=h(Φ) with h(x)=cx2/(1+cx)h(x)=cx^2/(1+cx)h(x)=cx2/(1+cx), and composition of a non-decreasing convex hhh with a non-decreasing convex Φ\PhiΦ. Differentiating (32) directly is possible but heavier.

Formalization scope

Everything is pointwise in real numbers. The continuous-time economy of §2 (Brownian dividends, portfolio choice, the derivation of (29)–(30) from the equilibrium conditions (16), (20), (21)) is the paper's motivation and is not formalized; Proposition 3 is stated relative to (29)–(30), which is exactly where the paper's proof begins. Conventions committed to:

  • standing assumptions σ>0\sigma>0σ>0 and 0<s<10<s<10<s<1 in every theorem; the endpoints s∈{0,1}s\in\{0,1\}s∈{0,1} are absorbing states where (31)–(32) divide by zero, and are excluded;
  • the indicator 1{s>s∗}\mathbb 1_{\{s>s^*\}}1{s>s∗}​ is encoded as σ2<sδ\sigma^2<s\deltaσ2<sδ, equivalent for σ>0\sigma>0σ>0, δ≥0\delta\ge 0δ≥0, s∈(0,1)s\in(0,1)s∈(0,1); it is never written as s>min⁡{1,σ/Δ}s>\min\{1,\sigma/\Delta\}s>min{1,σ/Δ}, where Lean's σ/0=0\sigma/0=0σ/0=0 would make every state a shorting state when Δ=0\Delta=0Δ=0;
  • in the goal's equivalence the lending yield is restricted to Γ≥0\Gamma\ge 0Γ≥0. This is a disclosed pin: on the shorting region the quadratic also has a negative root, which solves (29)–(30) as well; the paper's proof selects "the unique strictly positive solution", and a lending yield is a non-negative flow rate;
  • "increasing" is stated as non-decreasing on [0,∞)[0,\infty)[0,∞) plus strictly increasing on (σ2/s,∞)(\sigma^2/s,\infty)(σ2/s,∞), because both functions are zero below the region;
  • the paper prints g′′=−s(1−s)g''=-s(1-s)g′′=−s(1−s); the correct second derivative −2s(1−s)-2s(1-s)−2s(1−s) is stated (milestone 2);
  • only the outer equality of (34) is used; its middle expression involves the pessimist's portfolio and needs the economy.

A trivializing formalization is ruled out: stating only that (31)–(32) satisfy (29)–(30), or convexity only on the open shorting region, would be strictly weaker than the paper and is not the goal.

Needed infrastructure is Mathlib's real analysis: Real.sqrt, deriv, MonotoneOn, ConvexOn, and convexity of compositions. Proofs of any milestone are welcome independently. Facts about convexity of a function that vanishes up to a point and is convex beyond it are reusable outside this mission.

Selected references

  • T. Evgeniou, J. Hugonnier and R. Prieto, Asset Pricing with Costly Short Sales, Swiss Finance Institute Research Paper N°22-21, version of September 22, 2022 (the source of this mission; §3.3, §4.1, App. A). Published as J. Hugonnier and R. Prieto, Management Science, 2024. https://doi.org/10.1287/mnsc.2023.01887
  • G. D'Avolio, The market for borrowing stock, Journal of Financial Economics 66 (2002) 271–306. https://doi.org/10.1016/S0304-405X(02)00206-4
  • D. Duffie, N. Gârleanu and L. H. Pedersen, Securities lending, shorting, and pricing, Journal of Financial Economics 66 (2002) 307–339. https://doi.org/10.1016/S0304-405X(02)00226-X
  • J. Detemple and S. Murthy, Equilibrium asset prices and no-arbitrage with portfolio constraints, Review of Financial Studies 10 (1997) 1133–1174. https://doi.org/10.1093/rfs/10.4.1133
9 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations Research·Captain: mikedeng1

On the Optimality of Affine Policies for Budgeted Uncertainty Sets 3: With a Network Recourse Matrix, the Optimal Affine Policy Costs m/2 − 1 While the Adjustable Optimum Is 0Research Paper

Why the sign of the recourse matrix matters

A two-stage adjustable robust linear program chooses a first-stage decision xxx before an uncertain right-hand side hhh is revealed, and a second-stage (recourse) decision y(h)y(h)y(h) afterwards, minimising the worst case over an uncertainty set U\mathcal UU of the total cost. Computing the optimal value zAR(U)z_{AR}(\mathcal U)zAR​(U) is hard in general (Feige et al., 2007), and the standard tractable restriction is to affine policies y(h)=Ph+qy(h)=Ph+qy(h)=Ph+q (Ben-Tal et al., 2004), whose optimal value zAff(U)z_{Aff}(\mathcal U)zAff​(U) is computed by a single linear program.

El Housni and Goyal (arXiv:1807.00163v2) show that, when the recourse matrix BBB is non-negative and U\mathcal UU is a budget of uncertainty set, zAffz_{Aff}zAff​ is within a factor O(log⁡n/log⁡log⁡n)O(\log n/\log\log n)O(logn/loglogn) of zARz_{AR}zAR​. Their Section 7 asks whether the non-negativity of BBB is needed, and answers with a family of two-stage lot-sizing instances whose recourse matrix is a network matrix with entries in {−1,0,1}\{-1,0,1\}{−1,0,1}. On this family the adjustable problem has value 000 while every affine policy costs at least m/2−1m/2-1m/2−1. Lot-sizing and transportation recourse are among the most common uses of two-stage robust optimisation (see Bertsimas and de Ruiter, 2016), so the instance is a natural one, not an artefact.

Lower bounds on the gap between affine and adjustable policies were known before (Bertsimas and Goyal, 2012); the point of the present family is that the adjustable value is exactly 000, so the ratio zAff/zARz_{Aff}/z_{AR}zAff​/zAR​ is infinite and the difference zAff−zARz_{Aff}-z_{AR}zAff​−zAR​ grows linearly in mmm.

Setting

The lot-sizing problem (7.1). There are mmm nodes. Node iii stores inventory xix_ixi​ at cost cic_ici​ per unit, up to a capacity KiK_iKi​, and faces an uncertain demand hih_ihi​. After hhh is revealed, inventory may be shipped from node iii to node jjj in amount yij(h)≥0y_{ij}(h)\ge0yij​(h)≥0 at cost dijd_{ij}dij​ per unit. A solution (x,y)(x,y)(x,y) is feasible when 0≤xi≤Ki0\le x_i\le K_i0≤xi​≤Ki​ and, for every h∈Uh\in\mathcal Uh∈U,

xi+∑jyji(h)−∑jyij(h) ≥ hi(i∈[m]).x_i+\sum_{j}y_{ji}(h)-\sum_j y_{ij}(h)\ \ge\ h_i\qquad(i\in[m]).xi​+j∑​yji​(h)−j∑​yij​(h) ≥ hi​(i∈[m]).

The objective is the first-stage cost ∑icixi\sum_ic_ix_i∑i​ci​xi​ plus the worst case over h∈Uh\in\mathcal Uh∈U of the transportation cost ∑ijdijyij(h)\sum_{ij}d_{ij}y_{ij}(h)∑ij​dij​yij​(h). The optimum over all rules h↦y(h)h\mapsto y(h)h↦y(h) is zAR(U)z_{AR}(\mathcal U)zAR​(U), and the optimum over affine rules y(h)=Ph+qy(h)=Ph+qy(h)=Ph+q (one row of PPP per arc, one column per node) is zAff(U)z_{Aff}(\mathcal U)zAff​(U).

The family (7.2). Let m=2km=2km=2k, and split the nodes into J1J_1J1​ and J2J_2J2​ with ∣J1∣=∣J2∣=k|J_1|=|J_2|=k∣J1​∣=∣J2​∣=k. Set ci=0c_i=0ci​=0 on J1J_1J1​ and ci=1c_i=1ci​=1 on J2J_2J2​, Ki=1K_i=1Ki​=1 everywhere, dij=0d_{ij}=0dij​=0 for i∈J1i\in J_1i∈J1​, j∈J2j\in J_2j∈J2​, and dij=∞d_{ij}=\inftydij​=∞ otherwise. The uncertainty set is

U={h∈[0,1]m ∣ ∑i=1mhi≤m/2}.\mathcal U=\Big\{h\in[0,1]^m\ \Big|\ \sum_{i=1}^m h_i\le m/2\Big\}.U={h∈[0,1]m ​ i=1∑m​hi​≤m/2}.

Inventory can thus move only from J1J_1J1​ to J2J_2J2​, at no cost; stocking J1J_1J1​ is free and stocking J2J_2J2​ costs one per unit.

In the Lean development the general problem is the structure LotSizing N E (nodes N, usable arcs E with tail src, head tgt, distances d), with the predicate Feasible, the cost cost, and the sets adjustableValues, affineValues of objective values. The family is lotSizingFamily k, on nodes Fin k ⊕ Fin k and arcs Fin k × Fin k.

Formalization targets

Goal: Lemma 7.1

For every k≥1k\ge1k≥1,

zAR(U)=0andzAff(U)=m2−1=k−1,z_{AR}(\mathcal U)=0\qquad\text{and}\qquad z_{Aff}(\mathcal U)=\frac m2-1=k-1,zAR​(U)=0andzAff​(U)=2m​−1=k−1,

each stated as IsLeast of the corresponding set of objective values, which asserts that the value is attained and is the minimum. The unboundedness of the gap, zAff−zAR=k−1→∞z_{Aff}-z_{AR}=k-1\to\inftyzAff​−zAR​=k−1→∞, is immediate.

Milestones (Appendix D, in proof order)

  1. The first-stage decision x=1J1x=\mathbb 1_{J_1}x=1J1​​ admits a second-stage policy with cost 000 in every scenario (p. 35).
  2. (D.3), for k≥2k\ge2k≥2: every feasible affine solution has xi=1x_i=1xi​=1 on J1J_1J1​, and its flow on arc (i,j)(i,j)(i,j) depends on hih_ihi​ only, with P(i,j),i+qij=0P_{(i,j),i}+q_{ij}=0P(i,j),i​+qij​=0 (p. 36).
  3. For k≥2k\ge2k≥2, every feasible affine solution satisfies xj+qℓj≥1x_j+q_{\ell j}\ge1xj​+qℓj​≥1 for ℓ∈J1\ell\in J_1ℓ∈J1​, j∈J2j\in J_2j∈J2​ (pp. 36–37).
  4. Every feasible affine solution has ∑j∈J2xj≥m/2−1\sum_{j\in J_2}x_j\ge m/2-1∑j∈J2​​xj​≥m/2−1, hence zAff≥m/2−1z_{Aff}\ge m/2-1zAff​≥m/2−1 (p. 37).
  5. The explicit affine solution x=1−emx=\mathbb 1-e_mx=1−em​, yim(h)=1−hiy_{im}(h)=1-h_iyim​(h)=1−hi​, is feasible and costs m/2−1m/2-1m/2−1 (p. 37).

Significance

The result. The approximation guarantees of the paper (O(log⁡n/log⁡log⁡n)O(\log n/\log\log n)O(logn/loglogn) for budget sets, O(log⁡2n/log⁡log⁡n)O(\log^2 n/\log\log n)O(log2n/loglogn) for disjoint constrained budgets) assume B≥0B\ge0B≥0. Lemma 7.1 shows that this assumption is not a convenience of the proof: with a network recourse matrix no bound on zAff/zARz_{Aff}/z_{AR}zAff​/zAR​ of any form holds, even for a budget set and a bipartite network. Any extension of the guarantees to transportation or flow recourse must therefore change the policy class or add structure, which is the open direction the paper states after the lemma.

Formalizing it. The lemma is proved in the paper; it has not been machine-checked. The mission produces a reusable definition of the two-stage robust lot-sizing problem with arc-based recourse, the precise instance family, and checked versions of the five steps of Appendix D. Two of those steps hold only for m≥4m\ge4m≥4 and one is printed with its indices swapped (see the scope section); the formal statements make those boundaries explicit.

Difficulty

The adjustable half is a transportation argument, and the affine upper bound is a direct verification of one explicit solution. The substance is the affine lower bound, which must hold for every feasible affine solution, not for a particular one. Comparing an affine policy with the adjustable optimum on a few extreme scenarios gives nothing: on any single scenario an affine policy can match the adjustable cost. What fails for affine policies is simultaneous feasibility over the whole of U\mathcal UU, and the lower bound has to extract a cost from that requirement alone. It is also sensitive to the size of the instance: two of the intermediate steps of Appendix D are false for m=2m=2m=2, so a formal proof has to treat small mmm separately.

Formalization scope

  • Model. Vectors are functions on finite types with the componentwise order; indices are 0-based. The second stage is a rule y:RN→REy:\mathbb R^N\to\mathbb R^Ey:RN→RE, which gives the same values as choosing y(h)y(h)y(h) separately per scenario. The epigraph variable zzz of (7.1) appears through the sets of objective values ttt with ∑icixi+∑adaya(h)≤t\sum_ic_ix_i+\sum_a d_a y_a(h)\le t∑i​ci​xi​+∑a​da​ya​(h)≤t for all h∈Uh\in\mathcal Uh∈U.
  • Infinite distances. Arcs with dij=∞d_{ij}=\inftydij​=∞ are omitted rather than given an extended-real cost: a finite-cost solution never uses them, so no optimal value changes, and App. D itself works with the reduced constraints (D.1)–(D.2) and with a matrix PPP having "one row per edge". The kept arcs J1×J2J_1\times J_2J1​×J2​ have d=0d=0d=0, and the cost keeps the term ∑adaya(h)\sum_a d_a y_a(h)∑a​da​ya​(h) so that (7.1) is visible.
  • Values as IsLeast. No real infimum is used, so "z=0z=0z=0" cannot hold on an empty feasible set; feasibility includes 0≤x≤K0\le x\le K0≤x≤K, Ph+q≥0Ph+q\ge0Ph+q≥0 on all of U\mathcal UU, and the coverage constraint at every node, including the outflow constraint (D.2) at J1J_1J1​.
  • Sizes. The paper's "mmm even" is m=2km=2km=2k. The goal assumes k≥1k\ge1k≥1; at k=0k=0k=0 the affine value would be 0≠−10\ne-10=−1.
  • Corrections, disclosed in the items. (i) The paper builds the zero-cost adjustable policy only at extreme points of U\mathcal UU; the milestone quantifies over all of U\mathcal UU, as feasibility requires. (ii) (D.3) and the bound xj+qℓj≥1x_j+q_{\ell j}\ge1xj​+qℓj​≥1 are false for m=2m=2m=2 (explicit counterexamples are in the items' notes) and carry the hypothesis k≥2k\ge2k≥2. (iii) "for any j∈J1j\in J_1j∈J1​ and for any ℓ∈J2\ell\in J_2ℓ∈J2​" on p. 37 has the indices swapped and is stated with ℓ∈J1\ell\in J_1ℓ∈J1​, j∈J2j\in J_2j∈J2​.
  • Not formalized. That (7.1) has a network recourse matrix with entries in {−1,0,1}\{-1,0,1\}{−1,0,1} is descriptive and is not stated; total unimodularity is not needed.
  • Reusable parts. LotSizing (any node set, any arc set, any uncertainty set) can host other two-stage lot-sizing and transportation results. Proofs of any milestone, and alternative arguments for the affine lower bound, are welcome.

The source is arXiv:1807.00163v2; its printed page numbers equal the PDF's.

Selected references

  • O. El Housni, V. Goyal, On the Optimality of Affine Policies for Budgeted Uncertainty Sets, arXiv:1807.00163v2, 2019 (Mathematics of Operations Research 46(2), 2021). https://arxiv.org/abs/1807.00163v2
  • A. Ben-Tal, A. Goryashko, E. Guslitzer, A. Nemirovski, Adjustable robust solutions of uncertain linear programs, Mathematical Programming 99(2), 2004. https://doi.org/10.1007/s10107-003-0454-y
  • D. Bertsimas, V. Goyal, On the power and limitations of affine policies in two-stage adaptive optimization, Mathematical Programming 134(2), 2012. https://doi.org/10.1007/s10107-011-0444-4
  • D. Bertsimas, F. de Ruiter, Duality in two-stage adaptive linear optimization: Faster computation and stronger bounds, INFORMS Journal on Computing 28(3), 2016. https://doi.org/10.1287/ijoc.2016.0689
  • U. Feige, K. Jain, M. Mahdian, V. Mirrokni, Robust combinatorial optimization with exponential scenarios, IPCO 2007. https://doi.org/10.1007/978-3-540-72792-7_33
8 thms2 active usersReviewed
🏆Completed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 3: Correctness of the digits computed by iterative phase estimation (corrected)Textbook

Motivation

This mission develops Chapter 3 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

Let φ∈[0,1)\varphi\in[0,1)φ∈[0,1) be a phase (in full turns), h∈Nh\in\mathbb Nh∈N (h=q−2h=q-2h=q−2), and let ω1,…,ωh\omega_1,\dots,\omega_hω1​,…,ωh​ be the angle estimates used by the iterative phase estimation algorithm of §3.3.2, ωi\omega_iωi​ being the estimate of 2i−1φ2^{i-1}\varphi2i−1φ. The algorithm computes binary digits p1,…,ph+2p_1,\dots,p_{h+2}p1​,…,ph+2​ as follows: phph+1ph+2p_hp_{h+1}p_{h+2}ph​ph+1​ph+2​ are the digits of ωh\omega_hωh​ rounded to the closest multiple of 1/81/81/8 (modulo 111); then for j=h−1,…,1j=h-1,\dots,1j=h−1,…,1, pj=0p_j=0pj​=0 if d(0.0pj+1pj+2,ωj)<1/4d(0.0p_{j+1}p_{j+2},\omega_j)<1/4d(0.0pj+1​pj+2​,ωj​)<1/4 and pj=1p_j=1pj​=1 otherwise. Here d(x,y)d(x,y)d(x,y) is the distance between xxx and yyy modulo 111.

Fix 1≤j≤h1\le j\le h1≤j≤h. If d(ωi,2i−1φ)≤1/16d(\omega_i,2^{i-1}\varphi)\le 1/16d(ωi​,2i−1φ)≤1/16 for every step i=h,h−1,…,ji=h,h-1,\dots,ji=h,h−1,…,j, then

d(0.pjpj+1…ph+2, 2j−1φ) ≤ 2−(h+3−j).d\big(0.p_jp_{j+1}\dots p_{h+2},\ 2^{j-1}\varphi\big)\ \le\ 2^{-(h+3-j)} .d(0.pj​pj+1​…ph+2​, 2j−1φ) ≤ 2−(h+3−j).

In particular, for j=1j=1j=1 the algorithm outputs q=h+2q=h+2q=h+2 binary digits of φ\varphiφ with error at most 2−q2^{-q}2−q on the circle, which together with a union bound over the hhh estimation steps gives the success guarantee of iterative phase estimation.

Formalization Note The page states the bound with plain absolute values and strict inequality. Both are corrected: angles are only known modulo 111 (so all distances are on the circle), and the strict bound already fails at the base case (ωh=1/16\omega_h=1/16ωh​=1/16 is equidistant from 000 and 1/81/81/8, and rounding gives error exactly 1/81/81/8); the induction proves ≤\le≤, matching the goal Pr⁡(min⁡{… }≤2−q)\Pr(\min\{\dots\}\le 2^{-q})Pr(min{…}≤2−q) on p.66. The digits are the shared definition ipeDigits h ω and 0.pj…ph+20.p_j\dots p_{h+2}0.pj​…ph+2​ is binFracFrom.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 3.14: Phase estimation on an inexact eigenstate succeeds with probability at least (1 − δ)|⟨ξ|ψ⟩|²*.
  • Proposition 3.16: Combining cosine and sine estimates into an angle estimate (corrected).
  • Proposition 3.17: Correctness of the digits computed by iterative phase estimation (corrected).

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
3 thms2 active usersReviewed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 9: QAOA with enough layers reaches a maximum eigenstate of H_FTextbook

Motivation

This mission develops Chapter 9 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

Let n≥0n \ge 0n≥0 and let f:{0,1}n→Rf : \{0,1\}^n \to \mathbb{R}f:{0,1}n→R be the objective of the maximization problem (9.38). Define the nnn-qubit Hamiltonians

HF=∑x∈{0,1}nf(x) ∣x⟩⟨x∣,HI=∑j=1nσjX,H_F = \sum_{x \in \{0,1\}^n} f(x)\,|x\rangle\langle x|, \qquad H_I = \sum_{j=1}^n \sigma_j^X,HF​=x∈{0,1}n∑​f(x)∣x⟩⟨x∣,HI​=j=1∑n​σjX​,

where σjX\sigma_j^XσjX​ is the Pauli XXX on qubit jjj and the identity elsewhere. For p≥1p \ge 1p≥1 and β,θ∈[0,2π]p\beta, \theta \in [0, 2\pi]^pβ,θ∈[0,2π]p let

UQAOA(p,β,θ)=e−iβpHIe−iθpHF⋯e−iβ1HIe−iθ1HF.U_{\mathrm{QAOA}}(p, \beta, \theta) = e^{-i\beta_p H_I} e^{-i\theta_p H_F} \cdots e^{-i\beta_1 H_I} e^{-i\theta_1 H_F}.UQAOA​(p,β,θ)=e−iβp​HI​e−iθp​HF​⋯e−iβ1​HI​e−iθ1​HF​.

Then for every δ>0\delta > 0δ>0 there are a unit vector ∣φ⟩|\varphi\rangle∣φ⟩ with HF∣φ⟩=(max⁡xf(x)) ∣φ⟩H_F|\varphi\rangle = (\max_x f(x))\,|\varphi\rangleHF​∣φ⟩=(maxx​f(x))∣φ⟩, that is an eigenstate of HFH_FHF​ with maximum eigenvalue, and an integer P≥1P \ge 1P≥1 such that for every p≥Pp \ge Pp≥P there are angles β∗,θ∗∈[0,2π]p\beta^*, \theta^* \in [0, 2\pi]^pβ∗,θ∗∈[0,2π]p with

∥UQAOA(p,β∗,θ∗) (H∣0⟩)⊗n−∣φ⟩∥≤δ.\bigl\| U_{\mathrm{QAOA}}(p, \beta^*, \theta^*)\,(H|0\rangle)^{\otimes n} - |\varphi\rangle \bigr\| \le \delta .​UQAOA​(p,β∗,θ∗)(H∣0⟩)⊗n−∣φ⟩​≤δ.

Here (H∣0⟩)⊗n(H|0\rangle)^{\otimes n}(H∣0⟩)⊗n is the uniform superposition, the maximum eigenstate of HIH_IHI​. The proposition says that with enough layers, the QAOA ansatz can reproduce adiabatic evolution along H(s)=(1−s)HI+sHFH(s) = (1-s)H_I + sH_FH(s)=(1−s)HI​+sHF​ and so prepares a state close to one encoding an optimal solution of (9.38).

Formalization Note The source's limit over ppp, with angles that depend on ppp, is stated as "for all sufficiently large ppp some angles achieve distance at most δ\deltaδ", with the target eigenvector fixed before ppp. The global phase allowed by Theorem 9.11 is absorbed into the choice of the eigenvector, since a phase multiple of a maximum eigenvector is again one. The informal claim that UQAOAU_{\mathrm{QAOA}}UQAOA​ "approximates an adiabatic evolution" is represented by its stated "in particular" consequence.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 9.4: The Ising Hamiltonian is diagonal with the QUBO objective values.
  • Theorem 9.11: Adiabatic theorem with T ≥ (10⁴/δ²)(‖H′‖³/γ⁴ + ‖H′‖‖H″‖/γ³).
  • Theorem 9.17: Adiabatic theorem when the tracked eigenvalue is identically 0.
  • Lemma 9.18: Derivative bounds for the phase-fixed instantaneous zero eigenvector.
  • Lemma 9.20: Replacing U_k ⋯ U_j by powers of U_1 in the discretized adiabatic evolution.
  • Corollary 9.21: The T-bound of Theorem 9.11 suffices (derived from Theorem 9.17).
  • Theorem 9.23: Adiabatic theorem with the integrated 1/γ³ gap dependence.
  • Corollary 9.24: Adiabatic theorem for the linear interpolation (1 − s)H_I + sH_F.
  • Proposition 9.28: QAOA with enough layers reaches a maximum eigenstate of H_F.

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
9 thms2 active usersReviewed
🏆Completed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 6: Unitary conjugation commutes with the matrix exponential: e^{iUHU†t} = U e^{iHt} U†Textbook

Motivation

This mission develops Chapter 6 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

Let n≥0n \ge 0n≥0, let UUU be a unitary 2n×2n2^n \times 2^n2n×2n matrix, let H\mathcal{H}H be a Hamiltonian on nnn qubits, that is, a Hermitian 2n×2n2^n \times 2^n2n×2n complex matrix, and let t∈Rt \in \mathbb{R}t∈R. With the matrix exponential eA=∑k=0∞Ak/k!e^A = \sum_{k=0}^\infty A^k / k!eA=∑k=0∞​Ak/k!,

eiUHU†t=U eiHt U†.e^{iU\mathcal{H}U^\dagger t} = U\, e^{i\mathcal{H}t}\, U^\dagger.eiUHU†t=UeiHtU†.

This is what makes diagonalizable Hamiltonians easy to simulate: if UUU diagonalizes H\mathcal{H}H, simulating H\mathcal{H}H reduces to applying U†U^\daggerU†, a diagonal phase, and UUU.

Formalization Note The matrix exponential is Mathlib's power series NormedSpace.exp; U†U^\daggerU† is the conjugate transpose (star U). Hermiticity of H\mathcal{H}H is kept because the source says Hamiltonian (Def. 6.1), although the identity holds for every square matrix.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 6.9: Phase condition under which the clock Hamiltonian transports |u^(1)⟩ to e^{iϕ}|u^(N)⟩.
  • Proposition 6.12: Unitary conjugation commutes with the matrix exponential: e^{iUHU†t} = U e^{iHt} U†.

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
2 thms2 active usersReviewed
🏆Completed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 2: Simon's algorithm: n+t uniform samples orthogonal to a contain n−1 independent vectors with probability ≥ 1 − 2^{−(t+1)}Textbook

Motivation

This mission develops Chapter 2 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

This is the sampling bound behind the classical post-processing of Simon's algorithm.

Let n≥1n \ge 1n≥1 and t≥0t \ge 0t≥0 be integers, and let F2={0,1}\mathbb F_2 = \{0,1\}F2​={0,1} be the field with two elements. Fix a nonzero vector a∈F2na \in \mathbb F_2^na∈F2n​ and let

Va={k∈F2n:k⋅a=∑i=1nkiai≡0(mod2)}V_a = \{k \in \mathbb F_2^n : k \cdot a = \textstyle\sum_{i=1}^n k_i a_i \equiv 0 \pmod 2\}Va​={k∈F2n​:k⋅a=∑i=1n​ki​ai​≡0(mod2)}

be the (n−1)(n-1)(n−1)-dimensional subspace of vectors orthogonal to aaa. Draw k(1),…,k(n+t)k^{(1)}, \dots, k^{(n+t)}k(1),…,k(n+t) independently and uniformly at random from VaV_aVa​. Then

Pr⁡[some n−1 of k(1),…,k(n+t) are linearly independent over F2]≥1−12t+1.\Pr\big[\text{some } n-1 \text{ of } k^{(1)}, \dots, k^{(n+t)} \text{ are linearly independent over } \mathbb F_2\big] \ge 1 - \frac{1}{2^{t+1}}.Pr[some n−1 of k(1),…,k(n+t) are linearly independent over F2​]≥1−2t+11​.

The bound does not depend on nnn, so n+O(1)n + O(1)n+O(1) runs of Simon's circuit suffice to determine the hidden string aaa with high probability.

Formalization Note The probability is the fraction of all ∣Va∣n+t|V_a|^{n+t}∣Va​∣n+t tuples (k(1),…,k(n+t))∈Van+t(k^{(1)},\dots,k^{(n+t)}) \in V_a^{n+t}(k(1),…,k(n+t))∈Van+t​ for which there are n−1n-1n−1 distinct indices whose vectors are linearly independent; vectors of F2n\mathbb F_2^nF2n​ are functions Fin n→Z/2Z\mathrm{Fin}\,n \to \mathbb Z/2\mathbb ZFinn→Z/2Z.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 2.8: Simon's algorithm: n+t uniform samples orthogonal to a contain n−1 independent vectors with probability ≥ 1 − 2^{−(t+1)}.

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
1 thm2 active usersReviewed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 8: End-to-end complexity of the quantum MaxCut SDP solver in the QRAM model (corrected statement)Textbook

Motivation

This mission develops Chapter 8 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

This is Proposition 8.34 of Nannicini, the end-to-end cost of the quantum mirror-descent solver for the MaxCut SDP relaxation, stated in an explicit hybrid classical–quantum QRAM cost model.

Let n=2qn=2^qn=2q. For a nonzero real symmetric C∈Rn×nC\in\mathbb R^{n\times n}C∈Rn×n put C^=C/∥C∥F\hat C=C/\|C\|_FC^=C/∥C∥F​. Call a density matrix ρ∈Cn×n\rho\in\mathbb C^{n\times n}ρ∈Cn×n an ϵ\epsilonϵ-solution of (MaxCutSDP) if

∑j=1n∣ρjj−1n∣≤ϵandTr⁡(C^ρ) ≥ Tr⁡(C^σ)−ϵ  for every density matrix σ with diag⁡(σ)=1n1.\sum_{j=1}^n\Big|\rho_{jj}-\frac1n\Big|\le\epsilon\qquad\text{and}\qquad \operatorname{Tr}(\hat C\rho)\ \ge\ \operatorname{Tr}(\hat C\sigma)-\epsilon\ \text{ for every density matrix }\sigma\text{ with }\operatorname{diag}(\sigma)=\tfrac1n\mathbb 1.j=1∑n​​ρjj​−n1​​≤ϵandTr(C^ρ) ≥ Tr(C^σ)−ϵ  for every density matrix σ with diag(σ)=n1​1.

A hybrid algorithm consists of (i) a classical preprocessing program, a straight-line program of real arithmetic operations (+,−,×,÷,⋅,arccos⁡,arg⁡+,-,\times,\div,\sqrt\cdot,\arccos,\arg+,−,×,÷,⋅​,arccos,arg, rational constants), which is the only part that reads the entries of CCC and which writes the input half of a QRAM (UQRAM∣j⟩∣y⟩=∣j⟩∣y⊕Mj⟩U_{\mathrm{QRAM}}|j\rangle|y\rangle=|j\rangle|y\oplus M_j\rangleUQRAM​∣j⟩∣y⟩=∣j⟩∣y⊕Mj​⟩, Def. 5.39); (ii) RRR quantum runs, each applying a circuit of two-qubit gates and QRAM calls to ∣0⋯0⟩|0\cdots0\rangle∣0⋯0⟩ and measuring all qubits, where the circuit of each run and the contents of the work half of the QRAM are chosen classically from the outcomes of the earlier runs; (iii) an output, computed from all outcomes, in the form of a list of pairs (y(i),d(i))∈R2×Rn(y^{(i)},d^{(i)})\in\mathbb R^2\times\mathbb R^n(y(i),d(i))∈R2×Rn, which stands for the matrix

ρˉ=1L∑i=1Lexp⁡(y1(i)C^+y2(i)diag⁡(d(i)))Tr⁡exp⁡(y1(i)C^+y2(i)diag⁡(d(i))).\bar\rho=\frac1{L}\sum_{i=1}^{L}\frac{\exp\big(y^{(i)}_1\hat C+y^{(i)}_2\operatorname{diag}(d^{(i)})\big)}{\operatorname{Tr}\exp\big(y^{(i)}_1\hat C+y^{(i)}_2\operatorname{diag}(d^{(i)})\big)}.ρˉ​=L1​i=1∑L​Trexp(y1(i)​C^+y2(i)​diag(d(i)))exp(y1(i)​C^+y2(i)​diag(d(i)))​.

The theorem: there are absolute constants K>0K>0K>0 and ccc such that for all qqq, all ϵ∈(0,1]\epsilon\in(0,1]ϵ∈(0,1] and all δ∈(0,1)\delta\in(0,1)δ∈(0,1), with Λ=log⁡(2+n)+log⁡(2+1/ϵ)+log⁡(2+1/δ)\Lambda=\log(2+n)+\log(2+1/\epsilon)+\log(2+1/\delta)Λ=log(2+n)+log(2+1/ϵ)+log(2+1/δ), there is a hybrid algorithm, fixed before CCC, such that

  1. the QRAM has size at most Kn2ΛcK n^2\Lambda^cKn2Λc, with words of at most KΛcK\Lambda^cKΛc bits;
  2. the preprocessing uses at most Kn2ΛcK n^2\Lambda^cKn2Λc classical operations;
  3. along every measurement record the total number of QRAM accesses and additional gates is at most K n1.5ϵ5ΛcK\,\dfrac{n^{1.5}}{\epsilon^5}\Lambda^cKϵ5n1.5​Λc;
  4. for every nonzero real symmetric CCC, with probability at least 1−δ1-\delta1−δ the output ρˉ\bar\rhoρˉ​ is an ϵ\epsilonϵ-solution of (MaxCutSDP).

The proposition is the payoff of the chapter's MaxCut analysis: the subgradient estimation of Prop. 8.28, the iteration count of Thm. 8.30 and the Hamiltonian structure of Lem. 8.33 combine into a quantum solver whose quantum cost is sublinear in the n2n^2n2 entries of CCC.

Formalization Note The printed proposition has no cost model, no success probability, and no precise meaning for the tolerance over the binary search on γ\gammaγ; these are fixed as above. The classical bookkeeping between quantum runs (tallying samples, forming the subgradients, updating yyy and DDD) is not counted, matching the proof, which takes the classical cost from Prop. 7.29 alone; that bookkeeping never sees CCC. The output is the source's own representation of the iterate (Rem. 8.27, Lem. 8.33): with an arbitrary decoder, the optimum could be read off C^\hat CC^ for free.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 8.7: Entropic mirror descent iterates are the Gibbs states of the accumulated subgradients.
  • Theorem 8.10: Regret bound of the matrix multiplicative weights update.
  • Lemma 8.12: Emptiness of the PIC polytope certifies primal feasibility after rescaling.
  • Theorem 8.15: Algorithm 7 (MMWU for SDP) returns a primal or a dual certificate.
  • Proposition 8.19: The generalized PIC polytope built from θ-accurate traces is sandwiched between P_0 and P_{4Rrθ}.
  • Proposition 8.21: Computing the dual vector with Õ(√m) calls to a trace-estimate oracle (corrected statement).
  • Proposition 8.28: The estimated MaxCut subgradient is an ϵ/2-subgradient (corrected zero branch).
  • Lemma 8.29: A subgradient of the active piece at a nearby point is an approximate subgradient of the max.
  • Theorem 8.30: Convergence of inexact entropic mirror descent for the MaxCut SDP feasibility problem.
  • Lemma 8.33: The MaxCut mirror-descent Hamiltonians are y₁Ĉ + y₂D with ‖y‖₁ ≤ (4/ϵ) log n.
  • Proposition 8.34: End-to-end complexity of the quantum MaxCut SDP solver in the QRAM model (corrected statement).

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
11 thms2 active usersReviewed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 7: A (‖A‖_F, Õ(q), ξ)-block-encoding of a classical matrix from QRAM, with an explicit cost modelTextbook

Motivation

This mission develops Chapter 7 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

Fix constants C0∈RC_0 \in \mathbb{R}C0​∈R and c0∈Nc_0 \in \mathbb{N}c0​∈N (those of the assumption p=O~(1)p = \widetilde{O}(1)p=O(1)). There are constants C>0C > 0C>0 and c∈Nc \in \mathbb{N}c∈N such that the following holds. Let q,p∈Nq, p \in \mathbb{N}q,p∈N, d=2qd = 2^qd=2q, ξ>0\xi > 0ξ>0, write L=log⁡(2+d)+log⁡(2+1/ξ)L = \log(2+d) + \log(2+1/\xi)L=log(2+d)+log(2+1/ξ), and assume p≤C0Lc0p \le C_0 L^{c_0}p≤C0​Lc0​. Then there exist

  1. a QRAM (Def. 5.39) with 2b2^b2b addresses and words of rrr bits, of size 2br≤Cd2(p+1)Lc2^b r \le C d^2 (p+1) L^c2br≤Cd2(p+1)Lc;
  2. a straight-line real-arithmetic program of at most Cd2LcC d^2 L^cCd2Lc operations (+,−,×,÷,⋅,arccos⁡+, -, \times, \div, \sqrt{\cdot}, \arccos+,−,×,÷,⋅​,arccos, complex argument, rational constants) and an addressing map, which compute the QRAM contents from the entries of the matrix;
  3. a quantum circuit V\mathcal{V}V on w+qw + qw+q qubits with w≤C(q+1)Lcw \le C (q+1) L^cw≤C(q+1)Lc, making at most CLcC L^cCLc uncontrolled calls to the QRAM (or its inverse) and using at most CLcC L^cCLc two-qubit gates,

all independent of the matrix, such that for every A∈Cd×dA \in \mathbb{C}^{d\times d}A∈Cd×d whose entries satisfy ∣Re⁡aij∣,∣Im⁡aij∣≤2p|\operatorname{Re} a_{ij}|, |\operatorname{Im} a_{ij}| \le 2^p∣Reaij​∣,∣Imaij​∣≤2p, the unitary V(UQRAM(A))\mathcal{V}(U_{\mathrm{QRAM}}(A))V(UQRAM​(A)) obtained with the QRAM loaded by the program is an (∥A∥F,w,ξ)(\|A\|_F, w, \xi)(∥A∥F​,w,ξ)-block-encoding of AAA:

∥∥A∥F (⟨0∣w⊗I) V (∣0⟩w⊗I)−A∥≤ξ.\bigl\| \|A\|_F\,(\langle 0|_w \otimes I)\,\mathcal{V}\,(|0\rangle_w \otimes I) - A \bigr\| \le \xi .​∥A∥F​(⟨0∣w​⊗I)V(∣0⟩w​⊗I)−A​≤ξ.

This is the data-structure route to block-encodings of classically stored dense matrices, with subnormalization the Frobenius norm and only polylogarithmic quantum cost.

Formalization Note Corrected statement. The source gives no cost model for classical arithmetic, does not say in which parameters ppp is polylogarithmic, and does not say how the costs depend on ξ\xiξ. Here classical cost is the length of a straight-line real-arithmetic program (the model of the Cor. 5.45 chunk), p=O~(1)p = \widetilde{O}(1)p=O(1) means p≤C0Lc0p \le C_0 L^{c_0}p≤C0​Lc0​ for arbitrary C0,c0C_0, c_0C0​,c0​, all O~\widetilde{O}O bounds are polylogarithmic in ddd and 1/ξ1/\xi1/ξ, and the QRAM size is O~(d2p)\widetilde{O}(d^2 p)O(d2p) rather than O(d2p)O(d^2 p)O(d2p) because the word size must grow with log⁡(1/ξ)\log(1/\xi)log(1/ξ). A ppp-bit entry is modelled by the magnitude bound 2p2^p2p on its real and imaginary parts.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 7.9: Iterative refinement reaches residual ϵ in O(log 1/ϵ) iterations.
  • Proposition 7.14: Product of block-encodings (error term corrected).
  • Proposition 7.18: Linear combination of block-encodings (error term corrected for α < 1).
  • Lemma 7.20: Block-encoding of the diagonal matrix of inner products ⟨ϕ_j|ψ_j⟩.
  • Proposition 7.21: Block-encoding from sparse-access oracles (rotation cost and entry encoding made explicit).
  • Lemma 7.37: A bounded polynomial of degree Õ(β) approximating exp(2βx)/4 on [−1, 0].
  • Lemma 7.39: Block-encoding a density matrix from a unitary preparing its purification.
  • Proposition 7.41: One-copy trace estimator: a random variable with bias ≤ θ/4 for Tr(Aρ) and constant variance.
  • Proposition 7.38: Gibbs-state preparation from a block-encoding of H, for the polynomial of Lemma 7.37 made explicit.
  • Proposition 7.29: A (‖A‖_F, Õ(q), ξ)-block-encoding of a classical matrix from QRAM, with an explicit cost model.

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
10 thms2 active usersReviewed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 5: Separation oracle from polylogarithmically many calls to a quantum membership oracle (corrected)Textbook

Motivation

This mission develops Chapter 5 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

This is a corrected form of the quantum construction of a separation oracle from a membership oracle.

Quantum membership oracle. Points of Rd\mathbb{R}^dRd are written in an mmm-qubit register through an encoding p↦enc(p)p \mapsto \mathrm{enc}(p)p↦enc(p). A quantum oracle implementing MEM0,ϵ′(K)\mathrm{MEM}_{0,\epsilon'}(K)MEM0,ϵ′​(K) is a unitary OOO acting on the point register, an answer qubit and kkk workspace qubits. On every basis point it acts as

O ∣p⟩∣0⟩∣0k⟩=∣p⟩∣φp⟩,O\,|p\rangle|0\rangle|0^k\rangle = |p\rangle|\varphi_p\rangle ,O∣p⟩∣0⟩∣0k⟩=∣p⟩∣φp​⟩,

where measuring the answer qubit of φp\varphi_pφp​ returns the correct membership bit [enc(p)∈K][\mathrm{enc}(p) \in K][enc(p)∈K] with probability at least 1−ϵ′1-\epsilon'1−ϵ′.

Separation oracle. SEPϵ,δ(x)\mathrm{SEP}_{\epsilon,\delta}(x)SEPϵ,δ​(x) (Definition 5.22) must, with probability at least 1−δ1-\delta1−δ, either assert x∈B2(K,ϵ)x \in B_2(K,\epsilon)x∈B2​(K,ϵ) or return a unit vector ggg with ⟨g,y⟩≤⟨g,x⟩+ϵ\langle g, y\rangle \le \langle g, x\rangle + \epsilon⟨g,y⟩≤⟨g,x⟩+ϵ for all y∈B2(K,−ϵ)={y:B2(y,ϵ)⊆K}y \in B_2(K,-\epsilon) = \{y : B_2(y,\epsilon) \subseteq K\}y∈B2​(K,−ϵ)={y:B2​(y,ϵ)⊆K}.

Theorem. There are absolute constants C>0C > 0C>0 and c∈Nc \in \mathbb{N}c∈N with the following property. Let d∈Nd \in \mathbb{N}d∈N and r,R,ϵ,δ∈Rr, R, \epsilon, \delta \in \mathbb{R}r,R,ϵ,δ∈R with 0<r<R0 < r < R0<r<R, 0<ϵ<R0 < \epsilon < R0<ϵ<R and 0<δ<1/30 < \delta < 1/30<δ<1/3. Then there is ϵ′>0\epsilon' > 0ϵ′>0 such that for every x∈Rdx \in \mathbb{R}^dx∈Rd there exist an encoding enc\mathrm{enc}enc and, for every workspace size kkk, a quantum circuit with measurement decoding. The circuit makes at most

C (log⁡(2+d)+log⁡(2+R)+log⁡(2+1/r)+log⁡(2+1/ϵ)+log⁡(2+1/δ))cC\,\bigl(\log(2+d) + \log(2+R) + \log(2+1/r) + \log(2+1/\epsilon) + \log(2+1/\delta)\bigr)^{c}C(log(2+d)+log(2+R)+log(2+1/r)+log(2+1/ϵ)+log(2+1/δ))c

uncontrolled calls to the oracle or its inverse. It correctly implements SEPϵ,δ(x)\mathrm{SEP}_{\epsilon,\delta}(x)SEPϵ,δ​(x) for every convex KKK with B2(0,r)⊆K⊆B2(0,R)B_2(0,r) \subseteq K \subseteq B_2(0,R)B2​(0,r)⊆K⊆B2​(0,R) and x∉B2(K,−ϵ)x \notin B_2(K,-\epsilon)x∈/B2​(K,−ϵ), and for every unitary implementing MEM0,ϵ′(K)\mathrm{MEM}_{0,\epsilon'}(K)MEM0,ϵ′​(K).

Classically, separation from membership needs O~(d)\tilde O(d)O~(d) membership calls. This result gives an exponential improvement in the dimension for the query complexity of convex optimization with a membership oracle.

Formalization Note The source leaves several objects open: the unitary implementing MEM\mathrm{MEM}MEM, the value of ϵ′\epsilon'ϵ′, and the parameters hidden in O~(1)\tilde O(1)O~(1). The statement makes each of them explicit. The unit-norm requirement on ggg is added because Definition 5.22 as printed accepts g=0g = 0g=0, which would make the separation oracle trivial.

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Proposition 5.3: Jordan's gradient circuit recovers the gradient of an exactly representable linear function.
  • Proposition 5.6: The gradient algorithm for approximately linear functions.
  • Proposition 5.16: A Hadamard-test circuit is a probability oracle for (1 + Re⟨ψ|ϕ_x⟩)/2.
  • Corollary 5.18: Pure-state tomography with Euclidean error using Õ(d/ϵ) uses of U.
  • Proposition 5.25: Properties of the height function: convexity, Lipschitz continuity, and separation from an ϵ̄-subgradient (corrected).
  • Lemma 5.28: The central-difference gradient is within (η/2)Δ^(η)f(x) of every subgradient.
  • Lemma 5.30: The Laplace approximation is at most dL/r on average over a cube.
  • Lemma 5.32: Deviation from the finite-difference linearization on the ℓ1 ball is at most (η²/2)Δ^(η)f(z).
  • Proposition 5.31: Finite differences of an approximate function at a random point give an explicit ϵ′-subgradient at the origin (corrected).
  • Proposition 5.36: Algorithm 4 (binary tree of controlled R_Y rotations) prepares the amplitude encoding of a real unit vector.
  • Corollary 5.37: Amplitude encoding of a complex vector to error ϵ with Õ(d) gates from {H, T, CX}.
  • Corollary 5.45: Amplitude encoding with O(log d) QRAM queries and O(log d (log d + log 1/ϵ)) two-qubit gates after Õ(d) classical preprocessing (corrected).
  • Theorem 5.33: Separation oracle from polylogarithmically many calls to a quantum membership oracle (corrected).

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
13 thms2 active usersReviewed
Quantum Information·Captain: Goku

Quantum algorithms for optimizers 4: Quantum minimum finding (Dürr–Høyer), with explicit bit width, interruption and gate modelTextbook

Motivation

This mission develops Chapter 4 of Quantum algorithms for optimizers by Giacomo Nannicini. The chapter's selected results describe the mathematical guarantees below.

Setting and conventions

The linked theorem statements and shared definitions specify the register types, oracle access, normalization, and resource conventions. Their source locators and independent readbacks accompany each target.

Chapter goal

Let f:{0,1}n→Zf : \{0,1\}^n \to \mathbb{Z}f:{0,1}n→Z take values of bit width bbb, i.e. ∣f(j)∣<2b|f(j)| < 2^b∣f(j)∣<2b for all jjj, and let Uf:∣j⟩∣k⟩↦∣j⟩∣k⊕f(j)⟩U_f : |j\rangle|k\rangle \mapsto |j\rangle|k \oplus f(j)\rangleUf​:∣j⟩∣k⟩↦∣j⟩∣k⊕f(j)⟩ evaluate fff in binary. Algorithm 2 with budget TTT starts from a uniformly random incumbent ℓ\ellℓ and repeatedly runs Algorithm 1 (search with an unknown number of marked items) with the marking unitary Um:∣j⟩∣y⟩↦∣j⟩∣y⊕I(f(j)<f(ℓ))⟩U_m : |j\rangle|y\rangle \mapsto |j\rangle|y \oplus \mathbb{I}(f(j) < f(\ell))\rangleUm​:∣j⟩∣y⟩↦∣j⟩∣y⊕I(f(j)<f(ℓ))⟩, replacing ℓ\ellℓ by the returned index kkk whenever f(k)<f(ℓ)f(k) < f(\ell)f(k)<f(ℓ); a call of Algorithm 1 that would exceed the budget is interrupted at the TTT-th application of UfU_fUf​, and the algorithm then returns ℓ\ellℓ. Each application of UmU_mUm​ counts as one application of UfU_fUf​ and is charged 3n+2b+13n + 2b + 13n+2b+1 additional gates; each round of Algorithm 1 with mmm qubits of precision is charged m+m(m+1)/2m + m(m+1)/2m+m(m+1)/2 further gates (Hadamards and the inverse QFT).

There are absolute constants c,C>0c, C > 0c,C>0 such that for every nnn, bbb, every such fff and every δ∈(0,1)\delta \in (0,1)δ∈(0,1) the following holds. Run Algorithm 2 independently k=⌈log⁡3(1/δ)⌉k = \lceil \log_3(1/\delta) \rceilk=⌈log3​(1/δ)⌉ times with budget T=⌈c2n⌉T = \lceil c\sqrt{2^n} \rceilT=⌈c2n​⌉ and output an fff-minimal one of the kkk returned indices. Then:

  1. with probability at least 1−δ1 - \delta1−δ the output is a global minimizer of fff;
  2. on every outcome, the total number of applications of UfU_fUf​ (including the kkk evaluations used to select the output) is at most
C2n (1+log⁡(1/δ)),C\sqrt{2^n}\,\bigl(1 + \log(1/\delta)\bigr),C2n​(1+log(1/δ)),

and the number of additional gates is at most C2n (n+b+1) (1+log⁡(1/δ))C\sqrt{2^n}\,(n + b + 1)\,(1 + \log(1/\delta))C2n​(n+b+1)(1+log(1/δ)).

This is the quadratic quantum speedup for unstructured minimization, the basis of the optimization applications of Grover search.

Formalization Note The source's O~(2n)\tilde O(\sqrt{2^n})O~(2n​) gate bound is stated with the suppressed polylogarithmic factors n+b+1n + b + 1n+b+1 and 1+log⁡(1/δ)1 + \log(1/\delta)1+log(1/δ) explicit, the interruption rule for the budget is made explicit, and TTT, kkk are the choices of the source's proof. Algorithm 1 is the shared formalization of the earlier corollary; the outcome law is a weight on (returned index, applications of UfU_fUf​, gates).

Significance

These are known mathematical results. Their Lean statements have been checked and reviewed against the cited source; formal proofs remain open for contributors.

Supporting targets

  • Theorem 4.6: Amplitude amplification: overlap 2/3 with the good state using O(1/√p) applications of S and R.
  • Corollary 4.9: Search with a known number of marked elements in O(√(2^n/|M|)) oracle calls.
  • Corollary 4.10: Finding all marked elements with O(√(|M| 2^n)) oracle calls.
  • Lemma 4.11: Oblivious amplitude amplification: the partner state Ψ⊥ is orthogonal to |0⟩|ψ⟩ and has no flag-0 support.
  • Theorem 4.12: Oblivious amplitude amplification: each iteration rotates by 2θ.
  • Proposition 4.15: Eigenstates of the Grover operator in amplitude estimation.
  • Proposition 4.19: Angle error to probability error for sin².
  • Proposition 4.21: Error bound of amplitude estimation with m qubits.
  • Corollary 4.22: Amplitude estimation to additive error ε with O(log 1/ε) qubits and O(1/ε) queries.
  • Lemma 4.28: Near-orthogonality of the two amplitude-estimation output states.
  • Theorem 4.29: Quantum search without knowing the number of marked items: O(1/θ) expected queries.
  • Corollary 4.30: Search without knowing |M| with O(√(2^n/|M|)) expected oracle calls.
  • Theorem 4.31: Quantum minimum finding (Dürr–Høyer), with explicit bit width, interruption and gate model.

Formalization scope

Prove the existing statements under their stated hypotheses and definitions. Any correction to a printed source claim remains explicit in its target description. All listed target proofs are currently sorry; no proof is claimed. The mission goal is the designated chapter capstone; the remaining targets are separate milestones. Parts a, b, c and d are merged into their original chapter.

Selected references

  • Giacomo Nannicini, Quantum algorithms for optimizers, 2025, v5; notes dated 9 July 2025. https://arxiv.org/pdf/2408.07086v5.
15 thms2 active usersReviewed
🏆Completed
Probability·Captain: Lucas

Secretary Problem: the 37% RuleTextbook

Motivation

The secretary problem is the standard example of an optimal stopping problem with partial information. It is also known as the marriage problem, the sultan's dowry problem, the fussy suitor problem, the googol game and the best choice problem. It is studied in applied probability, statistics and decision theory. Its solution is often called the 37% rule: a simple rule picks the single best of nnn applicants with probability about 1/e≈0.3681/e \approx 0.3681/e≈0.368, whether there are 100 or 100 million applicants (Wikipedia: Secretary problem). The problem is a standard example of the exploration–exploitation dilemma.

Timeline (as recounted in the Wikipedia article's History section, following Ferguson 1989):

  • 1949: Merrill M. Flood introduces the problem (as the "fiancée problem") in a lecture. It then spreads as folklore through the 1950s.
  • 1958: Flood circulates a letter outlining a proof of the optimal strategy. Its appendix by R. Palermo proves that every strategy is dominated by one of the form "reject the first ppp unconditionally, then accept the next candidate who is better".
  • 1960: First publication, in Martin Gardner's Scientific American column (February 1960), with the analysis supplied by Leo Moser and J. R. Pounder.
  • 1966: Gilbert and Mosteller, "Recognizing the maximum of a sequence", a detailed study of the problem and many variants.
  • 1989: Ferguson, "Who solved the secretary problem?", a historical survey.
  • 2000: Bruss's odds theorem, which the article calls the shortest rigorous proof known.

Setting

There is a single position and there are nnn applicants, where nnn is known. If seen together, the applicants can be ranked from best to worst with no ties. They are interviewed one at a time in a uniformly random order: each of the n!n!n! orders is equally likely. Right after each interview the applicant is either accepted, which ends the process, or rejected for good. The decision may depend only on the relative ranks of the applicants interviewed so far. The objective is to maximize the probability of selecting the best applicant of the whole group.

An order is a permutation σ\sigmaσ of {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1}. The applicant interviewed at time iii has quality σ(i)\sigma(i)σ(i), where larger means better. The relative rank of the applicant interviewed at time jjj is the number of applicants interviewed before time jjj who are worse than them. A stopping rule sss maps the list of relative ranks observed so far to "accept" or "reject". Its success probability Pn(s)P_n(s)Pn​(s) is the fraction of the n!n!n! orders on which the applicant accepted by sss is the overall best. A rule that never accepts anyone fails. The optimal success probability is

Vn=sup⁡sPn(s).V_n = \sup_s P_n(s).Vn​=ssup​Pn​(s).

A candidate is an applicant who is better than every applicant interviewed before them. The cutoff rule with cutoff rrr rejects the first r−1r-1r−1 applicants and then accepts the first candidate after that point.

Formalization targets

Goal: the 37% rule

lim⁡n→∞Vn=1e.\lim_{n\to\infty} V_n = \frac1e .n→∞lim​Vn​=e1​.

Milestones (following the article's derivation)

  1. Pn(cutoff 1)=1/nP_n(\text{cutoff } 1) = 1/nPn​(cutoff 1)=1/n.
  2. For 2≤r≤n2\le r\le n2≤r≤n: Pn(cutoff r)=r−1n∑i=rn1i−1P_n(\text{cutoff } r) = \dfrac{r-1}{n}\displaystyle\sum_{i=r}^{n}\frac{1}{i-1}Pn​(cutoff r)=nr−1​i=r∑n​i−11​.
  3. Some cutoff rule with 1≤r≤n1\le r\le n1≤r≤n is optimal among all rank-based stopping rules.
  4. The table of optimal cutoffs and optimal success probabilities for n=1,…,10n=1,\dots,10n=1,…,10.
  5. If rn/n→x∈[0,1]r_n/n\to x\in[0,1]rn​/n→x∈[0,1], then Pn(cutoff rn)→x∫x1dtt=−xlog⁡xP_n(\text{cutoff } r_n)\to x\int_x^1 \frac{dt}{t} = -x\log xPn​(cutoff rn​)→x∫x1​tdt​=−xlogx.
  6. On [0,1][0,1][0,1] the function −xlog⁡x-x\log x−xlogx has maximum value 1/e1/e1/e, attained only at x=1/ex=1/ex=1/e.
  7. Optimal cutoffs satisfy rn/n→1/er_n/n\to 1/ern​/n→1/e.
  8. Vn≥1/eV_n \ge 1/eVn​≥1/e for every n≥1n\ge 1n≥1.

Significance

The result. The 37% rule is the classical result of optimal stopping. It shows that a fixed fraction of the best possible success probability survives as the number of options grows without bound, and that a simple threshold policy achieves it. The structure of its solution has three parts: optimal rules may be taken to be threshold rules, there is an exact formula in terms of the records of a uniformly random permutation, and a limit turns a harmonic sum into an integral. This structure recurs throughout the best-choice literature, including the prophet-secretary and multi-choice secretary problems.

Formalizing it. The result has been proved since the late 1950s and early 1960s. The remaining work is to formalize the known proof: a model of rank-based stopping rules over uniformly random permutations, the exact success probability of cutoff rules, the optimality of cutoff rules among all rank-based rules, and the asymptotics.

Difficulty

The success probability of a fixed cutoff rule and the calculus limit are elementary. The central step is the optimality of cutoff rules (Milestone 3). A stopping rule may depend arbitrarily on the whole history of relative ranks, and one has to show that no such rule beats the best cutoff rule. Evaluating cutoff rules alone does not prove the goal, because VnV_nVn​ is a supremum over all rank-based rules. A second, smaller difficulty is that the limit statements need control of the harmonic sums along a varying cutoff rnr_nrn​, not only along a fixed ratio.

Formalization scope

  • The sample space is the finite set Equiv.Perm (Fin n) with uniform weights. successProb n s is the ratio (number of winning permutations) / n!n!n! in R\mathbb RR.
  • A stopping rule is a deterministic function List ℕ → Bool, applied to the list of relative ranks observed so far. Through the length of the list it also knows the current time. It never sees absolute qualities. Randomized rules are not modelled. A randomized rule is a mixture of deterministic ones, so it cannot do better.
  • optimalProb n is the real supremum of successProb n s over all such rules. The values lie in [0,1][0,1][0,1], so the supremum is the usual least upper bound.
  • Times are 0-based in Lean (Fin n). Cutoffs rrr are 1-based, as in the article: cutoffRule r accepts at time iii exactly when i+1≥ri+1 \ge ri+1≥r and the current applicant is a candidate.
  • 1/e1/e1/e is written Real.exp (-1).
  • The 1/e-law of best choice (unknown number of applicants, Bruss 1984), the odds algorithm, cardinal-payoff variants and the other generalizations in the article are outside this mission.

All declarations live in the namespace ClassicalSecretary. Reusable contributions are welcome, in particular facts about records of uniformly random permutations (independence of relative ranks, the probability that position iii is a record) and a backward-induction principle for finite-horizon stopping problems.

Selected references

  • Wikipedia contributors, Secretary problem, sections "Formulation" and "Deriving the optimal policy". https://en.wikipedia.org/wiki/Secretary_problem
  • T. S. Ferguson, Who solved the secretary problem?, Statistical Science 4(3), 282–289, 1989. https://doi.org/10.1214/ss/1177012493
  • J. Gilbert, F. Mosteller, Recognizing the maximum of a sequence, Journal of the American Statistical Association 61(313), 35–73, 1966. https://doi.org/10.2307/2283044
  • F. T. Bruss, Sum the odds to one and stop, Annals of Probability 28(3), 1384–1391, 2000. https://doi.org/10.1214/aop/1019160340
10 thms2 active usersReviewed
PreviousPage 22 of 67Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me