Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Optimization

1,819 missions · 1,088 completed

Missions

Open731Completed1088All1819
Operations ResearchQuantum Information·Captain: mikedeng1

An Optimal Product-State Approximation for 2-Local Quantum Hamiltonians with Positive Terms: Rounding Level 2 of the Quantum Lasserre Hierarchy Gives a 1/2-Approximation for Quantum Max CutResearch Paper

Motivation

Quantum Max Cut assigns a qubit to each vertex of a weighted graph and a two-qubit energy term to each edge. It asks for a quantum state with high total energy. The problem is a quantum analogue of graph Max Cut, but states can be entangled and edge terms act on a Hilbert space whose dimension grows exponentially with the number of vertices. Approximation algorithms therefore need a compact way to reason about the best quantum state without describing that state explicitly. Gharibian and Parekh's 2019 algorithm used product-state rounding for a quantum Max Cut relaxation; Parekh and Thompson's level-2 work showed why stronger quantum relaxations matter. The present paper combines a level-2 relaxation with a different treatment of highly valued edges to obtain a one-half guarantee.

The target is a known result from the pinned version arXiv:2206.08342v2, not an open conjecture. This mission isolates its Quantum Max Cut theorem. The paper also treats other positive 2-local Hamiltonians and a separate guarantee for graphs of prescribed minimum degree; neither is part of this target.

Setting

Let G=(V,E)G=(V,E)G=(V,E) be a finite undirected graph with a nonnegative weight wijw_{ij}wij​ on each edge, and put one qubit at each vertex. Write Xi,Yi,ZiX_i,Y_i,Z_iXi​,Yi​,Zi​ for the three Pauli operators acting on qubit iii. The edge Hamiltonian and total Quantum Max Cut Hamiltonian are

Hij=I−XiXj−YiYj−ZiZj4,H=∑{i,j}∈EwijHij.H_{ij}=\frac{I-X_iX_j-Y_iY_j-Z_iZ_j}{4},\qquad H=\sum_{\{i,j\}\in E}w_{ij}H_{ij}.Hij​=4I−Xi​Xj​−Yi​Yj​−Zi​Zj​​,H={i,j}∈E∑​wij​Hij​.

Every undirected edge appears once. A density matrix σ\sigmaσ is positive semidefinite with trace one. Its energy is Tr⁡(Hσ)\operatorname{Tr}(H\sigma)Tr(Hσ), and λmax⁡(H)\lambda_{\max}(H)λmax​(H) is the largest energy attainable by any density matrix, including an entangled one.

A Pauli polynomial is a real linear combination of tensor products of I,X,Y,ZI,X,Y,ZI,X,Y,Z. A monomial's degree counts its nonidentity factors. A kkk-positive pseudo-density ρ~\widetilde\rhoρ​ is Hermitian, has trace one, and satisfies Tr⁡(ρ~P2)≥0\operatorname{Tr}(\widetilde\rho P^2)\ge0Tr(ρ​P2)≥0 for every Pauli polynomial PPP of degree at most kkk. The level-2 quantum Lasserre relaxation maximizes Tr⁡(Hρ~)\operatorname{Tr}(H\widetilde\rho)Tr(Hρ​) over all such pseudo-densities. It is an upper bound on the unrestricted quantum optimum, even though ρ~\widetilde\rhoρ​ itself need not be positive semidefinite. These definitions are from pp. 6–8 of the paper.

For an edge, its relaxed value is μij=Tr⁡(Hijρ~)\mu_{ij}=\operatorname{Tr}(H_{ij}\widetilde\rho)μij​=Tr(Hij​ρ​). The rescaled value vijv_{ij}vij​ is defined by μij=(1+3vij)/4\mu_{ij}=(1+3v_{ij})/4μij​=(1+3vij​)/4. Algorithm 4 chooses a threshold γ\gammaγ, puts every edge with vij>γv_{ij}>\gammavij​>γ in LLL, and calls vertices incident to no edge in LLL the set BBB. It assigns the two-qubit mixed state (I−ZiZj)/4(I-Z_iZ_j)/4(I−Zi​Zj​)/4 to each edge in LLL. Vertices in BBB receive single-qubit states obtained by normalizing three independent Gaussian projections of the relaxation's rounding vectors. The output ρ\rhoρ is the product of those factors, as in equation (5), p. 14. The large edges form a matching at the selected threshold, so those factors occupy disjoint qubits. The Gaussian draw is the algorithm's only randomness.

Formalization targets

Theorem 3: a one-half approximation

The goal is the paper's Theorem 3, p. 17. A single threshold must work for every graph and every nonnegative edge weighting:

∃γ∈(−1/3,1]∀H of the form above,ETr⁡(HρAlg4)≥12λmax⁡(H).\exists\gamma\in(-1/3,1]\quad \forall H\text{ of the form above},\qquad \mathbb E\operatorname{Tr}(H\rho_{\mathrm{Alg4}}) \ge \frac12\lambda_{\max}(H).∃γ∈(−1/3,1]∀H of the form above,ETr(HρAlg4​)≥21​λmax​(H).

The level-2 solution used by Algorithm 4 is optimal for the given HHH. The goal also says that the matrix output is a density matrix for every Gaussian outcome. Its threshold is existential because the theorem does not fix a decimal constant; the paper subsequently selects 0.9110.9110.911 for its analysis.

Supporting results

The fourteen milestones follow the order in which the proof of Theorem 3 uses them.

  1. Relaxation and assembly. Lemma 9 (p. 28): the level-kkk value νk(H)\nu_k(H)νk​(H) is at least λmax⁡(H)\lambda_{\max}(H)λmax​(H). Proposition 1 (p. 9), for strictly quadratic 2-local Hamiltonians (Definition 3): if Tr⁡(Hijρ)≥αμij\operatorname{Tr}(H_{ij}\rho)\ge\alpha\mu_{ij}Tr(Hij​ρ)≥αμij​ on every edge, then Tr⁡(Hρ)≥αλmax⁡(H)\operatorname{Tr}(H\rho)\ge\alpha\lambda_{\max}(H)Tr(Hρ)≥αλmax​(H). Lemma 5 (p. 17): μij∈[0,1]\mu_{ij}\in[0,1]μij​∈[0,1], vij∈[−1/3,1]v_{ij}\in[-1/3,1]vij​∈[−1/3,1], sij∈[−1,1]s_{ij}\in[-1,1]sij​∈[−1,1] for k≥2k\ge2k≥2.
  2. Edges inside BBB. Lemma 4 (p. 12): for a k×dk\times dk×d standard Gaussian matrix ZZZ and unit u,vu,vu,v,
E[Zu∥Zu∥⋅Zv∥Zv∥]=F(k,u⋅v),F(k,t)=2k(Γ(k+12)Γ(k2))2t 2F1(12,12;k2+1;t2).\mathbb E\Big[\tfrac{Zu}{\|Zu\|}\cdot\tfrac{Zv}{\|Zv\|}\Big]=F(k,u\cdot v),\qquad F(k,t)=\frac2k\Big(\frac{\Gamma(\frac{k+1}2)}{\Gamma(\frac k2)}\Big)^2t\,{}_2F_1\big(\tfrac12,\tfrac12;\tfrac k2+1;t^2\big).E[∥Zu∥Zu​⋅∥Zv∥Zv​]=F(k,u⋅v),F(k,t)=k2​(Γ(2k​)Γ(2k+1​)​)2t2​F1​(21​,21​;2k​+1;t2).

Equation (7) (p. 17): Gaussian product-state rounding earns (1+F(3,vij))/4(1+F(3,v_{ij}))/4(1+F(3,vij​))/4 in expectation on edge ijijij. Lemma 6 (p. 18) reduces min⁡v∈(−1/3,γ](1+F(3,v))/(1+3v)≥1/2\min_{v\in(-1/3,\gamma]}(1+F(3,v))/(1+3v)\ge1/2minv∈(−1/3,γ]​(1+F(3,v))/(1+3v)≥1/2 to two checks at γ\gammaγ; Definition 13 (p. 19) asserts that γ=0.911\gamma=0.911γ=0.911 passes them; Fact 1 (p. 16) is the resulting factor 1/21/21/2 on edges with both ends in BBB. 3. Monogamy. The 4×44\times44×4 SWAP Gram matrix M(p,q,r)M(p,q,r)M(p,q,r) of three qubits is positive semidefinite (p. 20). Lemma 8 (p. 22): M⪰0M\succeq0M⪰0 and q≤0q\le0q≤0 imply p≥−3/2p\ge-\sqrt3/2p≥−3​/2. Fact 2 (p. 16): if vij>0.911v_{ij}>0.911vij​>0.911 then vik<1/3v_{ik}<1/3vik​<1/3. Remark 3 (p. 19): the large edges form a matching. 4. Edges touching LLL. Equation (12) (p. 19): (I−Z⊗Z)/4(I-Z\otimes Z)/4(I−Z⊗Z)/4 earns 1/2≥μij/21/2\ge\mu_{ij}/21/2≥μij​/2 on a large edge. The last display of the proof of Theorem 3 (p. 19): an edge adjacent to LLL earns exactly 1/4>μij/21/4>\mu_{ij}/21/4>μij​/2.

Significance

The theorem guarantees half of the optimum over all quantum states while returning a state built from one- and two-qubit product factors. This is stronger than a guarantee relative only to the best product state: the benchmark permits entanglement. It also explains why a level-2 relaxation has algorithmic value for this problem. The comparison and the claimed approximation factor are established in the paper; formalizing them would leave a reusable verified interface for finite-qubit Pauli polynomials, pseudo-densities, and Gaussian product-state rounding.

The formal work still needed is a machine-checked proof of the known theorem and its milestones. The published register, Pauli, density-matrix and standard-Gaussian-vector definitions can be reused. The source's separate results for other positive 2-local Hamiltonians would need additional models and theorems, beyond this mission.

Difficulty

Level-1 Gaussian product-state rounding alone does not reach one half uniformly: the paper identifies an edge range where its ratio falls below 0.50.50.5. Large edge values cannot be handled by the same rounding estimate. A level-2 pseudo-density supplies stronger constraints between adjacent edges, but it is not itself a physical state, so ordinary positivity of ρ~\widetilde\rhoρ​ is unavailable. The source's SWAP matrix and threshold analysis express the needed restrictions. The paper's printed dual certificate for Lemma 8 has a coordinate-order erratum; the lemma's statement remains the target.

Formalization scope

Qubits are indexed by Fin n (the paper uses 1,…,n1,\ldots,n1,…,n), with basis Fin n → Bool. Operators are complex matrices. The real part of a trace represents the expectation of a Hermitian expression. The maximum eigenvalue is stated through comparison with every density matrix; for Hermitian HHH, this is equivalent to comparing with its largest eigenvalue. Expected energy is a Bochner integral over a probability measure carrying independent standard Gaussian coordinates. A zero Gaussian projection is assigned Bloch vector zero, giving the maximally mixed one-qubit state at that outcome.

The rounding vectors are given with unit norms and exactly the Gram matrix obtained from the level-2 solution. The output state is computed as the matrix product in equation (5); energy is traced against that matrix. Positivity is required for every real degree-2 Pauli polynomial, and the pseudo-density is required to be optimal. These choices exclude vacuous variants based on degree-1 positivity, free Bloch vectors, or edge energies supplied as assumptions. The finite operator model also covers an empty graph; the approximation inequality there is 0≥00\ge00≥0.

The statement formalizes the approximation guarantee and state validity. The polynomial running-time clause of the paper's general approximation definition is outside this Lean statement. Reusable contributions include the Pauli-polynomial interface, matrix and moment identities for pseudo-densities, integrability and measurability facts for the Gaussian rounding, and the SWAP semidefinite bound.

Selected references

  • Ojas Parekh and Kevin Thompson, An Optimal Product-State Approximation for 2-Local Quantum Hamiltonians with Positive Terms, arXiv preprint, 2022, version 2 dated 2026. arXiv:2206.08342.
  • Sevag Gharibian and Ojas Parekh, Almost Optimal Classical Approximation Algorithms for a Quantum Generalization of Max-Cut, APPROX/RANDOM, 2019. DOI:10.4230/LIPIcs.APPROX-RANDOM.2019.31.
  • Ojas Parekh and Kevin Thompson, Application of the Level-2 Quantum Lasserre Hierarchy in Quantum Approximation Algorithms, ICALP, 2021. arXiv:2105.05698.
  • Jop Briët, Fernando Mário de Oliveira Filho and Frank Vallentin, Grothendieck Inequalities for Semidefinite Programs with Rank Constraint, Theory of Computing 10, 2014, 77–105. Journal article.
22 thms0 active usersReviewed
Quantum InformationTheoretical Computer Science·Captain: mikedeng1

Optimizing Quantum Circuit Parameters via SDP: Algorithm 1 Is a 0.562-Approximation for Quantum Max CutResearch Paper

Motivation

Quantum Max Cut asks for the highest energy of a two-qubit interaction Hamiltonian placed on the edges of a weighted graph. It is a quantum analogue of Max Cut: a classical cut assigns one of two labels to each vertex, while a quantum state can use correlations and entanglement across the qubits. Lee studies an approximation algorithm that first solves a semidefinite program and then uses its vectors to choose both a bit string and the angles of a quantum circuit. The result applies to arbitrary nonnegatively weighted simple graphs, without a degree or regularity restriction. The guarantee is an approximation ratio of 0.5620.5620.562 for the energy of the algorithm's random output in expectation Lee, 2022, pp. 9–13.

The paper places this algorithm alongside earlier approaches that round a level-one or level-two quantum Lasserre program. Its distinguishing object is a circuit with one parameter per graph edge, computed from the SDP vectors rather than optimized over circuit angles after rounding. The parameter rule makes a global approximation guarantee possible even when neighboring edge gates interfere Lee, 2022, pp. 3–5, 9.

Setting

Let G=(V,E,w)G=(V,E,w)G=(V,E,w) be a finite simple graph with nonnegative weights wijw_{ij}wij​. Associate one qubit with each vertex. On qubit iii, let Xi,Yi,ZiX_i,Y_i,Z_iXi​,Yi​,Zi​ be the standard Pauli operators, and let III be the identity. Each edge contributes

Hij=14(I−XiXj−YiYj−ZiZj),H=∑(i,j)∈EwijHij.H_{ij}=\frac14(I-X_iX_j-Y_iY_j-Z_iZ_j),\qquad H=\sum_{(i,j)\in E}w_{ij}H_{ij}.Hij​=41​(I−Xi​Xj​−Yi​Yj​−Zi​Zj​),H=(i,j)∈E∑​wij​Hij​.

For a unit state ∣ψ⟩|\psi\rangle∣ψ⟩, its energy is ⟨ψ∣H∣ψ⟩\langle\psi|H|\psi\rangle⟨ψ∣H∣ψ⟩. The Quantum Max Cut optimum is the largest eigenvalue of HHH, equivalently the largest energy over all unit states Lee, 2022, Definition 2, p. 2.

The paper's canonical Lasserre program at level kkk uses a real positive semidefinite matrix MMM indexed by Pauli strings of weight at most kkk. Its constraints make matrix entries consistent with products of Pauli strings. At level two, its objective has one term for each of XiXjX_iX_jXi​Xj​, YiYjY_iY_jYi​Yj​, and ZiZjZ_iZ_jZi​Zj​ on every edge. Lemma 1 places all quantum-state energies below feasible Lasserre objectives. The paper then introduces a vector semidefinite program (S). It uses a unit vector v0v_0v0​, vectors vi,av_{i,a}vi,a​ for vertices and a∈{1,2,3}a\in\{1,2,3\}a∈{1,2,3}, and vectors vij,av_{ij,a}vij,a​ for pairs of distinct vertices. Relations (1)–(8) fix their norms and inner products. Writing vij=∑avij,av_{ij}=\sum_a v_{ij,a}vij​=∑a​vij,a​, its objective is

S(G;v)=∑(i,j)∈Ewij4(v0−vij)⋅v0.S(G;v)=\sum_{(i,j)\in E}\frac{w_{ij}}4(v_0-v_{ij})\cdot v_0.S(G;v)=(i,j)∈E∑​4wij​​(v0​−vij​)⋅v0​.

Lemma 2 shows that (S) relaxes the level-two Lasserre program Lee, 2022, Definitions 3–5 and Lemmas 1–2, pp. 3–6.

Algorithm 1 takes an optimal feasible solution of (S). It picks a∈{1,2,3}a\in\{1,2,3\}a∈{1,2,3} uniformly, chooses a random direction rrr, and sets bit ziz_izi​ by the sign of vi,a⋅rv_{i,a}\cdot rvi,a​⋅r. For each edge it computes the normalized correlation

γij=−(v0+vij)⋅v0∥v0+vij∥∥v0∥,θij=12arccos⁡(exp⁡[−0.041max⁡(γij,0)]).\gamma_{ij}=-\frac{(v_0+v_{ij})\cdot v_0}{\|v_0+v_{ij}\|\|v_0\|},\qquad \theta_{ij}=\frac12\arccos\bigl(\exp[-0.041\max(\gamma_{ij},0)]\bigr).γij​=−∥v0​+vij​∥∥v0​∥(v0​+vij​)⋅v0​​,θij​=21​arccos(exp[−0.041max(γij​,0)]).

It starts in the computational basis state ∣z⟩|z\rangle∣z⟩ and applies the commuting edge gates exp⁡(iθijP(i)P(j))\exp(i\theta_{ij}P(i)P(j))exp(iθij​P(i)P(j)), with P(i)=XiP(i)=X_iP(i)=Xi​ when zi=1z_i=1zi​=1 and P(i)=YiP(i)=Y_iP(i)=Yi​ when zi=0z_i=0zi​=0. The result is a random state ∣ϕ(θ)⟩|\phi(\theta)\rangle∣ϕ(θ)⟩ Lee, 2022, Algorithm 1, p. 9.

Formalization targets

The goal is the expectation form of Theorem 1. For every nonnegatively weighted graph, every globally optimal feasible SDP solution vvv, and every unit quantum state ∣ψ⟩|\psi\rangle∣ψ⟩,

E ⟨ϕ(θ)∣H∣ϕ(θ)⟩≥0.562 ⟨ψ∣H∣ψ⟩.\mathbb E\,\langle\phi(\theta)|H|\phi(\theta)\rangle \ge 0.562\,\langle\psi|H|\psi\rangle.E⟨ϕ(θ)∣H∣ϕ(θ)⟩≥0.562⟨ψ∣H∣ψ⟩.

The goal also states that the random energy is integrable. Because the inequality holds for every unit ∣ψ⟩|\psi\rangle∣ψ⟩, it is exactly the comparison with 0.5620.5620.562 times the maximum eigenvalue. The printed theorem omits the expectation sign, while its proof explicitly averages the rounded output Lee, 2022, Theorem 1 and proof, pp. 10–11.

The milestones are the source's relaxation lemmas, the feasible-vector identities, the star monogamy bound, the hyperplane cut-probability bound, the circuit's edge-energy bound, equations (19) and (21)–(24), the final scalar minimum, and the per-solution expected-energy bound. Their order moves from the Hamiltonian and SDP model to the output of Algorithm 1. The coefficient 0.5620.5620.562 and the parameter 0.0410.0410.041 are the paper's values, not tunable placeholders.

Significance

Together, the two relaxation lemmas connect the quantum optimum to the objective optimized by (S). The rounding results then connect a feasible SDP value to a physically represented output state. The theorem certifies a constant approximation ratio for arbitrary weighted graphs in the model of the paper. The star monogamy inequality and edge-energy lemma also isolate claims useful for analyzing related rounding circuits Lee, 2022, Lemmas 1–6, pp. 4–10.

This result is proved in the cited paper. The mission asks for machine-checked proofs of its statements and for the model that makes those statements precise. Its definitions of Pauli strings, the quantum Hamiltonian, canonical Lasserre feasibility, the vector SDP, and the rounded circuit can support later comparisons of SDP-based quantum approximation algorithms. The draft statements compile, but a compiling sorry is not a proof; the theorem and milestones remain open formalization targets.

Difficulty

Bounding the probability that a rounded bit string cuts an edge is only one part of the argument. Its circuit gate acts on the same qubits as gates at neighboring edges. Consequently, a good cut probability alone does not determine the energy on that edge. The monogamy bound limits how much SDP value can be concentrated around a vertex, while the edge-energy statement accounts for the neighboring gate parameters. A formal proof must also connect matrix feasibility, vector feasibility, Gaussian rounding, and complex matrix expectations without losing the edge weights or the factor 1/41/41/4 Lee, 2022, pp. 7–13.

Formalization scope

Vertices are Fin n, computational basis labels are bit strings Fin n → Fin 2, and Pauli strings are maps Fin n → Fin 4. The graph is simple; each edge occurs once, with its smaller endpoint first. Only that orientation's weight is read. The vector SDP uses Fin N → ℝ, and its feasibility predicate states relations (1)–(8) with distinct-index conditions. The ordered-pair implementation of vij,av_{ij,a}vij,a​ includes symmetry, making the paper's undirected edge indexing explicit. Optimality in the goal compares feasible solutions across every finite dimension, so a solution optimal only in a small dimension cannot satisfy the intended premise.

The random direction is a standard Gaussian vector. Its signs have the same distribution as the signs from a direction uniform on the sphere; a zero projection gives bit zero. The circuit uses the cosine-sine form of each Pauli-product exponential and a lexicographic edge order. Its gates commute, so the chosen order represents the paper's product. The expectation averages the three choices of aaa and integrates over the Gaussian vector. The goal includes integrability, and its universal unit-state comparison avoids a supremum with a default value on a bad domain.

Three source boundaries are stated explicitly. The Lasserre objective requires k≥2k\ge2k≥2 because it indexes two-qubit Pauli strings. Lemma 6 requires 0≤θij≤π/40\le\theta_{ij}\le\pi/40≤θij​≤π/4 on edges; the printed nonnegative-angle condition is too broad, while Algorithm 1 always gives angles in that interval. Definition 4's repeated ZiZjZ_iZ_jZi​Zj​ objective term is read as YiYjY_iY_jYi​Yj​, as required by the Hamiltonian and its appendix calculation. The Goemans–Williamson quotient uses [−1,1)[-1,1)[−1,1) since the printed closed endpoint t=1t=1t=1 gives 0/00/00/0. A single arbitrary feasible SDP solution cannot replace the globally optimal one in the final comparison with the quantum optimum, and a deterministic bound for every random outcome is not asserted.

Contributions that establish the two relaxation maps, the vector identities, the Gaussian cut bound, the circuit's local energy bound, and the final expected-energy comparison all belong to this mission. Proofs of the paper's polynomial running-time claim and cited hardness results are outside the formal statements here.

Selected references

  • Eunou Lee, Optimizing quantum circuit parameters via SDP, arXiv preprint, 2022, arXiv:2209.00789v1.
13 thms0 active usersReviewed
Operations ResearchProbability·Captain: mikedeng1

Role of Risk Aversion in Price Postponement Under Supply Random Yield: Ex Ante and Responsive Pricing Share One CVaR Risk-Aversion ThresholdResearch Paper

Motivation

Many manufacturing processes deliver only a random fraction of what they start: semiconductor wafers, biologics, agricultural produce and recycled materials all suffer random yield. A firm facing yield risk has two classical levers. It can inflate production to hedge against low yield, and it can postpone pricing until the yield is observed, so that the price clears whatever was actually produced. The operations literature has long studied both levers for a risk-neutral firm, starting from the price-setting newsvendor (Petruzzi and Dada, 1999).

Real firms, and especially small producers exposed to a single bad harvest or batch, care about low-profit outcomes more than about the mean. Kouvelis, Xiao and Yang (Management Science, 2021) model this with the conditional value-at-risk (CVaR) of profit, the criterion introduced by Rockafellar and Uryasev (2000) and used for newsvendor problems by Chen, Xu and Zhang (2009). Their first finding is that a sufficiently risk-averse firm does not produce at all, and that the risk level at which production stops is the same whether or not the firm can postpone its price. This mission formalizes that finding.

Setting

A monopoly firm sells one product to a market with deterministic demand d(p)d(p)d(p), continuous and strictly decreasing in the price p∈[0,p0]p\in[0,p_0]p∈[0,p0​], where p0>0p_0>0p0​>0 is the maximal allowable price, d(p0)=0d(p_0)=0d(p0​)=0. The inverse demand p(x)p(x)p(x) satisfies p(d(p))=pp(d(p))=pp(d(p))=p and d(p(x))=xd(p(x))=xd(p(x))=x for x∈[0,d(0)]x\in[0,d(0)]x∈[0,d(0)]. Assumption 2 of the paper requires the revenue x↦p(x) xx\mapsto p(x)\,xx↦p(x)x to be concave on [0,d(0)][0,d(0)][0,d(0)].

Producing qqq units of input costs cqcqcq and yields qξq\xiqξ sellable units. The yield factor ξ\xiξ is a continuous random variable with law ν\nuν, support [l,u][l,u][l,u] with 0≤l<u≤10\le l<u\le10≤l<u≤1, c.d.f. GGG and mean μ\muμ. The cost satisfies 0≤c≤p0μ0\le c\le p_0\mu0≤c≤p0​μ, so that production is not hopeless. Write G−1(η)=inf⁡{x:G(x)≥η}G^{-1}(\eta)=\inf\{x:G(x)\ge\eta\}G−1(η)=inf{x:G(x)≥η} for the lower quantile and

g(η)=1η∫lG−1(η)ξ dG(ξ),η∈(0,1],g(\eta)=\frac1\eta\int_l^{G^{-1}(\eta)}\xi\,dG(\xi),\qquad \eta\in(0,1],g(η)=η1​∫lG−1(η)​ξdG(ξ),η∈(0,1],

for the mean of the lowest η\etaη-fraction of yields.

For a random profit π\piπ and a risk level η∈(0,1]\eta\in(0,1]η∈(0,1],

CVaRη(π)=max⁡v∈R{v+1η Emin⁡{π−v,0}},\mathrm{CVaR}_\eta(\pi)=\max_{v\in\mathbb R}\Big\{v+\frac1\eta\,\mathbb E\min\{\pi-v,0\}\Big\},CVaRη​(π)=v∈Rmax​{v+η1​Emin{π−v,0}},

the average profit over the worst η\etaη-fraction of outcomes; η=1\eta=1η=1 is risk neutrality and smaller η\etaη means more risk aversion.

Under ex ante pricing the firm picks pa∈[0,p0]p_a\in[0,p_0]pa​∈[0,p0​] and qa≥0q_a\ge0qa​≥0 before the yield realizes and maximizes Πa(pa,qa)=CVaRη(pamin⁡{d(pa),qaξ}−cqa)\Pi_a(p_a,q_a)=\mathrm{CVaR}_\eta\big(p_a\min\{d(p_a),q_a\xi\}-cq_a\big)Πa​(pa​,qa​)=CVaRη​(pa​min{d(pa​),qa​ξ}−cqa​). Under responsive pricing it picks qr≥0q_r\ge0qr​≥0, observes ξ\xiξ, then picks the revenue-maximizing price, and maximizes

Πr(qr)=CVaRη(max⁡pr∈[0,p0]prmin⁡{d(pr),qrξ}−cqr).\Pi_r(q_r)=\mathrm{CVaR}_\eta\Big(\max_{p_r\in[0,p_0]}p_r\min\{d(p_r),q_r\xi\}-cq_r\Big).Πr​(qr​)=CVaRη​(pr​∈[0,p0​]max​pr​min{d(pr​),qr​ξ}−cqr​).

Since q=0q=0q=0 gives CVaR 000, the firm produces under a scheme when some decision has strictly positive CVaR, and otherwise not producing is optimal.

Formalization targets

Goal: one threshold for both schemes (Proposition 4(i))

There is a single η∗∈[0,1]\eta^*\in[0,1]η∗∈[0,1], either η∗=0\eta^*=0η∗=0 or a solution of p0 g(η∗)=cp_0\,g(\eta^*)=cp0​g(η∗)=c, such that for every η∈(0,1]\eta\in(0,1]η∈(0,1]

ex ante firm produces  ⟺  η>η∗  ⟺  responsive firm produces.\text{ex ante firm produces}\iff\eta>\eta^*\iff\text{responsive firm produces}.ex ante firm produces⟺η>η∗⟺responsive firm produces.

This is the paper's ηa∗(p0,c)=ηr∗(p0,c)\eta_a^*(p_0,c)=\eta_r^*(p_0,c)ηa∗​(p0​,c)=ηr∗​(p0​,c), with the boundary case η=η∗\eta=\eta^*η=η∗ stated correctly (there the optimal CVaR is 000, so the firm is indifferent and "produces" in the strict sense fails).

Milestones

  1. Property 1: for a continuously distributed profit, the maximization formula equals the tail mean E[π∣π≤VaRη(π)]\mathbb E[\pi\mid\pi\le\mathrm{VaR}_\eta(\pi)]E[π∣π≤VaRη​(π)], attained at v=VaRη(π)v=\mathrm{VaR}_\eta(\pi)v=VaRη​(π).
  2. Property 2: the CVaR of a profit concave in the decision is concave in the decision.
  3. Proposition 1: at a fixed price pap_apa​, the optimal ex ante quantity is d(pa)/δd(p_a)/\deltad(pa​)/δ above a threshold price p~\tilde pp~​ and 000 below it.
  4. The tail mean ggg: strictly increasing and continuous on (0,1](0,1](0,1], with g(1)=μg(1)=\mug(1)=μ and g(0+)=lg(0^+)=lg(0+)=l.
  5. Proposition 2: the ex ante threshold ηa∗\eta_a^*ηa∗​.
  6. Lemma 1: the responsive firm's second-stage price is p(min⁡{qrξ,d∗})p(\min\{q_r\xi,d^*\})p(min{qr​ξ,d∗}), where d∗d^*d∗ maximizes revenue.
  7. Proposition 3: Πr\Pi_rΠr​ is concave and the responsive threshold ηr∗\eta_r^*ηr∗​ exists.

Significance

The result says that price postponement, although it raises the profit of a firm that does produce, does not enlarge the set of risk-averse firms willing to produce. The threshold is explicit: η∗=0\eta^*=0η∗=0 when p0l>cp_0l>cp0​l>c, and otherwise η∗\eta^*η∗ solves g(η)=c/p0g(\eta)=c/p_0g(η)=c/p0​. Because ggg depends only on the yield law, the threshold separates cost and price power (c/p0c/p_0c/p0​) from yield risk (ggg), which is what the paper's comparative statics in ccc, p0p_0p0​ and the yield distribution (Proposition 4(ii)–(iv)) build on.

The mission states the paper's threshold results and its two CVaR properties in Lean. None of them is machine-checked anywhere. Proofs of the milestones would also provide a reusable CVaR toolkit on a general probability space: the identification of the maximization formula with the lower-tail mean, and concavity of CVaR in a decision parameter.

Difficulty

The paper's argument uses densities and derivatives throughout: g′(η)>0g'(\eta)>0g′(η)>0, a first-order condition at q=0q=0q=0, L'Hospital's rule for g(0+)g(0^+)g(0+). The model here assumes only an atomless law with full support, so every such step has to be replaced by a measure-theoretic one. CVaR is a supremum of integrals over an unbounded index, so comparisons between the two schemes cannot be read off a closed form. The responsive profit is itself a maximum over prices inside an expectation inside a supremum. Finally, the two schemes have different optimal decisions everywhere except in the limit of vanishing production, so an argument that compares optimal values fails: the content is in comparing whether positive CVaR is attainable at all.

Formalization scope

  • The yield is its law ν : Measure ℝ: a probability measure without atoms (NullSingletonClass), with ν [l,u]ᶜ = 0 and positive mass on every open subinterval of [l,u]. The paper's density is not assumed. Expectations are Bochner integrals against ν.
  • p0p_0p0​ is a finite positive real (the paper also allows p0=∞p_0=\inftyp0​=∞). Demand d and inverse demand P are two functions with both inverse identities on their intervals.
  • CVaR (RiskPostpone.Threshold.cvar) is the real supremum over v∈Rv\in\mathbb Rv∈R of the bracket. The model's profits are bounded on the support, so the supremum is genuine there; the general CVaR properties assume integrability. VaR and the yield quantile use the published MultistageStochastic.valueAtRisk.
  • The responsive maximum is the sSup of the image of [0,p0][0,p_0][0,p0​], which is nonempty and bounded.
  • "Produces" is strict: some decision has CVaR >0>0>0. With ≥\ge≥ the statement would be trivially true at q=0q=0q=0; with a CVaR supremum that could be junk 000, or with two separate thresholds for the two schemes, the goal would lose its content. All three formalizations are ruled out.
  • Assumption 1 of the paper (an IGFR-type condition and increasing price elasticity) is used only for the uniqueness of the optimal ex ante price and is not assumed. Assumption 2 is stated without "twice differentiable". In Lemma 1, d∗d^*d∗ is any maximizer of revenue on [0,d(0)][0,d(0)][0,d(0)] rather than the root of the first-order condition. Proposition 1 excludes the degenerate case c=0=lc=0=lc=0=l (there the optimal quantity does not exist). Property 1 assumes the profit is integrable, essentially bounded above and atomless.
  • Not formalized: the first-order conditions of Propositions 2(ii) and 3(ii), Proposition 4(ii)–(iv), Corollaries 1–4, the linear-demand comparisons of §5.2–§5.4, and the extensions of §7.

Contributions welcome: proofs of the milestones, especially the general CVaR facts (Properties 1 and 2) and the measure-theoretic properties of ggg, which are reusable beyond this model.

Selected references

  • P. Kouvelis, G. Xiao, N. Yang, Role of Risk Aversion in Price Postponement under Supply Random Yield, Management Science 67(8), 4826–4844, 2021. https://doi.org/10.1287/mnsc.2020.3755 (formalized from the accepted manuscript MS-OPM-18-01273.R2)
  • R. T. Rockafellar, S. Uryasev, Optimization of conditional value-at-risk, Journal of Risk 2(3), 21–41, 2000. https://doi.org/10.21314/JOR.2000.038
  • R. T. Rockafellar, S. Uryasev, Conditional value-at-risk for general loss distributions, Journal of Banking & Finance 26(7), 1443–1471, 2002. https://doi.org/10.1016/S0378-4266(02)00271-6
  • Y. Chen, M. Xu, Z. G. Zhang, A risk-averse newsvendor model under the CVaR criterion, Operations Research 57(4), 1040–1044, 2009. https://doi.org/10.1287/opre.1080.0603
  • N. C. Petruzzi, M. Dada, Pricing and the newsvendor problem: a review with extensions, Operations Research 47(2), 183–194, 1999. https://doi.org/10.1287/opre.47.2.183
11 thms0 active usersReviewed
AlgebraLinear algebra·Captain: mikedeng1

Invariant Semidefinite Programs: Every Matrix ∗-Algebra Is ∗-Isomorphic to a Direct Sum of Full Matrix AlgebrasResearch Paper

Motivation

Semidefinite programs that arise in coding theory, extremal geometry, crossing-number bounds and polynomial optimization are often too large to solve directly, but they are invariant under a large symmetry group. Restricting the matrix variable to the invariant matrices loses nothing, and the invariant matrices form a matrix ∗-algebra. The survey of Bachoc, Gijswijt, Schrijver and Vallentin (arXiv:1007.2905, published in the Handbook on Semidefinite, Conic and Polynomial Optimization, Springer, 2012) organizes this symmetry reduction into steps. Its Step 2 (§1.2, pp. 5–7) replaces an SDP over such an algebra by an SDP over a few small blocks, and the justification of that step is a single structure theorem: every matrix ∗-algebra is ∗-isomorphic to a direct sum of full matrix algebras (Theorem 1.2, restated as Theorem 2.7 on p. 13).

The theorem is classical. It is the finite-dimensional case of the structure theory of C∗-algebras (Davidson, C∗-Algebras by Example, Chapter I.10), and in the unital, non-star form it is the Wedderburn–Artin theorem for semisimple algebras over ℂ. Its use in SDP symmetry reduction goes back to Gatermann and Parrilo (2004) and de Klerk, Pasechnik and Schrijver (2007). Section 2.5 of the survey gives a short, elementary, self-contained proof using only linear algebra; this mission follows that proof.

Setting

A matrix ∗-algebra (Definition 2.1, p. 10) is a complex linear subspace A⊆Cn×n\mathcal A \subseteq \mathbb C^{n\times n}A⊆Cn×n that is closed under matrix multiplication and under the conjugate transpose X↦X∗X \mapsto X^*X↦X∗. It need not contain the identity matrix, and it may be {0}\{0\}{0}.

A map φ:A→B\varphi : \mathcal A \to \mathcal Bφ:A→B between matrix ∗-algebras is a ∗-homomorphism (Definition 2.6, p. 13) if it is linear, satisfies φ(XY)=φ(X)φ(Y)\varphi(XY) = \varphi(X)\varphi(Y)φ(XY)=φ(X)φ(Y) and φ(X∗)=φ(X)∗\varphi(X^*) = \varphi(X)^*φ(X∗)=φ(X)∗; a bijective ∗-homomorphism is a ∗-isomorphism. The direct sum ⨁k=1dCmk×mk\bigoplus_{k=1}^d \mathbb C^{m_k\times m_k}⨁k=1d​Cmk​×mk​ is the algebra of block-diagonal matrices with diagonal blocks of sizes m1,…,mdm_1, \dots, m_dm1​,…,md​ (p. 10).

The proof uses the following vocabulary (p. 13). The center of A\mathcal AA is CA={Z∈A:ZX=XZ for all X∈A}\mathcal C_{\mathcal A} = \{Z \in \mathcal A : ZX = XZ \text{ for all } X \in \mathcal A\}CA​={Z∈A:ZX=XZ for all X∈A}. The unit of A\mathcal AA is the unique E∈AE \in \mathcal AE∈A with EX=XE=XEX = XE = XEX=XE=X for all X∈AX \in \mathcal AX∈A. A\mathcal AA is simple if it is non-zero and CA=CE\mathcal C_{\mathcal A} = \mathbb C ECA​=CE. For a partition [n]=S0∪S1∪⋯∪Sk[n] = S_0 \cup S_1 \cup \dots \cup S_k[n]=S0​∪S1​∪⋯∪Sk​, IiI_iIi​ is the zero-one diagonal matrix with ones in the positions of SiS_iSi​.

Formalization targets

Goal: Theorem 2.7 (= Theorem 1.2), p. 13

For every matrix ∗-algebra A⊆Cn×n\mathcal A \subseteq \mathbb C^{n\times n}A⊆Cn×n there are ddd and m1,…,mdm_1, \dots, m_dm1​,…,md​ and a ∗-isomorphism

φ:A⟶⨁k=1dCmk×mk.\varphi : \mathcal A \longrightarrow \bigoplus_{k=1}^d \mathbb C^{m_k\times m_k}.φ:A⟶k=1⨁d​Cmk​×mk​.

The goal fixes no sizes: it asserts only the existence of the block structure, which is the form Step 2 uses.

Milestones, in the order of the paper's proof

  1. Theorem 2.2 (p. 11): a commutative matrix ∗-algebra is unitarily similar to {λ1I1+⋯+λkIk:λi∈C}\{\lambda_1 I_1 + \dots + \lambda_k I_k : \lambda_i \in \mathbb C\}{λ1​I1​+⋯+λk​Ik​:λi​∈C} for a partition with S1,…,SkS_1, \dots, S_kS1​,…,Sk​ nonempty and S0S_0S0​ possibly empty.
  2. A maximal commutative ∗-subalgebra B\mathcal BB of A\mathcal AA contains every element of A\mathcal AA that commutes with B\mathcal BB (p. 14).
  3. Observations (i)–(ii) (p. 14): with B\mathcal BB in diagonal form, for X∈AX \in \mathcal AX∈A each IiXIiI_iXI_iIi​XIi​ is a multiple of IiI_iIi​, and I0X=XI0=0I_0X = XI_0 = 0I0​X=XI0​=0.
  4. Observation (iii) (p. 14): each block IiXIjI_iXI_jIi​XIj​ is zero or a nonzero multiple of a square unitary matrix.
  5. The unit of A\mathcal AA exists and is unique (p. 13).
  6. The relation i∼j  ⟺  IiAIj≠{0}i \sim j \iff I_i\mathcal A I_j \neq \{0\}i∼j⟺Ii​AIj​={0} is an equivalence relation (p. 14).
  7. A=⨁i=1dEiA\mathcal A = \bigoplus_{i=1}^d E_i\mathcal AA=⨁i=1d​Ei​A, where E1,…,EdE_1, \dots, E_dE1​,…,Ed​ are the minimal idempotents of CA\mathcal C_{\mathcal A}CA​ and each EiAE_i\mathcal AEi​A is simple (p. 14).
  8. Every simple matrix ∗-algebra is ∗-isomorphic to a full matrix algebra Ck×k\mathbb C^{k\times k}Ck×k (p. 14, proved pp. 14–15).

Milestones 7 and 8 together give the goal.

Significance

The result. A ∗-isomorphism preserves positive semidefiniteness, so Theorem 2.7 turns the constraint "X∈AX \in \mathcal AX∈A, X⪰0X \succeq 0X⪰0" into ddd independent constraints on blocks of sizes m1,…,mdm_1, \dots, m_dm1​,…,md​, with ∑kmk2=dim⁡A\sum_k m_k^2 = \dim \mathcal A∑k​mk2​=dimA. This is what makes the Lovász ϑ-number of symmetric graphs, the Delsarte and Schrijver bounds for codes, and the crossing-number bound of de Klerk et al. computable at scale (§§4–6 of the survey). Without it, an invariant SDP still has a variable of the original size nnn.

Formalizing it. The theorem is proved and textbook material; it is not open. As far as a search of the platform shows, it is not formalized in this form: Mathlib has Wedderburn–Artin for semisimple unital algebras over an algebraically closed field, which yields an algebra isomorphism but neither the star structure nor the non-unital case, and the platform holds a proved matrix-units statement for unital ∗-subalgebras (HarlowTASI.fdStarAlgebra_exists_matrixUnits, attached to this mission as a reference). The mission adds the non-unital ∗-isomorphism, the simultaneous unitary diagonalization of a commutative matrix ∗-algebra, and the intermediate facts of the elementary proof, each stated in a reusable form.

Difficulty

Two points make the obvious routes insufficient. First, a matrix ∗-algebra need not contain the identity: its unit is a projection onto a subspace, and the coordinates in S0S_0S0​ carry no part of the algebra. Statements and arguments that start from a unital subalgebra do not apply without first cutting the algebra down to the range of its unit. Second, an algebra isomorphism onto a product of matrix algebras is not enough: the isomorphism must commute with the conjugate transpose, since positive semidefiniteness is defined through it. Abstract Wedderburn–Artin provides the first kind of isomorphism, and turning it into a ∗-isomorphism requires choosing the matrix units compatibly with the adjoint, which is where the content of the theorem lies. The elementary proof avoids ring theory entirely but has to control every off-diagonal block IiXIjI_iXI_jIi​XIj​, which is the role of observations (i)–(iii).

Formalization scope

  • A matrix ∗-algebra is NonUnitalStarSubalgebra ℂ (Matrix (Fin n) (Fin n) ℂ); Mathlib's star on matrices is the conjugate transpose. The index set [n][n][n] is Fin n (0-based).
  • A ∗-isomorphism is StarAlgEquiv ℂ (≃⋆ₐ[ℂ]) on the subtype of A\mathcal AA: additive, multiplicative, ℂ-linear, star-preserving and bijective, exactly Definition 2.6.
  • ⨁k=1dCmk×mk\bigoplus_{k=1}^d \mathbb C^{m_k\times m_k}⨁k=1d​Cmk​×mk​ is the product type (k : Fin d) → Matrix (Fin (m k)) (Fin (m k)) ℂ with pointwise operations and star; it is ∗-isomorphic to the block-diagonal algebra (Matrix.blockDiagonal'). d=0d = 0d=0 is allowed and is needed for A={0}\mathcal A = \{0\}A={0}.
  • A partition [n]=S0∪S1∪⋯∪Sk[n] = S_0 \cup S_1 \cup \dots \cup S_k[n]=S0​∪S1​∪⋯∪Sk​ is a map S : Fin n → Option (Fin k), with none for S0S_0S0​ and some i for Si+1S_{i+1}Si+1​; the paper's block AijA_{ij}Aij​ is represented by the full-size product IiXIjI_iXI_jIi​XIj​.
  • The center is the set of elements of A\mathcal AA commuting with A\mathcal AA, not the commutant in Cn×n\mathbb C^{n\times n}Cn×n. "Simple" is the paper's definition: non-zero, with center CE\mathbb C ECE for the unit EEE.
  • Milestones 3, 4 and 6 are stated in the proof's normalized setting: B\mathcal BB is a maximal commutative ∗-subalgebra of A\mathcal AA that is already in diagonal form; the unitary change of basis is milestone 1.

The goal is not to be read with a unital StarSubalgebra (that adds the hypothesis I∈AI \in \mathcal AI∈A and is the case already covered by the reference item), with an AlgEquiv that ignores the star, or with a mere linear equivalence (which exists for dimensional reasons and has no content). Each of these would trivialize or weaken the statement.

Useful infrastructure, reusable beyond this mission: simultaneous unitary diagonalization of commuting normal matrices, the unit and the central decomposition of a non-unital finite-dimensional ∗-algebra, and an explicit ∗-isomorphism from a corner algebra onto Ck×k\mathbb C^{k\times k}Ck×k. Proofs of any milestone, and alternative routes to the goal (for example through Mathlib's Wedderburn–Artin plus a star-compatibility argument), are welcome.

Selected references

  • C. Bachoc, D. C. Gijswijt, A. Schrijver, F. Vallentin, Invariant semidefinite programs, in: Handbook on Semidefinite, Conic and Polynomial Optimization, Springer, 2012. arXiv:1007.2905v2. https://arxiv.org/abs/1007.2905
  • K. R. Davidson, C∗-Algebras by Example, Fields Institute Monographs 6, American Mathematical Society, 1996. https://doi.org/10.1090/fim/006
  • K. Gatermann, P. A. Parrilo, Symmetry groups, semidefinite programs, and sums of squares, Journal of Pure and Applied Algebra 192 (2004) 95–128. https://doi.org/10.1016/j.jpaa.2003.12.011
  • E. de Klerk, D. V. Pasechnik, A. Schrijver, Reduction of symmetric semidefinite programs using the regular ∗-representation, Mathematical Programming 109 (2007) 613–624. https://doi.org/10.1007/s10107-006-0039-7
  • R. A. Horn, C. R. Johnson, Matrix Analysis, Cambridge University Press, 1985. https://doi.org/10.1017/CBO9780511810817
11 thms0 active usersReviewed
Convex OptimizationOperations ResearchProbability·Captain: mikedeng1

Gradient-Based Algorithms for Convex Discrete Optimization via Simulation: Truncated Stochastic Subgradient Descent with Rounding Finds an (ε, δ)-Good Solution of Stochastic Submodular MinimizationResearch Paper

Motivation

Many operations decisions are made over discrete, high-dimensional choices whose cost can only be estimated by simulation: how many bikes to place at each station, which subset of facilities to open, how to allocate servers in a queueing network. Each evaluation of a candidate decision is a noisy run of a simulator, and the goal is to select a decision whose true expected cost is close to optimal with high probability. Classical ranking-and-selection procedures compare every candidate, which is hopeless when the number of candidates is 2d2^d2d or NdN^dNd.

Zhang, Zheng and Lavaei (arXiv:2010.16250, Operations Research, 2023) show that when the expected cost is L♮-convex (on {0,1}d\{0,1\}^d{0,1}d: submodular), the problem can be solved with a number of simulation runs that grows only polynomially in ddd, by running a stochastic subgradient method on a convex extension of the objective and rounding the result. Their headline upper bound for the case X={0,1}dX = \{0,1\}^dX={0,1}d is O~(d2ϵ2log⁡1δ)\tilde O\big(\tfrac{d^2}{\epsilon^2}\log\tfrac1\delta\big)O~(ϵ2d2​logδ1​) simulation runs; this mission formalizes its correctness half.

Setting

A decision is a set A⊆{1,…,d}A \subseteq \{1,\dots,d\}A⊆{1,…,d}, identified with its indicator vector 1A∈{0,1}d\mathbb 1_A \in \{0,1\}^d1A​∈{0,1}d. A simulator returns, at decision AAA, a random output F(A,ξA)F(A,\xi_A)F(A,ξA​) whose mean is the objective f(A)=E[F(A,ξA)]f(A) = \mathbb E[F(A,\xi_A)]f(A)=E[F(A,ξA​)]. Independent runs give independent outputs. Three assumptions are standing:

  • Assumption 1 (p. 10): every output F(A,ξA)−f(A)F(A,\xi_A) - f(A)F(A,ξA​)−f(A) is sub-Gaussian with known variance proxy σ2>0\sigma^2 > 0σ2>0.
  • Assumption 2 on {0,1}d\{0,1\}^d{0,1}d (pp. 14, 16): fff is submodular, f(A∩B)+f(A∪B)≤f(A)+f(B)f(A\cap B) + f(A\cup B) \le f(A) + f(B)f(A∩B)+f(A∪B)≤f(A)+f(B).
  • Assumption 4 (p. 16): a bound LLL with ∣f(A)−f(B)∣≤L|f(A) - f(B)| \le L∣f(A)−f(B)∣≤L whenever ∥1A−1B∥∞≤1\|\mathbb 1_A - \mathbb 1_B\|_\infty \le 1∥1A​−1B​∥∞​≤1, which on {0,1}d\{0,1\}^d{0,1}d is every pair.

A consistent permutation of x∈[0,1]dx \in [0,1]^dx∈[0,1]d orders its coordinates decreasingly, xα(1)≥⋯≥xα(d)x_{\alpha(1)} \ge \dots \ge x_{\alpha(d)}xα(1)​≥⋯≥xα(d)​; the neighbouring points are Sx,0=∅S^{x,0} = \emptysetSx,0=∅ and Sx,i={α(1),…,α(i)}S^{x,i} = \{\alpha(1),\dots,\alpha(i)\}Sx,i={α(1),…,α(i)}. The Lovász extension (2) is

f~(x)=f(Sx,0)+∑i=1d[f(Sx,i)−f(Sx,i−1)] xα(i),x∈[0,1]d.\tilde f(x) = f(S^{x,0}) + \sum_{i=1}^d \big[f(S^{x,i}) - f(S^{x,i-1})\big]\,x_{\alpha(i)}, \qquad x \in [0,1]^d.f~​(x)=f(Sx,0)+i=1∑d​[f(Sx,i)−f(Sx,i−1)]xα(i)​,x∈[0,1]d.

The estimator (4) of its subgradient at xxx uses two fresh runs per coordinate, g^α(i)=F(Sx,i,ξi1)−F(Sx,i−1,ξi−12)\hat g_{\alpha(i)} = F(S^{x,i},\xi^1_i) - F(S^{x,i-1},\xi^2_{i-1})g^​α(i)​=F(Sx,i,ξi1​)−F(Sx,i−1,ξi−12​). Algorithm 2 starts at a vertex x0x^0x0, truncates each estimate coordinatewise to [−M,M][-M, M][−M,M] (g~t=TM(g^t)\tilde g^t = T_M(\hat g^t)g~​t=TM​(g^​t)), takes a step xt+1=PX(xt−ηg~t)x^{t+1} = P_X(x^t - \eta\tilde g^t)xt+1=PX​(xt−ηg~​t) with PXP_XPX​ the projection onto [0,1]d[0,1]^d[0,1]d, and averages xˉ=1T∑t<Txt\bar x = \frac1T\sum_{t<T}x^txˉ=T1​∑t<T​xt. Algorithm 1 then simulates nnn times at each neighbouring point S0,…,SdS^0,\dots,S^dS0,…,Sd of xˉ\bar xxˉ and returns one with the smallest sample mean. A solution is (ϵ,δ)(\epsilon,\delta)(ϵ,δ)-PGS (probability of good selection) if, with probability at least 1−δ1-\delta1−δ, its objective value is at most ϵ\epsilonϵ above min⁡f\min fminf.

Formalization targets

Goal: Theorem 2 with explicit constants

With d≥1d \ge 1d≥1, ϵ>0\epsilon > 0ϵ>0, 0<δ<10 < \delta < 10<δ<1, and

T≥3584 dσ2ϵ2log⁡2δ,T≥max⁡{2ϵσ,4},M≥L+2σlog⁡4σdTϵ,64d2M2≤ϵ2T,n≥32σ2ϵ2log⁡8dδ,T \ge \tfrac{3584\,d\sigma^2}{\epsilon^2}\log\tfrac2\delta,\quad T \ge \max\{\tfrac{2\epsilon}{\sigma},4\},\quad M \ge L + 2\sigma\sqrt{\log\tfrac{4\sigma dT}{\epsilon}},\quad 64d^2M^2 \le \epsilon^2T,\quad n \ge \tfrac{32\sigma^2}{\epsilon^2}\log\tfrac{8d}{\delta},T≥ϵ23584dσ2​logδ2​,T≥max{σ2ϵ​,4},M≥L+2σlogϵ4σdT​​,64d2M2≤ϵ2T,n≥ϵ232σ2​logδ8d​,

Algorithm 2 with η=1/(MT)\eta = 1/(M\sqrt T)η=1/(MT​) followed by Algorithm 1 returns SSS with

P(f(S)>min⁡f+ϵ)≤δ,\mathbb P\big(f(S) > \min f + \epsilon\big) \le \delta,P(f(S)>minf+ϵ)≤δ,

whatever tie-break the final argmin uses.

Milestones

The milestone list follows the paper's proof: the deterministic properties of the Lovász extension (permutation independence, Lemma 2(i)–(iv), eq. (6)), unbiasedness of (4), the truncation-bias bound (Lemma EC.2), the Azuma-type inequality (Lemma EC.1) and its application to the iterates (Lemma EC.3), the projected-step regret bound (Lemma EC.4), and the rounding guarantee (Theorem 1).

Significance

The theorem certifies that a first-order method solves stochastic submodular minimization to PGS accuracy. At the proof's parameter choices, its simulation budget is 2dT+(d+1)n2dT + (d+1)n2dT+(d+1)n; the paper gives an asymptotic upper bound that also includes a term proportional to d3L2/ϵ2d^3L^2/\epsilon^2d3L2/ϵ2. Section 5 of the paper shows lower bounds of order dϵ2log⁡1δ\tfrac{d}{\epsilon^2}\log\tfrac1\deltaϵ2d​logδ1​. The truncation step improves the asymptotic dependence on ddd relative to untruncated SSGD (p. 20).

The result is proved in the paper; nothing in it is machine-checked. A formalization adds three things. It pins the Θ~\tilde\ThetaΘ~ choices of Theorem 2 to the explicit constants of its proof. It repairs two statements: Lemma EC.2 is false at the printed truncation level (counterexample below), and Lemma 2(ii) is false as an equality of argmin sets. And it produces reusable infrastructure: the Lovász extension on the box with its subgradient, and a tail form of Azuma's inequality that Mathlib does not have (Mathlib's version takes conditional moment-generating-function bounds).

Difficulty

The deterministic layer is classical but has edge cases: ties among coordinates (several consistent permutations), the boundary of the box, and d=1d = 1d=1. The convexity of the Lovász extension of a submodular function is the substantial fact there.

The probabilistic layer is where the obvious argument breaks. The iterates xtx^txt are random and depend on all earlier simulation runs, and the consistent permutation at xtx^txt is a discontinuous function of xtx^txt, so the estimator at step ttt is evaluated at random points chosen by the past. The analysis must condition on the past, use the independence of fresh runs, and control a biased estimator: truncation makes steps bounded but biased, and the bias bound must hold uniformly over points where the true subgradient coordinate can be as large as LLL. Lemma EC.3's printed proof treats ∥g^−g∥1\|\hat g - g\|_1∥g^​−g∥1​ as sub-Gaussian with proxy dσ2d\sigma^2dσ2, which a sum of absolute values is not, so its tail estimate has to be obtained differently. Finally, the rounding step evaluates sample means at random points determined by xˉ\bar xxˉ, so Hoeffding's inequality is applied conditionally on xˉ\bar xxˉ.

Formalization scope

Decisions are Finset (Fin d), points of the box are Fin d → ℝ in Set.Icc 0 1, and indices are 0-based (nbr α i is Sx,iS^{x,i}Sx,i). The Lovász extension is evaluated with a canonical consistent permutation (Tuple.sort of −x-x−x); a milestone shows any consistent permutation gives the same value. Submodularity is the published definition NonmonotoneSubmod.Shared.Submodular.

The simulator is a family of mutually independent random vectors indexed by slots: for each iteration t<Tt < Tt<T, coordinate kkk and j∈{1,2}j \in \{1,2\}j∈{1,2} one gradient slot, and for each neighbouring point i≤di \le di≤d and replication s<ns < ns<n one rounding slot. Each slot is measurable and its output at each AAA is centred at f(A)f(A)f(A) and sub-Gaussian with proxy σ2\sigma^2σ2 (Mathlib's HasSubgaussianMGF). Since each slot is read at one point only, identical distribution is not assumed. The failure probability is bounded for the event "some minimizer of the sample means is bad", as an outer measure, so no measurability of the output is presupposed.

Deviations from the page, all disclosed in the item notes:

  • Theorem 2's constants are taken from its proof (p. ec7). "δ small enough" there means exactly 64d2M2≤ϵ2T64d^2M^2 \le \epsilon^2T64d2M2≤ϵ2T and T≥max⁡{2ϵ/σ,4}T \ge \max\{2\epsilon/\sigma,4\}T≥max{2ϵ/σ,4}, which become hypotheses.
  • The truncation level is corrected to M≥L+2σlog⁡(4σdT/ϵ)M \ge L + 2\sigma\sqrt{\log(4\sigma dT/\epsilon)}M≥L+2σlog(4σdT/ϵ)​. At the printed M=max⁡{L,2σlog⁡(4σdT/ϵ)}M = \max\{L, 2\sigma\sqrt{\log(4\sigma dT/\epsilon)}\}M=max{L,2σlog(4σdT/ϵ)​}, Lemma EC.2 fails. Take d=1d = 1d=1, σ=1\sigma = 1σ=1, Gaussian noise, ϵ=0.1\epsilon = 0.1ϵ=0.1, T=100T = 100T=100, f(∅)=0f(\emptyset) = 0f(∅)=0 and f({1})=M=2log⁡4000f(\{1\}) = M = 2\sqrt{\log 4000}f({1})=M=2log4000​. The truncation bias is then about 0.5640.5640.564 against the claimed 0.00050.00050.0005.
  • Lemma 2(ii) is stated as equality of minima, plus the equivalence of minimizers on {0,1}d\{0,1\}^d{0,1}d.
  • Theorem 1's adaptive stopping rule is replaced by the fixed sample size of its proof, with the missing factor σ2\sigma^2σ2 restored.
  • The cost bounds T(ϵ,δ,MC)T(\epsilon,\delta,\mathcal{MC})T(ϵ,δ,MC) are not formalized: the paper gives them as O(⋅)O(\cdot)O(⋅) bounds, and with the pinned parameters the cost is a deterministic count.

Trivializing readings are excluded. The oracle is centred at fff and has independent slots; σ>0\sigma>0σ>0 is a permitted variance proxy, so a zero-noise oracle is allowed. The bias is that of the truncated estimator. The hypotheses of the goal are jointly satisfiable (for example d=1d = 1d=1, σ=ϵ=1\sigma = \epsilon = 1σ=ϵ=1, δ=1/2\delta = 1/2δ=1/2, T=20000T = 20000T=20000, M=7M = 7M=7, n=100n = 100n=100 with a zero-noise oracle). Contributions of reusable lemmas, in particular the Lovász-extension layer and the tail-form Azuma inequality, are welcome as separate theorems.

Selected references

  • H. Zhang, Z. Zheng, J. Lavaei, Gradient-based algorithms for convex discrete optimization via simulation, Operations Research, 2023; arXiv:2010.16250v3 (2022). https://arxiv.org/abs/2010.16250
  • L. Lovász, Submodular functions and convexity, in Mathematical Programming: The State of the Art, Springer, 1983. https://doi.org/10.1007/978-3-642-68874-4_10
  • S. Fujishige, Submodular Functions and Optimization, 2nd ed., Annals of Discrete Mathematics 58, Elsevier, 2005. https://doi.org/10.1016/S0167-5060(05)80003-2
  • O. Shamir, A variant of Azuma's inequality for martingales with subgaussian tails, 2011. https://arxiv.org/abs/1110.2392
  • M. Zinkevich, Online convex programming and generalized infinitesimal gradient ascent, ICML 2003. https://dl.acm.org/doi/10.5555/3041838.3041955
  • K. Murota, Discrete Convex Analysis, SIAM, 2003 (Theorem 4.16, convexity of the Lovász extension, proved on Prove2Me as DiscreteConvex.MConvexSetsB.lovasz_convex_iff_submodular). https://doi.org/10.1137/1.9780898718508
15 thms0 active usersReviewed
Convex OptimizationLinear OptimizationOperations Research·Captain: mikedeng1

Intersection Disjunctions for Reverse Convex Sets: The Basis Cone Outside the Recession-Cone Inner Approximation of the Convex Set Is a Union of |N2| + 1 Disjunctive TermsResearch Paper

Reverse convex sets and intersection cuts

A reverse convex set is the part of a polyhedron that lies outside an open convex set: P∖CP\setminus CP∖C, where P={x∈R+n:Ax=b}P=\{x\in\mathbb{R}^n_+ : Ax=b\}P={x∈R+n​:Ax=b} and C⊆RnC\subseteq\mathbb{R}^nC⊆Rn is open and convex. Such sets arise whenever a model forbids a convex region: integrality (a lattice-free convex set contains no feasible point in its interior), bilevel programs, where the points with d⊤y>Φ(x)d^\top y>\Phi(x)d⊤y>Φ(x) for a convex value function Φ\PhiΦ are infeasible, and nonconvex quadratic or polynomial constraints. Optimizing over P∖CP\setminus CP∖C calls for valid inequalities for its closed convex hull.

The classical tool is the intersection cut of Balas (Balas 1971): starting from a basic solution xˉ\bar xxˉ of the linear relaxation that lies inside CCC, one follows the extreme rays of the basis cone until they leave CCC, and the exit points define a valid inequality. Towle and Luedtke study the opposite case, where the basic solution lies outside the closure of CCC. Then the rays of the basis cone may enter CCC, cross it, or never leave it, and no single inequality captures the structure. They replace the cut by a disjunction: a finite union of simpler sets that contains P∖CP\setminus CP∖C, to which the disjunctive programming machinery of Balas can be applied. The present mission targets their multi-term disjunction (Theorem 5 of the paper), which uses the full recession cone of CCC.

Setting

Let A∈Rm×nA\in\mathbb{R}^{m\times n}A∈Rm×n have full row rank and b∈Rmb\in\mathbb{R}^mb∈Rm. A basis splits the variables into basic variables BBB and nonbasic variables NNN, with a tableau aˉ\bar aaˉ and a basic solution xˉ\bar xxˉ (xˉj=0\bar x_j=0xˉj​=0 for j∈Nj\in Nj∈N) such that Ax=bAx=bAx=b holds exactly when xi=xˉi−∑j∈Naˉijxjx_i=\bar x_i-\sum_{j\in N}\bar a_{ij}x_jxi​=xˉi​−∑j∈N​aˉij​xj​ for all i∈Bi\in Bi∈B. Dropping the sign constraints on the basic variables gives the basis cone

PB={x:xi=xˉi−∑j∈Naˉijxj (i∈B), xj≥0 (j∈N)},P^B=\Big\{x : x_i=\bar x_i-\sum_{j\in N}\bar a_{ij}x_j\ (i\in B),\ x_j\ge 0\ (j\in N)\Big\},PB={x:xi​=xˉi​−j∈N∑​aˉij​xj​ (i∈B), xj​≥0 (j∈N)},

a translated simplicial cone with apex xˉ\bar xxˉ and extreme rays rˉj\bar r^jrˉj (j∈Nj\in Nj∈N): rˉjj=1\bar r^j_j=1rˉjj​=1, rˉkj=−aˉkj\bar r^j_k=-\bar a_{kj}rˉkj​=−aˉkj​ for k∈Bk\in Bk∈B, and rˉkj=0\bar r^j_k=0rˉkj​=0 for the other nonbasic kkk.

The recession cone of CCC is recc⁡(C)={d:x+td∈C for all x∈C, t≥0}\operatorname{recc}(C)=\{d : x+td\in C\text{ for all }x\in C,\ t\ge 0\}recc(C)={d:x+td∈C for all x∈C, t≥0}. Along each ray, the halfline xˉ+λrˉj\bar x+\lambda\bar r^jxˉ+λrˉj, λ≥0\lambda\ge 0λ≥0, meets CCC in an interval with endpoints

αj=inf⁡{α≥0:xˉ+αrˉj∈C},βj=sup⁡{β≥0:xˉ+βrˉj∈C},\alpha_j=\inf\{\alpha\ge 0:\bar x+\alpha\bar r^j\in C\},\qquad \beta_j=\sup\{\beta\ge 0:\bar x+\beta\bar r^j\in C\},αj​=inf{α≥0:xˉ+αrˉj∈C},βj​=sup{β≥0:xˉ+βrˉj∈C},

in the extended reals, with αj=+∞\alpha_j=+\inftyαj​=+∞, βj=−∞\beta_j=-\inftyβj​=−∞ when the halfline misses CCC. This sorts the nonbasic indices into N0N_0N0​ (the ray misses CCC), N1N_1N1​ (αj\alpha_jαj​ finite and positive, βj=+∞\beta_j=+\inftyβj​=+∞: the ray enters CCC and stays) and N2N_2N2​ (αj<βj<+∞\alpha_j<\beta_j<+\inftyαj​<βj​<+∞: the ray crosses CCC); write N0c=N1∪N2N_0^{\mathrm c}=N_1\cup N_2N0c​=N1​∪N2​. For extended reals α<β\alpha<\betaα<β and a vector rrr, the segment (α,β)r(\alpha,\beta)r(α,β)r is {λr:λ∈R, α<λ<β}\{\lambda r:\lambda\in\mathbb{R},\ \alpha<\lambda<\beta\}{λr:λ∈R, α<λ<β}, and [0,β)r[0,\beta)r[0,β)r, (−∞,0]r(-\infty,0]r(−∞,0]r are defined likewise. The paper builds the inner approximation of CCC

TC={xˉ}+conv⁡(⋃j∈N0c(αj,βj)rˉj)+recc⁡(C)T^C=\{\bar x\}+\operatorname{conv}\Big(\bigcup_{j\in N_0^{\mathrm c}}(\alpha_j,\beta_j)\bar r^j\Big)+\operatorname{recc}(C)TC={xˉ}+conv(j∈N0c​⋃​(αj​,βj​)rˉj)+recc(C)

and the sets

S0C={xˉ}+conv⁡(⋃j∈N0c(αj,+∞)rˉj)+recc⁡(C),S^C_0=\{\bar x\}+\operatorname{conv}\Big(\bigcup_{j\in N_0^{\mathrm c}}(\alpha_j,+\infty)\bar r^j\Big)+\operatorname{recc}(C),S0C​={xˉ}+conv(j∈N0c​⋃​(αj​,+∞)rˉj)+recc(C), SkC={xˉ}+conv⁡(⋃j∈N2[0,βj)rˉj)+(−∞,0]rˉk+recc⁡(C)(k∈N2).S^C_k=\{\bar x\}+\operatorname{conv}\Big(\bigcup_{j\in N_2}[0,\beta_j)\bar r^j\Big)+(-\infty,0]\bar r^k+\operatorname{recc}(C)\qquad(k\in N_2).SkC​={xˉ}+conv(j∈N2​⋃​[0,βj​)rˉj)+(−∞,0]rˉk+recc(C)(k∈N2​).

Throughout, xˉ∉cl⁡(C)\bar x\notin\operatorname{cl}(C)xˉ∈/cl(C), and (Assumption 2 of the paper) recc⁡(C)⊆recc⁡(PB)\operatorname{recc}(C)\subseteq\operatorname{recc}(P^B)recc(C)⊆recc(PB).

Formalization targets

Goal: Theorem 5

With N20:=N2∪{0}N_2^0:=N_2\cup\{0\}N20​:=N2​∪{0},

PB∖TC=⋃k∈N20(PB∖SkC).P^B\setminus T^C=\bigcup_{k\in N_2^0}\big(P^B\setminus S^C_k\big).PB∖TC=k∈N20​⋃​(PB∖SkC​).

The relaxation PB∖TCP^B\setminus T^CPB∖TC of PB∖CP^B\setminus CPB∖C is thus a disjunction of ∣N2∣+1|N_2|+1∣N2​∣+1 terms.

Milestones

  1. (§3, p. 5) rˉj∈recc⁡(C)\bar r^j\in\operatorname{recc}(C)rˉj∈recc(C) for every j∈N1j\in N_1j∈N1​.
  2. (Proposition 5) For k∈N2k\in N_2k∈N2​, SkC={xˉ}+conv⁡(⋃j∈N0c(αj,βj)rˉj)+(−∞,0]rˉk+recc⁡(C)S^C_k=\{\bar x\}+\operatorname{conv}\big(\bigcup_{j\in N_0^{\mathrm c}}(\alpha_j,\beta_j)\bar r^j\big)+(-\infty,0]\bar r^k+\operatorname{recc}(C)SkC​={xˉ}+conv(⋃j∈N0c​​(αj​,βj​)rˉj)+(−∞,0]rˉk+recc(C).
  3. (Lemma 2) For a,c∈R+sa,c\in\mathbb{R}^s_+a,c∈R+s​ with ∑iai>0\sum_i a_i>0∑i​ai​>0 there is θ∈R+s+1\theta\in\mathbb{R}^{s+1}_+θ∈R+s+1​ with ∑i=0sθi=1\sum_{i=0}^s\theta_i=1∑i=0s​θi​=1 and aiθ0=ciθia_i\theta_0=c_i\theta_iai​θ0​=ci​θi​ for i=1,…,si=1,\dots,si=1,…,s.
  4. (Proof of Theorem 5) TC⊆SkCT^C\subseteq S^C_kTC⊆SkC​ for every k∈N20k\in N_2^0k∈N20​.
  5. (Proof of Theorem 5) TC=⋂k∈N20SkCT^C=\bigcap_{k\in N_2^0}S^C_kTC=⋂k∈N20​​SkC​.

Significance

Theorem 5 turns the nonconvex set PB∖TCP^B\setminus T^CPB∖TC into a finite union of sets with explicit generators. By the paper's Theorem 2, PB∖TCP^B\setminus T^CPB∖TC has the same closed convex hull as PB∖CP^B\setminus CPB∖C, so valid inequalities for the disjunction are valid for the reverse convex set and lose nothing in the limit. The paper then relaxes each term to a polyhedron (§4.4), and a cut-generating linear program over the union separates candidate points; when CCC is bounded the disjunction collapses to the two-term disjunction of the paper's Theorem 1. The disjunction is therefore the bridge between the geometry of CCC (its recession cone and the exit parameters along the basis rays) and polyhedral cut generation.

The result is proved in the paper (arXiv:1901.02112v5, pp. 17–18; Mathematics of Operations Research, 2022). It has no machine-checked proof. Formalizing it checks the extended-real conventions for αj,βj\alpha_j,\beta_jαj​,βj​, the treatment of empty and unbounded segments, and the role of the recession cone, all of which the paper handles in prose. The definitions of the basis cone, the exit parameters and the recession cone are reusable for other intersection-cut results on the platform.

Difficulty

The inclusion TC⊆⋂kSkCT^C\subseteq\bigcap_k S^C_kTC⊆⋂k​SkC​ is immediate from the definitions. The reverse inclusion is the substance: a point lying in every term SkCS^C_kSkC​ comes with ∣N2∣+1|N_2|+1∣N2​∣+1 unrelated representations, one per term, each using different segment parameters, a different multiple of −rˉk-\bar r^k−rˉk and a different recession direction. A point of TCT^CTC needs a single representation with all segment parameters inside (αj,βj)(\alpha_j,\beta_j)(αj​,βj​) and no negative multiples of the rays. A naive average of the representations keeps the negative components along the rays rˉk\bar r^krˉk, so it does not land in TCT^CTC. The rewriting of SkCS^C_kSkC​ in Proposition 5 also needs care: it replaces [0,βj)[0,\beta_j)[0,βj​) by (αj,βj)(\alpha_j,\beta_j)(αj​,βj​) inside a convex hull, and absorbs the rays of N1N_1N1​ into the recession cone, which holds only because CCC is open.

Formalization scope

Vectors are functions ι→R\iota\to\mathbb{R}ι→R on a finite index type ι\iotaι (the paper's {1,…,n}\{1,\dots,n\}{1,…,n}). The basis is the published Disjunctive.GeneralDisjunctions.IsTableau (a genuine tableau of Ax=bAx=bAx=b, with B,NB,NB,N a partition and xˉN=0\bar x_N=0xˉN​=0) together with rank⁡A=m\operatorname{rank}A=mrankA=m, and the extreme rays are the published Disjunctive.GeneralDisjunctions.extremeRay. PBP^BPB is defined, as on the page, by the tableau equations and xN≥0x_N\ge 0xN​≥0. The exit parameters αj,βj\alpha_j,\beta_jαj​,βj​ are EReal-valued infima and suprema over real parameters, so the empty set gives +∞+\infty+∞ and −∞-\infty−∞ and an unbounded set gives βj=+∞\beta_j=+\inftyβj​=+∞; segments quantify over real λ\lambdaλ compared with extended-real endpoints. N0,N1,N2N_0,N_1,N_2N0​,N1​,N2​ are filters of NNN, and N0c=N1∪N2N_0^{\mathrm c}=N_1\cup N_2N0c​=N1​∪N2​. The index 000 of N20N_2^0N20​ is encoded by stating the term S0CS^C_0S0C​ separately from the terms SkCS^C_kSkC​, k∈N2k\in N_2k∈N2​. The recession cone is the universal-quantifier cone, which is the whole space for C=∅C=\emptysetC=∅; in that case every set in the goal is empty or PBP^BPB and the identity is PB=PBP^B=P^BPB=PB.

All hypotheses are the paper's: CCC open and convex, AAA of full row rank (§2), xˉ∉cl⁡(C)\bar x\notin\operatorname{cl}(C)xˉ∈/cl(C) (§3), and Assumption 2 (§4). One generalization: the basic solution need not be feasible (bˉ≥0\bar b\ge 0bˉ≥0 is not imposed); the paper's own Example 2 uses an infeasible basic solution and the proof of Theorem 5 does not use feasibility.

Real-valued αj,βj\alpha_j,\beta_jαj​,βj​ (where an empty or unbounded parameter set returns 000), segments with endpoints converted to reals, or an encoding in which N2N_2N2​ is always empty would trivialize the statement; the extended-real definitions rule these out, and a sorry-free check confirms that the hypotheses are satisfiable with N2≠∅N_2\neq\emptysetN2​=∅ (one variable, C={1<x<2}C=\{1<x<2\}C={1<x<2}).

The development needs Minkowski sums and convex hulls of unions in Rn\mathbb{R}^nRn, recession cones of open convex sets, and a Farkas-type alternative (for Lemma 2); the platform's LinearOptimization.farkas_lemma is available. Proofs of the milestones in any order are welcome; Lemma 2 is self-contained.

Selected references

  • E. Towle and J. Luedtke, Intersection disjunctions for reverse convex sets, arXiv:1901.02112v5, 2020; Mathematics of Operations Research, 2022. https://arxiv.org/abs/1901.02112v5
  • E. Balas, Intersection cuts — a new type of cutting planes for integer programming, Operations Research 19(1), 1971. https://doi.org/10.1287/opre.19.1.19
  • E. Balas, Disjunctive programming, Annals of Discrete Mathematics 5, 1979. https://doi.org/10.1016/S0167-5060(08)70342-X
  • M. Conforti, G. Cornuéjols, G. Zambelli, Integer Programming, Springer, 2014. https://doi.org/10.1007/978-3-319-11008-0
9 thms0 active usersReviewed
Algebraic GeometryRepresentation Theory·Captain: mikedeng1

A Convex Form That Is Not a Sum of Squares: For k ≥ 17 the Octonionic Cauchy–Schwarz Form Plus (1/4)(‖x‖² + ‖y‖²)² Is a Convex Quartic in 16k Variables That Is Not a Sum of SquaresResearch Paper

Motivation

A convex form is a homogeneous polynomial of even degree whose value is convex as a function of its real variables. Every convex form is nonnegative, so it is natural to ask whether it can always be written as a sum of squares (SOS) of real polynomials. This matters in polynomial optimization because an SOS certificate can be searched for through semidefinite programming, while pointwise nonnegativity is generally harder to certify. Parrilo posed the convex versus SOS question in 2007. Blekherman proved nonconstructively that convex forms outside the SOS cone exist in sufficiently many variables. Saunderson constructed an explicit quartic example in 272 variables, together with a finite certificate of its failure to be SOS Saunderson, pp. 1–3.

Setting

An octonion is an eight-dimensional real normed division algebra. Write uˉ\bar uuˉ for conjugation and ∣u∣2|u|^2∣u∣2 for the sum of squares of its eight coordinates. For two lists x=(x1,…,xk)x=(x_1,\ldots,x_k)x=(x1​,…,xk​) and y=(y1,…,yk)y=(y_1,\ldots,y_k)y=(y1​,…,yk​) of octonions, let ∥x∥2=∑j∣xj∣2\|x\|^2=\sum_j|x_j|^2∥x∥2=∑j​∣xj​∣2 and ⟨x,y⟩=∑jxˉjyj\langle x,y\rangle=\sum_j\bar x_jy_j⟨x,y⟩=∑j​xˉj​yj​. The octonionic Cauchy–Schwarz form is

cs⁡kO(x,y)=∥x∥2∥y∥2−∣⟨x,y⟩∣2.\operatorname{cs}^{\mathbb O}_k(x,y)=\|x\|^2\|y\|^2-|\langle x,y\rangle|^2.cskO​(x,y)=∥x∥2∥y∥2−∣⟨x,y⟩∣2.

Each octonion contributes eight real coordinates, so this is a quartic polynomial in 16k16k16k real variables. The paper's companion form is

qkO(x,y)=cs⁡kO(x,y)+14(∥x∥2+∥y∥2)2.q^{\mathbb O}_k(x,y)=\operatorname{cs}^{\mathbb O}_k(x,y)+\tfrac14(\|x\|^2+\|y\|^2)^2.qkO​(x,y)=cskO​(x,y)+41​(∥x∥2+∥y∥2)2.

To measure the SOS relaxation, pmin⁡p_{\min}pmin​ and pmax⁡p_{\max}pmax​ are the minimum and maximum of a form ppp on the Euclidean unit sphere. For a degree-2d2d2d form, pmin⁡sosp^{\mathrm{sos}}_{\min}pminsos​ is the largest γ\gammaγ for which p−γ∥z∥2dp-\gamma\|z\|^{2d}p−γ∥z∥2d is SOS. When pmax⁡>pmin⁡p_{\max}>p_{\min}pmax​>pmin​, the paper defines

gap⁡(p)=pmax⁡−pmin⁡sospmax⁡−pmin⁡.\operatorname{gap}(p)=\frac{p_{\max}-p^{\mathrm{sos}}_{\min}}{p_{\max}-p_{\min}}.gap(p)=pmax​−pmin​pmax​−pminsos​​.

These are values of the specific polynomial, not free parameters. The SOS predicate concerns finite sums of squares in the real multivariate polynomial ring Saunderson, pp. 2–4.

Formalization targets

The main theorem

For every k≥17k\ge17k≥17, the target is the full Theorem 1.2:

gap⁡(cs⁡kO)>2,qkO is a convex quartic form and is not SOS.\operatorname{gap}(\operatorname{cs}^{\mathbb O}_k)>2, \qquad q^{\mathbb O}_k\text{ is a convex quartic form and is not SOS}.gap(cskO​)>2,qkO​ is a convex quartic form and is not SOS.

The milestone list includes the near-constant-on-the-sphere convexity criterion, its bound-based corollary, the octonionic inequality, the matrix identity for qkOq^{\mathbb O}_kqkO​, the symmetry-reduced SOS characterization, the explicit k=17k=17k=17 feasibility system, and the exact SOS threshold at k=16k=16k=16. The threshold is a separate claim: qkOq^{\mathbb O}_kqkO​ is SOS for k≤16k\le16k≤16 and is not SOS for k≥17k\ge17k≥17 Saunderson, Theorems 1.2 and 4.11.

Significance

The theorem supplies an explicit counterexample to the assertion that convexity of an even-degree homogeneous polynomial forces an SOS representation. At k=17k=17k=17, it is a concrete quartic in 272272272 variables. Its gap also gives an explicit case where the basic SOS lower bound for optimization on a sphere is more than a factor two away in the paper's normalized measure. Thus the example links an algebraic separation of two cones with a numerical limitation of an optimization relaxation Saunderson, pp. 2–4.

The mathematical theorem is proved in the cited paper. The work here is to encode its octonion multiplication table, quartic polynomial, symmetry action, and finite feasibility certificate in Lean, then close the formal proofs. The group and polynomial definitions can also support other examples based on Clifford systems or structured SOS relaxations. The statements in this proposal compile with sorry; they are proof targets, not machine-checked proofs.

Difficulty

Nonnegativity of cs⁡kO\operatorname{cs}^{\mathbb O}_kcskO​ follows from octonionic Cauchy–Schwarz, and near-constant values on the sphere yield convexity after the stated correction. The obstacle is proving that q17Oq^{\mathbb O}_{17}q17O​ has no SOS representation: evaluating a nonnegative polynomial at a few points cannot rule out SOS. The paper uses its Spin⁡(9)×O(k)\operatorname{Spin}(9)\times O(k)Spin(9)×O(k) symmetry to reduce the SOS question to eight nonnegative coefficients and then exhibits an infeasible three-row system. The corresponding positive SOS decomposition at k=16k=16k=16 marks the exact boundary Saunderson, §§3–4.

Formalization scope

The variables are indexed by Fin(16)×Fin(k)\mathrm{Fin}(16)\times\mathrm{Fin}(k)Fin(16)×Fin(k) and the forms live in MvPolynomial over R\mathbb RR. The first eight rows of each matrix column are xjx_jxj​, the last eight are yjy_jyj​. The octonion product is computed from the paper's right-multiplication table; the inner product conjugates its first argument. The squared Euclidean norm is the polynomial ∑iXi2\sum_i X_i^2∑i​Xi2​, and the unit sphere is defined by the corresponding real sum, not by the default norm on a function type. The SOS predicate is Mathlib's polynomial IsSumSq.

The symmetry group called Spin⁡(9)\operatorname{Spin}(9)Spin(9) in the paper is represented by its concrete matrix model G⊂SO(16)G\subset SO(16)G⊂SO(16) preserving the span of nine Clifford matrices. The eight sijs_{ij}sij​ use the equivalent orthogonal-projection formula: SJ/4S_J/4SJ​/4 supplies the normalized basis of the Clifford subspace, and the three matrix projections select scalar, traceless symmetric, and skew-symmetric parts. The paper's printed unscaled SJS_JSJ​ are orthogonal with squared trace norm 161616; the factor 1/161/161/16 in the definition accounts for this normalization. No assumption that the polynomial is SOS enters the definition of qkOq^{\mathbb O}_kqkO​; it is built from the octonion product itself.

For the general degree-2d2d2d milestones, d≥1d\ge1d≥1 and a nonempty finite variable type make explicit the paper's positive-degree, positive-dimension setting. Lemma 2.2 uses arbitrary lower and upper bounds, as its proof and its application at k=1k=1k=1 do. The scalar extrema and SOS bound are represented by real sSup and sInf; these operations return default values on empty or unbounded sets. The goal has k≥17k\ge17k≥17, where the sphere is nonempty and compact and the extrema have their intended meaning. Formal work is welcome on these endpoint facts, the octonionic identities, invariant polynomial spaces, and the finite infeasibility certificate.

Selected references

  • James Saunderson, A convex form that is not a sum of squares, Mathematics of Operations Research, 2023; formalization source arXiv:2105.08432v2, 2021. Preprint.
  • Grigoriy Blekherman, Nonnegative Polynomials and Sums of Squares, in Semidefinite Optimization and Convex Algebraic Geometry, SIAM, 2012, Theorem 4.75 as cited by Saunderson. SIAM chapter.
  • Karin Gatermann and Pablo Parrilo, Symmetry groups, semidefinite programs, and sums of squares, Journal of Pure and Applied Algebra, 2004. DOI.
11 thms0 active usersReviewed
Operations Research·Captain: mikedeng1

Penalty and Augmented Lagrangian Methods for Constrained DC Programming: Feasible Accumulation Points of the Penalty Method Are B-Stationary under the Pointwise Slater Constraint QualificationResearch Paper

Motivation

A DC function is a difference of two convex functions. Programs whose objective and constraints are DC functions model sparse estimation with nonconvex penalties, affine sparsity constraints, piecewise-affine regression and several problems in signal processing and finance. Constraints of DC type make the feasible region nonconvex and nonsmooth, and the usual Karush–Kuhn–Tucker theory and its constraint qualifications do not apply directly.

Lu, Sun and Zhou (arXiv:2111.09263, Mathematics of Operations Research, 2022) propose a penalty method and an augmented Lagrangian method for such programs. Each subproblem only has to be solved approximately, in a sense that a single convex subproblem per inner iteration can certify. Their main result for the penalty method is that every feasible accumulation point of the iterates is a B-stationary point, the strongest first-order condition used for nonsmooth nonconvex programs, under a new pointwise Slater constraint qualification (PSCQ).

Timeline:

  • Pang, Razaviyayn and Alvarado (Mathematics of Operations Research 42(1), 2017) computed B-stationary points of DC programs with one DC constraint. They reduced several constraints to one through a max-type reformulation. Their convergence result needs the maximizing piece of each concave part to be unique at the limit point, together with a Slater-type condition on the reformulated constraint.
  • Le Thi, Huynh and Pham Dinh (2014) gave penalty-type DCA methods for the case where every ψi\psi_iψi​ is smooth.
  • Lu, Sun and Zhou (2021/2022) drop the uniqueness assumption. Their PSCQ is strictly weaker than the condition of Pang et al. (Remark 2.1 gives a two-constraint example where the PSCQ holds and the earlier condition fails), and they need only approximate subproblem solutions.

Setting

Let X⊆RnX\subseteq\mathbb R^nX⊆Rn be closed and convex, and let S⊇X\mathcal S\supseteq XS⊇X be an open convex set. For i=0,1,…,Ii=0,1,\dots,Ii=0,1,…,I:

  • ζi\zeta_iζi​ is convex and continuous on S\mathcal SS;
  • ϕi\phi_iϕi​ is convex and C1C^1C1 on S\mathcal SS, with ∥∇ϕi(x)−∇ϕi(y)∥≤Li∥x−y∥\|\nabla\phi_i(x)-\nabla\phi_i(y)\|\le L_i\|x-y\|∥∇ϕi​(x)−∇ϕi​(y)∥≤Li​∥x−y∥ on XXX, where Li≥0L_i\ge 0Li​≥0 and L0>0L_0>0L0​>0;
  • ψi(x)=max⁡1≤j≤Jiψi,j(x)\psi_i(x)=\max_{1\le j\le J_i}\psi_{i,j}(x)ψi​(x)=max1≤j≤Ji​​ψi,j​(x), where each ψi,j\psi_{i,j}ψi,j​ is convex and C1C^1C1 on S\mathcal SS.

The program is

min⁡x∈XF(x)=ϕ0(x)+ζ0(x)−ψ0(x)s.t.ϕi(x)+ζi(x)−ψi(x)≤0, i∈I={1,…,I},\min_{x\in X} F(x)=\phi_0(x)+\zeta_0(x)-\psi_0(x)\quad\text{s.t.}\quad \phi_i(x)+\zeta_i(x)-\psi_i(x)\le 0,\ i\in\mathcal I=\{1,\dots,I\},x∈Xmin​F(x)=ϕ0​(x)+ζ0​(x)−ψ0​(x)s.t.ϕi​(x)+ζi​(x)−ψi​(x)≤0, i∈I={1,…,I},

with feasible region Ω\OmegaΩ. The definitions used throughout are these.

  • Active sets. For x∈Xx\in Xx∈X, Ji(x)\mathcal J_i(x)Ji​(x) is the set of indices jjj with ψi,j(x)=ψi(x)\psi_{i,j}(x)=\psi_i(x)ψi,j​(x)=ψi​(x). J(x)\mathcal J(x)J(x) is the set of tuples J=(j1,…,jI)\mathbb J=(j_1,\dots,j_I)J=(j1​,…,jI​) with ji∈Ji(x)j_i\in\mathcal J_i(x)ji​∈Ji​(x). I=(x)\mathcal I_=(x)I=​(x) is the set of constraints that hold with equality.
  • Tangent cone. The tangent cone TY(x)\mathcal T_Y(x)TY​(x) is the set of limits lim⁡k(xk−x)/τk\lim_k (x^k-x)/\tau_klimk​(xk−x)/τk​ with xk∈Yx^k\in Yxk∈Y, xk→xx^k\to xxk→x and τk↓0\tau_k\downarrow 0τk​↓0.
  • Directional derivative. The directional derivative is f′(x;d)=lim⁡τ↓0(f(x+τd)−f(x))/τf'(x;d)=\lim_{\tau\downarrow0}\big(f(x+\tau d)-f(x)\big)/\tauf′(x;d)=limτ↓0​(f(x+τd)−f(x))/τ.
  • B-stationarity. A point xˉ∈Ω\bar x\in\Omegaxˉ∈Ω is B-stationary if F′(xˉ;d)≥0F'(\bar x;d)\ge 0F′(xˉ;d)≥0 for all d∈TΩ(xˉ)d\in\mathcal T_\Omega(\bar x)d∈TΩ​(xˉ).
  • PSCQ. The PSCQ holds at xˉ\bar xxˉ if, for every J∈J(xˉ)\mathbb J\in\mathcal J(\bar x)J∈J(xˉ), some dJ∈TX(xˉ)d_{\mathbb J}\in\mathcal T_X(\bar x)dJ​∈TX​(xˉ) satisfies ∇ϕi(xˉ)TdJ+ζi′(xˉ;dJ)−∇ψi,ji(xˉ)TdJ<0\nabla\phi_i(\bar x)^Td_{\mathbb J}+\zeta_i'(\bar x;d_{\mathbb J})-\nabla\psi_{i,j_i}(\bar x)^Td_{\mathbb J}<0∇ϕi​(xˉ)TdJ​+ζi′​(xˉ;dJ​)−∇ψi,ji​​(xˉ)TdJ​<0 for all i∈I=(xˉ)i\in\mathcal I_=(\bar x)i∈I=​(xˉ).

Algorithm 3.1 fixes ϵ>0\epsilon>0ϵ>0, ρ0>0\rho_0>0ρ0​>0, σ>1\sigma>1σ>1, tolerances ηk≥0\eta_k\ge0ηk​≥0 with ηk→0\eta_k\to0ηk​→0, and an exponent p≥1p\ge1p≥1. It sets ρk=ρ0σk\rho_k=\rho_0\sigma^kρk​=ρ0​σk and requires each iterate xk∈Xx^k\in Xxk∈X to satisfy

Fρk(xk)≤Qρk(x;xk,j0,J)+ηk∀x∈XF_{\rho_k}(x^k)\le Q_{\rho_k}(x;x^k,j_0,\mathbb J)+\eta_k\qquad\forall x\in XFρk​​(xk)≤Qρk​​(x;xk,j0​,J)+ηk​∀x∈X

for every ϵ\epsilonϵ-active j0j_0j0​ and J\mathbb JJ at xkx^kxk. Here:

  • Fρ=F+ρ∑i[ϕi+ζi−ψi]+pF_\rho=F+\rho\sum_i[\phi_i+\zeta_i-\psi_i]_+^pFρ​=F+ρ∑i​[ϕi​+ζi​−ψi​]+p​ is the penalty function;
  • QρQ_\rhoQρ​ is the convex majorant obtained by replacing ϕi\phi_iϕi​ with ϕ^i(x;xˉ)=ϕi(xˉ)+∇ϕi(xˉ)T(x−xˉ)+Li∥x−xˉ∥2/2\hat\phi_i(x;\bar x)=\phi_i(\bar x)+\nabla\phi_i(\bar x)^T(x-\bar x)+L_i\|x-\bar x\|^2/2ϕ^​i​(x;xˉ)=ϕi​(xˉ)+∇ϕi​(xˉ)T(x−xˉ)+Li​∥x−xˉ∥2/2, and ψi,j\psi_{i,j}ψi,j​ with its linearization ℓψi,j(x;xˉ)\ell_{\psi_{i,j}}(x;\bar x)ℓψi,j​​(x;xˉ).

Formalization targets

Goal: Theorem 3.1(iii)

If {xk}k∈K→x∞\{x^k\}_{k\in\mathcal K}\to x^\infty{xk}k∈K​→x∞ along a subsequence of a run of Algorithm 3.1, and x∞∈Ωx^\infty\in\Omegax∞∈Ω, I=(x∞)≠∅\mathcal I_=(x^\infty)\neq\emptysetI=​(x∞)=∅ and the PSCQ holds at x∞x^\inftyx∞, then

F′(x∞;d)≥0∀d∈TΩ(x∞).F'(x^\infty;d)\ge 0\qquad\forall d\in\mathcal T_\Omega(x^\infty).F′(x∞;d)≥0∀d∈TΩ​(x∞).

The statement fixes no constants; it holds for every admissible choice of ϵ,ρ0,σ,η,p\epsilon,\rho_0,\sigma,\eta,pϵ,ρ0​,σ,η,p and every convergent subsequence.

Milestones

In the order the proof uses them:

  1. Remark 3.1(i): ϵ\epsilonϵ-active sets contain the active sets nearby.
  2. (3.10): the iterate inequality for active indices along K\mathcal KK.
  3. (3.18): a Slater point x^\hat xx^ of YJ(x∞)Y_{\mathbb J}(x^\infty)YJ​(x∞).
  4. (3.20)–(3.21): strict feasibility for the quadratic models along segments towards x∞x^\inftyx∞.
  5. (3.26): x∞x^\inftyx∞ minimizes ϕ^0(⋅;x∞)+ζ0−ℓψ0,j0(⋅;x∞)\hat\phi_0(\cdot;x^\infty)+\zeta_0-\ell_{\psi_{0,j_0}}(\cdot;x^\infty)ϕ^​0​(⋅;x∞)+ζ0​−ℓψ0,j0​​​(⋅;x∞) over YJ(x∞)Y_{\mathbb J}(x^\infty)YJ​(x∞).

The supporting results of §§1–2 follow: 6. (1.16), Danskin's formula. 7. (2.1): TΩ=⋃JTΩJ\mathcal T_\Omega=\bigcup_{\mathbb J}\mathcal T_{\Omega_{\mathbb J}}TΩ​=⋃J​TΩJ​​. 8. Proposition 2.1: TYJ(xˉ)=TΩJ=CJ\mathcal T_{Y_{\mathbb J}(\bar x)}=\mathcal T_{\Omega_{\mathbb J}}=C_{\mathbb J}TYJ​(xˉ)​=TΩJ​​=CJ​. 9. Corollary 2.1. 10. Theorem 2.1: under the PSCQ, B-stationarity reduces to F′(xˉ;d)≥0F'(\bar x;d)\ge0F′(xˉ;d)≥0 on each TYJ(xˉ)(xˉ)\mathcal T_{Y_{\mathbb J}(\bar x)}(\bar x)TYJ​(xˉ)​(xˉ).

Significance

The theorem certifies that a practical method, one whose subproblems are solved only approximately, reaches the strongest standard stationarity notion for DC-constrained programs. It does so without the piece-uniqueness assumption, so limit points may sit where some ψi\psi_iψi​ is nondifferentiable, which is the typical case in sparse and piecewise-affine models. Theorem 2.1 and Corollary 2.1 are useful in their own right: they describe the tangent cone of a nonconvex DC feasible region as a finite union of cones of convex sets.

Formalization status: the result is proved on paper. The local Prove2Me prior-art search found no machine-checked version of this theorem. Proposition 2.1 is stated in the paper without proof (it refers to Pang et al.), so a complete development must supply that argument.

Difficulty

Passing to the limit in (3.7) faces two obstacles. The inequality is available for pieces that are ϵ\epsilonϵ-active at xkx^kxk, while the conclusion concerns active pieces at x∞x^\inftyx∞. Also, ρk→∞\rho_k\to\inftyρk​→∞, so the penalty term cannot simply be dropped in the limit. The PSCQ must provide enough strict feasibility for the limiting comparison to remain meaningful.

The limiting minimization property is posed on each convex set YJ(x∞)Y_{\mathbb J}(x^\infty)YJ​(x∞), while B-stationarity concerns the nonconvex set Ω\OmegaΩ. Relating their tangent cones is a separate difficulty. Proposition 2.1 requires a Slater-type tangent-cone result whose proof the paper leaves to the literature.

Formalization scope

The space is EuclideanSpace ℝ (Fin n), and gradients are fderiv. Indices are Fin (m+1) with m = I: index 0 is the objective and constraint iii is i.succ. Each ψi\psi_iψi​ has a nonempty, finite set of pieces. The conventions committed to are these.

  • Convexity of S\mathcal SS is explicit.
  • No Li=0L_i=0Li​=0 convention. The convention "Li=0L_i=0Li​=0 when ϕi\phi_iϕi​ is affine" is not imposed; it matters only for part (iv).
  • Tangent cone. It is defined sequentially, with τk>0\tau_k>0τk​>0 and τk→0\tau_k\to0τk​→0. Mathlib's tangentConeAt, which admits negative scalings, is not used.
  • Directional derivative. It is the published predicate ClarkeGradients.MaxFunctions.HasOneSidedDirDeriv, a limit along τ→0+\tau\to0^+τ→0+, never a limUnder value. B-stationarity therefore asserts that F′(x∞;d)F'(x^\infty;d)F′(x∞;d) exists and is nonnegative.
  • Runs. A run of Algorithm 3.1 is a predicate with ρk=ρ0σk\rho_k=\rho_0\sigma^kρk​=ρ0​σk, σ>1\sigma>1σ>1, ρ0>0\rho_0>0ρ0​>0, p≥1p\ge1p≥1, ηk≥0\eta_k\ge0ηk​≥0, ηk→0\eta_k\to0ηk​→0. Condition (3.7) is imposed for every ϵ\epsilonϵ-active j0j_0j0​ and J\mathbb JJ, and every x∈Xx\in Xx∈X. A subsequence is a strictly increasing K:N→NK:\mathbb N\to\mathbb NK:N→N.
  • Penalty powers. [a]+p[a]_+^p[a]+p​ is (max a 0) ^ p with a real exponent.

Ruling out trivial readings.

  • Imposing (3.7) only at exactly active indices, or leaving ρk\rho_kρk​ free, would weaken the run hypothesis and break the proof. Taking a two-sided tangent cone would change the conclusion.
  • The hypotheses of the goal are satisfiable: a sorry-free check exhibits a one-dimensional run with an active constraint at which the PSCQ holds.

Deliberately absent.

  • Theorem 3.1(i), (ii) and (iv): other conclusions of the same theorem, not used by (iii).
  • The polyhedral branch of Proposition 2.1, Corollary 2.1 and Theorem 2.1, used only by (iv).
  • The augmented Lagrangian results, Theorems 4.1 and 4.2: a parallel analysis, and a KKT result needing subdifferentials and normal cones.
  • The KKT characterization, Theorem 2.2.
  • The finite termination of the inner solver, Theorem 5.1. The goal quantifies over all runs, so it does not depend on how the iterates are computed.

The tangent cone, B-stationarity, the PSCQ and Danskin's formula are reusable for other nonsmooth constrained programs. Contributions are welcome on any milestone, and in particular on the tangent-cone results (2.1) and Proposition 2.1, and on directional derivatives of convex functions on open sets.

Selected references

  • Z. Lu, Z. Sun, Z. Zhou, Penalty and augmented Lagrangian methods for constrained DC programming, Mathematics of Operations Research, 2022; preprint arXiv:2111.09263v1, 2021.
  • J.-S. Pang, M. Razaviyayn, A. Alvarado, Computing B-stationary points of nonsmooth DC programs, Mathematics of Operations Research 42(1):95–118, 2017. DOI.
  • H. A. Le Thi, V. N. Huynh, T. Pham Dinh, DC programming and DCA for general DC programs, in Advanced Computational Methods for Knowledge Engineering, Springer, 15–35, 2014. DOI.
15 thms0 active usersReviewed
Convex OptimizationEconomics·Captain: mikedeng1

Discrete Choice Prox-Functions on the Simplex: The Convex Conjugate of an Additive Random Utility Surplus Function Is a Prox-Function on the SimplexResearch Paper

Motivation

Prox-functions determine how subgradient and mirror-type optimization methods turn a direction of improvement into the next feasible point. On a probability simplex, that step should respect the geometry of probability vectors and be computable from the current direction. The entropic prox-function gives the softmax rule, familiar from the logit model of discrete choice. Müller, Nesterov and Shikhman ask whether a wider family of random-utility choice models supplies prox-functions with the same operational link between optimization and choice probabilities. Their 2019 preprint, published in Mathematics of Operations Research in 2022, states that it does: the convex conjugate of the model's surplus is a prox-function on the simplex.

This question matters to optimization because the random-utility law specifies a geometry and a computable update together. It matters to discrete-choice modeling because the update from an optimization problem can be interpreted as a vector of probabilities of choosing each alternative. The mission covers the general result in Section 2 of the preprint, rather than its later specialized generalized-extreme-value parameters or economic application.

Setting

There are n≥1n\ge1n≥1 alternatives. A deterministic utility vector u∈Rnu\in\mathbb R^nu∈Rn is perturbed by a random shock vector ϵ∈Rn\epsilon\in\mathbb R^nϵ∈Rn with law μ\muμ. Assumption 1 requires a finite mean, absolute continuity with respect to Lebesgue measure, and full support in Rn\mathbb R^nRn. The surplus function is the expected best perturbed utility,

E(u)=Eμ ⁣[max⁡1≤i≤n(ui+ϵi)].E(u)=\mathbb E_\mu\!\left[\max_{1\le i\le n}\bigl(u_i+\epsilon_i\bigr)\right].E(u)=Eμ​[1≤i≤nmax​(ui​+ϵi​)].

The convex conjugate of this function is taken over every utility vector, with extended-real values:

E∗(p)=sup⁡u∈Rn{⟨p,u⟩−E(u)},⟨p,u⟩=∑ipiui.E^*(p)=\sup_{u\in\mathbb R^n}\{\langle p,u\rangle-E(u)\},\qquad \langle p,u\rangle=\sum_i p_i u_i.E∗(p)=u∈Rnsup​{⟨p,u⟩−E(u)},⟨p,u⟩=i∑​pi​ui​.

The candidate domain is the simplex Δ={p∈Rn:pi≥0, ∑ipi=1}\Delta=\{p\in\mathbb R^n:p_i\ge0,\ \sum_i p_i=1\}Δ={p∈Rn:pi​≥0, ∑i​pi​=1}. The model's choice probability Pi(u)P_i(u)Pi​(u) is the chance that ui+ϵiu_i+\epsilon_iui​+ϵi​ attains the largest perturbed utility. Absolute continuity makes ties null, so including ties in this event does not change its probability. The paper identifies Pi(u)P_i(u)Pi​(u) with the iiith derivative of EEE in equation (1).

A prox-function on Δ\DeltaΔ is continuous and strongly convex there, and the optimization step that maximizes ⟨p,u⟩−E∗(p)\langle p,u\rangle-E^*(p)⟨p,u⟩−E∗(p) over p∈Δp\in\Deltap∈Δ has a unique, directly available answer. Here strong convexity uses ∥p−q∥1=∑i∣pi−qi∣\|p-q\|_1=\sum_i|p_i-q_i|∥p−q∥1​=∑i​∣pi​−qi​∣. The relevant smoothness of EEE uses the dual norm ∥u∥∞=max⁡i∣ui∣\|u\|_\infty=\max_i|u_i|∥u∥∞​=maxi​∣ui​∣.

Formalization targets

The goal combines the three claims that form the paper's Section 2 main result. First, Theorem 1 says that the finite domain of E∗E^*E∗ is exactly Δ\DeltaΔ, and that E∗E^*E∗ is continuous even at the boundary of that simplex. Second, Theorem 2 supplies an explicit strong-convexity parameter. For distinct alternatives i,ji,ji,j, let gijg_{ij}gij​ be a density of ϵj−ϵi\epsilon_j-\epsilon_iϵj​−ϵi​ and let zˉij\bar z_{ij}zˉij​ be a mode of that density. Then

E∗(αp+(1−α)q)≤αE∗(p)+(1−α)E∗(q)−β2α(1−α)∥p−q∥12,β=12∑i∑j≠igij(zˉij)E^*(\alpha p+(1-\alpha)q)\le \alpha E^*(p)+(1-\alpha)E^*(q) -\frac{\beta}{2}\alpha(1-\alpha)\|p-q\|_1^2, \quad \beta=\frac{1}{2\sum_i\sum_{j\ne i}g_{ij}(\bar z_{ij})}E∗(αp+(1−α)q)≤αE∗(p)+(1−α)E∗(q)−2β​α(1−α)∥p−q∥12​,β=2∑i​∑j=i​gij​(zˉij​)1​

for p,q∈Δp,q\in\Deltap,q∈Δ and α∈[0,1]\alpha\in[0,1]α∈[0,1]. The double sum is over ordered pairs. Third, under the strong-convexity premise stated at the opening of §2.2.3, Theorem 4 identifies the optimizer and the attained value:

argmax⁡p∈Δ(⟨p,u⟩−E∗(p))=P(u),max⁡p∈Δ(⟨p,u⟩−E∗(p))=E(u).\underset{p\in\Delta}{\operatorname{argmax}} \bigl(\langle p,u\rangle-E^*(p)\bigr)=P(u), \qquad \max_{p\in\Delta}\bigl(\langle p,u\rangle-E^*(p)\bigr)=E(u).p∈Δargmax​(⟨p,u⟩−E∗(p))=P(u),p∈Δmax​(⟨p,u⟩−E∗(p))=E(u).

The milestones record Lemmas 1, 2, 3 and 5, equation (1), and Theorems 1, 2 and 4. They cover the paper's elementary surplus properties, the choice-probability identity, the relation between strong convexity and strong smoothness, the Hessian norm criterion, the matrix trace bound, and the three final clauses.

Significance

The result gives a family of simplex prox-functions indexed by shock laws, rather than by a single entropy formula. The optimizer in the auxiliary problem is a choice-probability vector, so a prox update has an explicit behavioral interpretation. The strong-convexity bound supplies the geometric constant used when such a function enters first-order optimization estimates. The paper's later sections derive parameters for generalized extreme-value models and apply the update to a consumption cycle; those consequences motivate the general theorem but are outside this mission's goal.

The result is proved in the cited paper; this mission asks for its Lean formalization. The current draft has compile-checked statements with proof placeholders. A complete development would add machine-checked proofs of the listed lemmas and goal, together with reusable results about conjugacy, probability laws of differences, and norms of finite matrices. No proof of this specific paper result is claimed here.

Difficulty

Continuity in the relative interior of a simplex does not by itself establish continuity at its boundary, which is part of Theorem 1. The choice-probability formula connects differentiation of an expected maximum with an event defined by inequalities; ties, measurability, and integrability must all be handled. The strong-convexity constant then depends on controlling the Hessian with the norm induced from ℓ∞\ell_\inftyℓ∞​ to ℓ1\ell_1ℓ1​, while retaining the ordered-pair sum of density values. A direct substitution of the default norm on finite coordinate functions would change the theorem because that norm is ℓ∞\ell_\inftyℓ∞​.

Formalization scope

Alternatives are Fin n with [NeZero n]; vectors are Fin n → ℝ. The law μ\muμ is a probability measure on shock vectors. Assumption 1 explicitly includes coordinate integrability, absolute continuity and full support. Its integrability clause keeps the Bochner integral defining EEE meaningful, rather than allowing the integral's default value on a nonintegrable function. The choice event includes ties, which have zero measure under Assumption 1. The conjugate is EReal valued and takes its supremum over all utility vectors; defining it by a maximum over the simplex or by an entropy formula would change the result.

The real value of E∗E^*E∗ is used only alongside its finiteness on Δ\DeltaΔ. Strong convexity uses an explicit ℓ1\ell_1ℓ1​ sum, while Mathlib's norm on Fin n → ℝ represents ℓ∞\ell_\inftyℓ∞​. Coordinate derivatives and the Hessian are formed from Fréchet derivatives. The differences ϵj−ϵi\epsilon_j-\epsilon_iϵj​−ϵi​ have fixed, nonnegative measurable density versions tied to their pushforward laws; each mode maximizes its selected version pointwise. Theorem 4 carries the positive strong-convexity premise stated in its section preamble. The paper uses twice differentiability of EEE on page 7 without deriving it from Assumption 1. This mission explicitly adds ContDiff ℝ 2 E to the Hessian-dependent result and the goal. It is a necessary disclosed strengthening of the paper's stated assumptions.

For one alternative the simplex is a point, and the displayed denominator in β\betaβ is zero. Lean evaluates the reciprocal as zero. The strong-convexity inequality is then vacuous between distinct points; the draft asserts positivity of the displayed β\betaβ only when n≥2n\ge2n≥2 and separately asserts that some positive parameter exists for every n≥1n\ge1n≥1, as Definition 1 requires. No empty set of alternatives is admitted. Contributions should keep the unrestricted conjugate, the law-dependent densities, the exact ℓ1\ell_1ℓ1​ inequality, and the paper's constants. General finite-dimensional convex duality and induced matrix-norm lemmas would be reusable beyond this model.

Selected references

  • D. Müller, Yu. Nesterov and V. Shikhman, Discrete choice prox-functions on the simplex, arXiv:1909.05591v1, 2019; published in Mathematics of Operations Research, 2022. Preprint.
10 thms0 active usersReviewed
Differential GeometryNumerical Analysis·Captain: mikedeng1

Active-Set Newton Methods and Partial Smoothness: Transversal C² Manifolds with a Constant-Rank Map Between Them Yield a Quadratically Convergent Active-Set Newton IterationResearch Paper

Motivation

Active-set methods for optimization and variational problems run in two phases. A globally convergent first phase identifies which constraints are active at the solution; once they are identified the problem simplifies locally, and a second phase converges fast, typically by linearizing the simplified problem. Sequential quadratic programming for nonlinear programming is the classical instance: near a solution satisfying the standard second-order conditions, the graph of the normal-cone operator and the space Rn×{cˉ}\mathbf R^n\times\{\bar c\}Rn×{cˉ} are manifolds meeting at a single point, and one Newton step linearizes the first, intersects with the second, and restores the result.

The property behind the first phase, finite identification of an active manifold, is formalized by partial smoothness, introduced by Lewis (SIAM J. Optim., 2002) after Wright's identifiable surfaces (SIAM J. Control Optim., 1993); its constant-rank characterization is in Lewis and Liang, arXiv:1807.03134. Lewis and Wylie (arXiv:1902.00724) isolate what drives the second phase in the same geometric language: two manifolds intersecting transversally at an isolated point, a semi-linearization step, and a constant-rank map between the manifolds that splits the restoration step into a primal and a dual update. Their Theorem 5.1 is the general result; applied to the graph of a set-valued map it gives an active-set Newton method for generalized equations 0∈Φ(u)0\in\Phi(u)0∈Φ(u) with Φ\PhiΦ partly smooth.

Setting

Let E\mathbf EE be a Euclidean space with norm ∣⋅∣|\cdot|∣⋅∣. A set X⊂E\mathcal X\subset\mathbf EX⊂E is a C(r)C^{(r)}C(r)-manifold around a point z∈Xz\in\mathcal Xz∈X if there are a C(r)C^{(r)}C(r)-smooth map F:E→RmF:\mathbf E\to\mathbf R^mF:E→Rm with surjective derivative DF(z)DF(z)DF(z) and an open set V∋zV\ni zV∋z with X∩V=F−1(0)∩V\mathcal X\cap V=F^{-1}(0)\cap VX∩V=F−1(0)∩V.

The tangent space TX(x)T_{\mathcal X}(x)TX​(x) is the linear span of the tangent cone of X\mathcal XX at xxx, and the normal space is NX(x)=TX(x)⊥N_{\mathcal X}(x)=T_{\mathcal X}(x)^\perpNX​(x)=TX​(x)⊥. For a manifold, TX(z)=Null DF(z)T_{\mathcal X}(z)=\mathrm{Null}\,DF(z)TX​(z)=NullDF(z). Two manifolds X\mathcal XX, Y\mathcal YY around zzz intersect transversally at zzz if NX(z)∩NY(z)={0}N_{\mathcal X}(z)\cap N_{\mathcal Y}(z)=\{0\}NX​(z)∩NY​(z)={0}, and zzz is an isolated point of intersection if X∩Y∩V={z}\mathcal X\cap\mathcal Y\cap V=\{z\}X∩Y∩V={z} for some open V∋zV\ni zV∋z.

The semi-linearization point y(x)y(x)y(x) of x∈Xx\in\mathcal Xx∈X is the unique point where the linear approximation x+TX(x)x+T_{\mathcal X}(x)x+TX​(x) meets Y\mathcal YY near zzz: only X\mathcal XX is linearized.

A map PPP from X\mathcal XX into Y\mathcal YY is C(2)C^{(2)}C(2)-smooth and constant rank nearby zzz if it is C(2)C^{(2)}C(2) on a neighborhood of zzz and the rank of DP(x)DP(x)DP(x) on TX(x)T_{\mathcal X}(x)TX​(x) is the same for all x∈Xx\in\mathcal Xx∈X near zzz. For a neighborhood WWW of zzz the image M=P(X∩W)\mathcal M=P(\mathcal X\cap W)M=P(X∩W) is the active manifold. ProjA\mathrm{Proj}_AProjA​ is the nearest-point projection onto a set AAA. An iteration x←T(x)x\leftarrow T(x)x←T(x) converges quadratically to zzz if, from every start x0∈Xx_0\in\mathcal Xx0​∈X close enough to zzz, the iterates stay in X\mathcal XX near zzz, converge to zzz, and satisfy ∣xn+1−z∣≤C∣xn−z∣2|x_{n+1}-z|\le C|x_n-z|^2∣xn+1​−z∣≤C∣xn​−z∣2 with one constant CCC.

Formalization targets

Goal: Theorem 5.1 (Active set method for manifold intersection)

Let zzz be an isolated, transversal point of intersection of two C(2)C^{(2)}C(2)-manifolds X\mathcal XX and Y\mathcal YY around zzz, and let P:X→YP:\mathcal X\to\mathcal YP:X→Y fix zzz and be C(2)C^{(2)}C(2)-smooth and constant rank nearby. Then for every sufficiently small ball WWW around zzz:

(a)  M=P(X∩W) is a C(2)-manifold around z;(b)  ∃ S:Y∩W→M Lipschitz, S(z)=z; near z, S=ProjM is one;(c)  ∃ Q:M∩W→X Lipschitz, Q(z)=z, P(Q(w))=w; near z, Q(w)=ProjP−1(w)(w) is one;(d)  (x+TX(x))∩Y∩W={y(x)} for all x∈X∩W;\begin{aligned} &\text{(a)}\ \ \mathcal M=P(\mathcal X\cap W)\ \text{is a } C^{(2)}\text{-manifold around } z;\\ &\text{(b)}\ \ \exists\ S:\mathcal Y\cap W\to\mathcal M \text{ Lipschitz},\ S(z)=z;\ \text{near } z,\ S=\mathrm{Proj}_{\mathcal M}\ \text{is one};\\ &\text{(c)}\ \ \exists\ Q:\mathcal M\cap W\to\mathcal X \text{ Lipschitz},\ Q(z)=z,\ P(Q(w))=w;\ \text{near } z,\ Q(w)=\mathrm{Proj}_{P^{-1}(w)}(w)\ \text{is one};\\ &\text{(d)}\ \ (x+T_{\mathcal X}(x))\cap\mathcal Y\cap W=\{y(x)\}\ \text{for all } x\in\mathcal X\cap W; \end{aligned}​(a)  M=P(X∩W) is a C(2)-manifold around z;(b)  ∃ S:Y∩W→M Lipschitz, S(z)=z; near z, S=ProjM​ is one;(c)  ∃ Q:M∩W→X Lipschitz, Q(z)=z, P(Q(w))=w; near z, Q(w)=ProjP−1(w)​(w) is one;(d)  (x+TX​(x))∩Y∩W={y(x)} for all x∈X∩W;​

and for every such SSS and QQQ the iteration x←Q(S(y(x)))x\leftarrow Q\big(S(y(x))\big)x←Q(S(y(x))) converges quadratically to zzz.

Milestones

  1. §2, p. 4: TX(z)=Null DF(z)=Range DG(0)T_{\mathcal X}(z)=\mathrm{Null}\,DF(z)=\mathrm{Range}\,DG(0)TX​(z)=NullDF(z)=RangeDG(0) and NX(z)=Range DF(z)∗=Null DG(0)∗N_{\mathcal X}(z)=\mathrm{Range}\,DF(z)^*=\mathrm{Null}\,DG(0)^*NX​(z)=RangeDF(z)∗=NullDG(0)∗, for every defining map FFF and coordinate system GGG.
  2. Theorem 3.1: y(x)y(x)y(x) exists uniquely and ∣y(x)−z∣=O(∣x−z∣2)|y(x)-z|=O(|x-z|^2)∣y(x)−z∣=O(∣x−z∣2).
  3. Corollary 3.5: for every Lipschitz RRR into X\mathcal XX fixing zzz, x←R(y(x))x\leftarrow R(y(x))x←R(y(x)) converges quadratically.
  4. Theorem 5.1(a), (b), (c) as separate statements.

Significance

The result. Theorem 5.1 turns an abstract Newton scheme into an active-set method. Corollary 3.5 needs a Lipschitz restoration map RRR from Y\mathcal YY back into X\mathcal XX, which in applications is coupled and opaque; Theorem 5.1 builds R=Q∘SR=Q\circ SR=Q∘S from a constant-rank map, so the primal variables are updated by projecting onto the active manifold and the dual variables by a fiber projection with the primal part held fixed. With X=gph⁡Φ\mathcal X=\operatorname{gph}\PhiX=gphΦ, Y=U×{0}\mathcal Y=\mathbf U\times\{0\}Y=U×{0} and P(u,v)=(u,0)P(u,v)=(u,0)P(u,v)=(u,0) this yields the paper's Theorem 5.5 for partly smooth generalized equations, and through it Newton-type methods for variational inequalities over partly smooth sets (§6).

Formalizing it. The theorems are proved in the paper; none is machine-checked. The mission produces a statement of Theorem 5.1 at the level of sets in a Euclidean space, with every hypothesis explicit, and the intermediate results it depends on. A proof needs, in Lean, the identification of the tangent cone of a zero-set manifold with the kernel of the derivative, the semi-linearization estimate via the implicit function theorem, the constant-rank theorem for maps between embedded submanifolds, and local Lipschitz continuity of nearest-point projections onto C(2)C^{(2)}C(2) submanifolds. Several of these are absent from Mathlib in this form.

Difficulty

The convergence claim follows from Corollary 3.5 once (a)–(c) are available, and Corollary 3.5 follows from the quadratic estimate (3.2). The hard part is (a)–(c). Mathlib has no constant-rank theorem, which is what makes M\mathcal MM a manifold. And the image M=P(X∩W)\mathcal M=P(\mathcal X\cap W)M=P(X∩W) is not closed, so neither the nearest point of M\mathcal MM to a point of Y∩W\mathcal Y\cap WY∩W nor the nearest point of a fiber P−1(w)P^{-1}(w)P−1(w) need exist: both projections are single-valued and Lipschitz only near zzz, and the obvious argument (project onto a closed set) does not apply. A second obstacle is that TX(x)T_{\mathcal X}(x)TX​(x) enters at points x≠zx\ne zx=z, so the identification of the tangent cone with the classical tangent space is needed at every point of X\mathcal XX near zzz, not only at zzz.

Formalization scope

  • E\mathbf EE is a finite-dimensional real inner-product space; Rm\mathbf R^mRm is EuclideanSpace ℝ (Fin m). Smoothness C(r)C^{(r)}C(r) is ContDiff ℝ r with rrr a natural number. All maps (PPP, SSS, QQQ, RRR, yyy) are total functions on E\mathbf EE; mapping and Lipschitz conditions are imposed only on the paper's domains (Y∩W\mathcal Y\cap WY∩W, M∩W\mathcal M\cap WM∩W), never globally.
  • "F−1(0)F^{-1}(0)F−1(0) is a neighborhood of zzz in X\mathcal XX" is local equality on an open set. TX(x)T_{\mathcal X}(x)TX​(x) and NX(x)N_{\mathcal X}(x)NX​(x) come from the published definition ProjLikeRetr.Retractor.tangentBundle (span of tangentConeAt and its orthogonal complement), so they do not depend on a choice of FFF.
  • "C(2)C^{(2)}C(2)-smooth and constant rank nearby" is read as C(2)C^{(2)}C(2) on an open set of E\mathbf EE around zzz with constant rank of DP(x)∣TX(x)DP(x)|_{T_{\mathcal X}(x)}DP(x)∣TX​(x)​ for x∈Xx\in\mathcal Xx∈X near zzz.
  • "Any sufficiently small neighborhood WWW" ranges over open balls B(z,ε)B(z,\varepsilon)B(z,ε), 0<ε≤r0<\varepsilon\le r0<ε≤r: for open sets that are not star-shaped about zzz, part (d) can fail.
  • The two "in particular" projection clauses are stated on a ball B(z,δ)B(z,\delta)B(z,δ) for some δ>0\delta>0δ>0; the fiber of PPP over www is taken in X∩W\mathcal X\cap WX∩W.
  • Corollary 3.5 assumes RRR Lipschitz only on Y∩W\mathcal Y\cap WY∩W, which is the form Theorem 5.1 uses.
  • The existence half of (b) is witnessed by the constant map S≡zS\equiv zS≡z, and an existential convergence claim would be witnessed by S≡Q≡zS\equiv Q\equiv zS≡Q≡z. The goal therefore keeps the projection clauses and quantifies the convergence claim over every admissible SSS and QQQ.
  • Not formalized: Theorem 5.5 and §6 (coderivatives, partly smooth set-valued maps, variational inequalities).

Contributions welcome: the tangent-cone/kernel identity (reusable for any zero-set manifold), a constant-rank theorem for maps between embedded submanifolds of a Euclidean space, and local Lipschitz continuity of the projection onto a C(2)C^{(2)}C(2) submanifold. All three are useful well beyond this mission.

Selected references

  • A.S. Lewis and C. Wylie, Active-set Newton methods and partial smoothness, Mathematics of Operations Research, 2021; preprint arXiv:1902.00724v1, 2019. https://arxiv.org/abs/1902.00724
  • A.S. Lewis and J. Liang, Partial smoothness and constant rank, arXiv:1807.03134, 2018. https://arxiv.org/abs/1807.03134
  • A.S. Lewis, Active sets, nonsmoothness, and sensitivity, SIAM J. Optim. 13:702–725, 2002.
  • S.J. Wright, Identifiable surfaces in constrained optimization, SIAM J. Control Optim. 31:1063–1079, 1993.
  • J.M. Lee, Introduction to Smooth Manifolds, Springer, 2003.
  • R.T. Rockafellar and R.J-B. Wets, Variational Analysis, Springer, 1998.
9 thms0 active usersReviewed
EconomicsOperations Research·Captain: mikedeng1

A Model of Product Line Marketing: When the Transformed Marketing Cost Is Concave, the Optimal Marketing Effort Allocation Concentrates on a Single Flagship ProductResearch Paper

Why product lines can have a flagship

Firms with several products often put most of their marketing behind one. The resulting product can become the line's flagship even when another product has a higher unit markup. He, Ke, and Zhang give a supply-side model in which this allocation follows from the relation between consumer taste dispersion and the cost of raising a product's perceived utility. Their main proposition says that a concave transformed marketing cost favors concentrating effort on one product. This mission formalizes that proposition and the fixed-effort claims that support it. He, Ke, and Zhang, A Model of Product Line Marketing, 2021 SSRN version, §2 and Online Appendix C.

The question is operational: a firm chooses marketing effort across its product line while sales move through a multinomial logit choice model. Spending on one product changes its share and also takes sales from the firm's other products. Concentrating marketing effort therefore cannot be inferred from looking at a single product's markup in isolation. The paper's marketing effort allocation index provides a way to compare products at a given total effort. He, Ke, and Zhang, §2.1, pp. 12–15.

The monopoly model

A firm sells nnn products. Product iii has base utility ui∈Ru_i\in\mathbb Rui​∈R and markup πi>0\pi_i>0πi​>0. Consumers either buy one product or select an outside option with utility normalized to zero. A Gumbel taste shock has scale λ>0\lambda>0λ>0. The firm raises product iii's utility by Δui≥θ\Delta u_i\geq\thetaΔui​≥θ, where θ∈R\theta\in\mathbb Rθ∈R is the common lower bound, and pays c(Δui)c(\Delta u_i)c(Δui​). The paper assumes the cost ccc is strictly increasing, convex, and continuously differentiable on feasible utility increases. The logit choice formula gives product iii a share proportional to e(ui+Δui)/λe^{(u_i+\Delta u_i)/\lambda}e(ui​+Δui​)/λ, with 111 in the denominator for the outside option. He, Ke, and Zhang, §2, pp. 7–9.

Equation (7) uses a nonnegative effort multiplier mi=eΔui/λ−eθ/λm_i=e^{\Delta u_i/\lambda}-e^{\theta/\lambda}mi​=eΔui​/λ−eθ/λ. A marketing effort allocation, or MEA strategy, is the vector m=(mi)m=(m_i)m=(mi​) with every mi≥0m_i\geq0mi​≥0. Its total marketing effort, or TME, is M=∑imiM=\sum_i m_iM=∑i​mi​. In these coordinates the firm's program (8) maximizes

P(m)=∑i(mi+eθ/λ)eui/λπi1+∑i(mi+eθ/λ)eui/λ−∑ic ⁣(λlog⁡(mi+eθ/λ))P(m)=\frac{\sum_i(m_i+e^{\theta/\lambda})e^{u_i/\lambda}\pi_i}{1+\sum_i(m_i+e^{\theta/\lambda})e^{u_i/\lambda}}-\sum_i c\!\left(\lambda\log(m_i+e^{\theta/\lambda})\right)P(m)=1+∑i​(mi​+eθ/λ)eui​/λ∑i​(mi​+eθ/λ)eui​/λπi​​−i∑​c(λlog(mi​+eθ/λ))

over every feasible mmm. The first term is revenue and the second is marketing cost. A strategy is concentrated in Definition 1 exactly when one multiplier is positive and all the others are zero. In particular, the zero allocation is a separate case. The transformed cost is fc(v)=c(λlog⁡v)f_c(v)=c(\lambda\log v)fc​(v)=c(λlogv). He, Ke, and Zhang, pp. 10–11, equations (7)–(8), Definition 1, Proposition 1.

For positive total effort MMM, product iii's MEA index is Ri(M)=Ai(M)/Bi(M)R_i(M)=A_i(M)/B_i(M)Ri​(M)=Ai​(M)/Bi​(M), where

Ai(M)=eui/λπi+1M∑je(uj+θ)/λπj,Bi(M)=eui/λ+1M∑je(uj+θ)/λ+1M.A_i(M)=e^{u_i/\lambda}\pi_i+\frac{1}{M}\sum_j e^{(u_j+\theta)/\lambda}\pi_j,\qquad B_i(M)=e^{u_i/\lambda}+\frac{1}{M}\sum_j e^{(u_j+\theta)/\lambda}+\frac{1}{M}.Ai​(M)=eui​/λπi​+M1​j∑​e(uj​+θ)/λπj​,Bi​(M)=eui​/λ+M1​j∑​e(uj​+θ)/λ+M1​.

It equals the revenue when all MMM is assigned to product iii. This is Definition 2 and the sentence immediately following it. He, Ke, and Zhang, p. 12, Definition 2, equation (9).

Formalization targets

The goal is Proposition 1 with its implicit edge cases made explicit. If fcf_cfc​ is concave on [eθ/λ,∞)[e^{\theta/\lambda},\infty)[eθ/λ,∞), an optimum exists, some optimum is concentrated or zero, and pairwise distinct products have no mixed optimum:

∃m∗∈arg max⁡mi≥0P(m),∃m∗ optimal with (m∗=0 or concentrated),\exists m^*\in\operatorname*{arg\,max}_{m_i\geq0}P(m),\qquad \exists m^*\text{ optimal with }(m^*=0\text{ or concentrated}),∃m∗∈mi​≥0argmax​P(m),∃m∗ optimal with (m∗=0 or concentrated), [(ui,πi)≠(uj,πj) for i≠j]⟹[∀m∗ optimal, m∗=0 or concentrated].\left[(u_i,\pi_i)\ne(u_j,\pi_j)\text{ for }i\ne j\right]\Longrightarrow\left[\forall m^*\text{ optimal},\ m^*=0\text{ or concentrated}\right].[(ui​,πi​)=(uj​,πj​) for i=j]⟹[∀m∗ optimal, m∗=0 or concentrated].

The milestone list follows the source's fixed-effort results. Lemma 3 bounds a weighted ratio by its largest component ratio and characterizes equality. The index interpretation and equation (C–9) connect that inequality to revenue. Lemma 4 concerns revenue at fixed TME, while Lemma 5 concerns cost at fixed TME. Proposition 2 restricts which products can receive positive effort at a profit optimum. Claim 1 and Lemma 6 address tied MEA indices at a positive optimal TME. He, Ke, and Zhang, Online Appendix C, pp. 40–43.

What the result establishes

The proposition identifies a class of marketing cost functions under which the firm can choose a single flagship product without giving up optimal profit. Under a distinct-product condition, it characterizes every optimum up to the possibility of zero total effort. The MEA index separately identifies which products can carry positive effort at an optimum. These statements let a solver study effort concentration and product selection within one common optimization model. He, Ke, and Zhang, Propositions 1–2, pp. 11 and 14–15.

The paper proves these results on paper. This mission asks for machine-checked proofs of the model-specific statements, including the edge cases left implicit in the printed wording. It also establishes reusable finite-sum facts, especially the ratio inequality and its equality condition. No machine-checked proof of this paper's marketing-effort theorem is claimed here.

The mathematical difficulty

A larger markup does not always make a product the best flagship. Revenue depends on every product's logit attraction and on the outside option, while cost depends on the entire allocation. Maximizing revenue at a fixed total effort therefore does not by itself solve the firm's original problem, whose total effort is also chosen. Ties in the MEA index create another difficulty: at a fixed total, several products can share effort without changing the revenue, so a concentration statement about every optimum needs a separate condition. He, Ke, and Zhang, §2.1 and Online Appendix C.

Formalization scope

Products are indexed by Fin n; the book's indices 1,…,n1,\ldots,n1,…,n are relabeled from zero. All monetary, utility, and multiplier quantities are real numbers. Strategies range over all nonnegative vectors, and optimality compares profit against every such vector. The outside-option attraction is 111. The cost assumptions apply on [θ,∞)[\theta,\infty)[θ,∞), and transformed-cost concavity applies on [eθ/λ,∞)[e^{\theta/\lambda},\infty)[eθ/λ,∞), the ranges reached by feasible allocations. The formula Ri(M)R_i(M)Ri​(M) is used only for M>0M>0M>0, so its 1/M1/M1/M terms never rely on Lean's default value for division by zero. Since mi+eθ/λ>0m_i+e^{\theta/\lambda}>0mi​+eθ/λ>0, every logarithm in the objective has a positive argument.

The goal includes existence of an optimum so that its statement about all optima has content. It distinguishes zero effort from Definition 1's concentrated allocation: zero effort can be optimal. Pairwise distinct (ui,πi)(u_i,\pi_i)(ui​,πi​) are required for the assertion about every optimum; identical products can support mixed optima. The paper says an optimum is “generically unique” but does not define a generic set or prove uniqueness of the optimal total effort under a specified genericity condition, so that phrase is outside this goal. Lemma 3 separately requires a positive total weight; Claim 1 restricts its rational curves to nonconstant ones. The printed proof of Lemma 6 has a gap for constant tied index curves, noted for reviewers. He, Ke, and Zhang, Definition 1, Proposition 1, Online Appendix C.

The development needs finite sums, real exponentials and logarithms, elementary calculus, and convexity and concavity on intervals. Its model definition is paper-specific; the ratio bound and rational-curve identification are useful beyond this setting. Contributions to any of the stated milestones, including their explicit boundary cases, are in scope.

Selected references

  • C. He, S. Ke, and X. Zhang, A Model of Product Line Marketing, Management Science, 2021; cited here from the August 2021 SSRN preprint, especially §2 and Online Appendix C. Journal DOI.
11 thms0 active usersReviewed
Algebraic Geometry·Captain: mikedeng1

Exploiting Sign Symmetries in Minimizing Sums of Rational Functions: The Sign-Symmetry-Adapted Block-Diagonal SOS Hierarchy Converges Monotonically to the Global MinimumResearch Paper

Motivation

A sum of rational functions is a common objective when several performance measures each have a polynomial numerator and a positive polynomial denominator. Such problems appear, for example, in the applications to computer vision and signal processing cited by Guo, Wang and Zheng in their 2024 preprint. Even when all constraints and numerators are polynomial, the objective need not be convex, and its global minimum can be difficult to certify. Bugarin, Henrion and Lasserre studied a hierarchy based on a measure reformulation of this problem in Minimizing the sum of many rational functions. Guo, Wang and Zheng develop its polynomial dual and exploit sign symmetries to obtain a hierarchy with block-diagonal semidefinite matrices.

The mission targets the convergence assertion in Theorem 4.7(ii) of the pinned preprint, arXiv:2405.09419v1. Its mathematical question is precise: do the lower bounds from the sign-symmetry-adapted semidefinite relaxations increase to the true global infimum? The statement is already proved in the paper. Its formal proof and the supporting algebra are the work posed here.

Setting

Fix nnn real variables, NNN ratios, and mmm polynomial inequality constraints. For polynomials pi,qi,gj∈R[x1,…,xn]p_i,q_i,g_j\in\mathbb R[x_1,\ldots,x_n]pi​,qi​,gj​∈R[x1​,…,xn​], let

K={x∈Rn:gj(x)≥0 for every j∈[m]},ρ=inf⁡x∈K∑i=1Npi(x)qi(x).K=\{x\in\mathbb R^n:g_j(x)\geq0\text{ for every }j\in[m]\},\qquad \rho=\inf_{x\in K}\sum_{i=1}^{N}\frac{p_i(x)}{q_i(x)}.K={x∈Rn:gj​(x)≥0 for every j∈[m]},ρ=x∈Kinf​i=1∑N​qi​(x)pi​(x)​.

Assumption 1.1 says that KKK is compact and each qiq_iqi​ is strictly positive on KKK. The mission also requires N≥2N\geq2N≥2: the paper's definition of the distinguished support set A1A_1A1​ can omit the constraint supports when N=1N=1N=1, and the advertised sparse convergence then fails. This repair is explicit in the formal goal.

A polynomial is a sum of squares (SOS) if it is a finite sum of squares of real polynomials. The quadratic module Q(g)Q(g)Q(g) comprises σ0+∑jσjgj\sigma_0+\sum_j\sigma_jg_jσ0​+∑j​σj​gj​ with every σj\sigma_jσj​ SOS. Its order-kkk truncation Qk(g)Q_k(g)Qk​(g) restricts the degrees of σ0\sigma_0σ0​ and σjgj\sigma_jg_jσj​gj​ to 2k2k2k. The Archimedean condition asks for some M>0M>0M>0 with M−∑a=1nxa2∈Q(g)M-\sum_{a=1}^n x_a^2\in Q(g)M−∑a=1n​xa2​∈Q(g); it is a separate hypothesis in the convergence theorem.

For a finite monomial-exponent set A⊆NnA\subseteq\mathbb N^nA⊆Nn, the sign-symmetry group R(A)R(A)R(A) consists of the vectors r∈{0,1}nr\in\{0,1\}^nr∈{0,1}n for which rTαr^T\alpharTα is even for every α∈A\alpha\in Aα∈A. Its closure Aˉ\bar AAˉ contains every exponent fixed by all these parity tests. The sign action θr\theta_rθr​ substitutes (−1)raxa(-1)^{r_a}x_a(−1)ra​xa​ for xax_axa​. The paper forms AiA_iAi​ from the supports of pi,qip_i,q_ipi​,qi​, and all gjg_jgj​ for i≥2i\geq2i≥2; A1A_1A1​ contains the first numerator and denominator supports and the other AiA_iAi​.

The sparse quadratic module Qk(g,A)Q_k(g,A)Qk​(g,A) represents each SOS multiplier with a positive semidefinite Gram matrix indexed by monomials of bounded degree. A matrix entry at exponents α,β\alpha,\betaα,β must vanish when α+β∉Aˉ\alpha+\beta\notin\bar Aα+β∈/Aˉ. The program (SDk) uses Qk(g,A1)Q_k(g,A_1)Qk​(g,A1​) for the distinguished ratio and Qk(g,Ai)Q_k(g,A_i)Qk​(g,Ai​) for each other ratio. Its auxiliary polynomials hih_ihi​ have support in Aˉi\bar A_iAˉi​ and degree at most 2k−max⁡{deg⁡q1,deg⁡qi}2k-\max\{\deg q_1,\deg q_i\}2k−max{degq1​,degqi​}. The resulting optimal value is ρks\rho_k^sρks​.

Formalization targets

Sparse convergence

The main theorem is the paper's Theorem 4.7(ii): under Assumption 1.1 and the Archimedean condition, the sparse bounds rise to the original optimum,

ρks↗ρ(k⟶∞).\rho_k^s\nearrow\rho\qquad(k\longrightarrow\infty).ρks​↗ρ(k⟶∞).

The formal statement spells this out as monotonicity for k≥dmin⁡k\geq d_{\min}k≥dmin​, the lower-bound inequality ρks≤ρ\rho_k^s\leq\rhoρks​≤ρ, and convergence to ρ\rhoρ. Here dmin⁡d_{\min}dmin​ is the maximum of the rounded-up half-degrees of all numerators, denominators, and constraints, as defined on page 4 of the paper. No convergence rate is asserted.

Supporting results

The milestone list follows the source's claims: invariance of the data under sign flips (Lemma 4.2), cancellation of nonsymmetric monomials in the averaging argument, two-sided polynomial approximation in the proof of Theorem 3.1, equality of the polynomial dual value with ρ\rhoρ (Theorem 3.1), equality of the sign-symmetric dual value with ρ\rhoρ (Theorem 4.3), the sign-symmetric Positivstellensatz (Theorem 4.5), monotonicity in the proof of Theorem 4.7(ii), and the sparse-versus-dense inequality in Theorem 4.7(i). These are mathematical targets, not assumed facts in the goal.

Significance

A finite level of (SDk) supplies a certified lower bound on the global sum-of-ratios minimum. Theorem 4.7(ii) says that increasing the degree loses no value asymptotically while preserving the sign-induced zero pattern in the Gram matrices. The pattern can split a semidefinite constraint into smaller blocks; the paper demonstrates this computationally, but the theorem itself concerns correctness of the limiting bounds, not a runtime guarantee. The related term-sparsity framework is developed by Wang, Magron and Lasserre in TSSOS.

A Lean development of the known result would supply reusable definitions for support-based parity symmetries, sparse SOS Gram certificates, and extended-real optimal values of polynomial dual programs. None of this mission's proposed results has an existing machine-checked proof in the local prior-art search. The original paper establishes the mathematics; this mission asks solvers to formalize that proof and its stated intermediate results.

Difficulty

Ordinary SOS certificates do not automatically respect a prescribed zero pattern in their Gram matrices. Likewise, restricting the auxiliary polynomials to the symmetry-closed supports changes the dual feasible set. Thus the dense hierarchy's convergence theorem alone does not yield the sparse claim. The decisive issue is whether strictly positive polynomials with the relevant support admit sparse certificates, while the approximation steps retain the sign symmetries and the exact degree restrictions of (SDk).

Formalization scope

Lean uses MvPolynomial (Fin n) ℝ and points Fin n → ℝ. The paper's ratio i=1i=1i=1 is Lean index 0; i∈[N]∖{1}i\in[N]\setminus\{1\}i∈[N]∖{1} means i ≠ 0. Sign vectors are Fin n → ZMod 2, monomial exponents are finitely supported natural-number vectors, and the Gram matrices are finite matrices over the monomials of degree at most the relevant order. The zero pattern is tested against Aˉ\bar AAˉ, not against AAA. Every optimum is an EReal supremum or infimum, so an infeasible (SDk) has value −∞-\infty−∞ and an empty KKK gives ρ=+∞\rho=+\inftyρ=+∞. On KKK, the positivity assumption makes every ratio well-defined as intended.

The N≥2N\geq2N≥2 hypothesis is necessary for the paper's A1A_1A1​ formula to contain the constraint supports. It rules out a one-ratio counterexample to the sparse claim; it is disclosed in the goal and the affected milestones. Degrees use natural-number arithmetic only at orders k≥dmin⁡k\geq d_{\min}k≥dmin​, where the subtractions match the paper's bounds. A valid formalization must retain positive semidefiniteness, the α+β∈Aˉ\alpha+\beta\in\bar Aα+β∈Aˉ matrix pattern, the correct support sets, and the exact hih_ihi​ degree bound. Dropping any of these would state a different hierarchy.

Reusable contributions include the polynomial and SOS definitions, the parity action, the Gram construction, and the sparse Positivstellensatz. Solvers may develop auxiliary lemmas for the monotone inclusions or the approximation argument, while keeping each audited theorem statement faithful to the source. The moment-side formulation, convergence rates, correlative sparsity, and numerical examples lie outside this mission.

Selected references

  • F. Guo, J. Wang and J. Zheng, Exploiting Sign Symmetries in Minimizing Sums of Rational Functions, arXiv:2405.09419v1, 2024. https://arxiv.org/abs/2405.09419v1
  • F. Bugarin, D. Henrion and J.-B. Lasserre, Minimizing the sum of many rational functions, Mathematical Programming Computation 8, 83–111, 2016. https://homepages.laas.fr/henrion/papers/rational.pdf
  • J. Wang, V. Magron and J.-B. Lasserre, TSSOS: A Moment-SOS Hierarchy That Exploits Term Sparsity, SIAM Journal on Optimization 31, 30–58, 2021. https://arxiv.org/abs/1912.08899
13 thms0 active usersReviewed
Operations Research·Captain: mikedeng1

Sensitivity Analysis of the Maximal Value Function with Applications in Nonconvex Minimax Programs: Limiting and Horizon Subdifferentials of the Maximal Value Function via Wolfe DualityResearch Paper

Motivation

Value functions of parametric optimization problems appear wherever one optimization problem sits inside another. In a minimax program min⁡xmax⁡yf(x,y)\min_x \max_y f(x,y)minx​maxy​f(x,y) the outer problem minimizes the maximal value function V(x)=max⁡yf(x,y)V(x)=\max_y f(x,y)V(x)=maxy​f(x,y); in bilevel programming and in the value-function approach to equilibrium problems the same object enters as a constraint. Optimality conditions for the outer problem therefore need generalized derivatives of VVV, and VVV is in general neither smooth, nor convex, nor locally Lipschitz.

Classical estimates of the subdifferential of a value function, going back to Clarke's Optimization and Nonsmooth Analysis (1983) and to Rockafellar and Wets' Variational Analysis (1998), take a convex hull over all optimal solutions, or assume inner semicontinuity of the solution map, or joint convexity. Guo, Ye and Zhang (arXiv:2303.01474, Mathematics of Operations Research, 2024) give estimates for the limiting and horizon subdifferentials of a maximal value function without any of these assumptions, when the inner problem is concave in yyy. Their device is Wolfe's 1961 dual: weak duality bounds the maximal value from above by the value of a minimization problem over primal–dual pairs, to which minimal-value-function techniques apply. The estimates then feed into stationarity conditions for nonconvex–concave minimax programs (§4 of the paper).

Setting

Let f:Rn×Rm→Rf:\mathbb R^n\times\mathbb R^m\to\mathbb Rf:Rn×Rm→R and g=(g1,…,gq):Rn×Rm→Rqg=(g_1,\dots,g_q):\mathbb R^n\times\mathbb R^m\to\mathbb R^qg=(g1​,…,gq​):Rn×Rm→Rq. For a parameter x∈Rnx\in\mathbb R^nx∈Rn the parametric maximization problem is

(Px)max⁡yf(x,y)s.t.y∈F(x):={y:g(x,y)≤0}.(P_x)\qquad \max_y f(x,y)\quad\text{s.t.}\quad y\in\mathcal F(x):=\{y: g(x,y)\le0\}.(Px​)ymax​f(x,y)s.t.y∈F(x):={y:g(x,y)≤0}.

The maximal value function is V(x)=sup⁡{f(x,y):y∈F(x)}∈[−∞,∞]V(x)=\sup\{f(x,y):y\in\mathcal F(x)\}\in[-\infty,\infty]V(x)=sup{f(x,y):y∈F(x)}∈[−∞,∞] (with V(x)=−∞V(x)=-\inftyV(x)=−∞ on an empty feasible set), and the solution map is S(x)={y∈F(x):f(x,y)=V(x)}\mathcal S(x)=\{y\in\mathcal F(x):f(x,y)=V(x)\}S(x)={y∈F(x):f(x,y)=V(x)}. The Lagrangian is L(x,y,λ)=f(x,y)−g(x,y)⊤λ\mathcal L(x,y,\lambda)=f(x,y)-g(x,y)^\top\lambdaL(x,y,λ)=f(x,y)−g(x,y)⊤λ, and L0=−g⊤λ\mathcal L^0=-g^\top\lambdaL0=−g⊤λ. The multiplier set of (Px)(P_x)(Px​) at yyy is Σ(x,y)={λ:∇yL(x,y,λ)=0, 0≤−g(x,y)⊥λ≥0}\Sigma(x,y)=\{\lambda:\nabla_y\mathcal L(x,y,\lambda)=0,\ 0\le-g(x,y)\perp\lambda\ge0\}Σ(x,y)={λ:∇y​L(x,y,λ)=0, 0≤−g(x,y)⊥λ≥0}.

The Wolfe dual of (Px)(P_x)(Px​) is min⁡y,λL(x,y,λ)\min_{y,\lambda}\mathcal L(x,y,\lambda)miny,λ​L(x,y,λ) subject to ∇yL(x,y,λ)=0\nabla_y\mathcal L(x,y,\lambda)=0∇y​L(x,y,λ)=0, λ≥0\lambda\ge0λ≥0; its value is VD(x)V_D(x)VD​(x). For r∈{0,1}r\in\{0,1\}r∈{0,1} its multiplier set at (y,λ)(y,\lambda)(y,λ) is

Ξr(x,y,λ)={u∈Rm: ∇yy2L(x,y,λ)u=0, 0≤−∇yg(x,y)⊤u−r g(x,y)⊥λ≥0}.\Xi^r(x,y,\lambda)=\{u\in\mathbb R^m:\ \nabla^2_{yy}\mathcal L(x,y,\lambda)u=0,\ 0\le-\nabla_yg(x,y)^\top u-r\,g(x,y)\perp\lambda\ge0\}.Ξr(x,y,λ)={u∈Rm: ∇yy2​L(x,y,λ)u=0, 0≤−∇y​g(x,y)⊤u−rg(x,y)⊥λ≥0}.

For φ:Rn→[−∞,∞]\varphi:\mathbb R^n\to[-\infty,\infty]φ:Rn→[−∞,∞] at a point where φ(x)\varphi(x)φ(x) is finite, a regular subgradient v∈∂^φ(x)v\in\widehat\partial\varphi(x)v∈∂φ(x) satisfies φ(x′)≥φ(x)+v⊤(x′−x)+o(∥x′−x∥)\varphi(x')\ge\varphi(x)+v^\top(x'-x)+o(\|x'-x\|)φ(x′)≥φ(x)+v⊤(x′−x)+o(∥x′−x∥); the limiting subdifferential ∂φ(x)\partial\varphi(x)∂φ(x) collects limits of vk∈∂^φ(xk)v^k\in\widehat\partial\varphi(x^k)vk∈∂φ(xk) with xk→xx^k\to xxk→x, φ(xk)→φ(x)\varphi(x^k)\to\varphi(x)φ(xk)→φ(x); the horizon subdifferential ∂∞φ(x)\partial^\infty\varphi(x)∂∞φ(x) collects limits of tkvkt_kv^ktk​vk with additionally tk↓0t_k\downarrow0tk​↓0.

Throughout, fff and ggg are twice continuously differentiable, and f(x,⋅)f(x,\cdot)f(x,⋅) is concave and every gi(x,⋅)g_i(x,\cdot)gi​(x,⋅) convex for xxx near the reference point xˉ\bar xxˉ. Restricted sup-compactness at xˉ\bar xxˉ means V(xˉ)V(\bar x)V(xˉ) is finite and some compact set meets S(x)\mathcal S(x)S(x) for every xxx near xˉ\bar xxˉ with V(x)>V(xˉ)−ϵV(x)>V(\bar x)-\epsilonV(x)>V(xˉ)−ϵ. Two constraint qualifications enter: a stable parametric CQ for (Pxˉ)(P_{\bar x})(Pxˉ​) at a solution (Definition 2.3), and a stable CQ for the system ∇yL(x,y,λ)=0\nabla_y\mathcal L(x,y,\lambda)=0∇y​L(x,y,λ)=0, λ≥0\lambda\ge0λ≥0 in (x,y,λ)(x,y,\lambda)(x,y,λ) (Definition 2.4), each asking that a CQ hold at nearby points and that multipliers of nearby points have subsequences converging to multipliers at the limit.

Formalization targets

Goal: Theorem 3.3, (3.13)–(3.14)

Under the standing assumption, restricted sup-compactness at xˉ\bar xxˉ, a stable parametric CQ at every y∈S(xˉ)y\in\mathcal S(\bar x)y∈S(xˉ), and a stable CQ for (3.11) at every (xˉ,y~,λ~)(\bar x,\tilde y,\tilde\lambda)(xˉ,y~​,λ~) with y~∈S(xˉ)\tilde y\in\mathcal S(\bar x)y~​∈S(xˉ), λ~∈Σ(xˉ,y~)\tilde\lambda\in\Sigma(\bar x,\tilde y)λ~∈Σ(xˉ,y~​):

∂V(xˉ)⊆⋃y∈S(xˉ){∇xL(xˉ,y,λ)+∇xy2L(xˉ,y,λ)u: u∈Ξ1(xˉ,y,λ), λ∈Σ(xˉ,y)},\partial V(\bar x)\subseteq\bigcup_{y\in\mathcal S(\bar x)}\{\nabla_x\mathcal L(\bar x,y,\lambda)+\nabla^2_{xy}\mathcal L(\bar x,y,\lambda)u:\ u\in\Xi^1(\bar x,y,\lambda),\ \lambda\in\Sigma(\bar x,y)\},∂V(xˉ)⊆y∈S(xˉ)⋃​{∇x​L(xˉ,y,λ)+∇xy2​L(xˉ,y,λ)u: u∈Ξ1(xˉ,y,λ), λ∈Σ(xˉ,y)}, ∂∞V(xˉ)⊆⋃y∈S(xˉ){∇xy2L(xˉ,y,λ)u: u∈Ξ0(xˉ,y,λ), λ∈Σ(xˉ,y)}.\partial^\infty V(\bar x)\subseteq\bigcup_{y\in\mathcal S(\bar x)}\{\nabla^2_{xy}\mathcal L(\bar x,y,\lambda)u:\ u\in\Xi^0(\bar x,y,\lambda),\ \lambda\in\Sigma(\bar x,y)\}.∂∞V(xˉ)⊆y∈S(xˉ)⋃​{∇xy2​L(xˉ,y,λ)u: u∈Ξ0(xˉ,y,λ), λ∈Σ(xˉ,y)}.

Milestones

  1. Lemma 3.1: Wolfe weak duality V(x)≤VD(x)V(x)\le V_D(x)V(x)≤VD​(x).
  2. Proof of Theorem 3.3 (i): under a CQ, a local minimizer of L(x,y,λ)−ξ⊤(x−xˉ)+ϵ∥x−xˉ∥\mathcal L(x,y,\lambda)-\xi^\top(x-\bar x)+\epsilon\|x-\bar x\|L(x,y,λ)−ξ⊤(x−xˉ)+ϵ∥x−xˉ∥ subject to (3.11) is a KKT point, with multiplier in Ξ1\Xi^1Ξ1 up to an ϵ\epsilonϵ-ball.
  3. Theorem 3.3 (3.12): ∂^V(xˉ)⊆{∇xL(xˉ,yˉ,λˉ)+∇xy2L(xˉ,yˉ,λˉ)u:u∈Ξ1(xˉ,yˉ,λˉ)}\widehat\partial V(\bar x)\subseteq\{\nabla_x\mathcal L(\bar x,\bar y,\bar\lambda)+\nabla^2_{xy}\mathcal L(\bar x,\bar y,\bar\lambda)u: u\in\Xi^1(\bar x,\bar y,\bar\lambda)\}∂V(xˉ)⊆{∇x​L(xˉ,yˉ​,λˉ)+∇xy2​L(xˉ,yˉ​,λˉ)u:u∈Ξ1(xˉ,yˉ​,λˉ)} for one solution and one multiplier.
  4. Proof of Theorem 3.3 (ii): restricted sup-compactness gives solutions yk∈S(xk)y^k\in\mathcal S(x^k)yk∈S(xk) converging, along a subsequence, to some y~∈S(xˉ)\tilde y\in\mathcal S(\bar x)y~​∈S(xˉ).
  5. Proof of Theorem 3.3 (ii): a stable parametric CQ gives multipliers λk∈Σ(xk,yk)\lambda^k\in\Sigma(x^k,y^k)λk∈Σ(xk,yk) converging, along a subsequence, to some λ~∈Σ(xˉ,y~)\tilde\lambda\in\Sigma(\bar x,\tilde y)λ~∈Σ(xˉ,y~​).

A supporting item (proof of Theorem 3.3 (i), p. 17) states that a regular subgradient ξ\xiξ of VVV at xˉ\bar xxˉ makes (xˉ,yˉ,λˉ)(\bar x,\bar y,\bar\lambda)(xˉ,yˉ​,λˉ) a local minimizer of that problem (3.16), for every ϵ>0\epsilon>0ϵ>0.

Significance

The estimates (3.13)–(3.14) bound the limiting subdifferential of a maximal value function by a union over solutions rather than a convex hull, and they do not presuppose that VVV is locally Lipschitz: (3.14) is exactly what is needed to derive Lipschitz continuity (Corollary 3.3 of the paper: if the right side of (3.14) is {0}\{0\}{0} and VVV is continuous, VVV is Lipschitz near xˉ\bar xxˉ). The paper uses them to obtain stationarity conditions for nonconvex–concave minimax programs, including cases (Example 3.1) where the solution map is not inner semicontinuous and the problem is not jointly convex.

The result is proved in the paper; no machine-checked version exists. The mission formalizes the statement and its proof, which requires subdifferential calculus for extended-real functions, the exact-penalty consequence of a local error bound, and multiplier rules for problems with a nonsmooth term, none of which are in Mathlib today.

Difficulty

The obvious route to ∂V\partial V∂V differentiates the maximum directly (a Danskin-type argument), which needs compactness and continuity uniform in yyy and yields a convex hull; it fails exactly when VVV is not Lipschitz. The Wolfe-dual route replaces the maximization by a minimization over (y,λ)(y,\lambda)(y,λ), but the resulting problem (3.16) has a nonsmooth objective (ϵ∥x−xˉ∥\epsilon\|x-\bar x\|ϵ∥x−xˉ∥) and a constraint system in which xxx is a variable, so the KKT conditions follow only from a calmness/error-bound argument, not from a smooth Lagrange multiplier rule. The limiting estimate then requires passing to the limit simultaneously in solutions, primal multipliers λk\lambda^kλk and dual multipliers uku^kuk, and the latter can be unbounded unless the stable CQ controls them; this is the role of Definition 2.3(ii).

Formalization scope

Parameters are in EuclideanSpace ℝ (Fin n), decisions in EuclideanSpace ℝ (Fin m), multipliers in Fin q → ℝ; ggg is given by components gig_igi​. VVV and VDV_DVD​ are EReal-valued suprema/infima over the feasible sets. Regular subgradients and the limiting subdifferential are the published NonconvexSplitting.Shared.IsRegularSubgrad and LimitingSubdiff; the horizon subdifferential is defined from regular subgradients with tk>0t_k>0tk​>0, tk→0t_k\to0tk​→0. Second derivatives are gradient/fderiv of explicit functions of C2C^2C2 data.

The paper leaves "a CQ" abstract. Here it is the local error bound of (3.11), which every CQ listed in the paper implies (p. 8), so the formal statements are at least as strong as the paper's for each listed CQ. A stable CQ is the error bound at all feasible points near the reference point plus Definition 2.3(ii); a stable parametric CQ is Definition 2.3 with (i) read for local maximizers (the problem is a maximization) on a neighbourhood. Error-bound distances use the product sup norm, equivalent to the Euclidean one up to the constant.

A real-valued VVV (junk value 000 on empty or unbounded feasible sets) or a CQ hypothesis that already asserts the KKT conclusion of (3.12) would trivialize the goal; neither is used. A sanity file proves the standing assumption, a solution, a multiplier and restricted sup-compactness for Example 3.1 of the paper.

Needed infrastructure, reusable beyond this mission: Fermat's rule and sum rules for limiting subdifferentials of locally Lipschitz functions, exact penalization under a local error bound (Clarke calmness), and closedness of linear images of complementarity sets. Contributions on any of these are welcome.

Selected references

  • L. Guo, J. J. Ye, J. Zhang, Sensitivity analysis of the maximal value function with applications in nonconvex minimax programs, Mathematics of Operations Research, 2024; arXiv:2303.01474v1. https://arxiv.org/abs/2303.01474
  • P. Wolfe, A duality theorem for non-linear programming, Quarterly of Applied Mathematics 19 (1961), 239–244. https://doi.org/10.1090/qam/135625
  • F. H. Clarke, Optimization and Nonsmooth Analysis, SIAM Classics in Applied Mathematics, 1990 (reprint of the Wiley 1983 edition). https://doi.org/10.1137/1.9781611971309
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
  • J. J. Ye, J. Zhou, Verifiable sufficient conditions for the error bound property of second-order cone complementarity problems, Mathematical Programming 171 (2018), 361–395 (reference [52] of the paper; cited there for the fact that the listed CQs imply the error bound property).
8 thms0 active usersReviewed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

Characterizing and Computing the Set of Nash Equilibria via Vector Optimization: Shared Constraint Nash Equilibria Are Exactly the Pareto Optimal Points Under a Non-Convex Ordering ConeResearch Paper

Motivation

A Nash equilibrium is a feasible choice of strategies at which no player can lower her own cost by changing her strategy alone. A Pareto minimizer is a feasible point that cannot be improved under a specified comparison of vector outcomes. These ideas usually select different points: a change that helps several players at once is relevant to ordinary Pareto comparison, while Nash stability holds the other players' strategies fixed. Feinstein and Rudloff ask whether a suitable vector comparison can recover all equilibria, including when the equilibrium set has several points or is empty. Their answer for games with one shared feasibility constraint is Theorem 2.6 of the pinned preprint. The result addresses the full equilibrium set rather than the existence or computation of a single point.

The paper places this characterization alongside vector optimization methods that can compute solution sets for some structured games. It also extends the framework to generalized Nash games and vector-valued costs. This mission concentrates on the shared-constraint, scalar-cost statement on which those later sections build. The formal target is a known theorem from the paper, not a claim that the game always has an equilibrium or that a particular numerical algorithm finds one.

Setting

Let III be a finite set of at least two players. Player iii chooses a strategy in a real linear space Xi\mathcal X_iXi​; the spaces may differ. A joint strategy xxx is a member of ∏i∈IXi\prod_{i\in I}\mathcal X_i∏i∈I​Xi​. Player iii has an arbitrary real-valued cost function fif_ifi​ on joint strategies. A set X⊆∏iXi\mathbb X\subseteq\prod_i\mathcal X_iX⊆∏i​Xi​ specifies the shared constraint: only joint strategies in X\mathbb XX are feasible. No continuity, convexity, boundedness, or nonemptiness condition is imposed on the costs or on X\mathbb XX.

For a joint strategy x∗x^*x∗, write (xi,x−i∗)(x_i,x^*_{-i})(xi​,x−i∗​) for the strategy obtained by replacing only player iii's coordinate. The set NE(f,X)\mathrm{NE}(f,\mathbb X)NE(f,X) consists of feasible x∗x^*x∗ such that every feasible replacement obeys fi(x∗)≤fi(xi,x−i∗)f_i(x^*)\le f_i(x_i,x^*_{-i})fi​(x∗)≤fi​(xi​,x−i∗​). The feasibility condition applies to the whole replacement; it cannot be replaced by membership of xix_ixi​ in a coordinate projection of X\mathbb XX. This is Definition 2.2 in the source.

For a vector space ZZZ and a cone K⊆ZK\subseteq ZK⊆Z, define a≤Kba\le_K ba≤K​b when b−a∈Kb-a\in Kb−a∈K. For a domain DDD, feasible set A⊆DA\subseteq DA⊆D, and objective g:D→Zg:D\to Zg:D→Z, the paper calls x∗x^*x∗ a KKK-minimizer if it is feasible and every feasible xxx satisfying g(x)≤Kg(x∗)g(x)\le_K g(x^*)g(x)≤K​g(x∗) also satisfies g(x∗)≤Kg(x)g(x^*)\le_K g(x)g(x∗)≤K​g(x). This permits equivalent outcomes and does not require a convex cone. The mission restricts comparisons to feasible points, matching Definition 2.3.

The objective for the game is g(x)=(x,f(x))g(x)=(x,f(x))g(x)=(x,f(x)), where f(x)=(fi(x))i∈If(x)=(f_i(x))_{i\in I}f(x)=(fi​(x))i∈I​. Its target space is (∏iXi)×RI\bigl(\prod_i\mathcal X_i\bigr)\times\mathbb R^I(∏i​Xi​)×RI. For each player iii, the cone CiC_iCi​ permits any change in strategy coordinate iii and in the other players' cost coordinates, requires zero change in every other strategy coordinate, and requires a nonnegative change in cost coordinate iii. The paper's ordering cone is C={(u,v):∃i, uj=0 for j≠i, vi≥0}C=\{(u,v):\exists i,\ u_j=0\text{ for }j\ne i,\ v_i\ge0\}C={(u,v):∃i, uj​=0 for j=i, vi​≥0}. Equation (7) gives CiC_iCi​ as an explicit product; equation (6) gives CCC directly. The resulting relation compares costs only while other players' strategies remain fixed.

Formalization targets

Player-cone structure

The paper states that C=⋃i∈ICiC=\bigcup_{i\in I}C_iC=⋃i∈I​Ci​ and that each CiC_iCi​ is a convex cone. It then characterizes comparisons by CiC_iCi​ and CCC in terms of fixed strategy coordinates and a player's cost. These are the first two milestones, from §2.2, pages 6–7 of the preprint.

Minimizer decomposition

Lemma 2.7 is the third milestone:

C-argmin{(x,f(x)):x∈X}=⋂i∈ICi-argmin{(x,f(x)):x∈X}.C\text{-argmin}\{(x,f(x)):x\in\mathbb X\} =\bigcap_{i\in I} C_i\text{-argmin}\{(x,f(x)):x\in\mathbb X\}.C-argmin{(x,f(x)):x∈X}=i∈I⋂​Ci​-argmin{(x,f(x)):x∈X}.

Main equality

The goal is Theorem 2.6, an equality of complete solution sets:

NE(f,X)=C-argmin{(x,f(x)):x∈X}.\mathrm{NE}(f,\mathbb X) = C\text{-argmin}\{(x,f(x)):x\in\mathbb X\}.NE(f,X)=C-argmin{(x,f(x)):x∈X}.

The equality covers an empty equilibrium set as well as games with one, several, or infinitely many equilibria. It asserts neither existence nor uniqueness.

Significance

The theorem gives a vector optimization description of every stable joint strategy in a shared-constraint game. Because the objective retains the strategy vector, the cone can express which coordinates remain fixed during a unilateral deviation. The decomposition into player cones also identifies separate convex comparisons inside a potentially nonconvex overall preference. In settings where suitable vector optimization methods are available, the paper uses this characterization as a route toward finding full equilibrium sets; it does not claim a universal exact algorithm for arbitrary games §1 and §2.2.

Formalization adds a reusable generic cone-induced relation and vector-minimizer definition, plus a shared-constraint game interface that later results can import. It pins down the direction of comparison, the feasible deviation set, and the product-coordinate constraints in the cones. The source proves the goal and its supporting statements on paper. The local Prove2Me prior-art search found no published machine-checked statement with this exact shared-constraint model and cone; the mission asks solvers to supply proofs of the drafted statements.

Difficulty

Applying the ordinary coordinatewise order to the cost vector f(x)f(x)f(x) compares outcomes from arbitrary simultaneous changes of strategy. It therefore does not encode the unilateral test in the Nash definition. Including the strategy vector in the objective and using CCC makes the relevant changes comparable, but CCC is a union of player cones and need not be convex. A proof must respect the paper's minimizer definition for this relation and establish the set equality in both directions. Restricting the theorem to smooth or convex games would miss the generality of Theorem 2.6.

Formalization scope

Lean represents III by a finite type ι\iotaι with decidable equality and states 2≤∣I∣2\le|I|2≤∣I∣, the paper's standing convention. Each Xi\mathcal X_iXi​ is a possibly different type carrying an additive commutative group and a real module structure. Joint strategies are dependent functions ∀i,Xi\forall i,\mathcal X_i∀i,Xi​; feasible deviations use Function.update. The shared constraint is an arbitrary set of joint strategies, and each cost is an arbitrary real-valued function. An empty feasible set remains permitted. The objective space is the product of joint strategies with real cost profiles, and CiC_iCi​ is built as the product of the coordinate sets in equation (7). The condition x−i=0x_{-i}=0x−i​=0 in equation (6) means that every coordinate other than iii equals its vector-space zero.

The generic vector-minimizer definition, the Nash equilibrium definition, and the two cones are independent. In particular, Nash equilibrium is defined directly by unilateral feasible deviations; CCC is defined directly by the existential condition in (6); and vector minimization is generic in its cone, objective, and feasible domain. This rules out a definition that makes the main equality true by construction. The ∣I∣≥2|I|\ge2∣I∣≥2 hypothesis is copied from the paper, although these particular equalities also hold with fewer players. Contributions to the cone comparison lemmas, the minimizer decomposition, and the full set equality are welcome. Later generalized Nash and vector-valued results, numerical examples, and Corollary 2.8 lie outside this mission.

Selected references

  • Zachary Feinstein and Birgit Rudloff, Characterizing and Computing the Set of Nash Equilibria via Vector Optimization, arXiv:2109.14932v5, 2022; published as an Operations Research technical note, 2024. Pinned preprint
7 thms0 active usersReviewed
Machine LearningProbabilityStatistics·Captain: mikedeng1

Hidden Integrality and Semirandom Robustness of SDP Relaxation for Sub-Gaussian Mixture Model: The SDP Clustering Error Is at Most Twice the Oracle Integer Program ErrorResearch Paper

Why compare a clustering SDP with an oracle?

Clustering methods must infer a partition from noisy observations, while the quality of a partition is usually judged against labels that the method cannot see. Fei and Chen study a balanced sub-Gaussian mixture model in which a semidefinite program (SDP) estimates a cluster matrix from pairwise distances. Their Theorem 1 relates its error to a simpler integer program allowed to know the true cluster centers. This comparison makes the SDP's error interpretable through an explicit benchmark, even when exact recovery is unavailable. The paper also investigates semi-random perturbations, but this mission targets the Model 1 comparison on which that broader discussion builds.

The tension is that an SDP solution may be fractional. Its entries express pairwise affinities, whereas an assignment matrix places each point in exactly one cluster. The result bounds the fractional matrix's entrywise error by an integer assignment error without assuming that the SDP solution itself is integral. That is the hidden-integrality claim relevant to this mission.

The model and the two optimization problems

There are n≥4n\ge4n≥4 observations in Rd\mathbb R^dRd and k≥2k\ge2k≥2 clusters. The true label of point iii is σ∗(i)∈[k]\sigma^*(i)\in[k]σ∗(i)∈[k], and every cluster contains exactly ℓ=n/k\ell=n/kℓ=n/k points. For unknown centers μ1,…,μk\mu_1,\ldots,\mu_kμ1​,…,μk​, the observations have the form

hi=μσ∗(i)+gi.h_i=\mu_{\sigma^*(i)}+g_i.hi​=μσ∗(i)​+gi​.

The noise vectors gig_igi​ are independent, measurable, zero-mean, and sub-Gaussian. Their vector sub-Gaussian norms are at most τ>0\tau>0τ>0. The minimum center separation and signal-to-noise ratio are

Δ=min⁡a≠b∥μa−μb∥2,s=Δ/τ.\Delta=\min_{a\ne b}\|\mu_a-\mu_b\|_2,\qquad s=\Delta/\tau.Δ=a=bmin​∥μa​−μb​∥2​,s=Δ/τ.

The SDP uses the squared-distance matrix Aij=∥hi−hj∥22A_{ij}=\|h_i-h_j\|_2^2Aij​=∥hi​−hj​∥22​. It minimizes ⟨Y,A⟩=∑i,jYijAij\langle Y,A\rangle=\sum_{i,j}Y_{ij}A_{ij}⟨Y,A⟩=∑i,j​Yij​Aij​ over real n×nn\times nn×n matrices with row sums n/kn/kn/k, diagonal entries one, nonnegative entries, and symmetric positive semidefiniteness. Write Y^\widehat YY for any optimum. The true cluster matrix is Yij∗=1Y^*_{ij}=1Yij∗​=1 when σ∗(i)=σ∗(j)\sigma^*(i)=\sigma^*(j)σ∗(i)=σ∗(j) and 000 otherwise. Its error is measured by the entrywise norm ∥Y^−Y∗∥1=∑i,j∣Y^ij−Yij∗∣\|\widehat Y-Y^*\|_1=\sum_{i,j}|\widehat Y_{ij}-Y^*_{ij}|∥Y−Y∗∥1​=∑i,j​∣Yij​−Yij∗​∣.

The benchmark is an Oracle Integer Program. An assignment matrix F∈FF\in\mathcal FF∈F has zero-one entries and exactly one one in each row. The true assignment is Fja∗=1{σ∗(j)=a}F^*_{ja}=\mathbf1\{\sigma^*(j)=a\}Fja∗​=1{σ∗(j)=a}. The oracle sees the centers and augmented observations hˉj=μσ∗(j)+(2κ)−1gj\bar h_j=\mu_{\sigma^*(j)}+(2\kappa)^{-1}g_jhˉj​=μσ∗(j)​+(2κ)−1gj​ with the fixed κ=1/8\kappa=1/8κ=1/8, so its noise is four times the realized noise in hjh_jhj​. It minimizes

η(F)=∑j,a∥hˉj−μa∥22Fja.\eta(F)=\sum_{j,a}\|\bar h_j-\mu_a\|_2^2F_{ja}.η(F)=j,a∑​∥hˉj​−μa​∥22​Fja​.

The Oracle error is the largest 12∥F−F∗∥1\tfrac12\|F-F^*\|_121​∥F−F∗∥1​ among assignments satisfying η(F)≤η(F∗)\eta(F)\le\eta(F^*)η(F)≤η(F∗). The Oracle feasible set has no balance constraint. In contrast, the SDP retains the row-sum constraint inherited from balanced clustering.

Formalization targets

Main goal: Theorem 1

The goal is the paper's quantitative comparison. It asserts that universal constants Cs>0C_s>0Cs​>0 and C≥1C\ge1C≥1 exist such that, when

s2≥Cs(kdnlog⁡n+kdn+k),s^2\ge C_s\left(\sqrt{\frac{kd}{n}\log n}+\frac{kd}{n}+k\right),s2≥Cs​(nkd​logn​+nkd​+k),

an event of probability at least 1−n−C−2e−n1-n^{-C}-2e^{-n}1−n−C−2e−n has, for every realized SDP optimum Y^\widehat YY, the bound

∥Y^−Y∗∥1∥Y∗∥1≤2max⁡F∈Fη(F)≤η(F∗)∥F−F∗∥1∥F∗∥1.\frac{\|\widehat Y-Y^*\|_1}{\|Y^*\|_1} \le 2\max_{\substack{F\in\mathcal F\\\eta(F)\le\eta(F^*)}} \frac{\|F-F^*\|_1}{\|F^*\|_1}.∥Y∗∥1​∥Y−Y∗∥1​​≤2F∈Fη(F)≤η(F∗)​max​∥F∗∥1​∥F−F∗∥1​​.

The constants are independent of n,k,dn,k,dn,k,d, the centers, the labels, and the noise law. The event and the SDP optimum are chosen after the random observations are realized. The theorem fixes the factor two and the failure-probability expression exactly as printed.

Milestone results

The eight milestones follow the statements in Section 5: the six structural properties of the SDP error matrix (Fact 2), the basic inequality (16), the signal estimate (Proposition 3), the two noise estimates (Propositions 1 and 2), the representation of the remaining term (Lemma 1), the identity between the integer program and Oracle error (Lemma 2), and the final deterministic bound. Each milestone keeps the paper's constants and its own hypotheses. Together they expose the interfaces needed to close Theorem 1.

What the comparison gives

Theorem 1 transfers a question about a real matrix optimum to a finite assignment benchmark. The Oracle benchmark can itself be bounded under additional assumptions, as Fei and Chen do in their separate Theorem 2. The present target preserves the comparison even in regimes where the benchmark does not vanish. It therefore expresses an error guarantee rather than an exact-recovery assertion.

A complete Lean proof would connect a probability model, finite-dimensional semidefinite feasibility, and the paper's integer assignment comparison. At present these mission statements are draft proof obligations: compiling a statement with sorry checks its formulation but does not prove the result. The development reuses published definitions of scalar and vector sub-Gaussian norms; proving the new lemmas and the main theorem remains open within this mission.

Where the difficulty lies

SDP optimality gives an inequality for the squared-distance objective, but it does not directly bound the entrywise difference from Y∗Y^*Y∗. Noise enters that objective through both a Gram matrix and mixed center-noise terms. A direct entrywise comparison also ignores the row-sum and positive-semidefinite structure that constrains the SDP error.

On the benchmark side, replacing a fractional matrix error by an arbitrary rounded assignment would not retain the stated factor. The paper identifies an intermediate linear program whose value can be controlled at integer cardinalities. Formalizing the result requires preserving that cardinality constraint, the exact coefficient κ=1/8\kappa=1/8κ=1/8, and the distinction between the observed points and the oracle's augmented points.

Formalization scope

Points, clusters, and coordinates use finite index types; Lean indices start at zero while the paper's [n][n][n] and [k][k][k] start at one. All matrices are real. The trace inner product is represented by a double sum, the matrix ℓ1\ell_1ℓ1​ norm is entrywise, and the spectral norm in Proposition 2 uses the L2L^2L2 operator norm. The minimum separation ranges over distinct center pairs, which is nonempty when k≥2k\ge2k≥2. Oracle maxima are finite, nonempty, bounded sets; the true assignment is a feasible candidate. The normalized denominators are nonzero under n≥4n\ge4n≥4 and k≥2k\ge2k≥2 with balanced labels.

The random model uses one probability space and the same noise realization in both hhh and hˉ\bar hhˉ. Measurability, zero mean, independence, and the extended-nonnegative vector sub-Gaussian norm bound are explicit. High-probability conclusions use measurable events and quantify over every optimum at each realized data set. Deterministic milestones take a fixed realization and do not add a probability space. The universal constants occur before all model parameters. These choices rule out a vacuous instance-dependent SNR constant, a norm that assigns zero to heavy-tailed noise, and an SDP optimum chosen before observing the noise.

The scope is Theorem 1 and its selected Section 5 statements. Theorem 2's separate Oracle-error rate, the rounding algorithm, semi-random Model 2, and the stochastic-ball special case are outside this proposal. Reusable work includes the SDP and assignment interfaces, matrix-error identities, and finite integer-program comparisons. Contributions that prove the eight source milestones or establish their supporting concentration and finite-dimensional optimization results are welcome.

Selected references

  • Y. Fei and Y. Chen, Hidden Integrality and Semi-Random Robustness of SDP Relaxation for Sub-Gaussian Mixture Model, Mathematics of Operations Research, 2022. arXiv:1803.06510v2, the version and pagination used here.
13 thms0 active usersReviewed
Convex OptimizationLinear algebra·Captain: mikedeng1

Conic Optimization with Spectral Functions on Euclidean Jordan Algebras: The Root-Determinant Cone Barrier Is a (1 + d)-Logarithmically Homogeneous Self-Concordant BarrierResearch Paper

Motivation

Interior-point methods solve a conic optimization problem by following the minimizers of a barrier function for the cone. Their iteration count is governed by the barrier's parameter ν\nuν: the best known algorithms need O(νlog⁡(1/ε))O(\sqrt\nu\log(1/\varepsilon))O(ν​log(1/ε)) iterations to reach accuracy ε\varepsilonε (Nesterov and Todd, 1997). A cone can be used natively by a solver only once a logarithmically homogeneous self-concordant barrier (LHSCB) with a small parameter is known for it, together with efficient oracles for its derivatives.

Coey, Kapelevich and Vielma (arXiv:2103.04104v2; Mathematics of Operations Research, 2022) study cones defined by spectral functions on Euclidean Jordan algebras. This framework covers vectors, real symmetric matrices and complex Hermitian matrices at once. The paper implements the resulting cones in the solver Hypatia. One of its two new barrier results concerns the root-determinant cone, the hypograph of the geometric mean of the eigenvalues. For symmetric matrices this is the hypograph of det⁡(W)1/d\det(W)^{1/d}det(W)1/d over the positive semidefinite cone, a standard modelling device for D-optimal experimental design and for determinant maximization. Before this paper, the usual way to represent it was an extended formulation with auxiliary variables and a semidefinite constraint.

Setting

A Jordan algebra is a real vector space VVV with a bilinear product ∘\circ∘ that is commutative and satisfies the Jordan identity wa∘(wa2∘wb)=wa2∘(wa∘wb)w_a\circ(w_a^2\circ w_b)=w_a^2\circ(w_a\circ w_b)wa​∘(wa2​∘wb​)=wa2​∘(wa​∘wb​), where w2:=w∘ww^2:=w\circ ww2:=w∘w. It has a multiplicative identity eee. It is Euclidean if ⟨wa∘wb,wc⟩=⟨wb,wa∘wc⟩\langle w_a\circ w_b,w_c\rangle=\langle w_b,w_a\circ w_c\rangle⟨wa​∘wb​,wc​⟩=⟨wb​,wa​∘wc​⟩. An idempotent is a ccc with c2=cc^2=cc2=c. It is primitive if it is non-zero and is not the sum of two orthogonal non-zero idempotents. A Jordan frame is a family c1,…,cdc_1,\dots,c_dc1​,…,cd​ of pairwise orthogonal primitive idempotents summing to eee. Every Jordan frame of VVV has the same size ddd, the rank of VVV.

Every w∈Vw\in Vw∈V has a spectral decomposition w=∑i∈[ ⁣[d] ⁣]wiciw=\sum_{i\in[\![d]\!]}w_ic_iw=∑i∈[[d]]​wi​ci​ over a Jordan frame, with real eigenvalues w1,…,wdw_1,\dots,w_dw1​,…,wd​. From these, det⁡(w)=∏iwi\det(w)=\prod_iw_idet(w)=∏i​wi​, tr⁡(w)=∑iwi\operatorname{tr}(w)=\sum_iw_itr(w)=∑i​wi​, and a real function fff acts by f(w)=∑if(wi)cif(w)=\sum_if(w_i)c_if(w)=∑i​f(wi​)ci​. The inner product is the trace form ⟨wa,wb⟩=tr⁡(wa∘wb)\langle w_a,w_b\rangle=\operatorname{tr}(w_a\circ w_b)⟨wa​,wb​⟩=tr(wa​∘wb​). The cone of squares is Q={w∘w:w∈V}\mathcal Q=\{w\circ w:w\in V\}Q={w∘w:w∈V}; w≻0w\succ0w≻0 means w∈int⁡(Q)w\in\operatorname{int}(\mathcal Q)w∈int(Q). The quadratic representation is P(w)=2L(w)2−L(w2)P(w)=2L(w)^2-L(w^2)P(w)=2L(w)2−L(w2), where L(w)v=w∘vL(w)v=w\circ vL(w)v=w∘v.

The root-determinant is φ(w)=det⁡(w)1/d\varphi(w)=\det(w)^{1/d}φ(w)=det(w)1/d on Q\mathcal QQ. With E=R×Q\mathcal E=\mathbb R\times\mathcal QE=R×Q and ζ(u,w)=φ(w)−u\zeta(u,w)=\varphi(w)-uζ(u,w)=φ(w)−u, the root-determinant cone and its candidate barrier are

Krtdet={(u,w)∈R×Q: u≤det⁡(w)1/d},Γ(u,w)=−log⁡ζ(u,w)−log⁡det⁡(w).\mathcal K_{\mathrm{rtdet}}=\{(u,w)\in\mathbb R\times\mathcal Q:\ u\le\det(w)^{1/d}\},\qquad \Gamma(u,w)=-\log\zeta(u,w)-\log\det(w).Krtdet​={(u,w)∈R×Q: u≤det(w)1/d},Γ(u,w)=−logζ(u,w)−logdet(w).

A function Γ\GammaΓ is a ν\nuν-LHSCB for a cone K\mathcal KK if it is C3C^3C3 and convex on int⁡(K)\operatorname{int}(\mathcal K)int(K) and tends to +∞+\infty+∞ at the boundary. It must also satisfy Γ(θu~)=Γ(u~)−νlog⁡θ\Gamma(\theta\tilde u)=\Gamma(\tilde u)-\nu\log\thetaΓ(θu~)=Γ(u~)−νlogθ and ∣∇3Γ(u~)[p~,p~,p~]∣≤2(∇2Γ(u~)[p~,p~])3/2|\nabla^3\Gamma(\tilde u)[\tilde p,\tilde p,\tilde p]|\le2(\nabla^2\Gamma(\tilde u)[\tilde p,\tilde p])^{3/2}∣∇3Γ(u~)[p~​,p~​,p~​]∣≤2(∇2Γ(u~)[p~​,p~​])3/2, and the parameter satisfies ν≥1\nu\ge1ν≥1.

Formalization targets

Goal: Proposition 7.1 (p. 24)

Krtdet is a proper cone, and  Γ is a (1+d)-LHSCB for Krtdet.\mathcal K_{\mathrm{rtdet}}\ \text{is a proper cone, and}\ \ \Gamma\ \text{is a}\ (1+d)\text{-LHSCB for}\ \mathcal K_{\mathrm{rtdet}}.Krtdet​ is a proper cone, and  Γ is a (1+d)-LHSCB for Krtdet​.

The goal holds for every finite-dimensional Euclidean Jordan algebra of rank d≥1d\ge1d≥1, not for one matrix algebra.

Milestones, in proof order

  1. Krtdet\mathcal K_{\mathrm{rtdet}}Krtdet​ is proper (p. 23).
  2. Ψ(u,w)=−log⁡det⁡(w)\Psi(u,w)=-\log\det(w)Ψ(u,w)=−logdet(w) is a ddd-LHSCB for E\mathcal EE (p. 24).
  3. φ\varphiφ is nonnegative, concave and homogeneous on Q\mathcal QQ ((96), p. 23).
  4. ζ\zetaζ is concave and C3C^3C3 on int⁡(E)\operatorname{int}(\mathcal E)int(E) (p. 24).
  5. The derivative identities, with r^=P(w−1/2)r\hat r=P(w^{-1/2})rr^=P(w−1/2)r, σ\sigmaσ the eigenvalues of r^\hat rr^, m1=d−1∑iσim_1=d^{-1}\sum_i\sigma_im1​=d−1∑i​σi​ and δi=σi−m1\delta_i=\sigma_i-m_1δi​=σi​−m1​:
∇2Ψ(u~)[p~,p~]=tr⁡(r^2)=∥σ∥2,∇2φ(w)[r,r]=−d−1φ∑iδi2,∇3φ(w)[r,r,r]=d−1φ∑iδi2(m1+2σi),\nabla^2\Psi(\tilde u)[\tilde p,\tilde p]=\operatorname{tr}(\hat r^2)=\|\sigma\|^2,\quad \nabla^2\varphi(w)[r,r]=-d^{-1}\varphi\textstyle\sum_i\delta_i^2,\quad \nabla^3\varphi(w)[r,r,r]=d^{-1}\varphi\sum_i\delta_i^2(m_1+2\sigma_i),∇2Ψ(u~)[p~​,p~​]=tr(r^2)=∥σ∥2,∇2φ(w)[r,r]=−d−1φ∑i​δi2​,∇3φ(w)[r,r,r]=d−1φ∑i​δi2​(m1​+2σi​),

which are (105), (107) and (108). 6. The scalar inequality (109c):  d−1φ∑iδi2(∥σ∥−m1+2(∥σ∥−σi))≥0\ d^{-1}\varphi\sum_i\delta_i^2(\|\sigma\|-m_1+2(\|\sigma\|-\sigma_i))\ge0 d−1φ∑i​δi2​(∥σ∥−m1​+2(∥σ∥−σi​))≥0 for every σ∈Rd\sigma\in\mathbb R^dσ∈Rd. 7. The compatibility inequality (103) on int⁡(Krtdet)\operatorname{int}(\mathcal K_{\mathrm{rtdet}})int(Krtdet​):

∇3ζ(u~)[p~,p~,p~]≤−3(∇2Ψ(u~)[p~,p~])1/2∇2ζ(u~)[p~,p~].\nabla^3\zeta(\tilde u)[\tilde p,\tilde p,\tilde p]\le-3\big(\nabla^2\Psi(\tilde u)[\tilde p,\tilde p]\big)^{1/2}\nabla^2\zeta(\tilde u)[\tilde p,\tilde p].∇3ζ(u~)[p~​,p~​,p~​]≤−3(∇2Ψ(u~)[p~​,p~​])1/2∇2ζ(u~)[p~​,p~​].
  1. The reduction: if Ψ\PsiΨ is a ddd-LHSCB, ζ\zetaζ is C3C^3C3 and concave, and (103) holds, then Γ\GammaΓ is a (1+d)(1+d)(1+d)-LHSCB. This is the paper's application of Nesterov–Nemirovskii Proposition 5.1.7.

Significance

The result gives the root-determinant cone a barrier whose parameter 1+d1+d1+d is one more than the optimal parameter ddd of its domain R×Q\mathbb R\times\mathcal QR×Q, so it cannot be improved by more than one (p. 24). It also removes the extended formulation: a solver works with the cone in its natural dimension. The paper pairs the barrier with closed-form oracles for the gradient, Hessian product and inverse Hessian product (§7.4, Lemma 7.1), and reports computational gains in Hypatia. Because the statement is uniform over Euclidean Jordan algebras, it covers the vector, real symmetric and complex Hermitian cases at once.

The result is proved in the paper; this mission formalizes it. To the best of the curators' knowledge, it has no machine-checked proof, and Lean's Mathlib has no theory of Euclidean Jordan algebras, spectral decompositions in them, or barrier functions for their cones. Formalizing Proposition 7.1 therefore also yields a reusable layer: the Jordan-algebraic setting, the cone of squares, the quadratic representation, and an LHSCB predicate on arbitrary normed spaces.

Difficulty

The obvious route checks self-concordance of Γ\GammaΓ directly. That requires bounding the third derivative of −log⁡(det⁡(w)1/d−u)−log⁡det⁡(w)-\log(\det(w)^{1/d}-u)-\log\det(w)−log(det(w)1/d−u)−logdet(w) by the 3/23/23/2-power of its Hessian in every direction. The two logarithmic terms interact, and no simple direct estimate is available. The paper instead uses a compatibility criterion of Nesterov and Nemirovskii, which reduces the barrier property to the single inequality (103) between derivatives of ζ\zetaζ and Ψ\PsiΨ. In Lean that criterion is not available and must be established for this cone; it is the deepest milestone.

The derivative identities (105), (107) and (108) require differential calculus of spectral functions on a Jordan algebra: derivatives of det⁡\detdet, of w↦w−1w\mapsto w^{-1}w↦w−1, and of P(w−1/2)P(w^{-1/2})P(w−1/2), expressed through the eigenvalues of the scaled direction r^\hat rr^. Deriving them from the structure axioms needs, among other things, the fact that the eigenvalues of θw\theta wθw and w2w^2w2 are those of www scaled and squared, uniqueness of the spectral decomposition, and positivity of the eigenvalues on int⁡(Q)\operatorname{int}(\mathcal Q)int(Q). Only the final scalar inequality (109c) is elementary.

Formalization scope

VVV is a real finite-dimensional inner product space carrying a structure EJA V d. The structure bundles the Jordan product (bilinear, commutative, Jordan identity), the unit eee and the Euclidean property. It also bundles, for every www, eigenvalues and a Jordan frame of primitive idempotents with w=∑iwiciw=\sum_iw_ic_iw=∑i​wi​ci​, and the identity ⟨a,b⟩=tr⁡(a∘b)\langle a,b\rangle=\operatorname{tr}(a\circ b)⟨a,b⟩=tr(a∘b). The spectral theorem (Faraut–Korányi III.1.2) says such data exist for every Euclidean Jordan algebra of rank ddd, so this is the paper's setting. Primitivity forces ddd to be the rank: without it, a frame could be padded with zeros and det⁡\detdet would change.

The ambient space is R×V\mathbb R\times VR×V. Directional derivatives are iterated Fréchet derivatives on the diagonal, and "boundary" is the topological frontier. The barrier limit is taken within the interior at every frontier point.

The following conventions are fixed:

  • the rank satisfies d≥1d\ge1d≥1, since the paper divides by ddd and the goal is false at d=0d=0d=0;
  • self-concordance includes convexity, as in Nesterov–Nemirovskii Definition 2.1.1;
  • logarithmic homogeneity (38) is required for u~∈int⁡(K)\tilde u\in\operatorname{int}(\mathcal K)u~∈int(K) and θ>0\theta>0θ>0;
  • ∥σ∥\|\sigma\|∥σ∥ is the Euclidean norm;
  • (⋅)1/2(\cdot)^{1/2}(⋅)1/2 in (103) is the real square root;
  • (105) is stated in squared form;
  • φ\varphiφ, ζ\zetaζ, Γ\GammaΓ, Ψ\PsiΨ and r^\hat rr^ are total functions that are only evaluated on the relevant interiors.

Properness is a separate predicate from LHSCB, because E\mathcal EE is not pointed.

A trivializing formalization is ruled out by these choices. Specializing VVV to Rd\mathbb R^dRd or Sd\mathbb S^dSd, dropping primitivity, allowing d=0d=0d=0, dropping convexity, or imposing the barrier limit at only some boundary points would each prove a different, weaker or vacuous statement.

Proposition 6.1 (the (2+d)(2+d)(2+d)-LHSCB for the matrix monotone derivative cones) and Lemma 7.1 (the inverse Hessian oracle) are deliberately absent. The first needs matrix monotonicity and Löwner's integral representation and is independent of Proposition 7.1. The second is an oracle formula that the goal does not use.

Contributions are welcome at every level: the scalar inequality (109c); the cone and homogeneity facts; the spectral calculus behind (105)–(108); and the compatibility reduction. The Jordan-algebraic infrastructure and the LHSCB predicate are reusable beyond this mission.

Selected references

  • C. Coey, L. Kapelevich, J. P. Vielma, Conic optimization with spectral functions on Euclidean Jordan algebras, Mathematics of Operations Research, 2022. https://arxiv.org/abs/2103.04104v2
  • Y. Nesterov, A. Nemirovskii, Interior-Point Polynomial Algorithms in Convex Programming, SIAM, 1994. https://doi.org/10.1137/1.9781611970791
  • J. Faraut, A. Korányi, Analysis on Symmetric Cones, Oxford University Press, 1994 (cited in the paper as Faraut and Koranyi, 1998).
  • Y. Nesterov, M. J. Todd, Self-scaled barriers and interior-point methods for convex programming, Mathematics of Operations Research 22(1), 1997. https://doi.org/10.1287/moor.22.1.1
14 thms0 active usersReviewed
Algorithmic Game TheoryEconomicsOperations Research·Captain: mikedeng1

Multimarket Cournot Equilibria with Heterogeneous Resource-Constrained Firms: The Unique Equilibrium in Closed Form via Augmented and Cutoff BudgetsResearch Paper

Motivation

Cournot competition is the standard model of firms that compete by choosing quantities: each firm picks an output, the total output sets the market price, and an equilibrium is a profile in which no firm can gain by changing its own output alone. In practice firms rarely compete in one market. A manufacturer allocates a limited production capacity across regions, an advertiser allocates a budget across channels, a retailer allocates inventory across stores. The capacity couples the markets: what a firm sells in one market it cannot sell in another, so the markets can no longer be analysed one at a time.

Existence of equilibria in such games follows from general fixed-point arguments, and uniqueness under concave demand is known in several settings (for example Alsabah, Bernard, Capponi, Iyengar and Sethuraman, Multiregional oligopoly with capacity constraints, 2019–2021). What is usually missing is a description of the equilibrium itself: which firms enter which markets, and how much each firm allocates. R. Caldentey and M. B. Haugh (Operations Research, 2024) give that description for linear demand. Their Theorem 1 states the unique equilibrium in closed form, in terms of two scalar quantities per firm and per market, the augmented budgets and the cutoff budgets. The rest of their paper (participation thresholds, monotonicity, the limit of many small firms with a fixed aggregate budget, and merger effects) is read off from this formula.

Setting

There are NNN firms and MMM markets. Firm i∈[N]i\in[N]i∈[N] has a budget Bi>0B_i>0Bi​>0 and chooses an allocation xij≥0x_{ij}\ge 0xij​≥0 to each market j∈[M]j\in[M]j∈[M] subject to ∑j=1Mxij≤Bi\sum_{j=1}^M x_{ij}\le B_i∑j=1M​xij​≤Bi​. Market jjj has linear inverse demand

rj(X)=Rj−Xβj,βj>0,r_j(X)=R_j-\frac{X}{\beta_j},\qquad \beta_j>0,rj​(X)=Rj​−βj​X​,βj​>0,

where Xj=∑i=1NxijX_j=\sum_{i=1}^N x_{ij}Xj​=∑i=1N​xij​ is the total allocated to market jjj. Firm iii's profit is ∑j=1Mrj(Xj) xij\sum_{j=1}^M r_j(X_j)\,x_{ij}∑j=1M​rj​(Xj​)xij​. Markets are ranked 0≤R1≤⋯≤RM0\le R_1\le\cdots\le R_M0≤R1​≤⋯≤RM​ and budgets B1≥⋯≥BN>0B_1\ge\cdots\ge B_N>0B1​≥⋯≥BN​>0.

A Cournot equilibrium is a profile of feasible allocations such that, for every firm iii, no feasible allocation of firm iii yields a higher profit when the other firms keep their allocations.

Three derived quantities appear in the answer.

  • The augmented budget of firm iii is Bi=i Bi+∑k=iNBk\mathcal B_i=i\,B_i+\sum_{k=i}^N B_kBi​=iBi​+∑k=iN​Bk​.
  • The cutoff budget of market jjj is Bj=∑k=jMβk(Rk−Rj)\mathbb B_j=\sum_{k=j}^M\beta_k(R_k-R_j)Bj​=∑k=jM​βk​(Rk​−Rj​).
  • The water-level function is H(x)=inf⁡{z≥0: ∑j=1Mβj(Rj−z)+≤x}H(x)=\inf\{z\ge 0:\ \sum_{j=1}^M\beta_j(R_j-z)^+\le x\}H(x)=inf{z≥0: ∑j=1M​βj​(Rj​−z)+≤x} for x≥0x\ge 0x≥0: the lowest level zzz at which the "volume" ∑jβj(Rj−z)+\sum_j\beta_j(R_j-z)^+∑j​βj​(Rj​−z)+ above zzz fits into xxx.

Finally nj∗=max⁡{i∈[N]:Bi>Bj}n^*_j=\max\{i\in[N]:\mathcal B_i>\mathbb B_j\}nj∗​=max{i∈[N]:Bi​>Bj​}, with nj∗=0n^*_j=0nj∗​=0 when no firm qualifies, is the threshold index used in the formula. For Rj>0R_j>0Rj​>0 it counts the firms active in market jjj; at Rj=0R_j=0Rj​=0 the threshold index can be positive while every allocation to that market is zero.

Formalization targets

Goal: Theorem 1 (p. 8)

Under the standing assumptions there is exactly one Cournot equilibrium, and it is

xij∗=βj[Rj1+nj∗−H(Bi)i+1+∑k=1nj∗H(Bk)k(k+1)−∑k=1iH(Bk)k(k+1)]+.x^*_{ij}=\beta_j\Big[\frac{R_j}{1+n^*_j}-\frac{H(\mathcal B_i)}{i+1}+\sum_{k=1}^{n^*_j}\frac{H(\mathcal B_k)}{k(k+1)}-\sum_{k=1}^{i}\frac{H(\mathcal B_k)}{k(k+1)}\Big]^+ .xij∗​=βj​[1+nj∗​Rj​​−i+1H(Bi​)​+k=1∑nj∗​​k(k+1)H(Bk​)​−k=1∑i​k(k+1)H(Bk​)​]+.

It is stated as an equivalence: a profile xxx is a Cournot equilibrium if and only if x=x∗x=x^*x=x∗. This single statement contains existence, uniqueness and the formula.

Milestones

The milestones follow the proof in Appendix B.

  1. Properties of HHH (remark after Definition 3.2): continuous, non-increasing, piecewise linear on [0,∞)[0,\infty)[0,∞), and H(Bj)=RjH(\mathbb B_j)=R_jH(Bj​)=Rj​.
  2. H(x)H(x)H(x) is the least z≥0z\ge 0z≥0 with ∑jβj(Rj−z)+≤x\sum_j\beta_j(R_j-z)^+\le x∑j​βj​(Rj​−z)+≤x, and the inequality is tight when H(x)>0H(x)>0H(x)>0 (proof of Theorem 1, after (B-17)).
  3. (B-4): a firm's best response is xij=(βjRj−βjλi−Xij−)+/2x_{ij}=(\beta_jR_j-\beta_j\lambda_i-X_{ij-})^+/2xij​=(βj​Rj​−βj​λi​−Xij−​)+/2 with a budget multiplier λi≥0\lambda_i\ge 0λi​≥0.
  4. (B-5)–(B-7): in equilibrium the multipliers are non-decreasing, the active firms in a market are the first njn_jnj​, and xij=βjnj+1[Rj−λi(nj+1)+∑k≤njλk]+x_{ij}=\frac{\beta_j}{n_j+1}\big[R_j-\lambda_i(n_j+1)+\sum_{k\le n_j}\lambda_k\big]^+xij​=nj​+1βj​​[Rj​−λi​(nj​+1)+∑k≤nj​​λk​]+.
  5. (B-10) ⇒ (B-11): with αi=iλi−∑k<iλk\alpha_i=i\lambda_i-\sum_{k<i}\lambda_kαi​=iλi​−∑k<i​λk​, one has λi=αi/i+∑k<iαk/(k(k+1))\lambda_i=\alpha_i/i+\sum_{k<i}\alpha_k/(k(k+1))λi​=αi​/i+∑k<i​αk​/(k(k+1)).
  6. The identity after (B-12): ∑k≤nλk/(1+n)=∑k≤nαk/(k(k+1))\sum_{k\le n}\lambda_k/(1+n)=\sum_{k\le n}\alpha_k/(k(k+1))∑k≤n​λk​/(1+n)=∑k≤n​αk​/(k(k+1)).
  7. Lemma 1 (B-18): for the allocations (B-12) built from any non-decreasing α≥0\alpha\ge 0α≥0 and every vector VVV, (i+1)∑jVjxij+∑k>i∑jVjxkj=∑j:αi<RjVjβj(Rj−αi)(i+1)\sum_jV_jx_{ij}+\sum_{k>i}\sum_jV_jx_{kj}=\sum_{j:\alpha_i<R_j}V_j\beta_j(R_j-\alpha_i)(i+1)∑j​Vj​xij​+∑k>i​∑j​Vj​xkj​=∑j:αi​<Rj​​Vj​βj​(Rj​−αi​).
  8. (B-16): in equilibrium αi=H(Bi)\alpha_i=H(\mathcal B_i)αi​=H(Bi​) for every firm.

Significance

Theorem 1 turns an N×MN\times MN×M equilibrium problem with coupled constraints into a formula that can be evaluated in closed form once HHH is computed at NNN points. It shows that firm iii's allocation depends on the budgets only through Bi,…,BN\mathcal B_i,\dots,\mathcal B_NBi​,…,BN​, so a firm's behaviour is unaffected by the sizes of larger firms, only by their number. The paper's Proposition 1 (participation iff Bi>Bj\mathcal B_i>\mathbb B_jBi​>Bj​, monotonicity of allocations, and which budget constraints bind) and Proposition 2 (the limit of many firms with a fixed aggregate budget) are corollaries, as are its comparative statics on consumer surplus and welfare.

The result is proved in the paper, by a derivation through Lagrange multipliers. It has no machine-checked proof. A formalization would check the derivation, including the case of tied budgets, which the paper's proof sets aside in a footnote ("straightforward to handle"), and would make the closed form and the function HHH available for the follow-up results.

Difficulty

Each firm's problem is a strictly concave quadratic program, so best responses are easy to describe one firm at a time. The difficulty is that the best responses are coupled through the market totals and through which firms are active in which market. The obvious approach, solving the first-order conditions market by market, requires knowing the set of active firms in each market, and that set depends on all the multipliers at once, while the multipliers depend on which budget constraints bind. Uniqueness requires showing that every equilibrium has multipliers of this form; existence requires that the formula's profile satisfies every firm's optimality conditions, including the inactive markets.

Formalization scope

Firms are Fin N and markets Fin M; the paper's firm iii is the Lean index i.val + 1, so the factors i+1i+1i+1 and k(k+1)k(k+1)k(k+1) in (6) become i + 2 and (k+1)(k+2). Profiles are firm-first, x i j. All quantities are real numbers. The price Rj−Xj/βjR_j-X_j/\beta_jRj​−Xj​/βj​ is not truncated at zero. The equilibrium notion is the published CarbonDoubleCount.Planner.IsPureNash, which compares a firm's payoff against every feasible unilateral deviation.

The standing assumptions are bundled in one predicate: RRR monotone, Rj≥0R_j\ge 0Rj​≥0, βj>0\beta_j>0βj​>0, BBB antitone, Bi>0B_i>0Bi​>0. The orderings that §2 makes "without loss of generality" are hypotheses, because the formulas (5) and (6) depend on them. Ties among budgets are allowed (the paper's proof assumes distinct budgets in a footnote; the theorem does not). N=0N=0N=0 and M=0M=0M=0 are allowed.

Pinned readings: the empty maximum in nj∗n^*_jnj∗​ is 000; HHH is a real infimum, used only at nonnegative arguments; "the smallest real such that the budget holds" for a multiplier is complementary slackness; Lemma 1 is an identity for any non-decreasing α≥0\alpha\ge 0α≥0 and does not assume the market ordering; "greater than one" after (B-17) is read as "greater than zero".

The sentence after (7) calls nj∗n^*_jnj∗​ the number of firms operating. At the allowed boundary Rj=0R_j=0Rj​=0 this is not literally true: a one-market instance with positive budgets has nj∗=Nn^*_j=Nnj∗​=N and xij∗=0x^*_{ij}=0xij∗​=0 for every firm. The formal goal retains (7) and the closed form (6), and does not assert the false boundary interpretation.

The formula x∗x^*x∗ is a definition computed from the data. A statement that only asserts the existence of a unique equilibrium, or that defines x∗x^*x∗ by choice from an equilibrium, would not be Theorem 1; the goal is the equivalence with the explicit formula.

A complete development needs: KKT conditions for a separable concave quadratic program with one linear constraint (milestone 3), elementary properties of a water-filling level function (milestones 1–2), and finite summation identities (milestones 5–7). The water-filling lemmas and the summation identities are reusable beyond this mission. Proofs of any milestone, and alternative proofs of the goal that bypass the multiplier derivation, are welcome.

Selected references

  • R. Caldentey and M. B. Haugh, Technical Note—Multimarket Cournot equilibria with heterogeneous resource-constrained firms, Operations Research, 2024. https://doi.org/10.1287/opre.2022.0664 (cited from the authors' version of January 20, 2024).
  • A. Cournot, Recherches sur les principes mathématiques de la théorie des richesses, Hachette, Paris, 1838.
  • H. Alsabah, B. Bernard, A. Capponi, G. Iyengar and J. Sethuraman, Multiregional oligopoly with capacity constraints, SSRN 3280688, 2020. https://doi.org/10.2139/ssrn.3280688
11 thms0 active usersReviewed
Convex OptimizationFunctional AnalysisOperations Research·Captain: mikedeng1

On the Douglas–Rachford Algorithm for Solving Possibly Inconsistent Optimization Problems: The Primal Shadows Converge Weakly, and in Value, to a Solution of the Normal ProblemResearch Paper

Motivation

The Douglas–Rachford algorithm is one of the most widely used splitting methods for minimizing a sum f+gf + gf+g of two convex functions, or more generally for finding a zero of a sum A+BA + BA+B of two maximally monotone operators. It touches each summand only through its proximal mapping (resolvent), which is why it underlies ADMM and a large share of first-order solvers in signal processing, statistics and operations research.

Its convergence theory is classical in the consistent case, when A+BA + BA+B has a zero: then the shadow sequence JATnxJ_A T^n xJA​Tnx, the sequence actually used as the approximate solution, converges weakly to a zero of A+BA + BA+B (Lions and Mercier 1979; Svaiter 2011). In practice, however, problems are frequently inconsistent: the constraint sets do not meet, or dom⁡f∩dom⁡g=∅\operatorname{dom} f \cap \operatorname{dom} g = \varnothingdomf∩domg=∅, so that min⁡f+g\min f + gminf+g has no solution in the usual sense. Then the governing sequence TnxT^n xTnx diverges, and the question is what the shadows do. Infeasibility detection in ADMM-based conic solvers (Banjac, Goulart, Stellato and Boyd 2019; Liu, Ryu and Yin 2019) is one place where this question arises.

Timeline (as recounted in §1.2 of the paper).

  • 2004: Bauschke, Combettes and Luke treat two closed convex sets U,VU, VU,V: the shadows PUTnxP_U T^n xPU​Tnx are bounded and their weak cluster points minimize ιU+ιV(⋅−v)\iota_U + \iota_V(\cdot - v)ιU​+ιV​(⋅−v).
  • 2014: Bauschke, Hare and Moursi set up a static framework for generalized solutions of inconsistent monotone inclusions, the normal problem.
  • 2016: the same authors relate ran⁡(Id−T)\operatorname{ran}(\mathrm{Id} - T)ran(Id−T) to the domains and ranges of AAA and BBB.
  • 2016: Bauschke and Moursi prove strong convergence, with linear rates, for two closed affine subspaces; with Dao, one affine subspace and one closed convex set; and, via a new Fejér monotonicity principle, full weak convergence of the shadows for two closed convex sets.
  • 2020: Bauschke and Moursi treat f=ιUf = \iota_Uf=ιU​ for a closed linear subspace UUU and general g∈Γ0(X)g \in \Gamma_0(X)g∈Γ0​(X), under the assumption vR=0v_R = 0vR​=0.
  • This paper (arXiv 2021; Mathematics of Operations Research 2024): weak and value convergence of the shadows for two general f,g∈Γ0(X)f, g \in \Gamma_0(X)f,g∈Γ0​(X), and vR=0v_R = 0vR​=0 shown to be necessary.

Setting

Let XXX be a real Hilbert space and A,B:X⇉XA, B : X \rightrightarrows XA,B:X⇉X maximally monotone operators. The resolvent of AAA is JA=(Id+A)−1J_A = (\mathrm{Id} + A)^{-1}JA​=(Id+A)−1, a single-valued map on all of XXX; RA=2JA−IdR_A = 2J_A - \mathrm{Id}RA​=2JA​−Id is the reflected resolvent, and JA−1=Id−JAJ_{A^{-1}} = \mathrm{Id} - J_AJA−1​=Id−JA​. The Douglas–Rachford operator is

T=Id−JA+JBRA.T = \mathrm{Id} - J_A + J_B R_A .T=Id−JA​+JB​RA​.

The minimal displacement vector of TTT is v=Pran⁡‾(Id−T)(0)v = P_{\overline{\operatorname{ran}}(\mathrm{Id} - T)}(0)v=Pran(Id−T)​(0), the element of least norm in the closure of ran⁡(Id−T)\operatorname{ran}(\mathrm{Id}-T)ran(Id−T). With D=dom⁡A−dom⁡BD = \operatorname{dom}A - \operatorname{dom}BD=domA−domB and R=ran⁡A+ran⁡BR = \operatorname{ran}A + \operatorname{ran}BR=ranA+ranB, put vD=PD‾(0)v_D = P_{\overline D}(0)vD​=PD​(0) and vR=PR‾(0)v_R = P_{\overline R}(0)vR​=PR​(0). The paper works under the standing assumption

ran⁡‾(Id−T)=D∩R‾=D‾∩R‾,(12)\overline{\operatorname{ran}}(\mathrm{Id} - T) = \overline{D \cap R} = \overline{D} \cap \overline{R}, \tag{12}ran(Id−T)=D∩R=D∩R,(12)

which holds automatically in finite dimensions for subdifferential operators. The normal problem is to find xxx with 0∈−v+Ax+B(x−v)0 \in -v + Ax + B(x - v)0∈−v+Ax+B(x−v); its solution set is ZZZ.

In the optimization setting, f,g∈Γ0(X)f, g \in \Gamma_0(X)f,g∈Γ0​(X) are proper, convex and lower semicontinuous with values in ]−∞,+∞]]-\infty, +\infty]]−∞,+∞], (A,B)=(∂f,∂g)(A, B) = (\partial f, \partial g)(A,B)=(∂f,∂g), the resolvents become the proximal mappings Pf,PgP_f, P_gPf​,Pg​, and T=Id−Pf+PgRfT = \mathrm{Id} - P_f + P_g R_fT=Id−Pf​+Pg​Rf​. The normal problem becomes min⁡xf(x)+g(x−v)\min_x f(x) + g(x - v)minx​f(x)+g(x−v), which may have solutions even when dom⁡f∩dom⁡g=∅\operatorname{dom} f \cap \operatorname{dom} g = \varnothingdomf∩domg=∅. The primal shadows are PfTnxP_f T^n xPf​Tnx and PgRfTnxP_g R_f T^n xPg​Rf​Tnx.

Formalization targets

Goal: Theorem 6.9

Let f,g∈Γ0(X)f, g \in \Gamma_0(X)f,g∈Γ0​(X), assume (12), and suppose that 0∈dom⁡f∗+dom⁡g∗0 \in \operatorname{dom} f^* + \operatorname{dom} g^*0∈domf∗+domg∗, that v∈ran⁡(Id−T)v \in \operatorname{ran}(\mathrm{Id} - T)v∈ran(Id−T) and that zer⁡(∂f+∂g(⋅−v))≠∅\operatorname{zer}(\partial f + \partial g(\cdot - v)) \neq \varnothingzer(∂f+∂g(⋅−v))=∅. Let μ=min⁡x(f(x)+g(x−v))\mu = \min_x (f(x) + g(x - v))μ=minx​(f(x)+g(x−v)) and x∈Xx \in Xx∈X. Then there is zˉ\bar zzˉ such that

PfTnx⇀zˉ,PgRfTnx⇀zˉ−v,P_f T^n x \rightharpoonup \bar z,\qquad P_g R_f T^n x \rightharpoonup \bar z - v,Pf​Tnx⇀zˉ,Pg​Rf​Tnx⇀zˉ−v,

zˉ\bar zzˉ minimizes f+g(⋅−v)f + g(\cdot - v)f+g(⋅−v) and zˉ−v\bar z - vzˉ−v minimizes f(⋅+v)+gf(\cdot + v) + gf(⋅+v)+g, and

f(PfTnx)+g(PgRfTnx)→f(zˉ)+g(zˉ−v)=μ,f(P_f T^n x) + g(P_g R_f T^n x) \to f(\bar z) + g(\bar z - v) = \mu,f(Pf​Tnx)+g(Pg​Rf​Tnx)→f(zˉ)+g(zˉ−v)=μ,

with f(PfTnx)→f(zˉ)f(P_f T^n x) \to f(\bar z)f(Pf​Tnx)→f(zˉ) and g(PgRfTnx)→g(zˉ−v)g(P_g R_f T^n x) \to g(\bar z - v)g(Pg​Rf​Tnx)→g(zˉ−v).

Milestones

The milestones follow the paper's chain: the resolvent identities (Lemma 2.2) and Proposition 2.7; the splitting v=vD+vRv = v_D + v_Rv=vD​+vR​ (Proposition 3.3); the static results on Fix⁡(v+T)\operatorname{Fix}(v + T)Fix(v+T) and ZZZ (Lemma 4.1, Proposition 4.2, Theorem 4.3); the orbit dynamics (Proposition 5.3, Theorem 5.5, Corollary 5.7); and §6: vR=0v_R = 0vR​=0 from the conjugate condition, ZZZ as the minimizers of the normal problem (Proposition 6.2), the prox lemma and value estimate (Lemma 6.3, Proposition 6.4), and convergence in value and weakly (Propositions 6.5, 6.6).

Significance

The result. Theorem 6.9 says that running the Douglas–Rachford algorithm on an inconsistent convex problem is still meaningful: the computed shadows converge to a solution of the normal problem, the closest consistent shift of the original problem, and the objective values converge to its optimal value. Practitioners can thus run the method without first deciding feasibility. The static results of §§3–4 (the location of vDv_DvD​, vRv_RvR​, the description of ZZZ when vR=0v_R = 0vR​=0) are general facts about pairs of maximally monotone operators and are reusable outside the algorithm.

Formalizing it. The theorem is proved on paper; no part of it is machine-checked. A formalization would be the first verified convergence result for a splitting method in the inconsistent case, and it requires a library of Hilbert-space monotone operator theory (resolvents, Minty's theorem, Fejér monotonicity, Opial-type arguments, the Brøndsted–Rockafellar theorem) that Mathlib currently lacks.

Difficulty

When v≠0v \neq 0v=0 the governing sequence TnxT^n xTnx diverges, roughly like −nv-nv−nv, so the Fejér monotonicity argument of the consistent case, which rests on a fixed point of TTT, has nothing to anchor to: TTT has no fixed points. The natural first idea, to apply the consistent theory to the shifted pair (−v+A,B(⋅−v))(-v + A, B(\cdot - v))(−v+A,B(⋅−v)), does not by itself say anything about the shadows of the original iteration, and in general the primal shadows need not even be bounded (by Theorem 5.5 of the paper, when Fix⁡(v+T)≠∅\operatorname{Fix}(v + T) \neq \varnothingFix(v+T)=∅ they are bounded exactly when vR=0v_R = 0vR​=0). Identifying weak cluster points as minimizers requires an asymptotic value estimate rather than a fixed-point characterization, and the uniqueness of the weak limit needs a Fejér-type property in the product space X×XX \times XX×X. Lower semicontinuity gives only lim inf⁡\liminfliminf bounds on fff and ggg separately, so convergence of each value is a separate claim.

Formalization scope

XXX is a real inner product space with CompleteSpace X. Operators are X → Set X; maximal monotonicity and resolvents come from published definitions. Resolvents and proximal maps are maps J : X → X characterized by x−Jx∈A(Jx)x - Jx \in A(Jx)x−Jx∈A(Jx) for all xxx, which is J=(Id+A)−1J = (\mathrm{Id} + A)^{-1}J=(Id+A)−1; JA−1J_{A^{-1}}JA−1​ and Pf∗P_{f^*}Pf∗​ are written Id−JA\mathrm{Id} - J_AId−JA​ and Id−Pf\mathrm{Id} - P_fId−Pf​, by the inverse resolvent identity. The projections v,vD,vRv, v_D, v_Rv,vD​,vR​ are least-norm points of the respective closures. Functions are X → EReal in the published class Γ0\Gamma_0Γ0​; the subdifferential is empty off the domain; every inequality is stated as an EReal sum, without extended-real subtraction. μ\muμ is the EReal infimum of f+g(⋅−v)f + g(\cdot - v)f+g(⋅−v). Weak convergence is ⟨un,w⟩→⟨z,w⟩\langle u_n, w\rangle \to \langle z, w\rangle⟨un​,w⟩→⟨z,w⟩ for all www. Norms on X×XX \times XX×X are written ∥a∥2+∥b∥2\|a\|^2 + \|b\|^2∥a∥2+∥b∥2.

Restored hypotheses and corrections, disclosed on every item: the standing assumption (12) of p. 6 is an explicit hypothesis of every statement from §3 on; the §6 statements carry the section's standing assumptions (vR=0v_R = 0vR​=0, and Z≠∅Z \neq \varnothingZ=∅ from (74) on). The page prints μ:=min⁡x(f(x+v)−g(x))\mu := \min_x (f(x + v) - g(x))μ:=minx​(f(x+v)−g(x)) in Theorem 6.9; the statement uses min⁡x(f(x)+g(x−v))\min_x(f(x) + g(x - v))minx​(f(x)+g(x−v)), as in Proposition 6.5 and §1.1. The goal does not assume vR=0v_R = 0vR​=0, Z≠∅Z \neq \varnothingZ=∅ or boundedness of the shadows: these are consequences, and a version assuming them, or leaving the proximal maps or vvv unconstrained, would trivialize the statement.

The development needs Minty's theorem, the Brøndsted–Rockafellar density dom⁡‾f∗=ran⁡‾∂f\overline{\operatorname{dom}} f^* = \overline{\operatorname{ran}} \partial fdomf∗=ran∂f, closedness and convexity of ran⁡‾(Id−T)\overline{\operatorname{ran}}(\mathrm{Id} - T)ran(Id−T), Opial's lemma, and maximal monotonicity of subdifferentials of Γ0\Gamma_0Γ0​ functions. These are reusable throughout convex analysis and are welcome as separate contributions. Corollary 6.10 (dual shadows), Proposition 6.7 and the examples are not part of the mission.

Selected references

  • H. H. Bauschke and W. M. Moursi, On the Douglas–Rachford algorithm for solving possibly inconsistent optimization problems, Mathematics of Operations Research, 2024; preprint arXiv:2106.11547v1 (2021), the version formalized here. https://arxiv.org/abs/2106.11547
  • H. H. Bauschke, P. L. Combettes and D. R. Luke, Finding best approximation pairs relative to two closed convex sets in Hilbert spaces, Journal of Approximation Theory 127 (2004), 178–192.
  • H. H. Bauschke, W. L. Hare and W. M. Moursi, Generalized solutions for the sum of two maximally monotone operators, SIAM Journal on Control and Optimization 52 (2014), 1034–1047.
  • H. H. Bauschke, W. L. Hare and W. M. Moursi, On the range of the Douglas–Rachford operator, Mathematics of Operations Research 41 (2016), 884–897.
  • H. H. Bauschke and W. M. Moursi, On the Douglas–Rachford algorithm, Mathematical Programming (Series A) 164 (2017), 263–284.
  • H. H. Bauschke and W. M. Moursi, On the behaviour of the Douglas–Rachford algorithm for minimizing a convex function subject to a linear constraint, SIAM Journal on Optimization 30 (2020), 2559–2576.
  • W. M. Moursi, The Douglas–Rachford operator in the possibly inconsistent case: static properties and dynamic behaviour, Ph.D. thesis, University of British Columbia, 2016. https://doi.org/10.14288/1.0340501
  • P.-L. Lions and B. Mercier, Splitting algorithms for the sum of two nonlinear operators, SIAM Journal on Numerical Analysis 16 (1979), 964–979.
  • B. F. Svaiter, On weak convergence of the Douglas–Rachford method, SIAM Journal on Control and Optimization 49 (2011), 280–287.
  • H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd edition, Springer, 2017.
21 thms0 active usersReviewed
Mechanism DesignOperations Research·Captain: mikedeng1

Optimal Auction Design with Deferred Inspection and Reward: The Optimal Single-Agent Auction Has Best-Alternative Bid b(v) = G⁻¹(G(v) − G(v̲)) and a Continuous AllocationResearch Paper

Motivation

A seller who can inspect a buyer's true value after receiving a bid can use the bid as a refundable deposit. A truthful buyer may receive a reward, while a buyer whose report is false forfeits the deposit. This changes the incentive constraint: a buyer who considers reporting www compares her truthful utility with vx(w)−wv x(w)-wvx(w)−w, not with the payoff from a conventional payment schedule at the false report. Alaei, Belloni, Makhdoumi, and Malekian study the revenue-maximizing design for this setting in Optimal Auction Design with Deferred Inspection and Reward, §§2–3.

The single-agent problem is a useful test of how inspection affects mechanism design. The paper gives an explicit bid function, allocation rule, and payment rule for a general positive differentiable value density. The mission asks for a formal statement and proof of that characterization, including the claim that the proposed auction is optimal among every feasible deferred-inspection mechanism. The source used here is the SSRN copy dated 2022-03-22; all page and result numbers refer to that copy.

Setting

The buyer has a private value vvv in V=[0,1]V=[0,1]V=[0,1]. Its density fff is differentiable and strictly positive on VVV, and integrates to one. The seller allocates one object with probability x(w)∈[0,1]x(w)\in[0,1]x(w)∈[0,1] after report www. The buyer pays the report as a deposit. After inspection reveals the true value, a truthful report may earn a nonnegative reward; a false report earns none. Write p(v)p(v)p(v) for the seller's net payment when the buyer reports truthfully.

A pair (x,p)(x,p)(x,p) is incentive compatible and individually rational when, for every v,w∈Vv,w\in Vv,w∈V,

vx(v)−p(v)≥vx(w)−w,vx(v)−p(v)≥0.v x(v)-p(v)\ge v x(w)-w, \qquad v x(v)-p(v)\ge0.vx(v)−p(v)≥vx(w)−w,vx(v)−p(v)≥0.

The first inequality includes the forfeited deposit www. Expected revenue is Rf(x,p)=∫01p(v)f(v) dvR_f(x,p)=\int_0^1 p(v)f(v)\,dvRf​(x,p)=∫01​p(v)f(v)dv. Feasibility also requires p(v)f(v)p(v)f(v)p(v)f(v) to be integrable, so this real-valued objective represents an expectation. These are Problem (7)–(9) on p. 7 of the source.

For a fixed allocation, (10) defines its greatest compatible payment

px(v)=inf⁡0≤w≤v{v(x(v)−x(w))+w}.p_x(v)=\inf_{0\le w\le v}\{v(x(v)-x(w))+w\}.px​(v)=0≤w≤vinf​{v(x(v)−x(w))+w}.

The best-alternative bid bx(v)b_x(v)bx​(v) is the largest report attaining that minimum, when an attaining report exists. The paper also considers allocations that are strictly concave and differentiable up to a threshold vˉ\bar vvˉ and equal to one thereafter. It calls this class SCD. Those concepts are represented directly in the mission's definition module.

Formalization targets

The goal is Theorem 2 on p. 12. Put

G(t)=∫0tyf(y) dy,b(v)={0,v≤v‾,G−1(G(v)−G(v‾)),v>v‾.G(t)=\int_0^t yf(y)\,dy, \qquad b(v)= \begin{cases} 0,&v\le\underline v,\\ G^{-1}(G(v)-G(\underline v)),&v>\underline v. \end{cases}G(t)=∫0t​yf(y)dy,b(v)={0,G−1(G(v)−G(v​)),​v≤v​,v>v​.​

The theorem asserts that thresholds v‾,vˉ\underline v,\bar vv​,vˉ exist with vˉ=b(1)\bar v=b(1)vˉ=b(1) and with the integral branch of the proposed allocation reaching one at vˉ\bar vvˉ. The allocation is x(v)=1x(v)=1x(v)=1 above vˉ\bar vvˉ and

x(v)=∫v‾b−1(v)b′(t)t dt(v<vˉ),x(v)=\int_{\underline v}^{b^{-1}(v)}\frac{b'(t)}{t}\,dt \qquad(v<\bar v),x(v)=∫v​b−1(v)​tb′(t)​dt(v<vˉ),

where b−1(v)=G−1(G(v)+G(v‾))b^{-1}(v)=G^{-1}(G(v)+G(\underline v))b−1(v)=G−1(G(v)+G(v​)). Its payment is vx(v)v x(v)vx(v) at or below v‾\underline vv​, v(x(v)−x(b(v)))+b(v)v(x(v)-x(b(v)))+b(v)v(x(v)−x(b(v)))+b(v) between the thresholds, and v(1−x(b(v)))+b(v)v(1-x(b(v)))+b(v)v(1−x(b(v)))+b(v) at or above vˉ\bar vvˉ. The formal goal says this explicit pair is feasible and that Rf(x′,p′)≤Rf(x,p)R_f(x',p')\le R_f(x,p)Rf​(x′,p′)≤Rf​(x,p) for every feasible pair (x′,p′)(x',p')(x′,p′). It also asserts that a threshold pair exists.

The milestones follow the paper's route: Proposition 2 identifies pxp_xpx​; Lemma 1 records payment improvements from removing allocation decreases, changing endpoints, and taking the concave hull; Lemma 2 supplies smooth strictly concave approximations with convergent revenue; and the sound part of Proposition 3 concerns best-alternative bids. The final two targets are the differential identity for bbb in the proof of Theorem 2 and the threshold equation (15). Their source wording, page, and PDF hash are attached to each milestone.

Why the result matters

The result replaces an optimization over pairs of functions subject to all pairwise incentive inequalities with explicit rules calculated from the value density. It determines both the allocation probabilities and the payments in the inspection model. For the uniform density, Example 2 on pp. 13–14 gives a continuous allocation and revenue about 0.38080.38080.3808, compared with 0.250.250.25 for the standard no-inspection benchmark in that example; see the source. The difference comes from the seller's ability to retain the deposit after a false report.

The paper has a published mathematical argument, but these exact statements have no machine-checked proofs in this mission. A completed formalization would provide reusable definitions for truthful reporting with forfeited deposits, the optimal-payment operator, and the inverse weighted distribution GGG. It would also resolve proof gaps visible in the source rather than silently taking them as assumptions. Theorem 1 of the SSRN copy is false as printed for its stated bid class and is deliberately absent from the formal targets; the mission's goal is Theorem 2 itself.

Difficulty

The main obstacle is global optimality. Checking a derivative or a local incentive condition does not compare the proposed auction against every feasible mechanism. Every type can contemplate every false report, so a local condition alone does not settle incentive compatibility. The appendix derives the proposed bid through variations of an allocation-dependent functional, including Dirac-delta perturbations and an unconstrained reformulation in Theorem 1. Its admissible bids do not all correspond to feasible allocations satisfying the endpoint condition. A proof of Theorem 2 must establish the global revenue comparison without treating that reformulation as an already valid equivalence.

The boundary is also mathematically delicate. The derivative b′(v)b'(v)b′(v) becomes singular as vvv approaches v‾\underline vv​ from above, although the allocation integral remains meaningful for the intended positive threshold. Formula (15) must have a genuine solution; merely quantifying over thresholds satisfying an equation would make the optimality clause empty if no such pair existed.

Formalization scope

Lean represents values by real numbers and restricts every value and report quantifier to [0,1][0,1][0,1]. The density carries exactly Assumption 1's differentiability, positivity, and unit integral; the absence of point masses follows from the density representation. Allocation and payment functions are total real functions whose values outside the value interval have no economic role. Expected payment is a real interval integral, and feasible mechanisms require integrability of pfpfpf.

The inverse G−1G^{-1}G−1 is the lower inverse on [0,1][0,1][0,1], formed with a real infimum. Its intended calls are within the range of GGG. The displayed allocation uses the ordinary derivative of the explicit bid on its open differentiability interval; the singular endpoint does not affect the integral. The equation x(vˉ)=1x(\bar v)=1x(vˉ)=1 is read through the integral branch, not through the constant-one branch, because it determines the threshold by continuity. The goal states existence of thresholds and optimality over all feasible mechanisms. In particular, the incentive condition is not replaced by the classical vx(w)−p(w)v x(w)-p(w)vx(w)−p(w), and comparison is not restricted to SCD, concave, or monotone allocations.

Proposition 2 and Lemma 1 are expressed as payment-improvement statements, since pointwise assertions about every revenue optimum fail after null-set changes. Proposition 3 keeps the unique minimizer and monotonicity claims but narrows strict increase to the region before the bid reaches vˉ\bar vvˉ; the printed full-interval claim admits a flat segment. The derivative identity is stated on (v‾,1)(\underline v,1)(v​,1), where its terms are defined. Contributions that prove these precise statements, construct the threshold solution, or establish the final global comparison are within scope.

Selected references

  • Saeed Alaei, Alexandre Belloni, Azar Makhdoumi, and Ali Malekian, Optimal Auction Design with Deferred Inspection and Reward, SSRN preprint 3700525, version dated 2022-03-22; published in Operations Research, 2024. SSRN copy; journal DOI.
9 thms0 active usersReviewed
PreviousPage 73 of 73Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me