Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,338 missions · 1,108 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1230Completed1108All2338
Complexity TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

Scheduling Problems with Two Competing Agents 7: PARTITION Reduces to Two Agents Each Bounding Their Own Makespan in the Two-Machine Flow Shop and Open ShopResearch Paper

Motivation

In multi-agent scheduling, several decision makers share one processing resource, and each one cares only about the completion of its own jobs. Agnetis, Mirchandani, Pacciarelli and Pacifici (Oper. Res. 52(2), 2004) set up the two-agent version of this problem and classified its complexity for most combinations of classical objectives. Typical settings are a manufacturing cell that serves an internal and an external customer, or two departments that negotiate access to a shared machine. Most of the paper treats a single machine. Its §10 asks what happens when the shared resource is a small shop: two machines that every job must visit.

The answer is that even the simplest two-machine case is hard. In the classical single-agent setting, the two-machine flow shop makespan problem is solved by Johnson's rule (Johnson 1954) and the two-machine open shop makespan problem by Gonzalez and Sahni (1976), both in polynomial time. As soon as two agents each want their own jobs finished early, both problems become NP-hard.

Setting

There are two agents, A and B. Agent A owns jobs J1A,…,JnAAJ^A_1,\dots,J^A_{n_A}J1A​,…,JnA​A​ and agent B owns jobs J1B,…,JnBBJ^B_1,\dots,J^B_{n_B}J1B​,…,JnB​B​. Every job consists of one operation on machine M1M_1M1​ and one on machine M2M_2M2​, and pihX≥0p^X_{ih}\ge 0pihX​≥0 is the processing time of job JiXJ^X_iJiX​ on machine MhM_hMh​. A schedule gives every operation a start time. It is feasible when no operation starts before time 000, each machine processes at most one operation at a time, and the two operations of one job do not overlap in time. Processing is nonpreemptive.

  • In the flow shop F2F2F2 every job is processed first on M1M_1M1​ and then on M2M_2M2​.
  • In the open shop O2O2O2 the two operations of a job may be processed in either order.

The makespan of agent XXX, Cmax⁡XC^X_{\max}CmaxX​, is the latest completion time of an operation of one of its jobs. The recognition problem F2∥Cmax⁡A≤QA, Cmax⁡B≤QBF2\|C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_BF2∥CmaxA​≤QA​, CmaxB​≤QB​ asks, for given thresholds QA,QBQ_A, Q_BQA​,QB​, whether some feasible flow shop schedule has Cmax⁡A≤QAC^A_{\max}\le Q_ACmaxA​≤QA​ and Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​. The problem O2∥Cmax⁡A≤QA, Cmax⁡B≤QBO2\|C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_BO2∥CmaxA​≤QA​, CmaxB​≤QB​ is the same question for the open shop.

PARTITION (Problem 9.1 of the paper) asks whether a finite list of nonnegative integers p1,…,pkp_1,\dots,p_kp1​,…,pk​ can be split into two parts of equal sum P/2P/2P/2, where P=∑ipiP=\sum_i p_iP=∑i​pi​.

Formalization targets

Goal: Theorems 10.1 and 10.2

PARTITION ≤p F2 ∥ Cmax⁡A≤QA, Cmax⁡B≤QBandPARTITION ≤p O2 ∥ Cmax⁡A≤QA, Cmax⁡B≤QB,\text{PARTITION}\ \le_p\ F2\,\|\,C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_B \qquad\text{and}\qquad \text{PARTITION}\ \le_p\ O2\,\|\,C^A_{\max}\le Q_A,\ C^B_{\max}\le Q_B,PARTITION ≤p​ F2∥CmaxA​≤QA​, CmaxB​≤QB​andPARTITION ≤p​ O2∥CmaxA​≤QA​, CmaxB​≤QB​,

with ≤p\le_p≤p​ polynomial-time many-one reducibility between binary-coded languages. This is how the paper proves "F2∥Cmax⁡A:Cmax⁡BF2\|C^A_{\max}:C^B_{\max}F2∥CmaxA​:CmaxB​ is NP-hard" (Theorem 10.1, p. 238) and "O2∥Cmax⁡A:Cmax⁡BO2\|C^A_{\max}:C^B_{\max}O2∥CmaxA​:CmaxB​ is NP-hard" (Theorem 10.2, p. 239).

Milestones: the two constructions

For Theorem 10.1, with ε=1/(k+1)\varepsilon=1/(k+1)ε=1/(k+1), the paper builds the instance with kkk A-jobs of times (ε,pi)(\varepsilon, p_i)(ε,pi​), one B-job of times (P/2−(k−1)ε, P/2)(P/2-(k-1)\varepsilon,\ P/2)(P/2−(k−1)ε, P/2), and thresholds QA=3P/2+εQ_A = 3P/2+\varepsilonQA​=3P/2+ε, QB=P+εQ_B = P+\varepsilonQB​=P+ε. The milestones are:

  1. under Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​ the B-job starts on M2M_2M2​ by P/2+εP/2+\varepsilonP/2+ε, and the A-jobs before it on M2M_2M2​ total at most P/2P/2P/2;
  2. for even PPP, PARTITION has a solution if and only if this instance meets both thresholds.

For Theorem 10.2 the instance has kkk A-jobs of time pip_ipi​ on both machines, one B-job of time P/2P/2P/2 on both machines, and thresholds QA=3P/2Q_A=3P/2QA​=3P/2, QB=PQ_B=PQB​=P. The milestones are:

  1. under Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​ the B-job starts at 000 on one machine and at P/2P/2P/2 on the other;
  2. PARTITION has a solution if and only if this instance meets both thresholds.

Significance

The two theorems mark the boundary of tractability of §10. The single-agent problems F2∥Cmax⁡F2\|C_{\max}F2∥Cmax​ and O2∥Cmax⁡O2\|C_{\max}O2∥Cmax​ are polynomial. Giving the second agent a single job and a deadline is already enough to make the problems NP-hard, so no extension of Johnson's rule or of the Gonzalez–Sahni algorithm solves the two-agent versions unless P = NP. The paper also observes that any other combination of the objectives it considers is NP-hard in these shops.

The theorems are proved in the paper by short reductions. As far as we know none of them is machine-checked. This mission produces checked statements of both reductions on a general two-machine shop model with real start times. It also corrects the flow shop equivalence, which as printed does not hold for odd PPP.

Difficulty

The hard direction of each equivalence goes from a feasible schedule to a partition. A schedule is a set of real start times, not a permutation. Nothing forces the jobs into a fixed order or rules out idle time. The proof has to extract a combinatorial split from interval packing: which A-jobs fit into the gap before the B-job on one machine and which fit into the gap after it. The sum of lengths of pairwise disjoint intervals inside a window must be bounded by the window's length.

In the flow shop the gap after the B-job has length P/2+kεP/2+k\varepsilonP/2+kε, which is not P/2P/2P/2. Integrality of the A-lengths is what closes the gap, and it only works when P/2P/2P/2 is an integer. In the open shop, the same argument has to cover both orders of the B-job's operations. Both reductions output rational data, so the goal also needs a scaling to integer data and a polynomial-time bound on the code map.

Formalization scope

  • Model. Jobs are numbered Fin (n_A + n_B), the A-jobs first. Start times are real numbers, and idle time and different job orders on the two machines are allowed. Flow shop feasibility is the published JohnsonFlowShop.TwoStage.IsFeasible from the Johnson (1954) series. Open shop feasibility is the definition IsOpenFeasible of this mission: no machine overlap between distinct jobs, and no time overlap between the two operations of a job. "Cmax⁡X≤QXC^X_{\max}\le Q_XCmaxX​≤QX​" is stated as "every operation of every XXX-job ends by QXQ_XQX​", so no maximum over a possibly empty set is taken.
  • Languages. The target languages hold the binary codes of instances with natural-number processing times and thresholds that have a feasible schedule meeting both thresholds. PARTITION is the published ProjSchedTW.Complexity.partitionLang (nonnegative sizes, zero allowed), and reducibility is CookPvsNP.PolyReducible. Both come from published definitions of the Neumann–Schwindt–Zimmermann and Cook series. NP-membership is not formalized.
  • Constructions. They are defined over R\mathbb RR exactly as printed. A reduction to the N\mathbb NN-coded languages has to rescale (for example by 2(k+1)2(k+1)2(k+1)). That rescaling is the solver's to choose and is not a milestone.
  • Corrections. The printed flow shop equivalence uses ⌊P/2+kε⌋=P/2\lfloor P/2+k\varepsilon\rfloor = P/2⌊P/2+kε⌋=P/2 and fails for odd PPP: p=(1)p=(1)p=(1) gives a yes-instance of the scheduling problem but has no partition. It also fails for P=0P=0P=0 and k≥2k\ge 2k≥2, where the printed p11Bp^B_{11}p11B​ is negative. Milestone 2 therefore assumes PPP even and (P≥2P\ge2P≥2 or k≤1k\le1k≤1). The goal is unaffected, because odd PPP is a PARTITION no-instance. In the open shop proof, the printed identity "∑piA+∑piB=2P\sum p^A_i+\sum p^B_i = 2P∑piA​+∑piB​=2P" is read as "each machine carries 3P/23P/23P/2 of work", and the statement is unchanged.
  • No trivialization. The flow shop and open shop languages are not restricted to the instances the constructions produce, so they cannot be decided by reading off the construction. A schedule must satisfy the machine and job non-overlap constraints, including in the open shop, where a definition without the job constraint would let a job run on both machines at once.
  • Welcome contributions. Interval-packing lemmas on R\mathbb RR, a polynomial-time bound for list arithmetic over encNats, and a scaling lemma for shop schedules are reusable beyond this mission.

Selected references

  • A. Agnetis, P. B. Mirchandani, D. Pacciarelli, A. Pacifici, Scheduling Problems with Two Competing Agents, Operations Research 52(2) (2004) 229–242. https://doi.org/10.1287/opre.1030.0092
  • S. M. Johnson, Optimal two- and three-stage production schedules with setup times included, Naval Research Logistics Quarterly 1 (1954) 61–68. https://doi.org/10.1002/nav.3800010110
  • T. Gonzalez, S. Sahni, Open shop scheduling to minimize finish time, Journal of the ACM 23(4) (1976) 665–679. https://doi.org/10.1145/321978.321985
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
11 thms2 active usersReviewed
Complexity TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

Scheduling Problems with Two Competing Agents 6: PARTITION Reduces to Two Agents Each Bounding Their Own Total Completion Time on One MachineResearch Paper

Two agents sharing one machine

In many production and service settings a single resource is shared by parties with different goals: two departments sending orders to the same machine, two customers of a contract manufacturer, or two classes of requests on one processor. Multi-agent scheduling models this directly. Each agent owns its own jobs and its own objective, and a schedule is judged by the pair of objective values it gives the two agents rather than by a single combined criterion.

Agnetis, Mirchandani, Pacciarelli and Pacifici (Oper. Res. 52(2), 2004, pp. 229–242) set up the systematic study of the two-agent single-machine problem. For each pair of classical objectives they ask how hard it is to optimise one agent's objective while the other agent's objective stays within a given bound. This mission formalises their §9, the case in which both agents minimise their own total completion time. With a single agent, minimising the total completion time is solved by sorting the jobs by length (the shortest-processing-time rule of Smith, 1956). §9 shows that two agents, each with this easiest of objectives, already give an NP-hard problem (Theorem 9.2), and that the problem is solved in pseudopolynomial time by a dynamic program (Theorem 9.3).

Setting

There are two agents, A and B. Agent A owns jobs J1A,…,JnAAJ^A_1,\dots,J^A_{n_A}J1A​,…,JnA​A​ with processing times phA∈Np^A_h\in\mathbb NphA​∈N; agent B owns jobs J1B,…,JnBBJ^B_1,\dots,J^B_{n_B}J1B​,…,JnB​B​ with processing times pkB∈Np^B_k\in\mathbb NpkB​∈N. All jobs are available at time 000 and are processed on one machine, one at a time, without interruption. Since both objectives are nondecreasing in the completion times, a schedule σ\sigmaσ is a sequence of all nA+nBn_A+n_BnA​+nB​ jobs processed back to back from time 000. The completion time Cj(σ)C_j(\sigma)Cj​(σ) of a job is the total processing time of the job and of all jobs before it. Agent A's cost is ∑hChA(σ)\sum_hC^A_h(\sigma)∑h​ChA​(σ) and agent B's cost is ∑kCkB(σ)\sum_kC^B_k(\sigma)∑k​CkB​(σ).

The recognition problem 1∥∑CiA≤QA, ∑CiB≤QB1\|\sum C^A_i\le Q_A,\ \sum C^B_i\le Q_B1∥∑CiA​≤QA​, ∑CiB​≤QB​ asks, for thresholds QA,QBQ_A,Q_BQA​,QB​, whether some schedule has

∑h=1nAChA(σ)≤QAand∑k=1nBCkB(σ)≤QB.\sum_{h=1}^{n_A}C^A_h(\sigma)\le Q_A\qquad\text{and}\qquad\sum_{k=1}^{n_B}C^B_k(\sigma)\le Q_B .h=1∑nA​​ChA​(σ)≤QA​andk=1∑nB​​CkB​(σ)≤QB​.

The source problem is PARTITION (Problem 9.1): given integers p1,…,pkp_1,\dots,p_kp1​,…,pk​ with P=∑ipiP=\sum_ip_iP=∑i​pi​, is there a set S⊆{1,…,k}S\subseteq\{1,\dots,k\}S⊆{1,…,k} with ∑i∈Spi=∑i∉Spi=P/2\sum_{i\in S}p_i=\sum_{i\notin S}p_i=P/2∑i∈S​pi​=∑i∈/S​pi​=P/2?

The paper's reduction numbers the integers so that p1≤⋯≤pkp_1\le\dots\le p_kp1​≤⋯≤pk​ and gives both agents identical job sets, kkk jobs of lengths p1,…,pkp_1,\dots,p_kp1​,…,pk​, with thresholds QA=QB=T/2Q_A=Q_B=T/2QA​=QB​=T/2, where

T=3P+4∑i=1k(k−i)pi.T=3P+4\sum_{i=1}^k(k-i)p_i .T=3P+4i=1∑k​(k−i)pi​.

Writing J[i]J[i]J[i] for the pair JiA,JiBJ^A_i,J^B_iJiA​,JiB​, an SPT schedule processes J[1],…,J[k]J[1],\dots,J[k]J[1],…,J[k] in order, each pair in either internal order; xxx denotes the total length of the pairs in which B goes first.

Formalization targets

Goal: Theorem 9.2

PARTITION ≤p 1∥∑CiA≤QA, ∑CiB≤QB\text{PARTITION}\ \le_p\ 1\|\textstyle\sum C^A_i\le Q_A,\ \sum C^B_i\le Q_BPARTITION ≤p​ 1∥∑CiA​≤QA​, ∑CiB​≤QB​

Here ≤p\le_p≤p​ is polynomial-time many-one reducibility between languages of binary codes: a polynomial-time Turing-machine-computable map on strings that sends codes of PARTITION yes-instances, and only those, to codes of yes-instances of the recognition problem. Together with the NP-completeness of PARTITION (Karp 1972) this is the statement "1∥∑CiA:∑CiB1\|\sum C^A_i : \sum C^B_i1∥∑CiA​:∑CiB​ is binary NP-hard".

Milestones of the proof

  1. Every SPT schedule has ∑CiA+∑CiB=T\sum C^A_i+\sum C^B_i=T∑CiA​+∑CiB​=T, and QA=QB=T/2Q_A=Q_B=T/2QA​=QB​=T/2.
  2. Eqs. (5) and (6): in an SPT schedule, ∑CiA=P+2∑i(k−i)pi+x\sum C^A_i=P+2\sum_i(k-i)p_i+x∑CiA​=P+2∑i​(k−i)pi​+x and ∑CiB=P+2∑i(k−i)pi+(P−x)\sum C^B_i=P+2\sum_i(k-i)p_i+(P-x)∑CiB​=P+2∑i​(k−i)pi​+(P−x).
  3. A schedule with ∑CiA≤T/2\sum C^A_i\le T/2∑CiA​≤T/2 and ∑CiB≤T/2\sum C^B_i\le T/2∑CiB​≤T/2 processes the jobs in nondecreasing order of length.
  4. For pairwise distinct p1<⋯<pkp_1<\dots<p_kp1​<⋯<pk​: PARTITION has a solution iff some schedule meets T/2T/2T/2 for both agents.

Further result: Theorem 9.3 with recursion (7)

With each agent's jobs numbered by nondecreasing length and P(i,j)P(i,j)P(i,j) the total length of J1A,…,JiA,J1B,…,JjBJ^A_1,\dots,J^A_i,J^B_1,\dots,J^B_jJ1A​,…,JiA​,J1B​,…,JjB​, the recursion

F(i,j,q)=min⁡{F(i−1,j,q)+P(i−1,j)+piA; F(i,j−1,q−P(i,j))}F(i,j,q)=\min\bigl\{F(i-1,j,q)+P(i-1,j)+p^A_i;\ F(i,j-1,q-P(i,j))\bigr\}F(i,j,q)=min{F(i−1,j,q)+P(i−1,j)+piA​; F(i,j−1,q−P(i,j))}

with F(0,0,q)=0F(0,0,q)=0F(0,0,q)=0 for q≥0q\ge0q≥0 and F=+∞F=+\inftyF=+∞ for q<0q<0q<0 yields F(nA,nB,Q)=min⁡{∑CiA:∑CiB≤Q}F(n_A,n_B,Q)=\min\{\sum C^A_i:\sum C^B_i\le Q\}F(nA​,nB​,Q)=min{∑CiA​:∑CiB​≤Q}, and +∞+\infty+∞ when no schedule meets the bound.

Significance

Theorem 9.2 fills one cell of the paper's complexity table: even when both agents use the objective that is trivial for one agent, sharing the machine makes the constrained problem NP-hard. Together with Theorem 9.3 it places 1∥∑CiA:∑CiB1\|\sum C^A_i:\sum C^B_i1∥∑CiA​:∑CiB​ exactly: NP-hard under binary encoding, solvable in pseudopolynomial time, hence not strongly NP-hard unless P = NP. The later literature on two-agent and multi-agent scheduling (for example the monograph of Agnetis, Billaut, Gawiejnowicz, Pacciarelli and Soukhal, Multiagent Scheduling, Springer 2014) cites this classification.

Neither result has a machine-checked proof that we know of. The mission adds a formal record of the reduction and of the dynamic program, reusable definitions for the two-agent total-completion-time problem, and a correction of the printed proof: the equivalence between PARTITION and the constructed instance, as printed, holds only when the integers are pairwise distinct. For p=(1,1,1,1,10)p=(1,1,1,1,10)p=(1,1,1,1,10) PARTITION has no solution, yet a schedule meets T/2=41T/2=41T/2=41 for both agents. Theorem 9.2 itself is not affected, since PARTITION remains NP-hard, but a complete formal proof needs a reduction that is correct on every input.

Difficulty

The equivalence for distinct integers rests on two facts: the overall total ∑CiA+∑CiB\sum C^A_i+\sum C^B_i∑CiA​+∑CiB​ is at least TTT for every schedule, with equality only for sequences in nondecreasing order of length; and, with distinct lengths, such a sequence is made of consecutive pairs, whose split is controlled by xxx. The naive formal argument stops at the second fact, which is false with repeated lengths: a block of equal-length jobs can be shared between the agents in ways no sequence of pairs realises. The goal adds the encoding layer: the reduction must be computable in polynomial time on a Turing machine, must handle repeated and zero sizes and odd PPP (where T/2T/2T/2 is not an integer and the language's thresholds are), and must send strings that do not code a PARTITION instance outside the target language. For Theorem 9.3, the dynamic program is correct only because some optimal schedule orders each agent's jobs by length, and the constraint makes this exchange argument less direct than for a single agent.

Formalization scope

Jobs are Fin nA ⊕ Fin nB (Sum.inl h is Jh+1AJ^A_{h+1}Jh+1A​, Sum.inr k is Jk+1BJ^B_{k+1}Jk+1B​, 0-based). Schedules, completion times and the idle-free sequence model are the published MooreLateJobs.Shared.completionTime (Moore 1968 series): a schedule is a duplicate-free list containing every job once, and completion times are real numbers. Processing times and thresholds of the language are natural numbers. Reducibility is the published CookPvsNP.PolyReducible, and PARTITION, the alphabet and the binary codes are the published ProjSchedTW.Complexity.Encoding (partitionLang, whose sizes are natural numbers including 000). The target language allows any job counts and any processing times; identical job sets are a property of the construction only.

The following readings are explicit:

  • An SPT schedule of the construction is given by a choice x:Fin k→Boolx:\mathrm{Fin}\,k\to\mathrm{Bool}x:Fink→Bool of the first agent in each pair; "feasible implies SPT" is stated as "lengths are nondecreasing along the sequence", which is what the paper's exchange argument proves.
  • The milestones take the integers already sorted, as a hypothesis; the paper's thresholds T/2T/2T/2 are real numbers in the milestones.
  • The equivalence milestone assumes p1<⋯<pkp_1<\dots<p_kp1​<⋯<pk​; the printed version with ≤\le≤ is false, as shown above.
  • In recursion (7), the terms F(−1,j,q)F(-1,j,q)F(−1,j,q) and F(i,−1,q)F(i,-1,q)F(i,−1,q) that the paper leaves undefined are +∞+\infty+∞.
  • The running time O(nAnBQ)O(n_An_BQ)O(nA​nB​Q) of Theorem 9.3 is not formalised; only the correctness of (7) is. Membership in NP is not formalised.

The goal cannot be met by a trivial reduction: PolyReducible requires the map to be computed by a polynomial-time Turing machine and to be correct on every string, and the target language contains every two-agent instance, not only those with identical job sets. Contributions welcome: the exchange lemmas for total completion time on the shared sequence model, the SPT formulas, and Turing-machine constructions for list sorting and arithmetic on binary codes, which other reductions of this series reuse.

Selected references

  • A. Agnetis, P. B. Mirchandani, D. Pacciarelli, A. Pacifici, Scheduling Problems with Two Competing Agents, Operations Research 52(2) (2004) 229–242. https://doi.org/10.1287/opre.1030.0092
  • R. M. Karp, Reducibility among Combinatorial Problems, in Complexity of Computer Computations, Plenum (1972) 85–103. https://doi.org/10.1007/978-1-4684-2001-2_9
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3 (1956) 59–66. https://doi.org/10.1002/nav.3800030106
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1) (1968) 102–109. https://doi.org/10.1287/mnsc.15.1.102
  • S. Cook, The P versus NP Problem, Clay Mathematics Institute Millennium Problems (2000). https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
  • A. Agnetis, J.-C. Billaut, S. Gawiejnowicz, D. Pacciarelli, A. Soukhal, Multiagent Scheduling: Models and Algorithms, Springer (2014). https://doi.org/10.1007/978-3-642-41880-8
12 thms2 active usersReviewed
Complexity TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

Scheduling Problems with Two Competing Agents 2: KNAPSACK Reduces to Minimizing One Agent's Total Weighted Completion Time Under a Makespan Bound for the OtherResearch Paper

Two agents sharing one machine

In many production and logistics settings a single resource is shared by parties with different goals: two departments of a plant that send orders to the same machine, two customers of a contract manufacturer, or two classes of traffic on one processor. Multi-agent scheduling models this directly. Each agent owns its own jobs and its own objective, and a schedule is judged by the pair of objective values it gives the two agents rather than by one combined criterion.

Agnetis, Mirchandani, Pacciarelli and Pacifici (Oper. Res. 52(2), 2004, pp. 229–242) set up the systematic study of the two-agent single-machine problem. For each pair of classical objectives they ask how hard it is to optimise one agent's objective while the other agent's objective stays within a given bound. Their Table 1 lists the outcome for each pair. This mission formalises one entry, Theorem 5.2: when agent A minimises its total weighted completion time and agent B only requires its makespan to stay below a bound, the problem is NP-hard under binary encoding of the numbers. The corresponding single-agent bicriteria problem had been shown NP-hard in the strong sense by Lenstra, Rinnooy Kan and Brucker (1977); the two-agent version differs because only B's jobs are constrained.

Setting

There are two agents, A and B. Agent A owns jobs J1A,…,JnAAJ^A_1,\dots,J^A_{n_A}J1A​,…,JnA​A​; job JhAJ^A_hJhA​ has a processing time phA∈Np^A_h\in\mathbb NphA​∈N and a weight whA∈Nw^A_h\in\mathbb NwhA​∈N. Agent B owns jobs J1B,…,JnBBJ^B_1,\dots,J^B_{n_B}J1B​,…,JnB​B​ with processing times pkB∈Np^B_k\in\mathbb NpkB​∈N. All jobs are available at time 000 and are processed on one machine, one at a time, without interruption.

Because both objectives are nondecreasing in the completion times, there is no reason to leave the machine idle, so a schedule σ\sigmaσ is a sequence of all nA+nBn_A+n_BnA​+nB​ jobs processed back to back from time 000. The completion time Cj(σ)C_j(\sigma)Cj​(σ) of a job jjj is the total processing time of jjj and of all jobs sequenced before it. Agent A's cost is ∑hwhAChA(σ)\sum_{h}w^A_hC^A_h(\sigma)∑h​whA​ChA​(σ); agent B's cost is its makespan Cmax⁡B(σ)=max⁡kCkB(σ)C^B_{\max}(\sigma)=\max_kC^B_k(\sigma)CmaxB​(σ)=maxk​CkB​(σ).

The paper's recognition problem 1∥∑wiCiA≤QA, Cmax⁡B≤QB1\|\sum w_iC^A_i\le Q_A,\ C^B_{\max}\le Q_B1∥∑wi​CiA​≤QA​, CmaxB​≤QB​ asks, for given thresholds QA,QBQ_A,Q_BQA​,QB​, whether some schedule has

∑h=1nAwhAChA(σ)≤QAandCkB(σ)≤QB  for all k.\sum_{h=1}^{n_A}w^A_hC^A_h(\sigma)\le Q_A\qquad\text{and}\qquad C^B_k(\sigma)\le Q_B\ \text{ for all }k .h=1∑nA​​whA​ChA​(σ)≤QA​andCkB​(σ)≤QB​  for all k.

The source problem is KNAPSACK (Problem 5.1): given nonnegative integers u1,…,unu_1,\dots,u_nu1​,…,un​, w1,…,wnw_1,\dots,w_nw1​,…,wn​ and integers b,Wb,Wb,W, is there S⊆{1,…,n}S\subseteq\{1,\dots,n\}S⊆{1,…,n} with ∑i∈Sui≤b\sum_{i\in S}u_i\le b∑i∈S​ui​≤b and ∑i∈Swi≥W\sum_{i\in S}w_i\ge W∑i∈S​wi​≥W?

Formalization targets

Goal: Theorem 5.2

KNAPSACK ≤p 1∥∑wiCiA≤QA, Cmax⁡B≤QB\text{KNAPSACK}\ \le_p\ 1\|\textstyle\sum w_iC^A_i\le Q_A,\ C^B_{\max}\le Q_BKNAPSACK ≤p​ 1∥∑wi​CiA​≤QA​, CmaxB​≤QB​

Here ≤p\le_p≤p​ is polynomial-time many-one reducibility between languages of binary codes: a Turing-machine-computable, polynomial-time map on strings sending codes of KNAPSACK yes-instances, and only those, to codes of yes-instances of the recognition problem. Together with the NP-completeness of KNAPSACK (Garey and Johnson 1979) this is the statement "1∥∑wiCiA:Cmax⁡B1\|\sum w_iC^A_i : C^B_{\max}1∥∑wi​CiA​:CmaxB​ is binary NP-hard".

Milestones

The paper's reduction builds, from a KNAPSACK instance, the two-agent instance with piA=uip^A_i=u_ipiA​=ui​, wiA=wiw^A_i=w_iwiA​=wi​, a single B-job of length p1B=w^u^p^B_1=\hat w\hat up1B​=w^u^ (where u^=∑iui\hat u=\sum_iu_iu^=∑i​ui​, w^=∑iwi\hat w=\sum_iw_iw^=∑i​wi​), and thresholds QB=b+p1BQ_B=b+p^B_1QB​=b+p1B​, QA=w^u^+(w^−W)p1BQ_A=\hat w\hat u+(\hat w-W)p^B_1QA​=w^u^+(w^−W)p1B​. The milestones are the two directions of the proof and their combination:

  1. Eq. (1): if SSS solves KNAPSACK, every sequence with exactly the A-jobs of SSS before the B-job meets both thresholds.
  2. Eq. (2): if ∑iwiui>0\sum_iw_iu_i>0∑i​wi​ui​>0 and a sequence meets both thresholds, the A-jobs before the B-job solve KNAPSACK.
  3. Equivalence: under ∑iwiui>0\sum_iw_iu_i>0∑i​wi​ui​>0, KNAPSACK is a yes-instance iff the constructed instance is.
  4. §8: with every B-job given due date QQQ and Q′=0Q'=0Q′=0, a sequence meets ∑UiB≤Q′\sum U^B_i\le Q'∑UiB​≤Q′ (and A's bound) iff it meets Cmax⁡B≤QC^B_{\max}\le QCmaxB​≤Q, which carries the hardness over to 1∥∑wiCiA:∑UiB1\|\sum w_iC^A_i:\sum U^B_i1∥∑wi​CiA​:∑UiB​.

Significance

Theorem 5.2 fixes the complexity of one cell of the two-agent classification. It shows that the polynomial algorithm for the unweighted case 1∥∑CiA:fmax⁡B1\|\sum C^A_i:f^B_{\max}1∥∑CiA​:fmaxB​ (Theorem 5.5 of the same paper) cannot be extended to arbitrary weights unless P = NP. Through §8 it also settles 1∥∑wiCiA:∑UiB1\|\sum w_iC^A_i:\sum U^B_i1∥∑wi​CiA​:∑UiB​. The hardness is binary, not strong: the reduction produces numbers of size about w^u^\hat w\hat uw^u^, so pseudo-polynomial algorithms are not ruled out, which is consistent with the dynamic programs studied in later two-agent literature.

The result is proved in the paper; no machine-checked proof is known to exist. Formalizing it produces a complete reduction from a two-constraint knapsack problem to a scheduling recognition problem, with the encoding, the degenerate instances and the polynomial running time all made explicit. The model and the KNAPSACK language are reusable by other two-agent reductions (Theorems 9.2, 10.1 and 10.2 of the paper reduce from PARTITION in the same frame).

Difficulty

The two directions of the equivalence are short computations with completion times. The printed argument, however, is not correct as written in two places. The bounds "smaller than w^u^\hat w\hat uw^u^" and "smaller than (w^−W)p1B(\hat w-W)p^B_1(w^−W)p1B​" in the derivation of (1) hold only with equality allowed. The strict inequalities in (2) fail when ∑iwiui=0\sum_iw_iu_i=0∑i​wi​ui​=0, and then the reduction itself fails: with all ui=0u_i=0ui​=0 and W>w^W>\hat wW>w^ the KNAPSACK instance is a no-instance while the constructed instance has QA=QB=0Q_A=Q_B=0QA​=QB​=0 and every schedule meets both thresholds. A complete reduction must recognise such instances and treat them separately.

The construction also produces integer thresholds that can be negative (b<−p1Bb<-p^B_1b<−p1B​, or W>w^+1W>\hat w+1W>w^+1), while instances of the target are coded with natural numbers. Finally, the reduction must be a polynomial-time Turing machine computation over binary codes, including the decoding of arbitrary strings and the binary multiplication w^u^\hat w\hat uw^u^; that is where most of the formal work lies.

Formalization scope

  • Model. Jobs are Fin nA ⊕ Fin nB (0-based: Sum.inl h is Jh+1AJ^A_{h+1}Jh+1A​, Sum.inr k is Jk+1BJ^B_{k+1}Jk+1B​). Schedules and completion times are the published MooreLateJobs.Shared sequence model (IsSchedule, completionTime) of the Moore (1968) series: a duplicate-free list of all jobs, processed without idle time from time 000. Integer processing times are cast to R\mathbb RR.
  • Makespan bound. Cmax⁡B≤QBC^B_{\max}\le Q_BCmaxB​≤QB​ is written as CkB≤QBC^B_k\le Q_BCkB​≤QB​ for every B-job; no nonemptiness of B's job set is assumed.
  • Languages. Polynomial-time reducibility is the published CookPvsNP.PolyReducible (Cook's Definition 3, one-tape Turing machines). Codes use the published binary encoding ProjSchedTW.Complexity.Encoding (alphabet BSym, encNat, encInt) of the Neumann–Schwindt–Zimmermann series. A KNAPSACK instance is coded as the integers n,u1,…,un,w1,…,wn,b,Wn,u_1,\dots,u_n,w_1,\dots,w_n,b,Wn,u1​,…,un​,w1​,…,wn​,b,W; a target instance as the natural numbers nA,nBn_A,n_BnA​,nB​, the processing times and weights, and QA,QBQ_A,Q_BQA​,QB​. The target language allows any nA,nB≥0n_A,n_B\ge0nA​,nB​≥0; the reduction uses nB=1n_B=1nB​=1.
  • Readings of the paper. "Binary NP-hard" is formalised as the reduction from KNAPSACK, without the NP-completeness of KNAPSACK and without membership in NP. The milestone Eq. (2) and the equivalence carry the added hypothesis ∑iwiui>0\sum_iw_iu_i>0∑i​wi​ui​>0; the inequalities "smaller than" in (1) are read as ≤\le≤. Eq. (1) is stated for every order of the jobs inside SSS and inside its complement. The §8 result is stated as the encoding-free equivalence of feasible solutions, not as a reduction between languages.
  • Ruled out. The goal cannot be met by a reduction that ignores the input: the equivalence must hold for every string, and the target language is exactly the codes of yes-instances of the two-agent recognition problem with B's objective the makespan. KNAPSACK here is the two-constraint problem of Problem 5.1, not subset sum.

Contributions welcome: proofs of the two directions, of the equivalence, the treatment of the degenerate instances, and the Turing machine for the reduction, which would also serve the other binary-coded reductions on the platform.

Selected references

  • A. Agnetis, P. B. Mirchandani, D. Pacciarelli, A. Pacifici, Scheduling Problems with Two Competing Agents, Operations Research 52(2) (2004) 229–242. https://doi.org/10.1287/opre.1030.0092
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
  • J. K. Lenstra, A. H. G. Rinnooy Kan, P. Brucker, Complexity of Machine Scheduling Problems, Annals of Discrete Mathematics 1 (1977) 343–362. https://doi.org/10.1016/S0167-5060(08)70743-X
  • S. Cook, The P versus NP Problem, Clay Mathematics Institute Millennium Problem description. https://www.claymath.org/wp-content/uploads/2022/06/pvsnp.pdf
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1) (1968) 102–109. https://doi.org/10.1287/mnsc.15.1.102
11 thms2 active usersReviewed
Algorithmic Game TheoryDifferential Geometry·Captain: mikedeng1

Inefficiency of Nash Equilibria: For an Open Dense Set of C² Payoffs, Nash Equilibria Are Finite, an Efficient One Has a Player at a Vertex, and a Strong One Has at Most One Player off a VertexResearch Paper

Motivation

That noncooperative play usually wastes something is part of the folklore of game theory, with the Prisoner's Dilemma as its emblem: each player's best reply leads to an outcome that both would trade for another. Pradeep Dubey's paper turns this folklore into a theorem about smooth games. For games whose payoffs are twice continuously differentiable, and for all payoffs outside a negligible (closed, nowhere dense) set, Nash equilibria are finite in number and are Pareto-inefficient unless some player sits at a vertex of his strategy set. The same conclusion applies to Nash's mixed extensions of finite games (Nash 1951), where a vertex is a pure strategy.

The question is basic to welfare analysis of strategic interaction: market games, oligopoly, public goods and trading mechanisms (Shapley and Shubik 1977) all ask whether equilibrium outcomes can be efficient. Dubey's answer is that efficiency of an equilibrium is non-generic, so a model that delivers it is exploiting special structure.

Timeline. Nash (1951) introduced equilibrium points and multi-matrix games. Smale (1973, "Optimizing several functions") gave the first-order condition for Pareto optimality of several smooth functions: at an efficient interior point the gradients are linearly dependent. Harsanyi (1973, IJGT 2:235–250) proved that generic finite games have finitely many, indeed an odd number of, mixed equilibria. Dubey's Cowles Foundation Discussion Paper 508R (1978) stated finiteness and inefficiency; the version formalized here is the rewrite IIASA WP-83-74 (1983), published as Mathematics of Operations Research 11(1):1–8 (1986).

Setting

There are n≥2n\ge2n≥2 players N={1,…,n}N=\{1,\dots,n\}N={1,…,n}. Player iii's strategy set is the unit simplex

Si={x∈R+k(i):∑j=1k(i)xj≤1},k(i)≥1,S^i=\Big\{x\in\mathbb R^{k(i)}_+ : \sum_{j=1}^{k(i)}x_j\le1\Big\},\qquad k(i)\ge1,Si={x∈R+k(i)​:j=1∑k(i)​xj​≤1},k(i)≥1,

whose vertices (extreme points) are the origin and the unit vectors. Profiles s=(s1,…,sn)s=(s^1,\dots,s^n)s=(s1,…,sn) range over S=S1×⋯×Sn⊂Rr(n)S=S^1\times\dots\times S^n\subset\mathbb R^{r(n)}S=S1×⋯×Sn⊂Rr(n), r(n)=∑ik(i)r(n)=\sum_i k(i)r(n)=∑i​k(i).

Fix open neighbourhoods Vi⊇SiV^i\supseteq S^iVi⊇Si and V=V1×⋯×VnV=V^1\times\dots\times V^nV=V1×⋯×Vn. The space UUU consists of the C2C^2C2 functions f:V→Rf:V\to\mathbb Rf:V→R with finite C2C^2C2-norm ∥f∥=sup⁡{∥f(s)∥,∥Df(s)∥,∥D2f(s)∥:s∈V}\|f\|=\sup\{\|f(s)\|,\|Df(s)\|,\|D^2f(s)\|: s\in V\}∥f∥=sup{∥f(s)∥,∥Df(s)∥,∥D2f(s)∥:s∈V}. A game is u=(u1,…,un)∈(U)nu=(u^1,\dots,u^n)\in(U)^nu=(u1,…,un)∈(U)n. For T⊆NT\subseteq NT⊆N, (s∣e)(s|e)(s∣e) replaces sis^isi by eie^iei for i∈Ti\in Ti∈T. A profile s∈Ss\in Ss∈S is TTT-efficient if no e∈×i∈TSie\in\times_{i\in T}S^ie∈×i∈T​Si gives ui(s∣e)≥ui(s)u^i(s|e)\ge u^i(s)ui(s∣e)≥ui(s) for all i∈Ti\in Ti∈T with strict inequality for some j∈Tj\in Tj∈T. It is a Nash equilibrium if it is {i}\{i\}{i}-efficient for each iii, efficient if it is NNN-efficient, and a strong Nash equilibrium if it is TTT-efficient for every TTT. The three sets are N(u)N(u)N(u), E(u)E(u)E(u), G(u)G(u)G(u).

In the proof, Du(s)D_u(s)Du​(s) is the n×r(n)n\times r(n)n×r(n) matrix with rows Dui(s)Du^i(s)Dui(s); N∗N^*N∗ is the subspace of matrices whose iii-th row vanishes on player iii's block of columns; E∗E^*E∗ is the set of matrices with linearly dependent rows.

Formalization targets

Goal: the Theorem (p. 3)

There is an open dense set U0⊆(U)nU_0\subseteq(U)^nU0​⊆(U)n such that for u∈U0u\in U_0u∈U0​:

(a) N(u) is finite;(b) s∈N(u)∩E(u)⇒∃j, sj is a vertex;(c) s∈G(u)⇒at most one sj is not a vertex.\text{(a) } N(u)\text{ is finite};\quad \text{(b) } s\in N(u)\cap E(u)\Rightarrow \exists j,\ s^j\text{ is a vertex};\quad \text{(c) } s\in G(u)\Rightarrow \text{at most one } s^j \text{ is not a vertex}.(a) N(u) is finite;(b) s∈N(u)∩E(u)⇒∃j, sj is a vertex;(c) s∈G(u)⇒at most one sj is not a vertex.

Milestones (pp. 4–6)

For interior profiles (si∈Int⁡Sis^i\in\operatorname{Int}S^isi∈IntSi for all iii):

(i) s∈N(u)⇒Du(s)∈N∗,(ii) s∈E(u)⇒Du(s)∈E∗,\text{(i) } s\in N(u)\Rightarrow D_u(s)\in N^*,\qquad \text{(ii) } s\in E(u)\Rightarrow D_u(s)\in E^*,(i) s∈N(u)⇒Du​(s)∈N∗,(ii) s∈E(u)⇒Du​(s)∈E∗,

codim⁡N∗=r(n)\operatorname{codim}N^*=r(n)codimN∗=r(n); the linear perturbation uti(x)=u0i(x)+t∑jyijxju_t^i(x)=u_0^i(x)+t\sum_j y_{ij}x_juti​(x)=u0i​(x)+t∑j​yij​xj​ satisfies ddtD(ut,s0)∣t=0=y\frac{d}{dt}D(u_t,s_0)|_{t=0}=ydtd​D(ut​,s0​)∣t=0​=y (the computation behind (**)); claim (*) for M=N∗M=N^*M=N∗: for an open dense set of games DuD_uDu​ is transverse to N∗N^*N∗ on a compact neighbourhood V‾\underline VV​ of SSS; under that transversality S∩Du−1(N∗)S\cap D_u^{-1}(N^*)S∩Du−1​(N∗) is finite; and the Theorem restricted to interior profiles.

Companions

The Theorem (Multi-Matrix) (p. 14): for an open dense set of payoff vectors a∈(RK)na\in(\mathbb R^K)^na∈(RK)n, the mixed Nash equilibria of Πa\Pi_aΠa​ are finite, an efficient one has a player using a pure strategy, and a strong one is pure. From the example of §3: every game (P,Q)(P,Q)(P,Q) on [0,1]2[0,1]^2[0,1]2 with payoffs uP(x,y)=−[(x−a)2+(y−b)2]u_P(x,y)=-[(x-a)^2+(y-b)^2]uP​(x,y)=−[(x−a)2+(y−b)2] has a unique Nash equilibrium (p. 9); Lemma 1, E(P,Q)=rX(L(P,Q))E(P,Q)=r_X(L(P,Q))E(P,Q)=rX​(L(P,Q)) (p. 9); Lemma 2(a), an interior equilibrium is efficient iff a=ca=ca=c or b=db=db=d (p. 10).

Significance

The theorem gives the generic structure of equilibrium sets in smooth games: isolated and finitely many equilibria, and a sharp location of the only places where efficient equilibria can survive, namely the vertices. It explains why efficiency results for noncooperative models need boundary solutions or non-generic structure, and in its multi-matrix form it shows that strong equilibria of generic finite games are in pure strategies. It also supplies the finiteness of equilibria used in comparative-statics and index arguments.

On the formalization side, the result is proved on paper but has no machine-checked version. A complete development would give Lean its first generic-finiteness theorem for Nash equilibria of smooth games, a first-order Pareto condition in the form of Smale's lemma, and a parametric transversality argument in finite dimensions. The multi-matrix companion connects to the published vocabulary of finite games (agt_games), and the example of §3 is an elementary, fully explicit check of the general picture.

Difficulty

The interior case reduces, by (i) and (ii), to a dimension count: Du−1(N∗)D_u^{-1}(N^*)Du−1​(N∗) should be zero-dimensional and Du−1(N∗∩E∗)D_u^{-1}(N^*\cap E^*)Du−1​(N∗∩E∗) empty. Neither holds for every game: they hold only when DuD_uDu​ is transverse to N∗N^*N∗ and to the strata of N∗∩E∗N^*\cap E^*N∗∩E∗, and the step that requires work is showing that transversality is an open and dense condition in the C2C^2C2 topology. Density is not obtained by adding linear functions to the payoffs: a linear function has finite C2C^2C2-norm on VVV only when VVV is bounded, so perturbations must be localized. The step from interior profiles to the whole of SSS is a second difficulty. It requires repeating the argument on every product of faces of the simplices and on every subgame, and then intersecting finitely many open dense sets. Efficiency at a boundary point is not TTT-efficiency in a subgame, so the reduction has to be made with care.

Formalization scope

Players are Fin n with 2 ≤ n; block sizes k : Fin n → ℕ with 1 ≤ k i; profiles are ∀ i, Fin (k i) → ℝ. The simplex is the paper's corner simplex {x ≥ 0, ∑ x ≤ 1}, not the probability simplex; "vertex" is Set.extremePoints. The neighbourhoods ViV^iVi are taken open, and the goal is stated for every such choice, not assuming VVV bounded or convex. Payoffs are total functions; a game is ContDiffOn ℝ 2 on VVV with finite C2C^2C2-norm, which takes values in [0,∞][0,\infty][0,∞], so no junk real supremum enters. "Open dense in (U)n(U)^n(U)n" is written in ε\varepsilonε-form for the product of C2C^2C2-norm topologies; Lean's sup-type norms are equivalent to the Euclidean ones, so the open dense sets are the same. Deviations range over all strategies in ×i∈TSi\times_{i\in T}S^i×i∈T​Si, not only pure or vertex deviations.

Added hypotheses, all disclosed in the items: openness of ViV^iVi; interiority of every sis^isi on milestones (i), (ii) and the finiteness step (the proof's standing case assumption); M=N∗M=N^*M=N∗ in claim (*). The printed "By (i), N(u)⊂S∩Du−1(N∗)N(u)\subset S\cap D_u^{-1}(N^*)N(u)⊂S∩Du−1​(N∗)" is stated for interior equilibria, which is where (i) applies.

A trivializing formalization is ruled out: the open dense set must contain games arbitrarily close to every game (the zero game is a game, so it is never empty), interiority appears only in the milestones and not in the goal, and efficiency is with respect to all deviations in SSS.

Not stated: (*) for a general submanifold MMM, and the decomposition of N∗∩E∗N^*\cap E^*N∗∩E∗ into submanifolds of codimension ≥r(n)+1\ge r(n)+1≥r(n)+1, both of which need embedded submanifolds of RN\mathbb R^NRN; Remarks 1–4 (Remark 4's openness claim for strictly concave payoffs is false as printed); Lemma 2(b); §5, which the author leaves as a conjecture. Contributions welcome: a finite-dimensional parametric transversality theorem, Smale's first-order Pareto condition, and the face-by-face reduction.

Selected references

  • P. Dubey, Inefficiency of Nash Equilibria, IIASA Working Paper WP-83-74, 1983; Mathematics of Operations Research 11(1):1–8, 1986. https://doi.org/10.1287/moor.11.1.1
  • J. F. Nash, Non-Cooperative Games, Annals of Mathematics 54:286–295, 1951. https://doi.org/10.2307/1969529
  • J. C. Harsanyi, Oddness of the Number of Equilibrium Points: A New Proof, International Journal of Game Theory 2:235–250, 1973. https://doi.org/10.1007/BF01737572
  • S. Smale, Optimizing Several Functions, Manifolds — Tokyo 1973, Proceedings of the International Conference on Manifolds, University of Tokyo Press, 1975.
  • R. Abraham and J. Robbin, Transversal Mappings and Flows, W. A. Benjamin, New York, 1967.
  • L. S. Shapley and M. Shubik, Trade Using One Commodity as a Means of Payment, Journal of Political Economy 85:937–968, 1977. https://doi.org/10.1086/260617
13 thms2 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: mikedeng1

Obtaining Lower Bounds from the Progressive Hedging Algorithm for Stochastic Mixed-Integer Programs: The Dual Prices Give a Lower Bound on the Optimal Value in Every IterationResearch Paper

Why lower bounds matter for progressive hedging

Progressive hedging separates a stochastic optimization problem by scenario, solves those smaller problems, and coordinates their first-stage decisions through weighted aggregation and price updates. It is useful when the full extensive formulation is too large to solve directly. For stochastic mixed-integer programs, its iterates can provide feasible decisions, but a feasible cost alone does not reveal how far that cost is from the global optimum. A lower bound gives the missing comparison: the difference between a feasible cost and a valid lower bound is an optimality gap. Branch-and-bound methods also use lower bounds to discard regions whose best possible cost cannot improve the current solution. These are the reasons the authors seek a bound available during a progressive-hedging run, rather than only after convergence. Gade et al., author manuscript, §§1–3.

The paper establishes lower bounds for two-stage stochastic mixed-integer programs, extends them to scenario bundles, and studies their behavior computationally. The mission concerns the mathematical statement that the price vector produced at each completed iteration is eligible for a decomposed lower bound. The paper was published in Mathematical Programming in 2016; the theorem and page labels here follow the authors' SAND2013-9195J manuscript. Gade et al., author manuscript.

Finite-scenario two-stage setting

Let Ξ\XiΞ be a finite set of scenarios and let pξ>0p_\xi>0pξ​>0 be their probabilities, with ∑ξ∈Ξpξ=1\sum_{\xi\in\Xi}p_\xi=1∑ξ∈Ξ​pξ​=1. A first-stage decision x∈Rn1x\in\mathbb R^{n_1}x∈Rn1​ is made before the scenario is known. Its first p1p_1p1​ coordinates are nonnegative integers; the others are unrestricted reals. It incurs cost c⊤xc^\top xc⊤x and must satisfy Ax≥bAx\ge bAx≥b. After scenario ξ\xiξ is observed, a second-stage decision y(ξ)∈Rn2y(\xi)\in\mathbb R^{n_2}y(ξ)∈Rn2​ incurs cost g(ξ)⊤y(ξ)g(\xi)^\top y(\xi)g(ξ)⊤y(ξ). Its first p2p_2p2​ coordinates are nonnegative integers, and it must satisfy Wy(ξ)≥r(ξ)−T(ξ)xWy(\xi)\ge r(\xi)-T(\xi)xWy(ξ)≥r(ξ)−T(ξ)x. The recourse matrix WWW is common to all scenarios. The scenario feasible set X(ξ)X(\xi)X(ξ) contains pairs (x,y)(x,y)(x,y) satisfying these restrictions for one ξ\xiξ. Gade et al., §2, pp. 3–5.

In the extensive scenario formulation, each scenario has a copy x(ξ)x(\xi)x(ξ) of the first-stage vector, and a common vector x^\hat xx^ enforces implementability through pξx(ξ)−pξx^=0p_\xi x(\xi)-p_\xi\hat x=0pξ​x(ξ)−pξ​x^=0. Its optimum is z∗z^*z∗. Algorithm 1 starts with zero prices w0(ξ)=0w^0(\xi)=0w0(ξ)=0, solves unpenalized scenario problems, and at iteration ν\nuν computes x^ν=∑ξpξxν(ξ)\hat x^\nu=\sum_\xi p_\xi x^\nu(\xi)x^ν=∑ξ​pξ​xν(ξ) and wν(ξ)=wν−1(ξ)+ρ(xν(ξ)−x^ν)w^\nu(\xi)=w^{\nu-1}(\xi)+\rho(x^\nu(\xi)-\hat x^\nu)wν(ξ)=wν−1(ξ)+ρ(xν(ξ)−x^ν). Later scenario solves add both wν(ξ)⊤xw^\nu(\xi)^\top xwν(ξ)⊤x and (ρ/2)∥x−x^ν∥22(\rho/2)\|x-\hat x^\nu\|_2^2(ρ/2)∥x−x^ν∥22​ to their objectives. Here ρ\rhoρ is the algorithm's scalar parameter. Gade et al., Algorithm 1, p. 6.

Formalization targets

Scenario price bound

For any scenario prices w(ξ)w(\xi)w(ξ), define the decomposed dual value by

Dξ(w(ξ))=inf⁡(x,y)∈X(ξ)(c⊤x+g(ξ)⊤y+w(ξ)⊤x),D(w)=∑ξ∈ΞpξDξ(w(ξ)).D_\xi(w(\xi))=\inf_{(x,y)\in X(\xi)}\left(c^\top x+g(\xi)^\top y+w(\xi)^\top x\right),\qquad D(w)=\sum_{\xi\in\Xi}p_\xi D_\xi(w(\xi)).Dξ​(w(ξ))=(x,y)∈X(ξ)inf​(c⊤x+g(ξ)⊤y+w(ξ)⊤x),D(w)=ξ∈Ξ∑​pξ​Dξ​(w(ξ)).

Proposition 1 states that prices with ∑ξpξw(ξ)=0\sum_\xi p_\xi w(\xi)=0∑ξ​pξ​w(ξ)=0 satisfy D(w)≤z∗D(w)\le z^*D(w)≤z∗. The price invariant in §3.1 states that the update maintains this weighted zero sum. The mission's goal combines these source claims at every completed iteration N≥1N\ge1N≥1 of Algorithm 1:

∑ξ∈ΞpξwN(ξ)=0,D(wN)≤z∗.\sum_{\xi\in\Xi}p_\xi w^N(\xi)=0,\qquad D(w^N)\le z^*.ξ∈Ξ∑​pξ​wN(ξ)=0,D(wN)≤z∗.

The formal goal is the lower-bound inequality; the zero-sum statement and Proposition 1 are its two milestones. Gade et al., Proposition 1, p. 6, and §3.1, p. 7.

Bundle extension

For a partition BBB of the scenarios, a bundle β\betaβ has probability Pβ=∑ξ∈βpξP_\beta=\sum_{\xi\in\beta}p_\xiPβ​=∑ξ∈β​pξ​. A bundle subproblem uses one first-stage vector for its scenarios and second-stage weights pξ/Pβp_\xi/P_\betapξ​/Pβ​. Proposition 3 gives the corresponding inequality DB(w)≤z∗D_B(w)\le z^*DB​(w)≤z∗ when ∑β∈BPβw(β)=0\sum_{\beta\in B}P_\beta w(\beta)=0∑β∈B​Pβ​w(β)=0. The proposal also records the bundle price invariant and the resulting inequality at each completed bundled iteration as companion statements. Gade et al., §3.3, pp. 9–10.

What the results provide

The scenario bound turns each price vector into an independent set of optimization problems whose weighted values certify a lower bound on the original mixed-integer optimum. The bound does not require the scenario first-stage decisions to agree at that iteration. The bundle result gives the same kind of certificate when several scenarios are solved together. These are the paper's known results, not new open mathematical conjectures. Gade et al., §§3.1 and 3.3.

Formalizing them requires a reusable interface for finite-support stochastic mixed-integer models, their scenario feasible sets, implementability equations, price systems, and finite prefixes of both algorithms. It also separates the general price-feasibility inequality from the algorithmic invariant. The mission currently proposes statements with open Lean proofs; it does not claim a machine-checked proof of these paper results.

Main mathematical difficulty

An iteration of progressive hedging solves scenario problems with a quadratic proximal term, while the lower-bound calculation uses scenario problems without that term. Their objective values cannot simply be identified. The relevant connection is the price vector: to apply Proposition 1 at an arbitrary iteration, its weighted zero-sum condition must follow from the actual aggregation and price-update rules. The bundle version adds normalization by PβP_\betaPβ​, so every bundle must have positive mass and the bundle weights must cover the full scenario distribution. Gade et al., §§3.1 and 3.3.

Formalization scope

Lean represents vectors as Fin n → ℝ, linear constraints componentwise, and the extensive formulation with the weighted implementability equation printed in (15). The dimensions satisfy p1≤n1p_1\le n_1p1​≤n1​ and p2≤n2p_2\le n_2p2​≤n2​, as required by the paper's spaces Z+pi×Rni−pi\mathbb Z_+^{p_i}\times\mathbb R^{n_i-p_i}Z+pi​​×Rni​−pi​. The finite scenario weights are positive and sum to one. The first integer coordinates are nonnegative; every remaining real coordinate is free. The paper's assumptions that the SMIP has an attained finite optimum and each X(ξ)X(\xi)X(ξ) is nonempty are explicit in the goal and Propositions 1 and 3. The scenario and bundle subproblem values, and z∗z^*z∗, live in the extended reals: an unbounded-below subproblem retains −∞-\infty−∞ rather than acquiring an arbitrary real infimum. Gade et al., §§2–3.

An algorithm run is a finite prefix through its last aggregation and price update, with exact minimizers recorded as conditions on its sequences; a stopping test truncates the prefix. The proximal term is the Euclidean sum of squared coordinate differences. No positivity condition on ρ\rhoρ is added to the lower-bound statements, since the page does not require one for these claims. Bundles form a partition, but equal bundle sizes are not required for the inequalities. Algorithm 2's printed w^ν(i) at initialization and Σ_i P_β x^ν(β) at aggregation are read with bundle indices. A bundle recourse vector is represented as a function on all scenarios, with only its coordinates inside the bundle constrained or used.

The exact equations of the scenario model and runs prevent a trivial encoding that assumes dual feasibility or the desired bound as part of a run. Contributions to the model, the price invariants, the extended-real weak-duality arguments, and the bundle extension are all within scope. The paper's convexified limit result (Proposition 2), its cited Theorem 1, and multi-stage Algorithm 3 are outside this mission.

Selected references

  • D. Gade, G. Hackebeil, S. M. Ryan, J.-P. Watson, R. J-B Wets, and D. L. Woodruff, Obtaining Lower Bounds from the Progressive Hedging Algorithm for Stochastic Mixed-Integer Programs, author manuscript SAND2013-9195J; published in Mathematical Programming, 2016. OSTI manuscript; DOI.
4 thms2 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

Logic-Based Benders Decomposition: With Valid Benders Cuts (B1), the Generic Benders Algorithm Stops Only at an Optimal Solution, an Infeasible Problem or an Unbounded OneResearch Paper

Motivation

Benders decomposition solves an optimization problem in two groups of variables by fixing one group, solving the remaining subproblem, and turning what the subproblem's solution proves into a constraint, the Benders cut, on the fixed variables. In the classical method of Benders (1962) the subproblem is a linear program and the cut comes from its LP dual. Many problems that decompose naturally have subproblems that are not linear programs: scheduling, satisfiability, 0-1 and constraint programs. Hooker and Ottosson (Math. Program. 96, 2003) replaced the LP dual by the inference dual, the problem of inferring the strongest bound on the objective from the constraints, and obtained a Benders scheme in which any sound inference method produces cuts. This logic-based Benders decomposition has since become a standard technique for planning and scheduling problems that combine an assignment master problem with combinatorial subproblems.

The correctness of the generic scheme rests on two short theorems of the paper. Theorem 1 says that if every cut is valid, then each of the algorithm's three ways of stopping reports the right answer. Theorem 2 says that the algorithm stops when the fixed variables range over a finite set. This mission formalizes both theorems, together with the facts used in the proof of Theorem 1.

Setting

An optimization problem (1) has a domain DDD, a feasible set SSS and a real-valued objective fff; its value is inf⁡x∈Sf(x)\inf_{x\in S} f(x)infx∈S​f(x). Optimal values lie in [−∞,+∞][-\infty,+\infty][−∞,+∞]: an infeasible minimization has value +∞+\infty+∞, an unbounded one −∞-\infty−∞, and the reverse holds for maximization. For propositions P,QP,QP,Q about xxx, PPP implies QQQ with respect to DDD, written P→DQP\xrightarrow{D}QPD​Q, if Q(x)Q(x)Q(x) holds at every x∈Dx\in Dx∈D where P(x)P(x)P(x) holds. The inference dual (2) of (1) is

max⁡ βs.t.x∈S→Df(x)≥β.\max\ \beta\quad\text{s.t.}\quad x\in S\xrightarrow{D} f(x)\ge\beta .max βs.t.x∈SD​f(x)≥β.

In Benders decomposition the variables are pairs (x,y)(x,y)(x,y) with x∈Dxx\in D_xx∈Dx​, y∈Dyy\in D_yy∈Dy​, and problem (6) is min⁡f(x,y)\min f(x,y)minf(x,y) over (x,y)∈S(x,y)\in S(x,y)∈S. Fixing yyy at a trial value yˉ\bar yyˉ​ gives the subproblem (7), min⁡f(x,yˉ)\min f(x,\bar y)minf(x,yˉ​) over (x,yˉ)∈S(x,\bar y)\in S(x,yˉ​)∈S, with inference dual (8): max⁡β\max\betamaxβ s.t. (x,yˉ)∈S→Dxf(x,yˉ)≥β(x,\bar y)\in S\xrightarrow{D_x} f(x,\bar y)\ge\beta(x,yˉ​)∈SDx​​f(x,yˉ​)≥β. A bounding function βyˉ:Dy→[−∞,+∞]\beta_{\bar y}:D_y\to[-\infty,+\infty]βyˉ​​:Dy​→[−∞,+∞] defines the cut z≥βyˉ(y)z\ge\beta_{\bar y}(y)z≥βyˉ​​(y). The cut satisfies

(B1) if every feasible (x,y)(x,y)(x,y) of (6) satisfies f(x,y)≥βyˉ(y)f(x,y)\ge\beta_{\bar y}(y)f(x,y)≥βyˉ​​(y), and

(B2) if βyˉ(yˉ)=β\beta_{\bar y}(\bar y)=\betaβyˉ​​(yˉ​)=β, the value obtained in the subproblem dual.

The cuts generated so far form the master problem (9): min⁡z\min zminz s.t. z≥βyk(y)z\ge\beta_{y^k}(y)z≥βyk​(y) for every cut kkk, y∈Dyy\in D_yy∈Dy​.

The generic Benders algorithm (Figure 1 of the paper) starts with zˉ=−∞\bar z=-\inftyzˉ=−∞ and some yˉ∈Dy\bar y\in D_yyˉ​∈Dy​. While the subproblem dual at yˉ\bar yyˉ​ has a feasible β>zˉ\beta>\bar zβ>zˉ, it formulates βyˉ\beta_{\bar y}βyˉ​​ with βyˉ(yˉ)=β\beta_{\bar y}(\bar y)=\betaβyˉ​​(yˉ​)=β and adds its cut. If the master is then infeasible, it stops and reports (6) infeasible. Otherwise it takes an optimal solution (zˉ,yˉ)(\bar z,\bar y)(zˉ,yˉ​) of the master and repeats. When the loop exits, the optimal value of (6) is reported as zˉ\bar zzˉ.

In Lean, LogicBenders.Generic.Setting defines all of these objects: optVal, subVal, IsDualFeasible, ValidCut, masterLHS, IsMasterOptimal and MasterInfeasible, and a Run with the predicates IsRun, StopsAtWhile and StopsAtMaster.

Formalization targets

Goal: Theorem 1 (p. 9)

Assume (B1) for every cut the run has added. Then three statements hold.

  1. If the run stops at the While test with a finite master value zˉ\bar zzˉ, then (6) has an optimal solution (xˉ,yˉ)(\bar x,\bar y)(xˉ,yˉ​) with f(xˉ,yˉ)=zˉf(\bar x,\bar y)=\bar zf(xˉ,yˉ​)=zˉ.
  2. If it stops with an infeasible master, then S=∅S=\varnothingS=∅.
  3. If it stops because the subproblem dual has no real feasible β\betaβ, then (6) is unbounded.
(B1) ⟹ [finite stop⇒∃ xˉ: f(xˉ,yˉ)=zˉ=min⁡Sf]∧[master infeasible⇒S=∅]∧[dual infeasible⇒inf⁡Sf=−∞].\text{(B1)}\ \Longrightarrow\ \bigl[\text{finite stop}\Rightarrow \exists\,\bar x:\ f(\bar x,\bar y)=\bar z=\min_{S} f\bigr]\wedge\bigl[\text{master infeasible}\Rightarrow S=\varnothing\bigr]\wedge\bigl[\text{dual infeasible}\Rightarrow \inf_S f=-\infty\bigr].(B1) ⟹ [finite stop⇒∃xˉ: f(xˉ,yˉ​)=zˉ=Smin​f]∧[master infeasible⇒S=∅]∧[dual infeasible⇒Sinf​f=−∞].

Milestones (statements used in the proof)

  • §3, p. 6: strong inference duality, inf⁡x∈Sf(x)=sup⁡{β:x∈S→Df(x)≥β}\inf_{x\in S}f(x)=\sup\{\beta: x\in S\xrightarrow{D}f(x)\ge\beta\}infx∈S​f(x)=sup{β:x∈SD​f(x)≥β}.
  • The subproblem value at any yˉ\bar yyˉ​ bounds the value of (6) from above.
  • Under (B1), the value zˉ\bar zzˉ of a master optimum bounds the value of (6) from below.
  • At a terminating master optimum, β∗=zˉ\beta^*=\bar zβ∗=zˉ.
  • Under (B1), an infeasible master implies that (6) is infeasible.
  • An infeasible subproblem dual makes the subproblem, and hence (6), unbounded.

Companion: Theorem 2 (p. 10)

If (B1) and (B2) hold, DyD_yDy​ is finite, and the subproblem dual is solved to optimality, then no run of the algorithm continues forever.

Further items

Lemma 3 (p. 20) gives a criterion for a 0-1 inequality ax≥αax\ge\alphaax≥α to imply the branching clause (29). The §4 statement (p. 7) characterizes when a feasible linear system implies cx≥βcx\ge\betacx≥β.

Significance

Theorem 1 is what allows any sound inference method to supply Benders cuts. Correctness needs only (B1), so the method that derives the cuts (resolution, constraint propagation, a branch-and-bound proof, LP duality) never has to be re-verified at the level of the decomposition. The paper's specializations to satisfiability, 0-1 programming and machine scheduling, and much of the later literature on logic-based Benders, rely on this theorem when they check validity of their cuts and nothing more. Theorem 2 is the matching termination guarantee, and the example on p. 10 shows that the finiteness of DyD_yDy​ cannot be dropped.

Both theorems are proved in the paper, and to the extent known no machine-checked version exists. A formalization makes the paper's implicit conventions precise: values in [−∞,+∞][-\infty,+\infty][−∞,+∞], what "the subproblem dual is infeasible" means when −∞-\infty−∞ is always a feasible bound, and exactly which cuts the master contains at each iteration. It also exposes two gaps in the printed proofs. Theorem 1's first clause uses the attainment of the subproblem optimum without stating it. Theorem 2's printed proof claims the subproblem value increases at every iteration, which is false, although the theorem itself is true. The definitions form a small reusable layer for later formalizations of specific logic-based Benders schemes.

Difficulty

The mathematics is elementary, and the difficulty lies in stating it faithfully. Several readings of the statements are wrong. A "run" whose (zˉ,yˉ)(\bar z,\bar y)(zˉ,yˉ​) are not master optima for exactly the cuts generated so far makes Theorem 1 false. Optimal values taken as real infima turn the infeasible case into junk. Defining "dual infeasible" over the extended reals makes clause 3 vacuous. For Theorem 2, the obvious argument is the printed one, that β\betaβ (or zˉ\bar zzˉ) increases strictly. It fails: with three values of yyy and cuts equal to −100-100−100 away from their own yˉ\bar yyˉ​, the subproblem value can decrease between iterations while zˉ\bar zzˉ stays fixed. The printed argument therefore cannot be transcribed, and the theorem needs a proof the page does not give.

Formalization scope

  • Domains and values. Domains are Lean types: X stands for DxD_xDx​, Y for DyD_yDy​ and D for DDD. The feasible set is S : Set (X × Y) and the objective is f : X → Y → ℝ. Optimal values are EReal infima and suprema, with +∞+\infty+∞ for infeasible and −∞-\infty−∞ for unbounded problems.
  • Dual feasibility and the master problem. Dual feasibility ranges over EReal, so β=−∞\beta=-\inftyβ=−∞ is always feasible. "The subproblem dual is infeasible" is therefore stated as "no real β\betaβ is feasible". A master optimum (z,yˉ)(z,\bar y)(z,yˉ​) means z=max⁡j≤kβ(j)(yˉ)<+∞z=\max_{j\le k}\beta^{(j)}(\bar y)<+\inftyz=maxj≤k​β(j)(yˉ​)<+∞ and zzz is at most that maximum at every yyy; the value z=−∞z=-\inftyz=−∞ means the master is unbounded.
  • Iterations. Iterations are 0-based: iteration kkk works at ybar k, has bound zbar k, and adds cut k. The structure IsRun encodes Figure 1 exactly: zbar 0 = ⊥, every iteration finds a dual-feasible beta k > zbar k with cut k (ybar k) = beta k, and the next (zˉ,yˉ)(\bar z,\bar y)(zˉ,yˉ​) is a master optimum for exactly the cuts 0, …, k. An unconstrained "run", or a dual infeasibility that −∞-\infty−∞ satisfies vacuously, would trivialize the goal, and both are ruled out by these definitions.
  • Added hypotheses. Theorem 1's first clause assumes that the subproblem optimum at the terminal yˉ\bar yyˉ​ is attained whenever it is finite. The printed proof uses this fact ("some optimal solution xˉ\bar xxˉ"), and the clause is false without it. Lemma 3 adds J0∩J1=∅J_0\cap J_1=\varnothingJ0​∩J1​=∅, which branching guarantees. No other hypotheses are added.
  • Contributions welcome. Proofs of all items, especially a correct proof of Theorem 2.

Selected references

  • J. N. Hooker and G. Ottosson, Logic-based Benders decomposition, Mathematical Programming 96(1):33–60, 2003. https://doi.org/10.1007/s10107-003-0375-9 (statements cited from the authors' revised manuscript of November 2000).
  • J. F. Benders, Partitioning procedures for solving mixed-variables programming problems, Numerische Mathematik 4:238–252, 1962. https://doi.org/10.1007/BF01386316
8 thms2 active usersReviewed
Optimization·Captain: mikedeng1

Retail Assortment Planning in the Presence of Consumer Search III: Under Independent-Assortment Search, the Profit Change from Adding a Variant Is Quasi-Convex in Its PreferenceResearch Paper

Motivation

A retailer deciding which variants of a product to stock trades off two effects. A deeper assortment captures consumers whose favourite variant would otherwise be missing, but it splits demand among more variants, each of which then carries its operational costs (shelf space, handling, inventory) at a smaller, less efficient scale. Van Ryzin and Mahajan (Management Science 1999) showed that under multinomial-logit (MNL) demand the optimal assortment consists of the most popular variants, which reduces the search over 2n2^n2n assortments to nnn candidates.

Cachon, Terwiesch and Xu (working paper, 2002; published in MSOM 2005) add consumer search: a consumer who finds nothing good enough in the store may leave to look elsewhere, and a deeper assortment makes that less likely. In their independent-assortment model the search threshold does not depend on the store's assortment, but the fraction of consumers who stay does. This mission formalizes their Theorem 5: even with this extra dependence, the profit change from adding a variant is quasi-convex in that variant's preference.

Setting

There are nnn variants. Variant iii has a preference vi>0v_i>0vi​>0 and the no-purchase option has preference v0>0v_0>0v0​>0 (in the paper vi=exp⁡((ui−pi)/μ)v_i=\exp((u_i-p_i)/\mu)vi​=exp((ui​−pi​)/μ), with ui−piu_i-p_iui​−pi​ the net utility and μ>0\mu>0μ>0 the Gumbel scale). For an assortment S⊆{1,…,n}S\subseteq\{1,\dots,n\}S⊆{1,…,n} the MNL purchase probability without search is

qim(S)=vi∑k∈Svk+v0,i∈S.q_i^m(S)=\frac{v_i}{\sum_{k\in S}v_k+v_0},\qquad i\in S .qim​(S)=∑k∈S​vk​+v0​vi​​,i∈S.

A consumer searches when her best alternative in the store, including no purchase, falls below a threshold Uˉ\bar UUˉ. With Euler's constant γ\gammaγ and λ=exp⁡[−(Uˉ/μ+γ)]>0\lambda=\exp[-(\bar U/\mu+\gamma)]>0λ=exp[−(Uˉ/μ+γ)]>0, this happens with probability H(Uˉ,S)=exp⁡(−λ(v0+∑k∈Svk))H(\bar U,S)=\exp\bigl(-\lambda(v_0+\sum_{k\in S}v_k)\bigr)H(Uˉ,S)=exp(−λ(v0​+∑k∈S​vk​)), and by the paper's Theorem 1 the independent-assortment demand is

qisi(S)=qim(S)(1−H(Uˉ,S)).q_i^{si}(S)=q_i^m(S)\bigl(1-H(\bar U,S)\bigr).qisi​(S)=qim​(S)(1−H(Uˉ,S)).

Each variant sold earns a margin mmm, and stocking a variant with demand qqq costs c(q)c(q)c(q), where the cost function ccc is concave and increasing on [0,1][0,1][0,1] (economies of scale). Variant iii's profit is πisi(S)=m qisi(S)−c(qisi(S))\pi_i^{si}(S)=m\,q_i^{si}(S)-c(q_i^{si}(S))πisi​(S)=mqisi​(S)−c(qisi​(S)). Write VS=v0+∑i∈SviV_S=v_0+\sum_{i\in S}v_iVS​=v0​+∑i∈S​vi​.

Fix SSS and a variant j∉Sj\notin Sj∈/S, and treat jjj's preference vj≥0v_j\ge 0vj​≥0 as a variable. Let πisi(vj)\pi_i^{si}(v_j)πisi​(vj​) be variant iii's profit in Sj=S∪{j}S_j=S\cup\{j\}Sj​=S∪{j}; its demand carries the factor 1−e−λ(vj+VS)1-e^{-\lambda(v_j+V_S)}1−e−λ(vj​+VS​), not 1−e−λVS1-e^{-\lambda V_S}1−e−λVS​. The cannibalization loss and the profit change are

Lsi(vj)=∑i∈Sπisi(S)−∑i∈Sπisi(vj),hsi(vj)=πjsi(vj)−Lsi(vj).L^{si}(v_j)=\sum_{i\in S}\pi_i^{si}(S)-\sum_{i\in S}\pi_i^{si}(v_j),\qquad h^{si}(v_j)=\pi_j^{si}(v_j)-L^{si}(v_j).Lsi(vj​)=i∈S∑​πisi​(S)−i∈S∑​πisi​(vj​),hsi(vj​)=πjsi​(vj​)−Lsi(vj​).

Formalization targets

Goal: Theorem 5 (common margin)

hsi is quasi-convex on [0,∞):hsi(t)≤max⁡{hsi(a),hsi(b)}(0≤a≤t≤b).h^{si}\ \text{is quasi-convex on }[0,\infty):\qquad h^{si}(t)\le\max\{h^{si}(a),h^{si}(b)\}\quad(0\le a\le t\le b).hsi is quasi-convex on [0,∞):hsi(t)≤max{hsi(a),hsi(b)}(0≤a≤t≤b).

Milestones (the steps of the paper's proof)

  1. Display (7): hsi′(vj)=J(vj)f(vj)+N(vj)g(vj)h^{si\prime}(v_j)=J(v_j)f(v_j)+N(v_j)g(v_j)hsi′(vj​)=J(vj​)f(vj​)+N(vj​)g(vj​) for vj>0v_j>0vj​>0, with the paper's functions J,f,N,gJ,f,N,gJ,f,N,g.
  2. J(vj)>0J(v_j)>0J(vj​)>0 and N(vj)<0N(v_j)<0N(vj​)<0 for vj>0v_j>0vj​>0.
  3. fff is nondecreasing and ggg is nonincreasing on (0,∞)(0,\infty)(0,∞).
  4. Display (8), corrected: hsi′(vj)=e−λ(vj+VS)(vj+VS)2[VSD(vj)f(vj)−K(vj)g(vj)]h^{si\prime}(v_j)=\dfrac{e^{-\lambda(v_j+V_S)}}{(v_j+V_S)^2}\bigl[V_S D(v_j)f(v_j)-K(v_j)g(v_j)\bigr]hsi′(vj​)=(vj​+VS​)2e−λ(vj​+VS​)​[VS​D(vj​)f(vj​)−K(vj​)g(vj​)].
  5. DDD and KKK are positive and strictly increasing on [0,∞)[0,\infty)[0,∞), and so is K/DK/DK/D.
  6. Display (12): 2−2e−t−te−t−t<02-2e^{-t}-te^{-t}-t<02−2e−t−te−t−t<0 for t=λ(vj+VS)>0t=\lambda(v_j+V_S)>0t=λ(vj​+VS​)>0.

Significance

Quasi-convexity of hsih^{si}hsi says that a variant is worth adding, if at all, at an extreme of its popularity. The paper uses it to conclude that, as without search, the optimal assortment under independent-assortment search lies among the popular assortments, the sets of the kkk most preferred variants. This reduces assortment optimization to nnn candidates. The paper also shows that the conclusion fails in its overlapping-assortment model, so the independent-assortment case marks where this structural result survives the addition of search.

The result is proved in the paper; none of it has a machine-checked proof. The paper's proof contains gaps that a formalization must close: several sign and monotonicity facts are asserted without proof ("It can be shown", "by a similar argument as in Theorem 4"), display (8) is printed without a factor VSV_SVS​, and the step from (10) to (11) rests on an inequality asserted without the full expression. A complete formal proof of Theorem 5 therefore also fixes the argument.

Difficulty

The no-search analogue (Theorem 4) is easy: the numerator of hm′h^{m\prime}hm′ is increasing, so hm′h^{m\prime}hm′ changes sign at most once. Here the search factor 1−e−λ(vj+VS)1-e^{-\lambda(v_j+V_S)}1−e−λ(vj​+VS​) depends on vjv_jvj​, and the derivative splits as Jf+NgJf+NgJf+Ng with J>0J>0J>0, N<0N<0N<0, fff nondecreasing and ggg nonincreasing, but neither JJJ nor NNN is monotone. So the argument used for Theorem 4 no longer applies, and when f≥0f\ge 0f≥0 and g≥0g\ge 0g≥0 the derivative cannot be written as a positive factor times a monotone one. The proof needs a separate second-order argument at critical points in that case. Showing only that hsi′h^{si\prime}hsi′ has at most one zero is also not enough: it must change sign from negative to positive.

Formalization scope

  • Variants are Fin n (0-based); the no-purchase option is a separate real v0 > 0, not an element of Fin n. All preferences are positive. The MNL probability is the published RetailVariety.Structure.share, referenced, not redefined.
  • One margin m∈Rm\in\mathbb Rm∈R for every variant, including jjj. The paper's model allows per-variant margins, but its proof of Theorem 5 writes a single mmm throughout. With unequal margins the statement is false: one variant i∈Si\in Si∈S with vi=0.76202736v_i=0.76202736vi​=0.76202736, v0=0.021273423v_0=0.021273423v0​=0.021273423, c(q)=0.38165308 q0.59833805c(q)=0.38165308\,q^{0.59833805}c(q)=0.38165308q0.59833805, mj=5.4080321m_j=5.4080321mj​=5.4080321, mi=6.1078441m_i=6.1078441mi​=6.1078441, λ=2.6494844\lambda=2.6494844λ=2.6494844 gives an hsih^{si}hsi that rises to about 0.2460.2460.246 near vj≈1.0v_j\approx1.0vj​≈1.0, falls to about 0.1520.1520.152 near vj≈15.9v_j\approx15.9vj​≈15.9, and rises again.
  • c:R→Rc:\mathbb R\to\mathbb Rc:R→R is concave and monotone on [0,1][0,1][0,1] (all demands lie in [0,1)[0,1)[0,1)) and, in addition to the paper's assumptions, twice continuously differentiable on (0,1)(0,1)(0,1), because the proof uses c′c'c′ and c′′c''c′′. The milestones use only differentiability where they need it. c′c'c′ is Mathlib's deriv c. The value c(0)c(0)c(0) is unconstrained; hsi(0)=−c(0)h^{si}(0)=-c(0)hsi(0)=−c(0).
  • λ>0\lambda>0λ>0 is a free parameter; μ\muμ, γ\gammaγ and Uˉ\bar UUˉ enter only through it.
  • Adding jjj with preference xxx is Function.update v j x on insert j S, with j∉Sj\notin Sj∈/S. Quasi-convexity is Mathlib's QuasiconvexOn ℝ (Set.Ici 0).
  • The following formalizations would trivialize or change the theorem and are ruled out: demand without the factor 1−H1-H1−H (that is Theorem 4); evaluating HHH at SSS instead of SjS_jSj​ inside πisi(vj)\pi_i^{si}(v_j)πisi​(vj​); convexity in place of quasi-convexity; a specific cost function such as νqβ\nu q^\betaνqβ or a linear cost.
  • The definitions (search-adjusted MNL demand, profit-change function) are reusable for the paper's other results. Proofs of the asserted lemmas (milestones 2, 3, 5) and of the corrected (8) are welcome independently of the goal.

Selected references

  • G. P. Cachon, C. Terwiesch, Y. Xu, Retail Assortment Planning in the Presence of Consumer Search, Wharton working paper, December 20, 2002. UPenn repository. Published version: Manufacturing & Service Operations Management 7(4), 2005, 330–346. doi:10.1287/msom.1050.0088
  • G. van Ryzin, S. Mahajan, On the Relationship Between Inventory Costs and Variety Benefits in Retail Assortments, Management Science 45(11), 1999, 1496–1509. doi:10.1287/mnsc.45.11.1496
  • D. McFadden, Conditional Logit Analysis of Qualitative Choice Behavior, in P. Zarembka (ed.), Frontiers in Econometrics, Academic Press, 1974, 105–142.
10 thms2 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

Retail Assortment Planning in the Presence of Consumer Search II: Under MNL Without Search, the Profit Change from Adding a Variant Is Quasi-Convex in Its PreferenceResearch Paper

Motivation

A retailer that sells a product in many variants (colours, sizes, flavours) has to decide which variants to stock. This is the assortment planning problem. Each variant added to the shelf brings new demand. It also cannibalizes demand from the variants already stocked, and it lowers their cost efficiency, because operational costs (shelf space, handling, holding) usually show economies of scale. Cachon, Terwiesch and Xu, in Retail Assortment Planning in the Presence of Consumer Search (Wharton working paper, December 2002), study this trade-off under the multinomial logit (MNL) model of consumer choice. They compare a model without consumer search with two models in which consumers may leave to search elsewhere.

There are 2n−12^n - 12n−1 nonempty assortments of nnn variants, so full enumeration is impractical. The retailer wants to know whether attention can be restricted to the popular assortments {1},{1,2},…,{1,…,n}\{1\}, \{1,2\}, \dots, \{1,\dots,n\}{1},{1,2},…,{1,…,n}, the assortments made of the most preferred variants.

Timeline. Van Ryzin and Mahajan (Management Science 45(11), 1999, doi:10.1287/mnsc.45.11.1496) showed that, without search and with a cost derived from the newsvendor model, the profit change from adding a variant is quasi-convex in that variant's preference. As a consequence, the optimal assortment is a popular one. Cachon, Terwiesch and Xu (working paper 2002; Manufacturing & Service Operations Management 7(4), 2005, doi:10.1287/msom.1050.0088) extended the quasi-convexity to any concave increasing cost (Theorem 4 of the working paper), and then to search with independent assortments (Theorem 5). This mission formalizes Theorem 4.

Setting

Let N={1,…,n}N = \{1, \dots, n\}N={1,…,n} be the possible variants. Variant iii has a preference vi>0v_i > 0vi​>0; in the paper vi=exp⁡((ui−pi)/μ)v_i = \exp((u_i - p_i)/\mu)vi​=exp((ui​−pi​)/μ), where ui−piu_i - p_iui​−pi​ is the variant's expected net utility and μ>0\mu > 0μ>0 is the Gumbel scale. The no-purchase option has preference v0>0v_0 > 0v0​>0. With assortment S⊆NS \subseteq NS⊆N, the MNL demand of variant i∈Si \in Si∈S is

qim(S)=vi∑k∈Svk+v0.(2)q_i^m(S) = \frac{v_i}{\sum_{k \in S} v_k + v_0}. \qquad (2)qim​(S)=∑k∈S​vk​+v0​vi​​.(2)

Variant iii has margin mi=pi−cim_i = p_i - c_imi​=pi​−ci​ (price minus purchase cost). Stocking it incurs an operational cost c(qi(S))c(q_i(S))c(qi​(S)), where the cost function ccc is concave and increasing on [0,1][0,1][0,1] (the consumer population is normalised to 111, so demands lie in [0,1][0,1][0,1]). The profit of variant iii is πi(S)=miqi(S)−c(qi(S))\pi_i(S) = m_i q_i(S) - c(q_i(S))πi​(S)=mi​qi​(S)−c(qi​(S)), and the retailer's profit is π(S)=∑i∈Sπi(S)\pi(S) = \sum_{i \in S} \pi_i(S)π(S)=∑i∈S​πi​(S).

Fix SSS and a variant j∉Sj \notin Sj∈/S, and let Sj=S∪{j}S_j = S \cup \{j\}Sj​=S∪{j}. Treat jjj's preference vjv_jvj​ as a variable. Write qi(vj)q_i(v_j)qi​(vj​) for variant iii's demand with assortment SjS_jSj​, and πi(vj)=miqi(vj)−c(qi(vj))\pi_i(v_j) = m_i q_i(v_j) - c(q_i(v_j))πi​(vj​)=mi​qi​(vj​)−c(qi​(vj​)) for its profit. The loss on the variants already stocked is

L(vj)=∑i∈Sπi(S)−∑i∈Sπi(vj),L(v_j) = \sum_{i \in S} \pi_i(S) - \sum_{i \in S} \pi_i(v_j),L(vj​)=i∈S∑​πi​(S)−i∈S∑​πi​(vj​),

and the net profit change from adding jjj is hm(vj)=πjm(vj)−Lm(vj)h^m(v_j) = \pi_j^m(v_j) - L^m(v_j)hm(vj​)=πjm​(vj​)−Lm(vj​). Adding jjj is profitable exactly when hm(vj)>0h^m(v_j) > 0hm(vj​)>0. Write VS=v0+∑i∈SviV_S = v_0 + \sum_{i \in S} v_iVS​=v0​+∑i∈S​vi​.

Formalization targets

Goal: Theorem 4 (p. 13)

hm(vj)=πjm(vj)−Lm(vj)  is quasi-convex in vj on [0,∞),h^m(v_j) = \pi_j^m(v_j) - L^m(v_j) \ \text{ is quasi-convex in } v_j \text{ on } [0, \infty),hm(vj​)=πjm​(vj​)−Lm(vj​)  is quasi-convex in vj​ on [0,∞),

that is, every sublevel set {vj≥0:hm(vj)≤r}\{v_j \ge 0 : h^m(v_j) \le r\}{vj​≥0:hm(vj​)≤r} is an interval. The goal holds for every concave increasing ccc and every choice of margins, and assumes no differentiability.

Milestones (proof of Theorem 4, p. 14)

  1. (6). For vj>0v_j > 0vj​>0 and ccc differentiable on (0,1)(0,1)(0,1),
hm′(vj)=[mjVS−c′(vjvj+VS)VS]−[∑i∈Smivi−∑i∈Sc′(vivj+VS)vi](vj+VS)2.h^{m\prime}(v_j) = \frac{\big[m_j V_S - c'\big(\tfrac{v_j}{v_j+V_S}\big)V_S\big] - \big[\sum_{i\in S} m_i v_i - \sum_{i\in S} c'\big(\tfrac{v_i}{v_j+V_S}\big)v_i\big]}{(v_j+V_S)^2}.hm′(vj​)=(vj​+VS​)2[mj​VS​−c′(vj​+VS​vj​​)VS​]−[∑i∈S​mi​vi​−∑i∈S​c′(vj​+VS​vi​​)vi​]​.
  1. The numerator of (6) is nondecreasing in vjv_jvj​ on (0,∞)(0,\infty)(0,∞).
  2. Single crossing. hm′h^{m\prime}hm′ is either ≤0\le 0≤0 on all of (0,∞)(0,\infty)(0,∞), or ≤0\le 0≤0 before some threshold a≥0a \ge 0a≥0 and ≥0\ge 0≥0 after it.

Significance

The result. A quasi-convex function on an interval attains its maximum at an endpoint. So if adding a less preferred variant kkk to SSS is profitable, adding a more preferred variant jjj (with vj>vkv_j > v_kvj​>vk​) is at least as profitable. With monotone margins, this exchange argument shows that an optimal assortment with xxx variants consists of the xxx most popular variants. The search for the optimal assortment then reduces from 2n−12^n - 12n−1 candidates to nnn. The paper uses this structure again for the search model with independent assortments (Theorem 5) and in its analysis of a heuristic equilibrium (Theorem 8).

Formalizing it. The theorem is proved in the paper, and is not known to have been formalized anywhere. The mission produces a machine-checked proof for an arbitrary concave increasing cost, with per-variant margins. The paper's proof differentiates ccc and writes a single common margin. A formal proof settles that neither assumption is needed. Van Ryzin and Mahajan's newsvendor-specific Lemma 1 is posed separately on Prove2Me (RetailVariety.Structure.lemma_1). It concerns a different function, a ratio g/fg/fg/f on [0,v1][0, v_1][0,v1​], and is not a special case of the statement here.

Difficulty

Adding jjj changes every demand at once: jjj's own demand rises while all of SSS's demands fall, each through the shared denominator vj+VSv_j + V_Svj​+VS​. The obvious approach is to show that hmh^mhm is convex, and it fails: hmh^mhm is in general not convex in vjv_jvj​, for example, when c(q)=aq+bc(q) = aq + bc(q)=aq+b is linear and every margin equals some m>am > am>a, hmh^mhm is a positive multiple of the concave demand vj/(vj+VS)v_j/(v_j+V_S)vj​/(vj​+VS​) plus a constant. The paper's own argument goes through the derivative (6). It needs a derivative of ccc, and its last step ("at most one vjv_jvj​ with hm′(vj)=0h^{m\prime}(v_j) = 0hm′(vj​)=0") is literally false when the numerator of (6) vanishes on an interval, for instance when ccc is linear with slope equal to a common margin, so that hmh^mhm is constant. A rigorous proof must handle a non-differentiable concave ccc, the endpoint vj=0v_j = 0vj​=0 where jjj's demand is 000, and a numerator that may be constant on stretches.

Formalization scope

  • Variants are Fin n, 0-based (the paper's variant iii is index i−1i-1i−1). The no-purchase option is not a variant: v0v_0v0​ is a separate real, with v0>0v_0 > 0v0​>0 and vi>0v_i > 0vi​>0 for all iii.
  • The demand qim(S)q_i^m(S)qim​(S) is the published definition RetailVariety.Structure.share (from RetailVariety.Structure.Model), with assortments as Finset (Fin n). qi(vj)q_i(v_j)qi​(vj​) is share applied to the preference vector with jjj's entry replaced by the variable, on insert j S, and j∉Sj \notin Sj∈/S is assumed.
  • The cost c:R→Rc : \mathbb R \to \mathbb Rc:R→R is assumed concave and monotone on [0,1][0,1][0,1] only (ConcaveOn ℝ (Set.Icc 0 1) c, MonotoneOn c (Set.Icc 0 1)). Nothing is assumed about c(0)c(0)c(0), so hm(0)=−c(0)h^m(0) = -c(0)hm(0)=−c(0).
  • Margins m : Fin n → ℝ are arbitrary reals. The monotone-margin assumption of §3 is not needed and not imposed.
  • Quasi-convexity is Mathlib's QuasiconvexOn ℝ (Set.Ici 0). The domain is the closed half-line, including vj=0v_j = 0vj​=0.
  • The milestones (6), monotone numerator and single crossing add differentiability of ccc on (0,1)(0,1)(0,1), because they are stated with c′=c' =c′= deriv c. The goal does not.

The following formalizations would trivialize the problem and are ruled out: a specific cost (newsvendor, power, linear); convexity instead of quasi-convexity; hmh^mhm only on (0,∞)(0,\infty)(0,∞); or a common margin imposed without need.

Contributions welcome: proofs of the milestones, a proof of the goal that avoids derivatives, and general lemmas on quasi-convex functions of one variable and on the algebra of MNL shares, which the companion missions of this series (I and III–V) can reuse.

Selected references

  • G. P. Cachon, C. Terwiesch, Y. Xu, Retail Assortment Planning in the Presence of Consumer Search, working paper, The Wharton School, December 20, 2002. Published in Manufacturing & Service Operations Management 7(4):330–346, 2005. doi:10.1287/msom.1050.0088
  • G. van Ryzin, S. Mahajan, On the Relationship Between Inventory Costs and Variety Benefits in Retail Assortments, Management Science 45(11):1496–1509, 1999. doi:10.1287/mnsc.45.11.1496
  • S. P. Anderson, A. de Palma, J.-F. Thisse, Discrete Choice Theory of Product Differentiation, MIT Press, 1992 (Chapter 2: the MNL formula (2)). doi:10.7551/mitpress/2450.001.0001
6 thms2 active usersReviewed
🏆Completed
Convex OptimizationOptimizationStatistics·Captain: mikedeng1

Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimization 3: The Big-M Relaxation Is at Least as Strong as PR(∞) for M ≤ ½√(λ0/λ2) and at Most as Strong for M ≥ √(λ0/λ2)Research Paper

Motivation

Best subset selection with a ridge term, the ℓ0ℓ2\ell_0\ell_2ℓ0​ℓ2​-regularized least squares problem

min⁡β∈Rp 12∥y−Xβ∥22+λ0∥β∥0+λ2∥β∥22,\min_{\beta\in\mathbb R^p}\ \tfrac12\|y - X\beta\|_2^2 + \lambda_0\|\beta\|_0 + \lambda_2\|\beta\|_2^2,β∈Rpmin​ 21​∥y−Xβ∥22​+λ0​∥β∥0​+λ2​∥β∥22​,

is a standard model for sparse linear regression. It can be solved to certified optimality by branch-and-bound (BnB) over a mixed integer formulation, and the speed of BnB depends on how tight the lower bounds of its node relaxations are. Two mixed integer formulations are in common use: the Big-M formulation, which links each coefficient to a binary indicator through a box ∣βi∣≤Mzi|\beta_i| \le M z_i∣βi​∣≤Mzi​ (Bertsimas, King and Mazumder, 2016), and the perspective formulation, which replaces βi2\beta_i^2βi2​ by an auxiliary variable constrained by a rotated second-order cone (Frangioni and Gentile, 2006; Günlük and Linderoth, 2010). Which formulation gives the stronger continuous relaxation decides which one a solver should be built on.

Hazimeh, Mazumder and Saab (2021) compare the relaxations in Section 2. Their Proposition 2 compares the interval relaxation of the Big-M formulation with that of the perspective formulation without a box, PR(∞)\mathrm{PR}(\infty)PR(∞), studied by Dong, Chen and Linderoth (2015). This mission formalizes that comparison.

Setting

Fix a design matrix X∈Rn×pX \in \mathbb R^{n\times p}X∈Rn×p, a response y∈Rny \in \mathbb R^ny∈Rn, parameters λ0,λ2>0\lambda_0, \lambda_2 > 0λ0​,λ2​>0 and a bound M>0M > 0M>0. Write [p]={1,…,p}[p] = \{1,\dots,p\}[p]={1,…,p} and ∥β∥∞≤M\|\beta\|_\infty \le M∥β∥∞​≤M for ∣βi∣≤M|\beta_i| \le M∣βi​∣≤M for every i∈[p]i \in [p]i∈[p].

The Big-M formulation (2) is

min⁡β,z 12∥y−Xβ∥22+λ0∑i∈[p]zi+λ2∥β∥22s.t.−Mzi≤βi≤Mzi, zi∈{0,1}.\min_{\beta, z}\ \tfrac12\|y - X\beta\|_2^2 + \lambda_0\sum_{i\in[p]} z_i + \lambda_2\|\beta\|_2^2 \quad\text{s.t.}\quad -Mz_i \le \beta_i \le Mz_i,\ z_i\in\{0,1\}.β,zmin​ 21​∥y−Xβ∥22​+λ0​i∈[p]∑​zi​+λ2​∥β∥22​s.t.−Mzi​≤βi​≤Mzi​, zi​∈{0,1}.

Its interval relaxation replaces zi∈{0,1}z_i \in \{0,1\}zi​∈{0,1} by zi∈[0,1]z_i \in [0,1]zi​∈[0,1]; its optimal value is VB(M)V_{B(M)}VB(M)​. Eliminating zzz gives the equivalent form (37),

VB(M)=min⁡∥β∥∞≤MH(β),H(β)=12∥y−Xβ∥22+∑i∈[p](λ0M∣βi∣+λ2βi2).V_{B(M)} = \min_{\|\beta\|_\infty\le M} H(\beta),\qquad H(\beta) = \tfrac12\|y - X\beta\|_2^2 + \sum_{i\in[p]}\Big(\frac{\lambda_0}{M}|\beta_i| + \lambda_2\beta_i^2\Big).VB(M)​=∥β∥∞​≤Mmin​H(β),H(β)=21​∥y−Xβ∥22​+i∈[p]∑​(Mλ0​​∣βi​∣+λ2​βi2​).

The reverse Huber penalty is B(t)=∣t∣\mathcal B(t) = |t|B(t)=∣t∣ for ∣t∣≤1|t| \le 1∣t∣≤1 and B(t)=(t2+1)/2\mathcal B(t) = (t^2+1)/2B(t)=(t2+1)/2 for ∣t∣≥1|t| \ge 1∣t∣≥1, and ψ1(b;λ0,λ2)=2λ0B(bλ2/λ0)\psi_1(b;\lambda_0,\lambda_2) = 2\lambda_0\mathcal B(b\sqrt{\lambda_2/\lambda_0})ψ1​(b;λ0​,λ2​)=2λ0​B(bλ2​/λ0​​). The interval relaxation of PR(∞)\mathrm{PR}(\infty)PR(∞) has the value (6),

VPR(∞)=min⁡β∈RpG(β),G(β)=12∥y−Xβ∥22+∑i∈[p]ψ1(βi;λ0,λ2).V_{PR(\infty)} = \min_{\beta\in\mathbb R^p} G(\beta),\qquad G(\beta) = \tfrac12\|y - X\beta\|_2^2 + \sum_{i\in[p]}\psi_1(\beta_i;\lambda_0,\lambda_2).VPR(∞)​=β∈Rpmin​G(β),G(β)=21​∥y−Xβ∥22​+i∈[p]∑​ψ1​(βi​;λ0​,λ2​).

Let S(λ2)\mathcal S(\lambda_2)S(λ2​) be the set of minimizers of GGG, and, as in (9),

L(M)={λ2>0  :  ∃β∈S(λ2) with ∥β∥∞≤M}.\mathcal L(M) = \{\lambda_2 > 0 \;:\; \exists\beta\in\mathcal S(\lambda_2) \text{ with } \|\beta\|_\infty \le M\}.L(M)={λ2​>0:∃β∈S(λ2​) with ∥β∥∞​≤M}.

The comparison runs through the scalar function t(b)=2λ0B(bλ2/λ0)−λ0M∣b∣−λ2b2=ψ1(b)−(λ0M∣b∣+λ2b2)t(b) = 2\lambda_0\mathcal B(b\sqrt{\lambda_2/\lambda_0}) - \frac{\lambda_0}{M}|b| - \lambda_2 b^2 = \psi_1(b) - \big(\tfrac{\lambda_0}{M}|b| + \lambda_2 b^2\big)t(b)=2λ0​B(bλ2​/λ0​​)−Mλ0​​∣b∣−λ2​b2=ψ1​(b)−(Mλ0​​∣b∣+λ2​b2) and through v∗(M)=min⁡∥β∥∞≤MG(β)v^*(M) = \min_{\|\beta\|_\infty\le M} G(\beta)v∗(M)=min∥β∥∞​≤M​G(β).

Formalization targets

Goal: Proposition 2 (p. 7)

VB(M)≥VPR(∞)if M≤12λ0/λ2,(10)V_{B(M)} \ge V_{PR(\infty)}\quad\text{if } M \le \tfrac12\sqrt{\lambda_0/\lambda_2},\qquad (10)VB(M)​≥VPR(∞)​if M≤21​λ0​/λ2​​,(10) VB(M)≤VPR(∞)if M≥λ0/λ2 and λ2∈L(M).(11)V_{B(M)} \le V_{PR(\infty)}\quad\text{if } M \ge \sqrt{\lambda_0/\lambda_2} \text{ and } \lambda_2 \in \mathcal L(M).\qquad (11)VB(M)​≤VPR(∞)​if M≥λ0​/λ2​​ and λ2​∈L(M).(11)

Milestones, in the order of the paper's proof

  1. (37): VB(M)=min⁡∥β∥∞≤MH(β)V_{B(M)} = \min_{\|\beta\|_\infty\le M} H(\beta)VB(M)​=min∥β∥∞​≤M​H(β), attained.
  2. (10) on its own.
  3. Lemma 1: for M≥λ0/λ2M \ge \sqrt{\lambda_0/\lambda_2}M≥λ0​/λ2​​ and b∈[−M,M]b \in [-M, M]b∈[−M,M], t(b)≥0t(b) \ge 0t(b)≥0.
  4. (41): for M≥λ0/λ2M \ge \sqrt{\lambda_0/\lambda_2}M≥λ0​/λ2​​, v∗(M)≥VB(M)v^*(M) \ge V_{B(M)}v∗(M)≥VB(M)​.

The mission also contains the scalar inequality (39) as a supporting statement (not a milestone): for M≤12λ0/λ2M \le \frac12\sqrt{\lambda_0/\lambda_2}M≤21​λ0​/λ2​​ and ∣b∣≤M|b| \le M∣b∣≤M, t(b)=(2λ0λ2−λ0/M)∣b∣−λ2b2≤0t(b) = (2\sqrt{\lambda_0\lambda_2} - \lambda_0/M)|b| - \lambda_2 b^2 \le 0t(b)=(2λ0​λ2​​−λ0​/M)∣b∣−λ2​b2≤0.

Significance

Proposition 2 says that neither relaxation dominates the other. For a tight Big-M bound the Big-M relaxation yields the larger lower bound; for a loose one, provided some optimal solution of PR(∞)\mathrm{PR}(\infty)PR(∞) lies in the box, the perspective relaxation does. Equivalently, with the other data fixed, a small λ2\lambda_2λ2​ favours the Big-M relaxation and a large λ2\lambda_2λ2​ favours PR(∞)\mathrm{PR}(\infty)PR(∞) (p. 8). Together with Proposition 1 of the same paper, which shows that the box-constrained perspective relaxation PR(M)\mathrm{PR}(M)PR(M) beats both when λ0/λ2>M\sqrt{\lambda_0/\lambda_2} > Mλ0​/λ2​​>M, this motivates the paper's choice of PR(M)\mathrm{PR}(M)PR(M) as the formulation on which its BnB solver is built.

The proposition is proved in the paper (Appendix A, pp. 29–30). No machine-checked proof of it, of the reformulation (37), or of any property of the reverse Huber penalty exists on the platform. The mission produces a formal statement of both inequalities with every hypothesis explicit, and the definitions of the two relaxation values in a form that later missions on perspective relaxations can reuse.

Difficulty

The scalar inequalities (39) and Lemma 1 are elementary but split into cases at the kink of the reverse Huber penalty, ∣b∣=λ0/λ2|b| = \sqrt{\lambda_0/\lambda_2}∣b∣=λ0​/λ2​​, and at the sign of 2λ0λ2−λ0/M2\sqrt{\lambda_0\lambda_2} - \lambda_0/M2λ0​λ2​​−λ0​/M. The passage from coordinatewise inequalities to optimal values is where care is needed. VB(M)V_{B(M)}VB(M)​ is defined over pairs (β,z)(\beta, z)(β,z), and its identification with a minimum of HHH over a compact box requires eliminating zzz and showing attainment. For (11) a pointwise comparison of GGG and HHH on the box only bounds VB(M)V_{B(M)}VB(M)​ by the box-restricted value v∗(M)v^*(M)v∗(M), not by VPR(∞)V_{PR(\infty)}VPR(∞)​, which is an infimum over all of Rp\mathbb R^pRp; the hypothesis λ2∈L(M)\lambda_2 \in \mathcal L(M)λ2​∈L(M) is what closes this gap, and dropping it gives a statement the paper does not prove.

Formalization scope

All declarations live in the namespace L0BnB.BigMvsPR. Vectors are Fin p → ℝ, XXX is a Matrix (Fin n) (Fin p) ℝ, and XβX\betaXβ is X *ᵥ β. Every norm is an explicit sum: ∥v∥22=∑ivi2\|v\|_2^2 = \sum_i v_i^2∥v∥22​=∑i​vi2​, and ∥β∥∞≤M\|\beta\|_\infty \le M∥β∥∞​≤M is ∀i, ∣βi∣≤M\forall i,\ |\beta_i| \le M∀i, ∣βi​∣≤M. The reverse Huber penalty is an if on ∣t∣≤1|t| \le 1∣t∣≤1.

Optimal values are real infima (sInf): VB(M)V_{B(M)}VB(M)​ over the feasible pairs (β,z)(\beta, z)(β,z) of the interval relaxation, VPR(∞)V_{PR(\infty)}VPR(∞)​ over all of Rp\mathbb R^pRp, v∗(M)v^*(M)v∗(M) over the box. For λ0,λ2>0\lambda_0, \lambda_2 > 0λ0​,λ2​>0 each set of values is nonempty (β=z=0\beta = z = 0β=z=0) and bounded below by 000, so no infimum takes Lean's junk value. VPR(∞)V_{PR(\infty)}VPR(∞)​ is defined as the displayed minimum (6); its identification with the interval relaxation of PR(∞)\mathrm{PR}(\infty)PR(∞) is a result of Dong, Chen and Linderoth that the paper cites and does not prove, and it is not part of this mission. S(λ2)\mathcal S(\lambda_2)S(λ2​) is the set of minimizers of GGG, as the paper uses it in the proof of (11).

All theorems assume λ0,λ2,M>0\lambda_0, \lambda_2, M > 0λ0​,λ2​,M>0. The paper remarks that Proposition 2 applies for any M≥0M \ge 0M≥0; M=0M = 0M=0 is excluded because HHH and ttt divide by MMM. The goal is stated for optimal values, not for the objective functions at a single point: a pointwise comparison of HHH and GGG is a milestone, not the proposition. Milestone (37) is stated with IsLeast, so it asserts attainment as well as the value.

The paper states no O(⋅)O(\cdot)O(⋅) bounds in this result, so no constants are instantiated. Contributions welcome: proofs of the scalar lemmas, of (37) (which needs compactness of the box and continuity of HHH), and of the goal.

Selected references

  • H. Hazimeh, R. Mazumder, A. Saab, Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimization, arXiv:2004.06152v2, 2021; Mathematical Programming, 2022. https://arxiv.org/abs/2004.06152
  • H. Dong, K. Chen, J. Linderoth, Regularization vs. Relaxation: A conic optimization perspective of statistical variable selection, arXiv preprint, 2015. https://arxiv.org/abs/1510.06083
  • D. Bertsimas, A. King, R. Mazumder, Best subset selection via a modern optimization lens, The Annals of Statistics 44(2), 813–852, 2016. https://doi.org/10.1214/15-AOS1388
  • A. Frangioni, C. Gentile, Perspective cuts for a class of convex 0–1 mixed integer programs, Mathematical Programming 106(2), 225–236, 2006. https://doi.org/10.1007/s10107-005-0594-3
  • O. Günlük, J. Linderoth, Perspective reformulations of mixed integer nonlinear programs with indicator variables, Mathematical Programming 124(1–2), 183–205, 2010. https://doi.org/10.1007/s10107-010-0360-z
  • A. B. Owen, A robust hybrid of lasso and ridge regression, Contemporary Mathematics 443, 59–72, 2007 (the reverse Huber penalty).
11 thms2 active usersReviewed
Convex OptimizationFunctional AnalysisMachine Learning+1·Captain: mikedeng1

Kernel Distributionally Robust Optimization: Generalized Duality Theorem and Stochastic Approximation: The Worst-Case Risk over an RKHS Ambiguity Set Equals Its Support-Function DualResearch Paper

Motivation

Distributionally robust optimization (DRO) chooses a decision θ\thetaθ that minimizes the expected loss under the worst distribution in an ambiguity set K\mathcal KK of plausible distributions, min⁡θsup⁡P∈K∫l(θ,ξ) dP(ξ)\min_\theta\sup_{P\in\mathcal K}\int l(\theta,\xi)\,dP(\xi)minθ​supP∈K​∫l(θ,ξ)dP(ξ). It sits between stochastic optimization, which trusts a single distribution, and worst-case robust optimization, which trusts none. The inner supremum is a problem of moments, studied since Stieltjes and made computable by duality (Isii 1962; Shapiro 2001; Bertsimas and Popescu 2005). Existing tractable reformulations require the ambiguity set to be described by finitely many moments, a ϕ\phiϕ-divergence or a Wasserstein ball, and they usually require a structural property of the loss: affine or quadratic form, or a known Lipschitz constant.

Zhu, Jitkrittum, Diehl and Schölkopf (AISTATS 2021; arXiv:2006.06981) describe the ambiguity set through kernel mean embeddings: a distribution is represented by its mean in a reproducing kernel Hilbert space, and the ambiguity set is the set of distributions whose embedding lies in a convex set C\mathcal CC of that space. Moment sets, MMD balls, scenario polytopes and the whole space (worst-case RO) all arise for suitable kernels and sets C\mathcal CC. Their Generalized Duality Theorem (Theorem 3.1) turns the inner worst-case problem into a minimization over a function of the RKHS that majorizes the loss, with no assumption on the loss beyond upper semicontinuity.

Setting

Let X\mathcal XX be a compact metric space (in the paper, a compact X⊂Rd\mathcal X\subset\mathbb R^dX⊂Rd) with its Borel σ\sigmaσ-algebra, and P\mathcal PP the set of Borel probability measures on X\mathcal XX. Let H\mathcal HH be a real Hilbert space and φ:X→H\varphi:\mathcal X\to\mathcal Hφ:X→H a continuous feature map; k(x,y)=⟨φ(x),φ(y)⟩Hk(x,y)=\langle\varphi(x),\varphi(y)\rangle_{\mathcal H}k(x,y)=⟨φ(x),φ(y)⟩H​ is then a continuous positive definite kernel, and an element f∈Hf\in\mathcal Hf∈H acts on X\mathcal XX by the reproducing property f(ξ)=⟨f,φ(ξ)⟩Hf(\xi)=\langle f,\varphi(\xi)\rangle_{\mathcal H}f(ξ)=⟨f,φ(ξ)⟩H​ (rkhsEval).

  • The mean embedding of P∈PP\in\mathcal PP∈P is μP=∫φ dP∈H\mu_P=\int\varphi\,dP\in\mathcal HμP​=∫φdP∈H (meanEmbedding).
  • For C⊆H\mathcal C\subseteq\mathcal HC⊆H, the ambiguity set is KC={P∈P:μP∈C}\mathcal K_{\mathcal C}=\{P\in\mathcal P:\mu_P\in\mathcal C\}KC​={P∈P:μP​∈C} (ambiguitySet).
  • The support function of C\mathcal CC is δC∗(f)=sup⁡μ∈C⟨f,μ⟩H∈[−∞,∞]\delta^*_{\mathcal C}(f)=\sup_{\mu\in\mathcal C}\langle f,\mu\rangle_{\mathcal H}\in[-\infty,\infty]δC∗​(f)=supμ∈C​⟨f,μ⟩H​∈[−∞,∞] (supportFun).
  • A loss is a function l:Θ×X→[−∞,∞)l:\Theta\times\mathcal X\to[-\infty,\infty)l:Θ×X→[−∞,∞), where Θ\ThetaΘ is an arbitrary set of decisions; ∫l dP\int l\,dP∫ldP is the extended-real expectation.

For fixed θ\thetaθ (written l=l(θ,⋅)l=l(\theta,\cdot)l=l(θ,⋅)), the primal inner problem (11) and the dual inner problem (12) are

(P)θ=sup⁡P∈KC∫l dP,(D)θ=inf⁡{f0+δC∗(f): f0∈R, f∈H, l(ξ)≤f0+f(ξ) ∀ξ∈X}\mathrm{(P)}_\theta=\sup_{P\in\mathcal K_{\mathcal C}}\int l\,dP,\qquad \mathrm{(D)}_\theta=\inf\Big\{f_0+\delta^*_{\mathcal C}(f):\ f_0\in\mathbb R,\ f\in\mathcal H,\ l(\xi)\le f_0+f(\xi)\ \forall\xi\in\mathcal X\Big\}(P)θ​=P∈KC​sup​∫ldP,(D)θ​=inf{f0​+δC∗​(f): f0​∈R, f∈H, l(ξ)≤f0​+f(ξ) ∀ξ∈X}

(primalValue, dualValue, with the constraint IsDualFeasible). Assumption 3.1 of the paper asks that each l(θ,⋅)l(\theta,\cdot)l(θ,⋅) be proper (not identically −∞-\infty−∞) and upper semicontinuous, that C\mathcal CC be closed and convex, and that ri(KC)≠∅\mathrm{ri}(\mathcal K_{\mathcal C})\neq\emptysetri(KC​)=∅.

The PDF prints no page numbers; every page cited in this mission is the PDF page of arXiv:2006.06981v3.

Formalization targets

Goal: Theorem 3.1 (Generalized Duality), p. 5

Under the hypotheses above, with KC≠∅\mathcal K_{\mathcal C}\ne\emptysetKC​=∅,

∀θ∈Θ:sup⁡P∈KC∫l(θ,ξ) dP(ξ)=inf⁡f0∈R,f∈Hl(θ,⋅)≤f0+ff0+δC∗(f),\forall\theta\in\Theta:\quad \sup_{P\in\mathcal K_{\mathcal C}}\int l(\theta,\xi)\,dP(\xi)=\inf_{\substack{f_0\in\mathbb R,\,f\in\mathcal H\\ l(\theta,\cdot)\le f_0+f}}f_0+\delta^*_{\mathcal C}(f),∀θ∈Θ:P∈KC​sup​∫l(θ,ξ)dP(ξ)=f0​∈R,f∈Hl(θ,⋅)≤f0​+f​inf​f0​+δC∗​(f),

and consequently (P)=inf⁡θ(P)θ=inf⁡θ(D)θ=(D)\mathrm{(P)}=\inf_\theta\mathrm{(P)}_\theta=\inf_\theta\mathrm{(D)}_\theta=\mathrm{(D)}(P)=infθ​(P)θ​=infθ​(D)θ​=(D), the equality of the Kernel DRO problem (2) and its dual (4).

Milestones (the proof of Proposition A.1, pp. 13–15, and Appendix D, pp. 22–23)

  1. The reproducing identity ∫f dP=⟨f,μP⟩H\int f\,dP=\langle f,\mu_P\rangle_{\mathcal H}∫fdP=⟨f,μP​⟩H​ (p. 13).
  2. Lemma D.1: ∫(l−f0−f) dP≤0\int(l-f_0-f)\,dP\le0∫(l−f0​−f)dP≤0 for all PPP iff l≤f0+fl\le f_0+fl≤f0​+f on X\mathcal XX.
  3. Weak duality: ∫l dP≤f0+δC∗(f)\int l\,dP\le f_0+\delta^*_{\mathcal C}(f)∫ldP≤f0​+δC∗​(f) for P∈KCP\in\mathcal K_{\mathcal C}P∈KC​ and feasible (f0,f)(f_0,f)(f0​,f) (p. 6).
  4. Lemmas D.2–D.4: T(P)={μP}\mathcal T(\mathcal P)=\{\mu_P\}T(P)={μP​}, C∩T(P)\mathcal C\cap\mathcal T(\mathcal P)C∩T(P) and KC\mathcal K_{\mathcal C}KC​ are compact.
  5. Primal attainment (p. 15), via the upper semicontinuity of P↦∫l dPP\mapsto\int l\,dPP↦∫ldP (a supporting lemma the paper uses without stating).
  6. The separation (14), the sign τ<0\tau<0τ<0 with the rescaled dual feasible point, and (D)≤(P)+ϵ\mathrm{(D)}\le\mathrm{(P)}+\epsilon(D)≤(P)+ϵ (p. 15).
  7. Proposition A.1: (P)θ=(D)θ\mathrm{(P)}_\theta=\mathrm{(D)}_\theta(P)θ​=(D)θ​ (p. 13).

Companions

Lemma A.2 (complementarity (19)), Corollary 3.1.3 (the optimal majorant interpolates lll P∗P^*P∗-a.e.), the support function 1N∑if(ξi)+ϵ∥f∥H\frac1N\sum_i f(\xi_i)+\epsilon\|f\|_{\mathcal H}N1​∑i​f(ξi​)+ϵ∥f∥H​ of the RKHS norm ball (Table 1), and the weak-duality content of Corollary 3.1.1 for integral probability metrics.

Significance

The theorem replaces an optimization over probability measures by a semi-infinite program over (f0,f)∈R×H(f_0,f)\in\mathbb R\times\mathcal H(f0​,f)∈R×H, whose objective is explicit for the common choices of C\mathcal CC (Table 1). The majorant f0+ff_0+ff0​+f needs no Lipschitz constant and no parametric form of the loss, and the dual variable f∗f^*f∗ doubles as a witness function for the MMD. This is the basis of the paper's batch and stochastic functional gradient algorithms, and it places moment-based DRO, scenario optimization, MMD-ball DRO and worst-case RO in one framework.

The result is proved on paper; it has no machine-checked proof that we know of. Formalizing it builds the duality theory of moment problems with infinitely many moment constraints, on top of Mathlib's Hilbert spaces, Bochner integrals and the weak topology on probability measures. The formal statements also fix points the paper leaves loose: the infimum in place of the printed "min", the reading of the Slater condition, and the role of the continuity of the kernel.

Difficulty

Weak duality is a two-line computation. The work is strong duality. The paper's route separates the cone A={(∫1 dP,∫φ dP,∫l dP):P∈co(P)}A=\{(\int1\,dP,\int\varphi\,dP,\int l\,dP):P\in\mathrm{co}(\mathcal P)\}A={(∫1dP,∫φdP,∫ldP):P∈co(P)} from Bϵ={(1,μ,t+ϵ):μ∈C}B_\epsilon=\{(1,\mu,t+\epsilon):\mu\in\mathcal C\}Bϵ​={(1,μ,t+ϵ):μ∈C} in R×H×R\mathbb R\times\mathcal H\times\mathbb RR×H×R. A Hahn–Banach strict separation needs one set compact or the two at positive distance, and AAA is neither obviously closed nor bounded. The step goes through only because KC\mathcal K_{\mathcal C}KC​ is compact in the weak topology and P↦∫l dPP\mapsto\int l\,dPP↦∫ldP is upper semicontinuous, which also gives primal attainment and the sign τ<0\tau<0τ<0. The loss may take the value −∞-\infty−∞, so every expectation lives in [−∞,∞)[-\infty,\infty)[−∞,∞). The infinite primal case also needs an argument of its own.

Formalization scope

  • X\mathcal XX is a compact metric space with a Borel σ\sigmaσ-algebra; a compact subset of Rd\mathbb R^dRd is an instance. P\mathcal PP is ProbabilityMeasure X with its topology of weak convergence; the paper's MMD topology agrees with it for a universal continuous kernel.
  • The RKHS is in feature-map form: a real Hilbert space H\mathcal HH and a continuous φ\varphiφ. Continuity of the kernel is not written in Assumption 3.1 but is used by Appendix D.
  • Losses are X → EReal, upper semicontinuous, never +∞+\infty+∞, and not identically −∞-\infty−∞. Expectations use the published definition WassersteinDRO.Duality.erealExpectation, which for such losses is the usual ∫l dP∈[−∞,∞)\int l\,dP\in[-\infty,\infty)∫ldP∈[−∞,∞).
  • Support function, primal and dual values are extended reals. δ∅∗=−∞\delta^*_\emptyset=-\inftyδ∅∗​=−∞; δH∗(f)=+∞\delta^*_{\mathcal H}(f)=+\inftyδH∗​(f)=+∞ for f≠0f\ne0f=0; an empty ambiguity set gives primal value −∞-\infty−∞; an infeasible dual gives +∞+\infty+∞. The sum f0+δC∗(f)f_0+\delta^*_{\mathcal C}(f)f0​+δC∗​(f) adds a real to an extended real, so +∞+(−∞)+\infty+(-\infty)+∞+(−∞) never occurs.
  • The Slater clause ri(KC)≠∅\mathrm{ri}(\mathcal K_{\mathcal C})\ne\emptysetri(KC​)=∅ names no topology on measures and is used only to obtain a primal solution (p. 15). It is read as KC≠∅\mathcal K_{\mathcal C}\ne\emptysetKC​=∅, which it implies under any reading, so the formal goal is at least as strong as the paper's.
  • Every printed "min" is read as an infimum. Dual attainment is not proved and can fail: for X=[0,1]\mathcal X=[0,1]X=[0,1], φ(x)=x\varphi(x)=xφ(x)=x, C=(−∞,0]\mathcal C=(-\infty,0]C=(−∞,0] and l(x)=xl(x)=\sqrt xl(x)=x​, the dual infimum 000 is not attained.
  • The dual variable ranges over H\mathcal HH, never over arbitrary functions on X\mathcal XX. Over all bounded functions, the choice f=lf=lf=l would make the duality trivial (Example 3.3). The goal is also not closed by unfolding: for C=H\mathcal C=\mathcal HC=H it says sup⁡P∫l dP=sup⁡ξl(ξ)\sup_P\int l\,dP=\sup_\xi l(\xi)supP​∫ldP=supξ​l(ξ), worst-case RO.
  • Corollary 3.1.2 (p. 6) is not stated: it is false under Assumption 3.1 alone (for C=H\mathcal C=\mathcal HC=H and l=1{0}l=\mathbf 1_{\{0\}}l=1{0}​, (2) equals 111 while (6) equals 000).

Reusable pieces: the kernel mean embedding and its continuity on ProbabilityMeasure X, compactness of RKHS ambiguity sets, and the upper semicontinuity of P↦∫l dPP\mapsto\int l\,dPP↦∫ldP for upper semicontinuous lll (a portmanteau-type fact not yet in Mathlib). Proofs of any milestone are welcome. So are support-function computations for the other rows of Tables 1 and 3.

Selected references

  • J.-J. Zhu, W. Jitkrittum, M. Diehl, B. Schölkopf, Kernel Distributionally Robust Optimization: Generalized Duality Theorem and Stochastic Approximation, AISTATS 2021 (PMLR 130); cited here as arXiv:2006.06981v3, 2021. https://arxiv.org/abs/2006.06981
  • A. Shapiro, On duality theory of conic linear problems, in Semi-Infinite Programming, Kluwer, 2001. https://doi.org/10.1007/978-1-4757-3403-4_7
  • K. Isii, On sharpness of Tchebycheff-type inequalities, Annals of the Institute of Statistical Mathematics 14, 1962. https://doi.org/10.1007/BF02868641
  • D. Bertsimas, I. Popescu, Optimal inequalities in probability theory: a convex optimization approach, SIAM Journal on Optimization 15(3), 2005. https://doi.org/10.1137/S1052623401399903
  • A. Gretton, K. Borgwardt, M. Rasch, B. Schölkopf, A. Smola, A kernel two-sample test, Journal of Machine Learning Research 13, 2012. https://jmlr.org/papers/v13/gretton12a.html
  • A. Ben-Tal, L. El Ghaoui, A. Nemirovski, Robust Optimization, Princeton University Press, 2009. https://doi.org/10.1515/9781400831050
15 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOptimization·Captain: mikedeng1

Quality in Supply Chain Encroachment IV: Without Quality Commitment in the Direct Channel, Quality Differentiation Across Channels Is Always OptimalResearch Paper

Motivation

A manufacturer that sells through an independent retailer may also open its own direct channel, an online store or a factory outlet. This is called supply chain encroachment. The operations literature has asked whether encroachment helps or hurts the two firms. The usual approach compares the double-marginalization cost of a pure retail channel with the competition the direct channel creates. With quality exogenous and uniform across channels, Arya, Mittendorf and Sappington (2007) showed that encroachment can lead to a win–win outcome when the manufacturer's direct selling cost is large, because it pushes the wholesale price down.

Ha, Long and Nasiry (Quality in Supply Chain Encroachment, MSOM 18(2), 2016; authors' manuscript SSRN 3970373) make product quality a decision of the manufacturer. Their main model lets her commit to the qualities of both channels before the retailer orders. In that model quality differentiation is not always optimal: for some parameters she sells the same quality in both channels (their Proposition 4).

Commitment is a modelling assumption. When design lead times are short, the manufacturer can redesign the direct-channel product after seeing the retailer's order, so she cannot credibly announce its quality in advance. Section 6.3 of the paper studies this fast-design case. Its only analytical result is Proposition 7: without commitment, quality differentiation across channels is always optimal. This mission formalizes that proposition and the three steps of its proof.

Setting

Consumers. A consumer has quality sensitivity θ\thetaθ, uniform on [0,1][0,1][0,1], and obtains surplus θu−p\theta u - pθu−p from one unit of quality u>0u>0u>0 at price ppp. The manufacturer sells qMq_MqM​ units of quality uMu_MuM​ directly and the retailer sells qRq_RqR​ units of quality uRu_RuR​. Each consumer buys at most one unit, and the market-clearing prices depend on which product has the higher quality:

  • if uR≤uMu_R\le u_MuR​≤uM​:   pM=uM(1−qM)−uRqR,pR=uR(1−qM−qR)\;p_M = u_M(1-q_M)-u_Rq_R,\quad p_R = u_R(1-q_M-q_R)pM​=uM​(1−qM​)−uR​qR​,pR​=uR​(1−qM​−qR​);
  • if uM<uRu_M<u_RuM​<uR​:   pM=uM(1−qM−qR),pR=uR(1−qR)−uMqM\;p_M = u_M(1-q_M-q_R),\quad p_R = u_R(1-q_R)-u_Mq_MpM​=uM​(1−qM​−qR​),pR​=uR​(1−qR​)−uM​qM​.

At uM=uR=uu_M=u_R=uuM​=uR​=u both channels clear at u(1−qM−qR)u(1-q_M-q_R)u(1−qM​−qR​).

Costs. One unit of quality vvv costs the manufacturer kv2kv^2kv2, with k>0k>0k>0. She pays a selling cost c≥0c\ge0c≥0 for each unit sold directly; the retailer's selling cost is 000.

Profits. For a wholesale price www,

ΠR=(pR−w) qR,ΠM=(w−kuR2) qR+(pM−c−kuM2) qM.\Pi_R = (p_R-w)\,q_R,\qquad \Pi_M = (w-ku_R^2)\,q_R + (p_M-c-ku_M^2)\,q_M .ΠR​=(pR​−w)qR​,ΠM​=(w−kuR2​)qR​+(pM​−c−kuM2​)qM​.

Timing without commitment.

  1. The manufacturer announces the retailer's quality uRu_RuR​ and the wholesale price www.
  2. The retailer chooses its order qRq_RqR​.
  3. The manufacturer chooses the direct-channel quality uMu_MuM​ and quantity qMq_MqM​.

The game has perfect information and is solved by backward induction. A strategy profile σ\sigmaσ has three parts: a stage-1 choice (w,uR)(w,u_R)(w,uR​), a retailer rule (w,uR)↦qR(w,u_R)\mapsto q_R(w,uR​)↦qR​, and a stage-3 rule (w,uR,qR)↦(uM,qM)(w,u_R,q_R)\mapsto(u_M,q_M)(w,uR​,qR​)↦(uM​,qM​). The profile is a subgame perfect equilibrium (SPE) when, at every history on or off the path, the mover's action is feasible and no feasible alternative gives the mover more. The manufacturer encroaches when qM>0q_M>0qM​>0 on the equilibrium path.

Formalization targets

Goal: Proposition 7 (p. 21)

For every k>0k>0k>0, c≥0c\ge0c≥0 and every SPE σ\sigmaσ whose equilibrium path has qM>0q_M>0qM​>0 and qR>0q_R>0qR​>0,

uM≠uRon the equilibrium path.u_M \neq u_R \quad\text{on the equilibrium path.}uM​=uR​on the equilibrium path.

Milestones (proof of Proposition 7, p. 37)

Write uM=τuRu_M=\tau u_RuM​=τuR​ with τ>0\tau>0τ>0.

  1. Stage-3 value functions. For τ≥1\tau\ge1τ≥1 the optimal direct quantity is qM(τ,qR,uR)=((−c−qRuR−kτ2uR2+τuR)/(2τuR))+q_M(\tau,q_R,u_R)=\big((-c-q_Ru_R-k\tau^2u_R^2+\tau u_R)/(2\tau u_R)\big)^+qM​(τ,qR​,uR​)=((−c−qR​uR​−kτ2uR2​+τuR​)/(2τuR​))+. When it is positive the optimal profit is
ΠMHF=(c+uR(qR+τ(kτuR−1)))24τuR+qR(w−kuR2).\Pi^{HF}_M=\frac{(c+u_R(q_R+\tau(k\tau u_R-1)))^2}{4\tau u_R}+q_R(w-ku_R^2).ΠMHF​=4τuR​(c+uR​(qR​+τ(kτuR​−1)))2​+qR​(w−kuR2​).

The case τ≤1\tau\le1τ≤1 gives ΠMLF\Pi^{LF}_MΠMLF​ in the same way, and the two agree at τ=1\tau=1τ=1. 2. Derivatives (31)–(32). The τ\tauτ-derivatives of ΠMHF\Pi^{HF}_MΠMHF​ and ΠMLF\Pi^{LF}_MΠMLF​, their values at τ=1\tau=1τ=1, and the equivalence

qM(1,qR,uR)>0  ⟺  c+uR(qR+kuR−1)<0.q_M(1,q_R,u_R)>0\iff c+u_R(q_R+ku_R-1)<0.qM​(1,qR​,uR​)>0⟺c+uR​(qR​+kuR​−1)<0.
  1. Stage-3 contradiction. At any history with uR>0u_R>0uR​>0 and qR>0q_R>0qR​>0, no optimal stage-3 choice has both uM=uRu_M=u_RuM​=uR​ and qM>0q_M>0qM​>0.

Milestone 3 is stronger than the goal: it holds at every stage-3 history, not only on the equilibrium path.

Significance

The result. Proposition 7 shows that the structure of the optimal product line depends on the timing of design decisions. With commitment, the manufacturer sometimes keeps a single quality. A lower-quality direct product would draw a larger retail order but forgo market segmentation, and with some parameter values she accepts that trade. Without commitment, the direct-channel quality can no longer influence the retailer's order. She then always differentiates, so whenever both channels sell, consumers face a two-product line. The paper's numerical work (Figure 6) compares the two regimes. The analytical statement that differentiation is universal without commitment is this proposition.

Formalizing it. The proposition has a short, informal proof in the e-Companion. That proof argues through first-order conditions, "given that τ=1\tau=1τ=1 is optimal". It uses the strict signs printed in (31) and (32), although optimality gives only weak inequalities. Its contradiction relies on the retailer's order being positive, which the statement leaves implicit. A machine-checked proof pins down exactly which hypotheses the result needs. It also contributes reusable facts about Cournot-type stage games with vertically differentiated products. No part of this paper has been formalized before.

Difficulty

The stage-3 problem is a joint choice of quality uMu_MuM​ and quantity qMq_MqM​, and the demand system changes form at uM=uRu_M=u_RuM​=uR​, so the manufacturer's profit is not differentiable in uMu_MuM​ there. The value function after optimizing qMq_MqM​ is a piecewise expression: ΠMHF\Pi^{HF}_MΠMHF​ to the right of τ=1\tau=1τ=1, ΠMLF\Pi^{LF}_MΠMLF​ to the left, and the linear profit qR(w−kuR2)q_R(w-ku_R^2)qR​(w−kuR2​) wherever the optimal qMq_MqM​ is zero. An argument that τ=1\tau=1τ=1 is not optimal has to work with one-sided derivatives of this function at a kink. It must also check that the optimal quantity stays positive on both sides near τ=1\tau=1τ=1.

An obvious shortcut is to argue that differentiation is optimal because segmentation always pays. That argument fails at qR=0q_R=0qR​=0. There the manufacturer is a one-product monopolist, and uM=uRu_M=u_RuM​=uR​ is optimal whenever uRu_RuR​ happens to equal her monopoly quality. The positive retail order is therefore essential.

Formalization scope

All definitions live in the namespace QualityEncroach.NoCommit. They are real-valued throughout, and the formalization fixes the following conventions:

  • the wholesale price www ranges over R\mathbb RR, since the paper states no sign restriction;
  • qualities satisfy uR,uM>0u_R,u_M>0uR​,uM​>0, and quantities satisfy qR,qM≥0q_R,q_M\ge0qR​,qM​≥0;
  • the inverse demand is the formula above for all nonnegative quantities, as in the paper;
  • the paper derives the case uM<uRu_M<u_RuM​<uR​ "similarly" (p. 15), and its explicit form is the one stated above;
  • τ\tauτ is not named in the paper's text; its formulas read uM=τuRu_M=\tau u_RuM​=τuR​;
  • subgame perfection is stated in one-shot-deviation form at every history, which in this three-stage game is equivalent to subgame perfection;
  • the goal adds the hypothesis qR>0q_R>0qR​>0 on the path, reading "across channels" as both channels selling (see Difficulty).

A trivializing formalization is ruled out: the stage-3 rule maps (w,uR,qR)(w,u_R,q_R)(w,uR​,qR​) to (uM,qM)(u_M,q_M)(uM​,qM​), so uMu_MuM​ is chosen after the order. Putting uMu_MuM​ at stage 1 would give the committed game, where the proposition is false. The goal is conditional on an SPE existing, which the paper does not prove. A verification file checks the price formulas on hand instances in both branches. At k=1k=1k=1, c=0.05c=0.05c=0.05, uR=0.3u_R=0.3uR​=0.3, qR=0.1q_R=0.1qR​=0.1 and w=0.15w=0.15w=0.15, it checks that the basic parameter conditions hold and a uniform stage-3 choice is strictly beaten by uM=0.33u_M=0.33uM​=0.33. The numerical check does not establish the existence of an optimal stage-3 choice or an SPE.

A complete development needs elementary real analysis only: maximization of concave quadratics, one-variable derivatives, and one-sided optimality conditions at a kink. Proofs of any milestone, and proofs of the goal from milestone 3, are welcome.

Selected references

  • A. Y. Ha, X. Long, J. Nasiry, Quality in Supply Chain Encroachment, Manufacturing & Service Operations Management 18(2), 2016. https://doi.org/10.1287/msom.2015.0562 (authors' manuscript: https://ssrn.com/abstract=3970373)
  • A. Arya, B. Mittendorf, D. E. M. Sappington, The Bright Side of Supplier Encroachment, Marketing Science 26(5), 651–659, 2007. https://doi.org/10.1287/mksc.1070.0280
  • M. Mussa, S. Rosen, Monopoly and Product Quality, Journal of Economic Theory 18(2), 301–317, 1978. https://doi.org/10.1016/0022-0531(78)90085-6
5 thms2 active usersReviewed
🏆Completed
Convex OptimizationOptimizationStatistics·Captain: mikedeng1

Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimization 2: When √(λ0/λ2) > M the Perspective Relaxation Is at Least as Strong as the Big-M and PR(∞) RelaxationsResearch Paper

Motivation

Best subset selection with ridge shrinkage asks for a coefficient vector β∈Rp\beta\in\mathbb R^pβ∈Rp that fits a response y∈Rny\in\mathbb R^ny∈Rn through a design matrix X∈Rn×pX\in\mathbb R^{n\times p}X∈Rn×p while using few nonzero coefficients:

min⁡β∈Rp 12∥y−Xβ∥22+λ0∥β∥0+λ2∥β∥22.\min_{\beta\in\mathbb R^p}\ \tfrac12\|y-X\beta\|_2^2 + \lambda_0\|\beta\|_0 + \lambda_2\|\beta\|_2^2 .β∈Rpmin​ 21​∥y−Xβ∥22​+λ0​∥β∥0​+λ2​∥β∥22​.

This ℓ0ℓ2\ell_0\ell_2ℓ0​ℓ2​-regularized least squares problem is NP-hard, and exact methods solve it as a mixed integer program by branch-and-bound (BnB). The speed of BnB is governed by the strength of the continuous relaxation solved at every node: a larger relaxation value prunes more nodes. Hazimeh, Mazumder and Saab (arXiv:2004.06152, Mathematical Programming 2022) build the solver L0BnB on a perspective formulation and compare its relaxation with two standard alternatives. Their Proposition 1 quantifies that comparison, and their experiments (Section 4.2.1 of the paper) report speed-ups of more than 90× from using the perspective formulation with a tight bound MMM instead of the bound-free formulation.

The mission formalizes Proposition 1 together with the three steps of its proof in the paper's Appendix A.

Setting

Fix XXX, yyy, regularization parameters λ0,λ2>0\lambda_0,\lambda_2>0λ0​,λ2​>0 and a bound M>0M>0M>0 on ∥β∥∞\|\beta\|_\infty∥β∥∞​; write [p]={1,…,p}[p]=\{1,\dots,p\}[p]={1,…,p}.

The Big-M formulation B(M)B(M)B(M) introduces indicators ziz_izi​ and minimizes 12∥y−Xβ∥22+λ0∑izi+λ2∥β∥22\tfrac12\|y-X\beta\|_2^2+\lambda_0\sum_i z_i+\lambda_2\|\beta\|_2^221​∥y−Xβ∥22​+λ0​∑i​zi​+λ2​∥β∥22​ subject to −Mzi≤βi≤Mzi-Mz_i\le\beta_i\le Mz_i−Mzi​≤βi​≤Mzi​, zi∈{0,1}z_i\in\{0,1\}zi​∈{0,1}. Its interval relaxation lets zi∈[0,1]z_i\in[0,1]zi​∈[0,1]; its optimal value is VB(M)V_{B(M)}VB(M)​.

The reverse Huber penalty is B(t)=∣t∣\mathcal B(t)=|t|B(t)=∣t∣ for ∣t∣≤1|t|\le1∣t∣≤1 and (t2+1)/2(t^2+1)/2(t2+1)/2 for ∣t∣≥1|t|\ge1∣t∣≥1. Put

ψ1(b;λ0,λ2)=2λ0 B(bλ2/λ0),ψ2(b;λ0,λ2,M)=(λ0M+λ2M)∣b∣,\psi_1(b;\lambda_0,\lambda_2)=2\lambda_0\,\mathcal B\big(b\sqrt{\lambda_2/\lambda_0}\big),\qquad \psi_2(b;\lambda_0,\lambda_2,M)=\Big(\frac{\lambda_0}{M}+\lambda_2M\Big)|b|,ψ1​(b;λ0​,λ2​)=2λ0​B(bλ2​/λ0​​),ψ2​(b;λ0​,λ2​,M)=(Mλ0​​+λ2​M)∣b∣,

and let ψ=ψ1\psi=\psi_1ψ=ψ1​ if λ0/λ2≤M\sqrt{\lambda_0/\lambda_2}\le Mλ0​/λ2​​≤M and ψ=ψ2\psi=\psi_2ψ=ψ2​ if λ0/λ2>M\sqrt{\lambda_0/\lambda_2}>Mλ0​/λ2​​>M. The paper's Theorem 1 shows that the interval relaxation of the perspective formulation PR(M)\mathrm{PR}(M)PR(M) is equivalent to

min⁡∥β∥∞≤MF(β),F(β)=12∥y−Xβ∥22+∑i∈[p]ψ(βi;λ0,λ2,M),(5)\min_{\|\beta\|_\infty\le M} F(\beta),\qquad F(\beta)=\tfrac12\|y-X\beta\|_2^2+\sum_{i\in[p]}\psi(\beta_i;\lambda_0,\lambda_2,M), \tag{5}∥β∥∞​≤Mmin​F(β),F(β)=21​∥y−Xβ∥22​+i∈[p]∑​ψ(βi​;λ0​,λ2​,M),(5)

and VPR(M)V_{PR(M)}VPR(M)​ denotes the optimal value of (5). Without a bound, the relaxation value of PR(∞)\mathrm{PR}(\infty)PR(∞) is

VPR(∞)=min⁡β∈RpG(β),G(β)=12∥y−Xβ∥22+∑i∈[p]ψ1(βi;λ0,λ2).(6)V_{PR(\infty)}=\min_{\beta\in\mathbb R^p}G(\beta),\qquad G(\beta)=\tfrac12\|y-X\beta\|_2^2+\sum_{i\in[p]}\psi_1(\beta_i;\lambda_0,\lambda_2). \tag{6}VPR(∞)​=β∈Rpmin​G(β),G(β)=21​∥y−Xβ∥22​+i∈[p]∑​ψ1​(βi​;λ0​,λ2​).(6)

Finally h(λ0,λ2,M)=λ0/M+λ2M−2λ0λ2h(\lambda_0,\lambda_2,M)=\lambda_0/M+\lambda_2M-2\sqrt{\lambda_0\lambda_2}h(λ0​,λ2​,M)=λ0​/M+λ2​M−2λ0​λ2​​, and β∗\beta^*β∗ denotes an optimal solution of (5).

Formalization targets

Goal: Proposition 1

For λ0/λ2>M\sqrt{\lambda_0/\lambda_2}>Mλ0​/λ2​​>M,

VPR(M) ≥ VB(M)+λ2(M∥β∗∥1−∥β∗∥22),(7)V_{PR(M)}\ \ge\ V_{B(M)}+\lambda_2\big(M\|\beta^*\|_1-\|\beta^*\|_2^2\big), \tag{7}VPR(M)​ ≥ VB(M)​+λ2​(M∥β∗∥1​−∥β∗∥22​),(7) VPR(M) ≥ VPR(∞)+h(λ0,λ2,M) ∥β∗∥1.(8)V_{PR(M)}\ \ge\ V_{PR(\infty)}+h(\lambda_0,\lambda_2,M)\,\|\beta^*\|_1. \tag{8}VPR(M)​ ≥ VPR(∞)​+h(λ0​,λ2​,M)∥β∗∥1​.(8)

Milestones

  1. (37): VB(M)=min⁡∥β∥∞≤MH(β)V_{B(M)}=\min_{\|\beta\|_\infty\le M}H(\beta)VB(M)​=min∥β∥∞​≤M​H(β) with H(β)=12∥y−Xβ∥22+∑i(λ0M∣βi∣+λ2βi2)H(\beta)=\tfrac12\|y-X\beta\|_2^2+\sum_i\big(\tfrac{\lambda_0}{M}|\beta_i|+\lambda_2\beta_i^2\big)H(β)=21​∥y−Xβ∥22​+∑i​(Mλ0​​∣βi​∣+λ2​βi2​); the Big-M relaxation expressed in β\betaβ alone. It holds for every M>0M>0M>0.
  2. (7) alone.
  3. The linear case of ψ1\psi_1ψ1​: if ∣b∣≤M<λ0/λ2|b|\le M<\sqrt{\lambda_0/\lambda_2}∣b∣≤M<λ0​/λ2​​ then ψ1(b;λ0,λ2)=2∣b∣λ0λ2\psi_1(b;\lambda_0,\lambda_2)=2|b|\sqrt{\lambda_0\lambda_2}ψ1​(b;λ0​,λ2​)=2∣b∣λ0​λ2​​.
  4. (8) alone (the paper's (38)).

The goal is the conjunction of milestones 2 and 4.

Significance

In the regime λ0/λ2>M\sqrt{\lambda_0/\lambda_2}>Mλ0​/λ2​​>M both added terms are nonnegative: M∥β∗∥1≥∥β∗∥22M\|\beta^*\|_1\ge\|\beta^*\|_2^2M∥β∗∥1​≥∥β∗∥22​ because ∥β∗∥∞≤M\|\beta^*\|_\infty\le M∥β∗∥∞​≤M, and h>0h>0h>0 because λ0/M+λ2M>2λ0λ2\lambda_0/M+\lambda_2M>2\sqrt{\lambda_0\lambda_2}λ0​/M+λ2​M>2λ0​λ2​​ whenever M≠λ0/λ2M\ne\sqrt{\lambda_0/\lambda_2}M=λ0​/λ2​​. So the perspective relaxation is at least as strong as both the Big-M relaxation and PR(∞)\mathrm{PR}(\infty)PR(∞), strictly so as soon as one coordinate of β∗\beta^*β∗ lies strictly inside (0,M)(0,M)(0,M) in absolute value (for (7)) or β∗≠0\beta^*\ne0β∗=0 (for (8)). The bounds are explicit in the relaxation's own solution, so they can be evaluated at a BnB node. This is the theoretical justification for the paper's design choice of building its solver on PR(M)\mathrm{PR}(M)PR(M) with a valid, tight MMM; the regime λ0/λ2≤M\sqrt{\lambda_0/\lambda_2}\le Mλ0​/λ2​​≤M, where (5) is (6) with the additional box constraint ∥β∥∞≤M\|\beta\|_\infty\le M∥β∥∞​≤M, is complementary.

Proposition 1 is proved in the paper; it has no machine-checked proof. The mission produces one, together with reusable Lean definitions of the three relaxation values and of the reverse Huber penalty that other statements about perspective relaxations of sparse regression can be stated against.

Difficulty

The arithmetic of the coordinate-wise penalties is short. The substance is in comparing optimal values that are defined as infima over different feasible sets. The obvious argument "VPR(M)−VB(M)≥F(β∗)−H(β∗)V_{PR(M)}-V_{B(M)}\ge F(\beta^*)-H(\beta^*)VPR(M)​−VB(M)​≥F(β∗)−H(β∗)" requires that the Big-M relaxation, which is posed over pairs (β,z)(\beta,z)(β,z), have value at most H(β∗)H(\beta^*)H(β∗); that is the content of (37), a statement about a different feasible set in more variables. Likewise (8) needs VPR(∞)≤G(β∗)V_{PR(\infty)}\le G(\beta^*)VPR(∞)​≤G(β∗), i.e. that the infimum in (6) is a genuine lower bound of a set bounded below, and both inequalities use the regime λ0/λ2>M\sqrt{\lambda_0/\lambda_2}>Mλ0​/λ2​​>M, in which ψ=ψ2\psi=\psi_2ψ=ψ2​. Dropping the regime hypothesis makes (8) false in general: for λ0/λ2≤M\sqrt{\lambda_0/\lambda_2}\le Mλ0​/λ2​​≤M one has ψ=ψ1\psi=\psi_1ψ=ψ1​ and h≥0h\ge0h≥0, and the right side can exceed VPR(M)=VPR(∞)V_{PR(M)}=V_{PR(\infty)}VPR(M)​=VPR(∞)​.

Formalization scope

All objects live in the namespace L0BnB.Strength. Data are X : Matrix (Fin n) (Fin p) ℝ, y : Fin n → ℝ, reals lam0 lam2 M with 0 < lam0, 0 < lam2, 0 < M as hypotheses; [p][p][p] is Fin p. Norms are explicit sums: ∥v∥22\|v\|_2^2∥v∥22​ is ∑ i, v i ^ 2, ∥β∥1\|\beta\|_1∥β∥1​ is ∑ i, |β i|, and ∥β∥∞≤M\|\beta\|_\infty\le M∥β∥∞​≤M is ∀ i, |β i| ≤ M. The regime is written M < Real.sqrt (lam0 / lam2).

Optimal values are sInf of the image of the feasible set in ℝ. Each set is nonempty (β=0\beta=0β=0, z=0z=0z=0) and bounded below by 000 under the positivity hypotheses, so sInf is the true infimum and never a junk value. VB(M)V_{B(M)}VB(M)​ is defined over pairs (β,z)(\beta,z)(β,z) with zi∈[0,1]z_i\in[0,1]zi​∈[0,1], not through HHH; (37) is a theorem. VPR(∞)V_{PR(\infty)}VPR(∞)​ is (6) as printed: the paper attributes to its reference [21] the identification of (6) with the interval relaxation of PR(∞)\mathrm{PR}(\infty)PR(∞) in (β,z,s)(\beta,z,s)(β,z,s) variables, and that identification is not part of the mission. VPR(M)V_{PR(M)}VPR(M)​ is the value of (5), which is the paper's definition; Theorem 1 (the equivalence of (5) with the (β,z,s)(\beta,z,s)(β,z,s) relaxation) belongs to a sibling mission.

The optimal solution β∗\beta^*β∗ is a binder with the hypotheses ∥β∗∥∞≤M\|\beta^*\|_\infty\le M∥β∗∥∞​≤M and F(β∗)≤F(β)F(\beta^*)\le F(\beta)F(β∗)≤F(β) for every β\betaβ in the box. A formalization in which β∗\beta^*β∗ is an arbitrary feasible point, or in which VB(M)V_{B(M)}VB(M)​ or VPR(∞)V_{PR(\infty)}VPR(∞)​ is defined through a chosen minimizer, would change the statement and is ruled out. The paper uses no O(⋅)O(\cdot)O(⋅) in this result, so no constant is instantiated.

Needed infrastructure is light: continuity of HHH and compactness of the box for the attainment in (37), and csInf lemmas on ℝ. Contributions of proofs of any milestone, and of the attainment of the infimum in (5), are welcome.

Selected references

  • H. Hazimeh, R. Mazumder, A. Saab, Sparse Regression at Scale: Branch-and-Bound rooted in First-Order Optimization, arXiv:2004.06152v2, 2021; Mathematical Programming (2022). https://arxiv.org/abs/2004.06152
  • H. Hazimeh, R. Mazumder, Fast Best Subset Selection: Coordinate Descent and Local Combinatorial Optimization Algorithms, Operations Research 68(5), 1517–1537, 2020. https://doi.org/10.1287/opre.2019.1919
  • H. Dong, K. Chen, J. Linderoth, Regularization vs. Relaxation: A conic optimization perspective of statistical variable selection, arXiv e-prints, 2015 (the paper's reference [21], source of (6) for PR(∞)\mathrm{PR}(\infty)PR(∞)). https://arxiv.org/abs/1510.06083
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOptimal TransportOptimization·Captain: mikedeng1

Computational Optimal Transport VI: On Termination the Auction Algorithm Returns an Assignment Whose Cost Is Within nε of the OptimumTextbook

Motivation

The optimal assignment problem asks for a one-to-one matching of nnn points to nnn objects of least total cost. It is the discrete optimal transport problem between two uniform measures with the same number of atoms, and by the Birkhoff–von Neumann theorem it coincides with the Kantorovich linear program on that instance (Peyré and Cuturi, Computational Optimal Transport, Proposition 2.1). Assignment solvers are therefore the inner routine of exact discrete optimal transport, of matching-based estimators in statistics and of many combinatorial optimization pipelines.

The auction algorithm was introduced by Bertsekas in 1981 (Bertsekas 1981) and refined with ε-scaling by Bertsekas and Eckstein in 1988 (Bertsekas & Eckstein 1988). It is a dual coordinate method with an economic reading: unassigned points bid for objects, prices of contested objects move, and an object changes hands when outbid. Its practical appeal is that each iteration is local and cheap, and that it parallelizes well. Peyré and Cuturi present it in §3.7 of their monograph (pp. 417–422) as an alternative use of the machinery of C-transforms, and as a precursor to the Sinkhorn algorithm of Chapter 4.

Setting

Fix n≥2n\ge 2n≥2, write [ ⁣[n] ⁣]={1,…,n}[\![n]\!]=\{1,\dots,n\}[[n]]={1,…,n}, and let C∈Rn×n\mathbf C\in\mathbb R^{n\times n}C∈Rn×n be a cost matrix: Ci,j\mathbf C_{i,j}Ci,j​ is the cost of assigning point iii to object jjj. A permutation σ\sigmaσ of [ ⁣[n] ⁣][\![n]\!][[n]] is an assignment, of cost ∑iCi,σi\sum_i \mathbf C_{i,\sigma_i}∑i​Ci,σi​​.

A dual vector (price vector) g∈Rn\mathbf g\in\mathbb R^ng∈Rn is indexed by the objects. Its Cˉ\bar{\mathbf C}Cˉ-transform is (gCˉ)i=min⁡jCi,j−gj(\mathbf g^{\bar{\mathbf C}})_i=\min_j \mathbf C_{i,j}-\mathbf g_j(gCˉ)i​=minj​Ci,j​−gj​, the best adjusted cost available to point iii; a pair (f,g)(\mathbf f,\mathbf g)(f,g) is dual feasible if fi+gj≤Ci,j\mathbf f_i+\mathbf g_j\le \mathbf C_{i,j}fi​+gj​≤Ci,j​ for all i,ji,ji,j.

The algorithm maintains a triplet (S,ξ,g)(S,\xi,\mathbf g)(S,ξ,g): a set S⊆[ ⁣[n] ⁣]S\subseteq[\![n]\!]S⊆[[n]] of assigned points, a partial assignment vector ξ\xiξ (an injective map from SSS to [ ⁣[n] ⁣][\![n]\!][[n]]) and a dual vector g\mathbf gg. The state satisfies ε-complementary slackness (ε-CS) if

∀i∈S,Ci,ξi−gξi≤ε+min⁡j(Ci,j−gj).\forall i\in S,\qquad \mathbf C_{i,\xi_i}-\mathbf g_{\xi_i}\le \varepsilon+\min_j\big(\mathbf C_{i,j}-\mathbf g_j\big).∀i∈S,Ci,ξi​​−gξi​​≤ε+jmin​(Ci,j​−gj​).

One iteration picks a point i∉Si\notin Si∈/S, a lowest adjusted cost index ji1∈argmin⁡jCi,j−gjj^1_i\in\operatorname{argmin}_j \mathbf C_{i,j}-\mathbf g_jji1​∈argminj​Ci,j​−gj​ and a second lowest ji2∈argmin⁡j≠ji1Ci,j−gjj^2_i\in\operatorname{argmin}_{j\neq j^1_i}\mathbf C_{i,j}-\mathbf g_jji2​∈argminj=ji1​​Ci,j​−gj​, and performs

gji1←Ci,ji1−(Ci,ji2−gji2)−ε,(3.9)\mathbf g_{j^1_i}\leftarrow \mathbf C_{i,j^1_i}-\big(\mathbf C_{i,j^2_i}-\mathbf g_{j^2_i}\big)-\varepsilon, \tag{3.9}gji1​​←Ci,ji1​​−(Ci,ji2​​−gji2​​)−ε,(3.9)

removes from SSS the point i′i'i′ with ξi′=ji1\xi_{i'}=j^1_iξi′​=ji1​ (if there is one), sets ξi=ji1\xi_i=j^1_iξi​=ji1​ and adds iii to SSS. The algorithm starts from S=∅S=\emptysetS=∅, g=0n\mathbf g=0_ng=0n​, and terminates when S=[ ⁣[n] ⁣]S=[\![n]\!]S=[[n]].

Formalization targets

Goal: Proposition 3.9 (p. 422)

For every ε>0\varepsilon>0ε>0 and every run of the algorithm that terminates, the final ξ\xiξ is a permutation and

∑iCi,ξi  ≤  ∑iCi,σi+nεfor every permutation σ.\sum_i \mathbf C_{i,\xi_i}\;\le\;\sum_i \mathbf C_{i,\sigma_i}+n\varepsilon\qquad\text{for every permutation }\sigma.i∑​Ci,ξi​​≤i∑​Ci,σi​​+nεfor every permutation σ.

The goal fixes no particular tie-breaking rule and no order in which unassigned points bid: it holds for all of them.

Milestones

  1. (3.8), p. 419. If Ci,σi−gσi=min⁡jCi,j−gj\mathbf C_{i,\sigma_i}-\mathbf g_{\sigma_i}=\min_j \mathbf C_{i,j}-\mathbf g_jCi,σi​​−gσi​​=minj​Ci,j​−gj​ for every iii, then σ\sigmaσ is an optimal assignment and (gCˉ,g)(\mathbf g^{\bar{\mathbf C}},\mathbf g)(gCˉ,g) is an optimal dual pair.
  2. Properties (b)–(c), pp. 419–420. At each iteration the size of SSS does not decrease, some price decreases by at least ε\varepsilonε, and no price increases.
  3. Proposition 3.7, p. 420. Every state of every run satisfies ε-CS.

Companion: Proposition 3.8 (p. 421), corrected

For C≥0\mathbf C\ge 0C≥0, every run has at most n(⌊∥C∥∞/ε⌋+1)n\big(\lfloor\|\mathbf C\|_\infty/\varepsilon\rfloor+1\big)n(⌊∥C∥∞​/ε⌋+1) iterations. This is the termination statement; the goal does not depend on it.

Significance

Proposition 3.9 is the accuracy guarantee of the auction algorithm. With integer costs and ε<1/n\varepsilon<1/nε<1/n it yields an exactly optimal assignment, which is how the algorithm is used as an exact solver; combined with ε-scaling it gives the complexity bounds quoted in Remark 3.3. The argument is also the template for every ε-relaxed primal–dual method: an approximate optimality certificate maintained by local moves, turned into a global suboptimality bound by weak duality.

The results are classical and proved in the book and in Bertsekas's monographs; they are not open. What this mission adds is a machine-checked account of the algorithm with all of its nondeterminism (ties in the argmins, the order of bidders) quantified explicitly, together with the corrected iteration bound. To the best of the mission's prior-art search, no Lean formalization of the auction algorithm exists on the platform or in Mathlib, which has the assignment problem only implicitly (through permutations and doubly stochastic matrices).

Difficulty

The obvious argument for the goal sums the ε-CS inequality over iii and compares with an arbitrary permutation σ\sigmaσ. The sum telescopes only if the final ξ\xiξ is a bijection, so the proof must carry, through every iteration, the invariant that ξ\xiξ is injective on SSS, and this invariant interacts with the removal of the displaced point in step 2: the set update has to remove exactly the point holding ji1j^1_iji1​, which needs injectivity at the previous step.

Preserving ε-CS for the points that are not bidding relies on prices only ever decreasing, which in turn needs ε≥0\varepsilon\ge 0ε≥0 and the specific form of (3.9); preserving it for the bidder needs the second-best index ji2j^2_iji2​ to realize the minimum over j≠ji1j\neq j^1_ij=ji1​, including in the presence of ties. The printed termination bound is false (see below), so the companion requires reconstructing the counting argument: an object that is still unassigned has never been bid on and keeps price 000, which caps the number of bids on any other object.

Formalization scope

  • [ ⁣[n] ⁣][\![n]\!][[n]] is Fin n; C\mathbf CC is a Matrix (Fin n) (Fin n) ℝ; prices are Fin n → ℝ; min⁡j\min_jminj​ is the infimum over the finite nonempty index set.
  • A state is a structure with fields S : Finset (Fin n), ξ : Fin n → Fin n and g : Fin n → ℝ. Only the values of ξ on S are meaningful; injectivity on S is a property to be proved, not a field.
  • An iteration is a relation between consecutive states (AuctionStep), with the choice of bidder, of ji1j^1_iji1​ and of ji2j^2_iji2​ existential. A run of TTT iterations is a sequence of states starting from S=∅S=\emptysetS=∅, g=0\mathbf g=0g=0; it is terminated when S=[ ⁣[n] ⁣]S=[\![n]\!]S=[[n]] at step TTT. The results hold for every run, whatever the tie-breaking.
  • Costs are the unnormalized sums ∑iCi,σi\sum_i \mathbf C_{i,\sigma_i}∑i​Ci,σi​​, as in the book's proof of Proposition 3.9. Under the 1n\frac1nn1​ normalization of (2.2) the gap nεn\varepsilonnε becomes ε\varepsilonε.
  • Added hypotheses: n≥2n\ge2n≥2 in the goal (the second-best index requires it); ε>0\varepsilon>0ε>0 throughout; C≥0\mathbf C\ge0C≥0 in the corrected Proposition 3.8, which its proof uses.
  • Printed slips. Proposition 3.8 as printed (N=n∥C∥∞/εN=n\|\mathbf C\|_\infty/\varepsilonN=n∥C∥∞​/ε) fails for C=0\mathbf C=0C=0; the companion states the bound the proof gives. Property (b) "can only increase" is stated as non-decrease; property (c) refers to an object index jjj.
  • Trivialization ruled out. The run predicate forces the initial state, the exact update (3.9) and the set update of step 2 at every iteration, and the goal requires S=[ ⁣[n] ⁣]S=[\![n]\!]S=[[n]] at the end; a terminated run exists already for n=2n=2n=2, so the goal is not vacuous.

Contributions welcome: the injectivity invariant of ξ on S as a reusable lemma; the milestones in any order; a proof of termination (the companion) and of the existence of a terminated run for every n≥2n\ge2n≥2.

Selected references

  • G. Peyré and M. Cuturi, Computational Optimal Transport, Foundations and Trends in Machine Learning 11(5–6):355–607, 2019, §3.7. https://doi.org/10.1561/2200000073
  • D. P. Bertsekas, A new algorithm for the assignment problem, Mathematical Programming 21:152–171, 1981. https://doi.org/10.1007/BF01584237
  • D. P. Bertsekas and J. Eckstein, Dual coordinate step methods for linear network flow problems, Mathematical Programming 42:203–243, 1988. https://doi.org/10.1007/BF01589417
  • D. P. Bertsekas, Auction algorithms for network flow problems: A tutorial introduction, Computational Optimization and Applications 1:7–66, 1992. https://doi.org/10.1007/BF00247653
5 thms2 active usersReviewed
ProbabilityStochastic Systems·Captain: mikedeng1

Optimality Gap of Constant-Order Policies Decays Exponentially in the Lead Time for Lost Sales Models: C(π_r∞)/OPT(L) ≤ 1 + h((1−γ)g)⁻¹(E[D] − r∞ + (eϑ(L+1))⁻¹)γ^{L+1} for Every Lead Time L ≥ 1Research Paper

Why lost-sales inventory with lead times matters

In many retail and spare-parts settings, demand that cannot be met from stock is lost rather than backlogged, and replenishment orders arrive only after a positive lead time. The resulting lost-sales inventory model is a basic model of inventory theory. Its optimal policy depends on the whole pipeline of outstanding orders, so dynamic programming over that state becomes intractable as the lead time grows. This is why the model is often replaced by its backlogged counterpart, even when that approximation is poor (Bijvank and Vis, 2011).

Simple heuristics are therefore of practical interest. The simplest is the constant-order policy, which orders the same amount in every period regardless of the state. Reiman (2004, unpublished manuscript) showed that the best constant-order policy sometimes outperforms the base-stock policy, and Goldberg, Katz-Rogozhnikov, Lu, Sharma and Squillante (arXiv:1211.4063, Math. Oper. Res. 2016) proved that it is asymptotically optimal as the lead time grows, with a gap that decays polynomially in the lead time. Xin and Goldberg (arXiv:1409.1499v2, Oper. Res. 2016) proved that for the infinite-horizon average-cost problem the gap actually decays exponentially, with an explicit rate and explicit constants. This mission formalizes that result.

Timeline:

  • 1958: Karlin and Scarf introduce the lost-sales model with a positive lead time; convexity results follow in Karlin and Scarf (1958) and Morton (1969).
  • 1962: Kingman bounds how fast the expected waiting time of an initially empty GI/G/1 queue approaches its steady-state value (doi).
  • 2004: Reiman finds that the best constant-order policy can outperform the base-stock policy.
  • 2009: Huh, Janakiraman, Muckstadt and Rusmevichientong (Management Science 55(3)) prove base-stock policies asymptotically optimal as the lost-sales penalty grows.
  • 2011: Huh, Janakiraman and Nagarajan (Operations Research 59(1)) give the existence of stationary optimal policies used by the paper.
  • 2015–2016: Goldberg et al. prove asymptotic optimality of constant-order policies as the lead time grows; Xin and Goldberg prove exponential decay of the gap.

The setting

Demands D1,D2,…D_1,D_2,\dotsD1​,D2​,… are i.i.d. copies of a nonnegative random variable DDD with law D\mathcal DD, finite mean E[D]\mathbb E[D]E[D] and strictly positive variance. The lead time L≥1L\ge1L≥1 is an integer, h>0h>0h>0 is the unit holding cost and p>0p>0p>0 the unit lost-sales penalty. At the start of period ttt there is on-hand inventory ItI_tIt​ and a pipeline xt=(x1,t,…,xL,t)\mathbf x_t=(x_{1,t},\dots,x_{L,t})xt​=(x1,t​,…,xL,t​) of orders placed but not yet delivered. In each period, x1,tx_{1,t}x1,t​ arrives, a new order is placed (it enters the end of the pipeline), demand DtD_tDt​ is realized, and the period cost

Ct=h (It+x1,t−Dt)++p (It+x1,t−Dt)−C_t=h\,(I_t+x_{1,t}-D_t)^++p\,(I_t+x_{1,t}-D_t)^-Ct​=h(It​+x1,t​−Dt​)++p(It​+x1,t​−Dt​)−

is incurred; then It+1=(It+x1,t−Dt)+I_{t+1}=(I_t+x_{1,t}-D_t)^+It+1​=(It​+x1,t​−Dt​)+. The system starts empty. A policy π\piπ chooses orders from the information available, and its long-run average cost is C(π)=lim sup⁡T→∞1T∑t=1TE[Ctπ]C(\pi)=\limsup_{T\to\infty}\frac1T\sum_{t=1}^T\mathbb E[C^\pi_t]C(π)=limsupT→∞​T1​∑t=1T​E[Ctπ​]. The optimal cost is OPT(L)=inf⁡πC(π)\mathrm{OPT}(L)=\inf_\pi C(\pi)OPT(L)=infπ​C(π).

The constant-order policy πr\pi_rπr​ orders rrr in every period. Its cost is governed by the random walk jr−∑i=1jDijr-\sum_{i=1}^jD_ijr−∑i=1j​Di​ through

I∞r=sup⁡j≥0(jr−∑i=1jDi),ILr=max⁡j=0,…,L(jr−∑i=1jDi),I^r_\infty=\sup_{j\ge0}\Big(jr-\sum_{i=1}^jD_i\Big),\qquad I^r_L=\max_{j=0,\dots,L}\Big(jr-\sum_{i=1}^jD_i\Big),I∞r​=j≥0sup​(jr−i=1∑j​Di​),ILr​=j=0,…,Lmax​(jr−i=1∑j​Di​),

the steady-state and LLL-th waiting times of a single-server queue with interarrival law D\mathcal DD and constant service time rrr. The best constant order r∞r_\inftyr∞​ is the least minimizer of C(πr)C(\pi_r)C(πr​) over 0≤r≤E[D]0\le r\le\mathbb E[D]0≤r≤E[D]. The rate and constants are

γ=inf⁡θ≥0eθr∞E[e−θD],g=inf⁡x∈RE[h(x−D)++p(x−D)−],\gamma=\inf_{\theta\ge0}e^{\theta r_\infty}\mathbb E[e^{-\theta D}],\qquad g=\inf_{x\in\mathbb R}\mathbb E\big[h(x-D)^++p(x-D)^-\big],γ=θ≥0inf​eθr∞​E[e−θD],g=x∈Rinf​E[h(x−D)++p(x−D)−],

with ϑ\varthetaϑ the largest minimizer in the definition of γ\gammaγ (ϑ=∞\vartheta=\inftyϑ=∞ if the infimum is not attained, and 1/∞=01/\infty=01/∞=0).

Formalization targets

Goal: Theorem 1 (p. 8)

C(πr∞)OPT(L)≤1+h((1−γ)g)−1(E[D]−r∞+(eϑ(L+1))−1)γL+1for all L≥1.\frac{C(\pi_{r_\infty})}{\mathrm{OPT}(L)}\le1+h\big((1-\gamma)g\big)^{-1}\Big(\mathbb E[D]-r_\infty+\big(e\vartheta(L+1)\big)^{-1}\Big)\gamma^{L+1}\qquad\text{for all }L\ge1 .OPT(L)C(πr∞​​)​≤1+h((1−γ)g)−1(E[D]−r∞​+(eϑ(L+1))−1)γL+1for all L≥1.

The quantities r∞,γ,ϑ,gr_\infty,\gamma,\vartheta,gr∞​,γ,ϑ,g depend on D,h,p\mathcal D,h,pD,h,p but not on LLL.

Milestones, in the order the proof uses them

  • Eq. (3): C(πr)=h E[I∞r]+p E[D]−prC(\pi_r)=h\,\mathbb E[I^r_\infty]+p\,\mathbb E[D]-prC(πr​)=hE[I∞r​]+pE[D]−pr for r∈[0,E[D])r\in[0,\mathbb E[D])r∈[0,E[D]).
  • Sec. 2.2: the best constant exists and r∞<E[D]r_\infty<\mathbb E[D]r∞​<E[D]; Sec. 2.3: ϑ>0\vartheta>0ϑ>0, γ∈[0,1)\gamma\in[0,1)γ∈[0,1), g>0g>0g>0 and OPT(L)≥g\mathrm{OPT}(L)\ge gOPT(L)≥g.
  • Observation 1 (convexity of fd\mathfrak f_{\mathbf d}fd​ and a Jensen bound) and Lemma 2: OPT(L)≥CL(rL)\mathrm{OPT}(L)\ge C_L(r_L)OPT(L)≥CL​(rL​) and the decomposition (5) of C(πr∞)−OPT(L)C(\pi_{r_\infty})-\mathrm{OPT}(L)C(πr∞​​)−OPT(L).
  • Lemma 3 (Kingman's series and the tail bound), Lemma 4 (r∞≤rLr_\infty\le r_Lr∞​≤rL​), Lemma 5 (∑nP(nr∞≥∑i≤nDi)≥p/h\sum_n\mathbb P(nr_\infty\ge\sum_{i\le n}D_i)\ge p/h∑n​P(nr∞​≥∑i≤n​Di​)≥p/h), the Chernoff step P(nr∞≥∑i≤nDi)≤γn\mathbb P(nr_\infty\ge\sum_{i\le n}D_i)\le\gamma^nP(nr∞​≥∑i≤n​Di​)≤γn, and the bound on the term (6).
  • Further: Lemma 1 (monotonicity of γ\gammaγ in p/hp/hp/h) and Corollary 1 (the closed form for exponential demand).

Significance

The theorem shows that a lead time of order log⁡(ϵ−1)\log(\epsilon^{-1})log(ϵ−1) suffices for the constant-order policy to be within a factor 1+ϵ1+\epsilon1+ϵ of optimal, whereas the earlier bounds of Goldberg et al. needed a lead time polynomial in ϵ−1\epsilon^{-1}ϵ−1. The constants are explicit and computable from the demand law: for exponential demand with p=hp=hp=h and L=1L=1L=1 the bound is already about 3.363.363.36, and it approaches 111 quickly as LLL grows (Table 1 of the paper). Lemma 1 adds that the rate γ\gammaγ worsens as p/hp/hp/h grows, the regime opposite to the one in which base-stock policies are known to be nearly optimal.

The result is proved on paper; no machine-checked proof is known to exist. A formalization would produce a checked infinite-horizon lost-sales model and a checked statement of Kingman's random-walk identities for this queue. It would also produce checked comparisons of an arbitrary history-dependent policy with constant-order policies through convexity. The statement here is taken over a policy class at least as large as the paper's, so a proof also extends the result to randomized history-dependent policies.

Difficulty

The cost of the constant-order policy is the expected supremum of a random walk, while the optimal policy has no closed form and may not even induce a stationary distribution. The paper avoids the steady state of the optimal policy by constructing a random vector with the needed stationarity properties (Theorem 2). That construction is not part of this mission. Here, the lower bound on OPT(L)\mathrm{OPT}(L)OPT(L) in Lemma 2 instead goes through the published, proved lower certificate for the full policy class. The second obstacle is quantitative: the exponential rate comes from comparing the minimizers r∞r_\inftyr∞​ and rLr_LrL​ of two different convex functions (Lemma 4) and from a first-order optimality condition involving a non-differentiable expectation (Lemma 5). Neither follows from the observation that one function dominates the other.

Formalization scope

The model is the published CappedBaseStock model: zero-based time, an empty initial state, demand laws on [0,∞)[0,\infty)[0,∞) with finite positive mean, and costs and long-run averages in [0,∞][0,\infty][0,∞]. OPT(L)\mathrm{OPT}(L)OPT(L) is the infimum over all measurable, history-dependent, possibly randomized policies. That class contains the paper's Markov deterministic class Π\PiΠ, so every statement involving OPT(L)\mathrm{OPT}(L)OPT(L) is at least as strong as printed. "Strictly positive variance" is encoded as "the demand law is not a point mass". It is a hypothesis wherever the paper's argument needs it; the Chernoff step, eq. (3) and Corollary 1 do not need it.

C(πr)C(\pi_r)C(πr​) is the model's long-run cost of the constant policy, not formula (3), and E[I∞r]\mathbb E[I^r_\infty]E[I∞r​] is a lower integral in [0,∞][0,\infty][0,∞], so that eq. (3) and Lemma 3 are not true by definition. r∞r_\inftyr∞​ and rLr_LrL​ are infima of the argmin sets, whose nonemptiness is a milestone. 1/ϑ1/\vartheta1/ϑ is encoded with the paper's convention 1/∞=01/\infty=01/∞=0. Lemma 3's tail bound is stated additively in [0,∞][0,\infty][0,∞], and the series in Lemmas 3 and 5 are extended-real series indexed from 000. The goal's ratio is taken in [0,∞][0,\infty][0,∞], where x/0=∞x/0=\inftyx/0=∞ for x≠0x\neq0x=0. None of γ<1\gamma<1γ<1, g>0g>0g>0 or r∞<E[D]r_\infty<\mathbb E[D]r∞​<E[D] is assumed: all three are milestones. A formalization that defines OPT\mathrm{OPT}OPT over constant-order policies only, fixes rrr instead of r∞r_\inftyr∞​, treats γ,ϑ,g\gamma,\vartheta,gγ,ϑ,g as free parameters, or takes the ratio in R\mathbb RR after truncating infinite costs would make the goal trivial and is ruled out. The objects are defined from the full parameter record, which includes LLL. That they do not depend on LLL follows from eq. (3) and the existence milestone.

No statement corrects a printed slip. Theorem 2 (existence of the stationary vector) and eq. (2) (bounded stationary optimal policies) are not stated; Observation 1 instead takes Theorem 2's properties (i)–(iii) as hypotheses on an arbitrary law. The source is arXiv:1409.1499v2, whose printed page numbers equal the PDF's. Useful infrastructure: Lindley-type random-walk suprema, Spitzer–Kingman identities, Chernoff bounds for i.i.d. sums (Mathlib's measure_le_le_exp_mul_mgf), and Cesàro limits of expected costs. All of it is reusable for other queueing and inventory missions. Proofs of any milestone are welcome, and the Chernoff step is the natural entry point.

Selected references

  • L. Xin, D. A. Goldberg, Optimality gap of constant-order policies decays exponentially in the lead time for lost sales models, Operations Research 64(6), 2016; preprint arXiv:1409.1499v2. https://arxiv.org/abs/1409.1499v2
  • D. A. Goldberg, D. A. Katz-Rogozhnikov, Y. Lu, M. Sharma, M. S. Squillante, Asymptotic optimality of constant-order policies for lost sales inventory models with large lead times, Mathematics of Operations Research, 2016; preprint arXiv:1211.4063. https://arxiv.org/abs/1211.4063
  • J. F. C. Kingman, Some inequalities for the queue GI/G/1, Biometrika 49, 1962. https://doi.org/10.1093/biomet/49.3-4.315
  • M. Bijvank, I. F. A. Vis, Lost-sales inventory theory: a review, European Journal of Operational Research 215(1), 2011. https://doi.org/10.1016/j.ejor.2011.02.004
  • S. Asmussen, Applied Probability and Queues, 2nd ed., Springer, 2003. https://doi.org/10.1007/b97236
19 thms2 active usersReviewed
AnalysisOptimization·Captain: mikedeng1

Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs 3: Enhanced e-PSG Cluster Points Are Strong Lifted Stationary Points for Max-Type DenominatorsResearch Paper

Motivation

Fractional programs minimize a ratio f(x)/g(x)f(x)/g(x)f(x)/g(x) over a constraint set. They arise whenever a quantity has to be normalized: the scale-invariant sparse recovery model minimizes ∥x∥1/∥x∥2\|x\|_1/\|x\|_2∥x∥1​/∥x∥2​ (Rahimi, Wang, Dong, Lou 2019), robust Sharpe-ratio portfolio selection maximizes a mean-to-worst-case-risk ratio, and generalized eigenvalue problems minimize Rayleigh quotients. Classical methods such as Dinkelbach's algorithm assume convex fff and concave ggg; many modern instances have neither.

Boţ, Dao and Li (arXiv:2003.04124, Math. Oper. Res. 2022) study the nonconvex nonsmooth case in which the numerator is a smooth convex part plus a lower semicontinuous part and the denominator is weakly convex on the constraint set. Their basic method, the extrapolated proximal subgradient (e-PSG) algorithm, converges subsequentially to lifted stationary points. When the denominator is a maximum of finitely many smooth functions, a lifted stationary point may be spurious: it only requires one element of the subdifferential of ggg to balance the numerator. Section 6 of the paper proposes an enhanced algorithm, in the spirit of the enhanced DC algorithm of Pang, Razaviyayn, Alvarado 2017, whose cluster points satisfy the stronger condition for all such elements. This mission formalizes that result.

Setting

HHH is a finite-dimensional real Hilbert space, S⊆HS\subseteq HS⊆H is nonempty, closed and convex, and the problem is

min⁡x∈S f(x)g(x).(P)\min_{x\in S}\ \frac{f(x)}{g(x)} .\qquad (P)x∈Smin​ g(x)f(x)​.(P)
  • Numerator (Assumption 1). f=fs+fnf=f^{\mathfrak s}+f^{\mathfrak n}f=fs+fn, where fs:H→Rf^{\mathfrak s}:H\to\mathbb Rfs:H→R is convex and continuously differentiable with an ℓ\ellℓ-Lipschitz gradient, fn:H→(−∞,+∞]f^{\mathfrak n}:H\to(-\infty,+\infty]fn:H→(−∞,+∞] is proper and lower semicontinuous, S∩dom⁡f≠∅S\cap\operatorname{dom}f\neq\emptysetS∩domf=∅, and f≥0f\ge0f≥0 on S∩dom⁡fS\cap\operatorname{dom}fS∩domf.
  • Denominator (Assumption 2′). g=max⁡{gi:1≤i≤p}g=\max\{g_i:1\le i\le p\}g=max{gi​:1≤i≤p}, each gig_igi​ continuously differentiable on an open set containing SSS and weakly convex on SSS with modulus β≥0\beta\ge0β≥0, meaning gi+β2∥⋅∥2g_i+\frac\beta2\|\cdot\|^2gi​+2β​∥⋅∥2 is convex on SSS. The boundedness condition (BC) holds: m≤g≤Mm\le g\le Mm≤g≤M on S∩dom⁡fS\cap\operatorname{dom}fS∩domf for some m,M>0m,M>0m,M>0.
  • Active sets. Iε(x)={i:gi(x)≥g(x)−ε}I_\varepsilon(x)=\{i: g_i(x)\ge g(x)-\varepsilon\}Iε​(x)={i:gi​(x)≥g(x)−ε}; I0(x)I_0(x)I0​(x) is the set of indices attaining the maximum.
  • Subdifferentials. ∂L\partial_L∂L​ is the limiting (Mordukhovich) subdifferential, and ιS\iota_SιS​ is the indicator of SSS.
  • Strong lifted stationarity (Definition 3.1(iii)). xˉ∈S\bar x\in Sxˉ∈S is a strong lifted stationary point if f(xˉ) ∂Lg(xˉ)⊆g(xˉ) ∂L(f+ιS)(xˉ)f(\bar x)\,\partial_L g(\bar x)\subseteq g(\bar x)\,\partial_L(f+\iota_S)(\bar x)f(xˉ)∂L​g(xˉ)⊆g(xˉ)∂L​(f+ιS​)(xˉ).

Algorithm 2 starts from x−1=x0∈S∩dom⁡fx_{-1}=x_0\in S\cap\operatorname{dom}fx−1​=x0​∈S∩domf. At step nnn it sets θn=f(xn)/g(xn)\theta_n=f(x_n)/g(x_n)θn​=f(xn​)/g(xn​), picks a step size τn\tau_nτn​ and extrapolation weights κn∈[0,κˉ]\kappa_n\in[0,\bar\kappa]κn​∈[0,κˉ], μn∈[0,μˉτn]\mu_n\in[0,\bar\mu\tau_n]μn​∈[0,μˉ​τn​], and forms un=xn+κn(xn−xn−1)u_n=x_n+\kappa_n(x_n-x_{n-1})un​=xn​+κn​(xn​−xn−1​) and vn=xn+μn(xn−xn−1)v_n=x_n+\mu_n(x_n-x_{n-1})vn​=xn​+μn​(xn​−xn−1​). For every i∈Iε(xn)i\in I_\varepsilon(x_n)i∈Iε​(xn​) it computes a proximal candidate

wni∈argmin⁡x∈S(fn(x)+⟨∇fs(un),x⟩+12τn∥x−vn−τnθn∇gi(xn)∥2+ℓ2∥x−un∥2)w_n^{i}\in\operatorname*{argmin}_{x\in S}\Big(f^{\mathfrak n}(x)+\langle\nabla f^{\mathfrak s}(u_n),x\rangle+\tfrac1{2\tau_n}\|x-v_n-\tau_n\theta_n\nabla g_i(x_n)\|^2+\tfrac\ell2\|x-u_n\|^2\Big)wni​∈x∈Sargmin​(fn(x)+⟨∇fs(un​),x⟩+2τn​1​∥x−vn​−τn​θn​∇gi​(xn​)∥2+2ℓ​∥x−un​∥2)

(up to constants), and keeps as xn+1x_{n+1}xn+1​ the candidate minimizing the merit value f(w)−θng(w)+12(1−βζτn−MμnmMτn)∥w−xn∥2f(w)-\theta_n g(w)+\frac12\big(\frac{1-\sqrt\beta\zeta}{\tau_n}-\frac{M\mu_n}{\sqrt{mM}\tau_n}\big)\|w-x_n\|^2f(w)−θn​g(w)+21​(τn​1−β​ζ​−mM​τn​Mμn​​)∥w−xn​∥2.

Formalization targets

Goal: Theorem 6.1(iii)

Assume the sublevel set S0={x∈S:f(x)/g(x)≤f(x0)/g(x0)}S_0=\{x\in S: f(x)/g(x)\le f(x_0)/g(x_0)\}S0​={x∈S:f(x)/g(x)≤f(x0​)/g(x0​)} is bounded and lim inf⁡nτn=τˉ>0\liminf_n\tau_n=\bar\tau>0liminfn​τn​=τˉ>0. Then every cluster point xˉ\bar xxˉ of (xn)(x_n)(xn​) satisfies xˉ∈S∩dom⁡f\bar x\in S\cap\operatorname{dom}fxˉ∈S∩domf, f(xn)/g(xn)→f(xˉ)/g(xˉ)f(x_n)/g(x_n)\to f(\bar x)/g(\bar x)f(xn​)/g(xn​)→f(xˉ)/g(xˉ),

f(xˉ)g(xˉ)⋃i∈I0(xˉ)∇gi(xˉ)⊆∂L(f+ιS)(xˉ),(28)\frac{f(\bar x)}{g(\bar x)}\bigcup_{i\in I_0(\bar x)}\nabla g_i(\bar x)\subseteq\partial_L(f+\iota_S)(\bar x),\qquad(28)g(xˉ)f(xˉ)​i∈I0​(xˉ)⋃​∇gi​(xˉ)⊆∂L​(f+ιS​)(xˉ),(28)

and, if fff is weakly convex on SSS, xˉ\bar xxˉ is a strong lifted stationary point of (P).

Milestones, in proof order

  1. Lemma 4.4 (descent lemma; already proved on the platform) and Lemma 4.3 (subgradient inequality for weakly convex functions).
  2. Inequality (32): the merit value of xn+1x_{n+1}xn+1​ is at most that of any candidate, which is bounded by a model of fff at any x∈Sx\in Sx∈S.
  3. The one-step decrease of f(xn)/g(xn)f(x_n)/g(x_n)f(xn​)/g(xn​) that follows from (32).
  4. Theorem 6.1(i): xn∈S∩dom⁡fx_n\in S\cap\operatorname{dom}fxn​∈S∩domf, and the sequence Fn=f(xn)/g(xn)+(ℓκˉ22m+μˉ2mM)∥xn−xn−1∥2F_n=f(x_n)/g(x_n)+\big(\frac{\ell\bar\kappa^2}{2m}+\frac{\bar\mu}{2\sqrt{mM}}\big)\|x_n-x_{n-1}\|^2Fn​=f(xn​)/g(xn​)+(2mℓκˉ2​+2mM​μˉ​​)∥xn​−xn−1​∥2 of (27) is nonincreasing and convergent.
  5. Theorem 6.1(ii): the iterates are bounded and ∑n∥xn+1−xn∥2<+∞\sum_n\|x_{n+1}-x_n\|^2<+\infty∑n​∥xn+1​−xn​∥2<+∞.
  6. The limit inequality at a cluster point, and inclusion (34) (= (28)).
  7. Lemma 2.2(i): ∂L(h+ιS)\partial_L(h+\iota_S)∂L​(h+ιS​) is closed and convex for weakly convex hhh.

Significance

For max-type denominators the result separates the enhanced algorithm from the basic one. A lifted stationary point only needs 0∈g(xˉ)∂L(f+ιS)(xˉ)−f(xˉ)∂Lg(xˉ)0\in g(\bar x)\partial_L(f+\iota_S)(\bar x)-f(\bar x)\partial_L g(\bar x)0∈g(xˉ)∂L​(f+ιS​)(xˉ)−f(xˉ)∂L​g(xˉ). The paper's Example 3.3 (min⁡∣x∣≤1(x2+1)/(∣x∣+1)\min_{|x|\le1}(x^2+1)/(|x|+1)min∣x∣≤1​(x2+1)/(∣x∣+1)) has the lifted stationary point 000, which is not a local minimizer; the strong lifted stationary points of that example are exactly its minimizers. Lemma 3.4 of the paper identifies strong lifted stationarity with d-stationarity of f−f(xˉ)g(xˉ)gf-\frac{f(\bar x)}{g(\bar x)}gf−g(xˉ)f(xˉ)​g on SSS when f+ιSf+\iota_Sf+ιS​ and ggg are weakly convex. This is the sharpest first-order notion used for DC-type programs.

The theorem is proved in the paper (pp. 22–24). No machine-checked version of it, of the e-PSG analysis, or of lifted stationarity exists on the platform. Formalizing it checks the step-size bookkeeping that the printed algorithm gets wrong (see below). It also produces reusable statements about weakly convex functions and the limiting subdifferential of h+ιSh+\iota_Sh+ιS​.

Difficulty

The descent part follows the template of the basic e-PSG analysis, but the merit criterion couples the candidate selection with the extrapolation: the coefficient 1−βζτn−MμnmMτn\frac{1-\sqrt\beta\zeta}{\tau_n}-\frac{M\mu_n}{\sqrt{mM}\tau_n}τn​1−β​ζ​−mM​τn​Mμn​​ has to stay positive, and the cross term ⟨w−xn,xn−xn−1⟩\langle w-x_n,x_n-x_{n-1}\rangle⟨w−xn​,xn​−xn−1​⟩ has to be split with the specific weight m/M\sqrt{m/M}m/M​ for the constants of (27) to close.

The limit step is the main obstacle. The algorithm works with Iε(xn)I_\varepsilon(x_n)Iε​(xn​), but the conclusion concerns I0(xˉ)I_0(\bar x)I0​(xˉ) at a limit point. One must show that every index active at xˉ\bar xxˉ was a candidate along the subsequence. One must also show that f(xkn+1)→f(xˉ)f(x_{k_n+1})\to f(\bar x)f(xkn​+1​)→f(xˉ) although fff is only lower semicontinuous. The naive approach, passing to the limit in the optimality condition of a single subproblem, gives one element of ∂Lg(xˉ)\partial_L g(\bar x)∂L​g(xˉ) only, which is lifted stationarity again. The final step needs the limiting subdifferential of a finite max of C1C^1C1 functions to be the convex hull of the active gradients. The paper uses this fact without proof, and Mathlib does not provide it for ∂L\partial_L∂L​.

Formalization scope

  • Carrier. HHH is EuclideanSpace ℝ (Fin N). Functions into (−∞,+∞](-\infty,+\infty](−∞,+∞] are EReal-valued. ∂L\partial_L∂L​ is the published NonconvexSplitting.Shared.LimitingSubdiff, and properness is IsProperFn.
  • Indices and the max. Indices are Fin p with p≥1p\ge1p≥1, so they run 0,…,p−10,\dots,p-10,…,p−1. ggg is defined as Finset.sup' of the gig_igi​, never as an independent function. The standing assumptions of (P) are kept: ggg is lower semicontinuous and positive on SSS.
  • Weak convexity. "Modulus" means "a valid constant". For real gig_igi​ it is ConvexOn of gi+β2∥⋅∥2g_i+\frac\beta2\|\cdot\|^2gi​+2β​∥⋅∥2 on SSS. For extended-real fff it is convexity of the epigraph of f+ιS+ρ2∥⋅∥2f+\iota_S+\frac\rho2\|\cdot\|^2f+ιS​+2ρ​∥⋅∥2.
  • Algorithm 2. A run is a predicate on iterates, candidates, selected indices, step sizes and weights. Each argmin is "some minimizer", candidates outside Iε(xn)I_\varepsilon(x_n)Iε​(xn​) are unconstrained, x−1=x0x_{-1}=x_0x−1​=x0​, and ratios are real numbers on S∩dom⁡fS\cap\operatorname{dom}fS∩domf.
  • Two misprints corrected. Step 1 declares an unused ω\omegaω and never declares ε\varepsilonε; it is read as ε>0\varepsilon>0ε>0. The printed step-size rule τn≤1/max⁡{βθn/(1−ζ),δ}\tau_n\le1/\max\{\beta\theta_n/(1-\zeta),\delta\}τn​≤1/max{βθn​/(1−ζ),δ} does not give the inequality βθn≤βζ/τn\beta\theta_n\le\sqrt\beta\zeta/\tau_nβθn​≤β​ζ/τn​ that the proof uses. The run therefore uses τn≤1/max⁡{βθn/ζ,δ}\tau_n\le1/\max\{\sqrt\beta\theta_n/\zeta,\delta\}τn​≤1/max{β​θn​/ζ,δ}, the rule of Algorithm 1.
  • Other conventions. τˉ\bar\tauτˉ is Filter.liminf τ atTop, which is well defined because 0<τn≤1/δ0<\tau_n\le1/\delta0<τn​≤1/δ. The κˉ\bar\kappaκˉ-range is multiplied out to avoid dividing by ℓ\ellℓ.
  • Ruled out. The theorem cannot be satisfied trivially: the run constrains every iterate, and the strong lifted conclusion quantifies over all of ∂Lg(xˉ)\partial_L g(\bar x)∂L​g(xˉ). Membership xˉ∈dom⁡f\bar x\in\operatorname{dom}fxˉ∈domf is concluded explicitly, so the toReal value of +∞+\infty+∞ never enters.
  • Needed infrastructure. The subgradient inequality for weakly convex functions, the convexity of ∂L(h+ιS)\partial_L(h+\iota_S)∂L​(h+ιS​) for weakly convex hhh, a Fermat rule for ∂L\partial_L∂L​, and the formula for ∂Lmax⁡igi\partial_L\max_i g_i∂L​maxi​gi​. Each is reusable beyond this paper, and a contribution of any of them is welcome.

Selected references

  • R. I. Boţ, M. N. Dao, G. Li, Extrapolated proximal subgradient algorithms for nonconvex and nonsmooth fractional programs, arXiv:2003.04124v2 (2020); Math. Oper. Res. 47 (2022). https://arxiv.org/abs/2003.04124
  • J.-S. Pang, M. Razaviyayn, A. Alvarado, Computing B-stationary points of nonsmooth DC programs, Math. Oper. Res. 42(1) (2017). https://doi.org/10.1287/moor.2016.0795
  • Y. Rahimi, C. Wang, H. Dong, Y. Lou, A scale invariant approach for sparse signal recovery, SIAM J. Sci. Comput. 41 (2019). https://arxiv.org/abs/1812.08852
  • B. S. Mordukhovich, Variational Analysis and Generalized Differentiation I, Springer, 2006. https://doi.org/10.1007/3-540-31247-1
  • R. T. Rockafellar, R. J.-B. Wets, Variational Analysis, Springer, 1998. https://doi.org/10.1007/978-3-642-02431-3
16 thms2 active usersReviewed
Optimal TransportOptimizationProbability·Captain: mikedeng1

Optimal Transport-Based Distributionally Robust Optimization: Structural Properties and Iterative Schemes 4: A Worst-Case Distribution Is the Law of X + √δ G A(X)⁻¹β, Spending the Whole Budget δResearch Paper

Why the worst case matters

Distributionally robust optimization (DRO) replaces the expected loss EP0[ℓ(βTX)]E_{P_0}[\ell(\beta^{\mathsf T}X)]EP0​​[ℓ(βTX)] of a linear decision rule β\betaβ by its worst case over all data laws PPP within transport distance δ\deltaδ of the baseline P0P_0P0​. When P0P_0P0​ is an empirical distribution this covers regularized regression and classification (Blanchet, Kang, Murthy 2019; Esfahani, Kuhn 2018). The optimal value is one number; a practitioner also wants to know which distribution realizes it, the adversary's best response. It shows which data points the robust model guards against, it gives stress-test scenarios, and its structure is what the paper's comparative statics (Theorem 7) and iterative schemes build on.

J. Blanchet, K. Murthy and F. Zhang, Optimal Transport-Based Distributionally Robust Optimization: Structural Properties and Iterative Schemes (arXiv:1810.02403v3; Math. Oper. Res. 47(2), 2022), answer this for a state-dependent Mahalanobis cost. Theorem 6 of that paper describes the worst-case distribution through the solution of the one-dimensional dual problem. This mission formalizes Theorem 6.

Setting

The data XXX take values in Rd\mathbb R^dRd with law P0P_0P0​, a Borel probability measure. The decision β\betaβ ranges over a convex set B⊆RdB\subseteq\mathbb R^dB⊆Rd (a standing assumption of the paper). Moving mass from xxx to x′x'x′ costs

c(x,x′)=(x−x′)TA(x)(x−x′),c(x,x')=(x-x')^{\mathsf T}A(x)(x-x'),c(x,x′)=(x−x′)TA(x)(x−x′),

where A(x)A(x)A(x) is positive definite. Assumption 1 asks that ccc be lower semicontinuous and that ρmin⁡∥v∥2≤vTA(x)v≤ρmax⁡∥v∥2\rho_{\min}\|v\|^2\le v^{\mathsf T}A(x)v\le\rho_{\max}\|v\|^2ρmin​∥v∥2≤vTA(x)v≤ρmax​∥v∥2 for P0P_0P0​-almost every xxx, with ρmin⁡>0\rho_{\min}>0ρmin​>0. The optimal transport cost Dc(P0,P)D_c(P_0,P)Dc​(P0​,P) is the least value of Eπ[c(X,X′)]E_\pi[c(X,X')]Eπ​[c(X,X′)] over couplings π\piπ of P0P_0P0​ and PPP. For δ>0\delta>0δ>0 the worst-case objective is

sup⁡P: Dc(P0,P)≤δEP[ℓ(βTX)].(6)\sup_{P:\,D_c(P_0,P)\le\delta}E_P\bigl[\ell(\beta^{\mathsf T}X)\bigr].\tag{6}P:Dc​(P0​,P)≤δsup​EP​[ℓ(βTX)].(6)

Assumption 2 asks that the loss ℓ:R→R\ell:\mathbb R\to\mathbb Rℓ:R→R be convex, that the growth exponent κ=inf⁡{s≥0:sup⁡u(ℓ(u)−su2)<∞}\kappa=\inf\{s\ge0:\sup_u(\ell(u)-su^2)<\infty\}κ=inf{s≥0:supu​(ℓ(u)−su2)<∞} be finite, and that EP0∥X∥4<∞E_{P_0}\|X\|^4<\inftyEP0​​∥X∥4<∞.

The dual side is built from

F(γ,β,λ;x)=ℓ(βTx+γδ βTA(x)−1β)−λδ(γ2βTA(x)−1β−1),F(\gamma,\beta,\lambda;x)=\ell\bigl(\beta^{\mathsf T}x+\gamma\sqrt\delta\,\beta^{\mathsf T}A(x)^{-1}\beta\bigr)-\lambda\sqrt\delta\bigl(\gamma^2\beta^{\mathsf T}A(x)^{-1}\beta-1\bigr),F(γ,β,λ;x)=ℓ(βTx+γδ​βTA(x)−1β)−λδ​(γ2βTA(x)−1β−1),

the robust loss ℓrob(β,λ;x)=sup⁡γF\ell_{\rm rob}(\beta,\lambda;x)=\sup_{\gamma}Fℓrob​(β,λ;x)=supγ​F, the dual objective fδ(β,λ)=EP0[ℓrob(β,λ;X)]∈R∪{∞}f_\delta(\beta,\lambda)=E_{P_0}[\ell_{\rm rob}(\beta,\lambda;X)]\in\mathbb R\cup\{\infty\}fδ​(β,λ)=EP0​​[ℓrob​(β,λ;X)]∈R∪{∞} and the maximizer set Γ∗(β,λ;x)=arg⁡max⁡γF(γ,β,λ;x)\Gamma^*(\beta,\lambda;x)=\arg\max_\gamma F(\gamma,\beta,\lambda;x)Γ∗(β,λ;x)=argmaxγ​F(γ,β,λ;x). By the paper's Theorem 1, (6) equals inf⁡λ≥0fδ(β,λ)\inf_{\lambda\ge0}f_\delta(\beta,\lambda)infλ≥0​fδ​(β,λ), and a minimizer λ∗(β)\lambda_*(\beta)λ∗​(β), the dual optimizer, exists. The threshold is λthr(β)=κδ ess supP0 βTA(X)−1β\lambda_{thr}(\beta)=\kappa\sqrt\delta\,\mathrm{ess\,sup}_{P_0}\,\beta^{\mathsf T}A(X)^{-1}\betaλthr​(β)=κδ​esssupP0​​βTA(X)−1β; below it fδ=∞f_\delta=\inftyfδ​=∞.

Formalization targets

Goal: Theorem 6(c)

Let β≠0\beta\ne0β=0 and λ∗(β)>λthr(β)\lambda_*(\beta)>\lambda_{thr}(\beta)λ∗​(β)>λthr​(β). Let G±(x)∈Γ∗(β,λ∗(β);x)G_\pm(x)\in\Gamma^*(\beta,\lambda_*(\beta);x)G±​(x)∈Γ∗(β,λ∗​(β);x) be measurable selections with the largest and smallest square, cˉ=E[G+2βTA(X)−1β]\bar c=E[G_+^2\beta^{\mathsf T}A(X)^{-1}\beta]cˉ=E[G+2​βTA(X)−1β], c‾=E[G−2βTA(X)−1β]\underline c=E[G_-^2\beta^{\mathsf T}A(X)^{-1}\beta]c​=E[G−2​βTA(X)−1β], and let Z∼Bernoulli(q)Z\sim\mathrm{Bernoulli}(q)Z∼Bernoulli(q) be independent of XXX with q=(cˉ−1)/(cˉ−c‾)∈[0,1]q=(\bar c-1)/(\bar c-\underline c)\in[0,1]q=(cˉ−1)/(cˉ−c​)∈[0,1]. Then

X∗=X+δ (ZG−+(1−Z)G+)A(X)−1β,E[c(X,X∗)]=δ,X^*=X+\sqrt\delta\,\bigl(ZG_-+(1-Z)G_+\bigr)A(X)^{-1}\beta,\qquad E[c(X,X^*)]=\delta,X∗=X+δ​(ZG−​+(1−Z)G+​)A(X)−1β,E[c(X,X∗)]=δ,

and the law of X∗X^*X∗ attains the supremum in (6).

Milestones

  • Lemma 1: Γ∗≠∅\Gamma^*\ne\emptysetΓ∗=∅ and ℓrob<∞\ell_{\rm rob}<\inftyℓrob​<∞ when λ>κδ βTA(x)−1β\lambda>\kappa\sqrt\delta\,\beta^{\mathsf T}A(x)^{-1}\betaλ>κδ​βTA(x)−1β, and ℓrob=∞\ell_{\rm rob}=\inftyℓrob​=∞ below that; hence {λ>λthr}⊆{fδ<∞}⊆{λ≥λthr}\{\lambda>\lambda_{thr}\}\subseteq\{f_\delta<\infty\}\subseteq\{\lambda\ge\lambda_{thr}\}{λ>λthr​}⊆{fδ​<∞}⊆{λ≥λthr​}.
  • Lemma 3(a): δ∣g∣βTA(x)−1β≤1+C1ε−1(1+∣βTx∣)\sqrt\delta|g|\beta^{\mathsf T}A(x)^{-1}\beta\le1+C_1\varepsilon^{-1}(1+|\beta^{\mathsf T}x|)δ​∣g∣βTA(x)−1β≤1+C1​ε−1(1+∣βTx∣) for g∈Γ∗g\in\Gamma^*g∈Γ∗ once λ≥(κ+ε)δβTA(x)−1β\lambda\ge(\kappa+\varepsilon)\sqrt\delta\beta^{\mathsf T}A(x)^{-1}\betaλ≥(κ+ε)δ​βTA(x)−1β.
  • Proposition 2 (a) and its λ\lambdaλ-part: the one-sided λ\lambdaλ-derivatives of ℓrob\ell_{\rm rob}ℓrob​ are the minimum and the maximum of −δ(γ2βTA(x)−1β−1)-\sqrt\delta(\gamma^2\beta^{\mathsf T}A(x)^{-1}\beta-1)−δ​(γ2βTA(x)−1β−1) over Γ∗\Gamma^*Γ∗.
  • The one-sided λ\lambdaλ-derivatives of fδf_\deltafδ​ on {λ>λthr}\{\lambda>\lambda_{thr}\}{λ>λthr​}:
∂±fδ/∂λ=δ(1−E[βTA(X)−1β inf⁡/sup⁡g∈Γ∗g2]).\partial_\pm f_\delta/\partial\lambda=\sqrt\delta\bigl(1-E[\beta^{\mathsf T}A(X)^{-1}\beta\,\inf/\sup_{g\in\Gamma^*}g^2]\bigr).∂±​fδ​/∂λ=δ​(1−E[βTA(X)−1βinf/g∈Γ∗sup​g2]).
  • [Blanchet–Murthy 2019, Theorem 1]: strong duality and complementary slackness (already proved on the platform).

Companion statements

Theorem 6(a): λ∗>0\lambda_*>0λ∗​>0 unless ℓ\ellℓ is constant. Theorem 6(b): λ∗≥λthr\lambda_*\ge\lambda_{thr}λ∗​≥λthr​. Theorem 6(d), as the paper's example: for ℓ(u)=u2−∣u∣(1−e−∣u∣)\ell(u)=u^2-|u|(1-e^{-|u|})ℓ(u)=u2−∣u∣(1−e−∣u∣), P0=δ0P_0=\delta_0P0​=δ0​, A=IA=IA=I and ∥β∥=1\|\beta\|=1∥β∥=1, λ∗=λthr=δ\lambda_*=\lambda_{thr}=\sqrt\deltaλ∗​=λthr​=δ​ and no distribution attains the value δ\deltaδ. Theorem 6(e), with Lemma 8: if ℓ′′≤M\ell''\le Mℓ′′≤M and λ∗>12Mδ ess sup βTA(X)−1β\lambda_*>\tfrac12M\sqrt\delta\,\mathrm{ess\,sup}\,\beta^{\mathsf T}A(X)^{-1}\betaλ∗​>21​Mδ​esssupβTA(X)−1β, then Γ∗\Gamma^*Γ∗ is a singleton {G(x)}\{G(x)\}{G(x)} almost surely and the law of X+δG(X)A(X)−1βX+\sqrt\delta G(X)A(X)^{-1}\betaX+δ​G(X)A(X)−1β is the unique worst case.

Significance

The result reduces a search over all probability measures to a scalar problem per data point. Each point is pushed along the single direction A(x)−1βA(x)^{-1}\betaA(x)−1β, by an amount read off the maximizers of FFF, and the budget δ\deltaδ is always spent completely. When the maximizer is not unique, randomization between two extreme maximizers is needed and suffices. Part (d) shows that the threshold condition cannot be removed, and part (e) gives a deterministic transport map (a Monge solution) under smoothness. Theorem 7 of the paper, the monotone growth of worst-case displacements in δ\deltaδ, is a statement about the random variable GGG produced here.

None of these statements has been machine-checked before. The general strong duality with complementary slackness of Blanchet–Murthy (arXiv:1604.01446) is proved on the platform, so this mission connects that abstract theorem to an explicit worst-case law. A formal proof also has to settle one point the printed text leaves loose: which extreme maximizers enter the mixture (see Formalization scope).

Difficulty

The first idea is to take the pointwise maximizers of FFF at λ∗\lambda_*λ∗​ and push P0P_0P0​ forward. That works only when the maximizer is unique and the budget constraint happens to be tight. In general the maximizer set is not a singleton, and the derivative of fδf_\deltafδ​ at λ∗\lambda_*λ∗​ only lies between a left and a right derivative. Turning the first-order condition ∂+fδ≥0≥∂−fδ\partial_+f_\delta\ge0\ge\partial_-f_\delta∂+​fδ​≥0≥∂−​fδ​ into an exact cost δ\deltaδ needs three things. The one-sided derivatives must be identified as expectations over Γ∗\Gamma^*Γ∗, an envelope theorem under an integral with a non-compact parameter set. The extreme maximizers must be compact and measurably selectable. Finally the resulting coupling must be certified optimal through complementary slackness. Each step needs a hypothesis that is easy to lose: the growth control of Lemma 3, the essential supremum in λthr\lambda_{thr}λthr​, measurability of selections.

Formalization scope

Points of Rd\mathbb R^dRd are EuclideanSpace ℝ (Fin d), βTx\beta^{\mathsf T}xβTx is the inner product, and βTA(x)−1β\beta^{\mathsf T}A(x)^{-1}\betaβTA(x)−1β is quadInv A β x. ℓrob\ell_{\rm rob}ℓrob​ and fδf_\deltafδ​ are extended-real valued; fδf_\deltafδ​ uses the published extended integral ModelRiskOT.Duality.extIntegral. The worst-case objective (6) is the published primal problem primalValue: a supremum over couplings π\piπ with first marginal P0P_0P0​ and ∫c dπ≤δ\int c\,d\pi\le\delta∫cdπ≤δ (primalFeasible). A distribution attains (6) when a coupling with that second marginal has value primalValue. The random worst case X∗X^*X∗ is encoded by the joint law of (X,X∗)(X,X^*)(X,X∗), a mixture of two graph couplings, because E[c(X,X∗)]E[c(X,X^*)]E[c(X,X∗)] depends on the pair. A dual optimizer is a real λ∗≥0\lambda_*\ge0λ∗​≥0 minimizing fδ(β,⋅)f_\delta(\beta,\cdot)fδ​(β,⋅) on [0,∞)[0,\infty)[0,∞).

Standing hypotheses on every statement: P0P_0P0​ a probability measure, Assumptions 1 and 2, δ>0\delta>0δ>0, BBB convex. The following departures from the printed text are disclosed in each item:

  • In (c), G±G_\pmG±​ are the selections of extreme square used in the proof (p. 40), not inf⁡Γ∗\inf\Gamma^*infΓ∗ and sup⁡Γ∗\sup\Gamma^*supΓ∗ as printed; a two-point example shows the printed choice can fail.
  • In (e), "for every xxx" is read as "for P0P_0P0​-almost every xxx", which is what the proof gives.
  • Lemma 8 is stated for β≠0\beta\ne0β=0.
  • Proposition 2 is formalized for part (a) and the λ\lambdaλ-derivatives only.

Every expectation used in the goal (cˉ\bar ccˉ, c‾\underline cc​) carries an integrability conjunct. The cost identity and optimality are asserted for the measure itself, so no junk value of a non-integrable integral can make the goal hold vacuously. A statement asserting only first-order conditions for λ∗\lambda_*λ∗​ would not be Theorem 6. The goal asserts primal attainment and the exact cost.

Needed infrastructure, reusable beyond this mission: envelope (Danskin) theorems for one-sided derivatives of suprema, differentiation of convex integral functionals, measurable selection of argmax sets, and complementary slackness through the published Blanchet–Murthy theorem. Contributions of any of these as standalone lemmas are welcome.

Selected references

  • J. Blanchet, K. Murthy, F. Zhang, Optimal Transport-Based Distributionally Robust Optimization: Structural Properties and Iterative Schemes, Math. Oper. Res. 47(2), 2022. arXiv:1810.02403v3, doi:10.1287/moor.2021.1178
  • J. Blanchet, K. Murthy, Quantifying Distributional Model Risk via Optimal Transport, Math. Oper. Res. 44(2), 2019. arXiv:1604.01446
  • J. Blanchet, Y. Kang, K. Murthy, Robust Wasserstein Profile Inference and Applications to Machine Learning, J. Appl. Probab. 56(3), 2019. doi:10.1017/jpr.2019.49
  • P. Mohajerin Esfahani, D. Kuhn, Data-driven distributionally robust optimization using the Wasserstein metric, Math. Program. 171, 2018. doi:10.1007/s10107-017-1172-1
  • D. P. Bertsekas, S. E. Shreve, Stochastic Optimal Control: The Discrete-Time Case, Academic Press, 1978 (Proposition 7.50, measurable selection).
13 thms2 active usersReviewed
AnalysisOptimization·Captain: mikedeng1

Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs 2: Sufficient Decrease, Multi-Step Relative Error and KL Give Finite Length and Linear RatesResearch Paper

Motivation

Many first-order methods for nonconvex and nonsmooth optimization are analysed with the same template: a merit function decreases by a definite amount at every step, a subgradient of the merit function at the current point is bounded by the step length, and the Kurdyka–Łojasiewicz (KL) property of the merit function turns these two facts into a proof that the whole sequence of iterates has finite length and converges. Attouch and Bolte (Math. Program. 2009), Attouch, Bolte and Svaiter (Math. Program. 2013) and Bolte, Sabach and Teboulle (Math. Program. 2014) isolated this template as a set of abstract conditions. Later frameworks for methods with inertia or extrapolation, such as iPiano (Ochs, Chen, Brox and Pock, SIAM J. Imaging Sci. 2014), needed the relative error bound to involve more than one past step.

Boţ, Dao and Li (arXiv:2003.04124, Math. Oper. Res. 2022) state a framework (H1)–(H5) in which the relative error bound is a convex combination of several step lengths, past or future, plus a summable error, and the iterates of the algorithm may live in a different space from the merit function. They prove finite length, convergence, stationarity and, for KL exponent at most 12\tfrac1221​, linear rates; they then apply it to an extrapolated proximal subgradient method for fractional programs. This mission formalizes that abstract result, Theorem 5.2 of the paper.

Setting

Let H\mathcal HH and K\mathcal KK be finite-dimensional real Hilbert spaces and h:K→(−∞,+∞]h:\mathcal K\to(-\infty,+\infty]h:K→(−∞,+∞] a proper (never −∞-\infty−∞, finite somewhere) lower semicontinuous function. ∂Lh(z)\partial_L h(z)∂L​h(z) denotes the limiting subdifferential of hhh at zzz, empty where h(z)=+∞h(z)=+\inftyh(z)=+∞, and dist⁡(0,∅)=+∞\operatorname{dist}(0,\emptyset)=+\inftydist(0,∅)=+∞.

Data: sequences (xn)(x_n)(xn​) in H\mathcal HH and (zn)(z_n)(zn​) in K\mathcal KK; αn,βn>0\alpha_n,\beta_n>0αn​,βn​>0; Δn,εn≥0\Delta_n,\varepsilon_n\ge0Δn​,εn​≥0, with the convention Δk=0\Delta_k=0Δk​=0 for k<0k<0k<0; integers ı‾≤ıˉ\underline\imath\le\bar\imath​≤ˉ (not necessarily positive), I={ı‾,…,ıˉ}I=\{\underline\imath,\dots,\bar\imath\}I={​,…,ˉ}, and weights λi≥0\lambda_i\ge0λi​≥0 with ∑i∈Iλi=1\sum_{i\in I}\lambda_i=1∑i∈I​λi​=1. The conditions, for all n∈Nn\in\mathbb Nn∈N, are:

  • (H1) sufficient decrease: h(zn+1)+αnΔn2≤h(zn)h(z_{n+1})+\alpha_n\Delta_n^2\le h(z_n)h(zn+1​)+αn​Δn2​≤h(zn​);
  • (H2) relative error: βndist⁡(0,∂Lh(zn))≤∑i∈IλiΔn−i+εn\beta_n\operatorname{dist}(0,\partial_L h(z_n))\le\sum_{i\in I}\lambda_i\Delta_{n-i}+\varepsilon_nβn​dist(0,∂L​h(zn​))≤∑i∈I​λi​Δn−i​+εn​;
  • (H3) continuity: some subsequence zkn→z~z_{k_n}\to\tilde zzkn​​→z~ has h(zkn)→h(z~)h(z_{k_n})\to h(\tilde z)h(zkn​​)→h(z~);
  • (H4) parameters: α‾:=inf⁡αn>0\underline\alpha:=\inf\alpha_n>0α​:=infαn​>0, γ‾:=inf⁡αnβn>0\underline\gamma:=\inf\alpha_n\beta_n>0γ​:=infαn​βn​>0, ∑εn<+∞\sum\varepsilon_n<+\infty∑εn​<+∞;
  • (H5) distance: there are j∈Zj\in\mathbb Zj∈Z, c∈Rc\in\mathbb Rc∈R with ∥xn+1−xn∥≤c Δn+j\|x_{n+1}-x_n\|\le c\,\Delta_{n+j}∥xn+1​−xn​∥≤cΔn+j​.

Ω\OmegaΩ is the set of cluster points of (zn)(z_n)(zn​), Ω0={zˉ∈Ω:h(zn)→h(zˉ)}\Omega_0=\{\bar z\in\Omega:h(z_n)\to h(\bar z)\}Ω0​={zˉ∈Ω:h(zn​)→h(zˉ)}, and hˉ=h(zˉ)\bar h=h(\bar z)hˉ=h(zˉ) for zˉ∈Ω0\bar z\in\Omega_0zˉ∈Ω0​. A desingularizing function φ∈Φη\varphi\in\Phi_\etaφ∈Φη​ is continuous and concave on [0,η)[0,\eta)[0,η), vanishes at 000, and is C1C^1C1 with φ′>0\varphi'>0φ′>0 on (0,η)(0,\eta)(0,η). hhh has the KL property at zˉ\bar zzˉ if for some neighbourhood UUU of zˉ\bar zzˉ, η>0\eta>0η>0 and φ∈Φη\varphi\in\Phi_\etaφ∈Φη​, φ′(h(z)−h(zˉ))dist⁡(0,∂Lh(z))≥1\varphi'(h(z)-h(\bar z))\operatorname{dist}(0,\partial_L h(z))\ge1φ′(h(z)−h(zˉ))dist(0,∂L​h(z))≥1 whenever z∈Uz\in Uz∈U and h(zˉ)<h(z)<h(zˉ)+ηh(\bar z)<h(z)<h(\bar z)+\etah(zˉ)<h(z)<h(zˉ)+η; it has the KL property with exponent a∈[0,1)a\in[0,1)a∈[0,1) if φ\varphiφ can be taken as γs1−a\gamma s^{1-a}γs1−a.

Formalization targets

Goal: Theorem 5.2

Assume (H1)–(H4), (zn)(z_n)(zn​) bounded, hhh constant on Ω\OmegaΩ with the KL property at every point of Ω\OmegaΩ. Then

(i) ∑n=0∞Δn<∞;(ii) (H5)⇒∑n=0∞∥xn+1−xn∥<∞ and xn→xˉ;(iii) inf⁡βn>0⇒0∈∂Lh(zˉ)  ∀zˉ∈Ω0;\text{(i)}\ \sum_{n=0}^{\infty}\Delta_n<\infty;\qquad \text{(ii)}\ \text{(H5)}\Rightarrow\sum_{n=0}^{\infty}\|x_{n+1}-x_n\|<\infty \text{ and } x_n\to\bar x;\qquad \text{(iii)}\ \inf\beta_n>0\Rightarrow 0\in\partial_L h(\bar z)\ \ \forall\bar z\in\Omega_0;(i) n=0∑∞​Δn​<∞;(ii) (H5)⇒n=0∑∞​∥xn+1​−xn​∥<∞ and xn​→xˉ;(iii) infβn​>0⇒0∈∂L​h(zˉ)  ∀zˉ∈Ω0​;

(iv) if hhh has KL exponent a≤12a\le\tfrac12a≤21​ on Ω\OmegaΩ, ı‾≤1\underline\imath\le1​≤1, inf⁡n,iαn−iβn2>0\inf_{n,i}\alpha_{n-i}\beta_n^2>0infn,i​αn−i​βn2​>0 and εn/βn=O(h(zn−ıˉ)−h(zn+1−ı‾))\varepsilon_n/\beta_n=O(\sqrt{h(z_{n-\bar\imath})-h(z_{n+1-\underline\imath})})εn​/βn​=O(h(zn−ˉ​)−h(zn+1−​​)​), then for some γ1>0\gamma_1>0γ1​>0, ρ∈(0,1)\rho\in(0,1)ρ∈(0,1),

h(zn)−hˉ≤γ1ρn∀n,h(z_n)-\bar h\le\gamma_1\rho^n\quad\forall n,h(zn​)−hˉ≤γ1​ρn∀n,

and under (H5) and ∑k≥nεk=O(h(zn−ıˉ)−hˉ)\sum_{k\ge n}\varepsilon_k=O(\sqrt{h(z_{n-\bar\imath})-\bar h})∑k≥n​εk​=O(h(zn−ˉ​)−hˉ​), ∥xn−xˉ∥≤γ2ρn/2\|x_n-\bar x\|\le\gamma_2\rho^{n/2}∥xn​−xˉ∥≤γ2​ρn/2 for the same ρ\rhoρ.

Milestones

Lemma 2.3 (uniformized KL along a bounded sequence, and its power form under an exponent); Lemma 5.1(i)–(iii) (nonemptiness of Ω0\Omega_0Ω0​ and monotone convergence of values; ∑Δn2≤(h(z0)−h(zˉ))/α‾\sum\Delta_n^2\le(h(z_0)-h(\bar z))/\underline\alpha∑Δn2​≤(h(z0​)−h(zˉ))/α​; the subgradient bound and stationarity); the tail bound (24) from the proof of (i); Theorem 5.2(i); and the first claim of Theorem 5.2(iv).

Significance

The theorem separates what is specific to an algorithm (checking (H1)–(H5) for its iterates) from what is common to all KL-based analyses (finite length, convergence, rates). In the paper it yields global convergence of the extrapolated proximal subgradient method (Theorem 5.5) with zn=(xn+1,xn)z_n=(x_{n+1},x_n)zn​=(xn+1​,xn​) and I={0,1}I=\{0,1\}I={0,1}, and Remark 5.4 shows that the frameworks of Attouch–Bolte–Svaiter, Bolte–Sabach–Teboulle, Frankel–Garrigos–Peypouquet and iPiano are special cases, while the linear rate for the iterates in the multi-step setting is new relative to those frameworks.

The result is proved on paper. To our knowledge no machine-checked version of this abstract framework exists. A formal proof yields a reusable theorem: any later mission that verifies (H1)–(H5) for a specific method gets convergence and rates by citation. Related single-algorithm KL convergence results on the platform (proximal alternating minimization, PALM, proximal ADMM) each repeat the same argument; this framework is the common abstraction.

Difficulty

The naive argument—sum (H1) to get ∑Δn2<∞\sum\Delta_n^2<\infty∑Δn2​<∞—gives only square-summability, which does not imply convergence of the iterates. Finite length needs the KL inequality along the whole tail of the sequence with one function φ\varphiφ, but the KL property is only pointwise; this requires a uniformization over the (compact) cluster set and the restriction to Ω0\Omega_0Ω0​, where values converge. The multi-step error with possibly negative indices in III means the right-hand side of (H2) can involve future steps, so the telescoping estimate must absorb sums with shifted index ranges. For the rates, the KL exponent turns the inequality into a recursion between rn+1−ı‾r_{n+1-\underline\imath}rn+1−​​ and rn−ıˉr_{n-\bar\imath}rn−ˉ​ separated by several steps, whose contraction must be shown to give a geometric rate.

Formalization scope

H\mathcal HH is EuclideanSpace ℝ (Fin N) and K\mathcal KK is EuclideanSpace ℝ (Fin P); hhh takes values in EReal, with properness and limiting subdifferential from the published NonconvexSplitting.Shared definitions and the KL property (HasKLProperty, IsDesingularizer, KLIneq) from the published NonconvexSplitting.ADMMKL definitions. η\etaη is a positive real. Δ\DeltaΔ is indexed by Z\mathbb ZZ and vanishes on negative integers. dist⁡(0,∂Lh(z))≤r\operatorname{dist}(0,\partial_L h(z))\le rdist(0,∂L​h(z))≤r is encoded as "some v∈∂Lh(z)v\in\partial_L h(z)v∈∂L​h(z) has ∥v∥≤r\|v\|\le r∥v∥≤r", and the KL inequality as "every v∈∂Lh(z)v\in\partial_L h(z)v∈∂L​h(z) satisfies φ′(⋅)∥v∥≥1\varphi'(\cdot)\|v\|\ge1φ′(⋅)∥v∥≥1"; Metric.infDist is never used, because it returns 000 on the empty set where the paper's distance is +∞+\infty+∞, which would make (H2) trivially satisfiable. Infima are encoded by positive lower bounds; O(⋅)O(\cdot)O(⋅) hypotheses as eventual bounds with a constant; hˉ\bar hhˉ by quantifying over Ω0\Omega_0Ω0​. Lemma 5.1(ii) assumes h(z0)<+∞h(z_0)<+\inftyh(z0​)<+∞ explicitly, which the page presupposes.

The definitions file FracPSG.Abstract.Basic (the setting, (H1)–(H5), Ω\OmegaΩ, Ω0\Omega_0Ω0​, the KL exponent) is reusable by any mission that instantiates the framework. Contributions welcome: proofs of the milestones, the uniformized KL lemma in general form, and summation lemmas for sequences indexed by Z\mathbb ZZ.

Selected references

  • R. I. Boţ, M. N. Dao, G. Li, Extrapolated Proximal Subgradient Algorithms for Nonconvex and Nonsmooth Fractional Programs, Math. Oper. Res., 2022; preprint arXiv:2003.04124v2 (2020). https://arxiv.org/abs/2003.04124
  • H. Attouch, J. Bolte, B. F. Svaiter, Convergence of descent methods for semi-algebraic and tame problems, Math. Program. 137, 2013. https://doi.org/10.1007/s10107-011-0484-9
  • J. Bolte, S. Sabach, M. Teboulle, Proximal alternating linearized minimization for nonconvex and nonsmooth problems, Math. Program. 146, 2014. https://doi.org/10.1007/s10107-013-0701-9
  • H. Attouch, J. Bolte, On the convergence of the proximal algorithm for nonsmooth functions involving analytic features, Math. Program. 116, 2009. https://doi.org/10.1007/s10107-007-0133-5
  • P. Ochs, Y. Chen, T. Brox, T. Pock, iPiano: Inertial proximal algorithm for nonconvex optimization, SIAM J. Imaging Sci. 7, 2014. https://doi.org/10.1137/130942954
14 thms2 active usersReviewed
CombinatoricsComplexity TheoryOptimization+1·Captain: mikedeng1

A Comment on "Computational Complexity of Stochastic Programming Problems" 2: The Expected Recourse Value of (10) Is 1 − Vol(P(S; ⪯)), and a 1/(2k!)-Accurate Value Counts Linear ExtensionsResearch Paper

Why expected recourse is a counting question

A two-stage stochastic program chooses a first action before uncertainty is observed and then takes a recourse action after the observation. Evaluating the expected optimal recourse value can be difficult even when the recourse problem for each fixed observation is a small linear program. This mission isolates the example in Section 3 of Hanasusanto, Kuhn and Wiesemann's preprint: the second-stage program has no first-stage decision at all, yet sufficiently accurate expected values determine how many ways a finite partial order can be arranged into a total order.

The counting connection has a specific history. Brightwell and Winkler (1991) established the complexity of counting linear extensions and related their number to an order-polytope volume. Hanasusanto, Kuhn and Wiesemann use that relation in their October 2015 preprint to establish Theorem 3's strong #P-hardness claim for approximate expected recourse with random recourse coefficients. The mission addresses the exact mathematical relation and the error threshold that support that claim. The complexity-class and encoding parts are outside its Lean statement.

Finite orders, volumes, and program (10)

Let PPP be a finite partially ordered set with k=∣P∣k=|P|k=∣P∣. A linear extension lists its elements in a total order that respects the partial order. The number of these lists is N(P)N(P)N(P). The unit cube is C=[0,1]PC=[0,1]^PC=[0,1]P. Its order polytope is

O(P)={ξ∈C:ξi≤ξj whenever i≤Pj}.O(P)=\{\xi\in C:\xi_i\le\xi_j\text{ whenever }i\le_P j\}.O(P)={ξ∈C:ξi​≤ξj​ whenever i≤P​j}.

Write V(P)V(P)V(P) for the Lebesgue volume of O(P)O(P)O(P). The paper writes S={1,…,k}S=\{1,\ldots,k\}S={1,…,k} and P(S;⪯)P(S;\preceq)P(S;⪯) for this polytope; changing the names of the elements does not change either the count or the volume.

For a realization ξ∈C\xi\in Cξ∈C, define qP(ξ)q_P(\xi)qP​(ξ) as the optimal objective value of the paper's random-recourse program (10). It maximizes a scalar zzz, subject to 0≤z≤10\le z\le10≤z≤1, nonnegative variables yijy_{ij}yij​, and

z≤∑i,j∈P: i≤Pj(ξi−ξj)yij.z\le\sum_{i,j\in P:\,i\le_P j}(\xi_i-\xi_j)y_{ij}.z≤i,j∈P:i≤P​j∑​(ξi​−ξj​)yij​.

The sum includes reflexive pairs, for which the summand is zero. The expected recourse value is Q(P)=∫CqP(ξ) dξQ(P)=\int_C q_P(\xi)\,d\xiQ(P)=∫C​qP​(ξ)dξ. Lebesgue measure of CCC is one, so this integral is the expectation under the uniform distribution on the cube. The program is feasible for every ξ\xiξ: y=0y=0y=0 and z=0z=0z=0 are allowed. Its objective is bounded by one because z≤1z\le1z≤1. These details give the value a genuine finite meaning at every realization.

Formalization targets

The first target is the exact value of the second stage for every ξ∈C\xi\in Cξ∈C:

qP(ξ)=1C∖O(P)(ξ).q_P(\xi)=\mathbf 1_{C\setminus O(P)}(\xi).qP​(ξ)=1C∖O(P)​(ξ).

Consequently, the expected recourse value satisfies the displayed identity in the proof of Theorem 3:

Q(P)=1−V(P).Q(P)=1-V(P).Q(P)=1−V(P).

The counting target quoted in the proof of Lemma 3 is

N(P)=k! V(P).N(P)=k!\,V(P).N(P)=k!V(P).

Lemma 3's rounding step concerns an approximation ϑ\varthetaϑ of V(P)V(P)V(P). If ∣ϑ−V(P)∣≤ε|\vartheta-V(P)|\le\varepsilon∣ϑ−V(P)∣≤ε and 0≤ε<1/(2k!)0\le\varepsilon<1/(2k!)0≤ε<1/(2k!), then ∣k!ϑ−N(P)∣<1/2|k!\vartheta-N(P)|<1/2∣k!ϑ−N(P)∣<1/2. The mission's main goal uses an approximation of Q(P)Q(P)Q(P), as in Theorem 3. Under the same strict error threshold,

∣ϑ−Q(P)∣≤ε⟹∣k!(1−ϑ)−N(P)∣<12.|\vartheta-Q(P)|\le\varepsilon \quad\Longrightarrow\quad \left|k!(1-\vartheta)-N(P)\right|<\frac12.∣ϑ−Q(P)∣≤ε⟹∣k!(1−ϑ)−N(P)∣<21​.

The target leaves no independent dimension parameter or unspecified oracle value: kkk is the cardinality of the very poset used in program (10), and ϑ\varthetaϑ must approximate that program's expected value. The strict half-unit bound makes N(P)N(P)N(P) the unique nearest integer to k!(1−ϑ)k!(1-\vartheta)k!(1−ϑ).

What the result provides

The theorem shows that an accurate numerical answer to the expected-recourse question contains an exact combinatorial count. This explains why a routine second-stage linear optimization problem can lead to a difficult expectation problem: the expectation records the volume of a polytope whose geometry encodes all linear extensions. The page's threshold specifies precisely how much accuracy is needed to recover the count; a coarser estimate does not support the same rounding conclusion. The original paper also explains why its instance yields strong #P-hardness: the coefficients needed for its random-recourse representation are only −1-1−1, 000, and 111 in the continuation of Theorem 3's proof.

Formalizing the reduction's mathematical claims produces reusable interfaces for order-polytopes, their volumes, and the expectation of this recourse program. It also poses the factorial volume identity as a theorem rather than treating it as a free assumption. The published Prove2Me definition FCP.Order.LinearExtensions already represents the same linear-extension object and is reused here. The five theorem statements in this proposal are open proof obligations; the existence of the published definition is not a claim that these results already have machine-checked proofs. Proofs of the pointwise value, the expectation identity, the volume identity, and the rounding consequences are welcome.

Where the difficulty lies

For a fixed realization, the program's yijy_{ij}yij​ variables have no upper bounds. That feature makes its value jump between zero and one according to whether the order inequalities hold. The pointwise characterization does not by itself settle the expectation: the set where the value changes must be represented measurably, and the integral is over the unit cube with its normalized mass. The factorial relation is a separate geometric statement about the order polytope. Simply counting its defining inequalities gives neither its volume nor the number of linear extensions. These are the substantive steps behind the short rounding calculation.

Formalization scope and conventions

Lean uses a finite type with a PartialOrder in place of the paper's labeled set S={1,…,k}S=\{1,\ldots,k\}S={1,…,k}. The published FCP.Order.LinearExtensions definition counts order-preserving bijections from this type to the positions 0,…,k−10,\ldots,k-10,…,k−1. It has exactly the paper's meaning of a compatible permutation. The cube and order polytope are sets of real-valued functions on that finite type. Volume is volume converted to a real number; expected recourse is the Lebesgue integral over the cube. The cube has mass one, including when PPP is empty, and the results include that edge case.

The reusable cube, order polytope, volume, and linear-extension count form a separate definition module. The paper's second-stage program imports that module and defines only its own feasible levels, optimal value, and expected recourse.

The second-stage program is encoded through its feasible objective levels and their real supremum. Since zero is feasible and every feasible level is at most one, the supremum cannot use Lean's default value for an empty or unbounded real set. Classical decidability selects the comparable pairs in the finite sum. Accuracy means an absolute-error inequality with a nonnegative ε\varepsilonε and a strict threshold ε<1/(2k!)\varepsilon<1/(2k!)ε<1/(2k!). These choices preserve both the page's feasibility and its rounding margin.

The main goal is the correctness of the reduction in Theorem 3. It does not formalize #P, strong #P-hardness, pseudo-polynomial running time, unary encodings, or bit lengths. A formulation that assumes Q(P)=1−V(P)Q(P)=1-V(P)Q(P)=1−V(P) or N(P)=k!V(P)N(P)=k!V(P)N(P)=k!V(P) in the goal would erase the result's content; those are separate milestone theorems. Reusable work includes the finite-order volume identity and measure-theoretic handling of the indicator on the cube. The preprint's Section 3 supplies every object and convention used here.

Selected references

  • G. A. Hanasusanto, D. Kuhn, and W. Wiesemann, A comment on “computational complexity of stochastic programming problems”, Optimization Online preprint 2015/03/4825, version of October 6, 2015, pp. 10–12. Preprint.
  • G. Brightwell and P. Winkler, Counting linear extensions, Order 8(3), 225–242, 1991. DOI.
8 thms2 active usersReviewed
🏆Completed
Numerical AnalysisOptimization·Captain: mikedeng1

The Proximal Alternating Direction Method of Multipliers in the Nonconvex Setting: Convergence Analysis and Rates 1: Bounded Iterates Converge to a KKT Point with Finite Length Under the KL PropertyResearch Paper

Motivation

Many problems in signal processing, statistics and machine learning are of the form min⁡x{g(Ax)+h(x)}\min_x \{g(Ax)+h(x)\}minx​{g(Ax)+h(x)}: a smooth data-fitting term hhh, plus a possibly nonsmooth and nonconvex regularizer ggg applied to a linear image AxAxAx of the variable. Examples are total-variation-type penalties with nonconvex potentials, ℓ0\ell_0ℓ0​-type sparsity terms, and constraints Ax∈CAx\in CAx∈C with CCC nonconvex. The alternating direction method of multipliers (ADMM) treats ggg and hhh separately, which makes it the method of choice for this class. For convex problems its convergence theory is classical. For nonconvex problems it was long used as a heuristic, and the Kurdyka–Łojasiewicz (KŁ) framework of Attouch, Bolte, Redont, Soubeyran and Svaiter, and of Bolte, Sabach and Teboulle, is now the standard tool for proving that such methods converge.

Timeline. Li and Pong (SIAM J. Optim. 2015) proved global convergence of a proximal ADMM with ρ=1\rho=1ρ=1 for twice differentiable hhh under a KŁ hypothesis. Hong, Luo and Razaviyayn (SIAM J. Optim. 2016) studied related nonconvex ADMM schemes under other assumptions. Boţ and Nguyen (arXiv:1801.01994v2, Math. Oper. Res. 45(2), 2020) extended this in three directions. Their scheme uses variable metrics M1kM_1^kM1k​, M2kM_2^kM2k​. It allows a relaxation parameter ρ∈(0,2)\rho\in(0,2)ρ∈(0,2) in the dual step. It covers both a proximal and a proximal-linearized xxx-update. Under these conditions they proved that bounded iterates have finite length and converge to a KKT point whenever a regularized augmented Lagrangian has the KŁ property. This mission formalizes that theorem.

Setting

Let g:Rm→R∪{+∞}g:\mathbb R^m\to\mathbb R\cup\{+\infty\}g:Rm→R∪{+∞} be proper and lower semicontinuous, let h:Rn→Rh:\mathbb R^n\to\mathbb Rh:Rn→R be differentiable with LLL-Lipschitz gradient, and let A:Rn→RmA:\mathbb R^n\to\mathbb R^mA:Rn→Rm be linear. The augmented Lagrangian with parameter r>0r>0r>0 is

Lr(x,z,y)=g(z)+h(x)+⟨y,Ax−z⟩+r2∥Ax−z∥2.L_r(x,z,y)=g(z)+h(x)+\langle y,Ax-z\rangle+\tfrac r2\|Ax-z\|^2 .Lr​(x,z,y)=g(z)+h(x)+⟨y,Ax−z⟩+2r​∥Ax−z∥2.

Let M1kM_1^kM1k​ and M2kM_2^kM2k​ be symmetric positive semidefinite matrices, and write ∥v∥M2=⟨Mv,v⟩\|v\|_M^2=\langle Mv,v\rangle∥v∥M2​=⟨Mv,v⟩. Fix 0<ρ<20<\rho<20<ρ<2. From an arbitrary starting point (x0,z0,y0)(x^0,z^0,y^0)(x0,z0,y0), Algorithm 1 generates

  • zk+1∈arg⁡min⁡z{g(z)+⟨yk,Axk−z⟩+r2∥Axk−z∥2+12∥z−zk∥M2k2}z^{k+1}\in\arg\min_z\{g(z)+\langle y^k,Ax^k-z\rangle+\frac r2\|Ax^k-z\|^2+\frac12\|z-z^k\|^2_{M_2^k}\}zk+1∈argminz​{g(z)+⟨yk,Axk−z⟩+2r​∥Axk−z∥2+21​∥z−zk∥M2k​2​},
  • xk+1∈arg⁡min⁡x{h(x)+⟨yk,Ax−zk+1⟩+r2∥Ax−zk+1∥2+12∥x−xk∥M1k2}x^{k+1}\in\arg\min_x\{h(x)+\langle y^k,Ax-z^{k+1}\rangle+\frac r2\|Ax-z^{k+1}\|^2+\frac12\|x-x^k\|^2_{M_1^k}\}xk+1∈argminx​{h(x)+⟨yk,Ax−zk+1⟩+2r​∥Ax−zk+1∥2+21​∥x−xk∥M1k​2​},
  • yk+1=yk+ρr(Axk+1−zk+1)y^{k+1}=y^k+\rho r(Ax^{k+1}-z^{k+1})yk+1=yk+ρr(Axk+1−zk+1).

Algorithm 2 is the same, except that h(x)h(x)h(x) in the xxx-update is replaced by its linearization ⟨x−xk,∇h(xk)⟩\langle x-x^k,\nabla h(x^k)\rangle⟨x−xk,∇h(xk)⟩. Assumption 1 asks for four things:

  1. ggg and hhh are bounded below;
  2. AAA is surjective;
  3. μi=sup⁡k∥Mik∥<∞\mu_i=\sup_k\|M_i^k\|<\inftyμi​=supk​∥Mik​∥<∞;
  4. r≥4T0L>0r\ge4T_0L>0r≥4T0​L>0 and 2M1k+rA∗A⪰(L+CM/r)Id2M_1^k+rA^*A\succeq(L+C_M/r)\mathrm{Id}2M1k​+rA∗A⪰(L+CM​/r)Id, where T0T_0T0​ and CMC_MCM​ are explicit in ρ\rhoρ, LLL, μ1\mu_1μ1​ and λmin⁡(AA∗)\lambda_{\min}(AA^*)λmin​(AA∗).

With the constants T1T_1T1​ and C1C_1C1​ of §2.2 of the paper, the regularized augmented Lagrangian is

Fr(x,z,y,x′,y′)=Lr(x,z,y)+T1∥A∗(y−y′)∥2+C12∥x−x′∥2.F_r(x,z,y,x',y')=L_r(x,z,y)+T_1\|A^*(y-y')\|^2+\tfrac{C_1}2\|x-x'\|^2 .Fr​(x,z,y,x′,y′)=Lr​(x,z,y)+T1​∥A∗(y−y′)∥2+2C1​​∥x−x′∥2.

A KKT point of the problem is a triple (x^,z^,y^)(\hat x,\hat z,\hat y)(x^,z^,y^​) with −A∗y^=∇h(x^)-A^*\hat y=\nabla h(\hat x)−A∗y^​=∇h(x^), y^∈∂g(z^)\hat y\in\partial g(\hat z)y^​∈∂g(z^) and z^=Ax^\hat z=A\hat xz^=Ax^, where ∂\partial∂ is the limiting subdifferential. A proper lower semicontinuous Ψ\PsiΨ is a KŁ function if, near every point of dom⁡∂Ψ\operatorname{dom}\partial\Psidom∂Ψ, a concave desingularizing function φ\varphiφ satisfies φ′(Ψ(u)−Ψ(u^))dist⁡(0,∂Ψ(u))≥1\varphi'(\Psi(u)-\Psi(\hat u))\operatorname{dist}(0,\partial\Psi(u))\ge1φ′(Ψ(u)−Ψ(u^))dist(0,∂Ψ(u))≥1.

Formalization targets

Goal: Theorem 14

Under Assumption 1, let {(xk,zk,yk)}\{(x^k,z^k,y^k)\}{(xk,zk,yk)} be a bounded sequence generated by Algorithm 1 or Algorithm 2. If FrF_rFr​ is a KŁ function, then

∑k≥0∥xk+1−xk∥<∞,∑k≥0∥zk+1−zk∥<∞,∑k≥0∥yk+1−yk∥<∞,\sum_{k\ge0}\|x^{k+1}-x^k\|<\infty,\quad\sum_{k\ge0}\|z^{k+1}-z^k\|<\infty,\quad\sum_{k\ge0}\|y^{k+1}-y^k\|<\infty,k≥0∑​∥xk+1−xk∥<∞,k≥0∑​∥zk+1−zk∥<∞,k≥0∑​∥yk+1−yk∥<∞,

and (xk,zk,yk)→(x^,z^,y^)(x^k,z^k,y^k)\to(\hat x,\hat z,\hat y)(xk,zk,yk)→(x^,z^,y^​) for some KKT point (x^,z^,y^)(\hat x,\hat z,\hat y)(x^,z^,y^​).

Milestones

The milestones follow the order in which the paper's proof uses them:

  1. the descent lemma (Remark 1, already proved on the platform);
  2. the monotonicity inequality for Lr+T1∥A∗Δy∥2L_r+T_1\|A^*\Delta y\|^2Lr​+T1​∥A∗Δy∥2 (Lemma 4);
  3. the increment estimates (Lemma 5);
  4. the Lyapunov property and convergence of FkF_kFk​ (Theorem 7);
  5. explicit subgradients of LrL_rLr​ and FrF_rFr​ with bounds (Lemma 8, Lemma 9, Corollary 10);
  6. the limit-set properties (Lemmas 11 and 12);
  7. the uniformized KŁ property (Lemma 13, shared with the PALM mission);
  8. a summability lemma for three-step recursions (Lemma 3).

Theorem 6, the boundedness of the iterates under coercivity, is included as a supporting item that discharges the boundedness hypothesis.

Significance

The theorem gives global convergence of the whole sequence, not just subsequences, for a broad family of nonconvex splitting methods. The family includes full-splitting variants, in which M1k=tkId−rA∗AM_1^k=t_k\mathrm{Id}-rA^*AM1k​=tk​Id−rA∗A makes the xxx-update explicit. The KŁ hypothesis on FrF_rFr​ holds, for example, whenever ggg and hhh are semi-algebraic. The finite length conclusion is also the starting point for the rates of Section 3 of the paper, which are the subject of the companion mission.

The paper result is proved; this mission formalizes the known proof. As far as the platform records go, no machine-checked proof of convergence of a nonconvex ADMM exists. The Li–Pong ADMM theorems on the platform are open statements about a different algorithm. A completed development would supply the following reusable pieces:

  • the Lyapunov analysis of a variable-metric ADMM with relaxed dual step;
  • subdifferential calculus for an augmented Lagrangian on a product space;
  • a second instance of the generic KŁ finite-length argument.

Difficulty

The obvious Lyapunov candidate, LrL_rLr​ itself, does not decrease along the iterates: the dual step increases it by 1ρr∥yk+1−yk∥2\frac1{\rho r}\|y^{k+1}-y^k\|^2ρr1​∥yk+1−yk∥2. That increase has to be paid for by primal progress, and this is possible only because surjectivity of AAA lets the dual increment be controlled by xxx-increments over two consecutive steps. This is where the specific constants T0T_0T0​, T1T_1T1​, C1C_1C1​ and the coupling condition (15) come from. The KŁ argument must therefore be run on the lifted function FrF_rFr​ in five variables, whose subgradient bound (Corollary 10) involves three past increments and two telescoping terms. The textbook one-step KŁ argument therefore does not apply directly, and the recursion has to be closed with the three-step summability Lemma 3. For ρ≠1\rho\ne1ρ=1 the dual update is relaxed, and the estimates must handle ∣1−ρ∣|1-\rho|∣1−ρ∣ in both regimes ρ<1\rho<1ρ<1 and ρ>1\rho>1ρ>1.

Formalization scope

Spaces are EuclideanSpace ℝ (Fin n), and products such as Rn×Rm×Rm\mathbb R^n\times\mathbb R^m\times\mathbb R^mRn×Rm×Rm and the 5-fold domain of FrF_rFr​ are nested WithLp 2 products. Their norm is the Euclidean product norm the paper uses, not the sup norm. The function ggg and the functions LrL_rLr​, FrF_rFr​ take values in EReal. The data are bundled in a structure Data, and the algorithm is a parameter Variant (prox for Algorithm 1, linearized for Algorithm 2), so every statement covers both algorithms. A run is a relation: any minimizer may be selected at each step, and existence of minimizers is not claimed. λmin⁡(AA∗)\lambda_{\min}(AA^*)λmin​(AA∗) and μ1,μ2\mu_1,\mu_2μ1​,μ2​ are replaced by parameters with the inequalities the proofs use (lam ∥y∥2≤∥A∗y∥2\mathrm{lam}\,\|y\|^2\le\|A^*y\|^2lam∥y∥2≤∥A∗y∥2 with lam>0\mathrm{lam}>0lam>0, and ∥Mik∥≤μi\|M_i^k\|\le\mu_i∥Mik​∥≤μi​). The paper's statements are the instance lam=λmin⁡(AA∗)\mathrm{lam}=\lambda_{\min}(AA^*)lam=λmin​(AA∗), μi=sup⁡k∥Mik∥\mu_i=\sup_k\|M_i^k\|μi​=supk​∥Mik​∥. The subdifferential is the published limiting subdifferential, and "KŁ function" is the published IsKLFunction. In that definition, dist⁡(0,∂Ψ(u))\operatorname{dist}(0,\partial\Psi(u))dist(0,∂Ψ(u)) is read as a bound for every subgradient, so dist⁡(0,∅)=+∞\operatorname{dist}(0,\emptyset)=+\inftydist(0,∅)=+∞. Corrections read past: the paper indexes {Fk}k≥0\{F_k\}_{k\ge0}{Fk​}k≥0​ although FkF_kFk​ exists only for k≥1k\ge1k≥1, and it writes "defined in Assumption 1" for T1T_1T1​ and C1C_1C1​, which are defined on p. 10.

There are three ways to formalize the statement trivially, and all are excluded:

  • a run predicate that no sequence satisfies, or a junk value making T0=0T_0=0T0​=0 so that Assumption 1 cannot hold (a sorry-free check shows that Assumption 1 and the run relation are jointly satisfiable for both algorithms);
  • a KŁ hypothesis on an arbitrary function: the hypothesis is on the specific FrF_rFr​ built from T1T_1T1​ and C1C_1C1​;
  • the weaker conclusion "x^\hat xx^ is stationary": the conclusion is the full KKT triple.

Contributions are welcome at every milestone. Lemma 3 and the subdifferential calculus behind Lemmas 8–9 are independent of the algorithm, and are good entry points.

Selected references

  • R. I. Boţ, D.-K. Nguyen, The proximal alternating direction method of multipliers in the nonconvex setting: convergence analysis and rates, arXiv:1801.01994v2, 2020; Math. Oper. Res. 45(2), 2020. https://arxiv.org/abs/1801.01994, https://doi.org/10.1287/moor.2019.1008
  • J. Bolte, S. Sabach, M. Teboulle, Proximal alternating linearized minimization for nonconvex and nonsmooth problems, Math. Program. 146, 2014. https://doi.org/10.1007/s10107-013-0701-9
  • H. Attouch, J. Bolte, B. F. Svaiter, Convergence of descent methods for semi-algebraic and tame problems, Math. Program. 137, 2013. https://doi.org/10.1007/s10107-011-0484-9
  • G. Li, T. K. Pong, Global convergence of splitting methods for nonconvex composite optimization, SIAM J. Optim. 25(4), 2015. https://doi.org/10.1137/140998135
  • M. Hong, Z.-Q. Luo, M. Razaviyayn, Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems, SIAM J. Optim. 26(1), 2016. https://doi.org/10.1137/140990309
16 thms2 active usersReviewed
Optimal TransportOptimizationProbability·Captain: mikedeng1

Optimal Transport-Based Distributionally Robust Optimization: Structural Properties and Iterative Schemes 1: Mahalanobis-Transport Worst-Case Loss Equals inf over λ ≥ 0 of E_P0[ℓ_rob(β, λ; X)]Research Paper

Motivation

Distributionally robust optimization chooses a decision against a range of plausible probability laws instead of a single fitted law. Here the decision is a linear rule evaluated through a loss function. The range of laws is specified by how much probability mass may be transported away from a baseline law. A conventional transport cost depends only on the displacement. Blanchet, Murthy and Zhang allow the cost of moving a point to depend on its starting location, so the uncertainty model can reflect local information. Their introduction gives a portfolio example: uncertainty about returns may differ across market conditions, and a state dependent cost can encode that difference. The paper develops a dual reformulation as the basis for its later convexity, optimizer, and algorithmic results.

The theorem in this mission is the first structural result of that development. It says that evaluating the worst-case loss does not require optimizing directly over all probability distributions. A dual objective built from the baseline law gives the same value, and its nonnegative scalar multiplier attains the best value. The earlier general transport duality theorem of Blanchet and Murthy is already formalized and proved on Prove2Me; the remaining target here is the state dependent Mahalanobis specialization and its explicit scalar form.

Setting

Let X∈RdX\in\mathbb R^dX∈Rd have a baseline law P0P_0P0​, and let B⊆RdB\subseteq\mathbb R^dB⊆Rd be a convex set of decisions. A decision β∈B\beta\in Bβ∈B incurs loss ℓ(βTX)\ell(\beta^{\mathsf T}X)ℓ(βTX), where ℓ:R→R\ell:\mathbb R\to\mathbb Rℓ:R→R. The transport cost of moving xxx to x′x'x′ is

c(x,x′)=(x−x′)TA(x)(x−x′),c(x,x')=(x-x')^{\mathsf T}A(x)(x-x'),c(x,x′)=(x−x′)TA(x)(x−x′),

where A(x)A(x)A(x) is positive definite at every xxx. Under Assumption 1, ccc is lower semicontinuous, and the eigenvalues of A(x)A(x)A(x) lie between fixed positive bounds ρmin⁡\rho_{\min}ρmin​ and ρmax⁡\rho_{\max}ρmax​ for P0P_0P0​-almost every xxx. Since AAA depends on the starting point, ccc need not be symmetric. For two laws P0P_0P0​ and PPP, Dc(P0,P)D_c(P_0,P)Dc​(P0​,P) is the least expected cost among couplings whose first and second marginals are P0P_0P0​ and PPP. The ambiguity set at radius δ>0\delta>0δ>0 consists of laws satisfying Dc(P0,P)≤δD_c(P_0,P)\le\deltaDc​(P0​,P)≤δ. The paper writes the worst-case loss as an equivalent supremum over couplings with first marginal P0P_0P0​ and cost at most δ\deltaδ (§2.1, p. 9).

For x,β∈Rdx,\beta\in\mathbb R^dx,β∈Rd, write qA(β,x)=βTA(x)−1βq_A(\beta,x)=\beta^{\mathsf T}A(x)^{-1}\betaqA​(β,x)=βTA(x)−1β. The paper introduces a pointwise robust loss from

F(γ,β,λ;x)=ℓ(βTx+γδ qA(β,x))−λδ(γ2qA(β,x)−1),F(\gamma,\beta,\lambda;x)=\ell\bigl(\beta^{\mathsf T}x+\gamma\sqrt\delta\,q_A(\beta,x)\bigr)-\lambda\sqrt\delta\bigl(\gamma^2q_A(\beta,x)-1\bigr),F(γ,β,λ;x)=ℓ(βTx+γδ​qA​(β,x))−λδ​(γ2qA​(β,x)−1),

by setting ℓrob(β,λ;x)=sup⁡γ∈RF(γ,β,λ;x)\ell_{\rm rob}(\beta,\lambda;x)=\sup_{\gamma\in\mathbb R}F(\gamma,\beta,\lambda;x)ℓrob​(β,λ;x)=supγ∈R​F(γ,β,λ;x) and fδ(β,λ)=EP0[ℓrob(β,λ;X)]f_\delta(\beta,\lambda)=E_{P_0}[\ell_{\rm rob}(\beta,\lambda;X)]fδ​(β,λ)=EP0​​[ℓrob​(β,λ;X)]. This expectation may be extended real. These are the objects of display (7) and Theorem 1 on p. 10.

Formalization targets

The goal is Theorem 1 of the paper. If ℓ\ellℓ is upper semicontinuous and the baseline loss is integrable, then for each β∈B\beta\in Bβ∈B,

sup⁡P: Dc(P0,P)≤δEP[ℓ(βTX)]=inf⁡λ≥0fδ(β,λ),\sup_{P:\,D_c(P_0,P)\le\delta}E_P[\ell(\beta^{\mathsf T}X)]=\inf_{\lambda\ge0}f_\delta(\beta,\lambda),P:Dc​(P0​,P)≤δsup​EP​[ℓ(βTX)]=λ≥0inf​fδ​(β,λ),

and a multiplier λ∗(β)≥0\lambda^*(\beta)\ge0λ∗(β)≥0 attains the infimum. The target retains the state dependence of AAA, the full range of β\betaβ in BBB, and the possible extended value of the worst-case loss. It asserts both the value identity and attainment; the latter is part of the printed theorem.

The milestone list follows the paper's proof on p. 32: the previously proved general strong duality theorem, the quadratic minimum under a linear constraint, and pointwise equality (25) between the transport envelope and ℓrob\ell_{\rm rob}ℓrob​. The quadratic minimum is stated with attainment. The pointwise equality includes β=0\beta=0β=0 and records the change from the original transport multiplier to the scaled multiplier used in FFF.

Significance

The formula replaces a search over probability laws with a scalar outer optimization and an expectation under P0P_0P0​. That representation is the paper's starting point for examining the shape of fδf_\deltafδ​, locating dual optimizers, describing worst-case laws, and designing iterative schemes. Without a faithful dual identity, those later claims would concern a function whose connection to the original distributional problem had not been established (Theorems 2–7).

The general Blanchet–Murthy strong duality theorem has a machine-checked proof on Prove2Me. This mission supplies the specialized model, the quadratic reduction, and the equality with the paper's fδf_\deltafδ​. Those declarations can then serve as a stable interface for the remaining missions in this series. The current goal and its new milestones are open Lean statements; the paper result itself is proved in the cited work.

Difficulty

The general duality theorem returns a dual problem whose envelope is a supremum over destination points in Rd\mathbb R^dRd. The paper's formula instead uses one scalar γ\gammaγ, and its multiplier is scaled by δ\sqrt\deltaδ​. Showing that these describe the same value requires controlling a positive definite quadratic cost with a state dependent matrix at every starting point. At β=0\beta=0β=0, the hyperplane formula used in the nonzero case has a zero denominator, while equation (25) remains meaningful. Extended values also matter: the pointwise supremum can be infinite, and replacing it with a real-valued approximation could alter the theorem.

Formalization scope

Vectors are EuclideanSpace ℝ (Fin d), laws are Borel probability measures, and matrices are real positive definite matrices. The local Setting definition fixes ccc, qAq_AqA​, FFF, ℓrob\ell_{\rm rob}ℓrob​, and fδf_\deltafδ​ using the paper's notation. The worst-case objective reuses the published coupling form ModelRiskOT.Duality.primalValue; its feasible plans already enforce the first marginal and cost budget. EReal carries the primal value, pointwise supremum, integral, and outer infimum. The extended integral is the published ModelRiskOT.Duality.extIntegral, with its documented convention for a difference of two infinite parts. The multiplier ranges over λ≥0\lambda\ge0λ≥0, and δ>0\delta>0δ>0 is explicit so its square root can be used in the rescaling.

The goal retains the paper's standing convexity of BBB, Assumption 1, and β∈B\beta\in Bβ∈B. It adds integrability of x↦ℓ(βTx)x\mapsto\ell(\beta^{\mathsf T}x)x↦ℓ(βTx), required by the cited general duality theorem but omitted from the printed Theorem 1. This addition is disclosed so the statement's scope is clear. The goal equates the primal worst-case loss with the explicit infimum of fδf_\deltafδ​ and asserts attainment; an identity between two dual notations would leave the main claim unaddressed. Contributions to the positive definite quadratic minimization, the pointwise envelope equality, and their connection to the general duality theorem are in scope. The shared Setting layer is intended for reuse in the later convexity and worst-case-law missions.

Selected references

  • J. Blanchet, K. Murthy and F. Zhang, Optimal Transport-Based Distributionally Robust Optimization: Structural Properties and Iterative Schemes, Mathematics of Operations Research 47(2), 2022. arXiv:1810.02403v3
  • J. Blanchet and K. Murthy, Quantifying Distributional Model Risk via Optimal Transport, Mathematics of Operations Research 44(2), 2019. arXiv:1604.01446v2
12 thms2 active usersReviewed
Algorithmic Game TheoryConvex OptimizationOptimization+1·Captain: mikedeng1

On Synchronous, Asynchronous, and Randomized Best-Response Schemes for Stochastic Nash Games 2: Randomized Inexact Best Response Reaches an ϵ-NE in Explicitly Bounded Expected SG StepsResearch Paper

Motivation

Many noncooperative problems in communication networks, power markets and supply chains are stochastic Nash games. Each player minimizes an expected cost that depends on its own decision and on the decisions of its rivals, and the expectation can only be sampled, not evaluated. A natural distributed way to compute an equilibrium is the best-response scheme: each player repeatedly replies optimally to the rivals' current strategies. In a stochastic game an exact best response is itself an expectation-valued optimization problem, so a practical scheme replies inexactly, running a few stochastic gradient steps per reply. Lei, Shanbhag, Pang and Sen (arXiv:1704.04578v2; Mathematics of Operations Research, 2020) analyse three such inexact proximal best-response schemes: synchronous, randomized and asynchronous. For each they prove a linear rate of convergence and a bound on the total number of projected stochastic gradient steps.

This mission concerns the randomized scheme. In large games it is unrealistic for all players to update at every round; in the paper's model each player independently decides to update with probability pip_ipi​. This is the game-theoretic analogue of randomized block-coordinate descent (Nesterov 2012; Richtárik–Takáč 2014). A local Poisson clock per player is a special case (Remark 5 of the paper). The synchronous scheme, the paper's Theorem 1, and the asynchronous scheme are separate missions of this series.

Setting

There are N≥1N \ge 1N≥1 players. Player iii chooses xix_ixi​ in a compact convex set Xi⊆RniX_i \subseteq \mathbb R^{n_i}Xi​⊆Rni​ and minimizes

fi(xi,x−i)=E[ψi(xi,x−i;ξ)],f_i(x_i, x_{-i}) = \mathbb E\big[\psi_i(x_i, x_{-i}; \xi)\big],fi​(xi​,x−i​)=E[ψi​(xi​,x−i​;ξ)],

where ξ\xiξ is a random vector and the oracle returns sampled gradients ∇xiψi(x;ξ)\nabla_{x_i}\psi_i(x; \xi)∇xi​​ψi​(x;ξ) with E∥∇xiψi∥2≤Mi2\mathbb E\|\nabla_{x_i}\psi_i\|^2 \le M_i^2E∥∇xi​​ψi​∥2≤Mi2​ (Assumption 1). A Nash equilibrium x∗x^*x∗ is a profile in X=∏iXiX = \prod_i X_iX=∏i​Xi​ from which no player can lower its cost by deviating alone.

For μ>0\mu > 0μ>0 the proximal best response to a profile yyy is

x^i(y)=argmin⁡xi∈Xi[fi(xi,y−i)+μ2∥xi−yi∥2].\widehat x_i(y) = \operatorname*{argmin}_{x_i \in X_i}\Big[f_i(x_i, y_{-i}) + \tfrac{\mu}{2}\|x_i - y_i\|^2\Big].xi​(y)=xi​∈Xi​argmin​[fi​(xi​,y−i​)+2μ​∥xi​−yi​∥2].

The N×NN\times NN×N matrix Γ\GammaΓ has entries γii=μ/(μ+ζi,min⁡)\gamma_{ii} = \mu/(\mu + \zeta_{i,\min})γii​=μ/(μ+ζi,min​) and γij=ζij,max⁡/(μ+ζi,min⁡)\gamma_{ij} = \zeta_{ij,\max}/(\mu + \zeta_{i,\min})γij​=ζij,max​/(μ+ζi,min​), built from the extreme curvatures ζi,min⁡=inf⁡Xλmin⁡(∇xi2fi)\zeta_{i,\min} = \inf_X \lambda_{\min}(\nabla^2_{x_i}f_i)ζi,min​=infX​λmin​(∇xi​2​fi​) and ζij,max⁡=sup⁡X∥∇xixj2fi∥\zeta_{ij,\max} = \sup_X\|\nabla^2_{x_ix_j}f_i\|ζij,max​=supX​∥∇xi​xj​2​fi​∥. Assumption 2 is a=∥Γ∥<1a = \|\Gamma\| < 1a=∥Γ∥<1 (spectral norm).

Algorithm 2. At major iteration kkk, each player iii flips an independent coin χi,k∈{0,1}\chi_{i,k} \in \{0,1\}χi,k​∈{0,1} with P(χi,k=1)=pi>0\mathbb P(\chi_{i,k} = 1) = p_i > 0P(χi,k​=1)=pi​>0, independent of the past information Fk\mathcal F_kFk​ (Assumption 3). If χi,k=1\chi_{i,k} = 1χi,k​=1, the player replaces xi,kx_{i,k}xi,k​ by an inexact proximal best response xi,k+1∈Xix_{i,k+1} \in X_ixi,k+1​∈Xi​ with

E[∥xi,k+1−x^i(xk)∥2∣Fk]≤αi,k2;\mathbb E\big[\|x_{i,k+1} - \widehat x_i(x_k)\|^2 \mid \mathcal F_k\big] \le \alpha_{i,k}^2;E[∥xi,k+1​−xi​(xk​)∥2∣Fk​]≤αi,k2​;

otherwise xi,k+1=xi,kx_{i,k+1} = x_{i,k}xi,k+1​=xi,k​. The accuracy αi,k=ηβi,k+1\alpha_{i,k} = \eta^{\beta_{i,k}+1}αi,k​=ηβi,k​+1 is tied to the number of updates βi,k=∑l<kχi,l\beta_{i,k} = \sum_{l<k}\chi_{i,l}βi,k​=∑l<k​χi,l​ the player has made so far. The reply is computed by ji,k=⌈Qi/η2(βi,k+1)⌉j_{i,k} = \lceil Q_i/\eta^{2(\beta_{i,k}+1)}\rceilji,k​=⌈Qi​/η2(βi,k​+1)⌉ projected stochastic gradient steps

zi,t+1=ΠXi[zi,t−γt(∇xiψi(zi,t,x−i,k;ξi,kt)+μ(zi,t−xi,k))],γt=1μ(t+1),z_{i,t+1} = \Pi_{X_i}\big[z_{i,t} - \gamma_t\big(\nabla_{x_i}\psi_i(z_{i,t}, x_{-i,k}; \xi^t_{i,k}) + \mu(z_{i,t} - x_{i,k})\big)\big],\qquad \gamma_t = \tfrac{1}{\mu(t+1)},zi,t+1​=ΠXi​​[zi,t​−γt​(∇xi​​ψi​(zi,t​,x−i,k​;ξi,kt​)+μ(zi,t​−xi,k​))],γt​=μ(t+1)1​,

from zi,1=xi,kz_{i,1} = x_{i,k}zi,1​=xi,k​, where Qi=2Mi2/μ2+2DXi2Q_i = 2M_i^2/\mu^2 + 2D_{X_i}^2Qi​=2Mi2​/μ2+2DXi​2​ and DXiD_{X_i}DXi​​ is the diameter of XiX_iXi​. The analysis uses the weighted norm ∥x∥P2=∑i∥xi∥2/pi\|x\|_P^2 = \sum_i \|x_i\|^2/p_i∥x∥P2​=∑i​∥xi​∥2/pi​ and the constants a~2=1−pmin⁡(1−a2)\tilde a^2 = 1 - p_{\min}(1 - a^2)a~2=1−pmin​(1−a2), η~2=1−pmin⁡(1−η2)\tilde\eta^2 = 1 - p_{\min}(1 - \eta^2)η~​2=1−pmin​(1−η2) and η~0−2=pmax⁡(η−2−1)+1\tilde\eta_0^{-2} = p_{\max}(\eta^{-2} - 1) + 1η~​0−2​=pmax​(η−2−1)+1.

Formalization targets

Goal: Theorem 2, (34)

Let c~=max⁡{a~,η~}\tilde c = \max\{\tilde a, \tilde\eta\}c~=max{a~,η~​}, q~∈(c~,1)\tilde q \in (\tilde c, 1)q~​∈(c~,1), D=1/(eln⁡(q~/c~))D = 1/(e\ln(\tilde q/\tilde c))D=1/(eln(q~​/c~)), C~=C(∑iN−1pi−1)1/2\tilde C = C(\sum_i N^{-1}p_i^{-1})^{1/2}C~=C(∑i​N−1pi−1​)1/2, D~=Dη/η~\tilde D = D\eta/\tilde\etaD~=Dη/η~​ and ϵ~=ϵ/((Npmax⁡)1/2(C~+D~))∈(0,1)\tilde\epsilon = \epsilon/((Np_{\max})^{1/2}(\tilde C + \tilde D)) \in (0,1)ϵ~=ϵ/((Npmax​)1/2(C~+D~))∈(0,1), where ∥xi,0−xi∗∥≤C\|x_{i,0} - x_i^*\| \le C∥xi,0​−xi∗​∥≤C. After K=⌈ln⁡(1/ϵ~)/ln⁡(1/q~)⌉K = \lceil\ln(1/\tilde\epsilon)/\ln(1/\tilde q)\rceilK=⌈ln(1/ϵ~)/ln(1/q~​)⌉ major iterations, xKx_KxK​ is an ϵ\epsilonϵ-NE2_22​, i.e. E(∑i∥xi,K−xi∗∥2)1/2≤ϵ\mathbb E\big(\sum_i\|x_{i,K} - x_i^*\|^2\big)^{1/2} \le \epsilonE(∑i​∥xi,K​−xi∗​∥2)1/2≤ϵ, and for every player

E[∑k=0K−1ji,kχi,k]≤piQiη2η~02ln⁡(1/η~02)(1ϵ~)ln⁡(1/η~02)/ln⁡(1/q~)+⌈ln⁡(1/ϵ~)ln⁡(1/q~)⌉.\mathbb E\Big[\sum_{k=0}^{K-1} j_{i,k}\chi_{i,k}\Big] \le \frac{p_iQ_i}{\eta^2\tilde\eta_0^2\ln(1/\tilde\eta_0^2)}\Big(\frac1{\tilde\epsilon}\Big)^{\ln(1/\tilde\eta_0^2)/\ln(1/\tilde q)} + \Big\lceil\frac{\ln(1/\tilde\epsilon)}{\ln(1/\tilde q)}\Big\rceil.E[k=0∑K−1​ji,k​χi,k​]≤η2η~​02​ln(1/η~​02​)pi​Qi​​(ϵ~1​)ln(1/η~​02​)/ln(1/q~​)+⌈ln(1/q~​)ln(1/ϵ~)​⌉.

Milestones

In the order the proof uses them:

  1. the Γ\GammaΓ-contraction (5);
  2. its Euclidean form (9);
  3. the fixed-point identity x^(x∗)=x∗\widehat x(x^*) = x^*x(x∗)=x∗;
  4. the one-step descent (A.3) and its contraction form (B.1) in ∥⋅∥P\|\cdot\|_P∥⋅∥P​;
  5. the binomial moments (B.3) and (36) of η±2βi,k\eta^{\pm2\beta_{i,k}}η±2βi,k​;
  6. the elementary inequalities Lemma 2 (zcz≤Dqzzc^z \le Dq^zzcz≤Dqz) and (30) (a geometric sum bounded by an integral);
  7. the linear rate, Lemma 5: E∥xk−x∗∥P≤N(C~+D~)q~k\mathbb E\|x_k - x^*\|_P \le \sqrt N(\tilde C + \tilde D)\tilde q^kE∥xk​−x∗∥P​≤N​(C~+D~)q~​k;
  8. its transfer to the unweighted error, Remark 6;
  9. the inner-loop bound, Lemma 6: E[∥zi,t−x^i(yk)∥2∣Fk]≤Qi/(t+1)\mathbb E[\|z_{i,t} - \widehat x_i(y_k)\|^2 \mid \mathcal F_k] \le Q_i/(t+1)E[∥zi,t​−xi​(yk​)∥2∣Fk​]≤Qi​/(t+1).

Significance

Theorem 2 gives an explicit, non-asymptotic sample complexity for computing a Nash equilibrium of a stochastic game when only a random subset of players acts at each round. Its exponent ln⁡(1/η~02)/ln⁡(1/q~)\ln(1/\tilde\eta_0^2)/\ln(1/\tilde q)ln(1/η~​02​)/ln(1/q~​) quantifies the price of randomization: Remark 7 of the paper shows it reduces to the synchronous exponent exactly when every pi=1p_i = 1pi​=1. Lemma 5 is the first linear-rate statement for inexact randomized best responses in this setting. The weighted-norm argument of App. A–B is the device that makes block-randomized fixed-point iterations contract.

The results are proved on paper. None of them has a machine-checked proof, and the platform holds no stochastic Nash game, proximal best-response map or randomized best-response scheme. A formal proof checks every constant of (34), including the interplay of the random inexactness ηβi,k+1\eta^{\beta_{i,k}+1}ηβi,k​+1 with the random number of steps ji,kj_{i,k}ji,k​. The paper does not prove (5): it adapts it from Facchinei–Pang 2009. A formal proof of (5) closes that gap.

Difficulty

The conditional-expectation bookkeeping is where a naive argument fails. The accuracy αi,k\alpha_{i,k}αi,k​ and the step count ji,kj_{i,k}ji,k​ are random, being functions of the past coins. The coin χi,k\chi_{i,k}χi,k​ must be independent of both the past and the samples the player uses in round kkk. The descent step (A.4) multiplies the coin with the inexactness error, and its factorization uses exactly this joint independence. Bounding the expected work requires the moment generating identities (B.3) and (36) of a binomial count, with two different constants η~\tilde\etaη~​ (through pmin⁡p_{\min}pmin​) and η~0\tilde\eta_0η~​0​ (through pmax⁡p_{\max}pmax​). Merging them gives a false bound. Lemma 6 is a stochastic approximation estimate conditional on Fk\mathcal F_kFk​, at a random, Fk\mathcal F_kFk​-measurable centre x^i(xk)\widehat x_i(x_k)xi​(xk​). Applying the unconditional O(1/t)O(1/t)O(1/t) bound for strongly convex SGD pointwise is not enough. On the deterministic side, (5) needs a mean-value argument along a segment in the product space, using the mixed Hessian blocks.

Formalization scope

Players are Fin N and player iii's space is EuclideanSpace ℝ (Fin (n i)). Costs are functions of the whole profile. The Euclidean norm of the vector of block norms and the weighted norm ∥⋅∥P\|\cdot\|_P∥⋅∥P​ are written out explicitly, since Lean's norm on the product type is the sup norm. ∥Γ∥\|\Gamma\|∥Γ∥ is the operator norm on Euclidean RN\mathbb R^NRN. ζi,min⁡\zeta_{i,\min}ζi,min​ is an infimum of Rayleigh quotients. The proximal best response is any map satisfying the argmin property on XXX. ΠXi\Pi_{X_i}ΠXi​​ is any map satisfying the published SpectralProjGrad.Shared.IsProjOnto. Randomness lives on a probability space with a filtration (Fk)(\mathcal F_k)(Fk​), and conditional expectations are Mathlib's condExp.

Statement repairs, all recorded in the items' Formalization Notes:

  • Starting point. x0x_0x0​ is deterministic, with ∥xi,0−xi∗∥≤C\|x_{i,0} - x_i^*\| \le C∥xi,0​−xi∗​∥≤C. The proof's bound ∥x0−x∗∥P≤C(∑ipi−1)1/2\|x_0 - x^*\|_P \le C(\sum_i p_i^{-1})^{1/2}∥x0​−x∗∥P​≤C(∑i​pi−1​)1/2 fails for a random start with only a first-moment bound.
  • Regularity. fif_ifi​ is C2C^2C2 jointly in the profile on a neighbourhood of XXX, which the mixed blocks of (4) require.
  • Independence. Assumption 3 is read as χi,k\chi_{i,k}χi,k​ independent of Fk\mathcal F_kFk​ together with player iii's round-kkk samples (or candidate), as step (A.4) needs.
  • Sampling. Samples are drawn for every player at every round and used only when χi,k=1\chi_{i,k} = 1χi,k​=1; in law this is the paper's scheme.
  • Range of ϵ~\tilde\epsilonϵ~. ϵ~<1\tilde\epsilon < 1ϵ~<1 is assumed.
  • Integrability. Every expectation hypothesis carries an integrability condition.
  • DDD. DDD reads 1/ln⁡((q/c)e)1/\ln((q/c)^e)1/ln((q/c)e) as 1/(eln⁡(q/c))1/(e\ln(q/c))1/(eln(q/c)).
  • Excluded. Statement (35), the case η=a\eta = aη=a, is not formalized.

A formalization in which the coins are almost surely 111 is the synchronous scheme, not this one. Coins and samples here are genuinely random with the stated laws and independence, and the expectation bounding the work is taken over both.

Reusable infrastructure includes the conditional O(1/t)O(1/t)O(1/t) bound for projected SGD on strongly convex problems (Lemma 6), the binomial moment identities (B.3)/(36), and Lemma 2 and (30). Contributions of intermediate lemmas, such as (A.4)–(A.5), (B.2) and the measurability of the iterates, are welcome as separate theorems.

Selected references

  • J. Lei, U. V. Shanbhag, J.-S. Pang, S. Sen, On Synchronous, Asynchronous, and Randomized Best-Response Schemes for Stochastic Nash Games, arXiv:1704.04578v2, 2018 (Mathematics of Operations Research, 2020). https://arxiv.org/abs/1704.04578v2
  • F. Facchinei, J.-S. Pang, Nash equilibria: the variational approach, in Convex Optimization in Signal Processing and Communications, Cambridge University Press, 2009. https://doi.org/10.1017/CBO9780511804458.013
  • Y. Nesterov, Efficiency of coordinate descent methods on huge-scale optimization problems, SIAM Journal on Optimization 22(2), 2012. https://doi.org/10.1137/100802001
  • P. Richtárik, M. Takáč, Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function, Mathematical Programming 144, 2014. https://doi.org/10.1007/s10107-012-0614-z
  • H. Robbins, S. Monro, A stochastic approximation method, Annals of Mathematical Statistics 22, 1951. https://doi.org/10.1214/aoms/1177729586
21 thms2 active usersReviewed
Algorithmic Game TheoryConvex OptimizationOptimization+1·Captain: mikedeng1

On Synchronous, Asynchronous, and Randomized Best-Response Schemes for Stochastic Nash Games 3: Asynchronous Inexact Best Response with Delays Reaches an ϵ-NE in Explicitly Bounded SG StepsResearch Paper

Motivation

Many equilibrium problems in operations research have the form of a stochastic Nash game: each of NNN players minimizes an expected cost that depends on the strategies of the others, and the expectation can only be sampled. The paper's introduction lists applications in generation-capacity and power markets and in communication networks (Abada, de Maere d'Aertrycke and Smeers, 2017; Başar, 2007). A natural way to compute an equilibrium is a best-response scheme: each player repeatedly re-optimizes against the current strategies of its rivals. In a large network the players cannot synchronize. They update at different times and see their rivals' strategies with delays.

Lei, Shanbhag, Pang and Sen (arXiv:1704.04578v2; Mathematics of Operations Research, 2020) analyze inexact proximal best-response schemes in three regimes: synchronous, randomized and asynchronous. This mission formalizes the asynchronous one (§5 and Appendix C). It adapts the partially asynchronous iterations of Bertsekas and Tsitsiklis (1989) to stochastic games with inexact, sampled best responses, and it gives an explicit bound on the number of stochastic gradient steps each player needs.

Setting

Player iii chooses xix_ixi​ in a nonempty compact convex set Xi⊆RniX_i \subseteq \mathbb R^{n_i}Xi​⊆Rni​. A profile is x=(x1,…,xN)∈X=∏iXix = (x_1,\dots,x_N) \in X = \prod_i X_ix=(x1​,…,xN​)∈X=∏i​Xi​. Player iii's cost is fi(xi,x−i)=E[ψi(xi,x−i;ξ)]f_i(x_i, x_{-i}) = \mathbb E[\psi_i(x_i, x_{-i};\xi)]fi​(xi​,x−i​)=E[ψi​(xi​,x−i​;ξ)], which is convex and twice continuously differentiable in a neighbourhood of XXX. A sampling oracle returns ∇xiψi(x;ξ)\nabla_{x_i}\psi_i(x;\xi)∇xi​​ψi​(x;ξ), whose second moment is at most Mi2M_i^2Mi2​ (Assumption 1). A Nash equilibrium x∗x^*x∗ is a profile in which each xi∗x^*_ixi∗​ minimizes fi(⋅,x−i∗)f_i(\cdot, x^*_{-i})fi​(⋅,x−i∗​) over XiX_iXi​.

For μ>0\mu > 0μ>0, the proximal best response of player iii to a profile y∈Xy \in Xy∈X is

x^i(y)=argmin⁡xi∈Xi[fi(xi,y−i)+μ2∥xi−yi∥2].\hat x_i(y) = \operatorname*{argmin}_{x_i \in X_i}\Big[f_i(x_i, y_{-i}) + \tfrac{\mu}{2}\|x_i - y_i\|^2\Big].x^i​(y)=xi​∈Xi​argmin​[fi​(xi​,y−i​)+2μ​∥xi​−yi​∥2].

The curvature constants ζi,min⁡=inf⁡x∈Xλmin⁡(∇xi2fi(x))\zeta_{i,\min} = \inf_{x\in X}\lambda_{\min}(\nabla^2_{x_i}f_i(x))ζi,min​=infx∈X​λmin​(∇xi​2​fi​(x)) and ζij,max⁡=sup⁡x∈X∥∇xixj2fi(x)∥\zeta_{ij,\max} = \sup_{x\in X}\|\nabla^2_{x_ix_j}f_i(x)\|ζij,max​=supx∈X​∥∇xi​xj​2​fi​(x)∥ define the matrix Γ\GammaΓ with γii=μ/(μ+ζi,min⁡)\gamma_{ii} = \mu/(\mu+\zeta_{i,\min})γii​=μ/(μ+ζi,min​) and γij=ζij,max⁡/(μ+ζi,min⁡)\gamma_{ij} = \zeta_{ij,\max}/(\mu+\zeta_{i,\min})γij​=ζij,max​/(μ+ζi,min​). Assumption 5 (strict diagonal dominance) asks ζi,min⁡>∑j≠iζij,max⁡\zeta_{i,\min} > \sum_{j\ne i}\zeta_{ij,\max}ζi,min​>∑j=i​ζij,max​. It makes a∞=∥Γ∥∞a_\infty = \|\Gamma\|_\inftya∞​=∥Γ∥∞​, the maximum absolute row sum, smaller than one.

The asynchronous scheme (Algorithm 3) runs on a deterministic schedule. At time kkk the players in IkI_kIk​ update. Player i∈Iki \in I_ki∈Ik​ sees the outdated profile yki=(x1,k−τi1(k),…,xN,k−τiN(k))y^i_k = (x_{1,k-\tau_{i1}(k)},\dots,x_{N,k-\tau_{iN}(k)})yki​=(x1,k−τi1​(k)​,…,xN,k−τiN​(k)​) and computes xi,k+1∈Xix_{i,k+1} \in X_ixi,k+1​∈Xi​ with

E[∥xi,k+1−x^i(yki)∥2∣Fk]≤αi,k2.\mathbb E\big[\|x_{i,k+1} - \hat x_i(y^i_k)\|^2 \mid \mathcal F_k\big] \le \alpha_{i,k}^2 .E[∥xi,k+1​−x^i​(yki​)∥2∣Fk​]≤αi,k2​.

The other players keep their strategies. Assumption 4 requires every player to update at least once in every B1B_1B1​ consecutive times, and every delay to be at most B2B_2B2​. The accuracy is αi,k=ηβi,k\alpha_{i,k} = \eta^{\beta_{i,k}}αi,k​=ηβi,k​, where βi,k\beta_{i,k}βi,k​ counts player iii's updates so far. The inexact response is computed by ji,k=⌈Qi/η2(k+1)⌉j_{i,k} = \lceil Q_i/\eta^{2(k+1)}\rceilji,k​=⌈Qi​/η2(k+1)⌉ projected stochastic gradient steps (43), with step size 1/(μ(t+1))1/(\mu(t+1))1/(μ(t+1)) and Qi=2Mi2/μ2+2DXi2Q_i = 2M_i^2/\mu^2 + 2D_{X_i}^2Qi​=2Mi2​/μ2+2DXi​2​. Write n0=⌈B2/B1⌉n_0 = \lceil B_2/B_1\rceiln0​=⌈B2​/B1​⌉, ρ=(max⁡{a∞,η})1/(n0+1)\rho = (\max\{a_\infty,\eta\})^{1/(n_0+1)}ρ=(max{a∞​,η})1/(n0​+1) and c=ρ1/B1c = \rho^{1/B_1}c=ρ1/B1​.

Formalization targets

Goal: Theorem 3, (45)

Let q∈(c,1)q \in (c,1)q∈(c,1), D≥1/(eln⁡(q/c))D \ge 1/(e\ln(q/c))D≥1/(eln(q/c)), ϵ>0\epsilon > 0ϵ>0, and

ϵ^=ϵC+D ρB1−1B1<1,\hat\epsilon = \frac{\epsilon}{C+D}\,\rho^{\frac{B_1-1}{B_1}} < 1,ϵ^=C+Dϵ​ρB1​B1​−1​<1,

where E∥xi,0−xi∗∥2≤C2\mathbb E\|x_{i,0}-x^*_i\|^2 \le C^2E∥xi,0​−xi∗​∥2≤C2. After K=⌈ln⁡(1/ϵ^)/ln⁡(1/q)⌉K = \lceil \ln(1/\hat\epsilon)/\ln(1/q)\rceilK=⌈ln(1/ϵ^)/ln(1/q)⌉ major iterations, max⁡iE∥xi,K−xi∗∥≤ϵ\max_i \mathbb E\|x_{i,K}-x^*_i\| \le \epsilonmaxi​E∥xi,K​−xi∗​∥≤ϵ, and player iii has taken at most

ℓi(1)(η)=Qiη4ln⁡(1/η2)(1ϵ^)ln⁡(1/η2)ln⁡(1/q)+⌈ln⁡(1/ϵ^)ln⁡(1/q)⌉\ell^{(1)}_i(\eta) = \frac{Q_i}{\eta^4\ln(1/\eta^2)}\Big(\frac1{\hat\epsilon}\Big)^{\frac{\ln(1/\eta^2)}{\ln(1/q)}} + \Big\lceil\frac{\ln(1/\hat\epsilon)}{\ln(1/q)}\Big\rceilℓi(1)​(η)=η4ln(1/η2)Qi​​(ϵ^1​)ln(1/q)ln(1/η2)​+⌈ln(1/q)ln(1/ϵ^)​⌉

projected gradient steps.

Milestones

In the order the proof uses them:

  • the Γ\GammaΓ-contraction (5) of the proximal best response;
  • the fixed-point identity xi∗=x^i(x∗)x^*_i = \hat x_i(x^*)xi∗​=x^i​(x∗);
  • a∞<1a_\infty < 1a∞​<1 under Assumption 5;
  • its expected ∞\infty∞-norm form (40), E∥x^i(y)−xi∗∥≤a∞max⁡jE∥yj−xj∗∥\mathbb E\|\hat x_i(y)-x^*_i\| \le a_\infty\max_j\mathbb E\|y_j-x^*_j\|E∥x^i​(y)−xi∗​∥≤a∞​maxj​E∥yj​−xj∗​∥;
  • the one-step recursion (C.2) and the delay step (C.3) of Appendix C;
  • Lemma 2, zcz≤Dqzzc^z \le Dq^zzcz≤Dqz;
  • Lemma 7, the rate
max⁡iE∥xi,k−xi∗∥≤(C+k)ρ⌊k/B1⌋,max⁡iE∥xi,k−xi∗∥≤ρ−B1−1B1(C+D)qk;\max_i\mathbb E\|x_{i,k}-x^*_i\| \le (C+k)\rho^{\lfloor k/B_1\rfloor},\qquad \max_i\mathbb E\|x_{i,k}-x^*_i\| \le \rho^{-\frac{B_1-1}{B_1}}(C+D)q^k;imax​E∥xi,k​−xi∗​∥≤(C+k)ρ⌊k/B1​⌋,imax​E∥xi,k​−xi∗​∥≤ρ−B1​B1​−1​(C+D)qk;
  • Lemma 8, the Qi/(t+1)Q_i/(t+1)Qi​/(t+1) mean-square error of the inner stochastic approximation loop;
  • the summation bound (30).

Significance

Theorem 3 makes the cost of asynchrony explicit. Bounded delays and a bounded update window enter only through the rate per window, max⁡{a∞,η}1/(n0+1)\max\{a_\infty,\eta\}^{1/(n_0+1)}max{a∞​,η}1/(n0​+1). The overall effort stays polynomial in 1/ϵ1/\epsilon1/ϵ, and the paper's Table 1 summarizes the exponent as 2B1(1+⌈B2/B1⌉)+δ2B_1(1+\lceil B_2/B_1\rceil)+\delta2B1​(1+⌈B2​/B1​⌉)+δ for a suitable choice of qqq. The result connects classical partially asynchronous fixed-point theory with the sample-complexity analysis of stochastic approximation. Lemma 7 holds for any inexact solver that achieves the accuracy (38), not only for the stochastic gradient loop, so it applies to other subproblem solvers as well.

The paper proves these results by hand. As far as is known, no part of them has been machine-checked: there is no formal treatment of stochastic Nash games, of proximal best-response maps, or of asynchronous iterations with delays in Mathlib or on this platform. A formalization would check the induction over windows in Appendix C, whose index bookkeeping has several printed slips. It would also make precise which properties of the delays the argument needs.

Difficulty

The obvious argument does not carry over from the synchronous case. There, one step of the scheme contracts the whole error vector by aaa in one norm. Here a step updates only some players, and each of them uses information up to B2B_2B2​ steps old. No single step contracts anything. The proof has to show that every window of B1B_1B1​ steps contracts the worst-case expected error by a factor ρ\rhoρ, with the delays absorbed into the root 1/(n0+1)1/(n_0+1)1/(n0​+1). This requires a nested induction with case distinctions on the window position (Appendix C). The analysis also mixes three layers: a deterministic contraction of the exact best response; conditional expectations, Jensen's inequality and adaptedness for the inexact responses; and an O(1/t)O(1/t)O(1/t) stochastic-approximation bound for the inner loop, which in turn needs strong convexity, the first-order optimality conditions and nonexpansiveness of the projection.

Formalization scope

Players are indexed by Fin N. Player iii's space is EuclideanSpace ℝ (Fin (n i)), and costs are functions of the whole profile: fi(z,y−i)f_i(z, y_{-i})fi​(z,y−i​) is f i (Function.update y i z). The projection ΠXi\Pi_{X_i}ΠXi​​ is any map satisfying the published predicate SpectralProjGrad.Shared.IsProjOnto. The proximal best response is a map constrained by an argmin predicate on XXX. ζi,min⁡\zeta_{i,\min}ζi,min​ and ζij,max⁡\zeta_{ij,\max}ζij,max​ are Rayleigh-quotient infima and suprema of second Fréchet derivatives, and ∥Γ∥∞\|\Gamma\|_\infty∥Γ∥∞​ is the maximum absolute row sum. The probability space carries a filtration (Fk)(\mathcal F_k)(Fk​) to which the iterates are adapted. The inner-loop σ\sigmaσ-algebras σ{Fk,ξi,k[t−1]}\sigma\{\mathcal F_k,\xi^{[t-1]}_{i,k}\}σ{Fk​,ξi,k[t−1]​} are parameters satisfying the inclusions the proof uses. Conditional expectations are Mathlib's condExp.

Statement repairs and implicit hypotheses, each recorded in the item it affects:

  • Deterministic delays. Assumption 4(c) allows random delays, but step (C.5) of the proof bounds an expectation at a random past time by the maximum over past times. That step is valid only when the delays do not depend on the iterates. The delays here are deterministic functions τij(k)≤k\tau_{ij}(k) \le kτij​(k)≤k with τii(k)=0\tau_{ii}(k) = 0τii​(k)=0.
  • Oracle second moment. Lemma 8 prints ψi\psi_iψi​ for ∇xiψi\nabla_{x_i}\psi_i∇xi​​ψi​, and its hypothesis E[∥∇xiψi∥2∣⋅]=∥∇xifi∥2\mathbb E[\|\nabla_{x_i}\psi_i\|^2\mid\cdot] = \|\nabla_{x_i}f_i\|^2E[∥∇xi​​ψi​∥2∣⋅]=∥∇xi​​fi​∥2 forces zero noise. The bound ≤Mi2\le M_i^2≤Mi2​ that the proof uses replaces it.
  • Regularity. Joint C2C^2C2 regularity of fif_ifi​ is assumed, which the mixed Hessian blocks in Γ\GammaΓ need, and XiX_iXi​ is nonempty.
  • Constants. Theorem 3 assumes C≥0C \ge 0C≥0 and ϵ^<1\hat\epsilon < 1ϵ^<1. Its "D≥/ln⁡((q/c)e)D \ge /\ln((q/c)^e)D≥/ln((q/c)e)" is read as D≥1/(eln⁡(q/c))D \ge 1/(e\ln(q/c))D≥1/(eln(q/c)), as in Lemma 7.
  • Step count. Theorem 3 counts the steps over player iii's update times; the proof's bound is for the larger sum over all times.

The special case B1=1B_1 = 1B1​=1, B2=0B_2 = 0B2​=0 of Theorem 3, Corollary 3 (cyclic updates) and Theorem 4 are not stated.

The goal cannot be met trivially. The schedule is a parameter, not "every player at every step". The sampled gradients may be genuinely random, since the second-moment hypothesis is an inequality. x^\hat xx^ is tied to fif_ifi​ by its argmin property, and x∗x^*x∗ is a Nash equilibrium. Each expectation in a conclusion is of a bounded measurable quantity, so it cannot vanish by non-integrability.

The development needs the following:

  • the contraction (5), which the paper only cites from Facchinei and Pang (2009, §12.6.1) and which uses the mean-value theorem along segments in XXX;
  • strong-convexity optimality conditions on convex sets;
  • nonexpansiveness of Euclidean projections;
  • conditional Jensen and tower arguments;
  • an integer-index induction over windows.

The projection and strong-convexity lemmas, and (5) itself, are reusable for the synchronous and randomized missions of this series. Proofs of individual milestones, or of general Mathlib-level facts such as the first-order optimality condition over a convex set, are welcome.

Selected references

  • J. Lei, U. V. Shanbhag, J.-S. Pang, S. Sen, On Synchronous, Asynchronous, and Randomized Best-Response Schemes for Stochastic Nash Games, arXiv:1704.04578v2, 2018; Mathematics of Operations Research, 2020, https://doi.org/10.1287/moor.2018.0986. https://arxiv.org/abs/1704.04578v2
  • D. P. Bertsekas, J. N. Tsitsiklis, Parallel and Distributed Computation: Numerical Methods, Prentice Hall, 1989 (reference [9] of the paper).
  • F. Facchinei, J.-S. Pang, Nash equilibria: the variational approach, in Convex Optimization in Signal Processing and Communications, Cambridge University Press, 2009 (reference [19] of the paper).
  • I. Abada, G. de Maere d'Aertrycke, Y. Smeers, On the multiplicity of solutions in generation capacity investment models with incomplete markets, Mathematical Programming 165(1):5–69, 2017 (reference [1] of the paper).
18 thms2 active usersReviewed
🏆Completed
Convex OptimizationOptimization·Captain: mikedeng1

Proximal Algorithms II: The Proximal Operator of a Norm Is v − λΠ_B(v/λ), B the Unit Ball of the Dual NormResearch Paper

Motivation

Norms are the most common nonsmooth terms in convex optimization models. The ℓ1\ell_1ℓ1​ norm promotes sparsity in the lasso and in compressed sensing, the Euclidean norm of blocks of variables promotes group sparsity in the group lasso, and the nuclear norm promotes low rank. First-order methods for such models, notably the proximal gradient method, ADMM and their accelerated and parallel variants, handle a norm term through a single operation: its proximal operator. Each iteration of these methods needs prox⁡λ∥⋅∥(v)\operatorname{prox}_{\lambda\|\cdot\|}(v)proxλ∥⋅∥​(v) for some point vvv and step λ>0\lambda>0λ>0, so a description of this operator for an arbitrary norm is needed in practice.

The monograph of N. Parikh and S. Boyd, Proximal Algorithms (Found. Trends Optim. 1(3), 2014), records this description twice. In §2.5 it derives it from Moreau decomposition, and in §6.5 it states the general scaled form: the proximal operator of a norm is the identity minus a scaled Euclidean projection onto the unit ball of the dual norm. The underlying decomposition is due to J.-J. Moreau (Proximité et dualité dans un espace hilbertien, Bull. SMF 93, 1965). The norm case is standard in convex analysis texts; Parikh and Boyd present it as the bridge between proximal operators of norms and projections onto norm balls.

Setting

Work in Rn\mathbb R^nRn with the Euclidean inner product zTxz^TxzTx and Euclidean norm ∥⋅∥2\|\cdot\|_2∥⋅∥2​.

A function f:Rn→R∪{+∞}f:\mathbb R^n\to\mathbb R\cup\{+\infty\}f:Rn→R∪{+∞} is closed proper convex if its epigraph {(x,t)∣f(x)≤t}\{(x,t)\mid f(x)\le t\}{(x,t)∣f(x)≤t} is a nonempty closed convex set. For such fff and λ>0\lambda>0λ>0, the proximal operator is

prox⁡λf(v)=argmin⁡x(f(x)+12λ∥x−v∥22),\operatorname{prox}_{\lambda f}(v)=\operatorname*{argmin}_x\Big(f(x)+\tfrac{1}{2\lambda}\|x-v\|_2^2\Big),proxλf​(v)=xargmin​(f(x)+2λ1​∥x−v∥22​),

which has a unique minimizer for every vvv. The convex conjugate is f∗(y)=sup⁡x(yTx−f(x))f^*(y)=\sup_x\big(y^Tx-f(x)\big)f∗(y)=supx​(yTx−f(x)). For a set CCC, the indicator function ICI_CIC​ is 000 on CCC and +∞+\infty+∞ off CCC, and the Euclidean projection onto a nonempty closed convex CCC is ΠC(v)=argmin⁡x∈C∥x−v∥2\Pi_C(v)=\operatorname{argmin}_{x\in C}\|x-v\|_2ΠC​(v)=argminx∈C​∥x−v∥2​.

Let ∥⋅∥\|\cdot\|∥⋅∥ be a general norm on Rn\mathbb R^nRn, possibly different from ∥⋅∥2\|\cdot\|_2∥⋅∥2​. Its dual norm and the dual unit ball are

∥z∥∗=sup⁡{zTx∣∥x∥≤1},B={x∣∥x∥∗≤1}.\|z\|_*=\sup\{z^Tx\mid \|x\|\le 1\},\qquad \mathcal B=\{x\mid \|x\|_*\le 1\}.∥z∥∗​=sup{zTx∣∥x∥≤1},B={x∣∥x∥∗​≤1}.

In the Lean development the space is EuclideanSpace ℝ (Fin n), the general norm is a seminorm N with the definiteness hypothesis IsNorm N, ∥z∥∗\|z\|_*∥z∥∗​ is dualNorm N z, B\mathcal BB is dualBall N, ICI_CIC​ is indicator C, and f=∥⋅∥f=\|\cdot\|f=∥⋅∥ is normFun N.

Formalization targets

Goal: (6.8), §6.5, p. 187

For every general norm f=∥⋅∥f=\|\cdot\|f=∥⋅∥ on Rn\mathbb R^nRn, every λ>0\lambda>0λ>0 and every v∈Rnv\in\mathbb R^nv∈Rn,

prox⁡λf(v)=v−λ ΠB(v/λ).\operatorname{prox}_{\lambda f}(v)=v-\lambda\,\Pi_{\mathcal B}(v/\lambda).proxλf​(v)=v−λΠB​(v/λ).

Stated as: v−λw=prox⁡λf(v)v-\lambda w=\operatorname{prox}_{\lambda f}(v)v−λw=proxλf​(v) if and only if w=ΠB(v/λ)w=\Pi_{\mathcal B}(v/\lambda)w=ΠB​(v/λ), for all v,wv,wv,w.

Milestones, in attack order

  1. Moreau decomposition (2.4), p. 133: v=prox⁡f(v)+prox⁡f∗(v)v=\operatorname{prox}_f(v)+\operatorname{prox}_{f^*}(v)v=proxf​(v)+proxf∗​(v) for closed proper convex fff. This is the published, proved theorem MoreauProx.Decomposition.moreau_decomposition.
  2. §2.5, p. 134: for a norm, f∗=IBf^*=I_{\mathcal B}f∗=IB​ as functions on all of Rn\mathbb R^nRn.
  3. §2.5, p. 134: the case λ=1\lambda=1λ=1, v=prox⁡f(v)+ΠB(v)v=\operatorname{prox}_f(v)+\Pi_{\mathcal B}(v)v=proxf​(v)+ΠB​(v).
  4. (6.7), p. 187: prox⁡λf(v)=v−λprox⁡f∗/λ(v/λ)\operatorname{prox}_{\lambda f}(v)=v-\lambda\operatorname{prox}_{f^*/\lambda}(v/\lambda)proxλf​(v)=v−λproxf∗/λ​(v/λ) for a general norm fff and λ>0\lambda>0λ>0, as printed.

Significance

The goal reduces evaluating the proximal operator of any norm to projecting onto one convex set, the unit ball of the dual norm. All the familiar closed forms are instances: soft thresholding for ℓ1\ell_1ℓ1​ (whose dual ball is the ℓ∞\ell_\inftyℓ∞​ box), block soft thresholding for ∥⋅∥2\|\cdot\|_2∥⋅∥2​ (whose dual ball is the Euclidean ball), and the ℓ∞\ell_\inftyℓ∞​ prox via projection onto the ℓ1\ell_1ℓ1​ ball. Conversely, it lets a projection onto a norm ball be computed from the norm's proximal operator. Milestone 4, the scaled Moreau decomposition, is here stated for norms; its general form is an identity used throughout splitting methods whenever a dual or conjugate prox is cheaper than the primal one.

The results are classical and proved in the literature; the work here is formalization. Moreau's decomposition is already formalized on the platform (Moreau 1965 series, proved). Several norm-specific corollaries are posed as open problems in other series: soft thresholding (BoydADMM.Prox.prox_l1_eq_softThreshold), block soft thresholding (BoydADMM.L1.group_lasso_z_update) and projection onto a Euclidean ball (Pegasos.Analysis.projBall_isProj). A proof of the goal here gives a uniform route to such statements for any norm. The general-norm statements, the conjugate of a norm and the scaled decomposition are not formalized elsewhere on the platform.

Difficulty

The derivation in the monograph is two lines, but each line hides a step. Computing f∗f^*f∗ for a norm requires the inequality yTx≤∥x∥ ∥y∥∗y^Tx\le\|x\|\,\|y\|_*yTx≤∥x∥∥y∥∗​ and, for ∥y∥∗>1\|y\|_*>1∥y∥∗​>1, a direction along which yTx−∥x∥y^Tx-\|x\|yTx−∥x∥ grows without bound; the dual norm is a supremum, so finiteness and attainment have to be argued from finite dimensionality and definiteness of the norm. The scaling step requires knowing how the conjugate and the proximal operator transform under f↦λff\mapsto\lambda ff↦λf and v↦v/λv\mapsto v/\lambdav↦v/λ, in extended-real arithmetic where +∞+\infty+∞ values must be tracked. The proximal operator of an indicator being the projection is an unfolding of definitions, but the minimizer predicates on both sides must be matched, including the factor 12\tfrac1221​ and squared versus unsquared distances.

A tempting shortcut is to work only with the Euclidean norm, where B\mathcal BB is the Euclidean unit ball; that proves a special case, not the goal.

Formalization scope

  • Space and norms. Rn\mathbb R^nRn is EuclideanSpace ℝ (Fin n) for arbitrary nnn, including n=0n=0n=0. The general norm is an arbitrary Seminorm ℝ (EuclideanSpace ℝ (Fin n)) with definiteness (IsNorm); the Euclidean norm of the space is used only in the proximal objective and the projection, as in (1.1) and (1.3).
  • Extended values. Functions Rn→R∪{+∞}\mathbb R^n\to\mathbb R\cup\{+\infty\}Rn→R∪{+∞} take values in EReal. The dual norm is computed in EReal as the supremum of the printed set, so it has no junk value. λf\lambda fλf and f∗/λf^*/\lambdaf∗/λ are products with the positive reals λ\lambdaλ, λ−1\lambda^{-1}λ−1, and λ>0\lambda>0λ>0 is a hypothesis everywhere (p. 124).
  • Proximal operator and projection as predicates. "x=prox⁡g(z)x=\operatorname{prox}_g(z)x=proxg​(z)" is IsProx g z x (xxx minimizes 12∥u−z∥22+g(u)\tfrac12\|u-z\|_2^2+g(u)21​∥u−z∥22​+g(u)) and "x=ΠC(z)x=\Pi_C(z)x=ΠC​(z)" is IsProj C z x. With g=λfg=\lambda fg=λf, Moreau's objective 12∥u−z∥22+λf(u)\tfrac12\|u-z\|_2^2+\lambda f(u)21​∥u−z∥22​+λf(u) is λ\lambdaλ times the objective of (1.2), so it has the same minimizers. Both minimizers exist and are unique, so an equivalence over all candidate points states the printed equations exactly.
  • Standing assumption. Every function whose proximal operator appears is closed proper convex (p. 124); a norm is, so no statement needs an extra hypothesis. Every statement, milestone 4 included, is about a general norm, as on the page.
  • Ruling out trivializations. The dual unit ball is defined through the printed supremum sup⁡{zTx∣∥x∥≤1}\sup\{z^Tx\mid\|x\|\le1\}sup{zTx∣∥x∥≤1}, never by a closed form or as "the set that makes (6.8) hold", and the projection is not pre-solved.
  • Imported objects. The conjugate conj, IsProx and IsProj come from the published Moreau 1965 series definitions MoreauProx.Decomposition.ConvexDuality and MoreauProx.Decomposition.Cones.
  • Source. The PDF used is the authors' copy of the published monograph in the journal's format (printed pages 123–231); page numbers are those of this copy.

Useful contributions include lemmas on conjugates of positively homogeneous functions, on the behaviour of IsProx under scaling, and the identity prox⁡IC=ΠC\operatorname{prox}_{I_C}=\Pi_CproxIC​​=ΠC​ in the predicate form; all are reusable beyond this mission.

Selected references

  • N. Parikh and S. Boyd, Proximal Algorithms, Foundations and Trends in Optimization 1(3), 2014. https://doi.org/10.1561/2400000003
  • J.-J. Moreau, Proximité et dualité dans un espace hilbertien, Bulletin de la Société Mathématique de France 93:273–299, 1965. https://doi.org/10.24033/bsmf.1625
  • H. H. Bauschke and P. L. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, 2nd ed., Springer, 2017. https://doi.org/10.1007/978-3-319-48311-5
  • S. Boyd, N. Parikh, E. Chu, B. Peleato and J. Eckstein, Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers, Foundations and Trends in Machine Learning 3(1), 2011. https://doi.org/10.1561/2200000016
8 thms2 active usersReviewed
OptimizationProbabilityStochastic Systems·Captain: mikedeng1

Asymptotic Optimality of Constant-Order Policies for Lost Sales Inventory Models with Large Lead Times: The Best Constant-Order Policy Costs at Most 1 + ε Times the Optimum Once L ≥ y(ε)Research Paper

Motivation

The lost-sales inventory model with a positive lead time is one of the basic models of inventory theory. A retailer reviews stock once per period, places an order that arrives LLL periods later, and loses (rather than backlogs) any demand that cannot be met from stock on hand. Lost sales are the norm in retail, where a customer facing an empty shelf buys elsewhere. The optimal policy is the solution of a dynamic program whose state is the on-hand inventory together with the whole pipeline of LLL outstanding orders. The state dimension therefore grows with the lead time, and computing the optimal policy is intractable beyond small LLL: for a lead time of four and geometric demand the dynamic program already has 228,581 states (Zipkin 2008a, Operations Research 56(5), 1256–1263).

Heuristics (base-stock, myopic, cost-balancing) have been studied at length. Reiman (2004) analyzed an open-loop policy that orders one unit at fixed intervals in a continuous-review lost-sales model with Poisson demand. Zipkin (2008a) observed numerically that ordering the same constant amount every period performs well already at lead time four. Huh, Janakiraman, Muckstadt and Rusmevichientong (2009) proved that order-up-to policies are asymptotically optimal as the lost-sales penalty grows. Goldberg, Katz-Rogozhnikov, Lu, Sharma and Squillante proved that a constant-order policy is asymptotically optimal as the lead time grows, with an explicit threshold. This mission formalizes that result, Theorem 1 of their paper.

Setting

Fix a holding cost h>0h>0h>0 per unit left over at the end of a period, a lost-demand penalty c>0c>0c>0 per unit of unmet demand, a lead time L≥1L\ge1L≥1, and a horizon T>LT>LT>L. Demands D1,D2,…D_1,D_2,\dotsD1​,D2​,… are i.i.d. with a law D\mathcal DD on [0,∞)[0,\infty)[0,∞) that has a finite third moment and is not deterministic. At the start of period ttt the system holds inventory ItI_tIt​ and a pipeline xt=(x1,t,…,xL,t)\mathbf x_t=(x_{1,t},\dots,x_{L,t})xt​=(x1,t​,…,xL,t​) of outstanding orders. First x1,tx_{1,t}x1,t​ arrives; then an order is placed and joins the end of the pipeline; then DtD_tDt​ is realized, and

It+1=(It+x1,t−Dt)+,Ct=hIt+1+c (It+x1,t−Dt)−.I_{t+1}=(I_t+x_{1,t}-D_t)^+,\qquad C_t=hI_{t+1}+c\,(I_t+x_{1,t}-D_t)^-.It+1​=(It​+x1,t​−Dt​)+,Ct​=hIt+1​+c(It​+x1,t​−Dt​)−.

The system starts empty. A policy chooses each order from the information available before the period's demand, possibly with randomization. Problem (1) is

OPT(L,T)=inf⁡π∑t=L+1T+LE[Ctπ].\mathrm{OPT}(L,T)=\inf_{\pi}\sum_{t=L+1}^{T+L}\mathbb E[C^\pi_t].OPT(L,T)=πinf​t=L+1∑T+L​E[Ctπ​].

For r≥0r\ge0r≥0 let I∞r=sup⁡k≥0(kr−∑i=1kDi)I^r_\infty=\sup_{k\ge0}\big(kr-\sum_{i=1}^kD_i\big)I∞r​=supk≥0​(kr−∑i=1k​Di​), the steady-state waiting time of a GI/D/1 queue. For r<E[D]r<\mathbb E[D]r<E[D] the constant-order policy πr\pi_rπr​ orders the random amount I∞r+rI^r_\infty+rI∞r​+r (drawn independently of the demands) in the first period and rrr in every later period. The best constant is z=arg⁡min⁡v≥0(hE[I∞v]−cv)z=\arg\min_{v\ge0}(h\mathbb E[I^v_\infty]-cv)z=argminv≥0​(hE[I∞v​]−cv) (the smallest minimizer). With QQQ the c/(c+h)c/(c+h)c/(c+h) quantile of D\mathcal DD, g=hE[(Q−D)+]+cE[(D−Q)+]g=h\mathbb E[(Q-D)^+]+c\mathbb E[(D-Q)^+]g=hE[(Q−D)+]+cE[(D−Q)+], σ\sigmaσ the standard deviation and ζ\zetaζ the skewness of DDD, set m=⌈(26(3ζ+c(hσ)−1E[D]+1))2⌉m=\lceil(26(3\zeta+c(h\sigma)^{-1}\mathbb E[D]+1))^2\rceilm=⌈(26(3ζ+c(hσ)−1E[D]+1))2⌉ and

y(ϵ)=max⁡(214h(Q+23/2E[D])(E2[D]+E[D2])3σ−6m3g−1ϵ−1, (12c E[D] g−1((2ch−1)1/2+3))2ϵ−2).y(\epsilon)=\max\Big(2^{14}h(Q+2^{3/2}\mathbb E[D])(\mathbb E^2[D]+\mathbb E[D^2])^3\sigma^{-6}m^3g^{-1}\epsilon^{-1},\ \big(12c\,\mathbb E[D]\,g^{-1}((2ch^{-1})^{1/2}+3)\big)^2\epsilon^{-2}\Big).y(ϵ)=max(214h(Q+23/2E[D])(E2[D]+E[D2])3σ−6m3g−1ϵ−1, (12cE[D]g−1((2ch−1)1/2+3))2ϵ−2).

Formalization targets

Goal: Theorem 1

For all ϵ∈(0,1)\epsilon\in(0,1)ϵ∈(0,1), L≥y(ϵ)L\ge y(\epsilon)L≥y(ϵ) and T≥(1+3ϵ−1)LT\ge(1+3\epsilon^{-1})LT≥(1+3ϵ−1)L,

E[∑t=L+1T+LCtπz] ≤ (1+ϵ) OPT(L,T).\mathbb E\Big[\sum_{t=L+1}^{T+L}C^{\pi_z}_t\Big]\ \le\ (1+\epsilon)\,\mathrm{OPT}(L,T).E[t=L+1∑T+L​Ctπz​​] ≤ (1+ϵ)OPT(L,T).

Milestones

The milestones follow the paper's argument in its order:

  • the cost of LLL consecutive periods from a given state (Lemma 3) and under πr\pi_rπr​ (Lemma 4);
  • a bounded optimal policy (Lemma 5) and the existence of a most favourable state (x∗,I∗)(\mathbf x^*,\mathcal I^*)(x∗,I∗) (§5);
  • lower bounds on the optimal cost over LLL periods (Lemmas 6, 7);
  • random-walk estimates ((26) and Lemma 9) and the per-window gap of πr∗\pi_{r^*}πr∗​, r∗=L−1∑ixi∗r^*=L^{-1}\sum_ix^*_ir∗=L−1∑i​xi∗​ (Theorem 8);
  • an explicit Lipschitz CLT rate (Theorem 11), the separation E[D]−r∗≥12σm−1/2\mathbb E[D]-r^*\ge\frac12\sigma m^{-1/2}E[D]−r∗≥21​σm−1/2 (Lemma 10), and the resulting explicit gap (Corollary 12);
  • the newsvendor bound E[Ctπ]≥g\mathbb E[C^\pi_t]\ge gE[Ctπ​]≥g (§3.1) and the stationary cost of πr\pi_rπr​, (25).

Significance

The theorem says that the policy which ignores the state entirely, ordering the same amount every period after a single randomized first order, loses at most a factor 1+ϵ1+\epsilon1+ϵ against the optimal policy once the lead time exceeds an explicit threshold. The threshold depends only on hhh, ccc and the demand law. Optimal policies are out of computational reach precisely when LLL is large, so this is the first guarantee of near-optimality whose computation does not grow with the lead time. The paper's Corollary 2 (the ratio tends to 111 as L→∞L\to\inftyL→∞) follows directly.

The result is proved in the paper (up to the correction below); this platform holds no formalization of it or of its lemmas. A formalization would produce reusable statements about suprema of random walks with negative drift (Lemma 9, (26)), a quantitative central limit theorem for Lipschitz test functions (Theorem 11), and the finite-horizon lost-sales problem built on the published model of this platform.

Difficulty

The obvious comparison fails. An optimal policy may vary its orders arbitrarily over time, so its pipeline need not look like a constant stream. Comparing it period by period with πr\pi_rπr​ gives nothing, because the inventory of πr\pi_rπr​ is driven by an unbounded random-walk supremum.

The paper instead bounds the optimal cost over any LLL consecutive periods by the cost from the most favourable state. It then has to show that the average r∗r^*r∗ of that state's pipeline stays bounded away from E[D]\mathbb E[D]E[D] uniformly in LLL. This last step is the crux. The components of x∗\mathbf x^*x∗ may vary considerably over the window, and a qualitative central limit theorem is not enough: the argument needs an explicit rate (Theorem 11) with constants that survive summation over LLL windows. On the probabilistic side, the expectations of random indices ikri^r_kikr​ at which random walks attain their maxima are not adapted to the demand filtration. They are controlled only through the distributional identity of Lemma 9 and the geometric tail (26).

Formalization scope

The model is the published CappedBaseStock_Model. Its parameter record supplies L≥1L\ge1L≥1, h>0h>0h>0 and the penalty c>0c>0c>0 (field p; the record is called prm). Its demand law supplies a probability law on [0,∞)[0,\infty)[0,∞) with finite positive mean. The finite third moment and non-determinism are explicit hypotheses. QQQ and ggg are the published newsvendorLevel and backorderCost. The conventions:

  • Time is zero-based: Lean period ttt is the paper's period t+1t+1t+1, and a window starting at Lean t0t_0t0​ is the paper's τ=t0+1\tau=t_0+1τ=t0​+1. Pipeline slot iii is xi+1x_{i+1}xi+1​.
  • Costs, OPT and expectations of nonnegative quantities are lower integrals in [0,∞][0,\infty][0,∞], and I∞rI^r_\inftyI∞r​ is valued in [0,∞][0,\infty][0,∞]. Real expectations appear only for integrable quantities.
  • OPT is the infimum over the model's admissible policies: measurable functions of past demands and a private uniform seed. This class contains the paper's policy class, so OPT is at most the paper's and the goal is at least as strong as the page.
  • "Conditional on xτπ=x\mathbf x^\pi_\tau=\mathbf xxτπ​=x, Iτπ=II^\pi_\tau=\mathcal IIτπ​=I" is rendered by running the system from that state. Lemma 3 states that this integrates back to the policy's cost.
  • Lemmas 6–7, Theorem 8 and Corollary 12 are stated for every policy that almost surely never orders more than QQQ, which includes the paper's optimal πˉ\bar\piπˉ; their proofs use only that bound.
  • πr\pi_rπr​ draws its first order as the quantile function of I∞rI^r_\inftyI∞r​ at the policy's uniform seed.
  • The ratio of Theorem 1 is stated multiplicatively. A ratio would read 000 at OPT=0\mathrm{OPT}=0OPT=0, whereas OPT(L,T)≥Tg>0\mathrm{OPT}(L,T)\ge Tg>0OPT(L,T)≥Tg>0.

A correction. As printed, the second term of y(ϵ)y(\epsilon)y(ϵ) (p. 5) and of Corollary 12 (p. 14) lack a factor E[D]\mathbb E[D]E[D]. The proof of Corollary 12 establishes I∗≤(⌈(2ch−1L)1/2⌉+2)E[D]\mathcal I^*\le(\lceil(2ch^{-1}L)^{1/2}\rceil+2)\mathbb E[D]I∗≤(⌈(2ch−1L)1/2⌉+2)E[D], and the printed bounds are not invariant under rescaling the demand. Both are stated here with the factor restored, and each item's note says so.

Neither a long-run average cost nor a restricted comparator (stationary, Markov, or bounded-order) may replace the finite-horizon OPT. The demand law may not be specialized, and πr\pi_rπr​ may not order rrr in its first period: each change makes the goal a different, easier theorem.

A complete development needs Lindley-type recursions and the stationarity of the GI/D/1 waiting time, Chernoff and moment bounds for random-walk maxima, a Stein-method CLT rate, and the existence of optimal policies for a finite-horizon problem with a continuous state. The random-walk and CLT parts are independent of inventory theory and reusable. Proofs of any milestone are welcome, as are alternative proofs of the goal.

Selected references

  • D. A. Goldberg, D. A. Katz-Rogozhnikov, Y. Lu, M. Sharma, M. S. Squillante, Asymptotic Optimality of Constant-Order Policies for Lost Sales Inventory Models with Large Lead Times, Mathematics of Operations Research, 2016; preprint arXiv:1211.4063v2 (cited version). https://arxiv.org/abs/1211.4063
  • P. Zipkin, Old and New Methods for Lost-Sales Inventory Systems, Operations Research 56(5), 1256–1263, 2008.
  • P. Zipkin, On the Structure of Lost-Sales Inventory Models, Operations Research 56(4), 937–944, 2008.
  • W. T. Huh, G. Janakiraman, J. A. Muckstadt, P. Rusmevichientong, Asymptotic Optimality of Order-Up-To Policies in Lost Sales Inventory Systems, Management Science 55(3), 404–420, 2009.
  • M. Reiman, A New and Simple Policy for a Continuous Review Lost-Sales Inventory Model, unpublished manuscript, 2004.
  • L. H. Y. Chen, Q.-M. Shao, Stein's Method for Normal Approximation, in An Introduction to Stein's Method, 1–59, 2005.
  • S. Asmussen, Applied Probability and Queues, 2nd ed., Springer, 2003.
21 thms2 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: mikedeng1

Constrained Assortment Optimization for the Nested Logit Model 6: Under Space Constraints, the Linear Program (13) over Knapsack-Relaxation Solutions Bounds the Optimal Expected RevenueResearch Paper

Motivation

A retailer that sells products in several categories has to decide which products to put on display. Under the nested logit model a customer first picks a category (a nest) and then a product inside it, so offering a product changes the purchase probabilities of every other product. Choosing the assortment that maximizes expected revenue is assortment optimization, a standard problem of revenue management. Gallego and Topaloglu (Management Science, 2014) study it when every nest carries its own constraint on the assortment. With a limit on the shelf space of each nest the problem is NP-hard even for a single nest, so the paper builds an assortment that is guaranteed to earn at least half of the optimum.

A worst-case factor of two says little about one concrete instance. For its computational study (§7.1) the paper therefore needs, instance by instance, a number that is provably at least the optimal expected revenue, and it obtains one from a linear program, (13), whose constraints come from the linear programming relaxations of knapsack problems. Proposition 7 (Online Supplement A, p. 33) proves that this linear program does give an upper bound. This mission formalizes that proposition.

Setting

There are nests M={1,…,m}M = \{1, \dots, m\}M={1,…,m} and products N={1,…,n}N = \{1, \dots, n\}N={1,…,n} in each nest. Product jjj of nest iii has a preference weight vij>0v_{ij} > 0vij​>0 and a revenue rijr_{ij}rij​ (any real number); v0v_0v0​ is the preference weight of buying nothing, and γi∈(0,1]\gamma_i \in (0, 1]γi​∈(0,1] is the dissimilarity parameter of nest iii. For an assortment Si⊆NS_i \subseteq NSi​⊆N of nest iii put

Vi(Si)=∑j∈Sivij,Ri(Si)=∑j∈SivijrijVi(Si),V_i(S_i) = \sum_{j \in S_i} v_{ij}, \qquad R_i(S_i) = \frac{\sum_{j \in S_i} v_{ij} r_{ij}}{V_i(S_i)},Vi​(Si​)=j∈Si​∑​vij​,Ri​(Si​)=Vi​(Si​)∑j∈Si​​vij​rij​​,

with Ri(0ˉ)=0R_i(\bar 0) = 0Ri​(0ˉ)=0 for the empty assortment 0ˉ\bar 00ˉ. The expected revenue of (S1,…,Sm)(S_1, \dots, S_m)(S1​,…,Sm​) is

Π(S1,…,Sm)=∑i∈MVi(Si)γiRi(Si)v0+∑i∈MVi(Si)γi.\Pi(S_1, \dots, S_m) = \frac{\sum_{i \in M} V_i(S_i)^{\gamma_i} R_i(S_i)}{v_0 + \sum_{i \in M} V_i(S_i)^{\gamma_i}}.Π(S1​,…,Sm​)=v0​+∑i∈M​Vi​(Si​)γi​∑i∈M​Vi​(Si​)γi​Ri​(Si​)​.

Under space constraints product jjj of nest iii uses wijw_{ij}wij​ units of space and nest iii has capacity cic_ici​, with wij≤ciw_{ij} \le c_iwij​≤ci​ for every product, so the feasible assortments are Ci={Si:∑j∈Siwij≤ci}\mathcal C_i = \{S_i : \sum_{j \in S_i} w_{ij} \le c_i\}Ci​={Si​:∑j∈Si​​wij​≤ci​}. Problem (1) is Z∗=max⁡{Π(S1,…,Sm):Si∈Ci ∀i}Z^* = \max\{\Pi(S_1, \dots, S_m) : S_i \in \mathcal C_i \ \forall i\}Z∗=max{Π(S1​,…,Sm​):Si​∈Ci​ ∀i}.

For a scalar uuu, the knapsack problem (10) of nest iii maximizes ∑jvij(rij−u)xj\sum_j v_{ij}(r_{ij} - u) x_j∑j​vij​(rij​−u)xj​ over x∈{0,1}nx \in \{0,1\}^nx∈{0,1}n with ∑jwijxj≤ci\sum_j w_{ij} x_j \le c_i∑j​wij​xj​≤ci​. Its linear programming relaxation allows x∈[0,1]nx \in [0,1]^nx∈[0,1]n. The paper partitions u≥0u \ge 0u≥0 into finitely many intervals Iig\mathcal I_i^gIig​, g∈Gig \in \mathcal G_ig∈Gi​, on each of which one vector xigx_i^gxig​ solves the relaxation. For a fractional vector xxx it writes Vi(x)=∑jvijxjV_i(x) = \sum_j v_{ij} x_jVi​(x)=∑j​vij​xj​ and Ri(x)=∑jvijrijxj/Vi(x)R_i(x) = \sum_j v_{ij} r_{ij} x_j / V_i(x)Ri​(x)=∑j​vij​rij​xj​/Vi​(x).

The linear program (13) in the variables (z,y1,…,ym)(z, y_1, \dots, y_m)(z,y1​,…,ym​) is

min⁡{z:v0z≥∑i∈Myi,  yi≥Vi(xig)γi(Ri(xig)−z)  ∀g∈Gi, i∈M}.\min\Big\{ z : v_0 z \ge \sum_{i \in M} y_i,\ \ y_i \ge V_i(x_i^g)^{\gamma_i}\big(R_i(x_i^g) - z\big)\ \ \forall g \in \mathcal G_i,\ i \in M \Big\}.min{z:v0​z≥i∈M∑​yi​,  yi​≥Vi​(xig​)γi​(Ri​(xig​)−z)  ∀g∈Gi​, i∈M}.

Formalization targets

Goal: Proposition 7

If (z^,y^)(\hat z, \hat y)(z^,y^​) is an optimal solution of (13), then

z^≥Z∗.\hat z \ge Z^*.z^≥Z∗.

Milestones

  1. Every feasible (z,y)(z, y)(z,y) of (13) has yi≥0y_i \ge 0yi​≥0 for all iii (p. 33).
  2. For a nonempty S∈CiS \in \mathcal C_iS∈Ci​ with Ri(S)>zR_i(S) > zRi​(S)>z, u^=γiz+(1−γi)Ri(S)\hat u = \gamma_i z + (1 - \gamma_i) R_i(S)u^=γi​z+(1−γi​)Ri​(S), and a nonzero optimal solution xxx of the relaxation at u^\hat uu^:
Vi(x)γi(Ri(x)−z)≥Vi(S)γi(Ri(S)−z)(pp. 33–34).V_i(x)^{\gamma_i}\big(R_i(x) - z\big) \ge V_i(S)^{\gamma_i}\big(R_i(S) - z\big)\quad\text{(pp. 33–34).}Vi​(x)γi​(Ri​(x)−z)≥Vi​(S)γi​(Ri​(S)−z)(pp. 33–34).
  1. Under the same hypotheses, the zero vector is not an optimal solution of the relaxation at u^\hat uu^ (p. 34).
  2. The claim of the proof: every feasible (z,y)(z, y)(z,y) of (13) satisfies yi≥Vi(Si)γi(Ri(Si)−z)y_i \ge V_i(S_i)^{\gamma_i}(R_i(S_i) - z)yi​≥Vi​(Si​)γi​(Ri​(Si​)−z) for every nest iii and every feasible assortment (pp. 33–34).

Significance

The proposition makes the optimality gaps of §7 meaningful: the expected revenue of any assortment that respects the space constraints, divided by the optimal value of (13), is a certified lower bound on its fraction of Z∗Z^*Z∗. The bound is a linear program with 1+m1 + m1+m variables and one constraint per interval solution, so it can be solved for instances where Z∗Z^*Z∗ itself, an NP-hard quantity, cannot be computed.

The result is proved in the paper; no machine-checked proof of it is known. Formalizing it checks the interplay of three ingredients that the paper treats briefly: the role of the interval solutions xigx_i^gxig​ (only their feasibility and their optimality for every u≥0u \ge 0u≥0 matter), the extension of ViV_iVi​ and RiR_iRi​ to fractional vectors, and the concavity of V↦VγiV \mapsto V^{\gamma_i}V↦Vγi​. A related but different program is Davis, Gallego and Topaloglu's LP (16) (NestedLogitVariants.LP.lp16_upper_bound), which bounds the unconstrained problem by another argument.

Difficulty

The constraints of (13) are indexed by finitely many fractional vectors, while Z∗Z^*Z∗ is attained at an integral assortment that need not be among them. The obvious argument, that (13) is a relaxation of an exact linear-programming formulation of problem (1), does not apply: no constraint of (13) involves Si∗S_i^*Si∗​ directly. The link between the two has to be made nest by nest, through the knapsack relaxations at values of uuu that depend on the unknown optimum, and the fractional vectors xigx_i^gxig​ are compared with integral assortments through the nonlinear map V↦VγiV \mapsto V^{\gamma_i}V↦Vγi​.

Formalization scope

The formalization references the published nested logit model NestedLogitVariants.General.Model (instance, ViV_iVi​, RiR_iRi​, ViγiV_i^{\gamma_i}Viγi​​, Π\PiΠ) and NestedLogitVariants.General.Relaxation (the unit box and the term FFF of the constraints of (13)). The conventions are:

  • nests are any finite type; products are Fin n, indexed from 000; assortments are finite sets of products and 0ˉ\bar 00ˉ is the empty set;
  • the within-nest no-purchase weights of the published model are set to 000 in every statement, which makes ViV_iVi​ the paper's Vi(Si)=∑j∈SivijV_i(S_i) = \sum_{j \in S_i} v_{ij}Vi​(Si​)=∑j∈Si​​vij​;
  • v0>0v_0 > 0v0​>0, vij>0v_{ij} > 0vij​>0 and wij>0w_{ij} > 0wij​>0 are added hypotheses, and the paper's wij≤ciw_{ij} \le c_iwij​≤ci​ (p. 8) is kept wherever the proof needs the zero vector to be feasible for the relaxation; revenues are arbitrary reals; γi∈(0,1]\gamma_i \in (0, 1]γi​∈(0,1] as on p. 8;
  • real powers are Real.rpow, and a/0=0a/0 = 0a/0=0, which gives Ri(0ˉ)=0R_i(\bar 0) = 0Ri​(0ˉ)=0 as in the paper and makes the constraint term at x=0x = 0x=0 equal to 000;
  • the vectors {xig}\{x_i^g\}{xig​} are replaced by any finite sets XiX_iXi​ of vectors that are feasible for the relaxation and contain an optimal solution of it for every u≥0u \ge 0u≥0, the family fixed before uuu; this is what the proof uses, and the paper's interval solutions satisfy it;
  • Z∗Z^*Z∗ is the revenue of a hypothesised optimal assortment of problem (1) under the space constraints; an optimal solution of (13) is a feasible pair with minimal zzz.

The statement is not to be trivialized: setting γi=1\gamma_i = 1γi​=1, taking XiX_iXi​ to be the whole box [0,1]n[0,1]^n[0,1]n (not a finite set and not LP (13)), assuming 0∈Xi0 \in X_i0∈Xi​, or proving the bound for one particular feasible point are all excluded.

A complete development needs the concavity (tangent-line) inequality of V↦VγV \mapsto V^{\gamma}V↦Vγ at a positive point and elementary facts about fractional knapsack relaxations; both are reusable. Proofs of the milestones and of the goal are welcome.

Selected references

  • G. Gallego and H. Topaloglu, Constrained Assortment Optimization for the Nested Logit Model, Management Science, 2014 (authors' manuscript of September 11, 2013). https://doi.org/10.1287/mnsc.2014.1931
  • J. M. Davis, G. Gallego and H. Topaloglu, Assortment Optimization Under Variants of the Nested Logit Model, Operations Research, 2014. https://doi.org/10.1287/opre.2014.1256
  • P. Rusmevichientong, Z.-J. M. Shen and D. B. Shmoys, A PTAS for Capacitated Sum-of-Ratios Optimization, Operations Research Letters, 2009. https://doi.org/10.1016/j.orl.2009.03.002
9 thms2 active usersReviewed
PreviousPage 34 of 94Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me