Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in
← Collections

The OR Formalization Drive

Help us formalize the operations research literature in Lean.

720 completed missions

Missions

561–580 of 720
OpenCompletedAll
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

One-Machine Sequencing to Minimize Certain Functions of Job Tardiness I: SPT Order Minimizes Total Tardiness When Each Due Date Plus Processing Time Is at Most the Next SPT Completion TimeResearch Paper

Why total tardiness on one machine

A shop that promises delivery dates is judged by how late its orders are, not by how early. For a single machine processing nnn jobs that are all available at time 000, the total tardiness of a processing order,

T=∑i∈Jmax⁡(0, Ci−di),T=\sum_{i\in J}\max(0,\,C_i-d_i),T=i∈J∑​max(0,Ci​−di​),

charges each job the amount by which its completion time CiC_iCi​ exceeds its due date did_idi​, and nothing for finishing early. It is one of the basic criteria of deterministic scheduling (Conway, Maxwell and Miller, Theory of Scheduling, 1967), and the single-machine problem of minimizing it is the core subproblem of many dispatching and decomposition methods.

Two contrasting rules are classical. Sequencing in order of shortest processing time (SPT) minimizes total lateness ∑i(Ci−di)\sum_i (C_i-d_i)∑i​(Ci​−di​) and total completion time (Smith, 1956), and it minimizes total tardiness when every job is tardy under it. Sequencing by earliest due date (EDD) minimizes total tardiness when at most one job is tardy under it. Between these extremes no simple rule is optimal, and before 1969 the proposed exact methods (Held and Karp, 1962; Lawler, 1964; Elmaghraby, 1968) searched subsets of schedules.

Timeline.

  • 1956: Smith's ratio rule for weighted completion time; SPT for flow time and lateness.
  • 1965: Root notes that SPT is optimal for total tardiness when all due dates are equal.
  • 1969: Emmons (Operations Research 17(4)) proves dominance theorems that fix the relative order of pairs of jobs in some optimal schedule, and derives from them general sufficient conditions for SPT and EDD optimality.
  • 1977: Lawler gives a pseudopolynomial algorithm, built on Emmons's dominance results (Annals of Discrete Mathematics 1).
  • 1990: Du and Leung prove the problem NP-hard (Mathematics of Operations Research 15(3)), so sufficient conditions of Emmons's kind are the most one can expect from a simple rule.

This mission formalizes Emmons's SPT side: the pairwise dominance theorem for a shorter job before a longer one, and its corollary that the SPT schedule is optimal under a condition far weaker than "every job is tardy".

Setting

A finite set JJJ of jobs is processed on one machine. Job iii has a processing time pi≥0p_i\ge 0pi​≥0 and a due date di∈Rd_i\in\mathbb Rdi​∈R. A schedule of JJJ is an ordering of the jobs of JJJ; the machine starts at time 000, never idles, and processes the jobs in that order, so a job's completion time CiC_iCi​ is the sum of the processing times of the jobs up to and including it. Its tardiness is Ti=max⁡(0,Ci−di)T_i=\max(0, C_i-d_i)Ti​=max(0,Ci​−di​), and the schedule's total tardiness is T=∑i∈JTiT=\sum_{i\in J}T_iT=∑i∈J​Ti​. A schedule is optimal if no schedule of JJJ has smaller total tardiness.

Following Emmons, jobs are SPT-indexed: J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​ are numbered so that j<kj<kj<k implies pj<pkp_j<p_kpj​<pk​, or pj=pkp_j=p_kpj​=pk​ and dj≤dkd_j\le d_kdj​≤dk​. The SPT schedule processes J1,J2,…,JnJ_1,J_2,\dots,J_nJ1​,J2​,…,Jn​ in this order.

Emmons's notation j←kj\leftarrow kj←k ("JjJ_jJj​ precedes JkJ_kJk​ in an optimal schedule") means that there exists an optimal schedule having all properties already established and in which JjJ_jJj​ comes before JkJ_kJk​. The set BkB_kBk​ collects the jobs already known to precede JkJ_kJk​.

Formalization targets

Goal: Corollary 1.4 (p. 705)

dj+pj≤∑i=1j+1pi(j=1,…,n−1)⟹the SPT schedule minimizes ∑i∈Jmax⁡(0,Ci−di).d_j+p_j\le\sum_{i=1}^{j+1}p_i\quad(j=1,\dots,n-1)\quad\Longrightarrow\quad\text{the SPT schedule minimizes } \sum_{i\in J}\max(0,C_i-d_i).dj​+pj​≤i=1∑j+1​pi​(j=1,…,n−1)⟹the SPT schedule minimizes i∈J∑​max(0,Ci​−di​).

The condition can be read as dj≤Cj+(pj+1−pj)d_j\le C_j+(p_{j+1}-p_j)dj​≤Cj​+(pj+1​−pj​) with CjC_jCj​ the SPT completion time of JjJ_jJj​, so it allows jobs to be early. It is the paper's sufficient condition for SPT optimality, and the conclusion is optimality against every schedule of JJJ.

Milestones

  1. Interchange claim (proof of Theorem 1, p. 703): in a schedule where all of BBB precede JkJ_kJk​ and JkJ_kJk​ precedes JjJ_jJj​, with j<kj<kj<k and dj≤max⁡(∑Bpi+pk, dk)d_j\le\max(\sum_{B}p_i+p_k,\,d_k)dj​≤max(∑B​pi​+pk​,dk​), interchanging JjJ_jJj​ and JkJ_kJk​ does not increase total tardiness.
  2. Theorem 1 (p. 703): if some optimal schedule has all of BBB before JkJ_kJk​ and dj≤max⁡(∑Bpi+pk, dk)d_j\le\max(\sum_{B}p_i+p_k,\,d_k)dj​≤max(∑B​pi​+pk​,dk​), then some optimal schedule has all of BBB before JkJ_kJk​ and also JjJ_jJj​ before JkJ_kJk​.
  3. Corollary 1.1 (p. 704): if d1≤max⁡(pi,di)d_1\le\max(p_i,d_i)d1​≤max(pi​,di​) for all i>1i>1i>1, then J1J_1J1​ is first in an optimal schedule.
  4. Time re-referencing (p. 705): processing JkJ_kJk​ first leaves the problem on J∖{Jk}J\setminus\{J_k\}J∖{Jk​} with due dates di−pkd_i-p_kdi​−pk​.
  5. First-job reduction (p. 705): JkJ_kJk​ followed by an optimal schedule of that reduced problem is optimal, whenever some optimal schedule starts with JkJ_kJk​.

Two further results are included as supporting statements: Corollary 1.2 (p. 705, JnJ_nJn​ last) and Corollary 2.3 (p. 707, the adjacent-pair rule j←kj\leftarrow kj←k iff dj≤max⁡(W+pk,dk)d_j\le\max(W+p_k,d_k)dj​≤max(W+pk​,dk​) after a waiting time WWW).

Significance

Corollary 1.4 turns an NP-hard problem into a closed-form answer on a recognizable class of instances: one pass over the SPT order checks the condition, and if it holds no search is needed. Theorem 1 is the more general tool. It orders pairs of jobs in an optimal schedule, and together with Emmons's companion theorems it underlies later exact methods for total tardiness, including Lawler's decomposition and the branch-and-bound algorithms that use Emmons's dominance rules for pruning.

The results are proved in the paper. What a formalization adds is a checked account of the step that the paper treats informally: dominance statements are existential ("some optimal schedule has JjJ_jJj​ before JkJ_kJk​"), and the paper argues on p. 702 that such statements can be accumulated. Each statement here makes explicit which previously established properties the new optimal schedule keeps. No machine-checked proof of these results was found on Prove2Me or in Mathlib at the time of drafting.

Difficulty

The obvious argument is a pairwise interchange, but the interchanged jobs are not adjacent. Moving JkJ_kJk​ from before JjJ_jJj​ to JjJ_jJj​'s position shifts every job in between, changes two tardiness terms in different directions, and the comparison depends on where the due dates fall relative to the start of JkJ_kJk​ and the end of JjJ_jJj​. The hypothesis involving ∑Bkpi\sum_{B_k}p_i∑Bk​​pi​ only controls the start time of JkJ_kJk​ through the information that BkB_kBk​ precedes it, so the existence statement must carry that information along.

The goal is not a direct consequence of Theorem 1 applied pairwise: existential conclusions for different pairs need not hold in a common optimal schedule. Optimality of one fixed order requires all the pairwise decisions to be realized simultaneously, and the problem changes (due dates shift) once a job is fixed in place.

Formalization scope

Jobs are elements of a type ι\iotaι with a linear order that plays the role of the paper's index, and the job set is a Finset ι; this lets the reduction remove a job and keep the remaining labels. Schedules and completion times are the published definitions MooreLateJobs.Shared.IsSchedule and MooreLateJobs.Shared.completionTime (duplicate-free lists containing exactly the jobs of JJJ; prefix sums of processing times from time 000). Tardiness, total tardiness, optimality (against every schedule of JJJ), "precedes" (comparison of positions), the SPT indexing convention and the SPT schedule (the jobs sorted by index) are defined in EmmonsTardiness.SPT.Model. Processing times and due dates are real.

Conventions and deviations from the page:

  • Added: processing times are nonnegative, pi≥0p_i\ge0pi​≥0 for i∈Ji\in Ji∈J. They are durations; the proof of Theorem 1 uses that the start time of JkJ_kJk​ is at least ∑Bkpi\sum_{B_k}p_i∑Bk​​pi​, and Corollary 2.3's second direction is false without it.
  • Not imposed: the reduction di<∑Jpid_i<\sum_J p_idi​<∑J​pi​ of p. 703. It is a without-loss-of-generality preprocessing step that no statement needs, so dropping it makes the statements stronger.
  • Kept: the SPT indexing convention of p. 703 is a hypothesis of every statement that refers to job indices.
  • j←kj\leftarrow kj←k: the "properties already established" are the precedences named in hypothesis (1); the broader cumulative reading of p. 702 is not formalized.

A formalization of the goal as "some optimal schedule starts with J1J_1J1​", or of Theorem 1 with an arbitrary set BBB unrelated to optimal schedules, would be a different and weaker (or false) statement; the targets above state optimality of the SPT schedule itself and tie BBB to an optimal schedule.

Needed infrastructure: lemmas on prefix sums of lists, on the effect of a transposition on positions in a duplicate-free list, on removing the head of a schedule, and existence of an optimal schedule among the finitely many permutations of JJJ. These list-scheduling lemmas are reusable for other single-machine results (Moore 1968, and the EDD mission of this series). Proofs of the milestones, alternative arguments, and general interchange lemmas are all welcome.

Selected references

  • H. Emmons, One-Machine Sequencing to Minimize Certain Functions of Job Tardiness, Operations Research 17(4):701–715, 1969. https://doi.org/10.1287/opre.17.4.701
  • R. W. Conway, W. L. Maxwell, L. W. Miller, Theory of Scheduling, Addison-Wesley, 1967.
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3:59–66, 1956. https://doi.org/10.1002/nav.3800030106
  • J. G. Root, Scheduling with Deadlines and Loss Functions on k Parallel Machines, Management Science 11:460–475, 1965. https://doi.org/10.1287/mnsc.11.4.460
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1):102–109, 1968. https://doi.org/10.1287/mnsc.15.1.102
  • E. L. Lawler, A "Pseudopolynomial" Algorithm for Sequencing Jobs to Minimize Total Tardiness, Annals of Discrete Mathematics 1:331–342, 1977. https://doi.org/10.1016/S0167-5060(08)70742-8
  • J. Du, J. Y.-T. Leung, Minimizing Total Tardiness on One Machine is NP-Hard, Mathematics of Operations Research 15(3):483–495, 1990. https://doi.org/10.1287/moor.15.3.483
8 thms3 active usersReviewed
🏆Completed
Convex OptimizationLinear algebraOperations Research+1·Captain: mikedeng1

A Nonlinear Programming Algorithm for Solving Semidefinite Programs via Low-rank Factorization: A Regular Local Minimum That Stays Locally Minimal After Adding a Zero Column Solves the SDPResearch Paper

Motivation

Semidefinite programs (SDPs) arise as convex relaxations of combinatorial problems such as maximum cut and the Lovász theta function, and in control and eigenvalue optimization. Interior-point methods solve them reliably but manipulate dense n×nn\times nn×n matrices, which limits the size of the instances they can handle. Burer and Monteiro (Math. Program. 95 (2003)) proposed replacing the matrix variable X⪰0X\succeq 0X⪰0 by a factorization X=RRTX=RR^{T}X=RRT with RRR having only rrr columns, and solving the resulting nonconvex program by a first-order augmented Lagrangian method. The approach rests on a theorem of Barvinok (1995) and Pataki (1998): an SDP with mmm linear constraints has an optimal solution of rank rrr with r(r+1)/2≤mr(r+1)/2\le mr(r+1)/2≤m, so a small number of columns suffices.

Because the factorized problem is nonconvex, a local minimum it returns is not automatically a solution of the SDP. Section 2 of the paper gives conditions under which it is. This mission formalizes those conditions, culminating in Proposition 2.5, which justifies the paper's strategy of increasing the rank one column at a time.

Setting

For real p×qp\times qp×q matrices, the trace inner product is A∙B=trace⁡(ATB)A\bullet B=\operatorname{trace}(A^{T}B)A∙B=trace(ATB). The data are symmetric matrices C,A1,…,Am∈SnC, A_1,\dots,A_m\in\mathcal S^nC,A1​,…,Am​∈Sn and a vector b∈Rmb\in\mathbb R^mb∈Rm. The primal SDP and dual SDP are

(1)min⁡{C∙X:Ai∙X=bi, i=1,…,m, X⪰0},(3)max⁡{bTy:S=C−∑i=1myiAi, S⪰0}.\text{(1)}\quad \min\{C\bullet X : A_i\bullet X=b_i,\ i=1,\dots,m,\ X\succeq0\},\qquad \text{(3)}\quad \max\Big\{b^{T}y : S=C-\sum_{i=1}^m y_iA_i,\ S\succeq0\Big\}.(1)min{C∙X:Ai​∙X=bi​, i=1,…,m, X⪰0},(3)max{bTy:S=C−i=1∑m​yi​Ai​, S⪰0}.

The standing assumptions of the paper are that A1,…,AmA_1,\dots,A_mA1​,…,Am​ are linearly independent and that there are feasible X∗X^*X∗ and (S∗,y∗)(S^*,y^*)(S∗,y∗) with C∙X∗=bTy∗C\bullet X^*=b^{T}y^*C∙X∗=bTy∗.

For a positive integer r≤nr\le nr≤n, the low-rank program is

(Nr)min⁡{C∙(RRT):Ai∙(RRT)=bi, i=1,…,m, R∈Rn×r}.(N_r)\qquad \min\{C\bullet(RR^{T}) : A_i\bullet(RR^{T})=b_i,\ i=1,\dots,m,\ R\in\mathbb R^{n\times r}\}.(Nr​)min{C∙(RRT):Ai​∙(RRT)=bi​, i=1,…,m, R∈Rn×r}.

Its Lagrangian is L(R,y)=C∙(RRT)−∑iyi(Ai∙(RRT)−bi)L(R,y)=C\bullet(RR^{T})-\sum_i y_i(A_i\bullet(RR^{T})-b_i)L(R,y)=C∙(RRT)−∑i​yi​(Ai​∙(RRT)−bi​), and S(y)=C−∑iyiAiS(y)=C-\sum_i y_iA_iS(y)=C−∑i​yi​Ai​. A feasible RRR is a local minimum if it minimizes the objective among nearby feasible points; it is a regular point if A1R,…,AmRA_1R,\dots,A_mRA1​R,…,Am​R are linearly independent; it is a stationary point with multiplier yyy if ∇RL(R,y)=0\nabla_RL(R,y)=0∇R​L(R,y)=0. The injection of R∈Rn×rR\in\mathbb R^{n\times r}R∈Rn×r is R^=[ R  0 ]∈Rn×(r+1)\hat R=[\,R\ \ 0\,]\in\mathbb R^{n\times(r+1)}R^=[R  0]∈Rn×(r+1), obtained by appending a zero column.

Formalization targets

Goal: Proposition 2.5

Let r<nr<nr<n and let R∗R^*R∗ be a regular local minimum of (Nr)(N_r)(Nr​) with multiplier y∗y^*y∗, S∗=S(y∗)S^*=S(y^*)S∗=S(y∗), S∗R∗=0S^*R^*=0S∗R∗=0. If R^\hat RR^ is a local minimum of (Nr+1)(N_{r+1})(Nr+1​), then

X∗=R∗(R∗)T solves (1)and(S∗,y∗) solves (3).X^*=R^*(R^*)^{T}\ \text{solves (1)}\quad\text{and}\quad (S^*,y^*)\ \text{solves (3)}.X∗=R∗(R∗)T solves (1)and(S∗,y∗) solves (3).

Milestones

  1. The derivative formulas (9): ∇R(Ai∙(RRT)−bi)=2AiR\nabla_R(A_i\bullet(RR^T)-b_i)=2A_iR∇R​(Ai​∙(RRT)−bi​)=2Ai​R, ∇RL(R,y)=2SR\nabla_RL(R,y)=2SR∇R​L(R,y)=2SR, and LRR′′(R,y)[D,D]=2S∙(DDT)L''_{RR}(R,y)[D,D]=2S\bullet(DD^T)LRR′′​(R,y)[D,D]=2S∙(DDT).
  2. Proposition 2.3: at a regular local minimum of (Nr)(N_r)(Nr​) there is a unique y∗y^*y∗ with S∗R∗=0S^*R^*=0S∗R∗=0, and S∗∙(DDT)≥0S^*\bullet(DD^T)\ge0S∗∙(DDT)≥0 for every DDD with AiR∗∙D=0A_iR^*\bullet D=0Ai​R∗∙D=0 for all iii.
  3. Proposition 2.1: feasible XXX and (S,y)(S,y)(S,y) are simultaneously optimal if and only if X∙S=0X\bullet S=0X∙S=0.
  4. Proposition 2.4: a stationary point of (Nr)(N_r)(Nr​) whose S∗S^*S∗ is positive semidefinite gives optimal X∗=R∗R∗TX^*=R^*R^{*T}X∗=R∗R∗T and (S∗,y∗)(S^*,y^*)(S∗,y∗).

Significance

Proposition 2.5 is a certificate of global optimality for a nonconvex problem obtained from local information alone. It is the basis of the rank-increase scheme described on p. 8 of the paper: compute a local minimum of (Nr)(N_r)(Nr​) for a small rrr; if the zero-column extension is still a local minimum of (Nr+1)(N_{r+1})(Nr+1​), the current point solves the SDP; otherwise a better point of (Nr+1)(N_{r+1})(Nr+1​) exists and rrr is increased. Proposition 2.4 gives the companion test, valid for every rrr: positive semidefiniteness of the multiplier matrix at a stationary point. These statements underlie the later convergence analysis of the method (Burer & Monteiro 2005) and the literature on benign landscapes of low-rank SDP formulations (Boumal, Voroninski & Bandeira 2016).

The results are proved in the paper. What this mission adds is a machine-checked version of the full chain from the standard-form SDP to the rank-increase certificate, including the matrix calculus (9), the first- and second-order necessary conditions for an equality-constrained program over rectangular matrices, and SDP complementary slackness in standard form. No machine-checked proof of these results is recorded in Mathlib or on the platform.

Difficulty

The SDP side (Propositions 2.1 and 2.4) is linear algebra: weak duality and the fact that the trace inner product of two positive semidefinite matrices is nonnegative. The substance lies in Proposition 2.3. The feasible set of (Nr)(N_r)(Nr​) is a variety cut out by mmm quadratic equations, and the multiplier rule and, especially, the second-order necessary condition require a constraint qualification and a curve in the feasible set realizing every tangent direction. Mathlib provides a first-order Lagrange multiplier rule, but not the second-order condition on the tangent space. A naive attempt to read Proposition 2.5 off Proposition 2.4 fails: local minimality of R∗R^*R∗ alone does not make S∗S^*S∗ positive semidefinite (when rrr is below the minimal optimal rank, it is not); the hypothesis on (Nr+1)(N_{r+1})(Nr+1​) is indispensable.

Formalization scope

Matrices are Matrix (Fin n) (Fin r) ℝ with 0-based indices. The trace inner product is frob A B = trace(Aᵀ * B), defined for rectangular matrices. The data carry explicit symmetry hypotheses C.IsSymm and (A i).IsSymm; without them the formulas (9) are false. Primal feasibility uses Mathlib's PosSemidef, which over R\mathbb RR includes symmetry. Optimality for (1) and (3) is defined relative to their entire feasible sets. The standing assumptions are a separate predicate carried as a hypothesis by Propositions 2.1, 2.3, 2.4 and 2.5, and every statement about (Nr)(N_r)(Nr​) carries 0<r0<r0<r and r≤nr\le nr≤n (or r<nr<nr<n). Gradients are Fréchet derivatives under the Frobenius norm, identified with matrices through the trace inner product; local minima use IsLocalMinOn on the feasible set of (Nr)(N_r)(Nr​) together with feasibility. The injection appends the zero column as the last column.

The statement admits several trivializing encodings, all excluded here: optimality defined relative to the factorized feasible set instead of the whole SDP, an empty or unconstrained (Nr)(N_r)(Nr​) (an unconstrained local minimum or a local minimum without feasibility), a stationarity notion that already includes S⪰0S\succeq0S⪰0, and an injection other than the zero-column extension.

A complete development needs the matrix calculus of R↦RRTR\mapsto RR^{T}R↦RRT, a second-order necessary optimality condition under linear independence of the constraint gradients, and standard-form SDP weak duality and complementary slackness; all of these are reusable well beyond this mission. Proofs of individual milestones, in particular the derivative formulas and Proposition 2.4, are welcome independently of the goal.

Selected references

  • S. Burer and R. D. C. Monteiro, A nonlinear programming algorithm for solving semidefinite programs via low-rank factorization, Mathematical Programming 95 (2003), 329–357. https://doi.org/10.1007/s10107-002-0352-8 (statements cited from the authors' manuscript of March 9, 2001)
  • A. Barvinok, Problems of distance geometry and convex properties of quadratic maps, Discrete & Computational Geometry 13 (1995), 189–202. https://doi.org/10.1007/BF02574037
  • G. Pataki, On the rank of extreme matrices in semidefinite programs and the multiplicity of optimal eigenvalues, Mathematics of Operations Research 23 (1998), 339–358. https://doi.org/10.1287/moor.23.2.339
  • R. D. C. Monteiro and M. Todd, Path-following methods for semidefinite programming, in Handbook of Semidefinite Programming, Kluwer, 2000 (source of Proposition 2.1).
  • S. Burer and R. D. C. Monteiro, Local minima and convergence in low-rank semidefinite programming, Mathematical Programming 103 (2005), 427–444. https://doi.org/10.1007/s10107-004-0564-1
  • N. Boumal, V. Voroninski and A. S. Bandeira, The non-convex Burer–Monteiro approach works on smooth semidefinite programs, NeurIPS 2016. https://arxiv.org/abs/1606.04970
10 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatoricsMechanism Design+2·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 1: Sequential Posted Prices 2-Approximate the Optimal Revenue under a Matroid ConstraintResearch Paper

Why posted prices

A seller who must decide whom to serve among several buyers with private values can, in principle, run Myerson's revenue-optimal mechanism: collect bids, compute virtual values, serve the feasible set of largest virtual surplus, and charge threshold payments (Myerson 1981). In practice sellers rarely do this. Retail, ticketing and online platforms mostly use posted prices: each buyer is offered a take-it-or-leave-it price and accepts if and only if the price does not exceed the buyer's value. Posted prices are simple to explain, are trivially truthful, and do not require buyers to reveal their values.

Chawla, Hartline, Malec and Sivan (arXiv:0907.2435, STOC 2010) asked how much revenue is lost by this simplification, and showed that for a wide range of feasibility constraints a sequential posted-price mechanism recovers a constant fraction of the optimal revenue. The matroid case, a factor of 2, is the first and most widely cited of their results. It is a revenue analogue of the prophet inequality and was one of the starting points of the literature on "simple versus optimal" mechanisms.

Setting

There are nnn single-parameter agents, indexed by [n][n][n], and one seller. Agent iii has a private value viv_ivi​ for being served, drawn independently from a distribution FiF_iFi​ with density fif_ifi​. The virtual valuation of agent iii is

ϕi(vi)=vi−1−Fi(vi)fi(vi),\phi_i(v_i) = v_i - \frac{1 - F_i(v_i)}{f_i(v_i)},ϕi​(vi​)=vi​−fi​(vi​)1−Fi​(vi​)​,

and FiF_iFi​ is regular if ϕi\phi_iϕi​ is non-decreasing.

The seller faces a feasibility constraint: a downward-closed family J\mathcal JJ of subsets of [n][n][n], the sets of agents that can be served together. The rank of a set SSS is rank⁡(S)=max⁡S′⊆S, S′∈J∣S′∣\operatorname{rank}(S) = \max_{S' \subseteq S,\, S' \in \mathcal J} |S'|rank(S)=maxS′⊆S,S′∈J​∣S′∣. The constraint is a matroid if it satisfies the augmentation axiom: whenever A,B∈JA, B \in \mathcal JA,B∈J and ∣A∣>∣B∣|A| > |B|∣A∣>∣B∣, some e∈A∖Be \in A \setminus Be∈A∖B has B∪{e}∈JB \cup \{e\} \in \mathcal JB∪{e}∈J. Examples are kkk identical units (kkk-uniform matroids) and disjoint markets with separate capacities (partition matroids).

A mechanism MMM maps reported values v\mathbf vv to a feasible set M(v)∈JM(\mathbf v) \in \mathcal JM(v)∈J of served agents and a payment πi(v)\pi_i(\mathbf v)πi​(v) for each agent. It is truthful if reporting the true value is a dominant strategy and no agent ends with negative utility. Its expected revenue is RM=E[∑iπi(v)]\mathcal R^M = \mathbb E[\sum_i \pi_i(\mathbf v)]RM=E[∑i​πi​(v)], and qiM=Pr⁡[i∈M(v)]q^M_i = \Pr[i \in M(\mathbf v)]qiM​=Pr[i∈M(v)] is the probability that it serves agent iii.

A sequential posted-price mechanism (SPM) with ordering σ\sigmaσ and prices p\mathbf pp approaches the agents in the order σ\sigmaσ. When agent iii's turn comes, if adding iii to the set AAA of agents served so far keeps AAA feasible, iii is offered price pip_ipi​ and is served (and pays pip_ipi​) if pi≤vip_i \le v_ipi​≤vi​; otherwise iii is blocked. Its expected revenue is Rpσ\mathcal R^\sigma_{\mathbf p}Rpσ​.

The mechanism S\mathcal SS of the paper sets pi=Fi−1(1−qiM)p_i = F_i^{-1}(1 - q^M_i)pi​=Fi−1​(1−qiM​), so that agent iii accepts an offer with probability exactly qiMq^M_iqiM​, and approaches the agents in decreasing order of price.

Formalization targets

Goal: Theorem 5

For regular, independent values and a matroid constraint, for every truthful mechanism MMM and the SPM S\mathcal SS built from its service probabilities,

RM≤2 Rpσ.\mathcal R^M \le 2\, \mathcal R^\sigma_{\mathbf p}.RM≤2Rpσ​.

Taking MMM to be Myerson's optimal mechanism gives the paper's statement that S\mathcal SS 2-approximates the optimal revenue.

Milestones

  1. Proposition 1 (p. 5): the expected revenue of a truthful mechanism equals its expected virtual surplus E[∑i∈M(v)ϕi(vi)]\mathbb E[\sum_{i \in M(\mathbf v)} \phi_i(v_i)]E[∑i∈M(v)​ϕi​(vi​)].
  2. Lemma 2 (p. 5): RM≤∑ipiMqiM\mathcal R^M \le \sum_i p^M_i q^M_iRM≤∑i​piM​qiM​ with piM=Fi−1(1−qiM)p^M_i = F_i^{-1}(1 - q^M_i)piM​=Fi−1​(1−qiM​).
  3. Revenue of an SPM (§2.2, p. 4): Rpσ=∑iciqipi\mathcal R^\sigma_{\mathbf p} = \sum_i c_i q_i p_iRpσ​=∑i​ci​qi​pi​, where cic_ici​ is the probability that agent iii is offered service and qi=1−Fi(pi)q_i = 1 - F_i(p_i)qi​=1−Fi​(pi​).
  4. Rank bound (§4, p. 6): ∑i∈SqiM≤rank⁡(S)\sum_{i \in S} q^M_i \le \operatorname{rank}(S)∑i∈S​qiM​≤rank(S) for every set SSS.
  5. Lost revenue (proof of Theorem 5, p. 7): in any run under a matroid, with prices in decreasing order and weights qqq satisfying the rank bound, ∑i blockedpiqi≤∑i servedpi\sum_{i \text{ blocked}} p_i q_i \le \sum_{i \text{ served}} p_i∑i blocked​pi​qi​≤∑i served​pi​.
  6. Half of the benchmark (p. 7): under the same conditions, ∑ipiqi≤2Rpσ\sum_i p_i q_i \le 2 \mathcal R^\sigma_{\mathbf p}∑i​pi​qi​≤2Rpσ​.

Significance

The theorem shows that under a matroid constraint the optimal mechanism's advantage over a single round of posted prices is at most a factor of 2, uniformly over all regular distributions. Prices, rather than an auction, then suffice up to a constant, which justifies posted pricing in settings where an auction is impractical. The same argument, with the matroid replaced by an intersection of mmm matroids, gives the paper's Theorems 7 and 8, and the bound underlies the analysis of VCG with reserve prices (Theorem 32). Lemma 2's benchmark ∑ipiMqiM\sum_i p^M_i q^M_i∑i​piM​qiM​ became a standard tool for "ex ante relaxation" arguments.

The results are proved in the paper; none of them has a machine-checked proof. Formalizing them requires Myerson's revenue characterization in a multi-agent, dominant-strategy setting with a general feasibility constraint, which Lean's libraries do not have, and a probabilistic analysis of a sequential process over a product measure. Related formalizations exist for narrower models: the single-unit, Bayesian incentive compatible revenue identity MechanismDesign.Auctions.revenue_eq_virtual_surplus (Börgers' textbook, common support) and the i.i.d. multi-unit RevenueManagement.revenue_equivalence. Neither covers per-agent supports, set-system constraints or dominant-strategy truthfulness.

Difficulty

The obvious argument compares the SPM with the hypothetical mechanism that ignores the feasibility constraint, whose revenue is exactly ∑ipiqi\sum_i p_i q_i∑i​pi​qi​. The SPM loses the revenue of agents who would have accepted but are blocked. The difficulty is that blocking is correlated with the values of earlier agents, and the lost revenue must be bounded by revenue actually collected. A naive per-agent charge fails in a general matroid, because one served agent can block many others; the bound has to use the matroid's rank structure together with the decreasing price order.

On the mechanism side, Lemma 2 needs the full Myerson theory: monotonicity of truthful allocations, the payment identity, and an optimization over interim allocation rules with a fixed service probability, where regularity is used.

Formalization scope

All objects live in the namespace CHMSPricing.SpmMatroid. Agents are Fin n. The following conventions are fixed.

  • Distributions. Each FiF_iFi​ is given by a measurable density, strictly positive on a bounded interval [v‾i,v‾i][\underline v_i, \overline v_i][v​i​,vi​] with 0≤v‾i<v‾i0 \le \underline v_i < \overline v_i0≤v​i​<vi​, integrating to 111 there, with no mass outside. There are no point masses, so the randomized variant of S\mathcal SS in §4 does not arise. The prior is the product measure.
  • Regularity. Monotone non-decreasing virtual values on the support (Definition 2). All goals assume regular distributions, as the body's analyses do; the non-regular case (the second paragraph of Lemma 2, Appendix E) uses randomized prices and is out of scope.
  • Truthfulness. Deterministic mechanisms, dominant-strategy incentive compatible with deviations within the support, ex-post individually rational, feasible on the type space, with measurable allocation events and measurable integrable payments. Payments of unserved agents are not forced to zero.
  • Benchmark. The goal is stated for every truthful MMM, with S\mathcal SS built from MMM's own service probabilities; this is stronger than comparing with Myerson's mechanism alone and avoids constructing it.
  • Prices. pi=Fi−1(1−qi)p_i = F_i^{-1}(1 - q_i)pi​=Fi−1​(1−qi​) is passed as an argument with the hypotheses pi∈[v‾i,v‾i]p_i \in [\underline v_i, \overline v_i]pi​∈[v​i​,vi​] and Fi(pi)=1−qiF_i(p_i) = 1 - q_iFi​(pi​)=1−qi​, rather than through a generalized inverse.
  • SPM. Positions are 000-based; the price belongs to the agent; acceptance is pi≤vip_i \le v_ipi​≤vi​; ties in the decreasing price order are arbitrary, and the goal holds for every such order.
  • Proposition 1 additionally assumes the normalization that an agent with value v‾i\underline v_iv​i​ has zero utility, which is how the paper's payments are pinned down.

The goal cannot be trivialized by a free choice of prices: the prices are tied to the mechanism's service probabilities, and the SPM uses the same matroid as the mechanism. Individual rationality is essential, since without it a "truthful" mechanism can extract unbounded revenue.

A complete development needs Myerson's lemma for dominant-strategy single-parameter mechanisms, a quantile/revenue-curve argument under regularity, matroid span and rank facts for the paper's finite set systems, and independence arguments for a sequential process on a product measure. The rank bound and the deterministic lost-revenue inequality are independent of the probabilistic parts and are good first contributions; the Myerson-side lemmas are reusable for the other missions of this series.

Selected references

  • S. Chawla, J. D. Hartline, D. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, arXiv:0907.2435v2, 2010; STOC 2010. https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1):58–73, 1981. https://doi.org/10.1287/moor.6.1.58
  • J. Bulow, J. Roberts, The Simple Economics of Optimal Auctions, Journal of Political Economy 97(5):1060–1090, 1989. https://doi.org/10.1086/261643
  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012. https://arxiv.org/abs/1201.4764
11 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatoricsMechanism Design+2·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 2: Sequential Posted Prices e/(e−1)-Approximate the Optimal Revenue under a Partition Matroid ConstraintResearch Paper

Motivation

A seller who knows the distributions of buyers' values can maximise expected revenue with Myerson's optimal mechanism (Myerson 1981): collect bids, compute virtual values, serve a feasible set of maximum virtual surplus, and charge threshold payments. Real sellers seldom run such auctions. They post prices: a buyer is offered a take-it-or-leave-it price and either accepts or walks away. Posted prices need no bidding, involve no competition between buyers, and are trivially truthful. The question is how much revenue they give up.

Chawla, Hartline, Malec and Sivan (arXiv:0907.2435, STOC 2010) answer this for a range of feasibility constraints with a single construction, the sequential posted-price mechanism (SPM) S\mathcal SS. For general matroids it loses at most a factor 222 (Theorem 5). For uniform and partition matroids, that is, multi-unit sales and unions of multi-unit sales, it loses at most a factor e/(e−1)≈1.58e/(e-1)\approx1.58e/(e−1)≈1.58 (Theorem 6), and the paper shows this factor is tight for its mechanism. This mission targets Theorem 6.

Timeline. Myerson (1981) characterised the optimal single-parameter mechanism. Blumrosen and Holenstein (2008) showed that the best single-unit SPM can be a factor π/2\sqrt{\pi/2}π/2​ below Myerson's revenue even with i.i.d. buyers. Chawla, Hartline and Kleinberg (EC 2007) used posted prices to approximate multi-parameter unit-demand pricing. Chawla, Hartline, Malec and Sivan (2010) gave the matroid, partition-matroid and matroid-intersection bounds. Yan (SODA 2011) explained the e/(e−1)e/(e-1)e/(e−1) factor through the correlation gap of submodular functions and sharpened it for kkk units to 1−kke−k/k!1-k^ke^{-k}/k!1−kke−k/k!.

Setting

There are nnn agents. Agent iii has a private value viv_ivi​ for being served, drawn independently from a distribution FiF_iFi​ with density fif_ifi​. The virtual value is φi(v)=v−1−Fi(v)fi(v)\varphi_i(v)=v-\frac{1-F_i(v)}{f_i(v)}φi​(v)=v−fi​(v)1−Fi​(v)​, and FiF_iFi​ is regular if φi\varphi_iφi​ is non-decreasing. The seller may serve any set in a downward-closed family J⊆2[n]\mathcal J\subseteq2^{[n]}J⊆2[n].

A partition matroid assigns each agent iii to a part part(i)\mathrm{part}(i)part(i) and each part bbb a capacity cap(b)∈N\mathrm{cap}(b)\in\mathbb Ncap(b)∈N. A set is feasible iff it contains at most cap(b)\mathrm{cap}(b)cap(b) agents of every part bbb. With one part of capacity kkk this is the kkk-uniform matroid: at most kkk agents are served.

A truthful mechanism MMM maps a value vector v\mathbf vv to a feasible set M(v)M(\mathbf v)M(v) and payments πi(v)\pi_i(\mathbf v)πi​(v). It is dominant-strategy incentive compatible and individually rational. Its expected revenue is RM=E[∑iπi(v)]\mathcal R^M=\mathbb E[\sum_i\pi_i(\mathbf v)]RM=E[∑i​πi​(v)], and qiM=Pr⁡[i∈M(v)]q^M_i=\Pr[i\in M(\mathbf v)]qiM​=Pr[i∈M(v)] is its service probability for agent iii.

The sequential posted-price mechanism S\mathcal SS built from MMM sets the price pi=Fi−1(1−qiM)p_i=F_i^{-1}(1-q^M_i)pi​=Fi−1​(1−qiM​) for agent iii, so that agent iii accepts with probability exactly qiMq^M_iqiM​. It approaches the agents one at a time in decreasing order of price (σ\sigmaσ is the ordering). It offers agent iii the price pip_ipi​ if adding iii to the agents already served keeps the set feasible. The agent accepts iff pi≤vip_i\le v_ipi​≤vi​. Its expected revenue is Rpσ\mathcal R^\sigma_{\mathbf p}Rpσ​.

Formalization targets

Goal: Theorem 6, partition matroids

For every partition matroid, every truthful MMM, and S\mathcal SS built from MMM as above,

RM≤ee−1 Rpσ.\mathcal R^M\le\frac{e}{e-1}\,\mathcal R^\sigma_{\mathbf p}.RM≤e−1e​Rpσ​.

Taking MMM to be Myerson's mechanism gives the paper's statement.

Milestones

  1. Lemma 2 (regular case): RM≤∑ipiMqiM\mathcal R^M\le\sum_ip^M_iq^M_iRM≤∑i​piM​qiM​ with piM=Fi−1(1−qiM)p^M_i=F_i^{-1}(1-q^M_i)piM​=Fi−1​(1−qiM​).
  2. Rank bound (§4): ∑i∈SqiM≤rank⁡(S)\sum_{i\in S}q^M_i\le\operatorname{rank}(S)∑i∈S​qiM​≤rank(S) for every set SSS; for a part bbb this reads ∑part(i)=bqiM≤cap(b)\sum_{\mathrm{part}(i)=b}q^M_i\le\mathrm{cap}(b)∑part(i)=b​qiM​≤cap(b).
  3. Single-unit revenue formula (App. C.2): RS=∑kckpkqk\mathcal R^{\mathcal S}=\sum_kc_kp_kq_kRS=∑k​ck​pk​qk​ with ck=∏j<k(1−qj)c_k=\prod_{j<k}(1-q_j)ck​=∏j<k​(1−qj​), positions in offer order.
  4. Lemma 20: with ppp defined by ∑kpkqk=p∑kqk\sum_kp_kq_k=p\sum_kq_k∑k​pk​qk​=p∑k​qk​ (equation (2)) and prices decreasing, p∑kckqk≤∑kckpkqkp\sum_kc_kq_k\le\sum_kc_kp_kq_kp∑k​ck​qk​≤∑k​ck​pk​qk​.
  5. Display (3): if ∑kqk=s≤1\sum_kq_k=s\le1∑k​qk​=s≤1, then p∑kckqk=p(1−∏k(1−qk))≥p(1−(1−s/n)n)≥(1−1/e)psp\sum_kc_kq_k=p(1-\prod_k(1-q_k))\ge p(1-(1-s/n)^n)\ge(1-1/e)psp∑k​ck​qk​=p(1−∏k​(1−qk​))≥p(1−(1−s/n)n)≥(1−1/e)ps.
  6. Theorem 21: the goal for the 111-uniform matroid.
  7. Theorem 22: the goal for the kkk-uniform matroid, every kkk.

Significance

The theorem shows that a mechanism with no bidding loses at most about 37%37\%37% of the optimal revenue when the constraint is a union of multi-unit supplies. That covers selling several kinds of goods, each in limited stock, to single-minded buyers. The prices are computed once from the distributions. The order is fixed before any value is seen. No agent's payment depends on another agent's report. The factor is tight for this mechanism (App. C.2), and the same template (prices from service probabilities, decreasing order) gives factor 222 for all matroids and m+1m+1m+1 for intersections of mmm matroids.

On the formal side, the paper's results are proved but none is machine-checked as far as we know. The platform has Myerson-type results for a single unit with Bayesian incentive compatibility and a common support (Börgers), and for i.i.d. buyers with a fixed number of units (Talluri and van Ryzin). Neither covers independent, non-identical buyers under a set-system constraint with dominant-strategy truthfulness. A complete development would include the ex-ante revenue bound of Lemma 2 for regular distributions, which is reusable for any posted-price or prophet-inequality argument, and the 1−1/e1-1/e1−1/e correlation-gap inequality.

Difficulty

The obvious argument compares S\mathcal SS with Myerson's mechanism one agent at a time. That fails, because S\mathcal SS may stop offering to an agent once the units of its part are gone, and the agents blocked this way can be the ones Myerson's mechanism serves. The loss has to be bounded in aggregate, using only the ex-ante constraint ∑part(i)=bqi≤cap(b)\sum_{\mathrm{part}(i)=b}q_i\le\mathrm{cap}(b)∑part(i)=b​qi​≤cap(b). The single-unit case reduces to an inequality about products ∏(1−qj)\prod(1-q_j)∏(1−qj​). For kkk units, the printed proof (pp. 15–16) is an induction that compares the run with a hypothetical single-unit instance with probabilities qi/kq_i/kqi​/k. Its second case is informal, so a formal proof needs its own argument for the kkk-unit bound. Passing from uniform to partition matroids needs the observation that with a global order the run inside each part depends only on that part's agents. Lemma 2 needs the revenue-curve concavity that regularity gives, stated through densities rather than derivatives.

Formalization scope

  • Values. Each FiF_iFi​ has a density that is measurable and strictly positive on a bounded interval [v‾i,vˉi][\underline v_i,\bar v_i][v​i​,vˉi​] with 0≤v‾i0\le\underline v_i0≤v​i​, integrates to 111 there, and has no mass outside. The paper says only "with density fif_ifi​". This pin rules out point masses, so the randomised-price variant of S\mathcal SS never arises. The prior is the product of these laws.
  • Regularity is φi\varphi_iφi​ non-decreasing on the support, assumed for every agent in the goal, as in the paper's §4 analyses. The non-regular extension (second paragraph of Lemma 2, Appendix E) is out of scope.
  • Truthful means deterministic, dominant-strategy incentive compatible over the support, ex-post individually rational, feasible, with measurable allocations and integrable payments.
  • Prices are arguments tied to MMM by pi∈[v‾i,vˉi]p_i\in[\underline v_i,\bar v_i]pi​∈[v​i​,vˉi​] and Fi(pi)=1−qiMF_i(p_i)=1-q^M_iFi​(pi​)=1−qiM​. No inverse distribution function is defined.
  • Order. The order σ\sigmaσ is a permutation with σ(0)\sigma(0)σ(0) first, decreasing in price, and ties are arbitrary. It is global across parts. Parts of capacity 000 are allowed.
  • Constant. The constant is exactly e/(e−1)e/(e-1)e/(e−1).
  • No free prices. The theorem is not stated with free or existentially chosen prices. Prices are pinned to MMM's service probabilities, and S\mathcal SS uses the same constraint as MMM. A statement in which the prices could be chosen after the fact, or in which MMM were not required to be individually rational, would be a different or false theorem.
  • Every truthful MMM. The comparison is with every truthful MMM, not with a constructed Myerson mechanism. This form is at least as strong as the paper's, and it is what the paper's proof shows.

Welcome contributions: proofs of the algebraic milestones (Lemma 20, display (3)), the revenue formula, Lemma 2 (reusable payment-identity infrastructure for dominant-strategy mechanisms), and a correlation-gap argument for kkk units.

Selected references

  • S. Chawla, J. D. Hartline, D. L. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, STOC 2010; arXiv:0907.2435v2, 2010. https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • L. Blumrosen, T. Holenstein, Posted Prices vs. Negotiations: An Asymptotic Analysis, ACM EC 2008.
  • Q. Yan, Mechanism Design via Correlation Gap, ACM-SIAM SODA 2011.
12 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignOperations Research+1·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 3: Order-Oblivious Posted Prices 2-Approximate the Optimal Revenue under a Uniform Matroid ConstraintResearch Paper

Motivation

Myerson's optimal auction (Myerson 1981) maximizes a seller's expected revenue when buyers have independent private values, but it is a sealed-bid mechanism: every buyer reports a value, and the allocation and payments are computed from all reports at once. Real sellers more often post prices: buyers arrive, each sees a take-it-or-leave-it price, and buys or leaves. Chawla, Hartline, Malec and Sivan (arXiv:0907.2435) ask how much revenue such simple mechanisms lose. Their strongest notion is the order-oblivious posted-price mechanism (OPM): the prices are fixed in advance, and the guarantee must hold whatever order the buyers arrive in, even an adversarial one.

The tool behind the guarantee for sellers of kkk identical units is a prophet inequality. In the single-choice version, a gambler inspects independent random rewards one at a time and must accept or reject each on the spot; Krengel and Sucheston, and Samuel-Cahn (Ann. Probab. 1984), showed that a single fixed threshold earns at least half of what a prophet who sees all rewards earns. The paper extends Samuel-Cahn's threshold rule to kkk choices (Appendix D.2) and turns it into a revenue guarantee (Theorem 10).

Setting

There are nnn agents [n][n][n]. Agent iii's value viv_ivi​ for being served is drawn independently from a distribution FiF_iFi​ with density fif_ifi​; the virtual valuation is ϕi(v)=v−(1−Fi(v))/fi(v)\phi_i(v) = v - (1 - F_i(v))/f_i(v)ϕi​(v)=v−(1−Fi​(v))/fi​(v) (Definition 1), and FiF_iFi​ is regular if ϕi\phi_iϕi​ is non-decreasing (Definition 2). The seller may serve any set of agents in a downward-closed set system J\mathcal JJ; this mission uses the kkk-uniform matroid, where a set is feasible exactly when it has at most kkk members.

A mechanism MMM maps reported values v\mathbf vv to an allocation M(v)∈JM(\mathbf v) \in \mathcal JM(v)∈J and payments πi(v)\pi_i(\mathbf v)πi​(v). It is truthful if reporting the true value is a dominant strategy and no agent ever gets negative utility. Its expected revenue is RM=Ev[∑iπi(v)]\mathcal R^M = \mathbb E_{\mathbf v}[\sum_i \pi_i(\mathbf v)]RM=Ev​[∑i​πi​(v)], and RM\mathcal R^{\mathcal M}RM denotes the revenue of Myerson's mechanism, the largest over truthful mechanisms (Theorem 19).

Given prices p\mathbf pp and values v\mathbf vv, agent iii desires service if vi≥piv_i \ge p_ivi​≥pi​. Let Sv\mathcal S_{\mathbf v}Sv​ be the class of maximal feasible sets of desiring agents. When agents arrive in an arbitrary order and each buys if it desires service and can still be feasibly served, the set of buyers lies in Sv\mathcal S_{\mathbf v}Sv​. The paper's pessimistic revenue estimate is

Rpobl=Ev∼F min⁡S∈Sv∑i∈Spi.\mathcal R^{\mathrm{obl}}_{\mathbf p} = \mathbb E_{\mathbf v \sim \mathbf F}\ \min_{S \in \mathcal S_{\mathbf v}} \sum_{i \in S} p_i .Rpobl​=Ev∼F​ S∈Sv​min​i∈S∑​pi​.

For the prophet inequality, X1,…,XnX_1, \dots, X_nX1​,…,Xn​ are independent nonnegative random variables with order statistics X(1)≥⋯≥X(n)X_{(1)} \ge \dots \ge X_{(n)}X(1)​≥⋯≥X(n)​, and (x)+=max⁡(0,x)(x)^+ = \max(0, x)(x)+=max(0,x). The threshold rule with threshold ccc picks indices t1(c),…,tk(c)t_1(c), \dots, t_k(c)t1​(c),…,tk​(c), where ti(c)t_i(c)ti​(c) is the lesser of n−k+in-k+in−k+i and the iii-th smallest index jjj with Xj≥cX_j \ge cXj​≥c (or n−k+in - k + in−k+i if there is none). The numbers a∗a^*a∗ and b∗b^*b∗ are the unique solutions of

a=∑i=1kE(X(i)−a/k)+,b=∑i=1nE(Xi−b/k)+.a = \sum_{i=1}^k \mathbb E\big(X_{(i)} - a/k\big)^+, \qquad b = \sum_{i=1}^n \mathbb E\big(X_i - b/k\big)^+ .a=i=1∑k​E(X(i)​−a/k)+,b=i=1∑n​E(Xi​−b/k)+.

Formalization targets

Goal: Theorem 10 (p. 9)

∃ p  ∀M truthful:RM≤2 Rpobl\exists\, \mathbf p\ \ \forall M \text{ truthful}:\qquad \mathcal R^M \le 2\, \mathcal R^{\mathrm{obl}}_{\mathbf p}∃p  ∀M truthful:RM≤2Rpobl​

for every instance with regular distributions and a kkk-uniform matroid constraint. The prices are chosen once, before the mechanism it is compared with; this is the paper's "Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ 2-approximates RM\mathcal R^{\mathcal M}RM".

Milestones

  1. Proposition 1 (p. 5): under regularity, the expected revenue of a truthful mechanism equals its expected virtual surplus E[∑i∈M(v)ϕi(vi)]\mathbb E[\sum_{i \in M(\mathbf v)} \phi_i(v_i)]E[∑i∈M(v)​ϕi​(vi​)] (with the lowest type receiving zero utility).
  2. a∗a^*a∗ and b∗b^*b∗ exist and are unique (App. D.2, p. 18).
  3. The claim a∗≤b∗a^* \le b^*a∗≤b∗ (App. D.2, p. 18).
  4. Theorem 24 (p. 18), the kkk-choice prophet inequality: for a∗≤kc≤b∗a^* \le k c \le b^*a∗≤kc≤b∗,
∑i=1kE[X(i)]≤2∑i=1kE[Xti(c)].\sum_{i=1}^k \mathbb E\big[X_{(i)}\big] \le 2 \sum_{i=1}^k \mathbb E\big[X_{t_i(c)}\big].i=1∑k​E[X(i)​]≤2i=1∑k​E[Xti​(c)​].

Significance

The theorem says that a seller of kkk identical units can fix one price per buyer, ignore the arrival order entirely, and still collect half of the optimal revenue. The factor 2 is tight: Appendix D.2 gives a single-item example with two buyers where no order-oblivious pricing does better. Corollary 11 extends the result to partition matroids, and Theorem 24 is reused for the graphical-matroid result (Theorem 12, App. D.3). Theorem 24 is a statement in optimal stopping independent of mechanism design, and kkk-choice prophet inequalities are now a standard tool for online allocation.

The results are proved in the paper (preprint arXiv:0907.2435v2; a conference version appeared at STOC 2010). To our knowledge none of them, nor any prophet inequality, has a machine-checked proof; Mathlib has independence of random variables but no order statistics, stopping-rule prophet inequalities, or Myerson's revenue characterization in this multi-agent dominant-strategy form. A related single-unit, Bayesian-incentive-compatible form of Proposition 1 exists on the platform (MechanismDesign.Auctions.revenue_eq_virtual_surplus), in a different model.

Difficulty

The threshold rule picks the first values above ccc, not the largest, and its picks are dependent random indices; the expectation E[Xti(c)]\mathbb E[X_{t_i(c)}]E[Xti​(c)​] does not factor. The obvious comparison of the gambler with the prophet term by term fails, because the gambler can exhaust its kkk picks on early, small values. The bound has to balance two events: either at least kkk values reach ccc, or a value is picked whenever it exceeds ccc; independence enters exactly in the second. The rule also has forced picks at the end of the sequence, which must be handled as stated.

On the mechanism side, Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ is a minimum over an adversarially chosen family, not the revenue of one run, so it cannot be read off from a single sequential mechanism. Proposition 1 needs the full revenue-equivalence argument: monotone allocations, the payment identity, and an integration by parts against the density.

Formalization scope

  • Distributions: each FiF_iFi​ has a bounded support [v‾i,v‾i][\underline v_i, \overline v_i][v​i​,vi​] with 0≤v‾i0 \le \underline v_i0≤v​i​, and a measurable density positive on it (a pinned convention; the paper says only "with density fif_ifi​"). Regularity is required on the support. The prior is the product of the marginals.
  • Mechanisms: deterministic, dominant-strategy incentive compatible and ex-post individually rational on the type space, with measurable allocation events and measurable, integrable payments. Payments of unserved agents are not forced to be zero.
  • RM\mathcal R^{\mathcal M}RM is not constructed. The goal is stated against every truthful mechanism, which by Theorem 19 is equivalent. Quantifier order matters: "for every mechanism there are prices" is a weaker statement and is not the goal.
  • Proposition 1 carries the normalization that an agent of the lowest type gets zero utility, which the paper presupposes on p. 12.
  • Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ is a genuine minimum over the finite, nonempty family Sv\mathcal S_{\mathbf v}Sv​; maximality is essential, since without it the empty set makes the estimate 000 and the goal false. Prices are arbitrary reals.
  • a∗a^*a∗ and b∗b^*b∗ are characterised by their equations as hypotheses, not defined by an infimum. Order statistics count multiplicity. Lean indices are 0-based. The threshold rule includes the page's forced picks ti(c)=n−k+it_i(c) = n - k + iti​(c)=n−k+i; it is not replaced by a pure threshold rule. Theorem 24 and the claims about a∗,b∗a^*, b^*a∗,b∗ assume 1≤k≤n1 \le k \le n1≤k≤n; the goal assumes nothing about kkk.
  • Out of scope: non-regular distributions (ironing), Corollary 11, and the p. 19 identity rewriting Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ as a sum of virtual values (a proof step, not a milestone).

Useful reusable infrastructure: order statistics and their measurability, Samuel-Cahn-type threshold rules, and Myerson's payment identity for dominant-strategy mechanisms. Proofs of any milestone, and supporting lemmas on these objects, are welcome.

Selected references

  • S. Chawla, J. D. Hartline, D. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, arXiv:0907.2435v2, 2010 (STOC 2010). https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • E. Samuel-Cahn, Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables, Annals of Probability 12(4), 1984. https://doi.org/10.1214/aop/1176993150
10 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimizationStochastic Systems·Captain: mikedeng1

An Efficient Algorithm for Computing an Optimal (r, Q) Policy in Continuous Review Stochastic Inventory Systems: Algorithm OPT Returns an Optimal Reorder Point and Order QuantityResearch Paper

Motivation

(r, Q) policies are the standard replenishment rule for a single item under continuous review: whenever the inventory position (stock on hand plus on order minus backorders) drops to the reorder point rrr, an order of size QQQ is placed. They are known to be optimal in the classical models with Poisson or compound renewal demand, constant or exogenous lead times and full backlogging, and they are used widely in practice and in multi-item and multi-echelon systems where they are applied item by item.

For decades, computing an optimal pair (r,Q)(r, Q)(r,Q) exactly was not routine. The textbook treatment of Hadley and Whitin (1963) gives approximations; as Browne and Zipkin (1991) put it, "until recently, there was no reliable, straightforward method for computing an optimal (r, Q) policy, even in the simple case of Poisson demand processes." Many heuristics were proposed (surveyed by Lee and Nahmias, 1989); the only exact procedure in circulation was in Zipkin's classnotes, based on a result of Sahin (1982).

Federgruen and Zheng (1992) give a short exact algorithm, Algorithm OPT, whose work is linear in the optimal order quantity Q∗Q^*Q∗. It rests only on the form of the cost, not on a particular demand model.

Setting

Inventory positions are integers (demand arrives unit by unit). A fixed cost κ>0\kappa>0κ>0 is charged per order, and G:Z→RG:\mathbb Z\to\mathbb RG:Z→R is the expected holding and backlogging cost rate as a function of the inventory position yyy. In all the models of the paper the long-run average cost of the (r,Q)(r,Q)(r,Q) policy, for an integer rrr and an integer Q≥1Q\ge1Q≥1, has the form

C(r,Q)=[κ+∑y=r+1r+QG(y)]/Q.(1)C(r,Q)=\Big[\kappa+\sum_{y=r+1}^{r+Q}G(y)\Big]\Big/Q. \tag{1}C(r,Q)=[κ+y=r+1∑r+Q​G(y)]/Q.(1)

The paper's standing assumptions on GGG are:

  1. −G-G−G is unimodal: there is an integer mmm with GGG nonincreasing on {y≤m}\{y\le m\}{y≤m} and nondecreasing on {y≥m}\{y\ge m\}{y≥m} (flat stretches allowed);
  2. lim⁡∣y∣→∞G(y)=∞\lim_{|y|\to\infty}G(y)=\inftylim∣y∣→∞​G(y)=∞.

The sequence yQy_QyQ​. Let y1y_1y1​ be an integer minimizing GGG. Given y1,…,yQy_1,\dots,y_Qy1​,…,yQ​, let L(Q)=min⁡{y1,…,yQ}L(Q)=\min\{y_1,\dots,y_Q\}L(Q)=min{y1​,…,yQ​} and R(Q)=max⁡{y1,…,yQ}R(Q)=\max\{y_1,\dots,y_Q\}R(Q)=max{y1​,…,yQ​}, and set

yQ+1={L(Q)−1if G(L(Q)−1)≤G(R(Q)+1),R(Q)+1otherwise.y_{Q+1}=\begin{cases}L(Q)-1 & \text{if } G(L(Q)-1)\le G(R(Q)+1),\\ R(Q)+1 & \text{otherwise.}\end{cases}yQ+1​={L(Q)−1R(Q)+1​if G(L(Q)−1)≤G(R(Q)+1),otherwise.​

So the window [L(Q),R(Q)][L(Q),R(Q)][L(Q),R(Q)] grows by one point at a time towards the smaller neighbouring value, ties going left. Write r∗(Q)r^*(Q)r∗(Q) for an optimal reorder point for a given QQQ, and

C∗(Q)=[κ+∑i=1QG(yi)]/Q.C^*(Q)=\Big[\kappa+\sum_{i=1}^{Q}G(y_i)\Big]\Big/Q .C∗(Q)=[κ+i=1∑Q​G(yi​)]/Q.

Algorithm OPT, Step 1. Variables S,Q,C∗,r,RS,Q,C^*,r,RS,Q,C∗,r,R start at S=κ+G(y1)S=\kappa+G(y_1)S=κ+G(y1​), Q=1Q=1Q=1, C∗=SC^*=SC∗=S, r=y1−1r=y_1-1r=y1​−1, R=y1+1R=y_1+1R=y1​+1. Each pass compares G(r)G(r)G(r) and G(R)G(R)G(R); on the smaller side (left on ties) it stops if C∗C^*C∗ is at most that value, and otherwise adds the value to SSS and moves rrr one step left or RRR one step right; then Q:=Q+1Q:=Q+1Q:=Q+1 and C∗:=S/QC^*:=S/QC∗:=S/Q. The output is the final (r,Q)(r,Q)(r,Q).

Formalization targets

Goal: Theorem 1

Under the standing assumptions, Step 1 of Algorithm OPT, started from any global minimizer y1y_1y1​ of GGG, stops after finitely many passes, and its output (r,Q)(r,Q)(r,Q) satisfies Q≥1Q\ge1Q≥1 and

C(r,Q)≤C(r′,Q′)for all integers r′ and all integers Q′≥1.C(r,Q)\le C(r',Q')\qquad\text{for all integers } r' \text{ and all integers } Q'\ge 1 .C(r,Q)≤C(r′,Q′)for all integers r′ and all integers Q′≥1.

The goal fixes no constants and no demand model: it is a statement about every GGG satisfying the standing assumptions.

Milestones, in proof order

  • §2, p. 811: {y1,…,yQ}\{y_1,\dots,y_Q\}{y1​,…,yQ​} is the contiguous block [L(Q),R(Q)][L(Q),R(Q)][L(Q),R(Q)] of QQQ integers and carries the QQQ smallest values of GGG.
  • Figure 1 (p. 809): yQ+1y_{Q+1}yQ+1​ has the least GGG-value outside the window; in particular G(y1)≤G(y2)≤⋯G(y_1)\le G(y_2)\le\cdotsG(y1​)≤G(y2​)≤⋯.
  • Lemma 1: L(Q)−1L(Q)-1L(Q)−1 is an optimal reorder point for QQQ.
  • Corollary 1: r∗(Q)−1≤r∗(Q+1)≤r∗(Q)r^*(Q)-1\le r^*(Q+1)\le r^*(Q)r∗(Q)−1≤r∗(Q+1)≤r∗(Q).
  • Display before (6): min⁡rC(r,Q)=C∗(Q)\min_r C(r,Q)=C^*(Q)minr​C(r,Q)=C∗(Q).
  • (6): C∗(Q+1)=[QC∗(Q)+G(yQ+1)]/(Q+1)C^*(Q+1)=[QC^*(Q)+G(y_{Q+1})]/(Q+1)C∗(Q+1)=[QC∗(Q)+G(yQ+1​)]/(Q+1), and C∗(Q+1)<C∗(Q)C^*(Q+1)<C^*(Q)C∗(Q+1)<C∗(Q) iff G(yQ+1)<C∗(Q)G(y_{Q+1})<C^*(Q)G(yQ+1​)<C∗(Q).
  • Lemma 2: the smallest qqq with C∗(q)≤G(yq+1)C^*(q)\le G(y_{q+1})C∗(q)≤G(yq+1​) exists and is an optimal order size.
  • Step 1 tracks the sequence: from the state (κ+∑i≤QG(yi), Q, C∗(Q), L(Q)−1, R(Q)+1)(\kappa+\sum_{i\le Q}G(y_i),\,Q,\,C^*(Q),\,L(Q)-1,\,R(Q)+1)(κ+∑i≤Q​G(yi​),Q,C∗(Q),L(Q)−1,R(Q)+1) one pass stops with (L(Q)−1,Q)(L(Q)-1,Q)(L(Q)−1,Q) exactly when C∗(Q)≤G(yQ+1)C^*(Q)\le G(y_{Q+1})C∗(Q)≤G(yQ+1​) and otherwise moves to the same state for Q+1Q+1Q+1.

Significance

The result turns the joint minimization of (1) over (r,Q)∈Z×Z≥1(r,Q)\in\mathbb Z\times\mathbb Z_{\ge1}(r,Q)∈Z×Z≥1​, an unbounded two-dimensional integer problem, into a single scan whose length is Q∗Q^*Q∗ plus the distance to the minimizer of GGG. Because it uses only the form (1) and the unimodality of −G-G−G, it applies at once to Poisson and compound Poisson demand, to stochastic lead times with an equilibrium lead-time demand, and to cost structures with stockout penalties; the paper also notes extensions to (r,nQ)(r,nQ)(r,nQ) policies. Lemma 1 and Corollary 1 additionally give the structure of the optimal reorder point as a function of QQQ.

The result has been proved on paper since 1992. What this mission adds is a machine-checked proof of the algorithm's correctness for general GGG under exactly the paper's hypotheses. The platform already has the linear-cost special case of the underlying lemmas for one discrete demand model (InventoryControl.rq_discrete_recursion, rq_discrete_joint_optimal), but with C(Q)C(Q)C(Q) and Q∗Q^*Q∗ given as hypotheses and no algorithm; nothing on the platform states the algorithm or treats general unimodal −G-G−G.

Difficulty

The obvious argument says: for fixed QQQ the sum in (1) should cover the QQQ smallest values of GGG, and the greedy window collects exactly those. Both halves need care on the integers with flat stretches of GGG: "the QQQ smallest values" is ambiguous under ties, and the claim that a greedy window holds them relies on y1y_1y1​ being a global minimizer together with the unimodality of −G-G−G, not on convexity.

The stopping rule is the second point. Lemma 2 looks like a first-order condition, but C∗(⋅)C^*(\cdot)C∗(⋅) need not be convex; optimality of the first stopping qqq for all larger QQQ uses that the values G(yi)G(y_i)G(yi​) are nondecreasing along the sequence, which the paper uses without stating. Termination of the algorithm is not discussed on the page; it needs G→∞G\to\inftyG→∞, and fails for constant GGG.

Finally, the goal is about an imperative loop. Connecting its five variables to yQy_QyQ​, C∗(Q)C^*(Q)C∗(Q) and L(Q)L(Q)L(Q) is an invariant argument that has to match the tie-breaking and the non-strict stopping tests exactly.

Formalization scope

  • Types. G:Z→RG:\mathbb Z\to\mathbb RG:Z→R, κ∈R\kappa\in\mathbb Rκ∈R with κ>0\kappa>0κ>0, reorder points in Z\mathbb ZZ, order quantities in N\mathbb NN with Q≥1Q\ge1Q≥1 required wherever a cost appears. Lean's x/0=0x/0=0x/0=0 makes C(r,0)=0C(r,0)=0C(r,0)=0, so optimality is always quantified over Q′≥1Q'\ge1Q′≥1 and the goal asserts that the returned QQQ is ≥1\ge1≥1.
  • Assumptions. "−G-G−G unimodal" is NegUnimodal G: ∃m\exists m∃m, GGG antitone on (−∞,m](-\infty,m](−∞,m] and monotone on [m,∞)[m,\infty)[m,∞). "lim⁡∣y∣→∞G=∞\lim_{|y|\to\infty}G=\inftylim∣y∣→∞​G=∞" is Coercive G: G→+∞G\to+\inftyG→+∞ along atBot and atTop. Mathlib's QuasiconvexOn ℤ is not used: over Z\mathbb ZZ-weights it holds for every function.
  • The sequence. L(Q),R(Q)L(Q),R(Q)L(Q),R(Q) are defined by recursion on the window, and yyy is 1-based with an unused value at index 0; that L,RL,RL,R are the minimum and maximum of {y1,…,yQ}\{y_1,\dots,y_Q\}{y1​,…,yQ​}, as the paper defines them, is the first milestone.
  • The algorithm. Step 1 is transcribed literally, including G(r)≤G(R)G(r)\le G(R)G(r)≤G(R) → left and the non-strict tests C∗≤G(r)C^*\le G(r)C∗≤G(r), C∗≤G(R)C^*\le G(R)C∗≤G(R); GGG is evaluated directly instead of through the ΔG\Delta GΔG bookkeeping. The loop runs with a pass budget and returns nothing when the budget runs out; the goal states that for every large enough budget it returns an optimal pair.
  • Step 0 is not formalized. It scans L=0,1,…L=0,1,\dotsL=0,1,… for the first LLL with ΔG(L)≥0\Delta G(L)\ge0ΔG(L)≥0, under the paper's simplification y1>0y_1>0y1​>0; under unimodality alone it can stop on a plateau before the minimum. The goal starts Step 1 from a given global minimizer y1y_1y1​, which is the paper's own §2 setup and matches its p. 812 remark that Step 0 may be replaced by a bisection search.
  • Not formalized: Theorem 1's second sentence (the operation count), the derivations of (1) for specific demand models, and (5).
  • Corrected slips. The printed proof of Lemma 2 writes C(Q)−C(Q∗)C(Q)-C(Q^*)C(Q)−C(Q∗) with C∗(Q)C^*(Q)C∗(Q) inside the bracket; the correct identity has C∗(Q)−C∗(Q∗)C^*(Q)-C^*(Q^*)C∗(Q)−C∗(Q∗) and C∗(Q∗)C^*(Q^*)C∗(Q∗). Lemma 2's "Q∗Q^*Q∗" is formalized as existence of the smallest qqq with the property plus its optimality, since minimizers need not be unique; likewise "r∗(Q)=L(Q)−1r^*(Q)=L(Q)-1r∗(Q)=L(Q)−1" means L(Q)−1L(Q)-1L(Q)−1 is an optimal reorder point.
  • Ruled out. Defining the algorithm's output as an argmin of CCC, or by searching for Lemma 2's qqq, would make the goal trivial; the algorithm is defined by its steps. A statement of the form "if the run returns a pair, it is optimal" would be vacuous for a loop that never stops; termination is part of the goal.

Proofs of any milestone are welcome, as are general lemmas on windows of unimodal integer sequences, which are reusable beyond this mission.

Selected references

  • A. Federgruen and Y.-S. Zheng, An Efficient Algorithm for Computing an Optimal (r, Q) Policy in Continuous Review Stochastic Inventory Systems, Operations Research 40(4):808–813, 1992. https://doi.org/10.1287/opre.40.4.808
  • G. Hadley and T. M. Whitin, Analysis of Inventory Systems, Prentice-Hall, 1963.
  • S. Browne and P. Zipkin, Inventory Models with Continuous, Stochastic Demands, Annals of Applied Probability 1(3):419–435, 1991. https://doi.org/10.1214/aoap/1177005875
  • H. L. Lee and S. Nahmias, Single-Product, Single-Location Models, in Handbooks in OR & MS vol. 4, 1993 (cited by the paper as a 1989 working paper).
  • I. Sahin, On the Objective Function Behavior in (s, S) Inventory Models, Operations Research 30(4):709–724, 1982. https://doi.org/10.1287/opre.30.4.709
10 thms3 active usersReviewed
🏆Completed
Operations ResearchOptimizationTheoretical Computer Science·Captain: mikedeng1

A Simple Forward Algorithm to Solve General Dynamic Lot Sizing Models with n Periods in O(n log n) or O(n) Time: Minimal Optimal Predecessor Lists Are Characterized by Strictly Increasing BreakpointsResearch Paper

Motivation

The dynamic lot size model asks when, and how much, to order of a single item over a planning horizon of nnn periods with known, time-varying demands, setup costs, unit order costs and holding costs. It is the textbook model of production planning and the building block of material requirements planning, multi-item scheduling and many decomposition schemes for larger supply-chain problems.

Wagner and Whitin (1958) showed that some optimal policy orders only when inventory is zero, which turns the problem into a shortest-path recursion with O(n2)O(n^2)O(n2) running time. For more than thirty years this was the standard algorithm. In 1991 three groups independently reduced the complexity: Federgruen and Tzur (Management Science 37(8), 1991), Wagelmans, van Hoesel and Kolen (Operations Research 40, 1992) and Aggarwal and Park (Operations Research 41, 1993). Each obtained O(nlog⁡n)O(n \log n)O(nlogn) in general and O(n)O(n)O(n) under special cost structures. The Federgruen–Tzur algorithm is a forward algorithm: at iteration jjj it keeps a short list of periods that could still be the best last setup period for some future horizon, and updates it by local tests on neighbouring entries. This mission formalizes the theorem that justifies those tests.

Setting

For periods i=1,2,…i = 1, 2, \dotsi=1,2,… let did_idi​ be the demand, KiK_iKi​ the setup cost, cic_ici​ the variable per unit order cost and hih_ihi​ the cost of carrying a unit of inventory at the end of period iii. Write D(i)=∑k=1idkD(i) = \sum_{k=1}^{i} d_kD(i)=∑k=1i​dk​ and H(i)=∑k=1ihkH(i) = \sum_{k=1}^{i} h_kH(i)=∑k=1i​hk​, so D(0)=H(0)=0D(0) = H(0) = 0D(0)=H(0)=0. For i<ji < ji<j let cij=ci+hi+⋯+hj−1c_{ij} = c_i + h_i + \dots + h_{j-1}cij​=ci​+hi​+⋯+hj−1​, let C~(i)=ci−H(i−1)\tilde C(i) = c_i - H(i-1)C~(i)=ci​−H(i−1), and let

S(i,j)=∑r=ij−1hr (D(j)−D(r))S(i, j) = \sum_{r=i}^{j-1} h_r\,\bigl(D(j) - D(r)\bigr)S(i,j)=r=i∑j−1​hr​(D(j)−D(r))

be the carrying cost of an order placed in period iii that covers the demands of periods i,…,ji, \dots, ji,…,j.

The costs are given by the zero-inventory recursion (2): F(0)=0F(0) = 0F(0)=0 and, for 1≤l≤t1 \le l \le t1≤l≤t,

F(l,t)=F(l−1)+Kl+S(l,t)+cl [D(t)−D(l−1)],F(t)=min⁡1≤l≤tF(l,t).F(l, t) = F(l-1) + K_l + S(l, t) + c_l\,[D(t) - D(l-1)], \qquad F(t) = \min_{1 \le l \le t} F(l, t).F(l,t)=F(l−1)+Kl​+S(l,t)+cl​[D(t)−D(l−1)],F(t)=1≤l≤tmin​F(l,t).

F(l,t)F(l, t)F(l,t) is the cost of the first ttt periods when the last setup is in period lll.

For two periods k<lk < lk<l the difference Δk,l(t)=F(k,t)−F(l,t)\Delta_{k,l}(t) = F(k,t) - F(l,t)Δk,l​(t)=F(k,t)−F(l,t) is affine in D(t)D(t)D(t), with intercept A(k,l)A(k,l)A(k,l) given by (4) and slope ck,l−cl=C~(k)−C~(l)c_{k,l} - c_l = \tilde C(k) - \tilde C(l)ck,l​−cl​=C~(k)−C~(l). Its root G(k,l)G(k,l)G(k,l) is defined by (5): A(k,l)/(C~(l)−C~(k))A(k,l)/(\tilde C(l) - \tilde C(k))A(k,l)/(C~(l)−C~(k)) when the slopes differ, and +∞+\infty+∞ or −∞-\infty−∞ according to the sign of A(k,l)A(k,l)A(k,l) when they agree. It is extended symmetrically, G(l,k)=G(k,l)G(l,k) = G(k,l)G(l,k)=G(k,l).

At iteration jjj the future demands are unknown, so a future horizon has a potential cumulative demand x≥D(j)x \ge D(j)x≥D(j). The jjjth Minimal Optimal Predecessors list Ω(j)\Omega(j)Ω(j) is the set of periods l≤jl \le jl≤j that are the lowest-index optimal last setup period, among {1,…,j}\{1, \dots, j\}{1,…,j}, for every potential cumulative demand in some open interval above D(j)D(j)D(j).

Formalization targets

Goal: Theorem 1(a)

Let j≥1j \ge 1j≥1 and let S={i1,…,ir}S = \{i_1, \dots, i_r\}S={i1​,…,ir​} with Ω(j)⊆S⊆{1,…,j}\Omega(j) \subseteq S \subseteq \{1, \dots, j\}Ω(j)⊆S⊆{1,…,j}, ranked so that C~(i1)≥⋯≥C~(ir)\tilde C(i_1) \ge \dots \ge \tilde C(i_r)C~(i1​)≥⋯≥C~(ir​), with equal C~\tilde CC~-values in ascending order of index. Put g(1)=D(j)g(1) = D(j)g(1)=D(j) and g(l)=G(il,il−1)g(l) = G(i_l, i_{l-1})g(l)=G(il​,il−1​) for l=2,…,rl = 2, \dots, rl=2,…,r. Then

S=Ω(j)  ⟺  g(1)<g(2)<⋯<g(r)<∞.(6)S = \Omega(j) \iff g(1) < g(2) < \dots < g(r) < \infty. \tag{6}S=Ω(j)⟺g(1)<g(2)<⋯<g(r)<∞.(6)

Milestones

In attack order:

  • identity (1a) for the carrying costs;
  • Lemma 2(a)–(d), the linearity of Δk,l\Delta_{k,l}Δk,l​ and the sign test against its root G(k,l)G(k,l)G(k,l);
  • the claim that Ω(j)\Omega(j)Ω(j) contains an optimal last setup period for the horizon jjj;
  • the strict chains (7)–(8) of the Appendix;
  • Theorem 1(b), that under (6) the first entry i1i_1i1​ is an optimal last setup period l(j)l(j)l(j);
  • Theorem 1(c)(i)–(iii), the three elimination rules: g(2)≤D(j)g(2) \le D(j)g(2)≤D(j) removes i1i_1i1​, g(k+1)≤g(k)g(k+1) \le g(k)g(k+1)≤g(k) removes iki_kik​, and g(r)=∞g(r) = \inftyg(r)=∞ removes iri_rir​.

A supporting item potCost_spec certifies that the potential costs used to define Ω(j)\Omega(j)Ω(j) agree with the paper's F(l,t)F(l,t)F(l,t), up to a term that does not depend on lll.

Significance

Theorem 1 is what makes the forward algorithm correct. Part (a) reduces the minimality of a candidate list to a condition on consecutive pairs of a sorted list. Part (c) says which entry to delete when the condition fails. Part (b) says where to read off the optimal last setup period. With these, Ω(j)\Omega(j)Ω(j) is maintained by deletions at the ends and in the interior of a list ordered by C~\tilde CC~, and each period is inserted and deleted at most once; the O(nlog⁡n)O(n \log n)O(nlogn) bound, and the O(n)O(n)O(n) bound under the paper's special cost structures, follow from this bookkeeping. The same lower-envelope reasoning appears in the other 1991–1993 algorithms and in later extensions to backlogging and capacitated variants.

The result has a complete published proof. To our knowledge there is no machine-checked development of the Wagner–Whitin recursion or of any of the fast lot-sizing algorithms. This mission produces the model, the breakpoints and the Minimal Optimal Predecessors lists as reusable definitions, and a checked proof of the characterization. It also records two small corrections that a formal reading forces on the printed text (see Formalization scope).

Difficulty

Each piece in isolation is elementary algebra on affine functions. The difficulty is in the combinatorics of the lower envelope with ties. The natural argument "consecutive breakpoints increase, so each line owns an interval" must handle three things:

  • equal slopes, where G=±∞G = \pm\inftyG=±∞;
  • several lines meeting at one point;
  • the lowest-index tie-breaking that makes Ω(j)\Omega(j)Ω(j) minimal.

The "only if" direction needs every failure of (6) to be traced to an element that is never the unique lowest-index optimum on an interval. Ties are exactly where the printed definition of Ω(j)\Omega(j)Ω(j), read literally at a single demand value, breaks the theorem. A proof that ignores ties proves a statement that is false.

Formalization scope

  • Data and costs. The data are four functions N→R\mathbb N \to \mathbb RN→R bundled in a structure; values at index 000 are unused, and no sign conditions are imposed. FFF is defined by the recursion (2) with F(0)=0F(0) = 0F(0)=0. Its identification with the minimum cost over all feasible policies is the paper's Lemma 1 (Wagner–Whitin), which is not part of this mission. The horizon nnn is not a parameter.
  • Breakpoints. GGG and the critical values g(⋅)g(\cdot)g(⋅) take values in EReal, so ±∞\pm\infty±∞ are kept distinct from every real number. The final "<∞< \infty<∞" of (6) is part of the condition.
  • Ranked lists. A ranked set is a duplicate-free List ℕ. Lean lists are 0-based, so the paper's im+1i_{m+1}im+1​ and g(m+1)g(m+1)g(m+1) are entry mmm and gval j L m.
  • Disclosed change 1, Ω(j)\Omega(j)Ω(j). The page asks for a single potential cumulative demand D≥D(j)D \ge D(j)D≥D(j) at which lll is the lowest-index optimum. With that reading, Theorem 1(a) "only if" and Theorem 1(c) fail when two lines tie exactly at a breakpoint (an explicit five-period instance is in the definition's note). The formalization requires lll to be the lowest-index optimum on a nondegenerate open interval of potential demands above D(j)D(j)D(j). This is the paper's own description of the list on p. 915: "the unique optimal last setup period for any horizon … with potential cumulative demand g(k)<D<g(k+1)g(k) < D < g(k+1)g(k)<D<g(k+1)".
  • Disclosed change 2, Lemma 2(d). The printed hypothesis "ck,l<clc_{k,l} < c_lck,l​<cl​" duplicates part (c) and is read as "ck,l=clc_{k,l} = c_lck,l​=cl​". The equivalence "Δk,l≥0\Delta_{k,l} \ge 0Δk,l​≥0 iff D(t)≥G(k,l)D(t) \ge G(k,l)D(t)≥G(k,l)" is stated under A(k,l)≠0A(k,l) \ne 0A(k,l)=0, since A(k,l)=0A(k,l) = 0A(k,l)=0 gives G=+∞G = +\inftyG=+∞ by (5).
  • Ruling out trivial formalizations. The hypotheses of the goal are satisfiable for every j≥1j \ge 1j≥1: rank {1,…,j}\{1, \dots, j\}{1,…,j} itself. Ω(j)\Omega(j)Ω(j) is nonempty (a milestone). F(t)F(t)F(t) for t≥1t \ge 1t≥1 is a minimum over the nonempty set {1,…,t}\{1, \dots, t\}{1,…,t}, never a default value. GGG is never replaced by a real-valued junk value at equal slopes.
  • Out of scope. Lemma 1, Lemma 3, Corollaries 1–5, Theorem 2, the Algorithm's pseudo-code and its complexity analysis, and the submodularity discussion of §5.
  • Reusable infrastructure. The model, the recursion (2), AAA, GGG and Ω(j)\Omega(j)Ω(j) can be reused for the paper's algorithmic results and for related lot-sizing papers. Proofs of the milestones, in any order, are welcome.

Selected references

  • A. Federgruen and M. Tzur, A Simple Forward Algorithm to Solve General Dynamic Lot Sizing Models with n Periods in O(n log n) or O(n) Time, Management Science 37(8):909–925, 1991. https://doi.org/10.1287/mnsc.37.8.909
  • H. M. Wagner and T. M. Whitin, Dynamic Version of the Economic Lot Size Model, Management Science 5(1):89–96, 1958. https://doi.org/10.1287/mnsc.5.1.89
  • A. Wagelmans, S. van Hoesel and A. Kolen, Economic Lot-Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case, Operations Research 40(1-supplement-1):S145–S156, 1992. https://doi.org/10.1287/opre.40.1.S145
  • A. Aggarwal and J. K. Park, Improved Algorithms for Economic Lot Size Problems, Operations Research 41(3):549–571, 1993. https://doi.org/10.1287/opre.41.3.549
16 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingGraph TheoryOperations Research+1·Captain: mikedeng1

Algorithm 97: Shortest Path: Floyd's Procedure Computes the Shortest Path Length Between Every Pair of PointsResearch Paper

Motivation

Routing and network optimization often require the length of the best route between every ordered pair of points. Robert W. Floyd's Algorithm 97 gives a compact procedure for this task: it receives a matrix of direct-link lengths and changes the matrix in place until each entry is meant to represent a shortest-path length. The procedure is a small historical source for an algorithm now used as a standard all-pairs shortest-path routine. Its published text consists of the ALGOL code and a short explanatory comment, without a correctness proof.

The same page contains Floyd's Algorithm 96, a Boolean procedure for ancestor relations. Its output records whether a chain of parent links connects two individuals. Floyd cites Warshall's theorem on Boolean matrices in both comments. The Boolean procedure and the length procedure use the same order of three loops; together they expose the distinction between discovering that a route exists and determining its best length. This mission formalizes both claims from Floyd's published page, with the shortest-path statement as its goal.

Setting

A directed network has nnn numbered points. Its length matrix www assigns a real number w(i,j)w(i,j)w(i,j) to a direct link from iii to jjj. The value ∞\infty∞ means that the direct link is absent. Links may have negative lengths, and the initial diagonal entries w(i,i)w(i,i)w(i,i) are unrestricted. The paper's matrix index range is 1,…,n1,\ldots,n1,…,n; the Lean development uses 0,…,n−10,\ldots,n-10,…,n−1 in the same order.

A path from iii to jjj is a sequence p0=i,p1,…,pL=jp_0=i,p_1,\ldots,p_L=jp0​=i,p1​,…,pL​=j with L≥1L\ge1L≥1 links. The points p0,…,pL−1p_0,\ldots,p_{L-1}p0​,…,pL−1​ are distinct, as are p1,…,pLp_1,\ldots,p_Lp1​,…,pL​. Thus a path between different points has no repeated point, while a path from a point to itself is a simple closed path with at least one link. Its length is ℓw(p)=∑t=0L−1w(pt,pt+1)\ell_w(p)=\sum_{t=0}^{L-1}w(p_t,p_{t+1})ℓw​(p)=∑t=0L−1​w(pt​,pt+1​); a missing link gives length ∞\infty∞. Write dw(i,j)d_w(i,j)dw​(i,j) for the minimum length among these paths, taking dw(i,j)=∞d_w(i,j)=\inftydw​(i,j)=∞ when there is no finite-length path. Since L≤nL\le nL≤n, this is a minimum over a finite family.

The no-negative-cycle condition says that every closed path has nonnegative length. Individual links can still be negative. This condition matters because, in a network with a negative cycle, repeated travel around that cycle can keep reducing a walk's length. Floyd's comment does not state the condition, although the claimed output needs it.

Algorithm 97 scans a pivot iii, then row jjj, then column kkk, each in increasing order. It enters the column scan when the current m(j,i)m(j,i)m(j,i) is finite; if the current m(i,k)m(i,k)m(i,k) is also finite, it computes s=m(j,i)+m(i,k)s=m(j,i)+m(i,k)s=m(j,i)+m(i,k) and replaces m(j,k)m(j,k)m(j,k) when s<m(j,k)s<m(j,k)s<m(j,k). Every replacement affects subsequent reads of the same matrix. Algorithm 96 makes the corresponding Boolean update: when m(j,i)m(j,i)m(j,i) and m(i,k)m(i,k)m(i,k) are true, it sets m(j,k)m(j,k)m(j,k) to true.

Formalization targets

Reachability and missing paths

For Algorithm 96, let b+b^+b+ be the transitive closure of the initial parent relation bbb, using chains of one or more links. Its comment asserts

ancestor⁡(b)(i,j)=true⟺ib+j.\operatorname{ancestor}(b)(i,j)=\mathrm{true}\quad\Longleftrightarrow\quad i\mathrel{b^+}j.ancestor(b)(i,j)=true⟺ib+j.

For Algorithm 97, the separate unreachable-pair sentence asserts that, whenever no finite-length path runs from iii to jjj,

shortestPath⁡(w)(i,j)=∞.\operatorname{shortestPath}(w)(i,j)=\infty.shortestPath(w)(i,j)=∞.

This second target needs no condition on cycle lengths. Both statements are milestones because they are claims printed in the two algorithm comments, rather than lemmas invented for the formalization.

Complete shortest-path matrix

The goal is the whole output claim of Algorithm 97. For every nnn, every matrix www with no negative cycle, and all points i,ji,ji,j,

shortestPath⁡(w)(i,j)=dw(i,j).\operatorname{shortestPath}(w)(i,j)=d_w(i,j).shortestPath(w)(i,j)=dw​(i,j).

The equality includes paths with negative individual links, diagonal entries, and unreachable pairs. It fixes the entire final matrix, rather than only an upper or lower bound.

Significance

The goal connects an explicit in-place matrix program with a route-based definition of shortest length. Once established, it permits later formal developments to use the procedure as a justified all-pairs distance computation, including networks whose individual links have negative lengths. The Boolean milestone similarly identifies the final state of an ancestor procedure with the transitive closure of the initial relation. Neither assertion requires treating an implementation's output as the definition of the mathematical answer.

Floyd's 1962 paper states these outcomes but supplies no proof. This mission supplies precise Lean statements and definitions for a proof to target. A completed machine-checked development would establish the published procedure's correctness under the missing necessary premise. The statements in this proposal are currently open theorem targets; compiling their declarations checks syntax and types, not their proofs. Supporting work on finite paths, cycle decompositions, and matrix updates can be reused in other finite directed-network arguments.

Difficulty

The array is changed in place. During a pivot's sweep, an entry used in a later update may already differ from its value at the start of that pivot. The test on m(j,i)m(j,i)m(j,i) is evaluated before the column loop, but the same entry is read again within every column iteration. A proof based only on a simultaneous, out-of-place matrix recurrence does not directly describe these reads. Negative individual links also prevent arguments that rely on every update decreasing only through a nonnegative segment. The no-negative-cycle condition must control what happens when a proposed route returns to a point already visited.

Formalization scope

Points are Fin n, including the empty network at n=0n=0n=0 and the single-point network at n=1n=1n=1. Lengths are WithTop ℝ, where ⊤ represents the paper's ₁₀10 sentinel as mathematical infinity. The paper's literal sentinel is 101010^{10}1010; a finite bound cannot represent arbitrarily long paths, so this mission uses infinity in its goal. The ALGOL real operations are represented by exact real arithmetic. The printed procedure's loop order, strict comparison, two finiteness guards, and immediate assignments are part of the Lean definition.

The initial diagonal is not normalized. Therefore a path from iii to itself has at least one link, and the final diagonal denotes a shortest closed-path length when one exists. The Boolean comment's “is true if” is read as an equivalence, supported by its following explanation of the final matrix; chains have one or more links, matching Lean's Relation.TransGen.

The sole added hypothesis in the main goal is absence of negative cycles. It is necessary: with one point and self-link length −1-1−1, the procedure changes that entry to −2-2−2, although the shortest simple closed path has length −1-1−1. No nonnegative-link or zero-diagonal premise is imposed. The unreachable-pair milestone omits the cycle hypothesis because its claim holds without it. The benchmark dwd_wdw​ is a finite minimum of summed link lengths, defined independently of Algorithm 97; defining it from the procedure or its recurrence would empty the goal of its intended content. Contributions proving the printed algorithms' statements, or establishing reusable finite-path and update results needed for them, fit this scope.

Selected references

  • Robert W. Floyd, Algorithm 97: Shortest Path, Communications of the ACM 5(6), 1962, p. 345. DOI 10.1145/367766.368168.
  • Robert W. Floyd, Algorithm 96: Ancestor, Communications of the ACM 5(6), 1962, pp. 344–345, in the same published Algorithms department scan.
6 thms2 active usersReviewed
🏆Completed
Dynamic ProgrammingOperations ResearchOptimization+1·Captain: mikedeng1

Optimal Policies for a Multi-Echelon Inventory Problem: The Two-Echelon Optimal Cost Splits into the Isolated Installation-1 Cost Plus a Function of Echelon StockResearch Paper

Motivation

Most physical supply chains hold stock at several levels: a factory warehouse feeds a regional depot, which feeds a retail outlet. Each level orders from the one above it, and a shortage upstream delays replenishment downstream. Optimizing such a multi-echelon system by dynamic programming looks hopeless, because the state is a vector of stock levels and stock in transit at every installation, and the value function of a two-installation system with a two-period shipping lag already depends on three continuous variables.

Andrew J. Clark and Herbert Scarf (Management Science 6(4):475–490, 1960) showed that for a serial system this curse of dimensionality disappears. Working with echelon stock (the stock at a level plus everything below it or in transit to a lower level), the optimal system cost separates into the cost of the lowest installation, optimized as if it stood alone, plus a function of echelon stock only. The result is the foundation of multi-echelon inventory theory: the echelon base-stock policies used in practice, the stationary analyses of Federgruen and Zipkin (1984) and Chen and Zheng (1994), and textbook treatments (Zipkin, Foundations of Inventory Management, 2000; Snyder and Shen, Fundamentals of Supply Chain Theory) all descend from it.

Timeline. Arrow, Harris and Marschak (1951) and Arrow, Karlin and Scarf (1958) set up periodic-review inventory models with discounted costs. Karlin and Scarf (1958) treated a single installation with a delivery lag, reducing it to a problem without lag (the paper's facts 1–3). Clark and Scarf (1960) proved the decomposition for serial systems with linear shipping costs and a setup cost permitted only at the top. Federgruen and Zipkin (1984) extended it to infinite horizons and Chen and Zheng (1994) gave a lower-bound proof that reaches more general structures.

Setting

Two installations are in series. Customer demand occurs only at installation 1; its demand in each period is non-negative with density φ\varphiφ on (0,∞)(0,\infty)(0,∞), independent across periods, and excess demand is backlogged. Installation 2 ships to installation 1 with a two-period lead time at unit cost c1≥0c_1\ge0c1​≥0. The system orders z≥0z\ge0z≥0 units from outside at cost c(z)=K+czc(z)=K+czc(z)=K+cz for z>0z>0z>0 and c(0)=0c(0)=0c(0)=0 (eq. (5)); these arrive at installation 2 one period later. Costs nnn periods ahead are discounted by αn\alpha^nαn, α≥0\alpha\ge0α≥0.

The state at the start of a period is (x1,w1,x2)(x_1,w_1,x_2)(x1​,w1​,x2​): x1x_1x1​ is the stock on hand at installation 1, w1w_1w1​ the stock that reaches installation 1 next period, and x2x_2x2​ the echelon-2 stock (on hand at both installations plus in transit), so x1+w1≤x2x_1+w_1\le x_2x1​+w1​≤x2​. Installation 1 pays the expected holding and shortage cost (1),

L(x)={hx+p∫x∞(t−x)φ(t) dt,x>0,p∫0∞(t−x)φ(t) dt,x≤0,L(x)=\begin{cases}hx+p\int_x^\infty(t-x)\varphi(t)\,dt,&x>0,\\ p\int_0^\infty(t-x)\varphi(t)\,dt,&x\le0,\end{cases}L(x)={hx+p∫x∞​(t−x)φ(t)dt,p∫0∞​(t−x)φ(t)dt,​x>0,x≤0,​

and echelon 2 pays a natural one-period cost L~(x2)\tilde L(x_2)L~(x2​) (Assumption 3).

With nnn periods remaining, the optimal system cost Cn(x1,w1,x2)C_n(x_1,w_1,x_2)Cn​(x1​,w1​,x2​) satisfies, with C0≡0C_0\equiv0C0​≡0,

Cn(x1,w1,x2)=min⁡x1+w1≤y≤x20≤z{c(z)+c1(y−x1−w1)+L~(x2)+L(x1)+α∫0∞Cn−1(x1+w1−t, y−x1−w1, x2+z−t)φ(t) dt}(14)C_n(x_1,w_1,x_2)=\min_{\substack{x_1+w_1\le y\le x_2\\0\le z}}\Big\{c(z)+c_1(y-x_1-w_1)+\tilde L(x_2)+L(x_1)+\alpha\int_0^\infty C_{n-1}(x_1+w_1-t,\,y-x_1-w_1,\,x_2+z-t)\varphi(t)\,dt\Big\}\qquad(14)Cn​(x1​,w1​,x2​)=x1​+w1​≤y≤x2​0≤z​min​{c(z)+c1​(y−x1​−w1​)+L~(x2​)+L(x1​)+α∫0∞​Cn−1​(x1​+w1​−t,y−x1​−w1​,x2​+z−t)φ(t)dt}(14)

where yyy is installation 1's target (stock on hand plus in transit after shipping). Installation 1 in isolation, buying at unit cost c1c_1c1​ with a two-period lag, has optimal cost C^n(x1,w1)\hat C_n(x_1,w_1)C^n​(x1​,w1​), C^0≡0\hat C_0\equiv0C^0​≡0:

C^n(x1,w1)=min⁡y≥x1+w1{c1(y−x1−w1)+L(x1)+α∫0∞C^n−1(x1+w1−t, y−x1−w1)φ(t) dt}.(15)\hat C_n(x_1,w_1)=\min_{y\ge x_1+w_1}\Big\{c_1(y-x_1-w_1)+L(x_1)+\alpha\int_0^\infty\hat C_{n-1}(x_1+w_1-t,\,y-x_1-w_1)\varphi(t)\,dt\Big\}.\qquad(15)C^n​(x1​,w1​)=y≥x1​+w1​min​{c1​(y−x1​−w1​)+L(x1​)+α∫0∞​C^n−1​(x1​+w1​−t,y−x1​−w1​)φ(t)dt}.(15)

In Lean these are ClarkScarf.Serial.Model.sysCost and isoCost; the expressions in braces are sysObj and isoObj, indexed by nnn for the problem with n+1n+1n+1 periods remaining.

Formalization targets

Goal: Theorem 1 (p. 482)

There are functions gng_ngn​ with g1=L~g_1=\tilde Lg1​=L~ such that, for all n≥1n\ge1n≥1 and x1+w1≤x2x_1+w_1\le x_2x1​+w1​≤x2​,

Cn(x1,w1,x2)=C^n(x1,w1)+gn(x2),(16)C_n(x_1,w_1,x_2)=\hat C_n(x_1,w_1)+g_n(x_2),\qquad(16)Cn​(x1​,w1​,x2​)=C^n​(x1​,w1​)+gn​(x2​),(16)

and installation 1 acts optimally by aiming at an isolated-optimal target y^\hat yy^​ and taking min⁡(x2,y^)\min(x_2,\hat y)min(x2​,y^​), as much as installation 2 can supply. The goal fixes no form for gng_ngn​ and needs no critical numbers.

Milestones

  1. Convexity of y↦α∫ ⁣ ⁣∫L(y−t1−t2)φ(t1)φ(t2)y\mapsto\alpha\int\!\!\int L(y-t_1-t_2)\varphi(t_1)\varphi(t_2)y↦α∫∫L(y−t1​−t2​)φ(t1​)φ(t2​) (§2 item 2, p. 478).
  2. The isolated decomposition C^n(x1,w1)=L(x1)+α∫0∞L(x1+w1−t)φ(t) dt+fn(x1+w1)\hat C_n(x_1,w_1)=L(x_1)+\alpha\int_0^\infty L(x_1+w_1-t)\varphi(t)\,dt+f_n(x_1+w_1)C^n​(x1​,w1​)=L(x1​)+α∫0∞​L(x1​+w1​−t)φ(t)dt+fn​(x1​+w1​) for n≥2n\ge2n≥2, with fnf_nfn​ of (7) (p. 480).
  3. Convexity of every fnf_nfn​ (§2 item 3, p. 478).
  4. Eqs. (18)–(19) (p. 483): the system cost when echelon-2 stock is above or below the isolated critical number xˉn\bar x_nxˉn​.
  5. Eqs. (21)–(25) (pp. 483–484): the shortfall cost Λn\Lambda_nΛn​ depends on x2x_2x2​ alone,
Λn(x2)=c1(x2−xˉn)+α2∫0∞ ⁣ ⁣∫0∞[L(x2−t−y)−L(xˉn−t−y)]φ(t)φ(y) dy dt+α∫0∞[fn−1(x2−t)−fn−1(xˉn−t)]φ(t) dt.\Lambda_n(x_2)=c_1(x_2-\bar x_n)+\alpha^2\int_0^\infty\!\!\int_0^\infty[L(x_2-t-y)-L(\bar x_n-t-y)]\varphi(t)\varphi(y)\,dy\,dt+\alpha\int_0^\infty[f_{n-1}(x_2-t)-f_{n-1}(\bar x_n-t)]\varphi(t)\,dt.Λn​(x2​)=c1​(x2​−xˉn​)+α2∫0∞​∫0∞​[L(x2​−t−y)−L(xˉn​−t−y)]φ(t)φ(y)dydt+α∫0∞​[fn−1​(x2​−t)−fn−1​(xˉn​−t)]φ(t)dt.
  1. Theorem 2 (p. 484), the explicit form: given critical numbers, gng_ngn​ is computed by (26), gn(x2)=min⁡z≥0{c(z)+L~(x2)+Λn(x2)+α∫gn−1(x2+z−t)φ(t) dt}g_n(x_2)=\min_{z\ge0}\{c(z)+\tilde L(x_2)+\Lambda_n(x_2)+\alpha\int g_{n-1}(x_2+z-t)\varphi(t)\,dt\}gn​(x2​)=minz≥0​{c(z)+L~(x2​)+Λn​(x2​)+α∫gn−1​(x2​+z−t)φ(t)dt}.

Significance

The result. Theorem 1 replaces one three-dimensional dynamic program by two one-dimensional ones. Installation 1 solves its own problem (15), whose solution is a critical-number policy, and echelon 2 solves a single-installation problem in x2x_2x2​ with one-period cost L~+Λn\tilde L+\Lambda_nL~+Λn​. When L~\tilde LL~ is convex the augmented cost is convex (the paper remarks this for Expression (10)), so the echelon-2 policy is of (S,s)(S,s)(S,s) type by Scarf's theorem, and the whole system runs on echelon base-stock rules. Every later serial-system result, finite or infinite horizon, uses this decomposition or its proof idea, and the "induced penalty" Λn\Lambda_nΛn​ is the prototype of the penalty functions used in the multi-echelon literature.

Formalizing it. The theorem is classical and proved, but no machine-checked version exists. The published platform items on Clark–Scarf are a stationary single-period decomposition with normal demand and a disproved infinite-horizon base-stock recursion, neither of which is this finite-horizon dynamic program. A formal development produces the value functions (14)–(15) with real infima and set integrals, the measurability and integrability of value functions defined by infima, the convexity propagation through the recursion (7), and the decomposition itself, which are reusable for any finite-horizon inventory recursion with lead times.

Difficulty

The obvious induction on nnn substitutes (16) into (14) and separates the minimizations over yyy and zzz. The separation is immediate; the hard step is that the constrained minimum over x1+w1≤y≤x2x_1+w_1\le y\le x_2x1​+w1​≤y≤x2​ differs from the unconstrained one by an amount that a priori depends on (x1,w1)(x_1,w_1)(x1​,w1​). Showing that it depends on x2x_2x2​ alone is the content of Theorem 1; nothing in the separation step itself rules out a dependence on (x1,w1)(x_1,w_1)(x1​,w1​). On the measure-theoretic side, every value function is defined by an infimum over an uncountable set and then integrated against φ\varphiφ. Its measurability and integrability are not automatic, and they must be established before any identity between integrals can be manipulated.

Formalization scope

Everything lives in ClarkScarf.Serial, one definition file Def_ClarkScarf_Serial_Model and seven theorem files. Conventions committed to:

  • The model is a structure Model whose fields carry the data and the standing hypotheses: h,p,α,c1,K,c≥0h,p,\alpha,c_1,K,c\ge0h,p,α,c1​,K,c≥0; φ≥0\varphi\ge0φ≥0 with ∫0∞φ=1\int_0^\infty\varphi=1∫0∞​φ=1; and two additions the page leaves implicit, disclosed in each statement: a finite demand mean (otherwise (1) is infinite for x≤0x\le0x≤0) and L~\tilde LL~ non-negative, continuous and of at most linear growth (Assumption 3 leaves L~\tilde LL~ unspecified; these make every expectation in (14) finite and measurable). No discount bound α<1\alpha<1α<1, no convexity of L~\tilde LL~, no K=0K=0K=0 and no sign condition on w1w_1w1​ is assumed.
  • Expectations are set integrals ∫(0,∞)F(t)φ(t) dt\int_{(0,\infty)}F(t)\varphi(t)\,dt∫(0,∞)​F(t)φ(t)dt; "Min" is a real infimum over a nonempty feasible set of a non-negative objective.
  • Every statement about CnC_nCn​ is restricted to the state domain x1+w1≤x2x_1+w_1\le x_2x1​+w1​≤x2​; outside it the feasible set of (14) is empty.
  • The horizon index counts periods remaining, C0≡C^0≡0C_0\equiv\hat C_0\equiv0C0​≡C^0​≡0, and fn≡0f_n\equiv0fn​≡0 for n≤2n\le2n≤2.

A formalization in which the feasible set of (14) is empty, in which the expectations are junk zeros of non-integrable integrands, or in which gng_ngn​ may depend on (x1,w1)(x_1,w_1)(x1​,w1​) would make (16) trivial; the domain restriction, the integrability conditions and the order ∃g ∀x1,w1,x2\exists g\,\forall x_1,w_1,x_2∃g∀x1​,w1​,x2​ rule these out. A sorry-free check (not part of the mission) verifies C1=L(x1)+L~(x2)C_1=L(x_1)+\tilde L(x_2)C1​=L(x1​)+L~(x2​) and C^1=L(x1)\hat C_1=L(x_1)C^1​=L(x1​) and exhibits a model with exponential demand satisfying all hypotheses.

Needed infrastructure: Fubini-type rearrangement of iterated set integrals against a density, integrability of functions of linear growth against a finite-mean density, convexity preserved under infimal projection u↦inf⁡y≥uu\mapsto\inf_{y\ge u}u↦infy≥u​ and under convolution with a density, and measurability of infimum-defined functions. Contributions of these general lemmas, of the base cases n=1,2n=1,2n=1,2, and of any milestone are welcome.

Selected references

  • A. J. Clark and H. Scarf, Optimal Policies for a Multi-Echelon Inventory Problem, Management Science 6(4):475–490, 1960. https://doi.org/10.1287/mnsc.6.4.475
  • S. Karlin and H. Scarf, Inventory Models of the Arrow-Harris-Marschak Type with Time Lag, in Arrow, Karlin, Scarf (eds.), Studies in the Mathematical Theory of Inventory and Production, Stanford University Press, 1958.
  • H. Scarf, The Optimality of (S, s) Policies in the Dynamic Inventory Problem, in Mathematical Methods in the Social Sciences, Stanford University Press, 1960.
  • A. Federgruen and P. Zipkin, Computational Issues in an Infinite-Horizon, Multiechelon Inventory Model, Operations Research 32(4):818–836, 1984. https://doi.org/10.1287/opre.32.4.818
  • F. Chen and Y.-S. Zheng, Lower Bounds for Multi-Echelon Stochastic Inventory Systems, Management Science 40(11):1426–1443, 1994. https://doi.org/10.1287/mnsc.40.11.1426
8 thms2 active usersReviewed
🏆Completed
CombinatoricsComplexity TheoryDiscrete Geometry+2·Captain: mikedeng1

Exponential Lower Bounds for Polytopes in Combinatorial Optimization: The TSP Polytope Has Extension Complexity 2^Ω(√n)Research Paper

Motivation

Combinatorial optimization problems are routinely solved by writing the convex hull of their feasible solutions as the feasible region of a linear program. When that convex hull has exponentially many facets, a classical trick is to add auxiliary variables: a polytope with many facets may be the linear projection of a higher-dimensional polyhedron with few. The spanning tree polytope, the permutahedron and the parity polytope all have compact descriptions of this kind. This raises the question of whether every polytope of an NP-hard problem might also have one, which would yield a polynomial-size linear program for that problem.

In the late 1980s several papers claimed polynomial-size linear programs for the traveling salesman problem (TSP). Yannakakis (STOC 1988; JCSS 1991) refuted all such claims at once by showing that every symmetric extended formulation of the TSP polytope has exponential size. He asked whether the symmetry assumption could be removed. Fiorini, Massar, Pokutta, Tiwary and de Wolf (STOC 2012; J. ACM 2015) answered the question: every extended formulation of the TSP polytope, symmetric or not, has 2Ω(n)2^{\Omega(\sqrt n)}2Ω(n​) inequalities.

Timeline.

  • 1990: De Simone shows that the correlation polytope is linearly isomorphic to the cut polytope.
  • 1991: Yannakakis proves the factorization theorem (extension complexity equals the nonnegative rank of a slack matrix) and the exponential lower bound for symmetric formulations of the TSP and perfect matching polytopes.
  • 1992: Razborov proves the distributional lower bound for set disjointness.
  • 2003: de Wolf shows that the support of M(n)ab=(1−a⊤b)2M(n)_{ab}=(1-a^\top b)^2M(n)ab​=(1−a⊤b)2 needs 2Ω(n)2^{\Omega(n)}2Ω(n) rectangles to cover.
  • 2012/2015: Fiorini et al. prove xc(CUT(n))=2Ω(n)\mathrm{xc}(\mathrm{CUT}(n))=2^{\Omega(n)}xc(CUT(n))=2Ω(n), xc(TSP(n))=2Ω(n)\mathrm{xc}(\mathrm{TSP}(n))=2^{\Omega(\sqrt n)}xc(TSP(n))=2Ω(n​), and a 2Ω(n)2^{\Omega(\sqrt n)}2Ω(n​) bound for stable set polytopes of some graphs on nnn vertices.
  • 2013: Kaibel and Weltge give a short combinatorial proof of the correlation-polytope bound, with constant C=log⁡2(3/2)C=\log_2(3/2)C=log2​(3/2).
  • 2014: Rothvoss proves 2Ω(n)2^{\Omega(n)}2Ω(n) for the perfect matching polytope.

Setting

Let ι\iotaι be a finite index set. An extended formulation (EF) of a set P⊆RιP\subseteq\mathbb R^{\iota}P⊆Rι is a linear system E=x+F=y=g=E^{=}x+F^{=}y=g^{=}E=x+F=y=g=, E≤x+F≤y≤g≤E^{\le}x+F^{\le}y\le g^{\le}E≤x+F≤y≤g≤ in variables (x,y)∈Rι×Rk(x,y)\in\mathbb R^{\iota}\times\mathbb R^{k}(x,y)∈Rι×Rk such that x∈Px\in Px∈P exactly when some yyy satisfies it. Its size is the number of inequalities. The extension complexity xc(P)\mathrm{xc}(P)xc(P) is the least size of an EF of PPP.

A polytope is the convex hull of finitely many points. A face of PPP is PPP itself or its intersection with a valid hyperplane, and a facet is a maximal proper face. A polytope QQQ is an extension of PPP if π(Q)=P\pi(Q)=Pπ(Q)=P for some linear map π\piπ. Given P={x:Ax≤b}=conv(V)P=\{x : Ax\le b\}=\mathrm{conv}(V)P={x:Ax≤b}=conv(V), the slack matrix has entries Sij=bi−AivjS_{ij}=b_i-A_iv_jSij​=bi​−Ai​vj​. The nonnegative rank rank+(M)\mathrm{rank}_+(M)rank+​(M) is the least rrr with M=TUM=TUM=TU, where T≥0T\ge 0T≥0 has rrr columns and U≥0U\ge 0U≥0 has rrr rows.

For nnn-bit strings a,ba,ba,b, a⊤ba^\top ba⊤b is the number of common ones, and M(n)M(n)M(n) is the 2n×2n2^n\times 2^n2n×2n matrix Mab=(1−a⊤b)2M_{ab}=(1-a^\top b)^2Mab​=(1−a⊤b)2. A 1-monochromatic rectangle cover of its support is a family of products R1×R2R_1\times R_2R1​×R2​, each containing only entries with Mab≠0M_{ab}\ne 0Mab​=0, that together contain all of them.

On the complete graph Kn=(Vn,En)K_n=(V_n,E_n)Kn​=(Vn​,En​), χF∈REn\chi^F\in\mathbb R^{E_n}χF∈REn​ is the characteristic vector of an edge set FFF and δ(X)\delta(X)δ(X) is the cut of X⊆VnX\subseteq V_nX⊆Vn​. The polytopes are

CUT(n)=conv{χδ(X)},COR(n)=conv{bb⊤:b∈{0,1}n}⊆Rn×n,\mathrm{CUT}(n)=\mathrm{conv}\{\chi^{\delta(X)}\},\qquad \mathrm{COR}(n)=\mathrm{conv}\{bb^\top : b\in\{0,1\}^n\}\subseteq\mathbb R^{n\times n},CUT(n)=conv{χδ(X)},COR(n)=conv{bb⊤:b∈{0,1}n}⊆Rn×n, TSP(n)=conv{χF:F⊆En is a tour (Hamiltonian cycle) of Kn}.\mathrm{TSP}(n)=\mathrm{conv}\{\chi^F : F\subseteq E_n \text{ is a tour (Hamiltonian cycle) of } K_n\}.TSP(n)=conv{χF:F⊆En​ is a tour (Hamiltonian cycle) of Kn​}.

Formalization targets

Goal: Theorem 12

∃ C>0 ∃ N ∀n≥N:xc(TSP(n)) ≥ 2Cn.\exists\,C>0\ \exists\,N\ \forall n\ge N:\qquad \mathrm{xc}(\mathrm{TSP}(n))\ \ge\ 2^{C\sqrt n}.∃C>0 ∃N ∀n≥N:xc(TSP(n)) ≥ 2Cn​.

The constant is left unfixed, so the goal survives any improvement of it.

Milestones, in attack order

  • Razborov's distributional bound (displayed in the proof of Theorem 1) and Theorem 1: every 1-rectangle cover of the support of M(n)M(n)M(n) has 2Ω(n)2^{\Omega(n)}2Ω(n) rectangles.
  • Lemma 2 and Theorem 3 (Yannakakis): rank+(S)≤r\mathrm{rank}_+(S)\le rrank+​(S)≤r   ⟺  \iff⟺ an extension with at most rrr facets   ⟺  \iff⟺ an EF with at most rrr inequalities.
  • Theorem 4: rank+(M)\mathrm{rank}_+(M)rank+​(M) is at least the rectangle covering bound of its support (already proved on the platform, referenced).
  • Theorem 5: COR(n)\mathrm{COR}(n)COR(n) is linearly isomorphic to CUT(n+1)\mathrm{CUT}(n+1)CUT(n+1). Lemma 6: ⟨2 diag(a)−aa⊤,x⟩≤1\langle 2\,\mathrm{diag}(a)-aa^\top,x\rangle\le 1⟨2diag(a)−aa⊤,x⟩≤1 is valid for COR(n)\mathrm{COR}(n)COR(n), with slack MabM_{ab}Mab​ at bb⊤bb^\topbb⊤.
  • Theorem 7: xc(CUT(n+1))=xc(COR(n))≥2Cn\mathrm{xc}(\mathrm{CUT}(n+1))=\mathrm{xc}(\mathrm{COR}(n))\ge 2^{Cn}xc(CUT(n+1))=xc(COR(n))≥2Cn.
  • Lemma 9: xc\mathrm{xc}xc does not increase under taking faces or linear images. Lemma 11: TSP(q)\mathrm{TSP}(q)TSP(q) with q=O(n2)q=O(n^2)q=O(n2) has a face that is an extension of COR(n)\mathrm{COR}(n)COR(n).
  • Stable sets: Lemma 8 and Theorem 10, xc(STAB(Gn))=2Ω(n)\mathrm{xc}(\mathrm{STAB}(G_n))=2^{\Omega(\sqrt n)}xc(STAB(Gn​))=2Ω(n​) for some graph GnG_nGn​ on nnn vertices.

Significance

The theorem rules out every polynomial-size linear programming formulation of the TSP polytope, in any number of auxiliary variables, which settles Yannakakis's question. The cut polytope bound does the same for max-cut, and the stable set bound for the stable set problem on general graphs. The results do not depend on P vs NP: they concern one specific model of computation, linear programs whose feasible region projects onto the polytope. They started a line of work on extension complexity, including perfect matching (Rothvoss), approximate EFs and semidefinite lifts.

Formalizing the result would produce a machine-checked chain from a communication-complexity bound to a polyhedral one. The paper's results are proved; the input of Theorem 1, Razborov's bound, is only cited, and is posed here as a separate target. To our knowledge none of these statements has a formal proof in Lean or another proof assistant. The polyhedral layer (Yannakakis's theorem, faces and extensions) and the matrix layer (nonnegative rank, rectangle covers) can be reused for later extension-complexity results.

Difficulty

The obvious approach, bounding the number of facets of the TSP polytope, does not work: extended formulations exist precisely because a projection can have far more facets than the lifted polyhedron. Any lower bound must cover every lifting at once, which means working with the nonnegative rank of a slack matrix rather than with any concrete formulation. Ordinary rank is no help, because M(n)M(n)M(n) has rank O(n2)O(n^2)O(n2). The step that carries the weight is Razborov's distributional bound for disjointness, a nontrivial piece of communication complexity. On the polyhedral side, Lemma 11 needs a reduction from 3SAT to a directed and then an undirected Hamiltonian cycle problem, realized as a face of TSP(q)\mathrm{TSP}(q)TSP(q) with q=O(n2)q=O(n^2)q=O(n2). Theorem 12 also needs a monotonicity of xc(TSP(n))\mathrm{xc}(\mathrm{TSP}(n))xc(TSP(n)) in nnn that the paper only indicates.

Formalization scope

  • Everything is over R\mathbb RR. Points of Rd\mathbb R^dRd are functions ι→R\iota\to\mathbb Rι→R on a finite type. REn\mathbb R^{E_n}REn​ has one coordinate per unordered edge of KnK_nKn​ (non-diagonal elements of Sym2 (Fin n)). Rn×n\mathbb R^{n\times n}Rn×n is indexed by ordered pairs, and the Frobenius product is the dot product over ordered pairs. Bit strings are Fin n → Bool.
  • xc\mathrm{xc}xc and rank+\mathrm{rank}_+rank+​ are natural numbers (sInf of the attainable sizes), never ∞\infty∞, so no lower bound can hold through an infinite value. The size of an EF counts inequalities only.
  • Every 2Ω(f(n))2^{\Omega(f(n))}2Ω(f(n)) is ∃C>0 ∃N ∀n≥N\exists C>0\,\exists N\,\forall n\ge N∃C>0∃N∀n≥N, 2Cf(n)≤⋅2^{Cf(n)}\le\cdot2Cf(n)≤⋅ (real power). Every O(n2)O(n^2)O(n2) is a constant ccc with ≤c n2\le c\,n^2≤cn2, uniform in nnn.
  • Theorem 7 and Lemma 11 carry an added n≥1n\ge 1n≥1: at n=0n=0n=0 the printed statements fail, since COR(0)\mathrm{COR}(0)COR(0) is a point with xc=0\mathrm{xc}=0xc=0 and no positive q≤c⋅0q\le c\cdot 0q≤c⋅0 exists.
  • "Linearly isomorphic" in Theorem 5 is an injective linear map carrying CUT(n+1)\mathrm{CUT}(n+1)CUT(n+1) onto COR(n)\mathrm{COR}(n)COR(n), because the two ambient spaces have different dimensions.
  • In Theorem 3, dim⁡P≥1\dim P\ge 1dimP≥1 is "PPP has two distinct points". Faces include ∅\emptyset∅ and PPP, facets are maximal proper faces, and facets are counted with an explicit finite family.
  • Ruled out: a TSP polytope over ordered pairs, all cycles or directed tours, a weakened isomorphism in Theorem 5, and an extension complexity valued in N∪{∞}\mathbb N\cup\{\infty\}N∪{∞} that is infinite on a broken EF definition.
  • Welcome contributions: proofs of any milestone, in particular Lemma 2 and the factorization theorem (reusable for every later extension-complexity result), Theorem 5, and the face construction of Lemma 11; a proof of the monotonicity of xc(TSP(n))\mathrm{xc}(\mathrm{TSP}(n))xc(TSP(n)) in nnn as a supporting lemma.

Selected references

  • S. Fiorini, S. Massar, S. Pokutta, H. R. Tiwary, R. de Wolf, Exponential lower bounds for polytopes in combinatorial optimization, J. ACM 62(2), Art. 17, 2015. https://doi.org/10.1145/2716307
  • M. Yannakakis, Expressing combinatorial optimization problems by linear programs, J. Comput. Syst. Sci. 43(3), 441–466, 1991. https://doi.org/10.1016/0022-0000(91)90024-Y
  • A. A. Razborov, On the distributional complexity of disjointness, Theoret. Comput. Sci. 106(2), 385–390, 1992. https://doi.org/10.1016/0304-3975(92)90260-M
  • R. de Wolf, Nondeterministic quantum query and communication complexities, SIAM J. Comput. 32(3), 681–699, 2003. https://doi.org/10.1137/S0097539702407345
  • C. De Simone, The cut polytope and the Boolean quadric polytope, Discrete Math. 79(1), 71–75, 1990. https://doi.org/10.1016/0012-365X(90)90056-N
  • V. Kaibel, S. Weltge, A short proof that the extension complexity of the correlation polytope grows exponentially, Discrete Comput. Geom. 53, 397–401, 2015. https://doi.org/10.1007/s00454-014-9655-9
  • T. Rothvoss, The matching polytope has exponential extension complexity, J. ACM 64(6), Art. 41, 2017. https://doi.org/10.1145/3127497
21 thms3 active usersReviewed
🏆Completed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Quantifying the Bullwhip Effect in a Simple Supply Chain: The Impact of Forecasting, Lead Times, and Information 1: Centralizing Demand Information Does Not Eliminate the Bullwhip EffectResearch Paper

Motivation

The bullwhip effect is the observation that the variability of orders increases as one moves up a supply chain, from the retailer towards the manufacturer and its suppliers. It was documented in industry and in classroom experiments such as the Beer Game (Sterman 1989), and analysed by Lee, Padmanabhan and Whang (1997), who named demand forecasting, lead times, batch ordering, rationing and price variations as its main causes. A remedy often proposed is to centralize demand information: give every stage of the chain the customer demand data, so that no stage forecasts from the distorted orders of its downstream neighbour.

Chen, Drezner, Ryan and Simchi-Levi (2000) quantified the effect for a retailer that forecasts with a moving average and orders with an order-up-to policy. They gave an explicit lower bound on the ratio of the order variance to the demand variance in terms of the lead time, the forecasting window and the demand autocorrelation. They then showed that in a multistage chain with fully centralized demand information this ratio still grows with the total lead time upstream of each stage. This mission formalizes that result, Theorem 3.1 of the paper, together with the single-stage analysis it rests on.

Setting

Time is indexed by the integers. The customer demands DtD_tDt​ seen by the retailer follow the AR(1) model

Dt=μ+ρDt−1+ϵt,(1)D_t = \mu + \rho D_{t-1} + \epsilon_t, \tag{1}Dt​=μ+ρDt−1​+ϵt​,(1)

where μ≥0\mu \ge 0μ≥0, ∣ρ∣<1|\rho| < 1∣ρ∣<1, and the errors ϵt\epsilon_tϵt​ are independent and identically distributed from a symmetric distribution with mean 000 and variance σ2\sigma^2σ2. The demand is in steady state, so that E(Dt)=μ/(1−ρ)E(D_t) = \mu/(1-\rho)E(Dt​)=μ/(1−ρ) and Var(D)=Var(Dt)=σ2/(1−ρ2)\mathrm{Var}(D) = \mathrm{Var}(D_t) = \sigma^2/(1-\rho^2)Var(D)=Var(Dt​)=σ2/(1−ρ2) for every ttt.

The retailer does not know the demand process. With a window of p≥1p \ge 1p≥1 past observations it forms the moving-average estimates

D^tL=L ∑i=1pDt−ip,et=Dt−D^t1,σ^etL=CL,ρ∑i=1pet−i2p,\hat D^L_t = L\,\frac{\sum_{i=1}^p D_{t-i}}{p}, \qquad e_t = D_t - \hat D^1_t, \qquad \hat\sigma^L_{et} = C_{L,\rho}\sqrt{\frac{\sum_{i=1}^p e_{t-i}^2}{p}},D^tL​=Lp∑i=1p​Dt−i​​,et​=Dt​−D^t1​,σ^etL​=CL,ρ​p∑i=1p​et−i2​​​,

where LLL is the lead-time parameter (L=1L = 1L=1 means an order placed at the end of period ttt arrives at the start of period t+1t+1t+1) and CL,ρC_{L,\rho}CL,ρ​ is a constant the paper leaves unspecified. The order-up-to point is yt=D^tL+z σ^etLy_t = \hat D^L_t + z\,\hat\sigma^L_{et}yt​=D^tL​+zσ^etL​ for a safety factor zzz, and the order placed in period ttt is qt=yt−yt−1+Dt−1q_t = y_t - y_{t-1} + D_{t-1}qt​=yt​−yt−1​+Dt−1​. It may be negative: excess inventory is returned without cost.

In the multistage chain with centralized information, stages k=1,2,…k = 1, 2, \dotsk=1,2,… (stage 111 is the retailer) all observe DtD_tDt​ and use the same estimate D^t=∑i=1pDt−i/p\hat D_t = \sum_{i=1}^p D_{t-i}/pD^t​=∑i=1p​Dt−i​/p. Stage kkk has lead time LkL_kLk​ and safety factor zkz_kzk​ and uses the order-up-to point ytk=LkD^t+zkσ^etLky^k_t = L_k\hat D_t + z_k\hat\sigma^{L_k}_{et}ytk​=Lk​D^t​+zk​σ^etLk​​. Following the paper's sequence of events, stage 111 orders qt1=yt1−yt−11+Dt−1q^1_t = y^1_t - y^1_{t-1} + D_{t-1}qt1​=yt1​−yt−11​+Dt−1​, and stage k≥2k \ge 2k≥2, receiving qtk−1q^{k-1}_tqtk−1​, orders qtk=ytk−yt−1k+qtk−1q^k_t = y^k_t - y^k_{t-1} + q^{k-1}_tqtk​=ytk​−yt−1k​+qtk−1​.

Formalization targets

Goal: Theorem 3.1 (p. 441)

For every stage k≥1k \ge 1k≥1 and every period ttt,

Var(qtk)Var(D)≥1+(2∑i=1kLip+2(∑i=1kLi)2p2)(1−ρp),\frac{\mathrm{Var}(q^k_t)}{\mathrm{Var}(D)} \ge 1 + \left(\frac{2\sum_{i=1}^k L_i}{p} + \frac{2\left(\sum_{i=1}^k L_i\right)^2}{p^2}\right)(1-\rho^p),Var(D)Var(qtk​)​≥1+​p2∑i=1k​Li​​+p22(∑i=1k​Li​)2​​(1−ρp),

with equality when z1=⋯=zk=0z_1 = \dots = z_k = 0z1​=⋯=zk​=0. The bound holds for every choice of the constants CLk,ρC_{L_k,\rho}CLk​,ρ​ and of the safety factors.

Milestones (p. 438)

  1. The AR(1) moments Var(Dt)=σ2/(1−ρ2)\mathrm{Var}(D_t) = \sigma^2/(1-\rho^2)Var(Dt​)=σ2/(1−ρ2) and Cov(Dt−1,Dt−p−1)=ρpσ2/(1−ρ2)\mathrm{Cov}(D_{t-1}, D_{t-p-1}) = \rho^p\sigma^2/(1-\rho^2)Cov(Dt−1​,Dt−p−1​)=ρpσ2/(1−ρ2).
  2. Eq. (4): qt=(1+L/p)Dt−1−(L/p)Dt−p−1+z(σ^etL−σ^e,t−1L)q_t = (1 + L/p)D_{t-1} - (L/p)D_{t-p-1} + z(\hat\sigma^L_{et} - \hat\sigma^L_{e,t-1})qt​=(1+L/p)Dt−1​−(L/p)Dt−p−1​+z(σ^etL​−σ^e,t−1L​) for every outcome.
  3. Lemma 2.1: Cov(Dt−i,σ^etL)=0\mathrm{Cov}(D_{t-i}, \hat\sigma^L_{et}) = 0Cov(Dt−i​,σ^etL​)=0 for i=1,…,pi = 1, \dots, pi=1,…,p.
  4. The variance identity after Eq. (4):
Var(qt)=[1+(2Lp+2L2p2)(1−ρp)]Var(D)+2z(1+2Lp)Cov(Dt−1,σ^etL)+z2 Var(σ^etL−σ^e,t−1L).\mathrm{Var}(q_t) = \left[1 + \left(\tfrac{2L}{p} + \tfrac{2L^2}{p^2}\right)(1-\rho^p)\right]\mathrm{Var}(D) + 2z\left(1+\tfrac{2L}{p}\right)\mathrm{Cov}(D_{t-1}, \hat\sigma^L_{et}) + z^2\,\mathrm{Var}(\hat\sigma^L_{et} - \hat\sigma^L_{e,t-1}).Var(qt​)=[1+(p2L​+p22L2​)(1−ρp)]Var(D)+2z(1+p2L​)Cov(Dt−1​,σ^etL​)+z2Var(σ^etL​−σ^e,t−1L​).
  1. Theorem 2.2, the single-stage case:
Var(q)Var(D)≥1+(2Lp+2L2p2)(1−ρp),(5)\frac{\mathrm{Var}(q)}{\mathrm{Var}(D)} \ge 1 + \left(\frac{2L}{p} + \frac{2L^2}{p^2}\right)(1-\rho^p), \tag{5}Var(D)Var(q)​≥1+(p2L​+p22L2​)(1−ρp),(5)

with equality when z=0z = 0z=0.

Significance

Theorem 2.2 shows that forecasting with a positive lead time is enough to make orders more variable than demand, even for independent demands (ρ=0\rho = 0ρ=0). It also says how the effect depends on each parameter: the bound decreases in the window ppp and increases in the lead time LLL. Theorem 3.1 is the paper's answer to the centralization remedy. When every stage sees the true customer demand and uses the same forecast and the same policy, the variability of orders at stage kkk is still bounded below by the single-stage expression with the cumulative lead time ∑i≤kLi\sum_{i\le k}L_i∑i≤k​Li​. Centralization reduces the bullwhip effect but does not remove it. The decentralized comparison (Theorem 3.2, where the bound becomes multiplicative across stages) is a separate mission in this series.

On the formalization side, the Gaussian special case of the single-stage results is on the platform. Snyder and Shen's Fundamentals of Supply Chain Theory states Theorem 2.2, Lemma 2.1, Eq. (4) and the AR(1) moments for normally distributed errors, as the items SupplyChainTheory.bullwhip_signal_processing, bullwhip_lemma_13_1, bullwhip_order_identity and ar1_moments. This mission states them under the paper's weaker hypothesis of a symmetric error distribution. The multistage Theorem 3.1 has no machine-checked counterpart. The paper proves only Theorem 2.2 in print. For the proofs of Lemma 2.1 and Theorem 3.1 it refers to Ryan (1997) and to a working paper, so a formalization supplies arguments the published article does not contain.

Difficulty

Most of the algebra is routine. The difficulty is Lemma 2.1 and the covariances like it. The estimate σ^etL\hat\sigma^L_{et}σ^etL​ is a square root of a quadratic form in past demands, so its covariance with a demand cannot be computed from second moments. Under Gaussian errors one can appeal to properties of Gaussian vectors. With only a symmetric error law, every distributional fact has to come from the symmetry of the errors and from the representation of the steady-state demand as an infinite series in past errors.

The printed derivation also moves faster than a proof. Expanding Var(qt)\mathrm{Var}(q_t)Var(qt​) from Eq. (4) produces the cross terms Cov(Dt−1,σ^e,t−1L)\mathrm{Cov}(D_{t-1}, \hat\sigma^L_{e,t-1})Cov(Dt−1​,σ^e,t−1L​) and Cov(Dt−p−1,σ^etL)\mathrm{Cov}(D_{t-p-1}, \hat\sigma^L_{et})Cov(Dt−p−1​,σ^etL​), which lie outside the lags 1,…,p1, \dots, p1,…,p of Lemma 2.1. The display after Eq. (4) does not account for them. A complete proof of milestone 4 must show that these terms vanish too. For the chain, the stage orders are defined by a recursion across stages, and the variance of qtkq^k_tqtk​ involves the estimates σ^etLi\hat\sigma^{L_i}_{et}σ^etLi​​ of all stages i≤ki \le ki≤k.

Formalization scope

Random variables are real functions on a probability space (Ω,P)(\Omega, P)(Ω,P), and time is Z\mathbb ZZ, so that Dt−p−1D_{t-p-1}Dt−p−1​ exists for every ttt. Variance and covariance are Mathlib's ProbabilityTheory.variance and ProbabilityTheory.covariance. The demand structure ChenBullwhip.Centralized.AR1Demand records (1) for every outcome and the paper's error hypotheses: independence, identical distribution, symmetry, mean 000 and variance σ2\sigma^2σ2. It adds four disclosed conditions:

  1. σ>0\sigma > 0σ>0, since the results divide by Var(D)\mathrm{Var}(D)Var(D);
  2. square integrability of errors and demands, since Mathlib's variance of a non-square-integrable function is 000;
  3. a steady-state condition: every DtD_tDt​ is square integrable with the law of D0D_0D0​, which is the stationary solution the paper's moment formulas presuppose;
  4. p≥1p \ge 1p≥1 in every result.

The published Gaussian structure SupplyChainTheory.AR1Demand satisfies these conditions, so this mission generalizes the Snyder–Shen items rather than referencing them. The constants CL,ρC_{L,\rho}CL,ρ​ are free real parameters, and in the chain CLk,ρC_{L_k,\rho}CLk​,ρ​ is C(Lk)C(L_k)C(Lk​) for an arbitrary function CCC. Lead times are natural numbers, L=0L = 0L=0 included. Sums ∑i=1p\sum_{i=1}^p∑i=1p​ and ∑i=1k\sum_{i=1}^k∑i=1k​ run over {1,…,p}\{1,\dots,p\}{1,…,p} and {1,…,k}\{1,\dots,k\}{1,…,k}, and stages are numbered from 111. The order recursion qtk=ytk−yt−1k+qtk−1q^k_t = y^k_t - y^k_{t-1} + q^{k-1}_tqtk​=ytk​−yt−1k​+qtk−1​ is read from the paper's sequence of events, because the paper prints no formula for qtkq^k_tqtk​.

The orders are computed from the demands through the definitions above. They are never arbitrary random variables with assumed moments. "Tight" is formalized as equality, and orders are never truncated at zero. Without the steady-state condition, a process started from an arbitrary D0D_0D0​ satisfies (1) but has time-dependent moments, and the results fail; with σ=0\sigma = 0σ=0 the ratio form would be false. Both cases are excluded by the structure, not by vacuous hypotheses. The structure is satisfiable: i.i.d. standard Gaussian demands on Z→R\mathbb Z \to \mathbb RZ→R form an instance.

A complete development needs: the L2L^2L2 series representation of a stationary AR(1) process; distributional symmetry facts for i.i.d. sequences with a symmetric law; and covariance bookkeeping for finite linear combinations. The first two are reusable for any linear time-series model with symmetric innovations. Contributions to any milestone, and to general lemmas about stationary AR(1) processes, are welcome.

Selected references

  • F. Chen, Z. Drezner, J. K. Ryan, D. Simchi-Levi, Quantifying the Bullwhip Effect in a Simple Supply Chain: The Impact of Forecasting, Lead Times, and Information, Management Science 46(3):436–443, 2000. https://doi.org/10.1287/mnsc.46.3.436.12069
  • H. L. Lee, V. Padmanabhan, S. Whang, Information Distortion in a Supply Chain: The Bullwhip Effect, Management Science 43(4):546–558, 1997. https://doi.org/10.1287/mnsc.43.4.546
  • J. D. Sterman, Modeling Managerial Behavior: Misperceptions of Feedback in a Dynamic Decision Making Experiment, Management Science 35(3):321–339, 1989. https://doi.org/10.1287/mnsc.35.3.321
  • L. V. Snyder, Z.-J. M. Shen, Fundamentals of Supply Chain Theory, 2nd ed., Wiley, 2019, Chapter 13. https://doi.org/10.1002/9781119584445
  • J. K. Ryan, Analysis of Inventory Models with Limited Demand Information, Ph.D. dissertation, Northwestern University, 1997 (cited by the paper for the proofs of Lemma 2.1 and Theorem 3.1).
9 thms3 active usersReviewed
🏆Completed
Convex OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Twice Regularized MDPs and the Equivalence Between Robustness and Regularization 1: The Robust Value Function Is the Optimum of a Policy- and Value-Regularized Convex ProgramResearch Paper

Motivation

A Markov decision process (MDP) is solved for one model of its dynamics and rewards, but in practice that model is estimated from data, and a policy that is optimal for the estimate can perform poorly on the true system (Mannor et al., 2007). Robust MDPs address this by evaluating a policy against the worst model in an uncertainty set U\mathcal UU (Iyengar, 2005; Nilim and El Ghaoui, 2005; Wiesemann, Kuhn and Rustem, 2013). Robust planning, however, solves an inner optimization over U\mathcal UU at every Bellman update, which is expensive and does not scale to learning settings.

A separate line of work regularizes the policy (entropy, KL, Tsallis penalties) and observes empirically that regularized policies are robust to perturbations (Geist, Scherrer and Pietquin, 2019). Derman, Geist and Mannor (arXiv:2110.06267, NeurIPS 2021) make this precise: for uncertainty sets centred at a nominal model, the robust value function is the solution of a regularized problem posed on the nominal model alone, with a regularizer that is the support function of the uncertainty set. This mission formalizes that equivalence: Proposition 3.1, Theorem 3.1 and Theorem 4.1 of the paper.

Setting

Let S\mathcal SS and A\mathcal AA be finite sets of states and actions, A\mathcal AA nonempty, and X:=S×A\mathcal X := \mathcal S\times\mathcal AX:=S×A. Fix a discount factor γ∈(0,1)\gamma\in(0,1)γ∈(0,1) and a strictly positive initial distribution μ0∈ΔS\mu_0\in\Delta_{\mathcal S}μ0​∈ΔS​. A transition kernel PPP assigns to every pair (s,a)(s,a)(s,a) a probability distribution P(⋅∣s,a)P(\cdot\mid s,a)P(⋅∣s,a) on S\mathcal SS; a reward is r∈RXr\in\mathbb R^{\mathcal X}r∈RX. A policy π∈ΔAS\pi\in\Delta_{\mathcal A}^{\mathcal S}π∈ΔAS​ assigns to every state an action distribution πs\pi_sπs​.

For v∈RSv\in\mathbb R^{\mathcal S}v∈RS write rπ(s)=∑aπs(a)r(s,a)r^\pi(s) = \sum_a\pi_s(a)r(s,a)rπ(s)=∑a​πs​(a)r(s,a), Pπ(s′∣s)=∑aπs(a)P(s′∣s,a)P^\pi(s'\mid s) = \sum_a\pi_s(a)P(s'\mid s,a)Pπ(s′∣s)=∑a​πs​(a)P(s′∣s,a), and define the evaluation Bellman operator

T(P,r)πv:=rπ+γPπv.T^\pi_{(P,r)}v := r^\pi + \gamma P^\pi v .T(P,r)π​v:=rπ+γPπv.

The inner product on RS\mathbb R^{\mathcal S}RS is ⟨v,μ⟩=∑sv(s)μ(s)\langle v,\mu\rangle = \sum_s v(s)\mu(s)⟨v,μ⟩=∑s​v(s)μ(s), and the support function of a set C⊆RιC\subseteq\mathbb R^{\iota}C⊆Rι is σC(y)=max⁡a∈C⟨a,y⟩\sigma_C(y) = \max_{a\in C}\langle a,y\rangleσC​(y)=maxa∈C​⟨a,y⟩.

Given a set U\mathcal UU of models (P,r)(P,r)(P,r), the robust Bellman operator is

[Tπ,Uv](s):=min⁡(P,r)∈UT(P,r)πv(s),[T^{\pi,\mathcal U}v](s) := \min_{(P,r)\in\mathcal U}T^\pi_{(P,r)}v(s),[Tπ,Uv](s):=(P,r)∈Umin​T(P,r)π​v(s),

and the robust value function vπ,Uv^{\pi,\mathcal U}vπ,U is its fixed point. Around a nominal model (P0,r0)(P_0,r_0)(P0​,r0​), an s-rectangular uncertainty set U=(P0+P)×(r0+R)\mathcal U = (P_0+\mathcal P)\times(r_0+\mathcal R)U=(P0​+P)×(r0​+R) is given by sets Ps⊆RX\mathcal P_s\subseteq\mathbb R^{\mathcal X}Ps​⊆RX and Rs⊆RA\mathcal R_s\subseteq\mathbb R^{\mathcal A}Rs​⊆RA, one per state: its models are P(s′∣s,a)=P0(s′∣s,a)+Ps(s′,a)P(s'\mid s,a) = P_0(s'\mid s,a)+P_s(s',a)P(s′∣s,a)=P0​(s′∣s,a)+Ps​(s′,a) and r(s,a)=r0(s,a)+rs(a)r(s,a) = r_0(s,a)+r_s(a)r(s,a)=r0​(s,a)+rs​(a), with Ps∈PsP_s\in\mathcal P_sPs​∈Ps​ and rs∈Rsr_s\in\mathcal R_srs​∈Rs​ chosen independently for each sss. Finally [v⋅πs](s′,a):=v(s′)πs(a)[v\cdot\pi_s](s',a) := v(s')\pi_s(a)[v⋅πs​](s′,a):=v(s′)πs​(a).

Formalization targets

Goal: Theorem 4.1 (general robust MDP)

For U=(P0+P)×(r0+R)\mathcal U = (P_0+\mathcal P)\times(r_0+\mathcal R)U=(P0​+P)×(r0​+R) and every policy π\piπ, Tπ,UT^{\pi,\mathcal U}Tπ,U has a unique fixed point vπ,Uv^{\pi,\mathcal U}vπ,U, and it is the optimal solution of

max⁡v∈RS⟨v,μ0⟩s.t.v(s)≤T(P0,r0)πv(s)−σRs(−πs)−σPs(−γv⋅πs)∀s∈S.(2)\max_{v\in\mathbb R^{\mathcal S}}\langle v,\mu_0\rangle\quad\text{s.t.}\quad v(s)\le T^\pi_{(P_0,r_0)}v(s)-\sigma_{\mathcal R_s}(-\pi_s)-\sigma_{\mathcal P_s}(-\gamma v\cdot\pi_s)\quad\forall s\in\mathcal S. \tag{2}v∈RSmax​⟨v,μ0​⟩s.t.v(s)≤T(P0​,r0​)π​v(s)−σRs​​(−πs​)−σPs​​(−γv⋅πs​)∀s∈S.(2)

Milestones

  1. Proposition 3.1. For any uncertainty set U=P×R\mathcal U = \mathcal P\times\mathcal RU=P×R with P\mathcal PP a nonempty compact set of kernels and R\mathcal RR a nonempty compact set of rewards, vπ,Uv^{\pi,\mathcal U}vπ,U is the optimal solution of the robust program \max_{v}\langle v,\mu_0\rangle\quad\text{s.t.}\quad v\le T^\pi_{(P,r)}v\ \ \forall(P,r)\in\mathcal U. \tag{$P_{\mathcal U}$}
  2. Theorem 3.1. For U={P0}×(r0+R)\mathcal U=\{P_0\}\times(r_0+\mathcal R)U={P0​}×(r0​+R), vπ,Uv^{\pi,\mathcal U}vπ,U is the optimal solution of max⁡v⟨v,μ0⟩\max_v\langle v,\mu_0\ranglemaxv​⟨v,μ0​⟩ s.t. v(s)≤T(P0,r0)πv(s)−σRs(−πs)v(s)\le T^\pi_{(P_0,r_0)}v(s)-\sigma_{\mathcal R_s}(-\pi_s)v(s)≤T(P0​,r0​)π​v(s)−σRs​​(−πs​) for all sss.
  3. Robust counterpart (proof of Theorem 4.1, App. B.1). For every vvv and sss,
max⁡(P,r)∈U{v(s)−rπ(s)−γPπv(s)}=σPs(−γv⋅πs)+σRs(−πs)+v(s)−T(P0,r0)πv(s).\max_{(P,r)\in\mathcal U}\{v(s)-r^\pi(s)-\gamma P^\pi v(s)\} = \sigma_{\mathcal P_s}(-\gamma v\cdot\pi_s)+\sigma_{\mathcal R_s}(-\pi_s)+v(s)-T^\pi_{(P_0,r_0)}v(s).(P,r)∈Umax​{v(s)−rπ(s)−γPπv(s)}=σPs​​(−γv⋅πs​)+σRs​​(−πs​)+v(s)−T(P0​,r0​)π​v(s).

Theorem 3.1 is the special case Ps={0}\mathcal P_s=\{0\}Ps​={0} of the goal; it is listed separately because it is the paper's statement that policy regularization is equivalent to reward uncertainty.

Significance

The goal says that a robust MDP with s-rectangular uncertainty in both reward and transitions is a regularized MDP on the nominal model, with two regularizers: a policy regularizer σRs(−πs)\sigma_{\mathcal R_s}(-\pi_s)σRs​​(−πs​) coming from reward uncertainty, and a regularizer σPs(−γv⋅πs)\sigma_{\mathcal P_s}(-\gamma v\cdot\pi_s)σPs​​(−γv⋅πs​) coming from transition uncertainty that depends on both the policy and the value. For ball-shaped sets these support functions are explicit (αsr∥πs∥\alpha^r_s\|\pi_s\|αsr​∥πs​∥ and αsPγ∥v∥∥πs∥\alpha^P_s\gamma\|v\|\|\pi_s\|αsP​γ∥v∥∥πs​∥, Corollary 4.1 of the paper), which leads to the twice regularized (R²) Bellman operators of Section 5 and to robust planning at the cost of non-robust planning. Theorem 3.1 also explains why standard policy regularizers (negative entropy, KL, Tsallis) yield robustness: each is the support function of a reward uncertainty set.

The results are proved in the paper (appendices A.1, A.2, B.1); none has a machine-checked proof. The mission produces formal statements and proofs of the equivalence, the robust Bellman operator's fixed-point theory for stochastic policies and general compact uncertainty sets, and a closed-form robust counterpart that later R² results can import. The paper's printed proof of Proposition 3.1 treats Tπ,UT^{\pi,\mathcal U}Tπ,U as linear in one step; a formal proof settles the statement independently of that step.

Difficulty

The obvious argument reads Proposition 3.1 as linear-programming duality, as for a single MDP. That fails: Tπ,UT^{\pi,\mathcal U}Tπ,U is a minimum of affine maps, hence concave and not affine, and the feasible set of (PU)(P_{\mathcal U})(PU​) is an intersection of infinitely many half-space systems; the argument has to go through monotonicity and contraction of Tπ,UT^{\pi,\mathcal U}Tπ,U, which in turn requires every model in U\mathcal UU to be a genuine transition kernel. For the goal, the paper invokes Fenchel–Rockafellar duality to evaluate the inner maximum; the work in Lean is to separate the maximum over the product set U\mathcal UU into per-state maxima, which needs the s-rectangular structure and attainment of every maximum (compactness), and to track the index order of the perturbation Ps(s′,a)P_s(s',a)Ps​(s′,a) against the kernel P(s′∣s,a)P(s'\mid s,a)P(s′∣s,a).

Formalization scope

  • States and actions are finite types, A nonempty; values are S → ℝ ordered pointwise; a transition array is P : S → A → S → ℝ with P s a s' =P(s′∣s,a)=P(s'\mid s,a)=P(s′∣s,a), and the kernel property is the published IsTransitionKernel; Pπ(s′∣s)P^\pi(s'\mid s)Pπ(s′∣s) is the published InducedTransition. A policy has π s ∈ stdSimplex ℝ A for every s.
  • Perturbations PsP_sPs​ are functions S × A → ℝ indexed (s′,a)(s',a)(s′,a), as in the paper's RX\mathbb R^{\mathcal X}RX; rewards perturbations are A → ℝ.
  • Minima and maxima (in Tπ,UT^{\pi,\mathcal U}Tπ,U and in σ\sigmaσ) are real sInf/sSup. Every theorem assumes the sets nonempty and compact, so these are attained; nothing is quantified over an unbounded set.
  • The robust value function is encoded as the fixed point of Tπ,UT^{\pi,\mathcal U}Tπ,U, and each theorem asserts its existence and uniqueness. The paper's definition vπ,U(s)=min⁡(P,r)∈Uv(P,r)π(s)v^{\pi,\mathcal U}(s)=\min_{(P,r)\in\mathcal U}v^\pi_{(P,r)}(s)vπ,U(s)=min(P,r)∈U​v(P,r)π​(s) (p. 4) coincides with it for rectangular sets by a cited result; the proofs use only the fixed-point property. For the non-rectangular sets of Proposition 3.1 the pointwise minimum can be strictly larger than the fixed point and is then not the optimum of (PU)(P_{\mathcal U})(PU​), so the fixed point is the object the proposition is true for.
  • "The optimal solution" means: feasible, objective-maximal, and the unique maximizer (uniqueness uses μ0>0\mu_0>0μ0​>0).
  • Disclosed hypotheses: U=P×R\mathcal U=\mathcal P\times\mathcal RU=P×R with P\mathcal PP, R\mathcal RR nonempty and compact and every transition in P\mathcal PP a kernel (Prop. 3.1); Ps\mathcal P_sPs​, Rs\mathcal R_sRs​ nonempty and compact and every perturbed row P0(⋅∣s,a)+Ps(⋅,a)P_0(\cdot\mid s,a)+P_s(\cdot,a)P0​(⋅∣s,a)+Ps​(⋅,a) in ΔS\Delta_{\mathcal S}ΔS​ (Thm 4.1); reward sets rectangular in Thm 3.1, as its proof uses. These are the robust-MDP standing assumptions of p. 4 (P⊆ΔSX\mathcal P\subseteq\Delta^{\mathcal X}_{\mathcal S}P⊆ΔSX​) and what makes "min" and "max" well defined.
  • Not drafted: Corollary 4.1, whose ℓ²-ball Ps\mathcal P_sPs​ contains perturbations that leave the simplex, so P0+PP_0+\mathcal PP0​+P is not a set of kernels; Corollary 3.1 and Proposition 3.2 (consequences after the goal; Prop. 3.2 depends on an unspecified policy parametrization).
  • A formalization that asserts only that the feasible sets of (PU)(P_{\mathcal U})(PU​) and (2) coincide, or that drops the kernel condition or the existence of the fixed point, does not count: the goal names the robust value function and its optimality.
  • "Convex" in the statement of Theorem 4.1 is descriptive and is not part of the formal goal.

Contributions welcome: the monotone-contraction fixed-point lemma for Tπ,UT^{\pi,\mathcal U}Tπ,U and the per-state separation of maxima over rectangular sets are reusable for any robust MDP mission.

Selected references

  • E. Derman, M. Geist, S. Mannor, Twice regularized MDPs and the equivalence between robustness and regularization, NeurIPS 2021. arXiv:2110.06267v1
  • G. N. Iyengar, Robust dynamic programming, Mathematics of Operations Research 30(2), 2005. doi:10.1287/moor.1040.0129
  • A. Nilim, L. El Ghaoui, Robust control of Markov decision processes with uncertain transition matrices, Operations Research 53(5), 2005. doi:10.1287/opre.1050.0216
  • W. Wiesemann, D. Kuhn, B. Rustem, Robust Markov decision processes, Mathematics of Operations Research 38(1), 2013. doi:10.1287/moor.1120.0566
  • M. Geist, B. Scherrer, O. Pietquin, A theory of regularized Markov decision processes, ICML 2019. PMLR 97
  • S. Mannor, D. Simester, P. Sun, J. N. Tsitsiklis, Bias and variance approximation in value function estimates, Management Science 53(2), 2007. doi:10.1287/mnsc.1060.0614
8 thms3 active usersReviewed
🏆Completed
Convex OptimizationFunctional AnalysisOperations Research+1·Captain: mikedeng1

On the Douglas–Rachford Splitting Method and the Proximal Point Algorithm for Maximal Monotone Operators: Generalized Douglas–Rachford Splitting Converges Weakly if A+B Has a Zero, Else Is UnboundedResearch Paper

Motivation

Many problems in convex optimization, variational inequalities and equilibrium modelling reduce to finding a point xxx with 0∈Ax+Bx0 \in A x + B x0∈Ax+Bx, where AAA and BBB are maximal monotone operators on a real Hilbert space H\mathcal HH: for example, minimizing f+gf + gf+g for closed proper convex f,gf, gf,g is the case A=∂fA = \partial fA=∂f, B=∂gB = \partial gB=∂g. When the resolvent of A+BA + BA+B is hard to evaluate but the resolvents of AAA and BBB separately are easy, one uses a splitting method. Douglas–Rachford splitting, introduced for monotone operators by Lions and Mercier (1979) after an alternating-direction scheme of Douglas and Rachford (1956) for the heat equation, is the most widely used one; through its dual form it underlies the alternating direction method of multipliers (ADMM) used throughout large-scale optimization and statistics.

Eckstein and Bertsekas (MIT report LIDS-P-1919, 1989; Mathematical Programming 55, 1992) showed that Douglas–Rachford splitting is a special case of the proximal point algorithm applied to a single derived operator, the splitting operator Sλ,A,BS_{\lambda,A,B}Sλ,A,B​. This identification lets the convergence theory of the proximal point algorithm transfer to splitting, and yields a generalized method with inexact resolvent evaluations and relaxation.

Timeline.

  • Minty (1962): a monotone TTT is maximal iff I+TI + TI+T is onto.
  • Rockafellar (1976): the proximal point algorithm with variable stepsizes and summable errors converges weakly to a zero.
  • Lions and Mercier (1979): Douglas–Rachford splitting for maximal monotone AAA, BBB; its map Gλ,A,BG_{\lambda,A,B}Gλ,A,B​ is firmly nonexpansive.
  • Gol'shtein and Tret'yakov (1979): relaxed proximal iterations with factors ρk∈(0,2)\rho_k \in (0,2)ρk​∈(0,2), in finite dimension, with a fixed stepsize.
  • Eckstein and Bertsekas (1989/1992): the splitting operator; Douglas–Rachford as a proximal point method; the generalized proximal point algorithm and the generalized Douglas–Rachford method, including the case with no solution.

Setting

An operator on H\mathcal HH is a subset T⊆H×HT \subseteq \mathcal H \times \mathcal HT⊆H×H, with Tx={y∣(x,y)∈T}Tx = \{y \mid (x,y) \in T\}Tx={y∣(x,y)∈T}; it may be multivalued and partially defined. Its domain is dom⁡T={x∣Tx≠∅}\operatorname{dom} T = \{x \mid Tx \ne \emptyset\}domT={x∣Tx=∅}, its image im⁡T\operatorname{im} TimT the projection on the second coordinate, its inverse T−1={(y,x)∣(x,y)∈T}T^{-1} = \{(y,x) \mid (x,y) \in T\}T−1={(y,x)∣(x,y)∈T}. Scaling and sum are cT={(x,cy)}cT = \{(x, cy)\}cT={(x,cy)} and A+B={(x,y+z)∣(x,y)∈A,(x,z)∈B}A + B = \{(x, y+z) \mid (x,y) \in A, (x,z) \in B\}A+B={(x,y+z)∣(x,y)∈A,(x,z)∈B}; III is the identity. TTT is monotone if ⟨x′−x,y′−y⟩≥0\langle x' - x, y' - y\rangle \ge 0⟨x′−x,y′−y⟩≥0 for all (x,y),(x′,y′)∈T(x,y),(x',y') \in T(x,y),(x′,y′)∈T, and maximal monotone if no other monotone operator strictly contains it. The resolvent is JcT=(I+cT)−1J_{cT} = (I + cT)^{-1}JcT​=(I+cT)−1, and zer⁡T={x∣0∈Tx}\operatorname{zer} T = \{x \mid 0 \in Tx\}zerT={x∣0∈Tx}. An operator JJJ is firmly nonexpansive if ∥y′−y∥2≤⟨x′−x,y′−y⟩\|y'-y\|^2 \le \langle x'-x, y'-y\rangle∥y′−y∥2≤⟨x′−x,y′−y⟩ for all (x,y),(x′,y′)∈J(x,y),(x',y') \in J(x,y),(x′,y′)∈J.

For λ>0\lambda > 0λ>0 the Douglas–Rachford map is Gλ,A,B=JλA∘(2JλB−I)+(I−JλB)G_{\lambda,A,B} = J_{\lambda A} \circ (2J_{\lambda B} - I) + (I - J_{\lambda B})Gλ,A,B​=JλA​∘(2JλB​−I)+(I−JλB​), and the splitting operator is

Sλ,A,B={(v+λb, u−v)∣(u,b)∈B, (v,a)∈A, v+λa=u−λb}.S_{\lambda,A,B} = \{(v + \lambda b,\ u - v) \mid (u,b) \in B,\ (v,a) \in A,\ v + \lambda a = u - \lambda b\}.Sλ,A,B​={(v+λb, u−v)∣(u,b)∈B, (v,a)∈A, v+λa=u−λb}.

Its zero set is Zλ∗={u+λb∣b∈Bu, −b∈Au}Z^*_\lambda = \{u + \lambda b \mid b \in Bu,\ -b \in Au\}Zλ∗​={u+λb∣b∈Bu, −b∈Au}.

Formalization targets

Goal: Theorem 7 (generalized Douglas–Rachford splitting)

Let AAA, BBB be maximal monotone, λ>0\lambda > 0λ>0, and let {zk},{uk},{vk}⊆H\{z^k\}, \{u^k\}, \{v^k\} \subseteq \mathcal H{zk},{uk},{vk}⊆H, αk,βk≥0\alpha_k, \beta_k \ge 0αk​,βk​≥0 and ρk\rho_kρk​ satisfy

∥uk−JλB(zk)∥≤βk,∥vk+1−JλA(2uk−zk)∥≤αk,zk+1=zk+ρk(vk+1−uk),\|u^k - J_{\lambda B}(z^k)\| \le \beta_k,\quad \|v^{k+1} - J_{\lambda A}(2u^k - z^k)\| \le \alpha_k,\quad z^{k+1} = z^k + \rho_k (v^{k+1} - u^k),∥uk−JλB​(zk)∥≤βk​,∥vk+1−JλA​(2uk−zk)∥≤αk​,zk+1=zk+ρk​(vk+1−uk),

with ∑αk<∞\sum \alpha_k < \infty∑αk​<∞, ∑βk<∞\sum \beta_k < \infty∑βk​<∞ and 0<inf⁡ρk≤sup⁡ρk<20 < \inf \rho_k \le \sup \rho_k < 20<infρk​≤supρk​<2. Then

zer⁡(A+B)≠∅  ⟹  zk⇀z∗ for some z∗∈Zλ∗,zer⁡(A+B)=∅  ⟹  {zk} unbounded.\operatorname{zer}(A+B) \ne \emptyset \implies z^k \rightharpoonup z^* \text{ for some } z^* \in Z^*_\lambda,\qquad \operatorname{zer}(A+B) = \emptyset \implies \{z^k\} \text{ unbounded}.zer(A+B)=∅⟹zk⇀z∗ for some z∗∈Zλ∗​,zer(A+B)=∅⟹{zk} unbounded.

Milestones

In the paper's order: Minty's theorem (Theorem 1); properties of firmly nonexpansive operators (Lemma 1); the monotone / firmly nonexpansive correspondence (Theorem 2, Corollaries 2.1–2.3); zeros as fixed points of resolvents (Lemma 2); the generalized proximal point algorithm (Theorem 3): weak convergence to a zero of TTT under summable errors, relaxation in (0,2)(0,2)(0,2) and stepsizes bounded away from 000, unboundedness when zer⁡T=∅\operatorname{zer} T = \emptysetzerT=∅; (maximal) monotonicity of Sλ,A,BS_{\lambda,A,B}Sλ,A,B​ (Theorem 4) and firm nonexpansiveness of its resolvent (Corollary 4.1); zer⁡Sλ,A,B=Zλ∗\operatorname{zer} S_{\lambda,A,B} = Z^*_\lambdazerSλ,A,B​=Zλ∗​ (Theorem 5); and (I+Sλ,A,B)−1=Gλ,A,B(I + S_{\lambda,A,B})^{-1} = G_{\lambda,A,B}(I+Sλ,A,B​)−1=Gλ,A,B​ (Theorem 6).

Significance

Theorem 7 gives convergence of Douglas–Rachford splitting with both resolvents evaluated inexactly and with over- or under-relaxation, and it characterizes the case without a solution: the iterates are unbounded exactly when A+BA + BA+B has no zero. The relaxed, inexact form is the one implementations actually run, and through Gabay's identification of ADMM with Douglas–Rachford on the dual it is the basis of the paper's Theorem 8, a convergence theorem for a generalized ADMM. Theorem 3, used to prove Theorem 7, is itself a standard reference form of the inexact relaxed proximal point algorithm.

All results here are proved in the paper (one step in the unbounded case of Theorem 3 rests on results of Rockafellar 1969 and 1970 on sums of maximal monotone operators). As of 2026, neither Douglas–Rachford splitting in this generality nor the generalized proximal point algorithm is formalized in Lean or Mathlib. Mathlib has Hilbert spaces, weak topologies and summability, but no theory of maximal monotone operators, Minty's theorem or resolvents. The mission builds that layer and machine-checks the paper's results on it.

Difficulty

The convergence argument cannot be strong: in infinite dimensions the proximal point algorithm need not converge in norm (Güler 1991), so the conclusion is weak convergence, and identifying the weak limit as a zero requires the weak–strong closedness of the graph of a maximal monotone operator. The maximality halves of Theorems 2 and 4 need Minty's theorem, whose proof requires a nontrivial existence argument (all known proofs use Zorn's lemma or an equivalent). The unbounded case of Theorem 3 is a contradiction argument that truncates TTT by the subdifferential of the indicator of a ball and invokes two external facts: maximality of the sum of two maximal monotone operators under an interiority condition (Rockafellar 1970), and existence of zeros for maximal monotone operators with bounded domain (Rockafellar 1969). Neither is available in Lean. The natural first idea for Theorem 7, iterating the firm nonexpansiveness of Gλ,A,BG_{\lambda,A,B}Gλ,A,B​, gives neither the error tolerance on both resolvents nor the unbounded case without the full machinery of Theorem 3.

Formalization scope

  • H\mathcal HH is a real inner product space that is complete ([CompleteSpace H]). An operator is a map H → Set H. Monotonicity, maximal monotonicity, dom⁡\operatorname{dom}dom, zer⁡\operatorname{zer}zer and the function-level resolvent predicate IsResolvent are the published definitions ThreeOpSplitting_Convergence_MonotoneOperators; weak convergence is the published WeakTendsto (⟨zk,y⟩→⟨z∗,y⟩\langle z^k, y\rangle \to \langle z^*, y\rangle⟨zk,y⟩→⟨z∗,y⟩ for every yyy).
  • §2 notions are graph notions (opResolvent, IsFirmlyNonexpansiveOp, ...), so Theorem 2 and Corollary 2.1 can speak of resolvents that are a priori partial or multivalued. In Theorems 3, 6 and 7 the resolvents are maps J:H→HJ : \mathcal H \to \mathcal HJ:H→H with λ−1(x−Jx)∈A(Jx)\lambda^{-1}(x - J x) \in A(Jx)λ−1(x−Jx)∈A(Jx) for all xxx, unique by Corollary 2.2.
  • Sλ,A,BS_{\lambda,A,B}Sλ,A,B​ is defined by its set formula, not as Gλ,A,B−1−IG_{\lambda,A,B}^{-1} - IGλ,A,B−1​−I; with the latter, Theorem 6 and Corollary 4.1 would be unfoldings. Taking free resolvent functions without the IsResolvent hypothesis would make the iteration unrelated to AAA and BBB; the hypothesis is always present.
  • inf⁡ρk>0\inf \rho_k > 0infρk​>0, sup⁡ρk<2\sup \rho_k < 2supρk​<2 are encoded as ∃ ρ1,ρ2\exists\, \rho_1, \rho_2∃ρ1​,ρ2​ with 0<ρ1≤ρk≤ρ2<20 < \rho_1 \le \rho_k \le \rho_2 < 20<ρ1​≤ρk​≤ρ2​<2; inf⁡ck>0\inf c_k > 0infck​>0 as ∃ c0>0\exists\, c_0 > 0∃c0​>0, c0≤ckc_0 \le c_kc0​≤ck​. Summability is Summable with nonnegative terms. Sequences start at k=0k = 0k=0; v0v^0v0 is unused. Unboundedness is ¬ Bornology.IsBounded (Set.range z).
  • Printed slips corrected and disclosed in the items: Theorem 7 states its sequences in Rn\mathbb R^nRn (read H\mathcal HH); Theorem 3 prints (1−ρk)wk(1 - \rho_k) w^k(1−ρk​)wk (read ρkwk\rho_k w^kρk​wk, as on p. 9 and in the proof) and (I+cT)−1(I + cT)^{-1}(I+cT)−1 (read (I+ckT)−1(I + c_k T)^{-1}(I+ck​T)−1).
  • Not included: Corollary 2.4, Corollaries 6.1–6.2 (special cases of Theorem 7), §5 (partial inverses, generalized ADMM). The second sentence of Corollary 6.1 (convergence of JλB(zk)J_{\lambda B}(z^k)JλB​(zk)) is deliberately excluded: its argument does not transfer weak convergence (Svaiter 2011).
  • Welcome contributions: Minty's theorem in Hilbert space, the resolvent calculus of §2, and weak-limit lemmas (Opial-type arguments) are reusable well beyond this mission.

Selected references

  • J. Eckstein and D. P. Bertsekas, On the Douglas–Rachford splitting method and the proximal point algorithm for maximal monotone operators, MIT report LIDS-P-1919, 1989; Mathematical Programming 55 (1992) 293–318. https://doi.org/10.1007/BF01581204
  • P.-L. Lions and B. Mercier, Splitting algorithms for the sum of two nonlinear operators, SIAM J. Numer. Anal. 16 (1979) 964–979. https://doi.org/10.1137/0716071
  • G. J. Minty, Monotone (nonlinear) operators in Hilbert space, Duke Math. J. 29 (1962) 341–346. https://doi.org/10.1215/S0012-7094-62-02933-2
  • R. T. Rockafellar, Monotone operators and the proximal point algorithm, SIAM J. Control Optim. 14 (1976) 877–898. https://doi.org/10.1137/0314056
  • O. Güler, On the convergence of the proximal point algorithm for convex minimization, SIAM J. Control Optim. 29 (1991) 403–419. https://doi.org/10.1137/0329022
  • B. F. Svaiter, On weak convergence of the Douglas–Rachford method, SIAM J. Control Optim. 49 (2011) 280–287. https://doi.org/10.1137/100788100
17 thms3 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear Optimization+2·Captain: mikedeng1

Maximum Matching and a Polyhedron With 0,1-Vertices: The Vertices of the Matching Polyhedron Are Exactly the Matching VectorsResearch Paper

Motivation

A matching in a graph is a set of edges no two of which share a node. Given a real weight on every edge, the maximum-weight matching problem asks for a matching of largest total weight. It is one of the basic problems of combinatorial optimization: assignment, pairing and scheduling problems reduce to it, and it is the standard example of a combinatorial problem that is solvable in polynomial time although it is not obviously a linear program.

For bipartite graphs the problem is a linear program in disguise: the polytope cut out by nonnegativity and the node-degree inequalities has only 0–1 vertices (the Birkhoff–von Neumann theorem in the square case; Mathlib has it as extremePoints_doublyStochastic). For general graphs this fails already on a triangle, where the vector with every coordinate 1/21/21/2 satisfies all degree inequalities but is not a combination of matchings. Edmonds' 1965 paper (DOI 10.6028/jres.069b.013) adds one family of inequalities, one for each odd set of nodes, and proves that the resulting polyhedron has exactly the matching vectors as its vertices. The companion paper Paths, trees, and flowers gives the cardinality algorithm on which the weighted algorithm of §7 is built.

Timeline:

  • 1931: König and Egerváry prove the min–max theorems for bipartite matching; 1946: Birkhoff shows that the doubly stochastic matrices are the convex hull of the permutation matrices (the bipartite perfect-matching polytope).
  • 1947: Tutte characterizes graphs with a perfect matching.
  • 1965: Edmonds, Paths, trees, and flowers: the blossom algorithm for maximum-cardinality matching.
  • 1965: Edmonds, this paper: Theorem (P) (the matching polyhedron) and Theorem (M) (blossom-shrinking optimality certificates), with a weighted matching algorithm.

Setting

Let GGG be a finite graph with node set VVV and edge set EEE; each edge meets two different nodes, its ends. Real variables xex_exe​ correspond to the edges e∈Ee\in Ee∈E. The polyhedron C⊆REC\subseteq\mathbb R^EC⊆RE is the set of vectors xxx satisfying

  1. xe≥0x_e\ge 0xe​≥0 for every edge eee;
  2. ∑e meets vxe≤1\sum_{e \text{ meets } v} x_e\le 1∑e meets v​xe​≤1 for every node vvv;
  3. ∑e has both ends in Sxe≤r\sum_{e \text{ has both ends in } S} x_e\le r∑e has both ends in S​xe​≤r for every set SSS of 2r+12r+12r+1 nodes, rrr a strictly positive integer.

The matching vectors PPP are the vectors with every component 000 or 111 that satisfy (2); they are the incidence vectors of matchings. For edge weights c∈REc\in\mathbb R^Ec∈RE, the linear form (4) is W(c,x)=∑ecexeW(c,x)=\sum_e c_e x_eW(c,x)=∑e​ce​xe​.

The dual program has a variable yvy_vyv​ for each node and zSz_SzS​ for each odd set SSS (∣S∣=2rS+1|S|=2r_S+1∣S∣=2rS​+1, rS≥1r_S\ge1rS​≥1). Its objective is (5) U(y,z)=∑vyv+∑SrSzSU(y,z)=\sum_v y_v+\sum_S r_S z_SU(y,z)=∑v​yv​+∑S​rS​zS​, subject to (6) y,z≥0y,z\ge0y,z≥0 and (7) yv1+yv2+∑S∋v1,v2zS≥cey_{v_1}+y_{v_2}+\sum_{S\ni v_1,v_2}z_S\ge c_eyv1​​+yv2​​+∑S∋v1​,v2​​zS​≥ce​ for every edge eee with ends v1,v2v_1,v_2v1​,v2​. For a matching MMM, conditions (8)–(10) are the complementary slackness conditions: yv=0y_v=0yv​=0 at nodes not covered by MMM, equality in (7) on MMM, and every odd set with zS>0z_S>0zS​>0 contains exactly rSr_SrS​ edges of MMM.

A blossom sequence {Gi}i=0n\{G_i\}_{i=0}^n{Gi​}i=0n​ (Theorem (M)) starts from G0=GG_0=GG0​=G with matching M0=MM_0=MM0​=M and repeatedly shrinks an odd circuit BiB_iBi​ (a blossom, 2ai+12a_i+12ai​+1 edges of which aia_iai​ are matched) to a single node, carrying node weights w(vi)w(v^i)w(vi) and edge weights w(ei)w(e^i)w(ei) that obey conditions (a)–(k) of p. 127.

In the Lean development these are Graph, IsMatching, incidence, matchingPolyhedron (CCC), matchingVectors (PPP), W, U, DualFeasible ((6)–(7)), CompSlack ((8)–(10)) and BlossomSequence, all in the namespace EdmondsMatching65.Polyhedron.

Formalization targets

Goal: Theorem (P)

ext⁡(C)=P.\operatorname{ext}(C)=P.ext(C)=P.

The vertices (extreme points) of CCC are exactly the matching vectors of GGG. Hence the maximum weight of a matching equals max⁡{W(c,x):x∈C}\max\{W(c,x):x\in C\}max{W(c,x):x∈C} for every ccc.

Milestones

  1. P⊆ext⁡(C)P\subseteq\operatorname{ext}(C)P⊆ext(C) (§2, p. 126).
  2. If for every ccc some 0–1 point of CCC maximizes W(c,⋅)W(c,\cdot)W(c,⋅) over CCC, then ext⁡(C)=P\operatorname{ext}(C)=Pext(C)=P (§2, p. 126).
  3. Weak duality: W(c,x)≤U(y,z)W(c,x)\le U(y,z)W(c,x)≤U(y,z) for x∈Cx\in Cx∈C and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(7) (§3, p. 126).
  4. If MMM is a matching and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfies (6)–(10), then W(c,χM)=U(y,z)W(c,\chi^M)=U(y,z)W(c,χM)=U(y,z) (§3, p. 127).
  5. A blossom sequence for MMM yields ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(10) (§5, pp. 127–128).
  6. For every ccc some maximum matching has a blossom sequence (§6, p. 128).
  7. Theorem (M): a matching is maximum if and only if a blossom sequence for it exists (§4, p. 127).
  8. For every ccc there are a matching MMM and ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ satisfying (6)–(10) (§3, p. 127).

Significance

The result. Theorem (P) turns maximum-weight matching in general graphs into a linear program over an explicitly described polyhedron, and Theorem (M) with the §5 translation gives a short certificate of optimality for every maximum matching. Together they established the template of polyhedral combinatorics: describe the convex hull of the combinatorial objects by inequalities, and prove the description through linear programming duality and an algorithm. The matching polytope underlies the analysis of the weighted blossom algorithm, separation over odd-set inequalities (Padberg–Rao), and many later integrality results; Edmonds' own §8 states the extension to degree-constrained subgraphs.

Formalizing it. The theorem has been proved since 1965 and appears in every text on combinatorial optimization; this mission asks for a machine-checked proof of the polytope statement for general finite graphs, including parallel edges, together with the duality certificate and the blossom-sequence characterization. The prove2me platform has a proved form of Edmonds' perfect matching polytope theorem on complete graphs in convex-decomposition form (MetricTSP.pm_polytope_decomposition), a different polytope with a different conclusion; nothing states Theorem (P) or Theorem (M).

Difficulty

The inclusion P⊆ext⁡(C)P\subseteq\operatorname{ext}(C)P⊆ext(C) and weak duality are routine. The difficulty is the reverse inclusion: showing that no fractional point of CCC is a vertex. The bipartite argument (a fractional point has a cycle of fractional edges along which it can be perturbed both ways) breaks on odd cycles: perturbing along an odd circuit violates a degree inequality, and the odd-set inequalities that cut off the half-integral points are exponentially many and overlap. The paper's route needs, for every weight vector, an optimal matching together with a dual solution satisfying (6)–(10), and the existence of that certificate is the substance of the weighted matching algorithm: the blossom sequence of Theorem (M) must be constructed, and the translation (11)–(16) from node and edge weights of the contracted graphs to ⟨y,z⟩\langle y,z\rangle⟨y,z⟩ must be verified through the whole shrinking history.

Formalization scope

  • The graph is a finite node type V, a finite edge type E and an end map ends : E → Sym2 V with no loops. Parallel edges are allowed: the contracted graphs of Theorem (M) have them, and Theorem (P) holds for multigraphs; simple graphs are the case of an injective end map.
  • Vectors are E → ℝ, one coordinate per edge. Vertices are Mathlib's Set.extremePoints ℝ. Odd sets carry an explicit r : ℕ with 1 ≤ r and |S| = 2r + 1; even sets and singletons carry no inequality.
  • Edge weights are arbitrary reals; matchings need not be perfect and may be empty. No connectivity, no parity of |V|.
  • The dual variable z is a function on all node sets of which only odd sets are read.
  • A contracted graph Gᵢ is a partition of V into blocks; an edge of G is an edge of Gᵢ when its ends lie in different blocks. Each Mᵢ must be a matching of Gᵢ, and all of (a)–(k) appear as fields of BlossomSequence; a sequence missing any of them would make milestone 6 trivial or milestone 5 false.
  • A trivializing formalization is ruled out: coordinates indexed by node pairs (Sym2 V → ℝ) leave non-edge coordinates free and give a polyhedron with no extreme points, and the goal is stated as equality of extreme points, not as a convex-hull identity or as the existence of a dual certificate.
  • Needed infrastructure: extreme points of polyhedra as unique maximizers of linear forms, finite LP weak duality over these index sets, and the weighted blossom algorithm (or another proof of milestone 8). The polyhedral lemmas are reusable for other integrality results; contributions on any milestone are welcome.

Selected references

  • J. Edmonds, Maximum Matching and a Polyhedron With 0,1-Vertices, J. Res. Nat. Bur. Standards Sect. B 69B (1965), 125–130. https://doi.org/10.6028/jres.069b.013
  • J. Edmonds, Paths, Trees, and Flowers, Canad. J. Math. 17 (1965), 449–467. https://doi.org/10.4153/CJM-1965-045-4
  • W. T. Tutte, The Factorization of Linear Graphs, J. London Math. Soc. 22 (1947), 107–111. https://doi.org/10.1112/jlms/s1-22.2.107
  • M. W. Padberg, M. R. Rao, Odd Minimum Cut-Sets and b-Matchings, Math. Oper. Res. 7 (1982), 67–80. https://doi.org/10.1287/moor.7.1.67
  • A. Schrijver, Combinatorial Optimization: Polyhedra and Efficiency, Springer, 2003, Chapter 25.
13 thms4 active usersReviewed
🏆Completed
Dynamical SystemsOperations ResearchStochastic Systems·Captain: mikedeng1

Dynamics of Stochastic Approximation Algorithms 5: If V(Λ) Has Empty Interior for a Lyapunov Function V, Every Internally Chain Transitive Set Lies in ΛResearch Paper

Motivation

A stochastic approximation algorithm is a recursion xn+1=xn+γn+1(F(xn)+Un+1)x_{n+1}=x_n+\gamma_{n+1}\big(F(x_n)+U_{n+1}\big)xn+1​=xn​+γn+1​(F(xn​)+Un+1​) with decreasing steps γn\gamma_nγn​ and noise UnU_nUn​. Stochastic gradient descent, the Robbins–Monro procedure, reinforcement-learning updates and learning dynamics in games all have this form. The ODE method compares such a recursion with the deterministic dynamics x˙=F(x)\dot x=F(x)x˙=F(x). Benaïm's lecture notes (Séminaire de Probabilités XXXIII, 1999) do this in two steps. First, the limit set of the interpolated process is internally chain transitive for the semiflow of FFF (Theorem 5.7, the subject of mission 1 of this series). Second, internally chain transitive sets are located using properties of the dynamics alone.

The most common tool in the second step is a Lyapounov function: a function that decreases strictly along every trajectory outside a set Λ\LambdaΛ and is constant on Λ\LambdaΛ. Proposition 6.4 of the notes states exactly when such a function forces every internally chain transitive set into Λ\LambdaΛ. It is the step behind the convergence of stochastic gradient algorithms to critical points (Corollary 6.7) and behind convergence results for learning in potential games.

Timeline.

  • Conley (Isolated Invariant Sets and the Morse Index, CBMS 38, 1978) introduced chain recurrence and the attractor–repeller description of it.
  • Benaïm and Hirsch (J. Dyn. Diff. Eq. 8, 1996) identified limit sets of asymptotic pseudotrajectories with internally chain transitive sets.
  • Benaïm (SIAM J. Control Optim. 34, 1996) developed the dynamical-systems approach to stochastic approximation built on these notions.
  • Bowen (J. Differential Equations 18, 1975) characterized chain transitivity by the absence of proper attractors, the content of Proposition 5.3 of the notes.
  • The 1999 notes state the Lyapounov criterion in the form used here, for semiflows on arbitrary metric spaces.

Setting

Let (M,d)(M,d)(M,d) be a metric space, with no compactness or completeness assumed. A semiflow Φ\PhiΦ on MMM is a continuous map R+×M→M\mathbb R_+\times M\to MR+​×M→M, (t,x)↦Φt(x)(t,x)\mapsto\Phi_t(x)(t,x)↦Φt​(x), with Φ0=Id\Phi_0=\mathrm{Id}Φ0​=Id and Φt+s=Φt∘Φs\Phi_{t+s}=\Phi_t\circ\Phi_sΦt+s​=Φt​∘Φs​.

  • A set AAA is invariant if Φt(A)=A\Phi_t(A)=AΦt​(A)=A for every t≥0t\ge0t≥0. For an invariant Λ\LambdaΛ, the restriction Φ∣Λ\Phi|\LambdaΦ∣Λ is the semiflow Φ\PhiΦ acting on Λ\LambdaΛ.
  • For δ,T>0\delta,T>0δ,T>0, a (δ,T)(\delta,T)(δ,T)-pseudo-orbit from aaa to bbb is a list of points y0,…,yky_0,\dots,y_ky0​,…,yk​ (k≥1k\ge1k≥1) and times t0,…,tk−1≥Tt_0,\dots,t_{k-1}\ge Tt0​,…,tk−1​≥T with d(y0,a)<δd(y_0,a)<\deltad(y0​,a)<δ, d(Φtj(yj),yj+1)<δd(\Phi_{t_j}(y_j),y_{j+1})<\deltad(Φtj​​(yj​),yj+1​)<δ for j<kj<kj<k, and yk=by_k=byk​=b.
  • A set LLL is internally chain transitive if it is nonempty, compact and invariant, and for all a,b∈La,b\in La,b∈L and all δ,T>0\delta,T>0δ,T>0 there is a (δ,T)(\delta,T)(δ,T)-pseudo-orbit of Φ∣L\Phi|LΦ∣L, so with every yi∈Ly_i\in Lyi​∈L, from aaa to bbb.
  • An attractor is a nonempty compact invariant set AAA with a neighbourhood WWW on which dist(Φtx,A)→0\mathrm{dist}(\Phi_t x,A)\to0dist(Φt​x,A)→0 uniformly. Its basin is the set of points xxx with dist(Φtx,A)→0\mathrm{dist}(\Phi_t x,A)\to0dist(Φt​x,A)→0.
  • Let Λ⊂M\Lambda\subset MΛ⊂M be compact and invariant. A continuous V:M→RV:M\to\mathbb RV:M→R is a Lyapounov function for Λ\LambdaΛ if t↦V(Φt(x))t\mapsto V(\Phi_t(x))t↦V(Φt​(x)) is constant for x∈Λx\in\Lambdax∈Λ and strictly decreasing for x∉Λx\notin\Lambdax∈/Λ.

Formalization targets

Goal: Proposition 6.4

Let Λ\LambdaΛ be compact invariant and VVV a Lyapounov function for Λ\LambdaΛ, and assume that V(Λ)V(\Lambda)V(Λ) has empty interior in R\mathbb RR. Then for every internally chain transitive set LLL,

L⊂ΛandV∣L is constant.L\subset\Lambda\qquad\text{and}\qquad V|_L\ \text{is constant}.L⊂ΛandV∣L​ is constant.

Milestones

  1. Lemma 5.2. If UUU is open with compact closure and ΦT(U‾)⊂U\Phi_T(\overline U)\subset UΦT​(U)⊂U for some T>0T>0T>0, there is an attractor A⊂UA\subset UA⊂U whose basin contains U‾\overline UU.
  2. Proposition 5.3. For nonempty Λ\LambdaΛ: internally chain transitive   ⟺  \iff⟺ connected and internally chain recurrent   ⟺  \iff⟺ compact invariant, and Φ∣Λ\Phi|\LambdaΦ∣Λ has no proper attractor.
  3. The claim of the proof of 6.4. For LLL internally chain transitive and v∗=inf⁡LVv^*=\inf_L Vv∗=infL​V: L∩Λ≠∅L\cap\Lambda\ne\emptysetL∩Λ=∅ and v∗=inf⁡L∩ΛVv^*=\inf_{L\cap\Lambda}Vv∗=infL∩Λ​V.
  4. The sublevel step of the proof of 6.4. For every c>v∗c>v^*c>v∗ with c∉V(Λ)c\notin V(\Lambda)c∈/V(Λ), V<cV<cV<c on all of LLL.

Significance

The result. Proposition 6.4 converts a statement about real numbers, that V(Λ)V(\Lambda)V(Λ) has empty interior, into a statement about dynamics: the chain recurrent behaviour of Φ\PhiΦ is confined to Λ\LambdaΛ. With Theorem 5.7 it gives the following. If Φ\PhiΦ has such a Lyapounov function, then the limit set of any precompact asymptotic pseudotrajectory, in particular of a bounded stochastic approximation process, lies in Λ\LambdaΛ, and VVV is constant on it. When Λ\LambdaΛ is the set of equilibria and V(Λ)V(\Lambda)V(Λ) is Lebesgue-null by Sard's theorem, this is the convergence of stochastic gradient algorithms to connected sets of critical points (Corollary 6.7). Remark 6.5 gives a flow on the circle with a strict Lyapounov function, where the circle itself is internally chain transitive. So the empty-interior hypothesis cannot be removed.

Formalizing it. The result is proved, in the notes and in the earlier literature. No machine-checked version of chain recurrence for semiflows on metric spaces, Conley's attractor lemma, or Bowen's characterization of chain transitive sets is known to us. The mission therefore adds the following:

  • a formal definition layer for these notions on Mathlib's Flow;
  • formal proofs of Lemma 5.2 and Proposition 5.3, which are reused across this series (missions 1 and 6);
  • the Lyapounov criterion itself.

Difficulty

The obvious argument does not work. It runs: VVV decreases along trajectories, so along an orbit in LLL the value of VVV must settle on Λ\LambdaΛ. But points of an internally chain transitive set are joined only by pseudo-orbits. At each of the kkk jumps, VVV may increase by an amount that is small but not controlled in number, so monotonicity of VVV along true trajectories says nothing directly about LLL. Remark 6.5 shows that the conclusion is genuinely false without a condition on V(Λ)V(\Lambda)V(Λ). The difficulty is therefore global: pseudo-orbits that climb back up VVV through many small jumps must be excluded using information about the restricted semiflow Φ∣L\Phi|LΦ∣L as a whole, not the monotonicity of VVV along single trajectories. Milestones 1 and 2 are the general facts about chain transitive sets that this requires, and their own proofs involve compactness and uniform-continuity estimates over arbitrarily long pseudo-orbits.

Formalization scope

  • Representation. MMM is any MetricSpace, and the semiflow is Flow ℝ≥0 M.
  • Invariance is equality Φt(A)=A\Phi_t(A)=AΦt​(A)=A for every ttt, not inclusion.
  • Pseudo-orbits have at least one trajectory piece (k≥1k\ge1k≥1), times ≥T\ge T≥T, an exact endpoint, and, in the internal notions, all their points in the set.
  • Nonemptiness. Internally chain transitive and internally chain recurrent sets are nonempty by definition. Accordingly, Proposition 5.3 assumes Λ≠∅\Lambda\neq\emptysetΛ=∅ and Lemma 5.2 assumes U≠∅U\neq\emptysetU=∅.
  • Lyapounov function. The predicate contains the standing assumptions of its definition: Λ\LambdaΛ is compact and invariant, VVV is continuous, V(Φtx)=V(x)V(\Phi_t x)=V(x)V(Φt​x)=V(x) on Λ\LambdaΛ, and t↦V(Φtx)t\mapsto V(\Phi_t x)t↦V(Φt​x) is strictly antitone off Λ\LambdaΛ.
  • Empty interior is interior (V '' Λ) = ∅ in R\mathbb RR, not countability, finiteness or measure zero.
  • Infima are stated with IsGLB, not a real sInf.

The following formalizations are trivializing and are excluded:

  • chains with no jumps, under which every point is chain recurrent;
  • invariance as inclusion;
  • a non-strict decrease condition, under which constant functions are Lyapounov functions and the goal is false;
  • chains of Φ\PhiΦ that leave LLL, a strictly weaker notion;
  • quantifying only over limit sets instead of every internally chain transitive set.

A complete development needs elementary facts about ω-limit sets of points of a compact invariant set: they are nonempty, compact and invariant. It also needs the attractor construction A=⋂t≥0⋃s≥tΦs(U)‾A=\bigcap_{t\ge0}\overline{\bigcup_{s\ge t}\Phi_s(U)}A=⋂t≥0​⋃s≥t​Φs​(U)​ and the open sets {y:x↪δ,Ty}\{y: x\hookrightarrow_{\delta,T}y\}{y:x↪δ,T​y} used in Proposition 5.3. These are reusable for any work on Conley theory. Contributions of any of these lemmas, or of proofs of the milestones in any order, are welcome.

Selected references

  • M. Benaïm, Dynamics of Stochastic Approximation Algorithms, Séminaire de Probabilités XXXIII, Lecture Notes in Mathematics 1709, Springer, 1999, pp. 1–68. https://doi.org/10.1007/BFb0096509
  • M. Benaïm, M. W. Hirsch, Asymptotic pseudotrajectories and chain recurrent flows, with applications, J. Dynam. Differential Equations 8 (1996), 141–176. https://doi.org/10.1007/BF02218613
  • M. Benaïm, A dynamical system approach to stochastic approximations, SIAM J. Control Optim. 34 (1996), 437–472. https://doi.org/10.1137/S0363012993253534
  • C. Conley, Isolated Invariant Sets and the Morse Index, CBMS Regional Conference Series in Mathematics 38, AMS, 1978. https://doi.org/10.1090/cbms/038
  • R. Bowen, ω-limit sets for Axiom A diffeomorphisms, J. Differential Equations 18 (1975), 333–339. https://doi.org/10.1016/0022-0396(75)90065-0
9 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research+1·Captain: mikedeng1

Maximal Flow Through a Network I: The Minimal Cut Theorem — the Maximal Flow Value Equals the Minimum Value of a Disconnecting SetResearch Paper

Motivation

The question behind this mission was posed by T. E. Harris to L. R. Ford, Jr. and D. R. Fulkerson at RAND, in the setting of rail transport: given a rail network linking two cities, with a capacity on every link, find the largest steady flow from one city to the other. Ford and Fulkerson's answer, the minimal cut theorem, published in the Canadian Journal of Mathematics in 1956 (DOI 10.4153/CJM-1956-045-5), says that the obvious upper bound, the total capacity of a set of links whose removal separates the two cities, is always achieved by some flow.

The theorem became the starting point of network flow theory, and through it of a large part of combinatorial optimization and operations research: transportation, assignment, scheduling and network reliability problems are routinely reduced to it.

Timeline.

  • 1927: K. Menger proves that the minimum number of vertices separating two vertex sets of a graph equals the maximum number of disjoint paths joining them (Fund. Math. 10), the unit-capacity ancestor of the theorem.
  • 1955: Harris and Ross study the Soviet rail network as a capacity problem in a RAND report; Harris formulates the maximal flow problem (Schrijver's historical account: Math. Program. 91, 2002).
  • 1956: Ford and Fulkerson publish the minimal cut theorem for undirected networks, with a non-constructive proof based on maximal flows (this paper). Independently, Elias, Feinstein and Shannon state and prove the max-flow min-cut theorem for directed networks (IRE Trans. Inf. Theory 2, 1956), and Dantzig and Fulkerson obtain it from linear programming duality.
  • 1956–1962: Ford and Fulkerson's labelling (augmenting path) algorithm, collected in Flows in Networks (Princeton, 1962).
  • 1972: Edmonds and Karp give polynomial bounds for augmenting-path methods (J. ACM 19).

Setting

A network NNN consists of a finite set of vertices VVV, a finite set of arcs EEE, two distinct vertices, the source aaa and the sink bbb, and a positive capacity c(e)>0c(e)>0c(e)>0 on every arc. Each arc eee has two distinct end vertices; arcs are undirected, and several arcs may join the same pair of vertices.

A chain joining uuu and www is a set of distinct arcs that can be arranged as α1(v0v1),α2(v1v2),…,αm(vm−1vm)\alpha_1(v_0v_1),\alpha_2(v_1v_2),\dots,\alpha_m(v_{m-1}v_m)α1​(v0​v1​),α2​(v1​v2​),…,αm​(vm−1​vm​) with v0=uv_0=uv0​=u, vm=wv_m=wvm​=w and the vertices v0,…,vmv_0,\dots,v_mv0​,…,vm​ pairwise distinct; each arc may be traversed in either direction. The null chain (m=0m=0m=0) joins uuu to itself.

A flow fff assigns a number f(C)≥0f(C)\ge 0f(C)≥0 to each chain CCC joining aaa and bbb (and 000 to every other set of arcs) such that the load ℓf(e)=∑C∋ef(C)\ell_f(e)=\sum_{C\ni e}f(C)ℓf​(e)=∑C∋e​f(C) satisfies ℓf(e)≤c(e)\ell_f(e)\le c(e)ℓf​(e)≤c(e) for every arc. Its value is val(f)=∑Cf(C)\mathrm{val}(f)=\sum_C f(C)val(f)=∑C​f(C). An arc is saturated by fff if ℓf(e)=c(e)\ell_f(e)=c(e)ℓf​(e)=c(e). A maximal flow is a flow of largest value.

A set DDD of arcs is a disconnecting set if every chain joining aaa and bbb contains an arc of DDD; its value is v(D)=∑e∈Dc(e)v(D)=\sum_{e\in D}c(e)v(D)=∑e∈D​c(e). A cut is a disconnecting set no proper subset of which is disconnecting.

The proof introduces two further objects: the set SSS of arcs saturated by every maximal flow, and the set L⊆SL\subseteq SL⊆S of left arcs, those arcs of SSS whose left vertex (the end vertex met first by a positive chain flow of a maximal flow, travelling from aaa) can be reached from aaa by a chain with no arc saturated by some maximal flow.

Formalization targets

Goal: Theorem 1 (Minimal cut theorem), p. 400

∃ m∈R:m=max⁡f flowval(f)=min⁡D disconnectingv(D),\exists\, m\in\mathbb R:\quad m=\max_{f\ \text{flow}}\mathrm{val}(f)=\min_{D\ \text{disconnecting}}v(D),∃m∈R:m=f flowmax​val(f)=D disconnectingmin​v(D),

with both the maximum and the minimum attained. The statement mentions only flows and disconnecting sets, not the proof objects SSS and LLL.

Milestones, in the order of the paper's proof

  1. A maximal flow exists, and the set of maximal flows is convex (p. 400).
  2. Lemma 1: SSS is a disconnecting set (p. 400).
  3. Every arc of SSS receives the same orientation from all positive chain flows of all maximal flows: its left vertex is unique (pp. 400–401).
  4. Lemma 2: LLL is a disconnecting set (p. 401).
  5. Lemma 3: no positive chain flow of a maximal flow contains more than one arc of LLL (p. 401).
  6. val(f)≤v(D)\mathrm{val}(f)\le v(D)val(f)≤v(D) for every flow fff and every disconnecting set DDD (p. 402).
  7. LLL is a cut of minimal value, and every maximal flow has value v(L)v(L)v(L) (p. 402).

Two further statements of the paper are included as items without being milestones: the remark that a disconnecting set of minimal value is a cut (p. 400), and the Corollary (p. 402): if a set AAA of arcs meets every cut in exactly one arc, adding kkk to the capacity of each arc of AAA raises the maximal flow value by kkk.

Significance

The minimal cut theorem turns a maximization over flows into a minimization over finite sets of arcs, so an optimal flow comes with a short certificate of optimality. It implies Menger's theorem (unit capacities), and through it König's theorem on bipartite matchings and Hall's marriage theorem. The Corollary is the tool behind the paper's own computing procedure for source–sink planar networks (§2, formalized in a companion mission).

The theorem is classical and proved. What this mission adds is a machine-checked proof of the paper's own formulation: undirected arcs, parallel arcs, flows decomposed along chains (path flows, with no circulations), and the minimum taken over arc sets meeting every chain, together with the proof's intermediate claims. Max-flow min-cut theorems already on the platform (Applied Combinatorics VIII, AppliedComb.Flows.max_flow_min_cut; Introduction to Linear Optimization X, LinearOptimization.max_flow_min_cut) concern directed networks with edge flows obeying conservation and cuts given by vertex sets. They are related results, not this statement, and connecting the two models is itself welcome work.

Difficulty

Weak duality (milestone 6) is immediate; the content is the reverse inequality. The obvious first step, taking a maximal flow and observing that its saturated arcs separate aaa from bbb, does not finish the proof: a positive chain flow may pass through several saturated arcs, so the total capacity of the saturated arcs can exceed the flow value. One has to single out a disconnecting subset that every positive chain flow crosses exactly once, and there is no canonical choice from a single flow. The paper's sets SSS and LLL are defined from all maximal flows at once, and the work consists in showing that these sets are well behaved. The orientation claim in particular needs an exchange argument on two chains that cross at an arc, where the recombined arc sequences may revisit vertices and must be reduced to chains. In a formal development this "a walk contains a chain" step and the averaging of maximal flows over finitely many chains are the main bookkeeping costs.

Formalization scope

  • A network is a structure on a vertex type V and an arc type E, both Fintype with decidable equality, with end-vertex maps tail, head (labels only, no direction), tail e ≠ head e, a source and a sink with source ≠ sink, and capacities cap : E → ℝ with 0 < cap e. These are the paper's standing assumptions; there are no others in §1. In particular, no planarity is assumed and an arc may join aaa and bbb directly.
  • A chain is a Finset E that is the arc set of some arrangement (list of arcs, list of pairwise distinct vertices, each arc joining consecutive vertices in either order).
  • A flow is a function f : Finset E → ℝ, non-negative, zero off the chains joining source and sink, with every arc load at most the capacity. A collection of chain flows that lists a chain twice merges into this form without changing the value or any load.
  • "Maximal" means of maximum value. The goal is stated with IsGreatest and IsLeast on the sets of flow values and of values of disconnecting sets, so no supremum of a real set appears and both extrema must be attained.
  • A trivializing formalization is ruled out: chains must be self-avoiding and must join the source and the sink, the disconnecting condition quantifies over exactly these chains, and the minimum ranges over all disconnecting sets rather than over a family chosen to match a given flow.
  • Needed infrastructure: finite sums over Finset (Finset E), convexity in Finset E → ℝ, compactness of the flow polytope (for existence), and lemmas on lists (extracting a chain from a walk). The walk-to-chain lemma and weak duality are reusable for the companion mission and for any path-flow model.

Selected references

  • L. R. Ford, Jr. and D. R. Fulkerson, Maximal Flow Through a Network, Canadian Journal of Mathematics 8 (1956), 399–404. https://doi.org/10.4153/CJM-1956-045-5
  • P. Elias, A. Feinstein and C. E. Shannon, A note on the maximum flow through a network, IRE Transactions on Information Theory 2 (1956), 117–119. https://doi.org/10.1109/TIT.1956.1056816
  • K. Menger, Zur allgemeinen Kurventheorie, Fundamenta Mathematicae 10 (1927), 96–115. https://doi.org/10.4064/fm-10-1-96-115
  • L. R. Ford, Jr. and D. R. Fulkerson, Flows in Networks, Princeton University Press, 1962.
  • J. Edmonds and R. M. Karp, Theoretical improvements in algorithmic efficiency for network flow problems, Journal of the ACM 19 (1972), 248–264. https://doi.org/10.1145/321694.321699
  • A. Schrijver, On the history of the transportation and maximum flow problems, Mathematical Programming 91 (2002), 437–445. https://doi.org/10.1007/s101070100259
13 thms4 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization+1·Captain: mikedeng1

A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization 1: Deterministic Double Greedy Achieves 1/3 of the OptimumResearch Paper

Motivation

A set function f:2N→Rf : 2^{\mathcal N} \to \mathbb Rf:2N→R on a finite ground set N\mathcal NN is submodular if it has diminishing returns, equivalently if f(A)+f(B)≥f(A∪B)+f(A∩B)f(A) + f(B) \ge f(A \cup B) + f(A \cap B)f(A)+f(B)≥f(A∪B)+f(A∩B) for all A,B⊆NA, B \subseteq \mathcal NA,B⊆N. Cut functions of graphs and hypergraphs, coverage functions, entropy, and many facility-location and welfare objectives are submodular. Unconstrained Submodular Maximization (USM) asks, given a nonnegative submodular fff through a value oracle, for a set S⊆NS \subseteq \mathcal NS⊆N of maximum value. It contains Max-Cut, Max-DiCut and Max Facility Location as special cases, and it is a subroutine in algorithms for constrained submodular maximization.

Timeline:

  • Feige, Mirrokni and Vondrák (FOCS 2007; SIAM J. Comput. 2011) gave a uniformly random set achieving 1/41/41/4 of the optimum, a deterministic local search achieving 1/3−ε/n1/3 - \varepsilon/n1/3−ε/n, a randomized local search achieving 2/52/52/5, and proved that no algorithm making polynomially many value queries achieves 1/2+ε1/2 + \varepsilon1/2+ε.
  • Oveis Gharan and Vondrák (SODA 2011) improved the ratio to about 0.410.410.41 by simulated annealing; Feldman, Naor and Schwartz (ICALP 2011) to about 0.420.420.42.
  • Buchbinder, Feldman, Naor and Schwartz (FOCS 2012; SIAM J. Comput. 2015) gave the double greedy algorithms: a deterministic linear-time 1/31/31/3-approximation (this mission) and a randomized linear-time 1/21/21/2-approximation, matching the query lower bound.

Setting

Let N\mathcal NN be a finite ground set and f:2N→R≥0f : 2^{\mathcal N} \to \mathbb R_{\ge 0}f:2N→R≥0​ a nonnegative submodular function. Write f(OPT)=max⁡S⊆Nf(S)f(OPT) = \max_{S \subseteq \mathcal N} f(S)f(OPT)=maxS⊆N​f(S), and let OPTOPTOPT denote a set attaining it.

Algorithm 1 (DeterministicUSM) fixes an arbitrary order u1,…,unu_1, \dots, u_nu1​,…,un​ of N\mathcal NN and maintains two solutions, starting from X0=∅X_0 = \emptysetX0​=∅ and Y0=NY_0 = \mathcal NY0​=N. In iteration i=1,…,ni = 1, \dots, ni=1,…,n it computes

ai=f(Xi−1∪{ui})−f(Xi−1),bi=f(Yi−1∖{ui})−f(Yi−1).a_i = f(X_{i-1} \cup \{u_i\}) - f(X_{i-1}), \qquad b_i = f(Y_{i-1} \setminus \{u_i\}) - f(Y_{i-1}).ai​=f(Xi−1​∪{ui​})−f(Xi−1​),bi​=f(Yi−1​∖{ui​})−f(Yi−1​).

If ai≥bia_i \ge b_iai​≥bi​ it sets Xi=Xi−1∪{ui}X_i = X_{i-1} \cup \{u_i\}Xi​=Xi−1​∪{ui​}, Yi=Yi−1Y_i = Y_{i-1}Yi​=Yi−1​; otherwise Xi=Xi−1X_i = X_{i-1}Xi​=Xi−1​, Yi=Yi−1∖{ui}Y_i = Y_{i-1} \setminus \{u_i\}Yi​=Yi−1​∖{ui​}. A tie adds uiu_iui​. After nnn iterations Xn=YnX_n = Y_nXn​=Yn​, which is the output.

The analysis uses the hybrid sets OPTi=(OPT∪Xi)∩YiOPT_i = (OPT \cup X_i) \cap Y_iOPTi​=(OPT∪Xi​)∩Yi​, which agree with XiX_iXi​ and YiY_iYi​ on u1,…,uiu_1, \dots, u_iu1​,…,ui​ and with OPTOPTOPT on ui+1,…,unu_{i+1}, \dots, u_nui+1​,…,un​. In Lean, the run is state f l i, the state (Xi,Yi)(X_i, Y_i)(Xi​,Yi​) after the first iii entries of the order l, and OPTiOPT_iOPTi​ is optI O (state f l i).

Formalization targets

Goal: Theorem I.1

For every nonnegative submodular fff and every order of N\mathcal NN,

Xn=Ynandf(OPT)≤3 f(Xn).X_n = Y_n \qquad\text{and}\qquad f(OPT) \le 3\, f(X_n).Xn​=Yn​andf(OPT)≤3f(Xn​).

Milestones

  1. Lemma II.1. For every 1≤i≤n1 \le i \le n1≤i≤n, ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0.
  2. The hybrid sequence. OPTiOPT_iOPTi​ agrees with Xi,YiX_i, Y_iXi​,Yi​ on u1,…,uiu_1, \dots, u_iu1​,…,ui​ and with OPTOPTOPT on the rest; OPT0=OPTOPT_0 = OPTOPT0​=OPT and OPTn=Xn=YnOPT_n = X_n = Y_nOPTn​=Xn​=Yn​.
  3. Lemma II.2. For every 1≤i≤n1 \le i \le n1≤i≤n,
f(OPTi−1)−f(OPTi)≤[f(Xi)−f(Xi−1)]+[f(Yi)−f(Yi−1)].f(OPT_{i-1}) - f(OPT_i) \le [f(X_i) - f(X_{i-1})] + [f(Y_i) - f(Y_{i-1})].f(OPTi−1​)−f(OPTi​)≤[f(Xi​)−f(Xi−1​)]+[f(Yi​)−f(Yi−1​)].
  1. The telescoped display. f(OPT0)−f(OPTn)≤[f(Xn)−f(X0)]+[f(Yn)−f(Y0)]≤f(Xn)+f(Yn)f(OPT_0) - f(OPT_n) \le [f(X_n) - f(X_0)] + [f(Y_n) - f(Y_0)] \le f(X_n) + f(Y_n)f(OPT0​)−f(OPTn​)≤[f(Xn​)−f(X0​)]+[f(Yn​)−f(Y0​)]≤f(Xn​)+f(Yn​).
  2. Theorem II.3 (tightness). For every ε>0\varepsilon > 0ε>0 there is a nonnegative submodular fff with f(OPT)>0f(OPT) > 0f(OPT)>0 and an order on which f(Xn)≤(1/3+ε) f(OPT)f(X_n) \le (1/3 + \varepsilon)\, f(OPT)f(Xn​)≤(1/3+ε)f(OPT).

Significance

The result. Algorithm 1 is the deterministic member of the double greedy family. It makes one pass over the ground set with four value queries per element, and it guarantees 1/31/31/3 of the optimum for every order, without the polynomial-but-large running time and the ε/n\varepsilon/nε/n loss of local search. Its analysis, which charges the decrease of f(OPTi)f(OPT_i)f(OPTi​) to the increases of f(Xi)f(X_i)f(Xi​) and f(Yi)f(Y_i)f(Yi​), is the template the paper then refines into the randomized 1/21/21/2-approximation (Theorem I.2) and its continuous counterpart on the multilinear extension. Theorem II.3 shows that 1/31/31/3 is the exact ratio of this algorithm, so the improvement to 1/21/21/2 requires randomization (or a different deterministic rule) rather than a sharper analysis.

Formalizing it. The theorem is proved in the paper; to our knowledge it has no machine-checked proof. The mission produces a formal statement of the algorithm as printed, a checked proof of its guarantee for every order, and a checked tight instance. The definitions of the run and of OPTiOPT_iOPTi​ are the same objects the randomized and fractional analyses reason about, so a complete development here is the first step toward the paper's main theorem.

Difficulty

The individual inequalities are short; the difficulty lies in the bookkeeping. Each step needs the invariants Xi−1⊆Yi−1X_{i-1} \subseteq Y_{i-1}Xi−1​⊆Yi−1​ and ui∈Yi−1∖Xi−1u_i \in Y_{i-1} \setminus X_{i-1}ui​∈Yi−1​∖Xi−1​, which follow from the order being an enumeration (no repetitions, every element present), and the identification of OPTiOPT_iOPTi​ from OPTi−1OPT_{i-1}OPTi−1​ in each branch of the algorithm. Summing Lemma II.2 needs a telescoping over the run defined as a fold. The naive idea of comparing f(Xn)f(X_n)f(Xn​) with f(OPT)f(OPT)f(OPT) directly, without the hybrid sets, gives no bound: the greedy choices are made against XXX and YYY, not against OPTOPTOPT. For Theorem II.3 the difficulty is producing an explicit instance, checking that it is submodular and nonnegative, and tracing the run, including the ties, which the algorithm resolves by adding.

Formalization scope

  • The ground set is a finite type X with decidable equality; subsets are Finset X; fff is real valued, Finset X → ℝ, and nonnegativity is the hypothesis ∀ S, 0 ≤ f S where the page uses it (the goal, the telescoped display and the tight example). Lemma II.1, Lemma II.2 and the hybrid-sequence milestone do not assume it.
  • Submodularity is the lattice form f(A)+f(B)≥f(A∪B)+f(A∩B)f(A) + f(B) \ge f(A \cup B) + f(A \cap B)f(A)+f(B)≥f(A∪B)+f(A∩B) of the paper's footnote 1, through the published definition NonmonotoneSubmod.Shared.Submodular. The paper's main-text sentence ("for every A⊆B⊆NA \subseteq B \subseteq \mathcal NA⊆B⊆N and u∈Nu \in \mathcal Nu∈N") would force monotonicity when u∈B∖Au \in B \setminus Au∈B∖A and is read as the footnote. f(OPT)f(OPT)f(OPT) is the published NonmonotoneSubmod.Shared.OPT f, the maximum of fff over all subsets.
  • The order u1,…,unu_1, \dots, u_nu1​,…,un​ is a list l with l.Nodup and ∀ x, x ∈ l; uiu_iui​ is l[i - 1]. Every statement quantifies over all such lists. No nonemptiness of N\mathcal NN is assumed: for an empty ground set the goal reads f(∅)≤3f(∅)f(\emptyset) \le 3 f(\emptyset)f(∅)≤3f(∅).
  • The tie rule is line 5's ai≥bia_i \ge b_iai​≥bi​: ties add uiu_iui​.
  • Where a milestone mentions an optimal solution, it takes a set O with ∀ S, f S ≤ f O.
  • The goal is stated multiplied out, f(OPT)≤3f(Xn)f(OPT) \le 3 f(X_n)f(OPT)≤3f(Xn​), because f(OPT)f(OPT)f(OPT) may be 000.
  • Trivializing formalizations ruled out. The paper's Theorem I.1 reads "there exists a deterministic linear time (1/3)(1/3)(1/3)-approximation algorithm"; without the running time that existential is satisfied by exhaustive search, so the goal is the guarantee of the printed Algorithm 1 for every order. Running time is not formalized: the algorithm evaluates fff on four sets per element, nnn elements in all. Theorem II.3 requires f(OPT)>0f(OPT) > 0f(OPT)>0, without which f≡0f \equiv 0f≡0 would satisfy it.
  • Needed infrastructure: elementary lemmas on List.foldl over List.take, on membership in the states of the run, and on telescoping sums over 1≤i≤n1 \le i \le n1≤i≤n. A reusable lemma "the run keeps Xi⊆YiX_i \subseteq Y_iXi​⊆Yi​ and decides exactly u1,…,uiu_1, \dots, u_iu1​,…,ui​" would serve all three missions of this paper. Contributions of proofs of any milestone, of the goal from the milestones, and of the tight instance (e.g. the paper's five-vertex directed cut function) are welcome.

Selected references

  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization, FOCS 2012. https://doi.org/10.1109/FOCS.2012.73 (journal version: SIAM J. Comput. 44(5), 2015, https://doi.org/10.1137/130929205)
  • U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-monotone Submodular Functions, SIAM J. Comput. 40(4), 2011. https://doi.org/10.1137/090779346
  • S. Oveis Gharan, J. Vondrák, Submodular Maximization by Simulated Annealing, SODA 2011. https://doi.org/10.1137/1.9781611973082.83
  • M. Feldman, J. Naor, R. Schwartz, Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm, ICALP 2011. https://doi.org/10.1007/978-3-642-22006-7_29
9 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations Research·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games II: For Symmetric Games the Average Social Cost Price of Anarchy Is (5N-2)/(2N+1)Research Paper

Motivation

Selfish routing and resource sharing are modelled by congestion games: each player picks a set of shared resources, and the cost of a resource grows with the number of players using it. The price of anarchy, introduced by Koutsoupias and Papadimitriou (STACS 1999), measures how much worse the social cost of a worst Nash equilibrium is than the optimum. For non-atomic (infinitesimal) traffic with linear latencies, Roughgarden and Tardos (J. ACM 2002) showed the ratio is 4/34/34/3. Christodoulou and Koutsoupias (STOC 2005) turned to finite (atomic, unweighted) congestion games, where each of NNN players controls one indivisible unit of load, and determined the pure price of anarchy for linear latencies in four settings: asymmetric or symmetric strategy sets, and average or maximum social cost. Awerbuch, Azar and Epstein (STOC 2005) obtained the value 5/25/25/2 for the asymmetric average case independently.

This mission covers the symmetric average-cost entry of that table (Sect. 3.2 of the paper). It shows that when all players share one strategy set, the ratio is not 5/25/25/2 but (5N−2)/(2N+1)(5N-2)/(2N+1)(5N−2)/(2N+1), which depends on the number of players and tends to 5/25/25/2 only as N→∞N\to\inftyN→∞.

Setting

A congestion game has a finite set of players N={1,…,n}N=\{1,\dots,n\}N={1,…,n} (in Lean, Fin N), a finite set of facilities EEE, for each player iii a collection of pure strategies Σi⊆2E\Sigma_i\subseteq 2^EΣi​⊆2E, and for each facility a latency fe:N→Rf_e:\mathbb N\to\mathbb Rfe​:N→R. A profile A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) picks Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ for each player (IsProfile). The load ne(A)n_e(A)ne​(A) is the number of players whose strategy contains eee (load), the cost of player iii is

ci(A)=∑e∈Aife(ne(A))c_i(A)=\sum_{e\in A_i} f_e\bigl(n_e(A)\bigr)ci​(A)=e∈Ai​∑​fe​(ne​(A))

(cost), and the social cost is SUM(A)=∑ici(A)\mathrm{SUM}(A)=\sum_i c_i(A)SUM(A)=∑i​ci​(A) (sumCost), NNN times the average cost. A profile AAA is a pure Nash equilibrium (IsPureNash) if ci(A)≤ci(A−i,S)c_i(A)\le c_i(A_{-i},S)ci​(A)≤ci​(A−i​,S) for every player iii and every S∈ΣiS\in\Sigma_iS∈Σi​, where (A−i,S)(A_{-i},S)(A−i​,S) replaces AiA_iAi​ by SSS.

Latencies are linear (IsLinear) when fe(k)=aek+bef_e(k)=a_ek+b_efe​(k)=ae​k+be​ with ae,be≥0a_e,b_e\ge0ae​,be​≥0. The game is symmetric (IsSymmetric) when all players have the same strategy set, Σi=Σ\Sigma_i=\SigmaΣi​=Σ. The pure price of anarchy of a class of games is the supremum, over games in the class and pure Nash equilibria AAA, of SUM(A)/opt\mathrm{SUM}(A)/\mathit{opt}SUM(A)/opt, with opt=min⁡PSUM(P)\mathit{opt}=\min_P\mathrm{SUM}(P)opt=minP​SUM(P).

Formalization targets

Goal: Theorems 3 and 4

For every N≥1N\ge1N≥1: every pure Nash equilibrium AAA of every symmetric linear congestion game with NNN players satisfies

SUM(A)≤5N−22N+1 SUM(P)for every profile P,\mathrm{SUM}(A)\le\frac{5N-2}{2N+1}\,\mathrm{SUM}(P)\quad\text{for every profile }P,SUM(A)≤2N+15N−2​SUM(P)for every profile P,

and some symmetric linear game with NNN players has a pure Nash equilibrium AAA and a profile PPP with SUM(P)>0\mathrm{SUM}(P)>0SUM(P)>0 and equality. Together these state that the pure price of anarchy of the class is exactly (5N−2)/(2N+1)(5N-2)/(2N+1)(5N−2)/(2N+1).

Milestones

  1. Lemma 1: β(α+1)≤13α2+53β2\beta(\alpha+1)\le\frac13\alpha^2+\frac53\beta^2β(α+1)≤31​α2+35​β2 for nonnegative integers α,β\alpha,\betaα,β.
  2. Theorem 3, proof: the Nash inequality of player iii against the strategy PjP_jPj​ of any player jjj.
  3. Theorem 3, proof: the bound on N ci(A)N\,c_i(A)Nci​(A) obtained by summing over jjj.
  4. Theorem 3, proof: the bound on SUM(A)\mathrm{SUM}(A)SUM(A) obtained by summing over iii.
  5. Theorem 3: the upper bound alone.
  6. Theorem 4: the matching instances alone.

Significance

The result separates symmetric from asymmetric games for every finite number of players: for N=2N=2N=2 the symmetric bound is 8/58/58/5, for N=3N=3N=3 it is 13/713/713/7, against 5/25/25/2 for asymmetric games with N≥3N\ge3N≥3 players. Theorem 4 shows the bound is tight, so the function N↦(5N−2)/(2N+1)N\mapsto(5N-2)/(2N+1)N↦(5N−2)/(2N+1) is the exact answer, not an artefact of the proof. The asymptotic value 5/25/25/2 coincides with the asymmetric one, which says that symmetry helps only by a vanishing amount for large populations. Later work on smoothness arguments (Roughgarden, STOC 2009) takes the 5/25/25/2 bound of this paper as its central example.

The theorems are proved in the paper; the authors print the proofs for identity latencies fe(k)=kf_e(k)=kfe​(k)=k and state that they extend to aek+bea_ek+b_eae​k+be​. No machine-checked proof of these bounds is known to exist. This mission produces a statement for general affine latencies with nonnegative coefficients, the affine forms of the intermediate inequalities, and an explicit family of instances for every NNN, all of which are reusable for the other entries of the paper's table.

Difficulty

The upper bound requires combining the N2N^2N2 deviation inequalities (player iii against the strategy of each player jjj in the comparison profile) and then bounding cross terms facility by facility; the step that needs care is that the bound of Lemma 1 holds for integer loads only and fails for real numbers, so any argument that relaxes loads to reals loses the constant. The asymmetric argument, which compares player iii only with its own optimal strategy PiP_iPi​, gives 5/25/25/2 and cannot see the dependence on NNN.

For the lower bound, the instance must be a Nash equilibrium against every strategy in the common strategy set, which contains the equilibrium strategies of all other players as well as the optimal ones. Exact equality of the ratio requires the block sizes to be tuned to NNN; verifying the equilibrium condition involves counting facilities shared by pairs and triples of players.

Formalization scope

Players are Fin N with N≥1N\ge1N≥1; facilities are an arbitrary finite type with decidable equality; strategies and profiles are Finsets of facilities, with feasibility a separate predicate. Latencies are real-valued functions of the natural-number load. Linear latencies are affine with nonnegative coefficients, as in Sect. 2 of the paper; the milestone inequalities carry the coefficients ae,bea_e,b_eae​,be​ explicitly and reduce to the printed displays when ae=1a_e=1ae​=1, be=0b_e=0be​=0. The Nash condition is in cost form. Upper bounds are stated against every feasible profile PPP, which is equivalent to the bound on SUM(A)/opt\mathrm{SUM}(A)/\mathit{opt}SUM(A)/opt without dividing by opt\mathit{opt}opt. All constants are computed in R\mathbb RR.

The lower bound requires SUM(P)>0\mathrm{SUM}(P)>0SUM(P)>0: without it the statement is satisfied by zero latencies or empty strategies, where both sides vanish. Symmetry is a hypothesis of the upper bound and a property of the instance; without it the upper bound is false, since asymmetric instances reach 5/25/25/2.

A complete development needs finite-sum manipulations (double counting ∑j∑e∈Pj=∑ene(P)\sum_j\sum_{e\in P_j}=\sum_e n_e(P)∑j​∑e∈Pj​​=∑e​ne​(P)), the integer inequality of Lemma 1, and an explicit facility type for the instance. The model layer is shared with the other missions of this series. Proofs of the milestones and alternative proofs of the bound are welcome.

Selected references

  • G. Christodoulou and E. Koutsoupias, The Price of Anarchy of Finite Congestion Games, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar and A. Epstein, The Price of Routing Unsplittable Flow, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias and C. Papadimitriou, Worst-case Equilibria, STACS 1999. https://doi.org/10.1007/3-540-49116-3_38
  • T. Roughgarden and É. Tardos, How Bad Is Selfish Routing?, J. ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • T. Roughgarden, Intrinsic Robustness of the Price of Anarchy, Proc. 41st ACM STOC, 2009. https://doi.org/10.1145/1536414.1536485
9 thms3 active usersReviewed
🏆Completed
Dynamic ProgrammingMarkov ChainOperations Research·Captain: mikedeng1

Discrete Dynamic Programming 1: Every Finite Markov Decision Problem Has a Stationary Policy That Is Optimal for All Discount Factors Sufficiently Near 1Research Paper

Motivation

A Markov decision problem models a system that is observed once per period and controlled by choosing an action: the action earns an immediate income and determines the probabilities of the next state. Inventory control, machine replacement, queue admission and many reinforcement-learning benchmarks are of this form. With future income discounted by a factor β<1\beta<1β<1, Howard (Dynamic Programming and Markov Processes, 1960) showed how to compute an optimal policy by policy improvement. The undiscounted problem (β=1\beta=1β=1) is harder, because total income is typically infinite.

David Blackwell's Discrete Dynamic Programming (Ann. Math. Statist. 33 (1962) 719–726) treats β=1\beta=1β=1 as a limit of β<1\beta<1β<1. Its Theorem 5 shows that some stationary policy is optimal simultaneously for all discount factors sufficiently close to 111. Such policies are now called Blackwell optimal, and the result is the base of sensitive discount optimality (Veinott, 1969) and of the standard textbook treatment of average-reward problems (Puterman, Markov Decision Processes, 1994, Ch. 10).

Timeline. Howard (1960): policy iteration for discounted and average-reward finite problems. Blackwell (1962): Theorem 5 (Blackwell optimal stationary policies exist) and the characterization of nearly optimal stationary policies (Theorem 4, the subject of the companion mission). Miller and Veinott (Ann. Math. Statist. 40 (1969) 366–370), Veinott (Ann. Math. Statist. 40 (1969) 1635–1660): Laurent expansions of VβV_\betaVβ​ in 1−β1-\beta1−β and nnn-discount optimality.

Setting

There are finitely many states sss and a finite set AAA of actions, every action available in every state. In state sss, action aaa yields income i(s,a)∈Ri(s,a)\in\mathbb Ri(s,a)∈R (any sign) and moves the system to state s′s's′ with probability q(s′∣s,a)q(s'\mid s,a)q(s′∣s,a); each q(⋅∣s,a)q(\cdot\mid s,a)q(⋅∣s,a) is a probability vector.

A decision rule is a function fff from states to actions; FFF is the finite set of decision rules. A policy is a sequence π={fn, n=1,2,… }\pi=\{f_n,\ n=1,2,\dots\}π={fn​, n=1,2,…} in FFF: on day nnn, in state sss, action fn(s)f_n(s)fn​(s) is used. Policies are deterministic and Markov but may change with time. The policy (f,π)(f,\pi)(f,π) uses fff on day 111 and then follows π\piπ; f(∞)f^{(\infty)}f(∞) uses fff every day and is called stationary.

For f∈Ff\in Ff∈F, r(f)r(f)r(f) is the vector (i(s,f(s)))s(i(s,f(s)))_s(i(s,f(s)))s​ and Q(f)Q(f)Q(f) the Markov matrix (q(s′∣s,f(s)))s,s′(q(s'\mid s,f(s)))_{s,s'}(q(s′∣s,f(s)))s,s′​. With Q0(π)=IQ_0(\pi)=IQ0​(π)=I and Qn(π)=Q(f1)⋯Q(fn)Q_n(\pi)=Q(f_1)\cdots Q(f_n)Qn​(π)=Q(f1​)⋯Q(fn​), the return of π\piπ at discount factor 0≤β<10\le\beta<10≤β<1 is

Vβ(π)=∑n=0∞βn Qn(π) r(fn+1),V_\beta(\pi)=\sum_{n=0}^\infty \beta^n\,Q_n(\pi)\,r(f_{n+1}),Vβ​(π)=n=0∑∞​βnQn​(π)r(fn+1​),

a vector indexed by the initial state. Vectors are compared coordinatewise; w1>w2w_1>w_2w1​>w2​ means w1≥w2w_1\ge w_2w1​≥w2​ and w1≠w2w_1\ne w_2w1​=w2​.

A policy π∗\pi^*π∗ is β\betaβ-optimal if Vβ(π∗)≥Vβ(π)V_\beta(\pi^*)\ge V_\beta(\pi)Vβ​(π∗)≥Vβ​(π) for every policy π\piπ. Following §4 of the paper, a policy is optimal if it is β\betaβ-optimal for all β\betaβ sufficiently near 111.

Formalization targets

Goal: Theorem 5

There exist a decision rule fff and β0<1\beta_0<1β0​<1 such that

Vβ(f(∞)) ≥ Vβ(π)for all β∈(β0,1) and all policies π.V_\beta(f^{(\infty)})\ \ge\ V_\beta(\pi)\qquad\text{for all }\beta\in(\beta_0,1)\text{ and all policies }\pi.Vβ​(f(∞)) ≥ Vβ​(π)for all β∈(β0​,1) and all policies π.

One fff and one β0\beta_0β0​ serve every competing policy and every β∈(β0,1)\beta\in(\beta_0,1)β∈(β0​,1).

Milestones

  1. The composition rule Vβ(f,π)=L(f)Vβ(π)V_\beta(f,\pi)=L(f)V_\beta(\pi)Vβ​(f,π)=L(f)Vβ​(π), with L(f)w=r(f)+βQ(f)wL(f)w=r(f)+\beta Q(f)wL(f)w=r(f)+βQ(f)w, and its NNN-fold version (§2).
  2. Theorem 1: if Vβ(f,π∗)≤Vβ(π∗)V_\beta(f,\pi^*)\le V_\beta(\pi^*)Vβ​(f,π∗)≤Vβ​(π∗) for all f∈Ff\in Ff∈F, then π∗\pi^*π∗ is β\betaβ-optimal.
  3. Theorem 2: if Vβ(f,π)>Vβ(π)V_\beta(f,\pi)>V_\beta(\pi)Vβ​(f,π)>Vβ​(π) then Vβ(f(∞))>Vβ(π)V_\beta(f^{(\infty)})>V_\beta(\pi)Vβ​(f(∞))>Vβ​(π).
  4. Theorem 3 (policy improvement): if no action improves f(∞)f^{(\infty)}f(∞) by one step, f(∞)f^{(\infty)}f(∞) is β\betaβ-optimal; otherwise switching to improving actions gives g(∞)>f(∞)g^{(\infty)}>f^{(\infty)}g(∞)>f(∞).
  5. Corollary: for each fixed β∈[0,1)\beta\in[0,1)β∈[0,1) some stationary policy is β\betaβ-optimal.
  6. Each coordinate of Vβ(f(∞))V_\beta(f^{(\infty)})Vβ​(f(∞)) is a rational function of β\betaβ on [0,1)[0,1)[0,1) with nonvanishing denominator.
  7. Some f∗f^*f∗ is β\betaβ-optimal for a set of β\betaβ's having 111 as a limit point.
  8. If Vβ(f∗(∞))≥Vβ(g(∞))V_\beta(f^{*(\infty)})\ge V_\beta(g^{(\infty)})Vβ​(f∗(∞))≥Vβ​(g(∞)) for a set of β\betaβ's accumulating at 111, then it holds for all β\betaβ near 111.

Significance

The result. Theorem 5 shows that the infinitely many discounted problems near β=1\beta=1β=1 share a common optimal stationary policy. Such a policy is also optimal for the long-run average criterion, which settles the existence of average-optimal stationary policies in finite models without any recurrence assumption. It also justifies computing undiscounted solutions as limits of discounted ones, and it is the first case of the sensitive optimality criteria developed later.

Formalizing it. The theorem is classical and proved in the paper and in the textbooks; there is no machine-checked proof of it in Blackwell's model on the platform. A related open item, SennottDP.AvgFinite.prop_6_2_3_blackwell_optimal, states the textbook version for nonnegative costs and randomized history-dependent policies; the present mission is Blackwell's own formulation with incomes of either sign and deterministic Markov policies. A complete development also yields a verified policy improvement theorem (Theorem 3) and the rationality of discounted values in β\betaβ, both reusable for any finite-state discounted model.

Difficulty

The Corollary gives, for each β\betaβ, some optimal stationary policy, and FFF is finite, so one f∗f^*f∗ is β\betaβ-optimal for infinitely many β\betaβ accumulating at 111. The obvious argument stops there: optimality on a sequence of β\betaβ's says nothing about the β\betaβ's in between, and a pointwise limit argument cannot produce a whole interval (β0,1)(\beta_0,1)(β0​,1). The step that fails is passing from "frequently" to "eventually", and it needs structural information about how VβV_\betaVβ​ depends on β\betaβ, not just continuity. A second difficulty is the comparison class: optimality must hold against all time-dependent policies, not only the finitely many stationary ones, so the final step has to bring the Corollary back in for every β\betaβ near 111.

Formalization scope

States and actions are finite nonempty Lean types St, Act; decision rules are functions St → Act and policies are sequences ℕ → St → Act, indexed from 000 (π 0 is Blackwell's f1f_1f1​). Incomes are real-valued with no sign restriction. The law of motion law s a s' =q(s′∣s,a)=q(s'\mid s,a)=q(s′∣s,a) satisfies the published predicate IsTransitionKernel. Qn(π)Q_n(\pi)Qn​(π) is the ordered matrix product and Vβ(π)V_\beta(\pi)Vβ​(π) is the tsum of the series, which converges absolutely for 0≤β<10\le\beta<10≤β<1; every statement at a fixed β\betaβ assumes 0≤β<10\le\beta<10≤β<1, and nothing is stated for β≥1\beta\ge1β≥1. Vector inequalities are coordinatewise, and the strict order is "≥\ge≥ and ≠\ne=", not coordinatewise strict. "β\betaβ sufficiently near 111" is "there is β0<1\beta_0<1β0​<1 such that for every β∈(β0,1)\beta\in(\beta_0,1)β∈(β0​,1)". The paper's §4 phrase Vβ(π)=U(β)V_\beta(\pi)=U(\beta)Vβ​(π)=U(β) is encoded as β\betaβ-optimality, so no supremum over policies appears.

The word "optimal" has two meanings in the paper: at one fixed β\betaβ (§3, the Corollary) and for all β\betaβ near 111 (§4, Theorem 5). The Lean development keeps them apart as IsBetaOptimal β and IsOptimal. A statement of Theorem 5 at a single β\betaβ, with "there exists β\betaβ", for a set of β\betaβ's accumulating at 111, or against stationary policies only would be a different and weaker theorem; the goal rules all of these out.

Needed infrastructure: summation and shifting of the discounted series, Neumann series (I−βQ)−1=∑nβnQn(I-\beta Q)^{-1}=\sum_n\beta^nQ^n(I−βQ)−1=∑n​βnQn for stochastic QQQ, Cramer's rule to express (I−βQ)−1r(I-\beta Q)^{-1}r(I−βQ)−1r as a ratio of polynomials in β\betaβ, and the fact that a nonzero polynomial has finitely many roots. The policy improvement theorem and the rationality lemma are reusable beyond this mission. Proofs of individual milestones are welcome independently.

Selected references

  • D. Blackwell, Discrete Dynamic Programming, Ann. Math. Statist. 33(2):719–726, 1962. https://doi.org/10.1214/aoms/1177704593
  • R. A. Howard, Dynamic Programming and Markov Processes, Technology Press and Wiley, 1960.
  • A. F. Veinott Jr., Discrete Dynamic Programming with Sensitive Discount Optimality Criteria, Ann. Math. Statist. 40(5):1635–1660, 1969. https://doi.org/10.1214/aoms/1177697379
  • M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming, Wiley, 1994. https://doi.org/10.1002/9780470316887
  • L. I. Sennott, Stochastic Dynamic Programming and the Control of Queueing Systems, Wiley, 1999 (Proposition 6.2.3, Blackwell optimality for finite models). https://doi.org/10.1002/9780470317037
11 thms3 active usersReviewed
🏆Completed
Operations ResearchProbability·Captain: mikedeng1

Conditional Logit Analysis of Qualitative Choice Behavior 1: Independence of Irrelevant Alternatives with a Universal Benchmark Yields Logit Selection ProbabilitiesResearch Paper

Motivation

The conditional logit model is the workhorse of discrete choice analysis: it is used to forecast travel mode shares, to estimate demand for differentiated products, and, in operations research, as the multinomial logit (MNL) choice model behind assortment optimization and revenue management. Its selection probabilities have the form P(x∣s,B)=ev(s,x)/∑y∈Bev(s,y)P(x\mid s,B) = e^{v(s,x)}/\sum_{y\in B} e^{v(s,y)}P(x∣s,B)=ev(s,x)/∑y∈B​ev(s,y). Daniel McFadden's 1974 chapter Conditional Logit Analysis of Qualitative Choice Behavior gave the model two behavioural foundations, one of which is the subject of this mission: the logit form is a consequence of a single axiom on how choice probabilities change when the set of available alternatives changes.

That axiom is Luce's choice axiom, which McFadden calls Independence of Irrelevant Alternatives (IIA): the relative odds of choosing one alternative over another do not depend on which other alternatives are present. Luce (1959) introduced it; McFadden (1974, §I) showed how, together with positivity and a mild condition on which alternative sets can occur, it yields the conditional logit form with a "utility indicator" v(s,x)v(s,x)v(s,x) shared by all alternative sets.

Timeline. Luce, Individual Choice Behavior (1959): the choice axiom and its ratio-scale representation. McFadden (1974, pp. 109–110): the derivation in the econometric setting with measured attributes sss, the binary-odds identities (5)–(10), and footnote 3, which removes an extra axiom (Axiom 3) by a universal benchmark alternative. McFadden (1974, pp. 111–112): the companion random-utility characterization by extreme-value shocks, treated in mission 2 of this series.

Setting

Let XXX be the universe of objects of choice and SSS the universe of vectors of measured attributes of decision-makers. An alternative set is a finite set B⊆XB\subseteq XB⊆X; a designated family of finite sets is the family of possible alternative sets. The selection probability P(x∣s,B)P(x\mid s,B)P(x∣s,B) is the probability that an individual drawn at random from the population, with attributes sss and facing BBB, chooses x∈Bx\in Bx∈B. For every sss and possible BBB, x↦P(x∣s,B)x\mapsto P(x\mid s,B)x↦P(x∣s,B) is a probability vector on BBB. Whenever x≠yx\neq yx=y belong to a possible set, the pair {x,y}\{x,y\}{x,y} is possible too, so binary choices are defined.

  • Axiom 1 (IIA). For all possible BBB, all sss and all x,y∈Bx,y\in Bx,y∈B: P(x∣s,{x,y})P(y∣s,B)=P(y∣s,{x,y})P(x∣s,B)P(x\mid s,\{x,y\})P(y\mid s,B) = P(y\mid s,\{x,y\})P(x\mid s,B)P(x∣s,{x,y})P(y∣s,B)=P(y∣s,{x,y})P(x∣s,B).
  • Axiom 2 (Positivity). P(x∣s,B)>0P(x\mid s,B)>0P(x∣s,B)>0 for all possible BBB, all sss, all x∈Bx\in Bx∈B.
  • Binary probabilities. pxy=P(x∣s,{x,y})p_{xy}=P(x\mid s,\{x,y\})pxy​=P(x∣s,{x,y}) for x≠yx\neq yx=y, and pxx=12p_{xx}=\tfrac12pxx​=21​ by definition.
  • The function VVV. V(s,x,z)=log⁡(pxz/pzx)V(s,x,z)=\log(p_{xz}/p_{zx})V(s,x,z)=log(pxz​/pzx​).
  • Universal benchmark. An alternative zzz such that B∪{z}B\cup\{z\}B∪{z} is possible whenever BBB is.

In Lean these are IsSelectionProb, PairsPossible, Axiom1, Axiom2, binProb, altSetV and IsUniversalBenchmark in the namespace McFadden1974.IIA.

Formalization targets

Goal: footnote 3 with Equation (12)

Under Axioms 1 and 2 and a universal benchmark zzz, with v(s,x)=V(s,x,z)v(s,x)=V(s,x,z)v(s,x)=V(s,x,z), for every sss, every possible BBB (containing zzz or not) and every x∈Bx\in Bx∈B:

P(x∣s,B)=ev(s,x)∑y∈Bev(s,y).P(x\mid s,B) = \frac{e^{v(s,x)}}{\sum_{y\in B} e^{v(s,y)}}.P(x∣s,B)=∑y∈B​ev(s,y)ev(s,x)​.

The function vvv is the same for all alternative sets; this is what distinguishes the goal from Equation (10).

Milestones, in the paper's order

  1. Equation (5): for x≠yx\neq yx=y in BBB with P(x∣s,B)>0P(x\mid s,B)>0P(x∣s,B)>0, Axiom 1 gives P(x∣s,{x,y})>0P(x\mid s,\{x,y\})>0P(x∣s,{x,y})>0 and P(y∣s,{x,y})P(x∣s,{x,y})=P(y∣s,B)P(x∣s,B)\dfrac{P(y\mid s,\{x,y\})}{P(x\mid s,\{x,y\})}=\dfrac{P(y\mid s,B)}{P(x\mid s,B)}P(x∣s,{x,y})P(y∣s,{x,y})​=P(x∣s,B)P(y∣s,B)​.
  2. Equations (6)–(7): P(y∣s,B)=pyxpxyP(x∣s,B)P(y\mid s,B)=\dfrac{p_{yx}}{p_{xy}}P(x\mid s,B)P(y∣s,B)=pxy​pyx​​P(x∣s,B) and 1=(∑y∈Bpyxpxy)P(x∣s,B)1=\Big(\sum_{y\in B}\dfrac{p_{yx}}{p_{xy}}\Big)P(x\mid s,B)1=(∑y∈B​pxy​pyx​​)P(x∣s,B).
  3. Equation (8): P(x∣s,B)=1/∑y∈B(pyx/pxy)P(x\mid s,B)=1\big/\sum_{y\in B}(p_{yx}/p_{xy})P(x∣s,B)=1/∑y∈B​(pyx​/pxy​).
  4. Equation (9): pyxpxy=pyz/pzypxz/pzx\dfrac{p_{yx}}{p_{xy}}=\dfrac{p_{yz}/p_{zy}}{p_{xz}/p_{zx}}pxy​pyx​​=pxz​/pzx​pyz​/pzy​​ for x,y,zx,y,zx,y,z in a possible set.
  5. Equation (10): for a benchmark z∈Bz\in Bz∈B, P(x∣s,B)=eV(s,x,z)/∑y∈BeV(s,y,z)P(x\mid s,B)=e^{V(s,x,z)}\big/\sum_{y\in B}e^{V(s,y,z)}P(x∣s,B)=eV(s,x,z)/∑y∈B​eV(s,y,z).

Significance

The result. The goal identifies a testable axiom on choice probabilities, IIA, with a parametric functional form, the conditional logit model. It is what licenses the econometric specification v(s,x)=θ′z(s,x)v(s,x)=\theta'z(s,x)v(s,x)=θ′z(s,x) estimated in the rest of McFadden's chapter, and it is the reason the MNL model is the default in assortment and pricing problems in operations research. It also makes the model's limitations precise: any population whose choices violate IIA (the auto/red-bus/blue-bus example on p. 113 of the chapter) cannot be logit.

Formalizing it. The result is classical and proved on paper. No machine-checked statement of it exists on the platform, which has the logit form only as a definition (soft-max, MNL revenue) and IIA only in Arrow's social-choice sense, a different axiom about preference aggregation. This mission produces a formal statement of the derivation with every standing assumption explicit, including two the paper leaves implicit: that selection probabilities are normalized on binary sets, and that binary subsets of possible sets are possible.

Difficulty

The algebra is elementary; the difficulty is bookkeeping of where each axiom may be applied. Axioms 1 and 2 are assumed only on possible alternative sets. Equation (10) needs the benchmark to lie in the alternative set, and the naive argument "pick z∈Bz\in Bz∈B as benchmark" produces a function V(s,x,z)V(s,x,z)V(s,x,z) that depends on the set through the choice of zzz. The goal requires a single vvv for all sets, including sets that do not contain zzz, where neither Equation (10) nor the axioms on BBB alone say anything about zzz. A second subtlety is the diagonal: {x,x}={x}\{x,x\}=\{x\}{x,x}={x}, so pxxp_{xx}pxx​ is set to 12\tfrac1221​ by definition rather than read off a singleton choice.

Formalization scope

Alternatives form a type X with decidable equality, alternative sets are Finset X, possible sets are a Set (Finset X), and selection probabilities are a real-valued function P : S → Finset X → X → ℝ. Only values P s B x with x ∈ B and B possible are constrained; no statement depends on the others. binProb sets the diagonal to 1/2. altSetV uses Real.log, which is 0 on non-positive arguments; under Axiom 2 on the binary sets its argument is always positive where it is used.

The probability-vector hypothesis on every possible set, binary sets included, is part of every statement: without it the zero function satisfies Axiom 1 vacuously and Equations (7)–(8) fail. The goal is stated with the explicit v(s,x)=V(s,x,z)v(s,x)=V(s,x,z)v(s,x)=V(s,x,z), never as "for each BBB there is a vvv", which would only restate (10).

Nothing beyond Mathlib's finite sums, Real.exp and Real.log is needed. Proofs of the milestones and of the goal are welcome, as is a formal statement of the auto/bus example or of the converse (logit selection probabilities satisfy Axioms 1 and 2).

Selected references

  • D. McFadden, Conditional logit analysis of qualitative choice behavior, in P. Zarembka (ed.), Frontiers in Econometrics, Academic Press, New York, 1974, pp. 105–142. https://eml.berkeley.edu/reprints/mcfadden/zarembka.pdf
  • R. D. Luce, Individual Choice Behavior: A Theoretical Analysis, Wiley, New York, 1959. https://doi.org/10.1037/14396-000
7 thms2 active usersReviewed
PreviousNext

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me