Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Operations Research

2,210 missions · 1,106 completed

The discipline of applying mathematical analysis to complex decision problems in operations: allocating scarce resources, scheduling, routing, inventory, and the design of service and production systems. Drawing on mathematical programming, stochastic modeling, queueing, simulation, and game-theoretic reasoning, it seeks policies that perform provably well in systems shaped by constraints, congestion, and uncertainty.

Missions

Open1104Completed1106All2210
🏆Completed
OptimizationTheoretical Computer Science·Captain: mikedeng1

A Simple Forward Algorithm to Solve General Dynamic Lot Sizing Models with n Periods in O(n log n) or O(n) Time: Minimal Optimal Predecessor Lists Are Characterized by Strictly Increasing BreakpointsResearch Paper

Motivation

The dynamic lot size model asks when, and how much, to order of a single item over a planning horizon of nnn periods with known, time-varying demands, setup costs, unit order costs and holding costs. It is the textbook model of production planning and the building block of material requirements planning, multi-item scheduling and many decomposition schemes for larger supply-chain problems.

Wagner and Whitin (1958) showed that some optimal policy orders only when inventory is zero, which turns the problem into a shortest-path recursion with O(n2)O(n^2)O(n2) running time. For more than thirty years this was the standard algorithm. In 1991 three groups independently reduced the complexity: Federgruen and Tzur (Management Science 37(8), 1991), Wagelmans, van Hoesel and Kolen (Operations Research 40, 1992) and Aggarwal and Park (Operations Research 41, 1993). Each obtained O(nlog⁡n)O(n \log n)O(nlogn) in general and O(n)O(n)O(n) under special cost structures. The Federgruen–Tzur algorithm is a forward algorithm: at iteration jjj it keeps a short list of periods that could still be the best last setup period for some future horizon, and updates it by local tests on neighbouring entries. This mission formalizes the theorem that justifies those tests.

Setting

For periods i=1,2,…i = 1, 2, \dotsi=1,2,… let did_idi​ be the demand, KiK_iKi​ the setup cost, cic_ici​ the variable per unit order cost and hih_ihi​ the cost of carrying a unit of inventory at the end of period iii. Write D(i)=∑k=1idkD(i) = \sum_{k=1}^{i} d_kD(i)=∑k=1i​dk​ and H(i)=∑k=1ihkH(i) = \sum_{k=1}^{i} h_kH(i)=∑k=1i​hk​, so D(0)=H(0)=0D(0) = H(0) = 0D(0)=H(0)=0. For i<ji < ji<j let cij=ci+hi+⋯+hj−1c_{ij} = c_i + h_i + \dots + h_{j-1}cij​=ci​+hi​+⋯+hj−1​, let C~(i)=ci−H(i−1)\tilde C(i) = c_i - H(i-1)C~(i)=ci​−H(i−1), and let

S(i,j)=∑r=ij−1hr (D(j)−D(r))S(i, j) = \sum_{r=i}^{j-1} h_r\,\bigl(D(j) - D(r)\bigr)S(i,j)=r=i∑j−1​hr​(D(j)−D(r))

be the carrying cost of an order placed in period iii that covers the demands of periods i,…,ji, \dots, ji,…,j.

The costs are given by the zero-inventory recursion (2): F(0)=0F(0) = 0F(0)=0 and, for 1≤l≤t1 \le l \le t1≤l≤t,

F(l,t)=F(l−1)+Kl+S(l,t)+cl [D(t)−D(l−1)],F(t)=min⁡1≤l≤tF(l,t).F(l, t) = F(l-1) + K_l + S(l, t) + c_l\,[D(t) - D(l-1)], \qquad F(t) = \min_{1 \le l \le t} F(l, t).F(l,t)=F(l−1)+Kl​+S(l,t)+cl​[D(t)−D(l−1)],F(t)=1≤l≤tmin​F(l,t).

F(l,t)F(l, t)F(l,t) is the cost of the first ttt periods when the last setup is in period lll.

For two periods k<lk < lk<l the difference Δk,l(t)=F(k,t)−F(l,t)\Delta_{k,l}(t) = F(k,t) - F(l,t)Δk,l​(t)=F(k,t)−F(l,t) is affine in D(t)D(t)D(t), with intercept A(k,l)A(k,l)A(k,l) given by (4) and slope ck,l−cl=C~(k)−C~(l)c_{k,l} - c_l = \tilde C(k) - \tilde C(l)ck,l​−cl​=C~(k)−C~(l). Its root G(k,l)G(k,l)G(k,l) is defined by (5): A(k,l)/(C~(l)−C~(k))A(k,l)/(\tilde C(l) - \tilde C(k))A(k,l)/(C~(l)−C~(k)) when the slopes differ, and +∞+\infty+∞ or −∞-\infty−∞ according to the sign of A(k,l)A(k,l)A(k,l) when they agree. It is extended symmetrically, G(l,k)=G(k,l)G(l,k) = G(k,l)G(l,k)=G(k,l).

At iteration jjj the future demands are unknown, so a future horizon has a potential cumulative demand x≥D(j)x \ge D(j)x≥D(j). The jjjth Minimal Optimal Predecessors list Ω(j)\Omega(j)Ω(j) is the set of periods l≤jl \le jl≤j that are the lowest-index optimal last setup period, among {1,…,j}\{1, \dots, j\}{1,…,j}, for every potential cumulative demand in some open interval above D(j)D(j)D(j).

Formalization targets

Goal: Theorem 1(a)

Let j≥1j \ge 1j≥1 and let S={i1,…,ir}S = \{i_1, \dots, i_r\}S={i1​,…,ir​} with Ω(j)⊆S⊆{1,…,j}\Omega(j) \subseteq S \subseteq \{1, \dots, j\}Ω(j)⊆S⊆{1,…,j}, ranked so that C~(i1)≥⋯≥C~(ir)\tilde C(i_1) \ge \dots \ge \tilde C(i_r)C~(i1​)≥⋯≥C~(ir​), with equal C~\tilde CC~-values in ascending order of index. Put g(1)=D(j)g(1) = D(j)g(1)=D(j) and g(l)=G(il,il−1)g(l) = G(i_l, i_{l-1})g(l)=G(il​,il−1​) for l=2,…,rl = 2, \dots, rl=2,…,r. Then

S=Ω(j)  ⟺  g(1)<g(2)<⋯<g(r)<∞.(6)S = \Omega(j) \iff g(1) < g(2) < \dots < g(r) < \infty. \tag{6}S=Ω(j)⟺g(1)<g(2)<⋯<g(r)<∞.(6)

Milestones

In attack order:

  • identity (1a) for the carrying costs;
  • Lemma 2(a)–(d), the linearity of Δk,l\Delta_{k,l}Δk,l​ and the sign test against its root G(k,l)G(k,l)G(k,l);
  • the claim that Ω(j)\Omega(j)Ω(j) contains an optimal last setup period for the horizon jjj;
  • the strict chains (7)–(8) of the Appendix;
  • Theorem 1(b), that under (6) the first entry i1i_1i1​ is an optimal last setup period l(j)l(j)l(j);
  • Theorem 1(c)(i)–(iii), the three elimination rules: g(2)≤D(j)g(2) \le D(j)g(2)≤D(j) removes i1i_1i1​, g(k+1)≤g(k)g(k+1) \le g(k)g(k+1)≤g(k) removes iki_kik​, and g(r)=∞g(r) = \inftyg(r)=∞ removes iri_rir​.

A supporting item potCost_spec certifies that the potential costs used to define Ω(j)\Omega(j)Ω(j) agree with the paper's F(l,t)F(l,t)F(l,t), up to a term that does not depend on lll.

Significance

Theorem 1 is what makes the forward algorithm correct. Part (a) reduces the minimality of a candidate list to a condition on consecutive pairs of a sorted list. Part (c) says which entry to delete when the condition fails. Part (b) says where to read off the optimal last setup period. With these, Ω(j)\Omega(j)Ω(j) is maintained by deletions at the ends and in the interior of a list ordered by C~\tilde CC~, and each period is inserted and deleted at most once; the O(nlog⁡n)O(n \log n)O(nlogn) bound, and the O(n)O(n)O(n) bound under the paper's special cost structures, follow from this bookkeeping. The same lower-envelope reasoning appears in the other 1991–1993 algorithms and in later extensions to backlogging and capacitated variants.

The result has a complete published proof. To our knowledge there is no machine-checked development of the Wagner–Whitin recursion or of any of the fast lot-sizing algorithms. This mission produces the model, the breakpoints and the Minimal Optimal Predecessors lists as reusable definitions, and a checked proof of the characterization. It also records two small corrections that a formal reading forces on the printed text (see Formalization scope).

Difficulty

Each piece in isolation is elementary algebra on affine functions. The difficulty is in the combinatorics of the lower envelope with ties. The natural argument "consecutive breakpoints increase, so each line owns an interval" must handle three things:

  • equal slopes, where G=±∞G = \pm\inftyG=±∞;
  • several lines meeting at one point;
  • the lowest-index tie-breaking that makes Ω(j)\Omega(j)Ω(j) minimal.

The "only if" direction needs every failure of (6) to be traced to an element that is never the unique lowest-index optimum on an interval. Ties are exactly where the printed definition of Ω(j)\Omega(j)Ω(j), read literally at a single demand value, breaks the theorem. A proof that ignores ties proves a statement that is false.

Formalization scope

  • Data and costs. The data are four functions N→R\mathbb N \to \mathbb RN→R bundled in a structure; values at index 000 are unused, and no sign conditions are imposed. FFF is defined by the recursion (2) with F(0)=0F(0) = 0F(0)=0. Its identification with the minimum cost over all feasible policies is the paper's Lemma 1 (Wagner–Whitin), which is not part of this mission. The horizon nnn is not a parameter.
  • Breakpoints. GGG and the critical values g(⋅)g(\cdot)g(⋅) take values in EReal, so ±∞\pm\infty±∞ are kept distinct from every real number. The final "<∞< \infty<∞" of (6) is part of the condition.
  • Ranked lists. A ranked set is a duplicate-free List ℕ. Lean lists are 0-based, so the paper's im+1i_{m+1}im+1​ and g(m+1)g(m+1)g(m+1) are entry mmm and gval j L m.
  • Disclosed change 1, Ω(j)\Omega(j)Ω(j). The page asks for a single potential cumulative demand D≥D(j)D \ge D(j)D≥D(j) at which lll is the lowest-index optimum. With that reading, Theorem 1(a) "only if" and Theorem 1(c) fail when two lines tie exactly at a breakpoint (an explicit five-period instance is in the definition's note). The formalization requires lll to be the lowest-index optimum on a nondegenerate open interval of potential demands above D(j)D(j)D(j). This is the paper's own description of the list on p. 915: "the unique optimal last setup period for any horizon … with potential cumulative demand g(k)<D<g(k+1)g(k) < D < g(k+1)g(k)<D<g(k+1)".
  • Disclosed change 2, Lemma 2(d). The printed hypothesis "ck,l<clc_{k,l} < c_lck,l​<cl​" duplicates part (c) and is read as "ck,l=clc_{k,l} = c_lck,l​=cl​". The equivalence "Δk,l≥0\Delta_{k,l} \ge 0Δk,l​≥0 iff D(t)≥G(k,l)D(t) \ge G(k,l)D(t)≥G(k,l)" is stated under A(k,l)≠0A(k,l) \ne 0A(k,l)=0, since A(k,l)=0A(k,l) = 0A(k,l)=0 gives G=+∞G = +\inftyG=+∞ by (5).
  • Ruling out trivial formalizations. The hypotheses of the goal are satisfiable for every j≥1j \ge 1j≥1: rank {1,…,j}\{1, \dots, j\}{1,…,j} itself. Ω(j)\Omega(j)Ω(j) is nonempty (a milestone). F(t)F(t)F(t) for t≥1t \ge 1t≥1 is a minimum over the nonempty set {1,…,t}\{1, \dots, t\}{1,…,t}, never a default value. GGG is never replaced by a real-valued junk value at equal slopes.
  • Out of scope. Lemma 1, Lemma 3, Corollaries 1–5, Theorem 2, the Algorithm's pseudo-code and its complexity analysis, and the submodularity discussion of §5.
  • Reusable infrastructure. The model, the recursion (2), AAA, GGG and Ω(j)\Omega(j)Ω(j) can be reused for the paper's algorithmic results and for related lot-sizing papers. Proofs of the milestones, in any order, are welcome.

Selected references

  • A. Federgruen and M. Tzur, A Simple Forward Algorithm to Solve General Dynamic Lot Sizing Models with n Periods in O(n log n) or O(n) Time, Management Science 37(8):909–925, 1991. https://doi.org/10.1287/mnsc.37.8.909
  • H. M. Wagner and T. M. Whitin, Dynamic Version of the Economic Lot Size Model, Management Science 5(1):89–96, 1958. https://doi.org/10.1287/mnsc.5.1.89
  • A. Wagelmans, S. van Hoesel and A. Kolen, Economic Lot-Sizing: An O(n log n) Algorithm That Runs in Linear Time in the Wagner-Whitin Case, Operations Research 40(1-supplement-1):S145–S156, 1992. https://doi.org/10.1287/opre.40.1.S145
  • A. Aggarwal and J. K. Park, Improved Algorithms for Economic Lot Size Problems, Operations Research 41(3):549–571, 1993. https://doi.org/10.1287/opre.41.3.549
16 thms3 active usersReviewed
🏆Completed
OptimizationStochastic Systems·Captain: mikedeng1

An Efficient Algorithm for Computing an Optimal (r, Q) Policy in Continuous Review Stochastic Inventory Systems: Algorithm OPT Returns an Optimal Reorder Point and Order QuantityResearch Paper

Motivation

(r, Q) policies are the standard replenishment rule for a single item under continuous review: whenever the inventory position (stock on hand plus on order minus backorders) drops to the reorder point rrr, an order of size QQQ is placed. They are known to be optimal in the classical models with Poisson or compound renewal demand, constant or exogenous lead times and full backlogging, and they are used widely in practice and in multi-item and multi-echelon systems where they are applied item by item.

For decades, computing an optimal pair (r,Q)(r, Q)(r,Q) exactly was not routine. The textbook treatment of Hadley and Whitin (1963) gives approximations; as Browne and Zipkin (1991) put it, "until recently, there was no reliable, straightforward method for computing an optimal (r, Q) policy, even in the simple case of Poisson demand processes." Many heuristics were proposed (surveyed by Lee and Nahmias, 1989); the only exact procedure in circulation was in Zipkin's classnotes, based on a result of Sahin (1982).

Federgruen and Zheng (1992) give a short exact algorithm, Algorithm OPT, whose work is linear in the optimal order quantity Q∗Q^*Q∗. It rests only on the form of the cost, not on a particular demand model.

Setting

Inventory positions are integers (demand arrives unit by unit). A fixed cost κ>0\kappa>0κ>0 is charged per order, and G:Z→RG:\mathbb Z\to\mathbb RG:Z→R is the expected holding and backlogging cost rate as a function of the inventory position yyy. In all the models of the paper the long-run average cost of the (r,Q)(r,Q)(r,Q) policy, for an integer rrr and an integer Q≥1Q\ge1Q≥1, has the form

C(r,Q)=[κ+∑y=r+1r+QG(y)]/Q.(1)C(r,Q)=\Big[\kappa+\sum_{y=r+1}^{r+Q}G(y)\Big]\Big/Q. \tag{1}C(r,Q)=[κ+y=r+1∑r+Q​G(y)]/Q.(1)

The paper's standing assumptions on GGG are:

  1. −G-G−G is unimodal: there is an integer mmm with GGG nonincreasing on {y≤m}\{y\le m\}{y≤m} and nondecreasing on {y≥m}\{y\ge m\}{y≥m} (flat stretches allowed);
  2. lim⁡∣y∣→∞G(y)=∞\lim_{|y|\to\infty}G(y)=\inftylim∣y∣→∞​G(y)=∞.

The sequence yQy_QyQ​. Let y1y_1y1​ be an integer minimizing GGG. Given y1,…,yQy_1,\dots,y_Qy1​,…,yQ​, let L(Q)=min⁡{y1,…,yQ}L(Q)=\min\{y_1,\dots,y_Q\}L(Q)=min{y1​,…,yQ​} and R(Q)=max⁡{y1,…,yQ}R(Q)=\max\{y_1,\dots,y_Q\}R(Q)=max{y1​,…,yQ​}, and set

yQ+1={L(Q)−1if G(L(Q)−1)≤G(R(Q)+1),R(Q)+1otherwise.y_{Q+1}=\begin{cases}L(Q)-1 & \text{if } G(L(Q)-1)\le G(R(Q)+1),\\ R(Q)+1 & \text{otherwise.}\end{cases}yQ+1​={L(Q)−1R(Q)+1​if G(L(Q)−1)≤G(R(Q)+1),otherwise.​

So the window [L(Q),R(Q)][L(Q),R(Q)][L(Q),R(Q)] grows by one point at a time towards the smaller neighbouring value, ties going left. Write r∗(Q)r^*(Q)r∗(Q) for an optimal reorder point for a given QQQ, and

C∗(Q)=[κ+∑i=1QG(yi)]/Q.C^*(Q)=\Big[\kappa+\sum_{i=1}^{Q}G(y_i)\Big]\Big/Q .C∗(Q)=[κ+i=1∑Q​G(yi​)]/Q.

Algorithm OPT, Step 1. Variables S,Q,C∗,r,RS,Q,C^*,r,RS,Q,C∗,r,R start at S=κ+G(y1)S=\kappa+G(y_1)S=κ+G(y1​), Q=1Q=1Q=1, C∗=SC^*=SC∗=S, r=y1−1r=y_1-1r=y1​−1, R=y1+1R=y_1+1R=y1​+1. Each pass compares G(r)G(r)G(r) and G(R)G(R)G(R); on the smaller side (left on ties) it stops if C∗C^*C∗ is at most that value, and otherwise adds the value to SSS and moves rrr one step left or RRR one step right; then Q:=Q+1Q:=Q+1Q:=Q+1 and C∗:=S/QC^*:=S/QC∗:=S/Q. The output is the final (r,Q)(r,Q)(r,Q).

Formalization targets

Goal: Theorem 1

Under the standing assumptions, Step 1 of Algorithm OPT, started from any global minimizer y1y_1y1​ of GGG, stops after finitely many passes, and its output (r,Q)(r,Q)(r,Q) satisfies Q≥1Q\ge1Q≥1 and

C(r,Q)≤C(r′,Q′)for all integers r′ and all integers Q′≥1.C(r,Q)\le C(r',Q')\qquad\text{for all integers } r' \text{ and all integers } Q'\ge 1 .C(r,Q)≤C(r′,Q′)for all integers r′ and all integers Q′≥1.

The goal fixes no constants and no demand model: it is a statement about every GGG satisfying the standing assumptions.

Milestones, in proof order

  • §2, p. 811: {y1,…,yQ}\{y_1,\dots,y_Q\}{y1​,…,yQ​} is the contiguous block [L(Q),R(Q)][L(Q),R(Q)][L(Q),R(Q)] of QQQ integers and carries the QQQ smallest values of GGG.
  • Figure 1 (p. 809): yQ+1y_{Q+1}yQ+1​ has the least GGG-value outside the window; in particular G(y1)≤G(y2)≤⋯G(y_1)\le G(y_2)\le\cdotsG(y1​)≤G(y2​)≤⋯.
  • Lemma 1: L(Q)−1L(Q)-1L(Q)−1 is an optimal reorder point for QQQ.
  • Corollary 1: r∗(Q)−1≤r∗(Q+1)≤r∗(Q)r^*(Q)-1\le r^*(Q+1)\le r^*(Q)r∗(Q)−1≤r∗(Q+1)≤r∗(Q).
  • Display before (6): min⁡rC(r,Q)=C∗(Q)\min_r C(r,Q)=C^*(Q)minr​C(r,Q)=C∗(Q).
  • (6): C∗(Q+1)=[QC∗(Q)+G(yQ+1)]/(Q+1)C^*(Q+1)=[QC^*(Q)+G(y_{Q+1})]/(Q+1)C∗(Q+1)=[QC∗(Q)+G(yQ+1​)]/(Q+1), and C∗(Q+1)<C∗(Q)C^*(Q+1)<C^*(Q)C∗(Q+1)<C∗(Q) iff G(yQ+1)<C∗(Q)G(y_{Q+1})<C^*(Q)G(yQ+1​)<C∗(Q).
  • Lemma 2: the smallest qqq with C∗(q)≤G(yq+1)C^*(q)\le G(y_{q+1})C∗(q)≤G(yq+1​) exists and is an optimal order size.
  • Step 1 tracks the sequence: from the state (κ+∑i≤QG(yi), Q, C∗(Q), L(Q)−1, R(Q)+1)(\kappa+\sum_{i\le Q}G(y_i),\,Q,\,C^*(Q),\,L(Q)-1,\,R(Q)+1)(κ+∑i≤Q​G(yi​),Q,C∗(Q),L(Q)−1,R(Q)+1) one pass stops with (L(Q)−1,Q)(L(Q)-1,Q)(L(Q)−1,Q) exactly when C∗(Q)≤G(yQ+1)C^*(Q)\le G(y_{Q+1})C∗(Q)≤G(yQ+1​) and otherwise moves to the same state for Q+1Q+1Q+1.

Significance

The result turns the joint minimization of (1) over (r,Q)∈Z×Z≥1(r,Q)\in\mathbb Z\times\mathbb Z_{\ge1}(r,Q)∈Z×Z≥1​, an unbounded two-dimensional integer problem, into a single scan whose length is Q∗Q^*Q∗ plus the distance to the minimizer of GGG. Because it uses only the form (1) and the unimodality of −G-G−G, it applies at once to Poisson and compound Poisson demand, to stochastic lead times with an equilibrium lead-time demand, and to cost structures with stockout penalties; the paper also notes extensions to (r,nQ)(r,nQ)(r,nQ) policies. Lemma 1 and Corollary 1 additionally give the structure of the optimal reorder point as a function of QQQ.

The result has been proved on paper since 1992. What this mission adds is a machine-checked proof of the algorithm's correctness for general GGG under exactly the paper's hypotheses. The platform already has the linear-cost special case of the underlying lemmas for one discrete demand model (InventoryControl.rq_discrete_recursion, rq_discrete_joint_optimal), but with C(Q)C(Q)C(Q) and Q∗Q^*Q∗ given as hypotheses and no algorithm; nothing on the platform states the algorithm or treats general unimodal −G-G−G.

Difficulty

The obvious argument says: for fixed QQQ the sum in (1) should cover the QQQ smallest values of GGG, and the greedy window collects exactly those. Both halves need care on the integers with flat stretches of GGG: "the QQQ smallest values" is ambiguous under ties, and the claim that a greedy window holds them relies on y1y_1y1​ being a global minimizer together with the unimodality of −G-G−G, not on convexity.

The stopping rule is the second point. Lemma 2 looks like a first-order condition, but C∗(⋅)C^*(\cdot)C∗(⋅) need not be convex; optimality of the first stopping qqq for all larger QQQ uses that the values G(yi)G(y_i)G(yi​) are nondecreasing along the sequence, which the paper uses without stating. Termination of the algorithm is not discussed on the page; it needs G→∞G\to\inftyG→∞, and fails for constant GGG.

Finally, the goal is about an imperative loop. Connecting its five variables to yQy_QyQ​, C∗(Q)C^*(Q)C∗(Q) and L(Q)L(Q)L(Q) is an invariant argument that has to match the tie-breaking and the non-strict stopping tests exactly.

Formalization scope

  • Types. G:Z→RG:\mathbb Z\to\mathbb RG:Z→R, κ∈R\kappa\in\mathbb Rκ∈R with κ>0\kappa>0κ>0, reorder points in Z\mathbb ZZ, order quantities in N\mathbb NN with Q≥1Q\ge1Q≥1 required wherever a cost appears. Lean's x/0=0x/0=0x/0=0 makes C(r,0)=0C(r,0)=0C(r,0)=0, so optimality is always quantified over Q′≥1Q'\ge1Q′≥1 and the goal asserts that the returned QQQ is ≥1\ge1≥1.
  • Assumptions. "−G-G−G unimodal" is NegUnimodal G: ∃m\exists m∃m, GGG antitone on (−∞,m](-\infty,m](−∞,m] and monotone on [m,∞)[m,\infty)[m,∞). "lim⁡∣y∣→∞G=∞\lim_{|y|\to\infty}G=\inftylim∣y∣→∞​G=∞" is Coercive G: G→+∞G\to+\inftyG→+∞ along atBot and atTop. Mathlib's QuasiconvexOn ℤ is not used: over Z\mathbb ZZ-weights it holds for every function.
  • The sequence. L(Q),R(Q)L(Q),R(Q)L(Q),R(Q) are defined by recursion on the window, and yyy is 1-based with an unused value at index 0; that L,RL,RL,R are the minimum and maximum of {y1,…,yQ}\{y_1,\dots,y_Q\}{y1​,…,yQ​}, as the paper defines them, is the first milestone.
  • The algorithm. Step 1 is transcribed literally, including G(r)≤G(R)G(r)\le G(R)G(r)≤G(R) → left and the non-strict tests C∗≤G(r)C^*\le G(r)C∗≤G(r), C∗≤G(R)C^*\le G(R)C∗≤G(R); GGG is evaluated directly instead of through the ΔG\Delta GΔG bookkeeping. The loop runs with a pass budget and returns nothing when the budget runs out; the goal states that for every large enough budget it returns an optimal pair.
  • Step 0 is not formalized. It scans L=0,1,…L=0,1,\dotsL=0,1,… for the first LLL with ΔG(L)≥0\Delta G(L)\ge0ΔG(L)≥0, under the paper's simplification y1>0y_1>0y1​>0; under unimodality alone it can stop on a plateau before the minimum. The goal starts Step 1 from a given global minimizer y1y_1y1​, which is the paper's own §2 setup and matches its p. 812 remark that Step 0 may be replaced by a bisection search.
  • Not formalized: Theorem 1's second sentence (the operation count), the derivations of (1) for specific demand models, and (5).
  • Corrected slips. The printed proof of Lemma 2 writes C(Q)−C(Q∗)C(Q)-C(Q^*)C(Q)−C(Q∗) with C∗(Q)C^*(Q)C∗(Q) inside the bracket; the correct identity has C∗(Q)−C∗(Q∗)C^*(Q)-C^*(Q^*)C∗(Q)−C∗(Q∗) and C∗(Q∗)C^*(Q^*)C∗(Q∗). Lemma 2's "Q∗Q^*Q∗" is formalized as existence of the smallest qqq with the property plus its optimality, since minimizers need not be unique; likewise "r∗(Q)=L(Q)−1r^*(Q)=L(Q)-1r∗(Q)=L(Q)−1" means L(Q)−1L(Q)-1L(Q)−1 is an optimal reorder point.
  • Ruled out. Defining the algorithm's output as an argmin of CCC, or by searching for Lemma 2's qqq, would make the goal trivial; the algorithm is defined by its steps. A statement of the form "if the run returns a pair, it is optimal" would be vacuous for a loop that never stops; termination is part of the goal.

Proofs of any milestone are welcome, as are general lemmas on windows of unimodal integer sequences, which are reusable beyond this mission.

Selected references

  • A. Federgruen and Y.-S. Zheng, An Efficient Algorithm for Computing an Optimal (r, Q) Policy in Continuous Review Stochastic Inventory Systems, Operations Research 40(4):808–813, 1992. https://doi.org/10.1287/opre.40.4.808
  • G. Hadley and T. M. Whitin, Analysis of Inventory Systems, Prentice-Hall, 1963.
  • S. Browne and P. Zipkin, Inventory Models with Continuous, Stochastic Demands, Annals of Applied Probability 1(3):419–435, 1991. https://doi.org/10.1214/aoap/1177005875
  • H. L. Lee and S. Nahmias, Single-Product, Single-Location Models, in Handbooks in OR & MS vol. 4, 1993 (cited by the paper as a 1989 working paper).
  • I. Sahin, On the Objective Function Behavior in (s, S) Inventory Models, Operations Research 30(4):709–724, 1982. https://doi.org/10.1287/opre.30.4.709
10 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryMechanism DesignProbability·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 3: Order-Oblivious Posted Prices 2-Approximate the Optimal Revenue under a Uniform Matroid ConstraintResearch Paper

Motivation

Myerson's optimal auction (Myerson 1981) maximizes a seller's expected revenue when buyers have independent private values, but it is a sealed-bid mechanism: every buyer reports a value, and the allocation and payments are computed from all reports at once. Real sellers more often post prices: buyers arrive, each sees a take-it-or-leave-it price, and buys or leaves. Chawla, Hartline, Malec and Sivan (arXiv:0907.2435) ask how much revenue such simple mechanisms lose. Their strongest notion is the order-oblivious posted-price mechanism (OPM): the prices are fixed in advance, and the guarantee must hold whatever order the buyers arrive in, even an adversarial one.

The tool behind the guarantee for sellers of kkk identical units is a prophet inequality. In the single-choice version, a gambler inspects independent random rewards one at a time and must accept or reject each on the spot; Krengel and Sucheston, and Samuel-Cahn (Ann. Probab. 1984), showed that a single fixed threshold earns at least half of what a prophet who sees all rewards earns. The paper extends Samuel-Cahn's threshold rule to kkk choices (Appendix D.2) and turns it into a revenue guarantee (Theorem 10).

Setting

There are nnn agents [n][n][n]. Agent iii's value viv_ivi​ for being served is drawn independently from a distribution FiF_iFi​ with density fif_ifi​; the virtual valuation is ϕi(v)=v−(1−Fi(v))/fi(v)\phi_i(v) = v - (1 - F_i(v))/f_i(v)ϕi​(v)=v−(1−Fi​(v))/fi​(v) (Definition 1), and FiF_iFi​ is regular if ϕi\phi_iϕi​ is non-decreasing (Definition 2). The seller may serve any set of agents in a downward-closed set system J\mathcal JJ; this mission uses the kkk-uniform matroid, where a set is feasible exactly when it has at most kkk members.

A mechanism MMM maps reported values v\mathbf vv to an allocation M(v)∈JM(\mathbf v) \in \mathcal JM(v)∈J and payments πi(v)\pi_i(\mathbf v)πi​(v). It is truthful if reporting the true value is a dominant strategy and no agent ever gets negative utility. Its expected revenue is RM=Ev[∑iπi(v)]\mathcal R^M = \mathbb E_{\mathbf v}[\sum_i \pi_i(\mathbf v)]RM=Ev​[∑i​πi​(v)], and RM\mathcal R^{\mathcal M}RM denotes the revenue of Myerson's mechanism, the largest over truthful mechanisms (Theorem 19).

Given prices p\mathbf pp and values v\mathbf vv, agent iii desires service if vi≥piv_i \ge p_ivi​≥pi​. Let Sv\mathcal S_{\mathbf v}Sv​ be the class of maximal feasible sets of desiring agents. When agents arrive in an arbitrary order and each buys if it desires service and can still be feasibly served, the set of buyers lies in Sv\mathcal S_{\mathbf v}Sv​. The paper's pessimistic revenue estimate is

Rpobl=Ev∼F min⁡S∈Sv∑i∈Spi.\mathcal R^{\mathrm{obl}}_{\mathbf p} = \mathbb E_{\mathbf v \sim \mathbf F}\ \min_{S \in \mathcal S_{\mathbf v}} \sum_{i \in S} p_i .Rpobl​=Ev∼F​ S∈Sv​min​i∈S∑​pi​.

For the prophet inequality, X1,…,XnX_1, \dots, X_nX1​,…,Xn​ are independent nonnegative random variables with order statistics X(1)≥⋯≥X(n)X_{(1)} \ge \dots \ge X_{(n)}X(1)​≥⋯≥X(n)​, and (x)+=max⁡(0,x)(x)^+ = \max(0, x)(x)+=max(0,x). The threshold rule with threshold ccc picks indices t1(c),…,tk(c)t_1(c), \dots, t_k(c)t1​(c),…,tk​(c), where ti(c)t_i(c)ti​(c) is the lesser of n−k+in-k+in−k+i and the iii-th smallest index jjj with Xj≥cX_j \ge cXj​≥c (or n−k+in - k + in−k+i if there is none). The numbers a∗a^*a∗ and b∗b^*b∗ are the unique solutions of

a=∑i=1kE(X(i)−a/k)+,b=∑i=1nE(Xi−b/k)+.a = \sum_{i=1}^k \mathbb E\big(X_{(i)} - a/k\big)^+, \qquad b = \sum_{i=1}^n \mathbb E\big(X_i - b/k\big)^+ .a=i=1∑k​E(X(i)​−a/k)+,b=i=1∑n​E(Xi​−b/k)+.

Formalization targets

Goal: Theorem 10 (p. 9)

∃ p  ∀M truthful:RM≤2 Rpobl\exists\, \mathbf p\ \ \forall M \text{ truthful}:\qquad \mathcal R^M \le 2\, \mathcal R^{\mathrm{obl}}_{\mathbf p}∃p  ∀M truthful:RM≤2Rpobl​

for every instance with regular distributions and a kkk-uniform matroid constraint. The prices are chosen once, before the mechanism it is compared with; this is the paper's "Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ 2-approximates RM\mathcal R^{\mathcal M}RM".

Milestones

  1. Proposition 1 (p. 5): under regularity, the expected revenue of a truthful mechanism equals its expected virtual surplus E[∑i∈M(v)ϕi(vi)]\mathbb E[\sum_{i \in M(\mathbf v)} \phi_i(v_i)]E[∑i∈M(v)​ϕi​(vi​)] (with the lowest type receiving zero utility).
  2. a∗a^*a∗ and b∗b^*b∗ exist and are unique (App. D.2, p. 18).
  3. The claim a∗≤b∗a^* \le b^*a∗≤b∗ (App. D.2, p. 18).
  4. Theorem 24 (p. 18), the kkk-choice prophet inequality: for a∗≤kc≤b∗a^* \le k c \le b^*a∗≤kc≤b∗,
∑i=1kE[X(i)]≤2∑i=1kE[Xti(c)].\sum_{i=1}^k \mathbb E\big[X_{(i)}\big] \le 2 \sum_{i=1}^k \mathbb E\big[X_{t_i(c)}\big].i=1∑k​E[X(i)​]≤2i=1∑k​E[Xti​(c)​].

Significance

The theorem says that a seller of kkk identical units can fix one price per buyer, ignore the arrival order entirely, and still collect half of the optimal revenue. The factor 2 is tight: Appendix D.2 gives a single-item example with two buyers where no order-oblivious pricing does better. Corollary 11 extends the result to partition matroids, and Theorem 24 is reused for the graphical-matroid result (Theorem 12, App. D.3). Theorem 24 is a statement in optimal stopping independent of mechanism design, and kkk-choice prophet inequalities are now a standard tool for online allocation.

The results are proved in the paper (preprint arXiv:0907.2435v2; a conference version appeared at STOC 2010). To our knowledge none of them, nor any prophet inequality, has a machine-checked proof; Mathlib has independence of random variables but no order statistics, stopping-rule prophet inequalities, or Myerson's revenue characterization in this multi-agent dominant-strategy form. A related single-unit, Bayesian-incentive-compatible form of Proposition 1 exists on the platform (MechanismDesign.Auctions.revenue_eq_virtual_surplus), in a different model.

Difficulty

The threshold rule picks the first values above ccc, not the largest, and its picks are dependent random indices; the expectation E[Xti(c)]\mathbb E[X_{t_i(c)}]E[Xti​(c)​] does not factor. The obvious comparison of the gambler with the prophet term by term fails, because the gambler can exhaust its kkk picks on early, small values. The bound has to balance two events: either at least kkk values reach ccc, or a value is picked whenever it exceeds ccc; independence enters exactly in the second. The rule also has forced picks at the end of the sequence, which must be handled as stated.

On the mechanism side, Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ is a minimum over an adversarially chosen family, not the revenue of one run, so it cannot be read off from a single sequential mechanism. Proposition 1 needs the full revenue-equivalence argument: monotone allocations, the payment identity, and an integration by parts against the density.

Formalization scope

  • Distributions: each FiF_iFi​ has a bounded support [v‾i,v‾i][\underline v_i, \overline v_i][v​i​,vi​] with 0≤v‾i0 \le \underline v_i0≤v​i​, and a measurable density positive on it (a pinned convention; the paper says only "with density fif_ifi​"). Regularity is required on the support. The prior is the product of the marginals.
  • Mechanisms: deterministic, dominant-strategy incentive compatible and ex-post individually rational on the type space, with measurable allocation events and measurable, integrable payments. Payments of unserved agents are not forced to be zero.
  • RM\mathcal R^{\mathcal M}RM is not constructed. The goal is stated against every truthful mechanism, which by Theorem 19 is equivalent. Quantifier order matters: "for every mechanism there are prices" is a weaker statement and is not the goal.
  • Proposition 1 carries the normalization that an agent of the lowest type gets zero utility, which the paper presupposes on p. 12.
  • Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ is a genuine minimum over the finite, nonempty family Sv\mathcal S_{\mathbf v}Sv​; maximality is essential, since without it the empty set makes the estimate 000 and the goal false. Prices are arbitrary reals.
  • a∗a^*a∗ and b∗b^*b∗ are characterised by their equations as hypotheses, not defined by an infimum. Order statistics count multiplicity. Lean indices are 0-based. The threshold rule includes the page's forced picks ti(c)=n−k+it_i(c) = n - k + iti​(c)=n−k+i; it is not replaced by a pure threshold rule. Theorem 24 and the claims about a∗,b∗a^*, b^*a∗,b∗ assume 1≤k≤n1 \le k \le n1≤k≤n; the goal assumes nothing about kkk.
  • Out of scope: non-regular distributions (ironing), Corollary 11, and the p. 19 identity rewriting Rpobl\mathcal R^{\mathrm{obl}}_{\mathbf p}Rpobl​ as a sum of virtual values (a proof step, not a milestone).

Useful reusable infrastructure: order statistics and their measurability, Samuel-Cahn-type threshold rules, and Myerson's payment identity for dominant-strategy mechanisms. Proofs of any milestone, and supporting lemmas on these objects, are welcome.

Selected references

  • S. Chawla, J. D. Hartline, D. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, arXiv:0907.2435v2, 2010 (STOC 2010). https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • E. Samuel-Cahn, Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables, Annals of Probability 12(4), 1984. https://doi.org/10.1214/aop/1176993150
10 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatoricsMechanism Design+1·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 2: Sequential Posted Prices e/(e−1)-Approximate the Optimal Revenue under a Partition Matroid ConstraintResearch Paper

Motivation

A seller who knows the distributions of buyers' values can maximise expected revenue with Myerson's optimal mechanism (Myerson 1981): collect bids, compute virtual values, serve a feasible set of maximum virtual surplus, and charge threshold payments. Real sellers seldom run such auctions. They post prices: a buyer is offered a take-it-or-leave-it price and either accepts or walks away. Posted prices need no bidding, involve no competition between buyers, and are trivially truthful. The question is how much revenue they give up.

Chawla, Hartline, Malec and Sivan (arXiv:0907.2435, STOC 2010) answer this for a range of feasibility constraints with a single construction, the sequential posted-price mechanism (SPM) S\mathcal SS. For general matroids it loses at most a factor 222 (Theorem 5). For uniform and partition matroids, that is, multi-unit sales and unions of multi-unit sales, it loses at most a factor e/(e−1)≈1.58e/(e-1)\approx1.58e/(e−1)≈1.58 (Theorem 6), and the paper shows this factor is tight for its mechanism. This mission targets Theorem 6.

Timeline. Myerson (1981) characterised the optimal single-parameter mechanism. Blumrosen and Holenstein (2008) showed that the best single-unit SPM can be a factor π/2\sqrt{\pi/2}π/2​ below Myerson's revenue even with i.i.d. buyers. Chawla, Hartline and Kleinberg (EC 2007) used posted prices to approximate multi-parameter unit-demand pricing. Chawla, Hartline, Malec and Sivan (2010) gave the matroid, partition-matroid and matroid-intersection bounds. Yan (SODA 2011) explained the e/(e−1)e/(e-1)e/(e−1) factor through the correlation gap of submodular functions and sharpened it for kkk units to 1−kke−k/k!1-k^ke^{-k}/k!1−kke−k/k!.

Setting

There are nnn agents. Agent iii has a private value viv_ivi​ for being served, drawn independently from a distribution FiF_iFi​ with density fif_ifi​. The virtual value is φi(v)=v−1−Fi(v)fi(v)\varphi_i(v)=v-\frac{1-F_i(v)}{f_i(v)}φi​(v)=v−fi​(v)1−Fi​(v)​, and FiF_iFi​ is regular if φi\varphi_iφi​ is non-decreasing. The seller may serve any set in a downward-closed family J⊆2[n]\mathcal J\subseteq2^{[n]}J⊆2[n].

A partition matroid assigns each agent iii to a part part(i)\mathrm{part}(i)part(i) and each part bbb a capacity cap(b)∈N\mathrm{cap}(b)\in\mathbb Ncap(b)∈N. A set is feasible iff it contains at most cap(b)\mathrm{cap}(b)cap(b) agents of every part bbb. With one part of capacity kkk this is the kkk-uniform matroid: at most kkk agents are served.

A truthful mechanism MMM maps a value vector v\mathbf vv to a feasible set M(v)M(\mathbf v)M(v) and payments πi(v)\pi_i(\mathbf v)πi​(v). It is dominant-strategy incentive compatible and individually rational. Its expected revenue is RM=E[∑iπi(v)]\mathcal R^M=\mathbb E[\sum_i\pi_i(\mathbf v)]RM=E[∑i​πi​(v)], and qiM=Pr⁡[i∈M(v)]q^M_i=\Pr[i\in M(\mathbf v)]qiM​=Pr[i∈M(v)] is its service probability for agent iii.

The sequential posted-price mechanism S\mathcal SS built from MMM sets the price pi=Fi−1(1−qiM)p_i=F_i^{-1}(1-q^M_i)pi​=Fi−1​(1−qiM​) for agent iii, so that agent iii accepts with probability exactly qiMq^M_iqiM​. It approaches the agents one at a time in decreasing order of price (σ\sigmaσ is the ordering). It offers agent iii the price pip_ipi​ if adding iii to the agents already served keeps the set feasible. The agent accepts iff pi≤vip_i\le v_ipi​≤vi​. Its expected revenue is Rpσ\mathcal R^\sigma_{\mathbf p}Rpσ​.

Formalization targets

Goal: Theorem 6, partition matroids

For every partition matroid, every truthful MMM, and S\mathcal SS built from MMM as above,

RM≤ee−1 Rpσ.\mathcal R^M\le\frac{e}{e-1}\,\mathcal R^\sigma_{\mathbf p}.RM≤e−1e​Rpσ​.

Taking MMM to be Myerson's mechanism gives the paper's statement.

Milestones

  1. Lemma 2 (regular case): RM≤∑ipiMqiM\mathcal R^M\le\sum_ip^M_iq^M_iRM≤∑i​piM​qiM​ with piM=Fi−1(1−qiM)p^M_i=F_i^{-1}(1-q^M_i)piM​=Fi−1​(1−qiM​).
  2. Rank bound (§4): ∑i∈SqiM≤rank⁡(S)\sum_{i\in S}q^M_i\le\operatorname{rank}(S)∑i∈S​qiM​≤rank(S) for every set SSS; for a part bbb this reads ∑part(i)=bqiM≤cap(b)\sum_{\mathrm{part}(i)=b}q^M_i\le\mathrm{cap}(b)∑part(i)=b​qiM​≤cap(b).
  3. Single-unit revenue formula (App. C.2): RS=∑kckpkqk\mathcal R^{\mathcal S}=\sum_kc_kp_kq_kRS=∑k​ck​pk​qk​ with ck=∏j<k(1−qj)c_k=\prod_{j<k}(1-q_j)ck​=∏j<k​(1−qj​), positions in offer order.
  4. Lemma 20: with ppp defined by ∑kpkqk=p∑kqk\sum_kp_kq_k=p\sum_kq_k∑k​pk​qk​=p∑k​qk​ (equation (2)) and prices decreasing, p∑kckqk≤∑kckpkqkp\sum_kc_kq_k\le\sum_kc_kp_kq_kp∑k​ck​qk​≤∑k​ck​pk​qk​.
  5. Display (3): if ∑kqk=s≤1\sum_kq_k=s\le1∑k​qk​=s≤1, then p∑kckqk=p(1−∏k(1−qk))≥p(1−(1−s/n)n)≥(1−1/e)psp\sum_kc_kq_k=p(1-\prod_k(1-q_k))\ge p(1-(1-s/n)^n)\ge(1-1/e)psp∑k​ck​qk​=p(1−∏k​(1−qk​))≥p(1−(1−s/n)n)≥(1−1/e)ps.
  6. Theorem 21: the goal for the 111-uniform matroid.
  7. Theorem 22: the goal for the kkk-uniform matroid, every kkk.

Significance

The theorem shows that a mechanism with no bidding loses at most about 37%37\%37% of the optimal revenue when the constraint is a union of multi-unit supplies. That covers selling several kinds of goods, each in limited stock, to single-minded buyers. The prices are computed once from the distributions. The order is fixed before any value is seen. No agent's payment depends on another agent's report. The factor is tight for this mechanism (App. C.2), and the same template (prices from service probabilities, decreasing order) gives factor 222 for all matroids and m+1m+1m+1 for intersections of mmm matroids.

On the formal side, the paper's results are proved but none is machine-checked as far as we know. The platform has Myerson-type results for a single unit with Bayesian incentive compatibility and a common support (Börgers), and for i.i.d. buyers with a fixed number of units (Talluri and van Ryzin). Neither covers independent, non-identical buyers under a set-system constraint with dominant-strategy truthfulness. A complete development would include the ex-ante revenue bound of Lemma 2 for regular distributions, which is reusable for any posted-price or prophet-inequality argument, and the 1−1/e1-1/e1−1/e correlation-gap inequality.

Difficulty

The obvious argument compares S\mathcal SS with Myerson's mechanism one agent at a time. That fails, because S\mathcal SS may stop offering to an agent once the units of its part are gone, and the agents blocked this way can be the ones Myerson's mechanism serves. The loss has to be bounded in aggregate, using only the ex-ante constraint ∑part(i)=bqi≤cap(b)\sum_{\mathrm{part}(i)=b}q_i\le\mathrm{cap}(b)∑part(i)=b​qi​≤cap(b). The single-unit case reduces to an inequality about products ∏(1−qj)\prod(1-q_j)∏(1−qj​). For kkk units, the printed proof (pp. 15–16) is an induction that compares the run with a hypothetical single-unit instance with probabilities qi/kq_i/kqi​/k. Its second case is informal, so a formal proof needs its own argument for the kkk-unit bound. Passing from uniform to partition matroids needs the observation that with a global order the run inside each part depends only on that part's agents. Lemma 2 needs the revenue-curve concavity that regularity gives, stated through densities rather than derivatives.

Formalization scope

  • Values. Each FiF_iFi​ has a density that is measurable and strictly positive on a bounded interval [v‾i,vˉi][\underline v_i,\bar v_i][v​i​,vˉi​] with 0≤v‾i0\le\underline v_i0≤v​i​, integrates to 111 there, and has no mass outside. The paper says only "with density fif_ifi​". This pin rules out point masses, so the randomised-price variant of S\mathcal SS never arises. The prior is the product of these laws.
  • Regularity is φi\varphi_iφi​ non-decreasing on the support, assumed for every agent in the goal, as in the paper's §4 analyses. The non-regular extension (second paragraph of Lemma 2, Appendix E) is out of scope.
  • Truthful means deterministic, dominant-strategy incentive compatible over the support, ex-post individually rational, feasible, with measurable allocations and integrable payments.
  • Prices are arguments tied to MMM by pi∈[v‾i,vˉi]p_i\in[\underline v_i,\bar v_i]pi​∈[v​i​,vˉi​] and Fi(pi)=1−qiMF_i(p_i)=1-q^M_iFi​(pi​)=1−qiM​. No inverse distribution function is defined.
  • Order. The order σ\sigmaσ is a permutation with σ(0)\sigma(0)σ(0) first, decreasing in price, and ties are arbitrary. It is global across parts. Parts of capacity 000 are allowed.
  • Constant. The constant is exactly e/(e−1)e/(e-1)e/(e−1).
  • No free prices. The theorem is not stated with free or existentially chosen prices. Prices are pinned to MMM's service probabilities, and S\mathcal SS uses the same constraint as MMM. A statement in which the prices could be chosen after the fact, or in which MMM were not required to be individually rational, would be a different or false theorem.
  • Every truthful MMM. The comparison is with every truthful MMM, not with a constructed Myerson mechanism. This form is at least as strong as the paper's, and it is what the paper's proof shows.

Welcome contributions: proofs of the algebraic milestones (Lemma 20, display (3)), the revenue formula, Lemma 2 (reusable payment-identity infrastructure for dominant-strategy mechanisms), and a correlation-gap argument for kkk units.

Selected references

  • S. Chawla, J. D. Hartline, D. L. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, STOC 2010; arXiv:0907.2435v2, 2010. https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1), 1981. https://doi.org/10.1287/moor.6.1.58
  • L. Blumrosen, T. Holenstein, Posted Prices vs. Negotiations: An Asymptotic Analysis, ACM EC 2008.
  • Q. Yan, Mechanism Design via Correlation Gap, ACM-SIAM SODA 2011.
12 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryCombinatoricsMechanism Design+1·Captain: mikedeng1

Multi-parameter Mechanism Design and Sequential Posted Pricing 1: Sequential Posted Prices 2-Approximate the Optimal Revenue under a Matroid ConstraintResearch Paper

Why posted prices

A seller who must decide whom to serve among several buyers with private values can, in principle, run Myerson's revenue-optimal mechanism: collect bids, compute virtual values, serve the feasible set of largest virtual surplus, and charge threshold payments (Myerson 1981). In practice sellers rarely do this. Retail, ticketing and online platforms mostly use posted prices: each buyer is offered a take-it-or-leave-it price and accepts if and only if the price does not exceed the buyer's value. Posted prices are simple to explain, are trivially truthful, and do not require buyers to reveal their values.

Chawla, Hartline, Malec and Sivan (arXiv:0907.2435, STOC 2010) asked how much revenue is lost by this simplification, and showed that for a wide range of feasibility constraints a sequential posted-price mechanism recovers a constant fraction of the optimal revenue. The matroid case, a factor of 2, is the first and most widely cited of their results. It is a revenue analogue of the prophet inequality and was one of the starting points of the literature on "simple versus optimal" mechanisms.

Setting

There are nnn single-parameter agents, indexed by [n][n][n], and one seller. Agent iii has a private value viv_ivi​ for being served, drawn independently from a distribution FiF_iFi​ with density fif_ifi​. The virtual valuation of agent iii is

ϕi(vi)=vi−1−Fi(vi)fi(vi),\phi_i(v_i) = v_i - \frac{1 - F_i(v_i)}{f_i(v_i)},ϕi​(vi​)=vi​−fi​(vi​)1−Fi​(vi​)​,

and FiF_iFi​ is regular if ϕi\phi_iϕi​ is non-decreasing.

The seller faces a feasibility constraint: a downward-closed family J\mathcal JJ of subsets of [n][n][n], the sets of agents that can be served together. The rank of a set SSS is rank⁡(S)=max⁡S′⊆S, S′∈J∣S′∣\operatorname{rank}(S) = \max_{S' \subseteq S,\, S' \in \mathcal J} |S'|rank(S)=maxS′⊆S,S′∈J​∣S′∣. The constraint is a matroid if it satisfies the augmentation axiom: whenever A,B∈JA, B \in \mathcal JA,B∈J and ∣A∣>∣B∣|A| > |B|∣A∣>∣B∣, some e∈A∖Be \in A \setminus Be∈A∖B has B∪{e}∈JB \cup \{e\} \in \mathcal JB∪{e}∈J. Examples are kkk identical units (kkk-uniform matroids) and disjoint markets with separate capacities (partition matroids).

A mechanism MMM maps reported values v\mathbf vv to a feasible set M(v)∈JM(\mathbf v) \in \mathcal JM(v)∈J of served agents and a payment πi(v)\pi_i(\mathbf v)πi​(v) for each agent. It is truthful if reporting the true value is a dominant strategy and no agent ends with negative utility. Its expected revenue is RM=E[∑iπi(v)]\mathcal R^M = \mathbb E[\sum_i \pi_i(\mathbf v)]RM=E[∑i​πi​(v)], and qiM=Pr⁡[i∈M(v)]q^M_i = \Pr[i \in M(\mathbf v)]qiM​=Pr[i∈M(v)] is the probability that it serves agent iii.

A sequential posted-price mechanism (SPM) with ordering σ\sigmaσ and prices p\mathbf pp approaches the agents in the order σ\sigmaσ. When agent iii's turn comes, if adding iii to the set AAA of agents served so far keeps AAA feasible, iii is offered price pip_ipi​ and is served (and pays pip_ipi​) if pi≤vip_i \le v_ipi​≤vi​; otherwise iii is blocked. Its expected revenue is Rpσ\mathcal R^\sigma_{\mathbf p}Rpσ​.

The mechanism S\mathcal SS of the paper sets pi=Fi−1(1−qiM)p_i = F_i^{-1}(1 - q^M_i)pi​=Fi−1​(1−qiM​), so that agent iii accepts an offer with probability exactly qiMq^M_iqiM​, and approaches the agents in decreasing order of price.

Formalization targets

Goal: Theorem 5

For regular, independent values and a matroid constraint, for every truthful mechanism MMM and the SPM S\mathcal SS built from its service probabilities,

RM≤2 Rpσ.\mathcal R^M \le 2\, \mathcal R^\sigma_{\mathbf p}.RM≤2Rpσ​.

Taking MMM to be Myerson's optimal mechanism gives the paper's statement that S\mathcal SS 2-approximates the optimal revenue.

Milestones

  1. Proposition 1 (p. 5): the expected revenue of a truthful mechanism equals its expected virtual surplus E[∑i∈M(v)ϕi(vi)]\mathbb E[\sum_{i \in M(\mathbf v)} \phi_i(v_i)]E[∑i∈M(v)​ϕi​(vi​)].
  2. Lemma 2 (p. 5): RM≤∑ipiMqiM\mathcal R^M \le \sum_i p^M_i q^M_iRM≤∑i​piM​qiM​ with piM=Fi−1(1−qiM)p^M_i = F_i^{-1}(1 - q^M_i)piM​=Fi−1​(1−qiM​).
  3. Revenue of an SPM (§2.2, p. 4): Rpσ=∑iciqipi\mathcal R^\sigma_{\mathbf p} = \sum_i c_i q_i p_iRpσ​=∑i​ci​qi​pi​, where cic_ici​ is the probability that agent iii is offered service and qi=1−Fi(pi)q_i = 1 - F_i(p_i)qi​=1−Fi​(pi​).
  4. Rank bound (§4, p. 6): ∑i∈SqiM≤rank⁡(S)\sum_{i \in S} q^M_i \le \operatorname{rank}(S)∑i∈S​qiM​≤rank(S) for every set SSS.
  5. Lost revenue (proof of Theorem 5, p. 7): in any run under a matroid, with prices in decreasing order and weights qqq satisfying the rank bound, ∑i blockedpiqi≤∑i servedpi\sum_{i \text{ blocked}} p_i q_i \le \sum_{i \text{ served}} p_i∑i blocked​pi​qi​≤∑i served​pi​.
  6. Half of the benchmark (p. 7): under the same conditions, ∑ipiqi≤2Rpσ\sum_i p_i q_i \le 2 \mathcal R^\sigma_{\mathbf p}∑i​pi​qi​≤2Rpσ​.

Significance

The theorem shows that under a matroid constraint the optimal mechanism's advantage over a single round of posted prices is at most a factor of 2, uniformly over all regular distributions. Prices, rather than an auction, then suffice up to a constant, which justifies posted pricing in settings where an auction is impractical. The same argument, with the matroid replaced by an intersection of mmm matroids, gives the paper's Theorems 7 and 8, and the bound underlies the analysis of VCG with reserve prices (Theorem 32). Lemma 2's benchmark ∑ipiMqiM\sum_i p^M_i q^M_i∑i​piM​qiM​ became a standard tool for "ex ante relaxation" arguments.

The results are proved in the paper; none of them has a machine-checked proof. Formalizing them requires Myerson's revenue characterization in a multi-agent, dominant-strategy setting with a general feasibility constraint, which Lean's libraries do not have, and a probabilistic analysis of a sequential process over a product measure. Related formalizations exist for narrower models: the single-unit, Bayesian incentive compatible revenue identity MechanismDesign.Auctions.revenue_eq_virtual_surplus (Börgers' textbook, common support) and the i.i.d. multi-unit RevenueManagement.revenue_equivalence. Neither covers per-agent supports, set-system constraints or dominant-strategy truthfulness.

Difficulty

The obvious argument compares the SPM with the hypothetical mechanism that ignores the feasibility constraint, whose revenue is exactly ∑ipiqi\sum_i p_i q_i∑i​pi​qi​. The SPM loses the revenue of agents who would have accepted but are blocked. The difficulty is that blocking is correlated with the values of earlier agents, and the lost revenue must be bounded by revenue actually collected. A naive per-agent charge fails in a general matroid, because one served agent can block many others; the bound has to use the matroid's rank structure together with the decreasing price order.

On the mechanism side, Lemma 2 needs the full Myerson theory: monotonicity of truthful allocations, the payment identity, and an optimization over interim allocation rules with a fixed service probability, where regularity is used.

Formalization scope

All objects live in the namespace CHMSPricing.SpmMatroid. Agents are Fin n. The following conventions are fixed.

  • Distributions. Each FiF_iFi​ is given by a measurable density, strictly positive on a bounded interval [v‾i,v‾i][\underline v_i, \overline v_i][v​i​,vi​] with 0≤v‾i<v‾i0 \le \underline v_i < \overline v_i0≤v​i​<vi​, integrating to 111 there, with no mass outside. There are no point masses, so the randomized variant of S\mathcal SS in §4 does not arise. The prior is the product measure.
  • Regularity. Monotone non-decreasing virtual values on the support (Definition 2). All goals assume regular distributions, as the body's analyses do; the non-regular case (the second paragraph of Lemma 2, Appendix E) uses randomized prices and is out of scope.
  • Truthfulness. Deterministic mechanisms, dominant-strategy incentive compatible with deviations within the support, ex-post individually rational, feasible on the type space, with measurable allocation events and measurable integrable payments. Payments of unserved agents are not forced to zero.
  • Benchmark. The goal is stated for every truthful MMM, with S\mathcal SS built from MMM's own service probabilities; this is stronger than comparing with Myerson's mechanism alone and avoids constructing it.
  • Prices. pi=Fi−1(1−qi)p_i = F_i^{-1}(1 - q_i)pi​=Fi−1​(1−qi​) is passed as an argument with the hypotheses pi∈[v‾i,v‾i]p_i \in [\underline v_i, \overline v_i]pi​∈[v​i​,vi​] and Fi(pi)=1−qiF_i(p_i) = 1 - q_iFi​(pi​)=1−qi​, rather than through a generalized inverse.
  • SPM. Positions are 000-based; the price belongs to the agent; acceptance is pi≤vip_i \le v_ipi​≤vi​; ties in the decreasing price order are arbitrary, and the goal holds for every such order.
  • Proposition 1 additionally assumes the normalization that an agent with value v‾i\underline v_iv​i​ has zero utility, which is how the paper's payments are pinned down.

The goal cannot be trivialized by a free choice of prices: the prices are tied to the mechanism's service probabilities, and the SPM uses the same matroid as the mechanism. Individual rationality is essential, since without it a "truthful" mechanism can extract unbounded revenue.

A complete development needs Myerson's lemma for dominant-strategy single-parameter mechanisms, a quantile/revenue-curve argument under regularity, matroid span and rank facts for the paper's finite set systems, and independence arguments for a sequential process on a product measure. The rank bound and the deterministic lost-revenue inequality are independent of the probabilistic parts and are good first contributions; the Myerson-side lemmas are reusable for the other missions of this series.

Selected references

  • S. Chawla, J. D. Hartline, D. Malec, B. Sivan, Multi-parameter Mechanism Design and Sequential Posted Pricing, arXiv:0907.2435v2, 2010; STOC 2010. https://arxiv.org/abs/0907.2435
  • R. B. Myerson, Optimal Auction Design, Mathematics of Operations Research 6(1):58–73, 1981. https://doi.org/10.1287/moor.6.1.58
  • J. Bulow, J. Roberts, The Simple Economics of Optimal Auctions, Journal of Political Economy 97(5):1060–1090, 1989. https://doi.org/10.1086/261643
  • R. Kleinberg, S. M. Weinberg, Matroid Prophet Inequalities, STOC 2012. https://arxiv.org/abs/1201.4764
11 thms3 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

One-Machine Sequencing to Minimize Certain Functions of Job Tardiness I: SPT Order Minimizes Total Tardiness When Each Due Date Plus Processing Time Is at Most the Next SPT Completion TimeResearch Paper

Why total tardiness on one machine

A shop that promises delivery dates is judged by how late its orders are, not by how early. For a single machine processing nnn jobs that are all available at time 000, the total tardiness of a processing order,

T=∑i∈Jmax⁡(0, Ci−di),T=\sum_{i\in J}\max(0,\,C_i-d_i),T=i∈J∑​max(0,Ci​−di​),

charges each job the amount by which its completion time CiC_iCi​ exceeds its due date did_idi​, and nothing for finishing early. It is one of the basic criteria of deterministic scheduling (Conway, Maxwell and Miller, Theory of Scheduling, 1967), and the single-machine problem of minimizing it is the core subproblem of many dispatching and decomposition methods.

Two contrasting rules are classical. Sequencing in order of shortest processing time (SPT) minimizes total lateness ∑i(Ci−di)\sum_i (C_i-d_i)∑i​(Ci​−di​) and total completion time (Smith, 1956), and it minimizes total tardiness when every job is tardy under it. Sequencing by earliest due date (EDD) minimizes total tardiness when at most one job is tardy under it. Between these extremes no simple rule is optimal, and before 1969 the proposed exact methods (Held and Karp, 1962; Lawler, 1964; Elmaghraby, 1968) searched subsets of schedules.

Timeline.

  • 1956: Smith's ratio rule for weighted completion time; SPT for flow time and lateness.
  • 1965: Root notes that SPT is optimal for total tardiness when all due dates are equal.
  • 1969: Emmons (Operations Research 17(4)) proves dominance theorems that fix the relative order of pairs of jobs in some optimal schedule, and derives from them general sufficient conditions for SPT and EDD optimality.
  • 1977: Lawler gives a pseudopolynomial algorithm, built on Emmons's dominance results (Annals of Discrete Mathematics 1).
  • 1990: Du and Leung prove the problem NP-hard (Mathematics of Operations Research 15(3)), so sufficient conditions of Emmons's kind are the most one can expect from a simple rule.

This mission formalizes Emmons's SPT side: the pairwise dominance theorem for a shorter job before a longer one, and its corollary that the SPT schedule is optimal under a condition far weaker than "every job is tardy".

Setting

A finite set JJJ of jobs is processed on one machine. Job iii has a processing time pi≥0p_i\ge 0pi​≥0 and a due date di∈Rd_i\in\mathbb Rdi​∈R. A schedule of JJJ is an ordering of the jobs of JJJ; the machine starts at time 000, never idles, and processes the jobs in that order, so a job's completion time CiC_iCi​ is the sum of the processing times of the jobs up to and including it. Its tardiness is Ti=max⁡(0,Ci−di)T_i=\max(0, C_i-d_i)Ti​=max(0,Ci​−di​), and the schedule's total tardiness is T=∑i∈JTiT=\sum_{i\in J}T_iT=∑i∈J​Ti​. A schedule is optimal if no schedule of JJJ has smaller total tardiness.

Following Emmons, jobs are SPT-indexed: J1,…,JnJ_1,\dots,J_nJ1​,…,Jn​ are numbered so that j<kj<kj<k implies pj<pkp_j<p_kpj​<pk​, or pj=pkp_j=p_kpj​=pk​ and dj≤dkd_j\le d_kdj​≤dk​. The SPT schedule processes J1,J2,…,JnJ_1,J_2,\dots,J_nJ1​,J2​,…,Jn​ in this order.

Emmons's notation j←kj\leftarrow kj←k ("JjJ_jJj​ precedes JkJ_kJk​ in an optimal schedule") means that there exists an optimal schedule having all properties already established and in which JjJ_jJj​ comes before JkJ_kJk​. The set BkB_kBk​ collects the jobs already known to precede JkJ_kJk​.

Formalization targets

Goal: Corollary 1.4 (p. 705)

dj+pj≤∑i=1j+1pi(j=1,…,n−1)⟹the SPT schedule minimizes ∑i∈Jmax⁡(0,Ci−di).d_j+p_j\le\sum_{i=1}^{j+1}p_i\quad(j=1,\dots,n-1)\quad\Longrightarrow\quad\text{the SPT schedule minimizes } \sum_{i\in J}\max(0,C_i-d_i).dj​+pj​≤i=1∑j+1​pi​(j=1,…,n−1)⟹the SPT schedule minimizes i∈J∑​max(0,Ci​−di​).

The condition can be read as dj≤Cj+(pj+1−pj)d_j\le C_j+(p_{j+1}-p_j)dj​≤Cj​+(pj+1​−pj​) with CjC_jCj​ the SPT completion time of JjJ_jJj​, so it allows jobs to be early. It is the paper's sufficient condition for SPT optimality, and the conclusion is optimality against every schedule of JJJ.

Milestones

  1. Interchange claim (proof of Theorem 1, p. 703): in a schedule where all of BBB precede JkJ_kJk​ and JkJ_kJk​ precedes JjJ_jJj​, with j<kj<kj<k and dj≤max⁡(∑Bpi+pk, dk)d_j\le\max(\sum_{B}p_i+p_k,\,d_k)dj​≤max(∑B​pi​+pk​,dk​), interchanging JjJ_jJj​ and JkJ_kJk​ does not increase total tardiness.
  2. Theorem 1 (p. 703): if some optimal schedule has all of BBB before JkJ_kJk​ and dj≤max⁡(∑Bpi+pk, dk)d_j\le\max(\sum_{B}p_i+p_k,\,d_k)dj​≤max(∑B​pi​+pk​,dk​), then some optimal schedule has all of BBB before JkJ_kJk​ and also JjJ_jJj​ before JkJ_kJk​.
  3. Corollary 1.1 (p. 704): if d1≤max⁡(pi,di)d_1\le\max(p_i,d_i)d1​≤max(pi​,di​) for all i>1i>1i>1, then J1J_1J1​ is first in an optimal schedule.
  4. Time re-referencing (p. 705): processing JkJ_kJk​ first leaves the problem on J∖{Jk}J\setminus\{J_k\}J∖{Jk​} with due dates di−pkd_i-p_kdi​−pk​.
  5. First-job reduction (p. 705): JkJ_kJk​ followed by an optimal schedule of that reduced problem is optimal, whenever some optimal schedule starts with JkJ_kJk​.

Two further results are included as supporting statements: Corollary 1.2 (p. 705, JnJ_nJn​ last) and Corollary 2.3 (p. 707, the adjacent-pair rule j←kj\leftarrow kj←k iff dj≤max⁡(W+pk,dk)d_j\le\max(W+p_k,d_k)dj​≤max(W+pk​,dk​) after a waiting time WWW).

Significance

Corollary 1.4 turns an NP-hard problem into a closed-form answer on a recognizable class of instances: one pass over the SPT order checks the condition, and if it holds no search is needed. Theorem 1 is the more general tool. It orders pairs of jobs in an optimal schedule, and together with Emmons's companion theorems it underlies later exact methods for total tardiness, including Lawler's decomposition and the branch-and-bound algorithms that use Emmons's dominance rules for pruning.

The results are proved in the paper. What a formalization adds is a checked account of the step that the paper treats informally: dominance statements are existential ("some optimal schedule has JjJ_jJj​ before JkJ_kJk​"), and the paper argues on p. 702 that such statements can be accumulated. Each statement here makes explicit which previously established properties the new optimal schedule keeps. No machine-checked proof of these results was found on Prove2Me or in Mathlib at the time of drafting.

Difficulty

The obvious argument is a pairwise interchange, but the interchanged jobs are not adjacent. Moving JkJ_kJk​ from before JjJ_jJj​ to JjJ_jJj​'s position shifts every job in between, changes two tardiness terms in different directions, and the comparison depends on where the due dates fall relative to the start of JkJ_kJk​ and the end of JjJ_jJj​. The hypothesis involving ∑Bkpi\sum_{B_k}p_i∑Bk​​pi​ only controls the start time of JkJ_kJk​ through the information that BkB_kBk​ precedes it, so the existence statement must carry that information along.

The goal is not a direct consequence of Theorem 1 applied pairwise: existential conclusions for different pairs need not hold in a common optimal schedule. Optimality of one fixed order requires all the pairwise decisions to be realized simultaneously, and the problem changes (due dates shift) once a job is fixed in place.

Formalization scope

Jobs are elements of a type ι\iotaι with a linear order that plays the role of the paper's index, and the job set is a Finset ι; this lets the reduction remove a job and keep the remaining labels. Schedules and completion times are the published definitions MooreLateJobs.Shared.IsSchedule and MooreLateJobs.Shared.completionTime (duplicate-free lists containing exactly the jobs of JJJ; prefix sums of processing times from time 000). Tardiness, total tardiness, optimality (against every schedule of JJJ), "precedes" (comparison of positions), the SPT indexing convention and the SPT schedule (the jobs sorted by index) are defined in EmmonsTardiness.SPT.Model. Processing times and due dates are real.

Conventions and deviations from the page:

  • Added: processing times are nonnegative, pi≥0p_i\ge0pi​≥0 for i∈Ji\in Ji∈J. They are durations; the proof of Theorem 1 uses that the start time of JkJ_kJk​ is at least ∑Bkpi\sum_{B_k}p_i∑Bk​​pi​, and Corollary 2.3's second direction is false without it.
  • Not imposed: the reduction di<∑Jpid_i<\sum_J p_idi​<∑J​pi​ of p. 703. It is a without-loss-of-generality preprocessing step that no statement needs, so dropping it makes the statements stronger.
  • Kept: the SPT indexing convention of p. 703 is a hypothesis of every statement that refers to job indices.
  • j←kj\leftarrow kj←k: the "properties already established" are the precedences named in hypothesis (1); the broader cumulative reading of p. 702 is not formalized.

A formalization of the goal as "some optimal schedule starts with J1J_1J1​", or of Theorem 1 with an arbitrary set BBB unrelated to optimal schedules, would be a different and weaker (or false) statement; the targets above state optimality of the SPT schedule itself and tie BBB to an optimal schedule.

Needed infrastructure: lemmas on prefix sums of lists, on the effect of a transposition on positions in a duplicate-free list, on removing the head of a schedule, and existence of an optimal schedule among the finitely many permutations of JJJ. These list-scheduling lemmas are reusable for other single-machine results (Moore 1968, and the EDD mission of this series). Proofs of the milestones, alternative arguments, and general interchange lemmas are all welcome.

Selected references

  • H. Emmons, One-Machine Sequencing to Minimize Certain Functions of Job Tardiness, Operations Research 17(4):701–715, 1969. https://doi.org/10.1287/opre.17.4.701
  • R. W. Conway, W. L. Maxwell, L. W. Miller, Theory of Scheduling, Addison-Wesley, 1967.
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3:59–66, 1956. https://doi.org/10.1002/nav.3800030106
  • J. G. Root, Scheduling with Deadlines and Loss Functions on k Parallel Machines, Management Science 11:460–475, 1965. https://doi.org/10.1287/mnsc.11.4.460
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1):102–109, 1968. https://doi.org/10.1287/mnsc.15.1.102
  • E. L. Lawler, A "Pseudopolynomial" Algorithm for Sequencing Jobs to Minimize Total Tardiness, Annals of Discrete Mathematics 1:331–342, 1977. https://doi.org/10.1016/S0167-5060(08)70742-8
  • J. Du, J. Y.-T. Leung, Minimizing Total Tardiness on One Machine is NP-Hard, Mathematics of Operations Research 15(3):483–495, 1990. https://doi.org/10.1287/moor.15.3.483
8 thms3 active usersReviewed
🏆Completed
ProbabilityStochastic Systems·Captain: mikedeng1

Fundamentals of Queueing Theory IX: Kingman's Upper Bound on the G/G/1 Queue WaitTextbook

Motivation

The single-server queue with general independent interarrival and service times, the G/G/1 queue, is the basic model of a congested resource: a machine, a link, a checkout. For Markovian arrivals or services the mean wait has a closed form (the Pollaczek–Khintchine formula for M/G/1, the geometric law for G/M/1). For general distributions it has none, and the mean wait depends on the whole distributions of the interarrival and service times, not only on their moments. Capacity planning still needs numbers. Bounds that use only the first two moments are therefore the practical tool. They say how bad congestion can be for any queue with a given arrival rate, service rate and variabilities, and they become exact as the traffic intensity approaches one.

This mission formalizes Chapter 7, §7.1 of Gross, Shortle, Thompson and Harris, Fundamentals of Queueing Theory (4th ed., Wiley 2008, DOI 10.1002/9781118625651), together with the heavy-traffic Theorem 7.1 of §7.2.3.

Timeline. Lindley (Proc. Cambridge Philos. Soc., 1952) derived the recursion for successive waiting times and characterized the stationary law. Kingman (Proc. Cambridge Philos. Soc., 1961, 1962) proved the heavy-traffic exponential limit. In "Some inequalities for the queue GI/G/1" (Biometrika, 1962) he proved the two-moment upper bound. Marshall (1968) derived further moment relations and bounds (Operations Research, 1968). Marchal (Operations Research, 1978) gave the lower bound (7.14).

Setting

A G/G/1 queue is specified by two probability laws on [0,∞)[0,\infty)[0,∞): the law AAA of an interarrival time TTT and the law BBB of a service time SSS. Both have finite second moments, and

E[T]=1λ,E[S]=1μ,σA2=Var[T],σB2=Var[S],ρ=λμ.E[T] = \frac1\lambda,\quad E[S] = \frac1\mu,\quad \sigma_A^2 = \mathrm{Var}[T],\quad \sigma_B^2 = \mathrm{Var}[S],\quad \rho = \frac{\lambda}{\mu}.E[T]=λ1​,E[S]=μ1​,σA2​=Var[T],σB2​=Var[S],ρ=μλ​.

The pairs (S(n),T(n))(S^{(n)}, T^{(n)})(S(n),T(n)) are independent and identically distributed, and S(n)S^{(n)}S(n) is independent of T(n)T^{(n)}T(n). Customers are served first come, first served. The line delay Wq(n)W_q^{(n)}Wq(n)​ of the nnnth customer obeys Lindley's recursion

Wq(n+1)=max⁡(0, Wq(n)+U(n)),U(n)=S(n)−T(n),(7.1)W_q^{(n+1)} = \max\bigl(0,\ W_q^{(n)} + U^{(n)}\bigr), \qquad U^{(n)} = S^{(n)} - T^{(n)}, \tag{7.1}Wq(n+1)​=max(0, Wq(n)​+U(n)),U(n)=S(n)−T(n),(7.1)

and Wq(n)W_q^{(n)}Wq(n)​ is independent of (S(n),T(n))(S^{(n)}, T^{(n)})(S(n),T(n)). The idle gap X(n)=−min⁡(0,Wq(n)+U(n))X^{(n)} = -\min(0, W_q^{(n)} + U^{(n)})X(n)=−min(0,Wq(n)​+U(n)) is the time between the nnnth departure and the next start of service.

The queue is stationary when the law ν\nuν of Wq(n)W_q^{(n)}Wq(n)​ does not depend on nnn, that is, when one step of (7.1) maps ν\nuν to itself. The mean stationary line delay is Wq=E[Wq(n)]=∫w dν(w)W_q = E[W_q^{(n)}] = \int w\,d\nu(w)Wq​=E[Wq(n)​]=∫wdν(w). In the Lean development these objects are IsGG1Input A B lam mu, lindley, idleX, IsStationaryWaitLaw A B ν and meanWait ν, in the namespace QueueingFundamentals.Bounds.

Formalization targets

Goal: Kingman's upper bound (7.13)

For every stationary G/G/1 queue with ρ<1\rho < 1ρ<1, WqW_qWq​ is finite and

Wq≤λ(σA2+σB2)2(1−ρ).W_q \le \frac{\lambda(\sigma_A^2 + \sigma_B^2)}{2(1-\rho)}.Wq​≤2(1−ρ)λ(σA2​+σB2​)​.

Milestones

  • the idle-gap identity E[X]=−E[U]=1/λ−1/μE[X] = -E[U] = 1/\lambda - 1/\muE[X]=−E[U]=1/λ−1/μ (7.4), and the mean-wait formula (7.7)
Wq=E[X2]−E[U2]2E[U];W_q = \frac{E[X^2] - E[U^2]}{2E[U]};Wq​=2E[U]E[X2]−E[U2]​;
  • the variance of the interdeparture time D=S(n+1)+X(n)D = S^{(n+1)} + X^{(n)}D=S(n+1)+X(n) (7.12): Var[D]=2σB2+σA2−2Wq(1/λ−1/μ)\mathrm{Var}[D] = 2\sigma_B^2 + \sigma_A^2 - 2W_q(1/\lambda - 1/\mu)Var[D]=2σB2​+σA2​−2Wq​(1/λ−1/μ);
  • Marchal's lower bound (7.14), Wq≥(λ2σB2+ρ(ρ−2))/(2λ(1−ρ))W_q \ge (\lambda^2\sigma_B^2 + \rho(\rho-2))/(2\lambda(1-\rho))Wq​≥(λ2σB2​+ρ(ρ−2))/(2λ(1−ρ));
  • the distributional lower bound Wq≥r0W_q \ge r_0Wq​≥r0​, with r0r_0r0​ the unique nonnegative root of f(z)=z−∫−z∞[1−U(t)] dtf(z) = z - \int_{-z}^\infty [1 - U(t)]\,dtf(z)=z−∫−z∞​[1−U(t)]dt and U(t)U(t)U(t) the CDF of S−TS - TS−T ((7.15), (7.16));
  • the two-sided estimate (7.17), max⁡(0,r0,λ2σB2+ρ(ρ−2)2λ(1−ρ))≤Wq≤λ(σA2+σB2)2(1−ρ)\max\bigl(0, r_0, \tfrac{\lambda^2\sigma_B^2 + \rho(\rho-2)}{2\lambda(1-\rho)}\bigr) \le W_q \le \tfrac{\lambda(\sigma_A^2+\sigma_B^2)}{2(1-\rho)}max(0,r0​,2λ(1−ρ)λ2σB2​+ρ(ρ−2)​)≤Wq​≤2(1−ρ)λ(σA2​+σB2​)​;
  • Theorem 7.1 (heavy traffic): for a sequence of G/G/1 queues with ρj→1\rho_j \to 1ρj​→1, αj=−E[Sj−Tj]\alpha_j = -E[S_j - T_j]αj​=−E[Sj​−Tj​] and βj2=Var[Sj−Tj]\beta_j^2 = \mathrm{Var}[S_j - T_j]βj2​=Var[Sj​−Tj​], under convergence of the input laws, Var[S−T]>0\mathrm{Var}[S - T] > 0Var[S−T]>0 and uniformly bounded (2+δ)(2+\delta)(2+δ)-moments,
2αjβj2 Wq,j→dExp(1).\frac{2\alpha_j}{\beta_j^2}\,W_{q,j} \xrightarrow{d} \mathrm{Exp}(1).βj2​2αj​​Wq,j​d​Exp(1).

The goal is (7.13) rather than the stronger (7.17) because it depends only on the first two moments of the input.

Significance

Kingman's bound is the most widely used performance estimate for single-server queues. It needs no distributional form, only two means and two variances. It yields the "Kingman formula" approximation used across manufacturing and service operations, and it is asymptotically exact as ρ→1\rho \to 1ρ→1 (Theorem 7.1). The departure variance (7.12) drives the decomposition approximations for networks of §7.3. The heavy-traffic theorem is the entry point to diffusion approximations of queues.

All results here are proved in the literature (Theorem 7.1 is stated in the book without proof). This mission produces the first machine-checked versions. As far as a search of the platform shows, none of these statements, and no stationary Lindley recursion, has been formalized. The substrate it needs is reusable for any mission on G/G/1, G/G/c or random walks: stationary laws of a recursion on distributions, moment identities for max⁡(0,⋅)\max(0,\cdot)max(0,⋅), and convergence in distribution.

Difficulty

The book's derivation squares (7.3) and takes expectations, using E[(Wq(n+1))2]=E[(Wq(n))2]E[(W_q^{(n+1)})^2] = E[(W_q^{(n)})^2]E[(Wq(n+1)​)2]=E[(Wq(n)​)2]. That step is valid only if the stationary wait has a finite second moment. It is not assumed here and fails in general: with finite second moments of SSS and TTT the stationary wait has a finite mean, but its second moment is finite only if E[S3]<∞E[S^3] < \inftyE[S3]<∞. So the moment identity (7.7) cannot be obtained by cancelling second moments. A truncation or limiting argument is needed, and even the finiteness of WqW_qWq​ has to be proved rather than assumed. The lower bound Wq≥r0W_q \ge r_0Wq​≥r0​ further needs a Jensen argument for the conditional mean of one Lindley step. Theorem 7.1 needs a uniform-integrability argument across a sequence of queues.

Formalization scope

Conventions committed to in Lean:

  • laws, not random variables: AAA, BBB and the stationary law ν\nuν are Measure ℝ; independence of Wq(n),S(n),T(n)W_q^{(n)}, S^{(n)}, T^{(n)}Wq(n)​,S(n),T(n) (and S(n+1)S^{(n+1)}S(n+1) for DDD) is the product measure;
  • the input laws are probability measures on [0,∞)[0,\infty)[0,∞) with finite second moments (MemLp id 2), E[T]=1/λE[T] = 1/\lambdaE[T]=1/λ, E[S]=1/μE[S] = 1/\muE[S]=1/μ, λ,μ>0\lambda, \mu > 0λ,μ>0, ρ=λ/μ<1\rho = \lambda/\mu < 1ρ=λ/μ<1;
  • stationarity is invariance of the whole law ν\nuν under one step of (7.1), not equality of means;
  • WqW_qWq​, the variances (Mathlib variance) and f1f_1f1​ are Lebesgue integrals. Every theorem therefore asserts, as part of its conclusion, that ν\nuν has a finite mean, and none assumes a finite second moment of ν\nuν;
  • U(t)U(t)U(t) is Mathlib's cdf of the law of S−TS - TS−T;
  • convergence in distribution is convergence of ∫g\int g∫g for all bounded continuous ggg, and Exp(1)\mathrm{Exp}(1)Exp(1) is expMeasure 1.

Closed forms carried by the statements: (7.4), (7.7), (7.12), (7.13), (7.14) and (7.17) exactly as printed, and the scaling 2αj/βj22\alpha_j/\beta_j^22αj​/βj2​ of Theorem 7.1.

Stating (7.13) with WqW_qWq​, E[X2]E[X^2]E[X2] or the idle probability as free real numbers constrained by (7.7) would reduce it to algebra. Here WqW_qWq​ is always the mean of a stationary law of the queue.

Not formalized: (7.5) and (7.8), which need the idle-period law III and the arrival-point probability q0q_0q0​ as separate objects, and the multiserver bounds of §7.1.3. Proofs of any milestone are welcome, as are reusable lemmas on stationary laws of Lindley's recursion (existence, uniqueness, and finiteness of the mean under E[S2]<∞E[S^2] < \inftyE[S2]<∞).

Selected references

  • D. Gross, J. F. Shortle, J. M. Thompson, C. M. Harris, Fundamentals of Queueing Theory, 4th ed., Wiley, 2008. https://doi.org/10.1002/9781118625651
  • D. V. Lindley, The theory of queues with a single server, Math. Proc. Cambridge Philos. Soc. 48 (1952)
  • J. F. C. Kingman, The single server queue in heavy traffic, Math. Proc. Cambridge Philos. Soc. 57 (1961)
  • J. F. C. Kingman, Some inequalities for the queue GI/G/1, Biometrika 49 (1962)
  • K. T. Marshall, Some inequalities in queuing, Operations Research 16 (1968)
  • W. G. Marchal, Some simpler bounds on the mean queuing time, Operations Research 26 (1978)
10 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: mikedeng1

A Multicut Algorithm for Two-Stage Stochastic Linear Programs 2: Multicut for Simple Recourse Stops Within J·m2 + 1 IterationsResearch Paper

Motivation

Two-stage stochastic linear programs model decisions taken before uncertainty is resolved (first stage) and corrected afterwards at a cost (second stage, the recourse). The standard solution method for problems with finitely many scenarios is the L-shaped method of Van Slyke and Wets (1969), an outer linearization in the style of Benders decomposition: a master program approximates the expected recourse function by cutting planes, one cut per iteration. Birge and Louveaux (1988) proposed the multicut variant, which approximates the recourse function of each realization separately and can add several cuts per iteration, and compared the two methods by worst-case counts of major iterations.

The paper's §5 treats the special case of simple recourse, where the second stage only penalizes shortage and surplus of each component of the first-stage output against a random target. Simple recourse arises in production planning, inventory and capacity models, and is the case in which the recourse function separates into one-dimensional pieces. There the paper derives an explicit LP (25) equivalent to the problem, a dedicated multicut algorithm for it, and the bound of Jm2+1Jm_2+1Jm2​+1 iterations quoted below. This mission formalizes that section.

Setting

First-stage data are c∈Rn1c\in\mathbb R^{n_1}c∈Rn1​, A∈Rm1×n1A\in\mathbb R^{m_1\times n_1}A∈Rm1​×n1​, b∈Rm1b\in\mathbb R^{m_1}b∈Rm1​, and the first-stage feasible set is K1={x∣Ax=b, x≥0}K_1=\{x\mid Ax=b,\ x\ge0\}K1​={x∣Ax=b, x≥0}. A deterministic technology matrix T∈Rm2×n1T\in\mathbb R^{m_2\times n_1}T∈Rm2​×n1​, with rows TiT_iTi​, maps xxx to the tender χ=Tx∈Rm2\chi=Tx\in\mathbb R^{m_2}χ=Tx∈Rm2​. Problem (3) of the paper is

min⁡ z(x)=cx+Ψ(Tx)s.t. x∈K1.\min\ z(x)=cx+\Psi(Tx)\quad\text{s.t. } x\in K_1 .min z(x)=cx+Ψ(Tx)s.t. x∈K1​.

For each row i=1,…,m2i=1,\dots,m_2i=1,…,m2​ the random vector ξi=(qi+,qi−,hi)\xi_i=(q_i^+,q_i^-,h_i)ξi​=(qi+​,qi−​,hi​) takes JJJ values ξij=(qij+,qij−,hij)\xi_{ij}=(q^+_{ij},q^-_{ij},h_{ij})ξij​=(qij+​,qij−​,hij​) with probabilities pijp_{ij}pij​. The simple recourse cost (20) of row iii is the optimal value of a one-row LP,

ψi(χi,ξij)=min⁡{qij+y++qij−y−∣y+−y−=hij−χi, y+,y−≥0},\psi_i(\chi_i,\xi_{ij})=\min\{q^+_{ij}y^+ + q^-_{ij}y^- \mid y^+-y^-=h_{ij}-\chi_i,\ y^+,y^-\ge0\},ψi​(χi​,ξij​)=min{qij+​y++qij−​y−∣y+−y−=hij​−χi​, y+,y−≥0},

and by separability (19) the expected recourse function is Ψ(χ)=∑iΨi(χi)\Psi(\chi)=\sum_i\Psi_i(\chi_i)Ψ(χ)=∑i​Ψi​(χi​) with Ψi(χi)=∑jpijψi(χi,ξij)\Psi_i(\chi_i)=\sum_j p_{ij}\psi_i(\chi_i,\xi_{ij})Ψi​(χi​)=∑j​pij​ψi​(χi​,ξij​). Write qij=qij++qij−q_{ij}=q^+_{ij}+q^-_{ij}qij​=qij+​+qij−​.

The multicut algorithm for simple recourse problems (p. 389) keeps a set III of identified pairs l=(i,j)l=(i,j)l=(i,j), initially empty. Step 1 solves the master program (26),

min⁡ cx+∑i,jpijqij−(Tix)+∑l∈Iuls.t. Ax=b, x≥0, ul≥el−Elx, ul≥0 (l∈I),\min\ cx+\sum_{i,j}p_{ij}q^-_{ij}(T_ix)+\sum_{l\in I}u_l\quad\text{s.t. } Ax=b,\ x\ge0,\ u_l\ge e_l-E_lx,\ u_l\ge0\ (l\in I),min cx+i,j∑​pij​qij−​(Ti​x)+l∈I∑​ul​s.t. Ax=b, x≥0, ul​≥el​−El​x, ul​≥0 (l∈I),

with El=pijqijTiE_l=p_{ij}q_{ij}T_iEl​=pij​qij​Ti​ and el=pijqijhije_l=p_{ij}q_{ij}h_{ij}el​=pij​qij​hij​. Step 2 adds to III every pair for which the constraint 0≥pijqij(hij−Tixν)0\ge p_{ij}q_{ij}(h_{ij}-T_ix^\nu)0≥pij​qij​(hij​−Ti​xν) (27) is violated at the master's solution xνx^\nuxν, and returns to Step 1; when no pair is added the algorithm stops.

Formalization targets

Goal: the Jm2+1Jm_2+1Jm2​+1 bound, with correctness

The paper states (p. 389): "The initial problem (26) involves m1m_1m1​ constraints and n1n_1n1​ variables. For this problem, the worst-case situation is when at each iteration, only one constraint (27) is violated in Step 2. Then, the maximal number of iterations is Jm2+1Jm_2+1Jm2​+1." The goal asserts, for every run of the algorithm (any optimal solution of (26) may be used at each Step 1):

ν-th solve of Step 1 takes place ⟹ ν≤Jm2+1,\nu\text{-th solve of Step 1 takes place}\ \Longrightarrow\ \nu\le Jm_2+1,ν-th solve of Step 1 takes place ⟹ ν≤Jm2​+1,

and, when the algorithm stops at xνx^\nuxν, xν∈K1x^\nu\in K_1xν∈K1​ and cxν+Ψ(Txν)≤cx+Ψ(Tx)cx^\nu+\Psi(Tx^\nu)\le cx+\Psi(Tx)cxν+Ψ(Txν)≤cx+Ψ(Tx) for all x∈K1x\in K_1x∈K1​.

Milestones

  1. (22)–(23): for q++q−≥0q^++q^-\ge0q++q−≥0 the LP (20) attains its minimum max⁡{q−(χ−h),q+(h−χ)}\max\{q^-(\chi-h),q^+(h-\chi)\}max{q−(χ−h),q+(h−χ)}, so each θij\theta_{ij}θij​ has only two cuts.
  2. (24)–(25): the simple recourse problem is equivalent to the LP (25): same optimal xxx, and the value of (25) at xxx with the best slacks is z(x)z(x)z(x).
  3. Relaxation and stopping: (26) is a relaxation of (25), and if no unidentified pair violates (27) at an optimum of (26), that optimum (extended by zero slacks) is optimal for (25).
  4. Facets: each Ψi\Psi_iΨi​ is a maximum of J+1J+1J+1 affine functions, so Ψ\PsiΨ is a maximum of at most (J+1)m2(J+1)^{m_2}(J+1)m2​ affine functions.

Significance

The bound is linear in m2m_2m2​ and JJJ, while the L-shaped method may need as many iterations as Ψ\PsiΨ has facets, up to (J+1)m2(J+1)^{m_2}(J+1)m2​ (milestone 4). This is the paper's clearest instance of the multicut method's worst-case advantage, and the equivalence (25) shows that simple recourse problems are LPs of size linear in m2Jm_2Jm2​J, a fact used throughout the later literature on simple and integrated recourse.

The results are proved in the paper, briefly. To our knowledge none has a machine-checked proof. Formalizing them produces a checked reduction of simple recourse to an explicit LP, a checked correctness proof of a constraint-generation algorithm with an explicit iteration bound, and the piece count of a sum of one-dimensional convex piecewise linear functions.

Difficulty

The counting argument is short once the algorithm is pinned down; the difficulty lies in the rest. Correctness at stopping requires relating three optimization problems (3), (25) and (26) whose objectives differ by a constant and by slack variables that are only present for identified pairs, and doing so for an arbitrary optimal solution of the master. The step from (20) to (22)–(23) requires solving an LP in closed form, as an infimum that must first be shown finite. The facet count requires showing that a sum of JJJ convex functions, each with one breakpoint, is a maximum of exactly J+1J+1J+1 affine functions, which is not a consequence of convexity alone.

Formalization scope

All vectors are Fin n → ℝ, matrices Matrix (Fin m) (Fin n) ℝ, realizations are indexed by Fin J, and pairs (i,j)(i,j)(i,j) by Fin m2 × Fin J. The second-stage value ψ\psiψ is the EReal infimum of the LP (20), not its closed form; expectations are finite sums weighted by pij≥0p_{ij}\ge0pij​≥0 with ∑jpij=1\sum_jp_{ij}=1∑j​pij​=1.

Readings pinned down, each recorded in the item statements:

  • qij≥0q_{ij}\ge0qij​≥0. The paper never states it, but without it (20) is unbounded below and (25) is not equivalent to (3). It is a field of the model.
  • x≥0x\ge0x≥0 belongs to (3) and is omitted in the displays of (25) and (26); it is kept in both.
  • Step 2 ranges over unidentified pairs. The paper writes "for each iii and jjj"; read literally, an identified pair whose ulu_lul​ already covers it could be re-added forever. The paper's remark that (27) "identifies any constraints in (25) that are not met" fixes the reading. The state of the algorithm is the set of identified pairs; the order of identification, and so the index ttt, is immaterial.
  • Stopping rule. It is implicit in the paper: stop when (27) is violated for no pair.
  • Counting. The paper writes "the maximal number of iterations is Jm2+1Jm_2+1Jm2​+1"; we count solves of Step 1, the stopping solve included, which is what its argument counts.
  • Constant. The objective of (26) omits the constant −∑pijqij−hij-\sum p_{ij}q^-_{ij}h_{ij}−∑pij​qij−​hij​ of (25), as printed.
  • Facets. "Ψi\Psi_iΨi​ contains J+1J+1J+1 facets" is read as "is a maximum of J+1J+1J+1 (not necessarily distinct) affine functions".

A formalization in which the master step could fire without a violated, unidentified pair, or in which the algorithm's optimal solutions were fixed in advance, would make the bound either false or empty; the definitions exclude both. The goal includes optimality at stopping so that it is not only a statement about a set growing inside a finite set.

Needed infrastructure: elementary LP feasibility and optimality, finite sums in EReal, and piecewise linear convex functions on R\mathbb RR. Contributions of any of the milestones, in any order, are welcome; milestone 1 is the natural first step.

Selected references

  • J.R. Birge and F.V. Louveaux, A multicut algorithm for two-stage stochastic linear programs, European Journal of Operational Research 34 (1988) 384–392. https://doi.org/10.1016/0377-2217(88)90159-2
  • R.M. Van Slyke and R. Wets, L-shaped linear programs with applications to optimal control and stochastic programming, SIAM Journal on Applied Mathematics 17 (1969) 638–663. https://doi.org/10.1137/0117061
  • J.R. Birge and F.V. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011. https://doi.org/10.1007/978-1-4614-0237-4
7 thms3 active usersReviewed
🏆Completed
Algorithmic Game Theory·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games IV: For Symmetric Games the Maximum Social Cost Price of Anarchy Is at Most 5/2Research Paper

Motivation

The price of anarchy measures how much a system of selfish agents loses compared with a centrally optimized one: it is the worst ratio, over all Nash equilibria, between the social cost of the equilibrium and the optimal social cost. Koutsoupias and Papadimitriou introduced it in 1999 (Worst-case equilibria, STACS 1999), and bounding it for routing and congestion games became a central topic of algorithmic game theory. Congestion games model routing in networks, load balancing on machines and any setting where agents choose sets of shared resources whose cost grows with their usage.

Christodoulou and Koutsoupias (The price of anarchy of finite congestion games, STOC 2005) determined the pure price of anarchy of finite (atomic, unweighted) congestion games with linear latencies for two social costs — the sum of the players' costs and the maximum cost of a player — and for asymmetric and symmetric games. Awerbuch, Azar and Epstein obtained the 5/25/25/2 bound for the sum independently in the same proceedings (The price of routing unsplittable flow, STOC 2005). This mission is the fourth of a series that formalizes the paper: the symmetric games with the maximum social cost (Sect. 3.4). For asymmetric games the maximum social cost has price of anarchy Θ(N)\Theta(\sqrt N)Θ(N​) (mission III); symmetry brings it down to a constant.

Setting

A congestion game has a finite set of players N={1,…,n}N=\{1,\dots,n\}N={1,…,n}, a finite set EEE of facilities, for each player iii a collection Σi\Sigma_iΣi​ of pure strategies (each a subset of EEE), and for each facility eee a latency function fe:N→Rf_e:\mathbb N\to\mathbb Rfe​:N→R. A pure strategy profile A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) picks Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ for every player. The load ne(A)n_e(A)ne​(A) is the number of players whose strategy contains eee, and the cost of player iii is

ci(A)=∑e∈Aife(ne(A)).c_i(A)=\sum_{e\in A_i} f_e\big(n_e(A)\big).ci​(A)=e∈Ai​∑​fe​(ne​(A)).

A profile AAA is a pure Nash equilibrium if no player can lower its cost by changing only its own strategy: ci(A)≤ci(A−i,S)c_i(A)\le c_i(A_{-i},S)ci​(A)≤ci​(A−i​,S) for every iii and every S∈ΣiS\in\Sigma_iS∈Σi​, where (A−i,S)(A_{-i},S)(A−i​,S) replaces AiA_iAi​ by SSS.

The maximum social cost is MAX(A)=max⁡ici(A)\mathrm{MAX}(A)=\max_{i} c_i(A)MAX(A)=maxi​ci​(A) and the sum social cost is SUM(A)=∑ici(A)\mathrm{SUM}(A)=\sum_i c_i(A)SUM(A)=∑i​ci​(A). Latencies are linear when fe(k)=aek+bef_e(k)=a_e k+b_efe​(k)=ae​k+be​ with ae,be≥0a_e,b_e\ge 0ae​,be​≥0. The game is symmetric when all players share one strategy set, Σi=Σ\Sigma_i=\SigmaΣi​=Σ. The pure price of anarchy for the maximum social cost is

PA=sup⁡A NashMAX(A)min⁡PMAX(P).\mathrm{PA}=\sup_{A\ \text{Nash}}\frac{\mathrm{MAX}(A)}{\min_{P}\mathrm{MAX}(P)}.PA=A Nashsup​minP​MAX(P)MAX(A)​.

Formalization targets

Goal: Theorems 7 and 8

For every symmetric linear congestion game with at least one player, every pure Nash equilibrium AAA and every pure strategy profile PPP,

MAX(A)≤52 MAX(P),\mathrm{MAX}(A)\le\tfrac52\,\mathrm{MAX}(P),MAX(A)≤25​MAX(P),

and for every N≥3N\ge3N≥3 there is a symmetric linear congestion game with NNN players, a pure Nash equilibrium AAA and a profile PPP that minimizes the maximum social cost, with MAX(P)>0\mathrm{MAX}(P)>0MAX(P)>0 and

MAX(A)=5N+12N+2 MAX(P).\mathrm{MAX}(A)=\frac{5N+1}{2N+2}\,\mathrm{MAX}(P).MAX(A)=2N+25N+1​MAX(P).

The second part shows that the constant 5/25/25/2 of the first is tight as N→∞N\to\inftyN→∞.

Milestones

  1. Theorem 7, proof (first display). In a symmetric linear game, a Nash equilibrium cost is bounded by the cost of every strategy PjP_jPj​ evaluated at loads ne(A)+1n_e(A)+1ne​(A)+1: ci(A)≤∑e∈Pjfe(ne(A)+1)c_i(A)\le\sum_{e\in P_j}f_e(n_e(A)+1)ci​(A)≤∑e∈Pj​​fe​(ne​(A)+1).
  2. Theorem 7, proof (second display). Summed over jjj: N⋅ci(A)≤∑ene(P)fe(ne(A)+1)N\cdot c_i(A)\le\sum_e n_e(P)f_e(n_e(A)+1)N⋅ci​(A)≤∑e​ne​(P)fe​(ne​(A)+1).
  3. Lemma 1. β(α+1)≤13α2+53β2\beta(\alpha+1)\le\frac13\alpha^2+\frac53\beta^2β(α+1)≤31​α2+35​β2 for nonnegative integers α,β\alpha,\betaα,β.
  4. Theorem 7, proof (Lemma 1 step). ∑ene(P)fe(ne(A)+1)≤13SUM(A)+53SUM(P)\sum_e n_e(P)f_e(n_e(A)+1)\le\frac13\mathrm{SUM}(A)+\frac53\mathrm{SUM}(P)∑e​ne​(P)fe​(ne​(A)+1)≤31​SUM(A)+35​SUM(P).
  5. Theorem 1. For linear congestion games, SUM(A)≤52SUM(P)\mathrm{SUM}(A)\le\frac52\mathrm{SUM}(P)SUM(A)≤25​SUM(P) at every pure Nash equilibrium AAA.
  6. Theorem 7 and Theorem 8 as separate statements.

Significance

The result says that in symmetric congestion games with linear costs no player at an equilibrium is ever more than 5/25/25/2 times worse off than the worst-off player under the best allocation, regardless of the number of players. This contrasts with the asymmetric case, where the ratio grows like N\sqrt NN​ (Theorems 5 and 6 of the paper), and it fills the symmetric–maximum entry of the paper's Table 1. Together with the sum bounds it completes the picture of pure equilibria under linear latencies that later work on smoothness and robust price of anarchy (Roughgarden, Intrinsic robustness of the price of anarchy, STOC 2009) generalized.

The results are proved in the paper, which only displays the identity-latency case and states that the arguments extend to affine latencies. No machine-checked version of any of the paper's bounds is known to exist; the mission produces a formal proof of the affine statement, a checked construction for the lower bound (the paper verifies its Nash condition only partly), and a congestion-game layer shared with the rest of the series.

Difficulty

The obvious attempt bounds the worst player's cost by its deviation to its own optimal strategy only, as in the proof for the sum; that gives one inequality per player and loses the factor NNN needed to compare with MAX(P)\mathrm{MAX}(P)MAX(P). Without symmetry the factor cannot be recovered at all (Theorem 6 of the paper). For the lower bound, the difficulty is that the construction must be a Nash equilibrium against all strategies in the common set — including the other players' equilibrium strategies and the isolated strategy of the maximum-cost player — while the paper only writes out the deviation to the optimal strategies; its parameters are left as the solution of a linear equation, which must be chosen integral for every N≥3N\ge3N≥3.

Formalization scope

Players form a finite type (Fin N in the lower bound) and facilities a finite type; profiles are maps from players to Finsets of facilities, with feasibility Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ as a separate predicate IsProfile. Latencies are real-valued functions on natural-number loads; "linear" means affine with nonnegative coefficients. MAX is the maximum over a nonempty player set. Upper bounds are stated for every Nash equilibrium and every feasible profile, never dividing by the optimum. The lower bound asserts that PPP minimizes MAX over all profiles and that MAX(P)>0\mathrm{MAX}(P)>0MAX(P)>0: without positivity the equality would be satisfied by a game with all costs 000, and without symmetry or the full common strategy set the instance would not be the paper's. The lower bound gives PA≥5N+12N+2\mathrm{PA}\ge\frac{5N+1}{2N+2}PA≥2N+25N+1​ for the instance, which is what the paper's proof shows.

The development needs sums over facilities exchanged with sums over players (∑j∑e∈Pjg(e)=∑ene(P)g(e)\sum_j\sum_{e\in P_j}g(e)=\sum_e n_e(P)g(e)∑j​∑e∈Pj​​g(e)=∑e​ne​(P)g(e)), monotonicity of affine latencies, and an explicit finite instance. The congestion-game definitions are shared with the other missions of the series and will be merged with them; Lemma 1 and Theorem 1 are also milestones of mission I. Proofs of any milestone, and alternative constructions for Theorem 8, are welcome.

Selected references

  • G. Christodoulou and E. Koutsoupias, The price of anarchy of finite congestion games, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar and A. Epstein, The price of routing unsplittable flow, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias and C. Papadimitriou, Worst-case equilibria, STACS 1999, LNCS 1563. https://doi.org/10.1007/3-540-49116-3_38
  • R. W. Rosenthal, A class of games possessing pure-strategy Nash equilibria, International Journal of Game Theory 2, 1973. https://doi.org/10.1007/BF01737559
  • T. Roughgarden, Intrinsic robustness of the price of anarchy, Proc. 41st ACM STOC, 2009. https://doi.org/10.1145/1536414.1536430
9 thms3 active usersReviewed
🏆Completed
Algorithmic Game Theory·Captain: mikedeng1

The Price of Anarchy of Finite Congestion Games I: The Pure Price of Anarchy of the Average Social Cost Is 5/2Research Paper

Motivation

When many independent users share a resource whose cost grows with use (links of a network, servers, machines), each user chooses for itself, and the outcome is a Nash equilibrium rather than a socially optimal allocation. The price of anarchy, introduced by Koutsoupias and Papadimitriou (STACS 1999), measures the cost of this decentralisation: the worst ratio between the social cost of an equilibrium and the optimal social cost. It has become a standard yardstick in algorithmic game theory, network routing and the design of distributed protocols.

Christodoulou and Koutsoupias (STOC 2005) determined the price of anarchy of finite congestion games with linear latencies, the atomic, unweighted counterpart of selfish routing. This mission formalizes the central entry of their table: pure equilibria, general (asymmetric) strategy sets, and the average social cost.

Timeline:

  • 1973. Rosenthal defines congestion games and shows that they always have pure Nash equilibria (IJGT 2).
  • 1999. Koutsoupias and Papadimitriou define the price of anarchy, for load balancing on parallel links (STACS 1999).
  • 2002. Roughgarden and Tardos prove that the price of anarchy of non-atomic selfish routing with linear latencies is 4/34/34/3 (J. ACM 49).
  • 2005. Christodoulou and Koutsoupias prove that for finite (atomic) congestion games with linear latencies the pure price of anarchy of the average social cost is exactly 5/25/25/2; independently, Awerbuch, Azar and Epstein obtain 2.52.52.5 for unweighted and (3+5)/2≈2.618(3+\sqrt5)/2\approx2.618(3+5​)/2≈2.618 for weighted games (STOC 2005).
  • 2009. Roughgarden shows that this type of bound extends to mixed, correlated and coarse correlated equilibria (STOC 2009).

Setting

A congestion game has a finite set NNN of players, a finite set EEE of facilities, for every player iii a set Σi⊆2E\Sigma_i\subseteq 2^EΣi​⊆2E of pure strategies (each a set of facilities), and for every facility eee a latency function fef_efe​ giving the cost of eee to each of its users as a function of how many users it has. A pure strategy profile A=(A1,…,An)A=(A_1,\dots,A_n)A=(A1​,…,An​) picks Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​ for each player. The load ne(A)n_e(A)ne​(A) is the number of players iii with e∈Aie\in A_ie∈Ai​, and player iii pays

ci(A)=∑e∈Aife(ne(A)).c_i(A)=\sum_{e\in A_i}f_e\bigl(n_e(A)\bigr).ci​(A)=e∈Ai​∑​fe​(ne​(A)).

The profile AAA is a pure Nash equilibrium if no player can lower its cost by switching alone: ci(A)≤ci(A−i,S)c_i(A)\le c_i(A_{-i},S)ci​(A)≤ci​(A−i​,S) for all iii and all S∈ΣiS\in\Sigma_iS∈Σi​, where (A−i,S)(A_{-i},S)(A−i​,S) replaces AiA_iAi​ by SSS. The social cost is SUM(A)=∑i∈Nci(A)\mathrm{SUM}(A)=\sum_{i\in N}c_i(A)SUM(A)=∑i∈N​ci​(A), which is ∣N∣|N|∣N∣ times the average cost of a player. Latencies are linear: fe(k)=aek+bef_e(k)=a_ek+b_efe​(k)=ae​k+be​ with ae,be≥0a_e,b_e\ge0ae​,be​≥0. The game is asymmetric in the sense that each player has its own strategy set (symmetric games, where all Σi\Sigma_iΣi​ coincide, are a special case).

The pure price of anarchy of the average social cost is

PA=sup⁡A NashSUM(A)opt,opt=min⁡PSUM(P),PA=\sup_{A\text{ Nash}}\frac{\mathrm{SUM}(A)}{\mathrm{opt}},\qquad \mathrm{opt}=\min_{P}\mathrm{SUM}(P),PA=A Nashsup​optSUM(A)​,opt=Pmin​SUM(P),

the minimum taken over pure strategy profiles. In Lean these objects are CongestionGame, load, cost, IsProfile, IsPureNash, sumCost and IsLinear in the namespace CongestionPoA.AsymSum.

Formalization targets

Goal: the pure price of anarchy is exactly 5/2

The goal theorem pure_poa_sum_eq_five_halves is the conjunction of Theorems 1 and 2 of the paper:

for every linear game, Nash A and profile P:SUM(A)≤52 SUM(P),\text{for every linear game, Nash } A \text{ and profile } P:\quad \mathrm{SUM}(A)\le\tfrac52\,\mathrm{SUM}(P),for every linear game, Nash A and profile P:SUM(A)≤25​SUM(P), for every N≥3 there are a linear game with N players, Nash A and profile P:SUM(A)=52 SUM(P).\text{for every } N\ge3 \text{ there are a linear game with } N \text{ players, Nash } A \text{ and profile } P:\quad \mathrm{SUM}(A)=\tfrac52\,\mathrm{SUM}(P).for every N≥3 there are a linear game with N players, Nash A and profile P:SUM(A)=25​SUM(P).

The first part is the upper bound; the second shows that it is attained for every number of players from three on.

Milestones

  1. Lemma 1: β(α+1)≤13α2+53β2\beta(\alpha+1)\le\frac13\alpha^2+\frac53\beta^2β(α+1)≤31​α2+35​β2 for nonnegative integers α,β\alpha,\betaα,β.
  2. Deviation inequality (proof of Theorem 1): at a Nash equilibrium AAA, ci(A)≤ci(A−i,Pi)≤∑e∈Pife(ne(A)+1)c_i(A)\le c_i(A_{-i},P_i)\le\sum_{e\in P_i}f_e(n_e(A)+1)ci​(A)≤ci​(A−i​,Pi​)≤∑e∈Pi​​fe​(ne​(A)+1).
  3. Summing over players (proof of Theorem 1): SUM(A)≤∑e∈Ene(P) fe(ne(A)+1)\mathrm{SUM}(A)\le\sum_{e\in E}n_e(P)\,f_e(n_e(A)+1)SUM(A)≤∑e∈E​ne​(P)fe​(ne​(A)+1).
  4. Theorem 1: the upper bound SUM(A)≤52SUM(P)\mathrm{SUM}(A)\le\frac52\mathrm{SUM}(P)SUM(A)≤25​SUM(P).
  5. Theorem 2: the matching instances for every N≥3N\ge3N≥3.

Significance

The value 5/25/25/2 is the benchmark for atomic congestion with affine costs. It is the reference point for the later results of the paper (the symmetric case (5N−2)/(2N+1)(5N-2)/(2N+1)(5N−2)/(2N+1), the maximum social cost Θ(N)\Theta(\sqrt N)Θ(N​), mixed equilibria (3+5)/2(3+\sqrt5)/2(3+5​)/2) and for a large literature on coordination mechanisms, taxes and the price of stability, which compare their guarantees against it. The bound is also the standard example of what later became the smoothness framework, through which the same constant governs mixed and coarse correlated equilibria and hence no-regret learning outcomes.

Both theorems are proved in the paper; nothing here is open. The proofs for affine latencies, however, are only indicated: the paper displays the identity case fe(k)=kf_e(k)=kfe​(k)=k and states that the arguments extend. The mission states the affine case and asks for complete machine-checked proofs, including the lower-bound construction, which the paper describes and declares "not hard to verify". No machine-checked proof of these results is on the platform.

Difficulty

The Nash conditions give one inequality per player, each mixing the equilibrium loads ne(A)n_e(A)ne​(A) with the strategies PiP_iPi​ of the comparison profile. Bounding the loads crudely, for instance by the number of players, gives a ratio that grows with NNN; the constant 5/25/25/2 requires comparing the cross term ∑ene(P) ne(A)\sum_e n_e(P)\,n_e(A)∑e​ne​(P)ne​(A) with both social costs simultaneously and with the right weights. The integrality of the loads matters at that point: the natural pointwise inequality is false for real arguments, so a proof that treats loads as real numbers cannot reach 5/25/25/2.

For the lower bound, a Nash equilibrium must be verified against every unilateral deviation of every player, for all N≥3N\ge3N≥3 at once, in a construction with cyclic indices. The case N=2N=2N=2 is genuinely different (the paper states that its price of anarchy is 222), so the argument has to use N≥3N\ge3N≥3.

Formalization scope

Players and facilities are finite types; a profile is a map from players to finite sets of facilities, and feasibility (Ai∈ΣiA_i\in\Sigma_iAi​∈Σi​) is a separate predicate. Latencies are real-valued functions of the natural-number load, and "linear" means affine with nonnegative coefficients. The upper bound is stated multiplicatively, for every Nash AAA and every feasible PPP, which is equivalent to PA≤5/2PA\le5/2PA≤5/2 and avoids dividing by opt\mathrm{opt}opt. The lower bound quantifies over players Fin N, N≥3N\ge3N≥3, and existentially over a finite facility type, a linear game, a Nash equilibrium and an optimal feasible profile of positive social cost. The positivity rules out the trivializing witness: in the all-zero latency game every profile is a Nash equilibrium and 0=52⋅00=\frac52\cdot00=25​⋅0. The Nash condition is the paper's cost form; it agrees with the payoff-form AGT.IsPureNash of agt_games for payoffs −ci-c_i−ci​.

Trivializing formalizations are ruled out: the comparison profile PPP must be feasible (otherwise SUM(P)\mathrm{SUM}(P)SUM(P) could be 000 by letting players use no facility), the upper bound covers all affine latencies rather than only fe(k)=kf_e(k)=kfe​(k)=k, and the lower-bound instance must have linear latencies with nonnegative coefficients.

A complete development needs finite double counting (regrouping ∑i∑e∈Pi\sum_i\sum_{e\in P_i}∑i​∑e∈Pi​​ by facilities), monotonicity of affine latencies, and a decidable or explicit check of the lower-bound game. The congestion-game layer is reused by the other missions of this series. Proofs of individual milestones, and alternative proofs of the upper bound, are welcome.

Selected references

  • G. Christodoulou and E. Koutsoupias, The Price of Anarchy of Finite Congestion Games, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060600
  • B. Awerbuch, Y. Azar and A. Epstein, The Price of Routing Unsplittable Flow, Proc. 37th ACM STOC, 2005. https://doi.org/10.1145/1060590.1060599
  • E. Koutsoupias and C. Papadimitriou, Worst-case Equilibria, STACS 1999, LNCS 1563. https://doi.org/10.1007/3-540-49116-3_38
  • R. W. Rosenthal, A Class of Games Possessing Pure-Strategy Nash Equilibria, International Journal of Game Theory 2, 1973. https://doi.org/10.1007/BF01737559
  • T. Roughgarden and É. Tardos, How Bad Is Selfish Routing?, Journal of the ACM 49(2), 2002. https://doi.org/10.1145/506147.506153
  • T. Roughgarden, Intrinsic Robustness of the Price of Anarchy, Proc. 41st ACM STOC, 2009. https://doi.org/10.1145/1536414.1536485
7 thms3 active usersReviewed
🏆Completed
Linear OptimizationOptimization·Captain: mikedeng1

A Multicut Algorithm for Two-Stage Stochastic Linear Programs 1: Worst-Case Bound on Multicut Major IterationsResearch Paper

Motivation

Two-stage stochastic linear programs with recourse are a standard model for planning under uncertainty: a first-stage decision xxx is taken before a random outcome ξ\xiξ is observed, and a second-stage (recourse) decision yyy corrects for it afterwards at a cost. When ξ\xiξ has finitely many realizations, the problem is a large but structured linear program, and the classical way to solve it is the L-shaped method of Van Slyke and Wets (1969), a Benders-type outer linearization of the expected recourse cost.

Birge and Louveaux (1988) proposed the multicut L-shaped algorithm: instead of one cut on the expected recourse function per iteration, it adds one cut per realization. They compared the two methods by worst-case counts of major iterations (the operations between two returns to the master problem), and showed that the multicut count grows linearly in the number KKK of realizations, while their bound for the single-cut method grows like Km2K^{m_2}Km2​. The multicut idea is now part of every textbook treatment of decomposition for stochastic programming (Birge and Louveaux, Introduction to Stochastic Programming, Ch. 5) and of most production implementations of Benders decomposition.

Setting

The data are a matrix A∈Rm1×n1A\in\mathbb R^{m_1\times n_1}A∈Rm1​×n1​, vectors bbb, ccc, a fixed recourse matrix W∈Rm2×n2W\in\mathbb R^{m_2\times n_2}W∈Rm2​×n2​, and KKK realizations k=1,…,Kk=1,\dots,Kk=1,…,K, each with a cost qk∈Rn2q_k\in\mathbb R^{n_2}qk​∈Rn2​, a right-hand side hk∈Rm2h_k\in\mathbb R^{m_2}hk​∈Rm2​, a technology matrix Tk∈Rm2×n1T_k\in\mathbb R^{m_2\times n_1}Tk​∈Rm2​×n1​ and a probability pkp_kpk​. Row vectors are written without transposes, as in the paper. The second-stage value of realization kkk is

Qk(x)=min⁡{ qky∣Wy=hk−Tkx, y≥0 }∈R∪{±∞},Q_k(x)=\min\{\,q_k y\mid Wy=h_k-T_kx,\ y\ge 0\,\}\in\mathbb R\cup\{\pm\infty\},Qk​(x)=min{qk​y∣Wy=hk​−Tk​x, y≥0}∈R∪{±∞},

the expected recourse is Ω(x)=∑kpkQk(x)\Omega(x)=\sum_k p_kQ_k(x)Ω(x)=∑k​pk​Qk​(x), and the deterministic equivalent (2) minimizes cx+Ω(x)cx+\Omega(x)cx+Ω(x) over K1∩K2K_1\cap K_2K1​∩K2​, where K1={x∣Ax=b, x≥0}K_1=\{x\mid Ax=b,\ x\ge 0\}K1​={x∣Ax=b, x≥0} and K2K_2K2​ is the set of xxx for which every second-stage problem is feasible.

The multicut algorithm keeps feasibility cuts (Dl,dl)(D_l,d_l)(Dl​,dl​) and, for each kkk, optimality cuts (El(k),el(k))(E_{l(k)},e_{l(k)})(El(k)​,el(k)​). Step 1 solves the master

min⁡ cx+∑kθks.t. Ax=b, x≥0, Dlx≥dl, El(k)x+θk≥el(k),\min\ cx+\sum_{k}\theta_k\quad\text{s.t. } Ax=b,\ x\ge0,\ D_lx\ge d_l,\ E_{l(k)}x+\theta_k\ge e_{l(k)},min cx+k∑​θk​s.t. Ax=b, x≥0, Dl​x≥dl​, El(k)​x+θk​≥el(k)​,

ignoring θk\theta_kθk​ when scenario kkk has no cut. Step 2 tests feasibility of each scenario at the master solution xνx^\nuxν and, at the first infeasible one, adds a feasibility cut (σTk,σhk)(\sigma T_k,\sigma h_k)(σTk​,σhk​) from the simplex multiplier σ\sigmaσ of a phase-one LP. Step 3 solves each second-stage problem at xνx^\nuxν with simplex multiplier πk\pi_kπk​; for every kkk with θk<pkπk(hk−Tkxν)\theta_k<p_k\pi_k(h_k-T_kx^\nu)θk​<pk​πk​(hk​−Tk​xν) (condition (14)) it adds the optimality cut (pkπkTk, pkπkhk)(p_k\pi_kT_k,\ p_k\pi_kh_k)(pk​πk​Tk​, pk​πk​hk​). If no kkk satisfies (14) the algorithm stops.

The cut set Ck\mathcal C_kCk​ is the finite set of all optimality cuts that Step 3 can produce for scenario kkk: the cuts of simplex-optimal bases of the scenario-kkk problem at points of K1K_1K1​.

Formalization targets

Goal: the iteration bound (17)

The paper states (Theorem, p. 388):

Let b be the slope number of the second stage of (2). Then, the maximum number of iterations for the multicut algorithm is 1 + K(b^{m₂} − 1) (17) while the maximum number of iterations for the L-shaped algorithm is [1 + K(b − 1)]^{m₂} (18) where K is the number of the different realizations of ξ.

The goal is (17) with the number of facets replaced by the number of distinct cuts: if ∣Ck∣≤M|\mathcal C_k|\le M∣Ck​∣≤M for every kkk and M≥1M\ge1M≥1, then in every run of the algorithm, for every choice of optimal master solutions and optimal bases,

#{returns to Step 1 from Step 3} ≤ 1+K(M−1).\#\{\text{returns to Step 1 from Step 3}\}\ \le\ 1+K(M-1).#{returns to Step 1 from Step 3} ≤ 1+K(M−1).

Milestones

  1. The feasibility cuts determine K2K_2K2​ (a point lies in K2K_2K2​ exactly when it satisfies every feasibility cut, §2, p. 385), and each optimality cut is an affine minorant of pkQkp_kQ_kpk​Qk​ touching it where it was generated (the multicut algorithm outer-linearizes each QkQ_kQk​, p. 387).
  2. Aggregating one cut per scenario gives a valid L-shaped cut, and z(multi)≥z(L-shaped)z(\text{multi})\ge z(\text{L-shaped})z(multi)≥z(L-shaped) (proof of the Proposition, p. 387).
  3. When (14) holds for no kkk, xνx^\nuxν is optimal for (2) (stopping rule, p. 387).
  4. The first return from Step 3 records one cut for each scenario, and every return records at least one cut not recorded before (proof of the Theorem, p. 388).

Significance

The bound explains why the multicut method needs few major iterations: the information sent to the master grows additively over scenarios, while the facets of Ω\OmegaΩ are combinations of facets of the QkQ_kQk​ and their number can grow multiplicatively. The paper itself notes the trade-off this creates against master size (m1+Km_1+Km1​+K rows instead of m1+1m_1+1m1​+1), which is the basis of later work on partial aggregation of cuts.

The mission produces a formal model of the multicut algorithm as a transition system over all admissible choices, valid-cut lemmas for both cut types with dual feasibility made explicit, the correctness of the stopping rule, and the counting argument. These results are proved on paper but, to our knowledge, no machine-checked version of the multicut L-shaped algorithm or its iteration bound exists. The model is reusable for other results on Benders-type methods for stochastic programs.

Difficulty

The counting argument is short once the right invariants are in place; the difficulty is the invariants. A cut recorded earlier must still be satisfied by the current master solution, while the cut added for a scenario satisfying (14) is violated by it, so the new cut differs from every recorded one. This uses that every recorded cut comes from a basis whose multiplier is dual feasible: a basis that merely attains the optimal value under degeneracy can produce a cut that is not valid. The stopping rule needs strong duality at the final bases and weak duality at all earlier ones, together with extended-real bookkeeping of QkQ_kQk​ on points where a scenario is infeasible.

Formalization scope

The model is the published StochasticProg_Recourse_Instance (QkQ_kQk​ in EReal, +∞+\infty+∞ when infeasible) with simplex bases and multipliers from StochasticProg_LShaped_Bases. Vectors are Fin n → ℝ, scenarios Fin K. A simplex-optimal basis is defined locally: invertible basic submatrix, nonnegative basic solution, and dual-feasible multiplier (πW≤qk\pi W\le q_kπW≤qk​; for the phase-one LP, σW≤0\sigma W\le 0σW≤0 and ∣σi∣≤1|\sigma_i|\le 1∣σi​∣≤1). The algorithm is an inductive step relation on states (feasibility cuts, per-scenario cut lists, return counter); a run is any finite sequence of steps from the empty state. Master optima are attained optimal solutions, not infima.

Pinned-down readings:

  • The paper writes the bound with bm2b^{m_2}bm2​, from its slope number bbb, and asserts without derivation that each QkQ_kQk​ has at most bm2b^{m_2}bm2​ facets. We state the bound for any MMM bounding the number of distinct cuts of each scenario, which is what the paper's proof counts. The L-shaped bound (18) is not stated.
  • "Iterations" are returns to Step 1 from Step 3. The final, stopping solve is not counted, consistent with Appendix A (four facets of Ω\OmegaΩ, five L-shaped solves; two multicut returns), and Step-2 (feasibility) returns are not counted, as in the paper's bound.
  • Positive probabilities pk>0p_k>0pk​>0 are assumed where K2K_2K2​ or optimality appears (the paper's realizations form the support of ξ\xiξ).
  • A scenario with no optimality cut has θk\theta_kθk​ omitted from the objective and always satisfies (14).

The transition relation allows every choice the paper allows; a relation that fixed, say, a particular basis or a particular master solution would prove a bound for fewer runs, and one that required the cut set to be smaller than the paper's would make the bound easy. Neither is done here.

Contributions welcome: proofs of the milestones, a sorry-free proof of the goal from them, and a worked check that the definitions admit the run of Appendix A.

Selected references

  • J. R. Birge and F. V. Louveaux, A multicut algorithm for two-stage stochastic linear programs, European Journal of Operational Research 34 (1988) 384–392. https://doi.org/10.1016/0377-2217(88)90159-2
  • R. M. Van Slyke and R. J.-B. Wets, L-shaped linear programs with applications to optimal control and stochastic programming, SIAM Journal on Applied Mathematics 17 (1969) 638–663. https://doi.org/10.1137/0117061
  • J. F. Benders, Partitioning procedures for solving mixed-variables programming problems, Numerische Mathematik 4 (1962) 238–252. https://doi.org/10.1007/BF01386316
  • J. R. Birge and F. Louveaux, Introduction to Stochastic Programming, 2nd ed., Springer, 2011. https://doi.org/10.1007/978-1-4614-0237-4
12 thms3 active usersReviewed
🏆Completed
Theoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 4: Restarting a Bounded-Cost Algorithm Is (1+ε)α-Competitive in Games of Finite DiameterResearch Paper

Motivation

Competitive analysis compares an online algorithm, which must answer each request before seeing the next, with the optimal off-line solution of the same request sequence. Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994) set up a general framework, request-answer games, in which paging, the KKK-server problem and metrical task systems are all instances, and used it to compare the power of randomized algorithms against several kinds of adversaries.

One of their results (Theorem 2.1) says that if a randomized algorithm is α\alphaα-competitive against every adaptive off-line adversary, then some deterministic algorithm is already α\alphaα-competitive. The argument is a game-theoretic existence proof: it says nothing about how to compute the deterministic algorithm. Section 4 of the paper, "A Constructive Version of Theorem 2.1", answers the natural follow-up question for a large class of games: under monotonicity, locality and a finite diameter, a deterministic algorithm that loses only a factor 1+ϵ1+\epsilon1+ϵ can be assembled from a finite object.

Setting

A request-answer game FFF has a request set RRR, a finite answer set AAA, and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb{R}fn​:Rn×An→R, n≥0n \ge 0n≥0; f0f_0f0​ is the cost of the empty play. The off-line optimum of a request sequence rrr of length nnn is c(r)=min⁡a∈Anfn(r,a)c(r) = \min_{a \in A^n} f_n(r, a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm GGG answers the iii-th request by a function gi(r1,…,ri)g_i(r_1, \dots, r_i)gi​(r1​,…,ri​) of the requests so far; its cost on rrr is cG(r)=fn(r,G(r))c_G(r) = f_n(r, G(r))cG​(r)=fn​(r,G(r)). It is α\alphaα-competitive if cG(r)≤α(c(r))c_G(r) \le \alpha(c(r))cG​(r)≤α(c(r)) for every rrr.

The game is monotone if fn+1(rt,ab)≥fn(r,a)f_{n+1}(rt, ab) \ge f_n(r, a)fn+1​(rt,ab)≥fn​(r,a) always, and local if for every h>0h > 0h>0 only finitely many request sequences have c(r)≤hc(r) \le hc(r)≤h. The discrepancy of two request-answer sequences is

δ((r,a),(r′,a′))=f(rr′,aa′)−f(r,a)−f(r′,a′),\delta((r,a),(r',a')) = f(rr', aa') - f(r,a) - f(r',a'),δ((r,a),(r′,a′))=f(rr′,aa′)−f(r,a)−f(r′,a′),

and the diameter D(F)D(F)D(F) is the supremum of ∣δ∣|\delta|∣δ∣ over all pairs.

For a real HHH, the set RHR_HRH​ consists of the request sequences all of whose proper prefixes have off-line optimum at most HHH. Given a deterministic algorithm AHA_HAH​, the restart algorithm simulates AHA_HAH​ and, as soon as the request sequence leaves RHR_HRH​, starts over as if it had received no previous requests. This cuts every request sequence into segments r=r(1) r(2)⋯r(t)r = r(1)\, r(2) \cdots r(t)r=r(1)r(2)⋯r(t), each a longest prefix in RHR_HRH​ of what remains.

Formalization targets

Goal: Theorem 4.1 through its construction

Let FFF be monotone and local, with finite nonempty RRR and AAA, f0≥0f_0 \ge 0f0​≥0, and diameter at most DDD. Let α(x)=d x\alpha(x) = d\,xα(x)=dx with d≥1d \ge 1d≥1, ϵ>0\epsilon > 0ϵ>0, and

H=(2+ϵ)Dϵ.H = \frac{(2+\epsilon) D}{\epsilon}.H=ϵ(2+ϵ)D​.

Then RHR_HRH​ is finite; the restart algorithm depends on AHA_HAH​ only through its values on RHR_HRH​; and for every AHA_HAH​ with cAH(r)≤α(c(r))c_{A_H}(r) \le \alpha(c(r))cAH​​(r)≤α(c(r)) on RHR_HRH​,

cRestart(r)≤(1+ϵ) α(c(r))for all request sequences r.c_{\mathrm{Restart}}(r) \le (1+\epsilon)\,\alpha(c(r)) \qquad \text{for all request sequences } r.cRestart​(r)≤(1+ϵ)α(c(r))for all request sequences r.

Milestones (proof of Theorem 4.1, pp. 17–18)

  1. RHR_HRH​ is finite.
  2. The restart rule produces the greedy decomposition into longest prefixes in RHR_HRH​.
  3. The restart algorithm answers AH(r(1)),AH(r(2)),…,AH(r(t))A_H(r(1)), A_H(r(2)), \dots, A_H(r(t))AH​(r(1)),AH​(r(2)),…,AH​(r(t)).
  4. c(r(i))≥Hc(r(i)) \ge Hc(r(i))≥H for i=1,…,t−1i = 1, \dots, t-1i=1,…,t−1.
  5. c(r)≥c(r(1))+∑i=2t(c(r(i))−D(F))c(r) \ge c(r(1)) + \sum_{i=2}^{t} (c(r(i)) - D(F))c(r)≥c(r(1))+∑i=2t​(c(r(i))−D(F)).
  6. cRestart(r)≤α(c(1))+∑i=2t(α(c(i))+D(F))c_{\mathrm{Restart}}(r) \le \alpha(c(1)) + \sum_{i=2}^{t} (\alpha(c(i)) + D(F))cRestart​(r)≤α(c(1))+∑i=2t​(α(c(i))+D(F)).

Significance

Theorem 2.1 shows that, against adaptive off-line adversaries, randomization gives no advantage, but only as an existence statement. Theorem 4.1 turns it into a recipe: a deterministic algorithm need only be good on the finite set RHR_HRH​, which can be prepared in advance, and restarting extends it to all inputs at a loss of 1+ϵ1+\epsilon1+ϵ. The paper illustrates this with KKK-server problems on finite graphs, where AHA_HAH​ is a finite table and each step of the resulting algorithm costs one dynamic-programming evaluation of an off-line optimum.

The restart construction is of independent use: it is a general way to turn a guarantee on bounded-cost inputs into a guarantee on all inputs when the cost is nearly additive over concatenation.

To our knowledge neither the abstract request-answer game model nor this theorem has a machine-checked proof. The mission produces a formal model of request-answer games with the monotonicity, locality and diameter conditions, the restart algorithm as an explicit definition, and the full chain of inequalities of the proof.

Difficulty

The individual inequalities are elementary; the work lies in the bookkeeping of the construction. The algorithm is defined online, one request at a time, while the analysis is phrased through the decomposition of the whole sequence. Relating the two requires showing that the online rule produces exactly the decomposition into longest prefixes in RHR_HRH​, and that the answers produced on each segment are those of AHA_HAH​ run from scratch, so that the cost of the whole play can be compared with the costs on the segments. The constants must close exactly: with H=(2+ϵ)D/ϵH = (2+\epsilon)D/\epsilonH=(2+ϵ)D/ϵ the additive losses at the t−1t-1t−1 cuts, on both the algorithm's side and the optimum's side, must be absorbed by the factor 1+ϵ1+\epsilon1+ϵ, and they do so only for ratios d≥1d \ge 1d≥1.

A tempting shortcut is to conclude Theorem 4.1 from Theorem 2.1 directly: a deterministic α\alphaα-competitive algorithm is trivially (1+ϵ)α(1+\epsilon)\alpha(1+ϵ)α-competitive when costs are nonnegative. This proves the sentence of the theorem without its point, and is ruled out below.

Formalization scope

  • Request and answer sequences are Lean Lists, oldest first; fn(r,a)f_n(r,a)fn​(r,a) is F.cost r a with r.length = a.length. Costs are real-valued (the paper allows +∞+\infty+∞; real costs are a special case).
  • The answer set is a Fintype and nonempty; in the goal the request set is a Fintype and nonempty.
  • A deterministic algorithm is one function List R → A. Competitiveness of a deterministic algorithm against adaptive off-line adversaries is stated as competitiveness on every request sequence, which is equivalent for deterministic algorithms (p. 8).
  • Finite diameter is a real bound DDD with ∣δ∣≤D|\delta| \le D∣δ∣≤D for all pairs, and every statement holds for every such DDD, in particular D=D(F)D = D(F)D=D(F); no real supremum is taken.
  • f0≥0f_0 \ge 0f0​≥0 is assumed in the goal; with monotonicity it makes every cost nonnegative. It holds in the paper's examples.
  • α(x)=d x\alpha(x) = d\,xα(x)=dx with d≥1d \ge 1d≥1 in the goal; the cost bound for the restart algorithm (milestone 6) holds for an arbitrary α\alphaα.
  • HHH is fixed to the paper's value (2+ϵ)D/ϵ(2+\epsilon)D/\epsilon(2+ϵ)D/ϵ.
  • The restart algorithm is a definition (a left fold over the requests), not a hypothesis. The paper's assumption of a randomized algorithm competitive against adaptive off-line adversaries is used only, through Theorem 2.1, to obtain AHA_HAH​; the goal quantifies over every AHA_HAH​ that is α\alphaα-competitive on RHR_HRH​. "Computable" has no precise meaning for real costs; its content is the finiteness of RHR_HRH​ together with the fact that the restart algorithm reads AHA_HAH​ only on RHR_HRH​. A formalization that proves only the existence of a deterministic (1+ϵ)α(1+\epsilon)\alpha(1+ϵ)α-competitive algorithm, without the construction, does not meet the goal.
  • Milestones 5 and 6 are stated for nonempty request sequences, so that t≥1t \ge 1t≥1; milestone 5 is stated for every decomposition into consecutive pieces.

Contributions welcome: proofs of the milestones, and a connection to the other missions of this series, where the randomized model and Theorem 2.1 are formalized.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994). https://doi.org/10.1007/BF01294260
  • M. Chrobak, H. Karloff, T. Payne, S. Vishwanathan, New results on server problems, SIAM Journal on Discrete Mathematics 4 (1991), 172–181. https://doi.org/10.1137/0404017
10 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 3: An Augmented Potential Function Yields an Explicit Deterministic α∘β-Competitive AlgorithmResearch Paper

Motivation

Competitive analysis measures an online algorithm, which must answer each request before seeing the next, against the best off-line answer to the whole request sequence. Randomized online algorithms are often much better than deterministic ones against an oblivious adversary, who fixes the requests in advance; the paging problem is the standard example. Against an adaptive adversary, who sees the algorithm's answers before choosing the next request, the advantage can disappear.

Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994; preliminary version STOC 1990) made this precise in an abstract framework of request-answer games. Their Corollary 2.1 says: if a game has a randomized algorithm that is α\alphaα-competitive against adaptive on-line adversaries and one that is β\betaβ-competitive against oblivious adversaries, then it has a deterministic α∘β\alpha\circ\betaα∘β-competitive algorithm. That proof is non-constructive: it goes through a game-theoretic determinacy argument. Section 3 of the paper gives a constructive version. Most competitive analyses of randomized algorithms against adaptive adversaries are carried out with a potential function, in the style of Manasse, McGeoch and Sleator (J. Algorithms 11, 1990). The paper shows that such a potential function, together with any oblivious-competitive algorithm HHH, determines an explicit deterministic algorithm MMM, answer by answer. This mission formalizes that construction and its guarantee.

Setting

A request-answer game has a request set RRR, a finite answer set AAA and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb Rfn​:Rn×An→R. The off-line optimum of r∈Rnr \in R^nr∈Rn is c(r)=min⁡a∈Anfn(r,a)c(r) = \min_{a \in A^n} f_n(r, a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm MMM is a sequence of maps mi:Ri→Am_i : R^i \to Ami​:Ri→A; on r=(r1,…,rn)r = (r_1,\dots,r_n)r=(r1​,…,rn​) it answers M(r)=(m1(r1),m2(r1,r2),…,mn(r))M(r) = (m_1(r_1), m_2(r_1,r_2), \dots, m_n(r))M(r)=(m1​(r1​),m2​(r1​,r2​),…,mn​(r)), at cost cM(r)=fn(r,M(r))c_M(r) = f_n(r, M(r))cM​(r)=fn​(r,M(r)). It is α\alphaα-competitive if cM(r)≤α(c(r))c_M(r) \le \alpha(c(r))cM​(r)≤α(c(r)) for all rrr. Throughout, α\alphaα and β\betaβ are affine maps R→R\mathbb R \to \mathbb RR→R (the paper's "linear functions").

A randomized online algorithm HHH is a probability distribution over deterministic algorithms HyH_yHy​; it is β\betaβ-competitive against any oblivious adversary if Ey[fn(r,Hy(r))]≤β(c(r))\mathbb E_y[f_n(r, H_y(r))] \le \beta(c(r))Ey​[fn​(r,Hy​(r))]≤β(c(r)) for all rrr. The algorithm GGG analysed by the potential function is described by its next-answer laws gn+1(rrn+1,a)g_{n+1}(r r_{n+1}, a)gn+1​(rrn+1​,a) on AAA, given the requests so far, the new request and its own past answers. An adaptive on-line adversary SSS chooses each request from the algorithm's past answers and answers it itself, before the algorithm does, for at most dQd_QdQ​ rounds; a configuration after nnn rounds is (r,a,b)∈Rn×An×An(r, a, b) \in R^n \times A^n \times A^n(r,a,b)∈Rn×An×An: requests, algorithm's answers, adversary's answers.

An augmented potential function for α\alphaα and GGG (Definition 3.1) is a family Φn:Rn×An×An→R\Phi_n : R^n \times A^n \times A^n \to \mathbb RΦn​:Rn×An×An→R with (1) Φ0=0\Phi_0 = 0Φ0​=0; (2) Φn(r,a,b)≤α(fn(r,b))−fn(r,a)\Phi_n(r,a,b) \le \alpha(f_n(r,b)) - f_n(r,a)Φn​(r,a,b)≤α(fn​(r,b))−fn​(r,a) for every configuration; (3) Ean+1∼gn+1(rrn+1,a)[Φn+1(rrn+1,aan+1,bbn+1)]≥Φn(r,a,b)\mathbb E_{a_{n+1} \sim g_{n+1}(r r_{n+1}, a)}[\Phi_{n+1}(r r_{n+1}, a a_{n+1}, b b_{n+1})] \ge \Phi_n(r,a,b)Ean+1​∼gn+1​(rrn+1​,a)​[Φn+1​(rrn+1​,aan+1​,bbn+1​)]≥Φn​(r,a,b) for every configuration, every rn+1∈Rr_{n+1} \in Rrn+1​∈R and every bn+1∈Ab_{n+1} \in Abn+1​∈A.

Formalization targets

Goal: Theorem 3.1 (p. 15)

Let Φ\PhiΦ be an augmented potential function for α\alphaα and GGG, and HHH a β\betaβ-competitive algorithm against oblivious adversaries. Say that MMM obeys the potential rule if for every r∈Rnr \in R^nr∈Rn and r′=rtr' = rtr′=rt,

Ey[Φn+1(r′,M(r) mn+1(r′),Hy(r′))] ≥ Ey[Φn(r,M(r),Hy(r))].\mathbb E_y\big[\Phi_{n+1}(r', M(r)\,m_{n+1}(r'), H_y(r'))\big] \ \ge\ \mathbb E_y\big[\Phi_n(r, M(r), H_y(r))\big].Ey​[Φn+1​(r′,M(r)mn+1​(r′),Hy​(r′))] ≥ Ey​[Φn​(r,M(r),Hy​(r))].

Then such an MMM exists, and every such MMM satisfies

cM(r)≤α(β(c(r)))for all r.c_M(r) \le \alpha\big(\beta(c(r))\big) \quad \text{for all } r .cM​(r)≤α(β(c(r)))for all r.

Both parts are part of the goal: the rule can be followed, and following it guarantees α∘β\alpha\circ\betaα∘β-competitiveness.

Milestones

  1. In every play of GGG against an adaptive on-line adversary, the expected final potential is nonnegative (proof of Lemma 3.1).
  2. Lemma 3.1, "if" direction: an augmented potential function for α\alphaα and GGG makes GGG α\alphaα-competitive against any adaptive on-line adversary, E[cG(S)]≤E[α(cS(G))]\mathbb E[c_G(S)] \le \mathbb E[\alpha(c_S(G))]E[cG​(S)]≤E[α(cS​(G))].
  3. For every rrr, ttt and every a∈Ana \in A^na∈An, some a′∈Aa' \in Aa′∈A satisfies Ey[Φn+1(rt,aa′,Hy(rt))]≥Ey[Φn(r,a,Hy(r))]\mathbb E_y[\Phi_{n+1}(rt, aa', H_y(rt))] \ge \mathbb E_y[\Phi_n(r, a, H_y(r))]Ey​[Φn+1​(rt,aa′,Hy​(rt))]≥Ey​[Φn​(r,a,Hy​(r))].
  4. If MMM obeys the rule, Ey[Φn(r,M(r),Hy(r))]≥0\mathbb E_y[\Phi_n(r, M(r), H_y(r))] \ge 0Ey​[Φn​(r,M(r),Hy​(r))]≥0 for every rrr.
  5. If MMM obeys the rule, fn(r,M(r))≤Ey[α(fn(r,Hy(r)))]f_n(r, M(r)) \le \mathbb E_y[\alpha(f_n(r, H_y(r)))]fn​(r,M(r))≤Ey​[α(fn​(r,Hy​(r)))] for every rrr: MMM is α\alphaα-competitive against the randomized adaptive adversary that serves its requests with HHH.

Significance

The theorem turns two separate analyses into one deterministic algorithm with an explicit description. The potential function certifies GGG against the strongest on-line adversary; the oblivious algorithm HHH need not be related to GGG, and the paper remarks that HHH may be GGG itself. The next answer of MMM is computable whenever the expected potential under HHH is (Corollary 3.1, stated informally in the paper), and the paper notes that for the potential functions used in the KKK-server literature this expectation is computable in time polynomial in the number of nodes and KKK. Read in this light, a potential-function proof for a randomized algorithm doubles as a deterministic algorithm.

The result is proved in the paper. As far as is known, neither this theorem nor the abstract framework of request-answer games with adaptive adversaries has a machine-checked formalization. The mission produces that framework and a checked derandomization principle that applies to every request-answer game with real costs, not to one problem.

Difficulty

The obvious argument for the existence of mn+1(r′)m_{n+1}(r')mn+1​(r′) averages property (3) of Φ\PhiΦ; the work is in seeing which configuration to apply it to. The rule compares MMM's configuration against HyH_yHy​'s answers, not against an adversary playing GGG, and the paper argues through an auxiliary on-line adversary that asks r′r'r′ and serves it with HyH_yHy​. Making this rigorous requires interchanging the expectation over HHH's coins with the finite expectation over GGG's next answer, and checking that the needed expectations are finite.

The second difficulty is the two kinds of randomness. GGG enters only through its next-answer laws, while HHH must be a single distribution over deterministic algorithms: the rule evaluates Hy(r)H_y(r)Hy​(r) and Hy(r′)H_y(r')Hy​(r′) with the same coins yyy. Replacing HHH by a behavioural description breaks the coupling between consecutive rounds.

Formalization scope

Requests and answers are Lean lists, oldest first, and fn(r,a)f_n(r,a)fn​(r,a) is F.cost r a on lists of common length; values on lists of different lengths are never used. Costs are real: the paper allows fn=+∞f_n = +\inftyfn​=+∞, so every statement here is about the real-valued games. The answer type is finite and nonempty, so the minimum c(r)c(r)c(r) exists. Affine maps are written α(x)=cx+d\alpha(x) = c x + dα(x)=cx+d. The goal additionally assumes α\alphaα nondecreasing: the last step of the paper's proof applies α\alphaα to an inequality, which needs it, and the paper's examples are positive ratios. In Lemma 3.1 and milestone 5 linearity of α\alphaα is kept as the paper's standing convention, although with α\alphaα inside the expectation the argument does not use it.

GGG is a map from (requests, own answers) to a probability mass function on AAA (behavioural form); its play against an adaptive on-line adversary is a probability mass function on final configurations, with finite support, and its expectations are finite sums. HHH is a probability measure on a coin space with a deterministic algorithm per coin, each answer measurable in the coins; expectations over HHH are Bochner integrals of functions with finitely many values. α\alphaα stays inside expectations, as in the paper's definition of competitiveness against adaptive adversaries. Adversaries stop by returning none and have a uniform depth bound.

The goal cannot be satisfied vacuously: it states the existence of an algorithm obeying the rule alongside the guarantee for every such algorithm, and Definition 3.1 is required at every configuration, not only at reachable ones.

Not formalized: the "only if" direction of Lemma 3.1, which the paper only sketches, and Corollary 3.1, whose notion of computability the paper leaves unspecified. The definitions of request-answer games, online algorithms, adversaries and competitiveness are reusable for the other missions of this paper and for any problem-specific competitive analysis. Contributions welcome: proofs of the milestones, and a lemma relating the mixed and behavioural forms of a randomized algorithm.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994), 2–14. https://doi.org/10.1007/BF01294260
  • M. Manasse, L. McGeoch, D. Sleator, Competitive algorithms for server problems, Journal of Algorithms 11 (1990), 208–230. https://doi.org/10.1016/0196-6774(90)90003-W
  • D. Sleator, R. Tarjan, Amortized efficiency of list update and paging rules, Communications of the ACM 28 (1985), 202–208. https://doi.org/10.1145/2786.2793
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998. ISBN 0-521-56392-5
9 thms3 active usersReviewed
🏆Completed
Linear OptimizationStochastic Systems·Captain: mikedeng1

Optimization of Multiclass Queueing Networks: Polyhedral and Nonlinear Characterizations of Achievable Performance II: An O(n²) Extended Formulation of the Multiclass M/M/1 Performance PolymatroidResearch Paper

Motivation

A single server shared by several classes of customers is the basic model of scheduling under uncertainty: jobs of different types arrive at random, need random amounts of work, and a scheduler decides at every moment which type to serve. A classical way to optimize such a system, the achievable region approach, describes the set of all performance vectors that some scheduling policy can attain, and optimizes a linear cost over that set with linear programming. For the multiclass M/M/1 queue under preemptive, work-conserving scheduling, this set is a polyhedron described by conservation laws (Coffman and Mitrani, 1980; Gelenbe and Mitrani, 1980; Shanthikumar and Yao, 1992): it is the base of a polymatroid, its vertices are the performance vectors of the n!n!n! strict priority rules, and minimizing a linear cost over it is solved greedily, which recovers the cμc\mucμ rule.

That description uses one inequality for every nonempty set of classes, 2n−12^n-12n−1 constraints in all. Bertsimas, Paschalidis and Tsitsiklis (working paper 1992, Annals of Applied Probability 1994) derived performance bounds for general multiclass networks from quadratic potential functions. Specialized to one station, their nonparametric method produces a different polyhedron, in O(n2)O(n^2)O(n2) variables with O(n2)O(n^2)O(n2) constraints, and they show that its projection is exactly the conservation-law polyhedron (Theorem 8.4). The paper remarks that this confirms, for this polymatroid, the belief that problems solvable in polynomial time admit polynomial-size formulations.

Setting

There are nnn customer classes E={1,…,n}E=\{1,\dots,n\}E={1,…,n}. Class iii has arrival rate λi>0\lambda_i>0λi​>0 and service rate μi>0\mu_i>0μi​>0; its traffic intensity is ρi=λi/μi\rho_i=\lambda_i/\mu_iρi​=λi​/μi​, and the queue is stable: ∑i∈Eρi<1\sum_{i\in E}\rho_i<1∑i∈E​ρi​<1. For S⊆ES\subseteq ES⊆E define

b(S)=∑i∈Sρi/μi1−∑i∈Sρi,b(∅)=0.b(S)=\frac{\sum_{i\in S}\rho_i/\mu_i}{1-\sum_{i\in S}\rho_i},\qquad b(\emptyset)=0 .b(S)=1−∑i∈S​ρi​∑i∈S​ρi​/μi​​,b(∅)=0.

In the queue, nin_ini​ is the steady-state mean number of class iii customers and ni/μin_i/\mu_ini​/μi​ their mean remaining work; b(S)b(S)b(S) is the mean work of the classes in SSS when those classes have preemptive priority over the rest.

The performance polymatroid P1 (Theorem 8.3) is the set of (ni)∈R+n(n_i)\in\mathbb R_+^n(ni​)∈R+n​ with

∑i∈Sniμi≥b(S)(S⊂E),∑i∈Eniμi=b(E).\sum_{i\in S}\frac{n_i}{\mu_i}\ge b(S)\quad (S\subset E),\qquad \sum_{i\in E}\frac{n_i}{\mu_i}=b(E).i∈S∑​μi​ni​​≥b(S)(S⊂E),i∈E∑​μi​ni​​=b(E).

For a permutation π=(π1,…,πn)\pi=(\pi_1,\dots,\pi_n)π=(π1​,…,πn​) of EEE, the vector v(π)v(\pi)v(π) is the solution of the triangular system ∑j=1kxπj/μπj=b({π1,…,πk})\sum_{j=1}^{k}x_{\pi_j}/\mu_{\pi_j}=b(\{\pi_1,\dots,\pi_k\})∑j=1k​xπj​​/μπj​​=b({π1​,…,πk​}), k=1,…,nk=1,\dots,nk=1,…,n (Eq. (58) with fiS=1/μif_i^S=1/\mu_ifiS​=1/μi​).

The extended formulation P2 (Theorem 8.4) is the set of nonnegative (ni)i∈E(n_i)_{i\in E}(ni​)i∈E​ and (Iij)i,j∈E(I_{ij})_{i,j\in E}(Iij​)i,j∈E​ satisfying

μiIii−λini=λi,μiIij+μjIji−λjni−λinj=0 (i≠j),∑i∈EIij=nj.\mu_iI_{ii}-\lambda_in_i=\lambda_i,\qquad \mu_iI_{ij}+\mu_jI_{ji}-\lambda_jn_i-\lambda_in_j=0\ (i\neq j),\qquad \sum_{i\in E}I_{ij}=n_j .μi​Iii​−λi​ni​=λi​,μi​Iij​+μj​Iji​−λj​ni​−λi​nj​=0 (i=j),i∈E∑​Iij​=nj​.

In the queue, IijI_{ij}Iij​ is the steady-state mean of the number of class jjj customers on the event that the server is busy with class iii. The projection P2′\mathrm{P2}'P2′ of P2 is the set of (ni)(n_i)(ni​) for which some (Iij)(I_{ij})(Iij​) makes ((ni),(Iij))((n_i),(I_{ij}))((ni​),(Iij​)) a point of P2.

Formalization targets

Goal: Theorem 8.4

P2′=P1.\mathrm{P2}'=\mathrm{P1}.P2′=P1.

Both inclusions are part of the goal. The statement fixes no constants and holds for every nnn, every positive rate vector and every stable load.

Milestones

  1. §8.2, proof of Theorem 8.3. The extreme points of P1 are exactly the vectors v(π)v(\pi)v(π), and P1 is their convex hull:
ext⁡P1={v(π)},P1=conv⁡{v(π)}.\operatorname{ext}\mathrm{P1}=\{v(\pi)\},\qquad \mathrm{P1}=\operatorname{conv}\{v(\pi)\}.extP1={v(π)},P1=conv{v(π)}.
  1. §8.2, proof of Theorem 8.4. The easy inclusion, which the paper obtains from its Theorem 4.4:
P2′⊆P1.\mathrm{P2}'\subseteq\mathrm{P1}.P2′⊆P1.

Significance

The result. Theorem 8.4 replaces 2n−12^n-12n−1 constraints by O(n2)O(n^2)O(n2) constraints in O(n2)O(n^2)O(n2) variables without changing the projected set. Any linear program over the M/M/1 performance region, including problems with side constraints where the greedy cμc\mucμ rule no longer applies, can then be solved with a polynomial-size LP. It also identifies the paper's nonparametric method as exact at a single station: the method loses nothing there, which is the baseline against which its gaps in networks are measured.

Formalizing it. The result is proved in the paper, but the reverse inclusion P1⊆P2′\mathrm{P1}\subseteq\mathrm{P2}'P1⊆P2′ is argued through achievability: every point of P1 is the performance of some (randomized) policy, and every policy's performance satisfies the equations of P2. That argument rests on stochastic objects (invariant distributions under arbitrary policies, and time-0 randomizations over priority rules) that the paper does not define precisely. The paper points to a purely combinatorial derivation in Paschalidis' thesis, which we have not seen. A machine-checked proof of the polyhedral identity is therefore new content: it supplies the deterministic argument the paper delegates. The polymatroid structure of P1 (Milestone 1) is classical for supermodular set functions; this mission requires it for this specific bbb. We know of no formalization of either result.

Difficulty

The inclusion P2′⊆P1\mathrm{P2}'\subseteq\mathrm{P1}P2′⊆P1 only combines the equations of P2 with nonnegativity. The reverse inclusion is the hard half: for each point of P1 one must exhibit a nonnegative matrix (Iij)(I_{ij})(Iij​) satisfying n2n^2n2 linear equations, and the inequalities of P1 say nothing directly about the off-diagonal entries IijI_{ij}Iij​. The paper's own argument does not help here, since it produces III as a steady-state expectation under a scheduling policy, an object defined through a Markov chain and given in no closed form. The sign constraints Iij≥0I_{ij}\ge0Iij​≥0 are where the 2n−12^n-12n−1 inequalities of P1 are encoded, and a proof has to explain how O(n2)O(n^2)O(n2) sign conditions on auxiliary variables carry exactly the information of exponentially many inequalities in the original ones.

Formalization scope

Classes are Fin n; rates are real functions lam mu : Fin n → ℝ with 0 < lam i, 0 < mu i and ∑ i, lam i / mu i < 1. The paper's nin_ini​ is written x i, because n is the number of classes. A point of P2 is a pair (x, I) with I i j =Iij=I_{ij}=Iij​, including the diagonal entries. P1 is the platform definition AllocationIndices.achievablePolytope with the matrix AiS=1/μiA^S_i=1/\mu_iAiS​=1/μi​: inequality for every S≠ES\neq ES=E, equality at S=ES=ES=E, nonnegativity. The paper writes NNN for the class set EEE in (65) and (71); every such sum runs over all classes. The constraints (64)–(65) bound ni/μin_i/\mu_ini​/μi​, not nin_ini​. v(π)v(\pi)v(π) is given by its closed form, v(π)πk=μπk(b({π1,…,πk})−b({π1,…,πk−1}))v(\pi)_{\pi_k}=\mu_{\pi_k}\bigl(b(\{\pi_1,\dots,\pi_k\})-b(\{\pi_1,\dots,\pi_{k-1}\})\bigr)v(π)πk​​=μπk​​(b({π1​,…,πk​})−b({π1​,…,πk−1​})), which solves (58). The standing hypothesis λi>0\lambda_i>0λi​>0 is presupposed by the model (Poisson arrivals at rate λi\lambda_iλi​); the load condition is the paper's stability condition and keeps every denominator of bbb positive.

No statement involves a policy, a Markov chain or an expectation; the queueing meaning above is motivation only. In particular, neither "P1 is the achievable region" nor "the performance vector of each priority rule is achievable" is formalized. The goal is the full set identity: stating only P2′⊆P1\mathrm{P2}'\subseteq\mathrm{P1}P2′⊆P1, or assuming P1=conv⁡{v(π)}\mathrm{P1}=\operatorname{conv}\{v(\pi)\}P1=conv{v(π)} as a hypothesis of the goal, would not be Theorem 8.4.

A complete development needs: supermodularity of bbb under the load condition; the greedy (Edmonds) description of base polytopes of supermodular functions, which is reusable well beyond this mission; and a nonnegative solution of the P2 system at each v(π)v(\pi)v(π). Contributions of any of these as separate lemmas are welcome.

Selected references

  • D. Bertsimas, I. Ch. Paschalidis, J. N. Tsitsiklis, Optimization of Multiclass Queueing Networks: Polyhedral and Nonlinear Characterizations of Achievable Performance, MIT Sloan School WP #3509-92-MSA, 1992; Annals of Applied Probability 4(1):43–75, 1994. https://doi.org/10.1214/aoap/1177005200
  • E. G. Coffman, I. Mitrani, A characterization of waiting time performance realizable by single-server queues, Operations Research 28(3):810–821, 1980. https://doi.org/10.1287/opre.28.3.810
  • J. G. Shanthikumar, D. D. Yao, Multiclass queueing systems: polymatroidal structure and optimal scheduling control, Operations Research 40(S2):S293–S299, 1992. https://doi.org/10.1287/opre.40.3.S293
  • D. Bertsimas, J. Niño-Mora, Conservation laws, extended polymatroids and multiarmed bandit problems; a polyhedral approach to indexable systems, Mathematics of Operations Research 21(2):257–306, 1996. https://doi.org/10.1287/moor.21.2.257
  • J. Edmonds, Submodular functions, matroids, and certain polyhedra, in Combinatorial Structures and Their Applications, Gordon and Breach, 1970, pp. 69–87.
5 thms3 active usersReviewed
🏆Completed
CombinatoricsOptimizationTheoretical Computer Science·Captain: mikedeng1

A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization 3: Fractional Double Greedy on the Multilinear Extension Achieves 1/2 of the OptimumResearch Paper

Motivation

Unconstrained submodular maximization (USM) asks for a subset SSS of a finite ground set N\mathcal NN maximizing a nonnegative submodular function fff. It contains Max-Cut, Max-DiCut and maximum facility location as special cases, and it is the basic subproblem of many constrained submodular maximization algorithms. Because fff is given only through a value oracle, the question is how close to the optimum a polynomial number of queries can get.

Timeline of the approximation ratio for USM in the value oracle model:

  • Feige, Mirrokni and Vondrák (FOCS 2007; SIAM J. Comput. 2011) showed that a uniformly random set achieves 1/41/41/4, local search achieves 1/31/31/3 and 2/52/52/5, and that no algorithm making polynomially many queries achieves 1/2+ε1/2 + \varepsilon1/2+ε for any fixed ε>0\varepsilon > 0ε>0.
  • Oveis Gharan and Vondrák (SODA 2011) reached 0.410.410.41 by simulated annealing; Feldman, Naor and Schwartz (ICALP 2011) reached 0.420.420.42.
  • Buchbinder, Feldman, Naor and Schwartz (FOCS 2012) closed the gap with the double greedy algorithms: a deterministic 1/31/31/3-approximation and a randomized 1/21/21/2-approximation, both linear in the number of oracle calls. Their Appendix A gives a third, fractional variant, which is the subject of this mission.

This is the third mission on the FOCS 2012 paper; the first two treat the deterministic and the randomized double greedy on sets.

Setting

Let N\mathcal NN be a finite ground set with nnn elements and f:2N→R≥0f : 2^{\mathcal N} \to \mathbb R_{\ge 0}f:2N→R≥0​. The function fff is submodular if

f(A)+f(B)≥f(A∪B)+f(A∩B)for all A,B⊆N.f(A) + f(B) \ge f(A \cup B) + f(A \cap B) \qquad \text{for all } A, B \subseteq \mathcal N .f(A)+f(B)≥f(A∪B)+f(A∩B)for all A,B⊆N.

Write f(OPT)=max⁡S⊆Nf(S)f(OPT) = \max_{S \subseteq \mathcal N} f(S)f(OPT)=maxS⊆N​f(S) and let OPTOPTOPT be a maximizing set.

The multilinear extension of fff is the function on vectors x∈[0,1]Nx \in [0,1]^{\mathcal N}x∈[0,1]N

F(x)=∑S⊆Nf(S)∏u∈Sxu∏u∉S(1−xu)=E[f(R(x))],F(x) = \sum_{S \subseteq \mathcal N} f(S) \prod_{u \in S} x_u \prod_{u \notin S} (1 - x_u) = \mathbb E\bigl[f(R(x))\bigr],F(x)=S⊆N∑​f(S)u∈S∏​xu​u∈/S∏​(1−xu​)=E[f(R(x))],

where the random set R(x)R(x)R(x) contains each element uuu independently with probability xux_uxu​. A set is identified with its characteristic vector, so FFF agrees with fff on {0,1}N\{0,1\}^{\mathcal N}{0,1}N, and {u}\{u\}{u} also denotes the unit vector at uuu. For vectors, x∨yx \vee yx∨y and x∧yx \wedge yx∧y are the coordinate-wise maximum and minimum.

Algorithm 4 (MultilinearUSM). Fix an arbitrary order u1,…,unu_1, \dots, u_nu1​,…,un​ of N\mathcal NN and start from x0=∅x_0 = \emptysetx0​=∅ and y0=Ny_0 = \mathcal Ny0​=N (the vectors 0\mathbf 00 and 1\mathbf 11). In iteration i=1,…,ni = 1, \dots, ni=1,…,n compute

ai=F(xi−1+{ui})−F(xi−1),bi=F(yi−1−{ui})−F(yi−1),a_i = F(x_{i-1} + \{u_i\}) - F(x_{i-1}), \qquad b_i = F(y_{i-1} - \{u_i\}) - F(y_{i-1}),ai​=F(xi−1​+{ui​})−F(xi−1​),bi​=F(yi−1​−{ui​})−F(yi−1​),

set ai′=max⁡{ai,0}a_i' = \max\{a_i, 0\}ai′​=max{ai​,0}, bi′=max⁡{bi,0}b_i' = \max\{b_i, 0\}bi′​=max{bi​,0}, and update

xi=xi−1+ai′ai′+bi′{ui},yi=yi−1−bi′ai′+bi′{ui},x_i = x_{i-1} + \frac{a_i'}{a_i' + b_i'} \{u_i\}, \qquad y_i = y_{i-1} - \frac{b_i'}{a_i' + b_i'} \{u_i\},xi​=xi−1​+ai′​+bi′​ai′​​{ui​},yi​=yi−1​−ai′​+bi′​bi′​​{ui​},

with the convention that the two fractions are 111 and 000 when ai′=bi′=0a_i' = b_i' = 0ai′​=bi′​=0. The output is the random set R(xn)R(x_n)R(xn​). Every choice before the output is deterministic; the algorithm queries FFF at four points per element.

For the analysis, OPTi=(OPT∨xi)∧yiOPT_i = (OPT \vee x_i) \wedge y_iOPTi​=(OPT∨xi​)∧yi​.

Formalization targets

Goal: Theorem A.1, oracle-access clause

For every nonnegative submodular fff and every order of the ground set,

xn=ynandf(OPT)≤2 F(xn)=2 E[f(R(xn))].x_n = y_n \qquad\text{and}\qquad f(OPT) \le 2\,F(x_n) = 2\,\mathbb E\bigl[f(R(x_n))\bigr].xn​=yn​andf(OPT)≤2F(xn​)=2E[f(R(xn​))].

Milestones, in the order the proof uses them

  1. ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0 at every iteration (proof of Lemma A.2; the page cites Lemma II.1).
  2. Endpoints: OPT0=OPTOPT_0 = OPTOPT0​=OPT with F(OPT)=f(OPT)F(OPT) = f(OPT)F(OPT)=f(OPT), and OPTn=xn=ynOPT_n = x_n = y_nOPTn​=xn​=yn​.
  3. (4) and (5): if ai≥0a_i \ge 0ai​≥0 and bi>0b_i > 0bi​>0, then F(xi)−F(xi−1)=ai2/(ai+bi)F(x_i) - F(x_{i-1}) = a_i^2/(a_i+b_i)F(xi​)−F(xi−1​)=ai2​/(ai​+bi​) and F(yi)−F(yi−1)=bi2/(ai+bi)F(y_i) - F(y_{i-1}) = b_i^2/(a_i+b_i)F(yi​)−F(yi−1​)=bi2​/(ai​+bi​).
  4. (6): in the same case, F(OPTi−1)−F(OPTi)≤aibi/(ai+bi)F(OPT_{i-1}) - F(OPT_i) \le a_i b_i/(a_i + b_i)F(OPTi−1​)−F(OPTi​)≤ai​bi​/(ai​+bi​), whether or not ui∈OPTu_i \in OPTui​∈OPT.
  5. Lemma A.2: for every 1≤i≤n1 \le i \le n1≤i≤n,
F(OPTi−1)−F(OPTi)≤12[F(xi)−F(xi−1)+F(yi)−F(yi−1)].F(OPT_{i-1}) - F(OPT_i) \le \tfrac12\bigl[F(x_i) - F(x_{i-1}) + F(y_i) - F(y_{i-1})\bigr].F(OPTi−1​)−F(OPTi​)≤21​[F(xi​)−F(xi−1​)+F(yi​)−F(yi−1​)].
  1. Telescoped display: F(OPT0)−F(OPTn)≤12[F(xn)−F(x0)]+12[F(yn)−F(y0)]≤12(F(xn)+F(yn))F(OPT_0) - F(OPT_n) \le \tfrac12[F(x_n) - F(x_0)] + \tfrac12[F(y_n) - F(y_0)] \le \tfrac12(F(x_n) + F(y_n))F(OPT0​)−F(OPTn​)≤21​[F(xn​)−F(x0​)]+21​[F(yn​)−F(y0​)]≤21​(F(xn​)+F(yn​)).

Significance

The result. Theorem A.1 shows that the double greedy analysis survives a change of domain: the factor 1/21/21/2 is obtained by a procedure that never flips a coin until the end, and whose state is a pair of fractional points. The ratio matches the Feige–Mirrokni–Vondrák hardness bound, so it cannot be improved in the value oracle model. Its output is a fractional point together with an independent rounding, which separates the optimization from the rounding step.

Formalizing it. The result is proved on paper; no machine-checked proof of a double greedy guarantee is known. A complete development yields reusable facts about the multilinear extension of a submodular function on a finite type: FFF is affine in each coordinate, its coordinate increments are antitone in the other coordinates on [0,1]N[0,1]^{\mathcal N}[0,1]N, and FFF restricted to characteristic vectors is fff. These are the standard tools of every continuous-relaxation argument for submodular maximization.

Difficulty

The proof on the page is short, but it relies on two facts it does not prove. First, the page justifies ai+bi≥0a_i + b_i \ge 0ai​+bi​≥0 "by Lemma II.1", which is a statement about sets; for vectors it requires that the increment of FFF along a coordinate decreases as the other coordinates increase, a property of the multilinear extension of a submodular function that must be derived from the sum defining FFF. Second, inequality (6) is written out only for ui∉OPTu_i \notin OPTui​∈/OPT, and Case 2 of Lemma A.2 is omitted as analogous; the formal statements cover all cases. The main technical work is the bookkeeping of the run: that each coordinate is touched once, that xi−1(ui)=0x_{i-1}(u_i) = 0xi−1​(ui​)=0 and yi−1(ui)=1y_{i-1}(u_i) = 1yi−1​(ui​)=1 when it is touched, that xi≤OPTi≤yix_i \le OPT_i \le y_ixi​≤OPTi​≤yi​, and that every state stays in [0,1]N[0,1]^{\mathcal N}[0,1]N, where the antitonicity applies.

Formalization scope

  • The ground set is a Fintype XXX with decidable equality; sets are Finset X; fff is real-valued, with nonnegativity a hypothesis ∀ S, 0 ≤ f S wherever the page uses it (the goal and the telescoped display). Submodularity is the published NonmonotoneSubmod.Shared.Submodular, the lattice form f(S∪T)+f(S∩T)≤f(S)+f(T)f(S \cup T) + f(S \cap T) \le f(S) + f(T)f(S∪T)+f(S∩T)≤f(S)+f(T); f(OPT)f(OPT)f(OPT) is the published NonmonotoneSubmod.Shared.OPT; FFF is the published NonmonotoneSubmod.Shared.F, the sum above, defined for every x:X→Rx : X \to \mathbb Rx:X→R.
  • The order u1,…,unu_1, \dots, u_nu1​,…,un​ is a duplicate-free list containing every element; uiu_iui​ is the entry at index i−1i-1i−1, and nnn is the list's length. The state after iii iterations is obtained by folding one step over the first iii entries from (0,1)(\mathbf 0, \mathbf 1)(0,1). Statements hold for every such order.
  • The footnote's convention ai′/(ai′+bi′)=1a_i'/(a_i'+b_i') = 1ai′​/(ai′​+bi′​)=1, bi′/(ai′+bi′)=0b_i'/(a_i'+b_i') = 0bi′​/(ai′​+bi′​)=0 when ai′=bi′=0a_i' = b_i' = 0ai′​=bi′​=0 is an explicit case split; with Lean's 0/0=00/0 = 00/0=0 it would otherwise be reversed and the run would no longer end with xn=ynx_n = y_nxn​=yn​.
  • Corrected slips of the page: lines 3–4 of Algorithm 4 assign ai′,bi′a_i', b_i'ai′​,bi′​ but define ai,bia_i, b_iai​,bi​; "f:N→R+f : \mathcal N \to \mathbb R^+f:N→R+" means f:2N→R+f : 2^{\mathcal N} \to \mathbb R^+f:2N→R+; "F(x)≜E[R(x)]F(x) \triangleq \mathbb E[R(x)]F(x)≜E[R(x)]" means E[f(R(x))]\mathbb E[f(R(x))]E[f(R(x))]; "NSM" in Theorem A.1 means USM. The main text's one-line definition of submodularity, read literally, forces monotonicity; the footnote's lattice form is used.
  • Not formalized: the sampling clause of Theorem A.1 (ratio (1/2)−o(1)(1/2) - o(1)(1/2)−o(1) without oracle access to FFF, whose proof the paper refers to Calinescu, Chekuri, Pál and Vondrák) and the running time. The guarantee is stated for the algorithm as printed, so the trivial existence of a 1/21/21/2-approximation by exhaustive search does not satisfy it. A statement in which xnx_nxn​ is an arbitrary point, or the state any process with xi≤yix_i \le y_ixi​≤yi​, would not be this theorem.
  • Contributions welcome: the multilinear-extension facts above as general lemmas, the run invariants, and proofs of the milestones in any order.

Selected references

  • N. Buchbinder, M. Feldman, J. Naor, R. Schwartz, A Tight Linear Time (1/2)-Approximation for Unconstrained Submodular Maximization, FOCS 2012, 649–658. https://doi.org/10.1109/FOCS.2012.73 (journal version: SIAM J. Comput. 44(5), 2015, https://doi.org/10.1137/130929205; its numbering differs and is not used here).
  • U. Feige, V. S. Mirrokni, J. Vondrák, Maximizing Non-monotone Submodular Functions, SIAM J. Comput. 40(4), 2011, 1133–1153. https://doi.org/10.1137/090779346
  • S. Oveis Gharan, J. Vondrák, Submodular Maximization by Simulated Annealing, SODA 2011, 1098–1117. https://doi.org/10.1137/1.9781611973082.83
  • M. Feldman, J. Naor, R. Schwartz, Nonmonotone Submodular Maximization via a Structural Continuous Greedy Algorithm, ICALP 2011, 342–353. https://doi.org/10.1007/978-3-642-22006-7_29
  • G. Calinescu, C. Chekuri, M. Pál, J. Vondrák, Maximizing a Monotone Submodular Function Subject to a Matroid Constraint, SIAM J. Comput. 40(6), 2011, 1740–1766. https://doi.org/10.1137/080733991
11 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 1: α-Competitiveness Against Adaptive On-Line and β Against Oblivious Adversaries Give a Deterministic α∘β-Competitive AlgorithmResearch Paper

Why randomization matters in online algorithms

An online algorithm must answer each request before it sees the next one. Its performance is compared with an optimum that may choose all its answers after seeing the complete request string. Randomization can improve an online algorithm's guarantee when the request string is fixed in advance. The comparison changes when an adversary chooses later requests after seeing the algorithm's earlier answers. Ben-David, Borodin, Karp, Tardos and Wigderson studied these choices of adversary in a common request-answer model and proved a general relation between their competitive guarantees (Ben-David et al., 1994, manuscript §§2–3).

The paper distinguishes three adversaries. An oblivious adversary fixes the request string before the algorithm's random choices affect any answer. An adaptive off-line adversary chooses the next request from previous answers but serves the resulting request string optimally after the play. An adaptive on-line adversary also chooses its own answer as each request arrives. The ability to react to answers makes the latter two adversaries materially different from the oblivious one for randomized algorithms (Ben-David et al., 1994, manuscript pp. 7–9).

Request-answer games and competitive cost

A request-answer game has a request set RRR, a finite nonempty answer set AAA, and a real cost fn(r,a)f_n(r,a)fn​(r,a) for a request string r∈Rnr\in R^nr∈Rn and an answer string a∈Ana\in A^na∈An. The off-line optimum for rrr is c(r)=min⁡a∈Anfn(r,a)c(r)=\min_{a\in A^n}f_n(r,a)c(r)=mina∈An​fn​(r,a). A deterministic online algorithm DDD returns its iiith answer from the first iii requests alone; it has no access to the rest of rrr or to the eventual stopping time. Its cost on rrr is cD(r)=fn(r,D(r))c_D(r)=f_n(r,D(r))cD​(r)=fn​(r,D(r)).

A randomized online algorithm is a distribution over deterministic online algorithms. With coins ω\omegaω, write GωG_\omegaGω​ for the resulting deterministic algorithm. For a fixed request string rrr, GGG is β\betaβ-competitive against oblivious adversaries when Eω[cGω(r)]≤β(c(r))\mathbb E_\omega[c_{G_\omega}(r)]\leq\beta(c(r))Eω​[cGω​​(r)]≤β(c(r)). The paper calls a transformation “linear” when it has the affine form x↦ux+vx\mapsto ux+vx↦ux+v (Ben-David et al., 1994, manuscript p. 7).

An adaptive off-line adversary QQQ has a rule from prior answer strings to either the next request or a stop signal, together with a common finite upper bound on play length. Let r(Gω,Q)r(G_\omega,Q)r(Gω​,Q) denote its request string and cQ(Gω)=c(r(Gω,Q))c_Q(G_\omega)=c(r(G_\omega,Q))cQ​(Gω​)=c(r(Gω​,Q)). Its competitiveness condition places the transformation inside the expectation: Eω[cGω(Q)]≤Eω[α(cQ(Gω))]\mathbb E_\omega[c_{G_\omega}(Q)]\leq\mathbb E_\omega[\alpha(c_Q(G_\omega))]Eω​[cGω​​(Q)]≤Eω​[α(cQ​(Gω​))]. An adaptive on-line adversary SSS has the same request rule and an additional answer rule; its own cost is cS(Gω)c_S(G_\omega)cS​(Gω​), and the corresponding condition uses Eω[α(cS(Gω))]\mathbb E_\omega[\alpha(c_S(G_\omega))]Eω​[α(cS​(Gω​))] on the right (Ben-David et al., 1994, manuscript pp. 8–9).

Formalization targets

Randomization against adaptive off-line adversaries

The first target is Theorem 2.1: if some randomized algorithm is α\alphaα-competitive against every adaptive off-line adversary, a deterministic algorithm has that same guarantee on every request string:

∃G  ∀Q,E[cG(Q)]≤E[α(cQ(G))]⟹∃D  ∀r,cD(r)≤α(c(r)).\exists G\;\forall Q,\quad \mathbb E[c_G(Q)]\leq\mathbb E[\alpha(c_Q(G))]\quad\Longrightarrow\quad\exists D\;\forall r,\quad c_D(r)\leq\alpha(c(r)).∃G∀Q,E[cG​(Q)]≤E[α(cQ​(G))]⟹∃D∀r,cD​(r)≤α(c(r)).

Composition of two guarantees

Theorem 2.2 takes an α\alphaα guarantee for GGG against adaptive on-line adversaries and a β\betaβ guarantee for another randomized algorithm against oblivious adversaries. It concludes that GGG has the composed guarantee against adaptive off-line adversaries:

E[cG(Q)]≤E[(α∘β)(cQ(G))]for every Q.\mathbb E[c_G(Q)]\leq\mathbb E[(\alpha\circ\beta)(c_Q(G))]\qquad\text{for every }Q.E[cG​(Q)]≤E[(α∘β)(cQ​(G))]for every Q.

The mission goal is Corollary 2.1, the deterministic consequence of these two results:

∃D  ∀r,cD(r)≤(α∘β)(c(r)).\exists D\;\forall r,\qquad c_D(r)\leq(\alpha\circ\beta)(c(r)).∃D∀r,cD​(r)≤(α∘β)(c(r)).

The milestones follow the paper's two theorems and the stated claims in their proofs, including the finite-horizon winning-position formulation and the adversary that simulates a fixed online algorithm (Ben-David et al., 1994, manuscript pp. 9–13).

What the result supplies

The corollary turns the existence of two randomized guarantees under different information rules into the existence of a deterministic online strategy with an explicit composed cost transformation. It is an existence result: it does not say that the deterministic strategy can be computed efficiently from the randomized algorithms. The paper itself notes that such a construction is unavailable in full generality and then examines settings where constructive versions are possible (Ben-David et al., 1994, manuscript p. 13).

The mathematical results were proved in the 1994 paper; this mission asks for machine-checked Lean proofs of the abstract model, the intermediate claims, and Corollary 2.1. The local draft currently contains compiled statements with proof placeholders, so it does not yet provide checked proofs. A completed development would make the adversary distinctions and the exact placement of expectations available for reuse in later online-algorithm formalizations.

Why the proof is difficult

The apparent shortcut is to treat an adaptive request sequence as fixed and apply a guarantee against oblivious adversaries directly. That loses the dependence of later requests on the algorithm's earlier answers. For Theorem 2.1, a winning request strategy must have one finite horizon that works for every answer path; separate finite horizons for each branch do not suffice when the answer set is infinite. For Theorem 2.2, the simulated adversary must make its own answers before the algorithm answers the current request, while still matching a fixed online benchmark along every resulting play. The expectation inequalities must remain valid when the request string itself depends on the algorithm's coins (Ben-David et al., 1994, manuscript pp. 9–11).

Formalization scope

Lean represents requests and answers as oldest-first lists. List index zero is request one in the paper. The general game is a separate definition; the algorithm, adversary, and competitiveness definitions build on it. An off-line adversary's rule returns Option R, where none is the stop signal, and has a uniform finite depth bound. A randomized algorithm consists of a coin probability space and a deterministic prefix algorithm for each coin; its answer events are measurable. Finiteness of AAA and bounded play depth make the cost of each fixed adversarial play take finitely many values, so its real expectation is an ordinary integrable expectation.

The formal game uses real-valued costs, a deliberate restriction of the paper's R∪{∞}\mathbb R\cup\{\infty\}R∪{∞} costs. The answer set is finite and nonempty, while the request set may be infinite. The transformations α\alphaα and β\betaβ are affine. Theorem 2.2 and the goal assume α\alphaα is monotone: the paper applies α\alphaα to an inequality in its proof, and its competitive-ratio examples have positive slope. Theorem 2.1 does not need this added assumption. The two randomized algorithms may have different coin spaces, each an arbitrary Lean type at the declaration's universe level. The off-line and on-line adaptive comparisons retain α\alphaα inside the expectation.

The target ranges over every equal-length request and answer play generated by these rules, including an adversary that stops without a request. It does not allow the deterministic algorithm to see future requests or choose a different policy for each adversary. Reusable contributions include the game interface, bounded adaptive plays, measurable randomized algorithms, and finite-horizon winning positions. The statements of all three principal results, their intervening claims, and proofs of those statements are within scope.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos and A. Wigderson, On the Power of Randomization in On-Line Algorithms, Algorithmica 11, 1994. DOI: 10.1007/BF01294260. The local source is the authors' 20-page manuscript; citations above use its page numbers.
11 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

On the Power of Randomization in On-Line Algorithms 2: The Bound α∘β Against Adaptive Off-Line Adversaries Is TightResearch Paper

Motivation

An on-line algorithm must answer each request as it arrives, without knowing the requests to come; paging, caching, the kkk-server problem and metrical task systems are standard examples. Its quality is measured by competitive analysis: its cost is compared with the cost of an optimal off-line solution that knows the whole request sequence. For randomized on-line algorithms the comparison depends on how much the adversary producing the requests is allowed to see. Ben-David, Borodin, Karp, Tardos and Wigderson (Algorithmica 11, 1994; conference version STOC 1990) introduced the three standard adversaries — oblivious, adaptive on-line and adaptive off-line — and related the competitive ratios achievable against each.

Their Theorem 2.2 (manuscript p. 10) shows that if a randomized algorithm is α\alphaα-competitive against adaptive on-line adversaries and some randomized algorithm is β\betaβ-competitive against oblivious adversaries, then the first algorithm is αβ\alpha\betaαβ-competitive against adaptive off-line adversaries. This mission formalizes the paper's claim (manuscript p. 11) that this product bound cannot be improved in general, together with the explicit construction on pp. 12–13 that proves it.

Setting

A request-answer game consists of a request set RRR, a finite answer set AAA, and cost functions fn:Rn×An→Rf_n : R^n \times A^n \to \mathbb Rfn​:Rn×An→R. For a request sequence r‾∈Rn\underline r \in R^nr​∈Rn, the off-line optimum is c(r‾)=min⁡a‾∈Anfn(r‾,a‾)c(\underline r) = \min_{\underline a \in A^n} f_n(\underline r, \underline a)c(r​)=mina​∈An​fn​(r​,a​). A deterministic on-line algorithm GGG answers the iii-th request with ai=gi(r1,…,ri)a_i = g_i(r_1, \dots, r_i)ai​=gi​(r1​,…,ri​); a randomized one is a probability distribution over deterministic algorithms GxG_xGx​, xxx being the coin tosses.

An adaptive off-line adversary QQQ chooses each request ri+1=qi(a1,…,ai)r_{i+1} = q_i(a_1, \dots, a_i)ri+1​=qi​(a1​,…,ai​) from the answers given so far, stops after at most dQd_QdQ​ requests, and pays the off-line optimum cQ(G)=c(r‾)c_Q(G) = c(\underline r)cQ​(G)=c(r​) of the requests it made; the algorithm pays cG(Q)=fn(r‾,a‾)c_G(Q) = f_n(\underline r, \underline a)cG​(Q)=fn​(r​,a​). An adaptive on-line adversary SSS must in addition answer each request itself, before the algorithm does, with bi+1=pi(a1,…,ai)b_{i+1} = p_i(a_1, \dots, a_i)bi+1​=pi​(a1​,…,ai​), and pays cS(G)=fn(r‾,b‾)c_S(G) = f_n(\underline r, \underline b)cS​(G)=fn​(r​,b​). An oblivious adversary fixes r‾\underline rr​ in advance and pays c(r‾)c(\underline r)c(r​). A randomized GGG is α\alphaα-competitive against oblivious adversaries if Ex[cGx(r‾)]≤α c(r‾)\mathbb E_x[c_{G_x}(\underline r)] \le \alpha\, c(\underline r)Ex​[cGx​​(r​)]≤αc(r​) for all r‾\underline rr​, and against adaptive on-line adversaries if Ex[cGx(S)]≤Ex[α cS(Gx)]\mathbb E_x[c_{G_x}(S)] \le \mathbb E_x[\alpha\, c_S(G_x)]Ex​[cGx​​(S)]≤Ex​[αcS​(Gx​)] for all SSS.

The construction uses the mates game: R=AR = AR=A is a set of 2t2t2t elements split into ttt pairs of mates, and for n≥2n \ge 2n≥2 the cost depends only on the first answer a1a_1a1​ and the second request r2r_2r2​: it is 111 if a1=r2a_1 = r_2a1​=r2​, MMM if a1a_1a1​ is the mate of r2r_2r2​, and mmm otherwise. The algorithm GGG draws a1a_1a1​ uniformly at random. The parameters solve

β=(2t−2)m+M+12t,α=1+(2t−1)M2+(2t−2)m.\beta = \frac{(2t-2)m + M + 1}{2t}, \qquad \alpha = \frac{1 + (2t-1)M}{2 + (2t-2)m}.β=2t(2t−2)m+M+1​,α=2+(2t−2)m1+(2t−1)M​.

Formalization targets

Goal: tightness of Theorem 2.2

For 1<β≤α1 < \beta \le \alpha1<β≤α (or α=β=1\alpha = \beta = 1α=β=1) and every C<αβC < \alpha\betaC<αβ, there are a game and a randomized algorithm GGG such that

G is α-competitive against adaptive on-line adversaries,G is β-competitive against oblivious adversaries,G \text{ is } \alpha\text{-competitive against adaptive on-line adversaries}, \qquad G \text{ is } \beta\text{-competitive against oblivious adversaries},G is α-competitive against adaptive on-line adversaries,G is β-competitive against oblivious adversaries,

and for every randomized algorithm KKK some adaptive off-line adversary QQQ achieves

E[cQ(K)]>0,E[cK(Q)]≥C⋅E[cQ(K)].\mathbb E[c_Q(K)] > 0, \qquad \mathbb E[c_K(Q)] \ge C\cdot \mathbb E[c_Q(K)].E[cQ​(K)]>0,E[cK​(Q)]≥C⋅E[cQ​(K)].

Milestones (pp. 12–13)

  1. The closed forms m(t)m(t)m(t), M(t)M(t)M(t) are the unique solution of the two equations.
  2. m(t)→βm(t) \to \betam(t)→β and M(t)→αβM(t) \to \alpha\betaM(t)→αβ as t→∞t \to \inftyt→∞.
  3. For all large ttt: M(t)≥max⁡(m(t)2,C)M(t) \ge \max(m(t)^2, C)M(t)≥max(m(t)2,C), 1≤m(t)≤M(t)1 \le m(t) \le M(t)1≤m(t)≤M(t), α(m(t)−1)≤M(t)−m(t)\alpha(m(t)-1) \le M(t) - m(t)α(m(t)−1)≤M(t)−m(t).
  4. GGG is β\betaβ-competitive against oblivious adversaries in the mates game.
  5. GGG is α\alphaα-competitive against adaptive on-line adversaries in the mates game.
  6. An adaptive off-line adversary makes every algorithm pay MMM while paying 111.

Significance

The result. Together with Theorem 2.2, the claim pins down exactly how much the adaptive off-line adversary can gain over the other two: the product αβ\alpha\betaαβ is an upper bound for every game and is approached by a single game for every admissible pair (α,β)(\alpha, \beta)(α,β). It shows that no general argument relating the three adversary models can give a bound better than the product, so any improvement for a specific problem (paging, kkk-server) must use the structure of that problem. The paging example cited on p. 11 (RANDOM against the three adversaries) gives one instance of tightness; the mates game gives tightness for every admissible pair.

Formalizing it. The result is proved in the paper, in about one page, with two steps left to the reader ("by inspection of the equations", "a simple case analysis"). No machine-checked proof of this or of any statement about adaptive adversaries is known to us. The formalization makes the model of §2 precise (sequences, stopping, the order in which adversary and algorithm commit, expectations over coins), checks the asymptotics of the parameters, and verifies the case analysis, which on inspection needs an inequality the page does not state. Two printed formulas on p. 12 contain typos; the formal statements carry the correct values.

Difficulty

The construction is explicit, but each competitiveness claim quantifies over all adversaries, which may adapt their requests to the algorithm's random answers, stop at any time, and (for the on-line adversary) commit to their own answers in advance. The algebra of α\alphaα-competitiveness is tight: the adversary's best expected advantage is exactly zero, so every case of its best reply must be checked with no slack. The page's condition M≥m2M \ge m^2M≥m2 does not suffice for this: when a1a_1a1​ is neither the adversary's first answer nor its mate, the reply "mate of a1a_1a1​" beats the reply "the adversary's own answer" only when α(m−1)≤M−m\alpha(m-1) \le M - mα(m−1)≤M−m, which holds for the solved parameters but is not implied by M≥m2M \ge m^2M≥m2. At β=1<α\beta = 1 < \alphaβ=1<α the solved parameter mmm is below 111 for every ttt, and the oblivious bound fails.

Formalization scope

All declarations live in OnlineRandomization.Tightness. The conventions:

  • Costs are real-valued; the paper allows +∞+\infty+∞, so the game class is a special case.
  • Answer sets are nonempty finite types; request sets are arbitrary types.
  • Sequences are Lean lists, oldest first; cost r a is fnf_nfn​ on lists of equal length nnn.
  • Adversaries return none for "stop" and carry a depth bound dQd_QdQ​; an on-line adversary's answer bi+1b_{i+1}bi+1​ depends only on a1,…,aia_1, \dots, a_ia1​,…,ai​.
  • Randomized algorithms are a probability space of coins with a deterministic algorithm per coin and measurable answers; expectations are Bochner integrals, with α\alphaα applied inside the expectation. In the goal, coin spaces range over Type.
  • Competitiveness uses the ratio functions x↦αxx \mapsto \alpha xx↦αx and x↦βxx \mapsto \beta xx↦βx, with no additive constant.
  • The mates game is on Fin t × Bool, with mate (i,b)↦(i,¬b)(i, b) \mapsto (i, \lnot b)(i,b)↦(i,¬b). The paper leaves the costs of plays with fewer than two requests undefined; the formalization sets f0=0f_0 = 0f0​=0 and f1≡1f_1 \equiv 1f1​≡1 (with f1≡0f_1 \equiv 0f1​≡0 the algorithm would not be α\alphaα-competitive).
  • Range. The goal assumes 1<β≤α1 < \beta \le \alpha1<β≤α or α=β=1\alpha = \beta = 1α=β=1; the page's case β=1<α\beta = 1 < \alphaβ=1<α is not covered by its construction and is left out. In fact the claim is false there for 1<C<α1 < C < \alpha1<C<α: an algorithm that is 111-competitive against oblivious adversaries answers optimally, almost surely, on every request sequence (its cost is never below the optimum and its expected cost does not exceed it), and an adaptive off-line adversary reaches only finitely many request sequences, so against K=GK = GK=G every adversary has E[cG(Q)]=E[cQ(G)]\mathbb E[c_G(Q)] = \mathbb E[c_Q(G)]E[cG​(Q)]=E[cQ​(G)], a ratio of 1<C1 < C1<C.

The positivity requirement E[cQ(K)]>0\mathbb E[c_Q(K)] > 0E[cQ​(K)]>0 in the goal is essential: without it the adversary that asks nothing satisfies E[cK(Q)]≥C⋅0\mathbb E[c_K(Q)] \ge C \cdot 0E[cK​(Q)]≥C⋅0 for every KKK, and the third clause would hold vacuously.

A complete development needs: finite expectations over a uniform coin, the evaluation of the play of an adversary against a constant algorithm, and limit and eventual-inequality arguments for rational functions of ttt. The model of §2 is shared with the other missions of this series and is reusable for any request-answer formulation of an on-line problem. Proofs of individual milestones are welcome.

Selected references

  • S. Ben-David, A. Borodin, R. Karp, G. Tardos, A. Wigderson, On the power of randomization in on-line algorithms, Algorithmica 11 (1994) 2–14. https://doi.org/10.1007/BF01294260 (cited from the authors' manuscript, manuscript pp. 7–13).
  • A. Borodin, R. El-Yaniv, Online Computation and Competitive Analysis, Cambridge University Press, 1998. ISBN 0-521-56392-5.
  • P. Raghavan, M. Snir, Memory versus randomization in on-line algorithms, IBM Journal of Research and Development 38 (1994) 683–707. https://doi.org/10.1147/rd.386.0683
9 thms3 active usersReviewed
🏆Completed
CombinatoricsComputational GeometryDiscrete Geometry·Captain: mikedeng1

A Polynomial Time Algorithm for Counting Integral Points in Polyhedra When the Dimension is Fixed: The Lattice-Point Count of an Integral Simplex Is a Short Signed Sum over Primitive ConesResearch Paper

Counting lattice points in fixed dimension

How many integral points does a polytope contain? The question arises in integer programming, where it measures the size of a feasible set, in combinatorics, where many enumeration problems are lattice-point counts in a polytope (contingency tables, magic squares, flows), in the representation theory of Lie groups, and in the analysis of loop nests in compilers. Counting is #P-hard when the dimension is part of the input, so the natural question is whether the count can be computed in polynomial time when the dimension ddd is fixed.

Timeline:

  • 1899. In dimension 222, Pick's formula leads to a polynomial algorithm.
  • 1983. Lenstra shows that integer feasibility is decidable in polynomial time for fixed ddd (Lenstra 1983). Deciding whether a lattice point exists does not count them.
  • 1988, 1992. Brion proves that the exponential sum over the lattice points of a rational polytope is the sum of the exponential sums of its vertex cones.
  • 1991. Dyer gives polynomial algorithms in dimensions 333 and 444, based on Dedekind sums (Dyer 1991).
  • 1994. Barvinok proves that for every fixed ddd the number of lattice points of an integral simplex, and hence of a rational polyhedron, can be computed in polynomial time (Barvinok 1994). The algorithm was later implemented (LattE, barvinok) and is the standard method.

Setting

Points of Rd\mathbb{R}^dRd have real coordinates and ⟨c,x⟩=∑lclxl\langle c,x\rangle=\sum_l c_lx_l⟨c,x⟩=∑l​cl​xl​. For integral vectors u1,…,uk∈Zdu_1,\dots,u_k\in\mathbb{Z}^du1​,…,uk​∈Zd, the rational cone they generate is co⁡{u1,…,uk}={∑iλiui:λi≥0}\operatorname{co}\{u_1,\dots,u_k\}=\{\sum_i\lambda_iu_i:\lambda_i\ge0\}co{u1​,…,uk​}={∑i​λi​ui​:λi​≥0}. The generators are simple if they are linearly independent, and primitive if moreover they form a basis of the lattice Zd∩Lin⁡{u1,…,uk}\mathbb{Z}^d\cap\operatorname{Lin}\{u_1,\dots,u_k\}Zd∩Lin{u1​,…,uk​}.

The index Ind⁡K\operatorname{Ind}KIndK of the cone given by simple generators is the number of integral points in the semi-open parallelepiped Π={∑iαiui:0≤αi<1}\Pi=\{\sum_i\alpha_iu_i:0\le\alpha_i<1\}Π={∑i​αi​ui​:0≤αi​<1}. It equals 111 exactly for primitive generators.

The exponential sum of KKK is σ(K;c)=∑x∈K∩Zde⟨c,x⟩\sigma(K;c)=\sum_{x\in K\cap\mathbb{Z}^d}e^{\langle c,x\rangle}σ(K;c)=∑x∈K∩Zd​e⟨c,x⟩. Where it converges it has the closed form

σ(K;c)=(∑x∈Π∩Zde⟨c,x⟩)∏i=1k11−e⟨c,ui⟩,\sigma(K;c)=\Bigl(\sum_{x\in\Pi\cap\mathbb{Z}^d}e^{\langle c,x\rangle}\Bigr)\prod_{i=1}^k\frac{1}{1-e^{\langle c,u_i\rangle}},σ(K;c)=(x∈Π∩Zd∑​e⟨c,x⟩)i=1∏k​1−e⟨c,ui​⟩1​,

and this closed form defines σ\sigmaσ at every regular point, i.e. every ccc with ⟨c,ui⟩≠0\langle c,u_i\rangle\ne0⟨c,ui​⟩=0 for all iii.

An integral simplex is Δ=conv⁡{v1,…,vk+1}\Delta=\operatorname{conv}\{v_1,\dots,v_{k+1}\}Δ=conv{v1​,…,vk+1​} with affinely independent vj∈Zdv_j\in\mathbb{Z}^dvj​∈Zd. Its supporting cone at a vertex vvv is Kv={u:v+δu∈Δ for all sufficiently small δ>0}K_v=\{u:v+\delta u\in\Delta\text{ for all sufficiently small }\delta>0\}Kv​={u:v+δu∈Δ for all sufficiently small δ>0}. A signed decomposition K=∑iεiKiK=\sum_i\varepsilon_iK_iK=∑i​εi​Ki​ with integers εi\varepsilon_iεi​ means χK=∑iεiχKi\chi_K=\sum_i\varepsilon_i\chi_{K_i}χK​=∑i​εi​χKi​​ on all of Rd\mathbb{R}^dRd. The constant term of the Laurent expansion of fff at t=0t=0t=0 is the coefficient of t0t^0t0 in the expansion of fff around its pole at 000.

Formalization targets

Goal: the short signed formula (Theorem 1.2, mathematical content)

For d≥2d\ge2d≥2 and every integral simplex Δ⊆Rd\Delta\subseteq\mathbb{R}^dΔ⊆Rd there are, for each vertex vjv_jvj​, primitive cones Kj,iK_{j,i}Kj,i​ and integers εj,i\varepsilon_{j,i}εj,i​ with Kvj=∑iεj,iKj,iK_{v_j}=\sum_i\varepsilon_{j,i}K_{j,i}Kvj​​=∑i​εj,i​Kj,i​ and at most (2d)Tj(2^d)^{T_j}(2d)Tj​ terms. Here TjT_jTj​ is the smallest integer

Tj≥−log⁡log⁡1.9+log⁡log⁡Ind⁡jlog⁡d−log⁡(d−1),T_j\ge\frac{-\log\log1.9+\log\log\operatorname{Ind}_j}{\log d-\log(d-1)},Tj​≥logd−log(d−1)−loglog1.9+loglogIndj​​,

and Ind⁡j\operatorname{Ind}_jIndj​ is the index of the edge vectors at vjv_jvj​. Moreover, for every ccc orthogonal to no generator of any Kj,iK_{j,i}Kj,i​,

#(Δ∩Zd)=∑j∑iεj,i R(Kj,i,vj,c),\#(\Delta\cap\mathbb{Z}^d)=\sum_j\sum_i\varepsilon_{j,i}\,R(K_{j,i},v_j,c),#(Δ∩Zd)=j∑​i∑​εj,i​R(Kj,i​,vj​,c),

where R(K,v,c)R(K,v,c)R(K,v,c) is the constant term at t=0t=0t=0 of t↦et⟨c,v⟩σ(K;tc)t\mapsto e^{t\langle c,v\rangle}\sigma(K;tc)t↦et⟨c,v⟩σ(K;tc).

Milestones

  1. Proposition 2.4 with Remark 2.5: the closed form of σ\sigmaσ for simple cones.
  2. Proposition 4.1: for primitive cones, σ(K;c)=∏i(1−e⟨c,ui⟩)−1\sigma(K;c)=\prod_i(1-e^{\langle c,u_i\rangle})^{-1}σ(K;c)=∏i​(1−e⟨c,ui​⟩)−1.
  3. Proposition 2.7 (Brion), for integral simplices.
  4. Corollary 4.2: R(K,v,c)=Qk(x;y)∏ixi−1R(K,v,c)=Q_k(x;y)\prod_ix_i^{-1}R(K,v,c)=Qk​(x;y)∏i​xi−1​ with deg⁡Qk≤k\deg Q_k\le kdegQk​≤k.
  5. Primitive generators iff Ind⁡K=1\operatorname{Ind}K=1IndK=1 (§5).
  6. Lemma 5.2: a short lattice vector www with Ind⁡Kj≤(Ind⁡K)(d−1)/d\operatorname{Ind}K_j\le(\operatorname{Ind}K)^{(d-1)/d}IndKj​≤(IndK)(d−1)/d.
  7. Lemma 5.3: at most 2d2^d2d cones of smaller index, with signs ±1\pm1±1.
  8. Theorem 5.4: decomposition into at most (2d)T(2^d)^T(2d)T primitive cones.
  9. The display in the proof of Theorem 5.4: (2d)T≤C1(d)(log⁡Ind⁡K)C2(d)(2^d)^T\le C_1(d)(\log\operatorname{Ind}K)^{C_2(d)}(2d)T≤C1​(d)(logIndK)C2​(d).
  10. Lemma 6.1: some c(t)=(1,t,…,td−1)c(t)=(1,t,\dots,t^{d-1})c(t)=(1,t,…,td−1), t∈{0,…,m(d−1)}t\in\{0,\dots,m(d-1)\}t∈{0,…,m(d−1)}, is orthogonal to none of mmm nonzero vectors.

Significance

The goal is the reason Barvinok's algorithm is polynomial. For fixed ddd, the number of terms is bounded by a polynomial in log⁡Ind⁡K\log\operatorname{Ind}KlogIndK, which is polynomial in the input size. Each term is an explicit rational function of inner products (Corollary 4.2). The identity therefore turns lattice-point counting into the evaluation of a short sum. Its consequences include polynomial-time counting for rational polyhedra in fixed dimension, polynomial-time computation of Ehrhart quasi-polynomials, and the theory of short rational generating functions (Barvinok–Woods), which underlies algorithms for parametric integer programming.

The result is proved and classical. As far as known it has not been machine-checked: Mathlib has convex cones, Minkowski's convex body theorem and lattices, but no signed cone decompositions, no generating functions of cones and no Brion identity. The mission produces a formal account of the algorithm's correctness and of the size of its output. Its milestones are statements of independent use: the closed form of cone generating functions, Brion's identity for simplices, and the index-reduction lemma.

Difficulty

The obvious approach is to triangulate the supporting cones into unimodular (primitive) cones. This fails: a cone of index Ind⁡K\operatorname{Ind}KIndK may need about Ind⁡K\operatorname{Ind}KIndK unimodular cones in any triangulation, which is exponential in the input size. The step that makes the count small is signed decomposition. Signed decomposition uses cones that are not contained in KKK, combined with signs ±1\pm1±1, and controls the index through the geometry of numbers rather than through a subdivision of KKK. The second difficulty is that c=0c=0c=0, where the exponential sum equals the count, is a singular point of every σ(Ki;⋅)\sigma(K_i;\cdot)σ(Ki​;⋅). The count is recovered as a constant term of a Laurent expansion, so every identity has to be valid as an identity of meromorphic functions on regular points, and not only where the series converge.

Formalization scope

  • Points of Rd\mathbb{R}^dRd are Fin d → ℝ, integral vectors Fin d → ℤ used through their real cast, and ⟨⋅,⋅⟩\langle\cdot,\cdot\rangle⟨⋅,⋅⟩ is dotProduct. A cone is given by its generator list, because index, parallelepiped and the closed form of σ\sigmaσ depend on the generators. Logarithms are natural, and ∣u∣|u|∣u∣ is the sup norm.
  • Theorem 1.2 is represented by its mathematical content. The paper's statement is "there exists a polynomial time algorithm". No machine model is formalized. The goal is the identity proved on p. 778, with the count of the proof of Theorem 5.4 (p. 777). The algorithmic clauses of Lemmas 5.2, 5.3, 6.1 and Theorem 5.4 are each replaced by the existence statement of the object the algorithm constructs. Lemma 5.3(c), whose constant is unquantified, is omitted.
  • Over R\mathbb{R}R. The paper uses c∈Cdc\in\mathbb{C}^dc∈Cd only to speak of meromorphic functions. Here ccc is real, σ\sigmaσ is defined by its closed form, and regularity means ⟨c,ui⟩≠0\langle c,u_i\rangle\ne0⟨c,ui​⟩=0 for every generator. The constant term is a predicate: tNf(t)t^Nf(t)tNf(t) agrees near 000 with a real-analytic function whose NNN-th Taylor coefficient is the value.
  • Added hypotheses. These are d≥2d\ge2d≥2 wherever TTT appears, k≥1k\ge1k≥1 in Lemma 5.2, d≥1d\ge1d≥1 in Lemma 5.3, ui≠0u_i\ne0ui​=0 in Lemma 6.1, and Ind⁡K≥2\operatorname{Ind}K\ge2IndK≥2 in the display bound. T=0T=0T=0 when the index is 111. Brion's identity is stated for integral simplices, the only case the proof uses.
  • Trivializations ruled out. σ\sigmaσ is never an infinite sum, which would take a junk value off its convergence region. "Primitive" means a lattice basis and not mere linear independence; with the weaker notion the decomposition is trivial. Decompositions hold for every x∈Rdx\in\mathbb{R}^dx∈Rd, not only on Zd\mathbb{Z}^dZd. The halfspace of Lemma 5.2 is linear, since an affine one would make it vacuous.
  • Infrastructure. A complete development needs generating functions of simplicial cones, Brion's theorem for simplices, the identity theorem for rational functions in ec1,…,ecde^{c_1},\dots,e^{c_d}ec1​,…,ecd​, Minkowski's theorem on a sublattice, and inclusion–exclusion for triangulations. Each is reusable beyond this mission, and contributions of any of these pieces are welcome.

Selected references

  • A. I. Barvinok, A polynomial time algorithm for counting integral points in polyhedra when the dimension is fixed, Mathematics of Operations Research 19(4), 1994, 769–779. https://doi.org/10.1287/moor.19.4.769
  • M. Brion, Points entiers dans les polyèdres convexes, Annales scientifiques de l'École Normale Supérieure 21(4), 1988, 653–663. https://doi.org/10.24033/asens.1572
  • M. Dyer, On counting lattice points in polyhedra, SIAM Journal on Computing 20(4), 1991, 695–707. https://doi.org/10.1137/0220044
  • H. W. Lenstra Jr., Integer programming with a fixed number of variables, Mathematics of Operations Research 8(4), 1983, 538–548. https://doi.org/10.1287/moor.8.4.538
  • R. P. Stanley, Enumerative Combinatorics, Vol. 1, Wadsworth & Brooks/Cole, 1986, §4.6. https://doi.org/10.1007/978-1-4615-9763-6
  • A. Barvinok, K. Woods, Short rational generating functions for lattice point problems, Journal of the AMS 16(4), 2003, 957–979. https://doi.org/10.1090/S0894-0347-03-00428-4
16 thms3 active usersReviewed
🏆Completed
ProbabilityTheoretical Computer Science·Captain: mikedeng1

Secretary Problems: Weights and Discounts 3: An O(log n)-Competitive Algorithm for the Discounted Secretary ProblemResearch Paper

Motivation

In the secretary problem, nnn candidates with arbitrary values arrive one at a time in a uniformly random order, and an online decision maker must accept or reject each candidate on arrival, irrevocably, keeping at most one. The rule that observes the first n/en/en/e candidates and then accepts the first one better than everything seen so far selects the best candidate with probability about 1/e1/e1/e (Dynkin, 1963). The problem is a basic model of online selection and, read economically, of posted-price mechanisms for agents who arrive in random order: a rule that compares each agent only against a threshold set by earlier agents is truthful.

Babaioff, Dinitz, Gupta, Immorlica and Talwar (SODA 2009) study a variant in which time costs value. Selecting the candidate who arrives at time ttt earns that candidate's value multiplied by a discount d(t)d(t)d(t), for an arbitrary non-negative discount function ddd known in advance. Earlier work treated only specific discount shapes, such as geometric discounting d(t)=βtd(t)=\beta^td(t)=βt (Rasmussen and Pliska, 1976). For a general ddd the classical rule can fail badly: if all the discount mass sits in the first few time steps, a rule that waits through a sample of size n/en/en/e earns nothing. The paper shows that the best competitive ratio for arbitrary discounts lies between Ω(log⁡n/log⁡log⁡n)\Omega(\log n/\log\log n)Ω(logn/loglogn) (its Theorem 4.3) and O(log⁡n)O(\log n)O(logn) (its Theorem 4.4). This mission formalizes the upper bound.

Setting

There are n≥1n\ge1n≥1 elements, indexed {0,…,n−1}\{0,\dots,n-1\}{0,…,n−1}, with values v(e)≥0v(e)\ge 0v(e)≥0, and nnn times with discounts d(t)≥0d(t)\ge0d(t)≥0. A uniformly random permutation π\piπ fixes the order of arrivals: element π(t)\pi(t)π(t) arrives at time ttt. An algorithm knows ddd but not vvv; it sees each value on arrival and may select the current element, irrevocably, earning d(t) v(π(t))d(t)\,v(\pi(t))d(t)v(π(t)). Expectations over π\piπ are exact averages over the n!n!n! orders.

The offline optimum on order π\piπ is OPT(π)=max⁡td(t) v(π(t))\mathsf{OPT}(\pi)=\max_t d(t)\,v(\pi(t))OPT(π)=maxt​d(t)v(π(t)); it is a random variable, and the benchmark is its expectation Eπ[OPT]\mathbb E_\pi[\mathsf{OPT}]Eπ​[OPT] (p. 4 of the paper).

Let dmax⁡=max⁡td(t)d_{\max}=\max_t d(t)dmax​=maxt​d(t) and vmax⁡=max⁡ev(e)v_{\max}=\max_e v(e)vmax​=maxe​v(e). For c≥1c\ge1c≥1 the ccc-th discount class is the set of times

Pc={ i:2−cdmax⁡<d(i)≤2−(c−1)dmax⁡ }.P_c=\{\,i : 2^{-c}d_{\max}<d(i)\le 2^{-(c-1)}d_{\max}\,\}.Pc​={i:2−cdmax​<d(i)≤2−(c−1)dmax​}.

The quantity OPTc\mathsf{OPT}_cOPTc​ is the part of Eπ[OPT]\mathbb E_\pi[\mathsf{OPT}]Eπ​[OPT] earned when the optimal time (the smallest time attaining the maximum) lies in PcP_cPc​.

The classical secretary rule on mmm arrivals observes the first ⌊m/e⌋\lfloor m/e\rfloor⌊m/e⌋ and then selects the first arrival that ranks above every earlier arrival. Ranks use a fixed tie-break order: larger value first, and smaller element index among equal values.

The algorithm A\mathcal AA sets M=3⌈log⁡2n⌉+2M=3\lceil\log_2 n\rceil+2M=3⌈log2​n⌉+2, draws c∈{1,…,M}c\in\{1,\dots,M\}c∈{1,…,M} uniformly, and runs the classical rule on the subsequence of arrivals at the times of PcP_cPc​, ignoring all other arrivals.

Formalization targets

Goal: Theorem 4.4 with its explicit constant

Eπ[OPT]  ≤  4e (3⌈log⁡2n⌉+2)  E[A](n≥1, d≥0, v≥0).\mathbb E_\pi[\mathsf{OPT}]\;\le\;4e\,\bigl(3\lceil\log_2 n\rceil+2\bigr)\;\mathbb E[\mathcal A]\qquad(n\ge1,\ d\ge0,\ v\ge0).Eπ​[OPT]≤4e(3⌈log2​n⌉+2)E[A](n≥1, d≥0, v≥0).

The paper states E[OPT]/E[A]≤O(log⁡n)\mathbb E[\mathsf{OPT}]/\mathbb E[\mathcal A]\le O(\log n)E[OPT]/E[A]≤O(logn); the constant 4e4e4e is the one its proof yields.

Milestones

  1. The classical secretary rule selects the top-ranked of m≥1m\ge1m≥1 elements with probability at least 1/e1/e1/e (§2, p. 4).
  2. OPT1≥vmax⁡dmax⁡/n\mathsf{OPT}_1\ge v_{\max}d_{\max}/nOPT1​≥vmax​dmax​/n (proof of Theorem 4.4, p. 7).
  3. OPTc≤2−c 2n2dmax⁡vmax⁡\mathsf{OPT}_c\le 2^{-c}\,2n^2d_{\max}v_{\max}OPTc​≤2−c2n2dmax​vmax​ for every c≥1c\ge1c≥1 (p. 7).
  4. ∑c=13⌈log⁡2n⌉+1OPTc≥12Eπ[OPT]\sum_{c=1}^{3\lceil\log_2 n\rceil+1}\mathsf{OPT}_c\ge\tfrac12\mathbb E_\pi[\mathsf{OPT}]∑c=13⌈log2​n⌉+1​OPTc​≥21​Eπ​[OPT] (p. 7).
  5. E[Ac]≥OPTc/2e\mathbb E[\mathcal A_c]\ge\mathsf{OPT}_c/2eE[Ac​]≥OPTc​/2e for every c≥1c\ge1c≥1, where Ac\mathcal A_cAc​ is the classical rule on PcP_cPc​ (p. 7).

Significance

The theorem shows that a general discount function costs only a logarithmic factor against the offline benchmark, and that one algorithm achieves this without any knowledge of the values. Together with the lower bound of Theorem 4.3 it pins the competitive ratio of the discounted secretary problem between log⁡n/log⁡log⁡n\log n/\log\log nlogn/loglogn and log⁡n\log nlogn. The same scale-splitting idea, stated in the paper as Theorem 4.5 without full proof, extends the bound to the weighted discounted problem.

The result is proved in the paper; to our knowledge it has not been formalized. A complete development would also produce a machine-checked proof of the classical secretary guarantee for the rule with sample size exactly ⌊m/e⌋\lfloor m/e\rfloor⌊m/e⌋ at every finite mmm, with an explicit tie-break, which is reusable by every secretary-type mission. Milestone 1 is that statement. Sharper constants or a smaller class range are welcome as additional statements but do not replace the goal, which is about this algorithm with this MMM.

Difficulty

The obvious argument, running the classical rule on all nnn arrivals, fails because the discounts can be concentrated at times the rule spends sampling. Splitting by discount scale fixes this but creates two problems. First, there are unboundedly many scales, and one has to show that the offline optimum's mass outside the top O(log⁡n)O(\log n)O(logn) of them is negligible against E[OPT]\mathbb E[\mathsf{OPT}]E[OPT], a random quantity rather than a fixed maximum. Second, the classical rule on a class sees only a random subset of the elements, in random order, and the guarantee must be transferred to this subsequence, conditioning on which elements land in PcP_cPc​. Neither step is deep, but both require careful bookkeeping of permutations, and the classical 1/e1/e1/e bound at finite mmm with a floor in the sample size is itself a nontrivial estimate.

Formalization scope

Elements and times are Fin n, an order is π : Equiv.Perm (Fin n) read as time ↦\mapsto↦ element, and the paper's time t=1,…,nt=1,\dots,nt=1,…,n is index t−1t-1t−1. Values and discounts are Fin n → ℝ with non-negativity hypotheses. Every expectation is the finite average 1n!∑π\frac1{n!}\sum_\pin!1​∑π​; the algorithm's random class is the explicit average 1M∑c=1M\frac1M\sum_{c=1}^MM1​∑c=1M​. Maxima are suprema over the finite index set. The logarithm is base 2, ⌈log⁡2n⌉\lceil\log_2 n\rceil⌈log2​n⌉ is Nat.clog 2 n, and the sample size is Nat.floor (m / Real.exp 1). Ties are broken by the order on Lex (ℝ × (Fin n)ᵒᵈ) (larger value, then smaller index); distinct values are not assumed. The optimal time is the smallest maximizing time, so that the OPTc\mathsf{OPT}_cOPTc​ add up to E[OPT]\mathbb E[\mathsf{OPT}]E[OPT]. Competitiveness is stated multiplicatively, never as a quotient, so E[A]=0\mathbb E[\mathcal A]=0E[A]=0 is not a loophole.

The goal is a statement about the specific algorithm A\mathcal AA, not "there exists an algorithm": an existential over unrestricted algorithms is witnessed by a clairvoyant rule that reads the values in advance. A\mathcal AA sees the values only through comparisons among arrivals that have already occurred, and E[OPT]\mathbb E[\mathsf{OPT}]E[OPT] is the expected offline maximum over the same random order, not dmax⁡vmax⁡d_{\max}v_{\max}dmax​vmax​.

Needed infrastructure: averages over permutations and the fact that the elements landing at a fixed set of times form a uniformly random subset in uniformly random order; the finite-mmm analysis of the classical rule; and elementary estimates on geometric sums. Contributions of general lemmas about uniform permutations are welcome and reusable.

Selected references

  • M. Babaioff, M. Dinitz, A. Gupta, N. Immorlica, K. Talwar, Secretary Problems: Weights and Discounts, Proc. 20th ACM-SIAM Symposium on Discrete Algorithms (SODA), 2009. https://doi.org/10.1137/1.9781611973068.139
  • E. B. Dynkin, The optimum choice of the instant for stopping a Markov process, Soviet Math. Doklady 4, 1963.
  • T. S. Ferguson, Who solved the secretary problem?, Statistical Science 4(3), 1989. https://doi.org/10.1214/ss/1177012493
  • L. T. Rasmussen, S. R. Pliska, Choosing the maximum from a sequence with a discount function, Applied Mathematics and Optimization 2, 1976. https://doi.org/10.1007/BF01458209
  • M. Babaioff, N. Immorlica, R. Kleinberg, Matroids, secretary problems, and online mechanisms, SODA 2007. https://dl.acm.org/doi/10.5555/1283383.1283429
9 thms3 active usersReviewed
🏆Completed
CombinatoricsMachine Learning·Captain: mikedeng1

How Much Data Is Sufficient to Learn High-Performing Algorithms? Generalization Guarantees for Data-Driven Algorithm Design 1: Pseudo-Dimension Bound from a Piecewise-Decomposable Dual ClassResearch Paper

Motivation

Many algorithms in operations research and computer science have tunable parameters: sequence-alignment weights, clustering linkage interpolations, branch-and-bound branching rules, auction reserve prices. In data-driven algorithm design the parameters are chosen by optimizing average performance over a training set of problem instances drawn from an unknown application-specific distribution. The question this mission is about is statistical: how many training instances suffice for the empirical average performance of every parameter setting to be close to its expected performance?

Classical learning theory answers this through the pseudo-dimension of the class of utility functions (Pollard, 1984): a bound on the pseudo-dimension gives a uniform convergence bound of order H(Pdim+ln⁡(1/δ))/NH\sqrt{(\mathrm{Pdim} + \ln(1/\delta))/N}H(Pdim+ln(1/δ))/N​. The difficulty is that utility functions of combinatorial algorithms are wildly discontinuous in the parameters, so standard tools (Lipschitz arguments, linear classes) do not apply. Balcan, DeBlasio, Dick, Kingsford, Sandholm and Vitercik (arXiv:1908.02894v4, STOC 2021) observed that for a large family of algorithms the utility on each fixed instance is a piecewise-structured function of the parameters, and proved a single general theorem converting that structure into a pseudo-dimension bound. Earlier analyses (for example Gupta and Roughgarden 2017; Balcan, Nagarajan, Vitercik and White 2017) derived such bounds one algorithm family at a time; Theorem 3.3 unifies them.

Setting

Let X\mathcal XX be a set of problem instances and U⊆RX\mathcal U \subseteq \mathbb R^{\mathcal X}U⊆RX a class of utility functions; in the paper U={uρ:ρ∈P}\mathcal U = \{u_\rho : \rho \in \mathcal P\}U={uρ​:ρ∈P} for a parameter space P⊆Rd\mathcal P \subseteq \mathbb R^dP⊆Rd, with uρ(x)u_\rho(x)uρ​(x) the performance of the algorithm with parameter ρ\rhoρ on instance xxx.

Pseudo-dimension. A class H\mathcal HH of real functions on a domain Y\mathcal YY shatters points y1,…,yNy_1, \dots, y_Ny1​,…,yN​ if there are targets z1,…,zN∈Rz_1, \dots, z_N \in \mathbb Rz1​,…,zN​∈R such that every one of the 2N2^N2N patterns of "above / not above ziz_izi​" at the points yiy_iyi​ is realized by some h∈Hh \in \mathcal Hh∈H. The pseudo-dimension Pdim(H)\mathrm{Pdim}(\mathcal H)Pdim(H) is the largest NNN for which some NNN points are shattered. For {0,1}\{0,1\}{0,1}-valued classes it is the VC-dimension VCdim(H)\mathrm{VCdim}(\mathcal H)VCdim(H).

Dual class (Definition 3.1). For H⊆RY\mathcal H \subseteq \mathbb R^{\mathcal Y}H⊆RY, each y∈Yy \in \mathcal Yy∈Y gives an evaluation map hy∗:H→Rh^*_y : \mathcal H \to \mathbb Rhy∗​:H→R, hy∗(h)=h(y)h^*_y(h) = h(y)hy∗​(h)=h(y), and H∗={hy∗:y∈Y}\mathcal H^* = \{h^*_y : y \in \mathcal Y\}H∗={hy∗​:y∈Y}. For utility functions, ux∗(uρ)=uρ(x)u^*_x(u_\rho) = u_\rho(x)ux∗​(uρ​)=uρ​(x): the dual function of instance xxx records performance on xxx as the algorithm varies.

Piecewise decomposability (Definition 3.2). Given a class G⊆{0,1}Y\mathcal G \subseteq \{0,1\}^{\mathcal Y}G⊆{0,1}Y of boundary functions, a class F⊆RY\mathcal F \subseteq \mathbb R^{\mathcal Y}F⊆RY of piece functions and k∈Nk \in \mathbb Nk∈N, a class H⊆RY\mathcal H \subseteq \mathbb R^{\mathcal Y}H⊆RY is (F,G,k)(\mathcal F, \mathcal G, k)(F,G,k)-piecewise decomposable if every h∈Hh \in \mathcal Hh∈H admits g(1),…,g(k)∈Gg^{(1)}, \dots, g^{(k)} \in \mathcal Gg(1),…,g(k)∈G and, for each bit vector b∈{0,1}k\boldsymbol b \in \{0,1\}^kb∈{0,1}k, some fb∈Ff_{\boldsymbol b} \in \mathcal Ffb​∈F, with h(y)=fby(y)h(y) = f_{\boldsymbol b_y}(y)h(y)=fby​​(y) where by=(g(1)(y),…,g(k)(y))\boldsymbol b_y = (g^{(1)}(y), \dots, g^{(k)}(y))by​=(g(1)(y),…,g(k)(y)). The theorem applies this to H=U∗\mathcal H = \mathcal U^*H=U∗, so F⊆RU\mathcal F \subseteq \mathbb R^{\mathcal U}F⊆RU and G⊆{0,1}U\mathcal G \subseteq \{0,1\}^{\mathcal U}G⊆{0,1}U, and their duals F∗\mathcal F^*F∗, G∗\mathcal G^*G∗ are classes of functions on F\mathcal FF and G\mathcal GG.

Formalization targets

Goal: Theorem 3.3, explicit form

Suppose U∗\mathcal U^*U∗ is (F,G,k)(\mathcal F, \mathcal G, k)(F,G,k)-piecewise decomposable, k≥1k \ge 1k≥1, dF=Pdim(F∗)d_F = \mathrm{Pdim}(\mathcal F^*)dF​=Pdim(F∗), dG=VCdim(G∗)d_G = \mathrm{VCdim}(\mathcal G^*)dG​=VCdim(G∗) and D=dF+dGD = d_F + d_GD=dF​+dG​. With a=D/ln⁡2a = D/\ln 2a=D/ln2 and b=(D+dGln⁡k)/ln⁡2b = (D + d_G\ln k)/\ln 2b=(D+dG​lnk)/ln2,

Pdim(U)≤4aln⁡(2a)+2b=O(Dln⁡D+dGln⁡k).\mathrm{Pdim}(\mathcal U) \le 4a\ln(2a) + 2b = O\bigl(D\ln D + d_G \ln k\bigr).Pdim(U)≤4aln(2a)+2b=O(DlnD+dG​lnk).

This is the explicit bound behind the printed O(⋅)O(\cdot)O(⋅); it is what the paper's proof establishes.

Milestones, in the order the proof uses them

  1. Lemma 3.4. For h1,…,hNh_1, \dots, h_Nh1​,…,hN​ in a {0,1}\{0,1\}{0,1}-valued class H\mathcal HH (N≥1N \ge 1N≥1),
∣{(h1(y),…,hN(y)):y∈Y}∣≤(eN)VCdim(H∗).|\{(h_1(y), \dots, h_N(y)) : y \in \mathcal Y\}| \le (eN)^{\mathrm{VCdim}(\mathcal H^*)}.∣{(h1​(y),…,hN​(y)):y∈Y}∣≤(eN)VCdim(H∗).
  1. Claim 3.5. For instances x1,…,xNx_1, \dots, x_Nx1​,…,xN​, the class U\mathcal UU splits into M≤(ekN)dGM \le (ekN)^{d_G}M≤(ekN)dG​ cells (strictly fewer when dG≥1d_G \ge 1dG​≥1) on each of which every uxi∗u^*_{x_i}uxi​∗​ coincides with one fixed piece function fi∈Ff_i \in \mathcal Ffi​∈F.
  2. Eq. (7). On any cell, fixed piece functions f1,…,fNf_1, \dots, f_Nf1​,…,fN​ realize at most (eN)dF(eN)^{d_F}(eN)dF​ label vectors (1[fi(u)>zi])i(\mathbb 1[f_i(u) > z_i])_i(1[fi​(u)>zi​])i​.
  3. Eq. (5). The whole class realizes at most (ekN)dG(eN)dF(ekN)^{d_G}(eN)^{d_F}(ekN)dG​(eN)dF​ label vectors (1[u(xi)>zi])i(\mathbb 1[u(x_i) > z_i])_i(1[u(xi​)>zi​])i​.
  4. Shattering inequality. If U\mathcal UU shatters x1,…,xNx_1, \dots, x_Nx1​,…,xN​ (N≥1N \ge 1N≥1), then 2N≤(ekN)dG(eN)dF2^N \le (ekN)^{d_G}(eN)^{d_F}2N≤(ekN)dG​(eN)dF​.
  5. Lemma A.1. For a≥1a \ge 1a≥1, b>0b > 0b>0: y<aln⁡y+by < a\ln y + by<alny+b implies y<4aln⁡(2a)+2by < 4a\ln(2a) + 2by<4aln(2a)+2b.

Significance

Theorem 3.3 is the engine behind every generalization guarantee in the paper. It is instantiated for piecewise-constant and piecewise-linear duals over Rd\mathbb R^dRd (Lemmas 3.8–3.10), and through them for sequence alignment, RNA folding, hierarchical clustering, integer programming (branch-and-bound), greedy algorithms and auction design. Combined with the classical uniform convergence bound, it says that O~(H2(D+dGln⁡k)/ε2)\tilde O(H^2(D + d_G\ln k)/\varepsilon^2)O~(H2(D+dG​lnk)/ε2) training instances suffice to tune any such algorithm to within ε\varepsilonε of its optimal expected performance. The matching lower bounds in the paper (Theorems 4.3 and 5.2) show that the bound is tight up to logarithmic factors.

The result is proved in the paper; to the best of available records it has not been machine-checked. The mission formalizes the known proof, including the dual-class version of Sauer's lemma and the counting argument over the partition induced by the boundary functions. The published Sauer's lemma FoundationsML.RademacherVC.sauer_lemma is included as a reference item, as it is the tool Lemma 3.4 cites.

Difficulty

The obvious approach, bounding the pseudo-dimension of U\mathcal UU directly from the complexity of F\mathcal FF and G\mathcal GG, fails: the piecewise structure lives on the dual side, and nothing about F\mathcal FF or G\mathcal GG themselves controls how U\mathcal UU labels instances. The bound has to pass through dual classes twice and through the dual of a dual once, and Sauer's lemma, which counts labelings of fixed points by varying functions, must be applied in the transposed direction. Formally, the counting step needs bookkeeping of label vectors under a partition indexed by kNkNkN boundary functions, and a conversion from a pseudo-dimension bound on F∗\mathcal F^*F∗ to a VC-dimension bound on the thresholded class {(f,z)↦1[f(u)>z]}\{(f, z) \mapsto \mathbb 1[f(u) > z]\}{(f,z)↦1[f(u)>z]}, which needs the observation that a shattered tuple of pairs has distinct first coordinates.

Formalization scope

  • Pseudo- and VC-dimension are the published FoundationsML predicates Shatters, PseudoDim, GrowthFunction, HasVCDim. The exact-value predicates fix finite dimensions dFd_FdF​, dGd_GdG​, which the paper's bound presupposes. "Pdim(U)≤B\mathrm{Pdim}(\mathcal U) \le BPdim(U)≤B" is stated as "every shattered tuple has length at most BBB". {0,1}\{0,1\}{0,1} is Bool.
  • Sign convention. Shattering uses strict thresholds u(xi)>ziu(x_i) > z_iu(xi​)>zi​; the paper leaves sign(0)\mathrm{sign}(0)sign(0) unspecified, and strict and non-strict thresholds shatter the same tuples, so the dimension is unchanged. Label vectors in the counting milestones use the same reading.
  • Domains. The dual classes are classes of functions on the subtype of the primal class. Parameters ρ\rhoρ are indexed by the functions uρu_\rhouρ​ themselves, and Claim 3.5's partition of P\mathcal PP becomes a partition of U\mathcal UU; nothing in the theorem depends on ρ\rhoρ except through uρu_\rhouρ​.
  • Corrections of the printed statements. (i) Theorem 3.3's O(⋅)O(\cdot)O(⋅) is replaced by the explicit bound 4aln⁡(2a)+2b4a\ln(2a) + 2b4aln(2a)+2b derived from the paper's own last step and Lemma A.1, with k≥1k \ge 1k≥1 added (the printed ln⁡k\ln klnk is undefined at k=0k = 0k=0); the case D=0D = 0D=0 is covered, where the bound is 000. (ii) Lemma 3.4 and the counting milestones assume N≥1N \ge 1N≥1; at N=0N = 0N=0 the printed bounds read 1≤01 \le 01≤0. (iii) Claim 3.5's strict M<(ekN)VCdim(G∗)M < (ekN)^{\mathrm{VCdim}(\mathcal G^*)}M<(ekN)VCdim(G∗) is kept for VCdim(G∗)≥1\mathrm{VCdim}(\mathcal G^*) \ge 1VCdim(G∗)≥1 and weakened to ≤\le≤ only when VCdim(G∗)=0\mathrm{VCdim}(\mathcal G^*) = 0VCdim(G∗)=0, where the strict form is false (M=1M = 1M=1). The milestone texts are quoted verbatim.
  • Dropped hypothesis. The range [0,H][0, H][0,H] of the utility functions is not used by the theorem or its proof and is omitted, which makes the statement more general.
  • Ruling out trivializations. The goal carries the explicit constant, never an O(⋅)O(\cdot)O(⋅) with a constant chosen after the classes; the hypotheses are jointly satisfiable on a nontrivial example (one instance, uρ(x)=ρu_\rho(x) = \rhouρ​(x)=ρ, k=1k = 1k=1, dF=1d_F = 1dF​=1, dG=0d_G = 0dG​=0, in which U\mathcal UU does shatter one point), checked by a sorry-free local verification file; all counts are of subsets of {0,1}N\{0,1\}^N{0,1}N, so no cardinality silently defaults to zero.
  • Contributions welcome: proofs of each milestone; a dual-class Sauer lemma reusable for other data-driven design papers; the passage from pseudo-dimension of F∗\mathcal F^*F∗ to the VC-dimension of its thresholded class.

Selected references

  • M.-F. Balcan, D. DeBlasio, T. Dick, C. Kingsford, T. Sandholm, E. Vitercik, How Much Data Is Sufficient to Learn High-Performing Algorithms? Generalization Guarantees for Data-Driven Algorithm Design, STOC 2021; arXiv:1908.02894v4, 2021. https://arxiv.org/abs/1908.02894
  • P. Assouad, Densité et dimension, Annales de l'Institut Fourier 33(3), 1983. https://doi.org/10.5802/aif.938
  • D. Pollard, Convergence of Stochastic Processes, Springer, 1984. https://doi.org/10.1007/978-1-4612-5254-2
  • N. Sauer, On the density of families of sets, Journal of Combinatorial Theory A 13(1), 1972. https://doi.org/10.1016/0097-3165(72)90019-2
  • S. Shalev-Shwartz, S. Ben-David, Understanding Machine Learning: From Theory to Algorithms, Cambridge University Press, 2014. https://doi.org/10.1017/CBO9781107298019
  • R. Gupta, T. Roughgarden, A PAC approach to application-specific algorithm selection, SIAM Journal on Computing 46(3), 2017. https://doi.org/10.1137/15M1050276
14 thms3 active usersReviewed
🏆Completed
Optimization·Captain: mikedeng1

Sequencing with Earliness and Tardiness Penalties: With Due-Date Tolerances, the Least Optimal Common Due Date Puts One Job at an End of Its Tolerance WindowResearch Paper

Motivation

Earliness/tardiness (E/T) scheduling penalizes a job both for finishing late and for finishing early. It models just-in-time production, where an early job ties up inventory and a late one delays a customer. Baker and Scudder's review (Oper. Res. 38 (1990) 22–36) organized the single-machine E/T literature around a short list of structural properties of optimal schedules for a common due date shared by all jobs. For the problem without tolerances these properties go back to work the review surveys, beginning with Kanet (1981) for equal penalties.

The review then turns to due-date tolerances: a job pays nothing if it completes within a window around the due date, as in contracts that accept delivery within a few days of a target. Cheng (1988) studied a version in which the penalty is discontinuous at the window ends. Baker and Scudder state the continuous version and prove two generalized properties, III(G) and IV(G), in the paper's Appendix (pp. 34–35). They are the paper's own results; the rest of the review cites results proved elsewhere.

Setting

Fix n≥1n \ge 1n≥1 jobs, processed on one machine in a fixed order, one after another, starting at time 000 with no idle time between them. The job in position jjj has a processing time pjp_jpj​, so it completes at Cj=p1+⋯+pjC_j = p_1 + \dots + p_jCj​=p1​+⋯+pj​. All jobs share a common due date d∈Rd \in \mathbb Rd∈R, which is a decision variable. Job jjj has tolerances uj,vj≥0u_j, v_j \ge 0uj​,vj​≥0 and is free of penalty when Cj∈[d−uj, d+vj]C_j \in [d - u_j,\ d + v_j]Cj​∈[d−uj​, d+vj​]. Outside its window it pays a unit earliness penalty αj>0\alpha_j > 0αj​>0 or a unit tardiness penalty βj>0\beta_j > 0βj​>0:

Ej=(d−Cj−uj)+,Tj=(Cj−d−vj)+,f(d)=∑j=1n(αjEj+βjTj).E_j = (d - C_j - u_j)^+,\qquad T_j = (C_j - d - v_j)^+,\qquad f(d) = \sum_{j=1}^n \bigl(\alpha_j E_j + \beta_j T_j\bigr).Ej​=(d−Cj​−uj​)+,Tj​=(Cj​−d−vj​)+,f(d)=j=1∑n​(αj​Ej​+βj​Tj​).

The tolerances are small compared with the processing times: pj−vj−ui>0p_j - v_j - u_i > 0pj​−vj​−ui​>0 for distinct jobs i≠ji \ne ji=j. Under this condition at most one job can avoid penalty costs. A due date is optimal if it minimizes fff over R\mathbb RR, and the least optimal due date is the smallest optimal one. The paper minimizes ddd as a secondary criterion when there are alternative optima.

In Lean the model is BakerScudder1990.Tolerance.Instance n, with fields p u v α β : Fin n → ℝ, completion times I.C, earliness I.earliness d, tardiness I.tardiness d, total penalty I.cost d, and the predicates I.IsOptimalDueDate and I.IsLeastOptimalDueDate.

Formalization targets

Goal: Property IV(G)

Let ddd be the least optimal due date and let bbb be the number of jobs with Tj=0T_j = 0Tj​=0. Then a least optimal due date exists, and exactly one of the following holds:

Cb=d+vbwith∑i<bαi<∑i≥bβi,  ∑i<bαi≥∑i>bβi,Cb=d−ubwith∑i<bαi<∑i>bβi,  ∑i≤bαi≥∑i>bβi.\begin{aligned} C_b &= d + v_b \quad\text{with}\quad \textstyle\sum_{i<b}\alpha_i < \sum_{i\ge b}\beta_i,\ \ \sum_{i<b}\alpha_i \ge \sum_{i>b}\beta_i,\\ C_b &= d - u_b \quad\text{with}\quad \textstyle\sum_{i<b}\alpha_i < \sum_{i>b}\beta_i,\ \ \sum_{i\le b}\alpha_i \ge \sum_{i>b}\beta_i. \end{aligned}Cb​Cb​​=d+vb​with∑i<b​αi​<∑i≥b​βi​,  ∑i<b​αi​≥∑i>b​βi​,=d−ub​with∑i<b​αi​<∑i>b​βi​,  ∑i≤b​αi​≥∑i>b​βi​.​

The case labels follow the paper's proof. The printed statement swaps them (see Formalization scope).

Milestones

  1. Case 1 of the proof of III(G). Between the window of job j−1j-1j−1 and the window of job jjj, fff is affine with slope ∑i<jαi−∑i≥jβi\sum_{i<j}\alpha_i - \sum_{i\ge j}\beta_i∑i<j​αi​−∑i≥j​βi​. Before the first window and after the last, the slopes are −∑iβi-\sum_i\beta_i−∑i​βi​ and ∑iαi\sum_i\alpha_i∑i​αi​.
  2. Case 2 of the proof of III(G). Inside the window of job jjj, fff is affine with slope ∑i<jαi−∑i>jβi\sum_{i<j}\alpha_i - \sum_{i>j}\beta_i∑i<j​αi​−∑i>j​βi​.
  3. Property III(G). A least optimal due date exists, and at it some job completes at d−ujd - u_jd−uj​ or at d+vjd + v_jd+vj​.
  4. The two optimality conditions. The first pair of inequalities above makes Cj−vjC_j - v_jCj​−vj​ the least optimal due date, and the second pair makes Cj+ujC_j + u_jCj​+uj​ the least optimal due date.

Significance

III(G) reduces the choice of an optimal common due date for a given sequence to 2n2n2n candidates. IV(G) goes further and names the candidate directly from prefix and suffix sums of the penalties. Baker and Scudder use this to say which V-shaped sequences remain candidates for optimality, so that an enumeration over sequences can discard the others. With uj=vj=0u_j = v_j = 0uj​=vj​=0 the two properties reduce to the classical common-due-date conditions: some job completes exactly at ddd, and which one is fixed by a weighted-median condition.

The results are proved in the paper, so the formalization does not settle an open question. It produces a machine-checked version of the Appendix, with two printed errors corrected, and a reusable model of single-machine E/T costs with tolerance windows. No earliness/tardiness model or result was formalized on Prove2Me as of October 2026.

Difficulty

Each linear piece of fff is elementary. The work lies in showing that the pieces are the claimed ones: the tolerance condition must imply that a job before position jjj is early, and a job after it tardy, throughout each gap and window. That needs the ordering Ci+ui<Cj−vjC_i + u_i < C_j - v_jCi​+ui​<Cj​−vj​ for every i<ji < ji<j, not only for consecutive jobs. The second point is the least optimal due date. Optimality alone does not determine ddd on a flat stretch of fff, where every point is optimal and only the left end satisfies the strict inequalities. Existence of a least minimizer also has to be shown, from the two outer slopes and finitely many breakpoints. Finally, the count bbb of jobs without tardiness must be matched to the position of the critical job at both kinds of breakpoint.

Formalization scope

  • Jobs are indexed by 0-based positions Fin n, so the paper's job bbb is position k=b−1k = b - 1k=b−1 and the goal states the count of untardy jobs as k+1k+1k+1. Data are real numbers. (x)+(x)^+(x)+ is max 0 x.
  • The sequence starts at time 000 and ddd ranges over all of R\mathbb RR; this is the unrestricted problem, which is the one where the paper asserts III(G) and IV(G). Shifting the start time is equivalent to shifting ddd.
  • "In an optimal schedule" is read for a fixed sequence and its least optimal due date. If a sequence and due date are jointly optimal with ddd least among such optima, then ddd is the least optimal due date for that sequence, so this reading implies the paper's.
  • The tolerance condition is assumed only for distinct jobs. That is a weaker hypothesis than the literal "for all pairs (i,j)(i,j)(i,j)", so the theorems are stronger.
  • Errata, corrected and disclosed. (i) IV(G) is printed (p. 30 and p. 35) with its two case labels swapped relative to its own proof. One job with u1,v1>0u_1, v_1 > 0u1​,v1​>0 has least optimal due date C1−v1C_1 - v_1C1​−v1​, so C1=d+v1C_1 = d + v_1C1​=d+v1​ while the first condition pair holds. (ii) In Cases 1 and 2 the identity is printed as f(S)−f(S′)=[… ]εf(S) - f(S') = [\dots]\varepsilonf(S)−f(S′)=[…]ε; the correct one is f(S′)−f(S)=[… ]εf(S') - f(S) = [\dots]\varepsilonf(S′)−f(S)=[…]ε. The milestone texts are quoted as printed; the Lean states the corrected mathematics.
  • Existence of a least optimal due date is a conjunct of III(G) and of IV(G), and both assume n≥1n \ge 1n≥1. A version quantifying only over least optimal due dates without existence would be vacuous. A version for every optimal due date would be false. Neither is acceptable.
  • The optimality conditions are stated as sufficient. Their converse fails when uj=vj=0u_j = v_j = 0uj​=vj​=0.
  • Properties I and II (no inserted idle time, V-shaped sequences) are quoted in the paper, not proved there, and are not formalized. Optimization over sequences is out of scope.
  • Welcome contributions: proofs of the two slope identities (finite sums of max 0 terms with a sign determined on each piece), a general lemma that a convex piecewise-linear coercive function on R\mathbb RR attains its least minimizer at a breakpoint, and the special cases u=v=0u = v = 0u=v=0 as corollaries.

Selected references

  • K. R. Baker and G. D. Scudder, Sequencing with earliness and tardiness penalties: a review, Operations Research 38(1) (1990) 22–36. https://doi.org/10.1287/opre.38.1.22
  • J. J. Kanet, Minimizing the average deviation of job completion times about a common due date, Naval Research Logistics Quarterly 28 (1981) 643–651 (as cited in Baker and Scudder 1990).
  • U. Bagchi, R. S. Sullivan and Y.-L. Chang, Minimizing mean absolute deviation of completion times about a common due date, Naval Research Logistics Quarterly 33 (1986) 227–240 (as cited in Baker and Scudder 1990).
  • T. C. E. Cheng, Optimal common due date with limited completion time deviation, Computers & Operations Research 15 (1988) 91–96 (as cited in Baker and Scudder 1990).
6 thms3 active usersReviewed
CombinatoricsProbabilityTheoretical Computer Science·Captain: mikedeng1

A Polylogarithmic-Competitive Algorithm for the k-Server Problem: Randomized k-Server Is O(log² k · log³ n · log log n)-Competitive on Every n-Point MetricResearch Paper

Motivation

The k-server problem (Manasse, McGeoch and Sleator, 1990) is the central problem of online computation: kkk servers sit on points of a metric space, requests arrive one at a time at points of the space, and each request must be served by moving a server to it, at a cost equal to the distance travelled. An online algorithm decides without knowing future requests; its quality is its competitive ratio, the worst-case ratio between its cost and the cost of an optimal offline schedule. Paging (caching) is the special case of a uniform metric, and weighted paging the case of a weighted star.

Timeline of the upper bounds for general metrics:

  • 1990: Manasse, McGeoch and Sleator prove that every deterministic algorithm has ratio at least kkk and conjecture that kkk is achievable.
  • 1991: Fiat, Rabani and Ravid give the first ratio depending on kkk only (exponential in kkk).
  • 1995: Koutsoupias and Papadimitriou prove that the work function algorithm is (2k−1)(2k-1)(2k−1)-competitive.
  • For randomized algorithms against an oblivious adversary, the conjectured answer is O(log⁡k)O(\log k)O(logk), achieved for paging (Fiat et al., 1991), but until 2011 nothing better than the deterministic 2k−12k-12k−1 was known for general metrics, even when the ratio may depend on the number of points nnn.
  • 2011: Bansal, Buchbinder, Mądry and Naor give the first polylogarithmic bound, O(log⁡2klog⁡3nlog⁡log⁡n)O(\log^2 k\log^3 n\log\log n)O(log2klog3nloglogn) (arXiv:1110.1580; J. ACM 62(5), 2015, DOI 10.1145/2783434), the result of this mission.

Setting

Let (M,dist)(M,\mathrm{dist})(M,dist) be a finite metric space with nnn points and kkk a number of servers. A configuration C:{1,…,k}→MC:\{1,\dots,k\}\to MC:{1,…,k}→M places server iii at C(i)C(i)C(i). A deterministic online algorithm maps each prefix of the request sequence to a configuration that has a server at the last request; its cost on a sequence ρ\rhoρ is the total distance travelled. OPT(C0,ρ)\mathrm{OPT}(C_0,\rho)OPT(C0​,ρ) is the least cost of any schedule serving ρ\rhoρ from the initial configuration C0C_0C0​. A randomized algorithm is a probability distribution over deterministic online algorithms, all starting at C0C_0C0​; it is ccc-competitive if there is a constant aaa such that its expected cost on every request sequence ρ\rhoρ is at most c⋅OPT(C0,ρ)+ac\cdot\mathrm{OPT}(C_0,\rho)+ac⋅OPT(C0​,ρ)+a.

The paper works with three auxiliary objects. A σ-HST is a rooted tree whose leaves are the points, in which all edges from a node to its children have one common length, equal to 1/σ1/\sigma1/σ times the length of the edge above that node; the distance between two leaves is the length of the tree path. A weighted σ-HST only requires that the edge above a non-root internal node be at least σ\sigmaσ times each edge below it. In the fractional k-server problem on a tree, the state is a vector xxx of server probabilities on the leaves with 0≤xi≤10\le x_i\le10≤xi​≤1 and ∑ixi=k\sum_i x_i=k∑i​xi​=k, a request at leaf iii forces xi=1x_i=1xi​=1, and moving from xxx to x′x'x′ costs ∑vW(v) ∣xv′−xv∣\sum_v W(v)\,|x'_v-x_v|∑v​W(v)∣xv′​−xv​∣, where xvx_vxv​ is the mass below node vvv and W(v)W(v)W(v) the length of the edge above vvv. In the allocation problem on a weighted star with weights wiw_iwi​, requests carry a location iti^tit, a monotone cost vector ht(0)≥⋯≥ht(k)≥0h^t(0)\ge\dots\ge h^t(k)\ge0ht(0)≥⋯≥ht(k)≥0 (the cost of serving with jjj servers there) and a server quota κ(t)≤k\kappa(t)\le kκ(t)≤k.

Formalization targets

Goal: Theorem 1

There is a universal constant C>0C>0C>0 such that for all k≥2k\ge2k≥2, every metric space MMM with n≥3n\ge3n≥3 points and every initial configuration C0C_0C0​, some randomized online algorithm starting at C0C_0C0​ is

C log⁡2k log⁡3n log⁡log⁡n-competitive.C\,\log^2 k\,\log^3 n\,\log\log n\text{-competitive.}Clog2klog3nloglogn-competitive.

Milestones

In the order the proof uses them:

  1. Claim 15: the fix-stage inequality behind the allocation algorithm's analysis.
  2. Theorem 5: for every 0<ε≤10<\varepsilon\le10<ε≤1, a fractional allocation algorithm whose hit cost is at most (1+ε)(Opt+wmax⁡g(κ))+a(1+\varepsilon)(\mathrm{Opt}+w_{\max}g(\kappa))+a(1+ε)(Opt+wmax​g(κ))+a and whose movement cost is at most O(log⁡(k/ε))(Opt+wmax⁡g(κ))+aO(\log(k/\varepsilon))(\mathrm{Opt}+w_{\max}g(\kappa))+aO(log(k/ε))(Opt+wmax​g(κ))+a, where g(κ)=∑t∣κ(t)−κ(t−1)∣g(\kappa)=\sum_t|\kappa(t)-\kappa(t-1)|g(κ)=∑t​∣κ(t)−κ(t−1)∣.
  3. Theorem 6: given such allocation algorithms, an O(ℓlog⁡(kℓ))O(\ell\log(k\ell))O(ℓlog(kℓ))-competitive fractional k-server algorithm on every weighted σ-HST of depth ℓ\ellℓ with σ=Ω(ℓlog⁡(kℓ))\sigma=\Omega(\ell\log(k\ell))σ=Ω(ℓlog(kℓ)).
  4. Theorem 8: every σ-HST with nnn leaves becomes a weighted σ-HST of depth O(log⁡n)O(\log n)O(logn) on the same leaves, with distances distorted by at most 2σ/(σ−1)2\sigma/(\sigma-1)2σ/(σ−1).
  5. Lemma 25 and Theorem 24: on a σ-HST with σ>5\sigma>5σ>5, randomized states consistent with a changing fractional state can be maintained online at cost O(ct)O(c_t)O(ct​) per step.
  6. Theorem 7: on a σ-HST with σ>5\sigma>5σ>5, a ccc-competitive fractional algorithm yields an O(c)O(c)O(c)-competitive randomized one.

Significance

The theorem broke the exponential gap between the Ω(log⁡k)\Omega(\log k)Ω(logk) lower bound and the 2k−12k-12k−1 upper bound for randomized k-server, and showed that randomization helps on every finite metric, not only on uniform or specially structured ones. Its two-level method (a fractional algorithm on trees driven by per-node allocation problems, followed by an online rounding) became the template for later work, including the O(log⁡2k)O(\log^2 k)O(log2k) bound on HSTs of Bubeck, Cohen, Lee, Lee and Mądry (STOC 2018) and Lee's O(log⁡6k)O(\log^6 k)O(log6k) bound on general metrics (FOCS 2018).

The result is proved, in this paper. As far as is known it has no machine-checked proof. Formalizing it means formalizing the analysis of an online algorithm driven by a continuous-time process, a potential-function argument with exact constants, a tree contraction with a distortion bound, and an online randomized rounding against a transportation cost. The allocation, HST and rounding statements are reusable for other online problems on trees (metrical task systems, weighted paging).

Difficulty

For a deterministic or randomized algorithm on a tree, the natural recursion splits the servers of each node among its children. Coté, Meyerson and Poplawski showed that this works if each node solves an allocation problem with a strong guarantee: hit cost within a factor 1+ε1+\varepsilon1+ε of optimal. Integral allocation algorithms cannot achieve this; the integrality gap example of the paper (p. 8) gives a factor Ω(k)\Omega(k)Ω(k). The fractional relaxation avoids the gap, but then the rounding step must keep a randomized state consistent with a fractional state at constant-factor cost, and the HSTs obtained from general metrics have depth growing with the aspect ratio, which a depth-dependent ratio cannot afford. Each of the three reductions (allocation to fractional k-server, deep HST to shallow weighted HST, fractional to randomized) loses only polylogarithmic or constant factors, and the main theorem needs all three at once.

Formalization scope

The k-server model, randomized algorithms and competitiveness are the published definitions KServer_model and KServer_randomized; competitiveness carries an additive constant fixed before the request sequence. Trees are finite rooted trees with a parent map, a depth function and positive edge lengths; points of the k-server problem are the leaves, and the theorems take an arbitrary finite metric space together with a bijection to the leaves and the hypothesis that the distance equals the tree distance. Fractional k-server states have exactly kkk units of mass, each leaf at most 111, and fractional algorithms are measured against the integral offline optimum. The allocation optimum is the integral optimum; cost vectors are finite, non-negative and non-increasing; the diameter of the star is wmax⁡=max⁡iwiw_{\max}=\max_i w_iwmax​=maxi​wi​. The cost of changing a randomized state is the transportation cost over couplings, with minimum-matching cost between configurations. Every O(⋅)O(\cdot)O(⋅) is an explicit constant quantified before the instance, except that in Theorems 7 and 24 and Lemma 25 it may depend on σ\sigmaσ.

Formalizations that make the targets trivial are excluded: the fractional state must place a full server on every request and stay in [0,1][0,1][0,1], the benchmark is the integral optimum (not the algorithm's own or the fractional cost), and no constant may depend on kkk, nnn, the metric or the tree, since otherwise Theorem 1 would follow from the 2k−12k-12k−1 bound.

The proof of Theorem 1 also uses the embedding of Fakcharoenphol, Rao and Talwar [18] of a finite metric into a distribution over σ-HSTs with expected distortion O(σlog⁡σn)O(\sigma\log_\sigma n)O(σlogσ​n). It is an external ingredient, not a result of this paper, and is not a milestone; contributions formalizing it (or Bartal's earlier embedding) are welcome, as are formalizations of the integral optimum's properties on trees (Lemmas 21–22 of the paper), which are not stated here.

Selected references

  • N. Bansal, N. Buchbinder, A. Mądry, J. Naor, A Polylogarithmic-Competitive Algorithm for the k-Server Problem, arXiv:1110.1580v1, 2011; J. ACM 62(5), 2015. https://arxiv.org/abs/1110.1580, https://doi.org/10.1145/2783434
  • M. Manasse, L. McGeoch, D. Sleator, Competitive algorithms for server problems, J. Algorithms 11, 1990. https://doi.org/10.1016/0196-6774(90)90003-W
  • E. Koutsoupias, C. Papadimitriou, On the k-server conjecture, J. ACM 42(5), 1995. https://doi.org/10.1145/210118.210128
  • A. Fiat, R. Karp, M. Luby, L. McGeoch, D. Sleator, N. Young, Competitive paging algorithms, J. Algorithms 12, 1991. https://doi.org/10.1016/0196-6774(91)90041-V
  • J. Fakcharoenphol, S. Rao, K. Talwar, A tight bound on approximating arbitrary metrics by tree metrics, J. Comput. Syst. Sci. 69(3), 2004. https://doi.org/10.1016/j.jcss.2004.04.011
  • A. Coté, A. Meyerson, L. Poplawski, Randomized k-server on hierarchical binary trees, STOC 2008. https://doi.org/10.1145/1374376.1374474
14 thms3 active usersReviewed
🏆Completed
CombinatoricsOptimizationTheoretical Computer Science·Captain: mikedeng1

Online Scheduling of a Single Machine to Minimize Total Weighted Completion Time: Delayed SWPT Has Competitive Ratio 2Research Paper

Motivation

A single machine must process nnn jobs that arrive over time. Job jjj is released at time rjr_jrj​, needs pjp_jpj​ units of uninterrupted processing, and has weight wj>0w_j > 0wj​>0; the goal is to minimize the total weighted completion time ∑jwjCj\sum_j w_j C_j∑j​wj​Cj​. Offline, with all release dates equal to zero, Smith's rule (sequence by nondecreasing pj/wjp_j/w_jpj​/wj​) is optimal (Smith 1956); with arbitrary release dates the problem 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​ is strongly NP-hard (Lenstra, Rinnooy Kan and Brucker 1977).

In the online version the scheduler learns of job jjj only at time rjr_jrj​, and at each moment must either start a released job or keep the machine idle. Its quality is measured by its competitive ratio: the worst case, over all instances, of the ratio between the online schedule's cost and the offline optimum. Release-date scheduling is one of the basic test cases of online optimization.

Timeline:

  • 1996. Hoogeveen and Vestjens show that no online algorithm has competitive ratio below 2, even with equal weights, and give the 2-competitive algorithm Delayed SPT for equal weights.
  • 1997. Hall, Schulz, Shmoys and Wein give a (3+ε)(3+\varepsilon)(3+ε)-competitive algorithm for arbitrary weights, based on geometric intervals and linear programming.
  • 1998. Phillips, Stein and Wein give another 2-competitive algorithm for equal weights, which does not extend to arbitrary weights.
  • 2002. Goemans, Queyranne, Schulz, Skutella and Wang obtain a (1+2)(1+\sqrt2)(1+2​)-competitive deterministic algorithm from an LP relaxation.
  • 2004. Anderson and Potts show that Delayed SWPT has competitive ratio exactly 2 for arbitrary positive weights, matching the lower bound.

Setting

An instance has jobs j∈J={1,…,n}j \in J = \{1,\dots,n\}j∈J={1,…,n} with integer release dates rj≥0r_j \ge 0rj​≥0, integer processing times pj≥1p_j \ge 1pj​≥1 and real weights wj>0w_j > 0wj​>0. A schedule assigns each job an integer start time SjS_jSj​. It is feasible if Sj≥rjS_j \ge r_jSj​≥rj​ for every jjj and no two intervals [Sj,Sj+pj)[S_j, S_j + p_j)[Sj​,Sj​+pj​) overlap; idle time is allowed. Its cost is C(S)=∑jwj(Sj+pj)C(S) = \sum_j w_j (S_j + p_j)C(S)=∑j​wj​(Sj​+pj​).

Delayed SWPT runs over unit time slots [t,t+1)[t, t+1)[t,t+1). When the machine is available at time ttt, it looks at the jobs released by ttt and not yet started, and selects one with the smallest ratio pj/wjp_j/w_jpj​/wj​. Ties go to the smaller pjp_jpj​, then to the smaller index. If pj≤tp_j \le tpj​≤t, it starts jjj at ttt and the machine is busy until t+pjt + p_jt+pj​. Otherwise the machine stays idle and the rule is applied again at t+1t+1t+1. The resulting schedule is written π\piπ, or dswpt I in Lean. In particular no job starts before time pjp_jpj​.

The proof uses three auxiliary problems:

  • the doubled problem (2P), with data (2rj,2pj,wj)(2r_j, 2p_j, w_j)(2rj​,2pj​,wj​);
  • the extended problem (E), with release dates rj′=max⁡{pj,f(rj)}r'_j = \max\{p_j, f(r_j)\}rj′​=max{pj​,f(rj​)}, where f(t)f(t)f(t) is the first time at or after ttt at which π\piπ leaves the machine free;
  • one unit-length gap job gtg_tgt​ for each slot [t,t+1)[t,t+1)[t,t+1) in which Delayed SWPT idles although a job jjj is available. The gap job has release date f(rj)f(r_j)f(rj​) and weight wj/pjw_j/p_jwj​/pj​.

The schedule πE\pi_EπE​ of (E) runs the original jobs as in π\piπ and each gtg_tgt​ in [t,t+1)[t,t+1)[t,t+1).

Formalization targets

Goal: Theorem 8

min⁡{ρ  :  ∑jwjCj(π)≤ρ∑jwjCj(S) for every instance and every feasible schedule S}=2.\min\Bigl\{\rho \;:\; \sum_j w_j C_j(\pi) \le \rho \sum_j w_j C_j(S)\ \text{for every instance and every feasible schedule } S\Bigr\} = 2.min{ρ:j∑​wj​Cj​(π)≤ρj∑​wj​Cj​(S) for every instance and every feasible schedule S}=2.

Lean: IsLeast {ρ | ∀ n I S, IsFeasible I.r I.p S → cost I.w I.p (dswpt I) ≤ ρ * cost I.w I.p S} 2. Both halves are required: the upper bound 222 and the fact that no smaller constant is valid for this algorithm.

Milestones

  1. πj≥pj\pi_j \ge p_jπj​≥pj​ for every job (§2) and rj′≤max⁡{2rj,pj}r'_j \le \max\{2r_j, p_j\}rj′​≤max{2rj​,pj​} (§3.2).
  2. πE\pi_EπE​ is feasible for (E) (§3.2).
  3. Lemma 1. If π∗\pi^*π∗ and μ∗\mu^*μ∗ are optimal for (P) and (2P), then C(μ∗)=2 C(π∗)C(\mu^*) = 2\,C(\pi^*)C(μ∗)=2C(π∗).
  4. Lemma 2. πE\pi_EπE​ is optimal for (E).
  5. Lemma 3. If μ∗\mu^*μ∗ is optimal for (2P) and a feasible σE\sigma_EσE​ for (E) satisfies
∑j∈JwjCj(σE)+∑g∈GwgCg(σE)≤∑j∈JwjCj(μ∗)+∑g∈GwgCg(πE),(1)\sum_{j\in J} w_j C_j(\sigma_E) + \sum_{g\in G} w_g C_g(\sigma_E) \le \sum_{j\in J} w_j C_j(\mu^*) + \sum_{g\in G} w_g C_g(\pi_E), \tag{1}j∈J∑​wj​Cj​(σE​)+g∈G∑​wg​Cg​(σE​)≤j∈J∑​wj​Cj​(μ∗)+g∈G∑​wg​Cg​(πE​),(1)

then C(π)≤2 C(S)C(\pi) \le 2\,C(S)C(π)≤2C(S) for every feasible SSS. 6. Inequality (1) holds for some feasible σE\sigma_EσE​, for every optimal μ∗\mu^*μ∗ of (2P) (§§3.4–3.6).

Significance

The theorem shows that a deterministic online algorithm can match the lower bound of Hoogeveen and Vestjens for arbitrary positive weights. This settles the best competitive ratio for deterministic online algorithms for 1 ∣ rj ∣ ∑wjCj1\,|\,r_j\,|\,\sum w_j C_j1∣rj​∣∑wj​Cj​. The algorithm needs no linear program. The analysis also does not compare the algorithm with a lower bound on the optimum. Instead it shows that the online schedule is optimal for a modified problem (E), and it converts an optimal schedule of (2P) into a schedule of (E).

The result was proved on paper in 2004. Neither Mathlib nor the Prove2Me catalog contains a machine-checked proof of it, or of any competitive ratio for online scheduling with release dates. This mission provides several reusable pieces:

  • an executable, verified-terminating definition of an online scheduling rule;
  • the doubling lemma for release-date problems;
  • the optimality criterion behind Lemma 2;
  • the block-by-block exchange argument of §§3.3–3.6.

Difficulty

The obvious argument fails at Lemma 2. Delayed SWPT is far from optimal for (P) itself, and its idle time is unbounded in relative terms. The proof therefore has to show that the inserted gap jobs make every idle slot "justified", so that a preemptive best-available argument becomes valid for (E). That argument rests on an optimality criterion of Belouadah, Posner and Potts (1992), which is not in Mathlib.

The second difficulty is inequality (1). Once μ∗\mu^*μ∗ is doubled and the gap jobs are inserted, nongap jobs must be shifted, and the gain of each gap-generating job must be charged against the delay of the gap jobs in its block. That accounting (Lemmas 4–7 of the paper) is an induction over blocks with signed differences of completion times.

The natural first idea, plain online SWPT (start the available job with the smallest pj/wjp_j/w_jpj​/wj​ whenever the machine is free), has no finite competitive ratio (Example 1 of the paper), so the delay πj≥pj\pi_j \ge p_jπj​≥pj​ is essential to the bound and must be tracked through the whole argument.

Formalization scope

Conventions committed to in Lean:

  • Data. Jobs are Fin n (0-based, so "smallest index" is the order of Fin n). Times are natural numbers, the paper's standing integer-data assumption (p. 688), and weights are real. Every instance carries pj≥1p_j \ge 1pj​≥1 and wj>0w_j > 0wj​>0.
  • Schedules and optimality. Schedules are integer start times. Feasibility, cost and optimality are defined for any finite job type, so (E), with job type Fin n ⊕ gapTimes I, uses the same notions. "Optimal" means optimal among all feasible nonpreemptive schedules with integer start times.
  • The algorithm. Delayed SWPT is a def: a unit-time simulation that compares ratios by cross-multiplication and re-applies the rule at every slot. It runs to the horizon ∑j(rj+2pj)+1\sum_j (r_j + 2p_j) + 1∑j​(rj​+2pj​)+1. A sorry-free check (not uploaded) shows that every job has started by then, and that the simulation reproduces Examples 3 and 4 of the paper, including the gap times 0,2,3,4,5,60,2,3,4,5,60,2,3,4,5,6 of Table 2.
  • Completion times. In (2P) the completion time is μj∗+2pj\mu^*_j + 2p_jμj∗​+2pj​, and gap jobs have unit length.

The goal quantifies over every feasible schedule of every instance. It cannot be met by restricting the competitor to schedules without idle time or to list schedules, by dropping release-date feasibility, or by leaving jobs unscheduled.

Out of scope:

  • The general lower bound "no online algorithm beats 2" (Example 2 of the paper, due to Hoogeveen and Vestjens) is not part of the mission. The lower half of the goal concerns Delayed SWPT only.
  • The Belouadah–Posner–Potts optimality criterion is an external ingredient of Lemma 2. Solvers may formalize it as a supporting theorem.

Infrastructure that a complete development needs:

  • simulation invariants for the algorithm;
  • exchange and left-shift arguments for single-machine schedules;
  • the job-splitting relaxation behind the best-available criterion.

The schedule vocabulary and the criterion are reusable for other release-date scheduling results. Contributions toward the block lemmas of §§3.3–3.6 (Lemmas 4–7, the bound (9)) are welcome as supporting theorems.

Selected references

  • E. J. Anderson and C. N. Potts, Online Scheduling of a Single Machine to Minimize Total Weighted Completion Time, Mathematics of Operations Research 29(3), 686–697, 2004. https://doi.org/10.1287/moor.1040.0092
  • J. A. Hoogeveen and A. P. A. Vestjens, Optimal On-Line Algorithms for Single-Machine Scheduling, IPCO 1996, LNCS 1084, 404–414. https://doi.org/10.1007/3-540-61310-2_30
  • L. A. Hall, A. S. Schulz, D. B. Shmoys and J. Wein, Scheduling to Minimize Average Completion Time: Off-line and On-line Approximation Algorithms, Mathematics of Operations Research 22(3), 513–544, 1997. https://doi.org/10.1287/moor.22.3.513
  • C. Phillips, C. Stein and J. Wein, Minimizing Average Completion Time in the Presence of Release Dates, Mathematical Programming 82, 199–223, 1998. https://doi.org/10.1007/BF01585872
  • M. X. Goemans, M. Queyranne, A. S. Schulz, M. Skutella and Y. Wang, Single Machine Scheduling with Release Dates, SIAM Journal on Discrete Mathematics 15(2), 165–192, 2002. https://doi.org/10.1137/S089548019936223X
  • H. Belouadah, M. E. Posner and C. N. Potts, Scheduling with Release Dates on a Single Machine to Minimize Total Weighted Completion Time, Discrete Applied Mathematics 36(3), 213–231, 1992. https://doi.org/10.1016/0166-218X(92)90255-9
  • J. K. Lenstra, A. H. G. Rinnooy Kan and P. Brucker, Complexity of Machine Scheduling Problems, Annals of Discrete Mathematics 1, 343–362, 1977. https://doi.org/10.1016/S0167-5060(08)70743-X
  • W. E. Smith, Various Optimizers for Single-Stage Production, Naval Research Logistics Quarterly 3, 59–66, 1956. https://doi.org/10.1002/nav.3800030106
11 thms3 active usersReviewed
🏆Completed
Algorithmic Game TheoryProbability·Captain: mikedeng1

Correlated Equilibrium as an Expression of Bayesian Rationality I: Bayes Rationality at Every State Yields Exactly the Correlated Equilibrium DistributionsResearch Paper

Motivation

Nash equilibrium is the standard solution concept for strategic games, but it is usually justified by appeal to what players "would" do once they somehow coordinate on a profile. Correlated equilibrium, introduced by Aumann (J. Math. Econ. 1, 1974), enlarges the set of outcomes by letting players condition their actions on correlated private signals. In Correlated Equilibrium as an Expression of Bayesian Rationality (Econometrica 55, 1987), Aumann gave the concept a decision-theoretic foundation: if the players share a common prior over the states of the world and each player maximizes expected utility given his information at every state, then what they play is a correlated equilibrium — and every correlated equilibrium arises this way. The result is a standard entry point to the epistemic foundations of game theory, and correlated equilibria are central in algorithmic game theory because no-swap-regret learning dynamics converge to them (Foster–Vohra 1997; Hart–Mas-Colell 2000).

Timeline:

  • 1974, Aumann: correlated equilibrium defined, in a measure-theoretic model with subjective probabilities and information σ-fields.
  • 1987, Aumann: the Main Theorem (Bayes rationality at every state under a common prior implies correlated equilibrium play) and its converse, in a finite model with information partitions.

Setting

A game GGG in strategic form has players iii, action sets SiS^iSi, action nnn-tuples s∈S=S1×⋯×Sns\in S=S^1\times\dots\times S^ns∈S=S1×⋯×Sn, and payoffs hi(s)∈Rh^i(s)\in\mathbb Rhi(s)∈R.

A correlated strategy nnn-tuple is a function f:Γ→Sf:\Gamma\to Sf:Γ→S on a finite probability space (Γ,q)(\Gamma,q)(Γ,q), with q≥0q\ge 0q≥0 and ∑γq(γ)=1\sum_\gamma q(\gamma)=1∑γ​q(γ)=1. Its expected payoff is Ehi(f)=∑γq(γ)hi(f(γ))Eh^i(f)=\sum_\gamma q(\gamma)h^i(f(\gamma))Ehi(f)=∑γ​q(γ)hi(f(γ)). For gi:Γ→Sig^i:\Gamma\to S^igi:Γ→Si, the profile (f−i,gi)(f^{-i},g^i)(f−i,gi) replaces player iii's coordinate of fff by gig^igi. The function fff is a correlated equilibrium (Definition 2.1) if

Ehi(f) ≥ Ehi(f−i,gi)(2.2)Eh^i(f)\ \ge\ Eh^i(f^{-i},g^i)\qquad(2.2)Ehi(f) ≥ Ehi(f−i,gi)(2.2)

for every player iii and every gig^igi that is a function of fif^ifi (i.e. gi=φ∘fig^i=\varphi\circ f^igi=φ∘fi). The distribution of fff assigns to each s∈Ss\in Ss∈S the number q{f−1(s)}q\{f^{-1}(s)\}q{f−1(s)}, and a correlated equilibrium distribution (c.e.d.) is the distribution of some correlated equilibrium.

An information system consists of a finite set Ω\OmegaΩ of states of the world, a common prior ppp on Ω\OmegaΩ, an information partition Pi\mathcal P^iPi of Ω\OmegaΩ for each player, and action functions si:Ω→Si\mathbf s^i:\Omega\to S^isi:Ω→Si with s=(s1,…,sn)\mathbf s=(\mathbf s^1,\dots,\mathbf s^n)s=(s1,…,sn), each si\mathbf s^isi constant on the elements of Pi\mathcal P^iPi (each player knows his own action). For a random variable xxx, E(x∣Pi)(ω)E(x\mid\mathcal P^i)(\omega)E(x∣Pi)(ω) is the ppp-average of xxx over the element of Pi\mathcal P^iPi containing ω\omegaω. Player iii is Bayes rational at ω\omegaω if

E(hi(s)∣Pi)(ω) ≥ E(hi(s−i,a)∣Pi)(ω)for every a∈Si.E\big(h^i(\mathbf s)\mid\mathcal P^i\big)(\omega)\ \ge\ E\big(h^i(\mathbf s^{-i},a)\mid\mathcal P^i\big)(\omega)\quad\text{for every }a\in S^i .E(hi(s)∣Pi)(ω) ≥ E(hi(s−i,a)∣Pi)(ω)for every a∈Si.

Formalization targets

Goal: Main Theorem with its converse

Q is a c.e.d. of G  ⟺  ∃ information system (Ω,p,(Pi),s): every player is Bayes rational at every state, and Q(a)=p{s=a} ∀a.Q\ \text{is a c.e.d. of }G\iff\exists\ \text{information system }(\Omega,p,(\mathcal P^i),\mathbf s):\ \text{every player is Bayes rational at every state, and } Q(a)=p\{\mathbf s=a\}\ \forall a.Q is a c.e.d. of G⟺∃ information system (Ω,p,(Pi),s): every player is Bayes rational at every state, and Q(a)=p{s=a} ∀a.

This is the two-sided statement the paper announces in its introduction (p. 2) and closes in Sect. 4d (p. 11): "under Bayesian rationality, the set of all information systems corresponds precisely to the set of all correlated equilibria."

Milestones

  1. Main Theorem, proof: summing the cell-wise inequalities over the partition, Ehi(s−i,gi)≤Ehi(s)Eh^i(\mathbf s^{-i},g^i)\le Eh^i(\mathbf s)Ehi(s−i,gi)≤Ehi(s) for gig^igi constant on the cells of Pi\mathcal P^iPi.
  2. Main Theorem, proof: s\mathbf ss itself is a correlated equilibrium on (Ω,p)(\Omega,p)(Ω,p).
  3. Main Theorem (p. 7): the distribution of s\mathbf ss is a c.e.d.
  4. Sect. 4d: in the system generated by fff (partitions generated by fif^ifi), Bayes rationality everywhere is equivalent to (2.2).
  5. Sect. 4d: every correlated equilibrium is realized by a Bayes-rational information system with the same distribution.

The mission also states, as a supporting lemma without a milestone, the cell-wise step of the proof of the Main Theorem: Bayes rationality at every state gives E(hi(s−i,gi)∣P)≤E(hi(s)∣P)E(h^i(\mathbf s^{-i},g^i)\mid P)\le E(h^i(\mathbf s)\mid P)E(hi(s−i,gi)∣P)≤E(hi(s)∣P) on every cell PPP for gig^igi constant on cells.

Significance

The theorem identifies correlated equilibrium as the outcome of individual Bayesian decision making under a common prior, without any assumption that players randomize or that their choices are independent. It shows that the Nash equilibrium's independence requirement is not implied by rationality alone, and it is the template for later epistemic characterizations of solution concepts. On the computational side, correlated equilibrium distributions form a polytope described by linear inequalities (the companion mission of this series), which is why they are the tractable equilibrium notion in algorithmic game theory.

The result is proved in the paper; it has no machine-checked formalization known to this mission. Formalizing it pins down the exact role of the standing assumptions — finiteness, a common prior, measurability of each player's action with respect to his own partition, rationality at every state — and of the conditional expectation on cells of probability zero. The definitions (information systems, Bayes rationality, correlated equilibria as functions on a finite probability space) are reusable for later formalizations of the paper's Sect. 5 (subjective correlated equilibrium) and of other epistemic results.

Difficulty

The mathematics is short; the difficulty lies in the bookkeeping that the paper's notation hides. The hypothesis is interim (a conditional inequality at each state), while Definition 2.1 is ex ante (an unconditional inequality). Passing between them requires the law of total expectation over a partition whose cells may have probability zero, where conditional expectations are undefined. Deviations in Definition 2.1 are functions of fif^ifi, not arbitrary maps, and must be shown constant on cells, which uses measurability of si\mathbf s^isi. A tempting first idea — that rationality against every fixed action already gives rationality against every deviation — fails without measurability: a player who does not know his own action could be rational at each state against constant deviations while a deviation φ∘si\varphi\circ\mathbf s^iφ∘si varies inside his cells. The converse direction needs an information system that satisfies every axiom of the goal's right-hand side, not just one that is Bayes rational.

Formalization scope

  • Players form a finite type ι with decidable equality; action sets S i are arbitrary types (the paper's finiteness of SiS^iSi is not used); payoffs are h : ι → (∀ i, S i) → ℝ.
  • Probability spaces are finite types with a real weight vector satisfying AGT.IsLottery (from the published definition agt_games). State spaces and the witnessing probability spaces of a c.e.d. range over Type; for finite sets this loses nothing.
  • Partitions are Setoids. The Common Prior Assumption is built into the information system, which has a single prior. Measurability of each action function is a field of the structure.
  • Conditional expectation on a cell is a ratio of finite sums; on a cell of probability zero Lean returns 000, so Bayes rationality at such states holds vacuously. The prior is not required to have full support. This matches the paper, whose argument multiplies each cell inequality by the cell's probability.
  • Deviations in Definition 2.1 are exactly the compositions φ∘fi\varphi\circ f^iφ∘fi; neither all maps nor only constant maps. A c.e.d. requires a genuine probability vector, ruling out the trivializing reading in which the zero weight function witnesses every QQQ.
  • Contributions welcome: proofs of the milestones, a general law-of-total-expectation lemma for finite partitions, and lemmas relating distr to sums over action profiles.

Selected references

  • R. J. Aumann, Correlated Equilibrium as an Expression of Bayesian Rationality, Econometrica 55 (1987), no. 1, 1–18. https://doi.org/10.2307/1911154
  • R. J. Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathematical Economics 1 (1974), 67–96. https://doi.org/10.1016/0304-4068(74)90037-8
  • D. P. Foster and R. V. Vohra, Calibrated Learning and Correlated Equilibrium, Games and Economic Behavior 21 (1997), 40–55. https://doi.org/10.1006/game.1997.0595
  • S. Hart and A. Mas-Colell, A Simple Adaptive Procedure Leading to Correlated Equilibrium, Econometrica 68 (2000), 1127–1150. https://doi.org/10.1111/1468-0262.00153
9 thms3 active usersReviewed
Complexity TheoryOptimizationTheoretical Computer Science·Captain: mikedeng1

Project Scheduling with Time Windows and Scarce Resources IX: Deciding Feasibility with Cumulative Resources Is NP-Complete Even for Acyclic Project NetworksTextbook

Motivation

Project scheduling with cumulative resources models production and logistics projects in which activities fill and empty storage: an activity withdraws material from an inventory when it starts and deposits its output when it completes, and every inventory must stay between a safety stock and a storage capacity. Neumann, Schwindt and Zimmermann treat this model in §2.12 of Project Scheduling with Time Windows and Scarce Resources (2nd ed., Springer 2003, doi:10.1007/978-3-540-24800-2) and use it in their process-industry applications.

Before any optimization, a scheduler must know whether a feasible schedule exists at all. Theorem 2.12.1 of the book answers the complexity of this question: it is NP-complete, and it stays NP-complete when the project network has no cycles. The contrast with renewable resources (machines, workers) is the point of the theorem: with renewable resources, the feasibility problem is NP-complete as well (Theorem 2.3.13, after Bartusch, Möhring and Radermacher, 1988), but an acyclic network always admits a feasible schedule when every requirement is within capacity.

The mission also collects the two other reductions the book proves in full: Proposition 2.5.4 (recognizing whether an activity lies in some minimal delaying alternative, the branching object of the book's branch-and-bound procedures, is NP-complete) and Proposition 3.4.2 (maximizing weighted start-time deviations, a resource-levelling objective, is NP-hard without any resource constraints).

Setting

A project has activities V={0,1,…,n+1}V=\{0,1,\dots,n+1\}V={0,1,…,n+1} with n≥1n\ge1n≥1; activity 000 is the project beginning and n+1n+1n+1 the project completion. Activity iii has a duration pi∈Np_i\in\mathbb Npi​∈N, with p0=pn+1=0p_0=p_{n+1}=0p0​=pn+1​=0. The project network NNN has arc set EEE; an arc ⟨i,j⟩\langle i,j\rangle⟨i,j⟩ with integer weight δij\delta_{ij}δij​ imposes the temporal constraint Sj−Si≥δijS_j-S_i\ge\delta_{ij}Sj​−Si​≥δij​ on the start times. A schedule is a real vector S=(Si)i∈VS=(S_i)_{i\in V}S=(Si​)i∈V​ with S0=0S_0=0S0​=0 and Si≥0S_i\ge0Si​≥0; it is time-feasible if it meets every temporal constraint.

Cumulative resources k∈Rγk\in\mathcal R^\gammak∈Rγ carry integer demands rikr_{ik}rik​: rik<0r_{ik}<0rik​<0 depletes −rik-r_{ik}−rik​ units at the start SiS_iSi​, rik>0r_{ik}>0rik​>0 replenishes rikr_{ik}rik​ units at the completion Si+piS_i+p_iSi​+pi​, and r0kr_{0k}r0k​ is the initial stock. The inventory at time ttt is

rk(S,t)=∑i: rik<0, Si≤trik+∑i: rik>0, Si+pi≤trik.r_k(S,t)=\sum_{i:\ r_{ik}<0,\ S_i\le t} r_{ik}+\sum_{i:\ r_{ik}>0,\ S_i+p_i\le t} r_{ik}.rk​(S,t)=i: rik​<0, Si​≤t∑​rik​+i: rik​>0, Si​+pi​≤t∑​rik​.

With safety stock R‾k\underline R_kR​k​ and storage capacity R‾k\overline R_kRk​ (integers, R‾k≤∑i∈Vrik≤R‾k\underline R_k\le\sum_{i\in V}r_{ik}\le\overline R_kR​k​≤∑i∈V​rik​≤Rk​ by (2.12.1)), SSS is feasible if it is time-feasible and R‾k≤rk(S,t)≤R‾k\underline R_k\le r_k(S,t)\le\overline R_kR​k​≤rk​(S,t)≤Rk​ for every kkk and every t≥0t\ge0t≥0. The decision problem of PSc∣temp∣Cmax⁡PSc|temp|C_{\max}PSc∣temp∣Cmax​ asks whether a feasible schedule exists.

For renewable resources k∈Rk\in\mathcal Rk∈R with capacities RkR_kRk​ and requirements rik∈Nr_{ik}\in\mathbb Nrik​∈N, a set F⊆VF\subseteq VF⊆V is forbidden if ∑i∈Frik>Rk\sum_{i\in F}r_{ik}>R_k∑i∈F​rik​>Rk​ for some kkk. A delaying alternative for FFF is a set B⊆FB\subseteq FB⊆F such that F∖BF\setminus BF∖B is not forbidden; it is minimal if no proper subset of BBB is one.

In PS∞∣temp,dˉ∣fPS\infty|temp,\bar d|fPS∞∣temp,dˉ∣f there are no resources, schedules must also satisfy Sn+1≤dˉS_{n+1}\le\bar dSn+1​≤dˉ, and the objective here is f(S)=−∑i∈V∑j>iwij∣Sj−Si∣f(S)=-\sum_{i\in V}\sum_{j>i}w_{ij}|S_j-S_i|f(S)=−∑i∈V​∑j>i​wij​∣Sj​−Si​∣ with weights wij≥0w_{ij}\ge0wij​≥0.

NP and NP-completeness are taken in the sense of Cook's Turing-machine formulation, with instances written in binary.

Formalization targets

Goal: Theorem 2.12.1

Assuming PARTITION is NP-complete,

L={codes of instances of PSc∣temp∣Cmax⁡ with a feasible schedule}  and  Lacyc=L∩{N acyclic}L=\{\text{codes of instances of }PSc|temp|C_{\max}\text{ with a feasible schedule}\}\ \text{ and }\ L_{\mathrm{acyc}}=L\cap\{N\text{ acyclic}\}L={codes of instances of PSc∣temp∣Cmax​ with a feasible schedule}  and  Lacyc​=L∩{N acyclic}

are both NP-complete.

Milestones

  1. Membership (proof of Theorem 2.12.1): L∈NPL\in\mathrm{NP}L∈NP and Lacyc∈NPL_{\mathrm{acyc}}\in\mathrm{NP}Lacyc​∈NP.
  2. Reduction correctness (proof of Theorem 2.12.1): for sizes s(1),…,s(ν)s(1),\dots,s(\nu)s(1),…,s(ν) with even sum, the project with r0=rn+1=−∑s(i)/2r_0=r_{n+1}=-\sum s(i)/2r0​=rn+1​=−∑s(i)/2, ri=s(i)r_i=s(i)ri​=s(i), R‾=R‾=0\underline R=\overline R=0R​=R=0, d0,n+1min⁡=1d^{\min}_{0,n+1}=1d0,n+1min​=1 has an acyclic network, and it has a feasible schedule iff the sizes split into two parts of equal sum.
  3. Polynomial transformation: PARTITION≤pLacyc\mathrm{PARTITION}\le_p L_{\mathrm{acyc}}PARTITION≤p​Lacyc​.
  4. Proof of Proposition 2.5.4, one resource: for j∗∈B⊆Fj^*\in B\subseteq Fj∗∈B⊆F, BBB is a minimal delaying alternative iff R−min⁡j∈Brj<∑i∈F∖Bri≤RR-\min_{j\in B}r_j<\sum_{i\in F\setminus B}r_i\le RR−minj∈B​rj​<∑i∈F∖B​ri​≤R.
  5. Proof of Proposition 2.5.4, with rj∗=1r_{j^*}=1rj∗​=1: a minimal delaying alternative contains j∗j^*j∗ iff some A⊆F∖{j∗}A\subseteq F\setminus\{j^*\}A⊆F∖{j∗} has ∑i∈Ari=R\sum_{i\in A}r_i=R∑i∈A​ri​=R.
  6. Proposition 2.5.4: assuming SUBSET SUM is NP-complete, deciding whether some minimal delaying alternative for a forbidden set FFF contains j∗∈Fj^*\in Fj∗∈F is NP-complete.
  7. Proof of Proposition 3.4.2: a graph has a cut of at least MMM edges iff the constructed instance has a schedule with Si∈{0,1}S_i\in\{0,1\}Si​∈{0,1} and ∑i<jwij∣Sj−Si∣≥M\sum_{i<j}w_{ij}|S_j-S_i|\ge M∑i<j​wij​∣Sj​−Si​∣≥M.
  8. Proposition 3.4.2: assuming SIMPLE MAX CUT is NP-complete, the decision version of PS∞∣temp,dˉ∣−∑∑wij∣Sj−Si∣PS\infty|temp,\bar d|-\sum\sum w_{ij}|S_j-S_i|PS∞∣temp,dˉ∣−∑∑wij​∣Sj​−Si​∣ is NP-hard.

The goal follows from milestones 1 and 3 together with the transfer of NP-completeness along ≤p\le_p≤p​ (on the platform as CookPvsNP.npComplete_of_polyReducible).

Significance

The result. Theorem 2.12.1 explains why the book's methods for cumulative resources enumerate precedence relations between depleting and replenishing activities (minimal surplus and shortage sets, Theorem 2.12.4) instead of relying on a constructive feasibility test: unless P = NP, no polynomial algorithm decides feasibility, even for acyclic networks, where the renewable-resource case is trivial. Proposition 2.5.4 does the same for the branching scheme of §2.5, and Proposition 3.4.2 places the resource-levelling objectives of Chapter 3 among the hard ones.

Formalizing it. The three results are proved in the book, as short reductions whose delicate steps are left implicit: the polynomial size of a certificate for real-valued schedules, the handling of instances outside the construction (odd sums, empty index sets, oversized items), and the passage from an optimization problem to its decision version. None of the three reductions is machine-checked anywhere known. The mission states them against a single Turing-machine model and a single binary encoding, reusing the published definitions CookPvsNP_defs, so that the reductions compose with the Cook–Levin development already on the platform.

Difficulty

The mathematical content of the reductions is short; the difficulty is in the complexity-theoretic layer. Two steps resist the obvious argument.

First, NP membership. The book's certificate is a schedule, and a schedule is a real vector: it is not a string. A verifier needs a finite certificate of polynomial length, and it is not immediate that a feasible instance has a feasible schedule with small rational (or integer) start times, since the inventory constraints involve strict orderings between event times.

Second, polynomial-time computability in a concrete Turing-machine model. The transformation must compute, on a one-tape machine, binary codes of sums and halves of the input sizes, an arc list of quadratic length, and must map malformed strings to fixed no-instances. Informal "clearly polynomial" arguments have to become explicit machine constructions or a reusable library of closure properties.

Formalization scope

The Lean development fixes the following conventions.

  • Activities are Fin (n + 2), with the completion Fin.last (n + 1); resources are Fin m. Start times are real.
  • The inventory constraints hold for every t≥0t\ge0t≥0, not only for 0≤t≤dˉ0\le t\le\bar d0≤t≤dˉ as (2.12.2) is printed; the book's proofs use this reading.
  • Real activities may have duration 000 in PSc∣temp∣Cmax⁡PSc|temp|C_{\max}PSc∣temp∣Cmax​: the reduction of Theorem 2.12.1 uses only such activities.
  • Instances are coded as lists of integers written in binary over the alphabet {0,1,−,#}\{0,1,-,\#\}{0,1,−,#}; arc weights are listed for every ordered pair of activities together with an arc indicator. Well-formedness (standing assumptions such as n≥1n\ge1n≥1, p0=pn+1=0p_0=p_{n+1}=0p0​=pn+1​=0, no loops, (2.12.1), rik≤Rkr_{ik}\le R_krik​≤Rk​) is part of each language.
  • "Acyclic" means the nodes admit a numbering increasing along every arc.
  • The NP-completeness of PARTITION, SUBSET SUM and SIMPLE MAX CUT (Karp, 1972) enters as a hypothesis of the corresponding theorem; these are not results of the book.
  • Proposition 3.4.2 is stated for the decision version of the optimization problem, with natural-number weights and threshold.

A trivializing formalization is ruled out: the languages contain only codes of well-formed instances, the encoding is injective, and the hypotheses on the source problems are true theorems, so the goal cannot hold vacuously or by a degenerate encoding.

A complete development needs closure properties of polynomial-time computable functions in Cook's model (composition, binary arithmetic, list manipulation), transitivity of ≤p\le_p≤p​, and a small-certificate lemma for systems of difference constraints with strict and non-strict inequalities. These are reusable for every NP-hardness proof stated in the same framework. Contributions to any of them, to the instance-level milestones 2, 4, 5 and 7, or to the NP-completeness of PARTITION, SUBSET SUM and SIMPLE MAX CUT in this model, are welcome.

Selected references

  • K. Neumann, C. Schwindt, J. Zimmermann, Project Scheduling with Time Windows and Scarce Resources, 2nd ed., Springer, 2003. doi:10.1007/978-3-540-24800-2
  • M. Bartusch, R. H. Möhring, F. J. Radermacher, Scheduling project networks with resource constraints and time windows, Annals of Operations Research 16, 1988.
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, W. H. Freeman, 1979.
  • R. M. Karp, Reducibility among combinatorial problems, in Complexity of Computer Computations, Plenum, 1972. doi:10.1007/978-1-4684-2001-2_9
  • S. Cook, The P versus NP Problem, Clay Mathematics Institute problem description. claymath.org
14 thms3 active usersReviewed
PreviousPage 16 of 89Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me