Prove2Me
Navigate
DiscoverCollectionsFormalpediaBlogsUsersMomentumMy Missions+
Prove2Me
⌕
Log in

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

Theoretical Computer Science

464 missions · 238 completed

The mathematical foundations of computation: which problems can be solved, by what algorithms, and at what cost in time, space, or communication. Distinguished by its emphasis on rigor and unconditional lower bounds, it spans computational complexity, algorithm design, automata and computability, cryptography, and the analysis of Boolean functions.

Missions

Open226Completed238All464
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Bounds on Multiprocessing Timing Anomalies 1: Changing the List, Relaxing the Order, Shortening the Tasks and Using n′ Processors Multiplies the Finishing Time by at Most 1 + (n − 1)/n′Research Paper

Motivation

Scheduling work on several identical processors creates a plausible expectation: completing tasks sooner, removing constraints, or adding a processor should not delay the overall finish. A fixed priority-list rule defeats that expectation. When a task becomes ready earlier, it can occupy a processor that would otherwise have run another task; that decision changes later availability. Graham gives explicit schedules in which changing only the list raises the finishing time from 12 to 14, removing two precedence constraints raises it to 16, shortening every task raises it to 13, or adding one processor raises it to 15. These examples establish that the effect is a property of the scheduling rule, rather than of a change in the total set of tasks. See Graham, §2, pp. 417–419.

This mission concerns the upper limit of that effect. An operations researcher comparing a list schedule before and after a change in available processors or task data needs a bound that survives all four changes at once. The result is also a compact benchmark for formalizing algorithms whose behavior depends on changing availability: the model must describe when tasks become ready, when processors are idle, and which ready task a processor takes next. Graham's Theorem 1, proved in the 1969 paper, supplies the bound.

Setting

There are rrr tasks T1,…,TrT_1,\ldots,T_rT1​,…,Tr​ and nnn identical processors. Each task TjT_jTj​ has a positive processing time μ(Tj)\mu(T_j)μ(Tj​). A strict precedence order ≺\prec≺ specifies tasks that must be completed first: Ti≺TjT_i\prec T_jTi​≺Tj​ means TjT_jTj​ cannot start before TiT_iTi​ ends. A priority list LLL orders all tasks once each. It may place a successor before a predecessor, because the processor skips any task that is not ready. These conventions are those of Graham's system in §2, p. 416.

A schedule gives each task a processor and a start time Sj≥0S_j\ge0Sj​≥0. Once started, the task occupies that processor continuously on [Sj,Sj+μ(Tj))[S_j,S_j+\mu(T_j))[Sj​,Sj​+μ(Tj​)). Two tasks on one processor cannot overlap, while tasks may meet at an endpoint. Precedence means Si+μ(Ti)≤SjS_i+\mu(T_i)\le S_jSi​+μ(Ti​)≤Sj​ whenever Ti≺TjT_i\prec T_jTi​≺Tj​. The finishing time ω\omegaω is the largest completion time Sj+μ(Tj)S_j+\mu(T_j)Sj​+μ(Tj​). The paper's list rule starts the first currently ready task in LLL whenever a processor can take a task. A ready task that has not started cannot coexist with an idle processor. If one task starts while another ready task waits, the started task is earlier in LLL.

The same task set is run a second time, with processing times μ′\mu'μ′, order ≺′\prec'≺′, list L′L'L′, processor count n′n'n′, and finishing time ω′\omega'ω′. The data satisfy μ′(Tj)≤μ(Tj)\mu'(T_j)\le\mu(T_j)μ′(Tj​)≤μ(Tj​) for every jjj and ≺′⊆≺\prec'\subseteq\prec≺′⊆≺. Thus the second run may have shorter tasks and fewer precedence relations; both lists may differ arbitrarily. Both runs obey the same list-scheduling rule Graham, §3, p. 419.

Formalization targets

General anomaly bound

For r,n,n′≥1r,n,n'\ge1r,n,n′≥1, positive processing times in both runs, and the two list schedules just described, the target is Graham's Theorem 1:

ω′ω≤1+n−1n′.\frac{\omega'}{\omega}\le 1+\frac{n-1}{n'}.ωω′​≤1+n′n−1​.

The numerator and denominator refer to the actual runs, with potentially different lists and processor counts. The conclusion does not require the new schedule to finish earlier. Its factor permits the anomalies shown in §2 while preventing an arbitrarily large increase for fixed n,n′n,n'n,n′. The supporting targets follow the proof's numbered displays: a precedence chain covering idle times in the second run (1), an idle-time estimate for that chain (2), a comparison of its length with the first run (3)–(4), and the work-volume bound used in (5) Graham, pp. 419–420.

Significance

The theorem places a quantitative limit on the damage caused by a list rule after simultaneous changes in task durations, precedence, ordering, and capacity. When n′=nn'=nn′=n, the factor is 2−1/n2-1/n2−1/n; when the first run has one processor, it is 111. The statement applies to every finite task set and every pair of lists, so it can be reused when a scheduling method produces a list without additional structural guarantees. Graham states that the bound is best possible, citing earlier examples; this mission formalizes the inequality in this paper and does not claim to formalize those external examples Graham, p. 420.

The result is proved in the source paper. The work here is to give its objects precise Lean definitions and to supply machine-checked proofs of the bound and its supporting claims. A formal development needs to account for continuous real start times, processor assignments, half-open execution intervals, and the behavior of the list rule when several tasks or processors become available together. The resulting model of a nonpreemptive list schedule and the basic volume and chain estimates can serve later formalizations of parallel scheduling. The present proposal contains statements and definitions; its theorem bodies are open proof obligations.

Difficulty

Total work alone does not control the anomaly: processors can be idle while precedence keeps available work from starting, and changing precedence can alter which tasks occupy the processors later. A direct comparison of corresponding task completion times between the two runs also fails in Graham's §2 examples. The central difficulty is expressing the second run's idle periods through work on a single precedence chain and then relating that chain to the first run's finishing time. In Lean, the chain and the time intervals must be represented without silently changing endpoint conventions or treating a ready but unstarted task as running.

Formalization scope

Tasks are Fin r and processors are Fin n, with zero-based Lean indices corresponding to Graham's one-based subscripts. Processing times and start times are real. A priority list is a bijection between positions and tasks, so it contains every task exactly once and need not respect precedence. The order is strict. Feasible schedules are nonpreemptive and use half-open running intervals. The finishing time is a finite maximum of completion times; for no tasks it is defined as zero, while the ratio theorem assumes r>0r>0r>0 so its denominator is positive. Both processor counts are positive. The strict positivity of both time functions is inherited from the paper's μ:T→(0,∞)\mu:T\to(0,\infty)μ:T→(0,∞) convention.

The model captures Graham's rule by no unforced idleness and list priority. It does not encode the smaller-index tie rule for identical processors, since the tie affects only processor labels and not start times or ω\omegaω. The covering-chain milestone represents Graham's set BBB as times before ω′\omega'ω′ when not all processors are busy; all-idle times before the finish cannot occur under the list rule. The idle-time milestone writes the total duration of empty tasks as n′ω′−∑jμ′(Tj)n'\omega'-\sum_j\mu'(T_j)n′ω′−∑j​μ′(Tj​) using display (5). Natural-number subtraction is not used in the constants: n−1n-1n−1 and n′−1n'-1n′−1 are real differences. The companion existence statement and a concrete two-task sanity check rule out a vacuous list-schedule predicate. Contributions can address that existence theorem, the chain construction, interval accounting, the volume bound, and the final ratio.

Selected references

  • R. L. Graham, Bounds on Multiprocessing Timing Anomalies, SIAM Journal on Applied Mathematics 17(2), 416–429, 1969. DOI: 10.1137/0117039.
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Bounds on Multiprocessing Timing Anomalies 2: Scheduling the k Longest Independent Tasks Optimally First Gives ω(k)/ω₀ ≤ 1 + (1 − 1/n)/(1 + ⌊k/n⌋)Research Paper

Motivation

Parallel processing poses a basic allocation question: given tasks of known lengths and several identical processors, how much time is lost when tasks are assigned by a simple list rule instead of an optimal allocation? The finishing time is the moment the last processor completes its work. For independent tasks, a list rule starts each next task on a processor that becomes free first. Such a rule is easy to execute, but the resulting allocation can be worse than the best partition of tasks among processors. Graham's 1969 paper studies precise worst-case ratios for this model. Its Theorem 3 asks what guarantee follows when the first kkk tasks of the list are chosen among the longest and scheduled optimally before the remaining tasks are appended.

The paper also notes two endpoints of this family. With k=0k=0k=0, the rule is ordinary list scheduling and has ratio at most 2−1/n2-1/n2−1/n. With k=nk=nk=n, the nnn longest tasks can start one per processor, giving ratio at most 3/2−1/(2n)3/2-1/(2n)3/2−1/(2n). Theorem 3 expresses these as instances of one bound, including the integer jump at each multiple of nnn Graham, pp. 427–428.

Setting

There are r>0r>0r>0 independent tasks, indexed by jin{0,…,r−1}jin\{0,\ldots,r-1\}jin{0,…,r−1}, and n>0n>0n>0 identical processors, indexed by p∈{0,…,n−1}p\in\{0,\ldots,n-1\}p∈{0,…,n−1}. Task jjj takes a strictly positive time μj\mu_jμj​. A priority list LLL contains every task exactly once. Its first kkk tasks are kkk of the longest tasks; equal lengths may be ordered either way. As a processor becomes available, it takes the next task in the list. Once started, a task runs without interruption. With no precedence constraints, every unstarted task is ready, so a processor runs its assigned tasks consecutively from time zero.

An assignment σ\sigmaσ records the processor that executes each task. The load ℓp(σ)\ell_p(\sigma)ℓp​(σ) of processor ppp is the sum of its assigned task lengths. The finishing time is the largest load, ω(k)=max⁡pℓp(σ)\omega(k)=\max_p\ell_p(\sigma)ω(k)=maxp​ℓp​(σ). For a list assignment, each task is assigned to a processor whose load from earlier list tasks is smallest at that step. If two processors are tied, either can be selected without changing the finishing time. For any assignment τ\tauτ, let ωk(τ)\omega_k(\tau)ωk​(τ) be the largest load contributed by only the first kkk list tasks. The algorithm requires its own first kkk assignments to minimize ωk(τ)\omega_k(\tau)ωk​(τ) over all assignments τ\tauτ; the remaining tasks may occur in any list order.

Write ω0\omega_0ω0​ for the smallest finishing time achievable for all rrr tasks. The paper introduces it as the minimum over possible lists and later describes the same problem as minimizing the largest part sum over partitions of the task lengths Graham, pp. 421, 428. The formalization uses the partition or assignment form of ω0\omega_0ω0​.

Formalization targets

Theorem 3

For 0≤k≤r0\le k\le r0≤k≤r, when the first kkk longest tasks have an optimal prefix schedule, Graham's bound is

ω(k)ω0≤1+1−1/n1+⌊k/n⌋.\frac{\omega(k)}{\omega_0} \le 1+\frac{1-1/n}{1+\lfloor k/n\rfloor}.ω0​ω(k)​≤1+1+⌊k/n⌋1−1/n​.

Here ⌊k/n⌋\lfloor k/n\rfloor⌊k/n⌋ is the greatest integer at most k/nk/nk/n. The theorem also says the bound is best possible when kkk is divisible by nnn Graham, Theorem 3, p. 427. The equality examples are a separate companion statement in this mission.

Source milestones

The milestones state the finite-volume lower bound on ω0\omega_0ω0​, the case in which completing all tasks takes no longer than completing the first kkk, and the paper's numbered inequalities (14), (15), and (16). They use α∗\alpha^*α∗ for the greatest task length after the first kkk positions. These are individual mathematical claims from the proof on p. 427, with their original wording and formulas recorded alongside the formal statements.

Significance

The theorem gives a quantitative tradeoff between work spent optimizing a prefix and the worst-case finishing time of the full list. Its denominator is 1+⌊k/n⌋1+\lfloor k/n\rfloor1+⌊k/n⌋, so the guarantee improves when the optimized prefix contains another full processor's worth of long tasks. The example at multiples of nnn shows that the stated coefficient cannot be uniformly reduced for the algorithm as specified Graham, p. 427.

The result is proved in the paper. This mission's remaining work is a machine-checked proof of its exact statement and the source's intermediate inequalities. The published identical-machine makespan definition is reused, while the list-assignment rule, optimal prefix, and longest-remaining-task quantity are made explicit here. Those definitions can also support later work on list scheduling without precedence constraints. No machine-checked proof of Theorem 3 is claimed by this proposal.

Difficulty

An optimal schedule for the first kkk long tasks does not make the entire list optimal: short tasks appended later can affect which processor finishes last. A bound based only on average total work ignores this final imbalance; a bound based only on the largest remaining task ignores how many long tasks every assignment must place together. The proof must relate both constraints to one finishing time while preserving the floor ⌊k/n⌋\lfloor k/n\rfloor⌊k/n⌋. Replacing that floor with the real quotient changes the claim, and allowing an arbitrary prefix arrangement loses the algorithm's required optimality.

Formalization scope

Tasks and processors are finite indexed sets Fin r and Fin n; their zero-based indices correspond to the paper's one-based TjT_jTj​ and PiP_iPi​. Task lengths are positive real numbers, and both rrr and nnn are positive. The list is a permutation, not merely a sequence that might omit or repeat a task. The condition k≤rk\le rk≤r is explicit because choosing kkk tasks from rrr requires it; the paper treats r>kr>kr>k inside the proof and the case k=rk=rk=r is covered by the theorem. There is no precedence relation in this mission.

The list rule is a predicate on assignments: each next task goes to a processor with least current load. It omits the paper's smaller-index tie convention, since tied identical processors can be interchanged without changing the finishing time. The first kkk positions must contain kkk longest tasks, and their assignment must minimize the prefix finishing time among all assignments of those tasks. Those conditions are part of the goal; the inequalities (14)–(16) are conclusions to establish, not assumptions of the goal. A separate existence statement and a checked concrete instance ensure the list predicate is satisfiable.

All maxima and minima range over finite nonempty processor or assignment sets. The optimum is a minimum over assignments, equivalent to the paper's minimum over lists in the independent-task model. The quantity α∗\alpha^*α∗ is the largest duration outside the prefix when k<rk<rk<r, and is defined as zero when none remains; statements using it require k<rk<rk<r. Division is by n>0n>0n>0 and by ω0>0\omega_0>0ω0​>0. Lean's natural-number quotient represents ⌊k/n⌋\lfloor k/n\rfloor⌊k/n⌋; real subtraction is used for coefficients such as n−1n-1n−1. Contributions toward the finite load identities, the optimum-over-lists equivalence, and proofs of the listed bounds are within scope.

Selected references

  • R. L. Graham, Bounds on Multiprocessing Timing Anomalies, SIAM Journal on Applied Mathematics 17(2), 416–429, 1969. DOI: 10.1137/0117039.
8 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: marwahaha

Truly Subquadratic 3SUM on a Word RAMResearch Paper

3SUM asks whether three distinct positions in a list of integers contain values summing to zero. It is a central problem in fine-grained complexity.

This mission formalizes a deterministic O(n1.9992)O(n^{1.9992})O(n1.9992) algorithm for 3SUM on nnn polynomially bounded integers, on a word RAM with O(log⁡n)O(\log n)O(logn)-bit words. Alman and Vassilevska Williams's 2026 breakthrough gives a truly subquadratic bound, refuting the integer 3SUM hypothesis in this model.

The mission uses the accompanying Lean specification and shares the Exact Triangle milestone with Truly Subcubic APSP on a Word RAM.

References

  1. Josh Alman and Virginia Vassilevska Williams, Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs, 2026, Theorem 22.
  2. Anthropic, formal-math / 3sum-apsp: accompanying Lean formalization, Theorem_22_3SUM.
51 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Fibonacci Heaps and Their Uses in Improved Network Optimization Algorithms: O(log n) Amortized Time for Delete Min and Delete, O(1) for Every Other F-Heap OperationResearch Paper

Why priority queues with cheap decrease key matter

Many network optimization algorithms spend most of their time in a heap (priority queue): a set of items with real keys that supports inserting an item, finding and deleting an item of minimum key, melding two heaps, decreasing the key of an item, and deleting an arbitrary item. Dijkstra's shortest-path algorithm performs at most one delete min per vertex and may perform a decrease key for each edge, so on a graph with nnn vertices and mmm edges its running time is governed by how cheap decrease key is. Binomial queues support the heap operations in O(log⁡n)O(\log n)O(logn) worst-case time.

Fredman and Tarjan (J. ACM 34 (1987)) introduced Fibonacci heaps (F-heaps), in which delete min and delete take O(log⁡n)O(\log n)O(logn) amortized time and every other operation, decrease key included, takes O(1)O(1)O(1) amortized time. This brings Dijkstra's algorithm to O(nlog⁡n+m)O(n \log n + m)O(nlogn+m) and improves the best bounds then known for all-pairs shortest paths, weighted bipartite matching (the assignment problem) and minimum spanning trees. F-heaps descend from the binomial queues of Vuillemin (1978) and use the potential technique of amortized analysis of Sleator and Tarjan. This mission formalizes the paper's §2 analysis, culminating in THEOREM 1 on p. 604.

Setting

An F-heap is a list of heap-ordered rooted trees: every child's key is at least its parent's key. Each node holds an item, the item's real key and a mark bit; the children of a node are kept in the order in which they were linked to it, earliest first. The rank r(x)r(x)r(x) of a node is its number of children. A collection is a list of heaps, named by position; a run starts with no heaps.

Linking two trees with roots xxx and yyy makes yyy the last child of xxx if the key of xxx is smaller, and otherwise makes xxx the last child of yyy; the root that becomes a child is unmarked. The operations act as follows:

  • make heap adds an empty heap; find min acts on a nonempty heap and returns a root of minimum key; insert adds a one-node tree for a new item; meld concatenates two root lists.
  • delete min removes a root xxx of minimum key, adds the children of xxx to the roots, then repeats the linking step, "find any two trees whose roots have the same rank, and link them", in any order, until all root ranks are distinct.
  • decrease key (Δ,i,h)(\Delta, i, h)(Δ,i,h), Δ≥0\Delta \ge 0Δ≥0, lowers the key of iii and, if the node xxx of iii is not a root, cuts xxx from its parent, making its subtree a new tree. delete (i,h)(i, h)(i,h) cuts xxx the same way, destroys it and adds its children to the roots; a minimum root is deleted as in delete min.
  • After every cut of a child of ppp, if ppp is not a root it is marked if unmarked and cut from its own parent if marked: a cascading cut, which may repeat upwards.

The actual time of an operation is one unit, plus one per linking step, plus one per cut, plus for delete min the scan of the rank array (the largest rank involved). The potential Φ\PhiΦ of a collection is the number of trees plus twice the number of marked nonroot nodes, and the amortized time of an operation is its actual time plus the increase of Φ\PhiΦ.

Formalization targets

Goal: THEOREM 1 (p. 604)

There is an absolute constant C>0C > 0C>0 such that for every sequence of TTT operations started from no heaps, with ntn_tnt​ the number of items in the heap that operation ttt acts on, just before it acts,

∑t<Tcostt  ≤  ∑t<Tbt,bt={C(log⁡2nt+1)delete min or delete,Cotherwise.\sum_{t<T} \mathrm{cost}_t \;\le\; \sum_{t<T} b_t, \qquad b_t = \begin{cases} C(\log_2 n_t + 1) & \text{delete min or delete},\\ C & \text{otherwise.}\end{cases}t<T∑​costt​≤t<T∑​bt​,bt​={C(log2​nt​+1)C​delete min or delete,otherwise.​

The paper's wording is "the total time is at most the total amortized time, where the amortized time is O(log⁡n)O(\log n)O(logn) for each delete min or delete operation and O(1)O(1)O(1) for each of the other operations"; the goal pins the O(⋅)O(\cdot)O(⋅) to one constant and does not name the potential.

Milestones

  1. LEMMA 1: the iiith child of a node, in linking order, has rank at least i−2i - 2i−2.
  2. Fk+2≥φkF_{k+2} \ge \varphi^kFk+2​≥φk, with FkF_kFk​ the Fibonacci numbers and φ=(1+5)/2\varphi = (1+\sqrt5)/2φ=(1+5​)/2.
  3. COROLLARY 1: a node of rank kkk has at least Fk+2≥φkF_{k+2} \ge \varphi^kFk+2​≥φk descendants, itself included.
  4. A node of rank kkk in an nnn-item heap has φk≤n\varphi^k \le nφk≤n, hence k≤log⁡n/log⁡φk \le \log n / \log\varphik≤logn/logφ.
  5. make heap, find min and meld leave Φ\PhiΦ unchanged; insert raises it by one.
  6. delete min raises Φ\PhiΦ by at most log⁡n/log⁡φ\log n / \log \varphilogn/logφ minus the number of linking steps.
  7. decrease key raises Φ\PhiΦ by at most three minus the number of cascading cuts.
  8. From no heaps, the total amortized time bounds the total actual time.

Significance

THEOREM 1 is the data-structure fact behind the paper's algorithmic results: Dijkstra's algorithm in O(nlog⁡n+m)O(n\log n + m)O(nlogn+m), all-pairs shortest paths and the assignment problem in O(n2log⁡n+nm)O(n^2 \log n + nm)O(n2logn+nm), and minimum spanning trees in O(m β(m,n))O(m\,\beta(m,n))O(mβ(m,n)).

The result has been proved since 1987. What the mission adds is a machine-checked version of the paper's own analysis on an operational model with arbitrary linking order, unmarking on link, marking or cascading on every cut, and the paper's unit costs. The proposal states the theorem and its supporting claims; their proofs remain to be formalized.

Difficulty

The obvious argument, that every tree is a binomial tree and so every rank is at most log⁡2n\log_2 nlog2​n, fails as soon as cuts are allowed: decrease key and delete remove subtrees arbitrarily, and the trees of an F-heap need not be binomial. The rank bound has to come from an invariant of the whole history (LEMMA 1), which only holds because a node loses at most one child before it is cut itself; without cascading cuts a node of rank kkk can be left with only k+1k+1k+1 descendants, and no logarithmic rank bound holds. A second difficulty is that the actual cost of one decrease key is unbounded, since a single operation may trigger arbitrarily many cascading cuts; a per-operation worst-case argument cannot give THEOREM 1, and the bound holds only for whole sequences started from no heaps.

Formalization scope

All declarations sit in the namespace FibHeap.Amort. Trees are a nested inductive FTree with item ℕ, key ℝ, a mark bit and a list of children in linking order; a heap is List FTree (its roots) and a collection is List Heap. Operations are a step relation Step s op s' d whose data d records linking steps, cuts, cascading cuts and the scan, so that cost d = 1 + links + cuts + scan is determined by what the operation did. The linking loop allows every order of linking; a link tie makes the first root a child of the second, while delete min may choose any minimum-key root. Runs start from no heaps; reachable collections consist of heap-ordered trees with each item in at most one heap. LEMMA 1, COROLLARY 1 and the delete-min bound are stated for reachable collections only, as the paper's "a node in an F-heap" intends. The paper's standing assumption that an item is in only one heap at a time is enforced by the precondition of insert and is not a hypothesis. The minimum pointer and returned items are not stored in the step relation; find min is a state-preserving step charged one unit. A heap destroyed by meld remains as an empty heap at its index.

Logarithms in the goal are base 2 (footnote 1, p. 600), with a +1+1+1 so that one-item heaps have positive budget. The paper's constant "≤1.4404log⁡n\le 1.4404 \log n≤1.4404logn" on p. 604 is a rounding slip (1/log⁡2φ=1.44042…1/\log_2 \varphi = 1.44042\ldots1/log2​φ=1.44042…); milestones use the exact log⁡φn\log_\varphi nlogφ​n.

The goal is not trivialized: the cost counts every linking step and every cut as fixed by the step relation, CCC is quantified before the run, and a companion theorem (step_exists) shows that every valid operation can be performed, so runs containing delete min, decrease key and cascading cuts exist. A further supporting statement gives an explicit form of the delete potential bound. A complete development needs facts about the nested inductive (sizes, subtree lists, marked counts under list edits), an invariant for LEMMA 1 recording when each child was linked, and the Fibonacci inequality; contributions of any of these as separate lemmas are welcome.

Selected references

  • M. L. Fredman and R. E. Tarjan, Fibonacci heaps and their uses in improved network optimization algorithms, J. ACM 34(3):596–615, 1987. https://doi.org/10.1145/28869.28874
  • J. Vuillemin, A data structure for manipulating priority queues, Comm. ACM 21(4):309–315, 1978. https://doi.org/10.1145/359460.359478
  • R. E. Tarjan, Amortized computational complexity, SIAM J. Algebraic Discrete Methods 6(2):306–318, 1985. https://doi.org/10.1137/0606031
  • E. W. Dijkstra, A note on two problems in connexion with graphs, Numer. Math. 1:269–271, 1959. https://doi.org/10.1007/BF01386390
10 thms2 active usersReviewed
🏆Completed
Combinatorics·Captain: wurtle

Truly Subcubic APSP on a Word RAMResearch Paper

All-pairs shortest paths (APSP) computes the shortest distance between every pair of vertices in a weighted graph. It is a fundamental problem in graph algorithms and a fundamental problem in fine-grained complexity.

This mission formalizes a deterministic O(n2.99942)O(n^{2.99942})O(n2.99942) algorithm for APSP on directed nnn-vertex graphs with polynomially bounded integer edge weights and no negative cycles, on a word RAM with O(log⁡n)O(\log n)O(logn)-bit words. This is a truly subcubic bound and refutes the integer-weight APSP hypothesis in this model.

References:

  1. Josh Alman and Virginia Vassilevska Williams, Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs, 2026, Theorem 22.
  2. Anthropic, formal-math / 3sum-apsp: accompanying Lean formalization, Theorem_22_APSP.
51 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Approximation Algorithms for Scheduling Unrelated Parallel Machines 3: On the 3-Dimensional Matching Instances, a Schedule within ρ < 3/2 of Optimal Has Makespan ≤ 2 Iff a Matching ExistsResearch Paper

Motivation

Minimum makespan scheduling on unrelated parallel machines, written R ∣∣ Cmax⁡R\,||\,C_{\max}R∣∣Cmax​, is one of the basic models of scheduling theory: nnn jobs must each be run on one of mmm machines, and the time a job takes depends arbitrarily on the machine. Lenstra, Shmoys and Tardos (CWI Report OS-R8714, 1987; journal version Math. Programming 46, 1990) gave a polynomial 2-approximation algorithm for this problem and, in the same paper, a matching limit from below: no polynomial algorithm can guarantee a factor smaller than 3/23/23/2 unless P=NPP = NPP=NP (their Corollary 2).

The two bounds have stood for more than three decades. Closing the gap between 3/23/23/2 and 222 for R ∣∣ Cmax⁡R\,||\,C_{\max}R∣∣Cmax​ is listed among the central open problems of approximation algorithms (Williamson and Shmoys, The Design of Approximation Algorithms, 2011, open problem on unrelated machines; Schuurman and Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 1999). The lower bound of 3/23/23/2 is the subject of this mission.

Timeline:

  • 1979: Graham, Lawler, Lenstra and Rinnooy Kan introduce the classification R ∣∣ Cmax⁡R\,||\,C_{\max}R∣∣Cmax​.
  • 1987/1990: Lenstra, Shmoys and Tardos prove NP-completeness of deciding makespan at most 3 (Theorem 4, giving the bound 4/34/34/3) and at most 2 (Theorem 5, giving 3/23/23/2), both by reduction from 3-dimensional matching.
  • Since then: the 3/23/23/2 hardness bound has not been improved for general R ∣∣ Cmax⁡R\,||\,C_{\max}R∣∣Cmax​; progress has concentrated on special cases such as the restricted-assignment problem.

Setting

3-dimensional matching. There are three disjoint sets A={a1,…,an}A = \{a_1,\dots,a_n\}A={a1​,…,an​}, B={b1,…,bn}B = \{b_1,\dots,b_n\}B={b1​,…,bn​}, C={c1,…,cn}C = \{c_1,\dots,c_n\}C={c1​,…,cn​} and a family F={T1,…,Tm}F = \{T_1,\dots,T_m\}F={T1​,…,Tm​} of triples, each with one element of AAA, one of BBB and one of CCC. A matching is a subfamily F′F'F′ with ∣F′∣=n|F'| = n∣F′∣=n whose union is A∪B∪CA \cup B \cup CA∪B∪C. In Lean an instance is a map T:Fin m→Fin n×Fin n×Fin nT : \mathrm{Fin}\,m \to \mathrm{Fin}\,n \times \mathrm{Fin}\,n \times \mathrm{Fin}\,nT:Finm→Finn×Finn×Finn, and HasMatching T says that a matching exists.

The scheduling model. Machines are Fin m\mathrm{Fin}\,mFinm, jobs are Fin N\mathrm{Fin}\,NFinN, and pijp_{ij}pij​ is the positive integer processing time of job jjj on machine iii. A schedule σ\sigmaσ assigns each job to one machine; the load of machine iii is ∑j:σ(j)=ipij\sum_{j:\sigma(j)=i} p_{ij}∑j:σ(j)=i​pij​ and the makespan Cmax⁡(σ)C_{\max}(\sigma)Cmax​(σ) is the largest load. These are the published definitions MatousekLP.Scheduling.load and makespan.

The instance of Theorem 5. The triples containing aja_jaj​ are the triples of type jjj; let tjt_jtj​ be their number. From TTT the paper builds a scheduling instance with mmm machines, machine iii corresponding to TiT_iTi​, and with

  1. 2n2n2n element jobs, one for each bkb_kbk​ and each clc_lcl​;
  2. tj−1t_j - 1tj​−1 dummy jobs of type jjj, for each jjj.

If Ti=(aj,bk,cl)T_i = (a_j, b_k, c_l)Ti​=(aj​,bk​,cl​), machine iii processes the element jobs of bkb_kbk​ and clc_lcl​ in time 111, each dummy job of type jjj in time 222, and every other job in time 333. In Lean the processing-time matrix is P T.

A ρ\rhoρ-approximate schedule of an instance is a schedule σ\sigmaσ with Cmax⁡(σ)≤ρ Cmax⁡(τ)C_{\max}(\sigma) \le \rho\, C_{\max}(\tau)Cmax​(σ)≤ρCmax​(τ) for every schedule τ\tauτ of the same instance.

Formalization targets

Goal: Corollary 2 (p. 8)

For every instance TTT, every ρ<3/2\rho < 3/2ρ<3/2, and every ρ\rhoρ-approximate schedule σ\sigmaσ of the instance of Theorem 5 built from TTT,

Cmax⁡(σ)≤2  ⟺  T has a matching.C_{\max}(\sigma) \le 2 \iff T \text{ has a matching}.Cmax​(σ)≤2⟺T has a matching.

This is the mathematical content of "for every ρ<3/2\rho < 3/2ρ<3/2 there is no polynomial ρ\rhoρ-approximation algorithm unless P=NPP = NPP=NP": a ρ\rhoρ-approximate answer on the reduced instance decides 3-dimensional matching.

Theorem 5 (p. 7)

For every instance TTT,

∃ σ: Cmax⁡(σ)≤2  ⟺  T has a matching.\exists\,\sigma:\ C_{\max}(\sigma) \le 2 \iff T \text{ has a matching}.∃σ: Cmax​(σ)≤2⟺T has a matching.

Milestones from the proof of Theorem 5 (pp. 7–8)

  1. If every tj≥1t_j \ge 1tj​≥1, then ∑j(tj−1)+n=m\sum_j (t_j - 1) + n = m∑j​(tj​−1)+n=m: there are m−nm - nm−n dummy jobs.
  2. A matching yields a schedule with makespan at most 222.
  3. A schedule with makespan at most 222 yields a matching.

Significance

The result. Theorem 5 shows that R ∣∣ Cmax⁡R\,||\,C_{\max}R∣∣Cmax​ is NP-hard already when every processing time lies in {1,2,3}\{1,2,3\}{1,2,3} and the target makespan is 222. Corollary 2 turns this into the best known inapproximability bound for the problem, 3/23/23/2, which sits opposite the paper's own factor-2 algorithm. The same reduction pattern (machines as triples, dummy jobs that pin machines down) is reused in many later hardness proofs for scheduling and assignment problems.

Formalizing it. The result is proved on paper; no machine-checked version is known to exist. A formal proof requires the full combinatorial argument behind the reduction, including the counting of machines per type and the case where some element of AAA lies in no triple, which the paper does not discuss. Together with mission 1 of this series (the factor-2 algorithm), it fixes both ends of the [3/2,2][3/2, 2][3/2,2] gap in one formal library.

Difficulty

The construction is short, but the converse direction carries the weight: from an arbitrary schedule with makespan at most 222 one must recover a matching, although nothing in the schedule singles out the triples that form it. The obvious first idea, to read the matching off the machines that receive unit-time jobs, fails as it stands: a machine may receive one unit-time job or none, and the argument must exclude this for every schedule, including the degenerate instances in which some aja_jaj​ lies in no triple or triples repeat. For Corollary 2, the passage from the real-valued approximation guarantee to the threshold 222 depends on the strict inequality ρ<3/2\rho < 3/2ρ<3/2; at ρ=3/2\rho = 3/2ρ=3/2 the statement is no longer implied by Theorem 5.

Formalization scope

  • Machines are Fin m; 3DM elements are Fin n; a 3DM instance is T : Fin m → Fin n × Fin n × Fin n, so a triple may repeat. A matching is a set of nnn triple indices covering every aja_jaj​, bkb_kbk​, clc_lcl​ (the covering form of the paper's definition, which forces disjointness).
  • The jobs of the reduced instance are the sum type Fin n⊕Fin n⊕Σj Fin(tj−1)\mathrm{Fin}\,n \oplus \mathrm{Fin}\,n \oplus \Sigma_j\,\mathrm{Fin}(t_j - 1)Finn⊕Finn⊕Σj​Fin(tj​−1). They are enumerated by a fixed bijection with Fin N\mathrm{Fin}\,NFinN so that the published MatousekLP.Scheduling.makespan applies. All statements quantify over every schedule, so the choice of bijection is irrelevant.
  • tj−1t_j - 1tj​−1 is natural-number subtraction. When some tj=0t_j = 0tj​=0 (a case the paper leaves aside), type jjj has no dummy job; the reduced instance then has neither a matching nor a schedule of makespan at most 222, so Theorem 5 and Corollary 2 hold as stated, with no hypothesis tj≥1t_j \ge 1tj​≥1. Only the dummy-count milestone assumes tj≥1t_j \ge 1tj​≥1.
  • Processing times are natural numbers cast to R\mathbb RR; makespans are real.
  • Not formalized: "polynomial" (running time of an algorithm and of the reduction), membership in NP, "NP-complete" and "unless P=NPP = NPP=NP". Theorem 5 is stated as the reduction's equivalence; Corollary 2 is stated as the fact that any ρ\rhoρ-approximate schedule of the reduced instance, ρ<3/2\rho < 3/2ρ<3/2, decides 3-dimensional matching. The reduction is evidently polynomial, but this is not stated.
  • The approximation hypothesis compares σ\sigmaσ with every schedule τ\tauτ of the same reduced instance; a goal in which σ\sigmaσ is an arbitrary schedule, or is bounded against an unrelated quantity, would be a different statement. The strict inequality ρ<3/2\rho < 3/2ρ<3/2 is essential and kept.
  • Contributions welcome: proofs of the three milestones, of Theorem 5 from them, and of Corollary 2; reusable lemmas about integer-valued makespans and about sum-type job sets.

Selected references

  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, CWI Report OS-R8714, Centre for Mathematics and Computer Science, Amsterdam, 1987 (FOCS 1987); the version cited for every theorem number in this mission.
  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, Mathematical Programming 46 (1990) 259–271. https://doi.org/10.1007/BF01585745
  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, 1979 (3-dimensional matching, problem [SP1]).
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, Journal of Scheduling 2 (1999) 203–213. https://doi.org/10.1002/(SICI)1099-1425(199909/10)2:5<203::AID-JOS26>3.0.CO;2-5
  • D. P. Williamson, D. B. Shmoys, The Design of Approximation Algorithms, Cambridge University Press, 2011. https://doi.org/10.1017/CBO9780511921735
8 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

Approximation Algorithms for Scheduling Unrelated Parallel Machines 4: With Times in {p, q} and gcd(p, q) = 1, a q-Dimensional Matching Exists Iff a Schedule Has Makespan ≤ pqResearch Paper

Motivation

Minimum makespan scheduling on unrelated parallel machines asks for an assignment of nnn jobs to mmm machines, where job jjj takes pijp_{ij}pij​ time units on machine iii, so that the largest machine load is as small as possible. In the three-field notation of Graham, Lawler, Lenstra and Rinnooy Kan (1979) it is R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​. It models load balancing across heterogeneous processors, workers or production lines, and it is a standard test case for linear-programming rounding.

Lenstra, Shmoys and Tardos (FOCS 1987; CWI Report OS-R8714; Mathematical Programming 46, 1990) gave a polynomial 2-approximation algorithm for R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​ and showed that no polynomial algorithm achieves a ratio below 3/23/23/2 unless P = NP. They also asked which restrictions on the processing times keep the problem hard. Their Section 5 answers this when only two distinct processing times occur:

  • all pij=1p_{ij}=1pij​=1: trivial;
  • all pij∈{1,∞}p_{ij}\in\{1,\infty\}pij​∈{1,∞}: bipartite cardinality matching;
  • all pij∈{1,2}p_{ij}\in\{1,2\}pij​∈{1,2}: polynomial by matching techniques (Theorem 6);
  • all pij∈{p,q}p_{ij}\in\{p,q\}pij​∈{p,q} with p<qp<qp<q, 2p≠q2p\ne q2p=q: NP-hard (Theorem 7).

Theorem 7 is the paper's last result and closes this classification. Its proof generalizes the reduction of Theorem 4, which handles the case {1,3}\{1,3\}{1,3}, from 3-dimensional matching to qqq-dimensional matching.

Setting

Machines are indexed by i∈{1,…,m}i\in\{1,\dots,m\}i∈{1,…,m} and jobs by jjj. A schedule σ\sigmaσ assigns every job to exactly one machine. The load of machine iii is ∑j:σ(j)=ipij\sum_{j:\sigma(j)=i}p_{ij}∑j:σ(j)=i​pij​, and the makespan Cmax⁡(σ)C_{\max}(\sigma)Cmax​(σ) is the largest load.

qqq-dimensional matching. An instance is a ground set UUU of qnqnqn elements and a family S1,…,SmS_1,\dots,S_mS1​,…,Sm​ of qqq-element subsets of UUU. A matching is a subfamily F′⊆{1,…,m}F'\subseteq\{1,\dots,m\}F′⊆{1,…,m} with ∣F′∣=n|F'|=n∣F′∣=n and ⋃i∈F′Si=U\bigcup_{i\in F'}S_i=U⋃i∈F′​Si​=U; its members are then pairwise disjoint.

The instance of Theorem 7. Fix natural numbers 0<p<q0<p<q0<p<q that are relatively prime. Build a scheduling instance with mmm machines, machine iii corresponding to SiS_iSi​, and two kinds of jobs:

  • qnqnqn element jobs, one per u∈Uu\in Uu∈U, with piu=pp_{iu}=ppiu​=p if u∈Siu\in S_iu∈Si​ and piu=qp_{iu}=qpiu​=q otherwise;
  • p(m−n)p(m-n)p(m−n) dummy jobs, each taking qqq time units on every machine.

Every processing time lies in {p,q}\{p,q\}{p,q}.

The instance of Theorem 4. For disjoint sets A={a1,…,an}A=\{a_1,\dots,a_n\}A={a1​,…,an​}, BBB, CCC of the same size and triples Ti=(aj,bk,cl)T_i=(a_j,b_k,c_l)Ti​=(aj​,bk​,cl​), i=1,…,mi=1,\dots,mi=1,…,m, there are 3n3n3n element jobs, one per element of A∪B∪CA\cup B\cup CA∪B∪C, and m−nm-nm−n dummy jobs. Machine iii processes the element jobs of aja_jaj​, bkb_kbk​, clc_lcl​ in one time unit and every other job in three time units. A 3-dimensional matching is a subfamily of nnn triples covering A∪B∪CA\cup B\cup CA∪B∪C.

Formalization targets

Goal: Theorem 7 (p. 8; proof pp. 8–9)

For relatively prime 0<p<q0<p<q0<p<q and a family of qqq-subsets S1,…,SmS_1,\dots,S_mS1​,…,Sm​ of a qnqnqn-element set, the instance above has all processing times in {p,q}\{p,q\}{p,q}, and

∃ σ: Cmax⁡(σ)≤pq⟺∃ F′⊆{1,…,m}: ∣F′∣=n, ⋃i∈F′Si=U.\exists\,\sigma:\ C_{\max}(\sigma)\le pq \quad\Longleftrightarrow\quad \exists\,F'\subseteq\{1,\dots,m\}:\ |F'|=n,\ \bigcup_{i\in F'}S_i=U .∃σ: Cmax​(σ)≤pq⟺∃F′⊆{1,…,m}: ∣F′∣=n, i∈F′⋃​Si​=U.

Milestones

  1. Theorem 4 (p. 7): on the 3-dimensional matching instance with times in {1,3}\{1,3\}{1,3}, a schedule with makespan at most 333 exists iff a matching exists.
  2. Matching gives a schedule (pp. 8–9): if SSS has a matching, some schedule has Cmax⁡≤pqC_{\max}\le pqCmax​≤pq.
  3. No idle time, two kinds of machine (p. 9): in every schedule with Cmax⁡≤pqC_{\max}\le pqCmax​≤pq, three things hold. Every load equals pqpqpq. Every element job runs at length ppp, on a machine whose tuple contains it. Each machine processes either exactly qqq element jobs and no dummy job, or exactly ppp dummy jobs and no element job.

Significance

The result. Theorems 6 and 7 together say exactly which two-valued restrictions of R ∥ Cmax⁡R\,\|\,C_{\max}R∥Cmax​ are tractable. Up to scaling, the polynomial case is {1,2}\{1,2\}{1,2}, and every other pair {p,q}\{p,q\}{p,q} with p<qp<qp<q is NP-hard. Theorem 4 is the base case. It also yields Corollary 1 of the paper: no polynomial ρ\rhoρ-approximation with ρ<4/3\rho<4/3ρ<4/3 exists unless P = NP. Reductions of this "no idle time" kind are a standard template for hardness of restricted-assignment and two-value scheduling, a line still active in the study of the restricted assignment problem and of the "graph balancing" special case.

Formalizing it. The result is proved, in two short paragraphs. The proof leaves to the reader the construction of the schedule from a matching and the "easy number theoretic argument" behind the converse, and both become explicit here. The development also produces reusable pieces: a qqq-dimensional matching definition over an arbitrary family of qqq-sets, and two reduction instances built on the published load and makespan of MatousekLP.Scheduling.Schedule. To our knowledge no machine-checked proof of these reductions exists.

Difficulty

The forward direction is a direct construction. The converse is where care is needed. A schedule with makespan at most pqpqpq may a priori place an element job on a machine whose tuple does not contain it, at length qqq, and may mix element and dummy jobs on one machine. Looking at one machine at a time does not exclude either: a single machine can carry such a mixed load below pqpqpq. What excludes them is a property of the whole schedule together with the arithmetic of ppp and qqq. The hypotheses are sharp for this step: for p>qp>qp>q element jobs are cheaper on foreign machines, and for gcd⁡(p,q)>1\gcd(p,q)>1gcd(p,q)>1 a load ap+bq=pqap+bq=pqap+bq=pq with a,b>0a,b>0a,b>0 becomes possible.

Formalization scope

  • Model. Machines are Fin m. Schedules are maps from jobs to machines. Load and makespan are those of the published MatousekLP.Scheduling.Schedule, with natural-number processing times cast to R\mathbb RR. The jobs are enumerated as Fin (q * n + p * (m - n)) (Theorem 7) and Fin (3 * n + (m - n)) (Theorem 4), element jobs first, through finSumFinEquiv.
  • Ground set and family. The ground set is Fin (q * n) and the family is indexed by machines, so repeated tuples are allowed. The qqq-partite structure of qqq-dimensional matching is not imposed: the reduction does not use it, and statements over all families of qqq-sets contain the qqq-partite case. Theorem 4 keeps the tripartite structure, with triples of indices in Fin n × Fin n × Fin n.
  • Threshold. The thresholds are exactly pqpqpq and 333, with "makespan at most".
  • Complexity wording not formalized. "NP-hard" (Theorem 7) and "NP-complete" (Theorem 4) are not formalized: membership in NP, polynomial size of the reductions, and the hardness of the matching problems are not stated. What is stated is the equivalence each reduction establishes.
  • Hypotheses. Theorem 7's goal assumes 0<p<q0<p<q0<p<q, gcd⁡(p,q)=1\gcd(p,q)=1gcd(p,q)=1 and ∣Si∣=q|S_i|=q∣Si​∣=q. The paper's general case gcd⁡(p,q)=g>1\gcd(p,q)=g>1gcd(p,q)=g>1 is its stated "without loss of generality": divide all times by ggg, which divides every makespan by ggg. It is not part of the formal statement. The paper's hypothesis 2p≠q2p\ne q2p=q is dropped because the reduction does not use it. With coprime p<qp<qp<q it excludes only (p,q)=(1,2)(p,q)=(1,2)(p,q)=(1,2), where the equivalence still holds but the source problem is bipartite matching. The formal goal is therefore stronger than the paper's.
  • Edge cases. For m<nm<nm<n, natural-number subtraction gives no dummy jobs; both sides of each equivalence are false when n≥1n\ge1n≥1. This stands in for the paper's "trivial 'no' instance". For n=0n=0n=0 the empty family is a matching and the dummy jobs fill the machines exactly.
  • No trivialization. The goal is an equivalence about a constructed instance whose processing times are given by explicit definitions. Neither side is assumed, the schedule is quantified over all maps from jobs to machines, and the instance is not a free parameter pinned by hypotheses.
  • Welcome contributions. Besides the milestones: counting lemmas relating a machine's load to the numbers of jobs of each length on it, and lemmas on the makespan of MatousekLP.Scheduling.Schedule (it bounds every load; it is attained when m≥1m\ge1m≥1), which are reusable across scheduling reductions.

Selected references

  • J. K. Lenstra, D. B. Shmoys, É. Tardos, Approximation algorithms for scheduling unrelated parallel machines, CWI Report OS-R8714, Amsterdam, 1987 (the version formalized here); journal version in Mathematical Programming 46 (1990) 259–271. https://doi.org/10.1007/BF01585745
  • M. R. Garey, D. S. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness, Freeman, 1979 (3-dimensional matching, problem SP1).
  • R. L. Graham, E. L. Lawler, J. K. Lenstra, A. H. G. Rinnooy Kan, Optimization and approximation in deterministic sequencing and scheduling: a survey, Annals of Discrete Mathematics 5 (1979) 287–326. https://doi.org/10.1016/S0167-5060(08)70356-X
  • J. Matoušek, B. Gärtner, Understanding and Using Linear Programming, Springer, 2007, §8.3 (the schedule, load and makespan definitions reused here). https://doi.org/10.1007/978-3-540-30717-4
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchOptimization·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments III: The Three Revenue-Ordered Approximation Bounds Are TightResearch Paper

Motivation

A retailer or an airline chooses which products to offer, and customers choose among what is offered, or buy nothing. Choosing the offer set that maximizes expected revenue is the assortment problem, central to revenue management (Talluri and van Ryzin, 2004). It is NP-hard even for simple mixtures of logit models, so practice relies on heuristics. The most common one is the revenue-ordered assortments strategy: offer the products whose price is above a threshold, and pick the best threshold.

Berbeglia and Joret (arXiv:1606.01371) analyse this heuristic under every regular choice model, the broad class in which enlarging the offer set never raises the probability of choosing any given alternative, including not buying. They prove three approximation guarantees, then show that none of the three can be improved. This mission formalizes that last result, Theorem 3.4.

Timeline:

  • Talluri and van Ryzin (2004) showed that revenue-ordered assortments are optimal under the multinomial logit model.
  • Rusmevichientong, Shmoys, Tong and Topaloglu (2014) showed the problem NP-hard under a mixture of two logit models, and proved that revenue-ordered assortments earn at least OPT/(e(1+ln⁡(rk/r1)))\mathrm{OPT}/(e(1+\ln(r_k/r_1)))OPT/(e(1+ln(rk​/r1​))) under mixed logit.
  • Aouad, Farias, Levi and Segev (2018) proved an Ω(1/ln⁡(rk/r1))\Omega(1/\ln(r_k/r_1))Ω(1/ln(rk​/r1​)) guarantee under random utility models, and that the assortment problem there is NP-hard to approximate within Ω(1/n1−ϵ)\Omega(1/n^{1-\epsilon})Ω(1/n1−ϵ) and Ω(1/log⁡1−ϵ(rk/r1))\Omega(1/\log^{1-\epsilon}(r_k/r_1))Ω(1/log1−ϵ(rk​/r1​)).
  • Berbeglia and Joret (2016–2020, Algorithmica) proved the guarantees 1/k1/k1/k, 1/∑i(ri−ri−1)/ri≥1/(1+ln⁡(rk/r1))1/\sum_{i}(r_i-r_{i-1})/r_i\ge1/(1+\ln(r_k/r_1))1/∑i​(ri​−ri−1​)/ri​≥1/(1+ln(rk​/r1​)) and a purchase-probability bound under any regular model, and an instance on which all three, in their sum forms, are attained in the limit.

Setting

The products form a finite set C\mathcal CC. A system of choice probabilities gives, for every offer set S⊆CS\subseteq\mathcal CS⊆C and product xxx, the probability P(x,S)\mathcal P(x,S)P(x,S) that a customer buys xxx. The no-purchase probability is P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S). The model is regular if

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for x∈C∪{0}x\in\mathcal C\cup\{0\}x∈C∪{0};
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 for x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) for S⊆S′S\subseteq S'S⊆S′ and every x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Each product has a revenue r(x)>0r(x)>0r(x)>0. Offering SSS earns rev(S)=∑x∈SP(x,S) r(x)\mathrm{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\mathrm{rev}(S)OPT=maxS⊆C​rev(S).

Let r1<⋯<rkr_1<\dots<r_kr1​<⋯<rk​ be the distinct revenues, with r0:=0r_0:=0r0​:=0, and Si={x:r(x)≥ri}S_i=\{x: r(x)\ge r_i\}Si​={x:r(x)≥ri​}. The heuristic earns

RO=max⁡i∈[k]rev(Si).\mathrm{RO}=\max_{i\in[k]}\mathrm{rev}(S_i).RO=i∈[k]max​rev(Si​).

For an optimal S∗S^*S∗ let Ni=∑x∈S∗, r(x)≥riP(x,S∗)N_i=\sum_{x\in S^*,\,r(x)\ge r_i}\mathcal P(x,S^*)Ni​=∑x∈S∗,r(x)≥ri​​P(x,S∗), Nk+1=0N_{k+1}=0Nk+1​=0, and ℓ\ellℓ the largest index with Nℓ>0N_\ell>0Nℓ​>0. Section 3 of the paper proves

  • (A) OPT≤k⋅RO\mathrm{OPT}\le k\cdot\mathrm{RO}OPT≤k⋅RO (Theorem 3.1);
  • (B) OPT≤Dr⋅RO\mathrm{OPT}\le D_r\cdot\mathrm{RO}OPT≤Dr​⋅RO, with Dr=∑i=1kri−ri−1ri≤1+ln⁡(rk/r1)D_r=\sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\le 1+\ln(r_k/r_1)Dr​=∑i=1k​ri​ri​−ri−1​​≤1+ln(rk​/r1​) (Theorem 3.2);
  • (C) OPT≤DN(S∗)⋅RO\mathrm{OPT}\le D_N(S^*)\cdot\mathrm{RO}OPT≤DN​(S∗)⋅RO, with DN(S∗)=∑i=1ℓNi−Ni+1Ni≤1+ln⁡(N1/Nℓ)D_N(S^*)=\sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}\le 1+\ln(N_1/N_\ell)DN​(S∗)=∑i=1ℓ​Ni​Ni​−Ni+1​​≤1+ln(N1​/Nℓ​) (Theorem 3.3).

Formalization targets

Goal: Theorem 3.4

For every k≥1k\ge1k≥1 and every δ>0\delta>0δ>0 there are a finite nonempty product set, a regular P\mathcal PP, revenues r>0r>0r>0 with exactly kkk distinct values, and an optimal S∗S^*S∗ with N1>0N_1>0N1​>0, such that

k⋅RO<(1+δ) OPT,Dr⋅RO<(1+δ) OPT,DN(S∗)⋅RO<(1+δ) OPT.k\cdot\mathrm{RO}<(1+\delta)\,\mathrm{OPT},\qquad D_r\cdot\mathrm{RO}<(1+\delta)\,\mathrm{OPT},\qquad D_N(S^*)\cdot\mathrm{RO}<(1+\delta)\,\mathrm{OPT}.k⋅RO<(1+δ)OPT,Dr​⋅RO<(1+δ)OPT,DN​(S∗)⋅RO<(1+δ)OPT.

So none of the bounds (A), (B), (C) stays true when multiplied by 1+δ1+\delta1+δ, for any number kkk of distinct revenues.

The tight instance (milestones)

The paper's witness has products (i,j)(i,j)(i,j) with i∈[k]i\in[k]i∈[k] and j∈[i]j\in[i]j∈[i]. Product (i,j)(i,j)(i,j) has revenue ε−j\varepsilon^{-j}ε−j, and P((i,j),S)=εi\mathcal P((i,j),S)=\varepsilon^iP((i,j),S)=εi when (i,j)∈S(i,j)\in S(i,j)∈S and (i,1),…,(i,j−1)∉S(i,1),\dots,(i,j-1)\notin S(i,1),…,(i,j−1)∈/S, and 000 otherwise, for 0<ε≤120<\varepsilon\le\tfrac120<ε≤21​. The milestones follow the proof on pp. 10–11:

  • the axiom (iii) bound;
  • (7);
  • (8);
  • (9);
  • regularity;
  • the distinct revenues ri=ε−ir_i=\varepsilon^{-i}ri​=ε−i;
  • RO=rev(C)<1/(1−ε)\mathrm{RO}=\mathrm{rev}(\mathcal C)<1/(1-\varepsilon)RO=rev(C)<1/(1−ε);
  • OPT=k\mathrm{OPT}=kOPT=k, attained by {(i,i)}\{(i,i)\}{(i,i)};
  • the limits OPT/RO→k\mathrm{OPT}/\mathrm{RO}\to kOPT/RO→k and Dr→kD_r\to kDr​→k;
  • Ni=εi+⋯+εkN_i=\varepsilon^i+\dots+\varepsilon^kNi​=εi+⋯+εk and DN→kD_N\to kDN​→k as ε→0+\varepsilon\to0^+ε→0+.

Significance

With Theorems 3.1–3.3, Theorem 3.4 closes the analysis: in terms of the parameters kkk, DrD_rDr​ and DND_NDN​, revenue-ordered assortments are understood exactly under regular choice. It complements the hardness results of Aouad et al., which already show that no efficient strategy can do much better than (A) and (B) in general; Theorem 3.4 shows that the analysis of this particular heuristic is exact. The instance is also a concrete regular choice model in which the optimal offer set is far from every nested one.

On the formal side, the mission produces a reusable formal definition of regular discrete choice models, revenue-ordered assortments and the three bound quantities. These are shared, under other sub-namespaces, with the companion missions on Theorems 3.2 and 3.3. The result is proved in the paper. As far as is known it has not been machine-checked anywhere; the remaining work is formalizing the paper's proof, including the steps it leaves to the reader.

Difficulty

The proof is a construction, and the paper verifies most of it in a sentence each. The work lies in those sentences:

  • the regularity of the instance at the no-purchase option, (9), which needs the row decomposition (8);
  • the claim that {(i,i)}\{(i,i)\}{(i,i)} is optimal among all 2k(k+1)/22^{k(k+1)/2}2k(k+1)/2 offer sets, asserted without proof;
  • the claim that the full set is the best threshold set;
  • the evaluation of DN(S∗)D_N(S^*)DN​(S∗), which needs ℓ=k\ell=kℓ=k.

The naive witness, one instance per bound, does not help: the goal asks for one instance with exactly kkk revenues on which all three bounds are nearly attained, for every kkk.

Formalization scope

  • Products are an arbitrary finite type C. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S. Offer sets are Finset C.
  • IsRegular carries axioms (i)–(iv), with (i) and (iv) stated both for products and for the no-purchase option. Regularity at x=0x=0x=0 is essential: without it the guarantees fail.
  • OPT\mathrm{OPT}OPT is Finset.sup' over all subsets, including ∅\emptyset∅. RO\mathrm{RO}RO is Finset.sup' over the kkk threshold sets only, and needs Nonempty C.
  • The distinct revenues are the sorted image of r, indexed by Fin k from 000: the Lean index iii is the paper's i+1i+1i+1, and r0=0r_0=0r0​=0 is a separate case. ℓ\ellℓ lives in WithBot (Fin k).
  • Bounds are multiplicative (OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO); there is no ratio RO/OPT\mathrm{RO}/\mathrm{OPT}RO/OPT in the goal. Limits are along 𝓝[>] 0.
  • The tight instance keeps the paper's 1-based pairs (i,j)(i,j)(i,j) as a subtype of Fin (k+1) × Fin (k+1). Its regularity is a theorem to prove, never a field assumed.

Ruled out:

  • a fixed kkk, since "for every kkk" is the content;
  • tightness of the logarithmic forms 1/(1+ln⁡(rk/r1))1/(1+\ln(r_k/r_1))1/(1+ln(rk​/r1​)) and 1/(1+ln⁡ν)1/(1+\ln\nu)1/(1+lnν), which this instance does not show (there 1+ln⁡(rk/r1)→∞1+\ln(r_k/r_1)\to\infty1+ln(rk​/r1​)→∞ while OPT/RO→k\mathrm{OPT}/\mathrm{RO}\to kOPT/RO→k), so only the sum forms are claimed tight;
  • an instance whose regularity is assumed;
  • a heuristic maximizing over all subsets.

Contributions welcome: proofs of the milestones, especially (8), (9) and the optimality of {(i,i)}\{(i,i)\}{(i,i)}, and general lemmas on sorted distinct values of a finite function.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; published in Algorithmica, 2020. https://arxiv.org/abs/1606.01371
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
  • A. Aouad, V. Farias, R. Levi and D. Segev, The Approximability of Assortment Optimization Under Ranking Preferences, Operations Research 66(6), 2018. https://doi.org/10.1287/opre.2018.1724
15 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments II: Revenue-Ordered Assortments Earn OPT/(1 + ln ν), ν the Optimum's Purchase RatioResearch Paper

Motivation

A retailer that can display only some of its products must choose an assortment: the set of products offered to an arriving customer. Customers substitute: whether a given product is bought depends on what else is on the shelf. The assortment problem asks for the offer set that maximises expected revenue under a model of this substitution behaviour. It is a core problem of revenue management (Talluri and van Ryzin, Management Science 2004), and it is NP-hard already for a mixture of two multinomial logit models (Rusmevichientong, Shmoys, Tong and Topaloglu, POMS 2014).

The heuristic used most widely in practice is revenue-ordered assortments: sort the products by price and offer, for some threshold, every product priced at least that threshold. It is optimal under the multinomial logit model (Talluri and van Ryzin 2004) but not in general. Berbeglia and Joret (arXiv:1606.01371v3, 2019; Algorithmica 2020) give a tight analysis of its approximation ratio for every regular discrete choice model, a class that includes all random utility models. They prove three incomparable guarantees. This mission formalizes the third, Theorem 3.3, whose ratio depends on the purchase behaviour of an optimal assortment rather than on the prices. Companion missions in this series cover the price-ratio bound (Theorem 3.2) and the tightness of all three bounds (Theorem 3.4).

Setting

Let C\mathcal CC be a finite nonempty set of products. A system of choice probabilities gives, for every offer set S⊆CS\subseteq\mathcal CS⊆C and product xxx, the probability P(x,S)\mathcal P(x,S)P(x,S) that a customer offered SSS buys xxx. Buying nothing is the option 000, with P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S). The model is regular when

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for products and for x=0x=0x=0;
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 for x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Axiom 4 at x=0x=0x=0 says that enlarging the offer set never makes buying nothing more likely.

Prices are a function r:C→R>0r:\mathcal C\to\mathbb R_{>0}r:C→R>0​. Offering SSS earns rev(S)=∑x∈SP(x,S) r(x)\mathrm{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\mathrm{rev}(S)OPT=maxS⊆C​rev(S). Let r1<⋯<rkr_1<\dots<r_kr1​<⋯<rk​ be the distinct values of rrr, and let Si={x:r(x)≥ri}S_i=\{x:r(x)\ge r_i\}Si​={x:r(x)≥ri​} for i∈[k]i\in[k]i∈[k]. The revenue-ordered strategy earns

RO=max⁡1≤i≤krev(Si).\mathrm{RO}=\max_{1\le i\le k}\mathrm{rev}(S_i).RO=1≤i≤kmax​rev(Si​).

For an assortment S∗S^*S∗, the purchase profile is

Ni=∑x∈S∗, r(x)≥riP(x,S∗)(i∈[k]),Nk+1:=0,N_i=\sum_{x\in S^*,\ r(x)\ge r_i}\mathcal P(x,S^*)\qquad(i\in[k]),\qquad N_{k+1}:=0,Ni​=x∈S∗, r(x)≥ri​∑​P(x,S∗)(i∈[k]),Nk+1​:=0,

the probability that a customer offered S∗S^*S∗ buys something priced at least rir_iri​. It is non-increasing in iii.

Formalization targets

Goal: Theorem 3.3 (p. 9)

Let S∗S^*S∗ be optimal, rev(S∗)=OPT\mathrm{rev}(S^*)=\mathrm{OPT}rev(S∗)=OPT, suppose N1>0N_1>0N1​>0, and let ℓ∈[k]\ell\in[k]ℓ∈[k] be maximum with Nℓ>0N_\ell>0Nℓ​>0. Then

OPT≤(∑i=1ℓNi−Ni+1Ni)ROand∑i=1ℓNi−Ni+1Ni≤1+ln⁡ν,ν=N1Nℓ.\mathrm{OPT}\le\Big(\sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}\Big)\mathrm{RO} \qquad\text{and}\qquad \sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}\le1+\ln\nu,\quad\nu=\frac{N_1}{N_\ell}.OPT≤(i=1∑ℓ​Ni​Ni​−Ni+1​​)ROandi=1∑ℓ​Ni​Ni​−Ni+1​​≤1+lnν,ν=Nℓ​N1​​.

The first inequality is the paper's sum-form factor, the bound that Theorem 3.4 shows to be tight. The second is the closed form 1/(1+ln⁡ν)1/(1+\ln\nu)1/(1+lnν).

Milestones (in proof order)

  • Lemma 2.1 (p. 6): ∑x∈SP(x,S)≤∑x∈S′P(x,S′)\sum_{x\in S}\mathcal P(x,S)\le\sum_{x\in S'}\mathcal P(x,S')∑x∈S​P(x,S)≤∑x∈S′​P(x,S′) for S⊆S′S\subseteq S'S⊆S′.
  • First observation of the proof (p. 9): Ni≤∑x∈SiP(x,Si)N_i\le\sum_{x\in S_i}\mathcal P(x,S_i)Ni​≤∑x∈Si​​P(x,Si​) and Niri≤∑x∈SiP(x,Si)riN_ir_i\le\sum_{x\in S_i}\mathcal P(x,S_i)r_iNi​ri​≤∑x∈Si​​P(x,Si​)ri​.
  • Inequality (6) (p. 9): Niri≤RON_ir_i\le\mathrm{RO}Ni​ri​≤RO for every i∈[k]i\in[k]i∈[k].
  • Revenue identity (p. 9): rev(S∗)=∑i=1ℓ(Ni−Ni+1)ri=∑i=1ℓNi−Ni+1NiNiri\mathrm{rev}(S^*)=\sum_{i=1}^{\ell}(N_i-N_{i+1})r_i=\sum_{i=1}^{\ell}\frac{N_i-N_{i+1}}{N_i}N_ir_irev(S∗)=∑i=1ℓ​(Ni​−Ni+1​)ri​=∑i=1ℓ​Ni​Ni​−Ni+1​​Ni​ri​.
  • Logarithmic step (p. 9, the comparison 1/∑≥1/(1+ln⁡ν)1/\sum\ge1/(1+\ln\nu)1/∑≥1/(1+lnν) in Theorem 3.3, used in the last inequality of the proof): for N1≥⋯≥Nℓ>0N_1\ge\dots\ge N_\ell>0N1​≥⋯≥Nℓ​>0 and Nℓ+1=0N_{\ell+1}=0Nℓ+1​=0, ∑i=1ℓ(Ni−Ni+1)/Ni≤1+ln⁡(N1/Nℓ)\sum_{i=1}^{\ell}(N_i-N_{i+1})/N_i\le1+\ln(N_1/N_\ell)∑i=1ℓ​(Ni​−Ni+1​)/Ni​≤1+ln(N1​/Nℓ​). The paper states this step without proof.

Significance

Theorem 3.3 gives a guarantee that is independent of prices. The bound 1+ln⁡(rk/r1)1+\ln(r_k/r_1)1+ln(rk​/r1​) of Theorem 3.2 grows when prices are spread out. The bound 1+ln⁡ν1+\ln\nu1+lnν is small whenever an optimal assortment sells its expensive products with probability comparable to its overall purchase probability. In §4 the paper combines it with a reduction from unit-demand pricing to derive, for example, the 1/(1+ln⁡m)1/(1+\ln m)1/(1+lnm) guarantee of uniform pricing for the unit-demand min-pricing problem (Corollary 4.8, originally due to Aggarwal et al.). Together with Theorems 3.1 and 3.2, it describes the performance of the most common assortment heuristic over the whole class of regular models, with no parametric assumption on customer behaviour.

The theorem is proved on paper. To our knowledge it has no machine-checked proof, and no regular choice model has been formalized on the platform. This mission produces the regular model as a reusable definition, a statement of Theorem 3.3 in which every hypothesis is explicit, and formal versions of the proof's identities and inequalities. The logarithmic step is asserted without proof in the source, so a formal proof of it completes the paper's argument.

Difficulty

Each step is elementary. The difficulty is bookkeeping. The revenue of S∗S^*S∗ has to be regrouped by distinct price levels rather than by products: several products may share a price, and kkk counts values. The regrouping uses an Abel-type rearrangement with the boundary convention Nk+1=0N_{k+1}=0Nk+1​=0. Comparing NiN_iNi​ with the purchase probability of SiS_iSi​ needs regularity twice. First, axiom 4 for products passes from S∗S^*S∗ to S∗∩SiS^*\cap S_iS∗∩Si​. Then the no-purchase case passes from S∗∩SiS^*\cap S_iS∗∩Si​ to SiS_iSi​. A proof that uses axiom 4 only for products fails at the second step, and the claim is false without it.

Formalization scope

  • Products form a finite type C with [Fintype C] [DecidableEq C]. The goal adds [Nonempty C], the paper's k≥1k\ge1k≥1. Offer sets are Finset C, and P\mathcal PP is P : C → Finset C → ℝ. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S. IsRegular P carries axioms 1–4, including both no-purchase cases.
  • OPT\mathrm{OPT}OPT is Finset.sup' over all subsets. RO\mathrm{RO}RO is Finset.sup' over the indices 1,…,k1,\dots,k1,…,k of the threshold sets only.
  • Indices are 1-based natural numbers. level r i is rir_iri​ for 1≤i≤k1\le i\le k1≤i≤k. purchaseProfile P r S i is NiN_iNi​ for 1≤i≤k1\le i\le k1≤i≤k and 000 otherwise, which builds in Nk+1=0N_{k+1}=0Nk+1​=0.
  • Optimality is the hypothesis rev(S∗)=OPT\mathrm{rev}(S^*)=\mathrm{OPT}rev(S∗)=OPT. The index ℓ\ellℓ is a variable with hypotheses 1≤ℓ≤k1\le\ell\le k1≤ℓ≤k, Nℓ>0N_\ell>0Nℓ​>0, and Ni≯0N_i\not>0Ni​>0 for ℓ<i≤k\ell<i\le kℓ<i≤k. N1>0N_1>0N1​>0 is kept as in the paper.
  • The approximation factor is stated in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO, never as a ratio. Both the sum form and the logarithmic form are stated. ln⁡\lnln is Real.log, applied to ν≥1\nu\ge1ν≥1.
  • The milestones other than the goal are stated for an arbitrary S∗S^*S∗, because the proof does not use optimality there.

The following statements are trivial or false and are not this mission: a maximum over all subsets in place of RO\mathrm{RO}RO; regularity without its no-purchase case; a purchase profile taken from a non-optimal set while rev(S∗)\mathrm{rev}(S^*)rev(S∗) is still called the optimum; the logarithmic form alone; a specific choice model (MNL, Markov chain) in place of an arbitrary regular P\mathcal PP.

A complete development needs finite sums regrouped by the values of a function and an elementary logarithm inequality. The regular choice model and the revenue-ordered sets are shared with the other missions of this series and are reusable for any analysis of assortment heuristics. Proofs of any milestone are welcome. So are alternative arguments for the logarithmic step and a proof that NNN is non-increasing.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82, 2020. https://arxiv.org/abs/1606.01371v3
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
9 thms2 active usersReviewed
🏆Completed
Formal Verification·Captain: mikedeng1

Consensus in the Presence of Partial Synchrony II: With Synchronous Processors, Partially Synchronous Communication and t Fail-Stop Faults, No Consensus Protocol Exists When 2 ≤ N ≤ 2tResearch Paper

Motivation

Consensus asks NNN processors, each holding an initial value, to agree on one value despite some of them failing. It underlies replicated databases, atomic commit and state-machine replication. Its solvability depends on the timing assumptions. With fully synchronous processors and communication, ttt fail-stop faults can be tolerated for any t<Nt < Nt<N. With fully asynchronous communication, Fischer, Lynch and Paterson showed that no deterministic protocol tolerates even one fail-stop fault (JACM 1985).

Dwork, Lynch and Stockmeyer (JACM 1988) introduced partial synchrony, a model between these two extremes. Message delays have an upper bound Δ\DeltaΔ, but either the bound is unknown to the protocol, or it holds only from an unknown time on. For each fault type they found the exact number of faults that can be tolerated. This mission formalizes the lower bound for fail-stop faults: when the processors are synchronous and communication is partially synchronous, no consensus protocol tolerates ttt faults once N≤2tN \le 2tN≤2t.

Timeline. 1985: Fischer, Lynch, Paterson, impossibility of consensus with one fail-stop fault under asynchrony. 1987: Dolev, Dwork, Stockmeyer, which combinations of synchrony assumptions admit consensus (JACM 1987). 1988: Dwork, Lynch, Stockmeyer, partial synchrony, with matching upper and lower bounds on resiliency for fail-stop, omission, authenticated Byzantine and Byzantine faults. The global stabilization time of the 1988 paper became a common liveness assumption for later fault-tolerant agreement protocols.

Setting

There are NNN processors p1,…,pNp_1, \dots, p_Np1​,…,pN​. Each processor holds an initial value vi∈{0,1}v_i \in \{0, 1\}vi​∈{0,1}. Each runs a deterministic protocol: a transition diagram over a possibly infinite set of states. In each state the next instruction is either Send(m,pj)\mathrm{Send}(m, p_j)Send(m,pj​), which puts message mmm in pjp_jpj​'s buffer, or Receive(pi)\mathrm{Receive}(p_i)Receive(pi​), which removes a set SSS of messages from pip_ipi​'s buffer and delivers it. The next state depends on the current state and, for a Receive, on SSS. A step never both sends and receives. Each state may record a decision, and the first decision a processor records is final.

Real time is the ticks 1,2,3,…1, 2, 3, \dots1,2,3,…. A run fixes the initial values and, at each tick, which processors take a step and which messages each Receive delivers. A message is delivered only after the tick at which it was sent, only to its addressee, and at most once.

  • Synchronous processors (Φ=1\Phi = 1Φ=1): every correct processor takes a step at every tick.
  • Fail-stop faults: a faulty processor follows the protocol until it stops, and it never restarts. A processor that stops at time 000 is initially dead.
  • Δ\DeltaΔ holds in [T,∞)[T, \infty)[T,∞): a message sent at a tick s1≥Ts_1 \ge Ts1​≥T is delivered no later than any Receive of its addressee at a tick s2≥s1+Δs_2 \ge s_1 + \Deltas2​≥s1​+Δ.
  • Delta holds eventually: Δ\DeltaΔ is a fixed positive integer known to the protocol. In every run, Δ\DeltaΔ holds in [T,∞)[T, \infty)[T,∞) for some unknown global stabilization time TTT. Messages sent before TTT may be delayed arbitrarily or lost.
  • Delta is unknown: the protocol is fixed first. In every run, some positive Δ\DeltaΔ holds in [1,∞)[1, \infty)[1,∞).

A protocol is a ttt-resilient consensus protocol achieving weak unanimity if the following holds for every set CCC of at least N−tN - tN−t processors and every allowed run in which the processors of CCC are correct and the others fail-stop. No two processors of CCC decide differently (consistency). Every processor of CCC decides (termination). If all initial values are vvv and no processor is faulty, every decision is vvv (weak unanimity).

Formalization targets

Goal: Theorem 4.3

For integers t≤Nt \le Nt≤N with

2≤N≤2t,2 \le N \le 2t,2≤N≤2t,

there is no ttt-resilient consensus protocol achieving weak unanimity for binary values with fail-stop faults and synchronous processors. This holds for every positive Δ\DeltaΔ when Δ\DeltaΔ holds eventually, and when delta is unknown.

Milestones: the three scenarios of the proof

Split the processors into groups PPP and QQQ with 1≤∣P∣,∣Q∣≤t1 \le |P|, |Q| \le t1≤∣P∣,∣Q∣≤t.

  • Scenario A: all inputs 000 and QQQ initially dead. The processors of PPP decide by some time TAT_ATA​, and they decide 000.
  • Scenario B: all inputs 111 and PPP initially dead. The processors of QQQ decide 111 by some time TBT_BTB​.
  • Scenario C: all processors alive, PPP starting with 000 and QQQ with 111, and messages between the groups held back past a time TTT. Up to time TTT, every processor of PPP is in the same state as in Scenario A, and every processor of QQQ in the same state as in Scenario B.

Significance

The result. Theorem 4.3 shows that the resiliency N≥2t+1N \ge 2t + 1N≥2t+1 of the paper's fail-stop and omission protocols (Theorems 4.1 and 4.2) is optimal. It holds even under three restrictions: binary values, weak unanimity, and processors in perfect lock-step. Partial synchrony costs a majority of correct processors, whereas full synchrony costs nothing. The same scenarios give the authenticated Byzantine bound N≥3t+1N \ge 3t + 1N≥3t+1 (Theorem 4.4). The halting remark of Section 4.2 rests on an argument of the same kind.

The formalization. The theorem is proved in the paper, and its proof is short. It is not machine-checked anywhere known to the mission. No message-passing model is on the platform. This mission supplies one: a step-level model with buffers, per-message timing, fail-stop faults and both partially synchronous communication models. It also gives a machine-checked impossibility on top of that model. FLP, Theorem 4.4 and the lower bounds of Section 6 are natural follow-ups on the same definitions.

Difficulty

The informal proof is an indistinguishability argument. Making it formal means comparing different runs of the same deterministic protocol. Two points need care.

First, the scenarios must be allowed runs. Scenario C holds messages between the groups back past max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​). With delta unknown, this needs a Δ\DeltaΔ larger than that delay. When Δ\DeltaΔ holds eventually, Δ\DeltaΔ is fixed before the protocol, and the protocol fixes TAT_ATA​ and TBT_BTB​. So the delay is legal only for messages sent before the global stabilization time, which must therefore be placed after max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​). Read literally, "every message between the groups takes more than max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​) steps" is not an allowed run in this model.

Second, "the processors of PPP act exactly as they do in Scenario A" is a claim about whole runs. Two runs must agree on states, on which messages are in which buffer, and on when each message is delivered, tick by tick up to TTT. With one-to-one sends and atomic steps, "delivered in exactly time 1" also needs a reading: a processor that sends at the next tick cannot receive at that tick.

Formalization scope

All declarations live in the namespace DLSConsensus.LowerBound. Processor pip_ipi​ is the index i−1i - 1i−1 of Fin N. Values are Bool. The protocol's state type and message type are arbitrary types in Type, finite or infinite. R.state i n is the state after tick nnn. A message instance is identified in the run by its sender and send tick. A Receive hands the protocol each delivered message as (sender, content); the absolute send tick is not exposed.

Explicit readings and conventions:

  • "Fail-stop or omission faults": the goal is the fail-stop impossibility. It implies the omission case, because a fail-stop processor looks to the others like one whose sends are all omitted. The omission case is not a separate item.
  • A fail-stop processor may skip ticks before its final stop. The processor timing bound Φ=1\Phi = 1Φ=1 applies to correct processors.
  • "Decides": the first state that records a decision. Irreversibility therefore holds by definition.
  • "Delivered in exactly time 1": the message is delivered no later than the addressee's first Receive at least one tick after the send.
  • "Within time TAT_ATA​" and "for some finite TBT_BTB​": an explicit ∃\exists∃ before the decision bound.
  • "Messages between the groups take more than max⁡(TA,TB)\max(T_A, T_B)max(TA​,TB​) steps": no message between the groups is delivered at a tick ≤T\le T≤T, for any given TTT.
  • "Act exactly as they do": equal local states at every tick n≤Tn \le Tn≤T.
  • Quantifier order: when Δ\DeltaΔ holds eventually, Δ\DeltaΔ is chosen first, then the protocol, then the run with its stabilization time. When delta is unknown, the protocol is chosen first and each run carries its own Δ\DeltaΔ. In both models Δ>0\Delta > 0Δ>0.

Trivializing formalizations are ruled out. The model has allowed runs for every protocol, so Resilient is never vacuously true. Correct processors step at every tick, so termination does not fail for the wrong reason. Unanimity is the weak form, applied only when no processor is faulty.

Contributions welcome: a general simulation lemma (equal inputs up to a tick give equal states up to that tick), the construction of runs from a delivery schedule, and proofs of the scenarios. These parts are reusable for the other lower bounds of the paper.

Selected references

  • C. Dwork, N. Lynch, L. Stockmeyer, Consensus in the presence of partial synchrony, Journal of the ACM 35(2), 1988, 288–323. https://doi.org/10.1145/42282.42283
  • M. J. Fischer, N. A. Lynch, M. S. Paterson, Impossibility of distributed consensus with one faulty process, Journal of the ACM 32(2), 1985, 374–382. https://doi.org/10.1145/3149.214121
  • D. Dolev, C. Dwork, L. Stockmeyer, On the minimal synchronism needed for distributed consensus, Journal of the ACM 34(1), 1987, 77–97. https://doi.org/10.1145/7531.7533
5 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations ResearchProbability·Captain: mikedeng1

Online Stochastic Matching: Beating 1-1/e 2: The Suggested Matching Algorithm Achieves 1 − 1/e with High Probability, and This Is Tight Even in ExpectationResearch Paper

Motivation

Online bipartite matching models decisions that must be made as requests arrive: an advertiser can be assigned to a compatible request once, and an assignment cannot be revised when later requests reveal a better alternative. Display advertising is the motivating example in Feldman, Mehta, Mirrokni, and Muthukrishnan's 2009 preprint: an ad server knows which advertisers accept each kind of impression and has estimates of how frequently those kinds will arrive. The question is how much this advance distributional information helps when decisions still have to be immediate.

This mission studies the paper's first offline-guided algorithm. It computes a maximum matching for the expected traffic and follows that matching during the actual random run. The paper shows that this natural policy reaches the familiar 1−1/e1-1/e1−1/e performance level and that its own analysis cannot be improved for this policy, even if performance is averaged over runs. The result sets the baseline for the paper's later two-suggested-matchings algorithm, which improves on that level under its stated assumptions. Feldman et al., §§1 and 4.1

Setting

An instance consists of a finite advertiser set AAA, a finite impression-type set III, and allowed edges E⊆A×IE\subseteq A\times IE⊆A×I. For each type iii, the nonnegative integer eie_iei​ is its expected number of arrivals. There are n=∑i∈Iei>0n=\sum_{i\in I}e_i>0n=∑i∈I​ei​>0 arrivals. Each arrival independently has type iii with probability ei/ne_i/nei​/n. A type with ei=0e_i=0ei​=0 remains in the graph but has zero arrival probability. On an arrival of type iii, an online algorithm may assign it to an adjacent advertiser that has not been assigned before, or may leave it unassigned. The hindsight optimum, OPT(ω)\mathrm{OPT}(\omega)OPT(ω), is the largest matching in the realization graph with one vertex for every arrival position, including separate vertices for repeated types. Feldman et al., §2, pp. 3–4

The suggested matching algorithm first selects any maximum integral flow in the expected-instance network. Each advertiser has capacity one, and each type iii has capacity eie_iei​. Equivalently, the selected edges form a maximum degree-capped bipartite matching M⊆EM\subseteq EM⊆E. Let A∗A^*A∗ be the advertisers covered by MMM. When type iii arrives, the algorithm chooses each advertiser joined to iii by a selected edge with probability 1/ei1/e_i1/ei​; any remaining probability chooses no advertiser. It assigns the chosen advertiser if available and otherwise makes no assignment. Its number of assignments is ALG(ω)\mathrm{ALG}(\omega)ALG(ω). This rule includes the algorithm's random choice in addition to the random arrival types. Feldman et al., §4.1, p. 5

The canonical residual cut of MMM places each advertiser and impression type on the source side if it is reachable from the source by residual edges. Write ATA_TAT​ for advertisers on the sink side and ISI_SIS​ for types on the source side. These sets describe the comparison between the expected-instance matching and the optimum of a realized run. The mission also uses occupancy: after nnn independent uniform throws into nnn bins, count how many bins in a fixed subset receive at least one ball. Feldman et al., §§2.1 and 4.1

Formalization targets

Theorem 4's general-instance guarantee is expressed in the additive form established by its analysis. For every ε>0\varepsilon>0ε>0, there are δ>0\delta>0δ>0 and NNN, uniform across all finite instances, all maximum integral flows, and all valid ways of realizing the algorithm's random choice, such that n≥Nn\ge Nn≥N implies

Pr⁡ ⁣[ALG(ω)≥(1−e−1)OPT(ω)−εn]≥1−e−δn.\Pr\!\left[\mathrm{ALG}(\omega)\ge(1-e^{-1})\mathrm{OPT}(\omega)-\varepsilon n\right] \ge 1-e^{-\delta n}.Pr[ALG(ω)≥(1−e−1)OPT(ω)−εn]≥1−e−δn.

The complete bipartite family gives the tightness target. When A=I={0,…,n−1}A=I=\{0,\ldots,n-1\}A=I={0,…,n−1} and every ei=1e_i=1ei​=1, every maximum expected-instance matching is perfect. For every run, OPT=n\mathrm{OPT}=nOPT=n, and

E[ALG]=n(1−(1−1n)n),lim⁡n→∞E[ALG]n=1−e−1.\mathbb E[\mathrm{ALG}] =n\left(1-\left(1-\frac1n\right)^n\right), \qquad \lim_{n\to\infty}\frac{\mathbb E[\mathrm{ALG}]}{n}=1-e^{-1}.E[ALG]=n(1−(1−n1​)n),n→∞lim​nE[ALG]​=1−e−1.

The milestone list follows the paper's Fact 1 and the named passages “Bounding ALG,” “Bounding OPT,” and “Tightness of the Analysis” in §4.1. The cut identity ∣A∗∣=∣AT∣+∑i∈ISei|A^*|=|A_T|+\sum_{i\in I_S}e_i∣A∗∣=∣AT​∣+∑i∈IS​​ei​ is a separate deterministic milestone. Feldman et al., Theorem 4 and §4.1, pp. 5–6

Significance

The result establishes exactly what this one-matching policy achieves under integer-frequency independent arrivals. It gives a guarantee for the actual number of assignments relative to the best assignment made with hindsight, and a family on which the limiting expected ratio equals the guarantee. That tight family explains why the paper introduces a second suggested matching rather than seeking a stronger bound for the same policy. Feldman et al., §4

The mathematical theorem is proved in the paper; the mission asks for its machine-checked formalization. The development would also provide reusable finite models of repeated-type realizations, integral degree-capped bipartite matchings, uniform occupancy, and residual reachability cuts. No machine-checked proof of these mission items is being claimed by this draft.

Difficulty

The expected-instance matching is selected before the arrivals, but the hindsight optimum can exploit the actual multiplicities of every type. Counting only the ads selected online does not compare the algorithm with that hindsight optimum. Also, a type may have several selected advertisers when ei>1e_i>1ei​>1, so replacing the algorithm's random choice by a deterministic designated ad would change its law. The cut and concentration statements have to apply uniformly to every maximum integral flow, including flows chosen by different tie-breaking rules. Feldman et al., §4.1, pp. 5–6

Formalization scope

Advertisers and types are finite Lean types. The edge relation is a finite set, and eie_iei​ and nnn are natural numbers with n=∑iei>0n=\sum_i e_i>0n=∑i​ei​>0. An integral maximum flow is represented by a maximum cardinality edge set with advertiser degree at most one and type-iii degree at most eie_iei​. The theorem quantifies over every such set. This is the unit-advertiser, integer-type-capacity flow used in §4.1, without a separate real-valued flow object. The canonical cut is defined through residual reachability. The hindsight optimum maximizes over matchings of the realized graph, with each arrival position distinct.

The run uses nnn independent uniform draws from ∑i{0,…,ei−1}\sum_i\{0,\ldots,e_i-1\}∑i​{0,…,ei​−1}. A valid labelling assigns each selected advertiser at type iii to a distinct copy. The drawn copy determines the type and, if labelled, the ad selected by the algorithm. This gives type probability ei/ne_i/nei​/n, conditional ad probability 1/ei1/e_i1/ei​ on selected edges, and the remaining “no ad” probability. Counts, probabilities, and expectations use finite sums, so there is no integrability convention. Since n>0n>0n>0, the run sample space is nonempty; no value of ALG/OPT\mathrm{ALG}/\mathrm{OPT}ALG/OPT at OPT=0\mathrm{OPT}=0OPT=0 is needed. The complete-graph family has n≥1n\ge1n≥1.

The paper writes 1−e−Ω(n)1-e^{-\Omega(n)}1−e−Ω(n) in both bounding passages. The Lean statements spell this out as ∀ε>0, ∃δ>0, ∃N, ∀\forall\varepsilon>0,\ \exists\delta>0,\ \exists N,\ \forall∀ε>0, ∃δ>0, ∃N, ∀ instances with n≥Nn\ge Nn≥N, with δ,N\delta,Nδ,N preceding the instance. Theorem 4's ratio language is represented by the additive estimate its proof yields; a vanishing ratio error requires a separate lower bound on OPT/n\mathrm{OPT}/nOPT/n. The exact finite-nnn expectation and its limit make “tight, even in expectation” precise. The printed Fact 1 exponent is εn/2\varepsilon n/2εn/2, while its Appendix A proof yields ε2n/2\varepsilon^2n/2ε2n/2; the formalized concentration statement uses the proved exponent and the milestone retains the printed wording. Neither a ratio with a zero denominator nor a labelling that changes the algorithm's choice law is accepted as a shortcut.

Contributions toward the occupancy bound, the residual cut identity, the realized matching bound, and the complete-graph expectation are welcome. The finite occupancy and matching interfaces are intended for reuse beyond this specific algorithm.

Selected references

  • Jon Feldman, Aranyak Mehta, Vahab Mirrokni, and S. Muthukrishnan, Online Stochastic Matching: Beating 1-1/e, arXiv:0905.4100v1, 2009; FOCS 2009. Preprint
10 thms2 active usersReviewed
🏆Completed
Formal Verification·Captain: mikedeng1

Consensus in the Presence of Partial Synchrony I: For N ≥ 2t + 1, Algorithm 1 Achieves Consistency, Strong Unanimity and Termination in the Basic Round Model with Fail-Stop or Omission FaultsResearch Paper

Motivation

Consensus asks NNN processors, each starting with a value, to agree on one value although some of them may be faulty. It underlies replicated databases, atomic commitment and state-machine replication. Two classical models bracket the problem. In a fully synchronous system, with known bounds on message delay and processor speed, consensus is solvable for many fault types. In a fully asynchronous system, Fischer, Lynch and Paterson showed in 1985 that no deterministic protocol tolerates even one fail-stop fault (FLP, J. ACM 1985).

Dwork, Lynch and Stockmeyer (J. ACM 35(2), 1988, 288–323) introduced partial synchrony between these extremes: message delays are bounded, but either the bound is unknown, or it holds only from an unknown global stabilization time (GST) on. This model, and the GST abstraction in particular, became the standard assumption under which practical consensus protocols (Paxos-style and Byzantine fault-tolerant replication) are proved live. The paper determines, for each fault type, the largest number ttt of faults that consensus can tolerate under partial synchrony. This mission formalizes its first positive result: for fail-stop and omission faults, N≥2t+1N \ge 2t+1N≥2t+1 processors suffice.

Setting

There are NNN processors p1,…,pNp_1,\dots,p_Np1​,…,pN​, an integer t≤Nt \le Nt≤N, and an arbitrary set VVV of values; processor pip_ipi​ starts with init(pi)∈V\mathrm{init}(p_i)\in Vinit(pi​)∈V.

In the basic round model (Section 3.1 of the paper), computation proceeds in rounds r=1,2,3,…r = 1, 2, 3, \dotsr=1,2,3,…. In each round every processor sends messages, each message is either delivered in that round or lost, and every processor then performs a state transition on the messages it received. Losses are described by a predicate deliv(r,q,p)\mathrm{deliv}(r,q,p)deliv(r,q,p). A set CCC of processors (the correct ones) and a round GST\mathrm{GST}GST constrain it: every message sent at a round r≥GSTr \ge \mathrm{GST}r≥GST from a processor of CCC to a processor of CCC is delivered. Before GST any message may be lost, and messages from or to processors outside CCC may be lost at any time. Processors outside CCC follow the protocol but lose sends and receptions (omission faults, which include fail-stop faults).

Algorithm 1 (Section 3.2.1) works as follows. Every processor keeps a set PROPER\mathrm{PROPER}PROPER, initially {init(p)}\{\mathrm{init}(p)\}{init(p)}, attaches it to every message, and merges in every PROPER set it receives. A processor may hold locks, each a value with an associated phase number; vvv is acceptable to ppp if ppp has no lock on a value other than vvv. Phase k≥1k \ge 1k≥1 belongs to pip_ipi​ when k≡i(modN)k \equiv i \pmod Nk≡i(modN). Trying phase kkk occupies rounds 4k−34k-34k−3, 4k−24k-24k−2, 4k−14k-14k−1:

  1. every processor sends the owner the list of its acceptable values that are in its PROPER set; the owner proposes, by an arbitrary choice, a value appearing in at least N−tN-tN−t of the lists received, if there is one;
  2. the owner broadcasts (lock v,k)(\mathrm{lock}\ v, k)(lock v,k); each receiver locks vvv with phase kkk;
  3. each receiver acknowledges; with at least t+1t+1t+1 acknowledgements the owner decides vvv.

Lock-release phase kkk is round 4k4k4k: every processor broadcasts its locks (v,h)(v,h)(v,h), and a lock on vvv with phase hhh is released on receipt of some (w,h′)(w,h')(w,h′) with w≠vw \ne vw=v and h′≥hh' \ge hh′≥h.

The correctness conditions (Section 2.4) for the set CCC are consistency (no two decisions of processors in CCC differ), termination (every processor in CCC decides), and strong unanimity (if all NNN initial values equal vvv, every decision in CCC is vvv).

Formalization targets

Goal: Theorem 3.1

For all N,tN, tN,t with N≥2t+1N \ge 2t+1N≥2t+1, every value type VVV, all initial values, every CCC with ∣C∣≥N−t|C| \ge N-t∣C∣≥N−t, every GST\mathrm{GST}GST, every delivery pattern allowed for CCC and GST\mathrm{GST}GST, and every admissible choice of proposals,

Algorithm 1 achievesConsistency(C) ∧ StrongUnanimity(C) ∧ Termination(C).\text{Algorithm 1 achieves}\quad \text{Consistency}(C)\ \wedge\ \text{StrongUnanimity}(C)\ \wedge\ \text{Termination}(C).Algorithm 1 achievesConsistency(C) ∧ StrongUnanimity(C) ∧ Termination(C).

This is the theorem as printed; it fixes no constants.

Milestones

  • Lemma 3.1: no two distinct values acquire locks with the same associated phase.
  • Lemma 3.2: if vvv is decided at the first phase kkk at which any decision is made, then at least t+1t+1t+1 processors lock vvv at phase kkk, and each keeps, from then on, a lock on vvv with phase at least kkk.
  • Lemma 3.3: immediately after a lock-release round 4k≥GST4k \ge \mathrm{GST}4k≥GST, the processors of CCC together hold locks on at most one value.
  • Round bound (Section 3.2.1, p. 298): every processor of CCC decides at some phase kkk with
4k−1≤GST+4(N+1).4k-1 \le \mathrm{GST} + 4(N+1).4k−1≤GST+4(N+1).

Significance

Theorem 3.1 shows that, against omission and fail-stop faults, partially synchronous communication costs nothing in resilience compared with a majority bound: N≥2t+1N \ge 2t+1N≥2t+1 suffices, and Section 4 of the paper shows that N≤2tN \le 2tN≤2t does not. The lock-and-release structure of Algorithm 1 (a value is decided only after a quorum locks it, and locks are released only on evidence of a later competing lock) recurs in later partially synchronous protocols, where safety must hold regardless of timing and liveness is obtained only after stabilization. The result separates the two concerns cleanly: consistency and strong unanimity hold in every run, while termination uses GST.

The result is proved in the paper; to the best of the available information it has not been formalized in Lean, and no distributed-computing model exists on Prove2Me. The mission produces a machine-checked model of the basic round model with a GST delivery guarantee, a full executable specification of Algorithm 1, and proofs of its safety and liveness. The paper's own proof of Lemma 3.3 is one line and the termination argument relies on "sufficient communication"; a formal proof must make these steps explicit.

Difficulty

The safety argument is an invariant over an unbounded number of phases with an arbitrary loss pattern: a lock on the decided value must be shown never to be released without being replaced by a higher lock on the same value, while competing locks on other values may exist at faulty or slow processors. The obvious argument ("after a decision, every later proposal must equal the decided value") is circular without a persistence statement for locks such as Lemma 3.2. Liveness requires reasoning about what every correct processor knows after GST (its PROPER set and the locks of the others), and it depends on processors sending lock-release and list messages even when these carry no locks or no acceptable values. Quorum counting with N−tN-tN−t and t+1t+1t+1 must be carried out over distinct senders.

Formalization scope

  • Processors are Fin N; the paper's pip_ipi​ is the processor of index i−1i-1i−1. Rounds start at 111; exec … 0 is the initial state and exec … r the state after round rrr. Phases start at 111.
  • The paper's "chooses one arbitrarily" is a parameter pick : ℕ → Set V → V, required only to pick an element of every nonempty candidate set, and universally quantified in every theorem.
  • The paper's "the behavior of the processors not in CCC is allowed by the fault type FFF" is read as: processors outside CCC run Algorithm 1, and any message from or to them may be lost (omission faults, containing fail-stop).
  • The GST guarantee covers a processor's messages to itself when it is in CCC; before GST self-messages may be lost like any other.
  • Every processor sends its list in round 4k−34k-34k−3 and its lock-release message in round 4k4k4k even when they are empty, since both carry the PROPER set (Section 3.2: PROPER sets are piggybacked on all messages).
  • A decision is the event DecidesAt p k v (owner of phase kkk, proposed vvv, at least t+1t+1t+1 acknowledgements in round 4k−14k-14k−1); consistency requires all such events of processors in CCC to agree.
  • "Decide by round GST+4(N+1)\mathrm{GST}+4(N+1)GST+4(N+1)" is read as: the deciding phase kkk satisfies 4k−1≤GST+4(N+1)4k-1 \le \mathrm{GST}+4(N+1)4k−1≤GST+4(N+1).
  • Not formalized: Remark 1's asymptotic claims, the PROPER simplifications for weak unanimity, Algorithms 2 and 3.

A formalization in which a run cannot exist, the delivery constraint is unsatisfiable, the choice of proposals is fixed, or faulty processors are absent (CCC = all processors) would trivialize the theorem; the model here admits runs in which processors decide, and CCC ranges over all sets of at least N−tN-tN−t processors.

Reusable beyond this mission: the round-based message-passing model with a GST delivery guarantee and omission faults. Contributions of general lemmas about runs (monotonicity of PROPER sets, persistence of locks, quorum intersection over Finset) are welcome.

Selected references

  • C. Dwork, N. Lynch, L. Stockmeyer, Consensus in the presence of partial synchrony, Journal of the ACM 35(2), 1988, 288–323. https://doi.org/10.1145/42282.42283
  • M. J. Fischer, N. A. Lynch, M. S. Paterson, Impossibility of distributed consensus with one faulty process, Journal of the ACM 32(2), 1985, 374–382. https://doi.org/10.1145/3149.214121
6 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 2: Every Convex Bipartite Order Has a Realizer of Size 3Research Paper

Motivation

The single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ asks for an order in which to process nnn jobs, each with a processing time and a weight, on one machine, respecting a partial order of precedence constraints, so that the weighted sum of completion times is as small as possible. It is NP-hard, and the best known approximation ratio for general precedence constraints is 222. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) relate the problem to the dimension theory of partial orders: their Theorem 3.2 states that when the precedence constraints are given together with a realizer of size kkk, the problem has a (2−2/k)(2 - 2/k)(2−2/k)-approximation algorithm. Small realizers of structured precedence orders therefore translate directly into better approximation ratios.

This mission formalizes one such structural result, Lemma 4.1 of the paper: every convex bipartite order has a realizer of size 333. Convex bipartite orders form a class of precedence constraints that lies strictly between strong bipartite orders and general bipartite orders (Möhring, 1989). Combined with Theorem 3.2, the lemma gives a 4/34/34/3-approximation for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ on this class. According to the authors, the bound dim⁡≤3\dim \le 3dim≤3 for convex bipartite orders had not been known before.

Setting

A poset is a set NNN with a reflexive, antisymmetric, transitive relation PPP. Two elements x,yx, yx,y are incomparable, written x∥yx \parallel yx∥y, when neither (x,y)∈P(x,y) \in P(x,y)∈P nor (y,x)∈P(y,x) \in P(y,x)∈P; the set of incomparable pairs is inc(P)\mathrm{inc}(P)inc(P). A linear extension of PPP is a linear order LLL on NNN with P⊆LP \subseteq LP⊆L. A linear order LLL reverses the pair (x,y)(x,y)(x,y) when y<xy < xy<x in LLL. A realizer of size ttt is a family L1,…,LtL_1, \dots, L_tL1​,…,Lt​ of linear extensions of PPP such that every incomparable pair (x,y)(x,y)(x,y) is reversed by at least one LiL_iLi​. The dimension dim⁡(P)\dim(P)dim(P) is the least ttt for which a realizer of size ttt exists.

A convex bipartite order has jobs N=J−∪J+N = J^- \cup J^+N=J−∪J+ split into minus jobs J−={j1,…,ja}J^- = \{j_1, \dots, j_a\}J−={j1​,…,ja​} and plus jobs J+={ja+1,…,jn}J^+ = \{j_{a+1}, \dots, j_n\}J+={ja+1​,…,jn​}. Each plus job jkj_kjk​ carries two indices 1≤l(k)≤r(k)≤a1 \le l(k) \le r(k) \le a1≤l(k)≤r(k)≤a, and a minus job jij_iji​ precedes jkj_kjk​ exactly when l(k)≤i≤r(k)l(k) \le i \le r(k)l(k)≤i≤r(k). There are no other precedences: the predecessors of each plus job form a nonempty interval of consecutive minus jobs.

For the Appendix construction, the incomparable pairs are sorted into three sets E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​ according to the kinds of the two jobs, the order of their indices and, for a pair (plus job jij_iji​, minus job jjj_jjj​), whether jjj_jjj​ precedes some plus job of larger index than iii. The sets Eˉm=Em∪P\bar E_m = E_m \cup PEˉm​=Em​∪P describe what the mmm-th linear order of the realizer must contain.

Formalization targets

Goal: Lemma 4.1

For every convex bipartite order (N,P):∃ L1,L2,L3 linear extensions of P with ∀(x,y)∈inc(P) ∃m: y<Lmx.\text{For every convex bipartite order } (N, P):\quad \exists\, L_1, L_2, L_3 \text{ linear extensions of } P \text{ with } \forall (x,y) \in \mathrm{inc}(P)\ \exists m:\ y <_{L_m} x .For every convex bipartite order (N,P):∃L1​,L2​,L3​ linear extensions of P with ∀(x,y)∈inc(P) ∃m: y<Lm​​x.

Equivalently, dim⁡(P)≤3\dim(P) \le 3dim(P)≤3. The goal holds for every numbering of the jobs and every choice of interval ends l,rl, rl,r.

Milestones

  • Lemma A.1. E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​ partition inc(P)\mathrm{inc}(P)inc(P), and for each mmm, (x,y)∈Em(x,y) \in E_m(x,y)∈Em​ implies (y,x)∉Em(y,x) \notin E_m(y,x)∈/Em​.
  • Lemma A.2. Under the Appendix's numbering of the plus jobs (i<ji < ji<j implies l(i)≤l(j)l(i) \le l(j)l(i)≤l(j)), each Eˉm\bar E_mEˉm​ is contained in a linear order on NNN.

Significance

The result. Lemma 4.1 places convex bipartite orders among the classes of precedence constraints for which 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_j C_j1∣prec∣∑wj​Cj​ has an approximation ratio strictly below 222, namely 4/34/34/3 through Theorem 3.2 of the paper. The bound is tight: a bipartite order has dimension 222 exactly when it is a strong bipartite order (Möhring), so the bound 333 cannot be lowered for the class of convex bipartite orders. Since dim⁡(P)=3\dim(P) = 3dim(P)=3 also gives χ(GP)=3\chi(G_P) = 3χ(GP​)=3 for the graph of incomparable pairs, a 333-realizer yields an optimal colouring of that graph.

Formalizing it. The result is proved in the paper, with a short case analysis in the Appendix. No machine-checked proof is known to exist. Mathlib has no dimension theory of posets: realizers, reversals of incomparable pairs and the construction of linear extensions containing a given acyclic relation have to be set up here. The definitions of realizer and linear extension are stated for an arbitrary relation and can be reused for other dimension bounds (interval orders, semiorders, the other missions of this series).

Difficulty

The three relations Eˉm\bar E_mEˉm​ are not partial orders. Eˉ2\bar E_2Eˉ2​, for instance, is not transitive: with two minus jobs and one plus job j3j_3j3​ with l(3)=r(3)=2l(3) = r(3) = 2l(3)=r(3)=2, the pairs (j1,j2)∈E2(j_1, j_2) \in E_2(j1​,j2​)∈E2​ and (j2,j3)∈P(j_2, j_3) \in P(j2​,j3​)∈P are present but (j1,j3)(j_1, j_3)(j1​,j3​) lies in E1E_1E1​. The step that requires work is to show that each Eˉm\bar E_mEˉm​ has no cycle, so that it extends to a linear order. For Eˉ2\bar E_2Eˉ2​ this depends on the convexity of the predecessor intervals and on the numbering of the plus jobs by their left ends: it is not a consequence of bipartiteness alone. The goal itself carries no numbering assumption, so any proof must also account for renumbering the plus jobs.

Formalization scope

All declarations live in the namespace SingleMachinePrec.ConvexBipartite.

  • Relations. A relation on NNN is a predicate N → N → Prop. Linear orders use Mathlib's unbundled class IsLinearOrder. A linear extension of PPP is a linear order LLL with P⊆LP \subseteq LP⊆L; LLL reverses (x,y)(x,y)(x,y) when L y xL\,y\,xLyx and y≠xy \ne xy=x. A realizer of size ttt is a function Fin t → N → N → Prop, so repeated members are allowed, as in the paper's multisets.
  • Convex bipartite orders. The jobs are the type Fin a ⊕ Fin b: Sum.inl i is the minus job ji+1j_{i+1}ji+1​, Sum.inr k the plus job ja+k+1j_{a+k+1}ja+k+1​, with indices starting at 000. The interval ends are maps l r : Fin b → Fin a with l k ≤ r k, and PPP is equality together with the pairs (minus iii, plus kkk) with l(k)≤i≤r(k)l(k) \le i \le r(k)l(k)≤i≤r(k). A file-level instance records that PPP is a partial order. Any convex bipartite order in the paper's sense is one of these after naming its jobs. The cases a=0a = 0a=0 and b=0b = 0b=0 are allowed.
  • E1,E2,E3E_1, E_2, E_3E1​,E2​,E3​. Each set is defined as "incomparable and satisfies the paper's case condition". In the plus–minus clauses, "k>ik > ik>i" compares plus indices, because kkk exceeds the index of a plus job.
  • Lemma A.2. "Eˉm\bar E_mEˉm​ is an extension of PPP" is formalized as "there is a linear order containing Eˉm\bar E_mEˉm​", which is what the paper's proof establishes (absence of cycles) and what its final paragraph uses. Reading it as "Eˉm\bar E_mEˉm​ is a partial order" would make the lemma false (see Difficulty). The Appendix's numbering assumption is the hypothesis Monotone l of this milestone only.
  • Algorithmic wording not formalized. The paper states Lemma 4.1 as "a realizer of size 3 can be computed in polynomial time". What is formalized is the existence of the realizer; the running time is not.

A trivializing formalization would let the members of the realizer be arbitrary relations, which makes reversing every pair free. Here every member must be a linear order containing PPP.

Contributions welcome: proofs of the two milestones and of the goal; a general lemma that a relation whose transitive closure is antisymmetric extends to a linear order on a finite type; and the renumbering argument that removes the numbering assumption.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • G. R. Brightwell, E. R. Scheinerman, Fractional dimension of partial orders, Order 9(2):139–158, 1992.
  • R. H. Möhring, Computationally tractable classes of ordered sets, in I. Rival (ed.), Algorithms and Order, NATO ASI Series 255, Kluwer, 1989, pp. 105–193.
  • W. T. Trotter, Combinatorics and Partially Ordered Sets: Dimension Theory, Johns Hopkins University Press, 1992.
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 6: The Optimal Value of S_G Lies Between n² − an²(ln 1/a + 2) and n² − an²Research Paper

Motivation

The problem 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ asks for a single-machine sequence of jobs, respecting precedence constraints, that minimizes the weighted sum of completion times. It has been known to be strongly NP-hard since Lawler (1978) and Lenstra and Rinnooy Kan (1978), several different 2-approximation algorithms are known, and closing the approximability gap is listed by Schuurman and Woeginger (1999) as one of ten outstanding open problems in scheduling theory. Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 36(4), 2011) give the first inapproximability result for this problem: under a widely believed complexity assumption it has no polynomial-time approximation scheme (PTAS). The bridge to that result is a quantitative link, Lemma 9.1, between the optimal value of a special bipartite scheduling instance and the maximum edge biclique of a bipartite graph, a problem whose hardness of approximation was established by Ambühl, Mastrolilli and Svensson (FOCS 2007). This mission formalizes that link.

Setting

A schedule of a finite job set is a sequence σ\sigmaσ listing every job once; the machine processes the jobs in that order from time 000 without idle time or pre-emption. Job jjj has a processing time pjp_jpj​ and a weight wjw_jwj​; its completion time CjC_jCj​ is the sum of the processing times of the jobs up to and including jjj, and the value of σ\sigmaσ is val(σ)=∑jwjCj\mathrm{val}(\sigma)=\sum_j w_jC_jval(σ)=∑j​wj​Cj​. Precedence constraints are a relation PPP on jobs: (i,j)∈P(i,j)\in P(i,j)∈P with i≠ji\ne ji=j means job iii must be completed before job jjj starts. A schedule respecting all of them is feasible, and a feasible schedule σ∗\sigma^*σ∗ of least value is optimal.

Let G=(U,V,E)G=(U,V,E)G=(U,V,E) be an nnn-by-nnn bipartite graph: ∣U∣=∣V∣=n|U|=|V|=n∣U∣=∣V∣=n and E⊆U×VE\subseteq U\times VE⊆U×V. An edge biclique is a pair A⊆UA\subseteq UA⊆U, B⊆VB\subseteq VB⊆V with A×B⊆EA\times B\subseteq EA×B⊆E, of value ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣; the maximum edge biclique problem (Definition 9.1) asks for one of largest value. The bipartite scheduling instance SGS_GSG​ has jobs U∪VU\cup VU∪V and precedence constraints

P=(U×V)∖E,P=(U\times V)\setminus E,P=(U×V)∖E,

so u∈Uu\in Uu∈U must precede v∈Vv\in Vv∈V exactly when (u,v)(u,v)(u,v) is not an edge. Jobs of UUU have p=1p=1p=1, w=0w=0w=0; jobs of VVV have p=0p=0p=0, w=1w=1w=1. Thus val(σ)=∑v∈VCv\mathrm{val}(\sigma)=\sum_{v\in V}C_vval(σ)=∑v∈V​Cv​, where CvC_vCv​ is the number of UUU-jobs scheduled before vvv. For i≥1i\ge1i≥1, σ(i)\sigma(i)σ(i) denotes the number of VVV-jobs scheduled before iii jobs of UUU have been scheduled.

In the Lean development these are weightedCompletion, IsOptimalSchedule, IsEdgeBiclique, maxBicliqueValue, precSG, procSG, weightSG, valSG, IsOptimalSG and vBefore in the namespace SingleMachinePrec.Biclique.

Formalization targets

Goal: Lemma 9.1 (p. 666)

If a maximum edge biclique of GGG has value an2an^2an2 with a∈(0,1]a\in(0,1]a∈(0,1], then SGS_GSG​ has an optimal schedule and every optimal schedule σ∗\sigma^*σ∗ satisfies

n2−an2(ln⁡1a+2)≤val(σ∗)≤n2−an2.n^2-an^2\Bigl(\ln\frac1a+2\Bigr)\le\mathrm{val}(\sigma^*)\le n^2-an^2 .n2−an2(lna1​+2)≤val(σ∗)≤n2−an2.

Milestones (proof of Lemma 9.1, §9, p. 666)

  1. For every edge biclique (A,B)(A,B)(A,B), a schedule in the block order U∖A→B→A→V∖BU\setminus A\to B\to A\to V\setminus BU∖A→B→A→V∖B exists, and every such schedule is feasible with
val(σ)=n2−∣A∣⋅∣B∣.\mathrm{val}(\sigma)=n^2-|A|\cdot|B| .val(σ)=n2−∣A∣⋅∣B∣.
  1. For every schedule, σ(n+1)=n\sigma(n+1)=nσ(n+1)=n and
val(σ)=∑i=1n(σ(i+1)−σ(i))i=n2−∑i=1nσ(i).\mathrm{val}(\sigma)=\sum_{i=1}^n\bigl(\sigma(i+1)-\sigma(i)\bigr)i=n^2-\sum_{i=1}^n\sigma(i).val(σ)=i=1∑n​(σ(i+1)−σ(i))i=n2−i=1∑n​σ(i).
  1. For every feasible schedule and i=1,…,ni=1,\dots,ni=1,…,n,
σ(i)(n−i+1)≤an2,σ(i)≤n.\sigma(i)(n-i+1)\le an^2,\qquad \sigma(i)\le n .σ(i)(n−i+1)≤an2,σ(i)≤n.

Significance

Lemma 9.1 shows that the optimal value of SGS_GSG​ determines the maximum edge biclique of GGG up to a factor of order ln⁡(1/a)\ln(1/a)ln(1/a) in the "area above the work line" n2−val(σ∗)n^2-\mathrm{val}(\sigma^*)n2−val(σ∗). Combined with the hardness of approximating maximum edge biclique (Theorem 9.1, cited from Ambühl, Mastrolilli and Svensson 2007) it yields Theorem 9.2: 1 ∣ prec ∣ ∑wjCj1\,|\,\mathrm{prec}\,|\,\sum w_jC_j1∣prec∣∑wj​Cj​ has no PTAS unless SAT can be decided by a probabilistic algorithm in time 2Nϵ2^{N^\epsilon}2Nϵ for every ϵ>0\epsilon>0ϵ>0. It also makes precise the two-dimensional Gantt chart picture of Eastman, Even and Isaacs (1964) and of Goemans and Williamson (2000), in which every point on the work line of a schedule defines an edge biclique.

The lemma is proved in the paper; it is not formalized anywhere to our knowledge. A formal proof certifies the combinatorial core of the no-PTAS result independently of the complexity-theoretic layer, and its definitions (the bipartite instance SGS_GSG​, edge bicliques, the profile σ(i)\sigma(i)σ(i)) are reusable for the gap inequality behind Theorem 9.2.

Difficulty

The upper bound is a direct computation on one explicit schedule. The lower bound is a statement about every feasible schedule, of which there are exponentially many, and it must hold with the explicit constant 222 and the factor ln⁡(1/a)\ln(1/a)ln(1/a) for every a∈(0,1]a\in(0,1]a∈(0,1]. The printed argument splits the sum at i=(1−a)ni=(1-a)ni=(1−a)n and uses ⌊an⌋\lfloor an\rfloor⌊an⌋, treating ananan as an integer; for general aaa (for example n=3n=3n=3, value 222, an=2/3an=2/3an=2/3) the split point is not an integer, so the printed estimate does not apply verbatim and the constant 222 has to be re-checked for non-integral ananan. On the formal side, the value identity requires relating completion times in a list to counting UUU-jobs before each VVV-job, with ties among zero-length jobs.

Formalization scope

Jobs are the disjoint union U ⊕ V of two finite types with Fintype.card U = Fintype.card V = n; EEE is a relation U → V → Prop. A schedule is a duplicate-free list containing every job; feasibility is the published LawlerPrec.MinMax.IsFeasible and completion times are the published MooreLateJobs.Shared.completionTime (time 000 start, no idle time). Processing times and weights are reals, here in {0,1}\{0,1\}{0,1}. The maximum edge biclique value is the maximum of ∣A∣⋅∣B∣|A|\cdot|B|∣A∣⋅∣B∣ over all edge bicliques, the empty ones included, so the hypothesis a>0a>0a>0 means E≠∅E\ne\emptysetE=∅. The logarithm is natural (Real.log).

Conventions and readings committed to:

  • The goal is stated for every optimal schedule, and the existence of an optimal schedule is a separate conclusion, so the bounds cannot hold vacuously. Proving the bounds for one particular schedule, or for an optimal value defined as an infimum that could be a junk default, would not be this lemma.
  • No integrality hypothesis on ananan is added.
  • Milestones 2 and 3 are stated for every schedule (respectively every feasible schedule), not only for σ∗\sigma^*σ∗; milestone 1 states the value of the block-order schedule as an equality, where the paper writes "≤⋯=\le\cdots=≤⋯=".
  • The paper's P=(U×V)∖EP=(U\times V)\setminus EP=(U×V)∖E is irreflexive; feasibility only constrains distinct jobs, so it agrees with the reflexive partial order of §1.

Not formalized: Theorem 9.1 (cited hardness of maximum edge biclique) and Theorem 9.2 (no PTAS under a complexity assumption); no polynomial-time or complexity-theoretic statement appears in the mission. Contributions welcome: proofs of the three milestones and of the goal; Mathlib's bounds on harmonic numbers (Mathlib/NumberTheory/Harmonic/Bounds.lean) are the relevant library.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, O. Svensson, Inapproximability results for sparsest cut, optimal linear arrangement, and precedence constraint scheduling, Proc. 48th IEEE FOCS, 329–337, 2007 (reference [4] of the paper).
  • W. L. Eastman, S. Even, I. M. Isaacs, Bounds for the optimal scheduling of n jobs on m processors, Management Science 11(2):268–279, 1964 (reference [11]).
  • M. X. Goemans, D. P. Williamson, Two-dimensional Gantt charts and a scheduling algorithm of Lawler, SIAM J. Discrete Math. 13(3):281–294, 2000 (reference [15]).
  • P. Schuurman, G. J. Woeginger, Polynomial time approximation algorithms for machine scheduling: ten open problems, J. Scheduling 2(5):203–213, 1999 (reference [36]).
8 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 4: Vertex Cover in Connected Graphs of Degree ≤ 3 Reduces to Weighted Vertex Cover for Interval-Order InstancesResearch Paper

Motivation

In the single-machine scheduling problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​, a set NNN of nnn jobs, each with a processing time pj≥0p_j\ge 0pj​≥0 and a weight wj≥0w_j\ge 0wj​≥0, is processed on one machine without interruption, subject to precedence constraints given by a partial order PPP on NNN. The aim is to minimize the weighted sum of completion times ∑jwjCj\sum_j w_jC_j∑j​wj​Cj​. The problem is strongly NP-hard for general precedence constraints (Lawler 1978; Lenstra and Rinnooy Kan 1978), and its approximability was a recurring open question in scheduling theory (Schuurman and Woeginger 1999).

A line of work by Chudak and Hochbaum, Correa and Schulz, and Ambühl and Mastrolilli showed that the problem is a special case of minimum weighted vertex cover in a graph GPSG^S_PGPS​ built from the instance. Many problems on partial orders become polynomial when the order is an interval order, so it is natural to ask whether this one does too. Section 7 of Ambühl, Mastrolilli, Mutsanas and Svensson (Math. Oper. Res. 2011) answers no: the problem stays NP-hard on interval orders. The proof is a reduction from vertex cover in connected graphs of maximum degree 3. This mission formalizes the correctness of that reduction.

Setting

A poset P=(N,P)P=(N,P)P=(N,P) is read as a reflexive relation: (x,y)∈P(x,y)\in P(x,y)∈P means x≤yx\le yx≤y. Jobs x,yx,yx,y are incomparable if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) is in PPP, and inc⁡(P)\operatorname{inc}(P)inc(P) is the set of ordered incomparable pairs. The vertex cover graph GPSG^S_PGPS​ has one node (i,j)(i,j)(i,j) for each incomparable pair, weighted piwjp_iw_jpi​wj​. Two nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent if j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P and (k,j)∈P(k,j)\in P(k,j)∈P. Write w(CI)w(C_I)w(CI​) for the minimum weight of a vertex cover of GISG^S_IGIS​.

A poset is an interval order if each element xxx can be assigned a closed real interval [ax,bx][a_x,b_x][ax​,bx​] such that x<yx<yx<y if and only if bx<ayb_x<a_ybx​<ay​.

The reduction starts from a graph G=(V,E)G=(V,E)G=(V,E) with vertices v1,…,vNv_1,\dots,v_Nv1​,…,vN​ and a spanning tree T=(V,ET)T=(V,E_T)T=(V,ET​) rooted at v1v_1v1​, numbered so that each parent comes before its children. The paper uses a breadth-first search tree.

  • Stage 1. The graph G′G'G′ is built from TTT. Each viv_ivi​ gets a pendant path vi−u1i−u2iv_i - u^i_1 - u^i_2vi​−u1i​−u2i​. Each non-tree edge {vi,vj}∈E∖ET\{v_i,v_j\}\in E\setminus E_T{vi​,vj​}∈E∖ET​ with i<ji<ji<j gets the path vi−e1ij−e2ij−u2jv_i - e^{ij}_1 - e^{ij}_2 - u^j_2vi​−e1ij​−e2ij​−u2j​. The non-tree edges themselves are not edges of G′G'G′.
  • Stage 2. The scheduling instance SSS has jobs s0s_0s0​, s1,…,sNs_1,\dots,s_Ns1​,…,sN​, m1,…,mNm_1,\dots,m_Nm1​,…,mN​, e1,…,eNe_1,\dots,e_Ne1​,…,eN​, and bijb_{ij}bij​ for each non-tree edge. Their intervals, processing times and weights are given in a table on p. 662. For example, sjs_jsj​ has interval [i,j][i,j][i,j], processing time 1/kj1/k^j1/kj and weight kik^iki, where viv_ivi​ is the parent of vjv_jvj​. The precedence constraints III are the interval order of these intervals. With nnn the number of jobs, the parameter is k=n2+1k=n^2+1k=n2+1.
  • The set DDD. It is {(s0,s1)}∪{(si,sj):vi parent of vj}∪{(si,mi),(mi,ei)}∪{(si,bij),(bij,mj)}\{(s_0,s_1)\}\cup\{(s_i,s_j): v_i \text{ parent of } v_j\}\cup\{(s_i,m_i),(m_i,e_i)\}\cup\{(s_i,b_{ij}),(b_{ij},m_j)\}{(s0​,s1​)}∪{(si​,sj​):vi​ parent of vj​}∪{(si​,mi​),(mi​,ei​)}∪{(si​,bij​),(bij​,mj​)}. The graph GI′G'_IGI′​ is the subgraph of GISG^S_IGIS​ induced by DDD.

Formalization targets

Goal: Theorem 7.1 (p. 661)

For every connected graph GGG of maximum degree at most 333, every parent-first spanning tree TTT and every m∈Nm\in\mathbb Nm∈N, the precedence constraints III of SSS form an interval order, and

G has a vertex cover of size≤m  ⟺  ⌊w(CI)⌋≤m+∣V∣+∣E∖ET∣.G \text{ has a vertex cover of size} \le m \iff \lfloor w(C_I)\rfloor \le m + |V| + |E\setminus E_T|.G has a vertex cover of size≤m⟺⌊w(CI​)⌋≤m+∣V∣+∣E∖ET​∣.

Milestones, in the order the proof uses them

  • Claim 1 (p. 662): τ(G′)=τ(G)+∣V∣+∣E∖ET∣\tau(G') = \tau(G)+|V|+|E\setminus E_T|τ(G′)=τ(G)+∣V∣+∣E∖ET​∣, where τ\tauτ is the vertex cover number.
  • Remark 7.1 (p. 662): for jobs with intervals [a,b][a,b][a,b] and [c,d][c,d][c,d] and a≤da\le da≤d, pi≤1/k⌈b⌉p_i\le 1/k^{\lceil b\rceil}pi​≤1/k⌈b⌉ and wj≤k⌈c⌉w_j\le k^{\lceil c\rceil}wj​≤k⌈c⌉. On incomparable pairs piwj∈{1}∪[0,1/k]p_iw_j\in\{1\}\cup[0,1/k]pi​wj​∈{1}∪[0,1/k]. Moreover, piwj≥kp_iw_j\ge kpi​wj​≥k forces b<cb<cb<c, and piwj=1p_iw_j=1pi​wj​=1 forces ⌈b⌉=⌈c⌉\lceil b\rceil=\lceil c\rceil⌈b⌉=⌈c⌉.
  • Claim 2 (p. 663): an incomparable pair (i,j)(i,j)(i,j) has piwj=1p_iw_j=1pi​wj​=1 if it is in DDD, and piwj≤1/kp_iw_j\le 1/kpi​wj​≤1/k otherwise.
  • Claim 3 (p. 663): GI′≅G′G'_I\cong G'GI′​≅G′.
  • §7, p. 664: with k=n2+1k=n^2+1k=n2+1, ∑(i,j)∈inc⁡(I)∖Dpiwj<1\sum_{(i,j)\in\operatorname{inc}(I)\setminus D}p_iw_j<1∑(i,j)∈inc(I)∖D​pi​wj​<1, and hence w(CI′)=⌊w(CI)⌋w(C'_I)=\lfloor w(C_I)\rfloorw(CI′​)=⌊w(CI​)⌋.

Significance

The result. Interval orders are a standard tractable class: several scheduling and order-theoretic problems that are hard in general become polynomial on them (Papadimitriou and Yannakakis 1979). Theorem 7.1 puts 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ outside this pattern. Section 6 of the same paper shows that the problem nonetheless has a 3/23/23/2-approximation on interval orders, so hardness and approximability are separated on this class. The paper also remarks that the proof makes weighted vertex cover NP-hard to approximate within some factor r>1r>1r>1 on the graphs GISG^S_IGIS​ arising from interval orders.

Formalizing it. The theorem is proved in the paper. Nothing in this mission is open, and none of it has been machine-checked before. The work splits into the following parts:

  • a gadget argument on unweighted vertex covers (Claim 1, after Alimonti and Kann);
  • an exact case analysis of incomparable pairs in a concrete interval order (Remark 7.1, Claim 2);
  • a graph isomorphism (Claim 3);
  • a rounding argument that links weighted and unweighted optima.

The definitions of GPSG^S_PGPS​ and of minimum-weight vertex covers are shared with the other missions of this series.

Difficulty

The construction is explicit, and each step is elementary. The work is in the bookkeeping. Claim 2 requires classifying every incomparable pair of jobs, including pairs of different kinds such as (bij,sℓ)(b_{ij}, s_\ell)(bij​,sℓ​), by comparing ceilings of interval endpoints. Half-integer endpoints (mim_imi​, bijb_{ij}bij​) are exactly what separates weight-one pairs from comparable ones. Claim 3 requires checking adjacency in GISG^S_IGIS​ for all pairs of nodes of DDD in both directions. The paper writes out two cases in each direction and calls the rest similar.

Claim 1 has a direction that is not simply local. A vertex cover of G′G'G′ that misses both endpoints of a non-tree edge has to be repaired by swapping gadget vertices, and the repair must be repeated without increasing the size.

A natural first idea is to treat the light nodes (weight at most 1/k1/k1/k) as negligible one at a time. This does not suffice: the argument needs their total weight to stay below 111, which is what forces kkk to grow with n2n^2n2.

Formalization scope

  • Graph and tree. GGG is a SimpleGraph (Fin N); vertex vi+1v_{i+1}vi+1​ is i, and the root is index 0. The tree is a TreeLayout: a parent function returning none exactly at the root, with each parent of smaller index and adjacent in GGG. The statements hold for every such layout. This is stronger than the paper's breadth-first tree, and the proof uses only "parent before child".
  • Hypotheses of the goal. Connectivity and the degree bound ((G.neighborSet v).ncard ≤ 3) are kept as in the paper. They matter only for the NP-completeness of the source problem.
  • Jobs. The jobs form an inductive type with one constructor per row of the table. Their order is a PartialOrder instance: x≤yx\le yx≤y iff x=yx=yx=y or bx<ayb_x<a_ybx​<ay​. Processing times and weights are real numbers. Section 1 of the paper asks for nonnegative integers, but the instance uses 1/kj1/k^j1/kj and the formalization follows the instance as printed.
  • Constants. The constants are explicit: k=n2+1k=n^2+1k=n2+1 with nnn the cardinality of the job type, and c=∣V∣+∣E∖ET∣c=|V|+|E\setminus E_T|c=∣V∣+∣E∖ET​∣. Remark 7.1 and Claim 2 are stated for every real k>1k>1k>1.
  • Optimum values. w(CI)w(C_I)w(CI​) is a minimum over the finite family of vertex covers. Unweighted cover numbers are Mathlib's SimpleGraph.vertexCoverNum. The floor is Nat.floor, which agrees with the integer floor because w(CI)≥0w(C_I)\ge 0w(CI​)≥0.
  • Not formalized. The goal's wording ("NP-hard") is not formalized. Neither are the NP-completeness of degree-3 vertex cover (Garey, Johnson and Stockmeyer), the polynomial size of the construction, or Theorem 2.1 (cited), which turns a vertex cover of GISG^S_IGIS​ into a schedule. What is stated is the correctness of the reduction: the instance has interval-order constraints, and its optimum decides the vertex cover question.
  • No trivialization. The instance SSS is built from GGG and TTT exactly as in the table. The goal quantifies over all graphs and layouts, never over an instance SSS assumed to have the properties.
  • Contributions. Contributions are welcome on any milestone. Claims 1 and 3 are independent of the weights, and Claim 2 is independent of the graph theory.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Math. Oper. Res. 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • C. Ambühl, M. Mastrolilli, Single machine precedence constrained scheduling is a vertex cover problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-1
  • J. R. Correa, A. S. Schulz, Single machine scheduling with precedence constraints, Math. Oper. Res. 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • P. Alimonti, V. Kann, Some APX-completeness results for cubic graphs, Theoret. Comput. Sci. 237(1–2):123–134, 2000. https://doi.org/10.1016/S0304-3975(98)00158-3
  • M. R. Garey, D. S. Johnson, L. Stockmeyer, Some simplified NP-complete graph problems, Theoret. Comput. Sci. 1(3):237–267, 1976. https://doi.org/10.1016/0304-3975(76)90059-1
  • C. H. Papadimitriou, M. Yannakakis, Scheduling interval-ordered tasks, SIAM J. Comput. 8(3):405–409, 1979. https://doi.org/10.1137/0208031
10 thms2 active usersReviewed
🏆Completed
Graph TheoryOperations Research·Captain: mikedeng1

On the Approximability of Single-Machine Scheduling with Precedence Constraints 5: An r-Approximate Vertex Cover of the Variable-Cost Graph Yields an (r + ε)-Approximate Vertex Cover of GResearch Paper

Why the variable cost matters

The problem 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ asks for an order in which to process jobs on one machine, respecting precedence constraints, so as to minimize the weighted sum of completion times. It is strongly NP-hard, and for decades the best approximation ratio known has been 222, achieved by several unrelated algorithms (LP relaxations, Sidney decompositions, primal–dual methods).

Correa and Schulz (2005) and Ambühl and Mastrolilli (2009) showed that the problem is a special case of weighted vertex cover: its objective splits into a fixed cost, the same for every feasible solution, and a variable cost, which equals the weight of a vertex cover in an auxiliary graph GPSG^S_{\mathbf P}GPS​. Approximating vertex cover in GPSG^S_{\mathbf P}GPS​ within a factor α\alphaα therefore approximates the scheduling problem within α\alphaα. Uhan observed that the classical 2-approximations owe their guarantee to the fixed cost and can be arbitrarily bad on the variable cost alone.

Section 8 of Ambühl, Mastrolilli, Mutsanas and Svensson, Math. Oper. Res. 36(4) (2011) (DOI), proves the converse: approximating the variable cost is as hard as approximating vertex cover itself. A better-than-2 algorithm for 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ must therefore either exploit the fixed cost or improve on the best known approximation for vertex cover, a long-standing open question.

Setting

Scheduling instance. A finite set NNN of jobs, a partial order P=(N,P)\mathbf P = (N,P)P=(N,P) (reflexive; (i,j)∈P(i,j) \in P(i,j)∈P, i≠ji \ne ji=j, means iii precedes jjj), processing times pj≥0p_j \ge 0pj​≥0 and weights wj≥0w_j \ge 0wj​≥0.

Incomparable pairs. Jobs x,yx,yx,y are incomparable, x∥yx \parallel yx∥y, if neither (x,y)(x,y)(x,y) nor (y,x)(y,x)(y,x) lies in PPP. The set inc⁡(P)\operatorname{inc}(\mathbf P)inc(P) consists of the ordered pairs (x,y)(x,y)(x,y) with x∥yx \parallel yx∥y.

The vertex cover graph GPSG^S_{\mathbf P}GPS​. One node per incomparable pair (i,j)(i,j)(i,j), of weight w(i,j)=piwjw_{(i,j)} = p_i w_jw(i,j)​=pi​wj​. Distinct nodes (i,j)(i,j)(i,j) and (k,ℓ)(k,\ell)(k,ℓ) are adjacent when, in one of the two orders, j=kj=kj=k and i=ℓi=\elli=ℓ, or j=kj=kj=k and (i,ℓ)∈P(i,\ell)\in P(i,ℓ)∈P, or (i,ℓ),(k,j)∈P(i,\ell),(k,j) \in P(i,ℓ),(k,j)∈P. For a set CCC of nodes, w(C)=∑u∈Cwuw(C) = \sum_{u\in C} w_uw(C)=∑u∈C​wu​; for a vertex cover CCC this is the variable cost, and τw(GPS)\tau_w(G^S_{\mathbf P})τw​(GPS​) is its minimum over all vertex covers.

The instance S(G,k)S(G,k)S(G,k). Given a graph G=(V,E)G=(V,E)G=(V,E) with V={v1,…,vn}V = \{v_1,\dots,v_n\}V={v1​,…,vn​} and k>0k > 0k>0, the instance has jobs vi′v'_ivi′​ (processing time k−ik^{-i}k−i, weight 000) and vi′′v''_ivi′′​ (processing time 000, weight kik^{i}ki), and precedence constraints vi′<vj′′v'_i < v''_jvi′​<vj′′​ and vj′<vi′′v'_j < v''_ivj′​<vi′′​ for each edge {vi,vj}∈E\{v_i,v_j\} \in E{vi​,vj​}∈E, plus vi′<vj′′v'_i < v''_jvi′​<vj′′​ for all i<ji<ji<j. The nodes (vi′,vi′′)(v'_i, v''_i)(vi′​,vi′′​) of GPSG^S_{\mathbf P}GPS​ have weight 111 and are called heavy; all others are light. For a set CCC of nodes, CG={vi:(vi′,vi′′)∈C}C_G = \{v_i : (v'_i,v''_i)\in C\}CG​={vi​:(vi′​,vi′′​)∈C}. The vertex cover number of GGG is τ(G)\tau(G)τ(G).

Formalization targets

Goal: Theorem 8.1

For every graph GGG on nnn vertices, every r≥1r \ge 1r≥1, ε>0\varepsilon>0ε>0 and every k≥1k \ge 1k≥1 with k>n2r/εk > n^2r/\varepsilonk>n2r/ε: if CCC is a vertex cover of GPSG^S_{\mathbf P}GPS​ for S=S(G,k)S = S(G,k)S=S(G,k) with w(C)≤r τw(GPS)w(C) \le r\,\tau_w(G^S_{\mathbf P})w(C)≤rτw​(GPS​), then CGC_GCG​ is a vertex cover of GGG,

∣CG∣≤r(τ(G)+n2k),|C_G| \le r\Bigl(\tau(G) + \frac{n^2}{k}\Bigr),∣CG​∣≤r(τ(G)+kn2​),

and, when E≠∅E \ne \emptysetE=∅,

∣CG∣≤r(1+n2k)τ(G)<(r+ε) τ(G).|C_G| \le r\Bigl(1+\frac{n^2}{k}\Bigr)\tau(G) < (r+\varepsilon)\,\tau(G).∣CG​∣≤r(1+kn2​)τ(G)<(r+ε)τ(G).

The paper words the theorem as "approximating the variable cost of 1∣prec∣∑wjCj1|\mathrm{prec}|\sum w_jC_j1∣prec∣∑wj​Cj​ is as hard as approximating vertex cover"; the statement above is the mathematical content its proof establishes.

Milestones (§8, p. 664)

  1. In GPSG^S_{\mathbf P}GPS​, every heavy node has weight 111, every light node has weight at most 1/k1/k1/k, and the light nodes have total weight at most n2/kn^2/kn2/k (for k≥1k \ge 1k≥1).
  2. Heavy nodes (vi′,vi′′)(v'_i,v''_i)(vi′​,vi′′​) and (vj′,vj′′)(v'_j,v''_j)(vj′​,vj′′​) are adjacent if and only if {vi,vj}∈E\{v_i,v_j\}\in E{vi​,vj​}∈E; for k>1k>1k>1 the subgraph induced by the weight-1 nodes is isomorphic to GGG via (vi′,vi′′)↦vi(v'_i,v''_i) \mapsto v_i(vi′​,vi′′​)↦vi​.

Significance

The result. Theorem 8.1 is one half of an equivalence: by Theorem 2.1 (Correa–Schulz, Ambühl–Mastrolilli), minimizing the variable cost is a special case of weighted vertex cover; by Theorem 8.1, it is also as hard to approximate. Any hardness of approximation for vertex cover (NP-hardness of factor 1.361.361.36 by Dinur and Safra; factor 2−δ2-\delta2−δ under the unique games conjecture by Khot and Regev) transfers to the variable cost. It also explains why the known 2-approximations must rely on the fixed cost, and it frames the later result of Bansal and Khot that the full objective is hard to approximate within 2−δ2-\delta2−δ under a variant of the unique games conjecture.

Formalizing it. The theorem is proved in the paper; no machine-checked version exists. The mission produces a checked account of the reduction: the vertex cover graph of an arbitrary precedence-constrained instance, the adjacency-poset instance built from a graph, and the quantitative transfer of approximation ratios. The definition of GPSG^S_{\mathbf P}GPS​ is shared with the other missions of this series.

Difficulty

The construction is short; the care is in the bookkeeping. One must check that the precedence relation is a partial order, determine exactly which ordered pairs are incomparable, verify that two heavy nodes are adjacent only through the third clause of the adjacency rule and only when the corresponding vertices are adjacent in GGG, and bound the weights of all remaining nodes, including the many nodes of weight 000. The transfer then compares an approximate cover of GPSG^S_{\mathbf P}GPS​ with an optimal one whose heavy part comes from an optimal cover of GGG; the additive error n2/kn^2/kn2/k must be converted into a multiplicative one, which requires τ(G)≥1\tau(G)\ge 1τ(G)≥1.

A first reading of the page suggests that GPSG^S_{\mathbf P}GPS​ has at most n2n^2n2 nodes; it does not. The pairs (vi′,vj′)(v'_i,v'_j)(vi′​,vj′​) and (vi′′,vj′′)(v''_i,v''_j)(vi′′​,vj′′​) with i≠ji\ne ji=j are incomparable nodes of weight 000, so there can be up to 4n2−2n4n^2-2n4n2−2n nodes. Only nodes of positive weight are few.

Formalization scope

  • Model. Jobs form a finite type; precedence constraints are an explicit reflexive partial-order relation P : N → N → Prop. Processing times and weights are nonnegative reals. The vertex cover graph is a SimpleGraph on the subtype of incomparable ordered pairs, using the symmetric closure of the printed adjacency rule without loops. Vertex covers are Mathlib's SimpleGraph.IsVertexCover; τ(G)\tau(G)τ(G) is Mathlib's vertexCoverNum, finite for a finite graph and converted with toNat; τw(GPS)\tau_w(G^S_{\mathbf P})τw​(GPS​) is a minimum over finite vertex covers.
  • The instance. The graph is a SimpleGraph (Fin n); i : Fin n stands for vi+1v_{i+1}vi+1​, so exponents are i+1i+1i+1 and the order i<ji<ji<j is that of Fin n. Jobs are Fin n ⊕ Fin n (v′v'v′ left, v′′v''v′′ right). The parameter kkk is in R≥0\mathbb R_{\ge 0}R≥0​.
  • Added hypotheses. k≥1k \ge 1k≥1, implicit in the page ("k>n2r/εk > n^2r/\varepsilonk>n2r/ε" does not imply it when ε\varepsilonε is large, and for k<1k<1k<1 the light nodes outweigh the heavy ones). The isomorphism with GGG is stated for k>1k > 1k>1, since at k=1k=1k=1 some light nodes also have weight 111. The multiplicative bound requires E≠∅E \ne \emptysetE=∅; the additive bound holds for every graph.
  • Not formalized. The phrases "approximation algorithm", "polynomial time" and "as hard as"; the passage from vertex covers of GPSG^S_{\mathbf P}GPS​ to schedules (Theorem 2.1, cited from Correa–Schulz and Ambühl–Mastrolilli); the fixed cost. What is stated instead is the explicit map C↦CGC \mapsto C_GC↦CG​ and the ratio it achieves, r(1+n2/k)<r+εr(1+n^2/k) < r+\varepsilonr(1+n2/k)<r+ε. The false count "at most n2n^2n2 vertices" is not stated.
  • Ruled out. The goal is not a statement about an arbitrary graph or an assumed cover of GGG: it concerns the specific instance S(G,k)S(G,k)S(G,k) and every CCC that is an rrr-approximate vertex cover of its graph, and the fact that CGC_GCG​ covers GGG is a conclusion, not a hypothesis.
  • Welcome contributions. Proofs of the two milestones and of the goal; general lemmas on GPSG^S_{\mathbf P}GPS​ (weights of vertex covers, behaviour under induced subgraphs) are reusable across the series.

Selected references

  • C. Ambühl, M. Mastrolilli, N. Mutsanas, O. Svensson, On the Approximability of Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 36(4):653–669, 2011. https://doi.org/10.1287/moor.1110.0512
  • J. R. Correa, A. S. Schulz, Single-Machine Scheduling with Precedence Constraints, Mathematics of Operations Research 30(4):1005–1021, 2005. https://doi.org/10.1287/moor.1050.0158
  • C. Ambühl, M. Mastrolilli, Single Machine Precedence Constrained Scheduling Is a Vertex Cover Problem, Algorithmica 53(4):488–503, 2009. https://doi.org/10.1007/s00453-008-9251-6
  • I. Dinur, S. Safra, On the Hardness of Approximating Minimum Vertex Cover, Annals of Mathematics 162(1):439–485, 2005. https://doi.org/10.4007/annals.2005.162.439
  • S. Khot, O. Regev, Vertex Cover Might Be Hard to Approximate to within 2 − ε, Journal of Computer and System Sciences 74(3):335–349, 2008. https://doi.org/10.1016/j.jcss.2007.06.019
  • N. Bansal, S. Khot, Optimal Long Code Test with One Free Bit, FOCS 2009, 453–462. https://doi.org/10.1109/FOCS.2009.23
5 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments I: Revenue-Ordered Assortments Earn OPT/(1 + ln(r_k/r_1)) Under Any Regular Choice ModelResearch Paper

Motivation

A retailer, an airline or an online platform decides which products to show a customer. Showing more is not always better: a customer who would have bought an expensive product may switch to a cheap one once it is offered. The assortment problem asks for the set of products that maximises expected revenue, given a model of how customers choose. It is a central problem of revenue management (Talluri and van Ryzin, 2004), and it is NP-hard even for mixtures of two multinomial logit models (Rusmevichientong, Shmoys, Tong and Topaloglu, 2014).

The standard heuristic in practice is revenue-ordered assortments: sort the products by price and only consider the sets consisting of the most expensive products down to some threshold. It is optimal under the multinomial logit model (Talluri and van Ryzin, 2004), but not in general. Berbeglia and Joret (arXiv:1606.01371) ask how much revenue the heuristic can lose under every reasonable choice model, and answer with guarantees that depend only on the prices.

Timeline:

  • 2004: Talluri and van Ryzin prove revenue-ordered assortments optimal under the multinomial logit model.
  • 2014: Rusmevichientong et al. show NP-hardness of the assortment problem for mixtures of logits, and prove that revenue-ordered assortments earn at least OPT/(e(1+ln⁡(rk/r1)))\mathrm{OPT}/(e(1+\ln(r_k/r_1)))OPT/(e(1+ln(rk​/r1​))) under mixed logit models.
  • 2016–2019: Berbeglia and Joret prove the guarantees 1/k1/k1/k and 1/(1+ln⁡(rk/r1))1/(1+\ln(r_k/r_1))1/(1+ln(rk​/r1​)) under any regular choice model and show them tight (arXiv v1 2016, v3 2019; Algorithmica 2020). Aouad, Farias, Levi and Segev (2018) show that under random utility models no efficient algorithm does essentially better than these ratios.

Setting

There is a finite nonempty set C\mathcal CC of products. For a choice set S⊆CS\subseteq\mathcal CS⊆C, P(x,S)\mathcal P(x,S)P(x,S) is the probability that a customer offered SSS buys product xxx, and P(0,S)=1−∑x∈SP(x,S)\mathcal P(0,S)=1-\sum_{x\in S}\mathcal P(x,S)P(0,S)=1−∑x∈S​P(x,S) is the probability that the customer buys nothing. The system P\mathcal PP is a regular discrete choice model if

  1. P(x,S)≥0\mathcal P(x,S)\ge0P(x,S)≥0 for every x∈C∪{0}x\in\mathcal C\cup\{0\}x∈C∪{0};
  2. P(x,S)=0\mathcal P(x,S)=0P(x,S)=0 whenever x∉Sx\notin Sx∈/S;
  3. ∑x∈SP(x,S)≤1\sum_{x\in S}\mathcal P(x,S)\le1∑x∈S​P(x,S)≤1;
  4. P(x,S)≥P(x,S′)\mathcal P(x,S)\ge\mathcal P(x,S')P(x,S)≥P(x,S′) whenever S⊆S′S\subseteq S'S⊆S′ and x∈S∪{0}x\in S\cup\{0\}x∈S∪{0}.

Axiom 4, regularity, says that adding products never makes a given product, or leaving without buying, more likely. Every random utility model is regular.

Each product has a positive price r(x)>0r(x)>0r(x)>0. The revenue of SSS is rev⁡(S)=∑x∈SP(x,S) r(x)\operatorname{rev}(S)=\sum_{x\in S}\mathcal P(x,S)\,r(x)rev(S)=∑x∈S​P(x,S)r(x), and OPT=max⁡S⊆Crev⁡(S)\mathrm{OPT}=\max_{S\subseteq\mathcal C}\operatorname{rev}(S)OPT=maxS⊆C​rev(S). Let 0<r1<⋯<rk0<r_1<\cdots<r_k0<r1​<⋯<rk​ be the distinct prices, so kkk counts price levels and not products, and set r0=0r_0=0r0​=0. The revenue-ordered assortments are Si={x∈C:r(x)≥ri}S_i=\{x\in\mathcal C : r(x)\ge r_i\}Si​={x∈C:r(x)≥ri​}, i=1,…,ki=1,\dots,ki=1,…,k, and the heuristic earns

RO=max⁡1≤i≤krev⁡(Si).\mathrm{RO}=\max_{1\le i\le k}\operatorname{rev}(S_i).RO=1≤i≤kmax​rev(Si​).

Formalization targets

Goal: Theorem 3.2

OPT  ≤  (∑i=1kri−ri−1ri) ROand∑i=1kri−ri−1ri  ≤  1+ln⁡rkr1.\mathrm{OPT}\;\le\;\Big(\sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\Big)\,\mathrm{RO} \qquad\text{and}\qquad \sum_{i=1}^{k}\frac{r_i-r_{i-1}}{r_i}\;\le\;1+\ln\frac{r_k}{r_1}.OPT≤(i=1∑k​ri​ri​−ri−1​​)ROandi=1∑k​ri​ri​−ri−1​​≤1+lnr1​rk​​.

The goal fixes no constant beyond the paper's own quantities. Both parts are required: the sum form is the sharper bound, and the paper shows it is attained (Theorem 3.4, a later mission of this series).

Milestones

  • Lemma 2.1: ∑x∈SP(x,S)≤∑x∈S′P(x,S′)\sum_{x\in S}\mathcal P(x,S)\le\sum_{x\in S'}\mathcal P(x,S')∑x∈S​P(x,S)≤∑x∈S′​P(x,S′) for S⊆S′S\subseteq S'S⊆S′.
  • Inequality (5): rev⁡(Si)≥ri∑x∈S∗∩SiP(x,S∗)\operatorname{rev}(S_i)\ge r_i\sum_{x\in S^*\cap S_i}\mathcal P(x,S^*)rev(Si​)≥ri​∑x∈S∗∩Si​​P(x,S∗) for every S∗S^*S∗ and i∈[k]i\in[k]i∈[k].
  • Theorem 3.1: OPT≤k⋅RO\mathrm{OPT}\le k\cdot\mathrm{RO}OPT≤k⋅RO.
  • Rearrangement (proof of Theorem 3.2): rev⁡(S∗)=∑ℓ(rℓ−rℓ−1)∑x∈S∗∩SℓP(x,S∗)\operatorname{rev}(S^*)=\sum_{\ell}(r_\ell-r_{\ell-1})\sum_{x\in S^*\cap S_\ell}\mathcal P(x,S^*)rev(S∗)=∑ℓ​(rℓ​−rℓ−1​)∑x∈S∗∩Sℓ​​P(x,S∗), and rev⁡(S∗)≤∑ℓrℓ−rℓ−1rℓrev⁡(Sℓ)\operatorname{rev}(S^*)\le\sum_\ell\frac{r_\ell-r_{\ell-1}}{r_\ell}\operatorname{rev}(S_\ell)rev(S∗)≤∑ℓ​rℓ​rℓ​−rℓ−1​​rev(Sℓ​).
  • Logarithmic bound: ∑ℓ=1kaℓ−aℓ−1aℓ≤1+ln⁡(ak/a1)\sum_{\ell=1}^k\frac{a_\ell-a_{\ell-1}}{a_\ell}\le1+\ln(a_k/a_1)∑ℓ=1k​aℓ​aℓ​−aℓ−1​​≤1+ln(ak​/a1​) for 0=a0<a1<⋯<ak0=a_0<a_1<\cdots<a_k0=a0​<a1​<⋯<ak​.

Significance

The theorem shows that a pricing-only quantity controls the loss of the most common heuristic in revenue management, uniformly over all regular choice models, including every random utility model, mixtures of logits and Markov chain models. Combined with the hardness result of Aouad et al., it shows that revenue-ordered assortments achieve essentially the best ratio, as a function of kkk or of rk/r1r_k/r_1rk​/r1​, that an efficient algorithm can achieve. The same analysis transfers to the envy-free pricing and Stackelberg problems studied in the later sections of the paper.

The result is proved in the paper; to our knowledge it has no machine-checked proof. This mission produces a Lean formalization of regular choice models, the revenue-ordered heuristic and its two guarantees, on which the paper's tightness examples, the purchase-probability bound (Theorem 3.3) and the applications to pricing can build.

Difficulty

The argument is short, but two points are easy to get wrong. First, revenues of SiS_iSi​ and of an optimal S∗S^*S∗ involve choice probabilities evaluated at different sets, so the comparison must pass through S∗∩SiS^*\cap S_iS∗∩Si​, using regularity once for products and once for the no-purchase option. A model that only assumes regularity for products does not satisfy the theorem. Second, the bound runs over distinct price levels, not products, and the first summand uses the convention r0=0r_0=0r0​=0; indexing by products or dropping r0r_0r0​ gives a different quantity. The comparison of the sum with ln⁡(rk/r1)\ln(r_k/r_1)ln(rk​/r1​) is a Riemann-sum estimate for ∫dt/t\int dt/t∫dt/t and needs a real-analysis lemma not phrased this way in Mathlib.

Formalization scope

  • Products are a finite nonempty type C with decidable equality; choice sets are Finset C. The choice probabilities are P : C → Finset C → ℝ, defined on all pairs. The no-purchase option is not a product: P(0,S)\mathcal P(0,S)P(0,S) is the derived quantity noPurchase P S = 1 - ∑ x ∈ S, P x S.
  • IsRegular P carries axioms (i)–(iv), with (i) and (iv) each split into a product case and a no-purchase case. The no-purchase case of (i) is redundant with (iii) and is kept to match the page.
  • r : C → ℝ with the hypothesis ∀ x, 0 < r x. revenue P r S is rev⁡(S)\operatorname{rev}(S)rev(S) and opt P r is the maximum over all Finset C (Finset.sup'), including the empty set.
  • Price levels are 1-based: level r i is rir_iri​ for 1≤i≤k1\le i\le k1≤i≤k and level r 0 = 0; numVals r is kkk, the number of distinct values. roSet r i is SiS_iSi​; roValue P r is the maximum over i∈{1,…,k}i\in\{1,\dots,k\}i∈{1,…,k} only.
  • Approximation guarantees are stated in product form, OPT≤D⋅RO\mathrm{OPT}\le D\cdot\mathrm{RO}OPT≤D⋅RO, never as a ratio. ln⁡\lnln is Real.log, applied to rk/r1≥1r_k/r_1\ge1rk​/r1​≥1.
  • Ruled out: a maximum over all subsets in place of RO\mathrm{RO}RO (which makes the bound trivial), a regularity axiom without its no-purchase case, the logarithmic form alone in place of the sum form, and any specific choice model (logit, Markov chain, random utility) in place of an arbitrary regular P\mathcal PP.

Needed infrastructure: finite sums over price levels and summation by parts, the comparison of (b−a)/b(b-a)/b(b−a)/b with ln⁡(b/a)\ln(b/a)ln(b/a), and the sorted enumeration of a finite set of reals (Finset.orderEmbOfFin). The regular model and the revenue-ordered sets are shared with the other missions of this series. Contributions of any milestone, alternative proofs of the logarithmic bound, and proofs that specific choice models are regular are welcome.

Selected references

  • G. Berbeglia and G. Joret, Assortment Optimisation Under a General Discrete Choice Model: A Tight Analysis of Revenue-Ordered Assortments, arXiv:1606.01371v3, 2019; Algorithmica 82, 2020. https://arxiv.org/abs/1606.01371
  • K. Talluri and G. van Ryzin, Revenue Management Under a General Discrete Choice Model of Consumer Behavior, Management Science 50(1), 2004. https://doi.org/10.1287/mnsc.1030.0147
  • A. Aouad, V. Farias, R. Levi and D. Segev, The Approximability of Assortment Optimization Under Ranking Preferences, Operations Research 66(6), 2018. https://doi.org/10.1287/opre.2018.1724
  • P. Rusmevichientong, D. Shmoys, C. Tong and H. Topaloglu, Assortment Optimization under the Multinomial Logit Model with Random Choice Parameters, Production and Operations Management 23(11), 2014. https://doi.org/10.1111/poms.12191
9 thms2 active usersReviewed
🏆Completed
CombinatoricsGraph TheoryLinear algebra·Captain: mikedeng1

Explicit Expanders of Every Degree and Size 2: Attaching New Vertices to a (p+1)-Regular Ramanujan Graph and Adding Loops Keeps Every Nontrivial Eigenvalue at Most √(2(p+1)) + √p + o(1)Research Paper

Motivation

Sparse graphs whose adjacency spectrum is concentrated near zero, expanders, are used throughout theoretical computer science: in error-correcting codes, derandomization, sorting and routing networks, and the construction of pseudorandom objects (Hoory, Linial and Wigderson, survey). The best possible spectral expansion for a ddd-regular graph is governed by the Alon–Boppana bound 2d−12\sqrt{d-1}2d−1​, and graphs attaining it, Ramanujan graphs, were constructed explicitly by Lubotzky, Phillips and Sarnak (LPS 1988) and by Margulis. These constructions exist only for special degrees (d=p+1d = p+1d=p+1 with ppp prime) and special numbers of vertices (orders of PSL(2,Fq)PSL(2,\mathbb F_q)PSL(2,Fq​) or SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​)). Applications often need a graph of a prescribed size nnn.

N. Alon's paper Explicit expanders of every degree and size (arXiv:2003.11673v1; Combinatorica 41, 2021) shows how to obtain explicit near-Ramanujan graphs on exactly nnn vertices. This mission formalizes the spectral core of its Theorem 1.2: a Ramanujan graph on mmm vertices can be enlarged to n=m+rn = m + rn=m+r vertices, with degree raised by one, while the nontrivial eigenvalues stay within a constant factor of optimal.

Setting

Let VVV be a finite set of m≥1m \ge 1m≥1 vertices. A (n,d,λ)(n,d,\lambda)(n,d,λ)-graph is a ddd-regular graph on nnn vertices whose adjacency matrix AAA satisfies ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue μ\muμ, that is, every eigenvalue other than the top eigenvalue ddd of the constant vector 1\mathbf 11. For a symmetric AAA with A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, the nontrivial eigenvalues are those with an eigenvector f≠0f \ne 0f=0 satisfying ∑vf(v)=0\sum_v f(v) = 0∑v​f(v)=0. Graphs may carry loops, at most one per vertex, and a loop adds one to the degree: it is a diagonal entry 111 of AAA.

Fix an integer p≥0p \ge 0p≥0 and let HHH be an (m,p+1,2p)(m, p+1, 2\sqrt p)(m,p+1,2p​)-graph on VVV, a (p+1)(p+1)(p+1)-regular Ramanujan graph. Let R={u1,…,ur}R = \{u_1, \dots, u_r\}R={u1​,…,ur​} be rrr new vertices and let W1,…,Wr⊆VW_1, \dots, W_r \subseteq VW1​,…,Wr​⊆V be pairwise disjoint sets of p+2p+2p+2 vertices each. Put W=⋃iWiW = \bigcup_i W_iW=⋃i​Wi​ and L=V∖WL = V \setminus WL=V∖W. The graph GGG on U=V∪RU = V \cup RU=V∪R is obtained from HHH by joining each uiu_iui​ to every vertex of WiW_iWi​ and adding one loop at each vertex of LLL. Its adjacency matrix is

AG=AH+AR+AL,A_G = A_H + A_R + A_L,AG​=AH​+AR​+AL​,

where AHA_HAH​ is the adjacency matrix of HHH (zero on RRR), ARA_RAR​ that of the stars joining uiu_iui​ to WiW_iWi​, and ALA_LAL​ the diagonal matrix of the loops. Every vertex of GGG has degree p+2p+2p+2.

Formalization targets

Goal: Theorem 1.2, spectral core

AG is an (m+r,  p+2,  2(p+1)+p+(p+1) rm) matrix.A_G \text{ is an } \Big(m+r,\; p+2,\; \sqrt{2(p+1)} + \sqrt p + \frac{(p+1)\,r}{m}\Big)\text{ matrix.}AG​ is an (m+r,p+2,2(p+1)​+p​+m(p+1)r​) matrix.

The paper states λ≤2(d−1)+d−1+o(1)\lambda \le \sqrt{2(d-1)} + \sqrt{d-1} + o(1)λ≤2(d−1)​+d−1​+o(1) for d=p+2d = p+2d=p+2; its proof gives 2(p+1)+p+o(1)\sqrt{2(p+1)} + \sqrt p + o(1)2(p+1)​+p​+o(1), which is stronger, and the error term it produces is (p+1)r/m(p+1)r/m(p+1)r/m. The goal is parametrised by HHH, rrr and the sets WiW_iWi​, so it does not depend on how mmm and rrr are chosen.

Milestones

  1. The variational characterization of the nontrivial eigenvalues: for a symmetric matrix with constant row sums and λ≥0\lambda \ge 0λ≥0, ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every nontrivial eigenvalue if and only if ∣ftAf∣≤λ∥f∥2|f^tAf| \le \lambda\|f\|^2∣ftAf∣≤λ∥f∥2 whenever ∑f=0\sum f = 0∑f=0.
  2. The Cauchy–Schwarz display: ∑Uf=0\sum_U f = 0∑U​f=0 implies ∣∑Vf∣2=∣∑Rf∣2≤∣R∣∑Rf2|\sum_V f|^2 = |\sum_R f|^2 \le |R| \sum_R f^2∣∑V​f∣2=∣∑R​f∣2≤∣R∣∑R​f2.
  3. Inequality (3): ∣ftAHf∣≤b2(p+1)+c2 2p|f^tA_Hf| \le b^2(p+1) + c^2\, 2\sqrt p∣ftAH​f∣≤b2(p+1)+c22p​ with b2=(∑Vf)2/mb^2 = (\sum_V f)^2/mb2=(∑V​f)2/m and c2=∑Vf2−b2c^2 = \sum_V f^2 - b^2c2=∑V​f2−b2.
  4. Display (4): ftALf=∑v∈Lf2(v)f^tA_Lf = \sum_{v\in L} f^2(v)ftAL​f=∑v∈L​f2(v).
  5. Inequality (5): ∣ftARf∣≤p+2x∑Rf2+x∑Wf2|f^tA_Rf| \le \frac{p+2}{x}\sum_R f^2 + x\sum_W f^2∣ftAR​f∣≤xp+2​∑R​f2+x∑W​f2 for every x>0x > 0x>0.
  6. Inequality (6): for ∑Uf=0\sum_U f = 0∑U​f=0 and x>0x > 0x>0,
∣ftAGf∣≤(2p+1)∑Lf2+(2p+x)∑Wf2+p+2x∑Rf2+(p+1)rm∑Rf2.|f^tA_Gf| \le (2\sqrt p+1)\sum_L f^2 + (2\sqrt p+x)\sum_W f^2 + \frac{p+2}{x}\sum_R f^2 + (p+1)\frac rm \sum_R f^2.∣ftAG​f∣≤(2p​+1)L∑​f2+(2p​+x)W∑​f2+xp+2​R∑​f2+(p+1)mr​R∑​f2.

Significance

With HHH the Lubotzky–Phillips–Sarnak graph on m=∣SL(2,Fq)∣m = |SL(2,\mathbb F_q)|m=∣SL(2,Fq​)∣ vertices for the largest suitable prime qqq with m≤nm \le nm≤n, and r=n−mr = n - mr=n−m, the distribution of primes in arithmetic progressions gives r=o(m)r = o(m)r=o(m), and the goal yields an explicit (n,p+2,λ)(n, p+2, \lambda)(n,p+2,λ)-graph with λ≤(1+2)d−1+o(1)\lambda \le (1+\sqrt2)\sqrt{d-1} + o(1)λ≤(1+2​)d−1​+o(1) for every sufficiently large nnn. This is within a factor of about 1.211.211.21 of the Ramanujan bound 2d−12\sqrt{d-1}2d−1​, for every number of vertices, by an elementary modification of an existing graph. The statement is useful independently of LPS: any Ramanujan graph, or any graph with a bound on its nontrivial eigenvalues, can be padded to a nearby size in the same way.

The result is proved in the paper. No formalization of it, of the (n,d,λ)(n,d,\lambda)(n,d,λ) notion, or of the variational characterization of nontrivial eigenvalues for regular graphs exists on the platform. The mission produces a checked version of the spectral argument, and the variational characterization (milestone 1) is a general fact about symmetric matrices with constant row sums that applies to any spectral expander argument.

Difficulty

The vertices of WWW and LLL lie in the old graph HHH, whose spectrum is controlled, but the new vertices of RRR are not; and a vector orthogonal to 1\mathbf 11 on UUU need not be orthogonal to the constant vector on VVV. Bounding ftAGff^tA_GfftAG​f by applying the Ramanujan bound for HHH to fff restricted to VVV therefore fails: the restriction has a component along the trivial eigenvector of HHH, whose eigenvalue p+1p+1p+1 is large. The argument must show that this component is small, of order r/mr/mr/m, and must balance the star edges between RRR and WWW against the loops on LLL so that every vertex class gets the same coefficient. The naive bound ∣ftARf∣≤∥AR∥ ∥f∥2=p+2 ∥f∥2|f^tA_Rf| \le \|A_R\|\,\|f\|^2 = \sqrt{p+2}\,\|f\|^2∣ftAR​f∣≤∥AR​∥∥f∥2=p+2​∥f∥2 added to 2p2\sqrt p2p​ for HHH and 111 for LLL gives a constant larger than 2(p+1)+p\sqrt{2(p+1)}+\sqrt p2(p+1)​+p​; the stated constant needs the weighted estimate.

On the Lean side, milestone 1 concerns the spectrum of a symmetric matrix on the invariant subspace 1⊥\mathbf 1^\perp1⊥, while Mathlib states the spectral theorem for the whole space.

Formalization scope

  • Vertices of GGG are the disjoint union V⊕Fin rV \oplus \mathrm{Fin}\, rV⊕Finr. GGG is represented by its real adjacency matrix, since it has loops; HHH is a Mathlib SimpleGraph with adjMatrix.
  • The (n,d,λ)(n,d,\lambda)(n,d,λ) predicate is stated for matrices: ∣V∣=n|V| = n∣V∣=n, symmetry, A1=d 1A\mathbf 1 = d\,\mathbf 1A1=d1, and ∣μ∣≤λ|\mu| \le \lambda∣μ∣≤λ for every eigenpair (μ,f)(\mu, f)(μ,f) with f≠0f \ne 0f=0 and ∑f=0\sum f = 0∑f=0. For simple graphs, ddd-regularity is added.
  • The paper's o(1)o(1)o(1) terms are replaced by the explicit quantities its proof produces: (p+1)r/m(p+1)r/m(p+1)r/m in the goal, and (p+1)rm∑Rf2(p+1)\frac rm\sum_R f^2(p+1)mr​∑R​f2 in (6). Inequality (3) is stated with the corrected relation b2+c2=∑Vf2b^2 + c^2 = \sum_V f^2b2+c2=∑V​f2; the paper's "b2+c2=1b^2 + c^2 = 1b2+c2=1" holds only for unit restrictions.
  • The bound uses p=d−2\sqrt p = \sqrt{d-2}p​=d−2​, as in the proof and the abstract, which implies the printed d−1\sqrt{d-1}d−1​.
  • ppp is any natural number. The hypothesis "ppp prime, p≡1(mod4)p \equiv 1 \pmod 4p≡1(mod4)" serves only to obtain HHH from LPS, and HHH is a hypothesis here. The sets WiW_iWi​ are arbitrary pairwise disjoint sets of size p+2p+2p+2, not the paper's consecutive blocks of a numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​).
  • Out of scope: the existence of the prime qqq and the estimate n−m=o(m)n - m = o(m)n−m=o(m); the numbering of SL(2,Fq)SL(2,\mathbb F_q)SL(2,Fq​); the "strongly explicit" and polynomial-time claims; the LPS construction (Theorem 2.1, cited); the variant that replaces loops by a matching for even nnn.
  • The goal cannot be satisfied trivially: dropping the condition ∑f=0\sum f = 0∑f=0 makes it false, since p+2p+2p+2 is always an eigenvalue, and for p≥2p \ge 2p≥2 and small r/mr/mr/m the bound is below p+2p + 2p+2 (for p=5p = 5p=5 it is about 5.70+6r/m5.70 + 6r/m5.70+6r/m). At p=1p = 1p=1 the bound 3+2r/m3 + 2r/m3+2r/m is at least the degree 333, so that case holds trivially; it is the paper's statement there as well.
  • Contributions welcome: proofs of each milestone, especially the variational characterization, which is reusable for mission 3 of this series and for any regular-graph spectral argument.

Selected references

  • N. Alon, Explicit expanders of every degree and size, arXiv:2003.11673v1, 2020; Combinatorica 41 (2021). https://arxiv.org/abs/2003.11673
  • A. Lubotzky, R. Phillips, P. Sarnak, Ramanujan graphs, Combinatorica 8 (1988) 261–277. https://doi.org/10.1007/BF02126799
  • S. Hoory, N. Linial, A. Wigderson, Expander graphs and their applications, Bull. AMS 43 (2006) 439–561. https://doi.org/10.1090/S0273-0979-06-01126-8
9 thms2 active usersReviewed
🏆Completed
Linear OptimizationOperations ResearchOptimization+1·Captain: mikedeng1

Solving Linear Programs in the Current Matrix Multiplication Time: The Stochastic Central Path Falls Back to a Classical Step with Probability at Most 10/n² per IterationResearch Paper

Motivation

Linear programming, min⁡{c⊤x:Ax=b, x≥0}\min\{c^\top x : Ax=b,\ x\ge0\}min{c⊤x:Ax=b, x≥0} with A∈Rd×nA\in\mathbb R^{d\times n}A∈Rd×n, is the basic model of operations research, and the complexity of solving it is a central question of algorithm theory. Interior-point methods follow the central path: primal–dual pairs (x,s)(x,s)(x,s) with x,s>0x,s>0x,s>0 and xisi=tx_is_i=txi​si​=t for every iii, as the path parameter ttt decreases to 000. A classical short-step method needs O(nlog⁡(n/δ))O(\sqrt n\log(n/\delta))O(n​log(n/δ)) iterations, each solving a linear system with the matrix AXSA⊤A\frac XSA^\topASX​A⊤, for a total of roughly n2.5n^{2.5}n2.5 operations or more.

Cohen, Lee and Song (J. ACM 68(1), 2021; arXiv:1810.07896) showed that linear programs can be solved in time nω+o(1)log⁡(n/δ)n^{\omega+o(1)}\log(n/\delta)nω+o(1)log(n/δ) (for the current values of the matrix multiplication exponent ω\omegaω and its dual α\alphaα), matching the cost of multiplying two n×nn\times nn×n matrices. The analysis has two halves: a data structure that maintains the projection matrix lazily, and the stochastic central path method, which replaces each Newton step by a sparse random step and proves that the iterates still stay close to the central path. This mission formalizes the second half.

Timeline: Karmarkar's projective method (1984) gave the first polynomial interior-point method; Renegar (1988) gave the O(nlog⁡(1/δ))O(\sqrt n\log(1/\delta))O(n​log(1/δ)) path-following bound; Vaidya (1989) reduced the per-iteration cost with low-rank updates; Lee and Sidford (2014–2015) reduced the iteration count to O~(d)\widetilde O(\sqrt d)O(d​); Cohen, Lee and Song (STOC 2019, J. ACM 2021) reached nωn^\omeganω; van den Brand (2020) derandomized the result.

Setting

Vectors are in Rn\mathbb R^nRn and products, quotients and roots of vectors are coordinatewise. For ϵ\epsilonϵ and vectors a,ba,ba,b, a≈ϵba\approx_\epsilon ba≈ϵ​b means (1−ϵ)bi≤ai≤(1+ϵ)bi(1-\epsilon)b_i\le a_i\le(1+\epsilon)b_i(1−ϵ)bi​≤ai​≤(1+ϵ)bi​ for all iii; a≈ϵta\approx_\epsilon ta≈ϵ​t for a scalar ttt is defined likewise. The number of variables is n≥10n\ge10n≥10 and AAA has full row rank d≤nd\le nd≤n.

The potential is Φλ(r)=∑i=1ncosh⁡(λri)\Phi_\lambda(r)=\sum_{i=1}^n\cosh(\lambda r_i)Φλ​(r)=∑i=1n​cosh(λri​), evaluated at r=μ/t−1r=\mu/t-1r=μ/t−1 with μ=xs\mu=xsμ=xs; it is small exactly when every xisix_is_ixi​si​ is close to ttt.

StochasticStep (Algorithm 1) takes positive x,sx,sx,s, a direction δμ\delta_\muδμ​, a sampling parameter kkk and the output v~\widetilde vv of a data structure with x/s≈ϵmpv~x/s\approx_{\epsilon_{\mathrm{mp}}}\widetilde vx/s≈ϵmp​​v. It rescales to x‾=xv~/w\overline x=x\sqrt{\widetilde v/w}x=xv/w​, s‾=sw/v~\overline s=s\sqrt{w/\widetilde v}s=sw/v​ (w=x/sw=x/sw=x/s), draws a sparse vector δ~μ\widetilde\delta_\muδμ​ with independent coordinates, δ~μ,i=δμ,i/pi\widetilde\delta_{\mu,i}=\delta_{\mu,i}/p_iδμ,i​=δμ,i​/pi​ with probability pi=min⁡(1,k(δμ,i2/∥δμ∥22+1/n))p_i=\min(1,k(\delta_{\mu,i}^2/\|\delta_\mu\|_2^2+1/n))pi​=min(1,k(δμ,i2​/∥δμ​∥22​+1/n)) and 000 otherwise, and computes the step (δ~x,δ~s)(\widetilde\delta_x,\widetilde\delta_s)(δx​,δs​) through the projection P‾=X‾/S‾A⊤(AX‾S‾A⊤)−1AX‾/S‾\overline P=\sqrt{\overline X/\overline S}A^\top(A\frac{\overline X}{\overline S}A^\top)^{-1}A\sqrt{\overline X/\overline S}P=X/S​A⊤(ASX​A⊤)−1AX/S​. The draw is repeated until ∥s‾−1δ~s∥∞\|\overline s^{-1}\widetilde\delta_s\|_\infty∥s−1δs​∥∞​ and ∥x‾−1δ~x∥∞\|\overline x^{-1}\widetilde\delta_x\|_\infty∥x−1δx​∥∞​ are at most 1/(100log⁡n)1/(100\log n)1/(100logn); the output is (x+δ~x,s+δ~s)(x+\widetilde\delta_x,s+\widetilde\delta_s)(x+δx​,s+δs​).

Main (Algorithm 2) sets ϵ=140000log⁡n\epsilon=\frac1{40000\log n}ϵ=40000logn1​, ϵmp=140000\epsilon_{\mathrm{mp}}=\frac1{40000}ϵmp​=400001​, k=1000ϵnlog⁡2n/ϵmpk=1000\epsilon\sqrt n\log^2n/\epsilon_{\mathrm{mp}}k=1000ϵn​log2n/ϵmp​, λ=40log⁡n\lambda=40\log nλ=40logn, starts at t=1t=1t=1, and in each iteration sets tnew=(1−ϵ3n)tt^{\mathrm{new}}=(1-\frac{\epsilon}{3\sqrt n})ttnew=(1−3n​ϵ​)t, takes the direction

δμ=(tnewt−1)xs−ϵ2tnew∇Φλ(μ/t−1)∥∇Φλ(μ/t−1)∥2,\delta_\mu=\Big(\frac{t^{\mathrm{new}}}{t}-1\Big)xs-\frac\epsilon2t^{\mathrm{new}}\frac{\nabla\Phi_\lambda(\mu/t-1)}{\|\nabla\Phi_\lambda(\mu/t-1)\|_2},δμ​=(ttnew​−1)xs−2ϵ​tnew∥∇Φλ​(μ/t−1)∥2​∇Φλ​(μ/t−1)​,

runs StochasticStep, and falls back to a deterministic ClassicalStep whenever Φλ(μnew/tnew−1)>n3\Phi_\lambda(\mu^{\mathrm{new}}/t^{\mathrm{new}}-1)>n^3Φλ​(μnew/tnew−1)>n3.

Formalization targets

Goal: Lemma 4.14

For every iteration jjj, almost surely Assumption 4.1 holds for the input of iteration jjj (in particular xjsj≈0.1tjx^js^j\approx_{0.1}t_jxjsj≈0.1​tj​ and ∥δμ∥2≤ϵtj\|\delta_\mu\|_2\le\epsilon t_j∥δμ​∥2​≤ϵtj​), almost surely the resampling loop of iteration jjj succeeds with positive probability, and

P(ClassicalStep is used in iteration j)≤10n2.\mathbb P(\text{ClassicalStep is used in iteration }j)\le\frac{10}{n^2}.P(ClassicalStep is used in iteration j)≤n210​.

The paper writes O(1/n2)O(1/n^2)O(1/n2); its proof gives the constant 101010.

Milestones

Lemma A.1 (variance of a product), Lemma 4.12 (properties of Φλ\Phi_\lambdaΦλ​), Lemma 4.2 (explicit step), Lemma 4.3 and Claim 4.7 (moments and success probability of the sampled step), Lemma 4.8 (moments of μnew\mu^{\mathrm{new}}μnew), and Lemma 4.13:

E[Φλ(μnewtnew−1)]≤Φλ(μt−1)−λϵ15n(Φλ(μt−1)−10n).\mathbf E\Big[\Phi_\lambda\Big(\frac{\mu^{\mathrm{new}}}{t^{\mathrm{new}}}-1\Big)\Big]\le\Phi_\lambda\Big(\frac\mu t-1\Big)-\frac{\lambda\epsilon}{15\sqrt n}\Big(\Phi_\lambda\Big(\frac\mu t-1\Big)-10n\Big).E[Φλ​(tnewμnew​−1)]≤Φλ​(tμ​−1)−15n​λϵ​(Φλ​(tμ​−1)−10n).

Significance

Lemma 4.14 is what makes the randomized method usable: the iterates stay in the 0.10.10.1-neighbourhood of the central path along the whole run, and the expensive fallback is rare enough that its expected cost, O~(n2.5)⋅10/n2\widetilde O(n^{2.5})\cdot 10/n^2O(n2.5)⋅10/n2, is negligible. The paper's cost bound (Lemma 4.16) and its main theorem rest on it. The same potential-based "stochastic central path" analysis was reused in later solvers, for instance for empirical risk minimization (Lee, Song and Zhang, COLT 2019).

The result is proved in the paper; no machine-checked version exists. A formalization pins down the probabilistic model that the paper leaves implicit (independence of the sampled coordinates, the law of the resampling loop, a data structure and fallback that see only the past) and checks the constants, several of which are tight against printed slack (Remark 4.4).

The running-time claims of the paper (Theorem 2.1's expected time nω+o(1)n^{\omega+o(1)}nω+o(1), Lemma 4.16, Section 5) are not part of this mission: they live in an arithmetic cost model that Lean does not have. The accuracy guarantee of Theorem 2.1 (Lemma A.6, ClassicalStep from [57]) is also outside the mission.

Difficulty

The obvious argument would bound each quantity under the product law of the sparse direction. But StochasticStep resamples, so the step actually taken is distributed according to that law conditioned on a success event, and expectations and variances shift. A second difficulty is that Φλ\Phi_\lambdaΦλ​ is controlled only in expectation, while Assumption 4.1 must hold surely at every iteration; this is reconciled by the deterministic ClassicalStep fallback, which caps Φλ\Phi_\lambdaΦλ​ at n3n^3n3, and by an induction over iterations of E[Φ]≤10n\mathbf E[\Phi]\le10nE[Φ]≤10n under the trajectory law. Claim 4.7 needs a Bernstein inequality, which Mathlib does not yet provide.

Formalization scope

Coordinates are Fin n, vectors Fin n → ℝ, AAA a Matrix (Fin d) (Fin n) ℝ with A.rank = d, and log⁡\loglog the natural logarithm. ∥⋅∥2\|\cdot\|_2∥⋅∥2​ is written out as ∑ivi2\sqrt{\sum_iv_i^2}∑i​vi2​​; ∥⋅∥∞≤c\|\cdot\|_\infty\le c∥⋅∥∞​≤c is stated coordinatewise. The sampled direction has law Measure.pi of two-point laws; the step taken by StochasticStep has that law conditioned (ProbabilityTheory.cond) on the success event, and every E\mathbf EE, Var\mathbf{Var}Var of Lemmas 4.3, 4.8 and 4.13 is under this conditioned law. mp.Query is replaced by its value P‾(X‾S‾)−1/2δ~μ\overline P(\overline X\overline S)^{-1/2}\widetilde\delta_\muP(XS)−1/2δμ​; the data structure and ClassicalStep are arbitrary measurable functions UjU_jUj​, CjC_jCj​ of the history with the only properties the paper uses. The trajectory is Mathlib's Ionescu-Tulcea measure, with kernels equal to the step law of Main. nnn is the number of variables of the program the loop runs on.

Deviations from the page, all recorded in the items: Assumption 4.1 is used with ϵ≤1/(40000log⁡n)\epsilon\le1/(40000\log n)ϵ≤1/(40000logn) instead of the printed <<<, because Main sets ϵ\epsilonϵ to exactly that value; O(1/n2)O(1/n^2)O(1/n2) is instantiated as 10/n210/n^210/n2, the constant of the paper's proof; the conclusions of Lemma 4.14 are stated for every iteration index rather than while t>δ2/(32n3)t>\delta^2/(32n^3)t>δ2/(32n3); at ∇Φλ=0\nabla\Phi_\lambda=0∇Φλ​=0 the second term of δμ\delta_\muδμ​ is 000. No hypothesis k≤nk\le nk≤n is imposed.

A trivializing formalization is ruled out: every statement that integrates against the conditioned law also concludes that this law is a probability measure (so it cannot be the zero measure), the goal concludes that each resampling loop succeeds with positive probability, the oracles UjU_jUj​, CjC_jCj​ cannot see the coins of the current iteration, and the goal is about the whole iterated process from the initial point, not one step from an arbitrary law.

Contributions welcome: a Bernstein inequality for bounded independent sums, conditional-law lemmas for cond of Measure.pi, and Markov-kernel measurability for the step law; these are reusable beyond this mission.

Selected references

  • M. B. Cohen, Y. T. Lee, Z. Song, Solving Linear Programs in the Current Matrix Multiplication Time, J. ACM 68(1), Article 3, 2021. https://doi.org/10.1145/3424305 (arXiv:1810.07896, https://arxiv.org/abs/1810.07896)
  • N. Karmarkar, A new polynomial-time algorithm for linear programming, Combinatorica 4, 1984. https://doi.org/10.1007/BF02579150
  • J. Renegar, A polynomial-time algorithm, based on Newton's method, for linear programming, Math. Programming 40, 1988. https://doi.org/10.1007/BF01580724
  • P. M. Vaidya, Speeding-up linear programming using fast matrix multiplication, Proc. 30th FOCS, 1989.
  • Y. T. Lee, A. Sidford, Path finding methods for linear programming, FOCS 2014. https://doi.org/10.1109/FOCS.2014.52
  • Y. T. Lee, Z. Song, Q. Zhang, Solving Empirical Risk Minimization in the Current Matrix Multiplication Time, COLT 2019. https://arxiv.org/abs/1905.04447
  • J. van den Brand, A deterministic linear program solver in current matrix multiplication time, SODA 2020. https://doi.org/10.1137/1.9781611975994.16
11 thms2 active usersReviewed
🏆Completed
Operations ResearchProbabilityStochastic Systems·Captain: mikedeng1

Approximation Algorithms for Stochastic Inventory Control Models 1: The Dual-Balancing Policy Costs at Most Twice the OptimumResearch Paper

Motivation

Periodic-review inventory control with backorders is one of the basic models of operations research: in each period a manager decides how much to order, orders arrive after a lead time, unmet demand is backlogged at a penalty, and stock left over is charged a holding cost. When demands in different periods are independent, dynamic programming yields an optimal base-stock policy and computing it is tractable. In practice demands are correlated and forecasts evolve over time, for example under the martingale model of forecast evolution (Heath and Jackson, 1994, doi:10.1080/07408179408966604). The dynamic program then has to range over all possible information states, whose number is typically exponential in the input (Zipkin, 2000), so optimal policies are out of reach and the heuristics in use came without performance guarantees.

Levi, Pál, Roundy and Shmoys (Math. Oper. Res. 32(2):284–302, 2007) gave the first policy for this model with a worst-case guarantee that holds for arbitrary correlated, nonstationary demand distributions: the dual-balancing policy costs at most twice the optimum in expectation. The analysis rests on a marginal cost accounting that charges each order, at the time it is placed, all the holding cost its units will ever incur. This mission formalizes that guarantee.

Setting

There are TTT periods t=1,…,Tt = 1, \dots, Tt=1,…,T and a known lead time L≥0L \ge 0L≥0: an order placed in period ttt arrives in period t+Lt + Lt+L. Period ttt has a per-unit holding cost ht≥0h_t \ge 0ht​≥0 and a per-unit backlogging penalty pt≥0p_t \ge 0pt​≥0. Ordering costs are zero (ct=0c_t = 0ct​=0), which is the standing assumption of the paper's §4. The initial data are the net inventory ni0ni_0ni0​ and the pipeline orders q1−L,…,q0≥0q_{1-L}, \dots, q_0 \ge 0q1−L​,…,q0​≥0.

Demands D1,…,DTD_1, \dots, D_TD1​,…,DT​ are nonnegative random variables on a probability space with a filtration (Ft)(\mathcal F_t)(Ft​); Ft\mathcal F_tFt​ is the information at the beginning of period ttt, and DtD_tDt​ is Ft+1\mathcal F_{t+1}Ft+1​-measurable. A feasible policy PPP places orders QtP≥0Q^P_t \ge 0QtP​≥0 that are Ft\mathcal F_tFt​-measurable. Write D[s,t]=∑j=stDjD_{[s,t]} = \sum_{j=s}^t D_jD[s,t]​=∑j=st​Dj​ (with Dj=0D_j = 0Dj​=0 for j≤0j \le 0j≤0), Xt=ni0+∑j=1−Lt−1Qj−D[1,t−1]X_t = ni_0 + \sum_{j=1-L}^{t-1} Q_j - D_{[1,t-1]}Xt​=ni0​+∑j=1−Lt−1​Qj​−D[1,t−1]​ for the inventory position before ordering and Yt=Xt+QtY_t = X_t + Q_tYt​=Xt​+Qt​ after ordering.

The marginal holding cost of period ttt is the holding cost that the units ordered in ttt incur until the end of the horizon, and the marginal backlogging cost is the penalty incurred one lead time later:

HtP=∑j=t+LThj (QtP−(D[t,j]−XtP)+)+,ΠtP=pt+L (D[t,t+L]−YtP)+.H^P_t = \sum_{j=t+L}^{T} h_j\,\bigl(Q^P_t - (D_{[t,j]} - X^P_t)^+\bigr)^+, \qquad \Pi^P_t = p_{t+L}\,\bigl(D_{[t,t+L]} - Y^P_t\bigr)^+ .HtP​=j=t+L∑T​hj​(QtP​−(D[t,j]​−XtP​)+)+,ΠtP​=pt+L​(D[t,t+L]​−YtP​)+.

The cost of PPP is C(P)=∑t=1T−L(HtP+ΠtP)\mathcal C(P) = \sum_{t=1}^{T-L}(H^P_t + \Pi^P_t)C(P)=∑t=1T−L​(HtP​+ΠtP​); by Eq. (3) it differs from the total holding and backlogging cost only by a policy-independent nonnegative term.

A dual-balancing policy BBB orders nothing after period T−LT - LT−L, and in each period t≤T−Lt \le T - Lt≤T−L orders the quantity that balances the two conditional expected marginal costs:

E[HtB∣Ft]=E[ΠtB∣Ft]almost surely.E\bigl[H^B_t \mid \mathcal F_t\bigr] = E\bigl[\Pi^B_t \mid \mathcal F_t\bigr] \quad\text{almost surely.}E[HtB​∣Ft​]=E[ΠtB​∣Ft​]almost surely.

Formalization targets

Goal: Theorem 4.1

For every dual-balancing policy BBB and every feasible policy PPP,

E[C(B)]  ≤  2 E[C(P)].E[\mathcal C(B)] \;\le\; 2\,E[\mathcal C(P)] .E[C(B)]≤2E[C(P)].

The paper writes P=OPTP = OPTP=OPT; quantifying over all feasible PPP is the same statement whenever an optimum exists and needs no existence assumption.

Milestones

  1. Lemma 4.1. E[C(B)]=2∑t=1T−LE[Zt]E[\mathcal C(B)] = 2\sum_{t=1}^{T-L}E[Z_t]E[C(B)]=2∑t=1T−L​E[Zt​] with Zt=E[HtB∣Ft]Z_t = E[H^B_t \mid \mathcal F_t]Zt​=E[HtB​∣Ft​].
  2. Lemma 4.2. With TH={t:YtB<YtP}\mathcal T_H = \{t : Y^B_t < Y^P_t\}TH​={t:YtB​<YtP​}, ∑t∈THHtB≤∑t=1T−LHtP\sum_{t\in\mathcal T_H} H^B_t \le \sum_{t=1}^{T-L} H^P_t∑t∈TH​​HtB​≤∑t=1T−L​HtP​ on every realization.
  3. Lemma 4.3. With TΠ={t:YtB≥YtP}\mathcal T_\Pi = \{t : Y^B_t \ge Y^P_t\}TΠ​={t:YtB​≥YtP​}, ∑t∈TΠΠtB≤∑t=1T−LΠtP\sum_{t\in\mathcal T_\Pi} \Pi^B_t \le \sum_{t=1}^{T-L} \Pi^P_t∑t∈TΠ​​ΠtB​≤∑t=1T−L​ΠtP​ on every realization.

Two further items are not milestones. Eq. (3) states that, along every realization, the period-by-period holding and backlogging cost equals ∑t=1−L0Πt+H(−∞,0]+∑t=1T−L(Ht+Πt)\sum_{t=1-L}^{0}\Pi_t + H_{(-\infty,0]} + \sum_{t=1}^{T-L}(H_t + \Pi_t)∑t=1−L0​Πt​+H(−∞,0]​+∑t=1T−L​(Ht​+Πt​), which is why the cost of Eq. (4) is the right objective. The other states that a dual-balancing policy exists when hT>0h_T > 0hT​>0 and the demands are integrable, so the goal is not about an empty class.

Significance

The theorem gives a policy that is computable period by period, by a one-dimensional search, with a factor-two guarantee that holds for every joint demand distribution, including correlated, nonstationary and forecast-driven ones, where the optimal policy cannot be computed. The constant is tight: the paper exhibits instances where the ratio tends to two. The second mission of this series treats the stochastic lot-sizing problem of the same paper, which uses the same marginal cost accounting.

The result is proved in the paper; no machine-checked proof of it is known. Formalizing it produces a reusable model of the periodic-review backlogging system with lead times and adapted policies, a verified marginal cost identity, and a formal approximation guarantee for a stochastic inventory policy. The pathwise comparison lemmas are stated for arbitrary pairs of order sequences and so apply to other balancing-type policies.

Difficulty

The obvious attempt compares the two policies period by period. That fails: in a given period the dual-balancing policy may hold far more or far less inventory than the comparison policy, and neither the holding nor the backlogging cost of one period is bounded by the comparator's cost in that period. The comparison only works after re-charging holding costs to the period in which the units were ordered, which requires the identity Eq. (3) to be established exactly, including the pipeline units, the initial stock and the lead-time shift. The probabilistic step then needs the random index sets TH\mathcal T_HTH​ and TΠ\mathcal T_\PiTΠ​ to be determined by the information of period ttt, so that conditioning on Ft\mathcal F_tFt​ commutes with the indicators; this is where the nonanticipativity of both policies enters. The existence of a balancing quantity needs a measurable selection from conditional laws, and it fails without a positive late holding cost.

Formalization scope

  • Periods are integers (ℤ). Orders and demands are functions ℤ → Ω → ℝ; only periods 1,…,T1, \dots, T1,…,T are read, and the pipeline qtq_tqt​ is substituted for t≤0t \le 0t≤0.
  • Ordering costs are ct=0c_t = 0ct​=0 and there is no discounting, as in the paper's §4; the reduction of §4.6 from general instances is not formalized. The lead time LLL is general.
  • Information is an arbitrary Filtration ℤ to which demands are adapted with a one-period lag; the paper's information vectors are a special case, and randomized policies are covered when their randomness is part of the information.
  • Expected costs are lower Lebesgue integrals in [0,∞][0,\infty][0,∞], so an infinite expected cost is never read as 000.
  • The balancing condition carries integrability of HtBH^B_tHtB​ and ΠtB\Pi^B_tΠtB​, so a conditional expectation of a non-integrable cost (which Mathlib sets to 000) cannot satisfy it vacuously. The existence item rules out an empty policy class.
  • Lemmas 4.2 and 4.3 are pathwise and do not use the balancing rule. The comparator totals are the marginal totals of Eq. (4), which is the stronger reading.
  • Eq. (2) prints Xt+LX_{t+L}Xt+L​ and its restatement on p. 292 prints ptp_tpt​; both are typos, and the formalization uses XtX_tXt​ and pt+Lp_{t+L}pt+L​.

A complete development needs finite-sum manipulations for Eq. (3) and Lemma 4.2, conditional expectation (tower property, pulling out bounded Ft\mathcal F_tFt​-measurable factors) for Lemma 4.1 and the goal, and regular conditional distributions with a measurable selection for the existence item. Theorem 4.2 (the randomized policy for integer demands) is outside this mission.

Selected references

  • R. Levi, M. Pál, R. O. Roundy, D. B. Shmoys, Approximation Algorithms for Stochastic Inventory Control Models, Mathematics of Operations Research 32(2):284–302, 2007. doi:10.1287/moor.1060.0205
  • D. C. Heath, P. L. Jackson, Modeling the evolution of demand forecasts with application to safety stock analysis in production/distribution systems, IIE Transactions 26(3):17–30, 1994. doi:10.1080/07408179408966604
  • P. H. Zipkin, Foundations of Inventory Management, McGraw-Hill, 2000. ISBN 978-0-256-11379-7.
6 thms2 active usersReviewed
🏆Completed
Captain: wurtle

WordRAM to Turing machines: polynomial simulation for NP proofsResearch Paper

We establish the polynomial simulation needed for WordRAM-based NP proofs. It reuses the same machines and Cook–Levin definitions, with uniform programs, logarithmic word widths, and standard bit input/output.

The targets cover function outputs and verifier verdicts, including loading and serialization costs.

This adapts Cook–Reckhow’s Theorem 2(a), pp. 361–363, to Hagerup’s bounded-word operations, including multiplication; no particular simulation exponent is prescribed.

References:

  • Stephen A. Cook and Robert A. Reckhow. Time Bounded Random Access Machines. Journal of Computer and System Sciences 7(4), 354–375, 1973.
  • Torben Hagerup. Sorting and Searching on the Word RAM. STACS 1998, 366–398.
15 thms2 active usersReviewed
🏆Completed
Operations ResearchOptimization·Captain: mikedeng1

Optimal Sequencing of a Single Machine Subject to Precedence Constraints: Repeatedly Placing Last a Least-Cost Eligible Job Yields a Minmax Optimal SequenceResearch Paper

Motivation

Single-machine sequencing is the base case of deterministic scheduling theory. Many multi-machine and shop problems are analysed by reduction to it, and many bounds and approximation algorithms for harder models use it as a subroutine. A central objective class is the bottleneck or minmax objective. Each job carries a nondecreasing cost of its completion time, and the schedule is judged by its worst job. Maximum lateness, maximum tardiness and maximum weighted tardiness are all special cases.

Before 1973 the minmax problem was solved without precedence constraints. Jackson (1955) showed that ordering by due date minimizes maximum lateness. Moore (1968, Management Science 15(1)) gave a procedure for general nondecreasing deferral costs, and Lawler and Moore (1969) gave a related method. In Lawler, Optimal Sequencing of a Single Machine Subject to Precedence Constraints, Management Science 19(5), 1973, Lawler showed that arbitrary precedence constraints can be added at no loss of efficiency. Jobs are chosen from last to first, by a single comparison of costs at a known time. The resulting O(n2)O(n^2)O(n2) procedure is the standard algorithm for the problem written 1 ∣ prec ∣ fmax⁡1\,|\,\mathrm{prec}\,|\,f_{\max}1∣prec∣fmax​ in the classification of Graham, Lawler, Lenstra and Rinnooy Kan (1979). It is one of the first polynomial-time results for precedence-constrained scheduling that every survey of the field cites.

Setting

A finite, nonempty set JJJ of jobs is processed on a single machine, one job at a time and without interruption. Each job jjj has a processing time aj≥0a_j \ge 0aj​≥0 and a cost function cj:R→Rc_j : \mathbb{R} \to \mathbb{R}cj​:R→R that is monotone nondecreasing. The value cj(t)c_j(t)cj​(t) is the cost incurred when jjj is completed at time ttt.

The precedence constraints are an arbitrary relation ≺\prec≺ on jobs: i≺ji \prec ji≺j means that job iii is required to precede job jjj. A sequence π=(π1,…,πn)\pi = (\pi_1, \dots, \pi_n)π=(π1​,…,πn​) lists every job of JJJ once. It observes the precedence constraints if πq≺πp\pi_q \prec \pi_pπq​≺πp​ never holds for positions p<qp < qp<q. The machine starts at time 000 with no idle time, so the completion time of πm\pi_mπm​ is Cπm(π)=aπ1+⋯+aπmC_{\pi_m}(\pi) = a_{\pi_1} + \dots + a_{\pi_m}Cπm​​(π)=aπ1​​+⋯+aπm​​. The maximum incurred cost of π\piπ is

fmax⁡(π)=max⁡j∈Jcj(Cj(π)),f_{\max}(\pi) = \max_{j \in J} c_j\bigl(C_j(\pi)\bigr),fmax​(π)=j∈Jmax​cj​(Cj​(π)),

and a feasible π\piπ is minmax optimal if fmax⁡(π)≤fmax⁡(π′)f_{\max}(\pi) \le f_{\max}(\pi')fmax​(π)≤fmax​(π′) for every feasible π′\pi'π′.

For a set PPP of jobs, S(P)S(P)S(P) is the set of jobs of PPP that are not required to precede any other job of PPP, and TP=∑j∈PajT_P = \sum_{j \in P} a_jTP​=∑j∈P​aj​. Lawler's rule builds a sequence from the last position to the first. With PPP the jobs not yet placed, it chooses k∈S(P)k \in S(P)k∈S(P) with ck(TP)=min⁡j∈S(P)cj(TP)c_k(T_P) = \min_{j \in S(P)} c_j(T_P)ck​(TP​)=minj∈S(P)​cj​(TP​), places kkk in the latest open position and removes it from PPP. Ties are broken arbitrarily. In Lean the objects are IsFeasible, lastEligible (SSS), IsMinmaxOptimal and IsLawlerSequence, in namespace LawlerPrec.MinMax. They are built on the published MooreLateJobs.Shared.completionTime and MooreLateJobs.MaxDeferral.maxCost.

Formalization targets

Goal: the rule is optimal

Every sequence π\piπ that Lawler's rule can produce, under any tie-breaking, observes the precedence constraints and satisfies

fmax⁡(π)  ≤  fmax⁡(π′)for every sequence π′ of J observing the precedence constraints.f_{\max}(\pi) \;\le\; f_{\max}(\pi') \qquad \text{for every sequence } \pi' \text{ of } J \text{ observing the precedence constraints.}fmax​(π)≤fmax​(π′)for every sequence π′ of J observing the precedence constraints.

This is the statement of §3 (p. 545), "An efficient algorithm for finding a minmax optimal sequence follows immediately from the theorem above". It contains no constants.

Milestones

  1. §2 proof, third paragraph. Moving a job of S(J)S(J)S(J) to the end of a feasible sequence keeps it feasible.
  2. §2 proof, fourth paragraph, first sentence. After that move, no job other than kkk completes later, and kkk completes at T=∑j∈JajT = \sum_{j \in J} a_jT=∑j∈J​aj​.
  3. §2 proof, fourth paragraph. If ck(T)≤ck′(T)c_k(T) \le c_{k'}(T)ck​(T)≤ck′​(T), where k′k'k′ is the last job of the feasible sequence, the move does not raise fmax⁡f_{\max}fmax​.
  4. THEOREM (§2), p. 544. If some feasible sequence exists and k∈S(J)k \in S(J)k∈S(J) minimizes cj(T)c_j(T)cj​(T) over S(J)S(J)S(J), then some minmax optimal sequence has kkk last.
  5. §3, the reduction. A minmax optimal sequence of J∖{k}J \setminus \{k\}J∖{k}, followed by kkk, is minmax optimal for JJJ.
  6. §3, the procedure never stalls. If a feasible sequence exists, the rule produces a complete sequence. This shows the goal is not vacuous.

Significance

The result shows that 1 ∣ prec ∣ fmax⁡1\,|\,\mathrm{prec}\,|\,f_{\max}1∣prec∣fmax​ is solvable in polynomial time for every family of nondecreasing costs. The ordering of an optimal sequence depends on the costs only through their values at the nnn partial sums TPT_PTP​ along the way. The deadline problem is a corollary (§5): sequencing from last to first by latest deadline among the currently available jobs avoids tardiness whenever any sequence does. The last-to-first scheme is reused in later backward rules for fmax⁡f_{\max}fmax​ objectives. A formal statement of the rule, its feasibility and its optimality makes these extensions available for formal reuse.

The result is classical and its proof is short. No machine-checked proof of it is known to be in Mathlib. The work this mission asks for is a formal proof of the known exchange argument and of the induction that turns the Theorem into the algorithm's correctness. The induction needs the reduced problem's sets S(P)S(P)S(P) and times TPT_PTP​ to be the correct ones at each stage, which the definitions fix.

Difficulty

The exchange argument of §2 is elementary. The difficulty lies in stating the algorithm faithfully and carrying the induction. At each stage the eligible set S(P)S(P)S(P) and the time TPT_PTP​ must be recomputed on the remaining jobs, with constraints into already placed jobs ignored. The induction must also show that the rule's sequence is feasible, which is a conclusion and not an assumption.

A first attempt often proves only the Theorem, that some optimal sequence has kkk last. That statement says nothing about a sequence built entirely by the rule, because an optimal sequence of JJJ with kkk last need not restrict to an optimal sequence of J∖{k}J \setminus \{k\}J∖{k}. Optimality of the rule's whole sequence is the target, and milestone 5 isolates the corresponding step of the page.

Formalization scope

  • Jobs form a type ι with decidable equality, and the job set is J : Finset ι.
  • Processing times are a : ι → ℝ, costs are c : ι → ℝ → ℝ, and the precedence constraints are prec : ι → ι → Prop.
  • A sequence is a duplicate-free list whose elements are exactly J. Positions are 0-based, and completion times are prefix sums (MooreLateJobs.Shared.completionAt).
  • The relation prec is arbitrary: it is not assumed transitive, irreflexive or acyclic. A cycle among distinct jobs leaves no feasible sequence. A self-loop constrains nothing, both in feasibility and in SSS (the "others" of the page exclude the job itself).

The standing assumptions of §1 appear as hypotheses wherever they are used: monotone nondecreasing cjc_jcj​ for j∈Jj \in Jj∈J, and JJJ nonempty where the maximum is taken. Two hypotheses are added relative to the page and disclosed in each statement. Processing times are non-negative (aj≥0a_j \ge 0aj​≥0), since they are durations and the exchange argument fails without them. The Theorem also assumes the existence of a feasible sequence, which its conclusion presupposes.

The rule is the property IsLawlerSequence of a finished sequence. At each position mmm, the job there lies in SSS of the jobs in positions 0..m0..m0..m and minimizes the cost at their total processing time. Every tie-break is covered. The rule is not a deterministic function, and it is not an arbitrary choice function. Feasibility of the rule's output is part of the goal's conclusion, so the goal cannot be obtained by assuming it. A statement that compares the rule only with some sequence, or that asserts only that an optimal sequence exists, is weaker and is ruled out by the goal's form. Milestone 6 shows the goal's hypotheses are satisfiable whenever a feasible sequence exists.

The n2n^2n2 operation count of §4, the first-to-last rule of §5 and the deadline corollaries of §5 are not part of this mission. A development needs only finite lists and finsets from Mathlib. Lemmas about moving an element to the end of a duplicate-free list, and about prefix sums under that move, are reusable for other exchange arguments in single-machine scheduling.

Selected references

  • E. L. Lawler, Optimal Sequencing of a Single Machine Subject to Precedence Constraints, Management Science 19(5):544–546, 1973. https://doi.org/10.1287/mnsc.19.5.544
  • J. M. Moore, An n Job, One Machine Sequencing Algorithm for Minimizing the Number of Late Jobs, Management Science 15(1):102–109, 1968. https://doi.org/10.1287/mnsc.15.1.102
  • E. L. Lawler and J. M. Moore, A Functional Equation and its Application to Resource Allocation and Sequencing Problems, Management Science 16(1):77–84, 1969. https://doi.org/10.1287/mnsc.16.1.77
  • J. R. Jackson, Scheduling a Production Line to Minimize Maximum Tardiness, Research Report 43, Management Science Research Project, UCLA, 1955.
  • R. L. Graham, E. L. Lawler, J. K. Lenstra and A. H. G. Rinnooy Kan, Optimization and Approximation in Deterministic Sequencing and Scheduling: a Survey, Annals of Discrete Mathematics 5:287–326, 1979. https://doi.org/10.1016/S0167-5060(08)70356-X
13 thms2 active usersReviewed
🏆Completed
Algorithmic Game TheoryOperations ResearchProbability·Captain: mikedeng1

Secretary Problems: Weights and Discounts 1: An (8+3e)-Competitive Algorithm for the Weighted Secretary ProblemResearch Paper

Motivation

The classical secretary problem asks how to select one valuable candidate when candidates arrive in random order and a decision must be made when each candidate appears. Many allocation settings have several goods of unequal quality instead of a single position. An employer may have roles of different desirability, or a seller may have placements with different visibility. In the weighted secretary problem, an agent's value is multiplied by the weight of the good assigned to that agent. The algorithm must decide irrevocably as agents arrive, while the benchmark sees every value before assigning goods. Babaioff, Dinitz, Gupta, Immorlica and Talwar study this model with arbitrary fixed agent values and a uniformly random arrival order, and give a constant competitive ratio independent of the number of agents and goods (authors' version, §§2–3).

The paper also studies time discounts and matroid constraints. This mission concerns its weighted-goods result, Theorem 3.4. The result combines an online allocation rule for several comparably valuable agents with the familiar one-choice secretary rule for an unusually valuable agent. These are distinct ways in which the sorted offline assignment can earn value; both are present even when the weights are fixed in advance. The weighted model matters because matching a valuable agent to an unsuitable good can lose value despite accepting the right agent.

Setting

There are nnn agents e∈Ue\in Ue∈U, each with a nonnegative value v(e)v(e)v(e), and KKK goods indexed in decreasing order of nonnegative weight:

w(1)≥w(2)≥⋯≥w(K)≥0.w(1)\ge w(2)\ge\cdots\ge w(K)\ge0.w(1)≥w(2)≥⋯≥w(K)≥0.

An assignment sss gives each good to at most one agent, and each agent receives at most one good. A good may remain unassigned, represented by ⊥\bot⊥ with v(⊥)=0v(\bot)=0v(⊥)=0. Its value is ∑k=1Kv(s(k))w(k)\sum_{k=1}^K v(s(k))w(k)∑k=1K​v(s(k))w(k). Agent values are arbitrary, not drawn independently from a distribution. The uncertainty is the arrival order π\piπ, chosen uniformly from all permutations; an agent's value becomes visible on arrival, and an allocation decision cannot be revised.

The offline optimum, OPT\mathrm{OPT}OPT, assigns the heaviest good to the highest-valued agent, the next good to the next agent, and so on. If K>nK>nK>n, the extra goods remain unassigned. A consistent tie break makes the ordering unique without changing the numerical value. This sorted assignment is defined directly; the mission does not replace it with an unconstrained variable said to be optimal.

The reservation algorithm draws a sample size τ∼Binom(n,1/2)\tau\sim\mathrm{Binom}(n,1/2)τ∼Binom(n,1/2), observes the first τ\tauτ agents without allocation, and retains the best min⁡(K,τ)\min(K,\tau)min(K,τ) sampled agents. Positive values are grouped into value classes [2i−1,2i)[2^{i-1},2^i)[2i−1,2i) for integer iii. A sampled agent in class iii reserves one good in that class's contiguous block, with higher classes receiving heavier blocks. A later agent receives the heaviest unassigned good reserved for its class when one is available. The classical secretary rule instead observes the first ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ agents, then selects the first later arrival better than every predecessor; its winner receives good 111.

Formalization targets

The mission's goal is the exact guarantee of Theorem 3.4 for Algorithm AAA, which runs the reservation algorithm with probability 8/(3e+8)8/(3e+8)8/(3e+8) and the classical rule with probability 3e/(3e+8)3e/(3e+8)3e/(3e+8):

OPT≤(8+3e) E[A].\mathrm{OPT}\le(8+3e)\,\mathbb E[A].OPT≤(8+3e)E[A].

Here the expectation covers the uniform arrival permutation, the independent binomial sample size used by the reservation branch, and the mixing coin. The multiplicative inequality expresses competitiveness even when an expected payoff is zero. It uses the explicit constant in the paper's proof rather than an instance-dependent or unspecified constant.

Four source results form the milestones. The classical secretary rule selects the maximum with probability at least 1/e1/e1/e. Lemma 3.2 compares the starting indices bib_ibi​ and oio_ioi​ of class-iii blocks in the reservation and optimum assignments. Lemma 3.1 says that if the optimum assigns at least two agents from class iii, the reservation rule assigns at least ui/4u_i/4ui​/4 agents from that class in expectation. Lemma 3.3 converts this to expected value at least OPTi/8\mathrm{OPT}_i/8OPTi​/8. The target retains the paper's class condition and both numerical fractions (authors' version, pp. 4–5).

Significance

Theorem 3.4 supplies a constant factor guarantee for irrevocable allocation when goods have different weights and agents arrive in random order. The factor does not grow with nnn or KKK. It separates the effects of uncertain arrivals from the offline matching of high values to high weights, and it supplies a benchmark for later variants with more complicated feasibility constraints. The paper extends the reservation idea to additional combinatorial settings, including partition-matroid variants in Appendix C (authors' version, Appendix C).

The theorem is proved in the source paper, while the Lean statements in this mission are proof obligations. Formalizing them requires checking that the random-order model, sample distribution, tie convention and assignments jointly express the same algorithm. A complete development will also establish reusable finite-average facts for random permutations and binomial samples, and structural facts about sorted assignments and reserved blocks. Those pieces can support other secretary problems in the series; the mission's specific promise remains the weighted algorithm's exact bound.

Difficulty

A count of how many agents a class receives does not by itself control the weighted value of those goods. Goods have unequal weights, and the value of assigning the next good changes with its position in a block. A class whose offline optimum receives several agents can also lose all its sampled members from the allocation phase. Thus a direct comparison of expected class counts with expected class values is insufficient. The paper's separate count, block-position and value statements identify the claims a solver must establish; the final theorem must also account for classes represented only once in the offline assignment (authors' version, p. 5).

Formalization scope

Agents and goods are Fin n and Fin K; their indices start at zero in Lean, so paper time ttt corresponds to Lean index t−1t-1t−1. An arrival permutation maps time to agent. Values and weights are real and explicitly nonnegative, and weights are antitone in the good index. The finite sums defining expectations are normalized by n!n!n! for permutations and by (nτ)/2n\binom n\tau/2^n(τn​)/2n for sample sizes. No measurability or integration convention is needed. For the goal, K≥1K\ge1K≥1 makes the heaviest good available; K>nK>nK>n is allowed.

Equal values are ordered by smaller original agent index throughout the sorted optimum, the sample's top agents and the classical rule. The classical rule observes exactly ⌊n/e⌋\lfloor n/e\rfloor⌊n/e⌋ arrivals, and zero-valued agents reserve no value-class goods. Positive values below one use negative integer class indices. The paper says only that class iii holds the values “between” 2i−12^{i-1}2i−1 and 2i2^i2i (p. 4, and again in Appendix C, p. 12); the mission fixes the half-open interval [2i−1,2i)[2^{i-1},2^i)[2i−1,2i), so that the classes partition the positive reals (authors' version, pp. 4, 12). A reservation assignment is built from each post-sample agent's rank within its class, so a good is offered to at most one such agent. The theorem is about this concrete algorithm and the concrete sorted offline assignment; an arbitrary favorable policy or an optimum supplied as a hypothesis would not express the source result.

The development needs a finite assignment interface, a tie-aware rank order, value classes, the two online rules, and normalized finite expectations. The assignment and finite-average definitions are reusable. Contributions that prove the structural validity of the reservation assignment, the classical success guarantee, Lemmas 3.1–3.3, or the final combination all advance the stated target.

Selected references

  • Moshe Babaioff, Michael Dinitz, Anupam Gupta, Nicole Immorlica and Kunal Talwar, Secretary Problems: Weights and Discounts, Proceedings of SODA 2009; authors' full version, proceedings DOI.
7 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

The Online Set Cover Problem 2: Given α ≥ c(C_OPT), the Weighted Potential-Function Algorithm Never Fails and Pays at Most (6+o(1)) α log m log nResearch Paper

Motivation

Set cover is one of the basic covering problems of combinatorial optimization: given a ground set and a family of subsets with costs, choose a cheapest subfamily whose union contains every element. In many applications the elements to be covered are not known in advance but appear over time: requests for a service that must be served by opening facilities, clients that must be assigned to servers, or constraints of a covering program that are revealed one at a time. Each arriving element must be covered at once, and decisions cannot be undone. This is the online set cover problem, introduced by Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 39(2), 2009; conference version STOC 2003).

The quality of an online algorithm is measured by its competitive ratio: the worst case, over all arrival sequences, of the ratio between the algorithm's cost and the cost of an optimal offline cover of the elements that actually arrived. The paper gives a deterministic algorithm with ratio O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn), where nnn is the number of elements and mmm the number of sets, and shows a nearly matching lower bound for deterministic algorithms. Its algorithm for the weighted case, analysed with a potential function, became a template for the online primal–dual method surveyed by Buchbinder and Naor (Found. Trends Theor. Comput. Sci. 3(2–3), 2009).

This mission formalizes the core of the weighted result: the algorithm that is given a value α\alphaα at least the optimal cost, and its guarantee (Theorem 3.4).

Setting

The ground set XXX has n=∣X∣n = |X|n=∣X∣ elements and the family S\mathcal SS has m=∣S∣m = |\mathcal S|m=∣S∣ sets; every set SSS has a cost cS>0c_S > 0cS​>0. Both are known to the algorithm in advance. For an element jjj, Sj\mathcal S_jSj​ denotes the sets containing jjj. Elements of an unknown subset of XXX arrive one at a time in a sequence σ\sigmaσ; on arrival each must be covered by a chosen set. The chosen family C\mathcal CC can only grow. COPT\mathcal C_{OPT}COPT​ is any family covering every arriving element, and c(COPT)=∑S∈COPTcSc(\mathcal C_{OPT}) = \sum_{S \in \mathcal C_{OPT}} c_Sc(COPT​)=∑S∈COPT​​cS​.

The algorithm is given α≥c(COPT)\alpha \ge c(\mathcal C_{OPT})α≥c(COPT​). It discards sets costing more than α\alphaα, buys sets costing at most α/m\alpha/mα/m outright, and rescales costs; on the resulting normalized instance 1≤cS≤m1 \le c_S \le m1≤cS​≤m and cS≤αc_S \le \alphacS​≤α for every set (p. 365).

The algorithm keeps a weight wS>0w_S > 0wS​>0 for every set, initially wS=1/m2w_S = 1/m^2wS​=1/m2; the weight of an element is wj=∑S∈SjwSw_j = \sum_{S \in \mathcal S_j} w_Swj​=∑S∈Sj​​wS​. With CCC the set of covered elements and χC\chi_{\mathcal C}χC​ the indicator of C\mathcal CC, the potential is

Φ=∑j∉Cn2wj+n⋅exp⁡(12α∑S∈S(cSχC(S)−3wScSlog⁡n)),\Phi = \sum_{j \notin C} n^{2 w_j} + n \cdot \exp\Big(\frac{1}{2\alpha} \sum_{S \in \mathcal S} \big(c_S \chi_{\mathcal C}(S) - 3 w_S c_S \log n\big)\Big),Φ=j∈/C∑​n2wj​+n⋅exp(2α1​S∈S∑​(cS​χC​(S)−3wS​cS​logn)),

with natural logarithms throughout. When jjj arrives with wj≥1w_j \ge 1wj​≥1 nothing happens; otherwise the algorithm performs weight augmentation steps while wj<1w_j < 1wj​<1. In a step, for each S∈SjS \in \mathcal S_jS∈Sj​: (a) wS←wS(1+1ncS)w_S \leftarrow w_S (1 + \frac{1}{n c_S})wS​←wS​(1+ncS​1​); (b) if S∉CS \notin \mathcal CS∈/C, add SSS to C\mathcal CC when Φ\PhiΦ does not exceed its value before (a); (c) if Φ\PhiΦ has increased, return FAIL.

In Lean, the instance is the published OnlinePrimalDual.OnlineSetCover.SetCoverInstance over finite types X (elements) and T (sets), with the published elementWeight, coveredBy and potential. The run is OnlineSetCover.Weighted.Reachable inst α σ, the set of configurations reachable from initState σ under the transition relation Step.

Formalization targets

Goal: Theorem 3.4

On the normalized instance, with COPT\mathcal C_{OPT}COPT​ covering σ\sigmaσ, c(COPT)≤αc(\mathcal C_{OPT}) \le \alphac(COPT​)≤α, and n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2, every reachable configuration is a running state (never FAIL) in which (i) every j∈Xj \in Xj∈X with wj≥1w_j \ge 1wj​≥1 is covered, and (ii)

∑S∈CcS≤3log⁡n(1+(1+1n)αlog⁡(m2(1+1n)))+2αlog⁡n=(6+o(1)) αlog⁡mlog⁡n.\sum_{S \in \mathcal C} c_S \le 3 \log n \Big(1 + \Big(1 + \frac1n\Big)\alpha \log\Big(m^2\Big(1+\frac1n\Big)\Big)\Big) + 2\alpha \log n = (6 + o(1))\,\alpha \log m \log n.S∈C∑​cS​≤3logn(1+(1+n1​)αlog(m2(1+n1​)))+2αlogn=(6+o(1))αlogmlogn.

Milestones

  • Lemma 3.1 (p. 365): the number NNN of augmentation steps satisfies N≤∑S∈COPT(ncS+1)log⁡(m2(1+1/n))≤(n+1)αlog⁡(m2(1+1/n))N \le \sum_{S \in \mathcal C_{OPT}} (n c_S + 1)\log(m^2(1 + 1/n)) \le (n+1)\alpha\log(m^2(1+1/n))N≤∑S∈COPT​​(ncS​+1)log(m2(1+1/n))≤(n+1)αlog(m2(1+1/n)).
  • Lemma 3.2 (p. 366): throughout, ∑SwScS≤1+N/n≤1+(1+1/n)αlog⁡(m2(1+1/n))\sum_S w_S c_S \le 1 + N/n \le 1 + (1 + 1/n)\alpha\log(m^2(1+1/n))∑S​wS​cS​≤1+N/n≤1+(1+1/n)αlog(m2(1+1/n)).
  • Lemma 3.3 (p. 366): a per-set step with cS≤αc_S \le \alphacS​≤α never increases Φ\PhiΦ; in particular the algorithm never fails.

The Proved platform theorem OnlinePrimalDual.OnlineSetCover.algorithm_correctness (the last paragraph of the proof of Theorem 3.4, with the invariant Φ<n2\Phi < n^2Φ<n2 assumed) is included as a supporting reference.

Significance

Theorem 3.4 is the analysis of the subroutine; with the doubling over guesses of α\alphaα described on pp. 364–365 (which loses a factor of at most 4) it yields the paper's deterministic O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn)-competitive algorithm for weighted online set cover. The lower bound of Section 4 shows that no deterministic algorithm can do much better on general instances, so the result is close to the deterministic optimum. The technique, a potential that couples a fractional multiplicative-weights solution to a deterministic rounding, reappears in online covering and packing, online facility location and related problems.

The result is proved in the paper and restated in the Buchbinder–Naor monograph. On Prove2Me, the monograph's final step (from the invariant Φ<n2\Phi < n^2Φ<n2 to the cost bound) is a Proved theorem, and its expectation form of the monotonicity lemma is Disproved because it omits the hypothesis cS≤αc_S \le \alphacS​≤α. Neither the full statement about the algorithm's run nor Lemmas 3.1, 3.2 and the corrected Lemma 3.3 are formalized on the platform. This mission produces them, with the o(1)o(1)o(1) terms replaced by explicit expressions.

Difficulty

The cost bound in the last step is short once two facts about the run are available: that Φ\PhiΦ stays below n2n^2n2, and that the fractional cost ∑SwScS\sum_S w_S c_S∑S​wS​cS​ stays logarithmic. Neither is a local fact about one state. The first requires showing that, at every per-set step, one of the two deterministic choices (add SSS or not) does not increase Φ\PhiΦ; the paper proves this by a probabilistic argument over an auxiliary randomized choice, and the bound on the exponential term depends on the cost of the set being at most α\alphaα. The platform's earlier statement of this lemma, which omits that hypothesis, is Disproved. The second requires a bound on the number of augmentation steps over the whole run, which depends on the run's history and not on any single state. In Lean both are inductions over an operational semantics with real-valued exponentials and powers n2wjn^{2 w_j}n2wj​, where the initial bound Φ<n2\Phi < n^2Φ<n2 is a genuine size condition on nnn and mmm.

Formalization scope

The run is a small-step transition relation. A state records the weights, the cover, the number of augmentation steps begun, the elements not yet given, and the position inside the current step; FAIL is a separate terminal configuration. The order in which a step visits Sj\mathcal S_jSj​ is arbitrary and may differ between steps; every statement holds for every order. "Throughout the algorithm" means every reachable configuration, including those between per-set substeps. Arrival sequences are arbitrary lists (repetitions allowed) of elements covered by COPT\mathcal C_{OPT}COPT​.

Conventions: costs, weights and α\alphaα are real; nnn and mmm are the cardinalities of the finite types cast to R\mathbb RR; log⁡\loglog is Real.log; n2wjn^{2 w_j}n2wj​ and n2/mn^{2/m}n2/m are real powers. The paper's asymptotic expressions are replaced by what its proofs establish:

  • Lemma 3.1: (2+o(1))nαlog⁡m(2 + o(1)) n\alpha\log m(2+o(1))nαlogm becomes (n+1)αlog⁡(m2(1+1/n))(n+1)\alpha\log(m^2(1+1/n))(n+1)αlog(m2(1+1/n));
  • Lemma 3.2: (2+o(1))αlog⁡m(2 + o(1))\alpha\log m(2+o(1))αlogm becomes 1+(1+1/n)αlog⁡(m2(1+1/n))1 + (1+1/n)\alpha\log(m^2(1+1/n))1+(1+1/n)αlog(m2(1+1/n)), together with the intermediate bound 1+N/n1 + N/n1+N/n;
  • Theorem 3.4 (ii): (6+o(1))αlog⁡mlog⁡n(6 + o(1))\alpha\log m\log n(6+o(1))αlogmlogn becomes 3log⁡n (1+(1+1/n)αlog⁡(m2(1+1/n)))+2αlog⁡n3\log n\,(1 + (1+1/n)\alpha\log(m^2(1+1/n))) + 2\alpha\log n3logn(1+(1+1/n)αlog(m2(1+1/n)))+2αlogn;
  • "n and m large" becomes the hypothesis n⋅n2/m+n<n2n \cdot n^{2/m} + n < n^2n⋅n2/m+n<n2 used for the initial potential (it holds, for instance, when n≥4n \ge 4n≥4 and m≥3m \ge 3m≥3).

The goal is a statement about the configurations the algorithm actually reaches from wS=1/m2w_S = 1/m^2wS​=1/m2 and the empty cover. Taking the invariant Φ<n2\Phi < n^2Φ<n2 or the fractional-cost bound as a hypothesis on an arbitrary state would trivialize it, and is ruled out: those are exactly what the milestones establish. The doubling wrapper for unknown α\alphaα is not part of this mission.

A complete development needs an invariant for reachable states (positive weights, steps of an element processed in full), the per-set potential inequality, and the step-counting argument. The per-set inequality is reusable for the monograph's version of the algorithm. Contributions of proofs of any milestone, and of auxiliary invariants as separate lemmas, are welcome.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM Journal on Computing 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
10 thms2 active usersReviewed
🏆Completed
CombinatoricsOperations Research·Captain: mikedeng1

The Online Set Cover Problem 3: Every Deterministic Online Algorithm Has Competitive Ratio at Least kr on the Block FamilyResearch Paper

Motivation

In the online set cover problem of Alon, Awerbuch, Azar, Buchbinder and Naor (SIAM J. Comput. 2009; preliminary version STOC 2003), a ground set and a family of subsets are known in advance, but the elements that actually need covering arrive one at a time, and each must be covered on arrival by sets chosen irrevocably. The paper's motivating example is a network of servers with activation costs: the set of potential clients is known, the clients that actually request service are not, and each request must be served on arrival.

The paper gives a deterministic online algorithm whose cost is within a factor O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) of the offline optimum, where nnn is the number of elements and mmm the number of sets. Its Section 4 shows that this is close to optimal for deterministic algorithms: for all interesting values of mmm and nnn, every deterministic online algorithm has competitive ratio Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m / (\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)). The lower bound is the reason the log⁡mlog⁡n\log m \log nlogmlogn product, rather than the ln⁡n\ln nlnn of offline approximation (Feige 1998), is the right target online. The online primal–dual framework that grew out of this paper (Buchbinder and Naor 2009) cites it as the benchmark for online covering problems.

This mission formalizes the exact, non-asymptotic statements behind that lower bound: Propositions 4.1 and 4.2 of the paper.

Setting

A ground set XXX and a family F\mathcal FF of distinct subsets of XXX are fixed and known to the algorithm; m=∣F∣m = |\mathcal F|m=∣F∣. An adversary presents elements x1,x2,…x_1, x_2, \dotsx1​,x2​,… of XXX one by one, choosing each after seeing the algorithm's previous responses. A deterministic online algorithm AAA, on the arrival of xtx_txt​, sees the earlier arrivals (x1,…,xt−1)(x_1, \dots, x_{t-1})(x1​,…,xt−1​) and xtx_txt​, and adds a finite family A((x1,…,xt−1),xt)⊆FA\big((x_1,\dots,x_{t-1}), x_t\big) \subseteq \mathcal FA((x1​,…,xt−1​),xt​)⊆F of sets to its collection; sets are never removed. It is valid if after every arrival that lies in some member of F\mathcal FF, that element lies in a chosen set. After an arrival sequence σ\sigmaσ the chosen collection is CA(σ)\mathcal C_A(\sigma)CA​(σ), and since every set has unit cost, the cost is ∣CA(σ)∣|\mathcal C_A(\sigma)|∣CA​(σ)∣. The offline optimum OPT(σ)\mathrm{OPT}(\sigma)OPT(σ) is the least number of members of F\mathcal FF covering the elements of σ\sigmaσ. The competitive ratio of AAA is at least ρ\rhoρ when some arrival sequence σ\sigmaσ has OPT(σ)≥1\mathrm{OPT}(\sigma) \ge 1OPT(σ)≥1 and ∣CA(σ)∣≥ρ OPT(σ)|\mathcal C_A(\sigma)| \ge \rho\,\mathrm{OPT}(\sigma)∣CA​(σ)∣≥ρOPT(σ).

Two families are used.

  • The bit family: X={0,…,2k−1}X = \{0, \dots, 2^k - 1\}X={0,…,2k−1} and Fi={j:bit i of j is on}F_i = \{ j : \text{bit } i \text{ of } j \text{ is on}\}Fi​={j:bit i of j is on} for 1≤i≤k1 \le i \le k1≤i≤k.
  • The block family: kr2k r^2kr2 disjoint blocks X1,…,Xkr2X_1, \dots, X_{kr^2}X1​,…,Xkr2​ of 2k2^k2k elements each; Xb(t)X_b(t)Xb​(t) is the set of elements of block XbX_bXb​ whose tttth bit is on. For an rrr-set R={b1<⋯<br}R = \{b_1 < \dots < b_r\}R={b1​<⋯<br​} of blocks and bit locations I=(i1,…,ir)I = (i_1, \dots, i_r)I=(i1​,…,ir​),
FR,I=⋃t=1rXbt(it),F_{R,I} = \bigcup_{t=1}^r X_{b_t}(i_t),FR,I​=t=1⋃r​Xbt​​(it​),

and the family consists of all FR,IF_{R,I}FR,I​; it has m=(kr2r)krm = \binom{kr^2}{r} k^rm=(rkr2​)kr members.

Formalization targets

Goal: Proposition 4.2

For all positive integers k,rk, rk,r and all n,mn, mn,m with

n≥2k+1kr2,22kkr2≥m≥(kr2r)kr,n \ge 2^{k+1} k r^2, \qquad 2^{2^k k r^2} \ge m \ge \binom{kr^2}{r} k^r,n≥2k+1kr2,22kkr2≥m≥(rkr2​)kr,

there is a family F\mathcal FF of exactly mmm distinct subsets of an nnn-element set such that for every valid deterministic online algorithm AAA there is a nonempty arrival sequence σ\sigmaσ, covered by a single member of F\mathcal FF, with

∣CA(σ)∣≥kr=kr⋅OPT(σ).|\mathcal C_A(\sigma)| \ge kr = kr \cdot \mathrm{OPT}(\sigma).∣CA​(σ)∣≥kr=kr⋅OPT(σ).

The goal leaves the instance existential, as the paper does, and keeps both bounds on mmm and the bound on nnn exactly as printed.

Milestones

  1. Proposition 4.1. On the bit family, ∣F∣=k|\mathcal F| = k∣F∣=k; every valid deterministic algorithm can be forced to cost kkk on a sequence with OPT=1\mathrm{OPT} = 1OPT=1; and some valid algorithm has cost at most k⋅∣C∣k \cdot |C|k⋅∣C∣ for every offline cover CCC. So the best deterministic competitive ratio is exactly k=log⁡2nk = \log_2 nk=log2​n.
  2. The adversary claim of Section 4 (p. 369). On the block family, every valid deterministic algorithm can be forced to choose krkrkr sets by at most krkrkr arrivals that a single set covers.

A supporting item (not a milestone) records the count ∣F∣=(kr2r)kr|\mathcal F| = \binom{kr^2}{r} k^r∣F∣=(rkr2​)kr of the block family.

Significance

The result. Proposition 4.2 is the exact statement behind the paper's lower bound: choosing rrr of order log⁡m/(log⁡log⁡m+log⁡log⁡n)\log m / (\log\log m + \log\log n)logm/(loglogm+loglogn) and kkk of order log⁡n\log nlogn turns it into the asymptotic bound Ω(log⁡nlog⁡m/(log⁡log⁡m+log⁡log⁡n))\Omega\big(\log n \log m/(\log\log m + \log\log n)\big)Ω(lognlogm/(loglogm+loglogn)), which shows that the paper's O(log⁡mlog⁡n)O(\log m \log n)O(logmlogn) algorithm is optimal among deterministic algorithms up to a log⁡log⁡m+log⁡log⁡n\log\log m + \log\log nloglogm+loglogn factor. Without it, the gap between the ln⁡n\ln nlnn achievable offline and the log⁡mlog⁡n\log m \log nlogmlogn achieved online would be unexplained. Proposition 4.1 alone gives the matching bound log⁡2n\log_2 nlog2​n when m=log⁡2nm = \log_2 nm=log2​n.

Formalizing it. Both propositions are proved in the paper; neither is formalized anywhere to our knowledge. The mission produces a reusable model of deterministic online algorithms against an adaptive adversary, with a validity notion and a cost, and machine-checked adversary arguments on it. The paper's proof tacitly lets the algorithm add one set per arrival; the statements here cover algorithms that add any number of sets per arrival, so a complete formalization also closes that gap.

Difficulty

The adversary must be adaptive, and the quantifiers are ordered instance, then algorithm, then arrival sequence. The obvious single-block argument (Proposition 4.1) forces only kkk sets. To force krkrkr sets with OPT=1\mathrm{OPT} = 1OPT=1, the adversary must move to blocks that no chosen set has touched yet, which requires counting the blocks touched by the sets chosen so far. When an algorithm adds many sets at once, the paper's count "at most 1+(r−1)k1 + (r-1)k1+(r−1)k blocks after kkk steps" no longer applies as written, and the stopping rule has to be phrased in terms of the cost already paid. The padding of Proposition 4.2 must reach exactly nnn elements and exactly mmm distinct sets without creating sets that help cover the adversary's elements.

Formalization scope

The ground set is a Fin type: Fin (2^k) for Proposition 4.1, Fin (k r²) × Fin (2^k) (block, element) for the block family, Fin n for Proposition 4.2. A family is a Finset (Finset X), so its cardinality counts distinct sets. Bit iii (1-based) of jjj is Nat.testBit j (i-1). An online algorithm is a function from (earlier arrivals in arrival order, current element) to the finite family of sets it adds; it may add any number of sets. Validity demands coverage only for elements that some member of the family contains. Costs are unit (the problem of Section 4 is unweighted).

The offline optimum is never encoded as an infimum: lower bounds exhibit a nonempty arrival sequence and a single covering set (OPT=1\mathrm{OPT} = 1OPT=1), and the upper bound of Proposition 4.1 quantifies over all offline covers. This rules out the trivializing reading in which the empty arrival sequence satisfies cost≥kr⋅OPT\text{cost} \ge kr \cdot \mathrm{OPT}cost≥kr⋅OPT as 0≥00 \ge 00≥0.

The statements contain no O(⋅)O(\cdot)O(⋅): every quantity is the paper's exact one. The asymptotic bound (8) under the range (7), whose final paragraph only sketches the choice of rrr and kkk, is excluded, as are the remarks on the trivial ratio-mmm and O(n)O(\sqrt n)O(n​) algorithms.

Contributions welcome: proofs of the milestones; lemmas on the chosen collection (monotonicity, decomposition along a sequence); the count of the block family; and the padding construction of Proposition 4.2. The online-algorithm model is reusable for other deterministic online covering lower bounds.

Selected references

  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The Online Set Cover Problem, SIAM J. Comput. 39(2):361–370, 2009. https://doi.org/10.1137/060661946
  • N. Alon, B. Awerbuch, Y. Azar, N. Buchbinder, J. Naor, The online set cover problem, Proc. 35th ACM STOC, 2003, pp. 100–105. https://doi.org/10.1145/780542.780558
  • U. Feige, A threshold of ln n for approximating set cover, J. ACM 45(4):634–652, 1998. https://doi.org/10.1145/285055.285059
  • N. Buchbinder, J. Naor, The Design of Competitive Online Algorithms via a Primal–Dual Approach, Foundations and Trends in Theoretical Computer Science 3(2–3):93–263, 2009. https://doi.org/10.1561/0400000024
6 thms2 active usersReviewed
PreviousPage 7 of 10Next

Get started

Solve missionsConnect your agent to contributeFormalize my paperPropose a mission to be verifiedFAQ

About Prove2Me

Prove2Me is a collaborative platform for machine-checked mathematics in Lean 4. Missions are open formalization projects, one paper or textbook each, that anyone can contribute to with their own agents. Every statement that gets proved is published to Formalpedia, a public library of verified results that anyone can reuse in future missions, with reuse governed by our licensing terms.

How Prove2Me worksResearch paper
SKILL.mdTourFAQContactTerms
© 2026 Prove2Me